-- Logs begin at Mon 2022-05-02 09:16:05 UTC, end at Mon 2022-05-02 11:53:38 UTC. -- May 02 09:56:25.315790 ncdv-master-1 systemd[1]: Starting Devstack devstack@keystone.service... May 02 09:56:25.325007 ncdv-master-1 devstack@keystone.service[91107]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 02 09:56:25.327018 ncdv-master-1 devstack@keystone.service[91107]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 2 09:56:25 2022] *** May 02 09:56:25.327018 ncdv-master-1 devstack@keystone.service[91107]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 02 09:56:25.327018 ncdv-master-1 devstack@keystone.service[91107]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 02 09:56:25.327018 ncdv-master-1 devstack@keystone.service[91107]: nodename: ncdv-master-1 May 02 09:56:25.327018 ncdv-master-1 devstack@keystone.service[91107]: machine: x86_64 May 02 09:56:25.327018 ncdv-master-1 devstack@keystone.service[91107]: clock source: unix May 02 09:56:25.327018 ncdv-master-1 devstack@keystone.service[91107]: pcre jit disabled May 02 09:56:25.327018 ncdv-master-1 devstack@keystone.service[91107]: detected number of CPU cores: 4 May 02 09:56:25.327018 ncdv-master-1 devstack@keystone.service[91107]: current working directory: / May 02 09:56:25.327018 ncdv-master-1 devstack@keystone.service[91107]: detected binary path: /usr/bin/uwsgi-core May 02 09:56:25.327018 ncdv-master-1 devstack@keystone.service[91107]: your processes number limit is 47680 May 02 09:56:25.327018 ncdv-master-1 devstack@keystone.service[91107]: your memory page size is 4096 bytes May 02 09:56:25.327817 ncdv-master-1 devstack@keystone.service[91107]: detected max file descriptor number: 2048 May 02 09:56:25.327817 ncdv-master-1 devstack@keystone.service[91107]: lock engine: pthread robust mutexes May 02 09:56:25.327817 ncdv-master-1 devstack@keystone.service[91107]: thunder lock: enabled May 02 09:56:25.327817 ncdv-master-1 devstack@keystone.service[91107]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 02 09:56:25.327817 ncdv-master-1 devstack@keystone.service[91107]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 02 09:56:25.376219 ncdv-master-1 devstack@keystone.service[91107]: Python main interpreter initialized at 0x56511be7c9c0 May 02 09:56:25.376219 ncdv-master-1 devstack@keystone.service[91107]: python threads support enabled May 02 09:56:25.376219 ncdv-master-1 devstack@keystone.service[91107]: your server socket listen backlog is limited to 100 connections May 02 09:56:25.376219 ncdv-master-1 devstack@keystone.service[91107]: your mercy for graceful operations on workers is 90 seconds May 02 09:56:25.376533 ncdv-master-1 devstack@keystone.service[91107]: mapped 403077 bytes (393 KB) for 2 cores May 02 09:56:25.376637 ncdv-master-1 devstack@keystone.service[91107]: *** Operational MODE: preforking *** May 02 09:56:25.376896 ncdv-master-1 devstack@keystone.service[91107]: *** uWSGI is running in multiple interpreter mode *** May 02 09:56:25.376896 ncdv-master-1 devstack@keystone.service[91107]: spawned uWSGI master process (pid: 91107) May 02 09:56:25.377086 ncdv-master-1 systemd[1]: Started Devstack devstack@keystone.service. May 02 09:56:25.378611 ncdv-master-1 devstack@keystone.service[91107]: spawned uWSGI worker 1 (pid: 91118, cores: 1) May 02 09:56:25.378611 ncdv-master-1 devstack@keystone.service[91107]: spawned uWSGI worker 2 (pid: 91119, cores: 1) May 02 09:56:25.378611 ncdv-master-1 devstack@keystone.service[91107]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 02 09:56:31.245923 ncdv-master-1 devstack@keystone.service[91119]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 02 09:56:31.245923 ncdv-master-1 devstack@keystone.service[91119]: from cryptography.utils import int_from_bytes May 02 09:56:31.246714 ncdv-master-1 devstack@keystone.service[91119]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 02 09:56:31.246714 ncdv-master-1 devstack@keystone.service[91119]: from cryptography.utils import int_from_bytes May 02 09:56:31.249101 ncdv-master-1 devstack@keystone.service[91118]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 02 09:56:31.249101 ncdv-master-1 devstack@keystone.service[91118]: from cryptography.utils import int_from_bytes May 02 09:56:31.249563 ncdv-master-1 devstack@keystone.service[91118]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 02 09:56:31.249563 ncdv-master-1 devstack@keystone.service[91118]: from cryptography.utils import int_from_bytes May 02 09:56:31.295622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 02 09:56:31.295792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 02 09:56:31.295988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] command line args: [] {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 02 09:56:31.296257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 02 09:56:31.296434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ================================================================================ {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 02 09:56:31.296516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 02 09:56:31.296704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 02 09:56:31.296795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] admin_token = **** {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.296901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] command line args: [] {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 02 09:56:31.296978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] config_dir = [] {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.297122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.297209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 02 09:56:31.297286 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] config_source = [] {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.297355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ================================================================================ {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 02 09:56:31.297464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] debug = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.297579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] admin_token = **** {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.297660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.297914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] config_dir = [] {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.298033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.298114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.298183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] config_source = [] {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.298246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.298352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] debug = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.298458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.298554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.298682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.298783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.298887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] list_limit = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.298987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.299086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] log_config_append = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.299190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.299283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.299381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] log_dir = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.299485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.299604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] log_file = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.299704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] list_limit = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.299797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.299898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] log_config_append = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.300013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.300098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.300219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] log_dir = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.300293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.300413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] log_file = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.300492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.300650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.300743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.300817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.300932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.301006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.301118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.301248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.301335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.301428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.301562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.301637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.301757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.301897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.301978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.302079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.302211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.302314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.302459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.302545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.302707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.302783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.302985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.303069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.303236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.303466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.303544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.303658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] publish_errors = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.303738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.303865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.304095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.304232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.304307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.304434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] publish_errors = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.304515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.304654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.304754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.304873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.305010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] standard_threads = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.305160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.305233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.305302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.305434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.305519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.305610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.305724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] standard_threads = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.305805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] use_journal = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.305946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] use_json = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.306026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.306108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] use_stderr = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.306184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.306280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] use_syslog = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.306357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.306509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.306591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] use_journal = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.306673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] use_json = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.306747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.306844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] use_stderr = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.307004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.307107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] use_syslog = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.307239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 02 09:56:31.307350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.307493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.307595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.307762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.307866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.307999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.308126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.308246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.308328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.308484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.308560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.308753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.308847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.309003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.309078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.309244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.309328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.309475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.309559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.309722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.309805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.309957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.310034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.310196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.310345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.310444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.310526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.310682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.310814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.310926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.311013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.311174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.311249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.311410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.311491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.311643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.311728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.311894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.311970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.312147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.312221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.312387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.312471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.312650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.312739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.312884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.312960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.313112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.313195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.313340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.313415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.313575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.313650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.313822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.313904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.314052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.314133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.314285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.314365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.314516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.314593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.314761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.314842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.314992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.315072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.315224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.315301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.315467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.315547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.315698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.315775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.315935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.316047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.316169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.316253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.316397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.316473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.316644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.316724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.316878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.316953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.317107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.317181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.317339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.317417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.317570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.317647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.317799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.317873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.318032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.318116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.318261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.318338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.318496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.318572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.318730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.318816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.318960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.319035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.319193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.319274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.319429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.319512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.319660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.319735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.319894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.319976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.320128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.320217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.320367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.320485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.320581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.320694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.320846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.320939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.321078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.321155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.321307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.321383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.321534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.321619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.321782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.321861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.322015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.322091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.322244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.322393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.322469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.322548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.322700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.322778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.322947 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.323033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.323210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.323287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.323448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.323525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.323687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.323771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.323923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.324001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.324157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.324234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.324388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.324477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.324654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.324735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.324892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.324976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.325125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.325217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.325366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.325455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.325600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.325678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.325834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.325928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.326078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.326162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.326309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.326386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.326542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.326619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.326784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.326869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.327023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.327100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.327260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.327354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.327496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.327696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.327823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.327963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.328093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.328213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.328348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.328475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.328648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.328781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.328908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.329032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.329165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.329291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.329417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.329540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.329665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.329799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.329936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.330062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.330186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.330312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.330438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.330562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.330695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.330820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.330945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.331069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.331194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.331328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.331466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.331602 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.331728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.331852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.331977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] auth.external = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.332101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.332233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.332360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.332486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.332625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.332746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.332868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] auth.external = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.333025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] auth.password = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.333160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.333303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] auth.token = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.333430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.333558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.333683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.333808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.333933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] auth.password = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.334066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.334192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] auth.token = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.334317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.334442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.334569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.334694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.334827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.334962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.335087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.335212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.335337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] credential.caching = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.335462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.335597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.335723 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.335856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.335983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.336108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.336233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] credential.caching = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.336433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.336561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.336713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.336859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.336987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.337092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.337225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.337348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.337468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.337594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.337719 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.337845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.337978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.338107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.338232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.338358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.338483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.338618 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.339229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.339353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.339475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.339600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.339740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.339867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.340000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] federation.caching = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.340126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.340252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.340376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.340502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.340640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.340784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.340912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] federation.caching = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.341038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.341163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.341294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.341421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.341555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.341682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.341807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.341933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.342057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.342190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.342316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.342447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.342582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.342707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.342832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.342918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.342992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] identity.caching = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.343062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.343131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.343201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.343271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.343349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.343421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.343491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] identity.caching = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.343561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.343630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.343705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.343784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.343857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.343927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.343996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.344072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.344144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.344226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.344347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.344422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.344493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.344562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.344654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.344738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.344812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.344882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.344953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.345022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.345091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.345169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.345247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.345319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.345389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.345464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.345536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.345614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.345691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.345763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.345833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.346003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.346082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.346254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.346333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.346488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.346564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.346719 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.346865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.346981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.347059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.347215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.347293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.347493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.347583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.347686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.347816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.348001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.348130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.348249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.348380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.348557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.348657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.348866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.348948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.349120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.349197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.349367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.349446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.349598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.349675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.349833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.349910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.350061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.350140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.350295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.350378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.350528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.350605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.350768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.350846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.351011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.351093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.351231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.351319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.351468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.351544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.351711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.351788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.351941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.352026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.352170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.352247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.352420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.352496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.352696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.352816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.352934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.353024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.353165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.353241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.353400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.353485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.353631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.user = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.353713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.353869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.353947 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.354108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.354193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.354346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.354457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.355135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.user = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.355258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.355382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.355510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.355646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.355758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.355881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.355996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.356130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.356214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.356379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.356456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.356649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.356728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.356892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.356982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.357125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.357203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.357365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.357441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.357602 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.357692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.357840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.357917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.358076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.358153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.358317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.358401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.358547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.358625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.358792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.358869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.359027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.359178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.359253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.359324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.359484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.359561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.359718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.359803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.359954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.360030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.360192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.360269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.360426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.360510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.360687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.360768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.360922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.360997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.361441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.361534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.361677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.361755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.361911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.361988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.362147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.362232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.362392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.362468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.362629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.362706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.362858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.362942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.363093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.363169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.363330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] resource.caching = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.363405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.363571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.363656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.363807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.363884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.364039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.364114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.364280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] resource.caching = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.364364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.364527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.364616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.364790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.364867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.365025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.365113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.365257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.365333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.365494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.365571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.365740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] role.caching = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.365830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.365987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.366063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] role.driver = sql {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.366214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.366290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.366461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.366546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.366700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] role.caching = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.366776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.366946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.367022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] role.driver = sql {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.367178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.367256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.367427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.367504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.367672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.367747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.367919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.367997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.368165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.368240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.368396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.368473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.368661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.368742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.368910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.368987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.369157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.369234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.369390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.369468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.369639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.369778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.369888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.370030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.370177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.370284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.370430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.370533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.370780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.370855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.371026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.371104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.371259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.371336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.371515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.371592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.371766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.371844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.372001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.372078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.372231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.372316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.372461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.372538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.372715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.372794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.372968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.373061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.373203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.373280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.373439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.373516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.373673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.373759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.373908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.373984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.374139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.374215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.374373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] token.caching = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.374458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.374609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.374686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.374857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.374934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.375088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.375172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.375328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] token.caching = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.375406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.375567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.375644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.375800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.375883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.376042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.376119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.376284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.376361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.376531 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.376635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.376790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.376867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.377026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.377105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.377260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.377349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.377505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.377582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.377741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.377817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.377968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.378052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.378210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.378287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.378457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.378534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.378707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.378792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] database.connection = **** {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.378939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.379025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.379184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.379261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.379439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.379514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.379680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.379759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] database.connection = **** {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.379903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.379986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.380137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.380222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.380371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.380448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.380651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.380734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.380869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.380946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.381104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.381181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.381354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.381485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.381608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.381737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.381863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.381989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.382122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.382250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.382376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.382501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.382626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.382753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.382901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.383029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.383155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.383280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.383405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 02 09:56:31.383532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.383532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.383775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.383899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 02 09:56:31.384024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 02 09:56:31.414022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.414275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.414458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.415176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.415413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.415642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.423431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.424858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.451824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.452081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.453288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.453523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.514965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.515731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.563446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.563676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.564510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.564841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.632148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.632375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.632615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.632839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.632938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.633056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.633272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.633353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.633624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.633911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.634195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.634479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.658556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.658680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.658789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.659017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.659099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.659238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.659445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.659526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.659654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.659832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.659914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.660163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.660447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.660757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.670992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.671244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.683579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.683809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.684035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.684258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.684339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.684477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.684706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.684790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.684918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91119) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.685107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.685396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.685680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.685959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.686239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 02 09:56:31.702596 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.702805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 02 09:56:31.703139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.703218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.703338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 02 09:56:31.703515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 02 09:56:31.703598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.703843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.704022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.704102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.704288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 02 09:56:31.704373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.704566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.704851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.705112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.705369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.715722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.715994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.716261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.716539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.716855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.717133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.717409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.717694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.724811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.725987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.728062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.728338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.728633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.728917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.729193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.729298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.729472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.729612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.729737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.729893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.730012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.730177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.730280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.730460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.730538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.730719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.730806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.730988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.731263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.731532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.731802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.732066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.757526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.759001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.759122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.759398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.761140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.761431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.765236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.765511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.765899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.766754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.767034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.767315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.773159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.773438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.774765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.775045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.778487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.778767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.779043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.779321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.779591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.779862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.780073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.780155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.780359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.780439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.780666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.780954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.781229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.781505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.781774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.782044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.798915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.799188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.800666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.800944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.803692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.805462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.807306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.808108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.809620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.809915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.813248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.815006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.816911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.818687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.820525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.820843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.821129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.821407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.821682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.821957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.822351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.822648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.822933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.823771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.824053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.824333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.841651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.841929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.842189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.842442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.843459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.843742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.844008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.844269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.850311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.852012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.852184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.852265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.853926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.854204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.855462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.855746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.856030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.856302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.856579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.857408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.857697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.857984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.858265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.858557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.870671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.870943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.871218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.871498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.871776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.872140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.872423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.873445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.873727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.874012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.874293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.874574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.874854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.875129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.890800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.893630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.894006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.896898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.897303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.899974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.900218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.901695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.901971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.902052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.902248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.904808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.905090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.905371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.909492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.911079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.912752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.914304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.914399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.914591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.914982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.915258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.917609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.917899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.918183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.918499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.924389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.924712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.924993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.927691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.927988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.928269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.933309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91119) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.933582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.933867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.934139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.934406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.934769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.935051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.935318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.935605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.935886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.936154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.936415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.936626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 02 09:56:31.936713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.936915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.936996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91119) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.937208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.937486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.937758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.938031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.938316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.938588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.938976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.939259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.939534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.939799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.940074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.940335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 02 09:56:31.974871 ncdv-master-1 devstack@keystone.service[91119]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56511be7c9c0 pid: 91119 (default app) May 02 09:56:31.978218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093beac-476f-4752-b19b-14fbeec95931 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:31.978396 ncdv-master-1 devstack@keystone.service[91118]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56511be7c9c0 pid: 91118 (default app) May 02 09:56:31.978518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093beac-476f-4752-b19b-14fbeec95931 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:31.978796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093beac-476f-4752-b19b-14fbeec95931 None None] PATH_INFO: `/v3` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:31.983035 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Mon May 2 09:56:31 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:56:40.988411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965aac4-25ea-427c-a380-56a4ea992704 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:40.988990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965aac4-25ea-427c-a380-56a4ea992704 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:40.989085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965aac4-25ea-427c-a380-56a4ea992704 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:40.993368 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:56:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:56:40.998540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334af100-5128-4e59-b468-e8eab4b9bac6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:40.998975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334af100-5128-4e59-b468-e8eab4b9bac6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:40.999110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334af100-5128-4e59-b468-e8eab4b9bac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:41.029209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG oslo_db.sqlalchemy.engines [None req-334af100-5128-4e59-b468-e8eab4b9bac6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 02 09:56:41.210652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG passlib.handlers.bcrypt [None req-334af100-5128-4e59-b468-e8eab4b9bac6 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=91119) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 02 09:56:41.211088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG passlib.handlers.bcrypt [None req-334af100-5128-4e59-b468-e8eab4b9bac6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91119) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 02 09:56:41.266466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-334af100-5128-4e59-b468-e8eab4b9bac6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:56:41.268004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-334af100-5128-4e59-b468-e8eab4b9bac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:56:41.389330 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:56:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 02 09:56:41.561987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965aac4-25ea-427c-a380-56a4ea992704 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:41.595281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG oslo_db.sqlalchemy.engines [None req-5965aac4-25ea-427c-a380-56a4ea992704 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91118) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 02 09:56:41.720689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965aac4-25ea-427c-a380-56a4ea992704 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:41.724944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8bc6c-0d61-4670-b0c7-85c895b43420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:41.725598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8bc6c-0d61-4670-b0c7-85c895b43420 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:41.725882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8bc6c-0d61-4670-b0c7-85c895b43420 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:41.726156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8bc6c-0d61-4670-b0c7-85c895b43420 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:41.734235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8bc6c-0d61-4670-b0c7-85c895b43420 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:41.785935 ncdv-master-1 devstack@keystone.service[91118]: WARNING keystone.common.rbac_enforcer.enforcer [None req-06b8bc6c-0d61-4670-b0c7-85c895b43420 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 02 09:56:41.786279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8bc6c-0d61-4670-b0c7-85c895b43420 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:41.795682 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Mon May 2 09:56:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 02 09:56:41.801582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334af100-5128-4e59-b468-e8eab4b9bac6 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:41.816229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334af100-5128-4e59-b468-e8eab4b9bac6 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:41.820565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5ad50-15fe-48fa-bb6a-90e549e3c929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:41.821726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5ad50-15fe-48fa-bb6a-90e549e3c929 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:41.822018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5ad50-15fe-48fa-bb6a-90e549e3c929 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:41.822310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5ad50-15fe-48fa-bb6a-90e549e3c929 admin admin] PATH_INFO: `/v3/projects/3af81e2baeae46b0b67902cedc893eb9` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:41.824453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5ad50-15fe-48fa-bb6a-90e549e3c929 admin admin] RBAC: Authorizing `identity:get_project(project_id=3af81e2baeae46b0b67902cedc893eb9)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:41.875344 ncdv-master-1 devstack@keystone.service[91119]: WARNING keystone.common.rbac_enforcer.enforcer [None req-82b5ad50-15fe-48fa-bb6a-90e549e3c929 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 02 09:56:41.875682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5ad50-15fe-48fa-bb6a-90e549e3c929 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:41.880297 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Mon May 2 09:56:41 2022] GET /identity/v3/projects/3af81e2baeae46b0b67902cedc893eb9 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:56:44.137528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f14c5-6a6a-4a0a-aa12-1dc6e4f38263 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:44.138022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f14c5-6a6a-4a0a-aa12-1dc6e4f38263 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:44.138117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f14c5-6a6a-4a0a-aa12-1dc6e4f38263 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:44.142172 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:56:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:56:44.147398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b0536-8d8f-4c44-9243-3b76f87ad504 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:44.147812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b0536-8d8f-4c44-9243-3b76f87ad504 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:44.147976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b0536-8d8f-4c44-9243-3b76f87ad504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:44.167314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-273b0536-8d8f-4c44-9243-3b76f87ad504 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:56:44.168882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-273b0536-8d8f-4c44-9243-3b76f87ad504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:56:44.177063 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:56:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 02 09:56:44.200828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f14c5-6a6a-4a0a-aa12-1dc6e4f38263 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:44.212552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f14c5-6a6a-4a0a-aa12-1dc6e4f38263 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:44.217330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44775446-26ee-4cda-8980-cce2e1b51c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:44.217955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44775446-26ee-4cda-8980-cce2e1b51c15 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:44.218239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44775446-26ee-4cda-8980-cce2e1b51c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:44.218517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44775446-26ee-4cda-8980-cce2e1b51c15 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:44.226042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44775446-26ee-4cda-8980-cce2e1b51c15 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:44.227853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44775446-26ee-4cda-8980-cce2e1b51c15 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:44.237023 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Mon May 2 09:56:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 09:56:44.242469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b0536-8d8f-4c44-9243-3b76f87ad504 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:44.251442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b0536-8d8f-4c44-9243-3b76f87ad504 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:44.255798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283d023-1c23-4013-af91-44c51c72f6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:44.256695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283d023-1c23-4013-af91-44c51c72f6bf admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:44.256984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283d023-1c23-4013-af91-44c51c72f6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:44.257268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283d023-1c23-4013-af91-44c51c72f6bf admin admin] PATH_INFO: `/v3/users/ac266adf0f16441aa7fe1157ada97e7b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:44.258663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283d023-1c23-4013-af91-44c51c72f6bf admin admin] RBAC: Authorizing `identity:get_user(user_id=ac266adf0f16441aa7fe1157ada97e7b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:44.261045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283d023-1c23-4013-af91-44c51c72f6bf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:44.262611 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Mon May 2 09:56:44 2022] GET /identity/v3/users/ac266adf0f16441aa7fe1157ada97e7b => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:56:46.628614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5995a-b848-44bf-a947-f6731f4c15e6 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:46.629131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5995a-b848-44bf-a947-f6731f4c15e6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:46.629244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5995a-b848-44bf-a947-f6731f4c15e6 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:46.630545 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:56:46.635704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddeffe-23b1-4e47-b0fd-06826a5adc27 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:46.636124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddeffe-23b1-4e47-b0fd-06826a5adc27 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:46.636393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddeffe-23b1-4e47-b0fd-06826a5adc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:46.648759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec646461-b8cf-43b2-8b46-65876eeb9275 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:46.649051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec646461-b8cf-43b2-8b46-65876eeb9275 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:46.649335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec646461-b8cf-43b2-8b46-65876eeb9275 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:46.650674 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:56:46.652879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-75ddeffe-23b1-4e47-b0fd-06826a5adc27 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:56:46.654071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-75ddeffe-23b1-4e47-b0fd-06826a5adc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:56:46.655486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6fa9f-d0f2-4727-be86-79e60fa04c72 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:46.655775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6fa9f-d0f2-4727-be86-79e60fa04c72 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:46.656058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6fa9f-d0f2-4727-be86-79e60fa04c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:46.695738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG passlib.handlers.bcrypt [None req-90e6fa9f-d0f2-4727-be86-79e60fa04c72 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=91118) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 02 09:56:46.696169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG passlib.handlers.bcrypt [None req-90e6fa9f-d0f2-4727-be86-79e60fa04c72 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91118) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 02 09:56:46.731128 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:56:46.742666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-90e6fa9f-d0f2-4727-be86-79e60fa04c72 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:56:46.744826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-90e6fa9f-d0f2-4727-be86-79e60fa04c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:56:46.755881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ddeffe-23b1-4e47-b0fd-06826a5adc27 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:46.840081 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:56:46.851046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ddeffe-23b1-4e47-b0fd-06826a5adc27 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:46.863689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6fa9f-d0f2-4727-be86-79e60fa04c72 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:46.883339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec0460-6609-47cc-b044-5742360e8f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:46.884075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec0460-6609-47cc-b044-5742360e8f7f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:46.884361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec0460-6609-47cc-b044-5742360e8f7f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:46.884673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec0460-6609-47cc-b044-5742360e8f7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:46.895258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec0460-6609-47cc-b044-5742360e8f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:56:46.906759 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-7eec0460-6609-47cc-b044-5742360e8f7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:56:46.906759 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:56:46.906759 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:56:46.906759 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:56:46.906759 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:56:46.906759 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:56:46.906759 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:56:46.906759 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:56:46.906759 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:56:46.906759 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:56:46.906759 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:56:46.906759 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:56:46.906759 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:56:46.906759 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:56:46.906759 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:56:46.906759 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:56:46.907654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:56:46.907654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:56:46.907654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:56:46.907654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:56:46.907654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:56:46.907654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:56:46.907654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:56:46.907654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:56:46.907654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:56:46.907654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:56:46.907654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:56:46.907654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:56:46.907654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:56:46.907654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:56:46.907654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:56:46.907654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:56:46.908476 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:56:46.908476 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:56:46.908476 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:56:46.908476 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:56:46.908476 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:56:46.908476 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:56:46.908476 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:56:46.908476 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:56:46.908476 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:56:46.908476 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:56:46.908476 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:56:46.908476 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:56:46.908476 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:56:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:56:46.913564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec0460-6609-47cc-b044-5742360e8f7f None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:46.959445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6fa9f-d0f2-4727-be86-79e60fa04c72 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:46.991703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430ac2e-c931-473c-b7f5-3850f05da3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:46.992616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430ac2e-c931-473c-b7f5-3850f05da3bb None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:46.992920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430ac2e-c931-473c-b7f5-3850f05da3bb None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:46.993196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430ac2e-c931-473c-b7f5-3850f05da3bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:47.007384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec0460-6609-47cc-b044-5742360e8f7f None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:47.038915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2bb89-d69c-4e2d-b433-da201c24b1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:47.039575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2bb89-d69c-4e2d-b433-da201c24b1b9 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:47.039864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2bb89-d69c-4e2d-b433-da201c24b1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:47.040144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2bb89-d69c-4e2d-b433-da201c24b1b9 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:47.040921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2bb89-d69c-4e2d-b433-da201c24b1b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:56:47.041814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2bb89-d69c-4e2d-b433-da201c24b1b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:47.043212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2bb89-d69c-4e2d-b433-da201c24b1b9 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:47.055814 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:56:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:56:47.057113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430ac2e-c931-473c-b7f5-3850f05da3bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:47.058612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430ac2e-c931-473c-b7f5-3850f05da3bb None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:47.061393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2bb89-d69c-4e2d-b433-da201c24b1b9 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:47.156311 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:56:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 02 09:56:47.161957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430ac2e-c931-473c-b7f5-3850f05da3bb None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:47.257010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430ac2e-c931-473c-b7f5-3850f05da3bb None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:47.266137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2bb89-d69c-4e2d-b433-da201c24b1b9 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:47.289361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767c962-a6c3-4bbb-bf79-6318c184b5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:47.290233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767c962-a6c3-4bbb-bf79-6318c184b5df None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:47.290596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767c962-a6c3-4bbb-bf79-6318c184b5df None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:47.290882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767c962-a6c3-4bbb-bf79-6318c184b5df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:47.296620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffe24b-30b0-4acd-b734-ba51bf78e09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:47.297488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffe24b-30b0-4acd-b734-ba51bf78e09e None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:47.297773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffe24b-30b0-4acd-b734-ba51bf78e09e None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:47.298052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffe24b-30b0-4acd-b734-ba51bf78e09e None admin] PATH_INFO: `/v3/users/ac266adf0f16441aa7fe1157ada97e7b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:47.299232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffe24b-30b0-4acd-b734-ba51bf78e09e None admin] RBAC: Authorizing `identity:get_user(user_id=ac266adf0f16441aa7fe1157ada97e7b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:47.300709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffe24b-30b0-4acd-b734-ba51bf78e09e None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:47.302428 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:56:47 2022] GET /identity/v3/users/ac266adf0f16441aa7fe1157ada97e7b => generated 247 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:56:47.307869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffe24b-30b0-4acd-b734-ba51bf78e09e None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:47.309107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767c962-a6c3-4bbb-bf79-6318c184b5df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:47.310654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767c962-a6c3-4bbb-bf79-6318c184b5df None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:47.331477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-8767c962-a6c3-4bbb-bf79-6318c184b5df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:56:47.331477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:56:47.331477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:56:47.331477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:56:47.331477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:56:47.331477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:56:47.331477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:56:47.331477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:56:47.331477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:56:47.331477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:56:47.331477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:56:47.331477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:56:47.331477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:56:47.331477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:56:47.331477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:56:47.335966 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:56:47.335966 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:56:47.335966 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:56:47.335966 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:56:47.335966 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:56:47.335966 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:56:47.335966 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:56:47.335966 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:56:47.335966 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:56:47.335966 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:56:47.335966 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:56:47.335966 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:56:47.335966 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:56:47.335966 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:56:47.335966 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:56:47.335966 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:56:47.335966 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:56:47.336785 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:56:47.336785 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:56:47.336785 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:56:47.336785 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:56:47.336785 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:56:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:56:47.339162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767c962-a6c3-4bbb-bf79-6318c184b5df None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:47.402917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffe24b-30b0-4acd-b734-ba51bf78e09e None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:47.433092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767c962-a6c3-4bbb-bf79-6318c184b5df None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:47.433933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387911a5-2bc9-44b6-b9d7-cc75c73042a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:47.434743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387911a5-2bc9-44b6-b9d7-cc75c73042a1 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:47.435040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387911a5-2bc9-44b6-b9d7-cc75c73042a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:47.435319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387911a5-2bc9-44b6-b9d7-cc75c73042a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:47.436516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387911a5-2bc9-44b6-b9d7-cc75c73042a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:47.438014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387911a5-2bc9-44b6-b9d7-cc75c73042a1 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:47.439665 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:56:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:56:47.445326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387911a5-2bc9-44b6-b9d7-cc75c73042a1 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:47.465665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ada9c7-40c1-4e02-bbbf-c943bb1c324f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:47.466643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ada9c7-40c1-4e02-bbbf-c943bb1c324f None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:47.466643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ada9c7-40c1-4e02-bbbf-c943bb1c324f None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:47.466883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ada9c7-40c1-4e02-bbbf-c943bb1c324f None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:47.467612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ada9c7-40c1-4e02-bbbf-c943bb1c324f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:56:47.467924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ada9c7-40c1-4e02-bbbf-c943bb1c324f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:47.469328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ada9c7-40c1-4e02-bbbf-c943bb1c324f None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:47.485872 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:56:47.543184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387911a5-2bc9-44b6-b9d7-cc75c73042a1 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:47.578249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4cd96-83f1-42cc-926a-9fcfbe4a8f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:47.578924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4cd96-83f1-42cc-926a-9fcfbe4a8f63 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:47.579213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4cd96-83f1-42cc-926a-9fcfbe4a8f63 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:47.579495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4cd96-83f1-42cc-926a-9fcfbe4a8f63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:47.580353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4cd96-83f1-42cc-926a-9fcfbe4a8f63 None admin] RBAC: Adding query filter params (role.id=dd8a47ade22941849ebdf8fbdf994b66, scope.domain.id=default, user.id=ac266adf0f16441aa7fe1157ada97e7b) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:56:47.580704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4cd96-83f1-42cc-926a-9fcfbe4a8f63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:47.582209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4cd96-83f1-42cc-926a-9fcfbe4a8f63 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:47.589866 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 11/21] 10.222.0.16 () {56 vars in 1322 bytes} [Mon May 2 09:56:47 2022] GET /identity/v3/role_assignments?user.id=ac266adf0f16441aa7fe1157ada97e7b&scope.domain.id=default&role.id=dd8a47ade22941849ebdf8fbdf994b66 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:56:50.377504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6733b4-69c1-4331-bde0-82544605526c None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:50.378025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6733b4-69c1-4331-bde0-82544605526c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:50.378108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6733b4-69c1-4331-bde0-82544605526c None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:50.379794 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 11/22] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:56:50.385628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d720cf-f390-4172-a09f-71fcce57a89d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:50.386482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d720cf-f390-4172-a09f-71fcce57a89d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:50.386963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d720cf-f390-4172-a09f-71fcce57a89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:50.404763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c2d720cf-f390-4172-a09f-71fcce57a89d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:56:50.406273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c2d720cf-f390-4172-a09f-71fcce57a89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:56:50.418608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59e7f0-832e-4bdd-a27b-088be535b2a5 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:50.419199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59e7f0-832e-4bdd-a27b-088be535b2a5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:50.419682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59e7f0-832e-4bdd-a27b-088be535b2a5 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:50.421532 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 12/23] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:56:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:56:50.432803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72b0c3-a652-4dae-a4e0-77067b201e55 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:50.433397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72b0c3-a652-4dae-a4e0-77067b201e55 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:50.433879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72b0c3-a652-4dae-a4e0-77067b201e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:50.461772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-bc72b0c3-a652-4dae-a4e0-77067b201e55 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:56:50.463845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bc72b0c3-a652-4dae-a4e0-77067b201e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:56:50.482010 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 12/24] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:56:50.509096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d720cf-f390-4172-a09f-71fcce57a89d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:50.626733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d720cf-f390-4172-a09f-71fcce57a89d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:50.663983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc97748-c442-4e65-8b2e-acc655040cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:50.665047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc97748-c442-4e65-8b2e-acc655040cbf None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:50.665537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc97748-c442-4e65-8b2e-acc655040cbf None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:50.666153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc97748-c442-4e65-8b2e-acc655040cbf None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:50.667212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc97748-c442-4e65-8b2e-acc655040cbf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:50.668977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc97748-c442-4e65-8b2e-acc655040cbf None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:50.743270 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 13/25] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:56:50.779926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72b0c3-a652-4dae-a4e0-77067b201e55 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:50.932343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72b0c3-a652-4dae-a4e0-77067b201e55 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:50.939362 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 13/26] 10.222.0.16 () {60 vars in 1131 bytes} [Mon May 2 09:56:50 2022] POST /identity/v3/roles => generated 219 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 09:56:50.945127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91a196-4580-4a8d-a397-93df5f9a9864 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:50.945531 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91a196-4580-4a8d-a397-93df5f9a9864 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:50.946097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91a196-4580-4a8d-a397-93df5f9a9864 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:50.948711 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 14/27] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:56:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:56:50.953190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234ce76-ce10-4255-b6bb-3260a29f79e9 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:50.953190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234ce76-ce10-4255-b6bb-3260a29f79e9 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:50.953190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234ce76-ce10-4255-b6bb-3260a29f79e9 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:50.959342 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 15/28] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:56:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:56:50.959342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c491903-88ae-4a2a-8044-7dcf9716ca4a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:50.959342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c491903-88ae-4a2a-8044-7dcf9716ca4a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:50.959342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c491903-88ae-4a2a-8044-7dcf9716ca4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:50.984173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc762d-8c6b-4882-b2d2-0939c44225d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:50.985461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc762d-8c6b-4882-b2d2-0939c44225d8 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:50.986245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc762d-8c6b-4882-b2d2-0939c44225d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:50.986744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc762d-8c6b-4882-b2d2-0939c44225d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:50.997328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7c491903-88ae-4a2a-8044-7dcf9716ca4a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:56:50.998914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7c491903-88ae-4a2a-8044-7dcf9716ca4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:56:51.001154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc762d-8c6b-4882-b2d2-0939c44225d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:56:51.012473 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-52fc762d-8c6b-4882-b2d2-0939c44225d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:56:51.012473 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:56:51.012473 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:56:51.012473 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:56:51.012473 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:56:51.012473 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:56:51.012473 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:56:51.012473 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:56:51.012473 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:56:51.012473 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:56:51.012473 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:56:51.012473 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:56:51.012473 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:56:51.012473 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:56:51.012473 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:56:51.012473 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:56:51.013562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:56:51.013562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:56:51.013562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:56:51.013562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:56:51.013562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:56:51.013562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:56:51.013562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:56:51.013562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:56:51.013562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:56:51.013562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:56:51.013562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:56:51.013562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:56:51.013562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:56:51.013562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:56:51.013562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:56:51.013562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:56:51.014393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:56:51.014393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:56:51.014393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:56:51.014393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:56:51.014393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:56:51.014393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:56:51.014393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:56:51.014393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:56:51.014393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:56:51.014393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:56:51.014393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:56:51.014393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:56:51.017265 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 14/29] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:56:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:56:51.019418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62665b25-c64d-4d0e-a074-477ce9004225 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:51.019926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62665b25-c64d-4d0e-a074-477ce9004225 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:51.020788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62665b25-c64d-4d0e-a074-477ce9004225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:51.052027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-62665b25-c64d-4d0e-a074-477ce9004225 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:56:51.053303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-62665b25-c64d-4d0e-a074-477ce9004225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:56:51.145377 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 16/30] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:56:51.146266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c491903-88ae-4a2a-8044-7dcf9716ca4a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:51.198493 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 15/31] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:56:51.200978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62665b25-c64d-4d0e-a074-477ce9004225 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:51.306263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c491903-88ae-4a2a-8044-7dcf9716ca4a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:51.335747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62665b25-c64d-4d0e-a074-477ce9004225 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:51.352563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecbaf0-20c3-4bbf-98ca-10ce412b0043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:51.357253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecbaf0-20c3-4bbf-98ca-10ce412b0043 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:51.357715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecbaf0-20c3-4bbf-98ca-10ce412b0043 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:51.357832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecbaf0-20c3-4bbf-98ca-10ce412b0043 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:51.358583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecbaf0-20c3-4bbf-98ca-10ce412b0043 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:56:51.358904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecbaf0-20c3-4bbf-98ca-10ce412b0043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:51.361564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecbaf0-20c3-4bbf-98ca-10ce412b0043 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:51.375838 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 17/32] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:56:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:56:51.377240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecbaf0-20c3-4bbf-98ca-10ce412b0043 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:51.380192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf02d6-99bd-4667-a7dd-3f98ef3397a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:51.381052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf02d6-99bd-4667-a7dd-3f98ef3397a6 None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:51.381441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf02d6-99bd-4667-a7dd-3f98ef3397a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:51.381826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf02d6-99bd-4667-a7dd-3f98ef3397a6 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:51.382686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf02d6-99bd-4667-a7dd-3f98ef3397a6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:51.384187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf02d6-99bd-4667-a7dd-3f98ef3397a6 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:51.500164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecbaf0-20c3-4bbf-98ca-10ce412b0043 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:51.538411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db487f2-80d7-430c-8dc1-aa2eb247f336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:51.539591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db487f2-80d7-430c-8dc1-aa2eb247f336 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:51.540028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db487f2-80d7-430c-8dc1-aa2eb247f336 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:51.540457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db487f2-80d7-430c-8dc1-aa2eb247f336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:51.552737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db487f2-80d7-430c-8dc1-aa2eb247f336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:51.554457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db487f2-80d7-430c-8dc1-aa2eb247f336 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:51.573709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-6db487f2-80d7-430c-8dc1-aa2eb247f336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:56:51.573709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:56:51.573709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:56:51.573709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:56:51.573709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:56:51.573709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:56:51.573709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:56:51.573709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:56:51.573709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:56:51.573709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:56:51.573709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:56:51.573709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:56:51.573709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:56:51.573709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:56:51.573709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:56:51.574889 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:56:51.574889 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:56:51.574889 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:56:51.574889 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:56:51.574889 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:56:51.574889 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:56:51.574889 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:56:51.574889 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:56:51.574889 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:56:51.574889 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:56:51.574889 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:56:51.574889 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:56:51.574889 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:56:51.574889 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:56:51.574889 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:56:51.574889 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:56:51.574889 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:56:51.575886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:56:51.575886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:56:51.575886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:56:51.575886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:56:51.576141 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 16/33] 10.222.0.16 () {60 vars in 1131 bytes} [Mon May 2 09:56:51 2022] POST /identity/v3/roles => generated 225 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:56:51.577135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf02d6-99bd-4667-a7dd-3f98ef3397a6 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:51.578111 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 18/34] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:56:51.585077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db487f2-80d7-430c-8dc1-aa2eb247f336 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:51.731686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db487f2-80d7-430c-8dc1-aa2eb247f336 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:51.733274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf02d6-99bd-4667-a7dd-3f98ef3397a6 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:51.769582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d21b29-ec81-4a49-bd99-ec57d2325710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:51.770188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d21b29-ec81-4a49-bd99-ec57d2325710 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:51.770480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d21b29-ec81-4a49-bd99-ec57d2325710 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:51.770788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d21b29-ec81-4a49-bd99-ec57d2325710 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:51.771529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d21b29-ec81-4a49-bd99-ec57d2325710 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:56:51.771847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d21b29-ec81-4a49-bd99-ec57d2325710 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:51.773300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d21b29-ec81-4a49-bd99-ec57d2325710 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:51.784818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf9ef9-2212-49da-8661-b00abd94eaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:51.786008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf9ef9-2212-49da-8661-b00abd94eaca None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:51.786322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf9ef9-2212-49da-8661-b00abd94eaca None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:51.786574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf9ef9-2212-49da-8661-b00abd94eaca None admin] PATH_INFO: `/v3/users/ac266adf0f16441aa7fe1157ada97e7b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:51.788284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf9ef9-2212-49da-8661-b00abd94eaca None admin] RBAC: Authorizing `identity:get_user(user_id=ac266adf0f16441aa7fe1157ada97e7b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:51.789918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf9ef9-2212-49da-8661-b00abd94eaca None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:51.792590 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 17/35] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:56:51 2022] GET /identity/v3/users/ac266adf0f16441aa7fe1157ada97e7b => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:56:51.793407 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 19/36] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:56:51.794676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83108032-804a-4e28-8a94-d9e24d1d7744 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:51.795157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83108032-804a-4e28-8a94-d9e24d1d7744 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:51.795446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83108032-804a-4e28-8a94-d9e24d1d7744 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:51.796820 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 18/37] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:56:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:56:51.801595 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d21b29-ec81-4a49-bd99-ec57d2325710 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:51.801789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83108032-804a-4e28-8a94-d9e24d1d7744 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:51.908781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d21b29-ec81-4a49-bd99-ec57d2325710 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:51.916983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83108032-804a-4e28-8a94-d9e24d1d7744 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:51.943354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e790f-9974-4fa6-9b28-35d21b56df98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:51.944173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e790f-9974-4fa6-9b28-35d21b56df98 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:51.944463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e790f-9974-4fa6-9b28-35d21b56df98 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:51.944777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e790f-9974-4fa6-9b28-35d21b56df98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:51.946042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e790f-9974-4fa6-9b28-35d21b56df98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:51.948111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e790f-9974-4fa6-9b28-35d21b56df98 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:51.954320 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:56:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:56:51.954320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d6fd6-bf34-43ec-b72f-d9937e305e9d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:51.954320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d6fd6-bf34-43ec-b72f-d9937e305e9d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:51.954320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d6fd6-bf34-43ec-b72f-d9937e305e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:51.965139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ee41f-0eb8-4826-8801-c8d3691b329c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:51.965813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ee41f-0eb8-4826-8801-c8d3691b329c None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:51.966105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ee41f-0eb8-4826-8801-c8d3691b329c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:51.966386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ee41f-0eb8-4826-8801-c8d3691b329c None admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:51.967125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ee41f-0eb8-4826-8801-c8d3691b329c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:51.968585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ee41f-0eb8-4826-8801-c8d3691b329c None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:51.971453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e71d6fd6-bf34-43ec-b72f-d9937e305e9d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:56:51.972656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e71d6fd6-bf34-43ec-b72f-d9937e305e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:56:52.048953 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 21/39] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:56:52.049705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d6fd6-bf34-43ec-b72f-d9937e305e9d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:52.088629 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 19/40] 10.222.0.16 () {60 vars in 1141 bytes} [Mon May 2 09:56:51 2022] POST /identity/v3/projects => generated 301 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 09:56:52.088629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ee41f-0eb8-4826-8801-c8d3691b329c None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:52.166499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d6fd6-bf34-43ec-b72f-d9937e305e9d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:52.203446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ee41f-0eb8-4826-8801-c8d3691b329c None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:52.203780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca23b8-2641-4e17-865e-538933be9f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:52.204633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca23b8-2641-4e17-865e-538933be9f1f None admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:52.204924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca23b8-2641-4e17-865e-538933be9f1f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:52.205208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca23b8-2641-4e17-865e-538933be9f1f None admin] PATH_INFO: `/v3/domains/default/users/ac266adf0f16441aa7fe1157ada97e7b/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:52.207326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca23b8-2641-4e17-865e-538933be9f1f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ac266adf0f16441aa7fe1157ada97e7b, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:52.208844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca23b8-2641-4e17-865e-538933be9f1f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:52.239955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfb50c-8641-4307-ad58-6c1f39b36501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:52.240700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfb50c-8641-4307-ad58-6c1f39b36501 None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:52.240980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfb50c-8641-4307-ad58-6c1f39b36501 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:52.241262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfb50c-8641-4307-ad58-6c1f39b36501 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:52.242030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfb50c-8641-4307-ad58-6c1f39b36501 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:52.243508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfb50c-8641-4307-ad58-6c1f39b36501 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:52.274091 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 22/41] 10.222.0.16 () {58 vars in 1361 bytes} [Mon May 2 09:56:52 2022] PUT /identity/v3/domains/default/users/ac266adf0f16441aa7fe1157ada97e7b/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:56:52.275463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff162fbf-55d3-4928-b384-a5de9e4ba0d3 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:52.275756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff162fbf-55d3-4928-b384-a5de9e4ba0d3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:52.276040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff162fbf-55d3-4928-b384-a5de9e4ba0d3 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:52.277335 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 23/42] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:56:52.283095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175034e-0d74-4d87-b247-d65270278b69 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:52.283400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175034e-0d74-4d87-b247-d65270278b69 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:52.283674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175034e-0d74-4d87-b247-d65270278b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:52.292581 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 20/43] 10.222.0.16 () {60 vars in 1131 bytes} [Mon May 2 09:56:52 2022] POST /identity/v3/roles => generated 223 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:56:52.302781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f175034e-0d74-4d87-b247-d65270278b69 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:56:52.304039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f175034e-0d74-4d87-b247-d65270278b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:56:52.392278 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 24/44] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:56:52.417063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfb50c-8641-4307-ad58-6c1f39b36501 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:52.523653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfb50c-8641-4307-ad58-6c1f39b36501 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:52.557310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113875f3-96ac-4c56-a121-1dde082aae52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:52.558330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113875f3-96ac-4c56-a121-1dde082aae52 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:52.558763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113875f3-96ac-4c56-a121-1dde082aae52 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:52.559184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113875f3-96ac-4c56-a121-1dde082aae52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:52.560585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113875f3-96ac-4c56-a121-1dde082aae52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:52.571040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113875f3-96ac-4c56-a121-1dde082aae52 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:52.571040 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 21/45] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:56:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:56:52.571209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175034e-0d74-4d87-b247-d65270278b69 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:52.664860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175034e-0d74-4d87-b247-d65270278b69 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:52.698109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1d440-d532-422a-8999-f809871b6ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:52.698779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1d440-d532-422a-8999-f809871b6ba6 None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:52.699070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1d440-d532-422a-8999-f809871b6ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:52.699357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1d440-d532-422a-8999-f809871b6ba6 None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:52.700080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1d440-d532-422a-8999-f809871b6ba6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:52.701599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1d440-d532-422a-8999-f809871b6ba6 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:52.778208 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 25/46] 10.222.0.16 () {60 vars in 1141 bytes} [Mon May 2 09:56:52 2022] POST /identity/v3/projects => generated 312 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 09:56:54.597388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae7788-eec1-4a43-b1cb-28f8d426e035 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:54.597897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae7788-eec1-4a43-b1cb-28f8d426e035 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:54.598092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae7788-eec1-4a43-b1cb-28f8d426e035 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:54.599400 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 22/47] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:56:54.605318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6df5c5-3596-441f-bd13-e9777b607d0a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:54.605688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6df5c5-3596-441f-bd13-e9777b607d0a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:54.605896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6df5c5-3596-441f-bd13-e9777b607d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:54.623509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4f6df5c5-3596-441f-bd13-e9777b607d0a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:56:54.624728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4f6df5c5-3596-441f-bd13-e9777b607d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:56:54.687453 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 26/48] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:56:54.711992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae7788-eec1-4a43-b1cb-28f8d426e035 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:54.809771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae7788-eec1-4a43-b1cb-28f8d426e035 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:54.842824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecf787-2809-4d1e-a558-a10776eb728d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:54.843615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecf787-2809-4d1e-a558-a10776eb728d None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:54.843906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecf787-2809-4d1e-a558-a10776eb728d None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:54.844189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecf787-2809-4d1e-a558-a10776eb728d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:54.854294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecf787-2809-4d1e-a558-a10776eb728d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:56:54.862073 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-1fecf787-2809-4d1e-a558-a10776eb728d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:56:54.862073 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:56:54.862073 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:56:54.862073 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:56:54.862073 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:56:54.862073 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:56:54.862073 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:56:54.862073 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:56:54.862073 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:56:54.862073 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:56:54.862073 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:56:54.862073 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:56:54.862073 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:56:54.862073 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:56:54.862073 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:56:54.862073 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:56:54.862869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:56:54.862869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:56:54.862869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:56:54.862869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:56:54.862869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:56:54.862869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:56:54.862869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:56:54.862869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:56:54.862869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:56:54.862869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:56:54.862869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:56:54.862869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:56:54.862869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:56:54.862869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:56:54.862869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:56:54.862869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:56:54.863607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:56:54.863607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:56:54.863607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:56:54.863607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:56:54.863607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:56:54.863607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:56:54.863607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:56:54.863607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:56:54.863607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:56:54.863607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:56:54.863607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:56:54.863607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:56:54.863607 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 23/49] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:56:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:56:54.869177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6df5c5-3596-441f-bd13-e9777b607d0a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:54.965678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6df5c5-3596-441f-bd13-e9777b607d0a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:54.997091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e724b3-722b-4e52-a5fe-a1fb79b287cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:54.997760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e724b3-722b-4e52-a5fe-a1fb79b287cc None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:54.998049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e724b3-722b-4e52-a5fe-a1fb79b287cc None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:54.998331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e724b3-722b-4e52-a5fe-a1fb79b287cc None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:54.999079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e724b3-722b-4e52-a5fe-a1fb79b287cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:56:54.999393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e724b3-722b-4e52-a5fe-a1fb79b287cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:55.000809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e724b3-722b-4e52-a5fe-a1fb79b287cc None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:55.014237 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 27/50] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:56:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:56:55.015600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecf787-2809-4d1e-a558-a10776eb728d None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:55.077260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c08c0-3571-4d5a-bd40-e17120a5e9a7 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:55.077561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c08c0-3571-4d5a-bd40-e17120a5e9a7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:55.077853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c08c0-3571-4d5a-bd40-e17120a5e9a7 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:55.079232 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 28/51] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:56:55.083923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f50461-b60d-466d-8877-34a9adfcc0fd None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:55.084214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f50461-b60d-466d-8877-34a9adfcc0fd None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:55.084500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f50461-b60d-466d-8877-34a9adfcc0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:55.100822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-56f50461-b60d-466d-8877-34a9adfcc0fd None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:56:55.102022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-56f50461-b60d-466d-8877-34a9adfcc0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:56:55.111009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecf787-2809-4d1e-a558-a10776eb728d None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:55.143356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde68bd6-e72a-426b-8137-86b7ee806cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:55.144224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde68bd6-e72a-426b-8137-86b7ee806cf3 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:55.144511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde68bd6-e72a-426b-8137-86b7ee806cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:55.144823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde68bd6-e72a-426b-8137-86b7ee806cf3 None admin] PATH_INFO: `/v3/users/ac266adf0f16441aa7fe1157ada97e7b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:55.146009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde68bd6-e72a-426b-8137-86b7ee806cf3 None admin] RBAC: Authorizing `identity:get_user(user_id=ac266adf0f16441aa7fe1157ada97e7b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:55.147449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde68bd6-e72a-426b-8137-86b7ee806cf3 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:55.149108 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 24/52] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:56:55 2022] GET /identity/v3/users/ac266adf0f16441aa7fe1157ada97e7b => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:56:55.154303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde68bd6-e72a-426b-8137-86b7ee806cf3 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:55.166155 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 29/53] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:56:55.190807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f50461-b60d-466d-8877-34a9adfcc0fd None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:55.249450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde68bd6-e72a-426b-8137-86b7ee806cf3 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:55.281002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef271f-bc84-4a76-bc6f-51a10c37ae6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:55.281793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef271f-bc84-4a76-bc6f-51a10c37ae6e None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:55.282079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef271f-bc84-4a76-bc6f-51a10c37ae6e None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:55.282359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef271f-bc84-4a76-bc6f-51a10c37ae6e None admin] PATH_INFO: `/v3/domains/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:55.283095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f50461-b60d-466d-8877-34a9adfcc0fd None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:55.283546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef271f-bc84-4a76-bc6f-51a10c37ae6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:55.285041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef271f-bc84-4a76-bc6f-51a10c37ae6e None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:55.286659 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 25/54] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:56:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:56:55.292224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef271f-bc84-4a76-bc6f-51a10c37ae6e None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:55.315655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a5737-1db8-41a3-be35-673511767c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:55.316452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a5737-1db8-41a3-be35-673511767c8e None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:55.316775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a5737-1db8-41a3-be35-673511767c8e None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:55.317062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a5737-1db8-41a3-be35-673511767c8e None admin] PATH_INFO: `/v3/domains/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:55.318281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a5737-1db8-41a3-be35-673511767c8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:55.319869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a5737-1db8-41a3-be35-673511767c8e None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:55.321520 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 30/55] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:56:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:56:55.327725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a5737-1db8-41a3-be35-673511767c8e None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:55.386730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef271f-bc84-4a76-bc6f-51a10c37ae6e None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:55.418117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fd09f-c129-411f-9aaf-541cf05f3771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:55.418765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fd09f-c129-411f-9aaf-541cf05f3771 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:55.419053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fd09f-c129-411f-9aaf-541cf05f3771 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:55.419336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fd09f-c129-411f-9aaf-541cf05f3771 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:55.419908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a5737-1db8-41a3-be35-673511767c8e None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:55.420218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035fd09f-c129-411f-9aaf-541cf05f3771 None admin] RBAC: Adding query filter params (role.id=dd8a47ade22941849ebdf8fbdf994b66, scope.domain.id=default, user.id=ac266adf0f16441aa7fe1157ada97e7b) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:56:55.420535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035fd09f-c129-411f-9aaf-541cf05f3771 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:55.422023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035fd09f-c129-411f-9aaf-541cf05f3771 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:55.430686 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 26/56] 10.222.0.16 () {56 vars in 1322 bytes} [Mon May 2 09:56:55 2022] GET /identity/v3/role_assignments?user.id=ac266adf0f16441aa7fe1157ada97e7b&scope.domain.id=default&role.id=dd8a47ade22941849ebdf8fbdf994b66 => generated 530 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:56:55.458009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180703c4-3125-4d4d-816e-d7e55786fe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:55.458825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180703c4-3125-4d4d-816e-d7e55786fe1c None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:55.459133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180703c4-3125-4d4d-816e-d7e55786fe1c None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:55.459413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180703c4-3125-4d4d-816e-d7e55786fe1c None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:55.460166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180703c4-3125-4d4d-816e-d7e55786fe1c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:55.461884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180703c4-3125-4d4d-816e-d7e55786fe1c None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:55.576632 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 31/57] 10.222.0.16 () {60 vars in 1140 bytes} [Mon May 2 09:56:55 2022] POST /identity/v3/projects => generated 298 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 09:56:57.867386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d765bbd-7d04-4eb7-9bb2-401c15d2c6ec None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:57.867923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d765bbd-7d04-4eb7-9bb2-401c15d2c6ec None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:57.868012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d765bbd-7d04-4eb7-9bb2-401c15d2c6ec None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:57.869395 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 27/58] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:56:57.874491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250b4ee-7502-4c70-9a4d-ec2e9f8e872f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:57.874919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250b4ee-7502-4c70-9a4d-ec2e9f8e872f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:57.875061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250b4ee-7502-4c70-9a4d-ec2e9f8e872f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:57.891557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-1250b4ee-7502-4c70-9a4d-ec2e9f8e872f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:56:57.892773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1250b4ee-7502-4c70-9a4d-ec2e9f8e872f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:56:57.954340 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 32/59] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:56:57.979860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d765bbd-7d04-4eb7-9bb2-401c15d2c6ec None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:58.076860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d765bbd-7d04-4eb7-9bb2-401c15d2c6ec None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:58.108101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2c368-41c5-46b3-bb72-3e7ebff5e09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:58.108920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2c368-41c5-46b3-bb72-3e7ebff5e09b None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:58.109208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2c368-41c5-46b3-bb72-3e7ebff5e09b None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:58.109485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2c368-41c5-46b3-bb72-3e7ebff5e09b None admin] PATH_INFO: `/v3/domains/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:58.110658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2c368-41c5-46b3-bb72-3e7ebff5e09b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:58.112335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2c368-41c5-46b3-bb72-3e7ebff5e09b None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:58.113970 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 28/60] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:56:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:56:58.119946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250b4ee-7502-4c70-9a4d-ec2e9f8e872f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:56:58.212359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250b4ee-7502-4c70-9a4d-ec2e9f8e872f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:56:58.243488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06564c02-27d0-4870-be49-bf541c4f57b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:56:58.244675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06564c02-27d0-4870-be49-bf541c4f57b7 None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:56:58.244968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06564c02-27d0-4870-be49-bf541c4f57b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:56:58.245252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06564c02-27d0-4870-be49-bf541c4f57b7 None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:56:58.245972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06564c02-27d0-4870-be49-bf541c4f57b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:56:58.247440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06564c02-27d0-4870-be49-bf541c4f57b7 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:56:58.336449 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 33/61] 10.222.0.16 () {60 vars in 1132 bytes} [Mon May 2 09:56:58 2022] POST /identity/v3/users => generated 275 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:57:01.750032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540f12d-ebd4-483e-a44e-c52da720fdf1 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:01.751065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540f12d-ebd4-483e-a44e-c52da720fdf1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:01.751590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540f12d-ebd4-483e-a44e-c52da720fdf1 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:01.753243 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 29/62] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:01.758702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab911373-dea4-408b-a20e-7f5fb2d5312d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:01.759619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab911373-dea4-408b-a20e-7f5fb2d5312d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:01.760114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab911373-dea4-408b-a20e-7f5fb2d5312d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:01.778181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ab911373-dea4-408b-a20e-7f5fb2d5312d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:01.779728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ab911373-dea4-408b-a20e-7f5fb2d5312d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:01.847373 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 34/63] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:01.873041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540f12d-ebd4-483e-a44e-c52da720fdf1 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:01.990300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540f12d-ebd4-483e-a44e-c52da720fdf1 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:02.025638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4694cbb-013e-4664-abb1-f8fb1e430d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:02.026801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4694cbb-013e-4664-abb1-f8fb1e430d22 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:02.027464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4694cbb-013e-4664-abb1-f8fb1e430d22 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:02.027948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4694cbb-013e-4664-abb1-f8fb1e430d22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:02.038712 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4694cbb-013e-4664-abb1-f8fb1e430d22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:02.047284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-e4694cbb-013e-4664-abb1-f8fb1e430d22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:02.047284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:02.047284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:02.047284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:02.047284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:02.047284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:02.047284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:02.047284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:02.047284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:02.047284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:02.047284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:02.047284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:02.047284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:02.047284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:02.047284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:02.047284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:02.048187 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:02.048187 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:02.048187 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:02.048187 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:02.048187 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:02.048187 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:02.048187 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:02.048187 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:02.048187 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:02.048187 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:02.048187 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:02.048187 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:02.048187 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:02.048187 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:02.048187 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:02.048187 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:02.048998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:02.048998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:02.048998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:02.048998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:02.048998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:02.048998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:02.048998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:02.048998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:02.048998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:02.048998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:02.048998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:02.048998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:02.051401 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 30/64] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:02.057411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab911373-dea4-408b-a20e-7f5fb2d5312d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:02.153118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66ea61-4bd2-4e25-8a4a-7d96ae5c373c None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:02.153403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66ea61-4bd2-4e25-8a4a-7d96ae5c373c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:02.153864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66ea61-4bd2-4e25-8a4a-7d96ae5c373c None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:02.155397 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 31/65] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:57:02.160635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa2fba-d59c-4e5a-bdcd-19b4257b4fc7 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:02.160635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa2fba-d59c-4e5a-bdcd-19b4257b4fc7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:02.160825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab911373-dea4-408b-a20e-7f5fb2d5312d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:02.160896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa2fba-d59c-4e5a-bdcd-19b4257b4fc7 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:02.161607 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 32/66] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:02.162786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34372c-bd7e-4c0c-8474-66a1326a3839 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:02.163080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34372c-bd7e-4c0c-8474-66a1326a3839 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:02.163361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34372c-bd7e-4c0c-8474-66a1326a3839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:02.184423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0b34372c-bd7e-4c0c-8474-66a1326a3839 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:02.186294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0b34372c-bd7e-4c0c-8474-66a1326a3839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:02.197760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3055f49-e40a-46f8-acc0-a4ad66e47fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:02.198870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3055f49-e40a-46f8-acc0-a4ad66e47fc1 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:02.199165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3055f49-e40a-46f8-acc0-a4ad66e47fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:02.199453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3055f49-e40a-46f8-acc0-a4ad66e47fc1 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:02.200542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3055f49-e40a-46f8-acc0-a4ad66e47fc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:02.200891 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3055f49-e40a-46f8-acc0-a4ad66e47fc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:02.202591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3055f49-e40a-46f8-acc0-a4ad66e47fc1 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:02.213347 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 35/67] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:02.219249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167784a-0382-4ca5-8301-8a349d44ebf6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:02.219249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167784a-0382-4ca5-8301-8a349d44ebf6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:02.219249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167784a-0382-4ca5-8301-8a349d44ebf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:02.238117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c167784a-0382-4ca5-8301-8a349d44ebf6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:02.239320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c167784a-0382-4ca5-8301-8a349d44ebf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:02.270590 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 33/68] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:02.271687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34372c-bd7e-4c0c-8474-66a1326a3839 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:02.320147 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 36/69] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:02.320147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f92bdc-f3ae-40ee-a957-bbcfdac20bae None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:02.320147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f92bdc-f3ae-40ee-a957-bbcfdac20bae None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:02.320147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f92bdc-f3ae-40ee-a957-bbcfdac20bae None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:02.320147 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 37/70] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:02.320147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f92bdc-f3ae-40ee-a957-bbcfdac20bae None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:02.380174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34372c-bd7e-4c0c-8474-66a1326a3839 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:02.416787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39cd61-e958-4d48-9ded-9f364d95e4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:02.417796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39cd61-e958-4d48-9ded-9f364d95e4fc None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:02.418089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39cd61-e958-4d48-9ded-9f364d95e4fc None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:02.418375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39cd61-e958-4d48-9ded-9f364d95e4fc None admin] PATH_INFO: `/v3/users/630418688b8a4b6cb66207b368f6f37f` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:02.432329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f92bdc-f3ae-40ee-a957-bbcfdac20bae None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:02.433294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39cd61-e958-4d48-9ded-9f364d95e4fc None admin] RBAC: Authorizing `identity:get_user(user_id=630418688b8a4b6cb66207b368f6f37f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:02.434763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39cd61-e958-4d48-9ded-9f364d95e4fc None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:02.436466 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 34/71] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:02 2022] GET /identity/v3/users/630418688b8a4b6cb66207b368f6f37f => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:02.438396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdc92f-cee5-4146-9ff5-004347d321e7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:02.438837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdc92f-cee5-4146-9ff5-004347d321e7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:02.439302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdc92f-cee5-4146-9ff5-004347d321e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:02.459019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0bcdc92f-cee5-4146-9ff5-004347d321e7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:02.460377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0bcdc92f-cee5-4146-9ff5-004347d321e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:02.468156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af1ad3-6514-495a-9b05-dffe6b65d272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:02.469001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af1ad3-6514-495a-9b05-dffe6b65d272 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:02.469286 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af1ad3-6514-495a-9b05-dffe6b65d272 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:02.469568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af1ad3-6514-495a-9b05-dffe6b65d272 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:02.479411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af1ad3-6514-495a-9b05-dffe6b65d272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:02.487511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-d9af1ad3-6514-495a-9b05-dffe6b65d272 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:02.487511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:02.487511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:02.487511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:02.487511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:02.487511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:02.487511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:02.487511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:02.487511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:02.487511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:02.487511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:02.487511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:02.487511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:02.487511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:02.487511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:02.487511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:02.488357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:02.488357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:02.488357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:02.488357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:02.488357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:02.488357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:02.488357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:02.488357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:02.488357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:02.488357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:02.488357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:02.488357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:57:02.488357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:02.488357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:02.488357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:02.488357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:02.489166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:02.489166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:02.489166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:02.489166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:02.489166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:02.489166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:02.489166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:02.489166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:02.489166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:02.489166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:02.489166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:02.489166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:02.489166 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 38/72] 10.222.0.16 () {56 vars in 1114 bytes} [Mon May 2 09:57:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:02.490427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af1ad3-6514-495a-9b05-dffe6b65d272 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:02.530723 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 35/73] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:02.541565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdc92f-cee5-4146-9ff5-004347d321e7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:02.598762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af1ad3-6514-495a-9b05-dffe6b65d272 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:02.630347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49bba5-fe56-4344-9a93-c4f626afdb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:02.631158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49bba5-fe56-4344-9a93-c4f626afdb44 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:02.631427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49bba5-fe56-4344-9a93-c4f626afdb44 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:02.631709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49bba5-fe56-4344-9a93-c4f626afdb44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:02.634413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdc92f-cee5-4146-9ff5-004347d321e7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:02.641941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49bba5-fe56-4344-9a93-c4f626afdb44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:02.649559 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-bd49bba5-fe56-4344-9a93-c4f626afdb44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:02.649559 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:02.649559 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:02.649559 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:02.649559 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:02.649559 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:02.649559 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:02.649559 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:02.649559 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:02.649559 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:02.649559 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:02.649559 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:02.649559 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:02.649559 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:02.649559 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:02.649559 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:02.650526 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:02.650526 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:02.650526 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:02.650526 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:02.650526 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:02.650526 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:02.650526 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:02.650526 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:02.650526 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:02.650526 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:02.650526 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:02.650526 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:57:02.650526 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:02.650526 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:02.650526 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:02.650526 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:02.651290 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:02.651290 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:02.651290 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:02.651290 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:02.651290 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:02.651290 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:02.651290 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:02.651290 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:02.651290 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:02.651290 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:02.651290 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:02.651290 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:02.651290 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 39/74] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:02.651929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49bba5-fe56-4344-9a93-c4f626afdb44 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:02.668892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08657a65-4be5-40c9-8fd1-8bba1d8c6cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:02.669549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08657a65-4be5-40c9-8fd1-8bba1d8c6cfb None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:02.669838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08657a65-4be5-40c9-8fd1-8bba1d8c6cfb None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:02.670122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08657a65-4be5-40c9-8fd1-8bba1d8c6cfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:02.733456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08657a65-4be5-40c9-8fd1-8bba1d8c6cfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:02.734925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08657a65-4be5-40c9-8fd1-8bba1d8c6cfb None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:02.743595 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49bba5-fe56-4344-9a93-c4f626afdb44 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:02.775638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28398400-654c-407f-bafc-99959733ac40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:02.776315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28398400-654c-407f-bafc-99959733ac40 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:02.776627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28398400-654c-407f-bafc-99959733ac40 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:02.776913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28398400-654c-407f-bafc-99959733ac40 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:02.777666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28398400-654c-407f-bafc-99959733ac40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:02.777980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28398400-654c-407f-bafc-99959733ac40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:02.779385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28398400-654c-407f-bafc-99959733ac40 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:02.787234 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 40/75] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:57:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:02.788564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28398400-654c-407f-bafc-99959733ac40 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:02.830691 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 36/76] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:02.832052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc050c1d-7802-497c-8d3e-b1379e81fc3a None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:02.832355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc050c1d-7802-497c-8d3e-b1379e81fc3a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:02.832659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc050c1d-7802-497c-8d3e-b1379e81fc3a None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:02.834055 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 37/77] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:02.836650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc050c1d-7802-497c-8d3e-b1379e81fc3a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:02.890103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28398400-654c-407f-bafc-99959733ac40 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:02.921404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982ee45-67df-4cf0-b92a-26b9732bb5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:02.922198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982ee45-67df-4cf0-b92a-26b9732bb5ae None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:02.922488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982ee45-67df-4cf0-b92a-26b9732bb5ae None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:02.922770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982ee45-67df-4cf0-b92a-26b9732bb5ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:02.929910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc050c1d-7802-497c-8d3e-b1379e81fc3a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:02.932888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982ee45-67df-4cf0-b92a-26b9732bb5ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:02.940401 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-0982ee45-67df-4cf0-b92a-26b9732bb5ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:57:02.940401 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:02.940401 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:02.940401 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:02.940401 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:02.940401 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:02.940401 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:02.940401 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:02.940401 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:02.940401 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:02.940401 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:02.940401 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:02.940401 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:02.940401 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:02.940401 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:02.940401 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:02.941264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:02.941264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:02.941264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:02.941264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:02.941264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:02.941264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:02.941264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:02.941264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:02.941264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:02.941264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:02.941264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:02.941264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:57:02.941264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:02.941264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:02.941264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:02.941264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:02.942007 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:02.942007 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:02.942007 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:02.942007 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:02.942007 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:02.942007 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:02.942007 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:02.942007 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:02.942007 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:02.942007 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:02.942007 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:57:02.942007 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:02.942007 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 41/78] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:57:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:02.942607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982ee45-67df-4cf0-b92a-26b9732bb5ae None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:02.962087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7717d9-c8ce-4cf3-a969-263356f86568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:02.962785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7717d9-c8ce-4cf3-a969-263356f86568 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:02.963071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7717d9-c8ce-4cf3-a969-263356f86568 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:02.963353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7717d9-c8ce-4cf3-a969-263356f86568 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:02.964106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7717d9-c8ce-4cf3-a969-263356f86568 None admin] RBAC: Adding query filter params (name=member) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:02.964425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7717d9-c8ce-4cf3-a969-263356f86568 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:02.965834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7717d9-c8ce-4cf3-a969-263356f86568 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:02.977163 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 38/79] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:02.978034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7717d9-c8ce-4cf3-a969-263356f86568 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:03.042690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982ee45-67df-4cf0-b92a-26b9732bb5ae None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:03.070676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7717d9-c8ce-4cf3-a969-263356f86568 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:03.074504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531b380-c4b1-4e37-929f-d2b2280b3aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:03.075385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531b380-c4b1-4e37-929f-d2b2280b3aa7 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:03.075675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531b380-c4b1-4e37-929f-d2b2280b3aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:03.075958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531b380-c4b1-4e37-929f-d2b2280b3aa7 None admin] PATH_INFO: `/v3/users/630418688b8a4b6cb66207b368f6f37f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:03.077201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531b380-c4b1-4e37-929f-d2b2280b3aa7 None admin] RBAC: Authorizing `identity:get_user(user_id=630418688b8a4b6cb66207b368f6f37f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:03.078655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531b380-c4b1-4e37-929f-d2b2280b3aa7 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:03.080291 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 42/80] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:02 2022] GET /identity/v3/users/630418688b8a4b6cb66207b368f6f37f => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:03.081469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3fa03-da13-40f2-b280-10f6cb58ace5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:03.081760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3fa03-da13-40f2-b280-10f6cb58ace5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:03.082057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3fa03-da13-40f2-b280-10f6cb58ace5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:03.097747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0aa3fa03-da13-40f2-b280-10f6cb58ace5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:03.098953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0aa3fa03-da13-40f2-b280-10f6cb58ace5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:03.105044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4a957-a68e-4014-a641-4f6f09a998a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:03.105926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4a957-a68e-4014-a641-4f6f09a998a1 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:03.106215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4a957-a68e-4014-a641-4f6f09a998a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:03.106497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4a957-a68e-4014-a641-4f6f09a998a1 None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:03.108139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4a957-a68e-4014-a641-4f6f09a998a1 None admin] RBAC: Authorizing `identity:get_project(project_id=d44324b154884c4cbb76a723c912a4e5)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:03.109626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4a957-a68e-4014-a641-4f6f09a998a1 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:03.111589 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 39/81] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:02 2022] GET /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5 => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:03.117228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4a957-a68e-4014-a641-4f6f09a998a1 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:03.161813 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 43/82] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:03.162578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3fa03-da13-40f2-b280-10f6cb58ace5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:03.209706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4a957-a68e-4014-a641-4f6f09a998a1 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:03.241184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6ad50-5f0b-4536-8cab-776a9e38fb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:03.241843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6ad50-5f0b-4536-8cab-776a9e38fb6a None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:03.242129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6ad50-5f0b-4536-8cab-776a9e38fb6a None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:03.242405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6ad50-5f0b-4536-8cab-776a9e38fb6a None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:03.243147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6ad50-5f0b-4536-8cab-776a9e38fb6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:03.243456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6ad50-5f0b-4536-8cab-776a9e38fb6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:03.245393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6ad50-5f0b-4536-8cab-776a9e38fb6a None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:03.252999 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 40/83] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:03.253769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6ad50-5f0b-4536-8cab-776a9e38fb6a None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:03.262764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3fa03-da13-40f2-b280-10f6cb58ace5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:03.294856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa03fd9-6f32-40e4-b188-64cdb0cb35a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:03.295729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa03fd9-6f32-40e4-b188-64cdb0cb35a7 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:03.296016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa03fd9-6f32-40e4-b188-64cdb0cb35a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:03.296296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa03fd9-6f32-40e4-b188-64cdb0cb35a7 None admin] PATH_INFO: `/v3/users/630418688b8a4b6cb66207b368f6f37f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:03.297516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa03fd9-6f32-40e4-b188-64cdb0cb35a7 None admin] RBAC: Authorizing `identity:get_user(user_id=630418688b8a4b6cb66207b368f6f37f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:03.298969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa03fd9-6f32-40e4-b188-64cdb0cb35a7 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:03.300591 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 44/84] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:03 2022] GET /identity/v3/users/630418688b8a4b6cb66207b368f6f37f => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:03.301396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa03fd9-6f32-40e4-b188-64cdb0cb35a7 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:03.349477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6ad50-5f0b-4536-8cab-776a9e38fb6a None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:03.381077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cd186-14f1-4359-939d-d11ae0b0a5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:03.381722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cd186-14f1-4359-939d-d11ae0b0a5d9 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:03.382008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cd186-14f1-4359-939d-d11ae0b0a5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:03.382288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cd186-14f1-4359-939d-d11ae0b0a5d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:03.391776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa03fd9-6f32-40e4-b188-64cdb0cb35a7 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:03.424268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53d0c5-51c4-46b0-bfa2-e7c9a708dd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:03.424886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53d0c5-51c4-46b0-bfa2-e7c9a708dd01 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:03.425179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53d0c5-51c4-46b0-bfa2-e7c9a708dd01 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:03.425462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53d0c5-51c4-46b0-bfa2-e7c9a708dd01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:03.426292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53d0c5-51c4-46b0-bfa2-e7c9a708dd01 None admin] RBAC: Adding query filter params (role.id=d1592d47a67b4f4a8d14e2101c799509, scope.project.id=d44324b154884c4cbb76a723c912a4e5, user.id=630418688b8a4b6cb66207b368f6f37f) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:03.426612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53d0c5-51c4-46b0-bfa2-e7c9a708dd01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:03.428088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53d0c5-51c4-46b0-bfa2-e7c9a708dd01 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:03.433300 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 45/85] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:57:03 2022] GET /identity/v3/role_assignments?user.id=630418688b8a4b6cb66207b368f6f37f&scope.project.id=d44324b154884c4cbb76a723c912a4e5&role.id=d1592d47a67b4f4a8d14e2101c799509 => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:03.434080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53d0c5-51c4-46b0-bfa2-e7c9a708dd01 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:03.446258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cd186-14f1-4359-939d-d11ae0b0a5d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:03.447767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cd186-14f1-4359-939d-d11ae0b0a5d9 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:03.542758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53d0c5-51c4-46b0-bfa2-e7c9a708dd01 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:03.551741 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 41/86] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:03.557691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cd186-14f1-4359-939d-d11ae0b0a5d9 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:03.577141 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910ccf1-67af-4595-9dbb-68e3c11c7964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:03.577958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910ccf1-67af-4595-9dbb-68e3c11c7964 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:03.578243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910ccf1-67af-4595-9dbb-68e3c11c7964 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:03.578520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910ccf1-67af-4595-9dbb-68e3c11c7964 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:03.579740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910ccf1-67af-4595-9dbb-68e3c11c7964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:03.581250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910ccf1-67af-4595-9dbb-68e3c11c7964 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:03.582929 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 46/87] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:57:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:03.588860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910ccf1-67af-4595-9dbb-68e3c11c7964 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:03.659560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cd186-14f1-4359-939d-d11ae0b0a5d9 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:03.687437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910ccf1-67af-4595-9dbb-68e3c11c7964 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:03.692452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d302d4-c801-40cf-8a14-02c09f918339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:03.693361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d302d4-c801-40cf-8a14-02c09f918339 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:03.693649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d302d4-c801-40cf-8a14-02c09f918339 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:03.693929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d302d4-c801-40cf-8a14-02c09f918339 None admin] PATH_INFO: `/v3/users/ac266adf0f16441aa7fe1157ada97e7b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:03.695157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d302d4-c801-40cf-8a14-02c09f918339 None admin] RBAC: Authorizing `identity:get_user(user_id=ac266adf0f16441aa7fe1157ada97e7b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:03.696636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d302d4-c801-40cf-8a14-02c09f918339 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:03.703227 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 42/88] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:03 2022] GET /identity/v3/users/ac266adf0f16441aa7fe1157ada97e7b => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:03.703227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d302d4-c801-40cf-8a14-02c09f918339 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:03.727909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240406d-272d-4747-ab68-a7265d7afbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:03.728784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240406d-272d-4747-ab68-a7265d7afbef None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:03.729372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240406d-272d-4747-ab68-a7265d7afbef None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:03.729918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240406d-272d-4747-ab68-a7265d7afbef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:03.795256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d302d4-c801-40cf-8a14-02c09f918339 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:03.800546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240406d-272d-4747-ab68-a7265d7afbef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:03.802990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240406d-272d-4747-ab68-a7265d7afbef None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:03.828010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade04fe1-aefd-4398-aa0c-12c508aeef63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:03.828903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade04fe1-aefd-4398-aa0c-12c508aeef63 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:03.829191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade04fe1-aefd-4398-aa0c-12c508aeef63 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:03.829473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade04fe1-aefd-4398-aa0c-12c508aeef63 None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:03.830682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade04fe1-aefd-4398-aa0c-12c508aeef63 None admin] RBAC: Authorizing `identity:get_project(project_id=d44324b154884c4cbb76a723c912a4e5)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:03.832130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade04fe1-aefd-4398-aa0c-12c508aeef63 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:03.833888 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 43/89] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:03 2022] GET /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5 => generated 298 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:03.834635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade04fe1-aefd-4398-aa0c-12c508aeef63 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:03.903727 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 47/90] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:03.905503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240406d-272d-4747-ab68-a7265d7afbef None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:03.930020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade04fe1-aefd-4398-aa0c-12c508aeef63 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:03.962377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d8e14-e397-4169-ae0a-33ec6190cbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:03.963539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d8e14-e397-4169-ae0a-33ec6190cbbc None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:03.963826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d8e14-e397-4169-ae0a-33ec6190cbbc None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:03.964113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d8e14-e397-4169-ae0a-33ec6190cbbc None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:03.964848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d8e14-e397-4169-ae0a-33ec6190cbbc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:03.966292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d8e14-e397-4169-ae0a-33ec6190cbbc None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:04.000888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240406d-272d-4747-ab68-a7265d7afbef None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:04.033425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e06ee9-ee4d-40cc-bee1-f8831b4b883d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:04.034081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e06ee9-ee4d-40cc-bee1-f8831b4b883d None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:04.034372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e06ee9-ee4d-40cc-bee1-f8831b4b883d None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:04.034656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e06ee9-ee4d-40cc-bee1-f8831b4b883d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:04.063175 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 44/91] 10.222.0.16 () {60 vars in 1132 bytes} [Mon May 2 09:57:03 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:57:04.064329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d8e14-e397-4169-ae0a-33ec6190cbbc None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:04.129032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e06ee9-ee4d-40cc-bee1-f8831b4b883d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:04.131031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e06ee9-ee4d-40cc-bee1-f8831b4b883d None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:04.177490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d8e14-e397-4169-ae0a-33ec6190cbbc None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:04.219099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9e23c-2657-41a6-9f95-9b54b42f37b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:04.219698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9e23c-2657-41a6-9f95-9b54b42f37b7 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:04.219991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9e23c-2657-41a6-9f95-9b54b42f37b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:04.220276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9e23c-2657-41a6-9f95-9b54b42f37b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:04.221171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9e23c-2657-41a6-9f95-9b54b42f37b7 None admin] RBAC: Adding query filter params (role.id=9d0cb59f15d2481eace97516b3b77a71, scope.project.id=d44324b154884c4cbb76a723c912a4e5, user.id=630418688b8a4b6cb66207b368f6f37f) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:04.221521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9e23c-2657-41a6-9f95-9b54b42f37b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:04.223041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9e23c-2657-41a6-9f95-9b54b42f37b7 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:04.229846 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 45/92] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:57:04 2022] GET /identity/v3/role_assignments?user.id=630418688b8a4b6cb66207b368f6f37f&scope.project.id=d44324b154884c4cbb76a723c912a4e5&role.id=9d0cb59f15d2481eace97516b3b77a71 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:04.233427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9e23c-2657-41a6-9f95-9b54b42f37b7 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:04.258169 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 48/93] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:04.264362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e06ee9-ee4d-40cc-bee1-f8831b4b883d None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:04.350020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9e23c-2657-41a6-9f95-9b54b42f37b7 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:04.395974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68021408-825b-4f8a-bf3b-bbc909d577f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:04.397487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68021408-825b-4f8a-bf3b-bbc909d577f3 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:04.397782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68021408-825b-4f8a-bf3b-bbc909d577f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:04.398333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68021408-825b-4f8a-bf3b-bbc909d577f3 None admin] PATH_INFO: `/v3/projects/c413384d8fdc4d86bc748f878f3ff7bf` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:04.399663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68021408-825b-4f8a-bf3b-bbc909d577f3 None admin] RBAC: Authorizing `identity:get_project(project_id=c413384d8fdc4d86bc748f878f3ff7bf)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:04.400044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e06ee9-ee4d-40cc-bee1-f8831b4b883d None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:04.401262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68021408-825b-4f8a-bf3b-bbc909d577f3 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:04.404249 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 46/94] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:04 2022] GET /identity/v3/projects/c413384d8fdc4d86bc748f878f3ff7bf => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:04.411199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68021408-825b-4f8a-bf3b-bbc909d577f3 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:04.446692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6407f-d42c-42ae-9fec-845a6630c768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:04.447634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6407f-d42c-42ae-9fec-845a6630c768 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:04.447925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6407f-d42c-42ae-9fec-845a6630c768 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:04.448210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6407f-d42c-42ae-9fec-845a6630c768 None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:04.449597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6407f-d42c-42ae-9fec-845a6630c768 None admin] RBAC: Authorizing `identity:get_project(project_id=d44324b154884c4cbb76a723c912a4e5)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:04.451101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6407f-d42c-42ae-9fec-845a6630c768 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:04.453066 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 49/95] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:04 2022] GET /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:04.461312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6407f-d42c-42ae-9fec-845a6630c768 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:04.553577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68021408-825b-4f8a-bf3b-bbc909d577f3 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:04.591843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6407f-d42c-42ae-9fec-845a6630c768 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:04.596330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b94e84-551d-435a-a60f-57578ede9017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:04.597034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b94e84-551d-435a-a60f-57578ede9017 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:04.597322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b94e84-551d-435a-a60f-57578ede9017 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:04.597599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b94e84-551d-435a-a60f-57578ede9017 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:04.598443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b94e84-551d-435a-a60f-57578ede9017 None admin] RBAC: Adding query filter params (role.id=d1592d47a67b4f4a8d14e2101c799509, scope.project.id=c413384d8fdc4d86bc748f878f3ff7bf, user.id=630418688b8a4b6cb66207b368f6f37f) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:04.598759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b94e84-551d-435a-a60f-57578ede9017 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:04.600782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b94e84-551d-435a-a60f-57578ede9017 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:04.611144 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 47/96] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:57:04 2022] GET /identity/v3/role_assignments?user.id=630418688b8a4b6cb66207b368f6f37f&scope.project.id=c413384d8fdc4d86bc748f878f3ff7bf&role.id=d1592d47a67b4f4a8d14e2101c799509 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:04.632095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f74a22-bbb0-4260-b1ac-a98795cb08f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:04.632912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f74a22-bbb0-4260-b1ac-a98795cb08f3 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:04.633210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f74a22-bbb0-4260-b1ac-a98795cb08f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:04.633498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f74a22-bbb0-4260-b1ac-a98795cb08f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:04.634425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f74a22-bbb0-4260-b1ac-a98795cb08f3 None admin] RBAC: Adding query filter params (role.id=dd8a47ade22941849ebdf8fbdf994b66, scope.project.id=d44324b154884c4cbb76a723c912a4e5, user.id=ac266adf0f16441aa7fe1157ada97e7b) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:04.634758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f74a22-bbb0-4260-b1ac-a98795cb08f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:04.636280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f74a22-bbb0-4260-b1ac-a98795cb08f3 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:04.648887 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 50/97] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:57:04 2022] GET /identity/v3/role_assignments?user.id=ac266adf0f16441aa7fe1157ada97e7b&scope.project.id=d44324b154884c4cbb76a723c912a4e5&role.id=dd8a47ade22941849ebdf8fbdf994b66 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:06.081690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158c677-a408-4727-911b-543cd09aa111 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:06.082251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158c677-a408-4727-911b-543cd09aa111 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:06.082251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158c677-a408-4727-911b-543cd09aa111 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:06.083615 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 48/98] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:06.110619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3964b-0f8c-47da-bdba-0a3eb18d2958 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:06.111053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3964b-0f8c-47da-bdba-0a3eb18d2958 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:06.111192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3964b-0f8c-47da-bdba-0a3eb18d2958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:06.137666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a1b3964b-0f8c-47da-bdba-0a3eb18d2958 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:06.139973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a1b3964b-0f8c-47da-bdba-0a3eb18d2958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:06.222942 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 51/99] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:06.271630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158c677-a408-4727-911b-543cd09aa111 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:06.405124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158c677-a408-4727-911b-543cd09aa111 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:06.447673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ac611-dd03-412d-bb11-20da2031ce5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:06.448571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ac611-dd03-412d-bb11-20da2031ce5a None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:06.449027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ac611-dd03-412d-bb11-20da2031ce5a None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:06.449307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ac611-dd03-412d-bb11-20da2031ce5a None admin] PATH_INFO: `/v3/roles/member` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:06.464310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ac611-dd03-412d-bb11-20da2031ce5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:06.472125 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-c46ac611-dd03-412d-bb11-20da2031ce5a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:06.472125 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:06.472125 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:06.472125 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:06.472125 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:06.472125 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:06.472125 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:06.472125 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:06.472125 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:06.472125 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:06.472125 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:06.472125 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:06.472125 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:06.472125 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:06.472125 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:06.472125 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:06.476940 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:06.476940 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:06.476940 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:06.476940 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:06.476940 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:06.476940 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:06.476940 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:06.476940 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:06.476940 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:06.476940 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:06.476940 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:06.476940 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:06.476940 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:06.476940 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:06.476940 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:06.476940 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:06.477868 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:06.477868 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:06.477868 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:06.477868 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:06.477868 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:06.477868 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:06.477868 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:06.477868 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:06.477868 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:06.477868 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:06.477868 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:06.477868 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:06.477868 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 49/100] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:06.480284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3964b-0f8c-47da-bdba-0a3eb18d2958 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:06.696122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3964b-0f8c-47da-bdba-0a3eb18d2958 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:06.738045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fd967-05bb-4ee9-b95a-ef635dc7c3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:06.738736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fd967-05bb-4ee9-b95a-ef635dc7c3f4 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:06.739024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fd967-05bb-4ee9-b95a-ef635dc7c3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:06.739316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fd967-05bb-4ee9-b95a-ef635dc7c3f4 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:06.740083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3fd967-05bb-4ee9-b95a-ef635dc7c3f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:06.740398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3fd967-05bb-4ee9-b95a-ef635dc7c3f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:06.741842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3fd967-05bb-4ee9-b95a-ef635dc7c3f4 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:06.755674 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 52/101] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:06.763547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ac611-dd03-412d-bb11-20da2031ce5a None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:06.911243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ac611-dd03-412d-bb11-20da2031ce5a None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:06.957009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe75c8b-762d-43f1-b896-86c6155a1321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:06.957809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe75c8b-762d-43f1-b896-86c6155a1321 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:06.958094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe75c8b-762d-43f1-b896-86c6155a1321 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:06.958460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe75c8b-762d-43f1-b896-86c6155a1321 None admin] PATH_INFO: `/v3/users/630418688b8a4b6cb66207b368f6f37f` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:06.959710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe75c8b-762d-43f1-b896-86c6155a1321 None admin] RBAC: Authorizing `identity:get_user(user_id=630418688b8a4b6cb66207b368f6f37f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:06.961200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe75c8b-762d-43f1-b896-86c6155a1321 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:06.963170 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 50/102] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:06 2022] GET /identity/v3/users/630418688b8a4b6cb66207b368f6f37f => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:06.968968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fd967-05bb-4ee9-b95a-ef635dc7c3f4 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:07.124455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fd967-05bb-4ee9-b95a-ef635dc7c3f4 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:07.168586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354782b-6ab1-4fe4-bddb-549c5350950c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:07.169534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354782b-6ab1-4fe4-bddb-549c5350950c None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:07.169826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354782b-6ab1-4fe4-bddb-549c5350950c None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:07.170107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354782b-6ab1-4fe4-bddb-549c5350950c None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:07.174508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354782b-6ab1-4fe4-bddb-549c5350950c None admin] RBAC: Authorizing `identity:get_project(project_id=d44324b154884c4cbb76a723c912a4e5)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:07.175997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354782b-6ab1-4fe4-bddb-549c5350950c None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:07.177969 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 53/103] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:06 2022] GET /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:07.183976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe75c8b-762d-43f1-b896-86c6155a1321 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:07.264337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7fc83-b09e-4e49-a983-ea486709ab2b None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:07.264687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7fc83-b09e-4e49-a983-ea486709ab2b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:07.264851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7fc83-b09e-4e49-a983-ea486709ab2b None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:07.266631 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 54/104] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:07.275401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8617b-ce8c-4e00-b961-c6483cfbe532 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:07.275880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8617b-ce8c-4e00-b961-c6483cfbe532 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:07.276178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8617b-ce8c-4e00-b961-c6483cfbe532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:07.306375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6cf8617b-ce8c-4e00-b961-c6483cfbe532 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:07.308162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6cf8617b-ce8c-4e00-b961-c6483cfbe532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:07.342898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe75c8b-762d-43f1-b896-86c6155a1321 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:07.393511 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 55/105] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:07.403128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c912f-0ac0-4c42-a6cf-1674b1c66dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:07.404039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c912f-0ac0-4c42-a6cf-1674b1c66dc8 None admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:07.404329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c912f-0ac0-4c42-a6cf-1674b1c66dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:07.404629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c912f-0ac0-4c42-a6cf-1674b1c66dc8 None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5/users/630418688b8a4b6cb66207b368f6f37f/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:07.409913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c912f-0ac0-4c42-a6cf-1674b1c66dc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d44324b154884c4cbb76a723c912a4e5, user_id=630418688b8a4b6cb66207b368f6f37f, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:07.411377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c912f-0ac0-4c42-a6cf-1674b1c66dc8 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:07.438151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8617b-ce8c-4e00-b961-c6483cfbe532 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:07.497593 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 51/106] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 09:57:07 2022] PUT /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5/users/630418688b8a4b6cb66207b368f6f37f/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:57:07.564278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8617b-ce8c-4e00-b961-c6483cfbe532 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:07.607855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0736d-8ea7-46ae-97a0-e57eda89488e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:07.608709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0736d-8ea7-46ae-97a0-e57eda89488e None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:07.608996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0736d-8ea7-46ae-97a0-e57eda89488e None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:07.609279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0736d-8ea7-46ae-97a0-e57eda89488e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:07.629819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0736d-8ea7-46ae-97a0-e57eda89488e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:07.638470 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-79e0736d-8ea7-46ae-97a0-e57eda89488e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:07.638470 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:07.638470 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:07.638470 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:07.638470 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:07.638470 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:07.638470 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:07.638470 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:07.638470 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:07.638470 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:07.638470 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:07.638470 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:07.638470 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:07.638470 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:07.638470 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:07.638470 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:07.639471 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:07.639471 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:07.639471 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:07.639471 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:07.639471 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:07.639471 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:07.639471 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:07.639471 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:07.639471 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:07.639471 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:07.639471 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:07.639471 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:57:07.639471 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:07.639471 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:07.639471 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:07.639471 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:07.640888 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:07.640888 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:07.640888 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:07.640888 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:07.640888 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:07.640888 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:07.640888 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:07.640888 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:07.640888 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:07.640888 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:07.640888 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:07.640888 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:07.640888 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 56/107] 10.222.0.16 () {56 vars in 1114 bytes} [Mon May 2 09:57:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:57:07.649852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c912f-0ac0-4c42-a6cf-1674b1c66dc8 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:07.808070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c912f-0ac0-4c42-a6cf-1674b1c66dc8 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:07.845844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d77cc2-2d00-4c52-82a9-76cc996e9f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:07.846880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d77cc2-2d00-4c52-82a9-76cc996e9f56 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:07.847387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d77cc2-2d00-4c52-82a9-76cc996e9f56 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:07.847876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d77cc2-2d00-4c52-82a9-76cc996e9f56 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:07.848861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d77cc2-2d00-4c52-82a9-76cc996e9f56 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:07.849377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d77cc2-2d00-4c52-82a9-76cc996e9f56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:07.850989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d77cc2-2d00-4c52-82a9-76cc996e9f56 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:07.864625 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 52/108] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:57:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:07.871200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0736d-8ea7-46ae-97a0-e57eda89488e None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:07.971759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a89b43-9362-4bf2-baf2-af29e9bc5eab None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:07.972412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a89b43-9362-4bf2-baf2-af29e9bc5eab None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:07.972943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a89b43-9362-4bf2-baf2-af29e9bc5eab None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:07.975398 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 53/109] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:07.979830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791f283-9c63-42c5-b659-0ddd12201e29 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:07.980500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791f283-9c63-42c5-b659-0ddd12201e29 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:07.981027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791f283-9c63-42c5-b659-0ddd12201e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:08.014822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4791f283-9c63-42c5-b659-0ddd12201e29 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:08.017338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4791f283-9c63-42c5-b659-0ddd12201e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:08.033822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0736d-8ea7-46ae-97a0-e57eda89488e None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:08.106478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32274ddd-3fe4-4261-8eca-71e00da9f628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:08.107388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32274ddd-3fe4-4261-8eca-71e00da9f628 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:08.107672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32274ddd-3fe4-4261-8eca-71e00da9f628 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:08.107950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32274ddd-3fe4-4261-8eca-71e00da9f628 None admin] PATH_INFO: `/v3/users/630418688b8a4b6cb66207b368f6f37f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:08.112064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32274ddd-3fe4-4261-8eca-71e00da9f628 None admin] RBAC: Authorizing `identity:get_user(user_id=630418688b8a4b6cb66207b368f6f37f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:08.115669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32274ddd-3fe4-4261-8eca-71e00da9f628 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:08.115669 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 57/110] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:07 2022] GET /identity/v3/users/630418688b8a4b6cb66207b368f6f37f => generated 275 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:08.121566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32274ddd-3fe4-4261-8eca-71e00da9f628 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:08.168836 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 54/111] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:57:08.219889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791f283-9c63-42c5-b659-0ddd12201e29 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:08.346540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32274ddd-3fe4-4261-8eca-71e00da9f628 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:08.363229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791f283-9c63-42c5-b659-0ddd12201e29 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:08.401551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b734de-2c0f-4f16-8983-ac8b3d0e804e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:08.402352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b734de-2c0f-4f16-8983-ac8b3d0e804e None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:08.402693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b734de-2c0f-4f16-8983-ac8b3d0e804e None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:08.402976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b734de-2c0f-4f16-8983-ac8b3d0e804e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:08.414815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b734de-2c0f-4f16-8983-ac8b3d0e804e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:08.423645 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-15b734de-2c0f-4f16-8983-ac8b3d0e804e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:57:08.423645 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:08.423645 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:08.423645 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:08.423645 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:08.423645 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:08.423645 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:08.423645 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:08.423645 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:08.423645 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:08.423645 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:08.423645 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:08.423645 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:08.423645 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:08.423645 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:08.423645 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:08.426268 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:08.426268 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:08.426268 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:08.426268 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:08.426268 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:08.426268 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:08.426268 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:08.426268 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:08.426268 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:08.426268 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:08.426268 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:08.426268 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:08.426268 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:08.426268 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:08.426268 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:08.426268 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:08.427184 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:08.427184 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:08.427184 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:08.427184 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:08.427184 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:08.427184 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:08.427184 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:08.427184 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:08.427184 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:08.427184 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:08.427184 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:57:08.427184 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:08.427184 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 55/112] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:57:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:57:08.427184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10f13f-b9db-478a-8e57-a44df2f26c00 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:08.427860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10f13f-b9db-478a-8e57-a44df2f26c00 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:08.427860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10f13f-b9db-478a-8e57-a44df2f26c00 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:08.432809 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 56/113] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:08.433606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10f13f-b9db-478a-8e57-a44df2f26c00 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:08.441372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e600b0-1a7e-4bcf-8e36-a9c239205350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:08.442332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e600b0-1a7e-4bcf-8e36-a9c239205350 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:08.442628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e600b0-1a7e-4bcf-8e36-a9c239205350 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:08.442910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e600b0-1a7e-4bcf-8e36-a9c239205350 None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:08.446744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e600b0-1a7e-4bcf-8e36-a9c239205350 None admin] RBAC: Authorizing `identity:get_project(project_id=d44324b154884c4cbb76a723c912a4e5)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:08.448341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e600b0-1a7e-4bcf-8e36-a9c239205350 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:08.450390 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 58/114] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:08 2022] GET /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5 => generated 298 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:08.451646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d7106-7ffd-49d8-b828-52988488db32 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:08.451966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d7106-7ffd-49d8-b828-52988488db32 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:08.452231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d7106-7ffd-49d8-b828-52988488db32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:08.488839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-cd3d7106-7ffd-49d8-b828-52988488db32 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:08.490061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cd3d7106-7ffd-49d8-b828-52988488db32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:08.595532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10f13f-b9db-478a-8e57-a44df2f26c00 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:08.629220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126bb3b-acd3-427d-bf7c-b64d0502f7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:08.629815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126bb3b-acd3-427d-bf7c-b64d0502f7d9 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:08.630104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126bb3b-acd3-427d-bf7c-b64d0502f7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:08.630393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126bb3b-acd3-427d-bf7c-b64d0502f7d9 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:08.631157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126bb3b-acd3-427d-bf7c-b64d0502f7d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:08.631475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126bb3b-acd3-427d-bf7c-b64d0502f7d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:08.632887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126bb3b-acd3-427d-bf7c-b64d0502f7d9 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:08.638345 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 59/115] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:08.639279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d7106-7ffd-49d8-b828-52988488db32 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:08.649497 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 57/116] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:08.652326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924571ac-4c35-4a44-8f54-77f7f0201aed None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:08.652879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924571ac-4c35-4a44-8f54-77f7f0201aed None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:08.653508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924571ac-4c35-4a44-8f54-77f7f0201aed None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:08.655780 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 58/117] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:08.657322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08554530-b59a-430a-9668-df0bf6b7e5df None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:08.657843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08554530-b59a-430a-9668-df0bf6b7e5df None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:08.658332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08554530-b59a-430a-9668-df0bf6b7e5df None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:08.660655 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 59/118] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:08.665566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08554530-b59a-430a-9668-df0bf6b7e5df None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:08.741207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d7106-7ffd-49d8-b828-52988488db32 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:08.773366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46271d8-093e-4d52-a396-7c7c3ef68d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:08.774277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46271d8-093e-4d52-a396-7c7c3ef68d2f None admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:08.774569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46271d8-093e-4d52-a396-7c7c3ef68d2f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:08.775378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46271d8-093e-4d52-a396-7c7c3ef68d2f None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5/users/630418688b8a4b6cb66207b368f6f37f/roles/9d0cb59f15d2481eace97516b3b77a71` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:08.775606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08554530-b59a-430a-9668-df0bf6b7e5df None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:08.777631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46271d8-093e-4d52-a396-7c7c3ef68d2f None admin] RBAC: Authorizing `identity:create_grant(project_id=d44324b154884c4cbb76a723c912a4e5, user_id=630418688b8a4b6cb66207b368f6f37f, role_id=9d0cb59f15d2481eace97516b3b77a71)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:08.779114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46271d8-093e-4d52-a396-7c7c3ef68d2f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:08.810012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03709ec1-11fc-4174-9be7-09759d846340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:08.810896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03709ec1-11fc-4174-9be7-09759d846340 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:08.811190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03709ec1-11fc-4174-9be7-09759d846340 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:08.811475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03709ec1-11fc-4174-9be7-09759d846340 None admin] PATH_INFO: `/v3/users/ac266adf0f16441aa7fe1157ada97e7b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:08.812704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03709ec1-11fc-4174-9be7-09759d846340 None admin] RBAC: Authorizing `identity:get_user(user_id=ac266adf0f16441aa7fe1157ada97e7b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:08.814200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03709ec1-11fc-4174-9be7-09759d846340 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:08.815835 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 60/119] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:08 2022] GET /identity/v3/users/ac266adf0f16441aa7fe1157ada97e7b => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:08.817038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57f637-5e5d-486e-8282-9a35b64c54ca None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:08.817333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57f637-5e5d-486e-8282-9a35b64c54ca None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:08.817621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57f637-5e5d-486e-8282-9a35b64c54ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:08.833907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-eb57f637-5e5d-486e-8282-9a35b64c54ca None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:08.835085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-eb57f637-5e5d-486e-8282-9a35b64c54ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:08.845579 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 60/120] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 09:57:08 2022] PUT /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5/users/630418688b8a4b6cb66207b368f6f37f/roles/9d0cb59f15d2481eace97516b3b77a71 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:57:08.846568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46271d8-093e-4d52-a396-7c7c3ef68d2f None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:08.932632 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 61/121] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:08.934337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcff53-33e4-4312-a0d0-164b2ff67b5e None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:08.934831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcff53-33e4-4312-a0d0-164b2ff67b5e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:08.935302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcff53-33e4-4312-a0d0-164b2ff67b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:08.964640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-affcff53-33e4-4312-a0d0-164b2ff67b5e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:08.964640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-affcff53-33e4-4312-a0d0-164b2ff67b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:08.976374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46271d8-093e-4d52-a396-7c7c3ef68d2f None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:09.028739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c37206-63ea-4f65-bbcf-587dbcad9294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:09.029509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c37206-63ea-4f65-bbcf-587dbcad9294 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:09.029807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c37206-63ea-4f65-bbcf-587dbcad9294 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:09.030096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c37206-63ea-4f65-bbcf-587dbcad9294 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:09.032430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c37206-63ea-4f65-bbcf-587dbcad9294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:09.034425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c37206-63ea-4f65-bbcf-587dbcad9294 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:09.037088 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 61/122] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:57:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:09.040008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c37206-63ea-4f65-bbcf-587dbcad9294 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:09.045208 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 62/123] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:09.046330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcff53-33e4-4312-a0d0-164b2ff67b5e None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:09.155927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c37206-63ea-4f65-bbcf-587dbcad9294 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:09.169671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcff53-33e4-4312-a0d0-164b2ff67b5e None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:09.198134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bacc82-23d8-404b-a1b3-4d3ef0bd283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:09.199371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bacc82-23d8-404b-a1b3-4d3ef0bd283f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:09.199830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bacc82-23d8-404b-a1b3-4d3ef0bd283f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:09.200299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bacc82-23d8-404b-a1b3-4d3ef0bd283f None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:09.201757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bacc82-23d8-404b-a1b3-4d3ef0bd283f None admin] RBAC: Authorizing `identity:get_project(project_id=d44324b154884c4cbb76a723c912a4e5)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:09.203448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bacc82-23d8-404b-a1b3-4d3ef0bd283f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:09.205785 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 62/124] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:09 2022] GET /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:09.206798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bacc82-23d8-404b-a1b3-4d3ef0bd283f None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:09.212422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ea759-2095-468e-aa28-053c47f5dbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:09.213752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ea759-2095-468e-aa28-053c47f5dbb0 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:09.214040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ea759-2095-468e-aa28-053c47f5dbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:09.214322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ea759-2095-468e-aa28-053c47f5dbb0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:09.227393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ea759-2095-468e-aa28-053c47f5dbb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:09.238439 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-fa1ea759-2095-468e-aa28-053c47f5dbb0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 02 09:57:09.238439 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:09.238439 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:09.238439 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:09.238439 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:09.238439 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:09.238439 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:09.238439 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:09.238439 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:09.238439 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:09.238439 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:09.238439 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:09.238439 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:09.238439 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:09.238439 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:09.238439 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:09.239284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:09.239284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:09.239284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:09.239284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:09.239284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:09.239284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:09.239284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:09.239284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:09.239284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:09.239284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:09.239284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:09.239284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:09.239284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:09.239284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:09.239284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:09.239284 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:09.240065 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:09.240065 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:09.240065 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:09.240065 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:09.240065 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:09.240065 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:09.240065 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:09.240065 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:09.240065 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:09.240065 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:09.240065 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 02 09:57:09.240065 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:09.240065 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 63/125] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:09.241742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ea759-2095-468e-aa28-053c47f5dbb0 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:09.309636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bacc82-23d8-404b-a1b3-4d3ef0bd283f None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:09.344326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef537986-b856-468b-91a1-a4cadf88f759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:09.345037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef537986-b856-468b-91a1-a4cadf88f759 None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:09.345326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef537986-b856-468b-91a1-a4cadf88f759 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:09.345604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef537986-b856-468b-91a1-a4cadf88f759 None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:09.346316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef537986-b856-468b-91a1-a4cadf88f759 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:09.348011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef537986-b856-468b-91a1-a4cadf88f759 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:09.365740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ea759-2095-468e-aa28-053c47f5dbb0 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:09.399289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e87f1f-a2fa-4a64-ac2b-e6cd1c37c07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:09.402220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e87f1f-a2fa-4a64-ac2b-e6cd1c37c07f None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:09.402666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e87f1f-a2fa-4a64-ac2b-e6cd1c37c07f None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:09.402960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e87f1f-a2fa-4a64-ac2b-e6cd1c37c07f None admin] PATH_INFO: `/v3/roles/member` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:09.412725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e87f1f-a2fa-4a64-ac2b-e6cd1c37c07f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:09.420475 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-66e87f1f-a2fa-4a64-ac2b-e6cd1c37c07f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:09.420475 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:09.420475 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:09.420475 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:09.420475 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:09.420475 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:09.420475 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:09.420475 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:09.420475 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:09.420475 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:09.420475 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:09.420475 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:09.420475 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:09.420475 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:09.420475 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:09.420475 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:09.421329 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:09.421329 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:09.421329 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:09.421329 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:09.421329 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:09.421329 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:09.421329 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:09.421329 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:09.421329 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:09.421329 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:09.421329 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:09.421329 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:09.421329 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:09.421329 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:09.421329 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:09.421329 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:09.422095 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:09.422095 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:09.422095 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:09.422095 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:09.422095 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:09.422095 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:09.422095 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:09.422095 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:09.422095 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:09.422095 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:09.422095 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:09.422095 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:09.422095 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 64/126] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:09.422713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e87f1f-a2fa-4a64-ac2b-e6cd1c37c07f None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:09.462816 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 63/127] 10.222.0.16 () {60 vars in 1141 bytes} [Mon May 2 09:57:09 2022] POST /identity/v3/projects => generated 302 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:57:09.463953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef537986-b856-468b-91a1-a4cadf88f759 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:09.613231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e87f1f-a2fa-4a64-ac2b-e6cd1c37c07f None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:09.666735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef537986-b856-468b-91a1-a4cadf88f759 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:09.680962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ce362-4a2b-4db8-bdb2-839db07bea7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:09.682828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ce362-4a2b-4db8-bdb2-839db07bea7d None admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:09.683334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ce362-4a2b-4db8-bdb2-839db07bea7d None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:09.683840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ce362-4a2b-4db8-bdb2-839db07bea7d None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5/users/ac266adf0f16441aa7fe1157ada97e7b/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:09.687817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ce362-4a2b-4db8-bdb2-839db07bea7d None admin] RBAC: Authorizing `identity:create_grant(project_id=d44324b154884c4cbb76a723c912a4e5, user_id=ac266adf0f16441aa7fe1157ada97e7b, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:09.690446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ce362-4a2b-4db8-bdb2-839db07bea7d None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:09.719113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51c87a-5735-46a0-8c87-5345ad74d1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:09.720284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51c87a-5735-46a0-8c87-5345ad74d1ed None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:09.720822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51c87a-5735-46a0-8c87-5345ad74d1ed None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:09.721296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51c87a-5735-46a0-8c87-5345ad74d1ed None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:09.722338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51c87a-5735-46a0-8c87-5345ad74d1ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:09.722916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51c87a-5735-46a0-8c87-5345ad74d1ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:09.724549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51c87a-5735-46a0-8c87-5345ad74d1ed None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:09.734833 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 64/128] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:09.735914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51c87a-5735-46a0-8c87-5345ad74d1ed None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:09.775430 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 65/129] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 09:57:09 2022] PUT /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5/users/ac266adf0f16441aa7fe1157ada97e7b/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:57:09.776279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ce362-4a2b-4db8-bdb2-839db07bea7d None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:09.862584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51c87a-5735-46a0-8c87-5345ad74d1ed None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:09.905672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd5b78-1b0f-4b1a-9f30-41380108779f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:09.906710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd5b78-1b0f-4b1a-9f30-41380108779f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:09.907250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd5b78-1b0f-4b1a-9f30-41380108779f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:09.907536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd5b78-1b0f-4b1a-9f30-41380108779f None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:09.908302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd5b78-1b0f-4b1a-9f30-41380108779f None admin] RBAC: Adding query filter params (name=member) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:09.908640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd5b78-1b0f-4b1a-9f30-41380108779f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:09.909238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ce362-4a2b-4db8-bdb2-839db07bea7d None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:09.910087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd5b78-1b0f-4b1a-9f30-41380108779f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:09.922580 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 65/130] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:09.934331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd5b78-1b0f-4b1a-9f30-41380108779f None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:09.981685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988da68-0812-4e03-bf27-da352420cfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:09.982545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988da68-0812-4e03-bf27-da352420cfde None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:09.982835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988da68-0812-4e03-bf27-da352420cfde None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:09.983115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988da68-0812-4e03-bf27-da352420cfde None admin] PATH_INFO: `/v3/users/e8cebfd1c2914e979e00fef78426117a` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:10.020890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988da68-0812-4e03-bf27-da352420cfde None admin] RBAC: Authorizing `identity:get_user(user_id=e8cebfd1c2914e979e00fef78426117a)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:10.022391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988da68-0812-4e03-bf27-da352420cfde None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:10.024166 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 66/131] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:09 2022] GET /identity/v3/users/e8cebfd1c2914e979e00fef78426117a => generated 289 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:10.048010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988da68-0812-4e03-bf27-da352420cfde None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:10.056842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd5b78-1b0f-4b1a-9f30-41380108779f None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:10.099163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2835f3b-eee4-4e89-9338-d81ba4dc6779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:10.100145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2835f3b-eee4-4e89-9338-d81ba4dc6779 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:10.101845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2835f3b-eee4-4e89-9338-d81ba4dc6779 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:10.102255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2835f3b-eee4-4e89-9338-d81ba4dc6779 None admin] PATH_INFO: `/v3/users/630418688b8a4b6cb66207b368f6f37f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:10.105856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2835f3b-eee4-4e89-9338-d81ba4dc6779 None admin] RBAC: Authorizing `identity:get_user(user_id=630418688b8a4b6cb66207b368f6f37f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:10.107428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2835f3b-eee4-4e89-9338-d81ba4dc6779 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:10.113201 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 66/132] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:09 2022] GET /identity/v3/users/630418688b8a4b6cb66207b368f6f37f => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:10.118420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2835f3b-eee4-4e89-9338-d81ba4dc6779 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:10.200763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988da68-0812-4e03-bf27-da352420cfde None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:10.225234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2835f3b-eee4-4e89-9338-d81ba4dc6779 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:10.245973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedba4a0-37c8-4115-927d-802929085c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:10.246589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedba4a0-37c8-4115-927d-802929085c67 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:10.246852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedba4a0-37c8-4115-927d-802929085c67 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:10.247142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedba4a0-37c8-4115-927d-802929085c67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:10.259030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbdee9-b711-43f0-a831-b5437181a9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:10.259939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbdee9-b711-43f0-a831-b5437181a9f6 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:10.260224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbdee9-b711-43f0-a831-b5437181a9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:10.260504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbdee9-b711-43f0-a831-b5437181a9f6 None admin] PATH_INFO: `/v3/projects/c413384d8fdc4d86bc748f878f3ff7bf` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:10.261736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cbdee9-b711-43f0-a831-b5437181a9f6 None admin] RBAC: Authorizing `identity:get_project(project_id=c413384d8fdc4d86bc748f878f3ff7bf)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:10.263207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cbdee9-b711-43f0-a831-b5437181a9f6 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:10.265443 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 67/133] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:10 2022] GET /identity/v3/projects/c413384d8fdc4d86bc748f878f3ff7bf => generated 312 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:10.270868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbdee9-b711-43f0-a831-b5437181a9f6 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:10.350638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedba4a0-37c8-4115-927d-802929085c67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:10.352153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedba4a0-37c8-4115-927d-802929085c67 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:10.369460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbdee9-b711-43f0-a831-b5437181a9f6 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:10.402537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b48dce-c56c-4d72-86cd-53981e9395df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:10.403473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b48dce-c56c-4d72-86cd-53981e9395df None admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:10.403767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b48dce-c56c-4d72-86cd-53981e9395df None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:10.404043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b48dce-c56c-4d72-86cd-53981e9395df None admin] PATH_INFO: `/v3/projects/c413384d8fdc4d86bc748f878f3ff7bf/users/630418688b8a4b6cb66207b368f6f37f/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:10.406118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b48dce-c56c-4d72-86cd-53981e9395df None admin] RBAC: Authorizing `identity:create_grant(project_id=c413384d8fdc4d86bc748f878f3ff7bf, user_id=630418688b8a4b6cb66207b368f6f37f, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:10.407585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b48dce-c56c-4d72-86cd-53981e9395df None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:10.469766 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 67/134] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:10.477597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedba4a0-37c8-4115-927d-802929085c67 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:10.503947 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 68/135] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 09:57:10 2022] PUT /identity/v3/projects/c413384d8fdc4d86bc748f878f3ff7bf/users/630418688b8a4b6cb66207b368f6f37f/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 09:57:10.598156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedba4a0-37c8-4115-927d-802929085c67 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:10.637791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb567a8a-996a-43df-a2a3-25e19524171f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:10.638671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb567a8a-996a-43df-a2a3-25e19524171f None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:10.638958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb567a8a-996a-43df-a2a3-25e19524171f None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:10.639254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb567a8a-996a-43df-a2a3-25e19524171f None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:10.640488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb567a8a-996a-43df-a2a3-25e19524171f None admin] RBAC: Authorizing `identity:get_project(project_id=d44324b154884c4cbb76a723c912a4e5)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:10.642065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb567a8a-996a-43df-a2a3-25e19524171f None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:10.643924 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 68/136] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:10 2022] GET /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:10.650350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b48dce-c56c-4d72-86cd-53981e9395df None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:10.825430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b48dce-c56c-4d72-86cd-53981e9395df None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:10.878474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99349aa0-0c8a-42b4-b48a-9a2e7244d3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:10.879153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99349aa0-0c8a-42b4-b48a-9a2e7244d3d1 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:10.879449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99349aa0-0c8a-42b4-b48a-9a2e7244d3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:10.879741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99349aa0-0c8a-42b4-b48a-9a2e7244d3d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:10.880594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99349aa0-0c8a-42b4-b48a-9a2e7244d3d1 None admin] RBAC: Adding query filter params (role.id=1325eb2a84a1482fade3efa8dbe3cfbf, scope.project.id=d44324b154884c4cbb76a723c912a4e5, user.id=e8cebfd1c2914e979e00fef78426117a) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:10.880930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99349aa0-0c8a-42b4-b48a-9a2e7244d3d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:10.882399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99349aa0-0c8a-42b4-b48a-9a2e7244d3d1 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:10.892990 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 69/137] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:57:10 2022] GET /identity/v3/role_assignments?user.id=e8cebfd1c2914e979e00fef78426117a&scope.project.id=d44324b154884c4cbb76a723c912a4e5&role.id=1325eb2a84a1482fade3efa8dbe3cfbf => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:10.959956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f5e18-cc65-4167-92ab-e9d1b8323fd3 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:10.959956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f5e18-cc65-4167-92ab-e9d1b8323fd3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:10.959956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f5e18-cc65-4167-92ab-e9d1b8323fd3 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:10.959956 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 69/138] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:10.966143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748057a-d2b7-40ca-99ef-88874241750d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:10.966447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748057a-d2b7-40ca-99ef-88874241750d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:10.966739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748057a-d2b7-40ca-99ef-88874241750d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:10.987368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0748057a-d2b7-40ca-99ef-88874241750d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:10.988636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0748057a-d2b7-40ca-99ef-88874241750d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:11.086666 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 70/139] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:57:11.122428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f5e18-cc65-4167-92ab-e9d1b8323fd3 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:11.260267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f5e18-cc65-4167-92ab-e9d1b8323fd3 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:11.309467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45c615-3212-456f-ad2c-189f53ac4e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:11.310323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45c615-3212-456f-ad2c-189f53ac4e51 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:11.310617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45c615-3212-456f-ad2c-189f53ac4e51 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:11.310902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45c615-3212-456f-ad2c-189f53ac4e51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:11.326020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45c615-3212-456f-ad2c-189f53ac4e51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:11.333851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-2f45c615-3212-456f-ad2c-189f53ac4e51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:11.333851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:11.333851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:11.333851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:11.333851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:11.333851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:11.333851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:11.333851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:11.333851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:11.333851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:11.333851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:11.333851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:11.333851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:11.333851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:11.333851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:11.333851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:11.334707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:11.334707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:11.334707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:11.334707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:11.334707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:11.334707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:11.334707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:11.334707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:11.334707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:11.334707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:11.334707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:11.334707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:11.334707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:11.334707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:11.334707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:11.334707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:11.335442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:11.335442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:11.335442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:11.335442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:11.335442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:11.335442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:11.335442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:11.335442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:11.335442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:11.335442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:11.335442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:11.335442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:11.338149 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 70/140] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:11.342990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748057a-d2b7-40ca-99ef-88874241750d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:11.493912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748057a-d2b7-40ca-99ef-88874241750d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:11.530996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1695301-7a84-4cbc-ad71-4aada3142a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:11.531715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1695301-7a84-4cbc-ad71-4aada3142a25 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:11.532010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1695301-7a84-4cbc-ad71-4aada3142a25 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:11.532292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1695301-7a84-4cbc-ad71-4aada3142a25 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:11.533076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1695301-7a84-4cbc-ad71-4aada3142a25 None admin] RBAC: Adding query filter params (name=member) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:11.533387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1695301-7a84-4cbc-ad71-4aada3142a25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:11.534770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1695301-7a84-4cbc-ad71-4aada3142a25 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:11.547977 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 71/141] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:11.553736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45c615-3212-456f-ad2c-189f53ac4e51 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:11.682659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45c615-3212-456f-ad2c-189f53ac4e51 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:11.722987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b36b6-4be3-4a26-8204-0177dbf42bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:11.723894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b36b6-4be3-4a26-8204-0177dbf42bb5 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:11.724184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b36b6-4be3-4a26-8204-0177dbf42bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:11.724468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b36b6-4be3-4a26-8204-0177dbf42bb5 None admin] PATH_INFO: `/v3/users/630418688b8a4b6cb66207b368f6f37f` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:11.725772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b36b6-4be3-4a26-8204-0177dbf42bb5 None admin] RBAC: Authorizing `identity:get_user(user_id=630418688b8a4b6cb66207b368f6f37f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:11.727237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b36b6-4be3-4a26-8204-0177dbf42bb5 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:11.728978 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 71/142] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:11 2022] GET /identity/v3/users/630418688b8a4b6cb66207b368f6f37f => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:11.734672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1695301-7a84-4cbc-ad71-4aada3142a25 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:11.844653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834573f-352c-4fd7-be5d-a7e4fcb6810b None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:11.845036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834573f-352c-4fd7-be5d-a7e4fcb6810b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:11.845281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834573f-352c-4fd7-be5d-a7e4fcb6810b None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:11.846879 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 72/143] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:11.852063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3cde3-08be-4fc9-aa87-80d155e2dfa5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:11.852377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3cde3-08be-4fc9-aa87-80d155e2dfa5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:11.852670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3cde3-08be-4fc9-aa87-80d155e2dfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:11.879753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1695301-7a84-4cbc-ad71-4aada3142a25 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:11.889664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-dcd3cde3-08be-4fc9-aa87-80d155e2dfa5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:11.890895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dcd3cde3-08be-4fc9-aa87-80d155e2dfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:11.920466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b36b8f-588a-463c-b9f1-9a7946ab8d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:11.921331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b36b8f-588a-463c-b9f1-9a7946ab8d41 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:11.921631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b36b8f-588a-463c-b9f1-9a7946ab8d41 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:11.921923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b36b8f-588a-463c-b9f1-9a7946ab8d41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:12.050047 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 73/144] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:57:12.057792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b36b8f-588a-463c-b9f1-9a7946ab8d41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:12.059308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b36b8f-588a-463c-b9f1-9a7946ab8d41 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:12.094132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3cde3-08be-4fc9-aa87-80d155e2dfa5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:12.199443 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 72/145] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:12.211174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b36b8f-588a-463c-b9f1-9a7946ab8d41 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:12.275240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3cde3-08be-4fc9-aa87-80d155e2dfa5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:12.309573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ead0d-2bfd-4436-b8c9-122a03ba3e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:12.310307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ead0d-2bfd-4436-b8c9-122a03ba3e70 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:12.310601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ead0d-2bfd-4436-b8c9-122a03ba3e70 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:12.310884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ead0d-2bfd-4436-b8c9-122a03ba3e70 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:12.321225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ead0d-2bfd-4436-b8c9-122a03ba3e70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:12.329230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-207ead0d-2bfd-4436-b8c9-122a03ba3e70 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:12.329230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:12.329230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:12.329230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:12.329230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:12.329230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:12.329230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:12.329230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:12.329230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:12.329230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:12.329230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:12.329230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:12.329230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:12.329230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:12.329230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:12.329230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:12.330094 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:12.330094 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:12.330094 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:12.330094 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:12.330094 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:12.330094 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:12.330094 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:12.330094 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:12.330094 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:12.330094 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:12.330094 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:12.330094 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:12.330094 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:12.330094 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:12.330094 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:12.330094 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:12.330855 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:12.330855 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:12.330855 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:12.330855 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:12.330855 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:12.330855 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:12.330855 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:12.330855 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:12.330855 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:12.330855 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:12.330855 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:12.330855 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:12.330855 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 74/146] 10.222.0.16 () {56 vars in 1114 bytes} [Mon May 2 09:57:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:12.336367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ead0d-2bfd-4436-b8c9-122a03ba3e70 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:12.416795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b36b8f-588a-463c-b9f1-9a7946ab8d41 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:12.435258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ead0d-2bfd-4436-b8c9-122a03ba3e70 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:12.469496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd0ec4-d536-4249-9bee-c58bc0a433d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:12.470175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd0ec4-d536-4249-9bee-c58bc0a433d7 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:12.474682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd0ec4-d536-4249-9bee-c58bc0a433d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:12.474682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd0ec4-d536-4249-9bee-c58bc0a433d7 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:12.474682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd0ec4-d536-4249-9bee-c58bc0a433d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:12.474682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd0ec4-d536-4249-9bee-c58bc0a433d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:12.474682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd0ec4-d536-4249-9bee-c58bc0a433d7 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:12.483172 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 75/147] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:57:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:12.488768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd0ec4-d536-4249-9bee-c58bc0a433d7 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:12.502574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e59a1e-db76-4a64-95b1-7da41a8a5acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:12.503456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e59a1e-db76-4a64-95b1-7da41a8a5acb None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:12.503747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e59a1e-db76-4a64-95b1-7da41a8a5acb None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:12.504032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e59a1e-db76-4a64-95b1-7da41a8a5acb None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:12.505292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e59a1e-db76-4a64-95b1-7da41a8a5acb None admin] RBAC: Authorizing `identity:get_project(project_id=d44324b154884c4cbb76a723c912a4e5)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:12.506832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e59a1e-db76-4a64-95b1-7da41a8a5acb None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:12.517124 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 73/148] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:12 2022] GET /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:12.522947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e59a1e-db76-4a64-95b1-7da41a8a5acb None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:12.595056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd0ec4-d536-4249-9bee-c58bc0a433d7 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:12.634654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc65b9-d59f-41ba-b414-e05b411acc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:12.635805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc65b9-d59f-41ba-b414-e05b411acc26 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:12.636103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc65b9-d59f-41ba-b414-e05b411acc26 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:12.636388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc65b9-d59f-41ba-b414-e05b411acc26 None admin] PATH_INFO: `/v3/users/630418688b8a4b6cb66207b368f6f37f` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:12.637642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc65b9-d59f-41ba-b414-e05b411acc26 None admin] RBAC: Authorizing `identity:get_user(user_id=630418688b8a4b6cb66207b368f6f37f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:12.639248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc65b9-d59f-41ba-b414-e05b411acc26 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:12.641612 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 76/149] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:12 2022] GET /identity/v3/users/630418688b8a4b6cb66207b368f6f37f => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:12.647405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc65b9-d59f-41ba-b414-e05b411acc26 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:12.756632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc65b9-d59f-41ba-b414-e05b411acc26 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:12.767458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e59a1e-db76-4a64-95b1-7da41a8a5acb None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:12.794113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523402d-3ffc-437f-8923-cc0e67ecff51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:12.794783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523402d-3ffc-437f-8923-cc0e67ecff51 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:12.795076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523402d-3ffc-437f-8923-cc0e67ecff51 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:12.795365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523402d-3ffc-437f-8923-cc0e67ecff51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:12.853448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfc41a-a21e-4733-8f9b-3a36d3bcb3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:12.854475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfc41a-a21e-4733-8f9b-3a36d3bcb3b8 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:12.854965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfc41a-a21e-4733-8f9b-3a36d3bcb3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:12.855444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfc41a-a21e-4733-8f9b-3a36d3bcb3b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:12.856486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfc41a-a21e-4733-8f9b-3a36d3bcb3b8 None admin] RBAC: Adding query filter params (role.id=d1592d47a67b4f4a8d14e2101c799509, scope.project.id=d44324b154884c4cbb76a723c912a4e5, user.id=630418688b8a4b6cb66207b368f6f37f) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:12.857097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfc41a-a21e-4733-8f9b-3a36d3bcb3b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:12.858790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfc41a-a21e-4733-8f9b-3a36d3bcb3b8 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:12.870189 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 74/150] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:57:12 2022] GET /identity/v3/role_assignments?user.id=630418688b8a4b6cb66207b368f6f37f&scope.project.id=d44324b154884c4cbb76a723c912a4e5&role.id=d1592d47a67b4f4a8d14e2101c799509 => generated 608 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:12.874952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523402d-3ffc-437f-8923-cc0e67ecff51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:12.876471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523402d-3ffc-437f-8923-cc0e67ecff51 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:12.985114 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 77/151] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:12.991108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfc41a-a21e-4733-8f9b-3a36d3bcb3b8 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:13.095282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfc41a-a21e-4733-8f9b-3a36d3bcb3b8 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:13.131240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab24dea-b02a-4b4e-b270-d2200f967be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:13.132112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab24dea-b02a-4b4e-b270-d2200f967be3 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:13.132399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab24dea-b02a-4b4e-b270-d2200f967be3 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:13.132710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab24dea-b02a-4b4e-b270-d2200f967be3 None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:13.133922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab24dea-b02a-4b4e-b270-d2200f967be3 None admin] RBAC: Authorizing `identity:get_project(project_id=d44324b154884c4cbb76a723c912a4e5)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:13.135943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab24dea-b02a-4b4e-b270-d2200f967be3 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:13.138041 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 75/152] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:12 2022] GET /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:13.143823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523402d-3ffc-437f-8923-cc0e67ecff51 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:13.248356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523402d-3ffc-437f-8923-cc0e67ecff51 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:13.284114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213d5c7-506b-425f-ad2d-0b7621b8b798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:13.284885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213d5c7-506b-425f-ad2d-0b7621b8b798 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:13.285110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213d5c7-506b-425f-ad2d-0b7621b8b798 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:13.285401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213d5c7-506b-425f-ad2d-0b7621b8b798 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:13.286269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213d5c7-506b-425f-ad2d-0b7621b8b798 None admin] RBAC: Adding query filter params (role.id=9d0cb59f15d2481eace97516b3b77a71, scope.project.id=d44324b154884c4cbb76a723c912a4e5, user.id=630418688b8a4b6cb66207b368f6f37f) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:13.286594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213d5c7-506b-425f-ad2d-0b7621b8b798 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:13.288106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213d5c7-506b-425f-ad2d-0b7621b8b798 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:13.295131 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 78/153] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:57:13 2022] GET /identity/v3/role_assignments?user.id=630418688b8a4b6cb66207b368f6f37f&scope.project.id=d44324b154884c4cbb76a723c912a4e5&role.id=9d0cb59f15d2481eace97516b3b77a71 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:13.324091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad8921-22a6-478f-a273-5bb7064ee6a9 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:13.324402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad8921-22a6-478f-a273-5bb7064ee6a9 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:13.324689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad8921-22a6-478f-a273-5bb7064ee6a9 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:13.326127 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 76/154] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:13.331850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c68f-2d75-476b-8f75-fcdd78efc449 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:13.332169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c68f-2d75-476b-8f75-fcdd78efc449 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:13.332444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c68f-2d75-476b-8f75-fcdd78efc449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:13.349468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-7235c68f-2d75-476b-8f75-fcdd78efc449 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:13.350661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7235c68f-2d75-476b-8f75-fcdd78efc449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:13.437564 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 79/155] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:13.479478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad8921-22a6-478f-a273-5bb7064ee6a9 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:13.538339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff12e7-60e8-43fc-af26-91b472e4e5ab None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:13.538679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff12e7-60e8-43fc-af26-91b472e4e5ab None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:13.538913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff12e7-60e8-43fc-af26-91b472e4e5ab None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:13.540853 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 80/156] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:57:13.546059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dffcd-ff90-4f13-81a6-01cc0914316b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:13.546350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dffcd-ff90-4f13-81a6-01cc0914316b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:13.546634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dffcd-ff90-4f13-81a6-01cc0914316b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:13.577790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-593dffcd-ff90-4f13-81a6-01cc0914316b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:13.579173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-593dffcd-ff90-4f13-81a6-01cc0914316b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:13.648894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad8921-22a6-478f-a273-5bb7064ee6a9 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:13.667565 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 81/157] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:13.693395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dffcd-ff90-4f13-81a6-01cc0914316b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:13.703356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd305c34-407f-4370-8826-c558454eda8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:13.704170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd305c34-407f-4370-8826-c558454eda8f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:13.704456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd305c34-407f-4370-8826-c558454eda8f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:13.704784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd305c34-407f-4370-8826-c558454eda8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:13.706034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd305c34-407f-4370-8826-c558454eda8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:13.707569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd305c34-407f-4370-8826-c558454eda8f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:13.709596 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 77/158] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:57:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:13.714929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd305c34-407f-4370-8826-c558454eda8f None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:13.817595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dffcd-ff90-4f13-81a6-01cc0914316b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:13.826424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd305c34-407f-4370-8826-c558454eda8f None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:13.854197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f230864-3b34-41ba-bf6d-a02b784bdcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:13.855036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f230864-3b34-41ba-bf6d-a02b784bdcab None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:13.855289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f230864-3b34-41ba-bf6d-a02b784bdcab None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:13.855567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f230864-3b34-41ba-bf6d-a02b784bdcab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:13.860737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738e258-517a-4b9a-9e4f-cdd5e98c4cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:13.861413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738e258-517a-4b9a-9e4f-cdd5e98c4cc5 None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:13.862000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738e258-517a-4b9a-9e4f-cdd5e98c4cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:13.862281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738e258-517a-4b9a-9e4f-cdd5e98c4cc5 None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:13.863053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738e258-517a-4b9a-9e4f-cdd5e98c4cc5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:13.864576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738e258-517a-4b9a-9e4f-cdd5e98c4cc5 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:13.866431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f230864-3b34-41ba-bf6d-a02b784bdcab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:13.875568 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-7f230864-3b34-41ba-bf6d-a02b784bdcab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:57:13.875568 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:13.875568 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:13.875568 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:13.875568 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:13.875568 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:13.875568 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:13.875568 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:13.875568 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:13.875568 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:13.875568 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:13.875568 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:13.875568 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:13.875568 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:13.875568 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:13.875568 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:13.876578 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:13.876578 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:13.876578 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:13.876578 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:13.876578 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:13.876578 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:13.876578 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:13.876578 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:13.876578 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:13.876578 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:13.876578 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:13.876578 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:13.876578 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:13.876578 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:13.876578 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:13.876578 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:13.877566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:13.877566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:13.877566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:13.877566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:13.877566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:13.877566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:13.877566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:13.877566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:13.877566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:13.877566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:13.877566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:57:13.877566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:13.877566 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 82/159] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:57:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:57:13.884375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f230864-3b34-41ba-bf6d-a02b784bdcab None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:13.960148 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 78/160] 10.222.0.16 () {60 vars in 1132 bytes} [Mon May 2 09:57:13 2022] POST /identity/v3/users => generated 283 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 09:57:14.016513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f230864-3b34-41ba-bf6d-a02b784bdcab None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:14.055107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8c893-ae26-4869-bd9b-202762bd3fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:14.055852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8c893-ae26-4869-bd9b-202762bd3fab None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:14.056183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8c893-ae26-4869-bd9b-202762bd3fab None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:14.056467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8c893-ae26-4869-bd9b-202762bd3fab None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:14.057336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8c893-ae26-4869-bd9b-202762bd3fab None admin] RBAC: Adding query filter params (name=admin) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:14.057653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8c893-ae26-4869-bd9b-202762bd3fab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:14.059131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8c893-ae26-4869-bd9b-202762bd3fab None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:14.069436 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 83/161] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:14.075103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738e258-517a-4b9a-9e4f-cdd5e98c4cc5 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:14.112464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505e38a-21d6-48cc-b261-510f8fe3f7c8 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:14.113141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505e38a-21d6-48cc-b261-510f8fe3f7c8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:14.113674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505e38a-21d6-48cc-b261-510f8fe3f7c8 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:14.115367 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 84/162] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:57:14.125672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7d228-2047-4d74-a961-d9a82e3ecda9 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:14.125964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7d228-2047-4d74-a961-d9a82e3ecda9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:14.126251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7d228-2047-4d74-a961-d9a82e3ecda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:14.144137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-61d7d228-2047-4d74-a961-d9a82e3ecda9 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:14.145470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-61d7d228-2047-4d74-a961-d9a82e3ecda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:14.210867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738e258-517a-4b9a-9e4f-cdd5e98c4cc5 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:14.240636 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 85/163] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:57:14.262174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7d228-2047-4d74-a961-d9a82e3ecda9 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:14.263010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd702a9-1513-4801-8e36-746fc3903ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:14.263909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd702a9-1513-4801-8e36-746fc3903ccc None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:14.264201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd702a9-1513-4801-8e36-746fc3903ccc None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:14.264742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd702a9-1513-4801-8e36-746fc3903ccc None admin] PATH_INFO: `/v3/users/ac266adf0f16441aa7fe1157ada97e7b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:14.266921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd702a9-1513-4801-8e36-746fc3903ccc None admin] RBAC: Authorizing `identity:get_user(user_id=ac266adf0f16441aa7fe1157ada97e7b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:14.268414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd702a9-1513-4801-8e36-746fc3903ccc None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:14.270428 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 79/164] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:14 2022] GET /identity/v3/users/ac266adf0f16441aa7fe1157ada97e7b => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:14.276529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd702a9-1513-4801-8e36-746fc3903ccc None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:14.397821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7d228-2047-4d74-a961-d9a82e3ecda9 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:14.404396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd702a9-1513-4801-8e36-746fc3903ccc None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:14.451287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0016b-f8cb-4cc3-85b0-73ee999d3463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:14.452684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0016b-f8cb-4cc3-85b0-73ee999d3463 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:14.453467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0016b-f8cb-4cc3-85b0-73ee999d3463 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:14.454435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0016b-f8cb-4cc3-85b0-73ee999d3463 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:14.455623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ce1bd-920d-434e-b696-12c93cc236ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:14.456429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ce1bd-920d-434e-b696-12c93cc236ce None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:14.456787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ce1bd-920d-434e-b696-12c93cc236ce None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:14.457067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ce1bd-920d-434e-b696-12c93cc236ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:14.470569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ce1bd-920d-434e-b696-12c93cc236ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:14.478937 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-180ce1bd-920d-434e-b696-12c93cc236ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 02 09:57:14.478937 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:14.478937 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:14.478937 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:14.478937 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:14.478937 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:14.478937 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:14.478937 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:14.478937 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:14.478937 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:14.478937 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:14.478937 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:14.478937 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:14.478937 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:14.478937 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:14.478937 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:14.479827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:14.479827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:14.479827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:14.479827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:14.479827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:14.479827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:14.479827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:14.479827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:14.479827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:14.479827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:14.479827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:14.479827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:14.479827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:14.479827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:14.479827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:14.479827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:14.480669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:14.480669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:14.480669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:14.480669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:14.480669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:14.480669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:14.480669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:14.480669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:14.480669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:14.480669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:14.480669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 02 09:57:14.480669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:14.481744 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 86/165] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:57:14.483736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ad7ca-ff24-4752-ac7d-317d03a0ba04 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:14.483736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ad7ca-ff24-4752-ac7d-317d03a0ba04 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:14.483736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ad7ca-ff24-4752-ac7d-317d03a0ba04 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:14.488834 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 87/166] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:14.490894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ad7ca-ff24-4752-ac7d-317d03a0ba04 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:14.541214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0016b-f8cb-4cc3-85b0-73ee999d3463 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:14.542902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0016b-f8cb-4cc3-85b0-73ee999d3463 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:14.614795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ad7ca-ff24-4752-ac7d-317d03a0ba04 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:14.650333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b525d8a-62a8-4070-9915-1e8555f611a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:14.651014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b525d8a-62a8-4070-9915-1e8555f611a6 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:14.651299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b525d8a-62a8-4070-9915-1e8555f611a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:14.651580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b525d8a-62a8-4070-9915-1e8555f611a6 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:14.652341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b525d8a-62a8-4070-9915-1e8555f611a6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:14.652671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b525d8a-62a8-4070-9915-1e8555f611a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:14.654258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b525d8a-62a8-4070-9915-1e8555f611a6 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:14.662841 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 88/167] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:14.664137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e608c3-1dfd-43f7-bf7b-370eeb7cd0f4 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:14.664430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e608c3-1dfd-43f7-bf7b-370eeb7cd0f4 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:14.664794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e608c3-1dfd-43f7-bf7b-370eeb7cd0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:14.670035 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 80/168] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:14.672169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0016b-f8cb-4cc3-85b0-73ee999d3463 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:14.682444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-92e608c3-1dfd-43f7-bf7b-370eeb7cd0f4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:14.683686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-92e608c3-1dfd-43f7-bf7b-370eeb7cd0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:14.774014 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 89/169] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:14.776781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e608c3-1dfd-43f7-bf7b-370eeb7cd0f4 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:14.794986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0016b-f8cb-4cc3-85b0-73ee999d3463 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:14.833289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a5de4-e7f4-4f67-8c15-e7ba1174c80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:14.835175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a5de4-e7f4-4f67-8c15-e7ba1174c80a None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:14.835819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a5de4-e7f4-4f67-8c15-e7ba1174c80a None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:14.837908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a5de4-e7f4-4f67-8c15-e7ba1174c80a None admin] PATH_INFO: `/v3/users/e8cebfd1c2914e979e00fef78426117a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:14.840516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a5de4-e7f4-4f67-8c15-e7ba1174c80a None admin] RBAC: Authorizing `identity:get_user(user_id=e8cebfd1c2914e979e00fef78426117a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:14.844062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a5de4-e7f4-4f67-8c15-e7ba1174c80a None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:14.846552 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 81/170] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:14 2022] GET /identity/v3/users/e8cebfd1c2914e979e00fef78426117a => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:14.847537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a5de4-e7f4-4f67-8c15-e7ba1174c80a None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:14.967255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e608c3-1dfd-43f7-bf7b-370eeb7cd0f4 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:15.022105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a5de4-e7f4-4f67-8c15-e7ba1174c80a None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:15.033364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edd763-a03f-4b7b-b3d4-596293eb4bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:15.034419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edd763-a03f-4b7b-b3d4-596293eb4bcd None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:15.034419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edd763-a03f-4b7b-b3d4-596293eb4bcd None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:15.034709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edd763-a03f-4b7b-b3d4-596293eb4bcd None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:15.035957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edd763-a03f-4b7b-b3d4-596293eb4bcd None admin] RBAC: Authorizing `identity:get_project(project_id=d44324b154884c4cbb76a723c912a4e5)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:15.037375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edd763-a03f-4b7b-b3d4-596293eb4bcd None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:15.039077 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 90/171] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:14 2022] GET /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:15.039835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edd763-a03f-4b7b-b3d4-596293eb4bcd None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:15.060129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865a2d8-cffe-43cb-a551-0d9990b5c4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:15.061341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865a2d8-cffe-43cb-a551-0d9990b5c4d0 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:15.061828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865a2d8-cffe-43cb-a551-0d9990b5c4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:15.062303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865a2d8-cffe-43cb-a551-0d9990b5c4d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:15.077513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865a2d8-cffe-43cb-a551-0d9990b5c4d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:15.091886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-6865a2d8-cffe-43cb-a551-0d9990b5c4d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:15.091886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:15.091886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:15.091886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:15.091886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:15.091886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:15.091886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:15.091886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:15.091886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:15.091886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:15.091886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:15.091886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:15.091886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:15.091886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:15.091886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:15.091886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:15.092868 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:15.092868 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:15.092868 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:15.092868 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:15.092868 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:15.092868 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:15.092868 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:15.092868 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:15.092868 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:15.092868 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:15.092868 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:15.092868 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:57:15.092868 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:15.092868 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:15.092868 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:15.092868 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:15.093935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:15.093935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:15.093935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:15.093935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:15.093935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:15.093935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:15.093935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:15.093935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:15.093935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:15.093935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:15.093935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:15.093935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:15.099809 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 82/172] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:15.104004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865a2d8-cffe-43cb-a551-0d9990b5c4d0 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:15.245907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edd763-a03f-4b7b-b3d4-596293eb4bcd None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:15.271410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865a2d8-cffe-43cb-a551-0d9990b5c4d0 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:15.305852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197ccf7-899e-4be3-86b0-cfb5387f3af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:15.306474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197ccf7-899e-4be3-86b0-cfb5387f3af6 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:15.306759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197ccf7-899e-4be3-86b0-cfb5387f3af6 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:15.307038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197ccf7-899e-4be3-86b0-cfb5387f3af6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:15.307872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197ccf7-899e-4be3-86b0-cfb5387f3af6 None admin] RBAC: Adding query filter params (role.id=dd8a47ade22941849ebdf8fbdf994b66, scope.project.id=d44324b154884c4cbb76a723c912a4e5, user.id=ac266adf0f16441aa7fe1157ada97e7b) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:15.308187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197ccf7-899e-4be3-86b0-cfb5387f3af6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:15.309694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197ccf7-899e-4be3-86b0-cfb5387f3af6 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:15.315861 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 83/173] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:57:15 2022] GET /identity/v3/role_assignments?user.id=ac266adf0f16441aa7fe1157ada97e7b&scope.project.id=d44324b154884c4cbb76a723c912a4e5&role.id=dd8a47ade22941849ebdf8fbdf994b66 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:15.316702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197ccf7-899e-4be3-86b0-cfb5387f3af6 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:15.331045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cfe9f-1802-4355-8b2f-4ed7f4f50e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:15.331936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cfe9f-1802-4355-8b2f-4ed7f4f50e17 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:15.332222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cfe9f-1802-4355-8b2f-4ed7f4f50e17 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:15.332511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cfe9f-1802-4355-8b2f-4ed7f4f50e17 None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:15.341399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cfe9f-1802-4355-8b2f-4ed7f4f50e17 None admin] RBAC: Authorizing `identity:get_project(project_id=d44324b154884c4cbb76a723c912a4e5)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:15.342870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cfe9f-1802-4355-8b2f-4ed7f4f50e17 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:15.344633 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 91/174] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:15 2022] GET /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5 => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:15.350759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cfe9f-1802-4355-8b2f-4ed7f4f50e17 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:15.467511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197ccf7-899e-4be3-86b0-cfb5387f3af6 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:15.541652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b93a73-701e-4329-914c-c3ed574780be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:15.542343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b93a73-701e-4329-914c-c3ed574780be None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:15.543039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b93a73-701e-4329-914c-c3ed574780be None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:15.543346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b93a73-701e-4329-914c-c3ed574780be None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:15.544128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b93a73-701e-4329-914c-c3ed574780be None admin] RBAC: Adding query filter params (name=member) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:15.544439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b93a73-701e-4329-914c-c3ed574780be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:15.545940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b93a73-701e-4329-914c-c3ed574780be None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:15.562562 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 84/175] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:15.568327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b93a73-701e-4329-914c-c3ed574780be None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:15.604554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cfe9f-1802-4355-8b2f-4ed7f4f50e17 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:15.675330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2bb96-fb9f-4477-a2ee-1a15364aa3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:15.676229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2bb96-fb9f-4477-a2ee-1a15364aa3c2 None admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:15.676512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2bb96-fb9f-4477-a2ee-1a15364aa3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:15.676879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2bb96-fb9f-4477-a2ee-1a15364aa3c2 None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5/users/e8cebfd1c2914e979e00fef78426117a/roles/1325eb2a84a1482fade3efa8dbe3cfbf` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:15.678955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2bb96-fb9f-4477-a2ee-1a15364aa3c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d44324b154884c4cbb76a723c912a4e5, user_id=e8cebfd1c2914e979e00fef78426117a, role_id=1325eb2a84a1482fade3efa8dbe3cfbf)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:15.680402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2bb96-fb9f-4477-a2ee-1a15364aa3c2 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:15.730948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b93a73-701e-4329-914c-c3ed574780be None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:15.760111 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 92/176] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 09:57:15 2022] PUT /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5/users/e8cebfd1c2914e979e00fef78426117a/roles/1325eb2a84a1482fade3efa8dbe3cfbf => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 09:57:15.781217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad872246-ce09-4c4c-9574-a5ec816f5b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:15.782276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad872246-ce09-4c4c-9574-a5ec816f5b14 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:15.782566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad872246-ce09-4c4c-9574-a5ec816f5b14 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:15.782842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad872246-ce09-4c4c-9574-a5ec816f5b14 None admin] PATH_INFO: `/v3/users/630418688b8a4b6cb66207b368f6f37f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:15.785462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad872246-ce09-4c4c-9574-a5ec816f5b14 None admin] RBAC: Authorizing `identity:get_user(user_id=630418688b8a4b6cb66207b368f6f37f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:15.786971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad872246-ce09-4c4c-9574-a5ec816f5b14 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:15.788904 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 85/177] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:15 2022] GET /identity/v3/users/630418688b8a4b6cb66207b368f6f37f => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:15.795290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2bb96-fb9f-4477-a2ee-1a15364aa3c2 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:15.957917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2bb96-fb9f-4477-a2ee-1a15364aa3c2 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:16.002013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7151e-32ad-45d1-8565-78a016778f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:16.002665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7151e-32ad-45d1-8565-78a016778f67 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:16.002949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7151e-32ad-45d1-8565-78a016778f67 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:16.003222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7151e-32ad-45d1-8565-78a016778f67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:16.097465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7151e-32ad-45d1-8565-78a016778f67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:16.097767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7151e-32ad-45d1-8565-78a016778f67 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:16.226465 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 93/178] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:16.233011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad872246-ce09-4c4c-9574-a5ec816f5b14 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:16.350866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad872246-ce09-4c4c-9574-a5ec816f5b14 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:16.388949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b8287-4436-4d7e-a40f-55641551aaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:16.389818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b8287-4436-4d7e-a40f-55641551aaf2 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:16.390101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b8287-4436-4d7e-a40f-55641551aaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:16.390383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b8287-4436-4d7e-a40f-55641551aaf2 None admin] PATH_INFO: `/v3/projects/c413384d8fdc4d86bc748f878f3ff7bf` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:16.397306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b8287-4436-4d7e-a40f-55641551aaf2 None admin] RBAC: Authorizing `identity:get_project(project_id=c413384d8fdc4d86bc748f878f3ff7bf)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:16.398762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b8287-4436-4d7e-a40f-55641551aaf2 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:16.401389 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 86/179] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:16 2022] GET /identity/v3/projects/c413384d8fdc4d86bc748f878f3ff7bf => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:16.408849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7151e-32ad-45d1-8565-78a016778f67 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:16.508037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7151e-32ad-45d1-8565-78a016778f67 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:16.542793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ab1d7-655e-4992-84ac-32ca8164a848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:16.546313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ab1d7-655e-4992-84ac-32ca8164a848 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:16.546313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ab1d7-655e-4992-84ac-32ca8164a848 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:16.546313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ab1d7-655e-4992-84ac-32ca8164a848 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:16.546313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5ab1d7-655e-4992-84ac-32ca8164a848 None admin] RBAC: Adding query filter params (role.id=d1592d47a67b4f4a8d14e2101c799509, scope.project.id=c413384d8fdc4d86bc748f878f3ff7bf, user.id=630418688b8a4b6cb66207b368f6f37f) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:16.546313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5ab1d7-655e-4992-84ac-32ca8164a848 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:16.547242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5ab1d7-655e-4992-84ac-32ca8164a848 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:16.553248 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 94/180] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:57:16 2022] GET /identity/v3/role_assignments?user.id=630418688b8a4b6cb66207b368f6f37f&scope.project.id=c413384d8fdc4d86bc748f878f3ff7bf&role.id=d1592d47a67b4f4a8d14e2101c799509 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:17.075364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b11b0e-d446-4544-a621-95b42ae36d53 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:17.075873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b11b0e-d446-4544-a621-95b42ae36d53 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:17.075972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b11b0e-d446-4544-a621-95b42ae36d53 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:17.077621 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 87/181] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:17.082941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c12263-c774-438f-a11b-8a91a6ce3924 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:17.083384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c12263-c774-438f-a11b-8a91a6ce3924 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:17.083565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c12263-c774-438f-a11b-8a91a6ce3924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:17.105398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c9c12263-c774-438f-a11b-8a91a6ce3924 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:17.106640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c9c12263-c774-438f-a11b-8a91a6ce3924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:17.132088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b704902-d376-417e-a5be-ab528dbe5512 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:17.132373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b704902-d376-417e-a5be-ab528dbe5512 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:17.132691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b704902-d376-417e-a5be-ab528dbe5512 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:17.134427 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 88/182] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:57:17.146680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b6cc7-06ed-4c1c-8cb4-53a8c69e5949 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:17.146991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b6cc7-06ed-4c1c-8cb4-53a8c69e5949 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:17.147244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b6cc7-06ed-4c1c-8cb4-53a8c69e5949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:17.168746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-050b6cc7-06ed-4c1c-8cb4-53a8c69e5949 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:17.169933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-050b6cc7-06ed-4c1c-8cb4-53a8c69e5949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:17.187158 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 95/183] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:17.216236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c12263-c774-438f-a11b-8a91a6ce3924 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:17.246061 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 89/184] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:57:17.279117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b6cc7-06ed-4c1c-8cb4-53a8c69e5949 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:17.323764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c12263-c774-438f-a11b-8a91a6ce3924 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:17.359120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bd6e8-aa76-49ba-a3d2-8b22150e2481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:17.359840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bd6e8-aa76-49ba-a3d2-8b22150e2481 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:17.360119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bd6e8-aa76-49ba-a3d2-8b22150e2481 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:17.360391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bd6e8-aa76-49ba-a3d2-8b22150e2481 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:17.370989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bd6e8-aa76-49ba-a3d2-8b22150e2481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:17.378383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b6cc7-06ed-4c1c-8cb4-53a8c69e5949 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:17.378509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-3f5bd6e8-aa76-49ba-a3d2-8b22150e2481 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:57:17.378509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:17.378509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:17.378509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:17.378509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:17.378509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:17.378509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:17.378509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:17.378509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:17.378509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:17.378509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:17.378509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:17.378509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:17.378509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:17.378509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:17.378509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:17.379529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:17.379529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:17.379529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:17.379529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:17.379529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:17.379529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:17.379529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:17.379529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:17.379529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:17.379529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:17.379529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:17.379529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:17.379529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:17.379529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:17.379529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:17.379529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:17.380348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:17.380348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:17.380348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:17.380348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:17.380348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:17.380348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:17.380348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:17.380348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:17.380348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:17.380348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:17.380348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:57:17.380348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:17.380348 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 96/185] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:57:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:57:17.381049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee869e6-0257-4c05-be6a-65c5ba8be967 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:17.387191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee869e6-0257-4c05-be6a-65c5ba8be967 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:17.387191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee869e6-0257-4c05-be6a-65c5ba8be967 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:17.387191 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 97/186] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:17.387191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee869e6-0257-4c05-be6a-65c5ba8be967 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:17.418102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab027b5d-c5fd-4c61-83f2-a3fac3e812f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:17.418908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab027b5d-c5fd-4c61-83f2-a3fac3e812f6 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:17.419187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab027b5d-c5fd-4c61-83f2-a3fac3e812f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:17.419459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab027b5d-c5fd-4c61-83f2-a3fac3e812f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:17.429065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab027b5d-c5fd-4c61-83f2-a3fac3e812f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:17.436915 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-ab027b5d-c5fd-4c61-83f2-a3fac3e812f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:17.436915 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:17.436915 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:17.436915 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:17.436915 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:17.436915 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:17.436915 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:17.436915 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:17.436915 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:17.436915 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:17.436915 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:17.436915 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:17.436915 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:17.436915 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:17.436915 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:17.436915 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:17.437800 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:17.437800 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:17.437800 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:17.437800 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:17.437800 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:17.437800 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:17.437800 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:17.437800 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:17.437800 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:17.437800 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:17.437800 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:17.437800 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:57:17.437800 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:17.437800 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:17.437800 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:17.437800 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:17.443789 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:17.443789 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:17.443789 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:17.443789 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:17.443789 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:17.443789 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:17.443789 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:17.443789 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:17.443789 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:17.443789 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:17.443789 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:17.443789 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:17.443789 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 90/187] 10.222.0.16 () {56 vars in 1114 bytes} [Mon May 2 09:57:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:57:17.443789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e316ca-2d15-48a5-b064-83b559de0e05 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:17.444515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e316ca-2d15-48a5-b064-83b559de0e05 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:17.444515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e316ca-2d15-48a5-b064-83b559de0e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:17.459036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d3e316ca-2d15-48a5-b064-83b559de0e05 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:17.460215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d3e316ca-2d15-48a5-b064-83b559de0e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:17.490656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee869e6-0257-4c05-be6a-65c5ba8be967 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:17.524483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893eac4-3b90-477a-bb72-73e17be3435c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:17.525731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893eac4-3b90-477a-bb72-73e17be3435c None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:17.526022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893eac4-3b90-477a-bb72-73e17be3435c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:17.526117 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 91/188] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:17.526327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893eac4-3b90-477a-bb72-73e17be3435c None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:17.527089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893eac4-3b90-477a-bb72-73e17be3435c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:17.527475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893eac4-3b90-477a-bb72-73e17be3435c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:17.528891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893eac4-3b90-477a-bb72-73e17be3435c None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:17.534791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e316ca-2d15-48a5-b064-83b559de0e05 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:17.539526 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 98/189] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:17.552552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893eac4-3b90-477a-bb72-73e17be3435c None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:17.640896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e316ca-2d15-48a5-b064-83b559de0e05 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:17.647221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893eac4-3b90-477a-bb72-73e17be3435c None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:17.675881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4499af-7534-44fb-97b2-9f24625cb806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:17.676543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4499af-7534-44fb-97b2-9f24625cb806 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:17.676878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4499af-7534-44fb-97b2-9f24625cb806 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:17.677155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4499af-7534-44fb-97b2-9f24625cb806 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:17.677896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4499af-7534-44fb-97b2-9f24625cb806 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:17.678203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4499af-7534-44fb-97b2-9f24625cb806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:17.678849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdd591-83b1-427e-b4f9-452b5a971466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:17.679574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4499af-7534-44fb-97b2-9f24625cb806 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:17.679741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdd591-83b1-427e-b4f9-452b5a971466 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:17.679992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdd591-83b1-427e-b4f9-452b5a971466 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:17.680262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdd591-83b1-427e-b4f9-452b5a971466 None admin] PATH_INFO: `/v3/users/9794438a6e024a8cad58f164c84072cb` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:17.692460 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 92/190] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:57:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:17.692460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4499af-7534-44fb-97b2-9f24625cb806 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:17.694186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bdd591-83b1-427e-b4f9-452b5a971466 None admin] RBAC: Authorizing `identity:get_user(user_id=9794438a6e024a8cad58f164c84072cb)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:17.695661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bdd591-83b1-427e-b4f9-452b5a971466 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:17.702225 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 99/191] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:17 2022] GET /identity/v3/users/9794438a6e024a8cad58f164c84072cb => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:17.702225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdd591-83b1-427e-b4f9-452b5a971466 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:17.788209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4499af-7534-44fb-97b2-9f24625cb806 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:17.796378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdd591-83b1-427e-b4f9-452b5a971466 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:17.819667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f158af-0c81-4e5e-9c26-804f33e132d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:17.820458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f158af-0c81-4e5e-9c26-804f33e132d2 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:17.820770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f158af-0c81-4e5e-9c26-804f33e132d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:17.821046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f158af-0c81-4e5e-9c26-804f33e132d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:17.822826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f158af-0c81-4e5e-9c26-804f33e132d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:17.824261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f158af-0c81-4e5e-9c26-804f33e132d2 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:17.830291 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 93/192] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:57:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:17.830291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f158af-0c81-4e5e-9c26-804f33e132d2 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:17.834084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee2d50-b0ef-4f67-adcd-73f680928c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:17.834964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee2d50-b0ef-4f67-adcd-73f680928c0e None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:17.835255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee2d50-b0ef-4f67-adcd-73f680928c0e None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:17.835539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee2d50-b0ef-4f67-adcd-73f680928c0e None admin] PATH_INFO: `/v3/users/9794438a6e024a8cad58f164c84072cb` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:17.836781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee2d50-b0ef-4f67-adcd-73f680928c0e None admin] RBAC: Authorizing `identity:get_user(user_id=9794438a6e024a8cad58f164c84072cb)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:17.838258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee2d50-b0ef-4f67-adcd-73f680928c0e None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:17.840046 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 100/193] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:17 2022] GET /identity/v3/users/9794438a6e024a8cad58f164c84072cb => generated 283 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:17.844967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee2d50-b0ef-4f67-adcd-73f680928c0e None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:17.925173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f158af-0c81-4e5e-9c26-804f33e132d2 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:17.940206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee2d50-b0ef-4f67-adcd-73f680928c0e None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:17.956798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f4e92-7e67-418a-8441-6afc9253319b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:17.957449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f4e92-7e67-418a-8441-6afc9253319b None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:17.957731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f4e92-7e67-418a-8441-6afc9253319b None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:17.958009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f4e92-7e67-418a-8441-6afc9253319b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:17.972953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bba6f5-d2f1-4d00-aa66-d6e5f25f05f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:17.973724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bba6f5-d2f1-4d00-aa66-d6e5f25f05f9 None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:17.974004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bba6f5-d2f1-4d00-aa66-d6e5f25f05f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:17.974280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bba6f5-d2f1-4d00-aa66-d6e5f25f05f9 None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:17.975022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bba6f5-d2f1-4d00-aa66-d6e5f25f05f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:17.976453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bba6f5-d2f1-4d00-aa66-d6e5f25f05f9 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:18.023237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f4e92-7e67-418a-8441-6afc9253319b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:18.024807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f4e92-7e67-418a-8441-6afc9253319b None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:18.074283 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 101/194] 10.222.0.16 () {60 vars in 1132 bytes} [Mon May 2 09:57:17 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:57:18.075178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bba6f5-d2f1-4d00-aa66-d6e5f25f05f9 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:18.141165 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 94/195] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:18.142558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f4e92-7e67-418a-8441-6afc9253319b None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:18.196036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bba6f5-d2f1-4d00-aa66-d6e5f25f05f9 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:18.233936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5e6aa-429c-417a-bece-c90907d3c2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:18.235089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5e6aa-429c-417a-bece-c90907d3c2d6 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:18.235638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5e6aa-429c-417a-bece-c90907d3c2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:18.236129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5e6aa-429c-417a-bece-c90907d3c2d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:18.264711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f4e92-7e67-418a-8441-6afc9253319b None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:18.317005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86d676-d7d3-4c72-b2fe-d052ed32573c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:18.317888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86d676-d7d3-4c72-b2fe-d052ed32573c None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:18.318173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86d676-d7d3-4c72-b2fe-d052ed32573c None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:18.318488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86d676-d7d3-4c72-b2fe-d052ed32573c None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:18.320483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86d676-d7d3-4c72-b2fe-d052ed32573c None admin] RBAC: Authorizing `identity:get_project(project_id=de9cf9f9d50e4932a34fb509a4d47ce6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:18.322745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86d676-d7d3-4c72-b2fe-d052ed32573c None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:18.324682 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 95/196] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:18 2022] GET /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:18.330481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5e6aa-429c-417a-bece-c90907d3c2d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:18.331983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5e6aa-429c-417a-bece-c90907d3c2d6 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:18.333111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86d676-d7d3-4c72-b2fe-d052ed32573c None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:18.448218 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 102/197] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:18.448383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86d676-d7d3-4c72-b2fe-d052ed32573c None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:18.455486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5e6aa-429c-417a-bece-c90907d3c2d6 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:18.491290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b57fe-4b8c-4723-9e66-f0e852619d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:18.491965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b57fe-4b8c-4723-9e66-f0e852619d4c None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:18.492249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b57fe-4b8c-4723-9e66-f0e852619d4c None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:18.492817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b57fe-4b8c-4723-9e66-f0e852619d4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:18.495559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b57fe-4b8c-4723-9e66-f0e852619d4c None admin] RBAC: Adding query filter params (role.id=dd8a47ade22941849ebdf8fbdf994b66, scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6, user.id=9794438a6e024a8cad58f164c84072cb) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:18.495559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b57fe-4b8c-4723-9e66-f0e852619d4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:18.495559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b57fe-4b8c-4723-9e66-f0e852619d4c None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:18.501507 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 96/198] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:57:18 2022] GET /identity/v3/role_assignments?user.id=9794438a6e024a8cad58f164c84072cb&scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6&role.id=dd8a47ade22941849ebdf8fbdf994b66 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:18.520781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f9a36-efb2-445c-a247-397d95a39bf5 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:18.521427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f9a36-efb2-445c-a247-397d95a39bf5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:18.521946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f9a36-efb2-445c-a247-397d95a39bf5 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:18.523579 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 97/199] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:57:18.530463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665591b8-9c7c-452f-833a-b6b5639b54bc None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:18.530817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665591b8-9c7c-452f-833a-b6b5639b54bc None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:18.531027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665591b8-9c7c-452f-833a-b6b5639b54bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:18.549254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-665591b8-9c7c-452f-833a-b6b5639b54bc None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:18.550484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-665591b8-9c7c-452f-833a-b6b5639b54bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:18.570587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5e6aa-429c-417a-bece-c90907d3c2d6 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:18.607581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319f27c-46a0-4237-991a-9b8ef75f2b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:18.608458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319f27c-46a0-4237-991a-9b8ef75f2b59 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:18.608789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319f27c-46a0-4237-991a-9b8ef75f2b59 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:18.609067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319f27c-46a0-4237-991a-9b8ef75f2b59 None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:18.610337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319f27c-46a0-4237-991a-9b8ef75f2b59 None admin] RBAC: Authorizing `identity:get_project(project_id=de9cf9f9d50e4932a34fb509a4d47ce6)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:18.612123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319f27c-46a0-4237-991a-9b8ef75f2b59 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:18.614296 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 103/200] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:18 2022] GET /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:18.624633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319f27c-46a0-4237-991a-9b8ef75f2b59 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:18.634106 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 98/201] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:57:18.671358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665591b8-9c7c-452f-833a-b6b5639b54bc None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:18.728340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319f27c-46a0-4237-991a-9b8ef75f2b59 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:18.763802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38393186-9447-4f64-8247-ea9665b81799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:18.764461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38393186-9447-4f64-8247-ea9665b81799 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:18.764785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38393186-9447-4f64-8247-ea9665b81799 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:18.765062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38393186-9447-4f64-8247-ea9665b81799 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:18.765899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38393186-9447-4f64-8247-ea9665b81799 None admin] RBAC: Adding query filter params (role.id=9d0cb59f15d2481eace97516b3b77a71, scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6, user.id=9794438a6e024a8cad58f164c84072cb) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:18.766213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38393186-9447-4f64-8247-ea9665b81799 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:18.767783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38393186-9447-4f64-8247-ea9665b81799 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:18.774468 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 104/202] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:57:18 2022] GET /identity/v3/role_assignments?user.id=9794438a6e024a8cad58f164c84072cb&scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6&role.id=9d0cb59f15d2481eace97516b3b77a71 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:18.819370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665591b8-9c7c-452f-833a-b6b5639b54bc None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:18.868002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c165dc-f197-4d47-93e3-943aaba944f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:18.868889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c165dc-f197-4d47-93e3-943aaba944f4 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:18.869169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c165dc-f197-4d47-93e3-943aaba944f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:18.869443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c165dc-f197-4d47-93e3-943aaba944f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:18.884787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c165dc-f197-4d47-93e3-943aaba944f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:18.892543 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-59c165dc-f197-4d47-93e3-943aaba944f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 02 09:57:18.892543 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:18.892543 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:18.892543 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:18.892543 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:18.892543 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:18.892543 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:18.892543 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:18.892543 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:18.892543 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:18.892543 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:18.892543 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:18.892543 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:18.892543 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:18.892543 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:18.892543 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:18.893428 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:18.893428 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:18.893428 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:18.893428 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:18.893428 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:18.893428 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:18.893428 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:18.893428 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:18.893428 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:18.893428 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:18.893428 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:18.893428 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:57:18.893428 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:18.893428 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:18.893428 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:18.893428 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:18.894216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:18.894216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:18.894216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:18.894216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:18.894216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:18.894216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:18.894216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:18.894216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:18.894216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:18.894216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:18.894216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 02 09:57:18.894216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:18.894216 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 99/203] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:57:18.901741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38393186-9447-4f64-8247-ea9665b81799 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:19.005787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38393186-9447-4f64-8247-ea9665b81799 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:19.040941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63e697-7189-49f1-8494-5e9d5d6c66f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:19.041623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63e697-7189-49f1-8494-5e9d5d6c66f3 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:19.041906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63e697-7189-49f1-8494-5e9d5d6c66f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:19.042178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63e697-7189-49f1-8494-5e9d5d6c66f3 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:19.042997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63e697-7189-49f1-8494-5e9d5d6c66f3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:19.043306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63e697-7189-49f1-8494-5e9d5d6c66f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:19.044770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63e697-7189-49f1-8494-5e9d5d6c66f3 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:19.053944 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 105/204] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:19.060196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c165dc-f197-4d47-93e3-943aaba944f4 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:19.196307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c165dc-f197-4d47-93e3-943aaba944f4 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:19.230958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6ac89-4d9f-41fa-8e6b-1ef9faa6c2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:19.231827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6ac89-4d9f-41fa-8e6b-1ef9faa6c2e4 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:19.232162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6ac89-4d9f-41fa-8e6b-1ef9faa6c2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:19.232448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6ac89-4d9f-41fa-8e6b-1ef9faa6c2e4 None admin] PATH_INFO: `/v3/users/e8cebfd1c2914e979e00fef78426117a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:19.233702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6ac89-4d9f-41fa-8e6b-1ef9faa6c2e4 None admin] RBAC: Authorizing `identity:get_user(user_id=e8cebfd1c2914e979e00fef78426117a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:19.235175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6ac89-4d9f-41fa-8e6b-1ef9faa6c2e4 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:19.237101 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 100/205] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:19 2022] GET /identity/v3/users/e8cebfd1c2914e979e00fef78426117a => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:19.242778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63e697-7189-49f1-8494-5e9d5d6c66f3 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:19.347298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63e697-7189-49f1-8494-5e9d5d6c66f3 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:19.380230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dcbf3-da85-460d-9a48-c14853142d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:19.380931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dcbf3-da85-460d-9a48-c14853142d22 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:19.381220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dcbf3-da85-460d-9a48-c14853142d22 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:19.381503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dcbf3-da85-460d-9a48-c14853142d22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:19.449440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dcbf3-da85-460d-9a48-c14853142d22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:19.450924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dcbf3-da85-460d-9a48-c14853142d22 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:19.549335 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 106/206] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:19.554903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6ac89-4d9f-41fa-8e6b-1ef9faa6c2e4 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:19.654665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6ac89-4d9f-41fa-8e6b-1ef9faa6c2e4 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:19.688661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1cdac-2e3f-4d2f-b04c-d1f1f2620aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:19.689551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1cdac-2e3f-4d2f-b04c-d1f1f2620aea None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:19.689845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1cdac-2e3f-4d2f-b04c-d1f1f2620aea None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:19.690125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1cdac-2e3f-4d2f-b04c-d1f1f2620aea None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:19.691337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1cdac-2e3f-4d2f-b04c-d1f1f2620aea None admin] RBAC: Authorizing `identity:get_project(project_id=d44324b154884c4cbb76a723c912a4e5)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:19.692822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1cdac-2e3f-4d2f-b04c-d1f1f2620aea None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:19.694537 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 101/207] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:19 2022] GET /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:19.700384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dcbf3-da85-460d-9a48-c14853142d22 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:19.802745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dcbf3-da85-460d-9a48-c14853142d22 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:19.836693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e3209-b51d-4055-af44-98086ed8f681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:19.837896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e3209-b51d-4055-af44-98086ed8f681 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:19.838184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e3209-b51d-4055-af44-98086ed8f681 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:19.838465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e3209-b51d-4055-af44-98086ed8f681 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:19.839311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e3209-b51d-4055-af44-98086ed8f681 None admin] RBAC: Adding query filter params (role.id=1325eb2a84a1482fade3efa8dbe3cfbf, scope.project.id=d44324b154884c4cbb76a723c912a4e5, user.id=e8cebfd1c2914e979e00fef78426117a) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:19.839627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e3209-b51d-4055-af44-98086ed8f681 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:19.841117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e3209-b51d-4055-af44-98086ed8f681 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:19.847177 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 107/208] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:57:19 2022] GET /identity/v3/role_assignments?user.id=e8cebfd1c2914e979e00fef78426117a&scope.project.id=d44324b154884c4cbb76a723c912a4e5&role.id=1325eb2a84a1482fade3efa8dbe3cfbf => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:20.998196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa60291-fcfa-4cbb-a894-ad23f935c694 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:20.998922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa60291-fcfa-4cbb-a894-ad23f935c694 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:20.998922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa60291-fcfa-4cbb-a894-ad23f935c694 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:21.000370 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 102/209] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:21.005866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c4f27-ff29-4d6a-9cbc-46670202f1a2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:21.006752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c4f27-ff29-4d6a-9cbc-46670202f1a2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:21.007258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c4f27-ff29-4d6a-9cbc-46670202f1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:21.024460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-946c4f27-ff29-4d6a-9cbc-46670202f1a2 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:21.026064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-946c4f27-ff29-4d6a-9cbc-46670202f1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:21.098975 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 108/210] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:21.129928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa60291-fcfa-4cbb-a894-ad23f935c694 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:21.154584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adcc3e-1371-4e6a-8439-147ce3f17926 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:21.154881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adcc3e-1371-4e6a-8439-147ce3f17926 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:21.155994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adcc3e-1371-4e6a-8439-147ce3f17926 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:21.157713 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 109/211] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:57:21.164175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65731879-26b7-43b5-84c8-ee6bf28fd5e7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:21.164746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65731879-26b7-43b5-84c8-ee6bf28fd5e7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:21.165760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65731879-26b7-43b5-84c8-ee6bf28fd5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:21.183806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-65731879-26b7-43b5-84c8-ee6bf28fd5e7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:21.185393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-65731879-26b7-43b5-84c8-ee6bf28fd5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:21.241491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa60291-fcfa-4cbb-a894-ad23f935c694 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:21.258159 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 110/212] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:57:21.279540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb053a-2d7c-4993-8eac-5a559b63fad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:21.280826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb053a-2d7c-4993-8eac-5a559b63fad6 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:21.281344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb053a-2d7c-4993-8eac-5a559b63fad6 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:21.281835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb053a-2d7c-4993-8eac-5a559b63fad6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:21.285014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65731879-26b7-43b5-84c8-ee6bf28fd5e7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:21.299275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb053a-2d7c-4993-8eac-5a559b63fad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:21.309172 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-65bb053a-2d7c-4993-8eac-5a559b63fad6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:21.309172 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:21.309172 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:21.309172 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:21.309172 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:21.309172 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:21.309172 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:21.309172 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:21.309172 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:21.309172 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:21.309172 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:21.309172 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:21.309172 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:21.309172 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:21.309172 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:21.309172 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:21.310135 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:21.310135 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:21.310135 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:21.310135 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:21.310135 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:21.310135 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:21.310135 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:21.310135 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:21.310135 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:21.310135 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:21.310135 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:21.310135 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:57:21.310135 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:21.310135 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:21.310135 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:21.310135 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:21.310947 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:21.310947 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:21.310947 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:21.310947 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:21.310947 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:21.310947 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:21.310947 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:21.310947 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:21.310947 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:21.310947 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:21.310947 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:21.310947 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:21.310947 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 103/213] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:21.317693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb053a-2d7c-4993-8eac-5a559b63fad6 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:21.389842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65731879-26b7-43b5-84c8-ee6bf28fd5e7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:21.419830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb053a-2d7c-4993-8eac-5a559b63fad6 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:21.424930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6a6d4-622b-4e4c-b31e-3b7d702fa82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:21.425738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6a6d4-622b-4e4c-b31e-3b7d702fa82e None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:21.426022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6a6d4-622b-4e4c-b31e-3b7d702fa82e None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:21.426300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6a6d4-622b-4e4c-b31e-3b7d702fa82e None admin] PATH_INFO: `/v3/domains/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:21.427661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6a6d4-622b-4e4c-b31e-3b7d702fa82e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:21.429141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6a6d4-622b-4e4c-b31e-3b7d702fa82e None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:21.430803 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 111/214] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:57:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:21.432717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43131a2e-ef79-4a0f-8952-334f72f40956 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:21.432717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43131a2e-ef79-4a0f-8952-334f72f40956 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:21.432717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43131a2e-ef79-4a0f-8952-334f72f40956 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:21.433903 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 112/215] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:21.438436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43131a2e-ef79-4a0f-8952-334f72f40956 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:21.457136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7441a-9bc4-4819-8a8c-721af26a7f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:21.457815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7441a-9bc4-4819-8a8c-721af26a7f4b None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:21.458069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7441a-9bc4-4819-8a8c-721af26a7f4b None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:21.458396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7441a-9bc4-4819-8a8c-721af26a7f4b None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:21.459149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7441a-9bc4-4819-8a8c-721af26a7f4b None admin] RBAC: Adding query filter params (name=member) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:21.459453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7441a-9bc4-4819-8a8c-721af26a7f4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:21.460883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7441a-9bc4-4819-8a8c-721af26a7f4b None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:21.469715 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 104/216] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:21.470968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04811dcb-db6f-431b-bebf-ddae1afe514e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:21.471257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04811dcb-db6f-431b-bebf-ddae1afe514e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:21.471534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04811dcb-db6f-431b-bebf-ddae1afe514e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:21.487961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-04811dcb-db6f-431b-bebf-ddae1afe514e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:21.489163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-04811dcb-db6f-431b-bebf-ddae1afe514e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:21.536161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43131a2e-ef79-4a0f-8952-334f72f40956 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:21.551399 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 105/217] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:21.552718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5051554-48f8-4c9e-adc3-87b7b64ceb56 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:21.553018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5051554-48f8-4c9e-adc3-87b7b64ceb56 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:21.553301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5051554-48f8-4c9e-adc3-87b7b64ceb56 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:21.554573 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 106/218] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:21.556745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5051554-48f8-4c9e-adc3-87b7b64ceb56 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:21.581711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82001754-5766-4c3d-9c7b-aada6a350d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:21.582382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82001754-5766-4c3d-9c7b-aada6a350d59 None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:21.582666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82001754-5766-4c3d-9c7b-aada6a350d59 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:21.582945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82001754-5766-4c3d-9c7b-aada6a350d59 None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:21.583654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82001754-5766-4c3d-9c7b-aada6a350d59 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:21.585134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82001754-5766-4c3d-9c7b-aada6a350d59 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:21.656728 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 113/219] 10.222.0.16 () {60 vars in 1132 bytes} [Mon May 2 09:57:21 2022] POST /identity/v3/users => generated 297 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:57:21.658068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947ee73-6d5b-49bd-9847-210c3029b8a2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:21.658216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5051554-48f8-4c9e-adc3-87b7b64ceb56 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:21.658386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947ee73-6d5b-49bd-9847-210c3029b8a2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:21.658633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947ee73-6d5b-49bd-9847-210c3029b8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:21.676856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9947ee73-6d5b-49bd-9847-210c3029b8a2 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:21.678116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9947ee73-6d5b-49bd-9847-210c3029b8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:21.700593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2337e6c-ce88-4bef-8558-16d2e9706e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:21.701522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2337e6c-ce88-4bef-8558-16d2e9706e59 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:21.701806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2337e6c-ce88-4bef-8558-16d2e9706e59 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:21.702148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2337e6c-ce88-4bef-8558-16d2e9706e59 None admin] PATH_INFO: `/v3/users/72fd2e7f610740ec80a19db2ecdfa4a0` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:21.718138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2337e6c-ce88-4bef-8558-16d2e9706e59 None admin] RBAC: Authorizing `identity:get_user(user_id=72fd2e7f610740ec80a19db2ecdfa4a0)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:21.720736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2337e6c-ce88-4bef-8558-16d2e9706e59 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:21.726762 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 107/220] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:21 2022] GET /identity/v3/users/72fd2e7f610740ec80a19db2ecdfa4a0 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:21.726762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2337e6c-ce88-4bef-8558-16d2e9706e59 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:21.756723 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 114/221] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:21.757944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947ee73-6d5b-49bd-9847-210c3029b8a2 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:21.842692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2337e6c-ce88-4bef-8558-16d2e9706e59 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:21.875602 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947ee73-6d5b-49bd-9847-210c3029b8a2 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:21.878905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f2e56-5fab-4ee5-a342-b5a3f639a89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:21.880645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f2e56-5fab-4ee5-a342-b5a3f639a89c None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:21.880645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f2e56-5fab-4ee5-a342-b5a3f639a89c None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:21.880645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f2e56-5fab-4ee5-a342-b5a3f639a89c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:21.891226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f2e56-5fab-4ee5-a342-b5a3f639a89c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:21.899260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-f57f2e56-5fab-4ee5-a342-b5a3f639a89c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:21.899260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:21.899260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:21.899260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:21.899260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:21.899260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:21.899260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:21.899260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:21.899260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:21.899260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:21.899260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:21.899260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:21.899260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:21.899260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:21.899260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:21.899260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:21.902840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:21.902840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:21.902840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:21.902840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:21.902840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:21.902840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:21.902840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:21.902840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:21.902840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:21.902840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:21.902840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:21.902840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:57:21.902840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:21.902840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:21.902840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:21.902840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:21.907069 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:21.907069 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:21.907069 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:21.907069 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:21.907069 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:21.907069 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:21.907069 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:21.907069 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:21.907069 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:21.907069 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:21.907069 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:21.907069 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:21.907069 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 108/222] 10.222.0.16 () {56 vars in 1114 bytes} [Mon May 2 09:57:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:21.907069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f2e56-5fab-4ee5-a342-b5a3f639a89c None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:21.918847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d38fb-7437-4e54-8d6d-42f04f1dd79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:21.919500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d38fb-7437-4e54-8d6d-42f04f1dd79a None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:21.919784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d38fb-7437-4e54-8d6d-42f04f1dd79a None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:21.920056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d38fb-7437-4e54-8d6d-42f04f1dd79a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:22.008384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d38fb-7437-4e54-8d6d-42f04f1dd79a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:22.010425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d38fb-7437-4e54-8d6d-42f04f1dd79a None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:22.025747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f2e56-5fab-4ee5-a342-b5a3f639a89c None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:22.059830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c094ae-6991-4931-a183-5c1dcad2d390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:22.060660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c094ae-6991-4931-a183-5c1dcad2d390 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:22.060954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c094ae-6991-4931-a183-5c1dcad2d390 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:22.061231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c094ae-6991-4931-a183-5c1dcad2d390 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:22.072104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c094ae-6991-4931-a183-5c1dcad2d390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:22.079982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-85c094ae-6991-4931-a183-5c1dcad2d390 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:57:22.079982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:22.079982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:22.079982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:22.079982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:22.079982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:22.079982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:22.079982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:22.079982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:22.079982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:22.079982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:22.079982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:22.079982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:22.079982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:22.079982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:22.079982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:22.080918 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:22.080918 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:22.080918 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:22.080918 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:22.080918 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:22.080918 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:22.080918 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:22.080918 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:22.080918 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:22.080918 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:22.080918 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:22.080918 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:57:22.080918 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:22.080918 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:22.080918 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:22.080918 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:22.083217 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:22.083217 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:22.083217 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:22.083217 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:22.083217 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:22.083217 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:22.083217 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:22.083217 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:22.083217 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:22.083217 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:22.083217 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:57:22.083217 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:22.083217 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 109/223] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:57:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:22.083217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c094ae-6991-4931-a183-5c1dcad2d390 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:22.125179 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 115/224] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:22.126144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d38fb-7437-4e54-8d6d-42f04f1dd79a None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:22.184131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c094ae-6991-4931-a183-5c1dcad2d390 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:22.218344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106705c-b953-4849-9a30-d3c4e771c101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:22.219020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106705c-b953-4849-9a30-d3c4e771c101 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:22.219312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106705c-b953-4849-9a30-d3c4e771c101 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:22.219593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106705c-b953-4849-9a30-d3c4e771c101 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:22.220346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106705c-b953-4849-9a30-d3c4e771c101 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:22.220687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106705c-b953-4849-9a30-d3c4e771c101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:22.222087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106705c-b953-4849-9a30-d3c4e771c101 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:22.223891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d38fb-7437-4e54-8d6d-42f04f1dd79a None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:22.230350 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 110/225] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:57:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:22.231056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106705c-b953-4849-9a30-d3c4e771c101 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:22.257846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40b3f6-1d66-4f05-a396-d91c54c7163a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:22.258511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40b3f6-1d66-4f05-a396-d91c54c7163a None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:22.258792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40b3f6-1d66-4f05-a396-d91c54c7163a None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:22.259673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40b3f6-1d66-4f05-a396-d91c54c7163a None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:22.260362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40b3f6-1d66-4f05-a396-d91c54c7163a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:22.260707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40b3f6-1d66-4f05-a396-d91c54c7163a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:22.262092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40b3f6-1d66-4f05-a396-d91c54c7163a None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:22.270247 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 116/226] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:22.270806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40b3f6-1d66-4f05-a396-d91c54c7163a None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:22.331371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106705c-b953-4849-9a30-d3c4e771c101 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:22.366623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383e1bf-03e9-4463-b490-d52facd4d25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:22.367484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383e1bf-03e9-4463-b490-d52facd4d25d None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:22.367763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383e1bf-03e9-4463-b490-d52facd4d25d None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:22.368038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383e1bf-03e9-4463-b490-d52facd4d25d None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:22.369800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383e1bf-03e9-4463-b490-d52facd4d25d None admin] RBAC: Authorizing `identity:get_project(project_id=de9cf9f9d50e4932a34fb509a4d47ce6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:22.370894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40b3f6-1d66-4f05-a396-d91c54c7163a None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:22.371260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383e1bf-03e9-4463-b490-d52facd4d25d None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:22.377878 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 111/227] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:22 2022] GET /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:22.378674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383e1bf-03e9-4463-b490-d52facd4d25d None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:22.412447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6e1bb-f575-42b7-99a1-98984512df55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:22.413359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6e1bb-f575-42b7-99a1-98984512df55 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:22.413648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6e1bb-f575-42b7-99a1-98984512df55 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:22.413924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6e1bb-f575-42b7-99a1-98984512df55 None admin] PATH_INFO: `/v3/users/9794438a6e024a8cad58f164c84072cb` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:22.415647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6e1bb-f575-42b7-99a1-98984512df55 None admin] RBAC: Authorizing `identity:get_user(user_id=9794438a6e024a8cad58f164c84072cb)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:22.417542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6e1bb-f575-42b7-99a1-98984512df55 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:22.420176 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 117/228] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:22 2022] GET /identity/v3/users/9794438a6e024a8cad58f164c84072cb => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:22.420985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6e1bb-f575-42b7-99a1-98984512df55 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:22.480376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383e1bf-03e9-4463-b490-d52facd4d25d None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:22.514437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c4ead-4fde-42bc-b5d6-aaf4bb075b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:22.515355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c4ead-4fde-42bc-b5d6-aaf4bb075b22 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:22.515644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c4ead-4fde-42bc-b5d6-aaf4bb075b22 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:22.515920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c4ead-4fde-42bc-b5d6-aaf4bb075b22 None admin] PATH_INFO: `/v3/users/9794438a6e024a8cad58f164c84072cb` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:22.517173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c4ead-4fde-42bc-b5d6-aaf4bb075b22 None admin] RBAC: Authorizing `identity:get_user(user_id=9794438a6e024a8cad58f164c84072cb)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:22.518764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c4ead-4fde-42bc-b5d6-aaf4bb075b22 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:22.520524 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 112/229] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:22 2022] GET /identity/v3/users/9794438a6e024a8cad58f164c84072cb => generated 283 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:22.520988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6e1bb-f575-42b7-99a1-98984512df55 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:22.521312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c4ead-4fde-42bc-b5d6-aaf4bb075b22 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:22.555668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65af000-e7ee-4e23-959b-ab13b9fe7c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:22.556913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65af000-e7ee-4e23-959b-ab13b9fe7c98 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:22.557201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65af000-e7ee-4e23-959b-ab13b9fe7c98 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:22.557485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65af000-e7ee-4e23-959b-ab13b9fe7c98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:22.558327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65af000-e7ee-4e23-959b-ab13b9fe7c98 None admin] RBAC: Adding query filter params (role.id=d1592d47a67b4f4a8d14e2101c799509, scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6, user.id=72fd2e7f610740ec80a19db2ecdfa4a0) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:22.558645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65af000-e7ee-4e23-959b-ab13b9fe7c98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:22.560094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65af000-e7ee-4e23-959b-ab13b9fe7c98 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:22.565930 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 118/230] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:57:22 2022] GET /identity/v3/role_assignments?user.id=72fd2e7f610740ec80a19db2ecdfa4a0&scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6&role.id=d1592d47a67b4f4a8d14e2101c799509 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:22.566507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65af000-e7ee-4e23-959b-ab13b9fe7c98 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:22.662304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c4ead-4fde-42bc-b5d6-aaf4bb075b22 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:22.671190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65af000-e7ee-4e23-959b-ab13b9fe7c98 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:22.723397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc9a65-c625-4b25-9bb6-bdf5569452d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:22.724404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc9a65-c625-4b25-9bb6-bdf5569452d3 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:22.724740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc9a65-c625-4b25-9bb6-bdf5569452d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:22.725023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc9a65-c625-4b25-9bb6-bdf5569452d3 None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:22.726313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc9a65-c625-4b25-9bb6-bdf5569452d3 None admin] RBAC: Authorizing `identity:get_project(project_id=de9cf9f9d50e4932a34fb509a4d47ce6)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:22.728343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc9a65-c625-4b25-9bb6-bdf5569452d3 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:22.730079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eec5a-5320-4e14-b985-f94b3b4dcc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:22.730321 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 119/231] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:22 2022] GET /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:22.730976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eec5a-5320-4e14-b985-f94b3b4dcc99 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:22.731259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eec5a-5320-4e14-b985-f94b3b4dcc99 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:22.731538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eec5a-5320-4e14-b985-f94b3b4dcc99 None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:22.732914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172eec5a-5320-4e14-b985-f94b3b4dcc99 None admin] RBAC: Authorizing `identity:get_project(project_id=de9cf9f9d50e4932a34fb509a4d47ce6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:22.734413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172eec5a-5320-4e14-b985-f94b3b4dcc99 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:22.736011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc9a65-c625-4b25-9bb6-bdf5569452d3 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:22.736223 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 113/232] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:22 2022] GET /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:22.741817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eec5a-5320-4e14-b985-f94b3b4dcc99 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:22.905102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eec5a-5320-4e14-b985-f94b3b4dcc99 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:22.931742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc9a65-c625-4b25-9bb6-bdf5569452d3 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:22.942251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543a0d1-716f-4bed-85a7-88086d031553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:22.943599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a0d1-716f-4bed-85a7-88086d031553 None admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:22.943916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a0d1-716f-4bed-85a7-88086d031553 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:22.944194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a0d1-716f-4bed-85a7-88086d031553 None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6/users/9794438a6e024a8cad58f164c84072cb/roles/9d0cb59f15d2481eace97516b3b77a71` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:22.948102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543a0d1-716f-4bed-85a7-88086d031553 None admin] RBAC: Authorizing `identity:create_grant(project_id=de9cf9f9d50e4932a34fb509a4d47ce6, user_id=9794438a6e024a8cad58f164c84072cb, role_id=9d0cb59f15d2481eace97516b3b77a71)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:22.949943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543a0d1-716f-4bed-85a7-88086d031553 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:22.984271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d43489-6f63-41c7-ba1e-ac017aaefad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:22.985208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d43489-6f63-41c7-ba1e-ac017aaefad0 None admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:22.985493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d43489-6f63-41c7-ba1e-ac017aaefad0 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:22.985769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d43489-6f63-41c7-ba1e-ac017aaefad0 None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6/users/9794438a6e024a8cad58f164c84072cb/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:22.988544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d43489-6f63-41c7-ba1e-ac017aaefad0 None admin] RBAC: Authorizing `identity:create_grant(project_id=de9cf9f9d50e4932a34fb509a4d47ce6, user_id=9794438a6e024a8cad58f164c84072cb, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:22.990101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d43489-6f63-41c7-ba1e-ac017aaefad0 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:23.018159 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 114/233] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 09:57:22 2022] PUT /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6/users/9794438a6e024a8cad58f164c84072cb/roles/9d0cb59f15d2481eace97516b3b77a71 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 09:57:23.118186 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 120/234] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 09:57:22 2022] PUT /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6/users/9794438a6e024a8cad58f164c84072cb/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 09:57:24.424557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ab86f-4381-43a6-9ea9-c3f1b11f00d4 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:24.425605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ab86f-4381-43a6-9ea9-c3f1b11f00d4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:24.426121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ab86f-4381-43a6-9ea9-c3f1b11f00d4 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:24.428062 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 115/235] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:24.433562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef22fb-acff-40c2-bd07-13be5c8c6de8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:24.434416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef22fb-acff-40c2-bd07-13be5c8c6de8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:24.434903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef22fb-acff-40c2-bd07-13be5c8c6de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:24.455791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-01ef22fb-acff-40c2-bd07-13be5c8c6de8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:24.457388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-01ef22fb-acff-40c2-bd07-13be5c8c6de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:24.479277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbaba4-7ba9-4085-96c3-99cd666787f8 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:24.479597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbaba4-7ba9-4085-96c3-99cd666787f8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:24.479856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbaba4-7ba9-4085-96c3-99cd666787f8 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:24.485611 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 116/236] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:57:24.497499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4d6d2-279f-44e9-82ad-6020b2a83eff None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:24.498066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4d6d2-279f-44e9-82ad-6020b2a83eff None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:24.498563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4d6d2-279f-44e9-82ad-6020b2a83eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:24.516358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4af4d6d2-279f-44e9-82ad-6020b2a83eff None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:24.517916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4af4d6d2-279f-44e9-82ad-6020b2a83eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:24.562579 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 121/237] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:24.612453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef22fb-acff-40c2-bd07-13be5c8c6de8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:24.612694 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 117/238] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:57:24.655106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4d6d2-279f-44e9-82ad-6020b2a83eff None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:24.714412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef22fb-acff-40c2-bd07-13be5c8c6de8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:24.749473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94dc96b-26ef-4033-a447-46895f7eb418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:24.750624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dc96b-26ef-4033-a447-46895f7eb418 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:24.751136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dc96b-26ef-4033-a447-46895f7eb418 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:24.751617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dc96b-26ef-4033-a447-46895f7eb418 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:24.762319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dc96b-26ef-4033-a447-46895f7eb418 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:24.770442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-c94dc96b-26ef-4033-a447-46895f7eb418 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 02 09:57:24.770442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:24.770442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:24.770442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:24.770442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:24.770442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:24.770442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:24.770442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:24.770442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:24.770442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:24.770442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:24.770442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:24.770442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:24.770442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:24.770442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:24.770442 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:24.771395 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:24.771395 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:24.771395 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:24.771395 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:24.771395 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:24.771395 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:24.771395 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:24.771395 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:24.771395 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:24.771395 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:24.771395 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:24.771395 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:24.771395 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:24.771395 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:24.771395 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:24.771395 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:24.772167 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:24.772167 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:24.772167 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:24.772167 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:24.772167 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:24.772167 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:24.772167 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:24.772167 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:24.772167 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:24.772167 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:24.772167 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 02 09:57:24.772167 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:24.774817 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 122/239] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:57:24.785443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94dc96b-26ef-4033-a447-46895f7eb418 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:24.850171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4d6d2-279f-44e9-82ad-6020b2a83eff None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:24.886806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94dc96b-26ef-4033-a447-46895f7eb418 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:24.921069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab5339-4ad7-4abd-8858-9bb759424fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:24.922364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab5339-4ad7-4abd-8858-9bb759424fcd None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:24.922949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab5339-4ad7-4abd-8858-9bb759424fcd None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:24.923434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab5339-4ad7-4abd-8858-9bb759424fcd None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:24.924391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab5339-4ad7-4abd-8858-9bb759424fcd None admin] RBAC: Adding query filter params (name=reader) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:24.924939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab5339-4ad7-4abd-8858-9bb759424fcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:24.926645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab5339-4ad7-4abd-8858-9bb759424fcd None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:24.928082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763899d-fdd4-4de1-9ab0-fe71a9934522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:24.928915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763899d-fdd4-4de1-9ab0-fe71a9934522 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:24.929199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763899d-fdd4-4de1-9ab0-fe71a9934522 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:24.929474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763899d-fdd4-4de1-9ab0-fe71a9934522 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:24.931521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763899d-fdd4-4de1-9ab0-fe71a9934522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:24.932979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763899d-fdd4-4de1-9ab0-fe71a9934522 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:24.934772 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 118/240] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:57:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:24.938212 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 123/241] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:24.940038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763899d-fdd4-4de1-9ab0-fe71a9934522 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:24.944964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab5339-4ad7-4abd-8858-9bb759424fcd None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:25.096924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab5339-4ad7-4abd-8858-9bb759424fcd None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:25.098173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763899d-fdd4-4de1-9ab0-fe71a9934522 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:25.142700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1004f-361d-4fab-be17-e473e2d4acc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:25.143589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1004f-361d-4fab-be17-e473e2d4acc9 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:25.143875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1004f-361d-4fab-be17-e473e2d4acc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:25.144155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1004f-361d-4fab-be17-e473e2d4acc9 None admin] PATH_INFO: `/v3/users/86cfedcbefaa4886ba1ef34864118ce2` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:25.156149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a42e92-225e-4816-b156-7acd6477a260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:25.156857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a42e92-225e-4816-b156-7acd6477a260 None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:25.157144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a42e92-225e-4816-b156-7acd6477a260 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:25.157427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a42e92-225e-4816-b156-7acd6477a260 None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:25.158164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a42e92-225e-4816-b156-7acd6477a260 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:25.159634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a42e92-225e-4816-b156-7acd6477a260 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:25.168549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1004f-361d-4fab-be17-e473e2d4acc9 None admin] RBAC: Authorizing `identity:get_user(user_id=86cfedcbefaa4886ba1ef34864118ce2)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:25.170051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1004f-361d-4fab-be17-e473e2d4acc9 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:25.172205 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 124/242] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:24 2022] GET /identity/v3/users/86cfedcbefaa4886ba1ef34864118ce2 => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:25.177680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1004f-361d-4fab-be17-e473e2d4acc9 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:25.271162 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 119/243] 10.222.0.16 () {60 vars in 1132 bytes} [Mon May 2 09:57:24 2022] POST /identity/v3/users => generated 293 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 09:57:25.285131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1004f-361d-4fab-be17-e473e2d4acc9 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:25.321983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b38390-cd54-416f-a321-ffbdfb233382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:25.322695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b38390-cd54-416f-a321-ffbdfb233382 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:25.322977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b38390-cd54-416f-a321-ffbdfb233382 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:25.323296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b38390-cd54-416f-a321-ffbdfb233382 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:25.395904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b38390-cd54-416f-a321-ffbdfb233382 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:25.397440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b38390-cd54-416f-a321-ffbdfb233382 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:25.516421 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 125/244] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 02 09:57:25.519331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a42e92-225e-4816-b156-7acd6477a260 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:25.639890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6d044-cabe-4c5e-8659-59025ae07d71 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:25.640248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6d044-cabe-4c5e-8659-59025ae07d71 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:25.640445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6d044-cabe-4c5e-8659-59025ae07d71 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:25.641996 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 126/245] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:57:25.647300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e64c2c-a6ee-4b09-8638-776edd369314 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:25.647850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e64c2c-a6ee-4b09-8638-776edd369314 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:25.648345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e64c2c-a6ee-4b09-8638-776edd369314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:25.672820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c3e64c2c-a6ee-4b09-8638-776edd369314 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:25.674455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c3e64c2c-a6ee-4b09-8638-776edd369314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:25.698481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a42e92-225e-4816-b156-7acd6477a260 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:25.747183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841be95-da75-458f-a510-1d780ef4b288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:25.748308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841be95-da75-458f-a510-1d780ef4b288 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:25.748797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841be95-da75-458f-a510-1d780ef4b288 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:25.749225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841be95-da75-458f-a510-1d780ef4b288 None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:25.750599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841be95-da75-458f-a510-1d780ef4b288 None admin] RBAC: Authorizing `identity:get_project(project_id=de9cf9f9d50e4932a34fb509a4d47ce6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:25.752210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841be95-da75-458f-a510-1d780ef4b288 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:25.754453 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 120/246] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:25 2022] GET /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:25.761799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841be95-da75-458f-a510-1d780ef4b288 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:25.764051 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 127/247] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:25.811430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e64c2c-a6ee-4b09-8638-776edd369314 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:25.877461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841be95-da75-458f-a510-1d780ef4b288 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:25.915868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31377d-7c0a-4ac9-bf1a-60de5608e8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:25.916836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31377d-7c0a-4ac9-bf1a-60de5608e8ee None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:25.917277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31377d-7c0a-4ac9-bf1a-60de5608e8ee None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:25.917706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31377d-7c0a-4ac9-bf1a-60de5608e8ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:25.918782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a31377d-7c0a-4ac9-bf1a-60de5608e8ee None admin] RBAC: Adding query filter params (role.id=1325eb2a84a1482fade3efa8dbe3cfbf, scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6, user.id=86cfedcbefaa4886ba1ef34864118ce2) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:25.919253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a31377d-7c0a-4ac9-bf1a-60de5608e8ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:25.919384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e64c2c-a6ee-4b09-8638-776edd369314 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:25.921167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a31377d-7c0a-4ac9-bf1a-60de5608e8ee None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:25.927802 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 121/248] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:57:25 2022] GET /identity/v3/role_assignments?user.id=86cfedcbefaa4886ba1ef34864118ce2&scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6&role.id=1325eb2a84a1482fade3efa8dbe3cfbf => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:25.929563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829e36d-7ac9-486a-bdb8-b2f7b057c88b None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:25.930126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829e36d-7ac9-486a-bdb8-b2f7b057c88b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:25.930626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829e36d-7ac9-486a-bdb8-b2f7b057c88b None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:25.932557 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 122/249] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:25.938302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9d84f-6313-4f7e-ad55-409d844c09a8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:25.939052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9d84f-6313-4f7e-ad55-409d844c09a8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:25.939542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9d84f-6313-4f7e-ad55-409d844c09a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:25.959896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d7c9d84f-6313-4f7e-ad55-409d844c09a8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:25.962571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d7c9d84f-6313-4f7e-ad55-409d844c09a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:25.987998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6b557-5b2d-4d24-82f3-a2f41b11a786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:25.990016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6b557-5b2d-4d24-82f3-a2f41b11a786 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:25.990305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6b557-5b2d-4d24-82f3-a2f41b11a786 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:25.990585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6b557-5b2d-4d24-82f3-a2f41b11a786 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:26.013349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6b557-5b2d-4d24-82f3-a2f41b11a786 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:26.030310 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-24f6b557-5b2d-4d24-82f3-a2f41b11a786 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:26.030310 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:26.030310 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:26.030310 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:26.030310 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:26.030310 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:26.030310 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:26.030310 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:26.030310 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:26.030310 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:26.030310 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:26.030310 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:26.030310 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:26.030310 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:26.030310 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:26.030310 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:26.031287 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:26.031287 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:26.031287 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:26.031287 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:26.031287 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:26.031287 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:26.031287 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:26.031287 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:26.031287 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:26.031287 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:26.031287 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:26.031287 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:26.031287 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:26.031287 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:26.031287 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:26.031287 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:26.032060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:26.032060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:26.032060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:26.032060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:26.032060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:26.032060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:26.032060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:26.032060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:26.032060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:26.032060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:26.032060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:26.032060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:26.032060 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 128/250] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:57:26.042056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6b557-5b2d-4d24-82f3-a2f41b11a786 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:26.091126 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 123/251] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:26.114422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab34ffc-5919-476c-a319-6ba57dd7960a None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:26.115204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab34ffc-5919-476c-a319-6ba57dd7960a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:26.115501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab34ffc-5919-476c-a319-6ba57dd7960a None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:26.117603 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 124/252] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:57:26.121503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab34ffc-5919-476c-a319-6ba57dd7960a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:26.229167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6b557-5b2d-4d24-82f3-a2f41b11a786 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:26.258380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab34ffc-5919-476c-a319-6ba57dd7960a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:26.270206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bf939-1cfb-4c97-a13e-9497e67c8a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:26.271114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bf939-1cfb-4c97-a13e-9497e67c8a28 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:26.271572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bf939-1cfb-4c97-a13e-9497e67c8a28 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:26.271999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bf939-1cfb-4c97-a13e-9497e67c8a28 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:26.272937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bf939-1cfb-4c97-a13e-9497e67c8a28 None admin] RBAC: Adding query filter params (name=member) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:26.273480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bf939-1cfb-4c97-a13e-9497e67c8a28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:26.275649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bf939-1cfb-4c97-a13e-9497e67c8a28 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:26.288795 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 129/253] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:26.290513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f1a1e-3451-42d1-80bd-50ecb393d2ab None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:26.291011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f1a1e-3451-42d1-80bd-50ecb393d2ab None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:26.291528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f1a1e-3451-42d1-80bd-50ecb393d2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:26.308855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b10f1a1e-3451-42d1-80bd-50ecb393d2ab None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:26.310350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b10f1a1e-3451-42d1-80bd-50ecb393d2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:26.314220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc42913-6ea6-4498-8c75-cb48ab42b973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:26.315032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc42913-6ea6-4498-8c75-cb48ab42b973 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:26.315315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc42913-6ea6-4498-8c75-cb48ab42b973 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:26.315590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc42913-6ea6-4498-8c75-cb48ab42b973 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:26.345854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc42913-6ea6-4498-8c75-cb48ab42b973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:26.361463 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-cbc42913-6ea6-4498-8c75-cb48ab42b973 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:57:26.361463 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:26.361463 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:26.361463 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:26.361463 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:26.361463 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:26.361463 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:26.361463 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:26.361463 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:26.361463 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:26.361463 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:26.361463 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:26.361463 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:26.361463 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:26.361463 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:26.361463 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:26.362645 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:26.362645 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:26.362645 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:26.362645 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:26.362645 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:26.362645 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:26.362645 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:26.362645 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:26.362645 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:26.362645 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:26.362645 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:26.362645 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:57:26.362645 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:26.362645 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:26.362645 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:26.362645 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:26.363439 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:26.363439 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:26.363439 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:26.363439 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:26.363439 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:26.363439 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:26.363439 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:26.363439 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:26.363439 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:26.363439 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:26.363439 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:57:26.363439 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:26.363439 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 125/254] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:57:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:57:26.364182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc42913-6ea6-4498-8c75-cb48ab42b973 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:26.382915 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 130/255] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:26.384707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f1a1e-3451-42d1-80bd-50ecb393d2ab None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:26.484246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f1a1e-3451-42d1-80bd-50ecb393d2ab None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:26.517479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ec6e1-d9f4-4584-8879-ee22e10c3fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:26.518223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ec6e1-d9f4-4584-8879-ee22e10c3fe4 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:26.518442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ec6e1-d9f4-4584-8879-ee22e10c3fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:26.518734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ec6e1-d9f4-4584-8879-ee22e10c3fe4 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:26.519490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ec6e1-d9f4-4584-8879-ee22e10c3fe4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:26.519806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ec6e1-d9f4-4584-8879-ee22e10c3fe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:26.521226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ec6e1-d9f4-4584-8879-ee22e10c3fe4 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:26.530073 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 131/256] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:26.530882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ec6e1-d9f4-4584-8879-ee22e10c3fe4 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:26.578668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc42913-6ea6-4498-8c75-cb48ab42b973 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:26.623866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261aac4d-bb01-4103-a1ac-d4de780c061a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:26.625134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261aac4d-bb01-4103-a1ac-d4de780c061a None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:26.625629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261aac4d-bb01-4103-a1ac-d4de780c061a None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:26.626398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261aac4d-bb01-4103-a1ac-d4de780c061a None admin] PATH_INFO: `/v3/users/72fd2e7f610740ec80a19db2ecdfa4a0` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:26.628016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261aac4d-bb01-4103-a1ac-d4de780c061a None admin] RBAC: Authorizing `identity:get_user(user_id=72fd2e7f610740ec80a19db2ecdfa4a0)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:26.629760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261aac4d-bb01-4103-a1ac-d4de780c061a None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:26.631906 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 126/257] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:26 2022] GET /identity/v3/users/72fd2e7f610740ec80a19db2ecdfa4a0 => generated 297 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:26.632906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261aac4d-bb01-4103-a1ac-d4de780c061a None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:26.736646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261aac4d-bb01-4103-a1ac-d4de780c061a None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:26.738993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ec6e1-d9f4-4584-8879-ee22e10c3fe4 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:26.772299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828eef0-53e5-4af7-8941-ac7cc3e1d870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:26.773588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828eef0-53e5-4af7-8941-ac7cc3e1d870 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:26.774083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828eef0-53e5-4af7-8941-ac7cc3e1d870 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:26.774619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828eef0-53e5-4af7-8941-ac7cc3e1d870 None admin] PATH_INFO: `/v3/users/9794438a6e024a8cad58f164c84072cb` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:26.776123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828eef0-53e5-4af7-8941-ac7cc3e1d870 None admin] RBAC: Authorizing `identity:get_user(user_id=9794438a6e024a8cad58f164c84072cb)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:26.777828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828eef0-53e5-4af7-8941-ac7cc3e1d870 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:26.779989 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 127/258] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:26 2022] GET /identity/v3/users/9794438a6e024a8cad58f164c84072cb => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:26.781017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828eef0-53e5-4af7-8941-ac7cc3e1d870 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:26.810787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396fe74-5d8c-4a4b-b55c-2f0ad4604458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:26.811884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396fe74-5d8c-4a4b-b55c-2f0ad4604458 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:26.812335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396fe74-5d8c-4a4b-b55c-2f0ad4604458 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:26.812899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396fe74-5d8c-4a4b-b55c-2f0ad4604458 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:26.845183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396fe74-5d8c-4a4b-b55c-2f0ad4604458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:26.853704 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-b396fe74-5d8c-4a4b-b55c-2f0ad4604458 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:26.853704 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:26.853704 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:26.853704 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:26.853704 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:26.853704 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:26.853704 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:26.853704 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:26.853704 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:26.853704 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:26.853704 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:26.853704 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:26.853704 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:26.853704 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:26.853704 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:26.853704 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:26.854620 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:26.854620 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:26.854620 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:26.854620 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:26.854620 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:26.854620 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:26.854620 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:26.854620 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:26.854620 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:26.854620 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:26.854620 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:26.854620 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:26.854620 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:26.854620 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:26.854620 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:26.854620 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:26.855398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:26.855398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:26.855398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:26.855398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:26.855398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:26.855398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:26.855398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:26.855398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:26.855398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:26.855398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:26.855398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:26.855398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:26.856690 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 132/259] 10.222.0.16 () {56 vars in 1114 bytes} [Mon May 2 09:57:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:26.858097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396fe74-5d8c-4a4b-b55c-2f0ad4604458 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:26.907396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828eef0-53e5-4af7-8941-ac7cc3e1d870 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:26.959304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3df0cd-8d44-4532-b256-8a0d17df2376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:26.960566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3df0cd-8d44-4532-b256-8a0d17df2376 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:26.961109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3df0cd-8d44-4532-b256-8a0d17df2376 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:26.961598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3df0cd-8d44-4532-b256-8a0d17df2376 None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:26.965326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3df0cd-8d44-4532-b256-8a0d17df2376 None admin] RBAC: Authorizing `identity:get_project(project_id=de9cf9f9d50e4932a34fb509a4d47ce6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:26.967014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3df0cd-8d44-4532-b256-8a0d17df2376 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:26.968990 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 128/260] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:26 2022] GET /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:26.969977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3df0cd-8d44-4532-b256-8a0d17df2376 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:26.975488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396fe74-5d8c-4a4b-b55c-2f0ad4604458 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:27.019605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160076d8-4981-43f9-a488-4bb1237f7609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:27.020193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160076d8-4981-43f9-a488-4bb1237f7609 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:27.020482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160076d8-4981-43f9-a488-4bb1237f7609 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:27.020794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160076d8-4981-43f9-a488-4bb1237f7609 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:27.089303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3df0cd-8d44-4532-b256-8a0d17df2376 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:27.141903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160076d8-4981-43f9-a488-4bb1237f7609 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:27.143920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160076d8-4981-43f9-a488-4bb1237f7609 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:27.152135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da4df7-60ce-497a-a445-1ca65bca5158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:27.152864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da4df7-60ce-497a-a445-1ca65bca5158 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:27.153159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da4df7-60ce-497a-a445-1ca65bca5158 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:27.153452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da4df7-60ce-497a-a445-1ca65bca5158 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:27.154236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da4df7-60ce-497a-a445-1ca65bca5158 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:27.154554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da4df7-60ce-497a-a445-1ca65bca5158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:27.155999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da4df7-60ce-497a-a445-1ca65bca5158 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:27.175897 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 129/261] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:57:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:27.176567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da4df7-60ce-497a-a445-1ca65bca5158 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:27.297623 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 133/262] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:27.298409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160076d8-4981-43f9-a488-4bb1237f7609 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:27.360267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da4df7-60ce-497a-a445-1ca65bca5158 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:27.429046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160076d8-4981-43f9-a488-4bb1237f7609 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:27.450339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c194c9-52b5-49ac-bb47-b0aa51d11258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:27.451638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c194c9-52b5-49ac-bb47-b0aa51d11258 None admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:27.452133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c194c9-52b5-49ac-bb47-b0aa51d11258 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:27.452651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c194c9-52b5-49ac-bb47-b0aa51d11258 None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6/users/72fd2e7f610740ec80a19db2ecdfa4a0/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:27.455026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c194c9-52b5-49ac-bb47-b0aa51d11258 None admin] RBAC: Authorizing `identity:create_grant(project_id=de9cf9f9d50e4932a34fb509a4d47ce6, user_id=72fd2e7f610740ec80a19db2ecdfa4a0, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:27.456756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c194c9-52b5-49ac-bb47-b0aa51d11258 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:27.464316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8d933-1bf9-4ef8-9b53-e46b84a2b348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:27.468764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8d933-1bf9-4ef8-9b53-e46b84a2b348 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:27.468764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8d933-1bf9-4ef8-9b53-e46b84a2b348 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:27.468764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8d933-1bf9-4ef8-9b53-e46b84a2b348 None admin] PATH_INFO: `/v3/users/9794438a6e024a8cad58f164c84072cb` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:27.469679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8d933-1bf9-4ef8-9b53-e46b84a2b348 None admin] RBAC: Authorizing `identity:get_user(user_id=9794438a6e024a8cad58f164c84072cb)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:27.471482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8d933-1bf9-4ef8-9b53-e46b84a2b348 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:27.473394 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 134/263] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:27 2022] GET /identity/v3/users/9794438a6e024a8cad58f164c84072cb => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:27.474292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8d933-1bf9-4ef8-9b53-e46b84a2b348 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:27.538766 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 130/264] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 09:57:27 2022] PUT /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6/users/72fd2e7f610740ec80a19db2ecdfa4a0/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:57:27.539911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c194c9-52b5-49ac-bb47-b0aa51d11258 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:27.690616 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c194c9-52b5-49ac-bb47-b0aa51d11258 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:27.703664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8d933-1bf9-4ef8-9b53-e46b84a2b348 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:27.731308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99e141-da6f-4dcc-837b-1fff3ea48c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:27.732294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99e141-da6f-4dcc-837b-1fff3ea48c24 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:27.732764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99e141-da6f-4dcc-837b-1fff3ea48c24 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:27.733221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99e141-da6f-4dcc-837b-1fff3ea48c24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:27.782523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b904474-65b5-4dfc-9e94-6134d607504d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:27.783409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b904474-65b5-4dfc-9e94-6134d607504d None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:27.783690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b904474-65b5-4dfc-9e94-6134d607504d None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:27.783970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b904474-65b5-4dfc-9e94-6134d607504d None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:27.789462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b904474-65b5-4dfc-9e94-6134d607504d None admin] RBAC: Authorizing `identity:get_project(project_id=de9cf9f9d50e4932a34fb509a4d47ce6)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:27.791498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b904474-65b5-4dfc-9e94-6134d607504d None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:27.793559 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 135/265] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:27 2022] GET /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6 => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:27.800806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b904474-65b5-4dfc-9e94-6134d607504d None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:27.815754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99e141-da6f-4dcc-837b-1fff3ea48c24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:27.817725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99e141-da6f-4dcc-837b-1fff3ea48c24 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:27.942523 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 131/266] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:27.956082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b904474-65b5-4dfc-9e94-6134d607504d None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:27.960428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99e141-da6f-4dcc-837b-1fff3ea48c24 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:27.997643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dae9cd-f503-4228-b1ef-342aac635469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:27.998646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dae9cd-f503-4228-b1ef-342aac635469 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:27.999114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dae9cd-f503-4228-b1ef-342aac635469 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:27.999576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dae9cd-f503-4228-b1ef-342aac635469 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:28.000632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dae9cd-f503-4228-b1ef-342aac635469 None admin] RBAC: Adding query filter params (role.id=dd8a47ade22941849ebdf8fbdf994b66, scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6, user.id=9794438a6e024a8cad58f164c84072cb) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:28.001150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dae9cd-f503-4228-b1ef-342aac635469 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:28.002845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dae9cd-f503-4228-b1ef-342aac635469 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:28.009866 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 136/267] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:57:27 2022] GET /identity/v3/role_assignments?user.id=9794438a6e024a8cad58f164c84072cb&scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6&role.id=dd8a47ade22941849ebdf8fbdf994b66 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:28.144557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99e141-da6f-4dcc-837b-1fff3ea48c24 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:28.198014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237964f8-46aa-4ae4-ae3d-457eb41ebb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:28.199232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237964f8-46aa-4ae4-ae3d-457eb41ebb28 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:28.199731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237964f8-46aa-4ae4-ae3d-457eb41ebb28 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:28.200186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237964f8-46aa-4ae4-ae3d-457eb41ebb28 None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:28.201736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237964f8-46aa-4ae4-ae3d-457eb41ebb28 None admin] RBAC: Authorizing `identity:get_project(project_id=de9cf9f9d50e4932a34fb509a4d47ce6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:28.203446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237964f8-46aa-4ae4-ae3d-457eb41ebb28 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:28.205556 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 132/268] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:27 2022] GET /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:28.211680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dae9cd-f503-4228-b1ef-342aac635469 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:28.329147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dae9cd-f503-4228-b1ef-342aac635469 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:28.366103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7481c-8d19-4ef3-bc3d-b9b830cd0f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:28.367130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7481c-8d19-4ef3-bc3d-b9b830cd0f90 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:28.367600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7481c-8d19-4ef3-bc3d-b9b830cd0f90 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:28.368146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7481c-8d19-4ef3-bc3d-b9b830cd0f90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:28.369191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7481c-8d19-4ef3-bc3d-b9b830cd0f90 None admin] RBAC: Adding query filter params (role.id=9d0cb59f15d2481eace97516b3b77a71, scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6, user.id=9794438a6e024a8cad58f164c84072cb) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:28.369694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7481c-8d19-4ef3-bc3d-b9b830cd0f90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:28.374642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7481c-8d19-4ef3-bc3d-b9b830cd0f90 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:28.381768 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 137/269] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:57:28 2022] GET /identity/v3/role_assignments?user.id=9794438a6e024a8cad58f164c84072cb&scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6&role.id=9d0cb59f15d2481eace97516b3b77a71 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:28.763470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad394af1-2873-4d9a-b9b7-ab83c486142c None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:28.763982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad394af1-2873-4d9a-b9b7-ab83c486142c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:28.764103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad394af1-2873-4d9a-b9b7-ab83c486142c None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:28.765716 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 133/270] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:28.771064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18504c-9d96-4971-8fd7-2962ce7cf36c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:28.771494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18504c-9d96-4971-8fd7-2962ce7cf36c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:28.771636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18504c-9d96-4971-8fd7-2962ce7cf36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:28.789294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8e18504c-9d96-4971-8fd7-2962ce7cf36c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:28.790546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8e18504c-9d96-4971-8fd7-2962ce7cf36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:28.861742 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 138/271] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:28.866593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f9fd8-0390-4489-85a4-f929a1e7dd0f None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:28.866885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f9fd8-0390-4489-85a4-f929a1e7dd0f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:28.867329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f9fd8-0390-4489-85a4-f929a1e7dd0f None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:28.869600 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 134/272] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:28.877959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ccba8-733c-48d0-9c1e-e25755ed59ae None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:28.878248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ccba8-733c-48d0-9c1e-e25755ed59ae None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:28.878533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ccba8-733c-48d0-9c1e-e25755ed59ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:28.893652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f9fd8-0390-4489-85a4-f929a1e7dd0f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:28.898317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-5c1ccba8-733c-48d0-9c1e-e25755ed59ae None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:28.899535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5c1ccba8-733c-48d0-9c1e-e25755ed59ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:28.980704 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 139/273] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:29.006900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ccba8-733c-48d0-9c1e-e25755ed59ae None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:29.019701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f9fd8-0390-4489-85a4-f929a1e7dd0f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:29.064112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f713f-cd6c-45e8-9aab-1a3431624868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:29.064993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f713f-cd6c-45e8-9aab-1a3431624868 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:29.065379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f713f-cd6c-45e8-9aab-1a3431624868 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:29.065664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f713f-cd6c-45e8-9aab-1a3431624868 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:29.077428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f713f-cd6c-45e8-9aab-1a3431624868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:29.085376 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-3d8f713f-cd6c-45e8-9aab-1a3431624868 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:29.085376 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:29.085376 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:29.085376 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:29.085376 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:29.085376 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:29.085376 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:29.085376 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:29.085376 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:29.085376 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:29.085376 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:29.085376 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:29.085376 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:29.085376 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:29.085376 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:29.085376 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:29.086245 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:29.086245 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:29.086245 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:29.086245 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:29.086245 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:29.086245 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:29.086245 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:29.086245 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:29.086245 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:29.086245 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:29.086245 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:29.086245 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:57:29.086245 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:29.086245 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:29.086245 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:29.086245 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:29.087076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:29.087076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:29.087076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:29.087076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:29.087076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:29.087076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:29.087076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:29.087076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:29.087076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:29.087076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:29.087076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:29.087076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:29.087076 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 135/274] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:29.097651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f713f-cd6c-45e8-9aab-1a3431624868 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:29.126208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ccba8-733c-48d0-9c1e-e25755ed59ae None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:29.162081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffd8af-a1bf-40d5-be3c-06ce169c51f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:29.163540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffd8af-a1bf-40d5-be3c-06ce169c51f2 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:29.164189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffd8af-a1bf-40d5-be3c-06ce169c51f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:29.165571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffd8af-a1bf-40d5-be3c-06ce169c51f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:29.167282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffd8af-a1bf-40d5-be3c-06ce169c51f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:29.169138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffd8af-a1bf-40d5-be3c-06ce169c51f2 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:29.172153 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 140/275] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:57:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:29.177634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffd8af-a1bf-40d5-be3c-06ce169c51f2 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:29.206163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f713f-cd6c-45e8-9aab-1a3431624868 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:29.240758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841def9e-b349-4af4-927a-d53b05f7f21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:29.241797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841def9e-b349-4af4-927a-d53b05f7f21b None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:29.242292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841def9e-b349-4af4-927a-d53b05f7f21b None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:29.242771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841def9e-b349-4af4-927a-d53b05f7f21b None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:29.244307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841def9e-b349-4af4-927a-d53b05f7f21b None admin] RBAC: Adding query filter params (name=member) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:29.244850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841def9e-b349-4af4-927a-d53b05f7f21b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:29.246435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841def9e-b349-4af4-927a-d53b05f7f21b None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:29.255985 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 136/276] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:29.257734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a147a-76f4-4cc2-80c2-e9d055db506c None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:29.258712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a147a-76f4-4cc2-80c2-e9d055db506c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:29.259184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a147a-76f4-4cc2-80c2-e9d055db506c None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:29.261298 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 137/277] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:29.263050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a147a-76f4-4cc2-80c2-e9d055db506c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:29.292460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffd8af-a1bf-40d5-be3c-06ce169c51f2 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:29.324935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44313ba-0346-4cfb-a919-e8295d849226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:29.325870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44313ba-0346-4cfb-a919-e8295d849226 None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:29.326159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44313ba-0346-4cfb-a919-e8295d849226 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:29.326440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44313ba-0346-4cfb-a919-e8295d849226 None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:29.327156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44313ba-0346-4cfb-a919-e8295d849226 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:29.328728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44313ba-0346-4cfb-a919-e8295d849226 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:29.363250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a147a-76f4-4cc2-80c2-e9d055db506c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:29.396090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e4e1a-421f-480e-b656-717d0d6ac730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:29.396997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e4e1a-421f-480e-b656-717d0d6ac730 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:29.397283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e4e1a-421f-480e-b656-717d0d6ac730 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:29.397586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e4e1a-421f-480e-b656-717d0d6ac730 None admin] PATH_INFO: `/v3/users/d0fbcd2e5aaa46ed9d1e8ba856d4beaf` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:29.410625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e4e1a-421f-480e-b656-717d0d6ac730 None admin] RBAC: Authorizing `identity:get_user(user_id=d0fbcd2e5aaa46ed9d1e8ba856d4beaf)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:29.412089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e4e1a-421f-480e-b656-717d0d6ac730 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:29.413815 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 138/278] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:29 2022] GET /identity/v3/users/d0fbcd2e5aaa46ed9d1e8ba856d4beaf => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:29.415522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cdf41-32ff-4db3-8bb4-c1ec11bbb857 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:29.415815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cdf41-32ff-4db3-8bb4-c1ec11bbb857 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:29.416093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cdf41-32ff-4db3-8bb4-c1ec11bbb857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:29.432152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-812cdf41-32ff-4db3-8bb4-c1ec11bbb857 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:29.433404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-812cdf41-32ff-4db3-8bb4-c1ec11bbb857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:29.434612 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 141/279] 10.222.0.16 () {60 vars in 1132 bytes} [Mon May 2 09:57:29 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:57:29.445865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44313ba-0346-4cfb-a919-e8295d849226 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:29.530820 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 139/280] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:29.557720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cdf41-32ff-4db3-8bb4-c1ec11bbb857 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:29.570370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44313ba-0346-4cfb-a919-e8295d849226 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:29.608913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513112c-9d59-4b28-8917-86947484e088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:29.609624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513112c-9d59-4b28-8917-86947484e088 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:29.609911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513112c-9d59-4b28-8917-86947484e088 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:29.610512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513112c-9d59-4b28-8917-86947484e088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:29.611038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513112c-9d59-4b28-8917-86947484e088 None admin] RBAC: Adding query filter params (role.id=d1592d47a67b4f4a8d14e2101c799509, user.id=d0fbcd2e5aaa46ed9d1e8ba856d4beaf, scope.system=all) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:29.611356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513112c-9d59-4b28-8917-86947484e088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:29.613191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513112c-9d59-4b28-8917-86947484e088 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:29.619238 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 142/281] 10.222.0.16 () {56 vars in 1308 bytes} [Mon May 2 09:57:29 2022] GET /identity/v3/role_assignments?user.id=d0fbcd2e5aaa46ed9d1e8ba856d4beaf&scope.system=all&role.id=d1592d47a67b4f4a8d14e2101c799509 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:29.674652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cdf41-32ff-4db3-8bb4-c1ec11bbb857 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:29.710311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab7868-dbe7-4f9f-8629-8ad516a4be97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:29.711331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab7868-dbe7-4f9f-8629-8ad516a4be97 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:29.711618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab7868-dbe7-4f9f-8629-8ad516a4be97 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:29.712424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab7868-dbe7-4f9f-8629-8ad516a4be97 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:29.724187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab7868-dbe7-4f9f-8629-8ad516a4be97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:29.732922 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-08ab7868-dbe7-4f9f-8629-8ad516a4be97 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 02 09:57:29.732922 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:29.732922 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:29.732922 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:29.732922 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:29.732922 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:29.732922 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:29.732922 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:29.732922 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:29.732922 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:29.732922 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:29.732922 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:29.732922 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:29.732922 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:29.732922 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:29.732922 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:29.733890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:29.733890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:29.733890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:29.733890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:29.733890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:29.733890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:29.733890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:29.733890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:29.733890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:29.733890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:29.733890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:29.733890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:57:29.733890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:29.733890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:29.733890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:29.733890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:29.734667 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:29.734667 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:29.734667 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:29.734667 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:29.734667 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:29.734667 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:29.734667 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:29.734667 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:29.734667 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:29.734667 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:29.734667 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 02 09:57:29.734667 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:29.734667 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 140/282] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:29.740729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513112c-9d59-4b28-8917-86947484e088 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:29.853712 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513112c-9d59-4b28-8917-86947484e088 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:29.887598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f18015-4622-470a-9188-151709f8dae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:29.888274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f18015-4622-470a-9188-151709f8dae9 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:29.888555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f18015-4622-470a-9188-151709f8dae9 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:29.888892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f18015-4622-470a-9188-151709f8dae9 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:29.889637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f18015-4622-470a-9188-151709f8dae9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:29.889948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f18015-4622-470a-9188-151709f8dae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:29.891323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f18015-4622-470a-9188-151709f8dae9 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:29.900406 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 143/283] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:29.906623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab7868-dbe7-4f9f-8629-8ad516a4be97 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:30.008507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab7868-dbe7-4f9f-8629-8ad516a4be97 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:30.043266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695d1dd-0d3c-41cd-a545-824cbf744ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:30.044308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695d1dd-0d3c-41cd-a545-824cbf744ac6 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:30.044722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695d1dd-0d3c-41cd-a545-824cbf744ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:30.045101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695d1dd-0d3c-41cd-a545-824cbf744ac6 None admin] PATH_INFO: `/v3/users/86cfedcbefaa4886ba1ef34864118ce2` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:30.046430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695d1dd-0d3c-41cd-a545-824cbf744ac6 None admin] RBAC: Authorizing `identity:get_user(user_id=86cfedcbefaa4886ba1ef34864118ce2)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:30.048064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695d1dd-0d3c-41cd-a545-824cbf744ac6 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:30.050215 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 141/284] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:29 2022] GET /identity/v3/users/86cfedcbefaa4886ba1ef34864118ce2 => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:30.055632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f18015-4622-470a-9188-151709f8dae9 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:30.185545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f18015-4622-470a-9188-151709f8dae9 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:30.223767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1dd06-12fc-4273-964e-3474adc95acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:30.224889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1dd06-12fc-4273-964e-3474adc95acf None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:30.225281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1dd06-12fc-4273-964e-3474adc95acf None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:30.225661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1dd06-12fc-4273-964e-3474adc95acf None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:30.226992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1dd06-12fc-4273-964e-3474adc95acf None admin] RBAC: Authorizing `identity:get_project(project_id=de9cf9f9d50e4932a34fb509a4d47ce6)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:30.228611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1dd06-12fc-4273-964e-3474adc95acf None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:30.230735 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 144/285] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:30 2022] GET /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:30.237890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695d1dd-0d3c-41cd-a545-824cbf744ac6 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:30.343183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695d1dd-0d3c-41cd-a545-824cbf744ac6 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:30.376639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96409c-772e-4931-955f-cbead2cc530a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:30.377552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96409c-772e-4931-955f-cbead2cc530a None admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:30.377838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96409c-772e-4931-955f-cbead2cc530a None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:30.378118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96409c-772e-4931-955f-cbead2cc530a None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6/users/86cfedcbefaa4886ba1ef34864118ce2/roles/1325eb2a84a1482fade3efa8dbe3cfbf` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:30.380087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96409c-772e-4931-955f-cbead2cc530a None admin] RBAC: Authorizing `identity:create_grant(project_id=de9cf9f9d50e4932a34fb509a4d47ce6, user_id=86cfedcbefaa4886ba1ef34864118ce2, role_id=1325eb2a84a1482fade3efa8dbe3cfbf)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:30.381558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96409c-772e-4931-955f-cbead2cc530a None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:30.481298 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 142/286] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 09:57:30 2022] PUT /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6/users/86cfedcbefaa4886ba1ef34864118ce2/roles/1325eb2a84a1482fade3efa8dbe3cfbf => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:57:30.787290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058f23b-cb88-456f-b429-878603eafe29 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:30.787625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058f23b-cb88-456f-b429-878603eafe29 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:30.787802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058f23b-cb88-456f-b429-878603eafe29 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:30.789198 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 145/287] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:30.796483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d7d12-972d-4719-bd24-3562f0a50baf None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:30.796805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d7d12-972d-4719-bd24-3562f0a50baf None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:30.797087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d7d12-972d-4719-bd24-3562f0a50baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:30.814769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9c4d7d12-972d-4719-bd24-3562f0a50baf None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:30.817970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9c4d7d12-972d-4719-bd24-3562f0a50baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:30.884811 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 143/288] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:57:30.940236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058f23b-cb88-456f-b429-878603eafe29 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:31.078887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058f23b-cb88-456f-b429-878603eafe29 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:31.134314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94b595-cc4a-47f5-9bec-1f92f085a0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:31.135114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94b595-cc4a-47f5-9bec-1f92f085a0ff None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:31.135394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94b595-cc4a-47f5-9bec-1f92f085a0ff None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:31.135667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94b595-cc4a-47f5-9bec-1f92f085a0ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:31.156094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f94b595-cc4a-47f5-9bec-1f92f085a0ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:31.163696 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-0f94b595-cc4a-47f5-9bec-1f92f085a0ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:31.163696 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:31.163696 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:31.163696 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:31.163696 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:31.163696 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:31.163696 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:31.163696 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:31.163696 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:31.163696 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:31.163696 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:31.163696 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:31.163696 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:31.163696 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:31.163696 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:31.163696 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:31.164562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:31.164562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:31.164562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:31.164562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:31.164562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:31.164562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:31.164562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:31.164562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:31.164562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:31.164562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:31.164562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:31.164562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:31.164562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:31.164562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:31.164562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:31.164562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:31.165950 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:31.165950 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:31.165950 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:31.165950 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:31.165950 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:31.165950 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:31.165950 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:31.165950 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:31.165950 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:31.165950 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:31.165950 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:31.165950 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:31.165950 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 146/289] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:31.171284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d7d12-972d-4719-bd24-3562f0a50baf None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:31.291071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d7d12-972d-4719-bd24-3562f0a50baf None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:31.324741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec7b37-3dee-463a-a7c8-069dc7f5e097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:31.325413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec7b37-3dee-463a-a7c8-069dc7f5e097 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:31.325699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec7b37-3dee-463a-a7c8-069dc7f5e097 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:31.325978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec7b37-3dee-463a-a7c8-069dc7f5e097 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:31.326718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec7b37-3dee-463a-a7c8-069dc7f5e097 None admin] RBAC: Adding query filter params (name=member) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:31.327026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec7b37-3dee-463a-a7c8-069dc7f5e097 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:31.328409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec7b37-3dee-463a-a7c8-069dc7f5e097 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:31.336737 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 144/290] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:31.345659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94b595-cc4a-47f5-9bec-1f92f085a0ff None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:31.500202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94b595-cc4a-47f5-9bec-1f92f085a0ff None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:31.545292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b94fa-d95a-41ac-a576-65e7692b9f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:31.546171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b94fa-d95a-41ac-a576-65e7692b9f30 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:31.546454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b94fa-d95a-41ac-a576-65e7692b9f30 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:31.546729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b94fa-d95a-41ac-a576-65e7692b9f30 None admin] PATH_INFO: `/v3/users/72fd2e7f610740ec80a19db2ecdfa4a0` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:31.547941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b94fa-d95a-41ac-a576-65e7692b9f30 None admin] RBAC: Authorizing `identity:get_user(user_id=72fd2e7f610740ec80a19db2ecdfa4a0)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:31.549409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b94fa-d95a-41ac-a576-65e7692b9f30 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:31.551381 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 147/291] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:31 2022] GET /identity/v3/users/72fd2e7f610740ec80a19db2ecdfa4a0 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:31.556581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec7b37-3dee-463a-a7c8-069dc7f5e097 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:31.689428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec7b37-3dee-463a-a7c8-069dc7f5e097 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:31.723550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba3a24-da41-4c49-841e-f5595d1cfbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:31.724212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba3a24-da41-4c49-841e-f5595d1cfbd3 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:31.724496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba3a24-da41-4c49-841e-f5595d1cfbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:31.724806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba3a24-da41-4c49-841e-f5595d1cfbd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:31.793260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba3a24-da41-4c49-841e-f5595d1cfbd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:31.794767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba3a24-da41-4c49-841e-f5595d1cfbd3 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:31.894730 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 145/292] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:31.900296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b94fa-d95a-41ac-a576-65e7692b9f30 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:32.023218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b94fa-d95a-41ac-a576-65e7692b9f30 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:32.061694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329ee7e-5412-454c-b4da-896b95da12a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:32.062615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329ee7e-5412-454c-b4da-896b95da12a0 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:32.062907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329ee7e-5412-454c-b4da-896b95da12a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:32.063189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329ee7e-5412-454c-b4da-896b95da12a0 None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:32.069329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329ee7e-5412-454c-b4da-896b95da12a0 None admin] RBAC: Authorizing `identity:get_project(project_id=de9cf9f9d50e4932a34fb509a4d47ce6)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:32.070782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329ee7e-5412-454c-b4da-896b95da12a0 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:32.073279 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 148/293] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:31 2022] GET /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:32.078891 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba3a24-da41-4c49-841e-f5595d1cfbd3 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:32.197944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba3a24-da41-4c49-841e-f5595d1cfbd3 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:32.233917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438bd594-2dda-4c1b-aabb-0cd240263c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:32.234586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bd594-2dda-4c1b-aabb-0cd240263c8f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:32.234870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bd594-2dda-4c1b-aabb-0cd240263c8f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:32.235148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bd594-2dda-4c1b-aabb-0cd240263c8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:32.235982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438bd594-2dda-4c1b-aabb-0cd240263c8f None admin] RBAC: Adding query filter params (role.id=d1592d47a67b4f4a8d14e2101c799509, scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6, user.id=72fd2e7f610740ec80a19db2ecdfa4a0) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:32.236295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438bd594-2dda-4c1b-aabb-0cd240263c8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:32.238034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438bd594-2dda-4c1b-aabb-0cd240263c8f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:32.244889 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 146/294] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:57:32 2022] GET /identity/v3/role_assignments?user.id=72fd2e7f610740ec80a19db2ecdfa4a0&scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6&role.id=d1592d47a67b4f4a8d14e2101c799509 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:32.407585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612935a-1689-485d-81e5-93c22b4029b8 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:32.407968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612935a-1689-485d-81e5-93c22b4029b8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:32.408156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612935a-1689-485d-81e5-93c22b4029b8 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:32.409728 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 149/295] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:32.415629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26569855-0c2d-4dd9-96af-4dceab1fdf31 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:32.415919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26569855-0c2d-4dd9-96af-4dceab1fdf31 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:32.416203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26569855-0c2d-4dd9-96af-4dceab1fdf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:32.436952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-26569855-0c2d-4dd9-96af-4dceab1fdf31 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:32.438161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-26569855-0c2d-4dd9-96af-4dceab1fdf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:32.521548 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 147/296] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:32.546655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612935a-1689-485d-81e5-93c22b4029b8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:32.610558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de877f0e-374a-48f7-8d80-5e8f9dda0a61 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:32.610890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de877f0e-374a-48f7-8d80-5e8f9dda0a61 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:32.611119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de877f0e-374a-48f7-8d80-5e8f9dda0a61 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:32.612959 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 148/297] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:57:32.622679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221e0fb-ec38-4f13-9348-232a074bf37d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:32.623302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221e0fb-ec38-4f13-9348-232a074bf37d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:32.623810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221e0fb-ec38-4f13-9348-232a074bf37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:32.642113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8221e0fb-ec38-4f13-9348-232a074bf37d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:32.643451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8221e0fb-ec38-4f13-9348-232a074bf37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:32.699561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612935a-1689-485d-81e5-93c22b4029b8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:32.730513 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 149/298] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:57:32.738371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0b92c-83de-47b7-b869-32ffef1792e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:32.739335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0b92c-83de-47b7-b869-32ffef1792e5 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:32.739786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0b92c-83de-47b7-b869-32ffef1792e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:32.740205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0b92c-83de-47b7-b869-32ffef1792e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:32.741559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0b92c-83de-47b7-b869-32ffef1792e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:32.743744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0b92c-83de-47b7-b869-32ffef1792e5 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:32.745952 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 150/299] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:57:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:32.754950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221e0fb-ec38-4f13-9348-232a074bf37d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:32.756406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0b92c-83de-47b7-b869-32ffef1792e5 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:32.857535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221e0fb-ec38-4f13-9348-232a074bf37d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:32.875785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0b92c-83de-47b7-b869-32ffef1792e5 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:32.891160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86035d48-7ca4-4336-ad07-a46c75bee39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:32.891832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86035d48-7ca4-4336-ad07-a46c75bee39d None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:32.892122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86035d48-7ca4-4336-ad07-a46c75bee39d None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:32.892496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86035d48-7ca4-4336-ad07-a46c75bee39d None admin] PATH_INFO: `/v3/groups` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:32.893227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86035d48-7ca4-4336-ad07-a46c75bee39d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:32.894693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86035d48-7ca4-4336-ad07-a46c75bee39d None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:32.909106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb0f59-0823-421e-bafd-f78caf4ef69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:32.909908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb0f59-0823-421e-bafd-f78caf4ef69b None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:32.913807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb0f59-0823-421e-bafd-f78caf4ef69b None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:32.913807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb0f59-0823-421e-bafd-f78caf4ef69b None admin] PATH_INFO: `/v3/roles/member` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:32.921042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb0f59-0823-421e-bafd-f78caf4ef69b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:32.928917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-2dbb0f59-0823-421e-bafd-f78caf4ef69b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:32.928917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:32.928917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:32.928917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:32.928917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:32.928917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:32.928917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:32.928917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:32.928917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:32.928917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:32.928917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:32.928917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:32.928917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:32.928917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:32.928917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:32.928917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:32.929812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:32.929812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:32.929812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:32.929812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:32.929812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:32.929812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:32.929812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:32.929812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:32.929812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:32.929812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:32.929812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:32.929812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:32.929812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:32.929812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:32.929812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:32.929812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:32.931604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:32.931604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:32.931604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:32.931604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:32.931604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:32.931604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:32.931604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:32.931604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:32.931604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:32.931604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:32.931604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:32.931604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:32.931604 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 151/300] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:32.932494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c21fa-f557-4a73-8da5-244340afaf1e None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:32.932494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c21fa-f557-4a73-8da5-244340afaf1e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:32.932494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c21fa-f557-4a73-8da5-244340afaf1e None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:32.933892 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 152/301] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:32.936836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c21fa-f557-4a73-8da5-244340afaf1e None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:32.966240 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 150/302] 10.222.0.16 () {60 vars in 1134 bytes} [Mon May 2 09:57:32 2022] POST /identity/v3/groups => generated 229 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:57:32.967542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd02ad-cfb4-4dab-a97f-09c761f6e33e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:32.967842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd02ad-cfb4-4dab-a97f-09c761f6e33e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:32.968336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd02ad-cfb4-4dab-a97f-09c761f6e33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:32.992480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-27dd02ad-cfb4-4dab-a97f-09c761f6e33e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:32.994551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-27dd02ad-cfb4-4dab-a97f-09c761f6e33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:33.046772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c21fa-f557-4a73-8da5-244340afaf1e None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:33.083406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d63597-9d10-47e8-9b8f-c6d50e6f9bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:33.084088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d63597-9d10-47e8-9b8f-c6d50e6f9bc8 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:33.084358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d63597-9d10-47e8-9b8f-c6d50e6f9bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:33.084679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d63597-9d10-47e8-9b8f-c6d50e6f9bc8 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:33.085502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d63597-9d10-47e8-9b8f-c6d50e6f9bc8 None admin] RBAC: Adding query filter params (name=member) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:33.085817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d63597-9d10-47e8-9b8f-c6d50e6f9bc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:33.087304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d63597-9d10-47e8-9b8f-c6d50e6f9bc8 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:33.090711 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 151/303] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:33.107185 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 153/304] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:33.112787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd02ad-cfb4-4dab-a97f-09c761f6e33e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:33.126700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d63597-9d10-47e8-9b8f-c6d50e6f9bc8 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:33.240937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd02ad-cfb4-4dab-a97f-09c761f6e33e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:33.241598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d63597-9d10-47e8-9b8f-c6d50e6f9bc8 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:33.283336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c144c-9e0b-41ae-89a2-d7cd23af6cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:33.284241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c144c-9e0b-41ae-89a2-d7cd23af6cbc None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:33.284526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c144c-9e0b-41ae-89a2-d7cd23af6cbc None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:33.284848 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c144c-9e0b-41ae-89a2-d7cd23af6cbc None admin] PATH_INFO: `/v3/users/d0fbcd2e5aaa46ed9d1e8ba856d4beaf` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:33.285192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08646413-c273-4931-9ff5-2d66c5b75b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:33.286133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c144c-9e0b-41ae-89a2-d7cd23af6cbc None admin] RBAC: Authorizing `identity:get_user(user_id=d0fbcd2e5aaa46ed9d1e8ba856d4beaf)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:33.286596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08646413-c273-4931-9ff5-2d66c5b75b2c None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:33.287073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08646413-c273-4931-9ff5-2d66c5b75b2c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:33.287560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08646413-c273-4931-9ff5-2d66c5b75b2c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:33.287839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c144c-9e0b-41ae-89a2-d7cd23af6cbc None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:33.289683 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 152/305] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:33 2022] GET /identity/v3/users/d0fbcd2e5aaa46ed9d1e8ba856d4beaf => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:33.296073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c144c-9e0b-41ae-89a2-d7cd23af6cbc None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:33.302293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08646413-c273-4931-9ff5-2d66c5b75b2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:33.312029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-08646413-c273-4931-9ff5-2d66c5b75b2c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 02 09:57:33.312029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:33.312029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:33.312029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:33.312029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:33.312029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:33.312029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:33.312029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:33.312029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:33.312029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:33.312029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:33.312029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:33.312029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:33.312029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:33.312029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:33.312029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:33.312952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:33.312952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:33.312952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:33.312952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:33.312952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:33.312952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:33.312952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:33.312952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:33.312952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:33.312952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:33.312952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:33.312952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:33.312952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:33.312952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:33.312952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:33.312952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:33.313736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:33.313736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:33.313736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:33.313736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:33.313736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:33.313736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:33.313736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:33.313736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:33.313736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:33.313736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:33.313736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 02 09:57:33.313736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:33.313736 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 154/306] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:57:33.318964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08646413-c273-4931-9ff5-2d66c5b75b2c None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:33.418319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08646413-c273-4931-9ff5-2d66c5b75b2c None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:33.422247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c144c-9e0b-41ae-89a2-d7cd23af6cbc None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:33.456574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b7b97-faab-4a2b-ae5b-999318f0b17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:33.457477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b7b97-faab-4a2b-ae5b-999318f0b17b None admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:33.457764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b7b97-faab-4a2b-ae5b-999318f0b17b None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:33.458046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b7b97-faab-4a2b-ae5b-999318f0b17b None admin] PATH_INFO: `/v3/system/users/d0fbcd2e5aaa46ed9d1e8ba856d4beaf/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:33.459548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b7b97-faab-4a2b-ae5b-999318f0b17b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d0fbcd2e5aaa46ed9d1e8ba856d4beaf, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:33.460991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b7b97-faab-4a2b-ae5b-999318f0b17b None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:33.461532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10e15c-b5c4-4da4-8ae0-7ab9d8c35dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:33.465160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10e15c-b5c4-4da4-8ae0-7ab9d8c35dbf None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:33.465160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10e15c-b5c4-4da4-8ae0-7ab9d8c35dbf None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:33.465160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10e15c-b5c4-4da4-8ae0-7ab9d8c35dbf None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:33.465160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10e15c-b5c4-4da4-8ae0-7ab9d8c35dbf None admin] RBAC: Adding query filter params (name=reader) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:33.465160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10e15c-b5c4-4da4-8ae0-7ab9d8c35dbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:33.466926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10e15c-b5c4-4da4-8ae0-7ab9d8c35dbf None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:33.475168 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 155/307] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:33.476378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bb57d-6287-4e73-a514-56a0e4a96ab3 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:33.476693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bb57d-6287-4e73-a514-56a0e4a96ab3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:33.476974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bb57d-6287-4e73-a514-56a0e4a96ab3 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:33.480641 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 156/308] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:33.481482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bb57d-6287-4e73-a514-56a0e4a96ab3 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:33.577240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bb57d-6287-4e73-a514-56a0e4a96ab3 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:33.609321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b58fe-ac1e-4c39-95ba-dd9402039fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:33.610181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b58fe-ac1e-4c39-95ba-dd9402039fbe None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:33.610466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b58fe-ac1e-4c39-95ba-dd9402039fbe None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:33.610745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b58fe-ac1e-4c39-95ba-dd9402039fbe None admin] PATH_INFO: `/v3/users/ef024fc724dc4af88e237f26ff3e4705` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:33.611536 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 153/309] 10.222.0.16 () {58 vars in 1334 bytes} [Mon May 2 09:57:33 2022] PUT /identity/v3/system/users/d0fbcd2e5aaa46ed9d1e8ba856d4beaf/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 09:57:33.613868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b5d9f-66b2-477c-a73b-393cbd498c20 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:33.613868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b5d9f-66b2-477c-a73b-393cbd498c20 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:33.613868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b5d9f-66b2-477c-a73b-393cbd498c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:33.627150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b58fe-ac1e-4c39-95ba-dd9402039fbe None admin] RBAC: Authorizing `identity:get_user(user_id=ef024fc724dc4af88e237f26ff3e4705)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:33.630966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b58fe-ac1e-4c39-95ba-dd9402039fbe None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:33.636022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-878b5d9f-66b2-477c-a73b-393cbd498c20 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:33.636714 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 157/310] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:33 2022] GET /identity/v3/users/ef024fc724dc4af88e237f26ff3e4705 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:33.636890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-878b5d9f-66b2-477c-a73b-393cbd498c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:33.638336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b58fe-ac1e-4c39-95ba-dd9402039fbe None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:33.731084 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 154/311] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:33.749789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b58fe-ac1e-4c39-95ba-dd9402039fbe None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:33.754881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b5d9f-66b2-477c-a73b-393cbd498c20 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:33.788560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c075b3-e24b-43e7-9293-8a5aefc8cbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:33.789256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c075b3-e24b-43e7-9293-8a5aefc8cbe9 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:33.789583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c075b3-e24b-43e7-9293-8a5aefc8cbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:33.789909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c075b3-e24b-43e7-9293-8a5aefc8cbe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:33.790757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c075b3-e24b-43e7-9293-8a5aefc8cbe9 None admin] RBAC: Adding query filter params (role.id=1325eb2a84a1482fade3efa8dbe3cfbf, user.id=ef024fc724dc4af88e237f26ff3e4705, scope.system=all) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:33.791070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c075b3-e24b-43e7-9293-8a5aefc8cbe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:33.792589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c075b3-e24b-43e7-9293-8a5aefc8cbe9 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:33.804628 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 158/312] 10.222.0.16 () {56 vars in 1308 bytes} [Mon May 2 09:57:33 2022] GET /identity/v3/role_assignments?user.id=ef024fc724dc4af88e237f26ff3e4705&scope.system=all&role.id=1325eb2a84a1482fade3efa8dbe3cfbf => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:33.878884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b5d9f-66b2-477c-a73b-393cbd498c20 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:33.915817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5dc798-d506-442a-9749-f1e8ac8ef98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:33.916724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5dc798-d506-442a-9749-f1e8ac8ef98c None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:33.917012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5dc798-d506-442a-9749-f1e8ac8ef98c None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:33.917287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5dc798-d506-442a-9749-f1e8ac8ef98c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:33.931288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5dc798-d506-442a-9749-f1e8ac8ef98c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:33.939115 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-9d5dc798-d506-442a-9749-f1e8ac8ef98c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 02 09:57:33.939115 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:33.939115 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:33.939115 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:33.939115 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:33.939115 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:33.939115 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:33.939115 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:33.939115 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:33.939115 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:33.939115 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:33.939115 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:33.939115 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:33.939115 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:33.939115 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:33.939115 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:33.940050 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:33.940050 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:33.940050 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:33.940050 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:33.940050 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:33.940050 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:33.940050 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:33.940050 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:33.940050 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:33.940050 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:33.940050 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:33.940050 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:57:33.940050 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:33.940050 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:33.940050 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:33.940050 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:33.941272 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:33.941272 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:33.941272 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:33.941272 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:33.941272 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:33.941272 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:33.941272 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:33.941272 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:33.941272 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:33.941272 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:33.941272 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 02 09:57:33.941272 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:33.941272 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 155/313] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:57:33.947036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c075b3-e24b-43e7-9293-8a5aefc8cbe9 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:34.050131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c075b3-e24b-43e7-9293-8a5aefc8cbe9 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:34.084345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6a381-22ab-43c5-90c9-071e844f01ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:34.085472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6a381-22ab-43c5-90c9-071e844f01ba None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:34.085955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6a381-22ab-43c5-90c9-071e844f01ba None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:34.086421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6a381-22ab-43c5-90c9-071e844f01ba None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:34.087383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6a381-22ab-43c5-90c9-071e844f01ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:34.087871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6a381-22ab-43c5-90c9-071e844f01ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:34.089446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6a381-22ab-43c5-90c9-071e844f01ba None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:34.098100 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 159/314] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:34.107433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5dc798-d506-442a-9749-f1e8ac8ef98c None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:34.224144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5dc798-d506-442a-9749-f1e8ac8ef98c None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:34.240885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a80f2-81cd-4910-8f9a-dd32d8b02621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:34.241818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a80f2-81cd-4910-8f9a-dd32d8b02621 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:34.242360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a80f2-81cd-4910-8f9a-dd32d8b02621 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:34.242360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a80f2-81cd-4910-8f9a-dd32d8b02621 None admin] PATH_INFO: `/v3/users/86cfedcbefaa4886ba1ef34864118ce2` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:34.244078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a80f2-81cd-4910-8f9a-dd32d8b02621 None admin] RBAC: Authorizing `identity:get_user(user_id=86cfedcbefaa4886ba1ef34864118ce2)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:34.245565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a80f2-81cd-4910-8f9a-dd32d8b02621 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:34.247219 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 156/315] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:34 2022] GET /identity/v3/users/86cfedcbefaa4886ba1ef34864118ce2 => generated 297 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:34.252887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6a381-22ab-43c5-90c9-071e844f01ba None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:34.355964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6a381-22ab-43c5-90c9-071e844f01ba None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:34.389434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd85224-ea2d-4d9a-95d9-6a88e88f9214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:34.390079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd85224-ea2d-4d9a-95d9-6a88e88f9214 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:34.390359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd85224-ea2d-4d9a-95d9-6a88e88f9214 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:34.390630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd85224-ea2d-4d9a-95d9-6a88e88f9214 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:34.456296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd85224-ea2d-4d9a-95d9-6a88e88f9214 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:34.460620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd85224-ea2d-4d9a-95d9-6a88e88f9214 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:34.558628 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 160/316] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:34.564358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a80f2-81cd-4910-8f9a-dd32d8b02621 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:34.669979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a80f2-81cd-4910-8f9a-dd32d8b02621 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:34.703409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35999bd8-b12b-45e8-b6e2-ef65dec1b81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:34.704276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35999bd8-b12b-45e8-b6e2-ef65dec1b81f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:34.704561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35999bd8-b12b-45e8-b6e2-ef65dec1b81f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:34.704877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35999bd8-b12b-45e8-b6e2-ef65dec1b81f None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:34.706064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35999bd8-b12b-45e8-b6e2-ef65dec1b81f None admin] RBAC: Authorizing `identity:get_project(project_id=de9cf9f9d50e4932a34fb509a4d47ce6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:34.707504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35999bd8-b12b-45e8-b6e2-ef65dec1b81f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:34.709544 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 157/317] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:34 2022] GET /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:34.715721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd85224-ea2d-4d9a-95d9-6a88e88f9214 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:34.814912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd85224-ea2d-4d9a-95d9-6a88e88f9214 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:34.848546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35627581-95b7-44c6-8941-4c9677c3df92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:34.849227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35627581-95b7-44c6-8941-4c9677c3df92 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:34.849507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35627581-95b7-44c6-8941-4c9677c3df92 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:34.849785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35627581-95b7-44c6-8941-4c9677c3df92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:34.850613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35627581-95b7-44c6-8941-4c9677c3df92 None admin] RBAC: Adding query filter params (role.id=1325eb2a84a1482fade3efa8dbe3cfbf, scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6, user.id=86cfedcbefaa4886ba1ef34864118ce2) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:34.850924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35627581-95b7-44c6-8941-4c9677c3df92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:34.853005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35627581-95b7-44c6-8941-4c9677c3df92 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:34.858887 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 161/318] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:57:34 2022] GET /identity/v3/role_assignments?user.id=86cfedcbefaa4886ba1ef34864118ce2&scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6&role.id=1325eb2a84a1482fade3efa8dbe3cfbf => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:35.405814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ceebe4-dbe9-4456-a9be-8346dc95c7cb None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:35.406339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ceebe4-dbe9-4456-a9be-8346dc95c7cb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:35.406417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ceebe4-dbe9-4456-a9be-8346dc95c7cb None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:35.408040 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 158/319] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:35.413121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e7ec8-f52c-424d-bbe8-b8718c880c58 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:35.413549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e7ec8-f52c-424d-bbe8-b8718c880c58 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:35.424742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e7ec8-f52c-424d-bbe8-b8718c880c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:35.430475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fc1e7ec8-f52c-424d-bbe8-b8718c880c58 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:35.431679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fc1e7ec8-f52c-424d-bbe8-b8718c880c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:35.497281 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 162/320] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:35.522231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ceebe4-dbe9-4456-a9be-8346dc95c7cb None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:35.625210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ceebe4-dbe9-4456-a9be-8346dc95c7cb None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:35.657979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e4ad4-e6b6-440c-8efd-66f3395692b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:35.658700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e4ad4-e6b6-440c-8efd-66f3395692b0 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:35.658988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e4ad4-e6b6-440c-8efd-66f3395692b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:35.659271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e4ad4-e6b6-440c-8efd-66f3395692b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:35.660452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e4ad4-e6b6-440c-8efd-66f3395692b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:35.661963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e4ad4-e6b6-440c-8efd-66f3395692b0 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:35.663782 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 159/321] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:57:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:35.669347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e7ec8-f52c-424d-bbe8-b8718c880c58 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:35.763736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e7ec8-f52c-424d-bbe8-b8718c880c58 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:35.797627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffcfa37-f785-427b-b1e5-edbbe6fdf7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:35.798299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcfa37-f785-427b-b1e5-edbbe6fdf7e7 None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:35.798588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcfa37-f785-427b-b1e5-edbbe6fdf7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:35.798868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcfa37-f785-427b-b1e5-edbbe6fdf7e7 None admin] PATH_INFO: `/v3/groups` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:35.799571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffcfa37-f785-427b-b1e5-edbbe6fdf7e7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:35.801221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffcfa37-f785-427b-b1e5-edbbe6fdf7e7 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:35.930492 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 163/322] 10.222.0.16 () {60 vars in 1134 bytes} [Mon May 2 09:57:35 2022] POST /identity/v3/groups => generated 226 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:57:36.044855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59e2b4-607e-4289-b5f2-44384c737957 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:36.045136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59e2b4-607e-4289-b5f2-44384c737957 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:36.045598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59e2b4-607e-4289-b5f2-44384c737957 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:36.046986 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 160/323] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:36.052628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817e74b-d76d-4904-82ef-8f11fb591bdd None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:36.052938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817e74b-d76d-4904-82ef-8f11fb591bdd None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:36.053220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817e74b-d76d-4904-82ef-8f11fb591bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:36.070977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0817e74b-d76d-4904-82ef-8f11fb591bdd None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:36.072250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0817e74b-d76d-4904-82ef-8f11fb591bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:36.148854 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 164/324] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:36.174073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59e2b4-607e-4289-b5f2-44384c737957 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:36.194226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847b09c-0104-4c42-97b3-e31c3d2e7891 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:36.194759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847b09c-0104-4c42-97b3-e31c3d2e7891 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:36.195042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847b09c-0104-4c42-97b3-e31c3d2e7891 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:36.196828 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 165/325] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:57:36.201963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c19cc-238f-4a55-8f6a-648790fb0e19 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:36.202256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c19cc-238f-4a55-8f6a-648790fb0e19 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:36.202537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c19cc-238f-4a55-8f6a-648790fb0e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:36.225039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-554c19cc-238f-4a55-8f6a-648790fb0e19 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:36.226479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-554c19cc-238f-4a55-8f6a-648790fb0e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:36.296242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59e2b4-607e-4289-b5f2-44384c737957 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:36.312294 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 166/326] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:36.329105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9a441-66af-4c43-8dca-33dc29f20c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:36.329903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9a441-66af-4c43-8dca-33dc29f20c4c None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:36.330185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9a441-66af-4c43-8dca-33dc29f20c4c None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:36.330464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9a441-66af-4c43-8dca-33dc29f20c4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:36.339350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c19cc-238f-4a55-8f6a-648790fb0e19 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:36.341368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9a441-66af-4c43-8dca-33dc29f20c4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:36.349825 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-a1c9a441-66af-4c43-8dca-33dc29f20c4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:36.349825 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:36.349825 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:36.349825 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:36.349825 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:36.349825 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:36.349825 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:36.349825 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:36.349825 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:36.349825 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:36.349825 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:36.349825 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:36.349825 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:36.349825 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:36.349825 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:36.349825 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:36.350779 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:36.350779 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:36.350779 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:36.350779 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:36.350779 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:36.350779 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:36.350779 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:36.350779 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:36.350779 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:36.350779 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:36.350779 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:36.350779 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:57:36.350779 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:36.350779 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:36.350779 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:36.350779 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:36.351614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:36.351614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:36.351614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:36.351614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:36.351614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:36.351614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:36.351614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:36.351614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:36.351614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:36.351614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:36.351614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:36.351614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:36.351614 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 161/327] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:36.356476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9a441-66af-4c43-8dca-33dc29f20c4c None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:36.454735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c19cc-238f-4a55-8f6a-648790fb0e19 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:36.470675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9a441-66af-4c43-8dca-33dc29f20c4c None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:36.490612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29c5f8-25a1-4717-86bf-7b35809f64bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:36.491408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29c5f8-25a1-4717-86bf-7b35809f64bd None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:36.491694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29c5f8-25a1-4717-86bf-7b35809f64bd None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:36.491973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29c5f8-25a1-4717-86bf-7b35809f64bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:36.502274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29c5f8-25a1-4717-86bf-7b35809f64bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:36.505559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d9e5c-aff1-46da-9b17-ec44671d987e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:36.506232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d9e5c-aff1-46da-9b17-ec44671d987e None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:36.506602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d9e5c-aff1-46da-9b17-ec44671d987e None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:36.506886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d9e5c-aff1-46da-9b17-ec44671d987e None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:36.507753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d9e5c-aff1-46da-9b17-ec44671d987e None admin] RBAC: Adding query filter params (name=member) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:36.508072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d9e5c-aff1-46da-9b17-ec44671d987e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:36.509638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d9e5c-aff1-46da-9b17-ec44671d987e None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:36.511461 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-ce29c5f8-25a1-4717-86bf-7b35809f64bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 02 09:57:36.511461 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:36.511461 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:36.511461 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:36.511461 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:36.511461 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:36.511461 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:36.511461 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:36.511461 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:36.511461 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:36.511461 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:36.511461 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:36.511461 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:36.511461 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:36.511461 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:36.511461 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:36.512483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:36.512483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:36.512483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:36.512483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:36.512483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:36.512483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:36.512483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:36.512483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:36.512483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:36.512483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:36.512483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:36.512483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:36.512483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:36.512483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:36.512483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:36.512483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:36.513377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:36.513377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:36.513377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:36.513377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:36.513377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:36.513377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:36.513377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:36.513377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:36.513377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:36.513377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:36.513377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 02 09:57:36.513377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:36.513377 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 167/328] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:36.520728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29c5f8-25a1-4717-86bf-7b35809f64bd None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:36.521810 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 162/329] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:36.542133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d9e5c-aff1-46da-9b17-ec44671d987e None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:36.626906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29c5f8-25a1-4717-86bf-7b35809f64bd None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:36.646030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d9e5c-aff1-46da-9b17-ec44671d987e None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:36.666838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf301d-4770-4a81-a0f4-67e6edc6921d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:36.666838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf301d-4770-4a81-a0f4-67e6edc6921d None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:36.666838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf301d-4770-4a81-a0f4-67e6edc6921d None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:36.666838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf301d-4770-4a81-a0f4-67e6edc6921d None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:36.667588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf301d-4770-4a81-a0f4-67e6edc6921d None admin] RBAC: Adding query filter params (name=reader) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:36.667588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf301d-4770-4a81-a0f4-67e6edc6921d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:36.667588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf301d-4770-4a81-a0f4-67e6edc6921d None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:36.675893 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 168/330] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:36.682418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf301d-4770-4a81-a0f4-67e6edc6921d None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:36.686554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a696deb-6564-47b2-b754-5ac4f3d07c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:36.688248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a696deb-6564-47b2-b754-5ac4f3d07c76 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:36.688533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a696deb-6564-47b2-b754-5ac4f3d07c76 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:36.688902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a696deb-6564-47b2-b754-5ac4f3d07c76 None admin] PATH_INFO: `/v3/users/d0fbcd2e5aaa46ed9d1e8ba856d4beaf` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:36.690158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a696deb-6564-47b2-b754-5ac4f3d07c76 None admin] RBAC: Authorizing `identity:get_user(user_id=d0fbcd2e5aaa46ed9d1e8ba856d4beaf)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:36.691611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a696deb-6564-47b2-b754-5ac4f3d07c76 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:36.696616 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 163/331] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:36 2022] GET /identity/v3/users/d0fbcd2e5aaa46ed9d1e8ba856d4beaf => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:36.702630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a696deb-6564-47b2-b754-5ac4f3d07c76 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:36.820194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf301d-4770-4a81-a0f4-67e6edc6921d None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:36.831728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a696deb-6564-47b2-b754-5ac4f3d07c76 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:36.860819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99e16d-adaa-4a9f-aba1-44173673ef4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:36.862267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99e16d-adaa-4a9f-aba1-44173673ef4e None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:36.862699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99e16d-adaa-4a9f-aba1-44173673ef4e None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:36.863133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99e16d-adaa-4a9f-aba1-44173673ef4e None admin] PATH_INFO: `/v3/users/ef024fc724dc4af88e237f26ff3e4705` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:36.864516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99e16d-adaa-4a9f-aba1-44173673ef4e None admin] RBAC: Authorizing `identity:get_user(user_id=ef024fc724dc4af88e237f26ff3e4705)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:36.866116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99e16d-adaa-4a9f-aba1-44173673ef4e None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:36.868374 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 169/332] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:36 2022] GET /identity/v3/users/ef024fc724dc4af88e237f26ff3e4705 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:36.871900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aaf6a1-685f-44e9-a23b-42335af0a4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:36.872853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaf6a1-685f-44e9-a23b-42335af0a4cf None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:36.874086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99e16d-adaa-4a9f-aba1-44173673ef4e None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:36.874747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaf6a1-685f-44e9-a23b-42335af0a4cf None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:36.876261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaf6a1-685f-44e9-a23b-42335af0a4cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:36.877567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aaf6a1-685f-44e9-a23b-42335af0a4cf None admin] RBAC: Adding query filter params (role.id=d1592d47a67b4f4a8d14e2101c799509, user.id=d0fbcd2e5aaa46ed9d1e8ba856d4beaf, scope.system=all) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:36.878952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aaf6a1-685f-44e9-a23b-42335af0a4cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:36.880626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aaf6a1-685f-44e9-a23b-42335af0a4cf None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:36.903661 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 164/333] 10.222.0.16 () {56 vars in 1308 bytes} [Mon May 2 09:57:36 2022] GET /identity/v3/role_assignments?user.id=d0fbcd2e5aaa46ed9d1e8ba856d4beaf&scope.system=all&role.id=d1592d47a67b4f4a8d14e2101c799509 => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:36.992056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99e16d-adaa-4a9f-aba1-44173673ef4e None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:37.032298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac643ca7-963b-4ac7-ac87-1c8873ab4ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:37.033501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac643ca7-963b-4ac7-ac87-1c8873ab4ad5 None admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:37.033939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac643ca7-963b-4ac7-ac87-1c8873ab4ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:37.034374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac643ca7-963b-4ac7-ac87-1c8873ab4ad5 None admin] PATH_INFO: `/v3/system/users/ef024fc724dc4af88e237f26ff3e4705/roles/1325eb2a84a1482fade3efa8dbe3cfbf` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:37.041623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac643ca7-963b-4ac7-ac87-1c8873ab4ad5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ef024fc724dc4af88e237f26ff3e4705, role_id=1325eb2a84a1482fade3efa8dbe3cfbf)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:37.043286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac643ca7-963b-4ac7-ac87-1c8873ab4ad5 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:37.115396 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 170/334] 10.222.0.16 () {58 vars in 1334 bytes} [Mon May 2 09:57:36 2022] PUT /identity/v3/system/users/ef024fc724dc4af88e237f26ff3e4705/roles/1325eb2a84a1482fade3efa8dbe3cfbf => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 09:57:38.688868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59367bc0-dd51-4688-8297-1e0c98c4adf7 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:38.689741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59367bc0-dd51-4688-8297-1e0c98c4adf7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:38.690176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59367bc0-dd51-4688-8297-1e0c98c4adf7 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:38.691746 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 165/335] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:38.706119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655bd78-2fe2-4501-9af2-201ddbfae25b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:38.706627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655bd78-2fe2-4501-9af2-201ddbfae25b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:38.706704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655bd78-2fe2-4501-9af2-201ddbfae25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:38.733598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1655bd78-2fe2-4501-9af2-201ddbfae25b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:38.734817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1655bd78-2fe2-4501-9af2-201ddbfae25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:38.812102 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 171/336] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:38.850076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59367bc0-dd51-4688-8297-1e0c98c4adf7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:38.981480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59367bc0-dd51-4688-8297-1e0c98c4adf7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:39.022304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0c55c-1aa8-4497-b469-6d7b939d14e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:39.023111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0c55c-1aa8-4497-b469-6d7b939d14e5 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:39.023396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0c55c-1aa8-4497-b469-6d7b939d14e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:39.023674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0c55c-1aa8-4497-b469-6d7b939d14e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:39.038846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0c55c-1aa8-4497-b469-6d7b939d14e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:39.047083 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-08c0c55c-1aa8-4497-b469-6d7b939d14e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:39.047083 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:39.047083 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:39.047083 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:39.047083 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:39.047083 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:39.047083 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:39.047083 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:39.047083 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:39.047083 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:39.047083 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:39.047083 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:39.047083 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:39.047083 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:39.047083 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:39.047083 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:39.047957 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:39.047957 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:39.047957 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:39.047957 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:39.047957 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:39.047957 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:39.047957 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:39.047957 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:39.047957 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:39.047957 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:39.047957 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:39.047957 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:57:39.047957 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:39.047957 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:39.047957 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:39.047957 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:39.049192 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:39.049192 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:39.049192 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:39.049192 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:39.049192 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:39.049192 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:39.049192 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:39.049192 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:39.049192 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:39.049192 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:39.049192 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:39.049192 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:39.049192 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 166/337] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:39.054342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655bd78-2fe2-4501-9af2-201ddbfae25b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:39.195357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655bd78-2fe2-4501-9af2-201ddbfae25b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:39.235705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79ac86-7c1b-485b-b9a9-dac23665db26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:39.236298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79ac86-7c1b-485b-b9a9-dac23665db26 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:39.236575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79ac86-7c1b-485b-b9a9-dac23665db26 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:39.236872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79ac86-7c1b-485b-b9a9-dac23665db26 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:39.237879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79ac86-7c1b-485b-b9a9-dac23665db26 None admin] RBAC: Adding query filter params (name=member) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:39.238186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79ac86-7c1b-485b-b9a9-dac23665db26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:39.239547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79ac86-7c1b-485b-b9a9-dac23665db26 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:39.251944 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 172/338] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:39.257502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0c55c-1aa8-4497-b469-6d7b939d14e5 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:39.367866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78b245-3fc8-41cb-9fe4-eda1329f461a None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:39.368538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78b245-3fc8-41cb-9fe4-eda1329f461a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:39.369087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78b245-3fc8-41cb-9fe4-eda1329f461a None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:39.370905 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 173/339] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:39.377889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a515ec-e75f-4497-9aee-f32a195d1584 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:39.378450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a515ec-e75f-4497-9aee-f32a195d1584 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:39.378934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a515ec-e75f-4497-9aee-f32a195d1584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:39.383054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0c55c-1aa8-4497-b469-6d7b939d14e5 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:39.417607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d4a515ec-e75f-4497-9aee-f32a195d1584 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:39.419179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d4a515ec-e75f-4497-9aee-f32a195d1584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:39.423744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e78a2-affe-48d4-b09f-d6e76b42ec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:39.424406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e78a2-affe-48d4-b09f-d6e76b42ec68 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:39.424716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e78a2-affe-48d4-b09f-d6e76b42ec68 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:39.424997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e78a2-affe-48d4-b09f-d6e76b42ec68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:39.533707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e78a2-affe-48d4-b09f-d6e76b42ec68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:39.535124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e78a2-affe-48d4-b09f-d6e76b42ec68 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:39.579267 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 174/340] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:57:39.608385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a515ec-e75f-4497-9aee-f32a195d1584 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:39.701362 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 167/341] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:39.707448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e78a2-affe-48d4-b09f-d6e76b42ec68 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:39.762243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a515ec-e75f-4497-9aee-f32a195d1584 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:39.801192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec7e6a-8826-44e8-bb92-8785850721fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:39.802252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec7e6a-8826-44e8-bb92-8785850721fc None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:39.802673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec7e6a-8826-44e8-bb92-8785850721fc None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:39.803084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec7e6a-8826-44e8-bb92-8785850721fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:39.813838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec7e6a-8826-44e8-bb92-8785850721fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:39.822919 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-1aec7e6a-8826-44e8-bb92-8785850721fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:39.822919 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:39.822919 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:39.822919 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:39.822919 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:39.822919 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:39.822919 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:39.822919 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:39.822919 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:39.822919 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:39.822919 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:39.822919 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:39.822919 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:39.822919 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:39.822919 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:39.822919 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:39.825101 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:39.825101 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:39.825101 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:39.825101 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:39.825101 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:39.825101 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:39.825101 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:39.825101 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:39.825101 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:39.825101 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:39.825101 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:39.825101 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:39.825101 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:39.825101 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:39.825101 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:39.825101 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:39.825912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:39.825912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:39.825912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:39.825912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:39.825912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:39.825912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:39.825912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:39.825912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:39.825912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:39.825912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:39.825912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:39.825912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:39.826543 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 175/342] 10.222.0.16 () {56 vars in 1114 bytes} [Mon May 2 09:57:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:57:39.841565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec7e6a-8826-44e8-bb92-8785850721fc None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:39.907771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e78a2-affe-48d4-b09f-d6e76b42ec68 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:39.960206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec7e6a-8826-44e8-bb92-8785850721fc None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:39.962771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a28e9-bc48-458d-abf3-9cf047f4fb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:39.963643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a28e9-bc48-458d-abf3-9cf047f4fb58 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:39.963928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a28e9-bc48-458d-abf3-9cf047f4fb58 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:39.964204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a28e9-bc48-458d-abf3-9cf047f4fb58 None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:39.969378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a28e9-bc48-458d-abf3-9cf047f4fb58 None admin] RBAC: Authorizing `identity:get_project(project_id=d44324b154884c4cbb76a723c912a4e5)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:39.970837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a28e9-bc48-458d-abf3-9cf047f4fb58 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:39.972586 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 168/343] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:39 2022] GET /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5 => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:39.977948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a28e9-bc48-458d-abf3-9cf047f4fb58 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:39.995258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b8d95-6ccb-4651-b3ab-ec1eb5f26ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:39.995929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b8d95-6ccb-4651-b3ab-ec1eb5f26ec4 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:39.996213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b8d95-6ccb-4651-b3ab-ec1eb5f26ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:39.996528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b8d95-6ccb-4651-b3ab-ec1eb5f26ec4 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:39.999334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b8d95-6ccb-4651-b3ab-ec1eb5f26ec4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:39.999649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b8d95-6ccb-4651-b3ab-ec1eb5f26ec4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:40.001076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b8d95-6ccb-4651-b3ab-ec1eb5f26ec4 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:40.010837 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 176/344] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:57:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:40.015823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b8d95-6ccb-4651-b3ab-ec1eb5f26ec4 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:40.121331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a28e9-bc48-458d-abf3-9cf047f4fb58 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:40.124479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b8d95-6ccb-4651-b3ab-ec1eb5f26ec4 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:40.158761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac42e6-d1af-45b8-83f4-82b35d086114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:40.159084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72185b0f-fdac-4aa8-836a-82f792383a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:40.159413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac42e6-d1af-45b8-83f4-82b35d086114 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:40.159698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac42e6-d1af-45b8-83f4-82b35d086114 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:40.159880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72185b0f-fdac-4aa8-836a-82f792383a2a None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:40.160028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac42e6-d1af-45b8-83f4-82b35d086114 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:40.160172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72185b0f-fdac-4aa8-836a-82f792383a2a None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:40.160321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72185b0f-fdac-4aa8-836a-82f792383a2a None admin] PATH_INFO: `/v3/groups/01fe0e1c193d405494cdf41e30e44734` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:40.170126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72185b0f-fdac-4aa8-836a-82f792383a2a None admin] RBAC: Authorizing `identity:get_group(group_id=01fe0e1c193d405494cdf41e30e44734)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:40.171614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72185b0f-fdac-4aa8-836a-82f792383a2a None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:40.174572 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 169/345] 10.222.0.16 () {56 vars in 1180 bytes} [Mon May 2 09:57:39 2022] GET /identity/v3/groups/01fe0e1c193d405494cdf41e30e44734 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:40.180140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72185b0f-fdac-4aa8-836a-82f792383a2a None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:40.232340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac42e6-d1af-45b8-83f4-82b35d086114 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:40.233895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac42e6-d1af-45b8-83f4-82b35d086114 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:40.286993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72185b0f-fdac-4aa8-836a-82f792383a2a None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:40.324207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1275914-648b-4fb5-ae92-bfe7536cc6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:40.325192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1275914-648b-4fb5-ae92-bfe7536cc6a4 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:40.325641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1275914-648b-4fb5-ae92-bfe7536cc6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:40.326062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1275914-648b-4fb5-ae92-bfe7536cc6a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:40.327066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1275914-648b-4fb5-ae92-bfe7536cc6a4 None admin] RBAC: Adding query filter params (group.id=01fe0e1c193d405494cdf41e30e44734, role.id=d1592d47a67b4f4a8d14e2101c799509, scope.project.id=d44324b154884c4cbb76a723c912a4e5) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:40.327543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1275914-648b-4fb5-ae92-bfe7536cc6a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:40.329190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1275914-648b-4fb5-ae92-bfe7536cc6a4 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:40.335148 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 170/346] 10.222.0.16 () {56 vars in 1376 bytes} [Mon May 2 09:57:40 2022] GET /identity/v3/role_assignments?group.id=01fe0e1c193d405494cdf41e30e44734&scope.project.id=d44324b154884c4cbb76a723c912a4e5&role.id=d1592d47a67b4f4a8d14e2101c799509 => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:40.339699 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 177/347] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 02 09:57:40.341694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1275914-648b-4fb5-ae92-bfe7536cc6a4 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:40.450303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788c2b9-6a01-458a-9d16-7beef3f82ad0 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:40.450909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788c2b9-6a01-458a-9d16-7beef3f82ad0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:40.451143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1275914-648b-4fb5-ae92-bfe7536cc6a4 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:40.451541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788c2b9-6a01-458a-9d16-7beef3f82ad0 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:40.453413 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 178/348] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:40.460715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f8f06-9d3a-471c-ab5a-be353583cc9e None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:40.461298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f8f06-9d3a-471c-ab5a-be353583cc9e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:40.461794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f8f06-9d3a-471c-ab5a-be353583cc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:40.488631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-887f8f06-9d3a-471c-ab5a-be353583cc9e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:40.488631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-887f8f06-9d3a-471c-ab5a-be353583cc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:40.492806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f4adc-ddc5-4810-91c4-41c3ff7fecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:40.494075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f4adc-ddc5-4810-91c4-41c3ff7fecf9 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:40.494424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f4adc-ddc5-4810-91c4-41c3ff7fecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:40.494701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f4adc-ddc5-4810-91c4-41c3ff7fecf9 None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:40.495991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f4adc-ddc5-4810-91c4-41c3ff7fecf9 None admin] RBAC: Authorizing `identity:get_project(project_id=d44324b154884c4cbb76a723c912a4e5)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:40.497517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f4adc-ddc5-4810-91c4-41c3ff7fecf9 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:40.504560 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 171/349] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:40 2022] GET /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:40.504775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f4adc-ddc5-4810-91c4-41c3ff7fecf9 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:40.632520 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 179/350] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:40.658625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f8f06-9d3a-471c-ab5a-be353583cc9e None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:40.670051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f4adc-ddc5-4810-91c4-41c3ff7fecf9 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:40.724070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31d2a0-08ac-4271-8ee3-c1b40ee7eeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:40.724070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31d2a0-08ac-4271-8ee3-c1b40ee7eeed None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:40.724070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31d2a0-08ac-4271-8ee3-c1b40ee7eeed None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:40.724070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31d2a0-08ac-4271-8ee3-c1b40ee7eeed None admin] PATH_INFO: `/v3/groups/01fe0e1c193d405494cdf41e30e44734` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:40.724886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31d2a0-08ac-4271-8ee3-c1b40ee7eeed None admin] RBAC: Authorizing `identity:get_group(group_id=01fe0e1c193d405494cdf41e30e44734)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:40.724886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31d2a0-08ac-4271-8ee3-c1b40ee7eeed None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:40.725608 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 172/351] 10.222.0.16 () {56 vars in 1180 bytes} [Mon May 2 09:57:40 2022] GET /identity/v3/groups/01fe0e1c193d405494cdf41e30e44734 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:40.732013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31d2a0-08ac-4271-8ee3-c1b40ee7eeed None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:40.840540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31d2a0-08ac-4271-8ee3-c1b40ee7eeed None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:40.856000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f8f06-9d3a-471c-ab5a-be353583cc9e None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:40.878010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97635e7-c56f-4fa5-9b75-d288051c3a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:40.878682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97635e7-c56f-4fa5-9b75-d288051c3a4e None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:40.878970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97635e7-c56f-4fa5-9b75-d288051c3a4e None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:40.879252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97635e7-c56f-4fa5-9b75-d288051c3a4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:40.880096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97635e7-c56f-4fa5-9b75-d288051c3a4e None admin] RBAC: Adding query filter params (group.id=01fe0e1c193d405494cdf41e30e44734, role.id=9d0cb59f15d2481eace97516b3b77a71, scope.project.id=d44324b154884c4cbb76a723c912a4e5) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:40.880412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97635e7-c56f-4fa5-9b75-d288051c3a4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:40.881968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97635e7-c56f-4fa5-9b75-d288051c3a4e None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:40.888141 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 173/352] 10.222.0.16 () {56 vars in 1376 bytes} [Mon May 2 09:57:40 2022] GET /identity/v3/role_assignments?group.id=01fe0e1c193d405494cdf41e30e44734&scope.project.id=d44324b154884c4cbb76a723c912a4e5&role.id=9d0cb59f15d2481eace97516b3b77a71 => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:40.923083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81ef57-4db9-4ead-8cc1-ff47cc22b74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:40.924342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81ef57-4db9-4ead-8cc1-ff47cc22b74a None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:40.924875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81ef57-4db9-4ead-8cc1-ff47cc22b74a None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:40.925367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81ef57-4db9-4ead-8cc1-ff47cc22b74a None admin] PATH_INFO: `/v3/roles/member` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:40.946504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81ef57-4db9-4ead-8cc1-ff47cc22b74a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:40.958599 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-2e81ef57-4db9-4ead-8cc1-ff47cc22b74a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:40.958599 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:40.958599 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:40.958599 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:40.958599 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:40.958599 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:40.958599 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:40.958599 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:40.958599 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:40.958599 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:40.958599 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:40.958599 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:40.958599 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:40.958599 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:40.958599 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:40.958599 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:40.959584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:40.959584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:40.959584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:40.959584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:40.959584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:40.959584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:40.959584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:40.959584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:40.959584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:40.959584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:40.959584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:40.959584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:40.959584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:40.959584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:40.959584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:40.959584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:40.960393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:40.960393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:40.960393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:40.960393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:40.960393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:40.960393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:40.960393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:40.960393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:40.960393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:40.960393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:40.960393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:40.960393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:40.963879 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 180/353] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:40.969445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97635e7-c56f-4fa5-9b75-d288051c3a4e None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:41.129392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97635e7-c56f-4fa5-9b75-d288051c3a4e None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:41.177853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cfb47-4941-4898-9080-79a1a36936da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:41.178536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cfb47-4941-4898-9080-79a1a36936da None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:41.178822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cfb47-4941-4898-9080-79a1a36936da None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:41.179096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cfb47-4941-4898-9080-79a1a36936da None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:41.179850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3cfb47-4941-4898-9080-79a1a36936da None admin] RBAC: Adding query filter params (name=member) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:41.180158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3cfb47-4941-4898-9080-79a1a36936da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:41.181622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3cfb47-4941-4898-9080-79a1a36936da None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:41.192451 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 174/354] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:41.199018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81ef57-4db9-4ead-8cc1-ff47cc22b74a None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:41.258194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a8a74-4407-4264-ac02-eed91bdf5d3c None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:41.259333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a8a74-4407-4264-ac02-eed91bdf5d3c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:41.259844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a8a74-4407-4264-ac02-eed91bdf5d3c None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:41.261709 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 175/355] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:41.266501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a06f5-6c93-4ac9-b948-bc0da399537f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:41.267029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a06f5-6c93-4ac9-b948-bc0da399537f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:41.267502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a06f5-6c93-4ac9-b948-bc0da399537f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:41.291361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c92a06f5-6c93-4ac9-b948-bc0da399537f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:41.292906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c92a06f5-6c93-4ac9-b948-bc0da399537f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:41.374992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81ef57-4db9-4ead-8cc1-ff47cc22b74a None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:41.409107 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 176/356] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:57:41.410454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e891fa-fd31-4ff5-8bb6-9fd946332344 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:41.410739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e891fa-fd31-4ff5-8bb6-9fd946332344 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:41.411016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e891fa-fd31-4ff5-8bb6-9fd946332344 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:41.414291 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 177/357] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:41.422456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccda8e-32b3-4e4e-bdb0-5fa6312e9f17 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:41.422739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccda8e-32b3-4e4e-bdb0-5fa6312e9f17 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:41.423018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccda8e-32b3-4e4e-bdb0-5fa6312e9f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:41.444937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3dccda8e-32b3-4e4e-bdb0-5fa6312e9f17 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:41.446823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62d755-860a-4adf-bf75-ebfecfca966c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:41.446968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3dccda8e-32b3-4e4e-bdb0-5fa6312e9f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:41.447493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62d755-860a-4adf-bf75-ebfecfca966c None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:41.447776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62d755-860a-4adf-bf75-ebfecfca966c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:41.448050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62d755-860a-4adf-bf75-ebfecfca966c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:41.552180 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 178/358] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:41.554236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dccda8e-32b3-4e4e-bdb0-5fa6312e9f17 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:41.581844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62d755-860a-4adf-bf75-ebfecfca966c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:41.583332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62d755-860a-4adf-bf75-ebfecfca966c None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:41.693614 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 181/359] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:41.694556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dccda8e-32b3-4e4e-bdb0-5fa6312e9f17 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:41.695303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d9f4d-7613-45d5-b9a5-8d4417c09861 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:41.695728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d9f4d-7613-45d5-b9a5-8d4417c09861 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:41.696787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d9f4d-7613-45d5-b9a5-8d4417c09861 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:41.698711 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 182/360] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:41.699562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d9f4d-7613-45d5-b9a5-8d4417c09861 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:41.738192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896908ae-6085-44bb-a678-1aa7005e011a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:41.739571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896908ae-6085-44bb-a678-1aa7005e011a None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:41.740141 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896908ae-6085-44bb-a678-1aa7005e011a None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:41.740695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896908ae-6085-44bb-a678-1aa7005e011a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:41.751902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896908ae-6085-44bb-a678-1aa7005e011a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:41.760938 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-896908ae-6085-44bb-a678-1aa7005e011a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:41.760938 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:41.760938 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:41.760938 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:41.760938 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:41.760938 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:41.760938 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:41.760938 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:41.760938 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:41.760938 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:41.760938 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:41.760938 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:41.760938 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:41.760938 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:41.760938 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:41.760938 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:41.761843 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:41.761843 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:41.761843 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:41.761843 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:41.761843 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:41.761843 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:41.761843 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:41.761843 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:41.761843 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:41.761843 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:41.761843 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:41.761843 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:57:41.761843 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:41.761843 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:41.761843 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:41.761843 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:41.762622 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:41.762622 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:41.762622 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:41.762622 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:41.762622 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:41.762622 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:41.762622 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:41.762622 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:41.762622 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:41.762622 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:41.762622 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:41.762622 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:41.765350 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 179/361] 10.222.0.16 () {56 vars in 1114 bytes} [Mon May 2 09:57:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:41.766369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896908ae-6085-44bb-a678-1aa7005e011a None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:41.811200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d9f4d-7613-45d5-b9a5-8d4417c09861 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:41.845734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e7c54-38e2-4516-9ff3-cd347a6ddf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:41.846770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e7c54-38e2-4516-9ff3-cd347a6ddf42 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:41.847226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e7c54-38e2-4516-9ff3-cd347a6ddf42 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:41.847683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e7c54-38e2-4516-9ff3-cd347a6ddf42 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:41.858091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e7c54-38e2-4516-9ff3-cd347a6ddf42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:41.866573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-ec9e7c54-38e2-4516-9ff3-cd347a6ddf42 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 02 09:57:41.866573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:41.866573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:41.866573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:41.866573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:41.866573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:41.866573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:41.866573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:41.866573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:41.866573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:41.866573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:41.866573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:41.866573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:41.866573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:41.866573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:41.866573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:41.867444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:41.867444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:41.867444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:41.867444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:41.867444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:41.867444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:41.867444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:41.867444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:41.867444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:41.867444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:41.867444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:41.867444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:41.867444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:41.867444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:41.867444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:41.867444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:41.868827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:41.868827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:41.868827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:41.868827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:41.868827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:41.868827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:41.868827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:41.868827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:41.868827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:41.868827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:41.868827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 02 09:57:41.868827 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:41.869424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896908ae-6085-44bb-a678-1aa7005e011a None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:41.871560 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 183/362] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:41.872951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef6f30-0911-4340-b775-ad28c4839e4d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:41.873412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef6f30-0911-4340-b775-ad28c4839e4d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:41.873863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef6f30-0911-4340-b775-ad28c4839e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:41.891380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fdef6f30-0911-4340-b775-ad28c4839e4d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:41.893057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fdef6f30-0911-4340-b775-ad28c4839e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:41.903811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89317018-35fa-48b3-920e-0eec4bb6dc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:41.904832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89317018-35fa-48b3-920e-0eec4bb6dc3c None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:41.905189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89317018-35fa-48b3-920e-0eec4bb6dc3c None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:41.905542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89317018-35fa-48b3-920e-0eec4bb6dc3c None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:41.907532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89317018-35fa-48b3-920e-0eec4bb6dc3c None admin] RBAC: Authorizing `identity:get_project(project_id=de9cf9f9d50e4932a34fb509a4d47ce6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:41.908453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89317018-35fa-48b3-920e-0eec4bb6dc3c None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:41.911557 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 180/363] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:41 2022] GET /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:41.912428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89317018-35fa-48b3-920e-0eec4bb6dc3c None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:41.968971 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 184/364] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:41.970128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef6f30-0911-4340-b775-ad28c4839e4d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:42.015672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89317018-35fa-48b3-920e-0eec4bb6dc3c None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:42.052318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2a21e-aa5e-4c4e-a22e-fcacb7de8d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:42.052893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2a21e-aa5e-4c4e-a22e-fcacb7de8d50 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:42.053257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2a21e-aa5e-4c4e-a22e-fcacb7de8d50 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:42.053611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2a21e-aa5e-4c4e-a22e-fcacb7de8d50 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:42.054438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2a21e-aa5e-4c4e-a22e-fcacb7de8d50 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:42.054821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2a21e-aa5e-4c4e-a22e-fcacb7de8d50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:42.056594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2a21e-aa5e-4c4e-a22e-fcacb7de8d50 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:42.065010 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 181/365] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:57:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:42.065943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2a21e-aa5e-4c4e-a22e-fcacb7de8d50 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:42.098379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef6f30-0911-4340-b775-ad28c4839e4d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:42.137589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b67d6-89e5-444b-a468-1bb14ec6908d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:42.138604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b67d6-89e5-444b-a468-1bb14ec6908d None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:42.139071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b67d6-89e5-444b-a468-1bb14ec6908d None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:42.139508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b67d6-89e5-444b-a468-1bb14ec6908d None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:42.140449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b67d6-89e5-444b-a468-1bb14ec6908d None admin] RBAC: Adding query filter params (name=reader) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:42.140973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b67d6-89e5-444b-a468-1bb14ec6908d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:42.142511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0b67d6-89e5-444b-a468-1bb14ec6908d None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:42.152242 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 185/366] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:42.153386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b67d6-89e5-444b-a468-1bb14ec6908d None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:42.174460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2a21e-aa5e-4c4e-a22e-fcacb7de8d50 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:42.208382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a150d5-e24f-4ff7-8e22-71617f689e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:42.209287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a150d5-e24f-4ff7-8e22-71617f689e6d None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:42.209573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a150d5-e24f-4ff7-8e22-71617f689e6d None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:42.209856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a150d5-e24f-4ff7-8e22-71617f689e6d None admin] PATH_INFO: `/v3/groups/01fe0e1c193d405494cdf41e30e44734` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:42.211109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a150d5-e24f-4ff7-8e22-71617f689e6d None admin] RBAC: Authorizing `identity:get_group(group_id=01fe0e1c193d405494cdf41e30e44734)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:42.213274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a150d5-e24f-4ff7-8e22-71617f689e6d None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:42.215084 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 182/367] 10.222.0.16 () {56 vars in 1180 bytes} [Mon May 2 09:57:42 2022] GET /identity/v3/groups/01fe0e1c193d405494cdf41e30e44734 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:42.215869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a150d5-e24f-4ff7-8e22-71617f689e6d None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:42.262227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b67d6-89e5-444b-a468-1bb14ec6908d None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:42.295432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2964a-00fb-465e-b11c-05407f5b1d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:42.296594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2964a-00fb-465e-b11c-05407f5b1d49 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:42.297121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2964a-00fb-465e-b11c-05407f5b1d49 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:42.297592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2964a-00fb-465e-b11c-05407f5b1d49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:42.308758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2964a-00fb-465e-b11c-05407f5b1d49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:42.316617 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-9df2964a-00fb-465e-b11c-05407f5b1d49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:57:42.316617 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:42.316617 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:42.316617 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:42.316617 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:42.316617 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:42.316617 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:42.316617 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:42.316617 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:42.316617 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:42.316617 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:42.316617 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:42.316617 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:42.316617 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:42.316617 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:42.316617 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:42.317491 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:42.317491 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:42.317491 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:42.317491 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:42.317491 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:42.317491 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:42.317491 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:42.317491 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:42.317491 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:42.317491 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:42.317491 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:42.317491 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:42.317491 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:42.317491 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:42.317491 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:42.317491 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:42.318266 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:42.318266 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:42.318266 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:42.318266 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:42.318266 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:42.318266 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:42.318266 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:42.318266 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:42.318266 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:42.318266 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:42.318266 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:57:42.318266 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:42.319609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a150d5-e24f-4ff7-8e22-71617f689e6d None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:42.320828 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 186/368] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:57:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:42.322513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2964a-00fb-465e-b11c-05407f5b1d49 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:42.354363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2ab1d-2971-4ebd-b9eb-27845f77e2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:42.355025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2ab1d-2971-4ebd-b9eb-27845f77e2f6 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:42.355311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2ab1d-2971-4ebd-b9eb-27845f77e2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:42.355593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2ab1d-2971-4ebd-b9eb-27845f77e2f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:42.423297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2964a-00fb-465e-b11c-05407f5b1d49 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:42.423488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd2ab1d-2971-4ebd-b9eb-27845f77e2f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:42.424972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd2ab1d-2971-4ebd-b9eb-27845f77e2f6 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:42.458906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42af2fe-16e4-4474-9c81-e32e8d45dc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:42.460135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42af2fe-16e4-4474-9c81-e32e8d45dc01 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:42.460639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42af2fe-16e4-4474-9c81-e32e8d45dc01 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:42.461116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42af2fe-16e4-4474-9c81-e32e8d45dc01 None admin] PATH_INFO: `/v3/users/ef024fc724dc4af88e237f26ff3e4705` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:42.462703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42af2fe-16e4-4474-9c81-e32e8d45dc01 None admin] RBAC: Authorizing `identity:get_user(user_id=ef024fc724dc4af88e237f26ff3e4705)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:42.464513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42af2fe-16e4-4474-9c81-e32e8d45dc01 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:42.466755 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 187/369] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:57:42 2022] GET /identity/v3/users/ef024fc724dc4af88e237f26ff3e4705 => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:42.467836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42af2fe-16e4-4474-9c81-e32e8d45dc01 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:42.529714 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 183/370] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:42.530793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2ab1d-2971-4ebd-b9eb-27845f77e2f6 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:42.570790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42af2fe-16e4-4474-9c81-e32e8d45dc01 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:42.604452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e74541-9488-49a5-8399-2c97d1f6eaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:42.605516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e74541-9488-49a5-8399-2c97d1f6eaae None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:42.606018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e74541-9488-49a5-8399-2c97d1f6eaae None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:42.606504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e74541-9488-49a5-8399-2c97d1f6eaae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:42.607528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e74541-9488-49a5-8399-2c97d1f6eaae None admin] RBAC: Adding query filter params (group.id=01fe0e1c193d405494cdf41e30e44734, role.id=d1592d47a67b4f4a8d14e2101c799509, scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:42.608035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e74541-9488-49a5-8399-2c97d1f6eaae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:42.609690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e74541-9488-49a5-8399-2c97d1f6eaae None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:42.615687 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 188/371] 10.222.0.16 () {56 vars in 1376 bytes} [Mon May 2 09:57:42 2022] GET /identity/v3/role_assignments?group.id=01fe0e1c193d405494cdf41e30e44734&scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6&role.id=d1592d47a67b4f4a8d14e2101c799509 => generated 260 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:42.620841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e74541-9488-49a5-8399-2c97d1f6eaae None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:42.638942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2ab1d-2971-4ebd-b9eb-27845f77e2f6 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:42.684514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108c376-2744-40fc-b061-3b264328f658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:42.685239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108c376-2744-40fc-b061-3b264328f658 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:42.685526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108c376-2744-40fc-b061-3b264328f658 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:42.685805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108c376-2744-40fc-b061-3b264328f658 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:42.686571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108c376-2744-40fc-b061-3b264328f658 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:42.686882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108c376-2744-40fc-b061-3b264328f658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:42.688332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108c376-2744-40fc-b061-3b264328f658 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:42.704350 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 184/372] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:42.705263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108c376-2744-40fc-b061-3b264328f658 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:42.821740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e74541-9488-49a5-8399-2c97d1f6eaae None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:42.891010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108c376-2744-40fc-b061-3b264328f658 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:42.901976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec05c11-7969-4147-8ef8-f1fbc7bb2aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:42.903294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec05c11-7969-4147-8ef8-f1fbc7bb2aba None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:42.903721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec05c11-7969-4147-8ef8-f1fbc7bb2aba None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:42.904142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec05c11-7969-4147-8ef8-f1fbc7bb2aba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:42.908625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec05c11-7969-4147-8ef8-f1fbc7bb2aba None admin] RBAC: Adding query filter params (role.id=1325eb2a84a1482fade3efa8dbe3cfbf, user.id=ef024fc724dc4af88e237f26ff3e4705, scope.system=all) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:42.908625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec05c11-7969-4147-8ef8-f1fbc7bb2aba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:42.908625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec05c11-7969-4147-8ef8-f1fbc7bb2aba None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:42.922772 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 189/373] 10.222.0.16 () {56 vars in 1308 bytes} [Mon May 2 09:57:42 2022] GET /identity/v3/role_assignments?user.id=ef024fc724dc4af88e237f26ff3e4705&scope.system=all&role.id=1325eb2a84a1482fade3efa8dbe3cfbf => generated 510 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:42.924500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec05c11-7969-4147-8ef8-f1fbc7bb2aba None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:42.964076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40019a-46b0-4d66-ab7f-b810322f6881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:42.964988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40019a-46b0-4d66-ab7f-b810322f6881 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:42.965273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40019a-46b0-4d66-ab7f-b810322f6881 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:42.965553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40019a-46b0-4d66-ab7f-b810322f6881 None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:42.970621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40019a-46b0-4d66-ab7f-b810322f6881 None admin] RBAC: Authorizing `identity:get_project(project_id=de9cf9f9d50e4932a34fb509a4d47ce6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:42.972121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40019a-46b0-4d66-ab7f-b810322f6881 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:42.980247 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 185/374] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:42 2022] GET /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:42.998218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40019a-46b0-4d66-ab7f-b810322f6881 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:43.161955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec05c11-7969-4147-8ef8-f1fbc7bb2aba None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:43.192510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40019a-46b0-4d66-ab7f-b810322f6881 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:43.212747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7bb3f-8ea5-4a35-95df-a9635cb39144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:43.213429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7bb3f-8ea5-4a35-95df-a9635cb39144 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:43.213716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7bb3f-8ea5-4a35-95df-a9635cb39144 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:43.213995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7bb3f-8ea5-4a35-95df-a9635cb39144 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:43.260194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca7bcb-43a7-43d3-8239-3830574ad08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:43.261100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca7bcb-43a7-43d3-8239-3830574ad08f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:43.261389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca7bcb-43a7-43d3-8239-3830574ad08f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:43.261673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca7bcb-43a7-43d3-8239-3830574ad08f None admin] PATH_INFO: `/v3/groups/01fe0e1c193d405494cdf41e30e44734` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:43.264037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca7bcb-43a7-43d3-8239-3830574ad08f None admin] RBAC: Authorizing `identity:get_group(group_id=01fe0e1c193d405494cdf41e30e44734)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:43.265539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca7bcb-43a7-43d3-8239-3830574ad08f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:43.268363 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 186/375] 10.222.0.16 () {56 vars in 1180 bytes} [Mon May 2 09:57:42 2022] GET /identity/v3/groups/01fe0e1c193d405494cdf41e30e44734 => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:43.274808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca7bcb-43a7-43d3-8239-3830574ad08f None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:43.336151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7bb3f-8ea5-4a35-95df-a9635cb39144 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:43.337724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7bb3f-8ea5-4a35-95df-a9635cb39144 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:43.420467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca7bcb-43a7-43d3-8239-3830574ad08f None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:43.456877 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 190/376] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:43.462273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7bb3f-8ea5-4a35-95df-a9635cb39144 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:43.464660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596e332-2d8d-45ee-a5ef-0d7808b67e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:43.465372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596e332-2d8d-45ee-a5ef-0d7808b67e66 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:43.466556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596e332-2d8d-45ee-a5ef-0d7808b67e66 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:43.466845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596e332-2d8d-45ee-a5ef-0d7808b67e66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:43.467807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596e332-2d8d-45ee-a5ef-0d7808b67e66 None admin] RBAC: Adding query filter params (group.id=01fe0e1c193d405494cdf41e30e44734, role.id=9d0cb59f15d2481eace97516b3b77a71, scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:43.468132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596e332-2d8d-45ee-a5ef-0d7808b67e66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:43.469700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596e332-2d8d-45ee-a5ef-0d7808b67e66 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:43.482675 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 187/377] 10.222.0.16 () {56 vars in 1376 bytes} [Mon May 2 09:57:43 2022] GET /identity/v3/role_assignments?group.id=01fe0e1c193d405494cdf41e30e44734&scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6&role.id=9d0cb59f15d2481eace97516b3b77a71 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:43.581599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7bb3f-8ea5-4a35-95df-a9635cb39144 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:43.620032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783eb22-73ac-488c-af6d-0388b24eab59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:43.620989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783eb22-73ac-488c-af6d-0388b24eab59 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:43.621275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783eb22-73ac-488c-af6d-0388b24eab59 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:43.621554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783eb22-73ac-488c-af6d-0388b24eab59 None admin] PATH_INFO: `/v3/projects/3af81e2baeae46b0b67902cedc893eb9` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:43.622853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783eb22-73ac-488c-af6d-0388b24eab59 None admin] RBAC: Authorizing `identity:get_project(project_id=3af81e2baeae46b0b67902cedc893eb9)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:43.624444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783eb22-73ac-488c-af6d-0388b24eab59 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:43.626303 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 191/378] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:43 2022] GET /identity/v3/projects/3af81e2baeae46b0b67902cedc893eb9 => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:43.633826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596e332-2d8d-45ee-a5ef-0d7808b67e66 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:43.766919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596e332-2d8d-45ee-a5ef-0d7808b67e66 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:43.792160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515451c6-3adb-4f3b-a8c1-462a3475596e None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:43.792793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515451c6-3adb-4f3b-a8c1-462a3475596e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:43.793252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515451c6-3adb-4f3b-a8c1-462a3475596e None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:43.795060 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 192/379] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:43.800635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596bf41-009b-4936-a3e2-c08e2ebcfd30 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:43.801232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596bf41-009b-4936-a3e2-c08e2ebcfd30 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:43.801743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596bf41-009b-4936-a3e2-c08e2ebcfd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:43.802532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb6b41-8b05-458f-bad3-030e6c7d7ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:43.803414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb6b41-8b05-458f-bad3-030e6c7d7ef8 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:43.803702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb6b41-8b05-458f-bad3-030e6c7d7ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:43.804071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb6b41-8b05-458f-bad3-030e6c7d7ef8 None admin] PATH_INFO: `/v3/groups/b6f134b4b42b459bb3496035335c4aa1` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:43.814197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb6b41-8b05-458f-bad3-030e6c7d7ef8 None admin] RBAC: Authorizing `identity:get_group(group_id=b6f134b4b42b459bb3496035335c4aa1)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:43.815700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb6b41-8b05-458f-bad3-030e6c7d7ef8 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:43.823659 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 188/380] 10.222.0.16 () {56 vars in 1180 bytes} [Mon May 2 09:57:43 2022] GET /identity/v3/groups/b6f134b4b42b459bb3496035335c4aa1 => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:43.824547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb6b41-8b05-458f-bad3-030e6c7d7ef8 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:43.842049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8596bf41-009b-4936-a3e2-c08e2ebcfd30 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:43.844093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8596bf41-009b-4936-a3e2-c08e2ebcfd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:43.925012 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 193/381] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:57:43.927146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cd041-da0f-45b2-a7bc-0ea5edeb0d52 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:43.927578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cd041-da0f-45b2-a7bc-0ea5edeb0d52 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:43.927998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cd041-da0f-45b2-a7bc-0ea5edeb0d52 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:43.929859 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 194/382] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:43.936415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b5789-7817-41d1-bf5f-f7120ec01c61 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:43.937130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b5789-7817-41d1-bf5f-f7120ec01c61 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:43.937609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b5789-7817-41d1-bf5f-f7120ec01c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:43.939021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb6b41-8b05-458f-bad3-030e6c7d7ef8 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:43.959119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-244b5789-7817-41d1-bf5f-f7120ec01c61 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:43.960503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-244b5789-7817-41d1-bf5f-f7120ec01c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:43.974850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa777d-be68-4352-a435-4ce60982b8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:43.975844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa777d-be68-4352-a435-4ce60982b8af None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:43.976352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa777d-be68-4352-a435-4ce60982b8af None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:43.976895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa777d-be68-4352-a435-4ce60982b8af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:43.977971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa777d-be68-4352-a435-4ce60982b8af None admin] RBAC: Adding query filter params (group.id=b6f134b4b42b459bb3496035335c4aa1, role.id=dd8a47ade22941849ebdf8fbdf994b66, scope.project.id=3af81e2baeae46b0b67902cedc893eb9) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:43.978492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa777d-be68-4352-a435-4ce60982b8af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:43.980132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa777d-be68-4352-a435-4ce60982b8af None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:43.985942 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 189/383] 10.222.0.16 () {56 vars in 1376 bytes} [Mon May 2 09:57:43 2022] GET /identity/v3/role_assignments?group.id=b6f134b4b42b459bb3496035335c4aa1&scope.project.id=3af81e2baeae46b0b67902cedc893eb9&role.id=dd8a47ade22941849ebdf8fbdf994b66 => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:43.986993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa777d-be68-4352-a435-4ce60982b8af None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:44.075577 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 195/384] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:44.109263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa777d-be68-4352-a435-4ce60982b8af None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:44.124989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b5789-7817-41d1-bf5f-f7120ec01c61 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:44.149875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff16e65-0be0-4ddb-9508-9cbf88bae53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:44.150708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff16e65-0be0-4ddb-9508-9cbf88bae53b None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:44.150989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff16e65-0be0-4ddb-9508-9cbf88bae53b None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:44.151266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff16e65-0be0-4ddb-9508-9cbf88bae53b None admin] PATH_INFO: `/v3/roles/member` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:44.164246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff16e65-0be0-4ddb-9508-9cbf88bae53b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:44.173638 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-5ff16e65-0be0-4ddb-9508-9cbf88bae53b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:44.173638 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:44.173638 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:44.173638 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:44.173638 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:44.173638 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:44.173638 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:44.173638 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:44.173638 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:44.173638 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:44.173638 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:44.173638 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:44.173638 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:44.173638 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:44.173638 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:44.173638 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:44.174781 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:44.174781 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:44.174781 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:44.174781 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:44.174781 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:44.174781 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:44.174781 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:44.174781 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:44.174781 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:44.174781 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:44.174781 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:44.174781 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:57:44.174781 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:44.174781 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:44.174781 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:44.174781 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:44.175684 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:44.175684 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:44.175684 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:44.175684 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:44.175684 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:44.175684 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:44.175684 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:44.175684 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:44.175684 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:44.175684 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:44.175684 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:44.175684 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:44.175684 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 190/385] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:44.182060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff16e65-0be0-4ddb-9508-9cbf88bae53b None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:44.316283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b5789-7817-41d1-bf5f-f7120ec01c61 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:44.336787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff16e65-0be0-4ddb-9508-9cbf88bae53b None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:44.371298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806325a9-1422-40b7-a210-67d442bea0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:44.372043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806325a9-1422-40b7-a210-67d442bea0aa None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:44.372332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806325a9-1422-40b7-a210-67d442bea0aa None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:44.372634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806325a9-1422-40b7-a210-67d442bea0aa None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:44.373384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806325a9-1422-40b7-a210-67d442bea0aa None admin] RBAC: Adding query filter params (name=member) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:44.373698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806325a9-1422-40b7-a210-67d442bea0aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:44.375463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806325a9-1422-40b7-a210-67d442bea0aa None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:44.385012 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 191/386] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:44.390538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806325a9-1422-40b7-a210-67d442bea0aa None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:44.405002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561e193-ef0f-4e2d-93c9-e015e04d7d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:44.406075 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561e193-ef0f-4e2d-93c9-e015e04d7d58 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:44.406528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561e193-ef0f-4e2d-93c9-e015e04d7d58 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:44.407020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561e193-ef0f-4e2d-93c9-e015e04d7d58 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:44.428894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561e193-ef0f-4e2d-93c9-e015e04d7d58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:44.437917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-a561e193-ef0f-4e2d-93c9-e015e04d7d58 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:44.437917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:44.437917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:44.437917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:44.437917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:44.437917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:44.437917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:44.437917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:44.437917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:44.437917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:44.437917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:44.437917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:44.437917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:44.437917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:44.437917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:44.437917 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:44.438993 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:44.438993 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:44.438993 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:44.438993 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:44.438993 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:44.438993 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:44.438993 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:44.438993 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:44.438993 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:44.438993 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:44.438993 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:44.438993 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:44.438993 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:44.438993 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:44.438993 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:44.438993 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:44.439982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:44.439982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:44.439982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:44.439982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:44.439982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:44.439982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:44.439982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:44.439982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:44.439982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:44.439982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:44.439982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:44.439982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:44.442676 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 196/387] 10.222.0.16 () {56 vars in 1114 bytes} [Mon May 2 09:57:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:44.449485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561e193-ef0f-4e2d-93c9-e015e04d7d58 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:44.568707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561e193-ef0f-4e2d-93c9-e015e04d7d58 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:44.606008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b31243-cc2f-4275-ac30-4cda8db5807c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:44.607010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b31243-cc2f-4275-ac30-4cda8db5807c None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:44.607561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b31243-cc2f-4275-ac30-4cda8db5807c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:44.608109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b31243-cc2f-4275-ac30-4cda8db5807c None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:44.609018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806325a9-1422-40b7-a210-67d442bea0aa None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:44.609353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b31243-cc2f-4275-ac30-4cda8db5807c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:44.609862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b31243-cc2f-4275-ac30-4cda8db5807c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:44.611606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b31243-cc2f-4275-ac30-4cda8db5807c None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:44.620838 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 197/388] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:57:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:44.626670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b31243-cc2f-4275-ac30-4cda8db5807c None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:44.661373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40db26c-35a0-4da0-a18b-a32de09ef825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:44.662444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40db26c-35a0-4da0-a18b-a32de09ef825 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:44.662555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40db26c-35a0-4da0-a18b-a32de09ef825 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:44.662809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40db26c-35a0-4da0-a18b-a32de09ef825 None admin] PATH_INFO: `/v3/groups/01fe0e1c193d405494cdf41e30e44734` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:44.664024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40db26c-35a0-4da0-a18b-a32de09ef825 None admin] RBAC: Authorizing `identity:get_group(group_id=01fe0e1c193d405494cdf41e30e44734)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:44.666062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40db26c-35a0-4da0-a18b-a32de09ef825 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:44.668163 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 192/389] 10.222.0.16 () {56 vars in 1180 bytes} [Mon May 2 09:57:44 2022] GET /identity/v3/groups/01fe0e1c193d405494cdf41e30e44734 => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:44.673249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40db26c-35a0-4da0-a18b-a32de09ef825 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:44.733147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b31243-cc2f-4275-ac30-4cda8db5807c None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:44.766980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21ff38-c161-40ab-a22b-a1385757664a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:44.768210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21ff38-c161-40ab-a22b-a1385757664a None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:44.768736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21ff38-c161-40ab-a22b-a1385757664a None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:44.769214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21ff38-c161-40ab-a22b-a1385757664a None admin] PATH_INFO: `/v3/groups/01fe0e1c193d405494cdf41e30e44734` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:44.770629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21ff38-c161-40ab-a22b-a1385757664a None admin] RBAC: Authorizing `identity:get_group(group_id=01fe0e1c193d405494cdf41e30e44734)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:44.772347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21ff38-c161-40ab-a22b-a1385757664a None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:44.775087 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 198/390] 10.222.0.16 () {56 vars in 1180 bytes} [Mon May 2 09:57:44 2022] GET /identity/v3/groups/01fe0e1c193d405494cdf41e30e44734 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:44.780896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21ff38-c161-40ab-a22b-a1385757664a None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:44.823410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40db26c-35a0-4da0-a18b-a32de09ef825 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:44.890236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21ff38-c161-40ab-a22b-a1385757664a None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:44.913317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d74e39-b101-4926-b968-67524fb514a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:44.914205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d74e39-b101-4926-b968-67524fb514a4 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:44.914491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d74e39-b101-4926-b968-67524fb514a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:44.915335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d74e39-b101-4926-b968-67524fb514a4 None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:44.916825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d74e39-b101-4926-b968-67524fb514a4 None admin] RBAC: Authorizing `identity:get_project(project_id=d44324b154884c4cbb76a723c912a4e5)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:44.918141 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d74e39-b101-4926-b968-67524fb514a4 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:44.920240 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 193/391] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:44 2022] GET /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:44.925337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d74e39-b101-4926-b968-67524fb514a4 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:44.928382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc3f14-6165-4714-9a9b-807fe7860ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:44.929944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc3f14-6165-4714-9a9b-807fe7860ab0 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:44.930485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc3f14-6165-4714-9a9b-807fe7860ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:44.931174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc3f14-6165-4714-9a9b-807fe7860ab0 None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:44.932636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc3f14-6165-4714-9a9b-807fe7860ab0 None admin] RBAC: Authorizing `identity:get_project(project_id=d44324b154884c4cbb76a723c912a4e5)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:44.934304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc3f14-6165-4714-9a9b-807fe7860ab0 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:44.936231 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 199/392] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:44 2022] GET /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:44.957430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc3f14-6165-4714-9a9b-807fe7860ab0 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:45.076435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc3f14-6165-4714-9a9b-807fe7860ab0 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:45.123841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213115d-d288-49de-b3c0-a6fa6eca222e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:45.125143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213115d-d288-49de-b3c0-a6fa6eca222e None admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:45.125657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213115d-d288-49de-b3c0-a6fa6eca222e None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:45.126134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213115d-d288-49de-b3c0-a6fa6eca222e None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5/groups/01fe0e1c193d405494cdf41e30e44734/roles/9d0cb59f15d2481eace97516b3b77a71` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:45.126534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d74e39-b101-4926-b968-67524fb514a4 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:45.130248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213115d-d288-49de-b3c0-a6fa6eca222e None admin] RBAC: Authorizing `identity:create_grant(project_id=d44324b154884c4cbb76a723c912a4e5, group_id=01fe0e1c193d405494cdf41e30e44734, role_id=9d0cb59f15d2481eace97516b3b77a71)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:45.131952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213115d-d288-49de-b3c0-a6fa6eca222e None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:45.179024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31bc3d-fd20-454c-97c8-808a6f3f0d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:45.179861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31bc3d-fd20-454c-97c8-808a6f3f0d4f None admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:45.180186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31bc3d-fd20-454c-97c8-808a6f3f0d4f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:45.180787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31bc3d-fd20-454c-97c8-808a6f3f0d4f None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5/groups/01fe0e1c193d405494cdf41e30e44734/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:45.182968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31bc3d-fd20-454c-97c8-808a6f3f0d4f None admin] RBAC: Authorizing `identity:create_grant(project_id=d44324b154884c4cbb76a723c912a4e5, group_id=01fe0e1c193d405494cdf41e30e44734, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:45.184568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31bc3d-fd20-454c-97c8-808a6f3f0d4f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:45.221392 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 200/393] 10.222.0.16 () {58 vars in 1442 bytes} [Mon May 2 09:57:44 2022] PUT /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5/groups/01fe0e1c193d405494cdf41e30e44734/roles/9d0cb59f15d2481eace97516b3b77a71 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 09:57:45.276898 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 194/394] 10.222.0.16 () {58 vars in 1442 bytes} [Mon May 2 09:57:44 2022] PUT /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5/groups/01fe0e1c193d405494cdf41e30e44734/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 09:57:45.743907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d11d1-d15b-44d8-b856-bfcf5e1cb7f4 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:45.744350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d11d1-d15b-44d8-b856-bfcf5e1cb7f4 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:45.744454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d11d1-d15b-44d8-b856-bfcf5e1cb7f4 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:45.746160 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 201/395] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:45.751183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ad425-4443-4711-8714-b43cb946f768 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:45.751474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ad425-4443-4711-8714-b43cb946f768 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:45.751752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ad425-4443-4711-8714-b43cb946f768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:45.773679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f62ad425-4443-4711-8714-b43cb946f768 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:45.774988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f62ad425-4443-4711-8714-b43cb946f768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:45.850313 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 195/396] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:45.887027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d11d1-d15b-44d8-b856-bfcf5e1cb7f4 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:46.007553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d11d1-d15b-44d8-b856-bfcf5e1cb7f4 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:46.045716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950784f0-96fe-48c1-922c-ea5167d8fde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:46.046514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950784f0-96fe-48c1-922c-ea5167d8fde2 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:46.046795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950784f0-96fe-48c1-922c-ea5167d8fde2 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:46.047070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950784f0-96fe-48c1-922c-ea5167d8fde2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:46.061691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950784f0-96fe-48c1-922c-ea5167d8fde2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:46.069528 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-950784f0-96fe-48c1-922c-ea5167d8fde2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:46.069528 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:46.069528 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:46.069528 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:46.069528 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:46.069528 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:46.069528 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:46.069528 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:46.069528 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:46.069528 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:46.069528 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:46.069528 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:46.069528 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:46.069528 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:46.069528 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:46.069528 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:46.071375 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:46.071375 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:46.071375 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:46.071375 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:46.071375 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:46.071375 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:46.071375 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:46.071375 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:46.071375 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:46.071375 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:46.071375 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:46.071375 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:46.071375 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:46.071375 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:46.071375 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:46.071375 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:46.072166 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:46.072166 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:46.072166 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:46.072166 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:46.072166 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:46.072166 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:46.072166 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:46.072166 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:46.072166 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:46.072166 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:46.072166 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:46.072166 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:46.075351 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 202/397] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:46.076575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ad425-4443-4711-8714-b43cb946f768 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:46.192263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ad425-4443-4711-8714-b43cb946f768 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:46.230805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71361a-0003-439f-af43-a43e6466374d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:46.231484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71361a-0003-439f-af43-a43e6466374d None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:46.231767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71361a-0003-439f-af43-a43e6466374d None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:46.232046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71361a-0003-439f-af43-a43e6466374d None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:46.232887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71361a-0003-439f-af43-a43e6466374d None admin] RBAC: Adding query filter params (name=member) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:46.233201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71361a-0003-439f-af43-a43e6466374d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:46.234574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71361a-0003-439f-af43-a43e6466374d None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:46.247639 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 196/398] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:46.248995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950784f0-96fe-48c1-922c-ea5167d8fde2 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:46.377574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950784f0-96fe-48c1-922c-ea5167d8fde2 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:46.425899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94bab5-b94c-4005-89bd-3702dfe80f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:46.426775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94bab5-b94c-4005-89bd-3702dfe80f73 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:46.427061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94bab5-b94c-4005-89bd-3702dfe80f73 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:46.427497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94bab5-b94c-4005-89bd-3702dfe80f73 None admin] PATH_INFO: `/v3/groups/01fe0e1c193d405494cdf41e30e44734` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:46.433307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94bab5-b94c-4005-89bd-3702dfe80f73 None admin] RBAC: Authorizing `identity:get_group(group_id=01fe0e1c193d405494cdf41e30e44734)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:46.434805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94bab5-b94c-4005-89bd-3702dfe80f73 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:46.436854 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 203/399] 10.222.0.16 () {56 vars in 1180 bytes} [Mon May 2 09:57:46 2022] GET /identity/v3/groups/01fe0e1c193d405494cdf41e30e44734 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:46.442358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71361a-0003-439f-af43-a43e6466374d None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:46.587838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71361a-0003-439f-af43-a43e6466374d None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:46.634875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7fe68-d073-4def-9659-80457e36b7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:46.635675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7fe68-d073-4def-9659-80457e36b7f6 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:46.635965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7fe68-d073-4def-9659-80457e36b7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:46.636246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7fe68-d073-4def-9659-80457e36b7f6 None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:46.637515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7fe68-d073-4def-9659-80457e36b7f6 None admin] RBAC: Authorizing `identity:get_project(project_id=de9cf9f9d50e4932a34fb509a4d47ce6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:46.638967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7fe68-d073-4def-9659-80457e36b7f6 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:46.641037 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 197/400] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:46 2022] GET /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:46.646290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94bab5-b94c-4005-89bd-3702dfe80f73 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:46.787956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94bab5-b94c-4005-89bd-3702dfe80f73 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:46.813068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a4236-793f-4d29-b86c-1c4449a7d919 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:46.813402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a4236-793f-4d29-b86c-1c4449a7d919 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:46.813643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a4236-793f-4d29-b86c-1c4449a7d919 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:46.815284 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 198/401] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:46.823426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5006d-045b-4d3f-a81a-0d2206552464 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:46.823714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5006d-045b-4d3f-a81a-0d2206552464 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:46.824000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5006d-045b-4d3f-a81a-0d2206552464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:46.842278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56fdf2-f2da-488f-9db4-9c9119321954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:46.842988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-22e5006d-045b-4d3f-a81a-0d2206552464 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:46.843754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56fdf2-f2da-488f-9db4-9c9119321954 None admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:46.844195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-22e5006d-045b-4d3f-a81a-0d2206552464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:46.844486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56fdf2-f2da-488f-9db4-9c9119321954 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:46.844986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56fdf2-f2da-488f-9db4-9c9119321954 None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6/groups/01fe0e1c193d405494cdf41e30e44734/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:46.847253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56fdf2-f2da-488f-9db4-9c9119321954 None admin] RBAC: Authorizing `identity:create_grant(project_id=de9cf9f9d50e4932a34fb509a4d47ce6, group_id=01fe0e1c193d405494cdf41e30e44734, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:46.848973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56fdf2-f2da-488f-9db4-9c9119321954 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:46.917859 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 199/402] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:46.921159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a24aef-07d0-424b-883f-1325e317506a None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:46.921454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a24aef-07d0-424b-883f-1325e317506a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:46.921737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a24aef-07d0-424b-883f-1325e317506a None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:46.923347 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 200/403] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:46.929125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee82ed3-8bb6-41d9-accc-05d09a3b1319 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:46.929411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee82ed3-8bb6-41d9-accc-05d09a3b1319 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:46.929743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee82ed3-8bb6-41d9-accc-05d09a3b1319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:46.948549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6ee82ed3-8bb6-41d9-accc-05d09a3b1319 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:46.949744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6ee82ed3-8bb6-41d9-accc-05d09a3b1319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:46.970649 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 204/404] 10.222.0.16 () {58 vars in 1442 bytes} [Mon May 2 09:57:46 2022] PUT /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6/groups/01fe0e1c193d405494cdf41e30e44734/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:57:46.972188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56fdf2-f2da-488f-9db4-9c9119321954 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:47.032776 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 201/405] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:57:47.050307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee82ed3-8bb6-41d9-accc-05d09a3b1319 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:47.115252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56fdf2-f2da-488f-9db4-9c9119321954 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:47.150976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6be48-d0e9-4715-a851-e4a96abc5410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:47.151803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6be48-d0e9-4715-a851-e4a96abc5410 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:47.152091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6be48-d0e9-4715-a851-e4a96abc5410 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:47.152371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6be48-d0e9-4715-a851-e4a96abc5410 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:47.159584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee82ed3-8bb6-41d9-accc-05d09a3b1319 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:47.165055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6be48-d0e9-4715-a851-e4a96abc5410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:47.173678 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-17a6be48-d0e9-4715-a851-e4a96abc5410 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:47.173678 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:47.173678 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:47.173678 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:47.173678 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:47.173678 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:47.173678 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:47.173678 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:47.173678 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:47.173678 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:47.173678 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:47.173678 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:47.173678 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:47.173678 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:47.173678 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:47.173678 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:47.174638 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:47.174638 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:47.174638 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:47.174638 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:47.174638 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:47.174638 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:47.174638 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:47.174638 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:47.174638 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:47.174638 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:47.174638 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:47.174638 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:47.174638 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:47.174638 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:47.174638 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:47.174638 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:47.175444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:47.175444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:47.175444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:47.175444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:47.175444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:47.175444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:47.175444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:47.175444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:47.175444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:47.175444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:47.175444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:47.175444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:47.175444 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 205/406] 10.222.0.16 () {56 vars in 1114 bytes} [Mon May 2 09:57:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:47.183177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6be48-d0e9-4715-a851-e4a96abc5410 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:47.201192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe083e-086f-45c5-bd82-502d4b0ff5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:47.202057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe083e-086f-45c5-bd82-502d4b0ff5c0 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:47.202349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe083e-086f-45c5-bd82-502d4b0ff5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:47.202632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe083e-086f-45c5-bd82-502d4b0ff5c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:47.216914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe083e-086f-45c5-bd82-502d4b0ff5c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:47.227334 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-9cfe083e-086f-45c5-bd82-502d4b0ff5c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:57:47.227334 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:47.227334 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:47.227334 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:47.227334 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:47.227334 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:47.227334 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:47.227334 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:47.227334 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:47.227334 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:47.227334 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:47.227334 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:47.227334 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:47.227334 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:47.227334 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:47.227334 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:47.228356 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:47.228356 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:47.228356 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:47.228356 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:47.228356 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:47.228356 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:47.228356 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:47.228356 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:47.228356 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:47.228356 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:47.228356 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:47.228356 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:57:47.228356 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:47.228356 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:47.228356 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:47.228356 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:47.233076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:47.233076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:47.233076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:47.233076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:47.233076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:47.233076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:47.233076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:47.233076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:47.233076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:47.233076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:47.233076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:57:47.233076 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:47.233076 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 202/407] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:57:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:47.237896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe083e-086f-45c5-bd82-502d4b0ff5c0 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:47.311904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6be48-d0e9-4715-a851-e4a96abc5410 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:47.344976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe083e-086f-45c5-bd82-502d4b0ff5c0 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:47.349888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc3ee3-643f-4fae-888d-63b9d1edea3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:47.349888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc3ee3-643f-4fae-888d-63b9d1edea3b None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:47.349888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc3ee3-643f-4fae-888d-63b9d1edea3b None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:47.349888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc3ee3-643f-4fae-888d-63b9d1edea3b None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:47.350266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc3ee3-643f-4fae-888d-63b9d1edea3b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:47.350536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc3ee3-643f-4fae-888d-63b9d1edea3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:47.351937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc3ee3-643f-4fae-888d-63b9d1edea3b None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:47.362711 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 206/408] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:57:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:47.367583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc3ee3-643f-4fae-888d-63b9d1edea3b None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:47.385183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ce697-c483-47b4-8e8f-cb580fa2404f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:47.386943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ce697-c483-47b4-8e8f-cb580fa2404f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:47.386943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ce697-c483-47b4-8e8f-cb580fa2404f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:47.386943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ce697-c483-47b4-8e8f-cb580fa2404f None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:47.388121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ce697-c483-47b4-8e8f-cb580fa2404f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:47.388782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ce697-c483-47b4-8e8f-cb580fa2404f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:47.390429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ce697-c483-47b4-8e8f-cb580fa2404f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:47.404060 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 203/409] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:47.406323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ce697-c483-47b4-8e8f-cb580fa2404f None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:47.480133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc3ee3-643f-4fae-888d-63b9d1edea3b None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:47.510561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ce697-c483-47b4-8e8f-cb580fa2404f None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:47.511437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47295ada-2e5d-47a9-89b5-9069ccee8106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:47.512308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47295ada-2e5d-47a9-89b5-9069ccee8106 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:47.512593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47295ada-2e5d-47a9-89b5-9069ccee8106 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:47.512904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47295ada-2e5d-47a9-89b5-9069ccee8106 None admin] PATH_INFO: `/v3/groups/01fe0e1c193d405494cdf41e30e44734` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:47.514803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47295ada-2e5d-47a9-89b5-9069ccee8106 None admin] RBAC: Authorizing `identity:get_group(group_id=01fe0e1c193d405494cdf41e30e44734)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:47.515653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47295ada-2e5d-47a9-89b5-9069ccee8106 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:47.517498 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 207/410] 10.222.0.16 () {56 vars in 1180 bytes} [Mon May 2 09:57:47 2022] GET /identity/v3/groups/01fe0e1c193d405494cdf41e30e44734 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:47.522960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47295ada-2e5d-47a9-89b5-9069ccee8106 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:47.547800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfed9d-d46a-4c3e-b88c-a610670bcfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:47.549111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfed9d-d46a-4c3e-b88c-a610670bcfe3 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:47.549643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfed9d-d46a-4c3e-b88c-a610670bcfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:47.550126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfed9d-d46a-4c3e-b88c-a610670bcfe3 None admin] PATH_INFO: `/v3/groups/b6f134b4b42b459bb3496035335c4aa1` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:47.551548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebfed9d-d46a-4c3e-b88c-a610670bcfe3 None admin] RBAC: Authorizing `identity:get_group(group_id=b6f134b4b42b459bb3496035335c4aa1)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:47.553299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebfed9d-d46a-4c3e-b88c-a610670bcfe3 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:47.560444 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 204/411] 10.222.0.16 () {56 vars in 1180 bytes} [Mon May 2 09:57:47 2022] GET /identity/v3/groups/b6f134b4b42b459bb3496035335c4aa1 => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:47.561953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfed9d-d46a-4c3e-b88c-a610670bcfe3 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:47.627172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47295ada-2e5d-47a9-89b5-9069ccee8106 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:47.662078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cec9b-95e8-40a6-a300-031efd686c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:47.662951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cec9b-95e8-40a6-a300-031efd686c4f None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:47.663239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cec9b-95e8-40a6-a300-031efd686c4f None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:47.663523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cec9b-95e8-40a6-a300-031efd686c4f None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:47.665291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cec9b-95e8-40a6-a300-031efd686c4f None admin] RBAC: Authorizing `identity:get_project(project_id=de9cf9f9d50e4932a34fb509a4d47ce6)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:47.665898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfed9d-d46a-4c3e-b88c-a610670bcfe3 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:47.666785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cec9b-95e8-40a6-a300-031efd686c4f None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:47.669368 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 208/412] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:47 2022] GET /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:47.674326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cec9b-95e8-40a6-a300-031efd686c4f None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:47.701927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112ac81-e015-4344-b89f-f8a3b0b3aa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:47.703180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112ac81-e015-4344-b89f-f8a3b0b3aa3c None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:47.703664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112ac81-e015-4344-b89f-f8a3b0b3aa3c None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:47.704206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112ac81-e015-4344-b89f-f8a3b0b3aa3c None admin] PATH_INFO: `/v3/projects/3af81e2baeae46b0b67902cedc893eb9` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:47.705781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112ac81-e015-4344-b89f-f8a3b0b3aa3c None admin] RBAC: Authorizing `identity:get_project(project_id=3af81e2baeae46b0b67902cedc893eb9)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:47.707469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112ac81-e015-4344-b89f-f8a3b0b3aa3c None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:47.712729 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 205/413] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:47 2022] GET /identity/v3/projects/3af81e2baeae46b0b67902cedc893eb9 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:47.715856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112ac81-e015-4344-b89f-f8a3b0b3aa3c None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:47.775336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cec9b-95e8-40a6-a300-031efd686c4f None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:47.810163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ed069-be82-40e5-afbf-70edb905d0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:47.810991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ed069-be82-40e5-afbf-70edb905d0ee None admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:47.811279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ed069-be82-40e5-afbf-70edb905d0ee None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:47.811576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ed069-be82-40e5-afbf-70edb905d0ee None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6/groups/01fe0e1c193d405494cdf41e30e44734/roles/9d0cb59f15d2481eace97516b3b77a71` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:47.814002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ed069-be82-40e5-afbf-70edb905d0ee None admin] RBAC: Authorizing `identity:create_grant(project_id=de9cf9f9d50e4932a34fb509a4d47ce6, group_id=01fe0e1c193d405494cdf41e30e44734, role_id=9d0cb59f15d2481eace97516b3b77a71)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:47.815366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ed069-be82-40e5-afbf-70edb905d0ee None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:47.820019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112ac81-e015-4344-b89f-f8a3b0b3aa3c None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:47.855902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf89e96-7222-4e4b-95fb-f866e4e1716c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:47.857229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf89e96-7222-4e4b-95fb-f866e4e1716c None admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:47.857711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf89e96-7222-4e4b-95fb-f866e4e1716c None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:47.858232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf89e96-7222-4e4b-95fb-f866e4e1716c None admin] PATH_INFO: `/v3/projects/3af81e2baeae46b0b67902cedc893eb9/groups/b6f134b4b42b459bb3496035335c4aa1/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:47.860563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf89e96-7222-4e4b-95fb-f866e4e1716c None admin] RBAC: Authorizing `identity:create_grant(project_id=3af81e2baeae46b0b67902cedc893eb9, group_id=b6f134b4b42b459bb3496035335c4aa1, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:47.862237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf89e96-7222-4e4b-95fb-f866e4e1716c None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:47.892921 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 209/414] 10.222.0.16 () {58 vars in 1442 bytes} [Mon May 2 09:57:47 2022] PUT /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6/groups/01fe0e1c193d405494cdf41e30e44734/roles/9d0cb59f15d2481eace97516b3b77a71 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 09:57:47.945039 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 206/415] 10.222.0.16 () {58 vars in 1442 bytes} [Mon May 2 09:57:47 2022] PUT /identity/v3/projects/3af81e2baeae46b0b67902cedc893eb9/groups/b6f134b4b42b459bb3496035335c4aa1/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:57:48.597042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2c529-824a-494e-a5cf-9a8b3e32b2b8 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:48.597557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2c529-824a-494e-a5cf-9a8b3e32b2b8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:48.597657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2c529-824a-494e-a5cf-9a8b3e32b2b8 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:48.599272 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 210/416] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:48.604581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140aafbc-a9cf-44af-b712-c51a4c8c50e6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:48.616824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140aafbc-a9cf-44af-b712-c51a4c8c50e6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:48.616824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140aafbc-a9cf-44af-b712-c51a4c8c50e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:48.623134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-140aafbc-a9cf-44af-b712-c51a4c8c50e6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:48.624325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-140aafbc-a9cf-44af-b712-c51a4c8c50e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:48.709661 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 207/417] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:48.754884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2c529-824a-494e-a5cf-9a8b3e32b2b8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:48.805604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d4353-3cac-4511-8fbf-18ebcd4a7ae6 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:48.805950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d4353-3cac-4511-8fbf-18ebcd4a7ae6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:48.806182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d4353-3cac-4511-8fbf-18ebcd4a7ae6 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:48.807795 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 208/418] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:48.830428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc495f6a-0511-4a2a-a135-58e7e104c003 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:48.830733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc495f6a-0511-4a2a-a135-58e7e104c003 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:48.831001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc495f6a-0511-4a2a-a135-58e7e104c003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:48.861945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-fc495f6a-0511-4a2a-a135-58e7e104c003 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:48.863403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fc495f6a-0511-4a2a-a135-58e7e104c003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:48.876791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2c529-824a-494e-a5cf-9a8b3e32b2b8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:48.913382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512c572-4446-4031-9f60-baa2d26ef6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:48.914174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512c572-4446-4031-9f60-baa2d26ef6f2 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:48.914481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512c572-4446-4031-9f60-baa2d26ef6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:48.914767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512c572-4446-4031-9f60-baa2d26ef6f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:48.937234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512c572-4446-4031-9f60-baa2d26ef6f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:48.949131 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-0512c572-4446-4031-9f60-baa2d26ef6f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:48.949131 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:48.949131 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:48.949131 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:48.949131 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:48.949131 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:48.949131 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:48.949131 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:48.949131 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:48.949131 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:48.949131 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:48.949131 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:48.949131 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:48.949131 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:48.949131 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:48.949131 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:48.950016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:48.950016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:48.950016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:48.950016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:48.950016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:48.950016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:48.950016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:48.950016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:48.950016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:48.950016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:48.950016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:48.950016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:48.950016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:48.950016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:48.950016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:48.950016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:48.951834 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:48.951834 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:48.951834 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:48.951834 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:48.951834 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:48.951834 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:48.951834 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:48.951834 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:48.951834 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:48.951834 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:48.951834 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:48.951834 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:48.953632 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 211/419] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:48.959320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512c572-4446-4031-9f60-baa2d26ef6f2 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:49.000451 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 209/420] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:49.049846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc495f6a-0511-4a2a-a135-58e7e104c003 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:49.075300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512c572-4446-4031-9f60-baa2d26ef6f2 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:49.130341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddc2be-bdef-42d8-b05f-577c00015560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:49.130937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddc2be-bdef-42d8-b05f-577c00015560 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:49.131222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddc2be-bdef-42d8-b05f-577c00015560 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:49.131499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddc2be-bdef-42d8-b05f-577c00015560 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:49.132259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddc2be-bdef-42d8-b05f-577c00015560 None admin] RBAC: Adding query filter params (name=member) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:49.132570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddc2be-bdef-42d8-b05f-577c00015560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:49.134007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddc2be-bdef-42d8-b05f-577c00015560 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:49.148400 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 212/421] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:49.154814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddc2be-bdef-42d8-b05f-577c00015560 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:49.213824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc495f6a-0511-4a2a-a135-58e7e104c003 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:49.281424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff30326-23cf-4aff-bb3d-30f4a7d79ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:49.282248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff30326-23cf-4aff-bb3d-30f4a7d79ffa None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:49.282532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff30326-23cf-4aff-bb3d-30f4a7d79ffa None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:49.282807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff30326-23cf-4aff-bb3d-30f4a7d79ffa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:49.306952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff30326-23cf-4aff-bb3d-30f4a7d79ffa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:49.320655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddc2be-bdef-42d8-b05f-577c00015560 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:49.321988 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-cff30326-23cf-4aff-bb3d-30f4a7d79ffa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:49.321988 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:49.321988 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:49.321988 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:49.321988 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:49.321988 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:49.321988 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:49.321988 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:49.321988 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:49.321988 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:49.321988 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:49.321988 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:49.321988 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:49.321988 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:49.321988 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:49.321988 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:49.322862 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:49.322862 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:49.322862 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:49.322862 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:49.322862 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:49.322862 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:49.322862 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:49.322862 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:49.322862 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:49.322862 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:49.322862 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:49.322862 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:57:49.322862 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:49.322862 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:49.322862 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:49.322862 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:49.323637 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:49.323637 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:49.323637 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:49.323637 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:49.323637 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:49.323637 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:49.323637 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:49.323637 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:49.323637 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:49.323637 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:49.323637 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:49.323637 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:49.330429 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 210/422] 10.222.0.16 () {56 vars in 1114 bytes} [Mon May 2 09:57:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:57:49.335790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff30326-23cf-4aff-bb3d-30f4a7d79ffa None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:49.358484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c3cc8-af12-4080-a571-ec0d7c3f4231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:49.359139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c3cc8-af12-4080-a571-ec0d7c3f4231 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:49.359426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c3cc8-af12-4080-a571-ec0d7c3f4231 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:49.359708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c3cc8-af12-4080-a571-ec0d7c3f4231 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:49.476496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff30326-23cf-4aff-bb3d-30f4a7d79ffa None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:49.481428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c3cc8-af12-4080-a571-ec0d7c3f4231 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:49.483117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c3cc8-af12-4080-a571-ec0d7c3f4231 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:49.569347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b02c5-74e7-4163-ba03-5e6da9487791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:49.569907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b02c5-74e7-4163-ba03-5e6da9487791 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:49.570201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b02c5-74e7-4163-ba03-5e6da9487791 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:49.570486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b02c5-74e7-4163-ba03-5e6da9487791 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:49.571290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b02c5-74e7-4163-ba03-5e6da9487791 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:49.571607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b02c5-74e7-4163-ba03-5e6da9487791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:49.573055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b02c5-74e7-4163-ba03-5e6da9487791 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:49.587151 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 213/423] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:49.590668 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 211/424] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:57:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:49.597141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c3cc8-af12-4080-a571-ec0d7c3f4231 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:49.597643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b02c5-74e7-4163-ba03-5e6da9487791 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:49.756660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b02c5-74e7-4163-ba03-5e6da9487791 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:49.771465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c3cc8-af12-4080-a571-ec0d7c3f4231 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:49.820230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99507f79-5e0e-40c8-b8c8-fb502389b67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:49.821692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99507f79-5e0e-40c8-b8c8-fb502389b67b None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:49.821973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99507f79-5e0e-40c8-b8c8-fb502389b67b None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:49.822248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99507f79-5e0e-40c8-b8c8-fb502389b67b None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:49.823786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99507f79-5e0e-40c8-b8c8-fb502389b67b None admin] RBAC: Authorizing `identity:get_project(project_id=d44324b154884c4cbb76a723c912a4e5)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:49.825299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99507f79-5e0e-40c8-b8c8-fb502389b67b None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:49.831144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685b60a-5d95-4cf4-bf15-0971d9db3f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:49.831813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685b60a-5d95-4cf4-bf15-0971d9db3f14 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:49.832095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685b60a-5d95-4cf4-bf15-0971d9db3f14 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:49.832367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685b60a-5d95-4cf4-bf15-0971d9db3f14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:49.840612 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 212/425] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:49 2022] GET /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:49.841881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99507f79-5e0e-40c8-b8c8-fb502389b67b None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:49.909829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685b60a-5d95-4cf4-bf15-0971d9db3f14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:49.911657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685b60a-5d95-4cf4-bf15-0971d9db3f14 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:49.967780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99507f79-5e0e-40c8-b8c8-fb502389b67b None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:50.011652 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 214/426] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:50.018080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685b60a-5d95-4cf4-bf15-0971d9db3f14 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:50.042018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a16b5-9252-4c86-9445-b84fed31d744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:50.042900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a16b5-9252-4c86-9445-b84fed31d744 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:50.043512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a16b5-9252-4c86-9445-b84fed31d744 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:50.043512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a16b5-9252-4c86-9445-b84fed31d744 None admin] PATH_INFO: `/v3/groups/01fe0e1c193d405494cdf41e30e44734` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:50.044660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a16b5-9252-4c86-9445-b84fed31d744 None admin] RBAC: Authorizing `identity:get_group(group_id=01fe0e1c193d405494cdf41e30e44734)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:50.046120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a16b5-9252-4c86-9445-b84fed31d744 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:50.048038 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 213/427] 10.222.0.16 () {56 vars in 1180 bytes} [Mon May 2 09:57:49 2022] GET /identity/v3/groups/01fe0e1c193d405494cdf41e30e44734 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:50.049437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f769f-8db6-4d02-afb0-c8002e976dde None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:50.049731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f769f-8db6-4d02-afb0-c8002e976dde None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:50.050014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f769f-8db6-4d02-afb0-c8002e976dde None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:50.051398 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 214/428] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:50.055793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f769f-8db6-4d02-afb0-c8002e976dde None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:50.130153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685b60a-5d95-4cf4-bf15-0971d9db3f14 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:50.161215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f769f-8db6-4d02-afb0-c8002e976dde None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:50.165131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514a020-15d3-4544-b02c-7797801157c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:50.165551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514a020-15d3-4544-b02c-7797801157c4 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:50.165838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514a020-15d3-4544-b02c-7797801157c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:50.166117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514a020-15d3-4544-b02c-7797801157c4 None admin] PATH_INFO: `/v3/projects/d44324b154884c4cbb76a723c912a4e5` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:50.167314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514a020-15d3-4544-b02c-7797801157c4 None admin] RBAC: Authorizing `identity:get_project(project_id=d44324b154884c4cbb76a723c912a4e5)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:50.168776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514a020-15d3-4544-b02c-7797801157c4 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:50.171142 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 215/429] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:50 2022] GET /identity/v3/projects/d44324b154884c4cbb76a723c912a4e5 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:50.172141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66886128-b4bb-4010-abfc-01b75ebcf8ea None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:50.172428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66886128-b4bb-4010-abfc-01b75ebcf8ea None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:50.172732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66886128-b4bb-4010-abfc-01b75ebcf8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:50.189957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-66886128-b4bb-4010-abfc-01b75ebcf8ea None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:50.191145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-66886128-b4bb-4010-abfc-01b75ebcf8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:50.201244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef97da2-a568-43cf-837f-98e129def868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:50.202242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef97da2-a568-43cf-837f-98e129def868 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:50.202735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef97da2-a568-43cf-837f-98e129def868 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:50.203220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef97da2-a568-43cf-837f-98e129def868 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:50.204280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef97da2-a568-43cf-837f-98e129def868 None admin] RBAC: Adding query filter params (group.id=01fe0e1c193d405494cdf41e30e44734, role.id=d1592d47a67b4f4a8d14e2101c799509, scope.project.id=d44324b154884c4cbb76a723c912a4e5) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:50.204855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef97da2-a568-43cf-837f-98e129def868 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:50.206505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef97da2-a568-43cf-837f-98e129def868 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:50.213371 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 215/430] 10.222.0.16 () {56 vars in 1376 bytes} [Mon May 2 09:57:50 2022] GET /identity/v3/role_assignments?group.id=01fe0e1c193d405494cdf41e30e44734&scope.project.id=d44324b154884c4cbb76a723c912a4e5&role.id=d1592d47a67b4f4a8d14e2101c799509 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:50.223831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef97da2-a568-43cf-837f-98e129def868 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:50.265600 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 216/431] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:50.290175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66886128-b4bb-4010-abfc-01b75ebcf8ea None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:50.395572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66886128-b4bb-4010-abfc-01b75ebcf8ea None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:50.404088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef97da2-a568-43cf-837f-98e129def868 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:50.433023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e4243-d8b8-49ad-a87a-77d32ef9e54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:50.434002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e4243-d8b8-49ad-a87a-77d32ef9e54d None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:50.434389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e4243-d8b8-49ad-a87a-77d32ef9e54d None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:50.434794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e4243-d8b8-49ad-a87a-77d32ef9e54d None admin] PATH_INFO: `/v3/roles/member` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:50.441183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b7073-0bbc-4f3c-a021-765ad49317df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:50.442406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b7073-0bbc-4f3c-a021-765ad49317df None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:50.442905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b7073-0bbc-4f3c-a021-765ad49317df None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:50.443383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b7073-0bbc-4f3c-a021-765ad49317df None admin] PATH_INFO: `/v3/groups/01fe0e1c193d405494cdf41e30e44734` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:50.444798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b7073-0bbc-4f3c-a021-765ad49317df None admin] RBAC: Authorizing `identity:get_group(group_id=01fe0e1c193d405494cdf41e30e44734)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:50.446917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e4243-d8b8-49ad-a87a-77d32ef9e54d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:50.447239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b7073-0bbc-4f3c-a021-765ad49317df None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:50.449113 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 216/432] 10.222.0.16 () {56 vars in 1180 bytes} [Mon May 2 09:57:50 2022] GET /identity/v3/groups/01fe0e1c193d405494cdf41e30e44734 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:50.460657 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-c49e4243-d8b8-49ad-a87a-77d32ef9e54d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:50.460657 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:50.460657 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:50.460657 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:50.460657 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:50.460657 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:50.460657 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:50.460657 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:50.460657 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:50.460657 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:50.460657 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:50.460657 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:50.460657 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:50.460657 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:50.460657 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:50.460657 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:50.461676 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:50.461676 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:50.461676 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:50.461676 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:50.461676 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:50.461676 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:50.461676 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:50.461676 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:50.461676 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:50.461676 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:50.461676 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:50.461676 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:50.461676 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:50.461676 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:50.461676 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:50.461676 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:50.462485 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:50.462485 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:50.462485 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:50.462485 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:50.462485 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:50.462485 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:50.462485 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:50.462485 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:50.462485 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:50.462485 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:50.462485 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 02 09:57:50.462485 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:50.462485 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 217/433] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:57:50.464960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e4243-d8b8-49ad-a87a-77d32ef9e54d None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:50.465159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b7073-0bbc-4f3c-a021-765ad49317df None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:50.570287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e4243-d8b8-49ad-a87a-77d32ef9e54d None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:50.573314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b7073-0bbc-4f3c-a021-765ad49317df None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:50.611350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222ab7b-0d80-4cf9-9317-6d5607cad245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:50.612772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16457efa-4848-4abb-ab95-a82f22c5ab55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:50.613060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222ab7b-0d80-4cf9-9317-6d5607cad245 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:50.615234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222ab7b-0d80-4cf9-9317-6d5607cad245 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:50.615337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16457efa-4848-4abb-ab95-a82f22c5ab55 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:50.615424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222ab7b-0d80-4cf9-9317-6d5607cad245 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:50.615506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16457efa-4848-4abb-ab95-a82f22c5ab55 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:50.615506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16457efa-4848-4abb-ab95-a82f22c5ab55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:50.615664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222ab7b-0d80-4cf9-9317-6d5607cad245 None admin] RBAC: Adding query filter params (name=member) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:50.615664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222ab7b-0d80-4cf9-9317-6d5607cad245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:50.615796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16457efa-4848-4abb-ab95-a82f22c5ab55 None admin] RBAC: Adding query filter params (group.id=01fe0e1c193d405494cdf41e30e44734, role.id=9d0cb59f15d2481eace97516b3b77a71, scope.project.id=d44324b154884c4cbb76a723c912a4e5) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:50.615796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16457efa-4848-4abb-ab95-a82f22c5ab55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:50.617292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16457efa-4848-4abb-ab95-a82f22c5ab55 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:50.617564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222ab7b-0d80-4cf9-9317-6d5607cad245 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:50.632629 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 217/434] 10.222.0.16 () {56 vars in 1376 bytes} [Mon May 2 09:57:50 2022] GET /identity/v3/role_assignments?group.id=01fe0e1c193d405494cdf41e30e44734&scope.project.id=d44324b154884c4cbb76a723c912a4e5&role.id=9d0cb59f15d2481eace97516b3b77a71 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:50.639141 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 218/435] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:57:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:50.645000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16457efa-4848-4abb-ab95-a82f22c5ab55 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:50.777248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16457efa-4848-4abb-ab95-a82f22c5ab55 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:50.818541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6671a9-24ba-4ad6-a92d-3d36fad7d8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:50.819218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6671a9-24ba-4ad6-a92d-3d36fad7d8e9 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:50.819506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6671a9-24ba-4ad6-a92d-3d36fad7d8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:50.819788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6671a9-24ba-4ad6-a92d-3d36fad7d8e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:50.881528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce27f0-2575-4a13-a5b6-35d72451b103 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:50.882192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce27f0-2575-4a13-a5b6-35d72451b103 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:50.882677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce27f0-2575-4a13-a5b6-35d72451b103 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:50.884537 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 219/436] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:50.893146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ced8e6-1c68-4ef3-819b-e89cc3661745 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:50.893716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ced8e6-1c68-4ef3-819b-e89cc3661745 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:50.894226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ced8e6-1c68-4ef3-819b-e89cc3661745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:50.899589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6671a9-24ba-4ad6-a92d-3d36fad7d8e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:50.900192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6671a9-24ba-4ad6-a92d-3d36fad7d8e9 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:50.924449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d9ced8e6-1c68-4ef3-819b-e89cc3661745 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:50.926038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d9ced8e6-1c68-4ef3-819b-e89cc3661745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:51.008824 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 220/437] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:57:51.010200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0827f-589e-49a3-a0ec-744eecfdf606 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:51.010487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0827f-589e-49a3-a0ec-744eecfdf606 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:51.011316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0827f-589e-49a3-a0ec-744eecfdf606 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:51.011855 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 218/438] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:51.013834 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 221/439] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:51.017420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6671a9-24ba-4ad6-a92d-3d36fad7d8e9 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:51.019478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff4209-1a32-4333-bc3e-8e93b58e3ccb None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:51.019770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff4209-1a32-4333-bc3e-8e93b58e3ccb None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:51.020051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff4209-1a32-4333-bc3e-8e93b58e3ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:51.037224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0cff4209-1a32-4333-bc3e-8e93b58e3ccb None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:51.038404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0cff4209-1a32-4333-bc3e-8e93b58e3ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:51.117036 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 222/440] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:57:51.118170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff4209-1a32-4333-bc3e-8e93b58e3ccb None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:51.129104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6671a9-24ba-4ad6-a92d-3d36fad7d8e9 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:51.171954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ce391-1361-44f9-811d-0084ea6e1497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:51.171954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ce391-1361-44f9-811d-0084ea6e1497 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:51.172194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ce391-1361-44f9-811d-0084ea6e1497 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:51.172422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ce391-1361-44f9-811d-0084ea6e1497 None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:51.174330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ce391-1361-44f9-811d-0084ea6e1497 None admin] RBAC: Authorizing `identity:get_project(project_id=de9cf9f9d50e4932a34fb509a4d47ce6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:51.175793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ce391-1361-44f9-811d-0084ea6e1497 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:51.177583 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 219/441] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:51 2022] GET /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:51.178506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ce391-1361-44f9-811d-0084ea6e1497 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:51.231275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff4209-1a32-4333-bc3e-8e93b58e3ccb None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:51.261790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2f2ac-9b39-4111-af1c-4c714825f941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:51.262594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f2ac-9b39-4111-af1c-4c714825f941 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:51.262881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f2ac-9b39-4111-af1c-4c714825f941 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:51.263153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f2ac-9b39-4111-af1c-4c714825f941 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:51.275260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2f2ac-9b39-4111-af1c-4c714825f941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:51.285504 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-c0d2f2ac-9b39-4111-af1c-4c714825f941 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:51.285504 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:51.285504 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:51.285504 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:51.285504 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:51.285504 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:51.285504 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:51.285504 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:51.285504 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:51.285504 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:51.285504 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:51.285504 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:51.285504 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:51.285504 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:51.285504 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:51.285504 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:51.286565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:51.286565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:51.286565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:51.286565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:51.286565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:51.286565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:51.286565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:51.286565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:51.286565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:51.286565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:51.286565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:51.286565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:51.286565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:51.286565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:51.286565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:51.286565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:51.287604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:51.287604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:51.287604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:51.287604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:51.287604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:51.287604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:51.287604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:51.287604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:51.287604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:51.287604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:51.287604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:51.287604 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:51.288376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ce391-1361-44f9-811d-0084ea6e1497 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:51.288742 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 223/442] 10.222.0.16 () {56 vars in 1114 bytes} [Mon May 2 09:57:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:51.290424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2f2ac-9b39-4111-af1c-4c714825f941 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:51.318557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f45f3-6aeb-4f25-b49f-c7925615a74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:51.319343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f45f3-6aeb-4f25-b49f-c7925615a74d None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:51.319626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f45f3-6aeb-4f25-b49f-c7925615a74d None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:51.319897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f45f3-6aeb-4f25-b49f-c7925615a74d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:51.329904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f45f3-6aeb-4f25-b49f-c7925615a74d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:51.338016 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-497f45f3-6aeb-4f25-b49f-c7925615a74d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:57:51.338016 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:51.338016 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:51.338016 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:51.338016 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:51.338016 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:51.338016 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:51.338016 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:51.338016 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:51.338016 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:51.338016 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:51.338016 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:51.338016 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:51.338016 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:51.338016 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:51.338016 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:51.339084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:51.339084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:51.339084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:51.339084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:51.339084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:51.339084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:51.339084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:51.339084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:51.339084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:51.339084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:51.339084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:51.339084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:57:51.339084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:51.339084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:51.339084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:51.339084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:51.344992 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:51.344992 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:51.344992 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:51.344992 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:51.344992 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:51.344992 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:51.344992 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:51.344992 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:51.344992 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:51.344992 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:51.344992 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:57:51.344992 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:51.344992 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 220/443] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:57:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:51.344992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f45f3-6aeb-4f25-b49f-c7925615a74d None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:51.384896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2f2ac-9b39-4111-af1c-4c714825f941 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:51.419846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419aba46-e907-4aad-949e-9a9207cd1e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:51.420739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aba46-e907-4aad-949e-9a9207cd1e9a None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:51.421029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aba46-e907-4aad-949e-9a9207cd1e9a None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:51.421315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aba46-e907-4aad-949e-9a9207cd1e9a None admin] PATH_INFO: `/v3/groups/01fe0e1c193d405494cdf41e30e44734` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:51.422585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419aba46-e907-4aad-949e-9a9207cd1e9a None admin] RBAC: Authorizing `identity:get_group(group_id=01fe0e1c193d405494cdf41e30e44734)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:51.423955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419aba46-e907-4aad-949e-9a9207cd1e9a None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:51.425618 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 224/444] 10.222.0.16 () {56 vars in 1180 bytes} [Mon May 2 09:57:51 2022] GET /identity/v3/groups/01fe0e1c193d405494cdf41e30e44734 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:51.426379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419aba46-e907-4aad-949e-9a9207cd1e9a None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:51.436617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f45f3-6aeb-4f25-b49f-c7925615a74d None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:51.470440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069fed0-3b44-424f-832c-c9f891b828f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:51.471114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069fed0-3b44-424f-832c-c9f891b828f0 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:51.471443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069fed0-3b44-424f-832c-c9f891b828f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:51.471690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069fed0-3b44-424f-832c-c9f891b828f0 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:51.472434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069fed0-3b44-424f-832c-c9f891b828f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:51.472784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069fed0-3b44-424f-832c-c9f891b828f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:51.476528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069fed0-3b44-424f-832c-c9f891b828f0 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:51.481733 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 221/445] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:57:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:51.482519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069fed0-3b44-424f-832c-c9f891b828f0 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:51.523641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419aba46-e907-4aad-949e-9a9207cd1e9a None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:51.554738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10cc48-e047-4792-ac88-d55b062e1bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:51.555421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10cc48-e047-4792-ac88-d55b062e1bc2 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:51.555700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10cc48-e047-4792-ac88-d55b062e1bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:51.555975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10cc48-e047-4792-ac88-d55b062e1bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:51.556746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10cc48-e047-4792-ac88-d55b062e1bc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:51.557051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10cc48-e047-4792-ac88-d55b062e1bc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:51.558404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10cc48-e047-4792-ac88-d55b062e1bc2 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:51.566153 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 225/446] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:57:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:51.566929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10cc48-e047-4792-ac88-d55b062e1bc2 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:51.581660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069fed0-3b44-424f-832c-c9f891b828f0 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:51.613082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fdb8e-f7f1-4340-b736-f317b8aeb58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:51.613726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fdb8e-f7f1-4340-b736-f317b8aeb58b None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:51.614010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fdb8e-f7f1-4340-b736-f317b8aeb58b None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:51.614284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fdb8e-f7f1-4340-b736-f317b8aeb58b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:51.615096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fdb8e-f7f1-4340-b736-f317b8aeb58b None admin] RBAC: Adding query filter params (group.id=01fe0e1c193d405494cdf41e30e44734, role.id=d1592d47a67b4f4a8d14e2101c799509, scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:51.615407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fdb8e-f7f1-4340-b736-f317b8aeb58b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:51.616859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fdb8e-f7f1-4340-b736-f317b8aeb58b None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:51.622418 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 222/447] 10.222.0.16 () {56 vars in 1376 bytes} [Mon May 2 09:57:51 2022] GET /identity/v3/role_assignments?group.id=01fe0e1c193d405494cdf41e30e44734&scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6&role.id=d1592d47a67b4f4a8d14e2101c799509 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:51.623183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fdb8e-f7f1-4340-b736-f317b8aeb58b None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:51.665488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10cc48-e047-4792-ac88-d55b062e1bc2 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:51.701749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7a3bf-1a96-485d-9fd5-25ae573911ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:51.702331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7a3bf-1a96-485d-9fd5-25ae573911ea None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:51.702615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7a3bf-1a96-485d-9fd5-25ae573911ea None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:51.702895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7a3bf-1a96-485d-9fd5-25ae573911ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:51.741079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fdb8e-f7f1-4340-b736-f317b8aeb58b None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:51.774112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7a3bf-1a96-485d-9fd5-25ae573911ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:51.775467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1ab18-2f84-411e-a21e-1c0d6b24621a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:51.775593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7a3bf-1a96-485d-9fd5-25ae573911ea None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:51.776412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1ab18-2f84-411e-a21e-1c0d6b24621a None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:51.776925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1ab18-2f84-411e-a21e-1c0d6b24621a None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:51.777494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1ab18-2f84-411e-a21e-1c0d6b24621a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:51.853055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1ab18-2f84-411e-a21e-1c0d6b24621a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:51.854513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1ab18-2f84-411e-a21e-1c0d6b24621a None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:51.878925 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 226/448] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:51.884885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7a3bf-1a96-485d-9fd5-25ae573911ea None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:51.955543 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 223/449] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:57:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:57:51.961355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1ab18-2f84-411e-a21e-1c0d6b24621a None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:51.988996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7a3bf-1a96-485d-9fd5-25ae573911ea None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:52.024753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c5ae6-ea12-461e-a834-0deafec7029e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:52.025606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c5ae6-ea12-461e-a834-0deafec7029e None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:52.025888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c5ae6-ea12-461e-a834-0deafec7029e None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:52.026160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c5ae6-ea12-461e-a834-0deafec7029e None admin] PATH_INFO: `/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:52.027340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c5ae6-ea12-461e-a834-0deafec7029e None admin] RBAC: Authorizing `identity:get_project(project_id=de9cf9f9d50e4932a34fb509a4d47ce6)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:52.028785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c5ae6-ea12-461e-a834-0deafec7029e None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:52.030466 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 227/450] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:51 2022] GET /identity/v3/projects/de9cf9f9d50e4932a34fb509a4d47ce6 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:52.035724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c5ae6-ea12-461e-a834-0deafec7029e None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:52.062625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1ab18-2f84-411e-a21e-1c0d6b24621a None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:52.093762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b56e22-a300-47a4-a9b5-c579b2f81410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:52.094628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b56e22-a300-47a4-a9b5-c579b2f81410 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:52.094919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b56e22-a300-47a4-a9b5-c579b2f81410 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:52.095202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b56e22-a300-47a4-a9b5-c579b2f81410 None admin] PATH_INFO: `/v3/projects/3af81e2baeae46b0b67902cedc893eb9` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:52.096417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b56e22-a300-47a4-a9b5-c579b2f81410 None admin] RBAC: Authorizing `identity:get_project(project_id=3af81e2baeae46b0b67902cedc893eb9)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:52.097896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b56e22-a300-47a4-a9b5-c579b2f81410 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:52.099593 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 224/451] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:57:51 2022] GET /identity/v3/projects/3af81e2baeae46b0b67902cedc893eb9 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:52.105603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b56e22-a300-47a4-a9b5-c579b2f81410 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:52.130510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c5ae6-ea12-461e-a834-0deafec7029e None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:52.162647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c64de5-d96e-4817-94f4-e5d385dadb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:52.163496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c64de5-d96e-4817-94f4-e5d385dadb64 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:52.163786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c64de5-d96e-4817-94f4-e5d385dadb64 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:52.164080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c64de5-d96e-4817-94f4-e5d385dadb64 None admin] PATH_INFO: `/v3/groups/01fe0e1c193d405494cdf41e30e44734` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:52.165802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c64de5-d96e-4817-94f4-e5d385dadb64 None admin] RBAC: Authorizing `identity:get_group(group_id=01fe0e1c193d405494cdf41e30e44734)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:52.167230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c64de5-d96e-4817-94f4-e5d385dadb64 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:52.168873 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 228/452] 10.222.0.16 () {56 vars in 1180 bytes} [Mon May 2 09:57:52 2022] GET /identity/v3/groups/01fe0e1c193d405494cdf41e30e44734 => generated 226 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:52.174742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c64de5-d96e-4817-94f4-e5d385dadb64 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:52.199130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b56e22-a300-47a4-a9b5-c579b2f81410 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:52.230380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819fdb3-351e-4ed0-bf16-b7f1c7502cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:52.231159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819fdb3-351e-4ed0-bf16-b7f1c7502cf8 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:52.231437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819fdb3-351e-4ed0-bf16-b7f1c7502cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:52.231709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819fdb3-351e-4ed0-bf16-b7f1c7502cf8 None admin] PATH_INFO: `/v3/groups/b6f134b4b42b459bb3496035335c4aa1` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:52.232899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819fdb3-351e-4ed0-bf16-b7f1c7502cf8 None admin] RBAC: Authorizing `identity:get_group(group_id=b6f134b4b42b459bb3496035335c4aa1)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:52.234348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819fdb3-351e-4ed0-bf16-b7f1c7502cf8 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:52.235947 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 225/453] 10.222.0.16 () {56 vars in 1180 bytes} [Mon May 2 09:57:52 2022] GET /identity/v3/groups/b6f134b4b42b459bb3496035335c4aa1 => generated 229 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:52.241762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819fdb3-351e-4ed0-bf16-b7f1c7502cf8 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:52.267289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c64de5-d96e-4817-94f4-e5d385dadb64 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:52.298556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f0d3c-a354-4ce3-8344-aa442e07641f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:52.299210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f0d3c-a354-4ce3-8344-aa442e07641f None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:52.299478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f0d3c-a354-4ce3-8344-aa442e07641f None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:52.299755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f0d3c-a354-4ce3-8344-aa442e07641f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:52.300575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f0d3c-a354-4ce3-8344-aa442e07641f None admin] RBAC: Adding query filter params (group.id=01fe0e1c193d405494cdf41e30e44734, role.id=9d0cb59f15d2481eace97516b3b77a71, scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:52.300919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f0d3c-a354-4ce3-8344-aa442e07641f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:52.302335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f0d3c-a354-4ce3-8344-aa442e07641f None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:52.308470 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 229/454] 10.222.0.16 () {56 vars in 1376 bytes} [Mon May 2 09:57:52 2022] GET /identity/v3/role_assignments?group.id=01fe0e1c193d405494cdf41e30e44734&scope.project.id=de9cf9f9d50e4932a34fb509a4d47ce6&role.id=9d0cb59f15d2481eace97516b3b77a71 => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:52.335249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819fdb3-351e-4ed0-bf16-b7f1c7502cf8 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:52.370690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110b8b7-8148-4d27-8bb7-e92918fdf63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:52.371432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110b8b7-8148-4d27-8bb7-e92918fdf63b None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:52.371721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110b8b7-8148-4d27-8bb7-e92918fdf63b None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:52.371997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110b8b7-8148-4d27-8bb7-e92918fdf63b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:52.372882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110b8b7-8148-4d27-8bb7-e92918fdf63b None admin] RBAC: Adding query filter params (group.id=b6f134b4b42b459bb3496035335c4aa1, role.id=dd8a47ade22941849ebdf8fbdf994b66, scope.project.id=3af81e2baeae46b0b67902cedc893eb9) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:52.373198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110b8b7-8148-4d27-8bb7-e92918fdf63b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:52.374686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110b8b7-8148-4d27-8bb7-e92918fdf63b None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:52.381269 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 226/455] 10.222.0.16 () {56 vars in 1376 bytes} [Mon May 2 09:57:52 2022] GET /identity/v3/role_assignments?group.id=b6f134b4b42b459bb3496035335c4aa1&scope.project.id=3af81e2baeae46b0b67902cedc893eb9&role.id=dd8a47ade22941849ebdf8fbdf994b66 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:55.277395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cea0a-53e6-493f-bb4e-9e05eea59042 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:55.277944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cea0a-53e6-493f-bb4e-9e05eea59042 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:55.277944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cea0a-53e6-493f-bb4e-9e05eea59042 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:55.279528 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 230/456] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:55.284883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73902570-1613-4525-8256-56abccb8d889 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:55.285337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73902570-1613-4525-8256-56abccb8d889 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:55.285517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73902570-1613-4525-8256-56abccb8d889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:55.313947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-73902570-1613-4525-8256-56abccb8d889 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:55.315199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-73902570-1613-4525-8256-56abccb8d889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:55.410903 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 227/457] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:57:55.444694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434cea0a-53e6-493f-bb4e-9e05eea59042 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:55.507167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a16450-eca6-4d87-b538-1507bcda011d None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:55.507806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a16450-eca6-4d87-b538-1507bcda011d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:55.508298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a16450-eca6-4d87-b538-1507bcda011d None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:55.510150 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 228/458] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:57:55.515387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedb3f0-4f5c-4921-a1f7-a8ab6ac5cc45 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:55.515944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedb3f0-4f5c-4921-a1f7-a8ab6ac5cc45 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:55.516422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedb3f0-4f5c-4921-a1f7-a8ab6ac5cc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:55.541586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-fcedb3f0-4f5c-4921-a1f7-a8ab6ac5cc45 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:55.543088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fcedb3f0-4f5c-4921-a1f7-a8ab6ac5cc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:55.573282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434cea0a-53e6-493f-bb4e-9e05eea59042 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:55.614850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1e66c-8751-4a73-b93f-5595a33ab1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:55.616127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1e66c-8751-4a73-b93f-5595a33ab1e3 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:55.616636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1e66c-8751-4a73-b93f-5595a33ab1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:55.617109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1e66c-8751-4a73-b93f-5595a33ab1e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:55.627469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1e66c-8751-4a73-b93f-5595a33ab1e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:55.629132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1e66c-8751-4a73-b93f-5595a33ab1e3 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:55.646822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-41b1e66c-8751-4a73-b93f-5595a33ab1e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:57:55.646822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:55.646822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:55.646822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:55.646822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:55.646822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:55.646822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:55.646822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:55.646822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:55.646822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:55.646822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:55.646822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:55.646822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:57:55.646822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:57:55.646822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:57:55.647710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:57:55.647710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:55.647710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:55.647710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:55.647710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:55.647710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:55.647710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:55.647710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:55.647710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:55.647710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:55.647710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:55.647710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:55.647710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:55.647710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:55.647710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:55.647710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:55.647710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:55.648531 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:57:55.648531 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:57:55.648531 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:57:55.648531 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:55.649313 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 229/459] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:57:55.653904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bd9e2-5565-4a53-8cfb-eb3a25684218 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:55.654433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bd9e2-5565-4a53-8cfb-eb3a25684218 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:55.654918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bd9e2-5565-4a53-8cfb-eb3a25684218 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:55.655690 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 231/460] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:57:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:55.656688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1e66c-8751-4a73-b93f-5595a33ab1e3 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:55.657010 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 230/461] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:55.662990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a768f07-8749-4672-9b65-53910ddf24e3 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:55.663722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a768f07-8749-4672-9b65-53910ddf24e3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:55.665661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a768f07-8749-4672-9b65-53910ddf24e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:55.683700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8a768f07-8749-4672-9b65-53910ddf24e3 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:55.685461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8a768f07-8749-4672-9b65-53910ddf24e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:55.771961 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 231/462] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:55.780961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a768f07-8749-4672-9b65-53910ddf24e3 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:55.795468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1e66c-8751-4a73-b93f-5595a33ab1e3 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:55.842064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea9b75-9008-4a91-ae51-a5ba765a318b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:55.843380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea9b75-9008-4a91-ae51-a5ba765a318b None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:55.843866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea9b75-9008-4a91-ae51-a5ba765a318b None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:55.844340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea9b75-9008-4a91-ae51-a5ba765a318b None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:55.845728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea9b75-9008-4a91-ae51-a5ba765a318b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:55.846261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea9b75-9008-4a91-ae51-a5ba765a318b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:55.848215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea9b75-9008-4a91-ae51-a5ba765a318b None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:55.869511 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 232/463] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:55.871742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea9b75-9008-4a91-ae51-a5ba765a318b None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:55.897503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a768f07-8749-4672-9b65-53910ddf24e3 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:55.932083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62cb83-ddd7-4f04-9d7b-16fa6a722687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:55.932961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62cb83-ddd7-4f04-9d7b-16fa6a722687 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:55.933256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62cb83-ddd7-4f04-9d7b-16fa6a722687 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:55.933542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62cb83-ddd7-4f04-9d7b-16fa6a722687 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:55.944975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62cb83-ddd7-4f04-9d7b-16fa6a722687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:55.947108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62cb83-ddd7-4f04-9d7b-16fa6a722687 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:55.967143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-fc62cb83-ddd7-4f04-9d7b-16fa6a722687 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:57:55.967143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:55.967143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:55.967143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:55.967143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:55.967143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:55.967143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:55.967143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:55.967143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:55.967143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:55.967143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:55.967143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:55.967143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:57:55.967143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:57:55.967143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:57:55.968053 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:57:55.968053 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:55.968053 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:55.968053 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:55.968053 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:55.968053 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:55.968053 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:55.968053 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:55.968053 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:57:55.968053 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:55.968053 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:55.968053 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:55.968053 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:55.968053 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:55.968053 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:55.968053 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:55.968053 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:55.968928 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:57:55.968928 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:57:55.968928 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:57:55.968928 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:55.968928 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 232/464] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:57:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:55.969285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62cb83-ddd7-4f04-9d7b-16fa6a722687 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:55.985499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea9b75-9008-4a91-ae51-a5ba765a318b None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:56.020141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e691d1-fd05-4a31-9dd3-2f925f66e286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:56.021329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e691d1-fd05-4a31-9dd3-2f925f66e286 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:56.021812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e691d1-fd05-4a31-9dd3-2f925f66e286 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:56.022302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e691d1-fd05-4a31-9dd3-2f925f66e286 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:56.033258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e691d1-fd05-4a31-9dd3-2f925f66e286 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:56.034970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e691d1-fd05-4a31-9dd3-2f925f66e286 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:56.052747 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-16e691d1-fd05-4a31-9dd3-2f925f66e286 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:57:56.052747 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:56.052747 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:56.052747 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:56.052747 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:56.052747 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:56.052747 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:56.052747 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:56.052747 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:56.052747 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:56.052747 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:56.052747 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:56.052747 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:57:56.052747 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:57:56.052747 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:57:56.053663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:57:56.053663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:56.053663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:56.053663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:56.053663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:56.053663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:56.053663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:56.053663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:56.053663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:56.053663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:56.053663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:56.053663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:56.053663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:56.053663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:56.053663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:56.053663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:56.053663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:56.054489 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:57:56.054489 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:57:56.054489 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:57:56.054489 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:56.061331 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 233/465] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:57:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:56.062402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e691d1-fd05-4a31-9dd3-2f925f66e286 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:56.074831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62cb83-ddd7-4f04-9d7b-16fa6a722687 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:56.120236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46add1d-4ff2-43d5-916f-4d8d4bdb9231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:56.120981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46add1d-4ff2-43d5-916f-4d8d4bdb9231 None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:56.121274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46add1d-4ff2-43d5-916f-4d8d4bdb9231 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:56.121600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46add1d-4ff2-43d5-916f-4d8d4bdb9231 None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:56.122465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46add1d-4ff2-43d5-916f-4d8d4bdb9231 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:56.124147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46add1d-4ff2-43d5-916f-4d8d4bdb9231 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:56.164529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e691d1-fd05-4a31-9dd3-2f925f66e286 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:56.197616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a28ca-8c90-495a-8d91-a71ef945c99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:56.198204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a28ca-8c90-495a-8d91-a71ef945c99c None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:56.198490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a28ca-8c90-495a-8d91-a71ef945c99c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:56.198772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a28ca-8c90-495a-8d91-a71ef945c99c None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:56.199500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a28ca-8c90-495a-8d91-a71ef945c99c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:56.199844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a28ca-8c90-495a-8d91-a71ef945c99c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:56.201292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a28ca-8c90-495a-8d91-a71ef945c99c None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:56.212921 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 234/466] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:56.213737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a28ca-8c90-495a-8d91-a71ef945c99c None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:56.246610 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 233/467] 10.222.0.16 () {60 vars in 1132 bytes} [Mon May 2 09:57:55 2022] POST /identity/v3/users => generated 246 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:57:56.247980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9b221-22ec-4caf-b0b5-82713f10625d None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:56.248270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9b221-22ec-4caf-b0b5-82713f10625d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:56.248555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9b221-22ec-4caf-b0b5-82713f10625d None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:56.249966 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 234/468] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:56.253524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9b221-22ec-4caf-b0b5-82713f10625d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:56.341679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a28ca-8c90-495a-8d91-a71ef945c99c None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:56.374648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9b221-22ec-4caf-b0b5-82713f10625d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:56.379645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a188b-a478-471a-b189-7d0e069a4dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:56.380817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a188b-a478-471a-b189-7d0e069a4dc9 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:56.381311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a188b-a478-471a-b189-7d0e069a4dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:56.381783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a188b-a478-471a-b189-7d0e069a4dc9 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:56.382784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a188b-a478-471a-b189-7d0e069a4dc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:56.383930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a188b-a478-471a-b189-7d0e069a4dc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:56.385731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a188b-a478-471a-b189-7d0e069a4dc9 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:56.400191 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 235/469] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:56.406409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce586acf-eefd-45db-aec9-95501df0b7b6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:56.406936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce586acf-eefd-45db-aec9-95501df0b7b6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:56.407443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce586acf-eefd-45db-aec9-95501df0b7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:56.411091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e6518-78ab-46fa-beac-bbc3762cc1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:56.411880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6518-78ab-46fa-beac-bbc3762cc1c2 None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:56.412173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6518-78ab-46fa-beac-bbc3762cc1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:56.412454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6518-78ab-46fa-beac-bbc3762cc1c2 None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:56.413212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e6518-78ab-46fa-beac-bbc3762cc1c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:56.415586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e6518-78ab-46fa-beac-bbc3762cc1c2 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:56.426971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ce586acf-eefd-45db-aec9-95501df0b7b6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:56.428300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ce586acf-eefd-45db-aec9-95501df0b7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:56.473045 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 235/470] 10.222.0.16 () {60 vars in 1132 bytes} [Mon May 2 09:57:56 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:57:56.474528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e6518-78ab-46fa-beac-bbc3762cc1c2 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:56.505419 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 236/471] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:56.533329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce586acf-eefd-45db-aec9-95501df0b7b6 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:56.638433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e6518-78ab-46fa-beac-bbc3762cc1c2 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:56.656116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce586acf-eefd-45db-aec9-95501df0b7b6 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:56.686911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea313112-e639-4631-a559-3272535f5b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:56.687666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea313112-e639-4631-a559-3272535f5b3a None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:56.687960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea313112-e639-4631-a559-3272535f5b3a None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:56.688241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea313112-e639-4631-a559-3272535f5b3a None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:56.688994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea313112-e639-4631-a559-3272535f5b3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:56.690471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea313112-e639-4631-a559-3272535f5b3a None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:56.696382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54a949-3f5d-4532-8c27-3b9b68bfedad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:56.697106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54a949-3f5d-4532-8c27-3b9b68bfedad None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:56.697388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54a949-3f5d-4532-8c27-3b9b68bfedad None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:56.697661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54a949-3f5d-4532-8c27-3b9b68bfedad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:56.713596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54a949-3f5d-4532-8c27-3b9b68bfedad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:56.716246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54a949-3f5d-4532-8c27-3b9b68bfedad None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:56.734138 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-7d54a949-3f5d-4532-8c27-3b9b68bfedad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:57:56.734138 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:56.734138 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:56.734138 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:56.734138 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:56.734138 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:56.734138 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:56.734138 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:56.734138 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:56.734138 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:56.734138 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:56.734138 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:56.734138 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:57:56.734138 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:57:56.734138 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:57:56.735031 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:57:56.735031 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:56.735031 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:56.735031 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:56.735031 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:56.735031 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:56.735031 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:56.735031 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:56.735031 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:56.735031 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:56.735031 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:56.735031 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:56.735031 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:56.735031 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:56.735031 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:56.735031 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:56.735031 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:56.735868 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:57:56.735868 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:57:56.735868 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:57:56.735868 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:56.735868 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 237/472] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:57:56.741173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54a949-3f5d-4532-8c27-3b9b68bfedad None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:56.797207 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 236/473] 10.222.0.16 () {60 vars in 1132 bytes} [Mon May 2 09:57:56 2022] POST /identity/v3/users => generated 248 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:57:56.798569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a12273-629b-4059-abe0-f72dd64f3fec None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:56.798905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a12273-629b-4059-abe0-f72dd64f3fec None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:56.799187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a12273-629b-4059-abe0-f72dd64f3fec None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:56.800787 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 237/474] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:56.808528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdc135-e12e-40ee-ba07-3ee34182e37e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:56.808932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdc135-e12e-40ee-ba07-3ee34182e37e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:56.809216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdc135-e12e-40ee-ba07-3ee34182e37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:56.830630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6cfdc135-e12e-40ee-ba07-3ee34182e37e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:56.832422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6cfdc135-e12e-40ee-ba07-3ee34182e37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:56.858081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54a949-3f5d-4532-8c27-3b9b68bfedad None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:56.894054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2058c9f-66f4-4617-b3e0-586a1d45fdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:56.895048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2058c9f-66f4-4617-b3e0-586a1d45fdc6 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:56.895557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2058c9f-66f4-4617-b3e0-586a1d45fdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:56.896073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2058c9f-66f4-4617-b3e0-586a1d45fdc6 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:56.897099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2058c9f-66f4-4617-b3e0-586a1d45fdc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:56.897657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2058c9f-66f4-4617-b3e0-586a1d45fdc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:56.899392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2058c9f-66f4-4617-b3e0-586a1d45fdc6 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:56.912741 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 238/475] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:56.919302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2058c9f-66f4-4617-b3e0-586a1d45fdc6 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:56.928750 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 238/476] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:56.970787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdc135-e12e-40ee-ba07-3ee34182e37e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:57.036705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2058c9f-66f4-4617-b3e0-586a1d45fdc6 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:57.079978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d386a-2fbb-49a3-8daa-a80faf82b987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:57.080694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d386a-2fbb-49a3-8daa-a80faf82b987 None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:57.080987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d386a-2fbb-49a3-8daa-a80faf82b987 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:57.081272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d386a-2fbb-49a3-8daa-a80faf82b987 None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:57.082011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d386a-2fbb-49a3-8daa-a80faf82b987 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:57.083465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d386a-2fbb-49a3-8daa-a80faf82b987 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:57.159022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdc135-e12e-40ee-ba07-3ee34182e37e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:57.196733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42aa8e5-ec7f-4587-aa54-0c0073afe038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:57.196733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42aa8e5-ec7f-4587-aa54-0c0073afe038 None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:57.196733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42aa8e5-ec7f-4587-aa54-0c0073afe038 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:57.196733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42aa8e5-ec7f-4587-aa54-0c0073afe038 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:57.197129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42aa8e5-ec7f-4587-aa54-0c0073afe038 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:57.198426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42aa8e5-ec7f-4587-aa54-0c0073afe038 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:57.200513 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 239/477] 10.222.0.16 () {60 vars in 1132 bytes} [Mon May 2 09:57:56 2022] POST /identity/v3/users => generated 249 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 09:57:57.273546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.sql.core [None req-b42aa8e5-ec7f-4587-aa54-0c0073afe038 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 02 09:57:57.273546 ncdv-master-1 devstack@keystone.service[91119]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 02 09:57:57.273546 ncdv-master-1 devstack@keystone.service[91119]: [parameters: {'id': '935b49c92140403c96425c2ccdc7f043', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 02 09:57:57.273546 ncdv-master-1 devstack@keystone.service[91119]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91119) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 02 09:57:57.295872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-b42aa8e5-ec7f-4587-aa54-0c0073afe038 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 02 09:57:57.295872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:57.295872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 02 09:57:57.295872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.dialect.do_execute( May 02 09:57:57.295872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 02 09:57:57.295872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 02 09:57:57.295872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 02 09:57:57.295872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application result = self._query(query) May 02 09:57:57.295872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 02 09:57:57.295872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application conn.query(q) May 02 09:57:57.295872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 02 09:57:57.295872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 02 09:57:57.295872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 02 09:57:57.295872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application result.read() May 02 09:57:57.295872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 02 09:57:57.296923 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 02 09:57:57.296923 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 02 09:57:57.296923 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application packet.raise_for_error() May 02 09:57:57.296923 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 02 09:57:57.296923 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 02 09:57:57.296923 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 02 09:57:57.296923 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 02 09:57:57.296923 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 02 09:57:57.296923 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:57.296923 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 02 09:57:57.296923 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:57.296923 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:57.296923 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 02 09:57:57.296923 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 02 09:57:57.296923 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 02 09:57:57.296923 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return ref.to_dict() May 02 09:57:57.296923 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 02 09:57:57.296923 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application next(self.gen) May 02 09:57:57.297846 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 02 09:57:57.297846 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application yield resource May 02 09:57:57.297846 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 02 09:57:57.297846 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application next(self.gen) May 02 09:57:57.297846 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 02 09:57:57.297846 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.session.rollback() May 02 09:57:57.297846 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 02 09:57:57.297846 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.force_reraise() May 02 09:57:57.297846 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 02 09:57:57.297846 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise self.value May 02 09:57:57.297846 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 02 09:57:57.297846 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 02 09:57:57.297846 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 02 09:57:57.297846 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application session.commit() May 02 09:57:57.297846 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 02 09:57:57.297846 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 02 09:57:57.297846 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 02 09:57:57.298725 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._prepare_impl() May 02 09:57:57.298725 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 02 09:57:57.298725 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.session.flush() May 02 09:57:57.298725 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 02 09:57:57.298725 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._flush(objects) May 02 09:57:57.298725 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 02 09:57:57.298725 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 02 09:57:57.298725 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 02 09:57:57.298725 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application compat.raise_( May 02 09:57:57.298725 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 02 09:57:57.298725 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception May 02 09:57:57.298725 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 02 09:57:57.298725 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application flush_context.execute() May 02 09:57:57.298725 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 02 09:57:57.298725 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rec.execute(self) May 02 09:57:57.298725 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 02 09:57:57.298725 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 02 09:57:57.299600 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 02 09:57:57.299600 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application _emit_insert_statements( May 02 09:57:57.299600 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 02 09:57:57.299600 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application c = connection._execute_20( May 02 09:57:57.299600 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 02 09:57:57.299600 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 02 09:57:57.299600 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 02 09:57:57.299600 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 02 09:57:57.299600 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 02 09:57:57.299600 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ret = self._execute_context( May 02 09:57:57.299600 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 02 09:57:57.299600 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 02 09:57:57.299600 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 02 09:57:57.299600 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 02 09:57:57.299600 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 02 09:57:57.299600 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception May 02 09:57:57.300398 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 02 09:57:57.300398 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.dialect.do_execute( May 02 09:57:57.300398 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 02 09:57:57.300398 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 02 09:57:57.300398 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 02 09:57:57.300398 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application result = self._query(query) May 02 09:57:57.300398 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 02 09:57:57.300398 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application conn.query(q) May 02 09:57:57.300398 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 02 09:57:57.300398 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 02 09:57:57.300398 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 02 09:57:57.300398 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application result.read() May 02 09:57:57.300398 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 02 09:57:57.300398 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 02 09:57:57.300398 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 02 09:57:57.300398 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application packet.raise_for_error() May 02 09:57:57.303081 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 02 09:57:57.303081 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 02 09:57:57.303081 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 02 09:57:57.303081 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 02 09:57:57.303081 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 02 09:57:57.303081 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 02 09:57:57.303081 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [parameters: {'id': '935b49c92140403c96425c2ccdc7f043', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 02 09:57:57.303081 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 02 09:57:57.303081 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:57.303081 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:57:57.303081 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:57.303081 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:57.303081 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:57.303081 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:57.303081 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:57.303081 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:57.305216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:57.305216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:57.305216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:57.305216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:57.305216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:57.305216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:57.305216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 02 09:57:57.305216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 02 09:57:57.305216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:57.305216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:57.305216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 02 09:57:57.305216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 02 09:57:57.305216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 02 09:57:57.305216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 02 09:57:57.305216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 02 09:57:57.305216 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:57.309304 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 239/478] 10.222.0.16 () {60 vars in 1131 bytes} [Mon May 2 09:57:56 2022] POST /identity/v3/roles => generated 144 bytes in 339 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:57.317864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d386a-2fbb-49a3-8daa-a80faf82b987 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:57.459876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d386a-2fbb-49a3-8daa-a80faf82b987 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:57.494516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9923b59-1858-470f-98c8-7abbeefc0b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:57.495327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9923b59-1858-470f-98c8-7abbeefc0b08 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:57.495611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9923b59-1858-470f-98c8-7abbeefc0b08 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:57.495886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9923b59-1858-470f-98c8-7abbeefc0b08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:57.507649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9923b59-1858-470f-98c8-7abbeefc0b08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:57.516523 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-d9923b59-1858-470f-98c8-7abbeefc0b08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:57.516523 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:57.516523 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:57.516523 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:57.516523 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:57.516523 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:57.516523 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:57.516523 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:57.516523 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:57.516523 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:57.516523 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:57.516523 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:57.516523 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:57.516523 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:57.516523 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:57.516523 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:57.520959 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:57.520959 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:57.520959 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:57.520959 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:57.520959 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:57.520959 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:57.520959 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:57.520959 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:57.520959 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:57.520959 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:57.520959 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:57.520959 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:57.520959 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:57.520959 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:57.520959 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:57.520959 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:57.521797 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:57.521797 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:57.521797 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:57.521797 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:57.521797 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:57.521797 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:57.521797 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:57.521797 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:57.521797 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:57.521797 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:57.521797 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 02 09:57:57.521797 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:57.521797 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 240/479] 10.222.0.16 () {56 vars in 1114 bytes} [Mon May 2 09:57:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:57.524186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42aa8e5-ec7f-4587-aa54-0c0073afe038 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:57.687197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42aa8e5-ec7f-4587-aa54-0c0073afe038 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:57.720942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7ebb0-e980-4622-9f0a-d05c92c33e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:57.721621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7ebb0-e980-4622-9f0a-d05c92c33e5f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:57.721907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7ebb0-e980-4622-9f0a-d05c92c33e5f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:57.722187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7ebb0-e980-4622-9f0a-d05c92c33e5f None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:57.722941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7ebb0-e980-4622-9f0a-d05c92c33e5f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:57.723250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7ebb0-e980-4622-9f0a-d05c92c33e5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:57.724644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b7ebb0-e980-4622-9f0a-d05c92c33e5f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:57.732978 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 240/480] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:57:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:59.173933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62096c3-e8c0-4e3e-a171-254ecf3b1d15 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:59.174489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62096c3-e8c0-4e3e-a171-254ecf3b1d15 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:59.174489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62096c3-e8c0-4e3e-a171-254ecf3b1d15 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:59.176213 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 241/481] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:59.187226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebaad2-d48b-4e6c-a4c8-7caf1215a10e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:59.187737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebaad2-d48b-4e6c-a4c8-7caf1215a10e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:59.187811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebaad2-d48b-4e6c-a4c8-7caf1215a10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:59.209704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-bbebaad2-d48b-4e6c-a4c8-7caf1215a10e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:59.211422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bbebaad2-d48b-4e6c-a4c8-7caf1215a10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:59.295852 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 241/482] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:57:59.347465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62096c3-e8c0-4e3e-a171-254ecf3b1d15 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:59.354182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f846af-ae04-4a69-a982-aecf44957b63 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:59.354443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f846af-ae04-4a69-a982-aecf44957b63 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:59.354680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f846af-ae04-4a69-a982-aecf44957b63 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:59.356319 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 242/483] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:57:59.365985 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ada8a-5b79-42a4-9e02-21cf71098e10 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:59.366275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ada8a-5b79-42a4-9e02-21cf71098e10 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:59.366564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ada8a-5b79-42a4-9e02-21cf71098e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:59.388910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-db1ada8a-5b79-42a4-9e02-21cf71098e10 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:59.390116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-db1ada8a-5b79-42a4-9e02-21cf71098e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:59.458553 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 243/484] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:57:59.502840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ada8a-5b79-42a4-9e02-21cf71098e10 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:59.526997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62096c3-e8c0-4e3e-a171-254ecf3b1d15 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:59.618682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ada8a-5b79-42a4-9e02-21cf71098e10 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:59.623003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde1822-ecd1-4aec-9ef7-b032f856eb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:59.624050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde1822-ecd1-4aec-9ef7-b032f856eb65 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:59.624429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde1822-ecd1-4aec-9ef7-b032f856eb65 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:59.624850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde1822-ecd1-4aec-9ef7-b032f856eb65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:59.651654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde1822-ecd1-4aec-9ef7-b032f856eb65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:59.654328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557fc9f-69ce-4136-8b1e-a2af67dc6846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:59.655142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557fc9f-69ce-4136-8b1e-a2af67dc6846 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:59.655429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557fc9f-69ce-4136-8b1e-a2af67dc6846 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:59.655709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557fc9f-69ce-4136-8b1e-a2af67dc6846 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:59.659434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-2fde1822-ecd1-4aec-9ef7-b032f856eb65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 09:57:59.659434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:59.659434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:59.659434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:59.659434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:59.659434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:59.659434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:59.659434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:59.659434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:59.659434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:59.659434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:59.659434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:59.659434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:59.659434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:59.659434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:59.659434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:59.660374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:59.660374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:59.660374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:59.660374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:59.660374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:59.660374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:59.660374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:59.660374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:59.660374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:59.660374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:59.660374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:59.660374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:57:59.660374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:59.660374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:59.660374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:59.660374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:59.661204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:59.661204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:59.661204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:59.661204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:59.661204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:59.661204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:59.661204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:59.661204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:59.661204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:59.661204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:59.661204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 09:57:59.661204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:57:59.666722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557fc9f-69ce-4136-8b1e-a2af67dc6846 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:57:59.670344 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 242/485] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 09:57:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:57:59.674614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-6557fc9f-69ce-4136-8b1e-a2af67dc6846 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 09:57:59.674614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:57:59.674614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:57:59.674614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:57:59.674614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:57:59.674614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:57:59.674614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:57:59.674614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:57:59.674614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:57:59.674614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:57:59.674614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:57:59.674614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:57:59.674614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:57:59.674614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:57:59.674614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:57:59.674614 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:57:59.676886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:57:59.676886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:57:59.676886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:57:59.676886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:57:59.676886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:57:59.676886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:57:59.676886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:57:59.676886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:57:59.676886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:57:59.676886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:57:59.676886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:57:59.676886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:57:59.676886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:57:59.676886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:57:59.676886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:57:59.676886 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:57:59.678935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:57:59.678935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:57:59.678935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:57:59.678935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:57:59.678935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:57:59.678935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:57:59.678935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:57:59.678935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:57:59.678935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:57:59.678935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:57:59.678935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 09:57:59.678935 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:57:59.678935 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 244/486] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 09:57:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:57:59.681213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde1822-ecd1-4aec-9ef7-b032f856eb65 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:59.686618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557fc9f-69ce-4136-8b1e-a2af67dc6846 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:59.799811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557fc9f-69ce-4136-8b1e-a2af67dc6846 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:59.836676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45855761-e682-4259-b5e7-19646d412567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:59.837785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45855761-e682-4259-b5e7-19646d412567 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:59.838086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45855761-e682-4259-b5e7-19646d412567 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:59.838372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45855761-e682-4259-b5e7-19646d412567 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:59.839130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45855761-e682-4259-b5e7-19646d412567 None admin] RBAC: Adding query filter params (name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:59.839445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45855761-e682-4259-b5e7-19646d412567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:59.840866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45855761-e682-4259-b5e7-19646d412567 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:59.850341 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 245/487] 10.222.0.16 () {56 vars in 1103 bytes} [Mon May 2 09:57:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:57:59.853156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570377b-d77c-40e5-9e46-a7a28977aaa8 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:59.853849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570377b-d77c-40e5-9e46-a7a28977aaa8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:59.854136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570377b-d77c-40e5-9e46-a7a28977aaa8 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:59.856076 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 246/488] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:57:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:57:59.860490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570377b-d77c-40e5-9e46-a7a28977aaa8 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:57:59.875138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde1822-ecd1-4aec-9ef7-b032f856eb65 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:57:59.907619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c96a0-11ce-4e9d-9efb-d5f66b5644ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:57:59.908330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c96a0-11ce-4e9d-9efb-d5f66b5644ca None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:59.908635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c96a0-11ce-4e9d-9efb-d5f66b5644ca None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:59.908921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c96a0-11ce-4e9d-9efb-d5f66b5644ca None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:59.909672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c96a0-11ce-4e9d-9efb-d5f66b5644ca None admin] RBAC: Adding query filter params (name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:57:59.910034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c96a0-11ce-4e9d-9efb-d5f66b5644ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:57:59.911428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c96a0-11ce-4e9d-9efb-d5f66b5644ca None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:57:59.920317 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 243/489] 10.222.0.16 () {56 vars in 1103 bytes} [Mon May 2 09:57:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:57:59.921495 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7426d16-c85f-4e2b-8381-f6bddb81e284 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:57:59.921783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7426d16-c85f-4e2b-8381-f6bddb81e284 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:57:59.922063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7426d16-c85f-4e2b-8381-f6bddb81e284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:57:59.946263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b7426d16-c85f-4e2b-8381-f6bddb81e284 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:57:59.947921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b7426d16-c85f-4e2b-8381-f6bddb81e284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:57:59.993594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570377b-d77c-40e5-9e46-a7a28977aaa8 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:00.027731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ddfa4-1aa3-40a5-bb5f-82fcbbdfbc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:00.028892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ddfa4-1aa3-40a5-bb5f-82fcbbdfbc7a None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:00.029379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ddfa4-1aa3-40a5-bb5f-82fcbbdfbc7a None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:00.029829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ddfa4-1aa3-40a5-bb5f-82fcbbdfbc7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:00.032287 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 244/490] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:58:00.033594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7426d16-c85f-4e2b-8381-f6bddb81e284 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:00.050682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ddfa4-1aa3-40a5-bb5f-82fcbbdfbc7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:00.052491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ddfa4-1aa3-40a5-bb5f-82fcbbdfbc7a None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:00.079215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-1f2ddfa4-1aa3-40a5-bb5f-82fcbbdfbc7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:00.079215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:00.079215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:00.079215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:00.079215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:00.079215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:00.079215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:00.079215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:00.079215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:00.079215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:00.079215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:00.079215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:00.079215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:00.079215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:00.079215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:00.080105 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:00.080105 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:00.080105 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:00.080105 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:00.080105 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:00.080105 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:00.080105 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:00.080105 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:00.080105 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:00.080105 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:00.080105 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:00.080105 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:00.080105 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:00.080105 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:00.080105 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:00.080105 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:00.080105 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:00.080969 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:00.080969 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:00.080969 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:00.080969 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:00.087682 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 247/491] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:57:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:00.088800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ddfa4-1aa3-40a5-bb5f-82fcbbdfbc7a None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:00.146224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7426d16-c85f-4e2b-8381-f6bddb81e284 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:00.185328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d609d-c1e8-447b-b7fb-fa650bbb1167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:00.186846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d609d-c1e8-447b-b7fb-fa650bbb1167 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:00.187333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d609d-c1e8-447b-b7fb-fa650bbb1167 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:00.187814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d609d-c1e8-447b-b7fb-fa650bbb1167 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:00.188903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ddfa4-1aa3-40a5-bb5f-82fcbbdfbc7a None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:00.198739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d609d-c1e8-447b-b7fb-fa650bbb1167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:00.200198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d609d-c1e8-447b-b7fb-fa650bbb1167 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:00.218551 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-1d9d609d-c1e8-447b-b7fb-fa650bbb1167 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:00.218551 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:00.218551 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:00.218551 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:00.218551 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:00.218551 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:00.218551 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:00.218551 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:00.218551 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:00.218551 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:00.218551 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:00.218551 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:00.218551 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:00.218551 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:00.218551 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:00.222382 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:00.222382 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:00.222382 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:00.222382 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:00.222382 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:00.222382 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:00.222382 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:00.222382 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:00.222382 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:00.222382 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:00.222382 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:00.222382 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:00.222382 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:00.222382 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:00.222382 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:00.222382 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:00.222382 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:00.223263 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:00.223263 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:00.223263 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:00.223263 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:00.223263 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 245/492] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:00.223263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d609d-c1e8-447b-b7fb-fa650bbb1167 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:00.226067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1e7a3-7902-4f93-a59d-e2a22cb78023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:00.227412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1e7a3-7902-4f93-a59d-e2a22cb78023 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:00.227727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1e7a3-7902-4f93-a59d-e2a22cb78023 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:00.227973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1e7a3-7902-4f93-a59d-e2a22cb78023 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:00.238370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1e7a3-7902-4f93-a59d-e2a22cb78023 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:00.246038 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-1ed1e7a3-7902-4f93-a59d-e2a22cb78023 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:00.246038 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:00.246038 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:00.246038 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:00.246038 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:00.246038 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:00.246038 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:00.246038 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:00.246038 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:00.246038 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:00.246038 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:00.246038 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:00.246038 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:00.246038 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:00.246038 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:00.246038 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:00.246912 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:00.246912 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:00.246912 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:00.246912 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:00.246912 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:00.246912 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:00.246912 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:00.246912 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:00.246912 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:00.246912 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:00.246912 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:00.246912 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:00.246912 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:00.246912 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:00.246912 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:00.246912 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:00.247701 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:00.247701 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:00.247701 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:00.247701 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:00.247701 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:00.247701 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:00.247701 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:00.247701 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:00.247701 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:00.247701 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:00.247701 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:00.247701 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:00.247701 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 248/493] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 09:58:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:00.248714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bd079-e9a1-4b32-a398-e93c52eab9eb None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:00.248714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bd079-e9a1-4b32-a398-e93c52eab9eb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:00.249003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bd079-e9a1-4b32-a398-e93c52eab9eb None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:00.250238 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 249/494] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:00.250963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bd079-e9a1-4b32-a398-e93c52eab9eb None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:00.338942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d609d-c1e8-447b-b7fb-fa650bbb1167 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:00.351540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bd079-e9a1-4b32-a398-e93c52eab9eb None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:00.371365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f374aab-d135-40af-8034-a4fa85ee244e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:00.372021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f374aab-d135-40af-8034-a4fa85ee244e None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:00.372302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f374aab-d135-40af-8034-a4fa85ee244e None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:00.372576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f374aab-d135-40af-8034-a4fa85ee244e None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:00.373332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f374aab-d135-40af-8034-a4fa85ee244e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:00.373641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f374aab-d135-40af-8034-a4fa85ee244e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:00.374983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f374aab-d135-40af-8034-a4fa85ee244e None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:00.384271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32ace3-19c8-4114-aaf9-44cf26a45ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:00.384979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32ace3-19c8-4114-aaf9-44cf26a45ba6 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:00.385269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32ace3-19c8-4114-aaf9-44cf26a45ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:00.385552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32ace3-19c8-4114-aaf9-44cf26a45ba6 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:00.386272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32ace3-19c8-4114-aaf9-44cf26a45ba6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:00.386584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32ace3-19c8-4114-aaf9-44cf26a45ba6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:00.391389 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 246/495] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:00.391389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f374aab-d135-40af-8034-a4fa85ee244e None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:00.391589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32ace3-19c8-4114-aaf9-44cf26a45ba6 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:00.404783 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 250/496] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:00.404783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f4b11-0670-4662-abcc-e02a81bb0314 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:00.404783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f4b11-0670-4662-abcc-e02a81bb0314 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:00.404783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f4b11-0670-4662-abcc-e02a81bb0314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:00.417833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-580f4b11-0670-4662-abcc-e02a81bb0314 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:00.419030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-580f4b11-0670-4662-abcc-e02a81bb0314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:00.482754 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 251/497] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:58:00.483602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f4b11-0670-4662-abcc-e02a81bb0314 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:00.505501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f374aab-d135-40af-8034-a4fa85ee244e None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:00.541549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e96921-4b57-4cc6-b350-5148f0038a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:00.542287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e96921-4b57-4cc6-b350-5148f0038a7c None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:00.542573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e96921-4b57-4cc6-b350-5148f0038a7c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:00.542848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e96921-4b57-4cc6-b350-5148f0038a7c None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:00.543590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e96921-4b57-4cc6-b350-5148f0038a7c None admin] RBAC: Adding query filter params (name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:00.543897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e96921-4b57-4cc6-b350-5148f0038a7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:00.545280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e96921-4b57-4cc6-b350-5148f0038a7c None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:00.557833 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 247/498] 10.222.0.16 () {56 vars in 1103 bytes} [Mon May 2 09:58:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:00.557833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e96921-4b57-4cc6-b350-5148f0038a7c None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:00.587563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f4b11-0670-4662-abcc-e02a81bb0314 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:00.619594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93750c9-5c6c-4946-9e3c-d9332eefcb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:00.620440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93750c9-5c6c-4946-9e3c-d9332eefcb56 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:00.620768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93750c9-5c6c-4946-9e3c-d9332eefcb56 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:00.621093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93750c9-5c6c-4946-9e3c-d9332eefcb56 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:00.628069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93750c9-5c6c-4946-9e3c-d9332eefcb56 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:00.629580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93750c9-5c6c-4946-9e3c-d9332eefcb56 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:00.645420 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-b93750c9-5c6c-4946-9e3c-d9332eefcb56 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 02 09:58:00.645420 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:00.645420 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:00.645420 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:00.645420 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:00.645420 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:00.645420 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:00.645420 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:00.645420 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:00.645420 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:00.645420 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:00.645420 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:00.645420 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:00.645420 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:00.645420 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:00.645420 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:00.646304 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:00.646304 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:00.646304 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:00.646304 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:00.646304 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:00.646304 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:00.646304 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:00.646304 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:00.646304 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:00.646304 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:00.646304 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:00.646304 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:00.646304 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:00.646304 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:00.646304 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:00.646304 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:00.646304 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:00.646304 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:00.652754 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:00.652754 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:00.652754 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:00.652754 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:00.652754 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:00.652754 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:00.652754 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:00.652754 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:00.652754 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 02 09:58:00.652754 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:00.652754 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 252/499] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:58:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:00.652754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93750c9-5c6c-4946-9e3c-d9332eefcb56 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:00.657449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e96921-4b57-4cc6-b350-5148f0038a7c None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:00.693368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fb912-ea71-4741-b6e5-f6e3fe51935f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:00.694178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fb912-ea71-4741-b6e5-f6e3fe51935f None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:00.694460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fb912-ea71-4741-b6e5-f6e3fe51935f None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:00.694743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fb912-ea71-4741-b6e5-f6e3fe51935f None admin] PATH_INFO: `/v3/users/nova` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:00.703253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fb912-ea71-4741-b6e5-f6e3fe51935f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:00.704727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fb912-ea71-4741-b6e5-f6e3fe51935f None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:00.719717 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-f88fb912-ea71-4741-b6e5-f6e3fe51935f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 02 09:58:00.719717 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:00.719717 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:00.719717 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:00.719717 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:00.719717 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:00.719717 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:00.719717 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:00.719717 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:00.719717 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:00.719717 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:00.719717 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:00.719717 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:00.719717 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:00.719717 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:00.719717 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:00.720683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:00.720683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:00.720683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:00.720683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:00.720683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:00.720683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:00.720683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:00.720683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:00.720683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:00.720683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:00.720683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:00.720683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:00.720683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:00.720683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:00.720683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:00.720683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:00.720683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:00.720683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:00.721573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:00.721573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:00.721573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:00.721573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:00.721573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:00.721573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:00.721573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:00.721573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:00.721573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 02 09:58:00.721573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:00.721573 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 248/500] 10.222.0.16 () {56 vars in 1093 bytes} [Mon May 2 09:58:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:00.726130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fb912-ea71-4741-b6e5-f6e3fe51935f None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:00.749047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93750c9-5c6c-4946-9e3c-d9332eefcb56 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:00.786289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fdb60-4d25-461d-bbcc-f3cff3a84cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:00.787084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fdb60-4d25-461d-bbcc-f3cff3a84cfe None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:00.787369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fdb60-4d25-461d-bbcc-f3cff3a84cfe None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:00.787651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fdb60-4d25-461d-bbcc-f3cff3a84cfe None admin] PATH_INFO: `/v3/roles/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:00.798057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fdb60-4d25-461d-bbcc-f3cff3a84cfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:00.806569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-3d5fdb60-4d25-461d-bbcc-f3cff3a84cfe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:00.806569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:00.806569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:00.806569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:00.806569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:00.806569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:00.806569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:00.806569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:00.806569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:00.806569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:00.806569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:00.806569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:00.806569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:00.806569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:00.806569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:00.806569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:00.807460 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:00.807460 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:00.807460 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:00.807460 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:00.807460 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:00.807460 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:00.807460 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:00.807460 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:00.807460 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:00.807460 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:00.807460 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:00.807460 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:00.807460 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:00.807460 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:00.807460 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:00.807460 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:00.808267 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:00.808267 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:00.808267 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:00.808267 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:00.808267 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:00.808267 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:00.808267 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:00.808267 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:00.808267 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:00.808267 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:00.808267 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:00.808267 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:00.810482 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 253/501] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 09:58:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:00.811403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fdb60-4d25-461d-bbcc-f3cff3a84cfe None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:00.828623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fb912-ea71-4741-b6e5-f6e3fe51935f None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:00.866062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449dcab-e506-4014-8f16-7c67afd05c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:00.866852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449dcab-e506-4014-8f16-7c67afd05c49 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:00.867139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449dcab-e506-4014-8f16-7c67afd05c49 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:00.867942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449dcab-e506-4014-8f16-7c67afd05c49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:00.878038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449dcab-e506-4014-8f16-7c67afd05c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:00.879486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449dcab-e506-4014-8f16-7c67afd05c49 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:00.896252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-6449dcab-e506-4014-8f16-7c67afd05c49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:00.896252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:00.896252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:00.896252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:00.896252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:00.896252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:00.896252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:00.896252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:00.896252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:00.896252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:00.896252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:00.896252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:00.896252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:00.896252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:00.896252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:00.897133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:00.897133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:00.897133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:00.897133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:00.897133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:00.897133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:00.897133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:00.897133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:00.897133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:00.897133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:00.897133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:00.897133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:00.897133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:00.897133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:00.897133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:00.897133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:00.897133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:00.897996 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:00.897996 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:00.897996 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:00.897996 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:00.897996 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 249/502] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:00.898360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449dcab-e506-4014-8f16-7c67afd05c49 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:00.910667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fdb60-4d25-461d-bbcc-f3cff3a84cfe None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:00.942489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5697a4-f1eb-412c-9013-fef08ccbc99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:00.943157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5697a4-f1eb-412c-9013-fef08ccbc99e None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:00.943444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5697a4-f1eb-412c-9013-fef08ccbc99e None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:00.943727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5697a4-f1eb-412c-9013-fef08ccbc99e None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:00.944562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5697a4-f1eb-412c-9013-fef08ccbc99e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:00.944912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5697a4-f1eb-412c-9013-fef08ccbc99e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:00.946996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5697a4-f1eb-412c-9013-fef08ccbc99e None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:00.982680 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 254/503] 10.222.0.16 () {56 vars in 1137 bytes} [Mon May 2 09:58:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:00.983517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5697a4-f1eb-412c-9013-fef08ccbc99e None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:00.994347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449dcab-e506-4014-8f16-7c67afd05c49 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:01.027119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb25cb1-c717-4c1f-af7b-83a0fa9f2e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:01.027775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb25cb1-c717-4c1f-af7b-83a0fa9f2e40 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:01.028055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb25cb1-c717-4c1f-af7b-83a0fa9f2e40 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:01.028328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb25cb1-c717-4c1f-af7b-83a0fa9f2e40 None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:01.029191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb25cb1-c717-4c1f-af7b-83a0fa9f2e40 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:01.029500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb25cb1-c717-4c1f-af7b-83a0fa9f2e40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:01.030913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb25cb1-c717-4c1f-af7b-83a0fa9f2e40 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:01.066283 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 250/504] 10.222.0.16 () {56 vars in 1133 bytes} [Mon May 2 09:58:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:01.067491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375540c-4152-47af-9da3-21268dd2ed6d None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:01.067791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375540c-4152-47af-9da3-21268dd2ed6d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:01.068067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375540c-4152-47af-9da3-21268dd2ed6d None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:01.069444 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 251/505] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:01.071599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375540c-4152-47af-9da3-21268dd2ed6d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:01.077983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5697a4-f1eb-412c-9013-fef08ccbc99e None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:01.112381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dfbfec-76a3-4a49-b272-780ebfa22f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:01.113420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfbfec-76a3-4a49-b272-780ebfa22f9f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:01.113707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfbfec-76a3-4a49-b272-780ebfa22f9f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:01.113984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfbfec-76a3-4a49-b272-780ebfa22f9f None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:01.114730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dfbfec-76a3-4a49-b272-780ebfa22f9f None admin] RBAC: Adding query filter params (name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:01.115037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dfbfec-76a3-4a49-b272-780ebfa22f9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:01.116445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dfbfec-76a3-4a49-b272-780ebfa22f9f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:01.124759 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 255/506] 10.222.0.16 () {56 vars in 1103 bytes} [Mon May 2 09:58:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:01.125537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dfbfec-76a3-4a49-b272-780ebfa22f9f None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:01.166472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375540c-4152-47af-9da3-21268dd2ed6d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:01.197907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7ee49-99e1-4dd5-a752-78a7127216e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:01.198571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7ee49-99e1-4dd5-a752-78a7127216e7 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:01.198857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7ee49-99e1-4dd5-a752-78a7127216e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:01.199139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7ee49-99e1-4dd5-a752-78a7127216e7 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:01.199872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7ee49-99e1-4dd5-a752-78a7127216e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:01.200185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7ee49-99e1-4dd5-a752-78a7127216e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:01.201599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7ee49-99e1-4dd5-a752-78a7127216e7 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:01.212398 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 252/507] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:01.213268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7ee49-99e1-4dd5-a752-78a7127216e7 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:01.218316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dfbfec-76a3-4a49-b272-780ebfa22f9f None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:01.250728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066ec58-b7bd-4e84-9e9f-7b442df33946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:01.251370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066ec58-b7bd-4e84-9e9f-7b442df33946 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:01.251657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066ec58-b7bd-4e84-9e9f-7b442df33946 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:01.251937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066ec58-b7bd-4e84-9e9f-7b442df33946 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:01.305803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7ee49-99e1-4dd5-a752-78a7127216e7 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:01.314593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066ec58-b7bd-4e84-9e9f-7b442df33946 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:01.316053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066ec58-b7bd-4e84-9e9f-7b442df33946 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:01.336514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5a5da-37fe-4a41-aacb-f488fadb688f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:01.337188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5a5da-37fe-4a41-aacb-f488fadb688f None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:01.337468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5a5da-37fe-4a41-aacb-f488fadb688f None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:01.337745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5a5da-37fe-4a41-aacb-f488fadb688f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:01.400693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5a5da-37fe-4a41-aacb-f488fadb688f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:01.402144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5a5da-37fe-4a41-aacb-f488fadb688f None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:01.407984 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 256/508] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:58:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:58:01.409293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc9430-9dd7-4add-8819-77ad3c52ee7e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:01.409588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc9430-9dd7-4add-8819-77ad3c52ee7e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:01.409971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc9430-9dd7-4add-8819-77ad3c52ee7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:01.425955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c3cc9430-9dd7-4add-8819-77ad3c52ee7e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:01.427097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c3cc9430-9dd7-4add-8819-77ad3c52ee7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:01.491050 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 257/509] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:58:01.491888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc9430-9dd7-4add-8819-77ad3c52ee7e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:01.498857 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 253/510] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:58:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:58:01.499866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5a5da-37fe-4a41-aacb-f488fadb688f None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:01.590015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc9430-9dd7-4add-8819-77ad3c52ee7e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:01.595649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5a5da-37fe-4a41-aacb-f488fadb688f None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:01.622677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f2ca8-c8e8-4fde-92d0-b8674e47a706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:01.623461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f2ca8-c8e8-4fde-92d0-b8674e47a706 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:01.623741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f2ca8-c8e8-4fde-92d0-b8674e47a706 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:01.624017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f2ca8-c8e8-4fde-92d0-b8674e47a706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:01.627711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d8bee-92b7-45ff-930d-4d9481ec79c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:01.628494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d8bee-92b7-45ff-930d-4d9481ec79c2 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:01.628812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d8bee-92b7-45ff-930d-4d9481ec79c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:01.629093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d8bee-92b7-45ff-930d-4d9481ec79c2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:01.633820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f2ca8-c8e8-4fde-92d0-b8674e47a706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:01.635298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f2ca8-c8e8-4fde-92d0-b8674e47a706 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:01.635826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d8bee-92b7-45ff-930d-4d9481ec79c2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:01.637289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d8bee-92b7-45ff-930d-4d9481ec79c2 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:01.652344 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-c62f2ca8-c8e8-4fde-92d0-b8674e47a706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:01.652344 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:01.652344 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:01.652344 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:01.652344 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:01.652344 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:01.652344 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:01.652344 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:01.652344 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:01.652344 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:01.652344 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:01.652344 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:01.652344 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:01.652344 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:01.652344 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:01.653200 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:01.653200 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:01.653200 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:01.653200 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:01.653200 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:01.653200 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:01.653200 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:01.653200 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:01.653200 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:01.653200 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:01.653200 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:01.653200 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:01.653200 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:01.653200 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:01.653200 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:01.653200 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:01.653200 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:01.654068 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:01.654068 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:01.654068 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:01.654068 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:01.654275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-8e0d8bee-92b7-45ff-930d-4d9481ec79c2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 02 09:58:01.654275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:01.654275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:01.654275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:01.654275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:01.654275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:01.654275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:01.654275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:01.654275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:01.654275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:01.654275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:01.654275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:01.654275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:01.654275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:01.654275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:01.654275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:01.655061 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:01.655061 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:01.655061 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:01.655061 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:01.655061 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:01.655061 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:01.655061 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:01.655061 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:01.655061 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:01.655061 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:01.655061 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:01.655061 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:01.655061 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:01.655061 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:01.655061 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:01.655061 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:01.655061 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:01.655061 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:01.655929 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:01.655929 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:01.655929 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:01.655929 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:01.655929 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:01.655929 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:01.655929 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:01.655929 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:01.655929 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 02 09:58:01.655929 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:01.656453 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 258/511] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:01.656519 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 254/512] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:58:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:01.656581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f2ca8-c8e8-4fde-92d0-b8674e47a706 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:01.656665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d8bee-92b7-45ff-930d-4d9481ec79c2 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:01.748826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d8bee-92b7-45ff-930d-4d9481ec79c2 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:01.752299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f2ca8-c8e8-4fde-92d0-b8674e47a706 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:01.779941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a422107-1dda-40f7-a810-3736fadaf39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:01.780745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a422107-1dda-40f7-a810-3736fadaf39f None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:01.781022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a422107-1dda-40f7-a810-3736fadaf39f None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:01.781290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a422107-1dda-40f7-a810-3736fadaf39f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:01.783299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a52e61-1b95-45d9-89a7-77817e374052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:01.784078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a52e61-1b95-45d9-89a7-77817e374052 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:01.784358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a52e61-1b95-45d9-89a7-77817e374052 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:01.784728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a52e61-1b95-45d9-89a7-77817e374052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:01.791270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a422107-1dda-40f7-a810-3736fadaf39f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:01.792755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a422107-1dda-40f7-a810-3736fadaf39f None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:01.795263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a52e61-1b95-45d9-89a7-77817e374052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:01.796711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a52e61-1b95-45d9-89a7-77817e374052 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:01.810299 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-5a422107-1dda-40f7-a810-3736fadaf39f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:01.810299 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:01.810299 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:01.810299 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:01.810299 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:01.810299 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:01.810299 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:01.810299 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:01.810299 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:01.810299 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:01.810299 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:01.810299 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:01.810299 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:01.810299 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:01.810299 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:01.811152 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:01.811152 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:01.811152 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:01.811152 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:01.811152 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:01.811152 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:01.811152 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:01.811152 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:01.811152 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:01.811152 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:01.811152 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:01.811152 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:01.811152 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:01.811152 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:01.811152 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:01.811152 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:01.811152 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:01.811983 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:01.811983 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:01.811983 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:01.811983 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:01.811983 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 255/513] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:01.812311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a422107-1dda-40f7-a810-3736fadaf39f None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:01.813608 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-51a52e61-1b95-45d9-89a7-77817e374052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:01.813608 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:01.813608 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:01.813608 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:01.813608 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:01.813608 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:01.813608 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:01.813608 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:01.813608 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:01.813608 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:01.813608 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:01.813608 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:01.813608 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:01.813608 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:01.813608 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:01.814390 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:01.814390 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:01.814390 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:01.814390 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:01.814390 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:01.814390 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:01.814390 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:01.814390 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:01.814390 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:01.814390 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:01.814390 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:01.814390 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:01.814390 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:01.814390 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:01.814390 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:01.814390 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:01.814390 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:01.815194 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:01.815194 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:01.815194 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:01.815194 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:01.815194 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 259/514] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:01.815858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a52e61-1b95-45d9-89a7-77817e374052 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:01.907743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a52e61-1b95-45d9-89a7-77817e374052 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:01.907934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a422107-1dda-40f7-a810-3736fadaf39f None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:01.937916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05edb9f-ac79-4a11-a182-0c069adb854d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:01.938556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05edb9f-ac79-4a11-a182-0c069adb854d None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:01.938722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ab7bb-7267-4a3d-b11d-d05dc3f6d881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:01.938827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05edb9f-ac79-4a11-a182-0c069adb854d None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:01.939096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05edb9f-ac79-4a11-a182-0c069adb854d None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:01.939501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ab7bb-7267-4a3d-b11d-d05dc3f6d881 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:01.939790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ab7bb-7267-4a3d-b11d-d05dc3f6d881 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:01.939875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05edb9f-ac79-4a11-a182-0c069adb854d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:01.940072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ab7bb-7267-4a3d-b11d-d05dc3f6d881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:01.940166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05edb9f-ac79-4a11-a182-0c069adb854d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:01.941482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05edb9f-ac79-4a11-a182-0c069adb854d None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:01.950614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ab7bb-7267-4a3d-b11d-d05dc3f6d881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:01.952051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ab7bb-7267-4a3d-b11d-d05dc3f6d881 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:01.953112 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 260/515] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:01.953797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05edb9f-ac79-4a11-a182-0c069adb854d None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:01.969482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-c06ab7bb-7267-4a3d-b11d-d05dc3f6d881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:01.969482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:01.969482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:01.969482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:01.969482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:01.969482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:01.969482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:01.969482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:01.969482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:01.969482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:01.969482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:01.969482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:01.969482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:01.969482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:01.969482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:01.970502 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:01.970502 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:01.970502 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:01.970502 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:01.970502 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:01.970502 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:01.970502 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:01.970502 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:01.970502 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:01.970502 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:01.970502 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:01.970502 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:01.970502 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:01.970502 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:01.970502 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:01.970502 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:01.970502 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:01.971542 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:01.971542 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:01.971542 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:01.971542 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:01.971542 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 256/516] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:01.971542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ab7bb-7267-4a3d-b11d-d05dc3f6d881 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:02.047880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05edb9f-ac79-4a11-a182-0c069adb854d None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:02.066209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ab7bb-7267-4a3d-b11d-d05dc3f6d881 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:02.079689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bcc0c-a8ae-41e0-8b3e-c424d3439ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:02.080355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bcc0c-a8ae-41e0-8b3e-c424d3439ed0 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:02.080672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bcc0c-a8ae-41e0-8b3e-c424d3439ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:02.080956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bcc0c-a8ae-41e0-8b3e-c424d3439ed0 None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:02.081788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bcc0c-a8ae-41e0-8b3e-c424d3439ed0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:02.082103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bcc0c-a8ae-41e0-8b3e-c424d3439ed0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:02.083560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bcc0c-a8ae-41e0-8b3e-c424d3439ed0 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:02.098781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18868fc6-73a2-4e6e-bee0-32c026671ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:02.099598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18868fc6-73a2-4e6e-bee0-32c026671ef8 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:02.099883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18868fc6-73a2-4e6e-bee0-32c026671ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:02.100157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18868fc6-73a2-4e6e-bee0-32c026671ef8 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:02.100458 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 261/517] 10.222.0.16 () {56 vars in 1137 bytes} [Mon May 2 09:58:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:02.100914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18868fc6-73a2-4e6e-bee0-32c026671ef8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:02.101803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18868fc6-73a2-4e6e-bee0-32c026671ef8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:02.101893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bcc0c-a8ae-41e0-8b3e-c424d3439ed0 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:02.102644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18868fc6-73a2-4e6e-bee0-32c026671ef8 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:02.115608 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 257/518] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:02.116419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18868fc6-73a2-4e6e-bee0-32c026671ef8 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:02.199415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bcc0c-a8ae-41e0-8b3e-c424d3439ed0 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:02.239152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18868fc6-73a2-4e6e-bee0-32c026671ef8 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:02.239624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c5194-db12-4765-9050-e01fbba78b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:02.239624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c5194-db12-4765-9050-e01fbba78b90 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:02.239624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c5194-db12-4765-9050-e01fbba78b90 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:02.239624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c5194-db12-4765-9050-e01fbba78b90 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:02.240228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c5194-db12-4765-9050-e01fbba78b90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:02.240228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c5194-db12-4765-9050-e01fbba78b90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:02.240228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c5194-db12-4765-9050-e01fbba78b90 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:02.243902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6a45d-7254-433a-9d48-cd8c42a87d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:02.244722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6a45d-7254-433a-9d48-cd8c42a87d2c None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:02.245008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6a45d-7254-433a-9d48-cd8c42a87d2c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:02.245284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6a45d-7254-433a-9d48-cd8c42a87d2c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:02.247572 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 262/519] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:02.248359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c5194-db12-4765-9050-e01fbba78b90 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:02.252698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6a45d-7254-433a-9d48-cd8c42a87d2c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:02.254129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6a45d-7254-433a-9d48-cd8c42a87d2c None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:02.268981 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-cee6a45d-7254-433a-9d48-cd8c42a87d2c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 02 09:58:02.268981 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:02.268981 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:02.268981 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:02.268981 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:02.268981 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:02.268981 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:02.268981 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:02.268981 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:02.268981 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:02.268981 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:02.268981 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:02.268981 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:02.268981 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:02.268981 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:02.268981 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:02.269965 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:02.269965 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:02.269965 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:02.269965 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:02.269965 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:02.269965 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:02.269965 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:02.269965 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:02.269965 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:02.269965 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:02.269965 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:02.269965 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:02.269965 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:02.269965 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:02.269965 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:02.269965 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:02.269965 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:02.269965 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:02.270862 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:02.270862 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:02.270862 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:02.270862 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:02.270862 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:02.270862 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:02.270862 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:02.270862 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:02.270862 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 02 09:58:02.270862 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:02.270862 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 258/520] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 09:58:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:02.270862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6a45d-7254-433a-9d48-cd8c42a87d2c None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:02.346060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c5194-db12-4765-9050-e01fbba78b90 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:02.367040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6a45d-7254-433a-9d48-cd8c42a87d2c None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:02.377903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15948e5-d8cc-4d5e-a4c2-0b72a1ed0ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:02.378567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15948e5-d8cc-4d5e-a4c2-0b72a1ed0ad4 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:02.378854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15948e5-d8cc-4d5e-a4c2-0b72a1ed0ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:02.379136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15948e5-d8cc-4d5e-a4c2-0b72a1ed0ad4 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:02.379886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15948e5-d8cc-4d5e-a4c2-0b72a1ed0ad4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:02.380197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15948e5-d8cc-4d5e-a4c2-0b72a1ed0ad4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:02.381610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15948e5-d8cc-4d5e-a4c2-0b72a1ed0ad4 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:02.393436 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 263/521] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:02.394220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15948e5-d8cc-4d5e-a4c2-0b72a1ed0ad4 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:02.400296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8158d8a-aae2-4030-8103-f7c60d63d55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:02.400972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8158d8a-aae2-4030-8103-f7c60d63d55c None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:02.401261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8158d8a-aae2-4030-8103-f7c60d63d55c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:02.401541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8158d8a-aae2-4030-8103-f7c60d63d55c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:02.464836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8158d8a-aae2-4030-8103-f7c60d63d55c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:02.466492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8158d8a-aae2-4030-8103-f7c60d63d55c None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:02.485735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15948e5-d8cc-4d5e-a4c2-0b72a1ed0ad4 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:02.519254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7f703-2873-4d7e-9b30-72f992e23556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:02.520045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7f703-2873-4d7e-9b30-72f992e23556 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:02.520330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7f703-2873-4d7e-9b30-72f992e23556 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:02.520694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7f703-2873-4d7e-9b30-72f992e23556 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:02.527242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7f703-2873-4d7e-9b30-72f992e23556 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:02.528723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7f703-2873-4d7e-9b30-72f992e23556 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:02.543315 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-0de7f703-2873-4d7e-9b30-72f992e23556 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:02.543315 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:02.543315 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:02.543315 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:02.543315 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:02.543315 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:02.543315 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:02.543315 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:02.543315 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:02.543315 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:02.543315 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:02.543315 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:02.543315 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:02.543315 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:02.543315 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:02.544163 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:02.544163 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:02.544163 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:02.544163 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:02.544163 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:02.544163 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:02.544163 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:02.544163 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:02.544163 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:02.544163 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:02.544163 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:02.544163 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:02.544163 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:02.544163 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:02.544163 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:02.544163 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:02.544163 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:02.545054 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:02.545054 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:02.545054 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:02.545054 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:02.545054 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:02.545054 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:02.545054 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:02.545054 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:02.545054 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 264/522] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:02.545528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7f703-2873-4d7e-9b30-72f992e23556 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:02.565325 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 259/523] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:58:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:58:02.566087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8158d8a-aae2-4030-8103-f7c60d63d55c None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:02.641240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7f703-2873-4d7e-9b30-72f992e23556 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:02.656063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8158d8a-aae2-4030-8103-f7c60d63d55c None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:02.672304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d2de3-4081-45e8-9448-fac466051ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:02.673125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d2de3-4081-45e8-9448-fac466051ad4 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:02.673414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d2de3-4081-45e8-9448-fac466051ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:02.673698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d2de3-4081-45e8-9448-fac466051ad4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:02.680592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d2de3-4081-45e8-9448-fac466051ad4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:02.682067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d2de3-4081-45e8-9448-fac466051ad4 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:02.687807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c8747-7b3b-4e02-a636-61e0bc93e5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:02.688460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c8747-7b3b-4e02-a636-61e0bc93e5a9 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:02.688773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c8747-7b3b-4e02-a636-61e0bc93e5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:02.689055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c8747-7b3b-4e02-a636-61e0bc93e5a9 None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:02.689877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c8747-7b3b-4e02-a636-61e0bc93e5a9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:02.690188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c8747-7b3b-4e02-a636-61e0bc93e5a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:02.691583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c8747-7b3b-4e02-a636-61e0bc93e5a9 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:02.695801 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-4d6d2de3-4081-45e8-9448-fac466051ad4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:02.695801 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:02.695801 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:02.695801 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:02.695801 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:02.695801 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:02.695801 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:02.695801 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:02.695801 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:02.695801 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:02.695801 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:02.695801 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:02.695801 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:02.695801 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:02.695801 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:02.696623 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:02.696623 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:02.696623 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:02.696623 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:02.696623 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:02.696623 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:02.696623 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:02.696623 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:02.696623 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:02.696623 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:02.696623 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:02.696623 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:02.696623 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:02.696623 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:02.696623 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:02.696623 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:02.696623 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:02.697513 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:02.697513 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:02.697513 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:02.697513 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:02.697513 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:02.697513 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:02.697513 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:02.697513 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:02.697513 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 265/524] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:02.697960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d2de3-4081-45e8-9448-fac466051ad4 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:02.712360 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 260/525] 10.222.0.16 () {56 vars in 1139 bytes} [Mon May 2 09:58:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:02.713150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c8747-7b3b-4e02-a636-61e0bc93e5a9 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:02.789845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d2de3-4081-45e8-9448-fac466051ad4 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:02.807398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c8747-7b3b-4e02-a636-61e0bc93e5a9 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:02.821244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43970954-fa93-4e06-b7b3-84f78d2be565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:02.821893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43970954-fa93-4e06-b7b3-84f78d2be565 None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:02.822174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43970954-fa93-4e06-b7b3-84f78d2be565 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:02.822448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43970954-fa93-4e06-b7b3-84f78d2be565 None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:02.823143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43970954-fa93-4e06-b7b3-84f78d2be565 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:02.824572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43970954-fa93-4e06-b7b3-84f78d2be565 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:02.838901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478f45d-f198-41ec-ac8c-171988798e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:02.839544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478f45d-f198-41ec-ac8c-171988798e3a None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:02.839833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478f45d-f198-41ec-ac8c-171988798e3a None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:02.840117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478f45d-f198-41ec-ac8c-171988798e3a None admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:02.840996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478f45d-f198-41ec-ac8c-171988798e3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:02.847521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478f45d-f198-41ec-ac8c-171988798e3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:02.847521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478f45d-f198-41ec-ac8c-171988798e3a None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:02.861245 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 261/526] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:02.862036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478f45d-f198-41ec-ac8c-171988798e3a None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:02.952261 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 266/527] 10.222.0.16 () {60 vars in 1132 bytes} [Mon May 2 09:58:02 2022] POST /identity/v3/users => generated 247 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:58:02.953046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43970954-fa93-4e06-b7b3-84f78d2be565 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:02.961793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478f45d-f198-41ec-ac8c-171988798e3a None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:02.998910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380d802-396a-4e85-9d2b-5b459106a7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:02.999710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380d802-396a-4e85-9d2b-5b459106a7b7 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:02.999993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380d802-396a-4e85-9d2b-5b459106a7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:03.000270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380d802-396a-4e85-9d2b-5b459106a7b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:03.011282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380d802-396a-4e85-9d2b-5b459106a7b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:03.012820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380d802-396a-4e85-9d2b-5b459106a7b7 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:03.032085 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-5380d802-396a-4e85-9d2b-5b459106a7b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:03.032085 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:03.032085 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:03.032085 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:03.032085 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:03.032085 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:03.032085 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:03.032085 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:03.032085 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:03.032085 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:03.032085 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:03.032085 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:03.032085 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:03.032085 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:03.032085 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:03.033077 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:03.033077 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:03.033077 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:03.033077 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:03.033077 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:03.033077 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:03.033077 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:03.033077 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:03.033077 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:03.033077 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:03.033077 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:03.033077 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:03.033077 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:03.033077 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:03.033077 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:03.033077 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:03.033077 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:03.039014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:03.039014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:03.039014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:03.039014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:03.039014 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 262/528] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:03.039014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380d802-396a-4e85-9d2b-5b459106a7b7 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:03.066725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43970954-fa93-4e06-b7b3-84f78d2be565 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:03.102163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3d2bf-5f67-4cf9-b890-9060526d5ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:03.102832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3d2bf-5f67-4cf9-b890-9060526d5ca3 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:03.103119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3d2bf-5f67-4cf9-b890-9060526d5ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:03.103399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3d2bf-5f67-4cf9-b890-9060526d5ca3 None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:03.104243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3d2bf-5f67-4cf9-b890-9060526d5ca3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:03.104562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3d2bf-5f67-4cf9-b890-9060526d5ca3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:03.106097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3d2bf-5f67-4cf9-b890-9060526d5ca3 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:03.129747 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 267/529] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:03.129747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3d2bf-5f67-4cf9-b890-9060526d5ca3 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:03.153881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380d802-396a-4e85-9d2b-5b459106a7b7 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:03.191396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed640a-8866-423f-90bb-7070b8262587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:03.192042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed640a-8866-423f-90bb-7070b8262587 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:03.192322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed640a-8866-423f-90bb-7070b8262587 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:03.192735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed640a-8866-423f-90bb-7070b8262587 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:03.235444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3d2bf-5f67-4cf9-b890-9060526d5ca3 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:03.259757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed640a-8866-423f-90bb-7070b8262587 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:03.261261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed640a-8866-423f-90bb-7070b8262587 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:03.268158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73606613-d2f1-4d4b-8ddb-13c280dd8878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:03.268833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73606613-d2f1-4d4b-8ddb-13c280dd8878 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:03.269116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73606613-d2f1-4d4b-8ddb-13c280dd8878 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:03.269391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73606613-d2f1-4d4b-8ddb-13c280dd8878 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:03.270213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73606613-d2f1-4d4b-8ddb-13c280dd8878 None admin] RBAC: Adding query filter params (role.id=a47492f29bc144158c1c2ed9a4c39d39, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=e6036dd39fb74289a8cbdcd6a21f8662) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:03.270525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73606613-d2f1-4d4b-8ddb-13c280dd8878 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:03.271965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73606613-d2f1-4d4b-8ddb-13c280dd8878 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:03.285007 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 268/530] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:58:03 2022] GET /identity/v3/role_assignments?user.id=e6036dd39fb74289a8cbdcd6a21f8662&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=a47492f29bc144158c1c2ed9a4c39d39 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:03.285007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73606613-d2f1-4d4b-8ddb-13c280dd8878 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:03.365875 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 263/531] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:58:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:58:03.366636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed640a-8866-423f-90bb-7070b8262587 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:03.389652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73606613-d2f1-4d4b-8ddb-13c280dd8878 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:03.431352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de345f3-dc21-45f1-84ec-69c623c45399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:03.432423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de345f3-dc21-45f1-84ec-69c623c45399 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:03.432922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de345f3-dc21-45f1-84ec-69c623c45399 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:03.433363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de345f3-dc21-45f1-84ec-69c623c45399 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:03.434293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de345f3-dc21-45f1-84ec-69c623c45399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:03.434783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de345f3-dc21-45f1-84ec-69c623c45399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:03.436376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de345f3-dc21-45f1-84ec-69c623c45399 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:03.450811 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 269/532] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:03.452132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de345f3-dc21-45f1-84ec-69c623c45399 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:03.475868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed640a-8866-423f-90bb-7070b8262587 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:03.515725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff7efd-d425-4d2e-ae92-600aa820108f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:03.516350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff7efd-d425-4d2e-ae92-600aa820108f None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:03.516662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff7efd-d425-4d2e-ae92-600aa820108f None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:03.516944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff7efd-d425-4d2e-ae92-600aa820108f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:03.517845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff7efd-d425-4d2e-ae92-600aa820108f None admin] RBAC: Adding query filter params (role.id=a47492f29bc144158c1c2ed9a4c39d39, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=8eab371b02c34a13b629eacdf504dbdb) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:03.518165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff7efd-d425-4d2e-ae92-600aa820108f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:03.519759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff7efd-d425-4d2e-ae92-600aa820108f None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:03.530467 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 264/533] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:58:03 2022] GET /identity/v3/role_assignments?user.id=8eab371b02c34a13b629eacdf504dbdb&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=a47492f29bc144158c1c2ed9a4c39d39 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:03.531321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff7efd-d425-4d2e-ae92-600aa820108f None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:03.560255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de345f3-dc21-45f1-84ec-69c623c45399 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:03.627680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e376d7f-1910-4616-bea8-1ab3543aba2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:03.628492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e376d7f-1910-4616-bea8-1ab3543aba2d None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:03.628800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e376d7f-1910-4616-bea8-1ab3543aba2d None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:03.629080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e376d7f-1910-4616-bea8-1ab3543aba2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:03.648065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e376d7f-1910-4616-bea8-1ab3543aba2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:03.650992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e376d7f-1910-4616-bea8-1ab3543aba2d None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:03.682653 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-6e376d7f-1910-4616-bea8-1ab3543aba2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:03.682653 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:03.682653 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:03.682653 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:03.682653 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:03.682653 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:03.682653 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:03.682653 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:03.682653 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:03.682653 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:03.682653 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:03.682653 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:03.682653 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:03.682653 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:03.682653 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:03.683555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:03.683555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:03.683555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:03.683555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:03.683555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:03.683555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:03.683555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:03.683555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:03.683555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:03.683555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:03.683555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:03.683555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:03.683555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:03.683555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:03.683555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:03.683555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:03.683555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:03.684395 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:03.684395 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:03.684395 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:03.684395 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:03.685046 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 270/534] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:03.698925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e376d7f-1910-4616-bea8-1ab3543aba2d None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:03.716344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff7efd-d425-4d2e-ae92-600aa820108f None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:03.755736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93443423-2979-4009-b0e3-68c8838aefea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:03.756917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93443423-2979-4009-b0e3-68c8838aefea None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:03.757402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93443423-2979-4009-b0e3-68c8838aefea None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:03.758523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93443423-2979-4009-b0e3-68c8838aefea None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:03.767209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93443423-2979-4009-b0e3-68c8838aefea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:03.768937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93443423-2979-4009-b0e3-68c8838aefea None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:03.785017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-93443423-2979-4009-b0e3-68c8838aefea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:03.785017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:03.785017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:03.785017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:03.785017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:03.785017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:03.785017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:03.785017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:03.785017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:03.785017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:03.785017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:03.785017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:03.785017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:03.785017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:03.785017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:03.785970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:03.785970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:03.785970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:03.785970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:03.785970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:03.785970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:03.785970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:03.785970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:03.785970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:03.785970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:03.785970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:03.785970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:03.785970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:03.785970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:03.785970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:03.785970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:03.785970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:03.786807 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:03.786807 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:03.786807 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:03.786807 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:03.786807 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:03.786807 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:03.786807 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:03.786807 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:03.789365 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 265/535] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:03.798098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93443423-2979-4009-b0e3-68c8838aefea None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:03.822019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e376d7f-1910-4616-bea8-1ab3543aba2d None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:03.856138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa125b4-af45-4d21-ae47-b1f76f5c012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:03.856843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa125b4-af45-4d21-ae47-b1f76f5c012c None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:03.857131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa125b4-af45-4d21-ae47-b1f76f5c012c None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:03.857408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa125b4-af45-4d21-ae47-b1f76f5c012c None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:03.858136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa125b4-af45-4d21-ae47-b1f76f5c012c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:03.858455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa125b4-af45-4d21-ae47-b1f76f5c012c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:03.859843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa125b4-af45-4d21-ae47-b1f76f5c012c None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:03.872571 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 271/536] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:03.879825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa125b4-af45-4d21-ae47-b1f76f5c012c None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:03.958004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93443423-2979-4009-b0e3-68c8838aefea None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:03.983088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa125b4-af45-4d21-ae47-b1f76f5c012c None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:03.993808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9753b9-57f0-4e18-aec0-ff1a92cbf1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:03.994467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9753b9-57f0-4e18-aec0-ff1a92cbf1ae None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:03.994750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9753b9-57f0-4e18-aec0-ff1a92cbf1ae None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:03.995029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9753b9-57f0-4e18-aec0-ff1a92cbf1ae None admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:03.995813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9753b9-57f0-4e18-aec0-ff1a92cbf1ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:03.996126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9753b9-57f0-4e18-aec0-ff1a92cbf1ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:03.997641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9753b9-57f0-4e18-aec0-ff1a92cbf1ae None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:04.009924 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 266/537] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:04.017675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9753b9-57f0-4e18-aec0-ff1a92cbf1ae None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:04.032485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f73d84-c4cc-4c60-9f3c-b2ee0f3a3aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:04.033381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f73d84-c4cc-4c60-9f3c-b2ee0f3a3aa7 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:04.033672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f73d84-c4cc-4c60-9f3c-b2ee0f3a3aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:04.033950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f73d84-c4cc-4c60-9f3c-b2ee0f3a3aa7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:04.046088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f73d84-c4cc-4c60-9f3c-b2ee0f3a3aa7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:04.047601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f73d84-c4cc-4c60-9f3c-b2ee0f3a3aa7 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:04.073708 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-17f73d84-c4cc-4c60-9f3c-b2ee0f3a3aa7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:04.073708 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:04.073708 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:04.073708 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:04.073708 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:04.073708 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:04.073708 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:04.073708 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:04.073708 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:04.073708 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:04.073708 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:04.073708 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:04.073708 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:04.073708 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:04.073708 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:04.074582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:04.074582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:04.074582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:04.074582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:04.074582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:04.074582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:04.074582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:04.074582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:04.074582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:04.074582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:04.074582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:04.074582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:04.074582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:04.074582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:04.074582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:04.074582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:04.074582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:04.075429 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:04.075429 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:04.075429 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:04.075429 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:04.075429 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:04.075429 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:04.075429 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:04.075429 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:04.080844 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 272/538] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:04.088806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f73d84-c4cc-4c60-9f3c-b2ee0f3a3aa7 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:04.197292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9753b9-57f0-4e18-aec0-ff1a92cbf1ae None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:04.233238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b034f-47ec-421e-996a-00d02dc87210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:04.234242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b034f-47ec-421e-996a-00d02dc87210 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:04.234722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b034f-47ec-421e-996a-00d02dc87210 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:04.235305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b034f-47ec-421e-996a-00d02dc87210 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:04.236325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b034f-47ec-421e-996a-00d02dc87210 None admin] RBAC: Adding query filter params (role.id=a47492f29bc144158c1c2ed9a4c39d39, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=08bc0cd97b6f45339f5dcf1a264b5ae2) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:04.236875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b034f-47ec-421e-996a-00d02dc87210 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:04.238770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b034f-47ec-421e-996a-00d02dc87210 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:04.253080 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 267/539] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:58:04 2022] GET /identity/v3/role_assignments?user.id=08bc0cd97b6f45339f5dcf1a264b5ae2&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=a47492f29bc144158c1c2ed9a4c39d39 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:04.254173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f73d84-c4cc-4c60-9f3c-b2ee0f3a3aa7 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:04.311645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045df20-836d-4cb4-bb96-230cab3169be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:04.312284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045df20-836d-4cb4-bb96-230cab3169be None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:04.312564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045df20-836d-4cb4-bb96-230cab3169be None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:04.312830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045df20-836d-4cb4-bb96-230cab3169be None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:04.313632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045df20-836d-4cb4-bb96-230cab3169be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:04.313943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045df20-836d-4cb4-bb96-230cab3169be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:04.315397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045df20-836d-4cb4-bb96-230cab3169be None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:04.333210 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 273/540] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:04.340817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b034f-47ec-421e-996a-00d02dc87210 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:04.485093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b034f-47ec-421e-996a-00d02dc87210 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:04.522155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b578a-c897-4335-a085-256044b968d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:04.523164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b578a-c897-4335-a085-256044b968d9 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:04.524124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b578a-c897-4335-a085-256044b968d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:04.524561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b578a-c897-4335-a085-256044b968d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:04.525689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b578a-c897-4335-a085-256044b968d9 None admin] RBAC: Adding query filter params (role.id=a47492f29bc144158c1c2ed9a4c39d39, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=4cd9fe10f94f43aeb3eb10009ee96ea9) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:04.526182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b578a-c897-4335-a085-256044b968d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:04.527991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b578a-c897-4335-a085-256044b968d9 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:04.534201 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 268/541] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:58:04 2022] GET /identity/v3/role_assignments?user.id=4cd9fe10f94f43aeb3eb10009ee96ea9&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=a47492f29bc144158c1c2ed9a4c39d39 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:05.641050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e0355-f9f1-44e6-8ad3-586031de045f None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:05.641569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e0355-f9f1-44e6-8ad3-586031de045f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:05.641677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e0355-f9f1-44e6-8ad3-586031de045f None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:05.643213 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 274/542] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:05.649210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387c0c6-4c20-49dd-9351-ba2ca4b45eb3 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:05.649605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387c0c6-4c20-49dd-9351-ba2ca4b45eb3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:05.649783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387c0c6-4c20-49dd-9351-ba2ca4b45eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:05.673556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0387c0c6-4c20-49dd-9351-ba2ca4b45eb3 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:05.674771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0387c0c6-4c20-49dd-9351-ba2ca4b45eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:05.770771 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 269/543] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:58:05.808761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e0355-f9f1-44e6-8ad3-586031de045f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:05.949523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e0355-f9f1-44e6-8ad3-586031de045f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:05.995163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf96414-1fdb-4283-b791-ac9757fa7815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:05.995974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf96414-1fdb-4283-b791-ac9757fa7815 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:05.996255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf96414-1fdb-4283-b791-ac9757fa7815 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:05.996536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf96414-1fdb-4283-b791-ac9757fa7815 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:06.011025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf96414-1fdb-4283-b791-ac9757fa7815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:06.018674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-ddf96414-1fdb-4283-b791-ac9757fa7815 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:06.018674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:06.018674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:06.018674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:06.018674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:06.018674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:06.018674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:06.018674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:06.018674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:06.018674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:06.018674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:06.018674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:06.018674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:06.018674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:06.018674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:06.018674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:06.019524 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:06.019524 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:06.019524 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:06.019524 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:06.019524 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:06.019524 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:06.019524 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:06.019524 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:06.019524 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:06.019524 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:06.019524 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:06.019524 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:06.019524 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:06.019524 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:06.019524 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:06.019524 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:06.020743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:06.020743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:06.020743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:06.020743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:06.020743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:06.020743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:06.020743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:06.020743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:06.020743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:06.020743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:06.020743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:06.020743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:06.020743 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 275/544] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 09:58:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:06.025865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387c0c6-4c20-49dd-9351-ba2ca4b45eb3 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:06.167087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387c0c6-4c20-49dd-9351-ba2ca4b45eb3 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:06.214281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fd17c-686e-43c4-80fc-44bd9bce91c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:06.214886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fd17c-686e-43c4-80fc-44bd9bce91c3 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:06.215172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fd17c-686e-43c4-80fc-44bd9bce91c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:06.215455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fd17c-686e-43c4-80fc-44bd9bce91c3 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:06.216241 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fd17c-686e-43c4-80fc-44bd9bce91c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:06.216626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fd17c-686e-43c4-80fc-44bd9bce91c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:06.218013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fd17c-686e-43c4-80fc-44bd9bce91c3 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:06.231967 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 270/545] 10.222.0.16 () {56 vars in 1103 bytes} [Mon May 2 09:58:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:06.237478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf96414-1fdb-4283-b791-ac9757fa7815 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:06.398845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718456ba-041b-4556-b7c6-a4ade9b1bc77 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:06.399135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718456ba-041b-4556-b7c6-a4ade9b1bc77 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:06.399403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718456ba-041b-4556-b7c6-a4ade9b1bc77 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:06.401064 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 271/546] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:58:06.406254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c30d78-8edd-4695-89b3-b5d909418f33 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:06.406605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c30d78-8edd-4695-89b3-b5d909418f33 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:06.406894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c30d78-8edd-4695-89b3-b5d909418f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:06.412365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf96414-1fdb-4283-b791-ac9757fa7815 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:06.444969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e9c30d78-8edd-4695-89b3-b5d909418f33 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:06.447044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e9c30d78-8edd-4695-89b3-b5d909418f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:06.465411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb82103-f02b-42b3-b4f1-6b3960e18aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:06.466126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb82103-f02b-42b3-b4f1-6b3960e18aa9 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:06.466408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb82103-f02b-42b3-b4f1-6b3960e18aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:06.466681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb82103-f02b-42b3-b4f1-6b3960e18aa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:06.488328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb82103-f02b-42b3-b4f1-6b3960e18aa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:06.489838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb82103-f02b-42b3-b4f1-6b3960e18aa9 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:06.507560 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-cfb82103-f02b-42b3-b4f1-6b3960e18aa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:06.507560 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:06.507560 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:06.507560 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:06.507560 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:06.507560 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:06.507560 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:06.507560 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:06.507560 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:06.507560 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:06.507560 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:06.507560 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:06.507560 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:06.507560 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:06.507560 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:06.510984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:06.510984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:06.510984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:06.510984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:06.510984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:06.510984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:06.510984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:06.510984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:06.510984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:06.510984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:06.510984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:06.510984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:06.510984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:06.510984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:06.510984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:06.510984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:06.510984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:06.512047 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:06.512047 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:06.512047 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:06.512047 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:06.514152 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 276/547] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:06.515481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42f149-e219-43ec-8933-766fff463aca None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:06.515770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42f149-e219-43ec-8933-766fff463aca None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:06.516052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42f149-e219-43ec-8933-766fff463aca None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:06.517592 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 277/548] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:06.518297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42f149-e219-43ec-8933-766fff463aca None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:06.526114 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 272/549] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:58:06.528237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48df4b-319a-423a-9a99-38496ca41ef7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:06.528935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48df4b-319a-423a-9a99-38496ca41ef7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:06.529366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48df4b-319a-423a-9a99-38496ca41ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:06.546667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2a48df4b-319a-423a-9a99-38496ca41ef7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:06.548118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2a48df4b-319a-423a-9a99-38496ca41ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:06.619897 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 273/550] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:58:06.621147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48df4b-319a-423a-9a99-38496ca41ef7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:06.657900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42f149-e219-43ec-8933-766fff463aca None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:06.691912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde42b4f-08b8-480c-b918-64ea771720dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:06.692582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde42b4f-08b8-480c-b918-64ea771720dc None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:06.692900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde42b4f-08b8-480c-b918-64ea771720dc None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:06.693170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde42b4f-08b8-480c-b918-64ea771720dc None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:06.694066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde42b4f-08b8-480c-b918-64ea771720dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:06.694541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde42b4f-08b8-480c-b918-64ea771720dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:06.696633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde42b4f-08b8-480c-b918-64ea771720dc None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:06.713860 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 278/551] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:06.714965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde42b4f-08b8-480c-b918-64ea771720dc None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:06.723513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48df4b-319a-423a-9a99-38496ca41ef7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:06.760241 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da70518-d7dd-4338-bb84-6cf0bed4480a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:06.761351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da70518-d7dd-4338-bb84-6cf0bed4480a None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:06.761826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da70518-d7dd-4338-bb84-6cf0bed4480a None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:06.762253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da70518-d7dd-4338-bb84-6cf0bed4480a None admin] PATH_INFO: `/v3/roles/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:06.773033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da70518-d7dd-4338-bb84-6cf0bed4480a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:06.781208 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-3da70518-d7dd-4338-bb84-6cf0bed4480a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:06.781208 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:06.781208 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:06.781208 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:06.781208 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:06.781208 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:06.781208 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:06.781208 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:06.781208 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:06.781208 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:06.781208 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:06.781208 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:06.781208 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:06.781208 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:06.781208 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:06.781208 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:06.782293 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:06.782293 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:06.782293 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:06.782293 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:06.782293 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:06.782293 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:06.782293 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:06.782293 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:06.782293 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:06.782293 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:06.782293 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:06.782293 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:06.782293 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:06.782293 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:06.782293 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:06.782293 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:06.783238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:06.783238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:06.783238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:06.783238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:06.783238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:06.783238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:06.783238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:06.783238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:06.783238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:06.783238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:06.783238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:06.783238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:06.785499 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 274/552] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 09:58:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:06.786468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da70518-d7dd-4338-bb84-6cf0bed4480a None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:06.820036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde42b4f-08b8-480c-b918-64ea771720dc None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:06.858471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b25f05-0011-48c2-8a1a-58a4eaeb22a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:06.859282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b25f05-0011-48c2-8a1a-58a4eaeb22a5 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:06.859569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b25f05-0011-48c2-8a1a-58a4eaeb22a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:06.859848 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b25f05-0011-48c2-8a1a-58a4eaeb22a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:06.872076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b25f05-0011-48c2-8a1a-58a4eaeb22a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:06.880033 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-51b25f05-0011-48c2-8a1a-58a4eaeb22a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:06.880033 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:06.880033 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:06.880033 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:06.880033 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:06.880033 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:06.880033 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:06.880033 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:06.880033 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:06.880033 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:06.880033 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:06.880033 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:06.880033 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:06.880033 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:06.880033 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:06.880033 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:06.881120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:06.881120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:06.881120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:06.881120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:06.881120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:06.881120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:06.881120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:06.881120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:06.881120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:06.881120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:06.881120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:06.881120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:06.881120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:06.881120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:06.881120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:06.881120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:06.882084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:06.882084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:06.882084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:06.882084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:06.882084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:06.882084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:06.882084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:06.882084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:06.882084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:06.882084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:06.882084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:06.882084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:06.886748 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 279/553] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 09:58:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:06.887623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b25f05-0011-48c2-8a1a-58a4eaeb22a5 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:06.899507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da70518-d7dd-4338-bb84-6cf0bed4480a None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:06.934674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11aaa54-6cc3-44c8-9f4e-4855ffaf6585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:06.935786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11aaa54-6cc3-44c8-9f4e-4855ffaf6585 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:06.936219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11aaa54-6cc3-44c8-9f4e-4855ffaf6585 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:06.936670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11aaa54-6cc3-44c8-9f4e-4855ffaf6585 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:06.944820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11aaa54-6cc3-44c8-9f4e-4855ffaf6585 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:06.947057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11aaa54-6cc3-44c8-9f4e-4855ffaf6585 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:06.961628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-f11aaa54-6cc3-44c8-9f4e-4855ffaf6585 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 02 09:58:06.961628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:06.961628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:06.961628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:06.961628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:06.961628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:06.961628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:06.961628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:06.961628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:06.961628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:06.961628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:06.961628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:06.961628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:06.961628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:06.961628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:06.961628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:06.962618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:06.962618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:06.962618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:06.962618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:06.962618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:06.962618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:06.962618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:06.962618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:06.962618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:06.962618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:06.962618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:06.962618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:06.962618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:06.962618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:06.962618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:06.962618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:06.962618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:06.962618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:06.963619 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:06.963619 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:06.963619 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:06.963619 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:06.963619 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:06.963619 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:06.963619 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:06.963619 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:06.963619 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 02 09:58:06.963619 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:06.965823 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 275/554] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:58:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:06.966863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11aaa54-6cc3-44c8-9f4e-4855ffaf6585 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:07.001591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b25f05-0011-48c2-8a1a-58a4eaeb22a5 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:07.041237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81456419-239b-4ea9-b1a2-1ca22ceccadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:07.041906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81456419-239b-4ea9-b1a2-1ca22ceccadb None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:07.042190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81456419-239b-4ea9-b1a2-1ca22ceccadb None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:07.042470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81456419-239b-4ea9-b1a2-1ca22ceccadb None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:07.043223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81456419-239b-4ea9-b1a2-1ca22ceccadb None admin] RBAC: Adding query filter params (name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:07.043536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81456419-239b-4ea9-b1a2-1ca22ceccadb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:07.044943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81456419-239b-4ea9-b1a2-1ca22ceccadb None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:07.053532 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 280/555] 10.222.0.16 () {56 vars in 1103 bytes} [Mon May 2 09:58:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:07.057447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81456419-239b-4ea9-b1a2-1ca22ceccadb None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:07.084065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11aaa54-6cc3-44c8-9f4e-4855ffaf6585 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:07.125616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406434d-ae6e-48ae-a041-8a4ad4f43856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:07.126286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406434d-ae6e-48ae-a041-8a4ad4f43856 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:07.126567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406434d-ae6e-48ae-a041-8a4ad4f43856 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:07.126847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406434d-ae6e-48ae-a041-8a4ad4f43856 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:07.127592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406434d-ae6e-48ae-a041-8a4ad4f43856 None admin] RBAC: Adding query filter params (name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:07.127907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406434d-ae6e-48ae-a041-8a4ad4f43856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:07.129307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406434d-ae6e-48ae-a041-8a4ad4f43856 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:07.141675 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 276/556] 10.222.0.16 () {56 vars in 1103 bytes} [Mon May 2 09:58:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:07.141675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50536c98-7557-4a3f-875d-4ae4b1f498b1 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:07.141675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50536c98-7557-4a3f-875d-4ae4b1f498b1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:07.141675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50536c98-7557-4a3f-875d-4ae4b1f498b1 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:07.141675 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 277/557] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:07.141675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50536c98-7557-4a3f-875d-4ae4b1f498b1 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:07.162969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81456419-239b-4ea9-b1a2-1ca22ceccadb None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:07.202575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc07fa-4b37-40a3-b94f-83a6387ae955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:07.203254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc07fa-4b37-40a3-b94f-83a6387ae955 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:07.203534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc07fa-4b37-40a3-b94f-83a6387ae955 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:07.203809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc07fa-4b37-40a3-b94f-83a6387ae955 None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:07.204672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc07fa-4b37-40a3-b94f-83a6387ae955 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:07.204986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc07fa-4b37-40a3-b94f-83a6387ae955 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:07.206732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc07fa-4b37-40a3-b94f-83a6387ae955 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:07.228642 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 281/558] 10.222.0.16 () {56 vars in 1135 bytes} [Mon May 2 09:58:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:07.228642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc07fa-4b37-40a3-b94f-83a6387ae955 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:07.249305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50536c98-7557-4a3f-875d-4ae4b1f498b1 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:07.281695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a900c9-c074-40b2-aa22-10b253ff8a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:07.282506 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a900c9-c074-40b2-aa22-10b253ff8a58 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:07.282801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a900c9-c074-40b2-aa22-10b253ff8a58 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:07.283077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a900c9-c074-40b2-aa22-10b253ff8a58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:07.294256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a900c9-c074-40b2-aa22-10b253ff8a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:07.295774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a900c9-c074-40b2-aa22-10b253ff8a58 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:07.313426 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-a8a900c9-c074-40b2-aa22-10b253ff8a58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:07.313426 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:07.313426 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:07.313426 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:07.313426 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:07.313426 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:07.313426 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:07.313426 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:07.313426 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:07.313426 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:07.313426 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:07.313426 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:07.313426 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:07.313426 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:07.313426 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:07.321053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:07.321053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:07.321053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:07.321053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:07.321053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:07.321053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:07.321053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:07.321053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:07.321053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:07.321053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:07.321053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:07.321053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:07.321053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:07.321053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:07.321053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:07.321053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:07.321053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:07.321904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:07.321904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:07.321904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:07.321904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:07.321904 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 278/559] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:07.321904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58d6ff-bcf3-4cf3-8f9b-532fa8db62b7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:07.321904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58d6ff-bcf3-4cf3-8f9b-532fa8db62b7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:07.321904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58d6ff-bcf3-4cf3-8f9b-532fa8db62b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:07.332830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc07fa-4b37-40a3-b94f-83a6387ae955 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:07.334239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-7b58d6ff-bcf3-4cf3-8f9b-532fa8db62b7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:07.335428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7b58d6ff-bcf3-4cf3-8f9b-532fa8db62b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:07.366314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ff19a-6b11-4c7f-94ee-6e1ee06ed32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:07.367709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ff19a-6b11-4c7f-94ee-6e1ee06ed32f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:07.368064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ff19a-6b11-4c7f-94ee-6e1ee06ed32f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:07.368348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ff19a-6b11-4c7f-94ee-6e1ee06ed32f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:07.378912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ff19a-6b11-4c7f-94ee-6e1ee06ed32f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:07.380376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ff19a-6b11-4c7f-94ee-6e1ee06ed32f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:07.397176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-3b3ff19a-6b11-4c7f-94ee-6e1ee06ed32f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:07.397176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:07.397176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:07.397176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:07.397176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:07.397176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:07.397176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:07.397176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:07.397176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:07.397176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:07.397176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:07.397176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:07.397176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:07.397176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:07.397176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:07.398176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:07.398176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:07.398176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:07.398176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:07.398176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:07.398176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:07.398176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:07.398176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:07.398176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:07.398176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:07.398176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:07.398176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:07.398176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:07.398176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:07.398176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:07.398176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:07.398176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:07.399212 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:07.399212 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:07.399212 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:07.399212 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:07.399212 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 282/560] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:07.399212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ff19a-6b11-4c7f-94ee-6e1ee06ed32f None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:07.401840 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 279/561] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:58:07.402846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58d6ff-bcf3-4cf3-8f9b-532fa8db62b7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:07.498436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ff19a-6b11-4c7f-94ee-6e1ee06ed32f None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:07.501450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58d6ff-bcf3-4cf3-8f9b-532fa8db62b7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:07.531952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702f072-4a93-4f82-9cc2-3372cf92c187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:07.532528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702f072-4a93-4f82-9cc2-3372cf92c187 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:07.532838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702f072-4a93-4f82-9cc2-3372cf92c187 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:07.533118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702f072-4a93-4f82-9cc2-3372cf92c187 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:07.533756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a75bba-8e39-4a17-91b7-a82f5a535317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:07.534440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a75bba-8e39-4a17-91b7-a82f5a535317 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:07.534719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a75bba-8e39-4a17-91b7-a82f5a535317 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:07.534994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a75bba-8e39-4a17-91b7-a82f5a535317 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:07.535711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a75bba-8e39-4a17-91b7-a82f5a535317 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:07.536014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a75bba-8e39-4a17-91b7-a82f5a535317 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:07.537405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a75bba-8e39-4a17-91b7-a82f5a535317 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:07.548790 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 280/562] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:07.550027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcb733-e089-45b7-a340-0cc47bc2054e None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:07.550420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcb733-e089-45b7-a340-0cc47bc2054e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:07.550596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcb733-e089-45b7-a340-0cc47bc2054e None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:07.551999 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 281/563] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:07.556544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcb733-e089-45b7-a340-0cc47bc2054e None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:07.598295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702f072-4a93-4f82-9cc2-3372cf92c187 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:07.599757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702f072-4a93-4f82-9cc2-3372cf92c187 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:07.651540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcb733-e089-45b7-a340-0cc47bc2054e None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:07.683135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9368123-671a-43f9-a07a-a473eb5dd066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:07.683779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9368123-671a-43f9-a07a-a473eb5dd066 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:07.684066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9368123-671a-43f9-a07a-a473eb5dd066 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:07.684342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9368123-671a-43f9-a07a-a473eb5dd066 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:07.685102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9368123-671a-43f9-a07a-a473eb5dd066 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:07.685409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9368123-671a-43f9-a07a-a473eb5dd066 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:07.686769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9368123-671a-43f9-a07a-a473eb5dd066 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:07.690609 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 283/564] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:58:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:58:07.691449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702f072-4a93-4f82-9cc2-3372cf92c187 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:07.698673 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 282/565] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:07.699470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9368123-671a-43f9-a07a-a473eb5dd066 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:07.782499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702f072-4a93-4f82-9cc2-3372cf92c187 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:07.793092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9368123-671a-43f9-a07a-a473eb5dd066 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:07.814228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa5abd-d3b6-4506-a4ad-116621432996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:07.815015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa5abd-d3b6-4506-a4ad-116621432996 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:07.815298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa5abd-d3b6-4506-a4ad-116621432996 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:07.815579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa5abd-d3b6-4506-a4ad-116621432996 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:07.824046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b0de2-ba23-43ac-9cd4-c368fa2d5708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:07.824846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b0de2-ba23-43ac-9cd4-c368fa2d5708 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:07.825131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b0de2-ba23-43ac-9cd4-c368fa2d5708 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:07.825404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b0de2-ba23-43ac-9cd4-c368fa2d5708 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:07.825703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa5abd-d3b6-4506-a4ad-116621432996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:07.832537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b0de2-ba23-43ac-9cd4-c368fa2d5708 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:07.833274 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-44fa5abd-d3b6-4506-a4ad-116621432996 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:07.833274 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:07.833274 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:07.833274 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:07.833274 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:07.833274 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:07.833274 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:07.833274 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:07.833274 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:07.833274 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:07.833274 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:07.833274 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:07.833274 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:07.833274 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:07.833274 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:07.833274 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:07.834189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:07.834189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:07.834189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:07.834189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:07.834189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:07.834189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:07.834189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:07.834189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:07.834189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:07.834189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:07.834189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:07.834189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:07.834189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:07.834189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:07.834189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:07.834189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:07.835066 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:07.835066 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:07.835066 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:07.835066 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:07.835066 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:07.835066 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:07.835066 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:07.835066 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:07.835066 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:07.835066 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:07.835066 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:07.835066 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:07.836577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b0de2-ba23-43ac-9cd4-c368fa2d5708 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:07.836693 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 284/566] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 09:58:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:07.836693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d720754-9257-46ee-858f-cd115092f98d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:07.836693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d720754-9257-46ee-858f-cd115092f98d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:07.836693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d720754-9257-46ee-858f-cd115092f98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:07.853499 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-3c9b0de2-ba23-43ac-9cd4-c368fa2d5708 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 02 09:58:07.853499 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:07.853499 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:07.853499 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:07.853499 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:07.853499 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:07.853499 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:07.853499 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:07.853499 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:07.853499 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:07.853499 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:07.853499 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:07.853499 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:07.853499 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:07.853499 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:07.853499 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:07.854430 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:07.854430 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:07.854430 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:07.854430 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:07.854430 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:07.854430 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:07.854430 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:07.854430 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:07.854430 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:07.854430 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:07.854430 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:07.854430 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:07.854430 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:07.854430 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:07.854430 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:07.854430 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:07.854430 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:07.854430 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:07.855328 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:07.855328 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:07.855328 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:07.855328 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:07.855328 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:07.855328 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:07.855328 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:07.855328 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:07.855328 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 02 09:58:07.855328 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:07.856466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-1d720754-9257-46ee-858f-cd115092f98d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:07.856576 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 283/567] 10.222.0.16 () {56 vars in 1093 bytes} [Mon May 2 09:58:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:07.856724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1d720754-9257-46ee-858f-cd115092f98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:07.856833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b0de2-ba23-43ac-9cd4-c368fa2d5708 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:07.917695 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 285/568] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:58:07.918517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d720754-9257-46ee-858f-cd115092f98d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:07.965185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b0de2-ba23-43ac-9cd4-c368fa2d5708 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:07.996128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94126a3c-5ad0-42b6-9b74-9cda15851e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:07.996947 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94126a3c-5ad0-42b6-9b74-9cda15851e22 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:07.997245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94126a3c-5ad0-42b6-9b74-9cda15851e22 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:07.997530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94126a3c-5ad0-42b6-9b74-9cda15851e22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:08.007484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94126a3c-5ad0-42b6-9b74-9cda15851e22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:08.008297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d720754-9257-46ee-858f-cd115092f98d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:08.009456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94126a3c-5ad0-42b6-9b74-9cda15851e22 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:08.026242 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-94126a3c-5ad0-42b6-9b74-9cda15851e22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:08.026242 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:08.026242 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:08.026242 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:08.026242 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:08.026242 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:08.026242 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:08.026242 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:08.026242 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:08.026242 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:08.026242 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:08.026242 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:08.026242 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:08.026242 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:08.026242 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:08.027163 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:08.027163 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:08.027163 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:08.027163 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:08.027163 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:08.027163 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:08.027163 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:08.027163 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:08.027163 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:08.027163 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:08.027163 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:08.027163 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:08.027163 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:08.027163 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:08.027163 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:08.027163 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:08.027163 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:08.028028 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:08.028028 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:08.028028 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:08.028028 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:08.028028 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 284/569] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:08.028593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94126a3c-5ad0-42b6-9b74-9cda15851e22 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:08.043856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04a66c-514d-4e73-adc0-200975ac1aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:08.044581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04a66c-514d-4e73-adc0-200975ac1aee None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:08.044888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04a66c-514d-4e73-adc0-200975ac1aee None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:08.045164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04a66c-514d-4e73-adc0-200975ac1aee None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:08.051939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04a66c-514d-4e73-adc0-200975ac1aee None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:08.053394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04a66c-514d-4e73-adc0-200975ac1aee None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:08.067153 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-0c04a66c-514d-4e73-adc0-200975ac1aee None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 02 09:58:08.067153 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:08.067153 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:08.067153 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:08.067153 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:08.067153 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:08.067153 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:08.067153 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:08.067153 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:08.067153 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:08.067153 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:08.067153 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:08.067153 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:08.067153 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:08.067153 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:08.067153 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:08.068325 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:08.068325 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:08.068325 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:08.068325 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:08.068325 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:08.068325 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:08.068325 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:08.068325 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:08.068325 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:08.068325 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:08.068325 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:08.068325 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:08.068325 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:08.068325 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:08.068325 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:08.068325 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:08.068325 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:08.068325 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:08.069302 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:08.069302 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:08.069302 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:08.069302 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:08.069302 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:08.069302 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:08.069302 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:08.069302 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:08.069302 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 02 09:58:08.069302 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:08.069302 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 286/570] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:58:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:08.070837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04a66c-514d-4e73-adc0-200975ac1aee None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:08.129518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94126a3c-5ad0-42b6-9b74-9cda15851e22 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:08.161424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603b229-7635-4ce6-a824-bdf33b5e3f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:08.162083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603b229-7635-4ce6-a824-bdf33b5e3f97 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:08.162363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603b229-7635-4ce6-a824-bdf33b5e3f97 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:08.162636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603b229-7635-4ce6-a824-bdf33b5e3f97 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:08.163371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603b229-7635-4ce6-a824-bdf33b5e3f97 None admin] RBAC: Adding query filter params (name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:08.163677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603b229-7635-4ce6-a824-bdf33b5e3f97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:08.164505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04a66c-514d-4e73-adc0-200975ac1aee None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:08.165106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603b229-7635-4ce6-a824-bdf33b5e3f97 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:08.172675 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 285/571] 10.222.0.16 () {56 vars in 1103 bytes} [Mon May 2 09:58:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:08.173507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603b229-7635-4ce6-a824-bdf33b5e3f97 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:08.197743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d313985-37f2-4544-87fd-c68b68697e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:08.198407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d313985-37f2-4544-87fd-c68b68697e42 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:08.198684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d313985-37f2-4544-87fd-c68b68697e42 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:08.198952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d313985-37f2-4544-87fd-c68b68697e42 None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:08.199784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d313985-37f2-4544-87fd-c68b68697e42 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:08.200092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d313985-37f2-4544-87fd-c68b68697e42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:08.201555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d313985-37f2-4544-87fd-c68b68697e42 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:08.217518 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 287/572] 10.222.0.16 () {56 vars in 1133 bytes} [Mon May 2 09:58:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:08.218293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d313985-37f2-4544-87fd-c68b68697e42 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:08.266713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603b229-7635-4ce6-a824-bdf33b5e3f97 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:08.297394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4e7b7-964c-4edd-a8fe-e2027b1faa2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:08.298114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4e7b7-964c-4edd-a8fe-e2027b1faa2e None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:08.298403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4e7b7-964c-4edd-a8fe-e2027b1faa2e None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:08.298683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4e7b7-964c-4edd-a8fe-e2027b1faa2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:08.308784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4e7b7-964c-4edd-a8fe-e2027b1faa2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:08.308945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d313985-37f2-4544-87fd-c68b68697e42 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:08.316338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-21e4e7b7-964c-4edd-a8fe-e2027b1faa2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:08.316338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:08.316338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:08.316338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:08.316338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:08.316338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:08.316338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:08.316338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:08.316338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:08.316338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:08.316338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:08.316338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:08.316338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:08.316338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:08.316338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:08.316338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:08.317484 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:08.317484 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:08.317484 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:08.317484 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:08.317484 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:08.317484 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:08.317484 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:08.317484 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:08.317484 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:08.317484 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:08.317484 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:08.317484 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:08.317484 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:08.317484 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:08.317484 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:08.317484 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:08.318333 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:08.318333 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:08.318333 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:08.318333 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:08.318333 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:08.318333 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:08.318333 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:08.318333 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:08.318333 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:08.318333 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:08.318333 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:08.318333 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:08.318333 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 286/573] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 09:58:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:08.318333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4e7b7-964c-4edd-a8fe-e2027b1faa2e None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:08.343567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758b3b7-6faa-48fb-8ab3-f5dee0c5849a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:08.344219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758b3b7-6faa-48fb-8ab3-f5dee0c5849a None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:08.344496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758b3b7-6faa-48fb-8ab3-f5dee0c5849a None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:08.344810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758b3b7-6faa-48fb-8ab3-f5dee0c5849a None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:08.345517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758b3b7-6faa-48fb-8ab3-f5dee0c5849a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:08.345820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758b3b7-6faa-48fb-8ab3-f5dee0c5849a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:08.347199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758b3b7-6faa-48fb-8ab3-f5dee0c5849a None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:08.357860 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 288/574] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:08.358631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758b3b7-6faa-48fb-8ab3-f5dee0c5849a None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:08.411034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4e7b7-964c-4edd-a8fe-e2027b1faa2e None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:08.441966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39393769-3a33-48f6-94bc-90afbb8b2f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:08.442626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39393769-3a33-48f6-94bc-90afbb8b2f2b None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:08.442911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39393769-3a33-48f6-94bc-90afbb8b2f2b None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:08.443190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39393769-3a33-48f6-94bc-90afbb8b2f2b None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:08.444022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39393769-3a33-48f6-94bc-90afbb8b2f2b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:08.444334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39393769-3a33-48f6-94bc-90afbb8b2f2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:08.446367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39393769-3a33-48f6-94bc-90afbb8b2f2b None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:08.451575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758b3b7-6faa-48fb-8ab3-f5dee0c5849a None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:08.462378 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 287/575] 10.222.0.16 () {56 vars in 1137 bytes} [Mon May 2 09:58:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:08.463170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39393769-3a33-48f6-94bc-90afbb8b2f2b None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:08.483112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b897ef-1e97-4bf6-93d1-667c62b04c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:08.483927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b897ef-1e97-4bf6-93d1-667c62b04c32 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:08.485786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b897ef-1e97-4bf6-93d1-667c62b04c32 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:08.485786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b897ef-1e97-4bf6-93d1-667c62b04c32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:08.495240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b897ef-1e97-4bf6-93d1-667c62b04c32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:08.496722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b897ef-1e97-4bf6-93d1-667c62b04c32 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:08.513734 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-93b897ef-1e97-4bf6-93d1-667c62b04c32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:08.513734 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:08.513734 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:08.513734 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:08.513734 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:08.513734 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:08.513734 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:08.513734 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:08.513734 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:08.513734 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:08.513734 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:08.513734 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:08.513734 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:08.513734 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:08.513734 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:08.521104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:08.521104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:08.521104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:08.521104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:08.521104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:08.521104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:08.521104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:08.521104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:08.521104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:08.521104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:08.521104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:08.521104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:08.521104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:08.521104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:08.521104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:08.521104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:08.521104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:08.522012 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:08.522012 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:08.522012 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:08.522012 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:08.522012 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 289/576] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:08.522012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b897ef-1e97-4bf6-93d1-667c62b04c32 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:08.567195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39393769-3a33-48f6-94bc-90afbb8b2f2b None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:08.598990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4330c6e-fbee-42e9-906c-4d22fd9c2e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:08.599877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4330c6e-fbee-42e9-906c-4d22fd9c2e13 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:08.600231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4330c6e-fbee-42e9-906c-4d22fd9c2e13 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:08.600516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4330c6e-fbee-42e9-906c-4d22fd9c2e13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:08.608952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b897ef-1e97-4bf6-93d1-667c62b04c32 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:08.610676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4330c6e-fbee-42e9-906c-4d22fd9c2e13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:08.612091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4330c6e-fbee-42e9-906c-4d22fd9c2e13 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:08.629699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-e4330c6e-fbee-42e9-906c-4d22fd9c2e13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:08.629699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:08.629699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:08.629699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:08.629699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:08.629699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:08.629699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:08.629699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:08.629699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:08.629699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:08.629699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:08.629699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:08.629699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:08.629699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:08.629699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:08.637207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:08.637207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:08.637207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:08.637207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:08.637207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:08.637207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:08.637207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:08.637207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:08.637207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:08.637207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:08.637207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:08.637207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:08.637207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:08.637207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:08.637207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:08.637207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:08.637207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:08.638072 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:08.638072 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:08.638072 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:08.638072 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:08.638072 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 288/577] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:08.638072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4330c6e-fbee-42e9-906c-4d22fd9c2e13 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:08.646327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b890f1-dd0b-4a68-8049-db3926ba0b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:08.646998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b890f1-dd0b-4a68-8049-db3926ba0b1e None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:08.647284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b890f1-dd0b-4a68-8049-db3926ba0b1e None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:08.647605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b890f1-dd0b-4a68-8049-db3926ba0b1e None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:08.648367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b890f1-dd0b-4a68-8049-db3926ba0b1e None admin] RBAC: Adding query filter params (name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:08.648717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b890f1-dd0b-4a68-8049-db3926ba0b1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:08.650089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b890f1-dd0b-4a68-8049-db3926ba0b1e None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:08.657821 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 290/578] 10.222.0.16 () {56 vars in 1103 bytes} [Mon May 2 09:58:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:08.658599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b890f1-dd0b-4a68-8049-db3926ba0b1e None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:08.724861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4330c6e-fbee-42e9-906c-4d22fd9c2e13 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:08.753753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b890f1-dd0b-4a68-8049-db3926ba0b1e None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:08.757617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd08fa-f7ab-4086-a6b5-53ad42213ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:08.758434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd08fa-f7ab-4086-a6b5-53ad42213ba5 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:08.758721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd08fa-f7ab-4086-a6b5-53ad42213ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:08.759001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd08fa-f7ab-4086-a6b5-53ad42213ba5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:08.765494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd08fa-f7ab-4086-a6b5-53ad42213ba5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:08.766925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd08fa-f7ab-4086-a6b5-53ad42213ba5 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:08.780565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-cbbd08fa-f7ab-4086-a6b5-53ad42213ba5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:08.780565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:08.780565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:08.780565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:08.780565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:08.780565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:08.780565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:08.780565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:08.780565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:08.780565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:08.780565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:08.780565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:08.780565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:08.780565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:08.780565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:08.781509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:08.781509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:08.781509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:08.781509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:08.781509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:08.781509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:08.781509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:08.781509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:08.781509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:08.781509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:08.781509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:08.781509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:08.781509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:08.781509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:08.781509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:08.781509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:08.781509 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:08.782419 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:08.782419 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:08.782419 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:08.782419 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:08.782419 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:08.782419 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:08.782419 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:08.782419 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:08.782419 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 289/579] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:08.782929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd08fa-f7ab-4086-a6b5-53ad42213ba5 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:08.790039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5975f-10cf-486d-a351-46d7671a1dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:08.790913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5975f-10cf-486d-a351-46d7671a1dc6 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:08.791269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5975f-10cf-486d-a351-46d7671a1dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:08.791621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5975f-10cf-486d-a351-46d7671a1dc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:08.802155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5975f-10cf-486d-a351-46d7671a1dc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:08.803611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5975f-10cf-486d-a351-46d7671a1dc6 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:08.820281 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-58a5975f-10cf-486d-a351-46d7671a1dc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:08.820281 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:08.820281 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:08.820281 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:08.820281 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:08.820281 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:08.820281 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:08.820281 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:08.820281 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:08.820281 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:08.820281 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:08.820281 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:08.820281 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:08.820281 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:08.820281 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:08.821206 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:08.821206 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:08.821206 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:08.821206 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:08.821206 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:08.821206 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:08.821206 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:08.821206 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:08.821206 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:08.821206 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:08.821206 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:08.821206 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:08.821206 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:08.821206 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:08.821206 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:08.821206 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:08.821206 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:08.822087 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:08.822087 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:08.822087 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:08.822087 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:08.822087 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 291/580] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:08.822367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5975f-10cf-486d-a351-46d7671a1dc6 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:08.880019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd08fa-f7ab-4086-a6b5-53ad42213ba5 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:08.911180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4326d0-741d-4fee-9ec8-d6e88282b270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:08.911837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4326d0-741d-4fee-9ec8-d6e88282b270 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:08.912113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4326d0-741d-4fee-9ec8-d6e88282b270 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:08.912397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4326d0-741d-4fee-9ec8-d6e88282b270 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:08.913148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4326d0-741d-4fee-9ec8-d6e88282b270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:08.913458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4326d0-741d-4fee-9ec8-d6e88282b270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:08.914853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5975f-10cf-486d-a351-46d7671a1dc6 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:08.915332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4326d0-741d-4fee-9ec8-d6e88282b270 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:08.925931 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 290/581] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:08.926707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4326d0-741d-4fee-9ec8-d6e88282b270 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:08.946986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce03ff9-870f-4bc4-98f5-63a8cedd766a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:08.947639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce03ff9-870f-4bc4-98f5-63a8cedd766a None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:08.947920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce03ff9-870f-4bc4-98f5-63a8cedd766a None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:08.948205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce03ff9-870f-4bc4-98f5-63a8cedd766a None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:08.948938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce03ff9-870f-4bc4-98f5-63a8cedd766a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:08.949244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce03ff9-870f-4bc4-98f5-63a8cedd766a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:08.950614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce03ff9-870f-4bc4-98f5-63a8cedd766a None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:08.962045 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 292/582] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:08.962819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce03ff9-870f-4bc4-98f5-63a8cedd766a None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:09.019645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4326d0-741d-4fee-9ec8-d6e88282b270 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:09.051546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b673a0c-29b1-4345-b55b-d81db9efe137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:09.052334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b673a0c-29b1-4345-b55b-d81db9efe137 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:09.052640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b673a0c-29b1-4345-b55b-d81db9efe137 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:09.052925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b673a0c-29b1-4345-b55b-d81db9efe137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:09.053712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce03ff9-870f-4bc4-98f5-63a8cedd766a None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:09.063066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b673a0c-29b1-4345-b55b-d81db9efe137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:09.064520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b673a0c-29b1-4345-b55b-d81db9efe137 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:09.080970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-2b673a0c-29b1-4345-b55b-d81db9efe137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:09.080970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:09.080970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:09.080970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:09.080970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:09.080970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:09.080970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:09.080970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:09.080970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:09.080970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:09.080970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:09.080970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:09.080970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:09.080970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:09.080970 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:09.081857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:09.081857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:09.081857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:09.081857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:09.081857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:09.081857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:09.081857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:09.081857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:09.081857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:09.081857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:09.081857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:09.081857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:09.081857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:09.081857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:09.081857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:09.081857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:09.081857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:09.082812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:09.082812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:09.082812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:09.082812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:09.082812 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 291/583] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:09.083092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b673a0c-29b1-4345-b55b-d81db9efe137 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:09.089342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308615b-09a0-4111-91fe-600e465c1d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:09.090004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308615b-09a0-4111-91fe-600e465c1d2f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:09.090286 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308615b-09a0-4111-91fe-600e465c1d2f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:09.090567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308615b-09a0-4111-91fe-600e465c1d2f None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:09.091346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308615b-09a0-4111-91fe-600e465c1d2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:09.091654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308615b-09a0-4111-91fe-600e465c1d2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:09.093156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308615b-09a0-4111-91fe-600e465c1d2f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:09.105344 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 293/584] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:09.106170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308615b-09a0-4111-91fe-600e465c1d2f None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:09.186177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b673a0c-29b1-4345-b55b-d81db9efe137 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:09.198904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308615b-09a0-4111-91fe-600e465c1d2f None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:09.217226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd49e6-5446-439e-b5f6-dd5360de52c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:09.217875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd49e6-5446-439e-b5f6-dd5360de52c4 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:09.218155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd49e6-5446-439e-b5f6-dd5360de52c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:09.218425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd49e6-5446-439e-b5f6-dd5360de52c4 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:09.219133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd49e6-5446-439e-b5f6-dd5360de52c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:09.219433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd49e6-5446-439e-b5f6-dd5360de52c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:09.220821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd49e6-5446-439e-b5f6-dd5360de52c4 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:09.230748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bd392-0db5-4cfe-95c1-4f839806ffec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:09.231537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bd392-0db5-4cfe-95c1-4f839806ffec None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:09.231847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bd392-0db5-4cfe-95c1-4f839806ffec None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:09.232111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bd392-0db5-4cfe-95c1-4f839806ffec None admin] PATH_INFO: `/v3/users/glance` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:09.232630 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 292/585] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:09.233251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd49e6-5446-439e-b5f6-dd5360de52c4 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:09.244010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bd392-0db5-4cfe-95c1-4f839806ffec None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:09.245488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bd392-0db5-4cfe-95c1-4f839806ffec None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:09.259056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-ac7bd392-0db5-4cfe-95c1-4f839806ffec None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 02 09:58:09.259056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:09.259056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:09.259056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:09.259056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:09.259056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:09.259056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:09.259056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:09.259056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:09.259056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:09.259056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:09.259056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:09.259056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:09.259056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:09.259056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:09.259056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:09.260130 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:09.260130 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:09.260130 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:09.260130 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:09.260130 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:09.260130 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:09.260130 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:09.260130 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:09.260130 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:09.260130 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:09.260130 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:09.260130 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:09.260130 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:09.260130 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:09.260130 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:09.260130 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:09.260130 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:09.260130 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:09.261141 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:09.261141 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:09.261141 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:09.261141 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:09.261141 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:09.261141 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:09.261141 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:09.261141 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:09.261141 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 02 09:58:09.261141 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:09.264754 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 294/586] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:58:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:09.265724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bd392-0db5-4cfe-95c1-4f839806ffec None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:09.328762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd49e6-5446-439e-b5f6-dd5360de52c4 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:09.356523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bd392-0db5-4cfe-95c1-4f839806ffec None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:09.360526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c46c16-091f-4009-9be8-027fc1f1fff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:09.361345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c46c16-091f-4009-9be8-027fc1f1fff1 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:09.361633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c46c16-091f-4009-9be8-027fc1f1fff1 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:09.361916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c46c16-091f-4009-9be8-027fc1f1fff1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:09.368689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c46c16-091f-4009-9be8-027fc1f1fff1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:09.370123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c46c16-091f-4009-9be8-027fc1f1fff1 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:09.383884 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-64c46c16-091f-4009-9be8-027fc1f1fff1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:09.383884 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:09.383884 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:09.383884 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:09.383884 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:09.383884 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:09.383884 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:09.383884 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:09.383884 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:09.383884 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:09.383884 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:09.383884 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:09.383884 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:09.383884 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:09.383884 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:09.384903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:09.384903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:09.384903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:09.384903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:09.384903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:09.384903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:09.384903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:09.384903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:09.384903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:09.384903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:09.384903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:09.384903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:09.384903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:09.384903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:09.384903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:09.384903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:09.384903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:09.385836 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:09.385836 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:09.385836 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:09.385836 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:09.385836 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:09.385836 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:09.385836 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:09.385836 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:09.385836 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 293/587] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:09.386332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c46c16-091f-4009-9be8-027fc1f1fff1 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:09.389280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477854d0-ab55-4701-81c2-db55c1fa8469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:09.389944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477854d0-ab55-4701-81c2-db55c1fa8469 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:09.390222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477854d0-ab55-4701-81c2-db55c1fa8469 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:09.390500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477854d0-ab55-4701-81c2-db55c1fa8469 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:09.391221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477854d0-ab55-4701-81c2-db55c1fa8469 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:09.391529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477854d0-ab55-4701-81c2-db55c1fa8469 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:09.392928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477854d0-ab55-4701-81c2-db55c1fa8469 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:09.408857 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 295/588] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:09.408857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477854d0-ab55-4701-81c2-db55c1fa8469 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:09.478154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c46c16-091f-4009-9be8-027fc1f1fff1 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:09.495826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477854d0-ab55-4701-81c2-db55c1fa8469 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:09.509453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89632ebd-ec3c-4866-92a9-e7c151ebe137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:09.510100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89632ebd-ec3c-4866-92a9-e7c151ebe137 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:09.510377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89632ebd-ec3c-4866-92a9-e7c151ebe137 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:09.510651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89632ebd-ec3c-4866-92a9-e7c151ebe137 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:09.511472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89632ebd-ec3c-4866-92a9-e7c151ebe137 None admin] RBAC: Adding query filter params (role.id=a47492f29bc144158c1c2ed9a4c39d39, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=6573f5c0731c4a18bf2374c3ba006a57) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:09.511781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89632ebd-ec3c-4866-92a9-e7c151ebe137 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:09.513257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89632ebd-ec3c-4866-92a9-e7c151ebe137 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:09.518581 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 294/589] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:58:09 2022] GET /identity/v3/role_assignments?user.id=6573f5c0731c4a18bf2374c3ba006a57&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=a47492f29bc144158c1c2ed9a4c39d39 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:09.519151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89632ebd-ec3c-4866-92a9-e7c151ebe137 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:09.530114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efeb34-5b3a-4048-87f1-6a9699164aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:09.531084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efeb34-5b3a-4048-87f1-6a9699164aea None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:09.531493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efeb34-5b3a-4048-87f1-6a9699164aea None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:09.531870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efeb34-5b3a-4048-87f1-6a9699164aea None admin] PATH_INFO: `/v3/projects/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:09.539764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6efeb34-5b3a-4048-87f1-6a9699164aea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:09.541459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6efeb34-5b3a-4048-87f1-6a9699164aea None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:09.556333 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-c6efeb34-5b3a-4048-87f1-6a9699164aea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:09.556333 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:09.556333 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:09.556333 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:09.556333 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:09.556333 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:09.556333 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:09.556333 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:09.556333 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:09.556333 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:09.556333 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:09.556333 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:09.556333 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:09.556333 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:09.556333 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:09.557512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:09.557512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:09.557512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:09.557512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:09.557512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:09.557512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:09.557512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:09.557512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:09.557512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:09.557512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:09.557512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:09.557512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:09.557512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:09.557512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:09.557512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:09.557512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:09.557512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:09.558601 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:09.558601 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:09.558601 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:09.558601 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:09.558601 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:09.558601 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:09.558601 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:09.558601 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:09.564686 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 296/590] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:09.564686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efeb34-5b3a-4048-87f1-6a9699164aea None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:09.626032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89632ebd-ec3c-4866-92a9-e7c151ebe137 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:09.661064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa5c18-2844-43a3-be4c-7cd4fb256205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:09.661744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa5c18-2844-43a3-be4c-7cd4fb256205 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:09.662027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa5c18-2844-43a3-be4c-7cd4fb256205 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:09.662303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa5c18-2844-43a3-be4c-7cd4fb256205 None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:09.663270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa5c18-2844-43a3-be4c-7cd4fb256205 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:09.663580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa5c18-2844-43a3-be4c-7cd4fb256205 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:09.665155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa5c18-2844-43a3-be4c-7cd4fb256205 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:09.668297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efeb34-5b3a-4048-87f1-6a9699164aea None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:09.688790 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 295/591] 10.222.0.16 () {56 vars in 1137 bytes} [Mon May 2 09:58:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:09.688790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa5c18-2844-43a3-be4c-7cd4fb256205 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:09.703352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eb438-80a7-48f7-8970-5234b119e409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:09.704025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eb438-80a7-48f7-8970-5234b119e409 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:09.704309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eb438-80a7-48f7-8970-5234b119e409 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:09.704587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eb438-80a7-48f7-8970-5234b119e409 None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:09.705407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149eb438-80a7-48f7-8970-5234b119e409 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:09.705778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149eb438-80a7-48f7-8970-5234b119e409 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:09.707210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149eb438-80a7-48f7-8970-5234b119e409 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:09.720473 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 297/592] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:09.720473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eb438-80a7-48f7-8970-5234b119e409 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:09.784705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa5c18-2844-43a3-be4c-7cd4fb256205 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:09.814424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eb438-80a7-48f7-8970-5234b119e409 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:09.817406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66727cd0-ddd3-4457-9bdc-d08ab32c57c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:09.818335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66727cd0-ddd3-4457-9bdc-d08ab32c57c9 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:09.818715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66727cd0-ddd3-4457-9bdc-d08ab32c57c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:09.819091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66727cd0-ddd3-4457-9bdc-d08ab32c57c9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:09.826862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66727cd0-ddd3-4457-9bdc-d08ab32c57c9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:09.828452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66727cd0-ddd3-4457-9bdc-d08ab32c57c9 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:09.842767 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-66727cd0-ddd3-4457-9bdc-d08ab32c57c9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 02 09:58:09.842767 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:09.842767 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:09.842767 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:09.842767 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:09.842767 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:09.842767 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:09.842767 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:09.842767 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:09.842767 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:09.842767 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:09.842767 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:09.842767 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:09.842767 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:09.842767 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:09.842767 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:09.843896 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:09.843896 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:09.843896 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:09.843896 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:09.843896 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:09.843896 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:09.843896 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:09.843896 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:09.843896 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:09.843896 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:09.843896 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:09.843896 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:09.843896 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:09.843896 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:09.843896 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:09.843896 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:09.843896 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:09.843896 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:09.845091 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:09.845091 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:09.845091 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:09.845091 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:09.845091 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:09.845091 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:09.845091 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:09.845091 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:09.845091 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 02 09:58:09.845091 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:09.850802 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 296/593] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 09:58:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:09.850802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66727cd0-ddd3-4457-9bdc-d08ab32c57c9 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:09.852465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da286b-58f3-4508-b06a-11f7f5c6c719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:09.853276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da286b-58f3-4508-b06a-11f7f5c6c719 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:09.853634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da286b-58f3-4508-b06a-11f7f5c6c719 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:09.855135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da286b-58f3-4508-b06a-11f7f5c6c719 None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:09.855135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da286b-58f3-4508-b06a-11f7f5c6c719 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:09.855135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da286b-58f3-4508-b06a-11f7f5c6c719 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:09.857040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da286b-58f3-4508-b06a-11f7f5c6c719 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:09.869934 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 298/594] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:09.870702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da286b-58f3-4508-b06a-11f7f5c6c719 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:09.946556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66727cd0-ddd3-4457-9bdc-d08ab32c57c9 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:09.964908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da286b-58f3-4508-b06a-11f7f5c6c719 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:09.978437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98f740-b62e-4a71-b03e-46500df34fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:09.979228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98f740-b62e-4a71-b03e-46500df34fa9 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:09.979509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98f740-b62e-4a71-b03e-46500df34fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:09.979786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98f740-b62e-4a71-b03e-46500df34fa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:09.989679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98f740-b62e-4a71-b03e-46500df34fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:09.991110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98f740-b62e-4a71-b03e-46500df34fa9 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:09.997784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89618ed-c329-48a2-97a5-9cb03585960c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:09.998677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89618ed-c329-48a2-97a5-9cb03585960c None admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:09.998962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89618ed-c329-48a2-97a5-9cb03585960c None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:09.999242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89618ed-c329-48a2-97a5-9cb03585960c None admin] PATH_INFO: `/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/e6036dd39fb74289a8cbdcd6a21f8662/roles/a47492f29bc144158c1c2ed9a4c39d39` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:10.010792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-be98f740-b62e-4a71-b03e-46500df34fa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:10.010792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:10.010792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:10.010792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:10.010792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:10.010792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:10.010792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:10.010792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:10.010792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:10.010792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:10.010792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:10.010792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:10.010792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:10.010792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:10.010792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:10.011866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:10.011866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:10.011866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:10.011866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:10.011866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:10.011866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:10.011866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:10.011866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:10.011866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:10.011866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:10.011866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:10.011866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:10.011866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:10.011866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:10.011866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:10.011866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:10.011866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:10.012998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:10.012998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:10.012998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:10.012998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:10.016458 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 297/595] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:10.017320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98f740-b62e-4a71-b03e-46500df34fa9 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:10.017543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89618ed-c329-48a2-97a5-9cb03585960c None admin] RBAC: Authorizing `identity:create_grant(project_id=972cae0aa9694d6cad22fbdbcf916ff7, user_id=e6036dd39fb74289a8cbdcd6a21f8662, role_id=a47492f29bc144158c1c2ed9a4c39d39)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:10.019075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89618ed-c329-48a2-97a5-9cb03585960c None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:10.104512 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 299/596] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 09:58:09 2022] PUT /identity/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/e6036dd39fb74289a8cbdcd6a21f8662/roles/a47492f29bc144158c1c2ed9a4c39d39 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:58:10.114102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89618ed-c329-48a2-97a5-9cb03585960c None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:10.114645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98f740-b62e-4a71-b03e-46500df34fa9 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:10.153978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85e5a5-668b-4f1f-b9de-14cbe8cf78d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:10.154927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85e5a5-668b-4f1f-b9de-14cbe8cf78d0 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:10.155392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85e5a5-668b-4f1f-b9de-14cbe8cf78d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:10.155940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85e5a5-668b-4f1f-b9de-14cbe8cf78d0 None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:10.156971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85e5a5-668b-4f1f-b9de-14cbe8cf78d0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:10.157434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85e5a5-668b-4f1f-b9de-14cbe8cf78d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:10.159116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85e5a5-668b-4f1f-b9de-14cbe8cf78d0 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:10.185467 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 298/597] 10.222.0.16 () {56 vars in 1139 bytes} [Mon May 2 09:58:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:10.186657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85e5a5-668b-4f1f-b9de-14cbe8cf78d0 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:10.227105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89618ed-c329-48a2-97a5-9cb03585960c None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:10.265348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e69af5-0d04-4d0e-9f92-39041adc93b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:10.266512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e69af5-0d04-4d0e-9f92-39041adc93b8 None admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:10.266779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e69af5-0d04-4d0e-9f92-39041adc93b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:10.267145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e69af5-0d04-4d0e-9f92-39041adc93b8 None admin] PATH_INFO: `/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/8eab371b02c34a13b629eacdf504dbdb/roles/a47492f29bc144158c1c2ed9a4c39d39` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:10.283601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e69af5-0d04-4d0e-9f92-39041adc93b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=972cae0aa9694d6cad22fbdbcf916ff7, user_id=8eab371b02c34a13b629eacdf504dbdb, role_id=a47492f29bc144158c1c2ed9a4c39d39)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:10.285327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e69af5-0d04-4d0e-9f92-39041adc93b8 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:10.306331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85e5a5-668b-4f1f-b9de-14cbe8cf78d0 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:10.341517 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 300/598] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 09:58:10 2022] PUT /identity/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/8eab371b02c34a13b629eacdf504dbdb/roles/a47492f29bc144158c1c2ed9a4c39d39 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:58:10.342659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e69af5-0d04-4d0e-9f92-39041adc93b8 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:10.346188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9ee9a-684b-4d7f-95d7-c74e28900272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:10.348102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9ee9a-684b-4d7f-95d7-c74e28900272 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:10.348557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9ee9a-684b-4d7f-95d7-c74e28900272 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:10.349069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9ee9a-684b-4d7f-95d7-c74e28900272 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:10.349997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9ee9a-684b-4d7f-95d7-c74e28900272 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:10.350460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9ee9a-684b-4d7f-95d7-c74e28900272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:10.353365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9ee9a-684b-4d7f-95d7-c74e28900272 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:10.370542 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 299/599] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:10.376249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9ee9a-684b-4d7f-95d7-c74e28900272 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:10.454813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e69af5-0d04-4d0e-9f92-39041adc93b8 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:10.481297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9ee9a-684b-4d7f-95d7-c74e28900272 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:10.493277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6056068-981c-4e2f-b15e-59256d1b4fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:10.494145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6056068-981c-4e2f-b15e-59256d1b4fcd None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:10.494556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6056068-981c-4e2f-b15e-59256d1b4fcd None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:10.494930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6056068-981c-4e2f-b15e-59256d1b4fcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:10.510603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6056068-981c-4e2f-b15e-59256d1b4fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:10.520928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6056068-981c-4e2f-b15e-59256d1b4fcd None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:10.532266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe647d6-958c-4c87-b8c5-c3eacbfc6dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:10.534338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe647d6-958c-4c87-b8c5-c3eacbfc6dfc None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:10.534998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe647d6-958c-4c87-b8c5-c3eacbfc6dfc None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:10.536344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe647d6-958c-4c87-b8c5-c3eacbfc6dfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:10.554284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe647d6-958c-4c87-b8c5-c3eacbfc6dfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:10.559014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe647d6-958c-4c87-b8c5-c3eacbfc6dfc None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:10.569878 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-a6056068-981c-4e2f-b15e-59256d1b4fcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:10.569878 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:10.569878 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:10.569878 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:10.569878 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:10.569878 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:10.569878 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:10.569878 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:10.569878 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:10.569878 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:10.569878 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:10.569878 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:10.569878 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:10.569878 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:10.569878 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:10.571104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:10.571104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:10.571104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:10.571104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:10.571104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:10.571104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:10.571104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:10.571104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:10.571104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:10.571104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:10.571104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:10.571104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:10.571104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:10.571104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:10.571104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:10.571104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:10.571104 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:10.572223 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:10.572223 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:10.572223 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:10.572223 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:10.574448 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 301/600] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:10.580064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6056068-981c-4e2f-b15e-59256d1b4fcd None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:10.595411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-dfe647d6-958c-4c87-b8c5-c3eacbfc6dfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:10.595411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:10.595411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:10.595411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:10.595411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:10.595411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:10.595411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:10.595411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:10.595411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:10.595411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:10.595411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:10.595411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:10.595411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:10.595411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:10.595411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:10.596562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:10.596562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:10.596562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:10.596562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:10.596562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:10.596562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:10.596562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:10.596562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:10.596562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:10.596562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:10.596562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:10.596562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:10.596562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:10.596562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:10.596562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:10.596562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:10.596562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:10.597748 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:10.597748 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:10.597748 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:10.597748 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:10.597748 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:10.597748 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:10.597748 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:10.597748 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:10.603164 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 300/601] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:10.609189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe647d6-958c-4c87-b8c5-c3eacbfc6dfc None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:10.722045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6056068-981c-4e2f-b15e-59256d1b4fcd None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:10.725300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe647d6-958c-4c87-b8c5-c3eacbfc6dfc None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:10.758276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d422636-2281-40bc-887d-3bd546af9b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:10.758877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d422636-2281-40bc-887d-3bd546af9b33 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:10.759162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d422636-2281-40bc-887d-3bd546af9b33 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:10.759443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d422636-2281-40bc-887d-3bd546af9b33 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:10.760172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d422636-2281-40bc-887d-3bd546af9b33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:10.760487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d422636-2281-40bc-887d-3bd546af9b33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:10.761895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d422636-2281-40bc-887d-3bd546af9b33 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:10.763056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4438672-e8ac-4c05-b35f-bf32e5874061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:10.763662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4438672-e8ac-4c05-b35f-bf32e5874061 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:10.764040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4438672-e8ac-4c05-b35f-bf32e5874061 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:10.764412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4438672-e8ac-4c05-b35f-bf32e5874061 None admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:10.765328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4438672-e8ac-4c05-b35f-bf32e5874061 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:10.765771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4438672-e8ac-4c05-b35f-bf32e5874061 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:10.767272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4438672-e8ac-4c05-b35f-bf32e5874061 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:10.774239 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 302/602] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:10.779062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d422636-2281-40bc-887d-3bd546af9b33 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:10.780464 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 301/603] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:10.802211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4438672-e8ac-4c05-b35f-bf32e5874061 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:10.889856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d422636-2281-40bc-887d-3bd546af9b33 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:10.926226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f65a2-8ca8-490e-adc4-e12fd2b0cf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:10.927030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f65a2-8ca8-490e-adc4-e12fd2b0cf20 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:10.927318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f65a2-8ca8-490e-adc4-e12fd2b0cf20 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:10.927600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f65a2-8ca8-490e-adc4-e12fd2b0cf20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:10.935287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f65a2-8ca8-490e-adc4-e12fd2b0cf20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:10.937230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f65a2-8ca8-490e-adc4-e12fd2b0cf20 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:10.953827 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-6a2f65a2-8ca8-490e-adc4-e12fd2b0cf20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:10.953827 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:10.953827 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:10.953827 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:10.953827 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:10.953827 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:10.953827 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:10.953827 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:10.953827 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:10.953827 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:10.953827 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:10.953827 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:10.953827 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:10.953827 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:10.953827 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:10.954761 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:10.954761 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:10.954761 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:10.954761 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:10.954761 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:10.954761 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:10.954761 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:10.954761 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:10.954761 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:10.954761 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:10.954761 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:10.954761 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:10.954761 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:10.954761 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:10.954761 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:10.954761 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:10.954761 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:10.955633 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:10.955633 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:10.955633 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:10.955633 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:10.955633 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:10.955633 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:10.955633 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:10.955633 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:10.955633 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 303/604] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:10.960364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f65a2-8ca8-490e-adc4-e12fd2b0cf20 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:11.031075 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4438672-e8ac-4c05-b35f-bf32e5874061 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:11.069503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f65a2-8ca8-490e-adc4-e12fd2b0cf20 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:11.107530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e027aeb-3272-4a64-8430-ea622f56b2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:11.108342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e027aeb-3272-4a64-8430-ea622f56b2d7 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:11.108555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f04833-495e-40fd-a5d0-b5d58a707fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:11.108863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e027aeb-3272-4a64-8430-ea622f56b2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:11.109248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e027aeb-3272-4a64-8430-ea622f56b2d7 None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:11.109948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f04833-495e-40fd-a5d0-b5d58a707fb3 None admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:11.110270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e027aeb-3272-4a64-8430-ea622f56b2d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:11.110562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f04833-495e-40fd-a5d0-b5d58a707fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:11.110774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e027aeb-3272-4a64-8430-ea622f56b2d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:11.111126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f04833-495e-40fd-a5d0-b5d58a707fb3 None admin] PATH_INFO: `/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/08bc0cd97b6f45339f5dcf1a264b5ae2/roles/a47492f29bc144158c1c2ed9a4c39d39` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:11.116620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e027aeb-3272-4a64-8430-ea622f56b2d7 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:11.126667 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 304/605] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:11.135335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e027aeb-3272-4a64-8430-ea622f56b2d7 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:11.147016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f04833-495e-40fd-a5d0-b5d58a707fb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=972cae0aa9694d6cad22fbdbcf916ff7, user_id=08bc0cd97b6f45339f5dcf1a264b5ae2, role_id=a47492f29bc144158c1c2ed9a4c39d39)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:11.149073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f04833-495e-40fd-a5d0-b5d58a707fb3 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:11.247720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e027aeb-3272-4a64-8430-ea622f56b2d7 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:11.284463 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 302/606] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 09:58:10 2022] PUT /identity/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/08bc0cd97b6f45339f5dcf1a264b5ae2/roles/a47492f29bc144158c1c2ed9a4c39d39 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:58:11.287610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee2f8c-3c45-4a8c-9cb9-abc9ad193c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:11.288520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee2f8c-3c45-4a8c-9cb9-abc9ad193c99 None admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:11.288882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee2f8c-3c45-4a8c-9cb9-abc9ad193c99 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:11.289168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee2f8c-3c45-4a8c-9cb9-abc9ad193c99 None admin] PATH_INFO: `/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/4cd9fe10f94f43aeb3eb10009ee96ea9/roles/a47492f29bc144158c1c2ed9a4c39d39` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:11.306582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee2f8c-3c45-4a8c-9cb9-abc9ad193c99 None admin] RBAC: Authorizing `identity:create_grant(project_id=972cae0aa9694d6cad22fbdbcf916ff7, user_id=4cd9fe10f94f43aeb3eb10009ee96ea9, role_id=a47492f29bc144158c1c2ed9a4c39d39)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:11.308113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee2f8c-3c45-4a8c-9cb9-abc9ad193c99 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:11.395717 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 305/607] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 09:58:11 2022] PUT /identity/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/4cd9fe10f94f43aeb3eb10009ee96ea9/roles/a47492f29bc144158c1c2ed9a4c39d39 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:58:12.145046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb61ce-27d1-41c3-b5b7-310ecbb52c74 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:12.145605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb61ce-27d1-41c3-b5b7-310ecbb52c74 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:12.145605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb61ce-27d1-41c3-b5b7-310ecbb52c74 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:12.147257 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 303/608] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:12.153219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02591688-5e62-469b-802b-7b15c6678989 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:12.153633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02591688-5e62-469b-802b-7b15c6678989 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:12.153633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02591688-5e62-469b-802b-7b15c6678989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:12.176023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-02591688-5e62-469b-802b-7b15c6678989 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:12.177256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-02591688-5e62-469b-802b-7b15c6678989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:12.271836 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 306/609] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:58:12.309568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb61ce-27d1-41c3-b5b7-310ecbb52c74 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:12.438923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb61ce-27d1-41c3-b5b7-310ecbb52c74 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:12.493334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c45635-8ecf-4760-9acb-7dde5c853a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:12.494165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c45635-8ecf-4760-9acb-7dde5c853a39 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:12.494451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c45635-8ecf-4760-9acb-7dde5c853a39 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:12.494733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c45635-8ecf-4760-9acb-7dde5c853a39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:12.509666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c45635-8ecf-4760-9acb-7dde5c853a39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:12.517777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-98c45635-8ecf-4760-9acb-7dde5c853a39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:12.517777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:12.517777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:12.517777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:12.517777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:12.517777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:12.517777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:12.517777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:12.517777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:12.517777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:12.517777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:12.517777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:12.517777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:12.517777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:12.517777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:12.517777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:12.520023 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:12.520023 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:12.520023 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:12.520023 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:12.520023 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:12.520023 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:12.520023 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:12.520023 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:12.520023 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:12.520023 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:12.520023 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:12.520023 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:12.520023 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:12.520023 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:12.520023 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:12.520023 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:12.520904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:12.520904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:12.520904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:12.520904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:12.520904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:12.520904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:12.520904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:12.520904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:12.520904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:12.520904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:12.520904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:12.520904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:12.520904 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 304/610] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 09:58:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:12.528636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02591688-5e62-469b-802b-7b15c6678989 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:12.661898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02591688-5e62-469b-802b-7b15c6678989 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:12.706371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c58b33-e992-488c-ad76-f5897384f78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:12.706974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c58b33-e992-488c-ad76-f5897384f78b None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:12.707255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c58b33-e992-488c-ad76-f5897384f78b None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:12.707534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c58b33-e992-488c-ad76-f5897384f78b None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:12.708296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c58b33-e992-488c-ad76-f5897384f78b None admin] RBAC: Adding query filter params (name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:12.708626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c58b33-e992-488c-ad76-f5897384f78b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:12.710015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c58b33-e992-488c-ad76-f5897384f78b None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:12.723912 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 307/611] 10.222.0.16 () {56 vars in 1103 bytes} [Mon May 2 09:58:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:12.729537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c45635-8ecf-4760-9acb-7dde5c853a39 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:12.745685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506ee27-9f06-446b-9ef9-663eb5c9fbeb None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:12.745977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506ee27-9f06-446b-9ef9-663eb5c9fbeb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:12.746249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506ee27-9f06-446b-9ef9-663eb5c9fbeb None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:12.747882 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 308/612] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:58:12.752841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880012b-fc0c-4e68-9cec-aad93ad4742e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:12.753134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880012b-fc0c-4e68-9cec-aad93ad4742e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:12.753447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880012b-fc0c-4e68-9cec-aad93ad4742e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:12.770553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0880012b-fc0c-4e68-9cec-aad93ad4742e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:12.771926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0880012b-fc0c-4e68-9cec-aad93ad4742e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:12.844714 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 309/613] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:58:12.865220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880012b-fc0c-4e68-9cec-aad93ad4742e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:12.935445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c45635-8ecf-4760-9acb-7dde5c853a39 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:12.964037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880012b-fc0c-4e68-9cec-aad93ad4742e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:12.999035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12eb856-2c75-48bf-80fe-9753498ccee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:12.999848 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12eb856-2c75-48bf-80fe-9753498ccee7 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:13.000147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12eb856-2c75-48bf-80fe-9753498ccee7 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:13.000402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12eb856-2c75-48bf-80fe-9753498ccee7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:13.012890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12eb856-2c75-48bf-80fe-9753498ccee7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:13.014839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c0591-242a-4137-8701-1681299a9ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:13.015653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c0591-242a-4137-8701-1681299a9ec7 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:13.015940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c0591-242a-4137-8701-1681299a9ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:13.016223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c0591-242a-4137-8701-1681299a9ec7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:13.021186 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-a12eb856-2c75-48bf-80fe-9753498ccee7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:13.021186 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:13.021186 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:13.021186 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:13.021186 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:13.021186 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:13.021186 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:13.021186 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:13.021186 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:13.021186 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:13.021186 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:13.021186 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:13.021186 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:13.021186 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:13.021186 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:13.021186 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:13.022268 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:13.022268 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:13.022268 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:13.022268 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:13.022268 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:13.022268 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:13.022268 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:13.022268 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:13.022268 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:13.022268 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:13.022268 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:13.022268 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:13.022268 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:13.022268 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:13.022268 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:13.022268 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:13.023086 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:13.023086 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:13.023086 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:13.023086 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:13.023086 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:13.023086 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:13.023086 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:13.023086 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:13.023086 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:13.023086 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:13.023086 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:13.023086 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:13.027596 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 310/614] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 09:58:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:13.029063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12eb856-2c75-48bf-80fe-9753498ccee7 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:13.047037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c0591-242a-4137-8701-1681299a9ec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:13.048713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c0591-242a-4137-8701-1681299a9ec7 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:13.081812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-bf0c0591-242a-4137-8701-1681299a9ec7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:13.081812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:13.081812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:13.081812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:13.081812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:13.081812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:13.081812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:13.081812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:13.081812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:13.081812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:13.081812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:13.081812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:13.081812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:13.081812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:13.081812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:13.082777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:13.082777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:13.082777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:13.082777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:13.082777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:13.082777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:13.082777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:13.082777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:13.082777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:13.082777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:13.082777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:13.082777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:13.082777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:13.082777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:13.082777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:13.082777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:13.082777 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:13.083669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:13.083669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:13.083669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:13.083669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:13.093082 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 305/615] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:13.118233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c0591-242a-4137-8701-1681299a9ec7 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:13.137518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12eb856-2c75-48bf-80fe-9753498ccee7 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:13.171002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70feecd4-b963-45b2-a7aa-dab8f43299d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:13.171657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70feecd4-b963-45b2-a7aa-dab8f43299d4 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:13.171942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70feecd4-b963-45b2-a7aa-dab8f43299d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:13.172225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70feecd4-b963-45b2-a7aa-dab8f43299d4 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:13.173328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70feecd4-b963-45b2-a7aa-dab8f43299d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:13.173673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70feecd4-b963-45b2-a7aa-dab8f43299d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:13.175070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70feecd4-b963-45b2-a7aa-dab8f43299d4 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:13.189750 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 311/616] 10.222.0.16 () {56 vars in 1103 bytes} [Mon May 2 09:58:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:13.190967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70feecd4-b963-45b2-a7aa-dab8f43299d4 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:13.279165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c0591-242a-4137-8701-1681299a9ec7 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:13.293157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70feecd4-b963-45b2-a7aa-dab8f43299d4 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:13.312733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e5798-14de-4d54-a044-9e7d7a7da80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:13.313403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e5798-14de-4d54-a044-9e7d7a7da80e None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:13.313691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e5798-14de-4d54-a044-9e7d7a7da80e None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:13.313973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e5798-14de-4d54-a044-9e7d7a7da80e None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:13.314698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e5798-14de-4d54-a044-9e7d7a7da80e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:13.315010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e5798-14de-4d54-a044-9e7d7a7da80e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:13.316372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e5798-14de-4d54-a044-9e7d7a7da80e None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:13.326436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12f471-943a-4a50-9bed-a50f930bdc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:13.327226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12f471-943a-4a50-9bed-a50f930bdc22 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:13.327639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12f471-943a-4a50-9bed-a50f930bdc22 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:13.327923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12f471-943a-4a50-9bed-a50f930bdc22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:13.329141 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 306/617] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:13.330476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89e841-4824-4cf3-a830-db884f0de608 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:13.330766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89e841-4824-4cf3-a830-db884f0de608 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:13.331049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89e841-4824-4cf3-a830-db884f0de608 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:13.332537 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 307/618] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:13.337855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608021f-84c9-410c-b45d-f7bf271673dd None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:13.338150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608021f-84c9-410c-b45d-f7bf271673dd None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:13.338433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608021f-84c9-410c-b45d-f7bf271673dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:13.339558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12f471-943a-4a50-9bed-a50f930bdc22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:13.341035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12f471-943a-4a50-9bed-a50f930bdc22 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:13.355745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b608021f-84c9-410c-b45d-f7bf271673dd None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:13.356997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b608021f-84c9-410c-b45d-f7bf271673dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:13.358279 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-9d12f471-943a-4a50-9bed-a50f930bdc22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:13.358279 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:13.358279 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:13.358279 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:13.358279 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:13.358279 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:13.358279 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:13.358279 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:13.358279 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:13.358279 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:13.358279 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:13.358279 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:13.358279 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:13.358279 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:13.358279 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:13.359984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:13.359984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:13.359984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:13.359984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:13.359984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:13.359984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:13.359984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:13.359984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:13.359984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:13.359984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:13.359984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:13.359984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:13.359984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:13.359984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:13.359984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:13.359984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:13.359984 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:13.362227 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:13.362227 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:13.362227 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:13.362227 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:13.368623 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 312/619] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:13.368623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12f471-943a-4a50-9bed-a50f930bdc22 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:13.424512 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 308/620] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:58:13.425452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608021f-84c9-410c-b45d-f7bf271673dd None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:13.467551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12f471-943a-4a50-9bed-a50f930bdc22 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:13.504423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f8655-d351-4ad0-aaff-991eed6df03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:13.505255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f8655-d351-4ad0-aaff-991eed6df03c None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:13.505537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f8655-d351-4ad0-aaff-991eed6df03c None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:13.505813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f8655-d351-4ad0-aaff-991eed6df03c None admin] PATH_INFO: `/v3/users/swift` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:13.513716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f8655-d351-4ad0-aaff-991eed6df03c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:13.515175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f8655-d351-4ad0-aaff-991eed6df03c None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:13.530921 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-569f8655-d351-4ad0-aaff-991eed6df03c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 02 09:58:13.530921 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:13.530921 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:13.530921 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:13.530921 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:13.530921 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:13.530921 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:13.530921 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:13.530921 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:13.530921 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:13.530921 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:13.530921 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:13.530921 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:13.530921 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:13.530921 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:13.530921 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:13.533306 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:13.533306 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:13.533306 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:13.533306 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:13.533306 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:13.533306 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:13.533306 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:13.533306 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:13.533306 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:13.533306 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:13.533306 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:13.533306 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:13.533306 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:13.533306 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:13.533306 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:13.533306 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:13.533306 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:13.533306 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:13.535772 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:13.535772 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:13.535772 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:13.535772 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:13.535772 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:13.535772 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:13.535772 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:13.535772 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:13.535772 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 02 09:58:13.535772 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:13.535772 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 313/621] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:58:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:13.535772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f8655-d351-4ad0-aaff-991eed6df03c None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:13.537248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608021f-84c9-410c-b45d-f7bf271673dd None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:13.576455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08dce1f-23e9-4e3d-bc15-b763c6db1f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:13.577574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dce1f-23e9-4e3d-bc15-b763c6db1f47 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:13.577939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dce1f-23e9-4e3d-bc15-b763c6db1f47 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:13.578547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dce1f-23e9-4e3d-bc15-b763c6db1f47 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:13.579347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08dce1f-23e9-4e3d-bc15-b763c6db1f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:13.579659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08dce1f-23e9-4e3d-bc15-b763c6db1f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:13.582544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08dce1f-23e9-4e3d-bc15-b763c6db1f47 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:13.600703 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 309/622] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:13.602124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08dce1f-23e9-4e3d-bc15-b763c6db1f47 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:13.650577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f8655-d351-4ad0-aaff-991eed6df03c None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:13.692758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fc2fe-e22e-4e21-a126-6161ec0d9283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:13.693971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fc2fe-e22e-4e21-a126-6161ec0d9283 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:13.694260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fc2fe-e22e-4e21-a126-6161ec0d9283 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:13.694723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fc2fe-e22e-4e21-a126-6161ec0d9283 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:13.703845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08dce1f-23e9-4e3d-bc15-b763c6db1f47 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:13.708020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fc2fe-e22e-4e21-a126-6161ec0d9283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:13.718184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-755fc2fe-e22e-4e21-a126-6161ec0d9283 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:13.718184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:13.718184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:13.718184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:13.718184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:13.718184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:13.718184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:13.718184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:13.718184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:13.718184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:13.718184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:13.718184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:13.718184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:13.718184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:13.718184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:13.718184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:13.719994 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:13.719994 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:13.719994 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:13.719994 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:13.719994 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:13.719994 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:13.719994 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:13.719994 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:13.719994 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:13.719994 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:13.719994 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:13.719994 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:13.719994 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:13.719994 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:13.719994 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:13.719994 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:13.720936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:13.720936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:13.720936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:13.720936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:13.720936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:13.720936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:13.720936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:13.720936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:13.720936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:13.720936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:13.720936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:13.720936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:13.720936 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 314/623] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 09:58:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:13.720936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fc2fe-e22e-4e21-a126-6161ec0d9283 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:13.745273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc3dc2-5a53-4a90-a7cc-cbef33716f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:13.746109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc3dc2-5a53-4a90-a7cc-cbef33716f66 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:13.746468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc3dc2-5a53-4a90-a7cc-cbef33716f66 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:13.746874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc3dc2-5a53-4a90-a7cc-cbef33716f66 None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:13.747799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc3dc2-5a53-4a90-a7cc-cbef33716f66 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:13.748188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc3dc2-5a53-4a90-a7cc-cbef33716f66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:13.749756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc3dc2-5a53-4a90-a7cc-cbef33716f66 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:13.770365 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 310/624] 10.222.0.16 () {56 vars in 1135 bytes} [Mon May 2 09:58:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:13.771353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc3dc2-5a53-4a90-a7cc-cbef33716f66 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:13.850660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fc2fe-e22e-4e21-a126-6161ec0d9283 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:13.875618 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc3dc2-5a53-4a90-a7cc-cbef33716f66 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:13.894918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b1ed8-fe10-4ef8-a016-e802bedcd050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:13.895732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b1ed8-fe10-4ef8-a016-e802bedcd050 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:13.896020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b1ed8-fe10-4ef8-a016-e802bedcd050 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:13.896299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b1ed8-fe10-4ef8-a016-e802bedcd050 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:13.907548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b1ed8-fe10-4ef8-a016-e802bedcd050 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:13.909221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b1ed8-fe10-4ef8-a016-e802bedcd050 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:13.911363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fafa00-3c0f-4cba-8a6a-96e173e39923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:13.912146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fafa00-3c0f-4cba-8a6a-96e173e39923 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:13.912539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fafa00-3c0f-4cba-8a6a-96e173e39923 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:13.912954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fafa00-3c0f-4cba-8a6a-96e173e39923 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:13.913852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fafa00-3c0f-4cba-8a6a-96e173e39923 None admin] RBAC: Adding query filter params (name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:13.914269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fafa00-3c0f-4cba-8a6a-96e173e39923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:13.915763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fafa00-3c0f-4cba-8a6a-96e173e39923 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:13.924852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-fb8b1ed8-fe10-4ef8-a016-e802bedcd050 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 02 09:58:13.924852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:13.924852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:13.924852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:13.924852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:13.924852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:13.924852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:13.924852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:13.924852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:13.924852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:13.924852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:13.924852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:13.924852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:13.924852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:13.924852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:13.924852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:13.927019 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:13.927019 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:13.927019 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:13.927019 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:13.927019 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:13.927019 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:13.927019 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:13.927019 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:13.927019 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:13.927019 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:13.927019 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:13.927019 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:13.927019 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:13.927019 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:13.927019 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:13.927019 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:13.927019 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:13.927019 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:13.929287 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:13.929287 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:13.929287 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:13.929287 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:13.929287 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:13.929287 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:13.929287 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:13.929287 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:13.929287 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 02 09:58:13.929287 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:13.930590 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 311/626] 10.222.0.16 () {56 vars in 1103 bytes} [Mon May 2 09:58:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:13.930746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fafa00-3c0f-4cba-8a6a-96e173e39923 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:13.930888 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 315/626] 10.222.0.16 () {56 vars in 1093 bytes} [Mon May 2 09:58:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:13.940622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b1ed8-fe10-4ef8-a016-e802bedcd050 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:14.032962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fafa00-3c0f-4cba-8a6a-96e173e39923 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:14.057207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b1ed8-fe10-4ef8-a016-e802bedcd050 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:14.075029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48c0d2-602f-42d4-8665-b319b02c28d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:14.076090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48c0d2-602f-42d4-8665-b319b02c28d1 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:14.076374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48c0d2-602f-42d4-8665-b319b02c28d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:14.076828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48c0d2-602f-42d4-8665-b319b02c28d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:14.091644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48c0d2-602f-42d4-8665-b319b02c28d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:14.093403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48c0d2-602f-42d4-8665-b319b02c28d1 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:14.094689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03565ca5-2400-43fc-8493-44ed4d7000e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:14.095569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03565ca5-2400-43fc-8493-44ed4d7000e7 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:14.095932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03565ca5-2400-43fc-8493-44ed4d7000e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:14.098238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03565ca5-2400-43fc-8493-44ed4d7000e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:14.111443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03565ca5-2400-43fc-8493-44ed4d7000e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:14.113266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03565ca5-2400-43fc-8493-44ed4d7000e7 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:14.114221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-9c48c0d2-602f-42d4-8665-b319b02c28d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:14.114221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:14.114221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:14.114221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:14.114221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:14.114221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:14.114221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:14.114221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:14.114221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:14.114221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:14.114221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:14.114221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:14.114221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:14.114221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:14.114221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:14.115105 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:14.115105 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:14.115105 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:14.115105 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:14.115105 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:14.115105 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:14.115105 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:14.115105 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:14.115105 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:14.115105 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:14.115105 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:14.115105 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:14.115105 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:14.115105 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:14.115105 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:14.115105 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:14.115105 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:14.115980 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:14.115980 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:14.115980 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:14.115980 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:14.118636 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 312/627] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:14.119861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48c0d2-602f-42d4-8665-b319b02c28d1 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:14.135881 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-03565ca5-2400-43fc-8493-44ed4d7000e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:14.135881 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:14.135881 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:14.135881 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:14.135881 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:14.135881 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:14.135881 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:14.135881 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:14.135881 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:14.135881 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:14.135881 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:14.135881 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:14.135881 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:14.135881 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:14.135881 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:14.137270 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:14.137270 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:14.137270 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:14.137270 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:14.137270 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:14.137270 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:14.137270 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:14.137270 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:14.137270 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:14.137270 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:14.137270 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:14.137270 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:14.137270 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:14.137270 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:14.137270 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:14.137270 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:14.137270 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:14.138151 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:14.138151 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:14.138151 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:14.138151 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:14.144810 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 316/628] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:14.146190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03565ca5-2400-43fc-8493-44ed4d7000e7 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:14.246979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03565ca5-2400-43fc-8493-44ed4d7000e7 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:14.248349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48c0d2-602f-42d4-8665-b319b02c28d1 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:14.283047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c3e80-b973-40ee-b89c-583353a4a0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:14.284102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c3e80-b973-40ee-b89c-583353a4a0ef None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:14.284744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c3e80-b973-40ee-b89c-583353a4a0ef None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:14.285230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c3e80-b973-40ee-b89c-583353a4a0ef None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:14.286164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c3e80-b973-40ee-b89c-583353a4a0ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:14.286697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c3e80-b973-40ee-b89c-583353a4a0ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:14.288272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c3e80-b973-40ee-b89c-583353a4a0ef None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:14.288562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c14c7-f6e7-45c6-b34b-7f56107fe90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:14.289350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c14c7-f6e7-45c6-b34b-7f56107fe90c None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:14.289633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c14c7-f6e7-45c6-b34b-7f56107fe90c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:14.289915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c14c7-f6e7-45c6-b34b-7f56107fe90c None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:14.290745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c14c7-f6e7-45c6-b34b-7f56107fe90c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:14.291053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c14c7-f6e7-45c6-b34b-7f56107fe90c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:14.292894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c14c7-f6e7-45c6-b34b-7f56107fe90c None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:14.302913 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 317/629] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:14.304112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c3e80-b973-40ee-b89c-583353a4a0ef None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:14.316687 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 313/630] 10.222.0.16 () {56 vars in 1133 bytes} [Mon May 2 09:58:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:14.317931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c14c7-f6e7-45c6-b34b-7f56107fe90c None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:14.404144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c3e80-b973-40ee-b89c-583353a4a0ef None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:14.413371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c14c7-f6e7-45c6-b34b-7f56107fe90c None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:14.435460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b2fae-17ff-49ee-8de2-e8abc198504f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:14.436118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b2fae-17ff-49ee-8de2-e8abc198504f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:14.436400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b2fae-17ff-49ee-8de2-e8abc198504f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:14.436712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b2fae-17ff-49ee-8de2-e8abc198504f None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:14.437433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b2fae-17ff-49ee-8de2-e8abc198504f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:14.437748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b2fae-17ff-49ee-8de2-e8abc198504f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:14.439109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b2fae-17ff-49ee-8de2-e8abc198504f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:14.444901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c587b40-9840-48f6-99db-a25a1068de71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:14.446269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c587b40-9840-48f6-99db-a25a1068de71 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:14.446552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c587b40-9840-48f6-99db-a25a1068de71 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:14.446824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c587b40-9840-48f6-99db-a25a1068de71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:14.450231 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 318/631] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:14.451013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b2fae-17ff-49ee-8de2-e8abc198504f None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:14.453414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c587b40-9840-48f6-99db-a25a1068de71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:14.455089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c587b40-9840-48f6-99db-a25a1068de71 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:14.468350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-2c587b40-9840-48f6-99db-a25a1068de71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:14.468350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:14.468350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:14.468350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:14.468350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:14.468350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:14.468350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:14.468350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:14.468350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:14.468350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:14.468350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:14.468350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:14.468350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:14.468350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:14.468350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:14.469456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:14.469456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:14.469456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:14.469456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:14.469456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:14.469456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:14.469456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:14.469456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:14.469456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:14.469456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:14.469456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:14.469456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:14.469456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:14.469456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:14.469456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:14.469456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:14.469456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:14.470453 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:14.470453 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:14.470453 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:14.470453 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:14.470453 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:14.470453 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:14.470453 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:14.470453 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:14.470453 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 314/632] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:14.470965 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd7aa2-1083-4fcf-bee6-aa4a68c60ed2 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:14.471251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd7aa2-1083-4fcf-bee6-aa4a68c60ed2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:14.471555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd7aa2-1083-4fcf-bee6-aa4a68c60ed2 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:14.472800 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 315/633] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:14.479019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f7a7d-7d4c-4728-8f22-25aff0e3b11c None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:14.479019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f7a7d-7d4c-4728-8f22-25aff0e3b11c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:14.479019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f7a7d-7d4c-4728-8f22-25aff0e3b11c None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:14.479019 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 316/634] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:14.479019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f7a7d-7d4c-4728-8f22-25aff0e3b11c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:14.549621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b2fae-17ff-49ee-8de2-e8abc198504f None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:14.574889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f7a7d-7d4c-4728-8f22-25aff0e3b11c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:14.580827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a96623-a317-45be-8b51-e40c68588a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:14.581472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a96623-a317-45be-8b51-e40c68588a29 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:14.581753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a96623-a317-45be-8b51-e40c68588a29 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:14.582029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a96623-a317-45be-8b51-e40c68588a29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:14.606666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60c704-7da1-4baf-b203-4574ee30da2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:14.607450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60c704-7da1-4baf-b203-4574ee30da2f None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:14.607734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60c704-7da1-4baf-b203-4574ee30da2f None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:14.608016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60c704-7da1-4baf-b203-4574ee30da2f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:14.615210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60c704-7da1-4baf-b203-4574ee30da2f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:14.616682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60c704-7da1-4baf-b203-4574ee30da2f None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:14.631057 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-9b60c704-7da1-4baf-b203-4574ee30da2f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 02 09:58:14.631057 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:14.631057 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:14.631057 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:14.631057 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:14.631057 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:14.631057 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:14.631057 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:14.631057 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:14.631057 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:14.631057 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:14.631057 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:14.631057 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:14.631057 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:14.631057 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:14.631057 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:14.632014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:14.632014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:14.632014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:14.632014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:14.632014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:14.632014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:14.632014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:14.632014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:14.632014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:14.632014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:14.632014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:14.632014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:14.632014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:14.632014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:14.632014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:14.632014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:14.632014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:14.632014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:14.633029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:14.633029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:14.633029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:14.633029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:14.633029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:14.633029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:14.633029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:14.633029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:14.633029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 02 09:58:14.633029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:14.633029 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 317/635] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:58:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:14.633664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60c704-7da1-4baf-b203-4574ee30da2f None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:14.648949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a96623-a317-45be-8b51-e40c68588a29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:14.650398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a96623-a317-45be-8b51-e40c68588a29 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:14.725097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60c704-7da1-4baf-b203-4574ee30da2f None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:14.742171 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 319/636] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:58:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:58:14.743457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c34850-182f-4e1d-8b9b-cf926ae81af2 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:14.743740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c34850-182f-4e1d-8b9b-cf926ae81af2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:14.744013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c34850-182f-4e1d-8b9b-cf926ae81af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:14.758990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bbf2e-ffb8-4485-b7a7-7a7b095d648b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:14.759648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bbf2e-ffb8-4485-b7a7-7a7b095d648b None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:14.759934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bbf2e-ffb8-4485-b7a7-7a7b095d648b None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:14.760215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bbf2e-ffb8-4485-b7a7-7a7b095d648b None admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:14.760563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-43c34850-182f-4e1d-8b9b-cf926ae81af2 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:14.761029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26bbf2e-ffb8-4485-b7a7-7a7b095d648b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:14.761344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26bbf2e-ffb8-4485-b7a7-7a7b095d648b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:14.761754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-43c34850-182f-4e1d-8b9b-cf926ae81af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:14.762771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26bbf2e-ffb8-4485-b7a7-7a7b095d648b None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:14.774418 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 318/637] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:14.775612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2251c-b65c-4bed-ab68-c8056f038784 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:14.775902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2251c-b65c-4bed-ab68-c8056f038784 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:14.776187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2251c-b65c-4bed-ab68-c8056f038784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:14.791590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d2b2251c-b65c-4bed-ab68-c8056f038784 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:14.792809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d2b2251c-b65c-4bed-ab68-c8056f038784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:14.824914 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 320/638] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:58:14.825771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c34850-182f-4e1d-8b9b-cf926ae81af2 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:14.857635 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 319/639] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:58:14.858482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2251c-b65c-4bed-ab68-c8056f038784 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:14.919189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c34850-182f-4e1d-8b9b-cf926ae81af2 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:14.950703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965494e-0a12-44b9-9a2b-5718c0085284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:14.950992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2251c-b65c-4bed-ab68-c8056f038784 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:14.951364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965494e-0a12-44b9-9a2b-5718c0085284 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:14.951644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965494e-0a12-44b9-9a2b-5718c0085284 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:14.951918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965494e-0a12-44b9-9a2b-5718c0085284 None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:14.952770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965494e-0a12-44b9-9a2b-5718c0085284 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:14.953079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965494e-0a12-44b9-9a2b-5718c0085284 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:14.954522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965494e-0a12-44b9-9a2b-5718c0085284 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:14.970381 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 321/640] 10.222.0.16 () {56 vars in 1137 bytes} [Mon May 2 09:58:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:14.971139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965494e-0a12-44b9-9a2b-5718c0085284 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:14.986542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214450d9-70cd-4c29-b553-fba31d43595d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:14.987274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214450d9-70cd-4c29-b553-fba31d43595d None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:14.987558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214450d9-70cd-4c29-b553-fba31d43595d None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:14.988091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214450d9-70cd-4c29-b553-fba31d43595d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:14.998350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214450d9-70cd-4c29-b553-fba31d43595d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:14.999789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214450d9-70cd-4c29-b553-fba31d43595d None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:15.017099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-214450d9-70cd-4c29-b553-fba31d43595d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:15.017099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:15.017099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:15.017099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:15.017099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:15.017099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:15.017099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:15.017099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:15.017099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:15.017099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:15.017099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:15.017099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:15.017099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:15.017099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:15.017099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:15.018147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:15.018147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:15.018147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:15.018147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:15.018147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:15.018147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:15.018147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:15.018147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:15.018147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:15.018147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:15.018147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:15.018147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:15.018147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:15.018147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:15.018147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:15.018147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:15.018147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:15.019082 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:15.019082 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:15.019082 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:15.019082 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:15.019082 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 320/641] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:15.019082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214450d9-70cd-4c29-b553-fba31d43595d None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:15.065662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965494e-0a12-44b9-9a2b-5718c0085284 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:15.097708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a3ae2-03cd-4600-8230-d59ab74b8256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:15.098597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a3ae2-03cd-4600-8230-d59ab74b8256 None admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:15.098882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a3ae2-03cd-4600-8230-d59ab74b8256 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:15.099162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a3ae2-03cd-4600-8230-d59ab74b8256 None admin] PATH_INFO: `/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/6573f5c0731c4a18bf2374c3ba006a57/roles/a47492f29bc144158c1c2ed9a4c39d39` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:15.111777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214450d9-70cd-4c29-b553-fba31d43595d None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:15.113392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a3ae2-03cd-4600-8230-d59ab74b8256 None admin] RBAC: Authorizing `identity:create_grant(project_id=972cae0aa9694d6cad22fbdbcf916ff7, user_id=6573f5c0731c4a18bf2374c3ba006a57, role_id=a47492f29bc144158c1c2ed9a4c39d39)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:15.114833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a3ae2-03cd-4600-8230-d59ab74b8256 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:15.144375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e095880-0a42-4fb9-bbcf-e04f3beab830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:15.145187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e095880-0a42-4fb9-bbcf-e04f3beab830 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:15.145470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e095880-0a42-4fb9-bbcf-e04f3beab830 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:15.145743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e095880-0a42-4fb9-bbcf-e04f3beab830 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:15.155307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e095880-0a42-4fb9-bbcf-e04f3beab830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:15.162903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-9e095880-0a42-4fb9-bbcf-e04f3beab830 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:15.162903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:15.162903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:15.162903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:15.162903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:15.162903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:15.162903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:15.162903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:15.162903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:15.162903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:15.162903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:15.162903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:15.162903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:15.162903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:15.162903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:15.162903 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:15.164133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:15.164133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:15.164133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:15.164133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:15.164133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:15.164133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:15.164133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:15.164133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:15.164133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:15.164133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:15.164133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:15.164133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:15.164133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:15.164133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:15.164133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:15.164133 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:15.165048 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:15.165048 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:15.165048 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:15.165048 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:15.165048 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:15.165048 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:15.165048 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:15.165048 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:15.165048 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:15.165048 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:15.165048 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:15.165048 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:15.165048 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 321/642] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 09:58:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:15.166065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e095880-0a42-4fb9-bbcf-e04f3beab830 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:15.203706 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 322/643] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 09:58:14 2022] PUT /identity/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/6573f5c0731c4a18bf2374c3ba006a57/roles/a47492f29bc144158c1c2ed9a4c39d39 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:58:15.204816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a3ae2-03cd-4600-8230-d59ab74b8256 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:15.266168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e095880-0a42-4fb9-bbcf-e04f3beab830 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:15.301237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c458e-b387-4b24-9ee4-969931fe18c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:15.302080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c458e-b387-4b24-9ee4-969931fe18c2 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:15.302338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c458e-b387-4b24-9ee4-969931fe18c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:15.302615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c458e-b387-4b24-9ee4-969931fe18c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:15.309794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a3ae2-03cd-4600-8230-d59ab74b8256 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:15.315180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c458e-b387-4b24-9ee4-969931fe18c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:15.323081 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-227c458e-b387-4b24-9ee4-969931fe18c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:15.323081 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:15.323081 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:15.323081 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:15.323081 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:15.323081 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:15.323081 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:15.323081 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:15.323081 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:15.323081 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:15.323081 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:15.323081 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:15.323081 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:15.323081 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:15.323081 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:15.323081 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:15.324257 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:15.324257 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:15.324257 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:15.324257 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:15.324257 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:15.324257 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:15.324257 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:15.324257 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:15.324257 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:15.324257 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:15.324257 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:15.324257 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:15.324257 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:15.324257 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:15.324257 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:15.324257 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:15.325291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:15.325291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:15.325291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:15.325291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:15.325291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:15.325291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:15.325291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:15.325291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:15.325291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:15.325291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:15.325291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:15.325291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:15.329622 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 322/644] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 09:58:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:15.330512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c458e-b387-4b24-9ee4-969931fe18c2 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:15.348030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4140db-2414-4298-a86e-973aab4807ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:15.348734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4140db-2414-4298-a86e-973aab4807ec None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:15.349006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4140db-2414-4298-a86e-973aab4807ec None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:15.349280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4140db-2414-4298-a86e-973aab4807ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:15.423623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4140db-2414-4298-a86e-973aab4807ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:15.425157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4140db-2414-4298-a86e-973aab4807ec None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:15.443911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c458e-b387-4b24-9ee4-969931fe18c2 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:15.480925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80989712-5edd-4464-86b7-f582d7d711f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:15.481706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80989712-5edd-4464-86b7-f582d7d711f4 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:15.481991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80989712-5edd-4464-86b7-f582d7d711f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:15.482399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80989712-5edd-4464-86b7-f582d7d711f4 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:15.483005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80989712-5edd-4464-86b7-f582d7d711f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:15.483318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80989712-5edd-4464-86b7-f582d7d711f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:15.484705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80989712-5edd-4464-86b7-f582d7d711f4 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:15.500667 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 323/645] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:15.500667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80989712-5edd-4464-86b7-f582d7d711f4 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:15.523751 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 323/646] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:58:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:58:15.524625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4140db-2414-4298-a86e-973aab4807ec None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:15.601732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80989712-5edd-4464-86b7-f582d7d711f4 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:15.623954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4140db-2414-4298-a86e-973aab4807ec None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:15.636349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56024f-f427-4efd-8e4f-ded504e551f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:15.637057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56024f-f427-4efd-8e4f-ded504e551f6 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:15.637343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56024f-f427-4efd-8e4f-ded504e551f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:15.637618 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56024f-f427-4efd-8e4f-ded504e551f6 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:15.638360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56024f-f427-4efd-8e4f-ded504e551f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:15.638668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56024f-f427-4efd-8e4f-ded504e551f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:15.640033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56024f-f427-4efd-8e4f-ded504e551f6 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:15.652823 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 324/647] 10.222.0.16 () {56 vars in 1103 bytes} [Mon May 2 09:58:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:15.652823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56024f-f427-4efd-8e4f-ded504e551f6 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:15.664265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e53aa-bc20-4bd2-b595-3f1c57cbd505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:15.664983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e53aa-bc20-4bd2-b595-3f1c57cbd505 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:15.665265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e53aa-bc20-4bd2-b595-3f1c57cbd505 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:15.665534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e53aa-bc20-4bd2-b595-3f1c57cbd505 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:15.666297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e53aa-bc20-4bd2-b595-3f1c57cbd505 None admin] RBAC: Adding query filter params (name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:15.666567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e53aa-bc20-4bd2-b595-3f1c57cbd505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:15.667934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e53aa-bc20-4bd2-b595-3f1c57cbd505 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:15.675505 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 324/648] 10.222.0.16 () {56 vars in 1103 bytes} [Mon May 2 09:58:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:15.676273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e53aa-bc20-4bd2-b595-3f1c57cbd505 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:15.748134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56024f-f427-4efd-8e4f-ded504e551f6 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:15.769631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e53aa-bc20-4bd2-b595-3f1c57cbd505 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:15.780666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae1485-508d-4596-8a6e-7379afdc1cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:15.781390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae1485-508d-4596-8a6e-7379afdc1cf0 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:15.781673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae1485-508d-4596-8a6e-7379afdc1cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:15.781948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae1485-508d-4596-8a6e-7379afdc1cf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:15.788687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae1485-508d-4596-8a6e-7379afdc1cf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:15.790634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae1485-508d-4596-8a6e-7379afdc1cf0 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:15.802804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7185c-634c-4410-9893-2b940a56f7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:15.803599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7185c-634c-4410-9893-2b940a56f7b4 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:15.803889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7185c-634c-4410-9893-2b940a56f7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:15.804168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7185c-634c-4410-9893-2b940a56f7b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:15.804839 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-7dae1485-508d-4596-8a6e-7379afdc1cf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:15.804839 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:15.804839 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:15.804839 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:15.804839 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:15.804839 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:15.804839 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:15.804839 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:15.804839 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:15.804839 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:15.804839 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:15.804839 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:15.804839 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:15.804839 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:15.804839 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:15.805680 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:15.805680 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:15.805680 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:15.805680 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:15.805680 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:15.805680 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:15.805680 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:15.805680 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:15.805680 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:15.805680 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:15.805680 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:15.805680 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:15.805680 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:15.805680 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:15.805680 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:15.805680 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:15.805680 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:15.806652 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:15.806652 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:15.806652 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:15.806652 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:15.806652 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:15.806652 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:15.806652 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:15.806652 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:15.806652 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 325/649] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:15.811230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae1485-508d-4596-8a6e-7379afdc1cf0 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:15.817416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7185c-634c-4410-9893-2b940a56f7b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:15.818901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7185c-634c-4410-9893-2b940a56f7b4 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:15.836579 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-a9a7185c-634c-4410-9893-2b940a56f7b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:15.836579 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:15.836579 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:15.836579 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:15.836579 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:15.836579 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:15.836579 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:15.836579 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:15.836579 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:15.836579 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:15.836579 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:15.836579 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:15.836579 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:15.836579 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:15.836579 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:15.837654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:15.837654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:15.837654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:15.837654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:15.837654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:15.837654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:15.837654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:15.837654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:15.837654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:15.837654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:15.837654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:15.837654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:15.837654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:15.837654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:15.837654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:15.837654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:15.837654 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:15.838559 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:15.838559 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:15.838559 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:15.838559 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:15.838559 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 325/650] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:15.838853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7185c-634c-4410-9893-2b940a56f7b4 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:15.911586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae1485-508d-4596-8a6e-7379afdc1cf0 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:15.937450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7185c-634c-4410-9893-2b940a56f7b4 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:15.946086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966e818-98a4-4387-acf8-d290ec33340b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:15.946721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966e818-98a4-4387-acf8-d290ec33340b None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:15.947348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966e818-98a4-4387-acf8-d290ec33340b None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:15.947490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966e818-98a4-4387-acf8-d290ec33340b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:15.957262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966e818-98a4-4387-acf8-d290ec33340b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:15.958847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966e818-98a4-4387-acf8-d290ec33340b None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:15.971407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc80eb-ca5e-474d-b892-c929b18097cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:15.972206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc80eb-ca5e-474d-b892-c929b18097cd None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:15.972492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc80eb-ca5e-474d-b892-c929b18097cd None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:15.972812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc80eb-ca5e-474d-b892-c929b18097cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:15.977547 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-3966e818-98a4-4387-acf8-d290ec33340b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:15.977547 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:15.977547 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:15.977547 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:15.977547 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:15.977547 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:15.977547 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:15.977547 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:15.977547 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:15.977547 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:15.977547 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:15.977547 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:15.977547 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:15.977547 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:15.977547 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:15.978540 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:15.978540 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:15.978540 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:15.978540 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:15.978540 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:15.978540 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:15.978540 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:15.978540 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:15.978540 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:15.978540 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:15.978540 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:15.978540 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:15.978540 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:15.978540 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:15.978540 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:15.978540 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:15.978540 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:15.979619 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:15.979619 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:15.979619 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:15.979619 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:15.985369 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 326/651] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:15.985369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966e818-98a4-4387-acf8-d290ec33340b None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:15.985577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc80eb-ca5e-474d-b892-c929b18097cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:15.985764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc80eb-ca5e-474d-b892-c929b18097cd None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:16.003282 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-b2fc80eb-ca5e-474d-b892-c929b18097cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:16.003282 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:16.003282 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:16.003282 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:16.003282 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:16.003282 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:16.003282 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:16.003282 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:16.003282 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:16.003282 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:16.003282 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:16.003282 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:16.003282 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:16.003282 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:16.003282 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:16.004379 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:16.004379 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:16.004379 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:16.004379 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:16.004379 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:16.004379 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:16.004379 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:16.004379 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:16.004379 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:16.004379 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:16.004379 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:16.004379 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:16.004379 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:16.004379 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:16.004379 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:16.004379 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:16.004379 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:16.005551 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:16.005551 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:16.005551 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:16.005551 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:16.008990 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 326/652] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:16.009622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc80eb-ca5e-474d-b892-c929b18097cd None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:16.084770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966e818-98a4-4387-acf8-d290ec33340b None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:16.108702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc80eb-ca5e-474d-b892-c929b18097cd None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:16.122572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75271f48-5465-458f-afd4-f08c9ba125ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:16.123240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75271f48-5465-458f-afd4-f08c9ba125ac None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:16.123518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75271f48-5465-458f-afd4-f08c9ba125ac None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:16.123791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75271f48-5465-458f-afd4-f08c9ba125ac None admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:16.124576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75271f48-5465-458f-afd4-f08c9ba125ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:16.124936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75271f48-5465-458f-afd4-f08c9ba125ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:16.126365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75271f48-5465-458f-afd4-f08c9ba125ac None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:16.143781 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 327/653] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:16.143781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75271f48-5465-458f-afd4-f08c9ba125ac None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:16.146305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60be6b8-6faa-4aa7-ab73-7769fc18d60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:16.147018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60be6b8-6faa-4aa7-ab73-7769fc18d60c None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:16.147292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60be6b8-6faa-4aa7-ab73-7769fc18d60c None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:16.147570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60be6b8-6faa-4aa7-ab73-7769fc18d60c None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:16.148892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60be6b8-6faa-4aa7-ab73-7769fc18d60c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:16.149208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60be6b8-6faa-4aa7-ab73-7769fc18d60c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:16.150598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60be6b8-6faa-4aa7-ab73-7769fc18d60c None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:16.166688 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 327/654] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:16.166688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60be6b8-6faa-4aa7-ab73-7769fc18d60c None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:16.241190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75271f48-5465-458f-afd4-f08c9ba125ac None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:16.260750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60be6b8-6faa-4aa7-ab73-7769fc18d60c None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:16.274259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88395d1d-db41-4d62-bf84-534f95f4cae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:16.274924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88395d1d-db41-4d62-bf84-534f95f4cae1 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:16.275205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88395d1d-db41-4d62-bf84-534f95f4cae1 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:16.275479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88395d1d-db41-4d62-bf84-534f95f4cae1 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:16.276196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88395d1d-db41-4d62-bf84-534f95f4cae1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:16.276505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88395d1d-db41-4d62-bf84-534f95f4cae1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:16.277913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88395d1d-db41-4d62-bf84-534f95f4cae1 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:16.293101 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 328/655] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:16.293101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88395d1d-db41-4d62-bf84-534f95f4cae1 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:16.296305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0155411-514f-4fce-b61d-c193ede8a2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:16.297010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0155411-514f-4fce-b61d-c193ede8a2ca None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:16.297294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0155411-514f-4fce-b61d-c193ede8a2ca None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:16.297572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0155411-514f-4fce-b61d-c193ede8a2ca None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:16.298294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0155411-514f-4fce-b61d-c193ede8a2ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:16.298603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0155411-514f-4fce-b61d-c193ede8a2ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:16.299979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0155411-514f-4fce-b61d-c193ede8a2ca None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:16.311151 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 328/656] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:16.312066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0155411-514f-4fce-b61d-c193ede8a2ca None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:16.391378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88395d1d-db41-4d62-bf84-534f95f4cae1 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:16.408304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0155411-514f-4fce-b61d-c193ede8a2ca None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:16.425907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc79d17-d85c-4fc5-9018-d5c8d5cf818b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:16.426559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc79d17-d85c-4fc5-9018-d5c8d5cf818b None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:16.426846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc79d17-d85c-4fc5-9018-d5c8d5cf818b None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:16.427122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc79d17-d85c-4fc5-9018-d5c8d5cf818b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:16.428045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc79d17-d85c-4fc5-9018-d5c8d5cf818b None admin] RBAC: Adding query filter params (role.id=a47492f29bc144158c1c2ed9a4c39d39, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=e6036dd39fb74289a8cbdcd6a21f8662) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:16.428354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc79d17-d85c-4fc5-9018-d5c8d5cf818b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:16.430350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc79d17-d85c-4fc5-9018-d5c8d5cf818b None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:16.436041 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 329/657] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:58:16 2022] GET /identity/v3/role_assignments?user.id=e6036dd39fb74289a8cbdcd6a21f8662&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=a47492f29bc144158c1c2ed9a4c39d39 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:16.436843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc79d17-d85c-4fc5-9018-d5c8d5cf818b None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:16.448489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fa55c-bc64-403b-abf9-b219f5f7055e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:16.449708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fa55c-bc64-403b-abf9-b219f5f7055e None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:16.450201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fa55c-bc64-403b-abf9-b219f5f7055e None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:16.450705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fa55c-bc64-403b-abf9-b219f5f7055e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:16.459209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fa55c-bc64-403b-abf9-b219f5f7055e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:16.461173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fa55c-bc64-403b-abf9-b219f5f7055e None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:16.477261 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-065fa55c-bc64-403b-abf9-b219f5f7055e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:16.477261 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:16.477261 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:16.477261 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:16.477261 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:16.477261 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:16.477261 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:16.477261 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:16.477261 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:16.477261 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:16.477261 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:16.477261 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:16.477261 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:16.477261 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:16.477261 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:16.489665 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:16.489665 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:16.489665 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:16.489665 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:16.489665 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:16.489665 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:16.489665 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:16.489665 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:16.489665 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:16.489665 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:16.489665 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:16.489665 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:16.489665 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:16.489665 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:16.489665 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:16.489665 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:16.489665 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:16.490746 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:16.490746 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:16.490746 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:16.490746 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:16.490746 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:16.490746 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:16.490746 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:16.490746 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:16.490746 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 329/658] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:16.490746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fa55c-bc64-403b-abf9-b219f5f7055e None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:16.577300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc79d17-d85c-4fc5-9018-d5c8d5cf818b None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:16.593841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fa55c-bc64-403b-abf9-b219f5f7055e None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:16.626361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe311b65-d595-4a2b-87be-e4c755163d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:16.628364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe311b65-d595-4a2b-87be-e4c755163d0c None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:16.629594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe311b65-d595-4a2b-87be-e4c755163d0c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:16.629879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe311b65-d595-4a2b-87be-e4c755163d0c None admin] PATH_INFO: `/v3/users/glance` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:16.639798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dbcc4-a4b3-4986-a19a-fca2e9d04413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:16.640695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dbcc4-a4b3-4986-a19a-fca2e9d04413 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:16.641004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dbcc4-a4b3-4986-a19a-fca2e9d04413 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:16.641290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dbcc4-a4b3-4986-a19a-fca2e9d04413 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:16.645074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe311b65-d595-4a2b-87be-e4c755163d0c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:16.646786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe311b65-d595-4a2b-87be-e4c755163d0c None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:16.649794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8dbcc4-a4b3-4986-a19a-fca2e9d04413 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:16.651893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8dbcc4-a4b3-4986-a19a-fca2e9d04413 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:16.663900 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-fe311b65-d595-4a2b-87be-e4c755163d0c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 02 09:58:16.663900 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:16.663900 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:16.663900 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:16.663900 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:16.663900 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:16.663900 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:16.663900 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:16.663900 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:16.663900 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:16.663900 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:16.663900 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:16.663900 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:16.663900 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:16.663900 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:16.663900 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:16.669608 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:16.669608 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:16.669608 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:16.669608 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:16.669608 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:16.669608 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:16.669608 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:16.669608 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:16.669608 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:16.669608 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:16.669608 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:16.669608 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:16.669608 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:16.669608 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:16.669608 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:16.669608 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:16.669608 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:16.669608 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:16.670765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:16.670765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:16.670765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:16.670765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:16.670765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:16.670765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:16.670765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:16.670765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:16.670765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 02 09:58:16.670765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:16.670765 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 330/659] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:58:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:16.670765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe311b65-d595-4a2b-87be-e4c755163d0c None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:16.671564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-9e8dbcc4-a4b3-4986-a19a-fca2e9d04413 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 02 09:58:16.671564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:16.671564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:16.671564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:16.671564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:16.671564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:16.671564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:16.671564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:16.671564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:16.671564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:16.671564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:16.671564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:16.671564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:16.671564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:16.671564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:16.671564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:16.673067 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:16.673067 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:16.673067 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:16.673067 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:16.673067 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:16.673067 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:16.673067 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:16.673067 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:16.673067 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:16.673067 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:16.673067 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:16.673067 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:16.673067 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:16.673067 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:16.673067 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:16.673067 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:16.673067 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:16.673067 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:16.674219 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:16.674219 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:16.674219 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:16.674219 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:16.674219 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:16.674219 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:16.674219 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:16.674219 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:16.674219 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 02 09:58:16.674219 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:16.674219 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 330/660] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 09:58:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:16.678056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dbcc4-a4b3-4986-a19a-fca2e9d04413 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:16.794832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe311b65-d595-4a2b-87be-e4c755163d0c None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:16.801275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dbcc4-a4b3-4986-a19a-fca2e9d04413 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:16.837496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dca35-fbce-4cbd-a3a3-b0a5304e59d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:16.838549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dca35-fbce-4cbd-a3a3-b0a5304e59d2 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:16.839033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dca35-fbce-4cbd-a3a3-b0a5304e59d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:16.839259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed74d6-312a-4a92-8d57-5baa5e8b0098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:16.839742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dca35-fbce-4cbd-a3a3-b0a5304e59d2 None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:16.839911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed74d6-312a-4a92-8d57-5baa5e8b0098 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:16.840201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed74d6-312a-4a92-8d57-5baa5e8b0098 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:16.840479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed74d6-312a-4a92-8d57-5baa5e8b0098 None admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:16.841362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dca35-fbce-4cbd-a3a3-b0a5304e59d2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:16.841467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed74d6-312a-4a92-8d57-5baa5e8b0098 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:16.841719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed74d6-312a-4a92-8d57-5baa5e8b0098 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:16.842163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dca35-fbce-4cbd-a3a3-b0a5304e59d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:16.843150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed74d6-312a-4a92-8d57-5baa5e8b0098 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:16.844010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dca35-fbce-4cbd-a3a3-b0a5304e59d2 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:16.859066 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 331/661] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:16.859910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed74d6-312a-4a92-8d57-5baa5e8b0098 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:16.869402 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 331/662] 10.222.0.16 () {56 vars in 1139 bytes} [Mon May 2 09:58:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:16.870588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dca35-fbce-4cbd-a3a3-b0a5304e59d2 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:16.967687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dca35-fbce-4cbd-a3a3-b0a5304e59d2 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:16.983650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed74d6-312a-4a92-8d57-5baa5e8b0098 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:17.006056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecf3bb-e2cb-47da-8f3b-d46bad2bed00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:17.007066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecf3bb-e2cb-47da-8f3b-d46bad2bed00 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:17.007590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecf3bb-e2cb-47da-8f3b-d46bad2bed00 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:17.008089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecf3bb-e2cb-47da-8f3b-d46bad2bed00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:17.009193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecf3bb-e2cb-47da-8f3b-d46bad2bed00 None admin] RBAC: Adding query filter params (role.id=a47492f29bc144158c1c2ed9a4c39d39, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=8eab371b02c34a13b629eacdf504dbdb) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:17.009710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecf3bb-e2cb-47da-8f3b-d46bad2bed00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:17.011332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecf3bb-e2cb-47da-8f3b-d46bad2bed00 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:17.022613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496349c7-6a5b-489a-8bf3-dca5cf281c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:17.023049 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 332/663] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:58:16 2022] GET /identity/v3/role_assignments?user.id=8eab371b02c34a13b629eacdf504dbdb&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=a47492f29bc144158c1c2ed9a4c39d39 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:17.023344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496349c7-6a5b-489a-8bf3-dca5cf281c42 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:17.023633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496349c7-6a5b-489a-8bf3-dca5cf281c42 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:17.023913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496349c7-6a5b-489a-8bf3-dca5cf281c42 None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:17.024804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496349c7-6a5b-489a-8bf3-dca5cf281c42 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:17.025030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecf3bb-e2cb-47da-8f3b-d46bad2bed00 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:17.025129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496349c7-6a5b-489a-8bf3-dca5cf281c42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:17.028625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496349c7-6a5b-489a-8bf3-dca5cf281c42 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:17.048933 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 332/664] 10.222.0.16 () {56 vars in 1137 bytes} [Mon May 2 09:58:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:17.054196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496349c7-6a5b-489a-8bf3-dca5cf281c42 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:17.200441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecf3bb-e2cb-47da-8f3b-d46bad2bed00 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:17.219651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496349c7-6a5b-489a-8bf3-dca5cf281c42 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:17.237269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bcad6-d19c-416d-b10f-dc465d737b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:17.238543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bcad6-d19c-416d-b10f-dc465d737b72 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:17.239050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bcad6-d19c-416d-b10f-dc465d737b72 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:17.239523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bcad6-d19c-416d-b10f-dc465d737b72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:17.263445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1c21a-780d-4309-9f23-ac6f83a65e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:17.266381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1c21a-780d-4309-9f23-ac6f83a65e44 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:17.266381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1c21a-780d-4309-9f23-ac6f83a65e44 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:17.266381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1c21a-780d-4309-9f23-ac6f83a65e44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:17.329562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777bcad6-d19c-416d-b10f-dc465d737b72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:17.332710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777bcad6-d19c-416d-b10f-dc465d737b72 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:17.366507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1c21a-780d-4309-9f23-ac6f83a65e44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:17.369127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1c21a-780d-4309-9f23-ac6f83a65e44 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:17.441460 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 333/665] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:58:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:58:17.449635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bcad6-d19c-416d-b10f-dc465d737b72 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:17.497095 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 333/666] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:58:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 02 09:58:17.503072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1c21a-780d-4309-9f23-ac6f83a65e44 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:17.571514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bcad6-d19c-416d-b10f-dc465d737b72 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:17.625812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc3103-bd6c-43b0-aa11-0aa17ff6ea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:17.627612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc3103-bd6c-43b0-aa11-0aa17ff6ea7b None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:17.628724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc3103-bd6c-43b0-aa11-0aa17ff6ea7b None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:17.629207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc3103-bd6c-43b0-aa11-0aa17ff6ea7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:17.643101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc3103-bd6c-43b0-aa11-0aa17ff6ea7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:17.643471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1c21a-780d-4309-9f23-ac6f83a65e44 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:17.645148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc3103-bd6c-43b0-aa11-0aa17ff6ea7b None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:17.670357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-27bc3103-bd6c-43b0-aa11-0aa17ff6ea7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:17.670357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:17.670357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:17.670357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:17.670357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:17.670357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:17.670357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:17.670357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:17.670357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:17.670357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:17.670357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:17.670357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:17.670357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:17.670357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:17.670357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:17.672134 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:17.672134 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:17.672134 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:17.672134 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:17.672134 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:17.672134 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:17.672134 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:17.672134 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:17.672134 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:17.672134 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:17.672134 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:17.672134 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:17.672134 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:17.672134 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:17.672134 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:17.672134 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:17.672134 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:17.673903 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:17.673903 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:17.673903 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:17.673903 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:17.676947 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 334/667] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:17.679356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b752c-7cbd-412c-a53b-c64e9b632db9 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:17.680134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b752c-7cbd-412c-a53b-c64e9b632db9 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:17.680958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b752c-7cbd-412c-a53b-c64e9b632db9 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:17.683913 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 335/668] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:17.685660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b752c-7cbd-412c-a53b-c64e9b632db9 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:17.689889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e67c2-affb-4d5f-9010-c44733a55e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:17.690699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e67c2-affb-4d5f-9010-c44733a55e7a None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:17.690995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e67c2-affb-4d5f-9010-c44733a55e7a None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:17.691315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e67c2-affb-4d5f-9010-c44733a55e7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:17.703137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e67c2-affb-4d5f-9010-c44733a55e7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:17.704677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e67c2-affb-4d5f-9010-c44733a55e7a None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:17.723294 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-473e67c2-affb-4d5f-9010-c44733a55e7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:17.723294 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:17.723294 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:17.723294 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:17.723294 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:17.723294 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:17.723294 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:17.723294 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:17.723294 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:17.723294 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:17.723294 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:17.723294 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:17.723294 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:17.723294 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:17.723294 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:17.731973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:17.731973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:17.731973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:17.731973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:17.731973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:17.731973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:17.731973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:17.731973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:17.731973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:17.731973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:17.731973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:17.731973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:17.731973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:17.731973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:17.731973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:17.731973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:17.731973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:17.734002 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:17.734002 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:17.734002 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:17.734002 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:17.734002 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 334/669] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:17.734002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee2fc6-461e-405c-bc9e-59c125b24be7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:17.734002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee2fc6-461e-405c-bc9e-59c125b24be7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:17.734002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee2fc6-461e-405c-bc9e-59c125b24be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:17.746452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-97ee2fc6-461e-405c-bc9e-59c125b24be7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:17.747727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-97ee2fc6-461e-405c-bc9e-59c125b24be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:17.820682 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 335/670] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:58:17.821663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee2fc6-461e-405c-bc9e-59c125b24be7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:17.875831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b752c-7cbd-412c-a53b-c64e9b632db9 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:17.934581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76793b6b-aaf0-4861-97d6-95a8a51fc585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:17.935496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee2fc6-461e-405c-bc9e-59c125b24be7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:17.936405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76793b6b-aaf0-4861-97d6-95a8a51fc585 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:17.937209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76793b6b-aaf0-4861-97d6-95a8a51fc585 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:17.937945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76793b6b-aaf0-4861-97d6-95a8a51fc585 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:17.939500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76793b6b-aaf0-4861-97d6-95a8a51fc585 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:17.940323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76793b6b-aaf0-4861-97d6-95a8a51fc585 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:17.943000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76793b6b-aaf0-4861-97d6-95a8a51fc585 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:17.963279 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 336/671] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:17.965109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76793b6b-aaf0-4861-97d6-95a8a51fc585 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:17.969398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41580e4-6f6c-4f22-82f9-08e988e00177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:17.969984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41580e4-6f6c-4f22-82f9-08e988e00177 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:17.970270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41580e4-6f6c-4f22-82f9-08e988e00177 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:17.970861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41580e4-6f6c-4f22-82f9-08e988e00177 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:17.971759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41580e4-6f6c-4f22-82f9-08e988e00177 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:17.972132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41580e4-6f6c-4f22-82f9-08e988e00177 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:17.973570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41580e4-6f6c-4f22-82f9-08e988e00177 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:17.992638 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 336/672] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:17.992638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41580e4-6f6c-4f22-82f9-08e988e00177 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:18.091562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41580e4-6f6c-4f22-82f9-08e988e00177 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:18.130273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1291430-0168-410d-be28-0800779b5629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:18.131139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1291430-0168-410d-be28-0800779b5629 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:18.131428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1291430-0168-410d-be28-0800779b5629 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:18.131707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1291430-0168-410d-be28-0800779b5629 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:18.139276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1291430-0168-410d-be28-0800779b5629 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:18.140837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1291430-0168-410d-be28-0800779b5629 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:18.156736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-d1291430-0168-410d-be28-0800779b5629 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:18.156736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:18.156736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:18.156736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:18.156736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:18.156736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:18.156736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:18.156736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:18.156736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:18.156736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:18.156736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:18.156736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:18.156736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:18.156736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:18.156736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:18.158446 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:18.158446 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:18.158446 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:18.158446 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:18.158446 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:18.158446 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:18.158446 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:18.158446 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:18.158446 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:18.158446 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:18.158446 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:18.158446 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:18.158446 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:18.158446 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:18.158446 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:18.158446 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:18.158446 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:18.160212 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:18.160212 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:18.160212 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:18.160212 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:18.160212 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:18.160212 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:18.160212 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:18.160212 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:18.160212 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 337/673] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:18.160212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1291430-0168-410d-be28-0800779b5629 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:18.165508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76793b6b-aaf0-4861-97d6-95a8a51fc585 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:18.226241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4cb5c-46f9-428f-9ab7-287a38d2f0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:18.229117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4cb5c-46f9-428f-9ab7-287a38d2f0d3 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:18.229405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4cb5c-46f9-428f-9ab7-287a38d2f0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:18.229669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4cb5c-46f9-428f-9ab7-287a38d2f0d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:18.243623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4cb5c-46f9-428f-9ab7-287a38d2f0d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:18.251166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-fcc4cb5c-46f9-428f-9ab7-287a38d2f0d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:18.251166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:18.251166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:18.251166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:18.251166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:18.251166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:18.251166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:18.251166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:18.251166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:18.251166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:18.251166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:18.251166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:18.251166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:18.251166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:18.251166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:18.251166 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:18.252904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:18.252904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:18.252904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:18.252904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:18.252904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:18.252904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:18.252904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:18.252904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:18.252904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:18.252904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:18.252904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:18.252904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:18.252904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:18.252904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:18.252904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:18.252904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:18.256571 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:18.256571 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:18.256571 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:18.256571 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:18.256571 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:18.256571 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:18.256571 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:18.256571 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:18.256571 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:18.256571 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:18.256571 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:18.256571 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:18.257943 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 337/674] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 09:58:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:18.258077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4cb5c-46f9-428f-9ab7-287a38d2f0d3 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:18.307313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1291430-0168-410d-be28-0800779b5629 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:18.341772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491f4ee-add9-4149-87e8-3ddeb9235d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:18.342417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491f4ee-add9-4149-87e8-3ddeb9235d56 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:18.342701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491f4ee-add9-4149-87e8-3ddeb9235d56 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:18.342979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491f4ee-add9-4149-87e8-3ddeb9235d56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:18.349603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491f4ee-add9-4149-87e8-3ddeb9235d56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:18.351047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491f4ee-add9-4149-87e8-3ddeb9235d56 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:18.364968 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-1491f4ee-add9-4149-87e8-3ddeb9235d56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:18.364968 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:18.364968 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:18.364968 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:18.364968 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:18.364968 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:18.364968 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:18.364968 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:18.364968 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:18.364968 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:18.364968 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:18.364968 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:18.364968 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:18.364968 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:18.364968 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:18.365863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:18.365863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:18.365863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:18.365863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:18.365863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:18.365863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:18.365863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:18.365863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:18.365863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:18.365863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:18.365863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:18.365863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:18.365863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:18.365863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:18.365863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:18.365863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:18.365863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:18.366735 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:18.366735 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:18.366735 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:18.366735 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:18.366735 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:18.366735 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:18.366735 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:18.366735 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:18.370789 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 338/675] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:18.371630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491f4ee-add9-4149-87e8-3ddeb9235d56 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:18.379656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4cb5c-46f9-428f-9ab7-287a38d2f0d3 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:18.423887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03b7d4-0bdf-4db9-aceb-17e3c77def07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:18.425171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03b7d4-0bdf-4db9-aceb-17e3c77def07 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:18.425849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03b7d4-0bdf-4db9-aceb-17e3c77def07 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:18.426658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03b7d4-0bdf-4db9-aceb-17e3c77def07 None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:18.427920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03b7d4-0bdf-4db9-aceb-17e3c77def07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:18.428613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03b7d4-0bdf-4db9-aceb-17e3c77def07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:18.430905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03b7d4-0bdf-4db9-aceb-17e3c77def07 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:18.446922 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 338/676] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:18.448449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03b7d4-0bdf-4db9-aceb-17e3c77def07 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:18.471946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491f4ee-add9-4149-87e8-3ddeb9235d56 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:18.506352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8dfc43-9a54-4132-9ccf-7efd60ee6d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:18.507852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dfc43-9a54-4132-9ccf-7efd60ee6d37 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:18.508511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dfc43-9a54-4132-9ccf-7efd60ee6d37 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:18.508511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dfc43-9a54-4132-9ccf-7efd60ee6d37 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:18.509209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8dfc43-9a54-4132-9ccf-7efd60ee6d37 None admin] RBAC: Adding query filter params (name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:18.509523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8dfc43-9a54-4132-9ccf-7efd60ee6d37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:18.510990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8dfc43-9a54-4132-9ccf-7efd60ee6d37 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:18.527187 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 339/677] 10.222.0.16 () {56 vars in 1103 bytes} [Mon May 2 09:58:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:18.529073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8dfc43-9a54-4132-9ccf-7efd60ee6d37 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:18.574870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03b7d4-0bdf-4db9-aceb-17e3c77def07 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:18.617625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30eb076-e3f4-4e0f-a09f-dc2362dff811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:18.619080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30eb076-e3f4-4e0f-a09f-dc2362dff811 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:18.619901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30eb076-e3f4-4e0f-a09f-dc2362dff811 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:18.620406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30eb076-e3f4-4e0f-a09f-dc2362dff811 None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:18.621921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30eb076-e3f4-4e0f-a09f-dc2362dff811 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:18.622730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30eb076-e3f4-4e0f-a09f-dc2362dff811 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:18.625064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30eb076-e3f4-4e0f-a09f-dc2362dff811 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:18.630147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8dfc43-9a54-4132-9ccf-7efd60ee6d37 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:18.642814 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 339/678] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:18.644098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30eb076-e3f4-4e0f-a09f-dc2362dff811 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:18.673344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eccc84-181b-449e-b007-e30b67443108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:18.674985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eccc84-181b-449e-b007-e30b67443108 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:18.675600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eccc84-181b-449e-b007-e30b67443108 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:18.676170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eccc84-181b-449e-b007-e30b67443108 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:18.677369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eccc84-181b-449e-b007-e30b67443108 None admin] RBAC: Adding query filter params (role.id=a47492f29bc144158c1c2ed9a4c39d39, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=4cd9fe10f94f43aeb3eb10009ee96ea9) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:18.678170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eccc84-181b-449e-b007-e30b67443108 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:18.680797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eccc84-181b-449e-b007-e30b67443108 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:18.688653 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 340/679] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:58:18 2022] GET /identity/v3/role_assignments?user.id=4cd9fe10f94f43aeb3eb10009ee96ea9&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=a47492f29bc144158c1c2ed9a4c39d39 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:18.689762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eccc84-181b-449e-b007-e30b67443108 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:18.765857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30eb076-e3f4-4e0f-a09f-dc2362dff811 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:18.811715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b9d4a-4d8f-446a-8ff6-f798b968cf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:18.812789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b9d4a-4d8f-446a-8ff6-f798b968cf3b None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:18.813147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b9d4a-4d8f-446a-8ff6-f798b968cf3b None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:18.813498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b9d4a-4d8f-446a-8ff6-f798b968cf3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:18.821720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eccc84-181b-449e-b007-e30b67443108 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:18.825462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b9d4a-4d8f-446a-8ff6-f798b968cf3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:18.827016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b9d4a-4d8f-446a-8ff6-f798b968cf3b None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:18.850026 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-7e1b9d4a-4d8f-446a-8ff6-f798b968cf3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:18.850026 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:18.850026 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:18.850026 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:18.850026 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:18.850026 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:18.850026 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:18.850026 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:18.850026 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:18.850026 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:18.850026 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:18.850026 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:18.850026 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:18.850026 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:18.850026 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:18.850987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:18.850987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:18.850987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:18.850987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:18.850987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:18.850987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:18.850987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:18.850987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:18.850987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:18.850987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:18.850987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:18.850987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:18.850987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:18.850987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:18.850987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:18.850987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:18.850987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:18.851932 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:18.851932 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:18.851932 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:18.851932 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:18.851932 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 340/680] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:18.857246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b9d4a-4d8f-446a-8ff6-f798b968cf3b None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:18.875732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fce35-6f10-433b-a916-ebd9d42495bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:18.876326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fce35-6f10-433b-a916-ebd9d42495bb None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:18.876632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fce35-6f10-433b-a916-ebd9d42495bb None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:18.876924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fce35-6f10-433b-a916-ebd9d42495bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:18.877777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fce35-6f10-433b-a916-ebd9d42495bb None admin] RBAC: Adding query filter params (role.id=a47492f29bc144158c1c2ed9a4c39d39, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=08bc0cd97b6f45339f5dcf1a264b5ae2) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:18.878093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fce35-6f10-433b-a916-ebd9d42495bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:18.881926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fce35-6f10-433b-a916-ebd9d42495bb None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:18.894242 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 341/681] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:58:18 2022] GET /identity/v3/role_assignments?user.id=08bc0cd97b6f45339f5dcf1a264b5ae2&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=a47492f29bc144158c1c2ed9a4c39d39 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:19.009497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b9d4a-4d8f-446a-8ff6-f798b968cf3b None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:19.060238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc131d2-5cc2-467b-8092-079897b503ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:19.060959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc131d2-5cc2-467b-8092-079897b503ff None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:19.061245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc131d2-5cc2-467b-8092-079897b503ff None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:19.061526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc131d2-5cc2-467b-8092-079897b503ff None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:19.062279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc131d2-5cc2-467b-8092-079897b503ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:19.062591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc131d2-5cc2-467b-8092-079897b503ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:19.063998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc131d2-5cc2-467b-8092-079897b503ff None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:19.080490 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 341/682] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:19.086112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fce35-6f10-433b-a916-ebd9d42495bb None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:19.208701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fce35-6f10-433b-a916-ebd9d42495bb None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:19.248277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdb680-739e-4b74-9703-5b2490504626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:19.249119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdb680-739e-4b74-9703-5b2490504626 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:19.249401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdb680-739e-4b74-9703-5b2490504626 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:19.249682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdb680-739e-4b74-9703-5b2490504626 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:19.258732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bdb680-739e-4b74-9703-5b2490504626 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:19.260170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bdb680-739e-4b74-9703-5b2490504626 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:19.274947 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-07bdb680-739e-4b74-9703-5b2490504626 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 02 09:58:19.274947 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:19.274947 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:19.274947 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:19.274947 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:19.274947 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:19.274947 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:19.274947 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:19.274947 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:19.274947 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:19.274947 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:19.274947 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:19.274947 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:19.274947 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:19.274947 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:19.274947 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:19.275967 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:19.275967 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:19.275967 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:19.275967 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:19.275967 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:19.275967 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:19.275967 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:19.275967 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:19.275967 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:19.275967 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:19.275967 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:19.275967 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:19.275967 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:19.275967 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:19.275967 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:19.275967 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:19.275967 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:19.275967 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:19.276952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:19.276952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:19.276952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:19.276952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:19.276952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:19.276952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:19.276952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:19.276952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:19.276952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 02 09:58:19.276952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:19.276952 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 342/683] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:58:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:19.282490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc131d2-5cc2-467b-8092-079897b503ff None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:19.387018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc131d2-5cc2-467b-8092-079897b503ff None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:19.421647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb221b68-b8f8-4ff3-ad27-daaff32e6a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:19.422400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb221b68-b8f8-4ff3-ad27-daaff32e6a3f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:19.422789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb221b68-b8f8-4ff3-ad27-daaff32e6a3f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:19.423070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb221b68-b8f8-4ff3-ad27-daaff32e6a3f None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:19.423914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb221b68-b8f8-4ff3-ad27-daaff32e6a3f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:19.424225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb221b68-b8f8-4ff3-ad27-daaff32e6a3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:19.425692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb221b68-b8f8-4ff3-ad27-daaff32e6a3f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:19.444461 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 342/684] 10.222.0.16 () {56 vars in 1135 bytes} [Mon May 2 09:58:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:19.450040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdb680-739e-4b74-9703-5b2490504626 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:19.499555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cc147-ecfa-4134-928a-3ad7a1618de0 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:19.499555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cc147-ecfa-4134-928a-3ad7a1618de0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:19.499555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cc147-ecfa-4134-928a-3ad7a1618de0 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:19.499555 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 343/685] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:58:19.499555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f465c33-6aa5-4c2d-981b-25e340d8b78b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:19.499555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f465c33-6aa5-4c2d-981b-25e340d8b78b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:19.500071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f465c33-6aa5-4c2d-981b-25e340d8b78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:19.516160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0f465c33-6aa5-4c2d-981b-25e340d8b78b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:19.517660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0f465c33-6aa5-4c2d-981b-25e340d8b78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:19.647226 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 344/686] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:58:19.683772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f465c33-6aa5-4c2d-981b-25e340d8b78b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:19.712493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdb680-739e-4b74-9703-5b2490504626 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:19.753438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9f8eb-08aa-46c9-aec0-1492719a1f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:19.754014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9f8eb-08aa-46c9-aec0-1492719a1f79 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:19.754293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9f8eb-08aa-46c9-aec0-1492719a1f79 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:19.754562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9f8eb-08aa-46c9-aec0-1492719a1f79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:19.847374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe9f8eb-08aa-46c9-aec0-1492719a1f79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:19.848858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe9f8eb-08aa-46c9-aec0-1492719a1f79 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:19.855467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f465c33-6aa5-4c2d-981b-25e340d8b78b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:19.901088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a88ea7-acfb-4327-adb1-aa0bc20fa12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:19.902048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a88ea7-acfb-4327-adb1-aa0bc20fa12c None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:19.902326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a88ea7-acfb-4327-adb1-aa0bc20fa12c None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:19.902900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a88ea7-acfb-4327-adb1-aa0bc20fa12c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:19.915120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a88ea7-acfb-4327-adb1-aa0bc20fa12c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:19.925005 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-19a88ea7-acfb-4327-adb1-aa0bc20fa12c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:58:19.925005 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:19.925005 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:19.925005 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:19.925005 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:19.925005 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:19.925005 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:19.925005 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:19.925005 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:19.925005 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:19.925005 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:19.925005 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:19.925005 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:19.925005 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:19.925005 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:19.925005 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:19.925917 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:19.925917 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:19.925917 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:19.925917 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:19.925917 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:19.925917 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:19.925917 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:19.925917 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:19.925917 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:19.925917 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:19.925917 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:19.925917 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:19.925917 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:19.925917 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:19.925917 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:19.925917 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:19.926738 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:19.926738 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:19.926738 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:19.926738 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:19.926738 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:19.926738 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:19.926738 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:19.926738 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:19.926738 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:19.926738 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:19.926738 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:58:19.926738 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:19.926738 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 345/687] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:58:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:19.927972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926e731-1bdd-4f8b-ba99-bf1278453087 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:19.929826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926e731-1bdd-4f8b-ba99-bf1278453087 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:19.929826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926e731-1bdd-4f8b-ba99-bf1278453087 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:19.930118 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 346/688] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:19.932696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926e731-1bdd-4f8b-ba99-bf1278453087 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:19.964200 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 343/689] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:58:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 09:58:19.965779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac1d6d-c3c4-4895-bc15-b668628717a8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:19.966386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac1d6d-c3c4-4895-bc15-b668628717a8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:19.966690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac1d6d-c3c4-4895-bc15-b668628717a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:19.986119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-02ac1d6d-c3c4-4895-bc15-b668628717a8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:19.988131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-02ac1d6d-c3c4-4895-bc15-b668628717a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:20.050824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926e731-1bdd-4f8b-ba99-bf1278453087 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:20.069240 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 344/690] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:58:20.070831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac1d6d-c3c4-4895-bc15-b668628717a8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:20.089621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec0ff1-86ea-432d-9abc-be6e984d90ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:20.090344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec0ff1-86ea-432d-9abc-be6e984d90ca None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:20.090636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec0ff1-86ea-432d-9abc-be6e984d90ca None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:20.090921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec0ff1-86ea-432d-9abc-be6e984d90ca None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:20.091676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec0ff1-86ea-432d-9abc-be6e984d90ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:20.091990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec0ff1-86ea-432d-9abc-be6e984d90ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:20.093462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec0ff1-86ea-432d-9abc-be6e984d90ca None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:20.104147 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 347/691] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:58:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:20.109165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec0ff1-86ea-432d-9abc-be6e984d90ca None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:20.187968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac1d6d-c3c4-4895-bc15-b668628717a8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:20.212298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec0ff1-86ea-432d-9abc-be6e984d90ca None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:20.222582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb648e-11f2-4ed9-b808-a70bc858c226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:20.223494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb648e-11f2-4ed9-b808-a70bc858c226 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:20.228282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb648e-11f2-4ed9-b808-a70bc858c226 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:20.228282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb648e-11f2-4ed9-b808-a70bc858c226 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:20.234735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb648e-11f2-4ed9-b808-a70bc858c226 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:20.236194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb648e-11f2-4ed9-b808-a70bc858c226 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:20.247764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1226525-c7f7-418a-8704-f49dfb1c4c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:20.248670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1226525-c7f7-418a-8704-f49dfb1c4c24 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:20.248964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1226525-c7f7-418a-8704-f49dfb1c4c24 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:20.249241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1226525-c7f7-418a-8704-f49dfb1c4c24 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:20.250049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1226525-c7f7-418a-8704-f49dfb1c4c24 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:20.251482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1226525-c7f7-418a-8704-f49dfb1c4c24 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:20.255157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-0dcb648e-11f2-4ed9-b808-a70bc858c226 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:20.255157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:20.255157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:20.255157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:20.255157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:20.255157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:20.255157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:20.255157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:20.255157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:20.255157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:20.255157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:20.255157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:20.255157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:20.255157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:20.255157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:20.256026 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:20.256026 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:20.256026 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:20.256026 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:20.256026 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:20.256026 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:20.256026 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:20.256026 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:20.256026 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:20.256026 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:20.256026 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:20.256026 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:20.256026 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:20.256026 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:20.256026 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:20.256026 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:20.256026 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:20.258731 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:20.258731 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:20.258731 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:20.258731 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:20.258731 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 345/692] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:20.258731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb648e-11f2-4ed9-b808-a70bc858c226 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:20.271842 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-f1226525-c7f7-418a-8704-f49dfb1c4c24 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 02 09:58:20.271842 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:20.271842 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 09:58:20.271842 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 09:58:20.271842 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 09:58:20.271842 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 09:58:20.271842 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 09:58:20.271842 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:20.271842 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 02 09:58:20.271842 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:20.271842 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:58:20.271842 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:20.271842 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:20.271842 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:20.271842 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:20.271842 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:20.274210 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:20.274210 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:20.274210 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:20.274210 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:20.274210 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:20.274210 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:20.274210 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:20.274210 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 09:58:20.274210 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 09:58:20.274210 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 09:58:20.274210 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 09:58:20.274210 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:20.274210 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:20.274210 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:20.274210 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:20.274210 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:20.276218 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:20.276218 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:20.276218 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:20.276218 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:20.276218 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:20.276218 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:20.276218 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:20.276218 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:20.276218 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:20.276218 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:20.276218 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:20.276218 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 09:58:20.276218 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:20.276218 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 02 09:58:20.276218 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:20.280169 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 348/693] 10.222.0.16 () {56 vars in 1129 bytes} [Mon May 2 09:58:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:20.280169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1226525-c7f7-418a-8704-f49dfb1c4c24 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:20.364790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb648e-11f2-4ed9-b808-a70bc858c226 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:20.401289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1226525-c7f7-418a-8704-f49dfb1c4c24 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:20.405629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8d91b-aa56-4dfc-87d9-12ac13c15405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:20.406425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8d91b-aa56-4dfc-87d9-12ac13c15405 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:20.406707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8d91b-aa56-4dfc-87d9-12ac13c15405 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:20.406983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8d91b-aa56-4dfc-87d9-12ac13c15405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:20.419880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8d91b-aa56-4dfc-87d9-12ac13c15405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:20.421724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8d91b-aa56-4dfc-87d9-12ac13c15405 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:20.435418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743854d3-a723-4f1c-865d-6f500e2b21bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:20.436137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743854d3-a723-4f1c-865d-6f500e2b21bb None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:20.436427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743854d3-a723-4f1c-865d-6f500e2b21bb None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:20.436738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743854d3-a723-4f1c-865d-6f500e2b21bb None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:20.437511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743854d3-a723-4f1c-865d-6f500e2b21bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:20.437825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743854d3-a723-4f1c-865d-6f500e2b21bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:20.439246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743854d3-a723-4f1c-865d-6f500e2b21bb None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:20.442069 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-a4f8d91b-aa56-4dfc-87d9-12ac13c15405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:20.442069 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:20.442069 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:20.442069 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:20.442069 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:20.442069 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:20.442069 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:20.442069 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:20.442069 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:20.442069 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:20.442069 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:20.442069 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:20.442069 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:20.442069 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:20.442069 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:20.444063 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:20.444063 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:20.444063 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:20.444063 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:20.444063 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:20.444063 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:20.444063 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:20.444063 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:20.444063 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:20.444063 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:20.444063 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:20.444063 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:20.444063 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:20.444063 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:20.444063 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:20.444063 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:20.444063 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:20.446783 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:20.446783 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:20.446783 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:20.446783 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:20.446783 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 346/694] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:20.446783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8d91b-aa56-4dfc-87d9-12ac13c15405 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:20.455872 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 349/695] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:20.456847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743854d3-a723-4f1c-865d-6f500e2b21bb None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:20.553514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8d91b-aa56-4dfc-87d9-12ac13c15405 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:20.574987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743854d3-a723-4f1c-865d-6f500e2b21bb None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:20.588108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355a62c-5a51-4f9f-a0f9-2f8d6e52c522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:20.588827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355a62c-5a51-4f9f-a0f9-2f8d6e52c522 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:20.589120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355a62c-5a51-4f9f-a0f9-2f8d6e52c522 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:20.589404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355a62c-5a51-4f9f-a0f9-2f8d6e52c522 None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:20.590126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355a62c-5a51-4f9f-a0f9-2f8d6e52c522 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:20.590504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355a62c-5a51-4f9f-a0f9-2f8d6e52c522 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:20.591959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355a62c-5a51-4f9f-a0f9-2f8d6e52c522 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:20.596753 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 347/696] 10.222.0.16 () {56 vars in 1124 bytes} [Mon May 2 09:58:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:20.597653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355a62c-5a51-4f9f-a0f9-2f8d6e52c522 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:20.620695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebaf71-b131-4054-8908-565678c86515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:20.621839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebaf71-b131-4054-8908-565678c86515 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:20.622121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebaf71-b131-4054-8908-565678c86515 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:20.622398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebaf71-b131-4054-8908-565678c86515 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:20.623453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebaf71-b131-4054-8908-565678c86515 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:20.623772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebaf71-b131-4054-8908-565678c86515 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:20.626021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebaf71-b131-4054-8908-565678c86515 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:20.641121 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 350/697] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:20.641975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebaf71-b131-4054-8908-565678c86515 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:20.714598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355a62c-5a51-4f9f-a0f9-2f8d6e52c522 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:20.740044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebaf71-b131-4054-8908-565678c86515 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:20.749179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9409af-1655-411b-9668-2ea5d19ba69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:20.749970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9409af-1655-411b-9668-2ea5d19ba69d None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:20.750247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9409af-1655-411b-9668-2ea5d19ba69d None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:20.750524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9409af-1655-411b-9668-2ea5d19ba69d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:20.757224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9409af-1655-411b-9668-2ea5d19ba69d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:20.758683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9409af-1655-411b-9668-2ea5d19ba69d None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:20.772370 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-cd9409af-1655-411b-9668-2ea5d19ba69d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:20.772370 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:20.772370 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:20.772370 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:20.772370 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:20.772370 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:20.772370 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:20.772370 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:20.772370 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:20.772370 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:20.772370 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:20.772370 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:20.772370 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:20.772370 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:20.772370 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:20.774653 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:20.774653 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:20.774653 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:20.774653 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:20.774653 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:20.774653 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:20.774653 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:20.774653 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:20.774653 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:20.774653 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:20.774653 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:20.774653 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:20.774653 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:20.774653 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:20.774653 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:20.774653 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:20.774653 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:20.776663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:20.776663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:20.776663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:20.776663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:20.776663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:20.776663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:20.776663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:20.776663 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:20.777638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9426674-469b-4d45-a763-48bf67452e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:20.777809 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 348/698] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:20.780921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9426674-469b-4d45-a763-48bf67452e85 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:20.780921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9426674-469b-4d45-a763-48bf67452e85 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:20.781087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9409af-1655-411b-9668-2ea5d19ba69d None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:20.781160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9426674-469b-4d45-a763-48bf67452e85 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:20.781160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9426674-469b-4d45-a763-48bf67452e85 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:20.781160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9426674-469b-4d45-a763-48bf67452e85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:20.781160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9426674-469b-4d45-a763-48bf67452e85 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:20.785406 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 351/699] 10.222.0.16 () {56 vars in 1124 bytes} [Mon May 2 09:58:20 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:20.786329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9426674-469b-4d45-a763-48bf67452e85 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:20.915457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9409af-1655-411b-9668-2ea5d19ba69d None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:20.935416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9426674-469b-4d45-a763-48bf67452e85 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:20.971379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210e7c1-e73e-4aff-9c9d-21b0e05bcb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:20.972391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210e7c1-e73e-4aff-9c9d-21b0e05bcb8f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:20.972886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210e7c1-e73e-4aff-9c9d-21b0e05bcb8f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:20.973338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210e7c1-e73e-4aff-9c9d-21b0e05bcb8f None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:20.974480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210e7c1-e73e-4aff-9c9d-21b0e05bcb8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:20.975028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210e7c1-e73e-4aff-9c9d-21b0e05bcb8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:20.976827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210e7c1-e73e-4aff-9c9d-21b0e05bcb8f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:20.991241 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 352/700] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:20.998288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210e7c1-e73e-4aff-9c9d-21b0e05bcb8f None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:21.006830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6c025-6b61-49e1-982b-50f09db7305f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:21.008196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6c025-6b61-49e1-982b-50f09db7305f None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:21.008475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6c025-6b61-49e1-982b-50f09db7305f None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:21.008786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6c025-6b61-49e1-982b-50f09db7305f None admin] PATH_INFO: `/v3/users/nova` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:21.026165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6c025-6b61-49e1-982b-50f09db7305f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:21.032271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6c025-6b61-49e1-982b-50f09db7305f None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:21.057309 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-24f6c025-6b61-49e1-982b-50f09db7305f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 02 09:58:21.057309 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:21.057309 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:21.057309 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:21.057309 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:21.057309 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:21.057309 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:21.057309 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:21.057309 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:21.057309 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:21.057309 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:21.057309 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:21.057309 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:21.057309 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:21.057309 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:21.057309 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:21.058319 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:21.058319 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:21.058319 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:21.058319 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:21.058319 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:21.058319 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:21.058319 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:21.058319 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:21.058319 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:21.058319 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:21.058319 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:21.058319 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:21.058319 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:21.058319 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:21.058319 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:21.058319 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:21.058319 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:21.058319 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:21.059249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:21.059249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:21.059249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:21.059249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:21.059249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:21.059249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:21.059249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:21.059249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:21.059249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 02 09:58:21.059249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:21.059249 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 349/701] 10.222.0.16 () {56 vars in 1093 bytes} [Mon May 2 09:58:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:21.069648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6c025-6b61-49e1-982b-50f09db7305f None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:21.107581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210e7c1-e73e-4aff-9c9d-21b0e05bcb8f None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:21.143059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f2528-d34d-4351-9e65-bf8cc23285d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:21.143958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f2528-d34d-4351-9e65-bf8cc23285d2 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:21.144386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f2528-d34d-4351-9e65-bf8cc23285d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:21.144870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f2528-d34d-4351-9e65-bf8cc23285d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:21.145844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f2528-d34d-4351-9e65-bf8cc23285d2 None admin] RBAC: Adding query filter params (role.id=a47492f29bc144158c1c2ed9a4c39d39, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=6573f5c0731c4a18bf2374c3ba006a57) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:21.146303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f2528-d34d-4351-9e65-bf8cc23285d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:21.147875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f2528-d34d-4351-9e65-bf8cc23285d2 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:21.154437 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 353/702] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:58:20 2022] GET /identity/v3/role_assignments?user.id=6573f5c0731c4a18bf2374c3ba006a57&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=a47492f29bc144158c1c2ed9a4c39d39 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:21.195717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6c025-6b61-49e1-982b-50f09db7305f None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:21.233248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef7bbe-b647-4622-a970-b4fb18d1a9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:21.234187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef7bbe-b647-4622-a970-b4fb18d1a9d5 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:21.234617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef7bbe-b647-4622-a970-b4fb18d1a9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:21.235067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef7bbe-b647-4622-a970-b4fb18d1a9d5 None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:21.236053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef7bbe-b647-4622-a970-b4fb18d1a9d5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:21.236524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef7bbe-b647-4622-a970-b4fb18d1a9d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:21.238415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef7bbe-b647-4622-a970-b4fb18d1a9d5 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:21.259883 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 350/703] 10.222.0.16 () {56 vars in 1133 bytes} [Mon May 2 09:58:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:21.265583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f2528-d34d-4351-9e65-bf8cc23285d2 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:21.403144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f2528-d34d-4351-9e65-bf8cc23285d2 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:21.440323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ea585-4752-46f1-875d-2e6d6d3270aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:21.441010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ea585-4752-46f1-875d-2e6d6d3270aa None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:21.441303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ea585-4752-46f1-875d-2e6d6d3270aa None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:21.441585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ea585-4752-46f1-875d-2e6d6d3270aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:21.517983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ea585-4752-46f1-875d-2e6d6d3270aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:21.519701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ea585-4752-46f1-875d-2e6d6d3270aa None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:21.576260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04777d-f5bc-4d2c-8b2b-5752f210807d None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:21.576542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04777d-f5bc-4d2c-8b2b-5752f210807d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:21.576851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04777d-f5bc-4d2c-8b2b-5752f210807d None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:21.581856 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 351/704] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:58:21.583318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44485c90-4bc8-47a4-b2a3-090a99f3c545 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:21.583690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44485c90-4bc8-47a4-b2a3-090a99f3c545 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:21.583878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44485c90-4bc8-47a4-b2a3-090a99f3c545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:21.601851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-44485c90-4bc8-47a4-b2a3-090a99f3c545 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:21.603023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-44485c90-4bc8-47a4-b2a3-090a99f3c545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:21.622717 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 354/705] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:58:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 02 09:58:21.627906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ea585-4752-46f1-875d-2e6d6d3270aa None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:21.682005 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 352/706] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 02 09:58:21.707851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44485c90-4bc8-47a4-b2a3-090a99f3c545 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:21.737066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ea585-4752-46f1-875d-2e6d6d3270aa None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:21.779341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb829e59-b25c-4697-9ec1-527dc830c786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:21.780300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb829e59-b25c-4697-9ec1-527dc830c786 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:21.780578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb829e59-b25c-4697-9ec1-527dc830c786 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:21.780879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb829e59-b25c-4697-9ec1-527dc830c786 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:21.793544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb829e59-b25c-4697-9ec1-527dc830c786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:21.795740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb829e59-b25c-4697-9ec1-527dc830c786 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:21.816663 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-eb829e59-b25c-4697-9ec1-527dc830c786 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:21.816663 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:21.816663 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:21.816663 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:21.816663 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:21.816663 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:21.816663 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:21.816663 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:21.816663 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:21.816663 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:21.816663 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:21.816663 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:21.816663 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:21.816663 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:21.816663 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:21.817603 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:21.817603 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:21.817603 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:21.817603 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:21.817603 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:21.817603 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:21.817603 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:21.817603 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:21.817603 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:21.817603 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:21.817603 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:21.817603 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:21.817603 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:21.817603 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:21.817603 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:21.817603 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:21.817603 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:21.818508 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:21.818508 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:21.818508 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:21.818508 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:21.818508 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 355/707] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:21.825399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb829e59-b25c-4697-9ec1-527dc830c786 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:21.831590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44485c90-4bc8-47a4-b2a3-090a99f3c545 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:21.876670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ec847-a1e6-4221-85f8-816bdf393270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:21.878122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ec847-a1e6-4221-85f8-816bdf393270 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:21.878562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ec847-a1e6-4221-85f8-816bdf393270 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:21.878990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ec847-a1e6-4221-85f8-816bdf393270 None admin] PATH_INFO: `/v3/services/network` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:21.880339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ec847-a1e6-4221-85f8-816bdf393270 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:21.882115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ec847-a1e6-4221-85f8-816bdf393270 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:21.909384 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-8a4ec847-a1e6-4221-85f8-816bdf393270 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 02 09:58:21.909384 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:21.909384 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 09:58:21.909384 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 09:58:21.909384 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 09:58:21.909384 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 09:58:21.909384 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 09:58:21.909384 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:21.909384 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 02 09:58:21.909384 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:21.909384 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:58:21.909384 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:21.909384 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:21.909384 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:21.909384 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:21.909384 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:21.909384 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:21.910435 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:21.910435 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:21.910435 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:21.910435 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:21.910435 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:21.910435 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:21.910435 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 09:58:21.910435 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 09:58:21.910435 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 09:58:21.910435 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 09:58:21.910435 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:21.910435 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:21.910435 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:21.910435 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:21.910435 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:21.910435 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:21.911258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:21.911258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:21.911258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:21.911258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:21.911258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:21.911258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:21.911258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:21.911258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:21.911258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:21.911258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:21.911258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 09:58:21.911258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:21.911258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 02 09:58:21.911258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:21.916801 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 353/708] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:21 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:21.920500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ec847-a1e6-4221-85f8-816bdf393270 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:21.987020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb829e59-b25c-4697-9ec1-527dc830c786 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:22.051160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc03291-9c7c-4a50-bda9-a9786bf57823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:22.051754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc03291-9c7c-4a50-bda9-a9786bf57823 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:22.052041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc03291-9c7c-4a50-bda9-a9786bf57823 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:22.052323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc03291-9c7c-4a50-bda9-a9786bf57823 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:22.053087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc03291-9c7c-4a50-bda9-a9786bf57823 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:22.053643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc03291-9c7c-4a50-bda9-a9786bf57823 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:22.055572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc03291-9c7c-4a50-bda9-a9786bf57823 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:22.076251 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 356/709] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:22.081917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc03291-9c7c-4a50-bda9-a9786bf57823 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:22.086915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ec847-a1e6-4221-85f8-816bdf393270 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:22.121675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebec22f-ba20-4ae1-8f05-b37c9eeee045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:22.122395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebec22f-ba20-4ae1-8f05-b37c9eeee045 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:22.122676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebec22f-ba20-4ae1-8f05-b37c9eeee045 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:22.122996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebec22f-ba20-4ae1-8f05-b37c9eeee045 None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:22.123707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebec22f-ba20-4ae1-8f05-b37c9eeee045 None admin] RBAC: Adding query filter params (name=network) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:22.124012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebec22f-ba20-4ae1-8f05-b37c9eeee045 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:22.125381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebec22f-ba20-4ae1-8f05-b37c9eeee045 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:22.134281 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 354/710] 10.222.0.16 () {56 vars in 1112 bytes} [Mon May 2 09:58:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:22.135655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ffc3e-3432-429c-a279-8564a786fb0f None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:22.135952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ffc3e-3432-429c-a279-8564a786fb0f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:22.136234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ffc3e-3432-429c-a279-8564a786fb0f None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:22.141610 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 355/711] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:22.142405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ffc3e-3432-429c-a279-8564a786fb0f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:22.184825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc03291-9c7c-4a50-bda9-a9786bf57823 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:22.216888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a259b-0e51-4fb7-9c61-c880a518f622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:22.218044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a259b-0e51-4fb7-9c61-c880a518f622 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:22.218538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a259b-0e51-4fb7-9c61-c880a518f622 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:22.219065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a259b-0e51-4fb7-9c61-c880a518f622 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:22.226613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a259b-0e51-4fb7-9c61-c880a518f622 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:22.228487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a259b-0e51-4fb7-9c61-c880a518f622 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:22.243786 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-c05a259b-0e51-4fb7-9c61-c880a518f622 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:22.243786 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:22.243786 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:22.243786 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:22.243786 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:22.243786 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:22.243786 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:22.243786 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:22.243786 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:22.243786 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:22.243786 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:22.243786 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:22.243786 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:22.243786 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:22.243786 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:22.244743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:22.244743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:22.244743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:22.244743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:22.244743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:22.244743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:22.244743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:22.244743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:22.244743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:22.244743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:22.244743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:22.244743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:22.244743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:22.244743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:22.244743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:22.244743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:22.244743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:22.245657 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:22.245657 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:22.245657 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:22.245657 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:22.245657 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:22.245657 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:22.245657 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:22.245657 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:22.247195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ffc3e-3432-429c-a279-8564a786fb0f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:22.248151 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 357/712] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:22.249555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017ee62-fdcb-412a-89de-03b5ba0de60f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:22.250020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017ee62-fdcb-412a-89de-03b5ba0de60f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:22.250517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017ee62-fdcb-412a-89de-03b5ba0de60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:22.267675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7017ee62-fdcb-412a-89de-03b5ba0de60f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:22.269231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7017ee62-fdcb-412a-89de-03b5ba0de60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:22.285603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d21b4e-cf81-4276-ac52-b49d0b6b0fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:22.286291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d21b4e-cf81-4276-ac52-b49d0b6b0fad None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:22.286574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d21b4e-cf81-4276-ac52-b49d0b6b0fad None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:22.286848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d21b4e-cf81-4276-ac52-b49d0b6b0fad None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:22.287583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d21b4e-cf81-4276-ac52-b49d0b6b0fad None admin] RBAC: Adding query filter params (type=network) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:22.287861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d21b4e-cf81-4276-ac52-b49d0b6b0fad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:22.290174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d21b4e-cf81-4276-ac52-b49d0b6b0fad None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:22.297429 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 356/713] 10.222.0.16 () {56 vars in 1112 bytes} [Mon May 2 09:58:22 2022] GET /identity/v3/services?type=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:22.301575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d21b4e-cf81-4276-ac52-b49d0b6b0fad None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:22.394921 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 358/714] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:58:22.446819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017ee62-fdcb-412a-89de-03b5ba0de60f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:22.490787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d21b4e-cf81-4276-ac52-b49d0b6b0fad None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:22.545632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2acfc-f80b-4d5a-aa41-2c2ba8723bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:22.546764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2acfc-f80b-4d5a-aa41-2c2ba8723bad None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:22.547521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2acfc-f80b-4d5a-aa41-2c2ba8723bad None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:22.548318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2acfc-f80b-4d5a-aa41-2c2ba8723bad None admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:22.549508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2acfc-f80b-4d5a-aa41-2c2ba8723bad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:22.550003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2acfc-f80b-4d5a-aa41-2c2ba8723bad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:22.552170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2acfc-f80b-4d5a-aa41-2c2ba8723bad None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:22.568146 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 357/715] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:22.576290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2acfc-f80b-4d5a-aa41-2c2ba8723bad None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:22.595183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017ee62-fdcb-412a-89de-03b5ba0de60f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:22.638068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfb0c3-6582-4c92-a763-d33dc97cc419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:22.639341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfb0c3-6582-4c92-a763-d33dc97cc419 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:22.639774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfb0c3-6582-4c92-a763-d33dc97cc419 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:22.640493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfb0c3-6582-4c92-a763-d33dc97cc419 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:22.653595 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfb0c3-6582-4c92-a763-d33dc97cc419 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:22.655277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfb0c3-6582-4c92-a763-d33dc97cc419 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:22.674936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-dfcfb0c3-6582-4c92-a763-d33dc97cc419 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:22.674936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:22.674936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:22.674936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:22.674936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:22.674936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:22.674936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:22.674936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:22.674936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:22.674936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:22.674936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:22.674936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:22.674936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:22.674936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:22.674936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:22.676182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:22.676182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:22.676182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:22.676182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:22.676182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:22.676182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:22.676182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:22.676182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:22.676182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:22.676182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:22.676182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:22.676182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:22.676182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:22.676182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:22.676182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:22.676182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:22.676182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:22.677288 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:22.677288 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:22.677288 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:22.677288 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:22.684327 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 359/716] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:22.686022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfb0c3-6582-4c92-a763-d33dc97cc419 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:22.730287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2acfc-f80b-4d5a-aa41-2c2ba8723bad None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:22.800561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89611506-0891-4b5f-a414-739e2f54a7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:22.801250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89611506-0891-4b5f-a414-739e2f54a7df None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:22.801537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89611506-0891-4b5f-a414-739e2f54a7df None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:22.801814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89611506-0891-4b5f-a414-739e2f54a7df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:22.802709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89611506-0891-4b5f-a414-739e2f54a7df None admin] RBAC: Adding query filter params (role.id=dd8a47ade22941849ebdf8fbdf994b66, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=e6036dd39fb74289a8cbdcd6a21f8662) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:22.802968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89611506-0891-4b5f-a414-739e2f54a7df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:22.804707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89611506-0891-4b5f-a414-739e2f54a7df None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:22.815728 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 358/717] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:58:22 2022] GET /identity/v3/role_assignments?user.id=e6036dd39fb74289a8cbdcd6a21f8662&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=dd8a47ade22941849ebdf8fbdf994b66 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:22.865866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfb0c3-6582-4c92-a763-d33dc97cc419 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:22.920342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868c9b8-1a10-4afb-836a-72f3b4bbbe7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:22.921062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868c9b8-1a10-4afb-836a-72f3b4bbbe7e None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:22.921351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868c9b8-1a10-4afb-836a-72f3b4bbbe7e None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:22.921634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868c9b8-1a10-4afb-836a-72f3b4bbbe7e None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:22.922384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868c9b8-1a10-4afb-836a-72f3b4bbbe7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:22.922697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868c9b8-1a10-4afb-836a-72f3b4bbbe7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:22.924107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868c9b8-1a10-4afb-836a-72f3b4bbbe7e None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:22.948771 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 360/718] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:22.954438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89611506-0891-4b5f-a414-739e2f54a7df None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:23.061035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89611506-0891-4b5f-a414-739e2f54a7df None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:23.095518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d1ead-267f-44a6-919d-773770423e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:23.096223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d1ead-267f-44a6-919d-773770423e4e None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:23.096512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d1ead-267f-44a6-919d-773770423e4e None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:23.096830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d1ead-267f-44a6-919d-773770423e4e None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:23.097566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d1ead-267f-44a6-919d-773770423e4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:23.099024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d1ead-267f-44a6-919d-773770423e4e None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:23.204304 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 359/719] 10.222.0.16 () {60 vars in 1132 bytes} [Mon May 2 09:58:22 2022] POST /identity/v3/users => generated 254 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:58:23.588515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622bd57-8a30-49b6-ad87-69e3de386b78 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:23.589056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622bd57-8a30-49b6-ad87-69e3de386b78 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:23.589133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622bd57-8a30-49b6-ad87-69e3de386b78 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:23.590832 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 361/720] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:23.596221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67480f-8953-402c-8ffc-ae5f80f5404c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:23.596519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67480f-8953-402c-8ffc-ae5f80f5404c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:23.596832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67480f-8953-402c-8ffc-ae5f80f5404c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:23.615555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ce67480f-8953-402c-8ffc-ae5f80f5404c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:23.617362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ce67480f-8953-402c-8ffc-ae5f80f5404c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:23.693823 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 360/721] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:58:23.723806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622bd57-8a30-49b6-ad87-69e3de386b78 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:23.830342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622bd57-8a30-49b6-ad87-69e3de386b78 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:23.866830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60f293-3fc0-4f8f-95ec-9f0d41e40764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:23.867839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60f293-3fc0-4f8f-95ec-9f0d41e40764 None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:23.868417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60f293-3fc0-4f8f-95ec-9f0d41e40764 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:23.868926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60f293-3fc0-4f8f-95ec-9f0d41e40764 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:23.869864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be60f293-3fc0-4f8f-95ec-9f0d41e40764 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:23.871434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be60f293-3fc0-4f8f-95ec-9f0d41e40764 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:23.977905 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 362/722] 10.222.0.16 () {60 vars in 1141 bytes} [Mon May 2 09:58:23 2022] POST /identity/v3/services => generated 251 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:58:24.439611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b165e-e19e-4afa-bb06-5c72ef4aceff None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:24.440128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b165e-e19e-4afa-bb06-5c72ef4aceff None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:24.440207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b165e-e19e-4afa-bb06-5c72ef4aceff None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:24.441809 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 361/723] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:24.447030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f40bfa-e10c-4d46-9a01-82aacfbab1bb None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:24.447320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f40bfa-e10c-4d46-9a01-82aacfbab1bb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:24.447605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f40bfa-e10c-4d46-9a01-82aacfbab1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:24.467566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-35f40bfa-e10c-4d46-9a01-82aacfbab1bb None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:24.468790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-35f40bfa-e10c-4d46-9a01-82aacfbab1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:24.549647 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 363/724] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:24 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:58:24.575004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b165e-e19e-4afa-bb06-5c72ef4aceff None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:24.688194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b165e-e19e-4afa-bb06-5c72ef4aceff None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:24.730862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971915c-12b0-48f3-a8cb-a871ddd7d54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:24.731573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971915c-12b0-48f3-a8cb-a871ddd7d54c None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:24.731849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971915c-12b0-48f3-a8cb-a871ddd7d54c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:24.732122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971915c-12b0-48f3-a8cb-a871ddd7d54c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:24.745451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971915c-12b0-48f3-a8cb-a871ddd7d54c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:24.752854 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-5971915c-12b0-48f3-a8cb-a871ddd7d54c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:58:24.752854 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:24.752854 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:24.752854 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:24.752854 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:24.752854 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:24.752854 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:24.752854 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:24.752854 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:24.752854 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:24.752854 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:24.752854 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:24.752854 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:24.752854 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:24.752854 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:24.752854 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:24.753789 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:24.753789 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:24.753789 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:24.753789 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:24.753789 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:24.753789 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:24.753789 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:24.753789 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:24.753789 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:24.753789 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:24.753789 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:24.753789 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:24.753789 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:24.753789 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:24.753789 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:24.753789 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:24.755456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:24.755456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:24.755456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:24.755456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:24.755456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:24.755456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:24.755456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:24.755456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:24.755456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:24.755456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:24.755456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:58:24.755456 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:24.755456 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 362/725] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:58:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:24.765934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f40bfa-e10c-4d46-9a01-82aacfbab1bb None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:24.915188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f40bfa-e10c-4d46-9a01-82aacfbab1bb None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:24.949746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f77a19-5ede-46dd-89c9-4b41efbfee19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:24.950419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f77a19-5ede-46dd-89c9-4b41efbfee19 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:24.950697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f77a19-5ede-46dd-89c9-4b41efbfee19 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:24.950970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f77a19-5ede-46dd-89c9-4b41efbfee19 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:24.951713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f77a19-5ede-46dd-89c9-4b41efbfee19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:24.952018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f77a19-5ede-46dd-89c9-4b41efbfee19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:24.953446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f77a19-5ede-46dd-89c9-4b41efbfee19 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:24.962525 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 364/726] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:58:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:24.967889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971915c-12b0-48f3-a8cb-a871ddd7d54c None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:25.040931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb87d1d-47a9-419a-ad23-a3b11d674c5a None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:25.041216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb87d1d-47a9-419a-ad23-a3b11d674c5a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:25.041374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb87d1d-47a9-419a-ad23-a3b11d674c5a None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:25.043276 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 365/727] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:25.052862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c828a-0054-488c-b423-89c32ebd6c7b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:25.053199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c828a-0054-488c-b423-89c32ebd6c7b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:25.053432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c828a-0054-488c-b423-89c32ebd6c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:25.087841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f81c828a-0054-488c-b423-89c32ebd6c7b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:25.090110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f81c828a-0054-488c-b423-89c32ebd6c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:25.118575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971915c-12b0-48f3-a8cb-a871ddd7d54c None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:25.175862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e8c6e-2428-476e-ad2d-ba99d6d12a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:25.176817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e8c6e-2428-476e-ad2d-ba99d6d12a01 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:25.177110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e8c6e-2428-476e-ad2d-ba99d6d12a01 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:25.177389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e8c6e-2428-476e-ad2d-ba99d6d12a01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:25.192634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e8c6e-2428-476e-ad2d-ba99d6d12a01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:25.192634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e8c6e-2428-476e-ad2d-ba99d6d12a01 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:25.211239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-543e8c6e-2428-476e-ad2d-ba99d6d12a01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:25.211239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:25.211239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:25.211239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:25.211239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:25.211239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:25.211239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:25.211239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:25.211239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:25.211239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:25.211239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:25.211239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:25.211239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:25.211239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:25.211239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:25.212183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:25.212183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:25.212183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:25.212183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:25.212183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:25.212183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:25.212183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:25.212183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:25.212183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:25.212183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:25.212183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:25.212183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:25.212183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:25.212183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:25.212183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:25.212183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:25.212183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:25.213100 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:25.213100 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:25.213100 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:25.213100 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:25.213100 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 363/728] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:25.221516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e8c6e-2428-476e-ad2d-ba99d6d12a01 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:25.239280 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 366/729] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:25 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 09:58:25.277337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c828a-0054-488c-b423-89c32ebd6c7b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:25.324943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e8c6e-2428-476e-ad2d-ba99d6d12a01 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:25.358858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c8eb5-d761-451a-b85e-8052b666f841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:25.359537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c8eb5-d761-451a-b85e-8052b666f841 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:25.359870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c8eb5-d761-451a-b85e-8052b666f841 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:25.368792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c8eb5-d761-451a-b85e-8052b666f841 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:25.368792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c8eb5-d761-451a-b85e-8052b666f841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:25.368792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c8eb5-d761-451a-b85e-8052b666f841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:25.368792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c8eb5-d761-451a-b85e-8052b666f841 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:25.375270 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 364/730] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:25.382016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c8eb5-d761-451a-b85e-8052b666f841 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:25.438702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c828a-0054-488c-b423-89c32ebd6c7b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:25.500219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b47a90-057b-48d6-8e2b-b4af2ee824f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:25.500930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b47a90-057b-48d6-8e2b-b4af2ee824f4 None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:25.501218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b47a90-057b-48d6-8e2b-b4af2ee824f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:25.501505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b47a90-057b-48d6-8e2b-b4af2ee824f4 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:25.502243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b47a90-057b-48d6-8e2b-b4af2ee824f4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:25.503629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b47a90-057b-48d6-8e2b-b4af2ee824f4 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:25.542549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c8eb5-d761-451a-b85e-8052b666f841 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:25.587068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf04ad8-a9ae-4f55-a83c-47fe3749a504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:25.587812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf04ad8-a9ae-4f55-a83c-47fe3749a504 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:25.589244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf04ad8-a9ae-4f55-a83c-47fe3749a504 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:25.590268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf04ad8-a9ae-4f55-a83c-47fe3749a504 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:25.591232 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 367/731] 10.222.0.16 () {60 vars in 1141 bytes} [Mon May 2 09:58:25 2022] POST /identity/v3/services => generated 240 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 09:58:25.599096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf04ad8-a9ae-4f55-a83c-47fe3749a504 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:25.602791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf04ad8-a9ae-4f55-a83c-47fe3749a504 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:25.617365 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-8cf04ad8-a9ae-4f55-a83c-47fe3749a504 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 02 09:58:25.617365 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:25.617365 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:25.617365 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:25.617365 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:25.617365 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:25.617365 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:25.617365 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:25.617365 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:25.617365 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:25.617365 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:25.617365 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:25.617365 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:25.617365 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:25.617365 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:25.617365 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:25.618367 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:25.618367 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:25.618367 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:25.618367 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:25.618367 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:25.618367 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:25.618367 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:25.618367 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:25.618367 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:25.618367 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:25.618367 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:25.618367 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:25.618367 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:25.618367 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:25.618367 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:25.618367 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:25.618367 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:25.618367 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:25.619344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:25.619344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:25.619344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:25.619344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:25.619344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:25.619344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:25.619344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:25.619344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:25.619344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 02 09:58:25.619344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:25.619344 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 365/732] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:58:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:25.625892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b47a90-057b-48d6-8e2b-b4af2ee824f4 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:25.769871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b47a90-057b-48d6-8e2b-b4af2ee824f4 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:25.815993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb51d9-8f48-4d86-8c58-5c59b634d3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:25.817070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb51d9-8f48-4d86-8c58-5c59b634d3d2 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:25.817564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb51d9-8f48-4d86-8c58-5c59b634d3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:25.818152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb51d9-8f48-4d86-8c58-5c59b634d3d2 None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:25.819251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb51d9-8f48-4d86-8c58-5c59b634d3d2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:25.819818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb51d9-8f48-4d86-8c58-5c59b634d3d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:25.821516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb51d9-8f48-4d86-8c58-5c59b634d3d2 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:25.850174 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 368/733] 10.222.0.16 () {56 vars in 1135 bytes} [Mon May 2 09:58:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:25.856276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf04ad8-a9ae-4f55-a83c-47fe3749a504 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:25.886502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fd6ef-e1e0-490e-afdf-89473c886528 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:25.887205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fd6ef-e1e0-490e-afdf-89473c886528 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:25.887692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fd6ef-e1e0-490e-afdf-89473c886528 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:25.889673 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 369/734] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:58:25.894957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46693f33-412d-4696-8d09-2ffdcd2ce79a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:25.895556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46693f33-412d-4696-8d09-2ffdcd2ce79a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:25.896118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46693f33-412d-4696-8d09-2ffdcd2ce79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:25.916062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-46693f33-412d-4696-8d09-2ffdcd2ce79a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:25.917794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-46693f33-412d-4696-8d09-2ffdcd2ce79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:25.990678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf04ad8-a9ae-4f55-a83c-47fe3749a504 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:25.993179 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 370/735] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 09:58:26.019655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46693f33-412d-4696-8d09-2ffdcd2ce79a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:26.039588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f06f9-30c6-44d6-a2b1-579284b323fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:26.040266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f06f9-30c6-44d6-a2b1-579284b323fe None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:26.040556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f06f9-30c6-44d6-a2b1-579284b323fe None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:26.040850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f06f9-30c6-44d6-a2b1-579284b323fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:26.146774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46693f33-412d-4696-8d09-2ffdcd2ce79a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:26.196956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3549237-f6c8-4dc9-b7cd-5de4bfa1b75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:26.197765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3549237-f6c8-4dc9-b7cd-5de4bfa1b75f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:26.198310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3549237-f6c8-4dc9-b7cd-5de4bfa1b75f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:26.198595 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3549237-f6c8-4dc9-b7cd-5de4bfa1b75f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:26.201447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f06f9-30c6-44d6-a2b1-579284b323fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:26.202891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f06f9-30c6-44d6-a2b1-579284b323fe None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:26.223691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3549237-f6c8-4dc9-b7cd-5de4bfa1b75f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:26.234979 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-c3549237-f6c8-4dc9-b7cd-5de4bfa1b75f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:58:26.234979 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:26.234979 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:26.234979 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:26.234979 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:26.234979 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:26.234979 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:26.234979 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:26.234979 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:26.234979 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:26.234979 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:26.234979 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:26.234979 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:26.234979 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:26.234979 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:26.234979 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:26.235936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:26.235936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:26.235936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:26.235936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:26.235936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:26.235936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:26.235936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:26.235936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:26.235936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:26.235936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:26.235936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:26.235936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:26.235936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:26.235936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:26.235936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:26.235936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:26.236844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:26.236844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:26.236844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:26.236844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:26.236844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:26.236844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:26.236844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:26.236844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:26.236844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:26.236844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:26.236844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:58:26.236844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:26.243112 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 371/736] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:58:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:26.243968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3549237-f6c8-4dc9-b7cd-5de4bfa1b75f None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:26.346595 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 366/737] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:58:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 09:58:26.348051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25466774-bffe-46c7-bed9-156b44086f5b None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:26.348350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25466774-bffe-46c7-bed9-156b44086f5b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:26.348646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25466774-bffe-46c7-bed9-156b44086f5b None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:26.350252 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 367/738] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:26.351630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25466774-bffe-46c7-bed9-156b44086f5b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:26.381139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3549237-f6c8-4dc9-b7cd-5de4bfa1b75f None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:26.420138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b207a96-e862-4f5d-872d-7d7885e1b0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:26.420825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b207a96-e862-4f5d-872d-7d7885e1b0b3 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:26.421328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b207a96-e862-4f5d-872d-7d7885e1b0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:26.421613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b207a96-e862-4f5d-872d-7d7885e1b0b3 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:26.422943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b207a96-e862-4f5d-872d-7d7885e1b0b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:26.423261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b207a96-e862-4f5d-872d-7d7885e1b0b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:26.425193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b207a96-e862-4f5d-872d-7d7885e1b0b3 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:26.438729 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 372/739] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:58:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:26.440490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d09d1-0229-42ae-bd0e-2bd8c3e51ff6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:26.441111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d09d1-0229-42ae-bd0e-2bd8c3e51ff6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:26.441399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d09d1-0229-42ae-bd0e-2bd8c3e51ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:26.462841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ab9d09d1-0229-42ae-bd0e-2bd8c3e51ff6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:26.463024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25466774-bffe-46c7-bed9-156b44086f5b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:26.464032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ab9d09d1-0229-42ae-bd0e-2bd8c3e51ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:26.498463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e248356-a162-48e9-8db3-67eb40825986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:26.499431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e248356-a162-48e9-8db3-67eb40825986 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:26.499809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e248356-a162-48e9-8db3-67eb40825986 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:26.500185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e248356-a162-48e9-8db3-67eb40825986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:26.510727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e248356-a162-48e9-8db3-67eb40825986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:26.512475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e248356-a162-48e9-8db3-67eb40825986 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:26.531345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-3e248356-a162-48e9-8db3-67eb40825986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:26.531345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:26.531345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:26.531345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:26.531345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:26.531345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:26.531345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:26.531345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:26.531345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:26.531345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:26.531345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:26.531345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:26.531345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:26.531345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:26.531345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:26.532763 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:26.532763 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:26.532763 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:26.532763 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:26.532763 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:26.532763 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:26.532763 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:26.532763 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:26.532763 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:26.532763 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:26.532763 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:26.532763 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:26.532763 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:26.532763 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:26.532763 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:26.532763 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:26.532763 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:26.534640 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:26.534640 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:26.534640 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:26.534640 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:26.539398 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 368/740] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:26.540250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e248356-a162-48e9-8db3-67eb40825986 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:26.541985 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 373/741] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:58:26.542828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d09d1-0229-42ae-bd0e-2bd8c3e51ff6 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:26.653589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e248356-a162-48e9-8db3-67eb40825986 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:26.661948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d09d1-0229-42ae-bd0e-2bd8c3e51ff6 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:26.690606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8bf95-974a-48a6-aad3-e305a704a5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:26.691316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8bf95-974a-48a6-aad3-e305a704a5e2 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:26.691595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8bf95-974a-48a6-aad3-e305a704a5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:26.691867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8bf95-974a-48a6-aad3-e305a704a5e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:26.703079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8bf95-974a-48a6-aad3-e305a704a5e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:26.703347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a01c4-e151-4b40-a7f1-ee162d0c2b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:26.703969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a01c4-e151-4b40-a7f1-ee162d0c2b66 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:26.704261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a01c4-e151-4b40-a7f1-ee162d0c2b66 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:26.704523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8bf95-974a-48a6-aad3-e305a704a5e2 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:26.704714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a01c4-e151-4b40-a7f1-ee162d0c2b66 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:26.705304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a01c4-e151-4b40-a7f1-ee162d0c2b66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:26.705620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a01c4-e151-4b40-a7f1-ee162d0c2b66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:26.707497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a01c4-e151-4b40-a7f1-ee162d0c2b66 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:26.721266 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 374/742] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:26.722123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a01c4-e151-4b40-a7f1-ee162d0c2b66 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:26.723956 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-f9a8bf95-974a-48a6-aad3-e305a704a5e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:26.723956 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:26.723956 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:26.723956 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:26.723956 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:26.723956 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:26.723956 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:26.723956 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:26.723956 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:26.723956 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:26.723956 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:26.723956 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:26.723956 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:26.723956 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:26.723956 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:26.725982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:26.725982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:26.725982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:26.725982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:26.725982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:26.725982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:26.725982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:26.725982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:26.725982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:26.725982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:26.725982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:26.725982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:26.725982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:26.725982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:26.725982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:26.725982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:26.725982 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:26.728185 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:26.728185 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:26.728185 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:26.728185 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:26.729963 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 369/743] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:26.735318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8bf95-974a-48a6-aad3-e305a704a5e2 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:26.835050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8bf95-974a-48a6-aad3-e305a704a5e2 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:26.843207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a01c4-e151-4b40-a7f1-ee162d0c2b66 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:26.870046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bb852-e3f8-432b-b63f-a573607fc92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:26.870872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bb852-e3f8-432b-b63f-a573607fc92e None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:26.871488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bb852-e3f8-432b-b63f-a573607fc92e None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:26.871769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bb852-e3f8-432b-b63f-a573607fc92e None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:26.872865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80bb852-e3f8-432b-b63f-a573607fc92e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:26.873337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80bb852-e3f8-432b-b63f-a573607fc92e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:26.875333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80bb852-e3f8-432b-b63f-a573607fc92e None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:26.882846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513109a5-5717-4d84-9576-dbed1fd6e301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:26.883973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513109a5-5717-4d84-9576-dbed1fd6e301 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:26.885700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513109a5-5717-4d84-9576-dbed1fd6e301 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:26.885700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513109a5-5717-4d84-9576-dbed1fd6e301 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:26.892675 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 370/744] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:26.894067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bb852-e3f8-432b-b63f-a573607fc92e None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:26.901883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513109a5-5717-4d84-9576-dbed1fd6e301 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:26.910466 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-513109a5-5717-4d84-9576-dbed1fd6e301 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:26.910466 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:26.910466 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:26.910466 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:26.910466 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:26.910466 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:26.910466 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:26.910466 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:26.910466 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:26.910466 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:26.910466 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:26.910466 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:26.910466 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:26.910466 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:26.910466 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:26.910466 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:26.911436 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:26.911436 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:26.911436 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:26.911436 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:26.911436 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:26.911436 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:26.911436 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:26.911436 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:26.911436 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:26.911436 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:26.911436 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:26.911436 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:26.911436 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:26.911436 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:26.911436 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:26.911436 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:26.913020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:26.913020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:26.913020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:26.913020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:26.913020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:26.913020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:26.913020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:26.913020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:26.913020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:26.913020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:26.913020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:26.913020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:26.913020 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 375/745] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 09:58:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:26.913020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513109a5-5717-4d84-9576-dbed1fd6e301 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:27.009036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bb852-e3f8-432b-b63f-a573607fc92e None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:27.017126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513109a5-5717-4d84-9576-dbed1fd6e301 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:27.043831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d562d9-bc54-45f4-a53f-246610d51793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:27.045223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d562d9-bc54-45f4-a53f-246610d51793 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:27.045748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d562d9-bc54-45f4-a53f-246610d51793 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:27.046271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d562d9-bc54-45f4-a53f-246610d51793 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:27.051218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cd390-9407-4e94-b86e-6bea323fe710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:27.052031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cd390-9407-4e94-b86e-6bea323fe710 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:27.052313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cd390-9407-4e94-b86e-6bea323fe710 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:27.052591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cd390-9407-4e94-b86e-6bea323fe710 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:27.056436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d562d9-bc54-45f4-a53f-246610d51793 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:27.058166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d562d9-bc54-45f4-a53f-246610d51793 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:27.061432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cd390-9407-4e94-b86e-6bea323fe710 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:27.062867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cd390-9407-4e94-b86e-6bea323fe710 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:27.074618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-b4d562d9-bc54-45f4-a53f-246610d51793 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:27.074618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:27.074618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:27.074618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:27.074618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:27.074618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:27.074618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:27.074618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:27.074618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:27.074618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:27.074618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:27.074618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:27.074618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:27.074618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:27.074618 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:27.075524 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:27.075524 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:27.075524 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:27.075524 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:27.075524 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:27.075524 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:27.075524 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:27.075524 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:27.075524 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:27.075524 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:27.075524 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:27.075524 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:27.075524 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:27.075524 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:27.075524 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:27.075524 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:27.075524 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:27.076418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:27.076418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:27.076418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:27.076418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:27.076418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:27.076418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:27.076418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:27.076418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:27.077588 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-226cd390-9407-4e94-b86e-6bea323fe710 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 02 09:58:27.077588 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:27.077588 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:27.077588 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:27.077588 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:27.077588 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:27.077588 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:27.077588 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:27.077588 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:27.077588 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:27.077588 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:27.077588 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:27.077588 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:27.077588 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:27.077588 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:27.077588 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:27.078682 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:27.078682 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:27.078682 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:27.078682 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:27.078682 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:27.078682 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:27.078682 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:27.078682 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:27.078682 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:27.078682 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:27.078682 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:27.078682 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:27.078682 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:27.078682 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:27.078682 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:27.078682 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:27.078682 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:27.078682 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:27.079620 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:27.079620 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:27.079620 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:27.079620 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:27.079620 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:27.079620 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:27.079620 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:27.079620 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:27.079620 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 02 09:58:27.079620 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:27.081447 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 371/747] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:27.082559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d562d9-bc54-45f4-a53f-246610d51793 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:27.083380 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 376/747] 10.222.0.16 () {56 vars in 1093 bytes} [Mon May 2 09:58:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:27.084175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cd390-9407-4e94-b86e-6bea323fe710 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:27.182312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cd390-9407-4e94-b86e-6bea323fe710 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:27.185591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d562d9-bc54-45f4-a53f-246610d51793 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:27.214750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe33b0-b7ff-4021-a3cf-657eebe0f4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:27.215409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe33b0-b7ff-4021-a3cf-657eebe0f4cf None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:27.215690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe33b0-b7ff-4021-a3cf-657eebe0f4cf None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:27.215966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe33b0-b7ff-4021-a3cf-657eebe0f4cf None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:27.216818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe33b0-b7ff-4021-a3cf-657eebe0f4cf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:27.217124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe33b0-b7ff-4021-a3cf-657eebe0f4cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:27.218139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f251a0-1747-49ea-8f9e-ea39bc43af7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:27.218569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe33b0-b7ff-4021-a3cf-657eebe0f4cf None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:27.218801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f251a0-1747-49ea-8f9e-ea39bc43af7a None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:27.219145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f251a0-1747-49ea-8f9e-ea39bc43af7a None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:27.219429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f251a0-1747-49ea-8f9e-ea39bc43af7a None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:27.220168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f251a0-1747-49ea-8f9e-ea39bc43af7a None admin] RBAC: Adding query filter params (name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:27.220478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f251a0-1747-49ea-8f9e-ea39bc43af7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:27.221856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f251a0-1747-49ea-8f9e-ea39bc43af7a None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:27.234957 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 372/748] 10.222.0.16 () {56 vars in 1103 bytes} [Mon May 2 09:58:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:27.234957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f251a0-1747-49ea-8f9e-ea39bc43af7a None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:27.239601 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 377/749] 10.222.0.16 () {56 vars in 1133 bytes} [Mon May 2 09:58:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:27.244451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791d39b-fdeb-4bf7-93eb-84c59fb6932f None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:27.244451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791d39b-fdeb-4bf7-93eb-84c59fb6932f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:27.244451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791d39b-fdeb-4bf7-93eb-84c59fb6932f None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:27.244867 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 378/750] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:27.245929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791d39b-fdeb-4bf7-93eb-84c59fb6932f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:27.328854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f251a0-1747-49ea-8f9e-ea39bc43af7a None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:27.343847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791d39b-fdeb-4bf7-93eb-84c59fb6932f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:27.361760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848016b-ffe1-4a88-b14c-bb90e0af9580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:27.362415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848016b-ffe1-4a88-b14c-bb90e0af9580 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:27.362696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848016b-ffe1-4a88-b14c-bb90e0af9580 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:27.362970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848016b-ffe1-4a88-b14c-bb90e0af9580 None admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:27.364009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848016b-ffe1-4a88-b14c-bb90e0af9580 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:27.364317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848016b-ffe1-4a88-b14c-bb90e0af9580 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:27.365755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848016b-ffe1-4a88-b14c-bb90e0af9580 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:27.377655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b279893-9682-478a-a060-238b79b7cec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:27.378629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b279893-9682-478a-a060-238b79b7cec8 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:27.378920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b279893-9682-478a-a060-238b79b7cec8 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:27.379202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b279893-9682-478a-a060-238b79b7cec8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:27.383963 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 373/751] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:27.384723 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848016b-ffe1-4a88-b14c-bb90e0af9580 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:27.389408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b279893-9682-478a-a060-238b79b7cec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:27.390896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b279893-9682-478a-a060-238b79b7cec8 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:27.416643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-9b279893-9682-478a-a060-238b79b7cec8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:27.416643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:27.416643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:27.416643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:27.416643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:27.416643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:27.416643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:27.416643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:27.416643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:27.416643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:27.416643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:27.416643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:27.416643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:27.416643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:27.416643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:27.417982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:27.417982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:27.417982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:27.417982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:27.417982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:27.417982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:27.417982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:27.417982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:27.417982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:27.417982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:27.417982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:27.417982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:27.417982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:27.417982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:27.417982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:27.417982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:27.417982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:27.418890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:27.418890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:27.418890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:27.418890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:27.418890 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 379/752] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:27.418890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c6277-14ad-42cc-a062-396ec8e115ac None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:27.418890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c6277-14ad-42cc-a062-396ec8e115ac None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:27.418890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c6277-14ad-42cc-a062-396ec8e115ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:27.435665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-979c6277-14ad-42cc-a062-396ec8e115ac None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:27.437006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-979c6277-14ad-42cc-a062-396ec8e115ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:27.482452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848016b-ffe1-4a88-b14c-bb90e0af9580 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:27.503739 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 380/753] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:58:27.504942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c6277-14ad-42cc-a062-396ec8e115ac None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:27.524162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfed7d4-ea6b-4fef-afbc-971efc2dfc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:27.525053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfed7d4-ea6b-4fef-afbc-971efc2dfc14 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:27.525345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfed7d4-ea6b-4fef-afbc-971efc2dfc14 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:27.525627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfed7d4-ea6b-4fef-afbc-971efc2dfc14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:27.535798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfed7d4-ea6b-4fef-afbc-971efc2dfc14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:27.537286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfed7d4-ea6b-4fef-afbc-971efc2dfc14 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:27.555214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-8dfed7d4-ea6b-4fef-afbc-971efc2dfc14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:27.555214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:27.555214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:27.555214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:27.555214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:27.555214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:27.555214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:27.555214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:27.555214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:27.555214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:27.555214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:27.555214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:27.555214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:27.555214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:27.555214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:27.556249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:27.556249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:27.556249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:27.556249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:27.556249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:27.556249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:27.556249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:27.556249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:27.556249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:27.556249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:27.556249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:27.556249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:27.556249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:27.556249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:27.556249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:27.556249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:27.556249 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:27.557404 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:27.557404 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:27.557404 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:27.557404 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:27.557404 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 374/754] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:27.557404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfed7d4-ea6b-4fef-afbc-971efc2dfc14 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:27.655087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfed7d4-ea6b-4fef-afbc-971efc2dfc14 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:27.655760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c6277-14ad-42cc-a062-396ec8e115ac None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:27.688722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73852b-2065-4da2-83e8-00e04e70c242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:27.689388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73852b-2065-4da2-83e8-00e04e70c242 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:27.689700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73852b-2065-4da2-83e8-00e04e70c242 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:27.689821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a57bb-aae7-48af-9061-188ee50f7d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:27.690135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73852b-2065-4da2-83e8-00e04e70c242 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:27.690691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a57bb-aae7-48af-9061-188ee50f7d0e None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:27.690865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73852b-2065-4da2-83e8-00e04e70c242 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:27.691154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a57bb-aae7-48af-9061-188ee50f7d0e None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:27.691255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73852b-2065-4da2-83e8-00e04e70c242 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:27.691598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a57bb-aae7-48af-9061-188ee50f7d0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:27.692516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a57bb-aae7-48af-9061-188ee50f7d0e None admin] RBAC: Adding query filter params (role.id=dd8a47ade22941849ebdf8fbdf994b66, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=6573f5c0731c4a18bf2374c3ba006a57) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:27.692641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73852b-2065-4da2-83e8-00e04e70c242 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:27.693017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a57bb-aae7-48af-9061-188ee50f7d0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:27.694980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a57bb-aae7-48af-9061-188ee50f7d0e None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:27.708781 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 375/755] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:27.708781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73852b-2065-4da2-83e8-00e04e70c242 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:27.709257 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 381/756] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:58:27 2022] GET /identity/v3/role_assignments?user.id=6573f5c0731c4a18bf2374c3ba006a57&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=dd8a47ade22941849ebdf8fbdf994b66 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:27.710844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a57bb-aae7-48af-9061-188ee50f7d0e None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:27.818717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a57bb-aae7-48af-9061-188ee50f7d0e None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:27.841046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73852b-2065-4da2-83e8-00e04e70c242 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:27.855467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82b33d-e806-446d-8408-16b2019705ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:27.856344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82b33d-e806-446d-8408-16b2019705ce None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:27.856782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82b33d-e806-446d-8408-16b2019705ce None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:27.857188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82b33d-e806-446d-8408-16b2019705ce None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:27.858037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82b33d-e806-446d-8408-16b2019705ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:27.858448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82b33d-e806-446d-8408-16b2019705ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:27.859944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82b33d-e806-446d-8408-16b2019705ce None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:27.876816 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 382/757] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:27.878343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82b33d-e806-446d-8408-16b2019705ce None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:27.882196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e8bc3-4d1d-4fb9-8dc1-48df79cf8502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:27.883040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e8bc3-4d1d-4fb9-8dc1-48df79cf8502 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:27.883323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e8bc3-4d1d-4fb9-8dc1-48df79cf8502 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:27.884470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e8bc3-4d1d-4fb9-8dc1-48df79cf8502 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:27.884470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e8bc3-4d1d-4fb9-8dc1-48df79cf8502 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:27.890473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e8bc3-4d1d-4fb9-8dc1-48df79cf8502 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:27.906393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-ca0e8bc3-4d1d-4fb9-8dc1-48df79cf8502 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 02 09:58:27.906393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:27.906393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 09:58:27.906393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 09:58:27.906393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 09:58:27.906393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 09:58:27.906393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 09:58:27.906393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:27.906393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 02 09:58:27.906393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:27.906393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:58:27.906393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:27.906393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:27.906393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:27.906393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:27.906393 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:27.907377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:27.907377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:27.907377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:27.907377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:27.907377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:27.907377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:27.907377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:27.907377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 09:58:27.907377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 09:58:27.907377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 09:58:27.907377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 09:58:27.907377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:27.907377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:27.907377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:27.907377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:27.907377 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:27.908221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:27.908221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:27.908221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:27.908221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:27.908221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:27.908221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:27.908221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:27.908221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:27.908221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:27.908221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:27.908221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:27.908221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 09:58:27.908221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:27.908221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 02 09:58:27.908221 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:27.909085 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 376/758] 10.222.0.16 () {56 vars in 1129 bytes} [Mon May 2 09:58:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:27.914751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e8bc3-4d1d-4fb9-8dc1-48df79cf8502 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:28.005288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82b33d-e806-446d-8408-16b2019705ce None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:28.020480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e8bc3-4d1d-4fb9-8dc1-48df79cf8502 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:28.056594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1024c9-2e3b-409f-bd56-d10aafe51291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:28.057980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1024c9-2e3b-409f-bd56-d10aafe51291 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:28.058527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1024c9-2e3b-409f-bd56-d10aafe51291 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:28.058950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1024c9-2e3b-409f-bd56-d10aafe51291 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:28.060248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de0eb0-a41d-4e8c-b584-73e3fe0a6058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:28.061198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de0eb0-a41d-4e8c-b584-73e3fe0a6058 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:28.061570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de0eb0-a41d-4e8c-b584-73e3fe0a6058 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:28.061983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de0eb0-a41d-4e8c-b584-73e3fe0a6058 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:28.068041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1024c9-2e3b-409f-bd56-d10aafe51291 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:28.070469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1024c9-2e3b-409f-bd56-d10aafe51291 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:28.071886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de0eb0-a41d-4e8c-b584-73e3fe0a6058 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:28.073350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de0eb0-a41d-4e8c-b584-73e3fe0a6058 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:28.088447 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-e5de0eb0-a41d-4e8c-b584-73e3fe0a6058 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:28.088447 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:28.088447 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:28.088447 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:28.088447 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:28.088447 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:28.088447 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:28.088447 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:28.088447 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:28.088447 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:28.088447 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:28.088447 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:28.088447 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:28.088447 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:28.088447 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:28.089411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:28.089411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:28.089411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:28.089411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:28.089411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:28.089411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:28.089411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:28.089411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:28.089411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:28.089411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:28.089411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:28.089411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:28.089411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:28.089411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:28.089411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:28.089411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:28.089411 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:28.090296 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:28.090296 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:28.090296 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:28.090296 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:28.090296 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:28.090296 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:28.090296 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:28.090296 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:28.092144 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-db1024c9-2e3b-409f-bd56-d10aafe51291 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 02 09:58:28.092144 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:28.092144 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:28.092144 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:28.092144 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:28.092144 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:28.092144 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:28.092144 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:28.092144 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:28.092144 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:28.092144 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:28.092144 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:28.092144 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:28.092144 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:28.092144 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:28.092144 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:28.093233 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:28.093233 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:28.093233 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:28.093233 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:28.093233 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:28.093233 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:28.093233 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:28.093233 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:28.093233 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:28.093233 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:28.093233 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:28.093233 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:28.093233 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:28.093233 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:28.093233 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:28.093233 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:28.093233 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:28.093233 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:28.094184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:28.094184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:28.094184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:28.094184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:28.094184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:28.094184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:28.094184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:28.094184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:28.094184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 02 09:58:28.094184 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:28.094719 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 377/759] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:28.095609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de0eb0-a41d-4e8c-b584-73e3fe0a6058 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:28.097198 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 383/760] 10.222.0.16 () {56 vars in 1117 bytes} [Mon May 2 09:58:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:28.098695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1024c9-2e3b-409f-bd56-d10aafe51291 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:28.205557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de0eb0-a41d-4e8c-b584-73e3fe0a6058 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:28.215354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1024c9-2e3b-409f-bd56-d10aafe51291 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:28.241413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164e80a-47b4-453a-a2f9-3e4899d0f037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:28.242104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164e80a-47b4-453a-a2f9-3e4899d0f037 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:28.242394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164e80a-47b4-453a-a2f9-3e4899d0f037 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:28.242677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164e80a-47b4-453a-a2f9-3e4899d0f037 None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:28.243387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164e80a-47b4-453a-a2f9-3e4899d0f037 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:28.243703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164e80a-47b4-453a-a2f9-3e4899d0f037 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:28.245106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164e80a-47b4-453a-a2f9-3e4899d0f037 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:28.248591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133756b4-90fc-48a8-92b4-e37b26afdd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:28.249305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133756b4-90fc-48a8-92b4-e37b26afdd8d None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:28.253986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133756b4-90fc-48a8-92b4-e37b26afdd8d None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:28.254097 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 378/761] 10.222.0.16 () {56 vars in 1124 bytes} [Mon May 2 09:58:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:28.254177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133756b4-90fc-48a8-92b4-e37b26afdd8d None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:28.254284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164e80a-47b4-453a-a2f9-3e4899d0f037 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:28.254362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133756b4-90fc-48a8-92b4-e37b26afdd8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:28.254362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133756b4-90fc-48a8-92b4-e37b26afdd8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:28.254362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133756b4-90fc-48a8-92b4-e37b26afdd8d None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:28.265437 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 384/762] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:28.266797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b525ef-121e-481c-a3ee-9c356a73cc6a None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:28.267207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b525ef-121e-481c-a3ee-9c356a73cc6a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:28.267561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b525ef-121e-481c-a3ee-9c356a73cc6a None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:28.273327 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 385/763] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:28.273327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b525ef-121e-481c-a3ee-9c356a73cc6a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:28.357334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164e80a-47b4-453a-a2f9-3e4899d0f037 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:28.368655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b525ef-121e-481c-a3ee-9c356a73cc6a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:28.390758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a8196-1a80-4818-b8e0-cce7be06ee4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:28.391433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a8196-1a80-4818-b8e0-cce7be06ee4b None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:28.391722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a8196-1a80-4818-b8e0-cce7be06ee4b None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:28.392008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a8196-1a80-4818-b8e0-cce7be06ee4b None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:28.392877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a8196-1a80-4818-b8e0-cce7be06ee4b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:28.393187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a8196-1a80-4818-b8e0-cce7be06ee4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:28.394618 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a8196-1a80-4818-b8e0-cce7be06ee4b None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:28.401906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e5a51-49c8-4f3e-af41-212bcc635e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:28.402567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e5a51-49c8-4f3e-af41-212bcc635e99 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:28.402856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e5a51-49c8-4f3e-af41-212bcc635e99 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:28.403135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e5a51-49c8-4f3e-af41-212bcc635e99 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:28.403843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e5a51-49c8-4f3e-af41-212bcc635e99 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:28.404149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e5a51-49c8-4f3e-af41-212bcc635e99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:28.405530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e5a51-49c8-4f3e-af41-212bcc635e99 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:28.414687 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 386/764] 10.222.0.16 () {56 vars in 1124 bytes} [Mon May 2 09:58:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:28.414687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e5a51-49c8-4f3e-af41-212bcc635e99 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:28.414925 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 379/765] 10.222.0.16 () {56 vars in 1149 bytes} [Mon May 2 09:58:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:28.414925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870409ee-775e-43f4-8e8a-e6697cf5dad5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:28.414925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870409ee-775e-43f4-8e8a-e6697cf5dad5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:28.414925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870409ee-775e-43f4-8e8a-e6697cf5dad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:28.431412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-870409ee-775e-43f4-8e8a-e6697cf5dad5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:28.432610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-870409ee-775e-43f4-8e8a-e6697cf5dad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:28.503271 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 380/766] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:58:28.503271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870409ee-775e-43f4-8e8a-e6697cf5dad5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:28.522863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e5a51-49c8-4f3e-af41-212bcc635e99 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:28.556231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d5f83-cf73-4ee7-88dc-abcfcfb9c7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:28.557163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d5f83-cf73-4ee7-88dc-abcfcfb9c7e0 None admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:28.557451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d5f83-cf73-4ee7-88dc-abcfcfb9c7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:28.557736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d5f83-cf73-4ee7-88dc-abcfcfb9c7e0 None admin] PATH_INFO: `/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/e6036dd39fb74289a8cbdcd6a21f8662/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:28.559719 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d5f83-cf73-4ee7-88dc-abcfcfb9c7e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=972cae0aa9694d6cad22fbdbcf916ff7, user_id=e6036dd39fb74289a8cbdcd6a21f8662, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:28.561201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d5f83-cf73-4ee7-88dc-abcfcfb9c7e0 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:28.595936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870409ee-775e-43f4-8e8a-e6697cf5dad5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:28.640630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5f0f1-14dc-49f3-966b-1f5b9d589428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:28.640877 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 387/767] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 09:58:28 2022] PUT /identity/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/e6036dd39fb74289a8cbdcd6a21f8662/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:58:28.640982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5f0f1-14dc-49f3-966b-1f5b9d589428 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:28.640982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5f0f1-14dc-49f3-966b-1f5b9d589428 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:28.640982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5f0f1-14dc-49f3-966b-1f5b9d589428 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:28.641180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d5f83-cf73-4ee7-88dc-abcfcfb9c7e0 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:28.641259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5f0f1-14dc-49f3-966b-1f5b9d589428 None admin] RBAC: Adding query filter params (interface=public, service_id=1f0165a229a445cfbd21c6971b83375d, region_id=RegionOne) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:28.641259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5f0f1-14dc-49f3-966b-1f5b9d589428 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:28.641259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5f0f1-14dc-49f3-966b-1f5b9d589428 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:28.652981 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 381/768] 10.222.0.16 () {56 vars in 1251 bytes} [Mon May 2 09:58:28 2022] GET /identity/v3/endpoints?service_id=1f0165a229a445cfbd21c6971b83375d&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:28.656658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5f0f1-14dc-49f3-966b-1f5b9d589428 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:28.768045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5f0f1-14dc-49f3-966b-1f5b9d589428 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:28.823086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678902b6-5513-4e9e-ad7f-fbe9ee6892e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:28.825289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678902b6-5513-4e9e-ad7f-fbe9ee6892e0 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:28.826802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678902b6-5513-4e9e-ad7f-fbe9ee6892e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:28.827783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678902b6-5513-4e9e-ad7f-fbe9ee6892e0 None admin] PATH_INFO: `/v3/services/network` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:28.829046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678902b6-5513-4e9e-ad7f-fbe9ee6892e0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:28.831760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678902b6-5513-4e9e-ad7f-fbe9ee6892e0 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:28.840862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d5f83-cf73-4ee7-88dc-abcfcfb9c7e0 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:28.854482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-678902b6-5513-4e9e-ad7f-fbe9ee6892e0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 02 09:58:28.854482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:28.854482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 09:58:28.854482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 09:58:28.854482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 09:58:28.854482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 09:58:28.854482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 09:58:28.854482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:28.854482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 02 09:58:28.854482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:28.854482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:58:28.854482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:28.854482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:28.854482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:28.854482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:28.854482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:28.854482 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:28.855543 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:28.855543 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:28.855543 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:28.855543 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:28.855543 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:28.855543 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:28.855543 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 09:58:28.855543 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 09:58:28.855543 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 09:58:28.855543 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 09:58:28.855543 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:28.855543 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:28.855543 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:28.855543 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:28.855543 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:28.855543 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:28.856933 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:28.856933 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:28.856933 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:28.856933 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:28.856933 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:28.856933 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:28.856933 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:28.856933 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:28.856933 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:28.856933 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:28.856933 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 09:58:28.856933 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:28.856933 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 02 09:58:28.856933 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:28.859723 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 382/769] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:28 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:28.860888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678902b6-5513-4e9e-ad7f-fbe9ee6892e0 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:28.892123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0724e5-f926-4ba8-b0a8-d27ffb4f43e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:28.892823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0724e5-f926-4ba8-b0a8-d27ffb4f43e9 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:28.894065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0724e5-f926-4ba8-b0a8-d27ffb4f43e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:28.894065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0724e5-f926-4ba8-b0a8-d27ffb4f43e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:28.978204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0724e5-f926-4ba8-b0a8-d27ffb4f43e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:28.979796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0724e5-f926-4ba8-b0a8-d27ffb4f43e9 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:29.095158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678902b6-5513-4e9e-ad7f-fbe9ee6892e0 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:29.101422 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 388/770] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:58:28 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 09:58:29.102474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0724e5-f926-4ba8-b0a8-d27ffb4f43e9 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:29.175530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e0808-1a4a-41f2-b3c4-18363beadcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:29.176201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e0808-1a4a-41f2-b3c4-18363beadcad None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:29.176488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e0808-1a4a-41f2-b3c4-18363beadcad None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:29.176796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e0808-1a4a-41f2-b3c4-18363beadcad None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:29.177488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e0808-1a4a-41f2-b3c4-18363beadcad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:29.178860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e0808-1a4a-41f2-b3c4-18363beadcad None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:29.192771 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 383/771] 10.222.0.16 () {56 vars in 1087 bytes} [Mon May 2 09:58:28 2022] GET /identity/v3/services => generated 772 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:29.192771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e0808-1a4a-41f2-b3c4-18363beadcad None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:29.277628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0724e5-f926-4ba8-b0a8-d27ffb4f43e9 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:29.360521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e0808-1a4a-41f2-b3c4-18363beadcad None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:29.370167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de3ed0-c47a-4c80-b133-2fc3cabfaa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:29.370858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de3ed0-c47a-4c80-b133-2fc3cabfaa3b None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:29.371145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de3ed0-c47a-4c80-b133-2fc3cabfaa3b None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:29.371424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de3ed0-c47a-4c80-b133-2fc3cabfaa3b None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:29.372454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de3ed0-c47a-4c80-b133-2fc3cabfaa3b None admin] RBAC: Adding query filter params (name=network) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:29.372454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de3ed0-c47a-4c80-b133-2fc3cabfaa3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:29.374095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de3ed0-c47a-4c80-b133-2fc3cabfaa3b None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:29.386297 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 389/772] 10.222.0.16 () {56 vars in 1112 bytes} [Mon May 2 09:58:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:29.391665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de3ed0-c47a-4c80-b133-2fc3cabfaa3b None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:29.401559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d1467-8b20-4f09-b076-01b2ae6c5ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:29.402731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d1467-8b20-4f09-b076-01b2ae6c5ffa None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:29.403219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d1467-8b20-4f09-b076-01b2ae6c5ffa None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:29.403695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d1467-8b20-4f09-b076-01b2ae6c5ffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:29.416914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d1467-8b20-4f09-b076-01b2ae6c5ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:29.418777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d1467-8b20-4f09-b076-01b2ae6c5ffa None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:29.439233 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-3b2d1467-8b20-4f09-b076-01b2ae6c5ffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:29.439233 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:29.439233 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:29.439233 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:29.439233 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:29.439233 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:29.439233 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:29.439233 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:29.439233 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:29.439233 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:29.439233 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:29.439233 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:29.439233 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:29.439233 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:29.439233 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:29.440238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:29.440238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:29.440238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:29.440238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:29.440238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:29.440238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:29.440238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:29.440238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:29.440238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:29.440238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:29.440238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:29.440238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:29.440238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:29.440238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:29.440238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:29.440238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:29.440238 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:29.441375 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:29.441375 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:29.441375 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:29.441375 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:29.443238 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 384/773] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:29.448833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d1467-8b20-4f09-b076-01b2ae6c5ffa None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:29.519906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de3ed0-c47a-4c80-b133-2fc3cabfaa3b None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:29.552380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d1467-8b20-4f09-b076-01b2ae6c5ffa None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:29.555252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0e7c3-a960-40f7-97d2-07ab7ed97634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:29.556217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0e7c3-a960-40f7-97d2-07ab7ed97634 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:29.556439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0e7c3-a960-40f7-97d2-07ab7ed97634 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:29.556849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0e7c3-a960-40f7-97d2-07ab7ed97634 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:29.557668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0e7c3-a960-40f7-97d2-07ab7ed97634 None admin] RBAC: Adding query filter params (type=network) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:29.558086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0e7c3-a960-40f7-97d2-07ab7ed97634 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:29.559735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0e7c3-a960-40f7-97d2-07ab7ed97634 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:29.565402 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 390/774] 10.222.0.16 () {56 vars in 1112 bytes} [Mon May 2 09:58:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:29.571874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0e7c3-a960-40f7-97d2-07ab7ed97634 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:29.599304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa24a67-9f48-444d-889a-137b9aca5d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:29.600171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa24a67-9f48-444d-889a-137b9aca5d58 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:29.600555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa24a67-9f48-444d-889a-137b9aca5d58 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:29.601017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa24a67-9f48-444d-889a-137b9aca5d58 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:29.601925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa24a67-9f48-444d-889a-137b9aca5d58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:29.602336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa24a67-9f48-444d-889a-137b9aca5d58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:29.603887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa24a67-9f48-444d-889a-137b9aca5d58 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:29.616583 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 385/775] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:29.621841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa24a67-9f48-444d-889a-137b9aca5d58 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:29.690480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0e7c3-a960-40f7-97d2-07ab7ed97634 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:29.725332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa24a67-9f48-444d-889a-137b9aca5d58 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:29.745847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671786ff-a3e3-4ed6-b6ff-cd0a174f906b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:29.746685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671786ff-a3e3-4ed6-b6ff-cd0a174f906b None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:29.747119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671786ff-a3e3-4ed6-b6ff-cd0a174f906b None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:29.747501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671786ff-a3e3-4ed6-b6ff-cd0a174f906b None admin] PATH_INFO: `/v3/endpoints` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:29.748435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671786ff-a3e3-4ed6-b6ff-cd0a174f906b None admin] RBAC: Adding query filter params (interface=public, service_id=cc88d97353ff47008f57f228c42cd3e4, region_id=RegionOne) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:29.748878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671786ff-a3e3-4ed6-b6ff-cd0a174f906b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:29.751136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671786ff-a3e3-4ed6-b6ff-cd0a174f906b None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:29.766251 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 391/776] 10.222.0.16 () {56 vars in 1251 bytes} [Mon May 2 09:58:29 2022] GET /identity/v3/endpoints?service_id=cc88d97353ff47008f57f228c42cd3e4&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:29.774165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671786ff-a3e3-4ed6-b6ff-cd0a174f906b None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:29.782705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043176e-f354-468a-8775-d625dbd5857a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:29.784338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043176e-f354-468a-8775-d625dbd5857a None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:29.784650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043176e-f354-468a-8775-d625dbd5857a None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:29.784935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043176e-f354-468a-8775-d625dbd5857a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:29.792157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043176e-f354-468a-8775-d625dbd5857a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:29.793657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043176e-f354-468a-8775-d625dbd5857a None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:29.807963 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-5043176e-f354-468a-8775-d625dbd5857a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:29.807963 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:29.807963 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:29.807963 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:29.807963 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:29.807963 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:29.807963 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:29.807963 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:29.807963 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:29.807963 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:29.807963 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:29.807963 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:29.807963 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:29.807963 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:29.807963 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:29.808939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:29.808939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:29.808939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:29.808939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:29.808939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:29.808939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:29.808939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:29.808939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:29.808939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:29.808939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:29.808939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:29.808939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:29.808939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:29.808939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:29.808939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:29.808939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:29.808939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:29.810006 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:29.810006 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:29.810006 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:29.810006 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:29.810006 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:29.810006 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:29.810006 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:29.810006 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:29.810006 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 386/777] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:29.816755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043176e-f354-468a-8775-d625dbd5857a None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:29.961778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671786ff-a3e3-4ed6-b6ff-cd0a174f906b None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:30.003073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b1e50-ce0c-4d00-85fa-748db7c26f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:30.004233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b1e50-ce0c-4d00-85fa-748db7c26f2e None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:30.004642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b1e50-ce0c-4d00-85fa-748db7c26f2e None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:30.005042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b1e50-ce0c-4d00-85fa-748db7c26f2e None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:30.005838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b1e50-ce0c-4d00-85fa-748db7c26f2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:30.008372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b1e50-ce0c-4d00-85fa-748db7c26f2e None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:30.014860 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 392/778] 10.222.0.16 () {56 vars in 1087 bytes} [Mon May 2 09:58:29 2022] GET /identity/v3/services => generated 772 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:30.044020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043176e-f354-468a-8775-d625dbd5857a None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:30.105696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced54c08-4a7e-4e62-9fd0-1dfcb4ae13eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:30.105696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced54c08-4a7e-4e62-9fd0-1dfcb4ae13eb None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:30.105696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced54c08-4a7e-4e62-9fd0-1dfcb4ae13eb None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:30.105696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced54c08-4a7e-4e62-9fd0-1dfcb4ae13eb None admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:30.106183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced54c08-4a7e-4e62-9fd0-1dfcb4ae13eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:30.106183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced54c08-4a7e-4e62-9fd0-1dfcb4ae13eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:30.106401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced54c08-4a7e-4e62-9fd0-1dfcb4ae13eb None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:30.130708 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 387/779] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:30.137349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b1e50-ce0c-4d00-85fa-748db7c26f2e None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:30.178604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696a0cb-4ea4-4f32-8bbc-b0d9e7d85829 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:30.179427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696a0cb-4ea4-4f32-8bbc-b0d9e7d85829 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:30.179720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696a0cb-4ea4-4f32-8bbc-b0d9e7d85829 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:30.181397 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 388/780] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:58:30.195394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba5a05-659c-4df1-8158-18764356c33b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:30.195698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba5a05-659c-4df1-8158-18764356c33b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:30.195961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba5a05-659c-4df1-8158-18764356c33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:30.236548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-34ba5a05-659c-4df1-8158-18764356c33b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:30.236548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-34ba5a05-659c-4df1-8158-18764356c33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:30.288157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b1e50-ce0c-4d00-85fa-748db7c26f2e None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:30.313075 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 389/781] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 09:58:30.328301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581405c9-797e-48c5-b395-e38dc0229c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:30.329000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581405c9-797e-48c5-b395-e38dc0229c29 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:30.329288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581405c9-797e-48c5-b395-e38dc0229c29 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:30.329567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581405c9-797e-48c5-b395-e38dc0229c29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:30.330400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581405c9-797e-48c5-b395-e38dc0229c29 None admin] RBAC: Adding query filter params (role.id=a47492f29bc144158c1c2ed9a4c39d39, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=c1c06bcf38a942ffbcdc4ee6d2edebb0) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:30.330714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581405c9-797e-48c5-b395-e38dc0229c29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:30.332167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581405c9-797e-48c5-b395-e38dc0229c29 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:30.338324 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 393/782] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:58:30 2022] GET /identity/v3/role_assignments?user.id=c1c06bcf38a942ffbcdc4ee6d2edebb0&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=a47492f29bc144158c1c2ed9a4c39d39 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:30.339915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba5a05-659c-4df1-8158-18764356c33b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:30.451758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba5a05-659c-4df1-8158-18764356c33b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:30.488428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593b45a-768f-4d77-982e-f1f57050a8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:30.489203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593b45a-768f-4d77-982e-f1f57050a8f4 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:30.489491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593b45a-768f-4d77-982e-f1f57050a8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:30.489773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593b45a-768f-4d77-982e-f1f57050a8f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:30.502104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593b45a-768f-4d77-982e-f1f57050a8f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:30.510128 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-f593b45a-768f-4d77-982e-f1f57050a8f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:58:30.510128 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:30.510128 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:30.510128 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:30.510128 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:30.510128 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:30.510128 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:30.510128 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:30.510128 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:30.510128 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:30.510128 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:30.510128 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:30.510128 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:30.510128 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:30.510128 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:30.510128 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:30.511135 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:30.511135 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:30.511135 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:30.511135 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:30.511135 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:30.511135 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:30.511135 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:30.511135 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:30.511135 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:30.511135 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:30.511135 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:30.511135 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:30.511135 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:30.511135 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:30.511135 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:30.511135 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:30.511992 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:30.511992 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:30.511992 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:30.511992 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:30.511992 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:30.511992 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:30.511992 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:30.511992 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:30.511992 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:30.511992 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:30.511992 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:58:30.511992 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:30.511992 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 390/783] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:58:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:30.519919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581405c9-797e-48c5-b395-e38dc0229c29 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:30.812716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581405c9-797e-48c5-b395-e38dc0229c29 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:30.852066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b5d16-17b9-4d5d-909b-be4df8a5c9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:30.853142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b5d16-17b9-4d5d-909b-be4df8a5c9a5 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:30.853639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b5d16-17b9-4d5d-909b-be4df8a5c9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:30.854149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b5d16-17b9-4d5d-909b-be4df8a5c9a5 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:30.855106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b5d16-17b9-4d5d-909b-be4df8a5c9a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:30.855643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b5d16-17b9-4d5d-909b-be4df8a5c9a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:30.857669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b5d16-17b9-4d5d-909b-be4df8a5c9a5 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:30.867601 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 394/784] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:58:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:30.873448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593b45a-768f-4d77-982e-f1f57050a8f4 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:30.990658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593b45a-768f-4d77-982e-f1f57050a8f4 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:31.024263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6382f-ba67-40ff-bc0b-3530c298b6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:31.025464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6382f-ba67-40ff-bc0b-3530c298b6d1 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:31.025956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6382f-ba67-40ff-bc0b-3530c298b6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:31.026454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6382f-ba67-40ff-bc0b-3530c298b6d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:31.037656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6382f-ba67-40ff-bc0b-3530c298b6d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:31.039969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6382f-ba67-40ff-bc0b-3530c298b6d1 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:31.057225 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-ded6382f-ba67-40ff-bc0b-3530c298b6d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:31.057225 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:31.057225 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:31.057225 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:31.057225 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:31.057225 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:31.057225 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:31.057225 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:31.057225 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:31.057225 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:31.057225 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:31.057225 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:31.057225 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:31.057225 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:31.057225 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:31.058145 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:31.058145 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:31.058145 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:31.058145 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:31.058145 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:31.058145 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:31.058145 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:31.058145 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:31.058145 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:31.058145 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:31.058145 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:31.058145 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:31.058145 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:31.058145 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:31.058145 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:31.058145 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:31.058145 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:31.059036 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:31.059036 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:31.059036 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:31.059036 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:31.061311 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 391/785] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:31.067360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b5d16-17b9-4d5d-909b-be4df8a5c9a5 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:31.227039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b5d16-17b9-4d5d-909b-be4df8a5c9a5 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:31.268386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedd8da-ff0b-4716-8708-7aeb93b25173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:31.269083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedd8da-ff0b-4716-8708-7aeb93b25173 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:31.269365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedd8da-ff0b-4716-8708-7aeb93b25173 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:31.269641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedd8da-ff0b-4716-8708-7aeb93b25173 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:31.270366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedd8da-ff0b-4716-8708-7aeb93b25173 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:31.270673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedd8da-ff0b-4716-8708-7aeb93b25173 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:31.272035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedd8da-ff0b-4716-8708-7aeb93b25173 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:31.291898 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 395/786] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:31.297739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6382f-ba67-40ff-bc0b-3530c298b6d1 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:31.417596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6382f-ba67-40ff-bc0b-3530c298b6d1 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:31.459883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701db00-2650-4aea-a72d-3136e926d533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:31.461599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701db00-2650-4aea-a72d-3136e926d533 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:31.462113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701db00-2650-4aea-a72d-3136e926d533 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:31.462658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701db00-2650-4aea-a72d-3136e926d533 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:31.471474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701db00-2650-4aea-a72d-3136e926d533 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:31.473260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701db00-2650-4aea-a72d-3136e926d533 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:31.490828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-7701db00-2650-4aea-a72d-3136e926d533 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 02 09:58:31.490828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:31.490828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:31.490828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:31.490828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:31.490828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:31.490828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:31.490828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:31.490828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:31.490828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:31.490828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:31.490828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:31.490828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:31.490828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:31.490828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:31.490828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:31.497323 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:31.497323 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:31.497323 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:31.497323 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:31.497323 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:31.497323 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:31.497323 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:31.497323 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:31.497323 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:31.497323 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:31.497323 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:31.497323 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:31.497323 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:31.497323 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:31.497323 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:31.497323 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:31.497323 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:31.497323 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:31.498353 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:31.498353 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:31.498353 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:31.498353 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:31.498353 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:31.498353 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:31.498353 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:31.498353 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:31.498353 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 02 09:58:31.498353 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:31.499574 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 392/787] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:58:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:31.505479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedd8da-ff0b-4716-8708-7aeb93b25173 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:31.556284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac68924-3627-4687-82d4-129aaa131d53 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:31.559554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac68924-3627-4687-82d4-129aaa131d53 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:31.560105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac68924-3627-4687-82d4-129aaa131d53 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:31.562765 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 393/788] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:31.577906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d62457-47ed-48a1-a41c-999582fe4e75 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:31.578197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d62457-47ed-48a1-a41c-999582fe4e75 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:31.578475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d62457-47ed-48a1-a41c-999582fe4e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:31.606537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f7d62457-47ed-48a1-a41c-999582fe4e75 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:31.607733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f7d62457-47ed-48a1-a41c-999582fe4e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:31.649352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedd8da-ff0b-4716-8708-7aeb93b25173 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:31.694719 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0bce4-1458-4e23-814d-41aa149765da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:31.695794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0bce4-1458-4e23-814d-41aa149765da None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:31.696293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0bce4-1458-4e23-814d-41aa149765da None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:31.696811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0bce4-1458-4e23-814d-41aa149765da None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:31.697901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0bce4-1458-4e23-814d-41aa149765da None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:31.698465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0bce4-1458-4e23-814d-41aa149765da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:31.700190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0bce4-1458-4e23-814d-41aa149765da None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:31.734284 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 394/789] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 09:58:31.737173 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 396/790] 10.222.0.16 () {56 vars in 1135 bytes} [Mon May 2 09:58:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:31.743113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d62457-47ed-48a1-a41c-999582fe4e75 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:31.759214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0bce4-1458-4e23-814d-41aa149765da None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:31.870289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0bce4-1458-4e23-814d-41aa149765da None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:31.905970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237918b-686b-4553-a2c1-8a17bd0838be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:31.906765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237918b-686b-4553-a2c1-8a17bd0838be None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:31.907051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237918b-686b-4553-a2c1-8a17bd0838be None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:31.907384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237918b-686b-4553-a2c1-8a17bd0838be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:31.918065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237918b-686b-4553-a2c1-8a17bd0838be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:31.925909 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-6237918b-686b-4553-a2c1-8a17bd0838be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:58:31.925909 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:31.925909 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:31.925909 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:31.925909 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:31.925909 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:31.925909 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:31.925909 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:31.925909 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:31.925909 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:31.925909 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:31.925909 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:31.925909 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:31.925909 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:31.925909 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:31.925909 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:31.926856 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:31.926856 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:31.926856 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:31.926856 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:31.926856 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:31.926856 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:31.926856 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:31.926856 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:31.926856 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:31.926856 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:31.926856 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:31.926856 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:31.926856 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:31.926856 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:31.926856 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:31.926856 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:31.927933 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:31.927933 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:31.927933 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:31.927933 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:31.927933 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:31.927933 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:31.927933 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:31.927933 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:31.927933 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:31.927933 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:31.927933 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:58:31.927933 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:31.927933 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 397/791] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:58:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:31.935399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237918b-686b-4553-a2c1-8a17bd0838be None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:31.953336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d62457-47ed-48a1-a41c-999582fe4e75 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:32.040627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525b3c5-9966-4571-a3e1-18bcf23ab90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:32.040627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525b3c5-9966-4571-a3e1-18bcf23ab90c None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:32.040627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525b3c5-9966-4571-a3e1-18bcf23ab90c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:32.040627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525b3c5-9966-4571-a3e1-18bcf23ab90c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:32.056494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525b3c5-9966-4571-a3e1-18bcf23ab90c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:32.058109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525b3c5-9966-4571-a3e1-18bcf23ab90c None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:32.071029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237918b-686b-4553-a2c1-8a17bd0838be None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:32.082234 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-4525b3c5-9966-4571-a3e1-18bcf23ab90c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:32.082234 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:32.082234 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:32.082234 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:32.082234 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:32.082234 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:32.082234 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:32.082234 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:32.082234 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:32.082234 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:32.082234 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:32.082234 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:32.082234 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:32.082234 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:32.082234 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:32.083214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:32.083214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:32.083214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:32.083214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:32.083214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:32.083214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:32.083214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:32.083214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:32.083214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:32.083214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:32.083214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:32.083214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:32.083214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:32.083214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:32.083214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:32.083214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:32.083214 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:32.084569 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:32.084569 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:32.084569 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:32.084569 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:32.084569 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 395/792] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:32.089468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bc8db-90a2-4ab0-a1b3-27e5b8896d98 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:32.090129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bc8db-90a2-4ab0-a1b3-27e5b8896d98 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:32.091524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bc8db-90a2-4ab0-a1b3-27e5b8896d98 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:32.097019 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 396/793] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:32.097891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7bc8db-90a2-4ab0-a1b3-27e5b8896d98 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:32.122248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f672b-d0c0-41e9-9143-6484c0b14a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:32.122884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f672b-d0c0-41e9-9143-6484c0b14a46 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:32.123171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f672b-d0c0-41e9-9143-6484c0b14a46 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:32.123455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f672b-d0c0-41e9-9143-6484c0b14a46 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:32.124205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f672b-d0c0-41e9-9143-6484c0b14a46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:32.124522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f672b-d0c0-41e9-9143-6484c0b14a46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:32.126121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f672b-d0c0-41e9-9143-6484c0b14a46 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:32.139850 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 398/794] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:58:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:32.141250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e140c-f646-45c2-b5c9-8aef3c8ef520 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:32.141543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e140c-f646-45c2-b5c9-8aef3c8ef520 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:32.141824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e140c-f646-45c2-b5c9-8aef3c8ef520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:32.160692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-794e140c-f646-45c2-b5c9-8aef3c8ef520 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:32.161886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-794e140c-f646-45c2-b5c9-8aef3c8ef520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:32.212666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7bc8db-90a2-4ab0-a1b3-27e5b8896d98 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:32.232715 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 399/795] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:58:32.233597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e140c-f646-45c2-b5c9-8aef3c8ef520 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:32.258483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d40cf2-421d-42ed-8e87-579e117c07af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:32.259559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d40cf2-421d-42ed-8e87-579e117c07af None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:32.260089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d40cf2-421d-42ed-8e87-579e117c07af None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:32.260645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d40cf2-421d-42ed-8e87-579e117c07af None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:32.261610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d40cf2-421d-42ed-8e87-579e117c07af None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:32.262524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d40cf2-421d-42ed-8e87-579e117c07af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:32.263935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d40cf2-421d-42ed-8e87-579e117c07af None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:32.278737 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 397/796] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:32.279564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d40cf2-421d-42ed-8e87-579e117c07af None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:32.372488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e140c-f646-45c2-b5c9-8aef3c8ef520 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:32.382914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d40cf2-421d-42ed-8e87-579e117c07af None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:32.415753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68eca8-479a-4d66-82ff-5a5485cd5a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:32.416557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68eca8-479a-4d66-82ff-5a5485cd5a48 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:32.416881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68eca8-479a-4d66-82ff-5a5485cd5a48 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:32.417279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68eca8-479a-4d66-82ff-5a5485cd5a48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:32.418897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e783b61-5b07-4cd8-8dbf-d4c43ece5121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:32.419923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e783b61-5b07-4cd8-8dbf-d4c43ece5121 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:32.420411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e783b61-5b07-4cd8-8dbf-d4c43ece5121 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:32.420916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e783b61-5b07-4cd8-8dbf-d4c43ece5121 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:32.421769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e783b61-5b07-4cd8-8dbf-d4c43ece5121 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:32.423351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e783b61-5b07-4cd8-8dbf-d4c43ece5121 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:32.428479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68eca8-479a-4d66-82ff-5a5485cd5a48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:32.430625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68eca8-479a-4d66-82ff-5a5485cd5a48 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:32.437222 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-2e783b61-5b07-4cd8-8dbf-d4c43ece5121 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 02 09:58:32.437222 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:32.437222 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 09:58:32.437222 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 09:58:32.437222 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 09:58:32.437222 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 09:58:32.437222 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 09:58:32.437222 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:32.437222 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 02 09:58:32.437222 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:32.437222 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:58:32.437222 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:32.437222 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:32.437222 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:32.437222 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:32.437222 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:32.438147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:32.438147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:32.438147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:32.438147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:32.438147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:32.438147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:32.438147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:32.438147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 09:58:32.438147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 09:58:32.438147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 09:58:32.438147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 09:58:32.438147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:32.438147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:32.438147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:32.438147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:32.438147 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:32.438973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:32.438973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:32.438973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:32.438973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:32.438973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:32.438973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:32.438973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:32.438973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:32.438973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:32.438973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:32.438973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:32.438973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 09:58:32.438973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:32.438973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 02 09:58:32.438973 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:32.447059 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 398/797] 10.222.0.16 () {56 vars in 1129 bytes} [Mon May 2 09:58:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:32.448261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e783b61-5b07-4cd8-8dbf-d4c43ece5121 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:32.449010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-cd68eca8-479a-4d66-82ff-5a5485cd5a48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:32.449010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:32.449010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:32.449010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:32.449010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:32.449010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:32.449010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:32.449010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:32.449010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:32.449010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:32.449010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:32.449010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:32.449010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:32.449010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:32.449010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:32.449882 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:32.449882 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:32.449882 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:32.449882 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:32.449882 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:32.449882 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:32.449882 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:32.449882 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:32.449882 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:32.449882 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:32.449882 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:32.449882 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:32.449882 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:32.449882 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:32.449882 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:32.449882 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:32.449882 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:32.451524 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:32.451524 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:32.451524 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:32.451524 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:32.454995 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 400/798] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:32.455867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68eca8-479a-4d66-82ff-5a5485cd5a48 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:32.561109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e783b61-5b07-4cd8-8dbf-d4c43ece5121 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:32.584639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68eca8-479a-4d66-82ff-5a5485cd5a48 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:32.595809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c14fc-78e0-4db4-b22c-7f2b223330de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:32.596976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c14fc-78e0-4db4-b22c-7f2b223330de None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:32.597471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c14fc-78e0-4db4-b22c-7f2b223330de None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:32.597910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c14fc-78e0-4db4-b22c-7f2b223330de None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:32.605856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c14fc-78e0-4db4-b22c-7f2b223330de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:32.607588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c14fc-78e0-4db4-b22c-7f2b223330de None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:32.624161 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-ae8c14fc-78e0-4db4-b22c-7f2b223330de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:32.624161 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:32.624161 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:32.624161 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:32.624161 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:32.624161 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:32.624161 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:32.624161 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:32.624161 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:32.624161 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:32.624161 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:32.624161 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:32.624161 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:32.624161 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:32.624161 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:32.627685 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:32.627685 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:32.627685 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:32.627685 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:32.627685 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:32.627685 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:32.627685 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:32.627685 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:32.627685 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:32.627685 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:32.627685 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:32.627685 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:32.627685 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:32.627685 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:32.627685 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:32.627685 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:32.627685 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:32.628814 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:32.628814 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:32.628814 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:32.628814 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:32.628814 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:32.628814 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:32.628814 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:32.628814 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:32.629269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc12b86-7934-4b8e-8399-23b143b09745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:32.629269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc12b86-7934-4b8e-8399-23b143b09745 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:32.629269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc12b86-7934-4b8e-8399-23b143b09745 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:32.629490 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 399/799] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:32.629560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc12b86-7934-4b8e-8399-23b143b09745 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:32.630194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c14fc-78e0-4db4-b22c-7f2b223330de None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:32.632368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc12b86-7934-4b8e-8399-23b143b09745 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:32.632798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc12b86-7934-4b8e-8399-23b143b09745 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:32.634542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc12b86-7934-4b8e-8399-23b143b09745 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:32.645327 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 401/800] 10.222.0.16 () {56 vars in 1124 bytes} [Mon May 2 09:58:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:32.645327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc12b86-7934-4b8e-8399-23b143b09745 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:32.752284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c14fc-78e0-4db4-b22c-7f2b223330de None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:32.761264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc12b86-7934-4b8e-8399-23b143b09745 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:32.787245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf71190-c743-443b-a803-e907071bf1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:32.788924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf71190-c743-443b-a803-e907071bf1a2 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:32.789408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf71190-c743-443b-a803-e907071bf1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:32.793547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf71190-c743-443b-a803-e907071bf1a2 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:32.793547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf71190-c743-443b-a803-e907071bf1a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:32.793547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf71190-c743-443b-a803-e907071bf1a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:32.793547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf71190-c743-443b-a803-e907071bf1a2 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:32.796044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d86354-478f-4f8e-b568-6eec498c8c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:32.796742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d86354-478f-4f8e-b568-6eec498c8c34 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:32.797033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d86354-478f-4f8e-b568-6eec498c8c34 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:32.797316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d86354-478f-4f8e-b568-6eec498c8c34 None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:32.798107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d86354-478f-4f8e-b568-6eec498c8c34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:32.798423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d86354-478f-4f8e-b568-6eec498c8c34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:32.799921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d86354-478f-4f8e-b568-6eec498c8c34 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:32.807516 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 400/801] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:32.808736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf71190-c743-443b-a803-e907071bf1a2 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:32.818015 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 402/802] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:32.818804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d86354-478f-4f8e-b568-6eec498c8c34 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:32.913966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf71190-c743-443b-a803-e907071bf1a2 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:32.922806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d86354-478f-4f8e-b568-6eec498c8c34 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:32.948023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f7d79-5fde-41c0-8248-f96e1c5404da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:32.949042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f7d79-5fde-41c0-8248-f96e1c5404da None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:32.949469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f7d79-5fde-41c0-8248-f96e1c5404da None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:32.949895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f7d79-5fde-41c0-8248-f96e1c5404da None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:32.950775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f7d79-5fde-41c0-8248-f96e1c5404da None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:32.951095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f7d79-5fde-41c0-8248-f96e1c5404da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:32.953066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f7d79-5fde-41c0-8248-f96e1c5404da None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:32.955860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085e11f-ad85-4cdf-8d73-a5b2dacf5512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:32.956656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085e11f-ad85-4cdf-8d73-a5b2dacf5512 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:32.956946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085e11f-ad85-4cdf-8d73-a5b2dacf5512 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:32.957231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085e11f-ad85-4cdf-8d73-a5b2dacf5512 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:32.962845 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 401/803] 10.222.0.16 () {56 vars in 1124 bytes} [Mon May 2 09:58:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:32.962845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f7d79-5fde-41c0-8248-f96e1c5404da None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:32.969345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085e11f-ad85-4cdf-8d73-a5b2dacf5512 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:32.970793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085e11f-ad85-4cdf-8d73-a5b2dacf5512 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:32.986109 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-8085e11f-ad85-4cdf-8d73-a5b2dacf5512 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 02 09:58:32.986109 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:32.986109 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:32.986109 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:32.986109 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:32.986109 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:32.986109 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:32.986109 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:32.986109 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:32.986109 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:32.986109 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:32.986109 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:32.986109 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:32.986109 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:32.986109 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:32.986109 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:32.987039 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:32.987039 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:32.987039 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:32.987039 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:32.987039 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:32.987039 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:32.987039 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:32.987039 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:32.987039 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:32.987039 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:32.987039 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:32.987039 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:32.987039 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:32.987039 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:32.987039 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:32.987039 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:32.987039 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:32.987039 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:32.987999 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:32.987999 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:32.987999 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:32.987999 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:32.987999 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:32.987999 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:32.987999 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:32.987999 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:32.987999 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 02 09:58:32.987999 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:32.987999 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 403/804] 10.222.0.16 () {56 vars in 1093 bytes} [Mon May 2 09:58:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:32.990078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b130d3-4138-4281-97ce-ab7e187b08f7 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:32.990078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b130d3-4138-4281-97ce-ab7e187b08f7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:32.990078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b130d3-4138-4281-97ce-ab7e187b08f7 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:32.993223 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 404/805] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:32.994458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b130d3-4138-4281-97ce-ab7e187b08f7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:33.069622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f7d79-5fde-41c0-8248-f96e1c5404da None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:33.099132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b130d3-4138-4281-97ce-ab7e187b08f7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:33.113607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e3afb-a8aa-4a7d-8f90-00a3cab382cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:33.114512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e3afb-a8aa-4a7d-8f90-00a3cab382cd None admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:33.114798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e3afb-a8aa-4a7d-8f90-00a3cab382cd None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:33.115076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e3afb-a8aa-4a7d-8f90-00a3cab382cd None admin] PATH_INFO: `/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/6573f5c0731c4a18bf2374c3ba006a57/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:33.117438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e3afb-a8aa-4a7d-8f90-00a3cab382cd None admin] RBAC: Authorizing `identity:create_grant(project_id=972cae0aa9694d6cad22fbdbcf916ff7, user_id=6573f5c0731c4a18bf2374c3ba006a57, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:33.118862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e3afb-a8aa-4a7d-8f90-00a3cab382cd None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:33.136225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2db552-eec6-4d31-ae6e-7259484bf2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:33.136909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2db552-eec6-4d31-ae6e-7259484bf2b7 None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:33.137189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2db552-eec6-4d31-ae6e-7259484bf2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:33.137459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2db552-eec6-4d31-ae6e-7259484bf2b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:33.138189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2db552-eec6-4d31-ae6e-7259484bf2b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:33.139536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2db552-eec6-4d31-ae6e-7259484bf2b7 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:33.188359 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 402/806] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 09:58:32 2022] PUT /identity/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/6573f5c0731c4a18bf2374c3ba006a57/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:58:33.189234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e3afb-a8aa-4a7d-8f90-00a3cab382cd None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:33.214513 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 405/807] 10.222.0.16 () {60 vars in 1144 bytes} [Mon May 2 09:58:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:58:33.214513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e48cb7-ece0-4d6a-b17a-be87d50357d4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:33.214513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e48cb7-ece0-4d6a-b17a-be87d50357d4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:33.214834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e48cb7-ece0-4d6a-b17a-be87d50357d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:33.250119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d2e48cb7-ece0-4d6a-b17a-be87d50357d4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:33.251514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d2e48cb7-ece0-4d6a-b17a-be87d50357d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:33.331043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e3afb-a8aa-4a7d-8f90-00a3cab382cd None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:33.358219 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 406/808] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:58:33.360112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d84133-9ff9-4fcd-9dc3-07976a5e554e None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:33.360480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d84133-9ff9-4fcd-9dc3-07976a5e554e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:33.361027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d84133-9ff9-4fcd-9dc3-07976a5e554e None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:33.367536 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 407/809] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:33.369363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4867f-d8d1-4156-a087-6360d51be187 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:33.369653 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4867f-d8d1-4156-a087-6360d51be187 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:33.369941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4867f-d8d1-4156-a087-6360d51be187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:33.375903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c0c2a-35db-40cc-89f9-95ccf5acd647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:33.376903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c0c2a-35db-40cc-89f9-95ccf5acd647 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:33.377365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c0c2a-35db-40cc-89f9-95ccf5acd647 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:33.377840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c0c2a-35db-40cc-89f9-95ccf5acd647 None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:33.378959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c0c2a-35db-40cc-89f9-95ccf5acd647 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:33.379510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c0c2a-35db-40cc-89f9-95ccf5acd647 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:33.381231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c0c2a-35db-40cc-89f9-95ccf5acd647 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:33.398150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-99c4867f-d8d1-4156-a087-6360d51be187 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:33.400104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-99c4867f-d8d1-4156-a087-6360d51be187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:33.403517 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 403/810] 10.222.0.16 () {56 vars in 1133 bytes} [Mon May 2 09:58:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:33.404689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c0c2a-35db-40cc-89f9-95ccf5acd647 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:33.486356 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 408/811] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:58:33.487210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4867f-d8d1-4156-a087-6360d51be187 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:33.514018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c0c2a-35db-40cc-89f9-95ccf5acd647 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:33.548713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649b83b-12c5-423f-926f-146a1af9498b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:33.549794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649b83b-12c5-423f-926f-146a1af9498b None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:33.550236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649b83b-12c5-423f-926f-146a1af9498b None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:33.550655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649b83b-12c5-423f-926f-146a1af9498b None admin] PATH_INFO: `/v3/services/network` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:33.551451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649b83b-12c5-423f-926f-146a1af9498b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:33.552971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649b83b-12c5-423f-926f-146a1af9498b None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:33.564995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-5649b83b-12c5-423f-926f-146a1af9498b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 02 09:58:33.564995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:33.564995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 09:58:33.564995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 09:58:33.564995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 09:58:33.564995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 09:58:33.564995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 09:58:33.564995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:33.564995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 02 09:58:33.564995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:33.564995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:58:33.564995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:33.564995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:33.564995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:33.564995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:33.564995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:33.564995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:33.566204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:33.566204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:33.566204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:33.566204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:33.566204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:33.566204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:33.566204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 09:58:33.566204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 09:58:33.566204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 09:58:33.566204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 09:58:33.566204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:33.566204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:33.566204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:33.566204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:33.566204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:33.566204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:33.567216 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:33.567216 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:33.567216 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:33.567216 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:33.567216 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:33.567216 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:33.567216 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:33.567216 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:33.567216 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:33.567216 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:33.567216 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 09:58:33.567216 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:33.567216 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 02 09:58:33.567216 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:33.570241 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 404/812] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:33 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:33.571155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649b83b-12c5-423f-926f-146a1af9498b None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:33.595873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4867f-d8d1-4156-a087-6360d51be187 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:33.629556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb0e65-6046-400c-bb23-afa843b18069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:33.630267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb0e65-6046-400c-bb23-afa843b18069 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:33.630622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb0e65-6046-400c-bb23-afa843b18069 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:33.630838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb0e65-6046-400c-bb23-afa843b18069 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:33.670212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649b83b-12c5-423f-926f-146a1af9498b None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:33.703727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb0e65-6046-400c-bb23-afa843b18069 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:33.705217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb0e65-6046-400c-bb23-afa843b18069 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:33.712921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d5a33-f965-4a54-8e8e-2494976e013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:33.714348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d5a33-f965-4a54-8e8e-2494976e013a None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:33.714814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d5a33-f965-4a54-8e8e-2494976e013a None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:33.715647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d5a33-f965-4a54-8e8e-2494976e013a None admin] PATH_INFO: `/v3/roles/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:33.728580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d5a33-f965-4a54-8e8e-2494976e013a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:33.739837 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-585d5a33-f965-4a54-8e8e-2494976e013a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:33.739837 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:33.739837 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:33.739837 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:33.739837 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:33.739837 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:33.739837 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:33.739837 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:33.739837 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:33.739837 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:33.739837 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:33.739837 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:33.739837 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:33.739837 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:33.739837 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:33.739837 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:33.740779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:33.740779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:33.740779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:33.740779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:33.740779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:33.740779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:33.740779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:33.740779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:33.740779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:33.740779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:33.740779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:33.740779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:33.740779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:33.740779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:33.740779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:33.740779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:33.742169 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:33.742169 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:33.742169 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:33.742169 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:33.742169 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:33.742169 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:33.742169 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:33.742169 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:33.742169 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:33.742169 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:33.742169 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:33.742169 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:33.745360 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 405/813] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 09:58:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:33.746640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d5a33-f965-4a54-8e8e-2494976e013a None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:33.808539 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 409/814] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:58:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 09:58:33.809520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb0e65-6046-400c-bb23-afa843b18069 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:33.874077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d5a33-f965-4a54-8e8e-2494976e013a None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:33.911125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb0e65-6046-400c-bb23-afa843b18069 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:33.915736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0793d6-7185-4828-9800-635e5ea744fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:33.916654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0793d6-7185-4828-9800-635e5ea744fe None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:33.917170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0793d6-7185-4828-9800-635e5ea744fe None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:33.917645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0793d6-7185-4828-9800-635e5ea744fe None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:33.918960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0793d6-7185-4828-9800-635e5ea744fe None admin] RBAC: Adding query filter params (name=network) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:33.919486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0793d6-7185-4828-9800-635e5ea744fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:33.921712 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0793d6-7185-4828-9800-635e5ea744fe None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:33.928149 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 406/815] 10.222.0.16 () {56 vars in 1112 bytes} [Mon May 2 09:58:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:33.929772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0793d6-7185-4828-9800-635e5ea744fe None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:33.945356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1678fd-a166-4c88-8f1a-30c963161190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:33.946138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1678fd-a166-4c88-8f1a-30c963161190 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:33.946326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1678fd-a166-4c88-8f1a-30c963161190 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:33.946586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1678fd-a166-4c88-8f1a-30c963161190 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:33.947320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1678fd-a166-4c88-8f1a-30c963161190 None admin] RBAC: Adding query filter params (name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:33.947651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1678fd-a166-4c88-8f1a-30c963161190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:33.949014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1678fd-a166-4c88-8f1a-30c963161190 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:33.960867 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 410/816] 10.222.0.16 () {56 vars in 1103 bytes} [Mon May 2 09:58:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:33.961784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1678fd-a166-4c88-8f1a-30c963161190 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:34.043118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0793d6-7185-4828-9800-635e5ea744fe None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:34.073870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1678fd-a166-4c88-8f1a-30c963161190 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:34.086020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525fcc7-26ea-4c17-a1ce-8709adf54e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:34.087496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525fcc7-26ea-4c17-a1ce-8709adf54e4d None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:34.087955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525fcc7-26ea-4c17-a1ce-8709adf54e4d None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:34.088638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525fcc7-26ea-4c17-a1ce-8709adf54e4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:34.103637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525fcc7-26ea-4c17-a1ce-8709adf54e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:34.105749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525fcc7-26ea-4c17-a1ce-8709adf54e4d None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:34.108446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721b63a-8699-4135-a43d-b67b21f981ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:34.109274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721b63a-8699-4135-a43d-b67b21f981ab None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:34.109634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721b63a-8699-4135-a43d-b67b21f981ab None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:34.110021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721b63a-8699-4135-a43d-b67b21f981ab None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:34.110832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c721b63a-8699-4135-a43d-b67b21f981ab None admin] RBAC: Adding query filter params (type=network) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:34.111239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c721b63a-8699-4135-a43d-b67b21f981ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:34.112764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c721b63a-8699-4135-a43d-b67b21f981ab None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:34.122052 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 411/817] 10.222.0.16 () {56 vars in 1112 bytes} [Mon May 2 09:58:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:34.123117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721b63a-8699-4135-a43d-b67b21f981ab None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:34.127999 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-b525fcc7-26ea-4c17-a1ce-8709adf54e4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:34.127999 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:34.127999 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:34.127999 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:34.127999 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:34.127999 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:34.127999 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:34.127999 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:34.127999 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:34.127999 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:34.127999 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:34.127999 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:34.127999 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:34.127999 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:34.127999 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:34.129083 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:34.129083 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:34.129083 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:34.129083 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:34.129083 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:34.129083 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:34.129083 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:34.129083 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:34.129083 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:34.129083 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:34.129083 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:34.129083 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:34.129083 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:34.129083 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:34.129083 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:34.129083 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:34.129083 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:34.130045 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:34.130045 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:34.130045 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:34.130045 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:34.132078 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 407/818] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:34.133138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525fcc7-26ea-4c17-a1ce-8709adf54e4d None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:34.233586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721b63a-8699-4135-a43d-b67b21f981ab None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:34.238742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525fcc7-26ea-4c17-a1ce-8709adf54e4d None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:34.268949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cbea1-e874-405f-91cf-b75a5956f16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:34.269854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cbea1-e874-405f-91cf-b75a5956f16b None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:34.270184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cbea1-e874-405f-91cf-b75a5956f16b None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:34.270556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cbea1-e874-405f-91cf-b75a5956f16b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:34.273899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fd105-e209-46e9-abc0-3b0cef548b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:34.274782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fd105-e209-46e9-abc0-3b0cef548b7f None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:34.275244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fd105-e209-46e9-abc0-3b0cef548b7f None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:34.275692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fd105-e209-46e9-abc0-3b0cef548b7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:34.276642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fd105-e209-46e9-abc0-3b0cef548b7f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:34.278179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fd105-e209-46e9-abc0-3b0cef548b7f None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:34.283893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cbea1-e874-405f-91cf-b75a5956f16b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:34.286039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cbea1-e874-405f-91cf-b75a5956f16b None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:34.304422 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-d51cbea1-e874-405f-91cf-b75a5956f16b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:34.304422 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:34.304422 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:34.304422 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:34.304422 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:34.304422 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:34.304422 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:34.304422 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:34.304422 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:34.304422 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:34.304422 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:34.304422 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:34.304422 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:34.304422 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:34.304422 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:34.305554 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:34.305554 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:34.305554 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:34.305554 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:34.305554 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:34.305554 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:34.305554 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:34.305554 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:34.305554 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:34.305554 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:34.305554 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:34.305554 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:34.305554 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:34.305554 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:34.305554 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:34.305554 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:34.305554 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:34.306470 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:34.306470 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:34.306470 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:34.306470 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:34.306470 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 412/819] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:34.306470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cbea1-e874-405f-91cf-b75a5956f16b None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:34.369277 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 408/820] 10.222.0.16 () {60 vars in 1144 bytes} [Mon May 2 09:58:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:58:34.371042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fd105-e209-46e9-abc0-3b0cef548b7f None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:34.486351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cbea1-e874-405f-91cf-b75a5956f16b None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:34.576648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1778f5-0d25-42d1-ad16-95b58adb6a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:34.577375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1778f5-0d25-42d1-ad16-95b58adb6a40 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:34.577759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1778f5-0d25-42d1-ad16-95b58adb6a40 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:34.578629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1778f5-0d25-42d1-ad16-95b58adb6a40 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:34.579370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1778f5-0d25-42d1-ad16-95b58adb6a40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:34.579682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1778f5-0d25-42d1-ad16-95b58adb6a40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:34.581091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1778f5-0d25-42d1-ad16-95b58adb6a40 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:34.595590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fd105-e209-46e9-abc0-3b0cef548b7f None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:34.612786 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 413/821] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:34.618036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1778f5-0d25-42d1-ad16-95b58adb6a40 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:34.648315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3b025-ea09-488f-93a6-2741af16f843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:34.649009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3b025-ea09-488f-93a6-2741af16f843 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:34.649294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3b025-ea09-488f-93a6-2741af16f843 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:34.649570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3b025-ea09-488f-93a6-2741af16f843 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:34.650297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3b025-ea09-488f-93a6-2741af16f843 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:34.650741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3b025-ea09-488f-93a6-2741af16f843 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:34.652173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3b025-ea09-488f-93a6-2741af16f843 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:34.670572 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 409/822] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:34.676348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3b025-ea09-488f-93a6-2741af16f843 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:34.753860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1778f5-0d25-42d1-ad16-95b58adb6a40 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:34.794172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77c804-6803-498d-b039-5869b8bf9b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:34.794960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77c804-6803-498d-b039-5869b8bf9b5f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:34.795247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77c804-6803-498d-b039-5869b8bf9b5f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:34.795735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77c804-6803-498d-b039-5869b8bf9b5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:34.802473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3b025-ea09-488f-93a6-2741af16f843 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:34.804375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77c804-6803-498d-b039-5869b8bf9b5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:34.805936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77c804-6803-498d-b039-5869b8bf9b5f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:34.819248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-8e77c804-6803-498d-b039-5869b8bf9b5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:34.819248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:34.819248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:34.819248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:34.819248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:34.819248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:34.819248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:34.819248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:34.819248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:34.819248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:34.819248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:34.819248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:34.819248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:34.819248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:34.819248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:34.820691 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:34.820691 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:34.820691 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:34.820691 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:34.820691 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:34.820691 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:34.820691 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:34.820691 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:34.820691 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:34.820691 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:34.820691 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:34.820691 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:34.820691 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:34.820691 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:34.820691 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:34.820691 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:34.820691 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:34.821574 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:34.821574 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:34.821574 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:34.821574 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:34.821574 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:34.821574 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:34.821574 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:34.821574 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:34.825762 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 414/823] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:34.826602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77c804-6803-498d-b039-5869b8bf9b5f None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:34.844886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7322f-f165-446c-abf5-b04765c357ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:34.846191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7322f-f165-446c-abf5-b04765c357ae None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:34.846996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7322f-f165-446c-abf5-b04765c357ae None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:34.847487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7322f-f165-446c-abf5-b04765c357ae None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:34.855279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7322f-f165-446c-abf5-b04765c357ae None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:34.857045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7322f-f165-446c-abf5-b04765c357ae None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:34.872301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-9ce7322f-f165-446c-abf5-b04765c357ae None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 02 09:58:34.872301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:34.872301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:34.872301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:34.872301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:34.872301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:34.872301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:34.872301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:34.872301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:34.872301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:34.872301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:34.872301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:34.872301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:34.872301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:34.872301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:34.872301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:34.873529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:34.873529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:34.873529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:34.873529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:34.873529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:34.873529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:34.873529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:34.873529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:34.873529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:34.873529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:34.873529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:34.873529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:34.873529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:34.873529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:34.873529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:34.873529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:34.873529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:34.873529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:34.874494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:34.874494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:34.874494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:34.874494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:34.874494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:34.874494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:34.874494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:34.874494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:34.874494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 02 09:58:34.874494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:34.884830 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 410/824] 10.222.0.16 () {56 vars in 1117 bytes} [Mon May 2 09:58:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:34.891863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7322f-f165-446c-abf5-b04765c357ae None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:34.942460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77c804-6803-498d-b039-5869b8bf9b5f None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:34.976217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292300d-69c6-45e1-b401-c82ea24dfaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:34.976925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292300d-69c6-45e1-b401-c82ea24dfaab None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:34.977210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292300d-69c6-45e1-b401-c82ea24dfaab None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:34.977487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292300d-69c6-45e1-b401-c82ea24dfaab None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:34.978275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292300d-69c6-45e1-b401-c82ea24dfaab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:34.978584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292300d-69c6-45e1-b401-c82ea24dfaab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:34.980071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292300d-69c6-45e1-b401-c82ea24dfaab None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:34.993141 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 415/825] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:34.999408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292300d-69c6-45e1-b401-c82ea24dfaab None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:35.015760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7322f-f165-446c-abf5-b04765c357ae None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:35.054948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d285f8-15db-4fde-aa3e-d8cede827dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:35.055713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d285f8-15db-4fde-aa3e-d8cede827dfc None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:35.055903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d285f8-15db-4fde-aa3e-d8cede827dfc None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:35.056185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d285f8-15db-4fde-aa3e-d8cede827dfc None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:35.057066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d285f8-15db-4fde-aa3e-d8cede827dfc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:35.057380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d285f8-15db-4fde-aa3e-d8cede827dfc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:35.058805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d285f8-15db-4fde-aa3e-d8cede827dfc None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:35.083705 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 411/826] 10.222.0.16 () {56 vars in 1149 bytes} [Mon May 2 09:58:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:35.086221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d285f8-15db-4fde-aa3e-d8cede827dfc None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:35.125927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292300d-69c6-45e1-b401-c82ea24dfaab None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:35.168901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3575fe-b36a-4ac3-a189-5eb251d6c57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:35.169960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3575fe-b36a-4ac3-a189-5eb251d6c57e None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:35.170776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3575fe-b36a-4ac3-a189-5eb251d6c57e None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:35.171233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3575fe-b36a-4ac3-a189-5eb251d6c57e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:35.172837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3575fe-b36a-4ac3-a189-5eb251d6c57e None admin] RBAC: Adding query filter params (role.id=dd8a47ade22941849ebdf8fbdf994b66, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=e6036dd39fb74289a8cbdcd6a21f8662) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:35.173336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3575fe-b36a-4ac3-a189-5eb251d6c57e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:35.175471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3575fe-b36a-4ac3-a189-5eb251d6c57e None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:35.184422 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 416/827] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:58:34 2022] GET /identity/v3/role_assignments?user.id=e6036dd39fb74289a8cbdcd6a21f8662&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=dd8a47ade22941849ebdf8fbdf994b66 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:35.195958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d285f8-15db-4fde-aa3e-d8cede827dfc None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:35.234874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a2f82-6142-4dd0-bd74-06dd26ac4966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:35.236005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a2f82-6142-4dd0-bd74-06dd26ac4966 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:35.236465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a2f82-6142-4dd0-bd74-06dd26ac4966 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:35.236971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a2f82-6142-4dd0-bd74-06dd26ac4966 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:35.249544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a2f82-6142-4dd0-bd74-06dd26ac4966 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:35.251391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a2f82-6142-4dd0-bd74-06dd26ac4966 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:35.271391 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-022a2f82-6142-4dd0-bd74-06dd26ac4966 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:35.271391 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:35.271391 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:35.271391 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:35.271391 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:35.271391 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:35.271391 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:35.271391 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:35.271391 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:35.271391 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:35.271391 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:35.271391 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:35.271391 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:35.271391 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:35.271391 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:35.272337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:35.272337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:35.272337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:35.272337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:35.272337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:35.272337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:35.272337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:35.272337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:35.272337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:35.272337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:35.272337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:35.272337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:35.272337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:35.272337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:35.272337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:35.272337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:35.272337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:35.273315 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:35.273315 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:35.273315 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:35.273315 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:35.275352 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 412/828] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:35.281093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3575fe-b36a-4ac3-a189-5eb251d6c57e None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:35.391335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3575fe-b36a-4ac3-a189-5eb251d6c57e None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:35.424177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef458f-a91f-4507-9d14-c4040d83f5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:35.424885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef458f-a91f-4507-9d14-c4040d83f5a9 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:35.425172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef458f-a91f-4507-9d14-c4040d83f5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:35.425452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef458f-a91f-4507-9d14-c4040d83f5a9 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:35.426178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef458f-a91f-4507-9d14-c4040d83f5a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:35.426486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef458f-a91f-4507-9d14-c4040d83f5a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:35.427906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef458f-a91f-4507-9d14-c4040d83f5a9 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:35.440644 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 417/829] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:35.446997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a2f82-6142-4dd0-bd74-06dd26ac4966 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:35.554563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a2f82-6142-4dd0-bd74-06dd26ac4966 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:35.588543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f1268-30b1-4603-a1f1-f7be3fb3b1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:35.589729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f1268-30b1-4603-a1f1-f7be3fb3b1e1 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:35.590231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f1268-30b1-4603-a1f1-f7be3fb3b1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:35.590706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f1268-30b1-4603-a1f1-f7be3fb3b1e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:35.597857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f1268-30b1-4603-a1f1-f7be3fb3b1e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:35.599526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f1268-30b1-4603-a1f1-f7be3fb3b1e1 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:35.614822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-da6f1268-30b1-4603-a1f1-f7be3fb3b1e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:35.614822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:35.614822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:35.614822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:35.614822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:35.614822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:35.614822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:35.614822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:35.614822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:35.614822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:35.614822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:35.614822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:35.614822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:35.614822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:35.614822 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:35.615800 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:35.615800 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:35.615800 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:35.615800 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:35.615800 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:35.615800 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:35.615800 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:35.615800 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:35.615800 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:35.615800 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:35.615800 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:35.615800 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:35.615800 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:35.615800 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:35.615800 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:35.615800 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:35.615800 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:35.617385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:35.617385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:35.617385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:35.617385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:35.617385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:35.617385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:35.617385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:35.617385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:35.620212 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 413/830] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:35.626356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef458f-a91f-4507-9d14-c4040d83f5a9 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:35.653099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152e078-985a-4eae-a448-8c9e3bfa91e2 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:35.653438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152e078-985a-4eae-a448-8c9e3bfa91e2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:35.653784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152e078-985a-4eae-a448-8c9e3bfa91e2 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:35.655273 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 414/831] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:58:35.662507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f014d-0a66-4c39-995f-ab749da6485b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:35.663822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f014d-0a66-4c39-995f-ab749da6485b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:35.664108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f014d-0a66-4c39-995f-ab749da6485b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:35.685383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e19f014d-0a66-4c39-995f-ab749da6485b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:35.686874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e19f014d-0a66-4c39-995f-ab749da6485b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:35.734911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef458f-a91f-4507-9d14-c4040d83f5a9 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:35.769751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6aab3-85a2-4755-87df-c766f4b9ee7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:35.772645 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 415/832] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 09:58:35.776972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6aab3-85a2-4755-87df-c766f4b9ee7f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:35.777465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6aab3-85a2-4755-87df-c766f4b9ee7f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:35.777918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6aab3-85a2-4755-87df-c766f4b9ee7f None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:35.778949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6aab3-85a2-4755-87df-c766f4b9ee7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:35.779439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6aab3-85a2-4755-87df-c766f4b9ee7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:35.781088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6aab3-85a2-4755-87df-c766f4b9ee7f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:35.794008 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 418/833] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:35.798670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f014d-0a66-4c39-995f-ab749da6485b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:35.799752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6aab3-85a2-4755-87df-c766f4b9ee7f None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:35.894868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f014d-0a66-4c39-995f-ab749da6485b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:35.899287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6aab3-85a2-4755-87df-c766f4b9ee7f None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:35.926906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a4fe5-cafd-4a10-aa10-bd172acbb6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:35.927687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a4fe5-cafd-4a10-aa10-bd172acbb6f9 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:35.927973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a4fe5-cafd-4a10-aa10-bd172acbb6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:35.928251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a4fe5-cafd-4a10-aa10-bd172acbb6f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:35.932421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952248d2-f6b5-4223-9ad1-d47e422aff8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:35.933347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952248d2-f6b5-4223-9ad1-d47e422aff8a None admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:35.933635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952248d2-f6b5-4223-9ad1-d47e422aff8a None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:35.933919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952248d2-f6b5-4223-9ad1-d47e422aff8a None admin] PATH_INFO: `/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/c1c06bcf38a942ffbcdc4ee6d2edebb0/roles/a47492f29bc144158c1c2ed9a4c39d39` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:35.938861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a4fe5-cafd-4a10-aa10-bd172acbb6f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:35.946477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-774a4fe5-cafd-4a10-aa10-bd172acbb6f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:58:35.946477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:35.946477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:35.946477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:35.946477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:35.946477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:35.946477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:35.946477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:35.946477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:35.946477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:35.946477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:35.946477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:35.946477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:35.946477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:35.946477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:35.946477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:35.947397 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:35.947397 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:35.947397 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:35.947397 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:35.947397 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:35.947397 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:35.947397 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:35.947397 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:35.947397 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:35.947397 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:35.947397 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:35.947397 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:35.947397 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:35.947397 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:35.947397 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:35.947397 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:35.948228 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:35.948228 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:35.948228 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:35.948228 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:35.948228 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:35.948228 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:35.948228 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:35.948228 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:35.948228 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:35.948228 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:35.948228 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:58:35.948228 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:35.948228 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 416/834] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:58:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:35.949454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbeb7e-8d9f-487d-9f90-c4f6bc8c4b7f None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:35.949454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbeb7e-8d9f-487d-9f90-c4f6bc8c4b7f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:35.949454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbeb7e-8d9f-487d-9f90-c4f6bc8c4b7f None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:35.950791 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 417/835] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:35.953450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbeb7e-8d9f-487d-9f90-c4f6bc8c4b7f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:35.955143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952248d2-f6b5-4223-9ad1-d47e422aff8a None admin] RBAC: Authorizing `identity:create_grant(project_id=972cae0aa9694d6cad22fbdbcf916ff7, user_id=c1c06bcf38a942ffbcdc4ee6d2edebb0, role_id=a47492f29bc144158c1c2ed9a4c39d39)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:35.956847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952248d2-f6b5-4223-9ad1-d47e422aff8a None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:36.029894 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 419/836] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 09:58:35 2022] PUT /identity/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/c1c06bcf38a942ffbcdc4ee6d2edebb0/roles/a47492f29bc144158c1c2ed9a4c39d39 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:58:36.031813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d2257-7e79-43f3-934b-5b33e2e9fa59 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:36.032442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d2257-7e79-43f3-934b-5b33e2e9fa59 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:36.033378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d2257-7e79-43f3-934b-5b33e2e9fa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:36.054691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbeb7e-8d9f-487d-9f90-c4f6bc8c4b7f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:36.058606 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-116d2257-7e79-43f3-934b-5b33e2e9fa59 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:36.060301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-116d2257-7e79-43f3-934b-5b33e2e9fa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:36.100048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014edac5-e659-4efd-b549-58adaa9f4c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:36.100048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014edac5-e659-4efd-b549-58adaa9f4c8d None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:36.101261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014edac5-e659-4efd-b549-58adaa9f4c8d None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:36.101261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014edac5-e659-4efd-b549-58adaa9f4c8d None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:36.104988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014edac5-e659-4efd-b549-58adaa9f4c8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:36.104988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014edac5-e659-4efd-b549-58adaa9f4c8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:36.104988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014edac5-e659-4efd-b549-58adaa9f4c8d None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:36.119443 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 418/837] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:58:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:36.121682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014edac5-e659-4efd-b549-58adaa9f4c8d None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:36.158555 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 420/838] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:58:36.183709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d2257-7e79-43f3-934b-5b33e2e9fa59 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:36.234596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014edac5-e659-4efd-b549-58adaa9f4c8d None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:36.277273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24310271-a9d7-4866-a3c1-9b21581f039e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:36.278809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24310271-a9d7-4866-a3c1-9b21581f039e None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:36.279252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24310271-a9d7-4866-a3c1-9b21581f039e None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:36.279682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24310271-a9d7-4866-a3c1-9b21581f039e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:36.294534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24310271-a9d7-4866-a3c1-9b21581f039e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:36.295010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d2257-7e79-43f3-934b-5b33e2e9fa59 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:36.296549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24310271-a9d7-4866-a3c1-9b21581f039e None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:36.317813 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-24310271-a9d7-4866-a3c1-9b21581f039e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:36.317813 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:36.317813 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:36.317813 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:36.317813 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:36.317813 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:36.317813 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:36.317813 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:36.317813 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:36.317813 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:36.317813 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:36.317813 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:36.317813 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:36.317813 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:36.317813 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:36.318916 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:36.318916 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:36.318916 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:36.318916 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:36.318916 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:36.318916 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:36.318916 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:36.318916 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:36.318916 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:36.318916 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:36.318916 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:36.318916 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:36.318916 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:36.318916 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:36.318916 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:36.318916 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:36.318916 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:36.320567 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:36.320567 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:36.320567 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:36.320567 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:36.323141 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 419/839] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:36.328775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24310271-a9d7-4866-a3c1-9b21581f039e None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:36.334285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519eb0d-a46d-4a28-86e0-4fa5b5a80ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:36.335745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519eb0d-a46d-4a28-86e0-4fa5b5a80ed3 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:36.336100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519eb0d-a46d-4a28-86e0-4fa5b5a80ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:36.336440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519eb0d-a46d-4a28-86e0-4fa5b5a80ed3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:36.337183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519eb0d-a46d-4a28-86e0-4fa5b5a80ed3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:36.338627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519eb0d-a46d-4a28-86e0-4fa5b5a80ed3 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:36.354143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-6519eb0d-a46d-4a28-86e0-4fa5b5a80ed3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 02 09:58:36.354143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:36.354143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 09:58:36.354143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 09:58:36.354143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 09:58:36.354143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 09:58:36.354143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 09:58:36.354143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:36.354143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 02 09:58:36.354143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:36.354143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:58:36.354143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:36.354143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:36.354143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:36.354143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:36.354143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:36.354143 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:36.355486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:36.355486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:36.355486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:36.355486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:36.355486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:36.355486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:36.355486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 09:58:36.355486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 09:58:36.355486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 09:58:36.355486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 09:58:36.355486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:36.355486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:36.355486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:36.355486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:36.355486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:36.355486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:36.356557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:36.356557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:36.356557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:36.356557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:36.356557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:36.356557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:36.356557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:36.356557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:36.356557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:36.356557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:36.356557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 09:58:36.356557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:36.356557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 02 09:58:36.356557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:36.358233 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 421/840] 10.222.0.16 () {56 vars in 1114 bytes} [Mon May 2 09:58:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:36.363739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519eb0d-a46d-4a28-86e0-4fa5b5a80ed3 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:36.439222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24310271-a9d7-4866-a3c1-9b21581f039e None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:36.473334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519eb0d-a46d-4a28-86e0-4fa5b5a80ed3 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:36.474770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ad8ec-3641-4c9c-bfe3-7e04b2821152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:36.475731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ad8ec-3641-4c9c-bfe3-7e04b2821152 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:36.476229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ad8ec-3641-4c9c-bfe3-7e04b2821152 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:36.476765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ad8ec-3641-4c9c-bfe3-7e04b2821152 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:36.477726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ad8ec-3641-4c9c-bfe3-7e04b2821152 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:36.483422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ad8ec-3641-4c9c-bfe3-7e04b2821152 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:36.483422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ad8ec-3641-4c9c-bfe3-7e04b2821152 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:36.493517 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 420/841] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:36.499184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ad8ec-3641-4c9c-bfe3-7e04b2821152 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:36.512720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613865af-3583-48dc-a2ad-749f712cebdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:36.513574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613865af-3583-48dc-a2ad-749f712cebdc None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:36.513940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613865af-3583-48dc-a2ad-749f712cebdc None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:36.514291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613865af-3583-48dc-a2ad-749f712cebdc None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:36.515080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613865af-3583-48dc-a2ad-749f712cebdc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:36.515500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613865af-3583-48dc-a2ad-749f712cebdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:36.517044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613865af-3583-48dc-a2ad-749f712cebdc None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:36.527123 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 422/842] 10.222.0.16 () {56 vars in 1114 bytes} [Mon May 2 09:58:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:36.528373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613865af-3583-48dc-a2ad-749f712cebdc None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:36.616235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ad8ec-3641-4c9c-bfe3-7e04b2821152 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:36.641983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613865af-3583-48dc-a2ad-749f712cebdc None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:36.654871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a42f98-b438-4166-bad5-c20a3cd02d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:36.655733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a42f98-b438-4166-bad5-c20a3cd02d44 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:36.656026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a42f98-b438-4166-bad5-c20a3cd02d44 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:36.656306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a42f98-b438-4166-bad5-c20a3cd02d44 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:36.663560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a42f98-b438-4166-bad5-c20a3cd02d44 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:36.665040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a42f98-b438-4166-bad5-c20a3cd02d44 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:36.680350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-24a42f98-b438-4166-bad5-c20a3cd02d44 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 02 09:58:36.680350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:36.680350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:36.680350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:36.680350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:36.680350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:36.680350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:36.680350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:36.680350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:36.680350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:36.680350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:36.680350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:36.680350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:36.680350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:36.680350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:36.680350 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:36.685313 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:36.685313 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:36.685313 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:36.685313 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:36.685313 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:36.685313 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:36.685313 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:36.685313 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:36.685313 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:36.685313 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:36.685313 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:36.685313 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:36.685313 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:36.685313 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:36.685313 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:36.685313 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:36.685313 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:36.685313 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:36.686263 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:36.686263 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:36.686263 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:36.686263 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:36.686263 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:36.686263 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:36.686263 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:36.686263 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:36.686263 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 02 09:58:36.686263 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:36.686802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04331e7b-e179-4bee-8f16-1b30292990c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:36.686802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04331e7b-e179-4bee-8f16-1b30292990c4 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:36.686802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04331e7b-e179-4bee-8f16-1b30292990c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:36.686802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04331e7b-e179-4bee-8f16-1b30292990c4 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:36.687078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04331e7b-e179-4bee-8f16-1b30292990c4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:36.687078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04331e7b-e179-4bee-8f16-1b30292990c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:36.687078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04331e7b-e179-4bee-8f16-1b30292990c4 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:36.687270 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 421/843] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:58:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:36.687270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a42f98-b438-4166-bad5-c20a3cd02d44 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:36.696849 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 423/844] 10.222.0.16 () {56 vars in 1114 bytes} [Mon May 2 09:58:36 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:36.802106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a42f98-b438-4166-bad5-c20a3cd02d44 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:36.839753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b71d30-b822-4b67-9eda-2fcbbcb28203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:36.840447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b71d30-b822-4b67-9eda-2fcbbcb28203 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:36.840769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b71d30-b822-4b67-9eda-2fcbbcb28203 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:36.841053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b71d30-b822-4b67-9eda-2fcbbcb28203 None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:36.841916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b71d30-b822-4b67-9eda-2fcbbcb28203 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:36.842232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b71d30-b822-4b67-9eda-2fcbbcb28203 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:36.843692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b71d30-b822-4b67-9eda-2fcbbcb28203 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:36.863962 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 422/845] 10.222.0.16 () {56 vars in 1135 bytes} [Mon May 2 09:58:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:36.873743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04331e7b-e179-4bee-8f16-1b30292990c4 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:36.979395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04331e7b-e179-4bee-8f16-1b30292990c4 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:37.016033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78803d9e-0b0b-4c58-9664-ff2c4f9dbeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:37.016830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78803d9e-0b0b-4c58-9664-ff2c4f9dbeda None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:37.017194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78803d9e-0b0b-4c58-9664-ff2c4f9dbeda None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:37.017693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78803d9e-0b0b-4c58-9664-ff2c4f9dbeda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:37.086384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78803d9e-0b0b-4c58-9664-ff2c4f9dbeda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:37.088238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78803d9e-0b0b-4c58-9664-ff2c4f9dbeda None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:37.193142 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 424/846] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:58:36 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 09:58:37.199186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b71d30-b822-4b67-9eda-2fcbbcb28203 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:37.307201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b71d30-b822-4b67-9eda-2fcbbcb28203 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:37.347183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8e4c0-ad08-4ca1-8e60-689966127bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:37.348336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8e4c0-ad08-4ca1-8e60-689966127bc4 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:37.348824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8e4c0-ad08-4ca1-8e60-689966127bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:37.349101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8e4c0-ad08-4ca1-8e60-689966127bc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:37.361405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8e4c0-ad08-4ca1-8e60-689966127bc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:37.362835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8e4c0-ad08-4ca1-8e60-689966127bc4 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:37.380899 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-8ec8e4c0-ad08-4ca1-8e60-689966127bc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:37.380899 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:37.380899 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:37.380899 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:37.380899 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:37.380899 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:37.380899 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:37.380899 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:37.380899 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:37.380899 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:37.380899 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:37.380899 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:37.380899 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:37.380899 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:37.380899 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:37.381881 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:37.381881 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:37.381881 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:37.381881 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:37.381881 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:37.381881 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:37.381881 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:37.381881 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:37.381881 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:37.381881 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:37.381881 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:37.381881 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:37.381881 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:37.381881 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:37.381881 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:37.381881 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:37.381881 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:37.382872 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:37.382872 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:37.382872 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:37.382872 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:37.382872 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 423/847] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:37.389230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78803d9e-0b0b-4c58-9664-ff2c4f9dbeda None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:37.485056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78803d9e-0b0b-4c58-9664-ff2c4f9dbeda None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:37.525305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d6c1e-3225-444e-b2c8-a38f03c2dfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:37.525984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d6c1e-3225-444e-b2c8-a38f03c2dfc7 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:37.526274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d6c1e-3225-444e-b2c8-a38f03c2dfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:37.526553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d6c1e-3225-444e-b2c8-a38f03c2dfc7 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:37.527300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d6c1e-3225-444e-b2c8-a38f03c2dfc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:37.527617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d6c1e-3225-444e-b2c8-a38f03c2dfc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:37.529050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d6c1e-3225-444e-b2c8-a38f03c2dfc7 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:37.543052 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 425/848] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:37.549050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8e4c0-ad08-4ca1-8e60-689966127bc4 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:37.652773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8e4c0-ad08-4ca1-8e60-689966127bc4 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:37.689139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613088bf-4440-4cdb-8604-146cdbc63fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:37.689947 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613088bf-4440-4cdb-8604-146cdbc63fe8 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:37.690232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613088bf-4440-4cdb-8604-146cdbc63fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:37.690508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613088bf-4440-4cdb-8604-146cdbc63fe8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:37.697585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613088bf-4440-4cdb-8604-146cdbc63fe8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:37.699082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613088bf-4440-4cdb-8604-146cdbc63fe8 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:37.713628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-613088bf-4440-4cdb-8604-146cdbc63fe8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:37.713628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:37.713628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:37.713628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:37.713628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:37.713628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:37.713628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:37.713628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:37.713628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:37.713628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:37.713628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:37.713628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:37.713628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:37.713628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:37.713628 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:37.714595 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:37.714595 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:37.714595 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:37.714595 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:37.714595 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:37.714595 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:37.714595 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:37.714595 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:37.714595 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:37.714595 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:37.714595 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:37.714595 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:37.714595 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:37.714595 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:37.714595 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:37.714595 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:37.714595 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:37.715492 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:37.715492 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:37.715492 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:37.715492 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:37.715492 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:37.715492 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:37.715492 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:37.715492 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:37.715492 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 424/849] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:37.722276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24251ddd-cf54-4b66-9015-1cfd9981120d None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:37.732011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24251ddd-cf54-4b66-9015-1cfd9981120d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:37.732011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24251ddd-cf54-4b66-9015-1cfd9981120d None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:37.732208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613088bf-4440-4cdb-8604-146cdbc63fe8 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:37.732313 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 426/850] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:37.732313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a98487-65d9-4165-899f-6c5703c10648 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:37.732313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a98487-65d9-4165-899f-6c5703c10648 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:37.732313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a98487-65d9-4165-899f-6c5703c10648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:37.748035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-00a98487-65d9-4165-899f-6c5703c10648 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:37.749420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-00a98487-65d9-4165-899f-6c5703c10648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:37.821185 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 427/851] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 09:58:37.827713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613088bf-4440-4cdb-8604-146cdbc63fe8 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:37.844961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a98487-65d9-4165-899f-6c5703c10648 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:37.861812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449c2aa-4627-43ce-88c0-39a83a4a7028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:37.862728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449c2aa-4627-43ce-88c0-39a83a4a7028 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:37.863152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449c2aa-4627-43ce-88c0-39a83a4a7028 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:37.863843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449c2aa-4627-43ce-88c0-39a83a4a7028 None admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:37.864818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449c2aa-4627-43ce-88c0-39a83a4a7028 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:37.865287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449c2aa-4627-43ce-88c0-39a83a4a7028 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:37.866887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449c2aa-4627-43ce-88c0-39a83a4a7028 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:37.879414 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 425/852] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:37.889984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449c2aa-4627-43ce-88c0-39a83a4a7028 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:37.959054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a98487-65d9-4165-899f-6c5703c10648 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:37.996924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9086eff-dc31-4023-95b9-09fa56838151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:37.997841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9086eff-dc31-4023-95b9-09fa56838151 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:37.998204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9086eff-dc31-4023-95b9-09fa56838151 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:37.998564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9086eff-dc31-4023-95b9-09fa56838151 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:37.999298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9086eff-dc31-4023-95b9-09fa56838151 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:38.000823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9086eff-dc31-4023-95b9-09fa56838151 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:38.004233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449c2aa-4627-43ce-88c0-39a83a4a7028 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:38.013566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-a9086eff-dc31-4023-95b9-09fa56838151 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 02 09:58:38.013566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:38.013566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 09:58:38.013566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 09:58:38.013566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 09:58:38.013566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 09:58:38.013566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 09:58:38.013566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:38.013566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 02 09:58:38.013566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:38.013566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:58:38.013566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:38.013566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:38.013566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:38.013566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:38.013566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:38.014553 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:38.014553 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:38.014553 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:38.014553 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:38.014553 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:38.014553 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:38.014553 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:38.014553 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 09:58:38.014553 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 09:58:38.014553 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 09:58:38.014553 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 09:58:38.014553 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:38.014553 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:38.014553 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:38.014553 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:38.014553 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:38.015408 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:38.015408 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:38.015408 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:38.015408 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:38.015408 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:38.015408 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:38.015408 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:38.015408 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:38.015408 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:38.015408 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:38.015408 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:38.015408 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 09:58:38.015408 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:38.015408 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 02 09:58:38.015408 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:38.015408 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 428/853] 10.222.0.16 () {56 vars in 1132 bytes} [Mon May 2 09:58:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:38.021706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9086eff-dc31-4023-95b9-09fa56838151 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:38.048328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb292bdc-e2b0-49c7-89c7-a06612abcc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:38.049036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb292bdc-e2b0-49c7-89c7-a06612abcc01 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:38.049323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb292bdc-e2b0-49c7-89c7-a06612abcc01 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:38.049881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb292bdc-e2b0-49c7-89c7-a06612abcc01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:38.050725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb292bdc-e2b0-49c7-89c7-a06612abcc01 None admin] RBAC: Adding query filter params (role.id=dd8a47ade22941849ebdf8fbdf994b66, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=6573f5c0731c4a18bf2374c3ba006a57) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:38.051203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb292bdc-e2b0-49c7-89c7-a06612abcc01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:38.053248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb292bdc-e2b0-49c7-89c7-a06612abcc01 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:38.061587 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 426/854] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:58:37 2022] GET /identity/v3/role_assignments?user.id=6573f5c0731c4a18bf2374c3ba006a57&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=dd8a47ade22941849ebdf8fbdf994b66 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:38.139819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9086eff-dc31-4023-95b9-09fa56838151 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:38.176771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee2420-3ebc-4c17-aaf7-9d3b5e49a43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:38.177586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee2420-3ebc-4c17-aaf7-9d3b5e49a43a None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:38.177873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee2420-3ebc-4c17-aaf7-9d3b5e49a43a None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:38.178152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee2420-3ebc-4c17-aaf7-9d3b5e49a43a None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:38.179409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee2420-3ebc-4c17-aaf7-9d3b5e49a43a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:38.179721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee2420-3ebc-4c17-aaf7-9d3b5e49a43a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:38.181145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee2420-3ebc-4c17-aaf7-9d3b5e49a43a None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:38.186556 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 429/855] 10.222.0.16 () {56 vars in 1126 bytes} [Mon May 2 09:58:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:38.192331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb292bdc-e2b0-49c7-89c7-a06612abcc01 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:38.303124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb292bdc-e2b0-49c7-89c7-a06612abcc01 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:38.341160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1b01e-002c-4a7b-baeb-c170902cb127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:38.342226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1b01e-002c-4a7b-baeb-c170902cb127 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:38.342733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1b01e-002c-4a7b-baeb-c170902cb127 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:38.343237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1b01e-002c-4a7b-baeb-c170902cb127 None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:38.344275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1b01e-002c-4a7b-baeb-c170902cb127 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:38.344844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1b01e-002c-4a7b-baeb-c170902cb127 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:38.346422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1b01e-002c-4a7b-baeb-c170902cb127 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:38.352625 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 427/856] 10.222.0.16 () {56 vars in 1126 bytes} [Mon May 2 09:58:38 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:38.500182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358db6d-4283-41d6-9392-69b665cccfba None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:38.500773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358db6d-4283-41d6-9392-69b665cccfba None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:38.500773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358db6d-4283-41d6-9392-69b665cccfba None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:38.502544 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 430/857] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:38.508854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579ca97-0ac0-44b6-a65e-c14f9a89537d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:38.509162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579ca97-0ac0-44b6-a65e-c14f9a89537d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:38.509414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579ca97-0ac0-44b6-a65e-c14f9a89537d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:38.527905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8579ca97-0ac0-44b6-a65e-c14f9a89537d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:38.529151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8579ca97-0ac0-44b6-a65e-c14f9a89537d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:38.601286 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 428/858] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:58:38.623674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358db6d-4283-41d6-9392-69b665cccfba None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:38.724177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358db6d-4283-41d6-9392-69b665cccfba None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:38.759929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f019e7-e610-4766-b18d-ec8261a135c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:38.760767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f019e7-e610-4766-b18d-ec8261a135c3 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:38.761056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f019e7-e610-4766-b18d-ec8261a135c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:38.761339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f019e7-e610-4766-b18d-ec8261a135c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:38.772863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f019e7-e610-4766-b18d-ec8261a135c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:38.780502 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-69f019e7-e610-4766-b18d-ec8261a135c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:38.780502 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:38.780502 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:38.780502 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:38.780502 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:38.780502 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:38.780502 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:38.780502 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:38.780502 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:38.780502 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:38.780502 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:38.780502 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:38.780502 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:38.780502 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:38.780502 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:38.780502 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:38.781473 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:38.781473 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:38.781473 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:38.781473 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:38.781473 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:38.781473 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:38.781473 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:38.781473 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:38.781473 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:38.781473 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:38.781473 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:38.781473 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:38.781473 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:38.781473 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:38.781473 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:38.781473 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:38.782323 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:38.782323 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:38.782323 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:38.782323 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:38.782323 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:38.782323 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:38.782323 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:38.782323 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:38.782323 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:38.782323 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:38.782323 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 09:58:38.782323 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:38.782323 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 431/859] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 09:58:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:38.787609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579ca97-0ac0-44b6-a65e-c14f9a89537d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:38.889704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579ca97-0ac0-44b6-a65e-c14f9a89537d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:38.924750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b84b6-aad6-485c-a441-cf07fb8887f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:38.925483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b84b6-aad6-485c-a441-cf07fb8887f9 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:38.925768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b84b6-aad6-485c-a441-cf07fb8887f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:38.926101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b84b6-aad6-485c-a441-cf07fb8887f9 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:38.926866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b84b6-aad6-485c-a441-cf07fb8887f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:38.927180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b84b6-aad6-485c-a441-cf07fb8887f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:38.928553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b84b6-aad6-485c-a441-cf07fb8887f9 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:38.937880 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 429/860] 10.222.0.16 () {56 vars in 1103 bytes} [Mon May 2 09:58:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:38.943169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f019e7-e610-4766-b18d-ec8261a135c3 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:39.048056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f019e7-e610-4766-b18d-ec8261a135c3 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:39.083115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cde40-9081-49df-b2d0-ec0611a627f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:39.083915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cde40-9081-49df-b2d0-ec0611a627f8 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:39.084199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cde40-9081-49df-b2d0-ec0611a627f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:39.084474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cde40-9081-49df-b2d0-ec0611a627f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:39.096048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cde40-9081-49df-b2d0-ec0611a627f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:39.097207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cde40-9081-49df-b2d0-ec0611a627f8 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:39.115852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-0a8cde40-9081-49df-b2d0-ec0611a627f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:39.115852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:39.115852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:39.115852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:39.115852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:39.115852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:39.115852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:39.115852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:39.115852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:39.115852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:39.115852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:39.115852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:39.115852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:39.115852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:39.115852 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:39.116850 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:39.116850 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:39.116850 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:39.116850 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:39.116850 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:39.116850 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:39.116850 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:39.116850 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:39.116850 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:39.116850 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:39.116850 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:39.116850 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:39.116850 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:39.116850 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:39.116850 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:39.116850 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:39.116850 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:39.117838 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:39.117838 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:39.117838 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:39.117838 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:39.117838 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 432/861] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:39.125854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b84b6-aad6-485c-a441-cf07fb8887f9 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:39.186543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43db19c-7b32-4119-b1e6-9fabc5931b82 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:39.187132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43db19c-7b32-4119-b1e6-9fabc5931b82 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:39.187621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43db19c-7b32-4119-b1e6-9fabc5931b82 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:39.189474 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 433/862] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:58:39.194623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eea4d-a008-405f-95ef-d048f4274f15 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:39.194913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eea4d-a008-405f-95ef-d048f4274f15 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:39.195199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eea4d-a008-405f-95ef-d048f4274f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:39.212524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e24eea4d-a008-405f-95ef-d048f4274f15 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:39.214093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e24eea4d-a008-405f-95ef-d048f4274f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:39.229482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b84b6-aad6-485c-a441-cf07fb8887f9 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:39.272221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0affa-b4a7-49d5-b73d-2640b57e744b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:39.273437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0affa-b4a7-49d5-b73d-2640b57e744b None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:39.273722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0affa-b4a7-49d5-b73d-2640b57e744b None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:39.274000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0affa-b4a7-49d5-b73d-2640b57e744b None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:39.274732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0affa-b4a7-49d5-b73d-2640b57e744b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:39.275041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0affa-b4a7-49d5-b73d-2640b57e744b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:39.276424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0affa-b4a7-49d5-b73d-2640b57e744b None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:39.294857 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 430/863] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:39.296680 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 434/864] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 09:58:39.301745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0affa-b4a7-49d5-b73d-2640b57e744b None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:39.319125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eea4d-a008-405f-95ef-d048f4274f15 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:39.428141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0affa-b4a7-49d5-b73d-2640b57e744b None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:39.441686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eea4d-a008-405f-95ef-d048f4274f15 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:39.463833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322defe-755d-4bac-b801-c06022b97bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:39.465132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322defe-755d-4bac-b801-c06022b97bc6 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:39.465568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322defe-755d-4bac-b801-c06022b97bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:39.466006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322defe-755d-4bac-b801-c06022b97bc6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:39.473344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322defe-755d-4bac-b801-c06022b97bc6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:39.475029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322defe-755d-4bac-b801-c06022b97bc6 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:39.481834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d9b6f-9a13-4c07-9255-255a3e4a5825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:39.482506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d9b6f-9a13-4c07-9255-255a3e4a5825 None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:39.482793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d9b6f-9a13-4c07-9255-255a3e4a5825 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:39.483078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d9b6f-9a13-4c07-9255-255a3e4a5825 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:39.483963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d9b6f-9a13-4c07-9255-255a3e4a5825 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:39.485519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d9b6f-9a13-4c07-9255-255a3e4a5825 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:39.494017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-8322defe-755d-4bac-b801-c06022b97bc6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 02 09:58:39.494017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:39.494017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:39.494017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:39.494017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:39.494017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:39.494017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:39.494017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:39.494017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:39.494017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:39.494017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:39.494017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:39.494017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:39.494017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:39.494017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:39.494017 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:39.495039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:39.495039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:39.495039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:39.495039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:39.495039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:39.495039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:39.495039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:39.495039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:39.495039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:39.495039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:39.495039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:39.495039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:39.495039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:39.495039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:39.495039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:39.495039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:39.495039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:39.495039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:39.496020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:39.496020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:39.496020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:39.496020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:39.496020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:39.496020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:39.496020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:39.496020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:39.496020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 02 09:58:39.496020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:39.499966 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 431/865] 10.222.0.16 () {56 vars in 1117 bytes} [Mon May 2 09:58:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:39.501127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322defe-755d-4bac-b801-c06022b97bc6 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:39.572638 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 435/866] 10.222.0.16 () {60 vars in 1141 bytes} [Mon May 2 09:58:39 2022] POST /identity/v3/services => generated 251 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 09:58:39.610946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322defe-755d-4bac-b801-c06022b97bc6 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:39.662061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978fbaa-bcce-4200-89cc-05bef50672dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:39.662760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978fbaa-bcce-4200-89cc-05bef50672dd None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:39.663089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978fbaa-bcce-4200-89cc-05bef50672dd None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:39.663371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978fbaa-bcce-4200-89cc-05bef50672dd None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:39.664225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978fbaa-bcce-4200-89cc-05bef50672dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:39.664539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978fbaa-bcce-4200-89cc-05bef50672dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:39.666016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978fbaa-bcce-4200-89cc-05bef50672dd None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:39.687830 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 432/867] 10.222.0.16 () {56 vars in 1149 bytes} [Mon May 2 09:58:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:39.693846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d9b6f-9a13-4c07-9255-255a3e4a5825 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:39.800640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d9b6f-9a13-4c07-9255-255a3e4a5825 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:39.836498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea2115-815d-4776-8452-6e0a500a01b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:39.837557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea2115-815d-4776-8452-6e0a500a01b6 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:39.838067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea2115-815d-4776-8452-6e0a500a01b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:39.838562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea2115-815d-4776-8452-6e0a500a01b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:39.905432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea2115-815d-4776-8452-6e0a500a01b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:39.907258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea2115-815d-4776-8452-6e0a500a01b6 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:40.005839 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 436/868] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:58:39 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 09:58:40.012203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978fbaa-bcce-4200-89cc-05bef50672dd None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:40.111607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978fbaa-bcce-4200-89cc-05bef50672dd None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:40.149625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713927f-99cf-4740-a79e-5c3ef1f11717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:40.150483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713927f-99cf-4740-a79e-5c3ef1f11717 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:40.150770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713927f-99cf-4740-a79e-5c3ef1f11717 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:40.151050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713927f-99cf-4740-a79e-5c3ef1f11717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:40.161385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713927f-99cf-4740-a79e-5c3ef1f11717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:40.162821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713927f-99cf-4740-a79e-5c3ef1f11717 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:40.182565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-5713927f-99cf-4740-a79e-5c3ef1f11717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:40.182565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:40.182565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:40.182565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:40.182565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:40.182565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:40.182565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:40.182565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:40.182565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:40.182565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:40.182565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:40.182565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:40.182565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:40.182565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:40.182565 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:40.183486 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:40.183486 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:40.183486 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:40.183486 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:40.183486 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:40.183486 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:40.183486 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:40.183486 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:40.183486 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:40.183486 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:40.183486 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:40.183486 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:40.183486 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:40.183486 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:40.183486 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:40.183486 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:40.183486 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:40.184363 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:40.184363 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:40.184363 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:40.184363 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:40.184363 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 433/869] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:40.189300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea2115-815d-4776-8452-6e0a500a01b6 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:40.287470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea2115-815d-4776-8452-6e0a500a01b6 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:40.323578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff3239-cd9d-43d9-97a6-b1713c5fa12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:40.324343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff3239-cd9d-43d9-97a6-b1713c5fa12d None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:40.324650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff3239-cd9d-43d9-97a6-b1713c5fa12d None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:40.324933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff3239-cd9d-43d9-97a6-b1713c5fa12d None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:40.325678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff3239-cd9d-43d9-97a6-b1713c5fa12d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:40.325987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff3239-cd9d-43d9-97a6-b1713c5fa12d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:40.327404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff3239-cd9d-43d9-97a6-b1713c5fa12d None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:40.340649 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 437/870] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:40.349820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713927f-99cf-4740-a79e-5c3ef1f11717 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:40.454690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713927f-99cf-4740-a79e-5c3ef1f11717 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:40.490163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76574737-3d53-4452-b412-d0585e24c8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:40.491019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76574737-3d53-4452-b412-d0585e24c8b9 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:40.491341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76574737-3d53-4452-b412-d0585e24c8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:40.491625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76574737-3d53-4452-b412-d0585e24c8b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:40.498749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76574737-3d53-4452-b412-d0585e24c8b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:40.500373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76574737-3d53-4452-b412-d0585e24c8b9 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:40.515312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b64a6c-7e94-496e-9e6f-2ad8a16acaf0 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:40.518683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-76574737-3d53-4452-b412-d0585e24c8b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:40.518683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:40.518683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:40.518683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:40.518683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:40.518683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:40.518683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:40.518683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:40.518683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:40.518683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:40.518683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:40.518683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:40.518683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:40.518683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:40.518683 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:40.519534 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:40.519534 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:40.519534 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:40.519534 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:40.519534 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:40.519534 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:40.519534 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:40.519534 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:40.519534 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:40.519534 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:40.519534 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:40.519534 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:40.519534 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:40.519534 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:40.519534 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:40.519534 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:40.519534 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:40.520419 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:40.520419 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:40.520419 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:40.520419 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:40.520419 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:40.520419 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:40.520419 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:40.520419 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:40.521315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b64a6c-7e94-496e-9e6f-2ad8a16acaf0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:40.521315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b64a6c-7e94-496e-9e6f-2ad8a16acaf0 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:40.521453 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 434/871] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:40.521529 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 438/872] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:58:40.523156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b64a6c-7e94-496e-9e6f-2ad8a16acaf0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:40.528650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84378ea0-9f52-42ef-93ef-285452432db3 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:40.528650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84378ea0-9f52-42ef-93ef-285452432db3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:40.528650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84378ea0-9f52-42ef-93ef-285452432db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:40.542758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-84378ea0-9f52-42ef-93ef-285452432db3 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:40.543899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-84378ea0-9f52-42ef-93ef-285452432db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:40.614262 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 435/873] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:40 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 09:58:40.638611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84378ea0-9f52-42ef-93ef-285452432db3 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:40.644344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b64a6c-7e94-496e-9e6f-2ad8a16acaf0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:40.687591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66c413-a480-4ad5-a7d4-a1171c6e312a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:40.688927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66c413-a480-4ad5-a7d4-a1171c6e312a None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:40.689420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66c413-a480-4ad5-a7d4-a1171c6e312a None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:40.690047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66c413-a480-4ad5-a7d4-a1171c6e312a None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:40.691447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66c413-a480-4ad5-a7d4-a1171c6e312a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:40.691986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66c413-a480-4ad5-a7d4-a1171c6e312a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:40.694320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66c413-a480-4ad5-a7d4-a1171c6e312a None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:40.711137 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 439/874] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:40.716923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66c413-a480-4ad5-a7d4-a1171c6e312a None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:40.750348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84378ea0-9f52-42ef-93ef-285452432db3 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:40.784901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0d397-7e11-4ae3-8e0a-68b21358ba9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:40.785680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0d397-7e11-4ae3-8e0a-68b21358ba9e None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:40.785969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0d397-7e11-4ae3-8e0a-68b21358ba9e None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:40.786255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0d397-7e11-4ae3-8e0a-68b21358ba9e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:40.786919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0d397-7e11-4ae3-8e0a-68b21358ba9e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:40.789389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0d397-7e11-4ae3-8e0a-68b21358ba9e None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:40.801311 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-92d0d397-7e11-4ae3-8e0a-68b21358ba9e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 02 09:58:40.801311 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:40.801311 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 09:58:40.801311 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 09:58:40.801311 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 09:58:40.801311 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 09:58:40.801311 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 09:58:40.801311 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:40.801311 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 02 09:58:40.801311 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:40.801311 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:58:40.801311 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:40.801311 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:40.801311 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:40.801311 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:40.801311 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:40.801311 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:40.802338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:40.802338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:40.802338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:40.802338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:40.802338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:40.802338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:40.802338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 09:58:40.802338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 09:58:40.802338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 09:58:40.802338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 09:58:40.802338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:40.802338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:40.802338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:40.802338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:40.802338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:40.802338 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:40.803195 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:40.803195 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:40.803195 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:40.803195 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:40.803195 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:40.803195 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:40.803195 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:40.803195 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:40.803195 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:40.803195 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:40.803195 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 09:58:40.803195 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:40.803195 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 02 09:58:40.803195 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:40.807754 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 436/875] 10.222.0.16 () {56 vars in 1126 bytes} [Mon May 2 09:58:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:40.808639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0d397-7e11-4ae3-8e0a-68b21358ba9e None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:40.822814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66c413-a480-4ad5-a7d4-a1171c6e312a None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:40.857822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aad769-14ca-4911-897b-2df651ce414e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:40.858744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aad769-14ca-4911-897b-2df651ce414e None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:40.859248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aad769-14ca-4911-897b-2df651ce414e None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:40.859688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aad769-14ca-4911-897b-2df651ce414e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:40.860700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aad769-14ca-4911-897b-2df651ce414e None admin] RBAC: Adding query filter params (role.id=a47492f29bc144158c1c2ed9a4c39d39, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=c1c06bcf38a942ffbcdc4ee6d2edebb0) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:40.861163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aad769-14ca-4911-897b-2df651ce414e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:40.862739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aad769-14ca-4911-897b-2df651ce414e None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:40.869664 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 440/876] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:58:40 2022] GET /identity/v3/role_assignments?user.id=c1c06bcf38a942ffbcdc4ee6d2edebb0&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=a47492f29bc144158c1c2ed9a4c39d39 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:40.889998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf829f0a-18ba-450a-abd6-e54c1e6ea70d None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:40.890607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf829f0a-18ba-450a-abd6-e54c1e6ea70d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:40.891039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf829f0a-18ba-450a-abd6-e54c1e6ea70d None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:40.893048 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 441/877] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:58:40.903018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81280f35-1245-4a42-a6ff-8f0421ccbea0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:40.903641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81280f35-1245-4a42-a6ff-8f0421ccbea0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:40.904133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81280f35-1245-4a42-a6ff-8f0421ccbea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:40.922261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-81280f35-1245-4a42-a6ff-8f0421ccbea0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:40.923860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-81280f35-1245-4a42-a6ff-8f0421ccbea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:40.925628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0d397-7e11-4ae3-8e0a-68b21358ba9e None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:40.965158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56546da8-2813-4ec3-9a68-3a6a930c4787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:40.965845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56546da8-2813-4ec3-9a68-3a6a930c4787 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:40.966134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56546da8-2813-4ec3-9a68-3a6a930c4787 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:40.966423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56546da8-2813-4ec3-9a68-3a6a930c4787 None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:40.967151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56546da8-2813-4ec3-9a68-3a6a930c4787 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:40.967469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56546da8-2813-4ec3-9a68-3a6a930c4787 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:40.970175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56546da8-2813-4ec3-9a68-3a6a930c4787 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:40.976044 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 437/878] 10.222.0.16 () {56 vars in 1122 bytes} [Mon May 2 09:58:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:40.981871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56546da8-2813-4ec3-9a68-3a6a930c4787 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:41.012739 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 442/879] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:40 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 09:58:41.033058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81280f35-1245-4a42-a6ff-8f0421ccbea0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:41.111363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56546da8-2813-4ec3-9a68-3a6a930c4787 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:41.143741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81280f35-1245-4a42-a6ff-8f0421ccbea0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:41.149199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc89d80-e7c2-406b-8a2f-db0a4b4b25b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:41.149869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc89d80-e7c2-406b-8a2f-db0a4b4b25b1 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:41.150158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc89d80-e7c2-406b-8a2f-db0a4b4b25b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:41.150440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc89d80-e7c2-406b-8a2f-db0a4b4b25b1 None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:41.151148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc89d80-e7c2-406b-8a2f-db0a4b4b25b1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:41.151459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc89d80-e7c2-406b-8a2f-db0a4b4b25b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:41.152872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc89d80-e7c2-406b-8a2f-db0a4b4b25b1 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:41.157863 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 438/880] 10.222.0.16 () {56 vars in 1122 bytes} [Mon May 2 09:58:40 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:41.189191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f5932-ca3e-4397-925f-7f2d028e6cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:41.189882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f5932-ca3e-4397-925f-7f2d028e6cfc None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:41.190171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f5932-ca3e-4397-925f-7f2d028e6cfc None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:41.190456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f5932-ca3e-4397-925f-7f2d028e6cfc None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:41.191216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f5932-ca3e-4397-925f-7f2d028e6cfc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:41.192649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f5932-ca3e-4397-925f-7f2d028e6cfc None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:41.299368 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 443/881] 10.222.0.16 () {60 vars in 1141 bytes} [Mon May 2 09:58:41 2022] POST /identity/v3/services => generated 269 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 09:58:42.080215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5833af-0319-4ff5-b453-6ab176c92e6c None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:42.080795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5833af-0319-4ff5-b453-6ab176c92e6c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:42.080795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5833af-0319-4ff5-b453-6ab176c92e6c None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:42.082374 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 439/882] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:42.088253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83227d-1302-4e5d-a4a7-cbe648e6e1e0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:42.088712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83227d-1302-4e5d-a4a7-cbe648e6e1e0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:42.088870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83227d-1302-4e5d-a4a7-cbe648e6e1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:42.112119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7b83227d-1302-4e5d-a4a7-cbe648e6e1e0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:42.113908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7b83227d-1302-4e5d-a4a7-cbe648e6e1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:42.186457 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 444/883] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 09:58:42.209276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5833af-0319-4ff5-b453-6ab176c92e6c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:42.314248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5833af-0319-4ff5-b453-6ab176c92e6c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:42.348021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf579a42-3338-4997-9f5b-7ed8327b83da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:42.348750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf579a42-3338-4997-9f5b-7ed8327b83da None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:42.349029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf579a42-3338-4997-9f5b-7ed8327b83da None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:42.349303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf579a42-3338-4997-9f5b-7ed8327b83da None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:42.349954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf579a42-3338-4997-9f5b-7ed8327b83da None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:42.351348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf579a42-3338-4997-9f5b-7ed8327b83da None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:42.362936 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-bf579a42-3338-4997-9f5b-7ed8327b83da None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 02 09:58:42.362936 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:42.362936 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 09:58:42.362936 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 09:58:42.362936 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 09:58:42.362936 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 09:58:42.362936 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 09:58:42.362936 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:42.362936 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 02 09:58:42.362936 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:42.362936 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:58:42.362936 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:42.362936 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:42.362936 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:42.362936 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:42.362936 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:42.362936 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:42.364213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:42.364213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:42.364213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:42.364213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:42.364213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:42.364213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:42.364213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 09:58:42.364213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 09:58:42.364213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 09:58:42.364213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 09:58:42.364213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:42.364213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:42.364213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:42.364213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:42.364213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:42.364213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:42.365103 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:42.365103 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:42.365103 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:42.365103 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:42.365103 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:42.365103 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:42.365103 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:42.365103 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:42.365103 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:42.365103 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:42.365103 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 09:58:42.365103 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:42.365103 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 02 09:58:42.365103 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:42.365103 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 440/884] 10.222.0.16 () {56 vars in 1114 bytes} [Mon May 2 09:58:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:42.370454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83227d-1302-4e5d-a4a7-cbe648e6e1e0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:42.467671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83227d-1302-4e5d-a4a7-cbe648e6e1e0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:42.501793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a863442-b943-44a5-bd59-083342275172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:42.502460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a863442-b943-44a5-bd59-083342275172 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:42.502741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a863442-b943-44a5-bd59-083342275172 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:42.503015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a863442-b943-44a5-bd59-083342275172 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:42.503713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a863442-b943-44a5-bd59-083342275172 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:42.504018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a863442-b943-44a5-bd59-083342275172 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:42.505423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a863442-b943-44a5-bd59-083342275172 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:42.510864 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 445/885] 10.222.0.16 () {56 vars in 1114 bytes} [Mon May 2 09:58:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:42.516623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf579a42-3338-4997-9f5b-7ed8327b83da None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:42.618313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf579a42-3338-4997-9f5b-7ed8327b83da None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:42.652390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf65ebe-bc8e-4c02-b698-8996223449f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:42.653859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf65ebe-bc8e-4c02-b698-8996223449f3 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:42.653859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf65ebe-bc8e-4c02-b698-8996223449f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:42.653859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf65ebe-bc8e-4c02-b698-8996223449f3 None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:42.654310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf65ebe-bc8e-4c02-b698-8996223449f3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:42.654595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf65ebe-bc8e-4c02-b698-8996223449f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:42.655949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf65ebe-bc8e-4c02-b698-8996223449f3 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:42.660916 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 441/886] 10.222.0.16 () {56 vars in 1114 bytes} [Mon May 2 09:58:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:42.666464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a863442-b943-44a5-bd59-083342275172 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:42.766260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a863442-b943-44a5-bd59-083342275172 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:42.805369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9ff9e-9e94-4428-9ebd-4f85769df4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:42.806033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9ff9e-9e94-4428-9ebd-4f85769df4f1 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:42.806362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9ff9e-9e94-4428-9ebd-4f85769df4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:42.806638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9ff9e-9e94-4428-9ebd-4f85769df4f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:42.807424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9ff9e-9e94-4428-9ebd-4f85769df4f1 None admin] RBAC: Adding query filter params (interface=public, service_id=4f1a48f50f63430c8a89a4ed7bf67537, region_id=RegionOne) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:42.807733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9ff9e-9e94-4428-9ebd-4f85769df4f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:42.809247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9ff9e-9e94-4428-9ebd-4f85769df4f1 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:42.814880 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 446/887] 10.222.0.16 () {56 vars in 1251 bytes} [Mon May 2 09:58:42 2022] GET /identity/v3/endpoints?service_id=4f1a48f50f63430c8a89a4ed7bf67537&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:42.820587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf65ebe-bc8e-4c02-b698-8996223449f3 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:42.919986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf65ebe-bc8e-4c02-b698-8996223449f3 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:42.954072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef6f71-d6d6-4870-91c4-fce16ee2feed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:42.954736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef6f71-d6d6-4870-91c4-fce16ee2feed None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:42.955021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef6f71-d6d6-4870-91c4-fce16ee2feed None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:42.955304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef6f71-d6d6-4870-91c4-fce16ee2feed None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:42.955990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef6f71-d6d6-4870-91c4-fce16ee2feed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:42.957381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef6f71-d6d6-4870-91c4-fce16ee2feed None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:42.963309 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 442/888] 10.222.0.16 () {56 vars in 1087 bytes} [Mon May 2 09:58:42 2022] GET /identity/v3/services => generated 1268 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 09:58:43.479666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c288307-f938-4a91-8e26-ce9bec3c3887 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:43.480400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c288307-f938-4a91-8e26-ce9bec3c3887 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:43.480400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c288307-f938-4a91-8e26-ce9bec3c3887 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:43.482087 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 447/889] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:43.489976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e71b9-a2a6-48c5-9d29-a60151578923 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:43.490608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e71b9-a2a6-48c5-9d29-a60151578923 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:43.490608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e71b9-a2a6-48c5-9d29-a60151578923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:43.508696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-669e71b9-a2a6-48c5-9d29-a60151578923 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:43.509977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-669e71b9-a2a6-48c5-9d29-a60151578923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:43.578852 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 443/890] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:58:43.582664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99172ac-6208-45ba-a102-1da2dd7a3429 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:43.583214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99172ac-6208-45ba-a102-1da2dd7a3429 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:43.583702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99172ac-6208-45ba-a102-1da2dd7a3429 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:43.586113 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 448/891] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:43.591366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222fb1f-47d4-4407-9a9b-3efc36e5dc16 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:43.591885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222fb1f-47d4-4407-9a9b-3efc36e5dc16 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:43.592371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222fb1f-47d4-4407-9a9b-3efc36e5dc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:43.603921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99172ac-6208-45ba-a102-1da2dd7a3429 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:43.611025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b222fb1f-47d4-4407-9a9b-3efc36e5dc16 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:43.612471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b222fb1f-47d4-4407-9a9b-3efc36e5dc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:43.688621 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 444/892] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:58:43.688621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78697ce-fd1f-4b7f-a1fc-58dc216723ba None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:43.688621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78697ce-fd1f-4b7f-a1fc-58dc216723ba None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:43.688967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78697ce-fd1f-4b7f-a1fc-58dc216723ba None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:43.692676 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 445/893] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:43.695868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7df7b-5a9a-4bab-be90-a501634de038 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:43.696314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7df7b-5a9a-4bab-be90-a501634de038 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:43.697394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7df7b-5a9a-4bab-be90-a501634de038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:43.716374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-baf7df7b-5a9a-4bab-be90-a501634de038 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:43.717633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-baf7df7b-5a9a-4bab-be90-a501634de038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:43.729452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99172ac-6208-45ba-a102-1da2dd7a3429 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:43.767147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa95823-bf5c-45ab-ae04-688730745735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:43.767884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa95823-bf5c-45ab-ae04-688730745735 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:43.768170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa95823-bf5c-45ab-ae04-688730745735 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:43.768447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa95823-bf5c-45ab-ae04-688730745735 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:43.778671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa95823-bf5c-45ab-ae04-688730745735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:43.788694 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 446/894] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 09:58:43.788694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7df7b-5a9a-4bab-be90-a501634de038 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:43.788974 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-3fa95823-bf5c-45ab-ae04-688730745735 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 02 09:58:43.788974 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:43.788974 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:43.788974 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:43.788974 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:43.788974 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:43.788974 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:43.788974 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:43.788974 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:43.788974 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:43.788974 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:43.788974 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:43.788974 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:43.788974 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:43.788974 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:43.788974 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:43.790222 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:43.790222 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:43.790222 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:43.790222 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:43.790222 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:43.790222 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:43.790222 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:43.790222 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:43.790222 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:43.790222 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:43.790222 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:43.790222 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:43.790222 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:43.790222 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:43.790222 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:43.790222 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:43.791248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:43.791248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:43.791248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:43.791248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:43.791248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:43.791248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:43.791248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:43.791248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:43.791248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:43.791248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:43.791248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 02 09:58:43.791248 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:43.791248 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 449/895] 10.222.0.16 () {56 vars in 1120 bytes} [Mon May 2 09:58:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:43.797716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa95823-bf5c-45ab-ae04-688730745735 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:43.895200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7df7b-5a9a-4bab-be90-a501634de038 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:43.895557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa95823-bf5c-45ab-ae04-688730745735 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:43.928807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df3bb4-455c-4e8d-8b1a-300a9dcdf1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:43.929355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a270e1-de4a-471b-9307-018b2981c697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:43.929478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df3bb4-455c-4e8d-8b1a-300a9dcdf1d1 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:43.929744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df3bb4-455c-4e8d-8b1a-300a9dcdf1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:43.930018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a270e1-de4a-471b-9307-018b2981c697 None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:43.930118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df3bb4-455c-4e8d-8b1a-300a9dcdf1d1 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:43.930304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a270e1-de4a-471b-9307-018b2981c697 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:43.930581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a270e1-de4a-471b-9307-018b2981c697 None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:43.930822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df3bb4-455c-4e8d-8b1a-300a9dcdf1d1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:43.931129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df3bb4-455c-4e8d-8b1a-300a9dcdf1d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:43.931299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a270e1-de4a-471b-9307-018b2981c697 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:43.932518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df3bb4-455c-4e8d-8b1a-300a9dcdf1d1 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:43.932707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a270e1-de4a-471b-9307-018b2981c697 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:43.940491 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 450/896] 10.222.0.16 () {56 vars in 1115 bytes} [Mon May 2 09:58:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:43.941322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df3bb4-455c-4e8d-8b1a-300a9dcdf1d1 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:44.016147 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 447/897] 10.222.0.16 () {60 vars in 1141 bytes} [Mon May 2 09:58:43 2022] POST /identity/v3/services => generated 241 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:58:44.017820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a270e1-de4a-471b-9307-018b2981c697 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:44.050577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df3bb4-455c-4e8d-8b1a-300a9dcdf1d1 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:44.104564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884823ff-b049-4e00-8cb8-5312058f5dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:44.105783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884823ff-b049-4e00-8cb8-5312058f5dc0 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:44.106686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884823ff-b049-4e00-8cb8-5312058f5dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:44.107138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884823ff-b049-4e00-8cb8-5312058f5dc0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:44.108265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884823ff-b049-4e00-8cb8-5312058f5dc0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:44.111107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884823ff-b049-4e00-8cb8-5312058f5dc0 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:44.129329 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-884823ff-b049-4e00-8cb8-5312058f5dc0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 02 09:58:44.129329 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:44.129329 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 09:58:44.129329 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 09:58:44.129329 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 09:58:44.129329 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 09:58:44.129329 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 09:58:44.129329 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:44.129329 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 02 09:58:44.129329 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:44.129329 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:58:44.129329 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:44.129329 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:44.129329 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:44.129329 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:44.129329 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:44.130509 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:44.130509 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:44.130509 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:44.130509 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:44.130509 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:44.130509 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:44.130509 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:44.130509 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 09:58:44.130509 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 09:58:44.130509 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 09:58:44.130509 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 09:58:44.130509 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:44.130509 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:44.130509 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:44.130509 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:44.130509 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:44.131367 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:44.131367 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:44.131367 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:44.131367 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:44.131367 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:44.131367 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:44.131367 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:44.131367 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:44.131367 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:44.131367 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:44.131367 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:44.131367 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 09:58:44.131367 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:44.131367 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 02 09:58:44.131367 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:44.136667 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 451/898] 10.222.0.16 () {56 vars in 1132 bytes} [Mon May 2 09:58:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:44.141394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884823ff-b049-4e00-8cb8-5312058f5dc0 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:44.153659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a270e1-de4a-471b-9307-018b2981c697 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:44.201829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bb3e1-e2d7-4ca7-802f-03eb3298b9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:44.203272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bb3e1-e2d7-4ca7-802f-03eb3298b9df None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:44.204197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bb3e1-e2d7-4ca7-802f-03eb3298b9df None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:44.205001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bb3e1-e2d7-4ca7-802f-03eb3298b9df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:44.219055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3bb3e1-e2d7-4ca7-802f-03eb3298b9df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:44.220444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3bb3e1-e2d7-4ca7-802f-03eb3298b9df None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:44.243566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-ab3bb3e1-e2d7-4ca7-802f-03eb3298b9df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:44.243566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:44.243566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:44.243566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:44.243566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:44.243566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:44.243566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:44.243566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:44.243566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:44.243566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:44.243566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:44.243566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:44.243566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:44.243566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:44.243566 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:44.244529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:44.244529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:44.244529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:44.244529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:44.244529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:44.244529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:44.244529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:44.244529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:44.244529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:44.244529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:44.244529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:44.244529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:44.244529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:44.244529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:44.244529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:44.244529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:44.244529 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:44.245474 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:44.245474 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:44.245474 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:44.245474 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:44.245474 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 448/899] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:44.250705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bb3e1-e2d7-4ca7-802f-03eb3298b9df None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:44.277778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884823ff-b049-4e00-8cb8-5312058f5dc0 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:44.311291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ab669-c404-46f9-9695-bb7a2abe7c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:44.311986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ab669-c404-46f9-9695-bb7a2abe7c71 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:44.312269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ab669-c404-46f9-9695-bb7a2abe7c71 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:44.312538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ab669-c404-46f9-9695-bb7a2abe7c71 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:44.313275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ab669-c404-46f9-9695-bb7a2abe7c71 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:44.313579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ab669-c404-46f9-9695-bb7a2abe7c71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:44.314943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ab669-c404-46f9-9695-bb7a2abe7c71 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:44.320372 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 452/900] 10.222.0.16 () {56 vars in 1126 bytes} [Mon May 2 09:58:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:44.325590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ab669-c404-46f9-9695-bb7a2abe7c71 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:44.365834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bb3e1-e2d7-4ca7-802f-03eb3298b9df None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:44.399695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef3de2-f818-453b-a3bf-8b509ca1791d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:44.400431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef3de2-f818-453b-a3bf-8b509ca1791d None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:44.400754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef3de2-f818-453b-a3bf-8b509ca1791d None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:44.401030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef3de2-f818-453b-a3bf-8b509ca1791d None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:44.401757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef3de2-f818-453b-a3bf-8b509ca1791d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:44.402063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef3de2-f818-453b-a3bf-8b509ca1791d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:44.405745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef3de2-f818-453b-a3bf-8b509ca1791d None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:44.421104 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 449/901] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:44.433327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef3de2-f818-453b-a3bf-8b509ca1791d None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:44.450598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ab669-c404-46f9-9695-bb7a2abe7c71 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:44.492367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf86a3-572b-4f6d-a3c4-e80332755d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:44.493064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf86a3-572b-4f6d-a3c4-e80332755d2f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:44.493337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf86a3-572b-4f6d-a3c4-e80332755d2f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:44.493691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf86a3-572b-4f6d-a3c4-e80332755d2f None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:44.494403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf86a3-572b-4f6d-a3c4-e80332755d2f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:44.494713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf86a3-572b-4f6d-a3c4-e80332755d2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:44.496085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf86a3-572b-4f6d-a3c4-e80332755d2f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:44.506182 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 453/902] 10.222.0.16 () {56 vars in 1126 bytes} [Mon May 2 09:58:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:44.508153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf86a3-572b-4f6d-a3c4-e80332755d2f None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:44.547112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef3de2-f818-453b-a3bf-8b509ca1791d None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:44.581253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056691c-90c3-4bb4-985a-ce8fc3fd6409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:44.582404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056691c-90c3-4bb4-985a-ce8fc3fd6409 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:44.582930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056691c-90c3-4bb4-985a-ce8fc3fd6409 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:44.583382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056691c-90c3-4bb4-985a-ce8fc3fd6409 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:44.591206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056691c-90c3-4bb4-985a-ce8fc3fd6409 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:44.592928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056691c-90c3-4bb4-985a-ce8fc3fd6409 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:44.607939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-1056691c-90c3-4bb4-985a-ce8fc3fd6409 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 02 09:58:44.607939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:44.607939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:44.607939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:44.607939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:44.607939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:44.607939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:44.607939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:44.607939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:44.607939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:44.607939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:44.607939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:44.607939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:44.607939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:44.607939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:44.607939 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:44.608921 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:44.608921 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:44.608921 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:44.608921 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:44.608921 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:44.608921 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:44.608921 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:44.608921 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:44.608921 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:44.608921 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:44.608921 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:44.608921 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:44.608921 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:44.608921 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:44.608921 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:44.608921 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:44.608921 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:44.608921 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:44.609857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:44.609857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:44.609857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:44.609857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:44.609857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:44.609857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:44.609857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:44.609857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:44.609857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 02 09:58:44.609857 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:44.610381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf86a3-572b-4f6d-a3c4-e80332755d2f None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:44.612544 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 450/903] 10.222.0.16 () {56 vars in 1117 bytes} [Mon May 2 09:58:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:44.619162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056691c-90c3-4bb4-985a-ce8fc3fd6409 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:44.644672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd962e93-25b9-4acf-8fa5-f61fe8835e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:44.645468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd962e93-25b9-4acf-8fa5-f61fe8835e5c None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:44.645814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd962e93-25b9-4acf-8fa5-f61fe8835e5c None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:44.646121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd962e93-25b9-4acf-8fa5-f61fe8835e5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:44.646981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd962e93-25b9-4acf-8fa5-f61fe8835e5c None admin] RBAC: Adding query filter params (interface=public, service_id=e473e8c6a44b49b6a094cfca1c951ae4, region_id=RegionOne) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:44.647401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd962e93-25b9-4acf-8fa5-f61fe8835e5c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:44.648860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd962e93-25b9-4acf-8fa5-f61fe8835e5c None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:44.658432 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 454/904] 10.222.0.16 () {56 vars in 1251 bytes} [Mon May 2 09:58:44 2022] GET /identity/v3/endpoints?service_id=e473e8c6a44b49b6a094cfca1c951ae4&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:44.659758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd962e93-25b9-4acf-8fa5-f61fe8835e5c None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:44.719300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056691c-90c3-4bb4-985a-ce8fc3fd6409 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:44.753903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca4aee-8186-445c-b36c-0baf0f3ce20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:44.754849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca4aee-8186-445c-b36c-0baf0f3ce20c None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:44.755286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca4aee-8186-445c-b36c-0baf0f3ce20c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:44.755712 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca4aee-8186-445c-b36c-0baf0f3ce20c None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:44.756803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca4aee-8186-445c-b36c-0baf0f3ce20c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:44.757266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca4aee-8186-445c-b36c-0baf0f3ce20c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:44.758801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd962e93-25b9-4acf-8fa5-f61fe8835e5c None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:44.759036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca4aee-8186-445c-b36c-0baf0f3ce20c None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:44.781020 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 451/905] 10.222.0.16 () {56 vars in 1149 bytes} [Mon May 2 09:58:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:44.782130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca4aee-8186-445c-b36c-0baf0f3ce20c None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:44.792406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892fd77-a6df-43b4-bb10-012c9a54dac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:44.793183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892fd77-a6df-43b4-bb10-012c9a54dac6 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:44.793468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892fd77-a6df-43b4-bb10-012c9a54dac6 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:44.793755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892fd77-a6df-43b4-bb10-012c9a54dac6 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:44.794431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892fd77-a6df-43b4-bb10-012c9a54dac6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:44.795816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892fd77-a6df-43b4-bb10-012c9a54dac6 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:44.808836 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 455/906] 10.222.0.16 () {56 vars in 1087 bytes} [Mon May 2 09:58:44 2022] GET /identity/v3/services => generated 1497 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 09:58:44.892030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca4aee-8186-445c-b36c-0baf0f3ce20c None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:44.929506 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ffa7b-6d83-4a1d-987a-c375247b3b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:44.930476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ffa7b-6d83-4a1d-987a-c375247b3b02 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:44.930914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ffa7b-6d83-4a1d-987a-c375247b3b02 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:44.931340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ffa7b-6d83-4a1d-987a-c375247b3b02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:45.010458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ffa7b-6d83-4a1d-987a-c375247b3b02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:45.011912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ffa7b-6d83-4a1d-987a-c375247b3b02 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:45.120511 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 452/907] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:58:44 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 09:58:45.125918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892fd77-a6df-43b4-bb10-012c9a54dac6 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:45.231152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892fd77-a6df-43b4-bb10-012c9a54dac6 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:45.264904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd2b52-8d4e-48f4-af90-6e964651f496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:45.265702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd2b52-8d4e-48f4-af90-6e964651f496 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:45.265985 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd2b52-8d4e-48f4-af90-6e964651f496 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:45.266270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd2b52-8d4e-48f4-af90-6e964651f496 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:45.277540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd2b52-8d4e-48f4-af90-6e964651f496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:45.278993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd2b52-8d4e-48f4-af90-6e964651f496 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:45.296549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-c4cd2b52-8d4e-48f4-af90-6e964651f496 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:45.296549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:45.296549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:45.296549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:45.296549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:45.296549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:45.296549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:45.296549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:45.296549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:45.296549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:45.296549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:45.296549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:45.296549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:45.296549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:45.296549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:45.297481 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:45.297481 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:45.297481 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:45.297481 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:45.297481 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:45.297481 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:45.297481 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:45.297481 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:45.297481 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:45.297481 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:45.297481 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:45.297481 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:45.297481 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:45.297481 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:45.297481 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:45.297481 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:45.297481 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:45.298372 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:45.298372 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:45.298372 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:45.298372 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:45.298372 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 456/908] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:45.304707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ffa7b-6d83-4a1d-987a-c375247b3b02 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:45.339765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094c1fb-0ad0-408f-abed-a46364b97c57 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:45.340097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094c1fb-0ad0-408f-abed-a46364b97c57 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:45.340329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094c1fb-0ad0-408f-abed-a46364b97c57 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:45.345234 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 457/909] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:58:45.346788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378aa57-b6c9-4bb9-b2b5-9cf48c573ace None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:45.347073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378aa57-b6c9-4bb9-b2b5-9cf48c573ace None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:45.347347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378aa57-b6c9-4bb9-b2b5-9cf48c573ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:45.370393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c378aa57-b6c9-4bb9-b2b5-9cf48c573ace None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:45.371836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c378aa57-b6c9-4bb9-b2b5-9cf48c573ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:45.410394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ffa7b-6d83-4a1d-987a-c375247b3b02 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:45.447796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816116a9-2e1d-4b10-a363-7e42e28d2ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:45.452629 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 458/910] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 09:58:45.456619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816116a9-2e1d-4b10-a363-7e42e28d2ff7 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:45.456619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816116a9-2e1d-4b10-a363-7e42e28d2ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:45.456619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816116a9-2e1d-4b10-a363-7e42e28d2ff7 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:45.456619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816116a9-2e1d-4b10-a363-7e42e28d2ff7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:45.456619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816116a9-2e1d-4b10-a363-7e42e28d2ff7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:45.456619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816116a9-2e1d-4b10-a363-7e42e28d2ff7 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:45.472630 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 453/911] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:45.474567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378aa57-b6c9-4bb9-b2b5-9cf48c573ace None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:45.481622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816116a9-2e1d-4b10-a363-7e42e28d2ff7 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:45.573710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378aa57-b6c9-4bb9-b2b5-9cf48c573ace None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:45.581168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816116a9-2e1d-4b10-a363-7e42e28d2ff7 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:45.609485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9ed76-a500-4d6c-a57a-4fe607119a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:45.610604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9ed76-a500-4d6c-a57a-4fe607119a67 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:45.611128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9ed76-a500-4d6c-a57a-4fe607119a67 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:45.611624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9ed76-a500-4d6c-a57a-4fe607119a67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:45.616792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0b816-dd4c-4131-a354-911f1598b0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:45.617594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0b816-dd4c-4131-a354-911f1598b0d7 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:45.617878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0b816-dd4c-4131-a354-911f1598b0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:45.618156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0b816-dd4c-4131-a354-911f1598b0d7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:45.618834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0b816-dd4c-4131-a354-911f1598b0d7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:45.620115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9ed76-a500-4d6c-a57a-4fe607119a67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:45.620228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0b816-dd4c-4131-a354-911f1598b0d7 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:45.622025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9ed76-a500-4d6c-a57a-4fe607119a67 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:45.634891 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-4ea0b816-dd4c-4131-a354-911f1598b0d7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 02 09:58:45.634891 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:45.634891 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 09:58:45.634891 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 09:58:45.634891 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 09:58:45.634891 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 09:58:45.634891 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 09:58:45.634891 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:45.634891 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 02 09:58:45.634891 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:45.634891 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:58:45.634891 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:45.634891 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:45.634891 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:45.634891 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:45.634891 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:45.634891 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:45.635925 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:45.635925 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:45.635925 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:45.635925 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:45.635925 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:45.635925 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:45.635925 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 09:58:45.635925 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 09:58:45.635925 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 09:58:45.635925 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 09:58:45.635925 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:45.635925 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:45.635925 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:45.635925 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:45.635925 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:45.635925 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:45.636810 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:45.636810 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:45.636810 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:45.636810 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:45.636810 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:45.636810 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:45.636810 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:45.636810 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:45.636810 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:45.636810 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:45.636810 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 09:58:45.636810 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:45.636810 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 02 09:58:45.636810 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:45.640462 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-11d9ed76-a500-4d6c-a57a-4fe607119a67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:45.640462 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:45.640462 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:45.640462 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:45.640462 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:45.640462 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:45.640462 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:45.640462 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:45.640462 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:45.640462 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:45.640462 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:45.640462 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:45.640462 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:45.640462 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:45.640462 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:45.641743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:45.641743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:45.641743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:45.641743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:45.641743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:45.641743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:45.641743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:45.641743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:45.641743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:45.641743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:45.641743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:45.641743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:45.641743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:45.641743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:45.641743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:45.641743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:45.641743 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:45.642612 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:45.642612 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:45.642612 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:45.642612 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:45.642612 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:45.642612 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:45.642612 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:45.642612 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:45.643036 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 454/912] 10.222.0.16 () {56 vars in 1114 bytes} [Mon May 2 09:58:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:45.643036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0b816-dd4c-4131-a354-911f1598b0d7 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:45.648727 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 459/913] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:45.651822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9ed76-a500-4d6c-a57a-4fe607119a67 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:45.741520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0b816-dd4c-4131-a354-911f1598b0d7 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:45.752173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9ed76-a500-4d6c-a57a-4fe607119a67 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:45.780091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f5795-dc77-47f4-8c4c-a4e30eb3f019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:45.780806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f5795-dc77-47f4-8c4c-a4e30eb3f019 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:45.781112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f5795-dc77-47f4-8c4c-a4e30eb3f019 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:45.781518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f5795-dc77-47f4-8c4c-a4e30eb3f019 None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:45.782545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f5795-dc77-47f4-8c4c-a4e30eb3f019 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:45.782863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f5795-dc77-47f4-8c4c-a4e30eb3f019 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:45.784477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f5795-dc77-47f4-8c4c-a4e30eb3f019 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:45.789973 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 455/914] 10.222.0.16 () {56 vars in 1114 bytes} [Mon May 2 09:58:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:45.791595 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b26756-f2ba-4539-b6bd-74c811a63f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:45.792266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b26756-f2ba-4539-b6bd-74c811a63f97 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:45.792551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b26756-f2ba-4539-b6bd-74c811a63f97 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:45.792860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b26756-f2ba-4539-b6bd-74c811a63f97 None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:45.793649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b26756-f2ba-4539-b6bd-74c811a63f97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:45.793961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b26756-f2ba-4539-b6bd-74c811a63f97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:45.795493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b26756-f2ba-4539-b6bd-74c811a63f97 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:45.795721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f5795-dc77-47f4-8c4c-a4e30eb3f019 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:45.812693 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 460/915] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:45.816556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b26756-f2ba-4539-b6bd-74c811a63f97 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:45.914312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f5795-dc77-47f4-8c4c-a4e30eb3f019 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:45.923180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b26756-f2ba-4539-b6bd-74c811a63f97 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:45.949264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dc28e-3d54-4ef9-8a1d-0709d8968669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:45.950297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dc28e-3d54-4ef9-8a1d-0709d8968669 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:45.950799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dc28e-3d54-4ef9-8a1d-0709d8968669 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:45.951275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dc28e-3d54-4ef9-8a1d-0709d8968669 None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:45.952190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20dc28e-3d54-4ef9-8a1d-0709d8968669 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:45.952738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20dc28e-3d54-4ef9-8a1d-0709d8968669 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:45.954293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20dc28e-3d54-4ef9-8a1d-0709d8968669 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:45.958077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a160f0a-ce2a-46f5-921f-3ed1ca9e98a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:45.958731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a160f0a-ce2a-46f5-921f-3ed1ca9e98a7 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:45.959016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a160f0a-ce2a-46f5-921f-3ed1ca9e98a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:45.959296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a160f0a-ce2a-46f5-921f-3ed1ca9e98a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:45.960160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a160f0a-ce2a-46f5-921f-3ed1ca9e98a7 None admin] RBAC: Adding query filter params (role.id=0ef68f89f9394078b95445392557cd47, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=c1c06bcf38a942ffbcdc4ee6d2edebb0) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:45.960472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a160f0a-ce2a-46f5-921f-3ed1ca9e98a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:45.961441 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 456/916] 10.222.0.16 () {56 vars in 1114 bytes} [Mon May 2 09:58:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:45.962102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a160f0a-ce2a-46f5-921f-3ed1ca9e98a7 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:45.968640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dc28e-3d54-4ef9-8a1d-0709d8968669 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:45.976727 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 461/917] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:58:45 2022] GET /identity/v3/role_assignments?user.id=c1c06bcf38a942ffbcdc4ee6d2edebb0&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=0ef68f89f9394078b95445392557cd47 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:46.085452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dc28e-3d54-4ef9-8a1d-0709d8968669 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:46.123540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b5d09-e076-476f-aed4-fe614426bd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:46.124262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b5d09-e076-476f-aed4-fe614426bd3c None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:46.124556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b5d09-e076-476f-aed4-fe614426bd3c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:46.124866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b5d09-e076-476f-aed4-fe614426bd3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:46.125626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b5d09-e076-476f-aed4-fe614426bd3c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:46.127014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b5d09-e076-476f-aed4-fe614426bd3c None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:46.201761 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 457/918] 10.222.0.16 () {60 vars in 1144 bytes} [Mon May 2 09:58:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 09:58:46.520389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d05038-880d-4b56-aa59-bb996357c34c None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:46.521132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d05038-880d-4b56-aa59-bb996357c34c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:46.521631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d05038-880d-4b56-aa59-bb996357c34c None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:46.524072 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 462/919] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:46.529133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2f548-dc4b-4729-a1dc-131aeac3d213 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:46.529430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2f548-dc4b-4729-a1dc-131aeac3d213 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:46.529710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2f548-dc4b-4729-a1dc-131aeac3d213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:46.548016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8ff2f548-dc4b-4729-a1dc-131aeac3d213 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:46.549240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8ff2f548-dc4b-4729-a1dc-131aeac3d213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:46.623577 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 458/920] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 09:58:46.646856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d05038-880d-4b56-aa59-bb996357c34c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:46.753265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d05038-880d-4b56-aa59-bb996357c34c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:46.791582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6dc37-0456-48e3-97d7-335177c3ea16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:46.792799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6dc37-0456-48e3-97d7-335177c3ea16 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:46.793311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6dc37-0456-48e3-97d7-335177c3ea16 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:46.793793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6dc37-0456-48e3-97d7-335177c3ea16 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:46.794653 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6dc37-0456-48e3-97d7-335177c3ea16 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:46.796239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6dc37-0456-48e3-97d7-335177c3ea16 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:46.808861 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-04b6dc37-0456-48e3-97d7-335177c3ea16 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 02 09:58:46.808861 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:46.808861 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 09:58:46.808861 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 09:58:46.808861 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 09:58:46.808861 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 09:58:46.808861 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 09:58:46.808861 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:46.808861 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 02 09:58:46.808861 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:46.808861 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:58:46.808861 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:46.808861 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:46.808861 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:46.808861 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:46.808861 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:46.808861 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:46.809836 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:46.809836 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:46.809836 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:46.809836 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:46.809836 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:46.809836 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:46.809836 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 09:58:46.809836 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 09:58:46.809836 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 09:58:46.809836 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 09:58:46.809836 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:46.809836 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:46.809836 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:46.809836 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:46.809836 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:46.809836 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:46.810699 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:46.810699 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:46.810699 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:46.810699 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:46.810699 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:46.810699 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:46.810699 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:46.810699 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:46.810699 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:46.810699 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:46.810699 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 09:58:46.810699 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:46.810699 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 02 09:58:46.810699 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:46.813556 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 463/921] 10.222.0.16 () {56 vars in 1126 bytes} [Mon May 2 09:58:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:46.819754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2f548-dc4b-4729-a1dc-131aeac3d213 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:46.918989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2f548-dc4b-4729-a1dc-131aeac3d213 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:46.953366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8237db-9b57-489a-a948-53e374921851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:46.954045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8237db-9b57-489a-a948-53e374921851 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:46.954326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8237db-9b57-489a-a948-53e374921851 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:46.954605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8237db-9b57-489a-a948-53e374921851 None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:46.955322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8237db-9b57-489a-a948-53e374921851 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:46.955640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8237db-9b57-489a-a948-53e374921851 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:46.957048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8237db-9b57-489a-a948-53e374921851 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:46.962903 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 459/922] 10.222.0.16 () {56 vars in 1122 bytes} [Mon May 2 09:58:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:46.968508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6dc37-0456-48e3-97d7-335177c3ea16 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:47.071664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6dc37-0456-48e3-97d7-335177c3ea16 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:47.112669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0a269-e754-4d0a-a853-9a2f92704886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:47.112669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0a269-e754-4d0a-a853-9a2f92704886 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:47.112669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0a269-e754-4d0a-a853-9a2f92704886 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:47.112669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0a269-e754-4d0a-a853-9a2f92704886 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:47.113085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0a269-e754-4d0a-a853-9a2f92704886 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:47.113085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0a269-e754-4d0a-a853-9a2f92704886 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:47.113085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0a269-e754-4d0a-a853-9a2f92704886 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:47.117185 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 464/923] 10.222.0.16 () {56 vars in 1122 bytes} [Mon May 2 09:58:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:47.123053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8237db-9b57-489a-a948-53e374921851 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:47.225529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8237db-9b57-489a-a948-53e374921851 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:47.245655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59d7dd-3a19-4892-8c86-f6d44a795b87 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:47.245979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59d7dd-3a19-4892-8c86-f6d44a795b87 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:47.246216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59d7dd-3a19-4892-8c86-f6d44a795b87 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:47.247970 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 465/924] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:58:47.253723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dcb7a-2074-4bee-8d07-b98d20326b35 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:47.254176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dcb7a-2074-4bee-8d07-b98d20326b35 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:47.254286 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dcb7a-2074-4bee-8d07-b98d20326b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:47.265322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32dafef-30c8-433e-96cb-345fda5b62e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:47.266369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dafef-30c8-433e-96cb-345fda5b62e0 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:47.266875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dafef-30c8-433e-96cb-345fda5b62e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:47.267368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dafef-30c8-433e-96cb-345fda5b62e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:47.268365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32dafef-30c8-433e-96cb-345fda5b62e0 None admin] RBAC: Adding query filter params (interface=public, service_id=726fe7ba88414317b244627d469cd35b, region_id=RegionOne) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:47.268898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32dafef-30c8-433e-96cb-345fda5b62e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:47.270348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32dafef-30c8-433e-96cb-345fda5b62e0 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:47.276000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-111dcb7a-2074-4bee-8d07-b98d20326b35 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:47.277050 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 460/925] 10.222.0.16 () {56 vars in 1251 bytes} [Mon May 2 09:58:47 2022] GET /identity/v3/endpoints?service_id=726fe7ba88414317b244627d469cd35b&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:47.277820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-111dcb7a-2074-4bee-8d07-b98d20326b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:47.282472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32dafef-30c8-433e-96cb-345fda5b62e0 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:47.361140 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 466/926] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:58:47.383992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32dafef-30c8-433e-96cb-345fda5b62e0 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:47.384986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dcb7a-2074-4bee-8d07-b98d20326b35 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:47.419733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877ff1f-45ad-4402-bbcf-fe7b833cffd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:47.420414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877ff1f-45ad-4402-bbcf-fe7b833cffd2 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:47.420732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877ff1f-45ad-4402-bbcf-fe7b833cffd2 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:47.421014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877ff1f-45ad-4402-bbcf-fe7b833cffd2 None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:47.421719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877ff1f-45ad-4402-bbcf-fe7b833cffd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:47.423234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877ff1f-45ad-4402-bbcf-fe7b833cffd2 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:47.431455 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 461/927] 10.222.0.16 () {56 vars in 1087 bytes} [Mon May 2 09:58:47 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 09:58:47.488894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dcb7a-2074-4bee-8d07-b98d20326b35 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:47.526974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189a60c-5a07-4f87-9128-27726af6375d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:47.527812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189a60c-5a07-4f87-9128-27726af6375d None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:47.528095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189a60c-5a07-4f87-9128-27726af6375d None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:47.528373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189a60c-5a07-4f87-9128-27726af6375d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:47.529088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189a60c-5a07-4f87-9128-27726af6375d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:47.533524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189a60c-5a07-4f87-9128-27726af6375d None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:47.543950 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-a189a60c-5a07-4f87-9128-27726af6375d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 02 09:58:47.543950 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:47.543950 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 09:58:47.543950 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 09:58:47.543950 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 09:58:47.543950 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 09:58:47.543950 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 09:58:47.543950 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:47.543950 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 02 09:58:47.543950 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:47.543950 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:58:47.543950 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:47.543950 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:47.543950 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:47.543950 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:47.543950 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:47.545335 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:47.545335 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:47.545335 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:47.545335 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:47.545335 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:47.545335 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:47.545335 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:47.545335 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 09:58:47.545335 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 09:58:47.545335 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 09:58:47.545335 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 09:58:47.545335 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:47.545335 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:47.545335 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:47.545335 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:47.545335 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:47.546176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:47.546176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:47.546176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:47.546176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:47.546176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:47.546176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:47.546176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:47.546176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:47.546176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:47.546176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:47.546176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:47.546176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 09:58:47.546176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:47.546176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 02 09:58:47.546176 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:47.546176 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 467/928] 10.222.0.16 () {56 vars in 1132 bytes} [Mon May 2 09:58:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:47.554556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877ff1f-45ad-4402-bbcf-fe7b833cffd2 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:47.658474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877ff1f-45ad-4402-bbcf-fe7b833cffd2 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:47.693594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87755db8-77eb-4434-93a9-d91115f9a833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:47.694646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87755db8-77eb-4434-93a9-d91115f9a833 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:47.695150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87755db8-77eb-4434-93a9-d91115f9a833 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:47.695632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87755db8-77eb-4434-93a9-d91115f9a833 None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:47.696560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87755db8-77eb-4434-93a9-d91115f9a833 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:47.697088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87755db8-77eb-4434-93a9-d91115f9a833 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:47.698643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87755db8-77eb-4434-93a9-d91115f9a833 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:47.704040 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 462/929] 10.222.0.16 () {56 vars in 1126 bytes} [Mon May 2 09:58:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:47.709865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189a60c-5a07-4f87-9128-27726af6375d None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:47.813091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189a60c-5a07-4f87-9128-27726af6375d None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:47.845894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4afd8-ab66-47c2-8781-56aaf4242cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:47.846569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4afd8-ab66-47c2-8781-56aaf4242cb3 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:47.846855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4afd8-ab66-47c2-8781-56aaf4242cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:47.847137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4afd8-ab66-47c2-8781-56aaf4242cb3 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:47.847851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4afd8-ab66-47c2-8781-56aaf4242cb3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:47.848166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4afd8-ab66-47c2-8781-56aaf4242cb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:47.849565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4afd8-ab66-47c2-8781-56aaf4242cb3 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:47.855430 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 468/930] 10.222.0.16 () {56 vars in 1126 bytes} [Mon May 2 09:58:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:47.860834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87755db8-77eb-4434-93a9-d91115f9a833 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:47.963655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87755db8-77eb-4434-93a9-d91115f9a833 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:48.001496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e19e4-2e38-494d-ad9f-36f1bda17036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:48.002166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e19e4-2e38-494d-ad9f-36f1bda17036 None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:48.002452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e19e4-2e38-494d-ad9f-36f1bda17036 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:48.002730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e19e4-2e38-494d-ad9f-36f1bda17036 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:48.003484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e19e4-2e38-494d-ad9f-36f1bda17036 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:48.004871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e19e4-2e38-494d-ad9f-36f1bda17036 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:48.121391 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 463/931] 10.222.0.16 () {60 vars in 1144 bytes} [Mon May 2 09:58:47 2022] POST /identity/v3/endpoints => generated 347 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:58:48.438137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6954ac-65fa-44e8-aabe-575c3be5d8e4 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:48.438424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6954ac-65fa-44e8-aabe-575c3be5d8e4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:48.438708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6954ac-65fa-44e8-aabe-575c3be5d8e4 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:48.440343 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 469/932] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:48.446172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed85d-c799-42df-a6dd-00acbe144b53 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:48.446462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed85d-c799-42df-a6dd-00acbe144b53 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:48.446741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed85d-c799-42df-a6dd-00acbe144b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:48.464197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-74eed85d-c799-42df-a6dd-00acbe144b53 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:48.465425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-74eed85d-c799-42df-a6dd-00acbe144b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:48.539315 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 464/933] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:58:48.562318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6954ac-65fa-44e8-aabe-575c3be5d8e4 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:48.595802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea7eff-6592-4842-b16e-ae7d2b773aa9 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:48.596095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea7eff-6592-4842-b16e-ae7d2b773aa9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:48.596377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea7eff-6592-4842-b16e-ae7d2b773aa9 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:48.598060 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 465/934] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:58:48.604009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a1ce1-ab63-4dfa-bc99-de6c8894a145 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:48.604297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a1ce1-ab63-4dfa-bc99-de6c8894a145 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:48.604577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a1ce1-ab63-4dfa-bc99-de6c8894a145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:48.622224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-936a1ce1-ab63-4dfa-bc99-de6c8894a145 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:48.623397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-936a1ce1-ab63-4dfa-bc99-de6c8894a145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:48.671202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6954ac-65fa-44e8-aabe-575c3be5d8e4 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:48.701023 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 466/935] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 09:58:48.718690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bde640-161b-46cb-ae35-871ef883945a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:48.720079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bde640-161b-46cb-ae35-871ef883945a None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:48.720546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bde640-161b-46cb-ae35-871ef883945a None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:48.721079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bde640-161b-46cb-ae35-871ef883945a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:48.725098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a1ce1-ab63-4dfa-bc99-de6c8894a145 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:48.733033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bde640-161b-46cb-ae35-871ef883945a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:48.741785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-77bde640-161b-46cb-ae35-871ef883945a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 02 09:58:48.741785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:48.741785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:48.741785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:48.741785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:48.741785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:48.741785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:48.741785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:48.741785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:48.741785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:48.741785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:48.741785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:48.741785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:48.741785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:48.741785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:48.741785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:48.742709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:48.742709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:48.742709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:48.742709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:48.742709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:48.742709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:48.742709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:48.742709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:48.742709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:48.742709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:48.742709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:48.742709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:48.742709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:48.742709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:48.742709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:48.742709 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:48.743566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:48.743566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:48.743566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:48.743566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:48.743566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:48.743566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:48.743566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:48.743566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:48.743566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:48.743566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:48.743566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 02 09:58:48.743566 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:48.743566 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 470/936] 10.222.0.16 () {56 vars in 1120 bytes} [Mon May 2 09:58:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:48.749975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bde640-161b-46cb-ae35-871ef883945a None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:48.840812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a1ce1-ab63-4dfa-bc99-de6c8894a145 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:48.859118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bde640-161b-46cb-ae35-871ef883945a None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:48.883139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcef0c-9a31-4b86-876e-b11972675fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:48.883805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcef0c-9a31-4b86-876e-b11972675fd0 None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:48.884238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcef0c-9a31-4b86-876e-b11972675fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:48.884528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcef0c-9a31-4b86-876e-b11972675fd0 None admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:48.885779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcef0c-9a31-4b86-876e-b11972675fd0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:48.888991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcef0c-9a31-4b86-876e-b11972675fd0 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:48.889344 ncdv-master-1 devstack@keystone.service[91118]: WARNING keystone.server.flask.common [None req-f0fcef0c-9a31-4b86-876e-b11972675fd0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 02 09:58:48.897225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ed9d7-1008-4db3-b3fe-43a1fe6cc966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:48.898249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ed9d7-1008-4db3-b3fe-43a1fe6cc966 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:48.898738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ed9d7-1008-4db3-b3fe-43a1fe6cc966 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:48.899266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ed9d7-1008-4db3-b3fe-43a1fe6cc966 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:48.900227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ed9d7-1008-4db3-b3fe-43a1fe6cc966 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:48.900860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ed9d7-1008-4db3-b3fe-43a1fe6cc966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:48.902510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ed9d7-1008-4db3-b3fe-43a1fe6cc966 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:48.916881 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 471/937] 10.222.0.16 () {56 vars in 1115 bytes} [Mon May 2 09:58:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:48.918438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ed9d7-1008-4db3-b3fe-43a1fe6cc966 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:48.937099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.sql.core [None req-f0fcef0c-9a31-4b86-876e-b11972675fd0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 02 09:58:48.937099 ncdv-master-1 devstack@keystone.service[91118]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 02 09:58:48.937099 ncdv-master-1 devstack@keystone.service[91118]: [parameters: {'id': '380ec505fedb40a7a2fef2b28c1f1709', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 02 09:58:48.937099 ncdv-master-1 devstack@keystone.service[91118]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91118) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 02 09:58:48.953781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-f0fcef0c-9a31-4b86-876e-b11972675fd0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 380ec505fedb40a7a2fef2b28c1f1709.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 380ec505fedb40a7a2fef2b28c1f1709. May 02 09:58:48.953781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:48.953781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 02 09:58:48.953781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self.dialect.do_execute( May 02 09:58:48.953781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 02 09:58:48.953781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 02 09:58:48.953781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 02 09:58:48.953781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application result = self._query(query) May 02 09:58:48.953781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 02 09:58:48.953781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application conn.query(q) May 02 09:58:48.953781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 02 09:58:48.953781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 02 09:58:48.953781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 02 09:58:48.954611 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application result.read() May 02 09:58:48.954611 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 02 09:58:48.954611 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 02 09:58:48.954611 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 02 09:58:48.954611 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application packet.raise_for_error() May 02 09:58:48.954611 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 02 09:58:48.954611 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 02 09:58:48.954611 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 02 09:58:48.954611 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 02 09:58:48.954611 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 02 09:58:48.954611 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:48.954611 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 02 09:58:48.954611 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:48.954611 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:48.954611 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 02 09:58:48.954611 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 02 09:58:48.954611 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 02 09:58:48.954611 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return project_ref.to_dict() May 02 09:58:48.955582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 02 09:58:48.955582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application next(self.gen) May 02 09:58:48.955582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 02 09:58:48.955582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application yield resource May 02 09:58:48.955582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 02 09:58:48.955582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application next(self.gen) May 02 09:58:48.955582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 02 09:58:48.955582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self.session.rollback() May 02 09:58:48.955582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 02 09:58:48.955582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self.force_reraise() May 02 09:58:48.955582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 02 09:58:48.955582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise self.value May 02 09:58:48.955582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 02 09:58:48.955582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 02 09:58:48.955582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 02 09:58:48.955582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application session.commit() May 02 09:58:48.955582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 02 09:58:48.956503 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 02 09:58:48.956503 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 02 09:58:48.956503 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._prepare_impl() May 02 09:58:48.956503 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 02 09:58:48.956503 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self.session.flush() May 02 09:58:48.956503 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 02 09:58:48.956503 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._flush(objects) May 02 09:58:48.956503 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 02 09:58:48.956503 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 02 09:58:48.956503 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 02 09:58:48.956503 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application compat.raise_( May 02 09:58:48.956503 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 02 09:58:48.956503 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception May 02 09:58:48.956503 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 02 09:58:48.956503 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application flush_context.execute() May 02 09:58:48.956503 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 02 09:58:48.956503 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rec.execute(self) May 02 09:58:48.957434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 02 09:58:48.957434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 02 09:58:48.957434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 02 09:58:48.957434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application _emit_insert_statements( May 02 09:58:48.957434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 02 09:58:48.957434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application c = connection._execute_20( May 02 09:58:48.957434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 02 09:58:48.957434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 02 09:58:48.957434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 02 09:58:48.957434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 02 09:58:48.957434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 02 09:58:48.957434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ret = self._execute_context( May 02 09:58:48.957434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 02 09:58:48.957434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 02 09:58:48.957434 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 02 09:58:48.960398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 02 09:58:48.960398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 02 09:58:48.960398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception May 02 09:58:48.960398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 02 09:58:48.960398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self.dialect.do_execute( May 02 09:58:48.960398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 02 09:58:48.960398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 02 09:58:48.960398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 02 09:58:48.960398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application result = self._query(query) May 02 09:58:48.960398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 02 09:58:48.960398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application conn.query(q) May 02 09:58:48.960398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 02 09:58:48.960398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 02 09:58:48.960398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 02 09:58:48.960398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application result.read() May 02 09:58:48.960398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 02 09:58:48.960398 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 02 09:58:48.962741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 02 09:58:48.962741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application packet.raise_for_error() May 02 09:58:48.962741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 02 09:58:48.962741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 02 09:58:48.962741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 02 09:58:48.962741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 02 09:58:48.962741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 02 09:58:48.962741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 02 09:58:48.962741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [parameters: {'id': '380ec505fedb40a7a2fef2b28c1f1709', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 02 09:58:48.962741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 02 09:58:48.962741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:48.962741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:58:48.962741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:48.962741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:48.962741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 02 09:58:48.970060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 02 09:58:48.970060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 02 09:58:48.970060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 02 09:58:48.970060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 02 09:58:48.970060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:48.970060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:58:48.970060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:48.970060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:48.970060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:48.970060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:48.970060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:48.970060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:48.970060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:48.970060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:48.970060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:48.970060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:48.970060 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:48.975684 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:48.975684 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 02 09:58:48.975684 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 02 09:58:48.975684 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:48.975684 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:48.975684 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 02 09:58:48.975684 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.Conflict( May 02 09:58:48.975684 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 380ec505fedb40a7a2fef2b28c1f1709. May 02 09:58:48.975684 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:48.975684 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 467/938] 10.222.0.16 () {60 vars in 1140 bytes} [Mon May 2 09:58:48 2022] POST /identity/v3/projects => generated 262 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:48.975684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcef0c-9a31-4b86-876e-b11972675fd0 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:49.056175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ed9d7-1008-4db3-b3fe-43a1fe6cc966 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:49.070013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcef0c-9a31-4b86-876e-b11972675fd0 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:49.094575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8547d81-edfc-4361-918e-fdfdd6c37421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:49.095683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8547d81-edfc-4361-918e-fdfdd6c37421 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:49.096175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8547d81-edfc-4361-918e-fdfdd6c37421 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:49.096654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8547d81-edfc-4361-918e-fdfdd6c37421 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:49.108276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a18f7-9ccc-4662-bb49-e71c70b7a266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:49.109088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a18f7-9ccc-4662-bb49-e71c70b7a266 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:49.109424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a18f7-9ccc-4662-bb49-e71c70b7a266 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:49.109705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a18f7-9ccc-4662-bb49-e71c70b7a266 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:49.111378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8547d81-edfc-4361-918e-fdfdd6c37421 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:49.113271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8547d81-edfc-4361-918e-fdfdd6c37421 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:49.117582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a18f7-9ccc-4662-bb49-e71c70b7a266 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:49.119221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a18f7-9ccc-4662-bb49-e71c70b7a266 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:49.132651 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-b8547d81-edfc-4361-918e-fdfdd6c37421 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:49.132651 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:49.132651 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:49.132651 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:49.132651 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:49.132651 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:49.132651 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:49.132651 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:49.132651 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:49.132651 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:49.132651 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:49.132651 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:49.132651 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:49.132651 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:49.132651 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:49.133590 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:49.133590 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:49.133590 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:49.133590 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:49.133590 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:49.133590 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:49.133590 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:49.133590 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:49.133590 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:49.133590 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:49.133590 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:49.133590 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:49.133590 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:49.133590 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:49.133590 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:49.133590 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:49.133590 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:49.134503 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:49.134503 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:49.134503 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:49.134503 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:49.134723 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-3e1a18f7-9ccc-4662-bb49-e71c70b7a266 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:49.134723 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:49.134723 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:49.134723 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:49.134723 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:49.134723 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:49.134723 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:49.134723 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:49.134723 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:49.134723 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:49.134723 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:49.134723 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:49.134723 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:49.134723 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:49.134723 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:49.135508 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:49.135508 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:49.135508 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:49.135508 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:49.135508 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:49.135508 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:49.135508 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:49.135508 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:49.135508 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:49.135508 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:49.135508 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:49.135508 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:49.135508 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:49.135508 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:49.135508 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:49.135508 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:49.135508 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:49.136371 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:49.136371 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:49.136371 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:49.136371 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:49.136371 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:49.136371 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:49.136371 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:49.136371 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:49.143559 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 468/940] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:49.143559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a18f7-9ccc-4662-bb49-e71c70b7a266 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:49.143756 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 472/940] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:49.145448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8547d81-edfc-4361-918e-fdfdd6c37421 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:49.255121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a18f7-9ccc-4662-bb49-e71c70b7a266 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:49.255428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8547d81-edfc-4361-918e-fdfdd6c37421 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:49.289487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614c689-613a-415a-9e3b-c7d4edea8736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:49.290153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614c689-613a-415a-9e3b-c7d4edea8736 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:49.290435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614c689-613a-415a-9e3b-c7d4edea8736 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:49.290712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614c689-613a-415a-9e3b-c7d4edea8736 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:49.291532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614c689-613a-415a-9e3b-c7d4edea8736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:49.291729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614c689-613a-415a-9e3b-c7d4edea8736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:49.293139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614c689-613a-415a-9e3b-c7d4edea8736 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:49.298429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73d27e-2148-4163-99c5-721f49b6593c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:49.299346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73d27e-2148-4163-99c5-721f49b6593c None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:49.300329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73d27e-2148-4163-99c5-721f49b6593c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:49.300864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73d27e-2148-4163-99c5-721f49b6593c None admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:49.302395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73d27e-2148-4163-99c5-721f49b6593c None admin] RBAC: Adding query filter params (name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:49.303172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73d27e-2148-4163-99c5-721f49b6593c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:49.305384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73d27e-2148-4163-99c5-721f49b6593c None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:49.308993 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 473/941] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:49.311337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614c689-613a-415a-9e3b-c7d4edea8736 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:49.331303 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 469/942] 10.222.0.16 () {56 vars in 1112 bytes} [Mon May 2 09:58:49 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:49.421144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614c689-613a-415a-9e3b-c7d4edea8736 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:49.457853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dadc9c-3253-4b49-a71f-fd8c6dd1706d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:49.459142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dadc9c-3253-4b49-a71f-fd8c6dd1706d None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:49.460181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dadc9c-3253-4b49-a71f-fd8c6dd1706d None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:49.460670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dadc9c-3253-4b49-a71f-fd8c6dd1706d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:49.469126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dadc9c-3253-4b49-a71f-fd8c6dd1706d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:49.470932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dadc9c-3253-4b49-a71f-fd8c6dd1706d None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:49.488088 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-38dadc9c-3253-4b49-a71f-fd8c6dd1706d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 02 09:58:49.488088 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:49.488088 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:49.488088 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:49.488088 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:49.488088 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:49.488088 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:49.488088 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:49.488088 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:49.488088 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:49.488088 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:49.488088 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:49.488088 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:49.488088 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:49.488088 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:49.488088 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:49.489405 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:49.489405 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:49.489405 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:49.489405 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:49.489405 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:49.489405 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:49.489405 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:49.489405 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:49.489405 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:49.489405 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:49.489405 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:49.489405 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:49.489405 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:49.489405 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:49.489405 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:49.489405 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:49.489405 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:49.489405 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:49.490359 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:49.490359 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:49.490359 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:49.490359 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:49.490359 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:49.490359 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:49.490359 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:49.490359 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:49.490359 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 02 09:58:49.490359 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:49.492796 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 474/943] 10.222.0.16 () {56 vars in 1117 bytes} [Mon May 2 09:58:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:49.501795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73d27e-2148-4163-99c5-721f49b6593c None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:49.610235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73d27e-2148-4163-99c5-721f49b6593c None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:49.645127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff551e8-ca4d-4533-8285-772657ff05db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:49.646051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff551e8-ca4d-4533-8285-772657ff05db None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:49.646484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff551e8-ca4d-4533-8285-772657ff05db None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:49.646934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff551e8-ca4d-4533-8285-772657ff05db None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:49.648456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff551e8-ca4d-4533-8285-772657ff05db None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:49.648946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff551e8-ca4d-4533-8285-772657ff05db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:49.650528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff551e8-ca4d-4533-8285-772657ff05db None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:49.670566 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 470/944] 10.222.0.16 () {56 vars in 1149 bytes} [Mon May 2 09:58:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:49.675802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dadc9c-3253-4b49-a71f-fd8c6dd1706d None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:49.781913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dadc9c-3253-4b49-a71f-fd8c6dd1706d None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:49.817593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ab443-a882-46c6-89b0-de9862255371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:49.818647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ab443-a882-46c6-89b0-de9862255371 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:49.819643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ab443-a882-46c6-89b0-de9862255371 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:49.820068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ab443-a882-46c6-89b0-de9862255371 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:49.830552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ab443-a882-46c6-89b0-de9862255371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:49.832207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ab443-a882-46c6-89b0-de9862255371 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:49.850564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-2d2ab443-a882-46c6-89b0-de9862255371 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:49.850564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:49.850564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:49.850564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:49.850564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:49.850564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:49.850564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:49.850564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:49.850564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:49.850564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:49.850564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:49.850564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:49.850564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:49.850564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:49.850564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:49.851678 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:49.851678 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:49.851678 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:49.851678 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:49.851678 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:49.851678 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:49.851678 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:49.851678 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:49.851678 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:49.851678 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:49.851678 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:49.851678 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:49.851678 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:49.851678 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:49.851678 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:49.851678 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:49.851678 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:49.852782 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:49.852782 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:49.852782 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:49.852782 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:49.854646 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 475/945] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:49.860536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff551e8-ca4d-4533-8285-772657ff05db None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:49.941816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36be144-75f2-4dcb-9f7a-b33692e65e39 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:49.942143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36be144-75f2-4dcb-9f7a-b33692e65e39 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:49.942422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36be144-75f2-4dcb-9f7a-b33692e65e39 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:49.948048 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 476/946] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:49.949701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acd574-0e6f-431e-91ce-bcb2e93ff3b9 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:49.949990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acd574-0e6f-431e-91ce-bcb2e93ff3b9 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:49.950274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acd574-0e6f-431e-91ce-bcb2e93ff3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:49.963156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff551e8-ca4d-4533-8285-772657ff05db None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:49.969519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-89acd574-0e6f-431e-91ce-bcb2e93ff3b9 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:49.970723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-89acd574-0e6f-431e-91ce-bcb2e93ff3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:50.005631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d68ff-0633-4bc5-b12b-810951307ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:50.007569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d68ff-0633-4bc5-b12b-810951307ff2 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:50.007861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d68ff-0633-4bc5-b12b-810951307ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:50.008142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d68ff-0633-4bc5-b12b-810951307ff2 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:50.008917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d68ff-0633-4bc5-b12b-810951307ff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:50.009230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d68ff-0633-4bc5-b12b-810951307ff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:50.010601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d68ff-0633-4bc5-b12b-810951307ff2 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:50.028633 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 471/947] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:50.031320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d68ff-0633-4bc5-b12b-810951307ff2 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:50.052628 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 477/948] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:58:50.076822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acd574-0e6f-431e-91ce-bcb2e93ff3b9 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:50.163423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d68ff-0633-4bc5-b12b-810951307ff2 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:50.186631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acd574-0e6f-431e-91ce-bcb2e93ff3b9 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:50.198852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c722054-5279-4756-8cdd-8a953d8838d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:50.199683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c722054-5279-4756-8cdd-8a953d8838d1 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:50.200117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c722054-5279-4756-8cdd-8a953d8838d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:50.200419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c722054-5279-4756-8cdd-8a953d8838d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:50.209293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c722054-5279-4756-8cdd-8a953d8838d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:50.211101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c722054-5279-4756-8cdd-8a953d8838d1 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:50.223228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac3350-b2b3-4715-824d-9cce2d8420ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:50.224368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac3350-b2b3-4715-824d-9cce2d8420ce None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:50.236178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac3350-b2b3-4715-824d-9cce2d8420ce None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:50.236178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac3350-b2b3-4715-824d-9cce2d8420ce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:50.236178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac3350-b2b3-4715-824d-9cce2d8420ce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:50.236178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac3350-b2b3-4715-824d-9cce2d8420ce None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:50.236481 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-0c722054-5279-4756-8cdd-8a953d8838d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:50.236481 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:50.236481 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:50.236481 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:50.236481 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:50.236481 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:50.236481 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:50.236481 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:50.236481 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:50.236481 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:50.236481 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:50.236481 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:50.236481 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:50.236481 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:50.236481 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:50.237562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:50.237562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:50.237562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:50.237562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:50.237562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:50.237562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:50.237562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:50.237562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:50.237562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:50.237562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:50.237562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:50.237562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:50.237562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:50.237562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:50.237562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:50.237562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:50.237562 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:50.238707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:50.238707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:50.238707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:50.238707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:50.238707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:50.238707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:50.238707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:50.238707 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:50.238707 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 472/949] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:50.238707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c722054-5279-4756-8cdd-8a953d8838d1 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:50.248785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-b0ac3350-b2b3-4715-824d-9cce2d8420ce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 02 09:58:50.248785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:50.248785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 09:58:50.248785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 09:58:50.248785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 09:58:50.248785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 09:58:50.248785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 09:58:50.248785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:50.248785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 02 09:58:50.248785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:50.248785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:58:50.248785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:50.248785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:50.248785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:50.248785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:50.248785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:50.248785 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:50.249740 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:50.249740 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:50.249740 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:50.249740 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:50.249740 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:50.249740 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:50.249740 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 09:58:50.249740 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 09:58:50.249740 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 09:58:50.249740 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 09:58:50.249740 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:50.249740 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:50.249740 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:50.249740 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:50.249740 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:50.249740 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:50.250564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:50.250564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:50.250564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:50.250564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:50.250564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:50.250564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:50.250564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:50.250564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:50.250564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:50.250564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:50.250564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 09:58:50.250564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:50.250564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 02 09:58:50.250564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:50.253383 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 478/950] 10.222.0.16 () {56 vars in 1126 bytes} [Mon May 2 09:58:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:50.260352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac3350-b2b3-4715-824d-9cce2d8420ce None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:50.351947 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c722054-5279-4756-8cdd-8a953d8838d1 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:50.382641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac3350-b2b3-4715-824d-9cce2d8420ce None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:50.391349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce1c12-716f-4358-bcae-23dd893c9b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:50.392018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce1c12-716f-4358-bcae-23dd893c9b08 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:50.392564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce1c12-716f-4358-bcae-23dd893c9b08 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:50.392564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce1c12-716f-4358-bcae-23dd893c9b08 None admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:50.393416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce1c12-716f-4358-bcae-23dd893c9b08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:50.393732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce1c12-716f-4358-bcae-23dd893c9b08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:50.395180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce1c12-716f-4358-bcae-23dd893c9b08 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:50.411727 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 473/951] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:50.413142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce1c12-716f-4358-bcae-23dd893c9b08 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:50.423150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188ca4a-64ba-492a-b36a-09ba206ff588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:50.424084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188ca4a-64ba-492a-b36a-09ba206ff588 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:50.424501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188ca4a-64ba-492a-b36a-09ba206ff588 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:50.424957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188ca4a-64ba-492a-b36a-09ba206ff588 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:50.425799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188ca4a-64ba-492a-b36a-09ba206ff588 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:50.426240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188ca4a-64ba-492a-b36a-09ba206ff588 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:50.427959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188ca4a-64ba-492a-b36a-09ba206ff588 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:50.433967 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 479/952] 10.222.0.16 () {56 vars in 1122 bytes} [Mon May 2 09:58:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:50.440214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188ca4a-64ba-492a-b36a-09ba206ff588 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:50.532008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce1c12-716f-4358-bcae-23dd893c9b08 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:50.543520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188ca4a-64ba-492a-b36a-09ba206ff588 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:50.565236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24987d22-40e3-4cd2-8acc-50973ae1bd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:50.572762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24987d22-40e3-4cd2-8acc-50973ae1bd5c None admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:50.572762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24987d22-40e3-4cd2-8acc-50973ae1bd5c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:50.572762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24987d22-40e3-4cd2-8acc-50973ae1bd5c None admin] PATH_INFO: `/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/c1c06bcf38a942ffbcdc4ee6d2edebb0/roles/0ef68f89f9394078b95445392557cd47` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:50.572762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24987d22-40e3-4cd2-8acc-50973ae1bd5c None admin] RBAC: Authorizing `identity:create_grant(project_id=972cae0aa9694d6cad22fbdbcf916ff7, user_id=c1c06bcf38a942ffbcdc4ee6d2edebb0, role_id=0ef68f89f9394078b95445392557cd47)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:50.572762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24987d22-40e3-4cd2-8acc-50973ae1bd5c None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:50.578751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9317c15-5487-4aff-9eeb-9f88867f6b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:50.579495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9317c15-5487-4aff-9eeb-9f88867f6b7b None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:50.579882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9317c15-5487-4aff-9eeb-9f88867f6b7b None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:50.580281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9317c15-5487-4aff-9eeb-9f88867f6b7b None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:50.581085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9317c15-5487-4aff-9eeb-9f88867f6b7b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:50.581458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9317c15-5487-4aff-9eeb-9f88867f6b7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:50.582882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9317c15-5487-4aff-9eeb-9f88867f6b7b None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:50.587655 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 480/953] 10.222.0.16 () {56 vars in 1122 bytes} [Mon May 2 09:58:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:50.588924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d218e-ad6c-4ae6-bbfd-3744e950c0a4 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:50.591505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d218e-ad6c-4ae6-bbfd-3744e950c0a4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:50.591505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d218e-ad6c-4ae6-bbfd-3744e950c0a4 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:50.591505 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 481/954] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:50.593567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d218e-ad6c-4ae6-bbfd-3744e950c0a4 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:50.684968 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 474/955] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 09:58:50 2022] PUT /identity/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/c1c06bcf38a942ffbcdc4ee6d2edebb0/roles/0ef68f89f9394078b95445392557cd47 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:58:50.686521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203298c0-b383-4715-8bf7-862dc534bfc2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:50.686812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203298c0-b383-4715-8bf7-862dc534bfc2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:50.687087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203298c0-b383-4715-8bf7-862dc534bfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:50.692863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d218e-ad6c-4ae6-bbfd-3744e950c0a4 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:50.727568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa586d-a81f-427a-8d04-0ebba4ef6dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:50.728256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa586d-a81f-427a-8d04-0ebba4ef6dfc None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:50.728543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa586d-a81f-427a-8d04-0ebba4ef6dfc None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:50.728848 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa586d-a81f-427a-8d04-0ebba4ef6dfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:50.729607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa586d-a81f-427a-8d04-0ebba4ef6dfc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:50.731060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa586d-a81f-427a-8d04-0ebba4ef6dfc None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:50.733766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-203298c0-b383-4715-8bf7-862dc534bfc2 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:50.735365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-203298c0-b383-4715-8bf7-862dc534bfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:50.813495 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 482/956] 10.222.0.16 () {60 vars in 1144 bytes} [Mon May 2 09:58:50 2022] POST /identity/v3/endpoints => generated 349 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 09:58:50.826826 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 475/957] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:58:50.845946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa586d-a81f-427a-8d04-0ebba4ef6dfc None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:50.957620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa586d-a81f-427a-8d04-0ebba4ef6dfc None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:50.994645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9d9e7-4101-4b44-8e5c-88b3882c36c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:50.995840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9d9e7-4101-4b44-8e5c-88b3882c36c6 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:50.996303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9d9e7-4101-4b44-8e5c-88b3882c36c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:50.996782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9d9e7-4101-4b44-8e5c-88b3882c36c6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:50.997645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9d9e7-4101-4b44-8e5c-88b3882c36c6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:50.999282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9d9e7-4101-4b44-8e5c-88b3882c36c6 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:51.011764 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-4fa9d9e7-4101-4b44-8e5c-88b3882c36c6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 02 09:58:51.011764 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:51.011764 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 09:58:51.011764 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 09:58:51.011764 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 09:58:51.011764 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 09:58:51.011764 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 09:58:51.011764 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:51.011764 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 02 09:58:51.011764 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:51.011764 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:58:51.011764 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:51.011764 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:51.011764 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:51.011764 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:51.011764 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:51.011764 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:51.012804 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:51.012804 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:51.012804 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:51.012804 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:51.012804 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:51.012804 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:51.012804 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 09:58:51.012804 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 09:58:51.012804 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 09:58:51.012804 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 09:58:51.012804 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:51.012804 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:51.012804 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:51.012804 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:51.012804 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:51.012804 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:51.013656 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:51.013656 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:51.013656 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:51.013656 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:51.013656 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:51.013656 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:51.013656 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:51.013656 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:51.013656 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:51.013656 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:51.013656 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 09:58:51.013656 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:51.013656 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 02 09:58:51.013656 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:51.014404 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 483/958] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:51.022479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203298c0-b383-4715-8bf7-862dc534bfc2 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:51.127227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203298c0-b383-4715-8bf7-862dc534bfc2 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:51.162246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03683a53-b085-4681-8dfe-622011e013ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:51.163542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03683a53-b085-4681-8dfe-622011e013ee None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:51.163819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03683a53-b085-4681-8dfe-622011e013ee None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:51.164093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03683a53-b085-4681-8dfe-622011e013ee None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:51.164834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03683a53-b085-4681-8dfe-622011e013ee None admin] RBAC: Adding query filter params (name=compute) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:51.165136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03683a53-b085-4681-8dfe-622011e013ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:51.166504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03683a53-b085-4681-8dfe-622011e013ee None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:51.171710 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 476/959] 10.222.0.16 () {56 vars in 1112 bytes} [Mon May 2 09:58:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:51.177298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9d9e7-4101-4b44-8e5c-88b3882c36c6 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:51.276391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9d9e7-4101-4b44-8e5c-88b3882c36c6 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:51.309456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6926b5-7536-4bd9-b6ca-becfa7deea48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:51.310503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6926b5-7536-4bd9-b6ca-becfa7deea48 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:51.310996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6926b5-7536-4bd9-b6ca-becfa7deea48 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:51.311484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6926b5-7536-4bd9-b6ca-becfa7deea48 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:51.312374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6926b5-7536-4bd9-b6ca-becfa7deea48 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:51.312914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6926b5-7536-4bd9-b6ca-becfa7deea48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:51.314523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6926b5-7536-4bd9-b6ca-becfa7deea48 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:51.319918 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 484/960] 10.222.0.16 () {56 vars in 1112 bytes} [Mon May 2 09:58:51 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:51.815887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70610d42-6a25-4aec-9398-fe2e54d10744 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:51.816225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70610d42-6a25-4aec-9398-fe2e54d10744 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:51.816451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70610d42-6a25-4aec-9398-fe2e54d10744 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:51.818120 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 477/961] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:51.824087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999b768-02ed-4869-be11-0113f5434123 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:51.824545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999b768-02ed-4869-be11-0113f5434123 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:51.824667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999b768-02ed-4869-be11-0113f5434123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:51.841226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c999b768-02ed-4869-be11-0113f5434123 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:51.842408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c999b768-02ed-4869-be11-0113f5434123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:51.907227 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 485/962] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 09:58:51.935106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70610d42-6a25-4aec-9398-fe2e54d10744 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:52.038940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70610d42-6a25-4aec-9398-fe2e54d10744 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:52.074790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c534f-b67b-4de6-8932-363e4307734c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:52.075384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c534f-b67b-4de6-8932-363e4307734c None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:52.075666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c534f-b67b-4de6-8932-363e4307734c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:52.075942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c534f-b67b-4de6-8932-363e4307734c None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:52.076676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c534f-b67b-4de6-8932-363e4307734c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:52.078099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c534f-b67b-4de6-8932-363e4307734c None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:52.124504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.sql.core [None req-3f8c534f-b67b-4de6-8932-363e4307734c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 02 09:58:52.124504 ncdv-master-1 devstack@keystone.service[91118]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 02 09:58:52.124504 ncdv-master-1 devstack@keystone.service[91118]: [parameters: {'user_id': 'aaffeee5b6b84aedbe6e5db115e9fd31', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 02 09:58:52.124504 ncdv-master-1 devstack@keystone.service[91118]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91118) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 02 09:58:52.132179 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-3f8c534f-b67b-4de6-8932-363e4307734c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 02 09:58:52.132179 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:52.132179 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 02 09:58:52.132179 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self.dialect.do_execute( May 02 09:58:52.132179 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 02 09:58:52.132179 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 02 09:58:52.132179 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 02 09:58:52.132179 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application result = self._query(query) May 02 09:58:52.132179 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 02 09:58:52.132179 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application conn.query(q) May 02 09:58:52.132179 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 02 09:58:52.132179 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 02 09:58:52.132179 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 02 09:58:52.132179 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application result.read() May 02 09:58:52.132179 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 02 09:58:52.133108 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 02 09:58:52.133108 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 02 09:58:52.133108 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application packet.raise_for_error() May 02 09:58:52.133108 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 02 09:58:52.133108 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 02 09:58:52.133108 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 02 09:58:52.133108 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 02 09:58:52.133108 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 02 09:58:52.133108 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:52.133108 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 02 09:58:52.133108 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:52.133108 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:52.133108 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 02 09:58:52.133108 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 02 09:58:52.133108 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 02 09:58:52.133108 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 02 09:58:52.133108 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 02 09:58:52.133108 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application next(self.gen) May 02 09:58:52.134654 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 02 09:58:52.134654 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application yield resource May 02 09:58:52.134654 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 02 09:58:52.134654 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application next(self.gen) May 02 09:58:52.134654 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 02 09:58:52.134654 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self.session.rollback() May 02 09:58:52.134654 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 02 09:58:52.134654 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self.force_reraise() May 02 09:58:52.134654 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 02 09:58:52.134654 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise self.value May 02 09:58:52.134654 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 02 09:58:52.134654 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 02 09:58:52.134654 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 02 09:58:52.134654 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application session.commit() May 02 09:58:52.134654 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 02 09:58:52.134654 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 02 09:58:52.134654 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 02 09:58:52.135564 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._prepare_impl() May 02 09:58:52.135564 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 02 09:58:52.135564 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self.session.flush() May 02 09:58:52.135564 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 02 09:58:52.135564 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._flush(objects) May 02 09:58:52.135564 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 02 09:58:52.135564 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 02 09:58:52.135564 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 02 09:58:52.135564 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application compat.raise_( May 02 09:58:52.135564 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 02 09:58:52.135564 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception May 02 09:58:52.135564 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 02 09:58:52.135564 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application flush_context.execute() May 02 09:58:52.135564 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 02 09:58:52.135564 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rec.execute(self) May 02 09:58:52.135564 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 02 09:58:52.135564 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 02 09:58:52.136433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 02 09:58:52.136433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application _emit_insert_statements( May 02 09:58:52.136433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 02 09:58:52.136433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application result = connection._execute_20( May 02 09:58:52.136433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 02 09:58:52.136433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 02 09:58:52.136433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 02 09:58:52.136433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 02 09:58:52.136433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 02 09:58:52.136433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ret = self._execute_context( May 02 09:58:52.136433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 02 09:58:52.136433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 02 09:58:52.136433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 02 09:58:52.136433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 02 09:58:52.136433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 02 09:58:52.136433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception May 02 09:58:52.138741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 02 09:58:52.138741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self.dialect.do_execute( May 02 09:58:52.138741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 02 09:58:52.138741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 02 09:58:52.138741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 02 09:58:52.138741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application result = self._query(query) May 02 09:58:52.138741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 02 09:58:52.138741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application conn.query(q) May 02 09:58:52.138741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 02 09:58:52.138741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 02 09:58:52.138741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 02 09:58:52.138741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application result.read() May 02 09:58:52.138741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 02 09:58:52.138741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 02 09:58:52.138741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 02 09:58:52.138741 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application packet.raise_for_error() May 02 09:58:52.140792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 02 09:58:52.140792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 02 09:58:52.140792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 02 09:58:52.140792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 02 09:58:52.140792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 02 09:58:52.140792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 02 09:58:52.140792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [parameters: {'user_id': 'aaffeee5b6b84aedbe6e5db115e9fd31', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 02 09:58:52.140792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 02 09:58:52.140792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:52.140792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:58:52.140792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:52.140792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:52.140792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:52.140792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:52.140792 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:52.142636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:52.142636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:52.142636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:52.142636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:52.142636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:52.142636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:52.142636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:52.142636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 02 09:58:52.142636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 02 09:58:52.142636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:52.142636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:52.142636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:52.142636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:52.142636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:52.142636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:52.142636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 02 09:58:52.142636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 02 09:58:52.145048 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 02 09:58:52.145048 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 02 09:58:52.145048 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 02 09:58:52.145048 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 02 09:58:52.145048 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 02 09:58:52.145048 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:52.145048 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 478/963] 10.222.0.16 () {60 vars in 1131 bytes} [Mon May 2 09:58:51 2022] POST /identity/v3/users => generated 160 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:52.146097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999b768-02ed-4869-be11-0113f5434123 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:52.246839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999b768-02ed-4869-be11-0113f5434123 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:52.281043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34580c4d-a1a7-4a0f-88ab-09156a549af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:52.282213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34580c4d-a1a7-4a0f-88ab-09156a549af2 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:52.282705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34580c4d-a1a7-4a0f-88ab-09156a549af2 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:52.283235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34580c4d-a1a7-4a0f-88ab-09156a549af2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:52.291526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34580c4d-a1a7-4a0f-88ab-09156a549af2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:52.293229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34580c4d-a1a7-4a0f-88ab-09156a549af2 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:52.308407 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-34580c4d-a1a7-4a0f-88ab-09156a549af2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 02 09:58:52.308407 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:52.308407 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:52.308407 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:52.308407 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:52.308407 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:52.308407 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:52.308407 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:52.308407 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:52.308407 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:52.308407 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:52.308407 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:52.308407 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:52.308407 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:52.308407 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:52.308407 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:52.309482 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:52.309482 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:52.309482 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:52.309482 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:52.309482 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:52.309482 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:52.309482 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:52.309482 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:52.309482 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:52.309482 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:52.309482 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:52.309482 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:52.309482 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:52.309482 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:52.309482 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:52.309482 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:52.309482 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:52.309482 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:52.310564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:52.310564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:52.310564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:52.310564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:52.310564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:52.310564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:52.310564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:52.310564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:52.310564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 02 09:58:52.310564 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:52.313338 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 486/964] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:58:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:52.322121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c534f-b67b-4de6-8932-363e4307734c None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:52.424529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c534f-b67b-4de6-8932-363e4307734c None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:52.459165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f55921-88ed-43f5-88e6-a47f2082f9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:52.460795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f55921-88ed-43f5-88e6-a47f2082f9fd None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:52.461384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f55921-88ed-43f5-88e6-a47f2082f9fd None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:52.461885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f55921-88ed-43f5-88e6-a47f2082f9fd None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:52.462897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f55921-88ed-43f5-88e6-a47f2082f9fd None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:52.463414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f55921-88ed-43f5-88e6-a47f2082f9fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:52.465332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f55921-88ed-43f5-88e6-a47f2082f9fd None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:52.504709 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 479/965] 10.222.0.16 () {56 vars in 1101 bytes} [Mon May 2 09:58:52 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:53.189312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62f0ae-6fee-4e13-9807-5e6bd9dca1b7 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:53.189820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62f0ae-6fee-4e13-9807-5e6bd9dca1b7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:53.189931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62f0ae-6fee-4e13-9807-5e6bd9dca1b7 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:53.191221 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 487/966] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:53.197324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6fcf3-7bff-40aa-8059-06c7c62932a8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:53.197708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6fcf3-7bff-40aa-8059-06c7c62932a8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:53.197889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6fcf3-7bff-40aa-8059-06c7c62932a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:53.214431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6bc6fcf3-7bff-40aa-8059-06c7c62932a8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:53.215933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6bc6fcf3-7bff-40aa-8059-06c7c62932a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:53.222491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a30f7-876e-4cbf-bed4-24f0cf8aa704 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:53.222776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a30f7-876e-4cbf-bed4-24f0cf8aa704 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:53.223054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a30f7-876e-4cbf-bed4-24f0cf8aa704 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:53.224395 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 488/967] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:53.229413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83e58b-0681-444b-bd94-619fa4f12784 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:53.229783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83e58b-0681-444b-bd94-619fa4f12784 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:53.230150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83e58b-0681-444b-bd94-619fa4f12784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:53.247029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6d83e58b-0681-444b-bd94-619fa4f12784 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:53.248211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6d83e58b-0681-444b-bd94-619fa4f12784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:53.290285 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 480/968] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:58:53.314768 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 489/969] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 09:58:53.314955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6fcf3-7bff-40aa-8059-06c7c62932a8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:53.338505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83e58b-0681-444b-bd94-619fa4f12784 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:53.413635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6fcf3-7bff-40aa-8059-06c7c62932a8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:53.443209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83e58b-0681-444b-bd94-619fa4f12784 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:53.448420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191118cd-d567-4f1c-a1e4-7ce2a641be1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:53.449275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191118cd-d567-4f1c-a1e4-7ce2a641be1c None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:53.449563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191118cd-d567-4f1c-a1e4-7ce2a641be1c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:53.449842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191118cd-d567-4f1c-a1e4-7ce2a641be1c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:53.459687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191118cd-d567-4f1c-a1e4-7ce2a641be1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:58:53.467749 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-191118cd-d567-4f1c-a1e4-7ce2a641be1c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 02 09:58:53.467749 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:53.467749 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:53.467749 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:53.467749 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:53.467749 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:53.467749 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:53.467749 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:53.467749 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:53.467749 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:53.467749 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:53.467749 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:53.467749 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:58:53.467749 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:58:53.467749 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:58:53.467749 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:58:53.468816 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:58:53.468816 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:58:53.468816 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:58:53.468816 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:58:53.468816 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:53.468816 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:53.468816 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:53.468816 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:53.468816 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:53.468816 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:53.468816 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:53.468816 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:53.468816 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:53.468816 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:53.468816 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:53.468816 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:53.469852 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:53.469852 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:53.469852 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:53.469852 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:53.469852 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:58:53.469852 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:58:53.469852 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:58:53.469852 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:58:53.469852 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:58:53.469852 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:58:53.469852 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 02 09:58:53.469852 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:53.469852 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 481/970] 10.222.0.16 () {56 vars in 1120 bytes} [Mon May 2 09:58:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:53.474689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191118cd-d567-4f1c-a1e4-7ce2a641be1c None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:53.478646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538fa04-b784-4483-bd5c-7e6adc3ee84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:53.479450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538fa04-b784-4483-bd5c-7e6adc3ee84b None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:53.479732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538fa04-b784-4483-bd5c-7e6adc3ee84b None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:53.480007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538fa04-b784-4483-bd5c-7e6adc3ee84b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:53.480694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538fa04-b784-4483-bd5c-7e6adc3ee84b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:53.482134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538fa04-b784-4483-bd5c-7e6adc3ee84b None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:53.495720 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-8538fa04-b784-4483-bd5c-7e6adc3ee84b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 02 09:58:53.495720 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:53.495720 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 09:58:53.495720 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 09:58:53.495720 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 09:58:53.495720 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 09:58:53.495720 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 09:58:53.495720 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:53.495720 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 02 09:58:53.495720 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:53.495720 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:58:53.495720 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:53.495720 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:53.495720 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:53.495720 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:53.495720 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:53.495720 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:53.502646 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:53.502646 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:53.502646 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:53.502646 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:53.502646 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:53.502646 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:53.502646 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 09:58:53.502646 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 09:58:53.502646 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 09:58:53.502646 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 09:58:53.502646 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:53.502646 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:53.502646 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:53.502646 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:53.502646 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:53.502646 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:53.503737 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:53.503737 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:53.503737 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:53.503737 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:53.503737 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:53.503737 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:53.503737 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:53.503737 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:53.503737 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:53.503737 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:53.503737 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 09:58:53.503737 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:53.503737 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 02 09:58:53.503737 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:53.503737 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 490/971] 10.222.0.16 () {56 vars in 1126 bytes} [Mon May 2 09:58:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:53.505193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538fa04-b784-4483-bd5c-7e6adc3ee84b None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:53.581598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191118cd-d567-4f1c-a1e4-7ce2a641be1c None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:53.613187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538fa04-b784-4483-bd5c-7e6adc3ee84b None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:53.613913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd9a19-ac73-4223-81ed-bfdae40d06ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:53.614576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd9a19-ac73-4223-81ed-bfdae40d06ae None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:53.614859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd9a19-ac73-4223-81ed-bfdae40d06ae None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:53.615128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd9a19-ac73-4223-81ed-bfdae40d06ae None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:53.616771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd9a19-ac73-4223-81ed-bfdae40d06ae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:53.617014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd9a19-ac73-4223-81ed-bfdae40d06ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:53.618384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd9a19-ac73-4223-81ed-bfdae40d06ae None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:53.631327 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 482/972] 10.222.0.16 () {56 vars in 1115 bytes} [Mon May 2 09:58:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:53.632184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd9a19-ac73-4223-81ed-bfdae40d06ae None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:53.646801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02da09d-2298-48da-9bfb-3e6473209bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:53.647507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02da09d-2298-48da-9bfb-3e6473209bb3 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:53.647790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02da09d-2298-48da-9bfb-3e6473209bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:53.648068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02da09d-2298-48da-9bfb-3e6473209bb3 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:53.648803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02da09d-2298-48da-9bfb-3e6473209bb3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:53.649116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02da09d-2298-48da-9bfb-3e6473209bb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:53.650518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02da09d-2298-48da-9bfb-3e6473209bb3 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:53.655195 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 491/973] 10.222.0.16 () {56 vars in 1122 bytes} [Mon May 2 09:58:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:53.660942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02da09d-2298-48da-9bfb-3e6473209bb3 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:53.726382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd9a19-ac73-4223-81ed-bfdae40d06ae None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:53.756140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02da09d-2298-48da-9bfb-3e6473209bb3 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:53.757512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4d9d6-de85-403b-8a4c-4f0637a2913b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:53.758298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4d9d6-de85-403b-8a4c-4f0637a2913b None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:53.758576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4d9d6-de85-403b-8a4c-4f0637a2913b None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:53.758853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4d9d6-de85-403b-8a4c-4f0637a2913b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:53.768704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c4d9d6-de85-403b-8a4c-4f0637a2913b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:53.770134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c4d9d6-de85-403b-8a4c-4f0637a2913b None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:53.787221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5f995-b895-475a-9e28-3c78b199bc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:53.787428 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-88c4d9d6-de85-403b-8a4c-4f0637a2913b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:53.787428 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:53.787428 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:53.787428 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:53.787428 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:53.787428 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:53.787428 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:53.787428 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:53.787428 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:53.787428 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:53.787428 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:53.787428 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:53.787428 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:53.787428 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:53.787428 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:53.789020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:53.789020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:53.789020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:53.789020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:53.789020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:53.789020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:53.789020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:53.789020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:53.789020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:53.789020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:53.789020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:53.789020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:53.789020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:53.789020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:53.789020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:53.789020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:53.789020 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:53.789934 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:53.789934 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:53.789934 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:53.789934 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:53.790174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5f995-b895-475a-9e28-3c78b199bc65 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:53.790174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5f995-b895-475a-9e28-3c78b199bc65 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:53.790315 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 483/974] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:53.790385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5f995-b895-475a-9e28-3c78b199bc65 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:53.790385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5f995-b895-475a-9e28-3c78b199bc65 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:53.790385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5f995-b895-475a-9e28-3c78b199bc65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:53.790559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9f776-cbbd-4a68-92bb-243e2c4a6243 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:53.790559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9f776-cbbd-4a68-92bb-243e2c4a6243 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:53.790941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9f776-cbbd-4a68-92bb-243e2c4a6243 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:53.791446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5f995-b895-475a-9e28-3c78b199bc65 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:53.795795 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 484/975] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:53.795795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9f776-cbbd-4a68-92bb-243e2c4a6243 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:53.800976 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 492/976] 10.222.0.16 () {56 vars in 1122 bytes} [Mon May 2 09:58:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:53.800976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de38324-fae9-44cf-91aa-dce38a7b2153 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:53.800976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de38324-fae9-44cf-91aa-dce38a7b2153 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:53.800976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de38324-fae9-44cf-91aa-dce38a7b2153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:53.814549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8de38324-fae9-44cf-91aa-dce38a7b2153 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:53.815730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8de38324-fae9-44cf-91aa-dce38a7b2153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:53.877451 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 493/977] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:58:53.878250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de38324-fae9-44cf-91aa-dce38a7b2153 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:53.890046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9f776-cbbd-4a68-92bb-243e2c4a6243 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:53.924447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9f31c-05a4-438f-af14-438260cb700c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:53.925138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9f31c-05a4-438f-af14-438260cb700c None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:53.925420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9f31c-05a4-438f-af14-438260cb700c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:53.925694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9f31c-05a4-438f-af14-438260cb700c None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:53.926409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9f31c-05a4-438f-af14-438260cb700c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:53.926718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9f31c-05a4-438f-af14-438260cb700c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:53.928080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9f31c-05a4-438f-af14-438260cb700c None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:53.939515 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 485/978] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:53.940007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9f31c-05a4-438f-af14-438260cb700c None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:53.975750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de38324-fae9-44cf-91aa-dce38a7b2153 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:54.007257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf0aad-6f6f-456a-8694-9ca87b1aebc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:54.007853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf0aad-6f6f-456a-8694-9ca87b1aebc0 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:54.008143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf0aad-6f6f-456a-8694-9ca87b1aebc0 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:54.008422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf0aad-6f6f-456a-8694-9ca87b1aebc0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:54.009257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf0aad-6f6f-456a-8694-9ca87b1aebc0 None admin] RBAC: Adding query filter params (interface=admin, service_id=726fe7ba88414317b244627d469cd35b, region_id=RegionOne) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:54.009573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf0aad-6f6f-456a-8694-9ca87b1aebc0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:54.010948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf0aad-6f6f-456a-8694-9ca87b1aebc0 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:54.015806 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 494/979] 10.222.0.16 () {56 vars in 1249 bytes} [Mon May 2 09:58:53 2022] GET /identity/v3/endpoints?service_id=726fe7ba88414317b244627d469cd35b&interface=admin®ion_id=RegionOne => generated 193 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:54.016576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf0aad-6f6f-456a-8694-9ca87b1aebc0 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:54.034238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9f31c-05a4-438f-af14-438260cb700c None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:54.066722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab6539-16a9-4e95-aafa-373b5ab186fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:54.067378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab6539-16a9-4e95-aafa-373b5ab186fc None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:54.067663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab6539-16a9-4e95-aafa-373b5ab186fc None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:54.067943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab6539-16a9-4e95-aafa-373b5ab186fc None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:54.068689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab6539-16a9-4e95-aafa-373b5ab186fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:54.070043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab6539-16a9-4e95-aafa-373b5ab186fc None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:54.108293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf0aad-6f6f-456a-8694-9ca87b1aebc0 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:54.139486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7bc84-6a33-4b69-95bb-565d0df2ebff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:54.140277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7bc84-6a33-4b69-95bb-565d0df2ebff None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:54.140555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7bc84-6a33-4b69-95bb-565d0df2ebff None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:54.140853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7bc84-6a33-4b69-95bb-565d0df2ebff None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:54.148001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7bc84-6a33-4b69-95bb-565d0df2ebff None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:54.148939 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 486/980] 10.222.0.16 () {60 vars in 1141 bytes} [Mon May 2 09:58:53 2022] POST /identity/v3/services => generated 242 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:58:54.149463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7bc84-6a33-4b69-95bb-565d0df2ebff None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:54.149838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab6539-16a9-4e95-aafa-373b5ab186fc None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:54.176966 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-3aa7bc84-6a33-4b69-95bb-565d0df2ebff None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 02 09:58:54.176966 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:54.176966 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:54.176966 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:54.176966 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:54.176966 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:54.176966 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:54.176966 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:54.176966 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:54.176966 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:54.176966 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:54.176966 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:54.176966 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:58:54.176966 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:58:54.176966 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:58:54.176966 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:58:54.178129 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:54.178129 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:54.178129 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:58:54.178129 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:54.178129 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:58:54.178129 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:58:54.178129 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:54.178129 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:54.178129 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:54.178129 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:54.178129 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:54.178129 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:54.178129 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:54.178129 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:54.178129 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:54.178129 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:54.178129 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:54.178129 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:54.179091 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:54.179091 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:54.179091 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:58:54.179091 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:58:54.179091 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:58:54.179091 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:58:54.179091 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:58:54.179091 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:58:54.179091 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 02 09:58:54.179091 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:54.179091 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 495/981] 10.222.0.16 () {56 vars in 1117 bytes} [Mon May 2 09:58:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:54.184232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7bc84-6a33-4b69-95bb-565d0df2ebff None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:54.272853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab6539-16a9-4e95-aafa-373b5ab186fc None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:54.287138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7bc84-6a33-4b69-95bb-565d0df2ebff None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:54.315588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c581e4-216b-444f-8916-e13ed12e403f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:54.316274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c581e4-216b-444f-8916-e13ed12e403f None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:54.316560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c581e4-216b-444f-8916-e13ed12e403f None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:54.316878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c581e4-216b-444f-8916-e13ed12e403f None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:54.317618 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c581e4-216b-444f-8916-e13ed12e403f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:54.319802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c581e4-216b-444f-8916-e13ed12e403f None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:54.324439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f60d87-f02a-46fe-a426-516d67b00298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:54.325151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f60d87-f02a-46fe-a426-516d67b00298 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:54.325432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f60d87-f02a-46fe-a426-516d67b00298 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:54.325733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f60d87-f02a-46fe-a426-516d67b00298 None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:54.326418 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 487/982] 10.222.0.16 () {56 vars in 1087 bytes} [Mon May 2 09:58:54 2022] GET /identity/v3/services => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 09:58:54.326524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f60d87-f02a-46fe-a426-516d67b00298 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:54.326837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f60d87-f02a-46fe-a426-516d67b00298 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:54.328288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f60d87-f02a-46fe-a426-516d67b00298 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:54.348906 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 496/983] 10.222.0.16 () {56 vars in 1149 bytes} [Mon May 2 09:58:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:54.354761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c581e4-216b-444f-8916-e13ed12e403f None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:54.459025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c581e4-216b-444f-8916-e13ed12e403f None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:54.494442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1ae7e-99f8-4cfe-9d52-ec3401ec2c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:54.495157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1ae7e-99f8-4cfe-9d52-ec3401ec2c8a None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:54.495440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1ae7e-99f8-4cfe-9d52-ec3401ec2c8a None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:54.495938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1ae7e-99f8-4cfe-9d52-ec3401ec2c8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:54.565561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1ae7e-99f8-4cfe-9d52-ec3401ec2c8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:54.566926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1ae7e-99f8-4cfe-9d52-ec3401ec2c8a None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:54.664857 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 488/984] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:58:54 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 09:58:54.666092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f60d87-f02a-46fe-a426-516d67b00298 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:54.760791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f60d87-f02a-46fe-a426-516d67b00298 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:54.792072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58e8e3-af30-4781-87c8-2cb7e020ac54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:54.792892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58e8e3-af30-4781-87c8-2cb7e020ac54 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:54.793177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58e8e3-af30-4781-87c8-2cb7e020ac54 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:54.793454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58e8e3-af30-4781-87c8-2cb7e020ac54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:54.803661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58e8e3-af30-4781-87c8-2cb7e020ac54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:54.805134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58e8e3-af30-4781-87c8-2cb7e020ac54 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:54.822316 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-ee58e8e3-af30-4781-87c8-2cb7e020ac54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:54.822316 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:54.822316 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:54.822316 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:54.822316 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:54.822316 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:54.822316 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:54.822316 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:54.822316 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:54.822316 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:54.822316 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:54.822316 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:54.822316 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:58:54.822316 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:58:54.822316 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:58:54.823173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:58:54.823173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:54.823173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:54.823173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:54.823173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:54.823173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:54.823173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:54.823173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:54.823173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:54.823173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:54.823173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:54.823173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:54.823173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:54.823173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:54.823173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:54.823173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:54.823173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:54.824046 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:58:54.824046 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:58:54.824046 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:58:54.824046 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:54.824046 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 497/985] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:54.829807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1ae7e-99f8-4cfe-9d52-ec3401ec2c8a None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:54.920513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1ae7e-99f8-4cfe-9d52-ec3401ec2c8a None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:54.955736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952add4-a7e1-4a38-828a-62c37681cbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:54.956397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952add4-a7e1-4a38-828a-62c37681cbf7 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:54.956709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952add4-a7e1-4a38-828a-62c37681cbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:54.956989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952add4-a7e1-4a38-828a-62c37681cbf7 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:54.957712 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952add4-a7e1-4a38-828a-62c37681cbf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:54.958022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952add4-a7e1-4a38-828a-62c37681cbf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:54.959421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952add4-a7e1-4a38-828a-62c37681cbf7 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:54.974578 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 489/986] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:54.975831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58e8e3-af30-4781-87c8-2cb7e020ac54 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:55.072702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58e8e3-af30-4781-87c8-2cb7e020ac54 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:55.113776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ed58e-f6db-4447-b58a-04ccf4dbc33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:55.114573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ed58e-f6db-4447-b58a-04ccf4dbc33a None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:55.114858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ed58e-f6db-4447-b58a-04ccf4dbc33a None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:55.115135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ed58e-f6db-4447-b58a-04ccf4dbc33a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:55.122242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ed58e-f6db-4447-b58a-04ccf4dbc33a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:55.123692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ed58e-f6db-4447-b58a-04ccf4dbc33a None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:55.137247 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-573ed58e-f6db-4447-b58a-04ccf4dbc33a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:55.137247 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:55.137247 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:55.137247 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:55.137247 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:55.137247 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:55.137247 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:55.137247 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:55.137247 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:55.137247 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:55.137247 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:55.137247 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:55.137247 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:58:55.137247 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:58:55.137247 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:58:55.138120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:58:55.138120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:55.138120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:55.138120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:55.138120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:55.138120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:55.138120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:55.138120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:55.138120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:55.138120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:55.138120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:55.138120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:55.138120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:55.138120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:55.138120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:55.138120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:55.138120 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:55.139010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:58:55.139010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:58:55.139010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:58:55.139010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:58:55.139010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:58:55.139010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:58:55.139010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:58:55.139010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:55.139010 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 498/987] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:55.145139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952add4-a7e1-4a38-828a-62c37681cbf7 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:55.241295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952add4-a7e1-4a38-828a-62c37681cbf7 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:55.272453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782aa19-c96c-4f9d-8c94-3fad7e773416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:55.273135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782aa19-c96c-4f9d-8c94-3fad7e773416 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:55.273659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782aa19-c96c-4f9d-8c94-3fad7e773416 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:55.273659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782aa19-c96c-4f9d-8c94-3fad7e773416 None admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:55.274452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782aa19-c96c-4f9d-8c94-3fad7e773416 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:55.274759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782aa19-c96c-4f9d-8c94-3fad7e773416 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:55.276171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782aa19-c96c-4f9d-8c94-3fad7e773416 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:55.289038 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 490/988] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:58:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:55.294787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ed58e-f6db-4447-b58a-04ccf4dbc33a None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:55.391454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ed58e-f6db-4447-b58a-04ccf4dbc33a None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:55.424154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5efc9c-6a2d-4a0d-a3a4-0252a6dca13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:55.424835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5efc9c-6a2d-4a0d-a3a4-0252a6dca13b None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:55.425119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5efc9c-6a2d-4a0d-a3a4-0252a6dca13b None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:55.425393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5efc9c-6a2d-4a0d-a3a4-0252a6dca13b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:55.426209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5efc9c-6a2d-4a0d-a3a4-0252a6dca13b None admin] RBAC: Adding query filter params (role.id=0ef68f89f9394078b95445392557cd47, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=c1c06bcf38a942ffbcdc4ee6d2edebb0) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:55.426520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5efc9c-6a2d-4a0d-a3a4-0252a6dca13b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:55.428091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5efc9c-6a2d-4a0d-a3a4-0252a6dca13b None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:55.434705 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 499/989] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:58:55 2022] GET /identity/v3/role_assignments?user.id=c1c06bcf38a942ffbcdc4ee6d2edebb0&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=0ef68f89f9394078b95445392557cd47 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:56.531871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560790a-0d7d-4b13-b106-1c66ebc22715 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:56.532394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560790a-0d7d-4b13-b106-1c66ebc22715 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:56.532505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560790a-0d7d-4b13-b106-1c66ebc22715 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:56.534087 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 491/990] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:56.539646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8541256-4660-4f7d-8a0a-19da8bbd8638 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:56.540706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8541256-4660-4f7d-8a0a-19da8bbd8638 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:56.541045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8541256-4660-4f7d-8a0a-19da8bbd8638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:56.558856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f8541256-4660-4f7d-8a0a-19da8bbd8638 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:56.560052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f8541256-4660-4f7d-8a0a-19da8bbd8638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:56.629952 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 500/991] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:58:56.654667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfac06a-6ee8-4f34-bc50-d539d7d1680d None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:56.654952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfac06a-6ee8-4f34-bc50-d539d7d1680d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:56.655232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfac06a-6ee8-4f34-bc50-d539d7d1680d None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:56.656004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8541256-4660-4f7d-8a0a-19da8bbd8638 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:56.656777 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 492/992] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:56.661574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fd1e2-b9d4-4b2a-9197-bb33a86c31e9 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:56.661865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fd1e2-b9d4-4b2a-9197-bb33a86c31e9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:56.662148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fd1e2-b9d4-4b2a-9197-bb33a86c31e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:56.678501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0c8fd1e2-b9d4-4b2a-9197-bb33a86c31e9 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:56.679701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0c8fd1e2-b9d4-4b2a-9197-bb33a86c31e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:56.749712 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 493/993] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 09:58:56.760545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8541256-4660-4f7d-8a0a-19da8bbd8638 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:56.774304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fd1e2-b9d4-4b2a-9197-bb33a86c31e9 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:56.793333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b05275-d088-452a-b594-070bc6154a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:56.794059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b05275-d088-452a-b594-070bc6154a32 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:56.794342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b05275-d088-452a-b594-070bc6154a32 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:56.794620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b05275-d088-452a-b594-070bc6154a32 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:56.795267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b05275-d088-452a-b594-070bc6154a32 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:56.796645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b05275-d088-452a-b594-070bc6154a32 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:56.808057 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-18b05275-d088-452a-b594-070bc6154a32 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 02 09:58:56.808057 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:56.808057 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 09:58:56.808057 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 09:58:56.808057 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 09:58:56.808057 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 09:58:56.808057 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 09:58:56.808057 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:56.808057 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 02 09:58:56.808057 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:56.808057 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:58:56.808057 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:56.808057 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:56.808057 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:56.808057 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:56.808057 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:56.808057 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:56.809357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:56.809357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:56.809357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:56.809357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:56.809357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:56.809357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:56.809357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 09:58:56.809357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 09:58:56.809357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 09:58:56.809357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 09:58:56.809357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:56.809357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:56.809357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:56.809357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:56.809357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:56.809357 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:56.810224 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:56.810224 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:56.810224 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:56.810224 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:56.810224 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:56.810224 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:56.810224 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:56.810224 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:56.810224 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:56.810224 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:56.810224 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 09:58:56.810224 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:56.810224 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 02 09:58:56.810224 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:56.810224 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 501/994] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:58:56.815175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b05275-d088-452a-b594-070bc6154a32 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:56.872054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fd1e2-b9d4-4b2a-9197-bb33a86c31e9 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:56.906852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2a85f-9ec9-4e2b-a52e-890b56d32a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:56.907982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2a85f-9ec9-4e2b-a52e-890b56d32a21 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:56.908476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2a85f-9ec9-4e2b-a52e-890b56d32a21 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:56.908813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2a85f-9ec9-4e2b-a52e-890b56d32a21 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:56.909482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2a85f-9ec9-4e2b-a52e-890b56d32a21 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:56.910828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2a85f-9ec9-4e2b-a52e-890b56d32a21 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:56.913952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b05275-d088-452a-b594-070bc6154a32 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:56.922794 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-ada2a85f-9ec9-4e2b-a52e-890b56d32a21 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 02 09:58:56.922794 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:56.922794 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 09:58:56.922794 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 09:58:56.922794 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 09:58:56.922794 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 09:58:56.922794 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 09:58:56.922794 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:56.922794 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 02 09:58:56.922794 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:56.922794 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:58:56.922794 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:56.922794 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:56.922794 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:56.922794 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:56.922794 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:56.922794 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:56.923785 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:56.923785 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:56.923785 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:56.923785 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:56.923785 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:56.923785 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:56.923785 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 09:58:56.923785 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 09:58:56.923785 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 09:58:56.923785 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 09:58:56.923785 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:56.923785 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:56.923785 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:56.923785 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:56.923785 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:56.923785 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:56.924819 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:56.924819 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:58:56.924819 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:56.924819 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:56.924819 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:56.924819 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:56.924819 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:56.924819 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:56.924819 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:56.924819 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:56.924819 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 09:58:56.924819 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:56.924819 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 02 09:58:56.924819 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:58:56.924819 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 494/995] 10.222.0.16 () {56 vars in 1126 bytes} [Mon May 2 09:58:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:56.930293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2a85f-9ec9-4e2b-a52e-890b56d32a21 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:56.950883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea513d78-4c6e-4dad-b6cd-4e73369adbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:56.951551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea513d78-4c6e-4dad-b6cd-4e73369adbe4 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:56.951835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea513d78-4c6e-4dad-b6cd-4e73369adbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:56.952112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea513d78-4c6e-4dad-b6cd-4e73369adbe4 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:56.952859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea513d78-4c6e-4dad-b6cd-4e73369adbe4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:56.953168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea513d78-4c6e-4dad-b6cd-4e73369adbe4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:56.954534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea513d78-4c6e-4dad-b6cd-4e73369adbe4 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:56.959313 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 502/996] 10.222.0.16 () {56 vars in 1112 bytes} [Mon May 2 09:58:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:56.964743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea513d78-4c6e-4dad-b6cd-4e73369adbe4 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:57.029333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2a85f-9ec9-4e2b-a52e-890b56d32a21 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:57.067747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea513d78-4c6e-4dad-b6cd-4e73369adbe4 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:57.068094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b00016-aa9a-43c0-80a7-9e201169b3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:57.069344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b00016-aa9a-43c0-80a7-9e201169b3f6 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:57.069642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b00016-aa9a-43c0-80a7-9e201169b3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:57.069921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b00016-aa9a-43c0-80a7-9e201169b3f6 None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:57.070636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b00016-aa9a-43c0-80a7-9e201169b3f6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:57.070949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b00016-aa9a-43c0-80a7-9e201169b3f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:57.072320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b00016-aa9a-43c0-80a7-9e201169b3f6 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:57.077534 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 495/997] 10.222.0.16 () {56 vars in 1122 bytes} [Mon May 2 09:58:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:57.082844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b00016-aa9a-43c0-80a7-9e201169b3f6 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:57.102518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce4cec-271f-400b-abfb-2122ae604e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:57.103319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce4cec-271f-400b-abfb-2122ae604e3d None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:57.103700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce4cec-271f-400b-abfb-2122ae604e3d None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:57.104053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce4cec-271f-400b-abfb-2122ae604e3d None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:57.104807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce4cec-271f-400b-abfb-2122ae604e3d None admin] RBAC: Adding query filter params (type=compute) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:57.105119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce4cec-271f-400b-abfb-2122ae604e3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:57.106494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce4cec-271f-400b-abfb-2122ae604e3d None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:57.111495 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 503/998] 10.222.0.16 () {56 vars in 1112 bytes} [Mon May 2 09:58:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:57.117937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce4cec-271f-400b-abfb-2122ae604e3d None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:57.187825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b00016-aa9a-43c0-80a7-9e201169b3f6 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:57.216709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce4cec-271f-400b-abfb-2122ae604e3d None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:57.220379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a2d8d-561c-45d2-92a9-e56ddcbc4ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:57.221080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a2d8d-561c-45d2-92a9-e56ddcbc4ad7 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:57.221366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a2d8d-561c-45d2-92a9-e56ddcbc4ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:57.221645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a2d8d-561c-45d2-92a9-e56ddcbc4ad7 None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:57.222353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a2d8d-561c-45d2-92a9-e56ddcbc4ad7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:57.222664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a2d8d-561c-45d2-92a9-e56ddcbc4ad7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:57.224029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a2d8d-561c-45d2-92a9-e56ddcbc4ad7 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:57.228933 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 496/999] 10.222.0.16 () {56 vars in 1122 bytes} [Mon May 2 09:58:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:57.234255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a2d8d-561c-45d2-92a9-e56ddcbc4ad7 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:57.251070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186a50e-eb55-4d73-a8ce-169503e72423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:57.251727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186a50e-eb55-4d73-a8ce-169503e72423 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:57.252007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186a50e-eb55-4d73-a8ce-169503e72423 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:57.252276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186a50e-eb55-4d73-a8ce-169503e72423 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:57.253094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186a50e-eb55-4d73-a8ce-169503e72423 None admin] RBAC: Adding query filter params (interface=public, service_id=ca97b191320b40eab60f318475fbe181, region_id=RegionOne) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:57.253405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186a50e-eb55-4d73-a8ce-169503e72423 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:57.254762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186a50e-eb55-4d73-a8ce-169503e72423 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:57.260678 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 504/1000] 10.222.0.16 () {56 vars in 1251 bytes} [Mon May 2 09:58:57 2022] GET /identity/v3/endpoints?service_id=ca97b191320b40eab60f318475fbe181&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:57.265644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186a50e-eb55-4d73-a8ce-169503e72423 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:57.336479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a2d8d-561c-45d2-92a9-e56ddcbc4ad7 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:57.363440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186a50e-eb55-4d73-a8ce-169503e72423 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:57.369300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f9247-935e-443a-9b6f-a0b68509f616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:57.370024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f9247-935e-443a-9b6f-a0b68509f616 None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:57.370372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f9247-935e-443a-9b6f-a0b68509f616 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:57.370710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f9247-935e-443a-9b6f-a0b68509f616 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:57.371511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f9247-935e-443a-9b6f-a0b68509f616 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:57.372960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f9247-935e-443a-9b6f-a0b68509f616 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:57.397349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965602f-069b-49d0-b3e0-bc3290ce15e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:57.398059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965602f-069b-49d0-b3e0-bc3290ce15e9 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:57.398343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965602f-069b-49d0-b3e0-bc3290ce15e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:57.398625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965602f-069b-49d0-b3e0-bc3290ce15e9 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:57.399299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965602f-069b-49d0-b3e0-bc3290ce15e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:57.400715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965602f-069b-49d0-b3e0-bc3290ce15e9 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:57.406716 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 505/1001] 10.222.0.16 () {56 vars in 1087 bytes} [Mon May 2 09:58:57 2022] GET /identity/v3/services => generated 1727 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 09:58:57.458481 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 497/1002] 10.222.0.16 () {60 vars in 1144 bytes} [Mon May 2 09:58:57 2022] POST /identity/v3/endpoints => generated 325 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 09:58:57.789288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7182fa8-aaf7-4370-ad1f-f25f7e2f3eb0 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:57.789811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7182fa8-aaf7-4370-ad1f-f25f7e2f3eb0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:57.789928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7182fa8-aaf7-4370-ad1f-f25f7e2f3eb0 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:57.791382 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 506/1003] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:57.796315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c554d-d6fc-48c7-90c2-f9ccfe2d0aec None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:57.796735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c554d-d6fc-48c7-90c2-f9ccfe2d0aec None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:57.797007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c554d-d6fc-48c7-90c2-f9ccfe2d0aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:57.813518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c50c554d-d6fc-48c7-90c2-f9ccfe2d0aec None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:57.814708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c50c554d-d6fc-48c7-90c2-f9ccfe2d0aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:57.914027 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 498/1004] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:57 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:58:57.936571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7182fa8-aaf7-4370-ad1f-f25f7e2f3eb0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:58.031908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7182fa8-aaf7-4370-ad1f-f25f7e2f3eb0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:58.064242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6447982-c497-4f7b-870a-d15dd5f64514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:58.064995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6447982-c497-4f7b-870a-d15dd5f64514 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:58.065276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6447982-c497-4f7b-870a-d15dd5f64514 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:58.065575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6447982-c497-4f7b-870a-d15dd5f64514 None admin] PATH_INFO: `/v3/services/image` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:58.066184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6447982-c497-4f7b-870a-d15dd5f64514 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:58.067539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6447982-c497-4f7b-870a-d15dd5f64514 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:58.080065 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-a6447982-c497-4f7b-870a-d15dd5f64514 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 02 09:58:58.080065 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:58.080065 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 09:58:58.080065 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 09:58:58.080065 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 09:58:58.080065 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 09:58:58.080065 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 09:58:58.080065 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:58.080065 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 02 09:58:58.080065 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:58.080065 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:58:58.080065 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:58.080065 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:58:58.080065 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:58:58.080065 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:58:58.080065 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:58:58.080065 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:58:58.081322 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:58:58.081322 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:58:58.081322 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:58:58.081322 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:58:58.081322 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:58:58.081322 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:58:58.081322 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 09:58:58.081322 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 09:58:58.081322 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 09:58:58.081322 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 09:58:58.081322 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:58:58.081322 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:58:58.081322 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:58:58.081322 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:58:58.081322 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:58:58.081322 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:58:58.082692 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:58:58.082692 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:58:58.082692 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:58:58.082692 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:58:58.082692 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:58:58.082692 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:58:58.082692 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:58:58.082692 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:58:58.082692 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:58:58.082692 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:58:58.082692 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 09:58:58.082692 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:58:58.082692 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 02 09:58:58.082692 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:58:58.084933 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 507/1005] 10.222.0.16 () {56 vars in 1105 bytes} [Mon May 2 09:58:57 2022] GET /identity/v3/services/image => generated 86 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:58:58.088155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c554d-d6fc-48c7-90c2-f9ccfe2d0aec None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:58.181359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c554d-d6fc-48c7-90c2-f9ccfe2d0aec None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:58.213776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321140b8-de50-4e3d-b98a-d0fe24f515dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:58.214451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321140b8-de50-4e3d-b98a-d0fe24f515dc None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:58.214717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321140b8-de50-4e3d-b98a-d0fe24f515dc None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:58.214992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321140b8-de50-4e3d-b98a-d0fe24f515dc None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:58.215692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321140b8-de50-4e3d-b98a-d0fe24f515dc None admin] RBAC: Adding query filter params (name=image) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:58.215995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321140b8-de50-4e3d-b98a-d0fe24f515dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:58.217380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321140b8-de50-4e3d-b98a-d0fe24f515dc None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:58.222198 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 499/1006] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:58:58.227743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6447982-c497-4f7b-870a-d15dd5f64514 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:58.324416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6447982-c497-4f7b-870a-d15dd5f64514 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:58:58.357398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd6f2c-d8e4-4c68-8e01-1f24418c9d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:58:58.358076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd6f2c-d8e4-4c68-8e01-1f24418c9d66 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:58.358344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd6f2c-d8e4-4c68-8e01-1f24418c9d66 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:58.358655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd6f2c-d8e4-4c68-8e01-1f24418c9d66 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:58.359363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd6f2c-d8e4-4c68-8e01-1f24418c9d66 None admin] RBAC: Adding query filter params (type=image) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:58:58.359668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd6f2c-d8e4-4c68-8e01-1f24418c9d66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:58:58.361065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd6f2c-d8e4-4c68-8e01-1f24418c9d66 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:58:58.365922 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 508/1007] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:58 2022] GET /identity/v3/services?type=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:58:59.788799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06c0d7-63a2-4449-9045-1b696d50f3ff None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:59.789327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06c0d7-63a2-4449-9045-1b696d50f3ff None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:59.789406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06c0d7-63a2-4449-9045-1b696d50f3ff None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:59.790781 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 500/1008] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:58:59.796092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33991d-7f14-474b-a4b0-df34a648d21e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:59.796514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33991d-7f14-474b-a4b0-df34a648d21e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:59.796683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33991d-7f14-474b-a4b0-df34a648d21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:59.804539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d939e3-7c86-49c4-b7fe-a068e5da6c85 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:59.804861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d939e3-7c86-49c4-b7fe-a068e5da6c85 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:59.805143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d939e3-7c86-49c4-b7fe-a068e5da6c85 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:59.806637 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 501/1009] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:58:59.811253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda39f22-aa39-4ebb-87f6-5dec9d2bda66 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:58:59.811547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda39f22-aa39-4ebb-87f6-5dec9d2bda66 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:58:59.811827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda39f22-aa39-4ebb-87f6-5dec9d2bda66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:58:59.813510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-fd33991d-7f14-474b-a4b0-df34a648d21e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:59.814691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fd33991d-7f14-474b-a4b0-df34a648d21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:59.828451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-bda39f22-aa39-4ebb-87f6-5dec9d2bda66 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:58:59.829650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bda39f22-aa39-4ebb-87f6-5dec9d2bda66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:58:59.880900 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 509/1010] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:59 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:58:59.895207 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 502/1011] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:58:59 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 09:58:59.905699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33991d-7f14-474b-a4b0-df34a648d21e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:58:59.919715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda39f22-aa39-4ebb-87f6-5dec9d2bda66 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:00.005692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33991d-7f14-474b-a4b0-df34a648d21e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:00.015183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda39f22-aa39-4ebb-87f6-5dec9d2bda66 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:00.039001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333e0ac-3399-4fc9-b816-ef7bbed3242f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:00.039716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333e0ac-3399-4fc9-b816-ef7bbed3242f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:00.039995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333e0ac-3399-4fc9-b816-ef7bbed3242f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:00.040269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333e0ac-3399-4fc9-b816-ef7bbed3242f None admin] PATH_INFO: `/v3/services/compute` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:00.040947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333e0ac-3399-4fc9-b816-ef7bbed3242f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:00.042307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333e0ac-3399-4fc9-b816-ef7bbed3242f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:00.048643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b2fa8-d334-42fe-9271-b949a95c55f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:00.049437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b2fa8-d334-42fe-9271-b949a95c55f8 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:00.049724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b2fa8-d334-42fe-9271-b949a95c55f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:00.050003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b2fa8-d334-42fe-9271-b949a95c55f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:00.051180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b2fa8-d334-42fe-9271-b949a95c55f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:00.052591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b2fa8-d334-42fe-9271-b949a95c55f8 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:00.053674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-9333e0ac-3399-4fc9-b816-ef7bbed3242f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 02 09:59:00.053674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:00.053674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 09:59:00.053674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 09:59:00.053674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 09:59:00.053674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 09:59:00.053674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 09:59:00.053674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:59:00.053674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 02 09:59:00.053674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:59:00.053674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:59:00.053674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:59:00.053674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:00.053674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:00.053674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:00.053674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:00.053674 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:00.060152 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:00.060152 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:00.060152 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:00.060152 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:00.060152 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:00.060152 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:00.060152 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 09:59:00.060152 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 09:59:00.060152 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 09:59:00.060152 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 09:59:00.060152 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:00.060152 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:00.060152 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:00.060152 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:00.060152 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:00.060152 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:00.062366 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:00.062366 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:59:00.062366 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:00.062366 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:00.062366 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:00.062366 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:00.062366 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:00.062366 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:00.062366 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:00.062366 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:00.062366 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 09:59:00.062366 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:59:00.062366 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 02 09:59:00.062366 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:59:00.063126 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 503/1012] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:58:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:00.063200 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 510/1013] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:58:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:59:00.063268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b2fa8-d334-42fe-9271-b949a95c55f8 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:00.064994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333e0ac-3399-4fc9-b816-ef7bbed3242f None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:00.158465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b2fa8-d334-42fe-9271-b949a95c55f8 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:00.168905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333e0ac-3399-4fc9-b816-ef7bbed3242f None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:00.193813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dfa73-9e80-4a9e-b4f1-7d12d9a513fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:00.194694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dfa73-9e80-4a9e-b4f1-7d12d9a513fa None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:00.194876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dfa73-9e80-4a9e-b4f1-7d12d9a513fa None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:00.195535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dfa73-9e80-4a9e-b4f1-7d12d9a513fa None admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:00.196044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dfa73-9e80-4a9e-b4f1-7d12d9a513fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:00.197506 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dfa73-9e80-4a9e-b4f1-7d12d9a513fa None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:00.205407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8aceb2-a01f-40f8-8a08-2cbf30ed12d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:00.206066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8aceb2-a01f-40f8-8a08-2cbf30ed12d7 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:00.206449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8aceb2-a01f-40f8-8a08-2cbf30ed12d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:00.206735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8aceb2-a01f-40f8-8a08-2cbf30ed12d7 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:00.207438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8aceb2-a01f-40f8-8a08-2cbf30ed12d7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:00.207747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8aceb2-a01f-40f8-8a08-2cbf30ed12d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:00.209147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8aceb2-a01f-40f8-8a08-2cbf30ed12d7 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:00.216658 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 511/1014] 10.222.0.16 () {56 vars in 1112 bytes} [Mon May 2 09:59:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:00.219987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8aceb2-a01f-40f8-8a08-2cbf30ed12d7 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:00.324729 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 504/1015] 10.222.0.16 () {60 vars in 1141 bytes} [Mon May 2 09:59:00 2022] POST /identity/v3/projects => generated 311 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 09:59:00.324926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8aceb2-a01f-40f8-8a08-2cbf30ed12d7 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:00.364486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a312e9b-788b-46ce-ae0a-fc7eee4b3524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:00.365241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a312e9b-788b-46ce-ae0a-fc7eee4b3524 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:00.365573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a312e9b-788b-46ce-ae0a-fc7eee4b3524 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:00.365845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a312e9b-788b-46ce-ae0a-fc7eee4b3524 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:00.366555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a312e9b-788b-46ce-ae0a-fc7eee4b3524 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:00.366860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a312e9b-788b-46ce-ae0a-fc7eee4b3524 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:00.368240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a312e9b-788b-46ce-ae0a-fc7eee4b3524 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:00.373590 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 512/1016] 10.222.0.16 () {56 vars in 1112 bytes} [Mon May 2 09:59:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:59:00.379437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dfa73-9e80-4a9e-b4f1-7d12d9a513fa None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:00.482480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dfa73-9e80-4a9e-b4f1-7d12d9a513fa None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:00.517535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af328d3-cbb2-44f2-bc33-7731c41235ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:00.518210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af328d3-cbb2-44f2-bc33-7731c41235ac None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:00.518494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af328d3-cbb2-44f2-bc33-7731c41235ac None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:00.518775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af328d3-cbb2-44f2-bc33-7731c41235ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:00.519542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af328d3-cbb2-44f2-bc33-7731c41235ac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:00.521027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af328d3-cbb2-44f2-bc33-7731c41235ac None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:00.600994 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 505/1017] 10.222.0.16 () {60 vars in 1144 bytes} [Mon May 2 09:59:00 2022] POST /identity/v3/endpoints => generated 334 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:59:00.723911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e79491-5150-4ff3-a280-a9699c7b7cf3 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:00.724219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e79491-5150-4ff3-a280-a9699c7b7cf3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:00.724494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e79491-5150-4ff3-a280-a9699c7b7cf3 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:00.726092 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 513/1018] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:59:00.732015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668a4ac-32ec-4ceb-9d87-a74301527903 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:00.732312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668a4ac-32ec-4ceb-9d87-a74301527903 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:00.732620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668a4ac-32ec-4ceb-9d87-a74301527903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:00.751037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0668a4ac-32ec-4ceb-9d87-a74301527903 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:00.752279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0668a4ac-32ec-4ceb-9d87-a74301527903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:00.827226 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 506/1019] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:00 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:59:00.850927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e79491-5150-4ff3-a280-a9699c7b7cf3 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:00.954753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e79491-5150-4ff3-a280-a9699c7b7cf3 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:00.985689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519a3fc-193a-40ae-bf57-1d014cd112e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:00.986354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519a3fc-193a-40ae-bf57-1d014cd112e1 None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:00.986638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519a3fc-193a-40ae-bf57-1d014cd112e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:00.986914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519a3fc-193a-40ae-bf57-1d014cd112e1 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:00.987631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519a3fc-193a-40ae-bf57-1d014cd112e1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:00.989397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519a3fc-193a-40ae-bf57-1d014cd112e1 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:01.092377 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 514/1020] 10.222.0.16 () {60 vars in 1141 bytes} [Mon May 2 09:59:00 2022] POST /identity/v3/services => generated 242 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:59:02.694200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0018be8-3c66-4961-b2bb-e5ca18db9d64 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:02.694729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0018be8-3c66-4961-b2bb-e5ca18db9d64 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:02.694809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0018be8-3c66-4961-b2bb-e5ca18db9d64 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:02.696153 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 507/1021] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:59:02.701408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac992475-c212-4682-8a63-2cea16b50fa1 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:02.701822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac992475-c212-4682-8a63-2cea16b50fa1 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:02.701993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac992475-c212-4682-8a63-2cea16b50fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:02.718321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ac992475-c212-4682-8a63-2cea16b50fa1 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:02.722383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ac992475-c212-4682-8a63-2cea16b50fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:02.790760 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 515/1022] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:59:02.816758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0018be8-3c66-4961-b2bb-e5ca18db9d64 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:02.919160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0018be8-3c66-4961-b2bb-e5ca18db9d64 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:02.952163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c8338-af53-4d42-ab18-1de9843c5166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:02.956163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c8338-af53-4d42-ab18-1de9843c5166 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:02.956163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c8338-af53-4d42-ab18-1de9843c5166 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:02.956163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c8338-af53-4d42-ab18-1de9843c5166 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:02.957362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c8338-af53-4d42-ab18-1de9843c5166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:02.958793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c8338-af53-4d42-ab18-1de9843c5166 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:02.965714 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 508/1023] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:59:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:02.967029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac992475-c212-4682-8a63-2cea16b50fa1 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:03.034400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c588a-7f7b-4ea8-af58-321d0dd7c04c None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:03.034754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c588a-7f7b-4ea8-af58-321d0dd7c04c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:03.034968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c588a-7f7b-4ea8-af58-321d0dd7c04c None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:03.036479 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 509/1024] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:59:03.041860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af95e5-7703-4b80-897f-b75a4bea524c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:03.042156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af95e5-7703-4b80-897f-b75a4bea524c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:03.042426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af95e5-7703-4b80-897f-b75a4bea524c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:03.059066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-22af95e5-7703-4b80-897f-b75a4bea524c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:03.060481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-22af95e5-7703-4b80-897f-b75a4bea524c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:03.063118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac992475-c212-4682-8a63-2cea16b50fa1 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:03.103900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb271776-4b0b-447e-b5a9-4795a4f1b584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:03.103900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb271776-4b0b-447e-b5a9-4795a4f1b584 None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:03.103900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb271776-4b0b-447e-b5a9-4795a4f1b584 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:03.103900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb271776-4b0b-447e-b5a9-4795a4f1b584 None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:03.104261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb271776-4b0b-447e-b5a9-4795a4f1b584 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:03.105378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb271776-4b0b-447e-b5a9-4795a4f1b584 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:03.127024 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 510/1025] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 09:59:03.151731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af95e5-7703-4b80-897f-b75a4bea524c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:03.216326 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 516/1026] 10.222.0.16 () {60 vars in 1132 bytes} [Mon May 2 09:59:02 2022] POST /identity/v3/users => generated 285 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:59:03.254522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af95e5-7703-4b80-897f-b75a4bea524c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:03.295464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593289ff-11e2-4520-a441-4a4e9ccddf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:03.296299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593289ff-11e2-4520-a441-4a4e9ccddf32 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:03.296584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593289ff-11e2-4520-a441-4a4e9ccddf32 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:03.296891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593289ff-11e2-4520-a441-4a4e9ccddf32 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:03.308346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593289ff-11e2-4520-a441-4a4e9ccddf32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:59:03.316730 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-593289ff-11e2-4520-a441-4a4e9ccddf32 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 02 09:59:03.316730 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:03.316730 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:03.316730 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:03.316730 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:03.316730 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:03.316730 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:03.316730 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:03.316730 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:03.316730 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:03.316730 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:03.316730 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:03.316730 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:59:03.316730 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:59:03.316730 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:59:03.316730 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:59:03.317778 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:59:03.317778 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:59:03.317778 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:59:03.317778 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:59:03.317778 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:03.317778 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:03.317778 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:03.317778 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:03.317778 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:03.317778 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:03.317778 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:03.317778 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:59:03.317778 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:03.317778 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:03.317778 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:03.317778 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:03.325888 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:03.325888 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:03.325888 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:03.325888 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:03.325888 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:59:03.325888 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:59:03.325888 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:59:03.325888 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:59:03.325888 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:59:03.325888 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:59:03.325888 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 02 09:59:03.325888 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:59:03.325888 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 511/1027] 10.222.0.16 () {56 vars in 1120 bytes} [Mon May 2 09:59:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:59:03.326667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb271776-4b0b-447e-b5a9-4795a4f1b584 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:03.423213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce20687-8dbc-44e0-a68a-c5c918458261 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:03.423500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce20687-8dbc-44e0-a68a-c5c918458261 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:03.423945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce20687-8dbc-44e0-a68a-c5c918458261 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:03.425570 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 512/1028] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:59:03.428319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb271776-4b0b-447e-b5a9-4795a4f1b584 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:03.430464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b21e5-672f-4b3b-aacd-abc737f1acec None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:03.430967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b21e5-672f-4b3b-aacd-abc737f1acec None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:03.431317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b21e5-672f-4b3b-aacd-abc737f1acec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:03.449308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-555b21e5-672f-4b3b-aacd-abc737f1acec None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:03.450514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-555b21e5-672f-4b3b-aacd-abc737f1acec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:03.465504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799863f-026b-47d2-be92-2020bfc5bccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:03.465828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799863f-026b-47d2-be92-2020bfc5bccb None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:03.466023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799863f-026b-47d2-be92-2020bfc5bccb None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:03.466294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799863f-026b-47d2-be92-2020bfc5bccb None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:03.467091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799863f-026b-47d2-be92-2020bfc5bccb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:03.467348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799863f-026b-47d2-be92-2020bfc5bccb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:03.469242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799863f-026b-47d2-be92-2020bfc5bccb None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:03.477689 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 517/1029] 10.222.0.16 () {56 vars in 1115 bytes} [Mon May 2 09:59:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:03.483275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799863f-026b-47d2-be92-2020bfc5bccb None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:03.518396 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 513/1030] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:59:03.542104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b21e5-672f-4b3b-aacd-abc737f1acec None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:03.581025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799863f-026b-47d2-be92-2020bfc5bccb None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:03.614394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c751f41-7b1d-4c32-a78c-609dd20fe881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:03.615189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c751f41-7b1d-4c32-a78c-609dd20fe881 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:03.615759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c751f41-7b1d-4c32-a78c-609dd20fe881 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:03.616046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c751f41-7b1d-4c32-a78c-609dd20fe881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:03.626530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c751f41-7b1d-4c32-a78c-609dd20fe881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:03.628074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c751f41-7b1d-4c32-a78c-609dd20fe881 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:03.638685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b21e5-672f-4b3b-aacd-abc737f1acec None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:03.645802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-3c751f41-7b1d-4c32-a78c-609dd20fe881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:59:03.645802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:03.645802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:03.645802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:03.645802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:03.645802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:03.645802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:03.645802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:03.645802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:03.645802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:03.645802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:03.645802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:03.645802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:59:03.645802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:59:03.645802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:59:03.647244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:59:03.647244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:03.647244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:03.647244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:03.647244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:03.647244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:03.647244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:03.647244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:03.647244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:59:03.647244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:03.647244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:03.647244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:03.647244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:03.647244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:03.647244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:03.647244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:03.647244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:03.653009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:59:03.653009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:59:03.653009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:59:03.653009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:59:03.653009 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 518/1031] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:59:03.653356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c751f41-7b1d-4c32-a78c-609dd20fe881 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:03.674041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad8e48-1045-4c30-8f64-26014c53799f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:03.674841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad8e48-1045-4c30-8f64-26014c53799f None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:03.675123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad8e48-1045-4c30-8f64-26014c53799f None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:03.675401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad8e48-1045-4c30-8f64-26014c53799f None admin] PATH_INFO: `/v3/services/image` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:03.676054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad8e48-1045-4c30-8f64-26014c53799f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:03.677439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad8e48-1045-4c30-8f64-26014c53799f None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:03.689332 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-0cad8e48-1045-4c30-8f64-26014c53799f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 02 09:59:03.689332 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:03.689332 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 09:59:03.689332 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 09:59:03.689332 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 09:59:03.689332 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 09:59:03.689332 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 09:59:03.689332 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:59:03.689332 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 02 09:59:03.689332 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:59:03.689332 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:59:03.689332 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:59:03.689332 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:03.689332 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:03.689332 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:03.689332 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:03.689332 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:03.690361 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:03.690361 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:03.690361 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:03.690361 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:03.690361 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:03.690361 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:03.690361 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 09:59:03.690361 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 09:59:03.690361 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 09:59:03.690361 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 09:59:03.690361 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:03.690361 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:03.690361 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:03.690361 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:03.690361 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:03.690361 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:03.697305 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:03.697305 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:59:03.697305 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:03.697305 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:03.697305 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:03.697305 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:03.697305 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:03.697305 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:03.697305 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:03.697305 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:03.697305 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 09:59:03.697305 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:59:03.697305 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 02 09:59:03.697305 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:59:03.697305 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 514/1032] 10.222.0.16 () {56 vars in 1105 bytes} [Mon May 2 09:59:03 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:59:03.698098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad8e48-1045-4c30-8f64-26014c53799f None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:03.751450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c751f41-7b1d-4c32-a78c-609dd20fe881 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:03.840343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad8e48-1045-4c30-8f64-26014c53799f None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:03.840563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a050d8d-f4c6-4ccb-ac00-4916588c9a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:03.841064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a050d8d-f4c6-4ccb-ac00-4916588c9a66 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:03.841344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a050d8d-f4c6-4ccb-ac00-4916588c9a66 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:03.841622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a050d8d-f4c6-4ccb-ac00-4916588c9a66 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:03.842334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a050d8d-f4c6-4ccb-ac00-4916588c9a66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:03.842642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a050d8d-f4c6-4ccb-ac00-4916588c9a66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:03.844002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a050d8d-f4c6-4ccb-ac00-4916588c9a66 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:03.855430 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 519/1033] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:59:03.860917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a050d8d-f4c6-4ccb-ac00-4916588c9a66 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:03.873975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e093bc-56a4-45d2-84d3-4d53c9cf8a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:03.874867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e093bc-56a4-45d2-84d3-4d53c9cf8a2d None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:03.875357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e093bc-56a4-45d2-84d3-4d53c9cf8a2d None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:03.875767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e093bc-56a4-45d2-84d3-4d53c9cf8a2d None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:03.876642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e093bc-56a4-45d2-84d3-4d53c9cf8a2d None admin] RBAC: Adding query filter params (name=image) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:03.876953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e093bc-56a4-45d2-84d3-4d53c9cf8a2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:03.878292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e093bc-56a4-45d2-84d3-4d53c9cf8a2d None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:03.883716 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 515/1034] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:59:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:03.888917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e093bc-56a4-45d2-84d3-4d53c9cf8a2d None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:03.961666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a050d8d-f4c6-4ccb-ac00-4916588c9a66 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:03.982959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e093bc-56a4-45d2-84d3-4d53c9cf8a2d None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:03.996052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d07934-2bdf-4460-93b4-ecf5d8474a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:03.996878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d07934-2bdf-4460-93b4-ecf5d8474a60 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:03.997166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d07934-2bdf-4460-93b4-ecf5d8474a60 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:03.997439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d07934-2bdf-4460-93b4-ecf5d8474a60 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:04.004392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d07934-2bdf-4460-93b4-ecf5d8474a60 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:04.005836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d07934-2bdf-4460-93b4-ecf5d8474a60 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:04.015764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256122b6-f29e-4397-9a11-ca9086a763ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:04.016419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256122b6-f29e-4397-9a11-ca9086a763ad None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:04.016732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256122b6-f29e-4397-9a11-ca9086a763ad None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:04.017012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256122b6-f29e-4397-9a11-ca9086a763ad None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:04.017710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256122b6-f29e-4397-9a11-ca9086a763ad None admin] RBAC: Adding query filter params (type=image) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:04.018015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256122b6-f29e-4397-9a11-ca9086a763ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:04.019354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256122b6-f29e-4397-9a11-ca9086a763ad None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:04.020523 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-04d07934-2bdf-4460-93b4-ecf5d8474a60 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 02 09:59:04.020523 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:04.020523 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:04.020523 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:04.020523 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:04.020523 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:04.020523 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:04.020523 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:04.020523 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:04.020523 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:04.020523 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:04.020523 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:04.020523 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:59:04.020523 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:59:04.020523 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:59:04.020523 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:59:04.021545 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:04.021545 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:04.021545 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:59:04.021545 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:59:04.021545 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:59:04.021545 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:59:04.021545 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:04.021545 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:04.021545 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:04.021545 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:04.021545 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:04.021545 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:59:04.021545 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:04.021545 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:04.021545 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:04.021545 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:04.021545 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:04.021545 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:04.031060 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:04.031060 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:04.031060 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:59:04.031060 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:59:04.031060 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:59:04.031060 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:59:04.031060 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:59:04.031060 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:59:04.031060 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 02 09:59:04.031060 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:59:04.031060 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 520/1035] 10.222.0.16 () {56 vars in 1093 bytes} [Mon May 2 09:59:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:59:04.031721 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 516/1036] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:59:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:59:04.031802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d07934-2bdf-4460-93b4-ecf5d8474a60 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:04.034248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256122b6-f29e-4397-9a11-ca9086a763ad None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:04.127534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d07934-2bdf-4460-93b4-ecf5d8474a60 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:04.132561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256122b6-f29e-4397-9a11-ca9086a763ad None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:04.160645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817e2b3-6f2a-4541-afa7-842c1029975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:04.161234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817e2b3-6f2a-4541-afa7-842c1029975a None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:04.161519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817e2b3-6f2a-4541-afa7-842c1029975a None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:04.161797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817e2b3-6f2a-4541-afa7-842c1029975a None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:04.163165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817e2b3-6f2a-4541-afa7-842c1029975a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:04.163476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817e2b3-6f2a-4541-afa7-842c1029975a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:04.165152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817e2b3-6f2a-4541-afa7-842c1029975a None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:04.167645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90220ff6-1211-43bf-9516-42d8b772a1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:04.168373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90220ff6-1211-43bf-9516-42d8b772a1a8 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:04.168693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90220ff6-1211-43bf-9516-42d8b772a1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:04.168973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90220ff6-1211-43bf-9516-42d8b772a1a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:04.169757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90220ff6-1211-43bf-9516-42d8b772a1a8 None admin] RBAC: Adding query filter params (interface=public, service_id=95f7f542c3b34523a89394110a41b69b, region_id=RegionOne) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:04.170070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90220ff6-1211-43bf-9516-42d8b772a1a8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:04.171403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90220ff6-1211-43bf-9516-42d8b772a1a8 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:04.176684 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 517/1037] 10.222.0.16 () {56 vars in 1251 bytes} [Mon May 2 09:59:04 2022] GET /identity/v3/endpoints?service_id=95f7f542c3b34523a89394110a41b69b&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:04.182392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90220ff6-1211-43bf-9516-42d8b772a1a8 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:04.182953 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 521/1038] 10.222.0.16 () {56 vars in 1133 bytes} [Mon May 2 09:59:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:59:04.188041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817e2b3-6f2a-4541-afa7-842c1029975a None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:04.283392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817e2b3-6f2a-4541-afa7-842c1029975a None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:04.284080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90220ff6-1211-43bf-9516-42d8b772a1a8 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:04.317705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed706a2e-d4f2-43ed-ad03-7b3005269e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:04.318679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed706a2e-d4f2-43ed-ad03-7b3005269e90 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:04.319141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed706a2e-d4f2-43ed-ad03-7b3005269e90 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:04.319593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed706a2e-d4f2-43ed-ad03-7b3005269e90 None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:04.320480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed706a2e-d4f2-43ed-ad03-7b3005269e90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:04.320680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471a426-8a3f-4973-8fa6-9610ea16c16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:04.321340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471a426-8a3f-4973-8fa6-9610ea16c16c None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:04.321870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471a426-8a3f-4973-8fa6-9610ea16c16c None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:04.322155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471a426-8a3f-4973-8fa6-9610ea16c16c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:04.323056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed706a2e-d4f2-43ed-ad03-7b3005269e90 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:04.330356 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 518/1039] 10.222.0.16 () {56 vars in 1087 bytes} [Mon May 2 09:59:04 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 09:59:04.405092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471a426-8a3f-4973-8fa6-9610ea16c16c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:04.406586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471a426-8a3f-4973-8fa6-9610ea16c16c None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:04.513872 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 522/1040] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:59:04 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 02 09:59:04.515279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed706a2e-d4f2-43ed-ad03-7b3005269e90 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:04.614111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed706a2e-d4f2-43ed-ad03-7b3005269e90 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:04.644850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5afced-221f-4ef4-b762-f89437dfc3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:04.645637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5afced-221f-4ef4-b762-f89437dfc3df None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:04.645917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5afced-221f-4ef4-b762-f89437dfc3df None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:04.646189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5afced-221f-4ef4-b762-f89437dfc3df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:04.656691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5afced-221f-4ef4-b762-f89437dfc3df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:04.658113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5afced-221f-4ef4-b762-f89437dfc3df None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:04.674734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-1b5afced-221f-4ef4-b762-f89437dfc3df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:59:04.674734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:04.674734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:04.674734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:04.674734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:04.674734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:04.674734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:04.674734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:04.674734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:04.674734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:04.674734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:04.674734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:04.674734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:59:04.674734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:59:04.674734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:59:04.675640 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:59:04.675640 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:04.675640 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:04.675640 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:04.675640 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:04.675640 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:04.675640 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:04.675640 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:04.675640 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:59:04.675640 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:04.675640 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:04.675640 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:04.675640 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:04.675640 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:04.675640 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:04.675640 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:04.675640 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:04.676538 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:59:04.676538 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:59:04.676538 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:59:04.676538 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:59:04.676538 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 519/1041] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:59:04.681824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471a426-8a3f-4973-8fa6-9610ea16c16c None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:04.774199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471a426-8a3f-4973-8fa6-9610ea16c16c None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:04.805801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e1a8b-1e55-457e-9ccc-d76f809e669d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:04.806456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e1a8b-1e55-457e-9ccc-d76f809e669d None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:04.806738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e1a8b-1e55-457e-9ccc-d76f809e669d None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:04.807011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e1a8b-1e55-457e-9ccc-d76f809e669d None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:04.807722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e1a8b-1e55-457e-9ccc-d76f809e669d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:04.808026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e1a8b-1e55-457e-9ccc-d76f809e669d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:04.809409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e1a8b-1e55-457e-9ccc-d76f809e669d None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:04.824700 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 523/1042] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:04.826499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5afced-221f-4ef4-b762-f89437dfc3df None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:04.920663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5afced-221f-4ef4-b762-f89437dfc3df None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:04.953435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd995f-0ed1-40ec-a55f-c8a6f116a942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:04.954226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd995f-0ed1-40ec-a55f-c8a6f116a942 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:04.954506 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd995f-0ed1-40ec-a55f-c8a6f116a942 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:04.954781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd995f-0ed1-40ec-a55f-c8a6f116a942 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:04.961817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd995f-0ed1-40ec-a55f-c8a6f116a942 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:04.963237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd995f-0ed1-40ec-a55f-c8a6f116a942 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:04.976433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-aecd995f-0ed1-40ec-a55f-c8a6f116a942 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:59:04.976433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:04.976433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:04.976433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:04.976433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:04.976433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:04.976433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:04.976433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:04.976433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:04.976433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:04.976433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:04.976433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:04.976433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:59:04.976433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:59:04.976433 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:59:04.977394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:59:04.977394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:04.977394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:04.977394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:04.977394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:04.977394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:04.977394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:04.977394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:04.977394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:59:04.977394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:04.977394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:04.977394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:04.977394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:04.977394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:04.977394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:04.977394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:04.977394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:04.978320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:59:04.978320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:59:04.978320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:59:04.978320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:59:04.978320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:59:04.978320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:59:04.978320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:59:04.978320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:59:04.978320 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 520/1043] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:59:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:59:04.984640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e1a8b-1e55-457e-9ccc-d76f809e669d None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:05.078658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e1a8b-1e55-457e-9ccc-d76f809e669d None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:05.112316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093eb224-5fec-488e-8ebb-d8752ebfe3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:05.113075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093eb224-5fec-488e-8ebb-d8752ebfe3d8 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:05.113358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093eb224-5fec-488e-8ebb-d8752ebfe3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:05.113884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093eb224-5fec-488e-8ebb-d8752ebfe3d8 None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:05.114666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093eb224-5fec-488e-8ebb-d8752ebfe3d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:05.114976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093eb224-5fec-488e-8ebb-d8752ebfe3d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:05.116459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093eb224-5fec-488e-8ebb-d8752ebfe3d8 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:05.129110 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 524/1044] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:59:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:05.135383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd995f-0ed1-40ec-a55f-c8a6f116a942 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:05.231600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd995f-0ed1-40ec-a55f-c8a6f116a942 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:05.264292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3283d55-9996-47d8-8b8c-3420b9840112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:05.264976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3283d55-9996-47d8-8b8c-3420b9840112 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:05.265259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3283d55-9996-47d8-8b8c-3420b9840112 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:05.265532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3283d55-9996-47d8-8b8c-3420b9840112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:05.266364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3283d55-9996-47d8-8b8c-3420b9840112 None admin] RBAC: Adding query filter params (role.id=0ef68f89f9394078b95445392557cd47, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=e6036dd39fb74289a8cbdcd6a21f8662) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:05.266673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3283d55-9996-47d8-8b8c-3420b9840112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:05.268086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3283d55-9996-47d8-8b8c-3420b9840112 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:05.280873 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 521/1045] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:59:05 2022] GET /identity/v3/role_assignments?user.id=e6036dd39fb74289a8cbdcd6a21f8662&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=0ef68f89f9394078b95445392557cd47 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:05.622906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493fc81-1e8c-4875-8371-57611dfbbe6f None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:05.623263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493fc81-1e8c-4875-8371-57611dfbbe6f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:05.623486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493fc81-1e8c-4875-8371-57611dfbbe6f None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:05.625010 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 525/1046] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:59:05.629936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32f71e-335a-42e0-afc5-6c7ecf195ab5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:05.630235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32f71e-335a-42e0-afc5-6c7ecf195ab5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:05.630520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32f71e-335a-42e0-afc5-6c7ecf195ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:05.646902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8f32f71e-335a-42e0-afc5-6c7ecf195ab5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:05.648110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8f32f71e-335a-42e0-afc5-6c7ecf195ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:05.710311 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 522/1047] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:59:05.734912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493fc81-1e8c-4875-8371-57611dfbbe6f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:05.831060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493fc81-1e8c-4875-8371-57611dfbbe6f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:05.862793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24892b80-2d45-4414-9daa-8600792f4aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:05.863580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24892b80-2d45-4414-9daa-8600792f4aad None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:05.864129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24892b80-2d45-4414-9daa-8600792f4aad None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:05.864411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24892b80-2d45-4414-9daa-8600792f4aad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:05.874807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24892b80-2d45-4414-9daa-8600792f4aad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:59:05.882319 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-24892b80-2d45-4414-9daa-8600792f4aad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:59:05.882319 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:05.882319 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:05.882319 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:05.882319 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:05.882319 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:05.882319 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:05.882319 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:05.882319 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:05.882319 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:05.882319 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:05.882319 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:05.882319 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:59:05.882319 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:59:05.882319 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:59:05.882319 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:59:05.883214 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:59:05.883214 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:59:05.883214 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:59:05.883214 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:59:05.883214 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:05.883214 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:05.883214 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:05.883214 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:05.883214 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:05.883214 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:05.883214 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:05.883214 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:59:05.883214 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:05.883214 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:05.883214 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:05.883214 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:05.884054 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:05.884054 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:05.884054 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:05.884054 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:05.884054 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:59:05.884054 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:59:05.884054 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:59:05.884054 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:59:05.884054 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:59:05.884054 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:59:05.884054 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:59:05.884054 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:59:05.885563 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 526/1048] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:59:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:59:05.889599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32f71e-335a-42e0-afc5-6c7ecf195ab5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:05.982907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32f71e-335a-42e0-afc5-6c7ecf195ab5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:06.015264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126db507-0d23-444b-960a-d53da427b57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:06.015940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126db507-0d23-444b-960a-d53da427b57c None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:06.016227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126db507-0d23-444b-960a-d53da427b57c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:06.016508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126db507-0d23-444b-960a-d53da427b57c None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:06.017285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126db507-0d23-444b-960a-d53da427b57c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:06.017595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126db507-0d23-444b-960a-d53da427b57c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:06.018951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126db507-0d23-444b-960a-d53da427b57c None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:06.027624 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 523/1049] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:59:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:06.033137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24892b80-2d45-4414-9daa-8600792f4aad None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:06.129660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24892b80-2d45-4414-9daa-8600792f4aad None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:06.162015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d2315-6258-4776-9e14-54b7b6f6e68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:06.163433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d2315-6258-4776-9e14-54b7b6f6e68e None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:06.163719 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d2315-6258-4776-9e14-54b7b6f6e68e None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:06.163998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d2315-6258-4776-9e14-54b7b6f6e68e None admin] PATH_INFO: `/v3/users/c0e3df552ce1465498b74b578cb788c6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:06.176994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d2315-6258-4776-9e14-54b7b6f6e68e None admin] RBAC: Authorizing `identity:get_user(user_id=c0e3df552ce1465498b74b578cb788c6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:06.178487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d2315-6258-4776-9e14-54b7b6f6e68e None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:06.180341 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 527/1050] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:59:06 2022] GET /identity/v3/users/c0e3df552ce1465498b74b578cb788c6 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:06.185834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126db507-0d23-444b-960a-d53da427b57c None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:06.280379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126db507-0d23-444b-960a-d53da427b57c None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:06.312402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17a9d4-1705-409e-99c4-e0783e01b1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:06.313084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17a9d4-1705-409e-99c4-e0783e01b1b6 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:06.313372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17a9d4-1705-409e-99c4-e0783e01b1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:06.313653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17a9d4-1705-409e-99c4-e0783e01b1b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:06.377839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17a9d4-1705-409e-99c4-e0783e01b1b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:06.379294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17a9d4-1705-409e-99c4-e0783e01b1b6 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:06.478041 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 524/1051] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:59:06 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 09:59:06.483868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d2315-6258-4776-9e14-54b7b6f6e68e None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:06.581891 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d2315-6258-4776-9e14-54b7b6f6e68e None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:06.614703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a5946-654c-4348-8cde-fff968e65ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:06.615586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a5946-654c-4348-8cde-fff968e65ba9 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:06.615871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a5946-654c-4348-8cde-fff968e65ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:06.616148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a5946-654c-4348-8cde-fff968e65ba9 None admin] PATH_INFO: `/v3/projects/f73db4799a374a5cae7ad46a90a853bb` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:06.617365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a5946-654c-4348-8cde-fff968e65ba9 None admin] RBAC: Authorizing `identity:get_project(project_id=f73db4799a374a5cae7ad46a90a853bb)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:06.618886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a5946-654c-4348-8cde-fff968e65ba9 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:06.620864 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 528/1052] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:59:06 2022] GET /identity/v3/projects/f73db4799a374a5cae7ad46a90a853bb => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:06.626831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17a9d4-1705-409e-99c4-e0783e01b1b6 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:06.670472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59d37b-4dfb-43de-bb06-163d2fa53ac5 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:06.670781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59d37b-4dfb-43de-bb06-163d2fa53ac5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:06.671038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59d37b-4dfb-43de-bb06-163d2fa53ac5 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:06.672712 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 529/1053] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:59:06.677347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce8195-bc30-4bc1-b8c0-f96d2a4c9527 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:06.678247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce8195-bc30-4bc1-b8c0-f96d2a4c9527 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:06.678629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce8195-bc30-4bc1-b8c0-f96d2a4c9527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:06.696252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-73ce8195-bc30-4bc1-b8c0-f96d2a4c9527 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:06.697479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-73ce8195-bc30-4bc1-b8c0-f96d2a4c9527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:06.723772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17a9d4-1705-409e-99c4-e0783e01b1b6 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:06.757651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948f272-578a-4860-892f-3a7c3554e0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:06.758230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948f272-578a-4860-892f-3a7c3554e0e7 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:06.758512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948f272-578a-4860-892f-3a7c3554e0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:06.758788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948f272-578a-4860-892f-3a7c3554e0e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:06.759613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948f272-578a-4860-892f-3a7c3554e0e7 None admin] RBAC: Adding query filter params (role.id=dd8a47ade22941849ebdf8fbdf994b66, scope.project.id=f73db4799a374a5cae7ad46a90a853bb, user.id=c0e3df552ce1465498b74b578cb788c6) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:06.759931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948f272-578a-4860-892f-3a7c3554e0e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:06.761397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948f272-578a-4860-892f-3a7c3554e0e7 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:06.769721 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 525/1054] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:59:06 2022] GET /identity/v3/role_assignments?user.id=c0e3df552ce1465498b74b578cb788c6&scope.project.id=f73db4799a374a5cae7ad46a90a853bb&role.id=dd8a47ade22941849ebdf8fbdf994b66 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:06.769859 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 530/1055] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:59:06.785941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948f272-578a-4860-892f-3a7c3554e0e7 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:06.890503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948f272-578a-4860-892f-3a7c3554e0e7 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:06.928310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841322ae-44c4-4b78-ab29-c7c2e24d2450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:06.929155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841322ae-44c4-4b78-ab29-c7c2e24d2450 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:06.929440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841322ae-44c4-4b78-ab29-c7c2e24d2450 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:06.929724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841322ae-44c4-4b78-ab29-c7c2e24d2450 None admin] PATH_INFO: `/v3/services/image` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:06.930395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841322ae-44c4-4b78-ab29-c7c2e24d2450 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:06.931781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841322ae-44c4-4b78-ab29-c7c2e24d2450 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:06.944497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-841322ae-44c4-4b78-ab29-c7c2e24d2450 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 02 09:59:06.944497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:06.944497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 09:59:06.944497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 09:59:06.944497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 09:59:06.944497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 09:59:06.944497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 09:59:06.944497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:59:06.944497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 02 09:59:06.944497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:59:06.944497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:59:06.944497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:59:06.944497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:06.944497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:06.944497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:06.944497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:06.944497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:06.945659 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:06.945659 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:06.945659 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:06.945659 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:06.945659 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:06.945659 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:06.945659 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 09:59:06.945659 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 09:59:06.945659 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 09:59:06.945659 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 09:59:06.945659 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:06.945659 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:06.945659 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:06.945659 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:06.945659 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:06.945659 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:06.946516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:06.946516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:59:06.946516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:06.946516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:06.946516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:06.946516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:06.946516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:06.946516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:06.946516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:06.946516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:06.946516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 09:59:06.946516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 09:59:06.946516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 02 09:59:06.946516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:59:06.947293 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 526/1056] 10.222.0.16 () {56 vars in 1105 bytes} [Mon May 2 09:59:06 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:59:06.953927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce8195-bc30-4bc1-b8c0-f96d2a4c9527 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:07.049423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce8195-bc30-4bc1-b8c0-f96d2a4c9527 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:07.081948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30dbc3-2682-40c7-8bc1-b571a188dddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:07.082618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30dbc3-2682-40c7-8bc1-b571a188dddc None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:07.082904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30dbc3-2682-40c7-8bc1-b571a188dddc None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:07.083182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30dbc3-2682-40c7-8bc1-b571a188dddc None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:07.083884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30dbc3-2682-40c7-8bc1-b571a188dddc None admin] RBAC: Adding query filter params (name=image) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:07.084228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30dbc3-2682-40c7-8bc1-b571a188dddc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:07.085627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30dbc3-2682-40c7-8bc1-b571a188dddc None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:07.095138 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 531/1057] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:59:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:07.096910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841322ae-44c4-4b78-ab29-c7c2e24d2450 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:07.193182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841322ae-44c4-4b78-ab29-c7c2e24d2450 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:07.224472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa66ca-db5f-4a1e-b3b2-d44ddc54dd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:07.225759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa66ca-db5f-4a1e-b3b2-d44ddc54dd46 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:07.226045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa66ca-db5f-4a1e-b3b2-d44ddc54dd46 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:07.226325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa66ca-db5f-4a1e-b3b2-d44ddc54dd46 None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:07.227027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa66ca-db5f-4a1e-b3b2-d44ddc54dd46 None admin] RBAC: Adding query filter params (type=image) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:07.227404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa66ca-db5f-4a1e-b3b2-d44ddc54dd46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:07.228736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa66ca-db5f-4a1e-b3b2-d44ddc54dd46 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:07.238055 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 527/1058] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:59:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:07.239462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30dbc3-2682-40c7-8bc1-b571a188dddc None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:07.332840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30dbc3-2682-40c7-8bc1-b571a188dddc None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:07.364347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0abd4a-d174-4be6-b879-e710bc2dd5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:07.365031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0abd4a-d174-4be6-b879-e710bc2dd5a0 None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:07.365889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0abd4a-d174-4be6-b879-e710bc2dd5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:07.366164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0abd4a-d174-4be6-b879-e710bc2dd5a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:07.366894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0abd4a-d174-4be6-b879-e710bc2dd5a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:07.368261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0abd4a-d174-4be6-b879-e710bc2dd5a0 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:07.452067 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 532/1059] 10.222.0.16 () {60 vars in 1144 bytes} [Mon May 2 09:59:07 2022] POST /identity/v3/endpoints => generated 327 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:59:07.611377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb8ea0-18fd-4f08-9abb-2b3e61b061fe None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:07.611689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb8ea0-18fd-4f08-9abb-2b3e61b061fe None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:07.611957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb8ea0-18fd-4f08-9abb-2b3e61b061fe None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:07.613564 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 528/1060] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:59:07.619322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3b7c7-bc5f-4dd7-8a87-c7caedd3aea7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:07.619615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3b7c7-bc5f-4dd7-8a87-c7caedd3aea7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:07.619894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3b7c7-bc5f-4dd7-8a87-c7caedd3aea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:07.636629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-54d3b7c7-bc5f-4dd7-8a87-c7caedd3aea7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:07.637835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-54d3b7c7-bc5f-4dd7-8a87-c7caedd3aea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:07.710506 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 533/1061] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:59:07.736309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb8ea0-18fd-4f08-9abb-2b3e61b061fe None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:07.838572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb8ea0-18fd-4f08-9abb-2b3e61b061fe None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:07.870594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec3173-096e-428e-82ee-f35d76177117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:07.871337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec3173-096e-428e-82ee-f35d76177117 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:07.871618 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec3173-096e-428e-82ee-f35d76177117 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:07.871888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec3173-096e-428e-82ee-f35d76177117 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:07.882274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec3173-096e-428e-82ee-f35d76177117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:59:07.890303 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-71ec3173-096e-428e-82ee-f35d76177117 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 02 09:59:07.890303 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:07.890303 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:07.890303 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:07.890303 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:07.890303 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:07.890303 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:07.890303 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:07.890303 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:07.890303 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:07.890303 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:07.890303 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:07.890303 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:59:07.890303 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:59:07.890303 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:59:07.890303 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:59:07.891765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:59:07.891765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:59:07.891765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:59:07.891765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:59:07.891765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:07.891765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:07.891765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:07.891765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:07.891765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:07.891765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:07.891765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:07.891765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:59:07.891765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:07.891765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:07.891765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:07.891765 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:07.893203 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:07.893203 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:07.893203 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:07.893203 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:07.893203 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:59:07.893203 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:59:07.893203 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:59:07.893203 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:59:07.893203 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:59:07.893203 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:59:07.893203 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 02 09:59:07.893203 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:59:07.894242 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 529/1062] 10.222.0.16 () {56 vars in 1120 bytes} [Mon May 2 09:59:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:59:07.898794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3b7c7-bc5f-4dd7-8a87-c7caedd3aea7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:07.997532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3b7c7-bc5f-4dd7-8a87-c7caedd3aea7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:08.032075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f6283-a981-4e93-91a4-49d65691b4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:08.033133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f6283-a981-4e93-91a4-49d65691b4bf None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:08.033648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f6283-a981-4e93-91a4-49d65691b4bf None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:08.034141 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f6283-a981-4e93-91a4-49d65691b4bf None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:08.035103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f6283-a981-4e93-91a4-49d65691b4bf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:08.035651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f6283-a981-4e93-91a4-49d65691b4bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:08.037791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f6283-a981-4e93-91a4-49d65691b4bf None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:08.045575 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 534/1063] 10.222.0.16 () {56 vars in 1115 bytes} [Mon May 2 09:59:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:59:08.051517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec3173-096e-428e-82ee-f35d76177117 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:08.152087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec3173-096e-428e-82ee-f35d76177117 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:08.183498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc518a9-1f1c-4f75-8d00-9a9da48dab3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:08.184283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc518a9-1f1c-4f75-8d00-9a9da48dab3c None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:08.184566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc518a9-1f1c-4f75-8d00-9a9da48dab3c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:08.184895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc518a9-1f1c-4f75-8d00-9a9da48dab3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:08.195727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc518a9-1f1c-4f75-8d00-9a9da48dab3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:08.197226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc518a9-1f1c-4f75-8d00-9a9da48dab3c None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:08.213753 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-dcc518a9-1f1c-4f75-8d00-9a9da48dab3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:59:08.213753 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:08.213753 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:08.213753 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:08.213753 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:08.213753 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:08.213753 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:08.213753 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:08.213753 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:08.213753 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:08.213753 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:08.213753 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:08.213753 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:59:08.213753 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:59:08.213753 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:59:08.214706 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:59:08.214706 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:08.214706 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:08.214706 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:08.214706 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:08.214706 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:08.214706 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:08.214706 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:08.214706 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:59:08.214706 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:08.214706 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:08.214706 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:08.214706 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:08.214706 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:08.214706 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:08.214706 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:08.214706 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:08.215621 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:59:08.215621 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:59:08.215621 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:59:08.215621 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:59:08.216372 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 530/1064] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:59:08.220972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f6283-a981-4e93-91a4-49d65691b4bf None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:08.322039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f6283-a981-4e93-91a4-49d65691b4bf None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:08.355303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d81ff3-f06e-4021-a0f4-a3729f06c77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:08.356096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d81ff3-f06e-4021-a0f4-a3729f06c77f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:08.356449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d81ff3-f06e-4021-a0f4-a3729f06c77f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:08.356828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d81ff3-f06e-4021-a0f4-a3729f06c77f None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:08.357554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d81ff3-f06e-4021-a0f4-a3729f06c77f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:08.357865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d81ff3-f06e-4021-a0f4-a3729f06c77f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:08.359317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d81ff3-f06e-4021-a0f4-a3729f06c77f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:08.376234 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 535/1065] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:08.377473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc518a9-1f1c-4f75-8d00-9a9da48dab3c None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:08.481081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc518a9-1f1c-4f75-8d00-9a9da48dab3c None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:08.523380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195e965-15b0-498f-a815-e5df2b215e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:08.524584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195e965-15b0-498f-a815-e5df2b215e1e None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:08.525089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195e965-15b0-498f-a815-e5df2b215e1e None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:08.526235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195e965-15b0-498f-a815-e5df2b215e1e None admin] PATH_INFO: `/v3/users/nova` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:08.533219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195e965-15b0-498f-a815-e5df2b215e1e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:08.534826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195e965-15b0-498f-a815-e5df2b215e1e None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:08.549418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-8195e965-15b0-498f-a815-e5df2b215e1e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 02 09:59:08.549418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:08.549418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:08.549418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:08.549418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:08.549418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:08.549418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:08.549418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:08.549418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:08.549418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:08.549418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:08.549418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:08.549418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:59:08.549418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:59:08.549418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:59:08.549418 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:59:08.550480 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:08.550480 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:08.550480 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:59:08.550480 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:59:08.550480 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:59:08.550480 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:59:08.550480 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:08.550480 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:08.550480 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:08.550480 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:08.550480 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:08.550480 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:59:08.550480 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:08.550480 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:08.550480 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:08.550480 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:08.550480 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:08.550480 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:08.551443 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:08.551443 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:08.551443 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:59:08.551443 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:59:08.551443 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:59:08.551443 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:59:08.551443 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:59:08.551443 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:59:08.551443 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 02 09:59:08.551443 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:59:08.551997 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 531/1066] 10.222.0.16 () {56 vars in 1093 bytes} [Mon May 2 09:59:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:59:08.558615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d81ff3-f06e-4021-a0f4-a3729f06c77f None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:08.657303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d81ff3-f06e-4021-a0f4-a3729f06c77f None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:08.691264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca913c6-fb86-4ed3-926c-e767e84024ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:08.691940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca913c6-fb86-4ed3-926c-e767e84024ea None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:08.692223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca913c6-fb86-4ed3-926c-e767e84024ea None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:08.692498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca913c6-fb86-4ed3-926c-e767e84024ea None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:08.693866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca913c6-fb86-4ed3-926c-e767e84024ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:08.694173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca913c6-fb86-4ed3-926c-e767e84024ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:08.695605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca913c6-fb86-4ed3-926c-e767e84024ea None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:08.712883 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 536/1067] 10.222.0.16 () {56 vars in 1133 bytes} [Mon May 2 09:59:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:08.718279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195e965-15b0-498f-a815-e5df2b215e1e None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:08.812856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195e965-15b0-498f-a815-e5df2b215e1e None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:08.847580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8c4a3-9f63-4e1e-8b9f-ca94a1936db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:08.848827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8c4a3-9f63-4e1e-8b9f-ca94a1936db0 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:08.849309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8c4a3-9f63-4e1e-8b9f-ca94a1936db0 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:08.849819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8c4a3-9f63-4e1e-8b9f-ca94a1936db0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:08.860057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8c4a3-9f63-4e1e-8b9f-ca94a1936db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:08.861755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8c4a3-9f63-4e1e-8b9f-ca94a1936db0 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:08.878394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-fff8c4a3-9f63-4e1e-8b9f-ca94a1936db0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:59:08.878394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:08.878394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:08.878394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:08.878394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:08.878394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:08.878394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:08.878394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:08.878394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:08.878394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:08.878394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:08.878394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:08.878394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:59:08.878394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:59:08.878394 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:59:08.879252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:59:08.879252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:08.879252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:08.879252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:08.879252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:08.879252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:08.879252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:08.879252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:08.879252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:59:08.879252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:08.879252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:08.879252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:08.879252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:08.879252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:08.879252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:08.879252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:08.879252 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:08.880232 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:59:08.880232 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:59:08.880232 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:59:08.880232 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:59:08.882580 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 532/1068] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:59:08.888060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca913c6-fb86-4ed3-926c-e767e84024ea None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:08.987075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca913c6-fb86-4ed3-926c-e767e84024ea None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:09.020488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef05e2-61fb-4452-a4be-0696ba354008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:09.021274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef05e2-61fb-4452-a4be-0696ba354008 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:09.022503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef05e2-61fb-4452-a4be-0696ba354008 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:09.022841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef05e2-61fb-4452-a4be-0696ba354008 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:09.023444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef05e2-61fb-4452-a4be-0696ba354008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:09.023753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef05e2-61fb-4452-a4be-0696ba354008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:09.025159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef05e2-61fb-4452-a4be-0696ba354008 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:09.041357 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 537/1069] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:09.042639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8c4a3-9f63-4e1e-8b9f-ca94a1936db0 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:09.116669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393af5b-3f48-4447-9a1f-e8380ebe89be None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:09.117024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393af5b-3f48-4447-9a1f-e8380ebe89be None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:09.117244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393af5b-3f48-4447-9a1f-e8380ebe89be None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:09.118751 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 538/1070] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:59:09.125905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c0f5f-e79c-4c95-8334-bdadc704d2fa None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:09.125905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c0f5f-e79c-4c95-8334-bdadc704d2fa None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:09.125905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c0f5f-e79c-4c95-8334-bdadc704d2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:09.141662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e71c0f5f-e79c-4c95-8334-bdadc704d2fa None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:09.142860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e71c0f5f-e79c-4c95-8334-bdadc704d2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:09.147280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8c4a3-9f63-4e1e-8b9f-ca94a1936db0 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:09.181342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206c0cd-6d62-41d1-9c32-60bde7a074f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:09.182149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206c0cd-6d62-41d1-9c32-60bde7a074f9 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:09.182433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206c0cd-6d62-41d1-9c32-60bde7a074f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:09.182711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206c0cd-6d62-41d1-9c32-60bde7a074f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:09.189378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206c0cd-6d62-41d1-9c32-60bde7a074f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:09.190848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206c0cd-6d62-41d1-9c32-60bde7a074f9 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:09.205084 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-a206c0cd-6d62-41d1-9c32-60bde7a074f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:59:09.205084 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:09.205084 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:09.205084 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:09.205084 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:09.205084 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:09.205084 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:09.205084 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:09.205084 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:09.205084 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:09.205084 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:09.205084 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:09.205084 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:59:09.205084 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:59:09.205084 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:59:09.212693 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:59:09.212693 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:09.212693 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:09.212693 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:09.212693 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:09.212693 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:09.212693 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:09.212693 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:09.212693 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:59:09.212693 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:09.212693 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:09.212693 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:09.212693 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:09.212693 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:09.212693 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:09.212693 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:09.212693 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:09.213635 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:59:09.213635 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:59:09.213635 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:59:09.213635 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:59:09.213635 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:59:09.213635 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:59:09.213635 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:59:09.213635 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:59:09.213635 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 533/1071] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:59:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:59:09.214179 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 539/1072] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:59:09.214254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206c0cd-6d62-41d1-9c32-60bde7a074f9 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:09.236985 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c0f5f-e79c-4c95-8334-bdadc704d2fa None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:09.313935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206c0cd-6d62-41d1-9c32-60bde7a074f9 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:09.331912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c0f5f-e79c-4c95-8334-bdadc704d2fa None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:09.347389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafc654-88e7-46d3-89d6-cbfab731ed7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:09.348060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafc654-88e7-46d3-89d6-cbfab731ed7c None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:09.348397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafc654-88e7-46d3-89d6-cbfab731ed7c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:09.348645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafc654-88e7-46d3-89d6-cbfab731ed7c None admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:09.349445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafc654-88e7-46d3-89d6-cbfab731ed7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:09.350281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafc654-88e7-46d3-89d6-cbfab731ed7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:09.351731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafc654-88e7-46d3-89d6-cbfab731ed7c None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:09.368067 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 534/1073] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:59:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:59:09.368258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c6f58-7eb0-4998-bcc0-4b05b73a7ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:09.368258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c6f58-7eb0-4998-bcc0-4b05b73a7ee5 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:09.368258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c6f58-7eb0-4998-bcc0-4b05b73a7ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:09.368258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c6f58-7eb0-4998-bcc0-4b05b73a7ee5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:09.369179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafc654-88e7-46d3-89d6-cbfab731ed7c None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:09.378478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c6f58-7eb0-4998-bcc0-4b05b73a7ee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:59:09.386472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-312c6f58-7eb0-4998-bcc0-4b05b73a7ee5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:59:09.386472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:09.386472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:09.386472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:09.386472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:09.386472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:09.386472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:09.386472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:09.386472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:09.386472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:09.386472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:09.386472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:09.386472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:59:09.386472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:59:09.386472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:59:09.386472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:59:09.387615 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:59:09.387615 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:59:09.387615 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:59:09.387615 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:59:09.387615 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:09.387615 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:09.387615 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:09.387615 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:09.387615 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:09.387615 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:09.387615 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:09.387615 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:59:09.387615 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:09.387615 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:09.387615 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:09.387615 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:09.388835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:09.388835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:09.388835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:09.388835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:09.388835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:59:09.388835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:59:09.388835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:59:09.388835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:59:09.388835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:59:09.388835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:59:09.388835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:59:09.388835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:59:09.392748 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 540/1074] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:59:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:59:09.393590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c6f58-7eb0-4998-bcc0-4b05b73a7ee5 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:09.472313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafc654-88e7-46d3-89d6-cbfab731ed7c None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:09.496276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c6f58-7eb0-4998-bcc0-4b05b73a7ee5 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:09.506422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76f44e-7a65-47f1-a32d-272738a7c308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:09.507370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76f44e-7a65-47f1-a32d-272738a7c308 None admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:09.507701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76f44e-7a65-47f1-a32d-272738a7c308 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:09.507983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76f44e-7a65-47f1-a32d-272738a7c308 None admin] PATH_INFO: `/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/e6036dd39fb74289a8cbdcd6a21f8662/roles/0ef68f89f9394078b95445392557cd47` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:09.510278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76f44e-7a65-47f1-a32d-272738a7c308 None admin] RBAC: Authorizing `identity:create_grant(project_id=972cae0aa9694d6cad22fbdbcf916ff7, user_id=e6036dd39fb74289a8cbdcd6a21f8662, role_id=0ef68f89f9394078b95445392557cd47)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:09.511722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76f44e-7a65-47f1-a32d-272738a7c308 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:09.533828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1817f9-9f73-4958-bebc-2f0cf9594707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:09.534624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1817f9-9f73-4958-bebc-2f0cf9594707 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:09.534913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1817f9-9f73-4958-bebc-2f0cf9594707 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:09.535190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1817f9-9f73-4958-bebc-2f0cf9594707 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:09.536034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1817f9-9f73-4958-bebc-2f0cf9594707 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:09.536344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1817f9-9f73-4958-bebc-2f0cf9594707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:09.538277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1817f9-9f73-4958-bebc-2f0cf9594707 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:09.546125 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 541/1075] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:59:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:09.551641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1817f9-9f73-4958-bebc-2f0cf9594707 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:09.604767 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 535/1076] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 09:59:09 2022] PUT /identity/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/e6036dd39fb74289a8cbdcd6a21f8662/roles/0ef68f89f9394078b95445392557cd47 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:59:09.656042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1817f9-9f73-4958-bebc-2f0cf9594707 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:09.692844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4918eae-e7d7-4ca2-877a-19851afe70ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:09.694117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4918eae-e7d7-4ca2-877a-19851afe70ee None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:09.694629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4918eae-e7d7-4ca2-877a-19851afe70ee None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:09.695116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4918eae-e7d7-4ca2-877a-19851afe70ee None admin] PATH_INFO: `/v3/users/c0e3df552ce1465498b74b578cb788c6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:09.696690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4918eae-e7d7-4ca2-877a-19851afe70ee None admin] RBAC: Authorizing `identity:get_user(user_id=c0e3df552ce1465498b74b578cb788c6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:09.698386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4918eae-e7d7-4ca2-877a-19851afe70ee None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:09.700381 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 542/1077] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:59:09 2022] GET /identity/v3/users/c0e3df552ce1465498b74b578cb788c6 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:59:09.706575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76f44e-7a65-47f1-a32d-272738a7c308 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:09.807487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76f44e-7a65-47f1-a32d-272738a7c308 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:09.807705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd1b8f-0a2e-4de9-be1c-374cc27fb049 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:09.807792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd1b8f-0a2e-4de9-be1c-374cc27fb049 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:09.808044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd1b8f-0a2e-4de9-be1c-374cc27fb049 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:09.809450 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 543/1078] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:59:09.814425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003c3dc-200f-439e-93b3-2f60d2859a2a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:09.814710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003c3dc-200f-439e-93b3-2f60d2859a2a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:09.814993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003c3dc-200f-439e-93b3-2f60d2859a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:09.831399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8003c3dc-200f-439e-93b3-2f60d2859a2a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:09.832575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8003c3dc-200f-439e-93b3-2f60d2859a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:09.843255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae3d8e-51b2-4ee7-8944-1f2211eeabb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:09.844409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae3d8e-51b2-4ee7-8944-1f2211eeabb0 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:09.844724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae3d8e-51b2-4ee7-8944-1f2211eeabb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:09.845002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae3d8e-51b2-4ee7-8944-1f2211eeabb0 None admin] PATH_INFO: `/v3/projects/f73db4799a374a5cae7ad46a90a853bb` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:09.846814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae3d8e-51b2-4ee7-8944-1f2211eeabb0 None admin] RBAC: Authorizing `identity:get_project(project_id=f73db4799a374a5cae7ad46a90a853bb)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:09.848218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae3d8e-51b2-4ee7-8944-1f2211eeabb0 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:09.850916 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 536/1079] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:59:09 2022] GET /identity/v3/projects/f73db4799a374a5cae7ad46a90a853bb => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:09.856255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae3d8e-51b2-4ee7-8944-1f2211eeabb0 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:09.899162 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 544/1080] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 09:59:09.922925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003c3dc-200f-439e-93b3-2f60d2859a2a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:09.953258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae3d8e-51b2-4ee7-8944-1f2211eeabb0 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:09.987272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d261b7-31dc-41ff-a41c-8df9ac0f9698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:09.988162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d261b7-31dc-41ff-a41c-8df9ac0f9698 None admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:09.988448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d261b7-31dc-41ff-a41c-8df9ac0f9698 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:09.989012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d261b7-31dc-41ff-a41c-8df9ac0f9698 None admin] PATH_INFO: `/v3/projects/f73db4799a374a5cae7ad46a90a853bb/users/c0e3df552ce1465498b74b578cb788c6/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:09.991043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d261b7-31dc-41ff-a41c-8df9ac0f9698 None admin] RBAC: Authorizing `identity:create_grant(project_id=f73db4799a374a5cae7ad46a90a853bb, user_id=c0e3df552ce1465498b74b578cb788c6, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:09.992451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d261b7-31dc-41ff-a41c-8df9ac0f9698 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:10.018826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003c3dc-200f-439e-93b3-2f60d2859a2a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:10.052062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447dc47-4ea4-46a0-9d38-cae173c021e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:10.052833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447dc47-4ea4-46a0-9d38-cae173c021e1 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:10.053121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447dc47-4ea4-46a0-9d38-cae173c021e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:10.053399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447dc47-4ea4-46a0-9d38-cae173c021e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:10.106504 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 537/1081] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 09:59:09 2022] PUT /identity/v3/projects/f73db4799a374a5cae7ad46a90a853bb/users/c0e3df552ce1465498b74b578cb788c6/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 09:59:10.121370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447dc47-4ea4-46a0-9d38-cae173c021e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:10.123063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447dc47-4ea4-46a0-9d38-cae173c021e1 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:10.226513 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 545/1082] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:59:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 02 09:59:10.232909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d261b7-31dc-41ff-a41c-8df9ac0f9698 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:10.338511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d261b7-31dc-41ff-a41c-8df9ac0f9698 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:10.371340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa6888-a583-4861-bbdf-f9799ee62ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:10.372139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa6888-a583-4861-bbdf-f9799ee62ac9 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:10.372426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa6888-a583-4861-bbdf-f9799ee62ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:10.372737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa6888-a583-4861-bbdf-f9799ee62ac9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:10.383751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa6888-a583-4861-bbdf-f9799ee62ac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:10.385232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa6888-a583-4861-bbdf-f9799ee62ac9 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:10.406301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-c1fa6888-a583-4861-bbdf-f9799ee62ac9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:59:10.406301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:10.406301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:10.406301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:10.406301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:10.406301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:10.406301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:10.406301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:10.406301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:10.406301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:10.406301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:10.406301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:10.406301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:59:10.406301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:59:10.406301 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:59:10.407291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:59:10.407291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:10.407291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:10.407291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:10.407291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:10.407291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:10.407291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:10.407291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:10.407291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:59:10.407291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:10.407291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:10.407291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:10.407291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:10.407291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:10.407291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:10.407291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:10.407291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:10.408936 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:59:10.408936 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:59:10.408936 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:59:10.408936 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:59:10.408936 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 538/1083] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:59:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:59:10.413764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447dc47-4ea4-46a0-9d38-cae173c021e1 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:10.510065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447dc47-4ea4-46a0-9d38-cae173c021e1 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:10.543454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6eb8d-a75c-4e9e-a367-875034423f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:10.544121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6eb8d-a75c-4e9e-a367-875034423f35 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:10.544406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6eb8d-a75c-4e9e-a367-875034423f35 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:10.544713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6eb8d-a75c-4e9e-a367-875034423f35 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:10.545430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6eb8d-a75c-4e9e-a367-875034423f35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:10.545738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6eb8d-a75c-4e9e-a367-875034423f35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:10.547104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6eb8d-a75c-4e9e-a367-875034423f35 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:10.564634 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 546/1084] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:11.900103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98097e25-d17f-4d33-8a3b-ac98614e6233 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:11.900721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98097e25-d17f-4d33-8a3b-ac98614e6233 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:11.900721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98097e25-d17f-4d33-8a3b-ac98614e6233 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:11.902198 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 539/1085] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:59:11.907103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1204878-1d0a-4a4a-9682-27086eb63d8b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:11.907532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1204878-1d0a-4a4a-9682-27086eb63d8b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:11.907681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1204878-1d0a-4a4a-9682-27086eb63d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:11.923921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e1204878-1d0a-4a4a-9682-27086eb63d8b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:11.925136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e1204878-1d0a-4a4a-9682-27086eb63d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:11.987709 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 547/1086] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 09:59:12.013490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98097e25-d17f-4d33-8a3b-ac98614e6233 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:12.116916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98097e25-d17f-4d33-8a3b-ac98614e6233 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:12.148954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ddd1d-e8db-43ee-8ce1-f15a354616d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:12.149755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ddd1d-e8db-43ee-8ce1-f15a354616d6 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:12.150038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ddd1d-e8db-43ee-8ce1-f15a354616d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:12.150365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ddd1d-e8db-43ee-8ce1-f15a354616d6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:12.160396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ddd1d-e8db-43ee-8ce1-f15a354616d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:59:12.168364 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-da5ddd1d-e8db-43ee-8ce1-f15a354616d6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 02 09:59:12.168364 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:12.168364 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:12.168364 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:12.168364 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:12.168364 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:12.168364 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:12.168364 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:12.168364 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:12.168364 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:12.168364 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:12.168364 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:12.168364 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:59:12.168364 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:59:12.168364 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:59:12.168364 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:59:12.169546 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:59:12.169546 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:59:12.169546 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:59:12.169546 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:59:12.169546 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:12.169546 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:12.169546 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:12.169546 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:12.169546 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:12.169546 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:12.169546 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:12.169546 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:59:12.169546 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:12.169546 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:12.169546 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:12.169546 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:12.170408 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:12.170408 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:12.170408 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:12.170408 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:12.170408 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:59:12.170408 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:59:12.170408 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:59:12.170408 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:59:12.170408 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:59:12.170408 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:59:12.170408 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 02 09:59:12.170408 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:59:12.170408 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 540/1087] 10.222.0.16 () {56 vars in 1120 bytes} [Mon May 2 09:59:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:59:12.175485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1204878-1d0a-4a4a-9682-27086eb63d8b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:12.273135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1204878-1d0a-4a4a-9682-27086eb63d8b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:12.305470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53f076-bcea-4d33-b48c-e3ea68f3d28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:12.306136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53f076-bcea-4d33-b48c-e3ea68f3d28e None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:12.306416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53f076-bcea-4d33-b48c-e3ea68f3d28e None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:12.306693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53f076-bcea-4d33-b48c-e3ea68f3d28e None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:12.307436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53f076-bcea-4d33-b48c-e3ea68f3d28e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:12.307744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53f076-bcea-4d33-b48c-e3ea68f3d28e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:12.309153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53f076-bcea-4d33-b48c-e3ea68f3d28e None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:12.316820 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 548/1088] 10.222.0.16 () {56 vars in 1115 bytes} [Mon May 2 09:59:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:12.322512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ddd1d-e8db-43ee-8ce1-f15a354616d6 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:12.389881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430bbe6-576d-4694-b6fa-3ce19ce2ee19 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:12.390162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430bbe6-576d-4694-b6fa-3ce19ce2ee19 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:12.390444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430bbe6-576d-4694-b6fa-3ce19ce2ee19 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:12.391781 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 549/1089] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 09:59:12.396479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77a4a3-c308-4d64-b5c2-7ea63d04b71c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:12.396794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77a4a3-c308-4d64-b5c2-7ea63d04b71c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:12.397076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77a4a3-c308-4d64-b5c2-7ea63d04b71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:12.413408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2c77a4a3-c308-4d64-b5c2-7ea63d04b71c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:12.414492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2c77a4a3-c308-4d64-b5c2-7ea63d04b71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:12.417532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ddd1d-e8db-43ee-8ce1-f15a354616d6 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:12.449353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f5c2c-530f-457d-ac17-a39f861af561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:12.450138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f5c2c-530f-457d-ac17-a39f861af561 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:12.450419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f5c2c-530f-457d-ac17-a39f861af561 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:12.450696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f5c2c-530f-457d-ac17-a39f861af561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:12.460128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f5c2c-530f-457d-ac17-a39f861af561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:12.461606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f5c2c-530f-457d-ac17-a39f861af561 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:12.477124 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 550/1090] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 09:59:12.479429 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-161f5c2c-530f-457d-ac17-a39f861af561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:59:12.479429 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:12.479429 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:12.479429 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:12.479429 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:12.479429 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:12.479429 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:12.479429 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:12.479429 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:12.479429 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:12.479429 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:12.479429 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:12.479429 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:59:12.479429 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:59:12.479429 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:59:12.480519 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:59:12.480519 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:12.480519 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:12.480519 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:12.480519 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:12.480519 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:12.480519 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:12.480519 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:12.480519 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:59:12.480519 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:12.480519 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:12.480519 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:12.480519 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:12.480519 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:12.480519 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:12.480519 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:12.480519 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:12.481680 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:59:12.481680 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:59:12.481680 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:59:12.481680 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:59:12.484749 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 541/1091] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:59:12.486249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77a4a3-c308-4d64-b5c2-7ea63d04b71c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:12.501823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f5c2c-530f-457d-ac17-a39f861af561 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:12.581149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77a4a3-c308-4d64-b5c2-7ea63d04b71c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:12.594563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f5c2c-530f-457d-ac17-a39f861af561 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:12.613002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6630b-25bb-4404-b73b-875d1c2933af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:12.613605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6630b-25bb-4404-b73b-875d1c2933af None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:12.614139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6630b-25bb-4404-b73b-875d1c2933af None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:12.614415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6630b-25bb-4404-b73b-875d1c2933af None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:12.615758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6630b-25bb-4404-b73b-875d1c2933af None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:12.616069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6630b-25bb-4404-b73b-875d1c2933af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:12.617470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6630b-25bb-4404-b73b-875d1c2933af None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:12.628341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a71c2-f89b-42fe-b9c9-ec4a31ef5294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:12.628500 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 551/1092] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:59:12.629234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a71c2-f89b-42fe-b9c9-ec4a31ef5294 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:12.629581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a71c2-f89b-42fe-b9c9-ec4a31ef5294 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:12.629867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a71c2-f89b-42fe-b9c9-ec4a31ef5294 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:12.633916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6630b-25bb-4404-b73b-875d1c2933af None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:12.640304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a71c2-f89b-42fe-b9c9-ec4a31ef5294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:59:12.648307 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-989a71c2-f89b-42fe-b9c9-ec4a31ef5294 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:59:12.648307 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:12.648307 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:12.648307 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:12.648307 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:12.648307 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:12.648307 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:12.648307 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:12.648307 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:12.648307 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:12.648307 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:12.648307 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:12.648307 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:59:12.648307 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:59:12.648307 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:59:12.648307 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:59:12.649275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:59:12.649275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:59:12.649275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:59:12.649275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:59:12.649275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:12.649275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:12.649275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:12.649275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:12.649275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:12.649275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:12.649275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:12.649275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:59:12.649275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:12.649275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:12.649275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:12.649275 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:12.655200 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:12.655200 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:12.655200 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:12.655200 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:12.655200 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:59:12.655200 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:59:12.655200 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:59:12.655200 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:59:12.655200 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:59:12.655200 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:59:12.655200 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:59:12.655200 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:59:12.655200 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 542/1093] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:59:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:59:12.655896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a71c2-f89b-42fe-b9c9-ec4a31ef5294 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:12.730271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6630b-25bb-4404-b73b-875d1c2933af None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:12.751802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a71c2-f89b-42fe-b9c9-ec4a31ef5294 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:12.761046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e9c71-4fa1-4ccf-a213-266c70a9cfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:12.761831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e9c71-4fa1-4ccf-a213-266c70a9cfec None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:12.762113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e9c71-4fa1-4ccf-a213-266c70a9cfec None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:12.762391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e9c71-4fa1-4ccf-a213-266c70a9cfec None admin] PATH_INFO: `/v3/users/nova` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:12.769459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e9c71-4fa1-4ccf-a213-266c70a9cfec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:12.770896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e9c71-4fa1-4ccf-a213-266c70a9cfec None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:12.783578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedf189-ab2d-47bc-a236-24ed63864bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:12.784239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedf189-ab2d-47bc-a236-24ed63864bd7 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:12.784526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedf189-ab2d-47bc-a236-24ed63864bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:12.784757 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-376e9c71-4fa1-4ccf-a213-266c70a9cfec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 02 09:59:12.784757 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:12.784757 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:12.784757 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:12.784757 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:12.784757 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:12.784757 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:12.784757 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:12.784757 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:12.784757 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:12.784757 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:12.784757 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:12.784757 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 09:59:12.784757 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 09:59:12.784757 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 09:59:12.784757 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 09:59:12.785775 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:12.785775 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:12.785775 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 09:59:12.785775 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:59:12.785775 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 09:59:12.785775 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 09:59:12.785775 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:12.785775 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:12.785775 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:12.785775 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:12.785775 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:12.785775 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:59:12.785775 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:12.785775 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:12.785775 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:12.785775 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:12.785775 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:12.785775 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:12.787813 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:12.787813 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:12.787813 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 09:59:12.787813 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 09:59:12.787813 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 09:59:12.787813 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 09:59:12.787813 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 09:59:12.787813 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 09:59:12.787813 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 02 09:59:12.787813 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:59:12.788477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedf189-ab2d-47bc-a236-24ed63864bd7 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:12.788477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedf189-ab2d-47bc-a236-24ed63864bd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:12.788477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedf189-ab2d-47bc-a236-24ed63864bd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:12.788751 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 552/1094] 10.222.0.16 () {56 vars in 1093 bytes} [Mon May 2 09:59:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 09:59:12.788838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedf189-ab2d-47bc-a236-24ed63864bd7 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:12.792133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e9c71-4fa1-4ccf-a213-266c70a9cfec None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:12.800727 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 543/1095] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:59:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:59:12.801679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedf189-ab2d-47bc-a236-24ed63864bd7 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:12.883684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e9c71-4fa1-4ccf-a213-266c70a9cfec None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:12.894424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedf189-ab2d-47bc-a236-24ed63864bd7 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:12.915810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf7fa3-6236-403e-870d-91012ee8a43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:12.916477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf7fa3-6236-403e-870d-91012ee8a43f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:12.916798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf7fa3-6236-403e-870d-91012ee8a43f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:12.917083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf7fa3-6236-403e-870d-91012ee8a43f None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:12.917916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf7fa3-6236-403e-870d-91012ee8a43f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:12.918232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf7fa3-6236-403e-870d-91012ee8a43f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:12.919668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf7fa3-6236-403e-870d-91012ee8a43f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:12.926319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95bd8ec-8bc5-481b-9204-58a6ceff46ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:12.927181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bd8ec-8bc5-481b-9204-58a6ceff46ac None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:12.927557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bd8ec-8bc5-481b-9204-58a6ceff46ac None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:12.927837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95bd8ec-8bc5-481b-9204-58a6ceff46ac None admin] PATH_INFO: `/v3/users/c0e3df552ce1465498b74b578cb788c6` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:12.929071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95bd8ec-8bc5-481b-9204-58a6ceff46ac None admin] RBAC: Authorizing `identity:get_user(user_id=c0e3df552ce1465498b74b578cb788c6)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:12.930461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95bd8ec-8bc5-481b-9204-58a6ceff46ac None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:12.932072 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 544/1096] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:59:12 2022] GET /identity/v3/users/c0e3df552ce1465498b74b578cb788c6 => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:59:12.940674 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 553/1097] 10.222.0.16 () {56 vars in 1133 bytes} [Mon May 2 09:59:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:59:12.940828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95bd8ec-8bc5-481b-9204-58a6ceff46ac None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:12.941979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf7fa3-6236-403e-870d-91012ee8a43f None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:13.030194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95bd8ec-8bc5-481b-9204-58a6ceff46ac None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:13.034095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf7fa3-6236-403e-870d-91012ee8a43f None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:13.062102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3c567-94b8-426f-9c76-e94fb7d1ad8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:13.062741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3c567-94b8-426f-9c76-e94fb7d1ad8a None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:13.063024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3c567-94b8-426f-9c76-e94fb7d1ad8a None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:13.063299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3c567-94b8-426f-9c76-e94fb7d1ad8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:13.066145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7fa07-454f-42d8-9f67-370d6f0c9a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:13.066789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7fa07-454f-42d8-9f67-370d6f0c9a06 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:13.067077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7fa07-454f-42d8-9f67-370d6f0c9a06 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:13.067357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7fa07-454f-42d8-9f67-370d6f0c9a06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:13.128047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3c567-94b8-426f-9c76-e94fb7d1ad8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:13.129522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3c567-94b8-426f-9c76-e94fb7d1ad8a None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:13.132809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7fa07-454f-42d8-9f67-370d6f0c9a06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:13.134257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7fa07-454f-42d8-9f67-370d6f0c9a06 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:13.222605 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 545/1098] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:59:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 09:59:13.228630 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 554/1099] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:59:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 02 09:59:13.231919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7fa07-454f-42d8-9f67-370d6f0c9a06 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:13.232050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3c567-94b8-426f-9c76-e94fb7d1ad8a None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:13.322575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7fa07-454f-42d8-9f67-370d6f0c9a06 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:13.322869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3c567-94b8-426f-9c76-e94fb7d1ad8a None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:13.354494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba893b-13ae-46a9-a60c-53b8628b9a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:13.354698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f8652-609c-4d0d-bd61-123a82f4b6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:13.355285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba893b-13ae-46a9-a60c-53b8628b9a6a None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:13.355462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f8652-609c-4d0d-bd61-123a82f4b6c0 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:13.355573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba893b-13ae-46a9-a60c-53b8628b9a6a None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:13.355743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f8652-609c-4d0d-bd61-123a82f4b6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:13.355835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba893b-13ae-46a9-a60c-53b8628b9a6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:13.356019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f8652-609c-4d0d-bd61-123a82f4b6c0 None admin] PATH_INFO: `/v3/projects/f73db4799a374a5cae7ad46a90a853bb` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:13.357203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f8652-609c-4d0d-bd61-123a82f4b6c0 None admin] RBAC: Authorizing `identity:get_project(project_id=f73db4799a374a5cae7ad46a90a853bb)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:13.358611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f8652-609c-4d0d-bd61-123a82f4b6c0 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:13.360278 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 546/1100] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:59:13 2022] GET /identity/v3/projects/f73db4799a374a5cae7ad46a90a853bb => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:13.366318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba893b-13ae-46a9-a60c-53b8628b9a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:13.366504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f8652-609c-4d0d-bd61-123a82f4b6c0 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:13.367810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba893b-13ae-46a9-a60c-53b8628b9a6a None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:13.385324 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-e5ba893b-13ae-46a9-a60c-53b8628b9a6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:59:13.385324 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:13.385324 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:13.385324 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:13.385324 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:13.385324 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:13.385324 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:13.385324 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:13.385324 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:13.385324 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:13.385324 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:13.385324 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:13.385324 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:59:13.385324 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:59:13.385324 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:59:13.386312 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:59:13.386312 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:13.386312 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:13.386312 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:13.386312 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:13.386312 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:13.386312 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:13.386312 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:13.386312 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:59:13.386312 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:13.386312 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:13.386312 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:13.386312 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:13.386312 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:13.386312 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:13.386312 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:13.386312 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:13.387365 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 09:59:13.387365 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:59:13.387365 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 09:59:13.387365 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:59:13.387365 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 555/1101] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:59:13.393194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba893b-13ae-46a9-a60c-53b8628b9a6a None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:13.457434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f8652-609c-4d0d-bd61-123a82f4b6c0 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:13.484324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba893b-13ae-46a9-a60c-53b8628b9a6a None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:13.488322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0ba47-0030-4238-ae35-a2934043de52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:13.489249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0ba47-0030-4238-ae35-a2934043de52 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:13.489526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0ba47-0030-4238-ae35-a2934043de52 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:13.493534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0ba47-0030-4238-ae35-a2934043de52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:13.493534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0ba47-0030-4238-ae35-a2934043de52 None admin] RBAC: Adding query filter params (role.id=dd8a47ade22941849ebdf8fbdf994b66, scope.project.id=f73db4799a374a5cae7ad46a90a853bb, user.id=c0e3df552ce1465498b74b578cb788c6) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:13.493534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0ba47-0030-4238-ae35-a2934043de52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:13.493534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0ba47-0030-4238-ae35-a2934043de52 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:13.498501 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 547/1102] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:59:13 2022] GET /identity/v3/role_assignments?user.id=c0e3df552ce1465498b74b578cb788c6&scope.project.id=f73db4799a374a5cae7ad46a90a853bb&role.id=dd8a47ade22941849ebdf8fbdf994b66 => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:59:13.518813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db695b5e-622f-4e34-b0ea-2bb4ddd165d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:13.519507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db695b5e-622f-4e34-b0ea-2bb4ddd165d5 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:13.519795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db695b5e-622f-4e34-b0ea-2bb4ddd165d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:13.520075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db695b5e-622f-4e34-b0ea-2bb4ddd165d5 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:13.520865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db695b5e-622f-4e34-b0ea-2bb4ddd165d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:13.526218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db695b5e-622f-4e34-b0ea-2bb4ddd165d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:13.526218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db695b5e-622f-4e34-b0ea-2bb4ddd165d5 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:13.535272 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 556/1103] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 09:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:59:13.541390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0ba47-0030-4238-ae35-a2934043de52 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:13.641000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0ba47-0030-4238-ae35-a2934043de52 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:13.673799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5462e-812c-4464-b6b0-dd7726650e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:13.674612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5462e-812c-4464-b6b0-dd7726650e94 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:13.674877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5462e-812c-4464-b6b0-dd7726650e94 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:13.675153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5462e-812c-4464-b6b0-dd7726650e94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:13.682394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5462e-812c-4464-b6b0-dd7726650e94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:13.683859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5462e-812c-4464-b6b0-dd7726650e94 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:13.698318 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-ebd5462e-812c-4464-b6b0-dd7726650e94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:59:13.698318 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:13.698318 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:13.698318 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:13.698318 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:13.698318 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:13.698318 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:13.698318 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:13.698318 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:13.698318 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:13.698318 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:13.698318 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:13.698318 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 09:59:13.698318 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 09:59:13.698318 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 09:59:13.699290 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 09:59:13.699290 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:13.699290 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:13.699290 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:13.699290 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:13.699290 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:13.699290 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:13.699290 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:13.699290 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:59:13.699290 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:13.699290 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:13.699290 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:13.699290 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:13.699290 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:13.699290 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:13.699290 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:13.699290 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:13.700195 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 09:59:13.700195 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 09:59:13.700195 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:59:13.700195 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:59:13.700195 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:59:13.700195 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:59:13.700195 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 09:59:13.700195 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:59:13.700195 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 548/1104] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 09:59:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:59:13.707143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db695b5e-622f-4e34-b0ea-2bb4ddd165d5 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:13.808267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db695b5e-622f-4e34-b0ea-2bb4ddd165d5 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:13.839232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be54e66-3433-423d-a306-8d045363e2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:13.839893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be54e66-3433-423d-a306-8d045363e2d1 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:13.840177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be54e66-3433-423d-a306-8d045363e2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:13.840452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be54e66-3433-423d-a306-8d045363e2d1 None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:13.841263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be54e66-3433-423d-a306-8d045363e2d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:13.841574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be54e66-3433-423d-a306-8d045363e2d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:13.843003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be54e66-3433-423d-a306-8d045363e2d1 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:13.855083 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 557/1105] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 09:59:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:13.861062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5462e-812c-4464-b6b0-dd7726650e94 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:13.954663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5462e-812c-4464-b6b0-dd7726650e94 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:13.986462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f1e29-71a5-4fcb-a9a1-8f74d181a018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:13.987107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f1e29-71a5-4fcb-a9a1-8f74d181a018 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:13.987447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f1e29-71a5-4fcb-a9a1-8f74d181a018 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:13.987731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f1e29-71a5-4fcb-a9a1-8f74d181a018 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:13.988583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f1e29-71a5-4fcb-a9a1-8f74d181a018 None admin] RBAC: Adding query filter params (role.id=0ef68f89f9394078b95445392557cd47, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=e6036dd39fb74289a8cbdcd6a21f8662) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:13.989193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f1e29-71a5-4fcb-a9a1-8f74d181a018 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:13.991207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f1e29-71a5-4fcb-a9a1-8f74d181a018 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:13.996739 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 549/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:59:13 2022] GET /identity/v3/role_assignments?user.id=e6036dd39fb74289a8cbdcd6a21f8662&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=0ef68f89f9394078b95445392557cd47 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:15.825330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cd96a-7113-49b9-a768-8bbc43ef3aa0 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:15.825897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cd96a-7113-49b9-a768-8bbc43ef3aa0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:15.825897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cd96a-7113-49b9-a768-8bbc43ef3aa0 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:15.827243 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 558/1107] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:59:15.832483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412e96b-8e69-4182-822b-8a4ba2272695 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:15.833047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412e96b-8e69-4182-822b-8a4ba2272695 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:15.833158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412e96b-8e69-4182-822b-8a4ba2272695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:15.850300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4412e96b-8e69-4182-822b-8a4ba2272695 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:15.851474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4412e96b-8e69-4182-822b-8a4ba2272695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:15.915121 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 550/1108] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:59:15.941291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cd96a-7113-49b9-a768-8bbc43ef3aa0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:16.035667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cd96a-7113-49b9-a768-8bbc43ef3aa0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:16.067233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c96d17-e2e5-4e29-8e2b-f1cd0ce23be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:16.068005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c96d17-e2e5-4e29-8e2b-f1cd0ce23be7 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:16.068835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c96d17-e2e5-4e29-8e2b-f1cd0ce23be7 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:16.069114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c96d17-e2e5-4e29-8e2b-f1cd0ce23be7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:16.070281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c96d17-e2e5-4e29-8e2b-f1cd0ce23be7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:16.071713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c96d17-e2e5-4e29-8e2b-f1cd0ce23be7 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:16.073329 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 559/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:59:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:16.078956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412e96b-8e69-4182-822b-8a4ba2272695 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:16.171884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412e96b-8e69-4182-822b-8a4ba2272695 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:16.203210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22991e-9de4-4216-ae9b-89978ae96f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:16.203862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22991e-9de4-4216-ae9b-89978ae96f3a None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:16.204144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22991e-9de4-4216-ae9b-89978ae96f3a None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:16.204418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22991e-9de4-4216-ae9b-89978ae96f3a None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:16.205146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22991e-9de4-4216-ae9b-89978ae96f3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:16.206574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22991e-9de4-4216-ae9b-89978ae96f3a None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:16.311659 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 551/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Mon May 2 09:59:16 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 09:59:18.648569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e93f2-0532-43b7-b057-5deb8877c36e None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:18.649150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e93f2-0532-43b7-b057-5deb8877c36e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:18.649150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e93f2-0532-43b7-b057-5deb8877c36e None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:18.650485 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 560/1111] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:59:18.655518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d8b26-c289-4f67-b66d-5eef2eaef2e1 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:18.655886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d8b26-c289-4f67-b66d-5eef2eaef2e1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:18.656071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d8b26-c289-4f67-b66d-5eef2eaef2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:18.672455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-309d8b26-c289-4f67-b66d-5eef2eaef2e1 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:18.673650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-309d8b26-c289-4f67-b66d-5eef2eaef2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:18.735254 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 552/1112] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:59:18.759473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e93f2-0532-43b7-b057-5deb8877c36e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:18.853400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e93f2-0532-43b7-b057-5deb8877c36e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:18.884413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adad18-4f06-44e5-90de-2bbe60070109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:18.885281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adad18-4f06-44e5-90de-2bbe60070109 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:18.885567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adad18-4f06-44e5-90de-2bbe60070109 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:18.885845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adad18-4f06-44e5-90de-2bbe60070109 None admin] PATH_INFO: `/v3/roles/9d0cb59f15d2481eace97516b3b77a71` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:18.887309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adad18-4f06-44e5-90de-2bbe60070109 None admin] RBAC: Authorizing `identity:get_role(role_id=9d0cb59f15d2481eace97516b3b77a71)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:18.888703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adad18-4f06-44e5-90de-2bbe60070109 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:18.890038 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 561/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:59:18 2022] GET /identity/v3/roles/9d0cb59f15d2481eace97516b3b77a71 => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:18.895636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d8b26-c289-4f67-b66d-5eef2eaef2e1 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:18.987313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d8b26-c289-4f67-b66d-5eef2eaef2e1 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:19.018287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a86ab3-6881-4933-8f66-9061fc92ece5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:19.019130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a86ab3-6881-4933-8f66-9061fc92ece5 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:19.019406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a86ab3-6881-4933-8f66-9061fc92ece5 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:19.019676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a86ab3-6881-4933-8f66-9061fc92ece5 None admin] PATH_INFO: `/v3/users/5e5bffffa245430a915f570aa3015559` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:19.032347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a86ab3-6881-4933-8f66-9061fc92ece5 None admin] RBAC: Authorizing `identity:get_user(user_id=5e5bffffa245430a915f570aa3015559)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:19.033800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a86ab3-6881-4933-8f66-9061fc92ece5 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:19.035395 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 553/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:59:18 2022] GET /identity/v3/users/5e5bffffa245430a915f570aa3015559 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:19.041565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adad18-4f06-44e5-90de-2bbe60070109 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:19.133704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adad18-4f06-44e5-90de-2bbe60070109 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:19.165864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5513a9a-9377-4998-aad9-2aad6d9d715e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:19.166510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5513a9a-9377-4998-aad9-2aad6d9d715e None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:19.166791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5513a9a-9377-4998-aad9-2aad6d9d715e None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:19.167066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5513a9a-9377-4998-aad9-2aad6d9d715e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:19.229365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5513a9a-9377-4998-aad9-2aad6d9d715e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:19.230798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5513a9a-9377-4998-aad9-2aad6d9d715e None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:19.322058 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 562/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:59:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 09:59:19.327929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a86ab3-6881-4933-8f66-9061fc92ece5 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:19.419845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a86ab3-6881-4933-8f66-9061fc92ece5 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:19.451382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8983e5-1c93-40a5-b076-9ecf44253975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:19.452230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8983e5-1c93-40a5-b076-9ecf44253975 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:19.452507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8983e5-1c93-40a5-b076-9ecf44253975 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:19.452800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8983e5-1c93-40a5-b076-9ecf44253975 None admin] PATH_INFO: `/v3/projects/f73db4799a374a5cae7ad46a90a853bb` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:19.453962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8983e5-1c93-40a5-b076-9ecf44253975 None admin] RBAC: Authorizing `identity:get_project(project_id=f73db4799a374a5cae7ad46a90a853bb)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:19.455366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8983e5-1c93-40a5-b076-9ecf44253975 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:19.457069 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 554/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:59:19 2022] GET /identity/v3/projects/f73db4799a374a5cae7ad46a90a853bb => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:19.463067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5513a9a-9377-4998-aad9-2aad6d9d715e None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:19.553062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5513a9a-9377-4998-aad9-2aad6d9d715e None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:19.584055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49f78d-ea6c-4c9e-9b30-d171d220e44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:19.584649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49f78d-ea6c-4c9e-9b30-d171d220e44c None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:19.584933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49f78d-ea6c-4c9e-9b30-d171d220e44c None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:19.585209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49f78d-ea6c-4c9e-9b30-d171d220e44c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:19.586019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49f78d-ea6c-4c9e-9b30-d171d220e44c None admin] RBAC: Adding query filter params (role.id=9d0cb59f15d2481eace97516b3b77a71, scope.project.id=f73db4799a374a5cae7ad46a90a853bb, user.id=5e5bffffa245430a915f570aa3015559) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:19.586327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49f78d-ea6c-4c9e-9b30-d171d220e44c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:19.587737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49f78d-ea6c-4c9e-9b30-d171d220e44c None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:19.592837 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 563/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:59:19 2022] GET /identity/v3/role_assignments?user.id=5e5bffffa245430a915f570aa3015559&scope.project.id=f73db4799a374a5cae7ad46a90a853bb&role.id=9d0cb59f15d2481eace97516b3b77a71 => generated 259 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:21.846801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08c466-6956-4b42-9aca-3745f711bbd9 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:21.847334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08c466-6956-4b42-9aca-3745f711bbd9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:21.847453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08c466-6956-4b42-9aca-3745f711bbd9 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:21.848791 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 555/1118] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:59:21.854014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f195d-b666-4c46-b843-55cdba1d3dc1 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:21.854386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f195d-b666-4c46-b843-55cdba1d3dc1 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:21.854573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f195d-b666-4c46-b843-55cdba1d3dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:21.871275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-102f195d-b666-4c46-b843-55cdba1d3dc1 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:21.872434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-102f195d-b666-4c46-b843-55cdba1d3dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:21.933271 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 564/1119] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:59:21.956528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08c466-6956-4b42-9aca-3745f711bbd9 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:22.051277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08c466-6956-4b42-9aca-3745f711bbd9 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:22.082598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234e5d7-c25f-4c22-87da-0697504ba005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:22.083436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234e5d7-c25f-4c22-87da-0697504ba005 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:22.083721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234e5d7-c25f-4c22-87da-0697504ba005 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:22.084001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234e5d7-c25f-4c22-87da-0697504ba005 None admin] PATH_INFO: `/v3/roles/9d0cb59f15d2481eace97516b3b77a71` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:22.085487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234e5d7-c25f-4c22-87da-0697504ba005 None admin] RBAC: Authorizing `identity:get_role(role_id=9d0cb59f15d2481eace97516b3b77a71)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:22.086834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234e5d7-c25f-4c22-87da-0697504ba005 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:22.088176 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 556/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:59:21 2022] GET /identity/v3/roles/9d0cb59f15d2481eace97516b3b77a71 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:22.093866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f195d-b666-4c46-b843-55cdba1d3dc1 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:22.187594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f195d-b666-4c46-b843-55cdba1d3dc1 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:22.219590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f5e09-f310-4fec-9f96-d41c63c3e974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:22.220564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f5e09-f310-4fec-9f96-d41c63c3e974 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:22.220873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f5e09-f310-4fec-9f96-d41c63c3e974 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:22.221154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f5e09-f310-4fec-9f96-d41c63c3e974 None admin] PATH_INFO: `/v3/users/5e5bffffa245430a915f570aa3015559` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:22.222339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f5e09-f310-4fec-9f96-d41c63c3e974 None admin] RBAC: Authorizing `identity:get_user(user_id=5e5bffffa245430a915f570aa3015559)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:22.223776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f5e09-f310-4fec-9f96-d41c63c3e974 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:22.225944 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 565/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:59:22 2022] GET /identity/v3/users/5e5bffffa245430a915f570aa3015559 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:22.231855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234e5d7-c25f-4c22-87da-0697504ba005 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:22.326233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234e5d7-c25f-4c22-87da-0697504ba005 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:22.357896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ccdc5-1abf-4b62-9e7a-6ad097e8dffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:22.358674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ccdc5-1abf-4b62-9e7a-6ad097e8dffd None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:22.358954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ccdc5-1abf-4b62-9e7a-6ad097e8dffd None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:22.359226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ccdc5-1abf-4b62-9e7a-6ad097e8dffd None admin] PATH_INFO: `/v3/projects/f73db4799a374a5cae7ad46a90a853bb` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:22.360394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ccdc5-1abf-4b62-9e7a-6ad097e8dffd None admin] RBAC: Authorizing `identity:get_project(project_id=f73db4799a374a5cae7ad46a90a853bb)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:22.361852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ccdc5-1abf-4b62-9e7a-6ad097e8dffd None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:22.363560 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 557/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:59:22 2022] GET /identity/v3/projects/f73db4799a374a5cae7ad46a90a853bb => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:22.370277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f5e09-f310-4fec-9f96-d41c63c3e974 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:22.460968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f5e09-f310-4fec-9f96-d41c63c3e974 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:22.492105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6f013-8c44-40f1-ba0f-b5726fc69d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:22.492999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6f013-8c44-40f1-ba0f-b5726fc69d01 None admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:22.493281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6f013-8c44-40f1-ba0f-b5726fc69d01 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:22.493556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6f013-8c44-40f1-ba0f-b5726fc69d01 None admin] PATH_INFO: `/v3/projects/f73db4799a374a5cae7ad46a90a853bb/users/5e5bffffa245430a915f570aa3015559/roles/9d0cb59f15d2481eace97516b3b77a71` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:22.495693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6f013-8c44-40f1-ba0f-b5726fc69d01 None admin] RBAC: Authorizing `identity:create_grant(project_id=f73db4799a374a5cae7ad46a90a853bb, user_id=5e5bffffa245430a915f570aa3015559, role_id=9d0cb59f15d2481eace97516b3b77a71)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:22.497148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6f013-8c44-40f1-ba0f-b5726fc69d01 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:22.562816 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 566/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 09:59:22 2022] PUT /identity/v3/projects/f73db4799a374a5cae7ad46a90a853bb/users/5e5bffffa245430a915f570aa3015559/roles/9d0cb59f15d2481eace97516b3b77a71 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:59:24.827162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398333e-2d2b-47f1-9120-c0b3c02ce4d9 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:24.827694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398333e-2d2b-47f1-9120-c0b3c02ce4d9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:24.827811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398333e-2d2b-47f1-9120-c0b3c02ce4d9 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:24.829144 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 558/1124] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:59:24.834690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b68e3-1cc4-4df9-adfb-5e4dd660cc52 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:24.835131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b68e3-1cc4-4df9-adfb-5e4dd660cc52 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:24.835249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b68e3-1cc4-4df9-adfb-5e4dd660cc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:24.851905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-768b68e3-1cc4-4df9-adfb-5e4dd660cc52 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:24.853109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-768b68e3-1cc4-4df9-adfb-5e4dd660cc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:24.915170 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 567/1125] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:59:24.939513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398333e-2d2b-47f1-9120-c0b3c02ce4d9 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:25.033936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398333e-2d2b-47f1-9120-c0b3c02ce4d9 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:25.064729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04d7c8-e38a-4366-a68f-936bdfec5173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:25.065562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04d7c8-e38a-4366-a68f-936bdfec5173 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:25.065839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04d7c8-e38a-4366-a68f-936bdfec5173 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:25.066107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04d7c8-e38a-4366-a68f-936bdfec5173 None admin] PATH_INFO: `/v3/roles/9d0cb59f15d2481eace97516b3b77a71` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:25.067626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04d7c8-e38a-4366-a68f-936bdfec5173 None admin] RBAC: Authorizing `identity:get_role(role_id=9d0cb59f15d2481eace97516b3b77a71)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:25.069520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04d7c8-e38a-4366-a68f-936bdfec5173 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:25.070844 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 559/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:59:24 2022] GET /identity/v3/roles/9d0cb59f15d2481eace97516b3b77a71 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:25.076531 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b68e3-1cc4-4df9-adfb-5e4dd660cc52 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:25.167520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b68e3-1cc4-4df9-adfb-5e4dd660cc52 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:25.198744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71197c19-22b5-4cda-9901-570a0f6b44e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:25.199599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71197c19-22b5-4cda-9901-570a0f6b44e8 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:25.199882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71197c19-22b5-4cda-9901-570a0f6b44e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:25.200156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71197c19-22b5-4cda-9901-570a0f6b44e8 None admin] PATH_INFO: `/v3/users/5e5bffffa245430a915f570aa3015559` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:25.201350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71197c19-22b5-4cda-9901-570a0f6b44e8 None admin] RBAC: Authorizing `identity:get_user(user_id=5e5bffffa245430a915f570aa3015559)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:25.202772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71197c19-22b5-4cda-9901-570a0f6b44e8 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:25.204368 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 568/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:59:25 2022] GET /identity/v3/users/5e5bffffa245430a915f570aa3015559 => generated 286 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:25.210657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04d7c8-e38a-4366-a68f-936bdfec5173 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:25.304758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04d7c8-e38a-4366-a68f-936bdfec5173 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:25.336699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2afdaa-473d-4bce-82e8-215009474210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:25.337753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2afdaa-473d-4bce-82e8-215009474210 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:25.337753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2afdaa-473d-4bce-82e8-215009474210 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:25.337929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2afdaa-473d-4bce-82e8-215009474210 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:25.399563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2afdaa-473d-4bce-82e8-215009474210 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:25.401094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2afdaa-473d-4bce-82e8-215009474210 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:25.490993 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 560/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:59:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 02 09:59:25.496757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71197c19-22b5-4cda-9901-570a0f6b44e8 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:25.592561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71197c19-22b5-4cda-9901-570a0f6b44e8 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:25.623844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803927f-8c5d-41e3-9fd1-1b43332cad9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:25.624705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803927f-8c5d-41e3-9fd1-1b43332cad9c None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:25.624988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803927f-8c5d-41e3-9fd1-1b43332cad9c None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:25.625257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803927f-8c5d-41e3-9fd1-1b43332cad9c None admin] PATH_INFO: `/v3/projects/f73db4799a374a5cae7ad46a90a853bb` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:25.626410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803927f-8c5d-41e3-9fd1-1b43332cad9c None admin] RBAC: Authorizing `identity:get_project(project_id=f73db4799a374a5cae7ad46a90a853bb)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:25.627824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803927f-8c5d-41e3-9fd1-1b43332cad9c None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:25.629490 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 569/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:59:25 2022] GET /identity/v3/projects/f73db4799a374a5cae7ad46a90a853bb => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:25.636071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2afdaa-473d-4bce-82e8-215009474210 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:25.726539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2afdaa-473d-4bce-82e8-215009474210 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:25.758474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceff93d-3ee1-4af5-afcd-21349b5a444d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:25.759109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceff93d-3ee1-4af5-afcd-21349b5a444d None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:25.759394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceff93d-3ee1-4af5-afcd-21349b5a444d None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:25.759672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceff93d-3ee1-4af5-afcd-21349b5a444d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:25.760487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceff93d-3ee1-4af5-afcd-21349b5a444d None admin] RBAC: Adding query filter params (role.id=9d0cb59f15d2481eace97516b3b77a71, scope.project.id=f73db4799a374a5cae7ad46a90a853bb, user.id=5e5bffffa245430a915f570aa3015559) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:25.760832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceff93d-3ee1-4af5-afcd-21349b5a444d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:25.762241 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceff93d-3ee1-4af5-afcd-21349b5a444d None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:25.767718 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 561/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:59:25 2022] GET /identity/v3/role_assignments?user.id=5e5bffffa245430a915f570aa3015559&scope.project.id=f73db4799a374a5cae7ad46a90a853bb&role.id=9d0cb59f15d2481eace97516b3b77a71 => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:28.063924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27014f77-9a92-48de-9d9a-703bf5230852 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:28.064451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27014f77-9a92-48de-9d9a-703bf5230852 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:28.064565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27014f77-9a92-48de-9d9a-703bf5230852 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:28.065917 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 570/1131] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:59:28.071532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d3fbb-6d90-4a09-a5b0-d9b1c6ee3195 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:28.071910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d3fbb-6d90-4a09-a5b0-d9b1c6ee3195 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:28.072088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d3fbb-6d90-4a09-a5b0-d9b1c6ee3195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:28.089482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d43d3fbb-6d90-4a09-a5b0-d9b1c6ee3195 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:28.090649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d43d3fbb-6d90-4a09-a5b0-d9b1c6ee3195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:28.153248 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 562/1132] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:59:28.177448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27014f77-9a92-48de-9d9a-703bf5230852 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:28.273718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27014f77-9a92-48de-9d9a-703bf5230852 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:28.304986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdbf39-74c1-437b-a4ac-7a6b1623f39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:28.305772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdbf39-74c1-437b-a4ac-7a6b1623f39c None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:28.306055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdbf39-74c1-437b-a4ac-7a6b1623f39c None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:28.306336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdbf39-74c1-437b-a4ac-7a6b1623f39c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:28.307530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fdbf39-74c1-437b-a4ac-7a6b1623f39c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:28.309007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fdbf39-74c1-437b-a4ac-7a6b1623f39c None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:28.310612 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 571/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:59:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:28.316553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d3fbb-6d90-4a09-a5b0-d9b1c6ee3195 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:28.408218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d3fbb-6d90-4a09-a5b0-d9b1c6ee3195 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:28.439398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a878b9-4c8c-4268-b203-885a42b099a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:28.440047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a878b9-4c8c-4268-b203-885a42b099a7 None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:28.440331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a878b9-4c8c-4268-b203-885a42b099a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:28.440636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a878b9-4c8c-4268-b203-885a42b099a7 None admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:28.441462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a878b9-4c8c-4268-b203-885a42b099a7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:28.443465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a878b9-4c8c-4268-b203-885a42b099a7 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:28.526300 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 563/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Mon May 2 09:59:28 2022] POST /identity/v3/projects => generated 311 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:59:30.833115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582975b0-91a6-45dd-867f-38f8ca27d201 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:30.833642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582975b0-91a6-45dd-867f-38f8ca27d201 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:30.833642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582975b0-91a6-45dd-867f-38f8ca27d201 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:30.835018 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 572/1135] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:59:30.840116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f5c09-b364-437a-ae2b-d0bb009f4980 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:30.840511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f5c09-b364-437a-ae2b-d0bb009f4980 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:30.840715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f5c09-b364-437a-ae2b-d0bb009f4980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:30.856907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-cd5f5c09-b364-437a-ae2b-d0bb009f4980 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:30.858092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-cd5f5c09-b364-437a-ae2b-d0bb009f4980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:30.919433 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 564/1136] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:59:30.945839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582975b0-91a6-45dd-867f-38f8ca27d201 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:31.040898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582975b0-91a6-45dd-867f-38f8ca27d201 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:31.076305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ade10-ef95-4a83-893b-e6882852d979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:31.077120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ade10-ef95-4a83-893b-e6882852d979 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:31.077401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ade10-ef95-4a83-893b-e6882852d979 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:31.077675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ade10-ef95-4a83-893b-e6882852d979 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:31.078841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ade10-ef95-4a83-893b-e6882852d979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:31.080272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ade10-ef95-4a83-893b-e6882852d979 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:31.081901 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 573/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 09:59:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:31.087647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f5c09-b364-437a-ae2b-d0bb009f4980 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:31.179342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f5c09-b364-437a-ae2b-d0bb009f4980 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:31.209906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e99c60-3b4e-4682-a6c1-8b1aa147c92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:31.210557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e99c60-3b4e-4682-a6c1-8b1aa147c92a None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:31.210838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e99c60-3b4e-4682-a6c1-8b1aa147c92a None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:31.211113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e99c60-3b4e-4682-a6c1-8b1aa147c92a None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:31.211815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e99c60-3b4e-4682-a6c1-8b1aa147c92a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:31.213248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e99c60-3b4e-4682-a6c1-8b1aa147c92a None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:31.328240 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 565/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Mon May 2 09:59:31 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:59:33.647291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ff2d7-3864-4064-97b6-fbf9b9190ea9 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:33.647846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ff2d7-3864-4064-97b6-fbf9b9190ea9 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:33.647846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ff2d7-3864-4064-97b6-fbf9b9190ea9 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:33.649230 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 574/1139] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:59:33.654392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d029e8-3cfe-4d27-967d-20990ac76c40 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:33.654765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d029e8-3cfe-4d27-967d-20990ac76c40 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:33.654944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d029e8-3cfe-4d27-967d-20990ac76c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:33.670995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-54d029e8-3cfe-4d27-967d-20990ac76c40 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:33.672171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-54d029e8-3cfe-4d27-967d-20990ac76c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:33.733826 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 566/1140] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:59:33.759287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ff2d7-3864-4064-97b6-fbf9b9190ea9 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:33.851837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ff2d7-3864-4064-97b6-fbf9b9190ea9 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:33.883756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a603200-f1b3-4ac1-bb0a-51097318c595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:33.884525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a603200-f1b3-4ac1-bb0a-51097318c595 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:33.884854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a603200-f1b3-4ac1-bb0a-51097318c595 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:33.885131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a603200-f1b3-4ac1-bb0a-51097318c595 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:33.894656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a603200-f1b3-4ac1-bb0a-51097318c595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:59:33.902162 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-5a603200-f1b3-4ac1-bb0a-51097318c595 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:59:33.902162 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:33.902162 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:33.902162 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:33.902162 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:33.902162 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:33.902162 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:33.902162 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:33.902162 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:33.902162 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:33.902162 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:33.902162 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:33.902162 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:59:33.902162 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:59:33.902162 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:59:33.902162 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:59:33.903232 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:59:33.903232 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:59:33.903232 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:59:33.903232 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:59:33.903232 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:33.903232 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:33.903232 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:33.903232 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:33.903232 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:33.903232 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:33.903232 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:33.903232 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:59:33.903232 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:33.903232 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:33.903232 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:33.903232 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:33.904257 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:33.904257 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:33.904257 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:33.904257 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:33.904257 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:59:33.904257 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:59:33.904257 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:59:33.904257 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:59:33.904257 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:59:33.904257 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:59:33.904257 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:59:33.904257 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:59:33.904257 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 575/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:59:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:59:33.910729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d029e8-3cfe-4d27-967d-20990ac76c40 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:34.000537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d029e8-3cfe-4d27-967d-20990ac76c40 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:34.031619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc97a74-1fc7-4bd7-a5e1-6e7aab495503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:34.032271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc97a74-1fc7-4bd7-a5e1-6e7aab495503 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:34.032550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc97a74-1fc7-4bd7-a5e1-6e7aab495503 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:34.032848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc97a74-1fc7-4bd7-a5e1-6e7aab495503 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:34.033592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc97a74-1fc7-4bd7-a5e1-6e7aab495503 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:34.033899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc97a74-1fc7-4bd7-a5e1-6e7aab495503 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:34.035243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc97a74-1fc7-4bd7-a5e1-6e7aab495503 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:34.043241 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 567/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:59:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:34.048961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a603200-f1b3-4ac1-bb0a-51097318c595 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:34.144008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a603200-f1b3-4ac1-bb0a-51097318c595 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:34.175574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba82789-d962-4913-a942-c7c7fa4bcafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:34.176556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba82789-d962-4913-a942-c7c7fa4bcafd None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:34.177493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba82789-d962-4913-a942-c7c7fa4bcafd None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:34.177775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba82789-d962-4913-a942-c7c7fa4bcafd None admin] PATH_INFO: `/v3/users/2e2f2a56489446e5b88d2c710ff7a0c2` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:34.190299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba82789-d962-4913-a942-c7c7fa4bcafd None admin] RBAC: Authorizing `identity:get_user(user_id=2e2f2a56489446e5b88d2c710ff7a0c2)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:34.191742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba82789-d962-4913-a942-c7c7fa4bcafd None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:34.193433 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 576/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:59:34 2022] GET /identity/v3/users/2e2f2a56489446e5b88d2c710ff7a0c2 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:34.199153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc97a74-1fc7-4bd7-a5e1-6e7aab495503 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:34.292268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc97a74-1fc7-4bd7-a5e1-6e7aab495503 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:34.323261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0c008-c4f2-4087-8570-521a8bc896a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:34.323889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0c008-c4f2-4087-8570-521a8bc896a2 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:34.324171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0c008-c4f2-4087-8570-521a8bc896a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:34.324447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0c008-c4f2-4087-8570-521a8bc896a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:34.386111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0c008-c4f2-4087-8570-521a8bc896a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:34.387535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0c008-c4f2-4087-8570-521a8bc896a2 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:34.478276 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 568/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:59:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 09:59:34.484128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba82789-d962-4913-a942-c7c7fa4bcafd None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:34.576494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba82789-d962-4913-a942-c7c7fa4bcafd None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:34.609311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753fa70-eb95-436d-99f3-ddf01ce6f77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:34.610170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753fa70-eb95-436d-99f3-ddf01ce6f77c None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:34.610457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753fa70-eb95-436d-99f3-ddf01ce6f77c None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:34.610736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753fa70-eb95-436d-99f3-ddf01ce6f77c None admin] PATH_INFO: `/v3/projects/1f31d92bed974725a725eb3dc66f2c42` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:34.611925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753fa70-eb95-436d-99f3-ddf01ce6f77c None admin] RBAC: Authorizing `identity:get_project(project_id=1f31d92bed974725a725eb3dc66f2c42)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:34.613412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753fa70-eb95-436d-99f3-ddf01ce6f77c None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:34.615354 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 577/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:59:34 2022] GET /identity/v3/projects/1f31d92bed974725a725eb3dc66f2c42 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:34.621529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0c008-c4f2-4087-8570-521a8bc896a2 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:34.713676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0c008-c4f2-4087-8570-521a8bc896a2 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:34.745643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd7259-d7f9-4650-b7ad-9fa2560752a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:34.746234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd7259-d7f9-4650-b7ad-9fa2560752a2 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:34.746517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd7259-d7f9-4650-b7ad-9fa2560752a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:34.746794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd7259-d7f9-4650-b7ad-9fa2560752a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:34.747617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd7259-d7f9-4650-b7ad-9fa2560752a2 None admin] RBAC: Adding query filter params (role.id=dd8a47ade22941849ebdf8fbdf994b66, scope.project.id=1f31d92bed974725a725eb3dc66f2c42, user.id=2e2f2a56489446e5b88d2c710ff7a0c2) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:34.747930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd7259-d7f9-4650-b7ad-9fa2560752a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:34.749370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd7259-d7f9-4650-b7ad-9fa2560752a2 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:34.754507 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 569/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:59:34 2022] GET /identity/v3/role_assignments?user.id=2e2f2a56489446e5b88d2c710ff7a0c2&scope.project.id=1f31d92bed974725a725eb3dc66f2c42&role.id=dd8a47ade22941849ebdf8fbdf994b66 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:37.030099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c1988-aed8-4832-b3f5-31e8c461e116 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:37.030652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c1988-aed8-4832-b3f5-31e8c461e116 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:37.030652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c1988-aed8-4832-b3f5-31e8c461e116 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:37.032018 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 578/1147] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:59:37.037329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005bb5d-c9de-45bb-9c77-1f2978c15f1a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:37.038191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005bb5d-c9de-45bb-9c77-1f2978c15f1a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:37.038384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005bb5d-c9de-45bb-9c77-1f2978c15f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:37.054892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1005bb5d-c9de-45bb-9c77-1f2978c15f1a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:37.056054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1005bb5d-c9de-45bb-9c77-1f2978c15f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:37.117985 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 570/1148] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:59:37.141852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c1988-aed8-4832-b3f5-31e8c461e116 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:37.235903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c1988-aed8-4832-b3f5-31e8c461e116 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:37.267584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa5cde-c73a-40dd-b95a-ffec7f5ecddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:37.268359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa5cde-c73a-40dd-b95a-ffec7f5ecddd None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:37.268667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa5cde-c73a-40dd-b95a-ffec7f5ecddd None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:37.268949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa5cde-c73a-40dd-b95a-ffec7f5ecddd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:37.278505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa5cde-c73a-40dd-b95a-ffec7f5ecddd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:59:37.286103 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-e2aa5cde-c73a-40dd-b95a-ffec7f5ecddd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:59:37.286103 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:37.286103 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:37.286103 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:37.286103 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:37.286103 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:37.286103 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:37.286103 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:37.286103 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:37.286103 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:37.286103 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:37.286103 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:37.286103 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:59:37.286103 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:59:37.286103 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:59:37.286103 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:59:37.287188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:59:37.287188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:59:37.287188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:59:37.287188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:59:37.287188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:37.287188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:37.287188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:37.287188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:37.287188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:37.287188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:37.287188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:37.287188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:59:37.287188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:37.287188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:37.287188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:37.287188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:37.288750 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:37.288750 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:37.288750 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:37.288750 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:37.288750 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:59:37.288750 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:59:37.288750 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:59:37.288750 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:59:37.288750 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:59:37.288750 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:59:37.288750 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:59:37.288750 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:59:37.288750 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 579/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:59:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:59:37.293656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005bb5d-c9de-45bb-9c77-1f2978c15f1a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:37.386006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005bb5d-c9de-45bb-9c77-1f2978c15f1a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:37.418464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49de24-2f66-4381-906e-9d8b7f001b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:37.419149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49de24-2f66-4381-906e-9d8b7f001b42 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:37.419442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49de24-2f66-4381-906e-9d8b7f001b42 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:37.419726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49de24-2f66-4381-906e-9d8b7f001b42 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:37.420465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49de24-2f66-4381-906e-9d8b7f001b42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:37.420802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49de24-2f66-4381-906e-9d8b7f001b42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:37.422154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49de24-2f66-4381-906e-9d8b7f001b42 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:37.429808 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 571/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:59:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:59:37.435516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa5cde-c73a-40dd-b95a-ffec7f5ecddd None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:37.530256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa5cde-c73a-40dd-b95a-ffec7f5ecddd None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:37.561753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e59f2a-5e3e-4d96-aa9f-9d8852af921c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:37.562559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e59f2a-5e3e-4d96-aa9f-9d8852af921c None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:37.562844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e59f2a-5e3e-4d96-aa9f-9d8852af921c None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:37.563124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e59f2a-5e3e-4d96-aa9f-9d8852af921c None admin] PATH_INFO: `/v3/users/2e2f2a56489446e5b88d2c710ff7a0c2` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:37.564302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e59f2a-5e3e-4d96-aa9f-9d8852af921c None admin] RBAC: Authorizing `identity:get_user(user_id=2e2f2a56489446e5b88d2c710ff7a0c2)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:37.565775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e59f2a-5e3e-4d96-aa9f-9d8852af921c None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:37.567379 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 580/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:59:37 2022] GET /identity/v3/users/2e2f2a56489446e5b88d2c710ff7a0c2 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:37.573276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49de24-2f66-4381-906e-9d8b7f001b42 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:37.666431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49de24-2f66-4381-906e-9d8b7f001b42 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:37.697295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca89b48-5ef5-4dab-acd1-0104b079d5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:37.698133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca89b48-5ef5-4dab-acd1-0104b079d5de None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:37.698412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca89b48-5ef5-4dab-acd1-0104b079d5de None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:37.698688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca89b48-5ef5-4dab-acd1-0104b079d5de None admin] PATH_INFO: `/v3/projects/1f31d92bed974725a725eb3dc66f2c42` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:37.699843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca89b48-5ef5-4dab-acd1-0104b079d5de None admin] RBAC: Authorizing `identity:get_project(project_id=1f31d92bed974725a725eb3dc66f2c42)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:37.701302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca89b48-5ef5-4dab-acd1-0104b079d5de None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:37.702941 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 572/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:59:37 2022] GET /identity/v3/projects/1f31d92bed974725a725eb3dc66f2c42 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:37.708571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e59f2a-5e3e-4d96-aa9f-9d8852af921c None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:37.800934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e59f2a-5e3e-4d96-aa9f-9d8852af921c None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:37.831709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02baf3fe-b01c-4a22-89a7-51dc9289ff82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:37.832526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baf3fe-b01c-4a22-89a7-51dc9289ff82 None admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:37.832839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baf3fe-b01c-4a22-89a7-51dc9289ff82 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:37.833117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baf3fe-b01c-4a22-89a7-51dc9289ff82 None admin] PATH_INFO: `/v3/projects/1f31d92bed974725a725eb3dc66f2c42/users/2e2f2a56489446e5b88d2c710ff7a0c2/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:37.835656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02baf3fe-b01c-4a22-89a7-51dc9289ff82 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f31d92bed974725a725eb3dc66f2c42, user_id=2e2f2a56489446e5b88d2c710ff7a0c2, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:37.837125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02baf3fe-b01c-4a22-89a7-51dc9289ff82 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:37.913363 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 581/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 09:59:37 2022] PUT /identity/v3/projects/1f31d92bed974725a725eb3dc66f2c42/users/2e2f2a56489446e5b88d2c710ff7a0c2/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 09:59:40.160849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17273b4d-5009-402a-a306-df34abde4c89 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:40.161415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17273b4d-5009-402a-a306-df34abde4c89 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:40.161415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17273b4d-5009-402a-a306-df34abde4c89 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:40.162764 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 573/1154] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:59:40.167727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0135cd-3a68-4378-9e1f-31a9664c651f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:40.168164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0135cd-3a68-4378-9e1f-31a9664c651f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:40.168289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0135cd-3a68-4378-9e1f-31a9664c651f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:40.184554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5a0135cd-3a68-4378-9e1f-31a9664c651f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:40.185765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5a0135cd-3a68-4378-9e1f-31a9664c651f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:40.248263 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 582/1155] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:59:40.273801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17273b4d-5009-402a-a306-df34abde4c89 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:40.368952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17273b4d-5009-402a-a306-df34abde4c89 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:40.401192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a938974-412a-4a22-9a57-91f524e07d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:40.401970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a938974-412a-4a22-9a57-91f524e07d07 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:40.402249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a938974-412a-4a22-9a57-91f524e07d07 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:40.402521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a938974-412a-4a22-9a57-91f524e07d07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:40.412295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a938974-412a-4a22-9a57-91f524e07d07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:59:40.419732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-6a938974-412a-4a22-9a57-91f524e07d07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:59:40.419732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:40.419732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:40.419732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:40.419732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:40.419732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:40.419732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:40.419732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:40.419732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:40.419732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:40.419732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:40.419732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:40.419732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:59:40.419732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:59:40.419732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:59:40.419732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:59:40.420904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:59:40.420904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:59:40.420904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:59:40.420904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:59:40.420904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:40.420904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:40.420904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:40.420904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:40.420904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:40.420904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:40.420904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:40.420904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:59:40.420904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:40.420904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:40.420904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:40.420904 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:40.421851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:40.421851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:40.421851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:40.421851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:40.421851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:59:40.421851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:59:40.421851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:59:40.421851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:59:40.421851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:59:40.421851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:59:40.421851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:59:40.421851 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:59:40.421851 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 574/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:59:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:59:40.426926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0135cd-3a68-4378-9e1f-31a9664c651f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:40.519473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0135cd-3a68-4378-9e1f-31a9664c651f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:40.550461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc738e-5caf-4765-bc08-c7bc3cb61652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:40.551124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc738e-5caf-4765-bc08-c7bc3cb61652 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:40.551408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc738e-5caf-4765-bc08-c7bc3cb61652 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:40.551685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc738e-5caf-4765-bc08-c7bc3cb61652 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:40.552428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc738e-5caf-4765-bc08-c7bc3cb61652 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:40.552777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc738e-5caf-4765-bc08-c7bc3cb61652 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:40.554661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc738e-5caf-4765-bc08-c7bc3cb61652 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:40.562504 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 583/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:59:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:40.568383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a938974-412a-4a22-9a57-91f524e07d07 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:40.661614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a938974-412a-4a22-9a57-91f524e07d07 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:40.692608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443f7a2-2b24-45ea-ae72-f3b5fe6fd11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:40.693488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443f7a2-2b24-45ea-ae72-f3b5fe6fd11a None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:40.694346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443f7a2-2b24-45ea-ae72-f3b5fe6fd11a None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:40.694621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443f7a2-2b24-45ea-ae72-f3b5fe6fd11a None admin] PATH_INFO: `/v3/users/2e2f2a56489446e5b88d2c710ff7a0c2` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:40.695796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443f7a2-2b24-45ea-ae72-f3b5fe6fd11a None admin] RBAC: Authorizing `identity:get_user(user_id=2e2f2a56489446e5b88d2c710ff7a0c2)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:40.697264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443f7a2-2b24-45ea-ae72-f3b5fe6fd11a None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:40.698990 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 575/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:59:40 2022] GET /identity/v3/users/2e2f2a56489446e5b88d2c710ff7a0c2 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:40.704735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc738e-5caf-4765-bc08-c7bc3cb61652 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:40.798073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc738e-5caf-4765-bc08-c7bc3cb61652 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:40.829318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddb0c6-700b-4805-8af2-4f1d423490c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:40.829955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddb0c6-700b-4805-8af2-4f1d423490c8 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:40.830240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddb0c6-700b-4805-8af2-4f1d423490c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:40.830516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddb0c6-700b-4805-8af2-4f1d423490c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:40.892423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddb0c6-700b-4805-8af2-4f1d423490c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:40.893834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddb0c6-700b-4805-8af2-4f1d423490c8 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:40.983803 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 584/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:59:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 09:59:40.989824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443f7a2-2b24-45ea-ae72-f3b5fe6fd11a None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:41.083102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443f7a2-2b24-45ea-ae72-f3b5fe6fd11a None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:41.114853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab368173-9cc4-4ffc-8976-a1a5b5941281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:41.116376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab368173-9cc4-4ffc-8976-a1a5b5941281 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:41.116684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab368173-9cc4-4ffc-8976-a1a5b5941281 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:41.116962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab368173-9cc4-4ffc-8976-a1a5b5941281 None admin] PATH_INFO: `/v3/projects/1f31d92bed974725a725eb3dc66f2c42` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:41.118141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab368173-9cc4-4ffc-8976-a1a5b5941281 None admin] RBAC: Authorizing `identity:get_project(project_id=1f31d92bed974725a725eb3dc66f2c42)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:41.119560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab368173-9cc4-4ffc-8976-a1a5b5941281 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:41.121271 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 576/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:59:40 2022] GET /identity/v3/projects/1f31d92bed974725a725eb3dc66f2c42 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:41.127254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddb0c6-700b-4805-8af2-4f1d423490c8 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:41.218488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddb0c6-700b-4805-8af2-4f1d423490c8 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:41.250756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616ab1a-5467-4c7a-85fd-ed76947c9702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:41.251334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616ab1a-5467-4c7a-85fd-ed76947c9702 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:41.251617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616ab1a-5467-4c7a-85fd-ed76947c9702 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:41.251892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616ab1a-5467-4c7a-85fd-ed76947c9702 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:41.252732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616ab1a-5467-4c7a-85fd-ed76947c9702 None admin] RBAC: Adding query filter params (role.id=dd8a47ade22941849ebdf8fbdf994b66, scope.project.id=1f31d92bed974725a725eb3dc66f2c42, user.id=2e2f2a56489446e5b88d2c710ff7a0c2) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:41.253046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616ab1a-5467-4c7a-85fd-ed76947c9702 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:41.254493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616ab1a-5467-4c7a-85fd-ed76947c9702 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:41.259940 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 585/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:59:41 2022] GET /identity/v3/role_assignments?user.id=2e2f2a56489446e5b88d2c710ff7a0c2&scope.project.id=1f31d92bed974725a725eb3dc66f2c42&role.id=dd8a47ade22941849ebdf8fbdf994b66 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:43.563691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b26823-c11a-4621-b57e-4c6ca08b70e1 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:43.564246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b26823-c11a-4621-b57e-4c6ca08b70e1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:43.564246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b26823-c11a-4621-b57e-4c6ca08b70e1 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:43.565629 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 577/1162] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:59:43.571420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f890d4c-206e-4ac3-b07f-267165bbab48 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:43.571835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f890d4c-206e-4ac3-b07f-267165bbab48 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:43.571982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f890d4c-206e-4ac3-b07f-267165bbab48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:43.588273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6f890d4c-206e-4ac3-b07f-267165bbab48 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:43.589482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6f890d4c-206e-4ac3-b07f-267165bbab48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:43.651703 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 586/1163] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:59:43.674851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b26823-c11a-4621-b57e-4c6ca08b70e1 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:43.768743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b26823-c11a-4621-b57e-4c6ca08b70e1 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:43.799497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02168f-b2d9-440e-b4ca-36b19eed0388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:43.800121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02168f-b2d9-440e-b4ca-36b19eed0388 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:43.800402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02168f-b2d9-440e-b4ca-36b19eed0388 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:43.800781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02168f-b2d9-440e-b4ca-36b19eed0388 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:43.861488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02168f-b2d9-440e-b4ca-36b19eed0388 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:43.862908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02168f-b2d9-440e-b4ca-36b19eed0388 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:43.952763 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 578/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:59:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 09:59:43.958535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f890d4c-206e-4ac3-b07f-267165bbab48 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:44.049168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f890d4c-206e-4ac3-b07f-267165bbab48 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:44.080242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb4af6-f7eb-4a90-a058-c91178c53029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:44.081053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb4af6-f7eb-4a90-a058-c91178c53029 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:44.081335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb4af6-f7eb-4a90-a058-c91178c53029 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:44.081610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb4af6-f7eb-4a90-a058-c91178c53029 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:44.087887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb4af6-f7eb-4a90-a058-c91178c53029 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:44.089389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb4af6-f7eb-4a90-a058-c91178c53029 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:44.103318 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-96fb4af6-f7eb-4a90-a058-c91178c53029 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 02 09:59:44.103318 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:44.103318 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 02 09:59:44.103318 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 02 09:59:44.103318 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 09:59:44.103318 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 09:59:44.103318 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 09:59:44.103318 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 09:59:44.103318 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 02 09:59:44.103318 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:59:44.103318 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 09:59:44.103318 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:59:44.103318 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:44.103318 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:44.103318 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:44.103318 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:44.103318 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:44.104352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:44.104352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:44.104352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:44.104352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:44.104352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:44.104352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:44.104352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 09:59:44.104352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 09:59:44.104352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 09:59:44.104352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 09:59:44.104352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:44.104352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:44.104352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:44.104352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:44.104352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:44.104352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:44.105555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:44.105555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 09:59:44.105555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:44.105555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:44.105555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:44.105555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:44.105555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:44.105555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:44.105555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:44.105555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:44.105555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 02 09:59:44.105555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 09:59:44.105555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 02 09:59:44.105555 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 09:59:44.105555 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 587/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Mon May 2 09:59:43 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:59:44.110382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02168f-b2d9-440e-b4ca-36b19eed0388 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:44.202531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02168f-b2d9-440e-b4ca-36b19eed0388 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:44.233966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62821aa1-89a2-4bf8-be3b-8d7246dc7703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:44.234608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62821aa1-89a2-4bf8-be3b-8d7246dc7703 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:44.234888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62821aa1-89a2-4bf8-be3b-8d7246dc7703 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:44.235162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62821aa1-89a2-4bf8-be3b-8d7246dc7703 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:44.235868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62821aa1-89a2-4bf8-be3b-8d7246dc7703 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:44.236173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62821aa1-89a2-4bf8-be3b-8d7246dc7703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:44.237537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62821aa1-89a2-4bf8-be3b-8d7246dc7703 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:44.244528 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 579/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Mon May 2 09:59:44 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:46.530889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210be432-13fe-417f-af52-3953318427b3 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:46.531432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210be432-13fe-417f-af52-3953318427b3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:46.531432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210be432-13fe-417f-af52-3953318427b3 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:46.532849 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 588/1167] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:59:46.538034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d55767-93da-4a21-8800-2832a4895bc7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:46.538413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d55767-93da-4a21-8800-2832a4895bc7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:46.538592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d55767-93da-4a21-8800-2832a4895bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:46.555287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-87d55767-93da-4a21-8800-2832a4895bc7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:46.556449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-87d55767-93da-4a21-8800-2832a4895bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:46.618440 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 580/1168] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:59:46.642821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210be432-13fe-417f-af52-3953318427b3 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:46.737042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210be432-13fe-417f-af52-3953318427b3 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:46.768918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbc062-9352-4684-9215-4729715d53c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:46.769566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbc062-9352-4684-9215-4729715d53c7 None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:46.769849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbc062-9352-4684-9215-4729715d53c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:46.770125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbc062-9352-4684-9215-4729715d53c7 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:46.770871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbc062-9352-4684-9215-4729715d53c7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:46.772226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbc062-9352-4684-9215-4729715d53c7 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:46.843460 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 589/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Mon May 2 09:59:46 2022] POST /identity/v3/domains => generated 267 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:59:49.152175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e219d-8162-404f-a204-dba9e7af91bc None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:49.152733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e219d-8162-404f-a204-dba9e7af91bc None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:49.152733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e219d-8162-404f-a204-dba9e7af91bc None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:49.154145 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 581/1170] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:59:49.159292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82261b4-77c8-4c21-b1dc-a758ecad420a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:49.159659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82261b4-77c8-4c21-b1dc-a758ecad420a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:49.159850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82261b4-77c8-4c21-b1dc-a758ecad420a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:49.175986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e82261b4-77c8-4c21-b1dc-a758ecad420a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:49.177205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e82261b4-77c8-4c21-b1dc-a758ecad420a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:49.239106 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 590/1171] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:59:49.264407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e219d-8162-404f-a204-dba9e7af91bc None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:49.357824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e219d-8162-404f-a204-dba9e7af91bc None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:49.388874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502f3e5-8e01-4d39-ae4e-3d02e09fe0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:49.389704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502f3e5-8e01-4d39-ae4e-3d02e09fe0a6 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:49.389982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502f3e5-8e01-4d39-ae4e-3d02e09fe0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:49.390252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502f3e5-8e01-4d39-ae4e-3d02e09fe0a6 None admin] PATH_INFO: `/v3/domains/4b24b933e0404f7aa342a650ce6ea198` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:49.400465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502f3e5-8e01-4d39-ae4e-3d02e09fe0a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4b24b933e0404f7aa342a650ce6ea198)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:49.401915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502f3e5-8e01-4d39-ae4e-3d02e09fe0a6 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:49.403495 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 582/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Mon May 2 09:59:49 2022] GET /identity/v3/domains/4b24b933e0404f7aa342a650ce6ea198 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:49.409128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82261b4-77c8-4c21-b1dc-a758ecad420a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:49.499526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82261b4-77c8-4c21-b1dc-a758ecad420a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:49.530750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e5242-008e-4984-89d2-4872339befa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:49.531387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e5242-008e-4984-89d2-4872339befa9 None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:49.531669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e5242-008e-4984-89d2-4872339befa9 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:49.531942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e5242-008e-4984-89d2-4872339befa9 None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:49.532659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e5242-008e-4984-89d2-4872339befa9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:49.534076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e5242-008e-4984-89d2-4872339befa9 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:49.657250 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 591/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Mon May 2 09:59:49 2022] POST /identity/v3/projects => generated 361 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:59:51.951441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcfc9f-be3d-4d24-8d1c-c200193c0255 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:51.952000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcfc9f-be3d-4d24-8d1c-c200193c0255 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:51.952000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcfc9f-be3d-4d24-8d1c-c200193c0255 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:51.953501 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 583/1174] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:59:51.958669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5257f-4d6e-4f63-afb0-c7421c2dac38 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:51.959569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5257f-4d6e-4f63-afb0-c7421c2dac38 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:51.959739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5257f-4d6e-4f63-afb0-c7421c2dac38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:51.977169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-def5257f-4d6e-4f63-afb0-c7421c2dac38 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:51.978328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-def5257f-4d6e-4f63-afb0-c7421c2dac38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:52.040223 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 592/1175] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:59:52.066014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcfc9f-be3d-4d24-8d1c-c200193c0255 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:52.160375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcfc9f-be3d-4d24-8d1c-c200193c0255 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:52.191115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fac3af-3bdc-4acd-bf22-a2cc62e50856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:52.191963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fac3af-3bdc-4acd-bf22-a2cc62e50856 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:52.192242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fac3af-3bdc-4acd-bf22-a2cc62e50856 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:52.192516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fac3af-3bdc-4acd-bf22-a2cc62e50856 None admin] PATH_INFO: `/v3/domains/4b24b933e0404f7aa342a650ce6ea198` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:52.194214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fac3af-3bdc-4acd-bf22-a2cc62e50856 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4b24b933e0404f7aa342a650ce6ea198)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:52.195635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fac3af-3bdc-4acd-bf22-a2cc62e50856 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:52.197267 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 584/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Mon May 2 09:59:52 2022] GET /identity/v3/domains/4b24b933e0404f7aa342a650ce6ea198 => generated 267 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:52.203004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5257f-4d6e-4f63-afb0-c7421c2dac38 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:52.293299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5257f-4d6e-4f63-afb0-c7421c2dac38 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:52.324325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a5fa5-c7d7-43e4-8be4-05dd199d6993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:52.325003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a5fa5-c7d7-43e4-8be4-05dd199d6993 None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:52.325284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a5fa5-c7d7-43e4-8be4-05dd199d6993 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:52.325555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a5fa5-c7d7-43e4-8be4-05dd199d6993 None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:52.326258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a5fa5-c7d7-43e4-8be4-05dd199d6993 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:52.327667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a5fa5-c7d7-43e4-8be4-05dd199d6993 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:52.402876 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 593/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Mon May 2 09:59:52 2022] POST /identity/v3/users => generated 311 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 09:59:54.718462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e380d90-28f6-4bce-9ed9-8ba06446126d None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:54.719026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e380d90-28f6-4bce-9ed9-8ba06446126d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:54.719225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e380d90-28f6-4bce-9ed9-8ba06446126d None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:54.720617 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 585/1178] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:59:54.726074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3977a7-79d8-4ea1-85cb-23a9b4e4b4a0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:54.726480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3977a7-79d8-4ea1-85cb-23a9b4e4b4a0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:54.726624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3977a7-79d8-4ea1-85cb-23a9b4e4b4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:54.743487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9a3977a7-79d8-4ea1-85cb-23a9b4e4b4a0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:54.744689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9a3977a7-79d8-4ea1-85cb-23a9b4e4b4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:54.807118 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 594/1179] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 09:59:54.832346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e380d90-28f6-4bce-9ed9-8ba06446126d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:54.927906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e380d90-28f6-4bce-9ed9-8ba06446126d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:54.960580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6faaae-9b0b-40c7-ad27-0f631eee7e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:54.961392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6faaae-9b0b-40c7-ad27-0f631eee7e4f None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:54.961672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6faaae-9b0b-40c7-ad27-0f631eee7e4f None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:54.961944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6faaae-9b0b-40c7-ad27-0f631eee7e4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:54.971452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6faaae-9b0b-40c7-ad27-0f631eee7e4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:59:54.978796 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-3a6faaae-9b0b-40c7-ad27-0f631eee7e4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:59:54.978796 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:54.978796 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:54.978796 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:54.978796 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:54.978796 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:54.978796 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:54.978796 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:54.978796 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:54.978796 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:54.978796 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:54.978796 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:54.978796 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:59:54.978796 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:59:54.978796 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:59:54.978796 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:59:54.979912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:59:54.979912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:59:54.979912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:59:54.979912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:59:54.979912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:54.979912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:54.979912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:54.979912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:54.979912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:54.979912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:54.979912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:54.979912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:59:54.979912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:54.979912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:54.979912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:54.979912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:54.981207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:54.981207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:54.981207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:54.981207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:54.981207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:59:54.981207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:59:54.981207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:59:54.981207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:59:54.981207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:59:54.981207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:59:54.981207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:59:54.981207 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:59:54.981207 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 586/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:59:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:59:54.985986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3977a7-79d8-4ea1-85cb-23a9b4e4b4a0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:55.078491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3977a7-79d8-4ea1-85cb-23a9b4e4b4a0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:55.109920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4115dd7-ae91-454f-9bfc-d582775ba17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:55.110586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4115dd7-ae91-454f-9bfc-d582775ba17b None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:55.110869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4115dd7-ae91-454f-9bfc-d582775ba17b None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:55.111148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4115dd7-ae91-454f-9bfc-d582775ba17b None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:55.111885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4115dd7-ae91-454f-9bfc-d582775ba17b None admin] RBAC: Adding query filter params (name=admin) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:55.112193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4115dd7-ae91-454f-9bfc-d582775ba17b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:55.113591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4115dd7-ae91-454f-9bfc-d582775ba17b None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:55.122083 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 595/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:59:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:55.127695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6faaae-9b0b-40c7-ad27-0f631eee7e4f None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:55.219122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6faaae-9b0b-40c7-ad27-0f631eee7e4f None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:55.251218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ba52f-40ae-4afa-a9a1-66c2c8cda2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:55.252011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ba52f-40ae-4afa-a9a1-66c2c8cda2ac None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:55.252297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ba52f-40ae-4afa-a9a1-66c2c8cda2ac None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:55.252575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ba52f-40ae-4afa-a9a1-66c2c8cda2ac None admin] PATH_INFO: `/v3/users/06d147591df546b8b718fd30999f3384` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:55.264843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ba52f-40ae-4afa-a9a1-66c2c8cda2ac None admin] RBAC: Authorizing `identity:get_user(user_id=06d147591df546b8b718fd30999f3384)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:55.266272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ba52f-40ae-4afa-a9a1-66c2c8cda2ac None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:55.267895 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 587/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:59:55 2022] GET /identity/v3/users/06d147591df546b8b718fd30999f3384 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:55.273406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4115dd7-ae91-454f-9bfc-d582775ba17b None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:55.366248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4115dd7-ae91-454f-9bfc-d582775ba17b None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:55.396957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35744abf-e519-4880-ae58-fcadcddc93e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:55.397580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35744abf-e519-4880-ae58-fcadcddc93e8 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:55.397858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35744abf-e519-4880-ae58-fcadcddc93e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:55.398129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35744abf-e519-4880-ae58-fcadcddc93e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:55.459617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35744abf-e519-4880-ae58-fcadcddc93e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:55.461154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35744abf-e519-4880-ae58-fcadcddc93e8 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:55.551546 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 596/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 09:59:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 09:59:55.557271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ba52f-40ae-4afa-a9a1-66c2c8cda2ac None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:55.647965 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ba52f-40ae-4afa-a9a1-66c2c8cda2ac None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:55.678831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e24852-cf19-4233-8595-a92e36a77ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:55.679658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e24852-cf19-4233-8595-a92e36a77ef2 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:55.679939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e24852-cf19-4233-8595-a92e36a77ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:55.680215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e24852-cf19-4233-8595-a92e36a77ef2 None admin] PATH_INFO: `/v3/projects/0c62e5722b87499badb590fd998e6920` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:55.681405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e24852-cf19-4233-8595-a92e36a77ef2 None admin] RBAC: Authorizing `identity:get_project(project_id=0c62e5722b87499badb590fd998e6920)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:55.682801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e24852-cf19-4233-8595-a92e36a77ef2 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:55.684442 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 588/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:59:55 2022] GET /identity/v3/projects/0c62e5722b87499badb590fd998e6920 => generated 361 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:55.690156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35744abf-e519-4880-ae58-fcadcddc93e8 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:55.781549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35744abf-e519-4880-ae58-fcadcddc93e8 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:55.811926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd411af-5577-4c50-9627-bafda2c76c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:55.812509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd411af-5577-4c50-9627-bafda2c76c92 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:55.812817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd411af-5577-4c50-9627-bafda2c76c92 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:55.813093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd411af-5577-4c50-9627-bafda2c76c92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:55.813904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd411af-5577-4c50-9627-bafda2c76c92 None admin] RBAC: Adding query filter params (role.id=dd8a47ade22941849ebdf8fbdf994b66, scope.project.id=0c62e5722b87499badb590fd998e6920, user.id=06d147591df546b8b718fd30999f3384) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:55.814210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd411af-5577-4c50-9627-bafda2c76c92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:55.815619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd411af-5577-4c50-9627-bafda2c76c92 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:55.821205 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 597/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 09:59:55 2022] GET /identity/v3/role_assignments?user.id=06d147591df546b8b718fd30999f3384&scope.project.id=0c62e5722b87499badb590fd998e6920&role.id=dd8a47ade22941849ebdf8fbdf994b66 => generated 259 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:58.069646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883537da-a551-4578-98b5-61dc80d56c59 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:58.070204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883537da-a551-4578-98b5-61dc80d56c59 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:58.070204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883537da-a551-4578-98b5-61dc80d56c59 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:58.071559 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 589/1186] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 09:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 09:59:58.076900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaed80f-c9d0-4c28-b3af-f64b8a0bb51f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:58.077304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaed80f-c9d0-4c28-b3af-f64b8a0bb51f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:58.077454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaed80f-c9d0-4c28-b3af-f64b8a0bb51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:58.093529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-afaed80f-c9d0-4c28-b3af-f64b8a0bb51f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 09:59:58.094700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-afaed80f-c9d0-4c28-b3af-f64b8a0bb51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 09:59:58.164212 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 598/1187] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 09:59:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 02 09:59:58.187546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883537da-a551-4578-98b5-61dc80d56c59 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:58.279625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883537da-a551-4578-98b5-61dc80d56c59 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:58.311255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fba0f-5163-414a-875c-2c7bdd1e3f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:58.312023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fba0f-5163-414a-875c-2c7bdd1e3f65 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:58.312377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fba0f-5163-414a-875c-2c7bdd1e3f65 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:58.312684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fba0f-5163-414a-875c-2c7bdd1e3f65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:58.322165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fba0f-5163-414a-875c-2c7bdd1e3f65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 09:59:58.329525 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-436fba0f-5163-414a-875c-2c7bdd1e3f65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:59:58.329525 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 09:59:58.329525 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 09:59:58.329525 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 09:59:58.329525 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 09:59:58.329525 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 09:59:58.329525 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 09:59:58.329525 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 09:59:58.329525 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 09:59:58.329525 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 09:59:58.329525 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 09:59:58.329525 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 09:59:58.329525 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 09:59:58.329525 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 09:59:58.329525 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 09:59:58.329525 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 09:59:58.330641 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 09:59:58.330641 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 09:59:58.330641 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 09:59:58.330641 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 09:59:58.330641 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 09:59:58.330641 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 09:59:58.330641 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 09:59:58.330641 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 09:59:58.330641 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 09:59:58.330641 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 09:59:58.330641 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 09:59:58.330641 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 09:59:58.330641 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 09:59:58.330641 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 09:59:58.330641 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 09:59:58.330641 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 09:59:58.331861 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 09:59:58.331861 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 09:59:58.331861 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 09:59:58.331861 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 09:59:58.331861 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 09:59:58.331861 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 09:59:58.331861 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 09:59:58.331861 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 09:59:58.331861 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 09:59:58.331861 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 09:59:58.331861 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 09:59:58.331861 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 09:59:58.331861 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 590/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 09:59:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 09:59:58.336574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaed80f-c9d0-4c28-b3af-f64b8a0bb51f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:58.427196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaed80f-c9d0-4c28-b3af-f64b8a0bb51f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:58.459452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9c9d8-a1aa-4147-8199-dd9d252ed80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:58.459452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9c9d8-a1aa-4147-8199-dd9d252ed80b None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:58.459742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9c9d8-a1aa-4147-8199-dd9d252ed80b None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:58.460017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9c9d8-a1aa-4147-8199-dd9d252ed80b None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:58.460771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9c9d8-a1aa-4147-8199-dd9d252ed80b None admin] RBAC: Adding query filter params (name=admin) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 09:59:58.461078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9c9d8-a1aa-4147-8199-dd9d252ed80b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:58.462438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9c9d8-a1aa-4147-8199-dd9d252ed80b None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:58.469953 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 599/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 09:59:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:58.476021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fba0f-5163-414a-875c-2c7bdd1e3f65 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:58.567682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fba0f-5163-414a-875c-2c7bdd1e3f65 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:58.598710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce3f2c-f41d-4a4a-898d-4b64a2acef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:58.600099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce3f2c-f41d-4a4a-898d-4b64a2acef33 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:58.600378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce3f2c-f41d-4a4a-898d-4b64a2acef33 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:58.600674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce3f2c-f41d-4a4a-898d-4b64a2acef33 None admin] PATH_INFO: `/v3/users/06d147591df546b8b718fd30999f3384` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:58.601898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce3f2c-f41d-4a4a-898d-4b64a2acef33 None admin] RBAC: Authorizing `identity:get_user(user_id=06d147591df546b8b718fd30999f3384)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:58.603335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce3f2c-f41d-4a4a-898d-4b64a2acef33 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:58.604942 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 591/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 09:59:58 2022] GET /identity/v3/users/06d147591df546b8b718fd30999f3384 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 09:59:58.610492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9c9d8-a1aa-4147-8199-dd9d252ed80b None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:58.703371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9c9d8-a1aa-4147-8199-dd9d252ed80b None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:58.735139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89964479-5e6d-4d51-b158-d457f534845e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:58.735983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89964479-5e6d-4d51-b158-d457f534845e None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:58.736263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89964479-5e6d-4d51-b158-d457f534845e None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:58.736538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89964479-5e6d-4d51-b158-d457f534845e None admin] PATH_INFO: `/v3/projects/0c62e5722b87499badb590fd998e6920` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:58.737731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89964479-5e6d-4d51-b158-d457f534845e None admin] RBAC: Authorizing `identity:get_project(project_id=0c62e5722b87499badb590fd998e6920)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:58.739155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89964479-5e6d-4d51-b158-d457f534845e None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:58.741241 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 600/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 09:59:58 2022] GET /identity/v3/projects/0c62e5722b87499badb590fd998e6920 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 09:59:58.747088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce3f2c-f41d-4a4a-898d-4b64a2acef33 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 09:59:58.839794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce3f2c-f41d-4a4a-898d-4b64a2acef33 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 09:59:58.870583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153140e-0f3c-490f-9b26-1b9540f7d8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 09:59:58.871458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153140e-0f3c-490f-9b26-1b9540f7d8cb None admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 09:59:58.871736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153140e-0f3c-490f-9b26-1b9540f7d8cb None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 09:59:58.872010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153140e-0f3c-490f-9b26-1b9540f7d8cb None admin] PATH_INFO: `/v3/projects/0c62e5722b87499badb590fd998e6920/users/06d147591df546b8b718fd30999f3384/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 09:59:58.873958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153140e-0f3c-490f-9b26-1b9540f7d8cb None admin] RBAC: Authorizing `identity:create_grant(project_id=0c62e5722b87499badb590fd998e6920, user_id=06d147591df546b8b718fd30999f3384, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 09:59:58.875373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153140e-0f3c-490f-9b26-1b9540f7d8cb None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 09:59:58.964539 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 592/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 09:59:58 2022] PUT /identity/v3/projects/0c62e5722b87499badb590fd998e6920/users/06d147591df546b8b718fd30999f3384/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:00:01.235337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d158f6-32fe-46de-bae5-9b9c498e58c4 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:00:01.235844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d158f6-32fe-46de-bae5-9b9c498e58c4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:00:01.235954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d158f6-32fe-46de-bae5-9b9c498e58c4 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:00:01.237289 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 601/1193] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:00:01.243314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b6dda-5943-481f-b349-af9ebf5445bf None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:00:01.243749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b6dda-5943-481f-b349-af9ebf5445bf None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:00:01.243875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b6dda-5943-481f-b349-af9ebf5445bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:00:01.261271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-908b6dda-5943-481f-b349-af9ebf5445bf None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:00:01.262465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-908b6dda-5943-481f-b349-af9ebf5445bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:00:01.324851 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 593/1194] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:00:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 10:00:01.349594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d158f6-32fe-46de-bae5-9b9c498e58c4 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:00:01.445409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d158f6-32fe-46de-bae5-9b9c498e58c4 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:00:01.477619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1b533-4bb4-4c7e-9eb7-4d8fbf1b24b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:00:01.478405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1b533-4bb4-4c7e-9eb7-4d8fbf1b24b7 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:00:01.478692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1b533-4bb4-4c7e-9eb7-4d8fbf1b24b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:00:01.478974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1b533-4bb4-4c7e-9eb7-4d8fbf1b24b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:00:01.488498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1b533-4bb4-4c7e-9eb7-4d8fbf1b24b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:00:01.496352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-33f1b533-4bb4-4c7e-9eb7-4d8fbf1b24b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 10:00:01.496352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:00:01.496352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:00:01.496352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:00:01.496352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:00:01.496352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:00:01.496352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:00:01.496352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:00:01.496352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:00:01.496352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:00:01.496352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:00:01.496352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:00:01.496352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 10:00:01.496352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 10:00:01.496352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 10:00:01.496352 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 10:00:01.497510 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:00:01.497510 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:00:01.497510 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:00:01.497510 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:00:01.497510 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:00:01.497510 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:00:01.497510 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:00:01.497510 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:00:01.497510 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:00:01.497510 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:00:01.497510 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:00:01.497510 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:00:01.497510 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:00:01.497510 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:00:01.497510 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:00:01.497510 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:00:01.498530 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:00:01.498530 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:00:01.498530 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:00:01.498530 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:00:01.498530 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 10:00:01.498530 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 10:00:01.498530 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 10:00:01.498530 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 10:00:01.498530 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 10:00:01.498530 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 10:00:01.498530 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 10:00:01.498530 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:00:01.498530 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 602/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 10:00:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:00:01.503652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b6dda-5943-481f-b349-af9ebf5445bf None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:00:01.595530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b6dda-5943-481f-b349-af9ebf5445bf None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:00:01.627299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33120a-0e25-43dc-ae10-7fddb362c5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:00:01.627951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33120a-0e25-43dc-ae10-7fddb362c5b8 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:00:01.628235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33120a-0e25-43dc-ae10-7fddb362c5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:00:01.628513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33120a-0e25-43dc-ae10-7fddb362c5b8 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:00:01.629283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33120a-0e25-43dc-ae10-7fddb362c5b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:00:01.629591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33120a-0e25-43dc-ae10-7fddb362c5b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:00:01.630992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33120a-0e25-43dc-ae10-7fddb362c5b8 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:00:01.638578 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 594/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 10:00:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:00:01.644237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1b533-4bb4-4c7e-9eb7-4d8fbf1b24b7 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:00:01.737623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1b533-4bb4-4c7e-9eb7-4d8fbf1b24b7 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:00:01.768610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ce60a-03f1-4e93-a2f8-26378b93b206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:00:01.769473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ce60a-03f1-4e93-a2f8-26378b93b206 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:00:01.769758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ce60a-03f1-4e93-a2f8-26378b93b206 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:00:01.770036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ce60a-03f1-4e93-a2f8-26378b93b206 None admin] PATH_INFO: `/v3/users/06d147591df546b8b718fd30999f3384` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:00:01.771770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ce60a-03f1-4e93-a2f8-26378b93b206 None admin] RBAC: Authorizing `identity:get_user(user_id=06d147591df546b8b718fd30999f3384)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:00:01.773229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ce60a-03f1-4e93-a2f8-26378b93b206 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:00:01.774808 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 603/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Mon May 2 10:00:01 2022] GET /identity/v3/users/06d147591df546b8b718fd30999f3384 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:00:01.780370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33120a-0e25-43dc-ae10-7fddb362c5b8 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:00:01.872442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33120a-0e25-43dc-ae10-7fddb362c5b8 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:00:01.904097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5275a64-da96-47c0-b2fc-e0e8dde75091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:00:01.904701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5275a64-da96-47c0-b2fc-e0e8dde75091 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:00:01.904991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5275a64-da96-47c0-b2fc-e0e8dde75091 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:00:01.905270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5275a64-da96-47c0-b2fc-e0e8dde75091 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:00:01.971491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5275a64-da96-47c0-b2fc-e0e8dde75091 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:00:01.972976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5275a64-da96-47c0-b2fc-e0e8dde75091 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:00:02.063472 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 595/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 10:00:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 10:00:02.069931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ce60a-03f1-4e93-a2f8-26378b93b206 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:00:02.163009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ce60a-03f1-4e93-a2f8-26378b93b206 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:00:02.194225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39025d55-b674-407f-89ad-163eae491548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:00:02.195071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39025d55-b674-407f-89ad-163eae491548 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:00:02.195349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39025d55-b674-407f-89ad-163eae491548 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:00:02.195622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39025d55-b674-407f-89ad-163eae491548 None admin] PATH_INFO: `/v3/projects/0c62e5722b87499badb590fd998e6920` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:00:02.196799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39025d55-b674-407f-89ad-163eae491548 None admin] RBAC: Authorizing `identity:get_project(project_id=0c62e5722b87499badb590fd998e6920)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:00:02.198222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39025d55-b674-407f-89ad-163eae491548 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:00:02.199871 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 604/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Mon May 2 10:00:02 2022] GET /identity/v3/projects/0c62e5722b87499badb590fd998e6920 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:00:02.206048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5275a64-da96-47c0-b2fc-e0e8dde75091 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:00:02.299201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5275a64-da96-47c0-b2fc-e0e8dde75091 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:00:02.331502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72551801-ed6f-4334-be81-501f203ea4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:00:02.332169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72551801-ed6f-4334-be81-501f203ea4af None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:00:02.332454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72551801-ed6f-4334-be81-501f203ea4af None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:00:02.332763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72551801-ed6f-4334-be81-501f203ea4af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:00:02.333620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72551801-ed6f-4334-be81-501f203ea4af None admin] RBAC: Adding query filter params (role.id=dd8a47ade22941849ebdf8fbdf994b66, scope.project.id=0c62e5722b87499badb590fd998e6920, user.id=06d147591df546b8b718fd30999f3384) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:00:02.333935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72551801-ed6f-4334-be81-501f203ea4af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:00:02.335360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72551801-ed6f-4334-be81-501f203ea4af None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:00:02.340918 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 596/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 10:00:02 2022] GET /identity/v3/role_assignments?user.id=06d147591df546b8b718fd30999f3384&scope.project.id=0c62e5722b87499badb590fd998e6920&role.id=dd8a47ade22941849ebdf8fbdf994b66 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:22.432942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b719a32-6a12-4082-a897-38e54f4ce8fa None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:22.433526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b719a32-6a12-4082-a897-38e54f4ce8fa None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:22.433526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b719a32-6a12-4082-a897-38e54f4ce8fa None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:22.434832 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 605/1201] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:01:22.439890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ab097-cc70-4b41-bc17-eebd3ad0001c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:22.440326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ab097-cc70-4b41-bc17-eebd3ad0001c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:22.440446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ab097-cc70-4b41-bc17-eebd3ad0001c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:22.457433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-096ab097-cc70-4b41-bc17-eebd3ad0001c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:01:22.458622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-096ab097-cc70-4b41-bc17-eebd3ad0001c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:01:22.524103 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 597/1202] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:01:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 10:01:22.549219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b719a32-6a12-4082-a897-38e54f4ce8fa None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:22.646099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b719a32-6a12-4082-a897-38e54f4ce8fa None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:22.677620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7c510-c212-428b-afe0-7ac8bc8d940d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:22.678405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7c510-c212-428b-afe0-7ac8bc8d940d None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:22.678689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7c510-c212-428b-afe0-7ac8bc8d940d None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:22.678966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7c510-c212-428b-afe0-7ac8bc8d940d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:22.689268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7c510-c212-428b-afe0-7ac8bc8d940d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:22.690673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7c510-c212-428b-afe0-7ac8bc8d940d None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:22.707340 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-51f7c510-c212-428b-afe0-7ac8bc8d940d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:22.707340 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:22.707340 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:22.707340 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:22.707340 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:22.707340 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:22.707340 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:22.707340 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:22.707340 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:22.707340 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:22.707340 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:22.707340 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:22.707340 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 10:01:22.707340 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 10:01:22.707340 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 10:01:22.708503 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 10:01:22.708503 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:22.708503 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:22.708503 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:22.708503 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:22.708503 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:22.708503 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:22.708503 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:22.708503 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:01:22.708503 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:22.708503 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:22.708503 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:22.708503 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:22.708503 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:22.708503 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:22.708503 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:22.708503 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:22.709748 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 10:01:22.709748 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:01:22.709748 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:22.709748 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:01:22.709748 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 606/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 10:01:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:22.714515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ab097-cc70-4b41-bc17-eebd3ad0001c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:22.807878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ab097-cc70-4b41-bc17-eebd3ad0001c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:22.839243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1105c3-d511-4237-a4bf-4327cd387612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:22.839898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1105c3-d511-4237-a4bf-4327cd387612 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:22.840180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1105c3-d511-4237-a4bf-4327cd387612 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:22.840461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1105c3-d511-4237-a4bf-4327cd387612 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:22.841280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1105c3-d511-4237-a4bf-4327cd387612 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:22.841589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1105c3-d511-4237-a4bf-4327cd387612 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:22.842973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1105c3-d511-4237-a4bf-4327cd387612 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:22.854047 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 598/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 10:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:22.859766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7c510-c212-428b-afe0-7ac8bc8d940d None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:22.953938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7c510-c212-428b-afe0-7ac8bc8d940d None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:22.986007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a93b1d-7151-490e-a618-9782a6f2b355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:22.986661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a93b1d-7151-490e-a618-9782a6f2b355 None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:22.986941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a93b1d-7151-490e-a618-9782a6f2b355 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:22.987211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a93b1d-7151-490e-a618-9782a6f2b355 None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:22.987906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a93b1d-7151-490e-a618-9782a6f2b355 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:22.989359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a93b1d-7151-490e-a618-9782a6f2b355 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:23.072725 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 607/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Mon May 2 10:01:22 2022] POST /identity/v3/users => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:01:25.402867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efe65b-adf7-4ed2-a504-11fd93e42c95 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:25.403403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efe65b-adf7-4ed2-a504-11fd93e42c95 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:25.403512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efe65b-adf7-4ed2-a504-11fd93e42c95 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:25.404895 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 599/1206] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:01:25.410088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecb05c-d4f6-4dee-844d-3c04bec7133a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:25.410751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecb05c-d4f6-4dee-844d-3c04bec7133a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:25.410751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecb05c-d4f6-4dee-844d-3c04bec7133a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:25.427392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-19ecb05c-d4f6-4dee-844d-3c04bec7133a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:01:25.428569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-19ecb05c-d4f6-4dee-844d-3c04bec7133a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:01:25.491513 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 608/1207] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:01:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 10:01:25.515975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efe65b-adf7-4ed2-a504-11fd93e42c95 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:25.613918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efe65b-adf7-4ed2-a504-11fd93e42c95 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:25.646029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858307bc-bea1-4213-bdaf-653cff82b26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:25.646812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858307bc-bea1-4213-bdaf-653cff82b26b None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:25.647116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858307bc-bea1-4213-bdaf-653cff82b26b None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:25.647389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858307bc-bea1-4213-bdaf-653cff82b26b None admin] PATH_INFO: `/v3/roles/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:25.657470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858307bc-bea1-4213-bdaf-653cff82b26b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:01:25.665016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-858307bc-bea1-4213-bdaf-653cff82b26b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 10:01:25.665016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:25.665016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:25.665016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:25.665016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:25.665016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:25.665016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:25.665016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:25.665016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:25.665016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:25.665016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:25.665016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:25.665016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 10:01:25.665016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 10:01:25.665016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 10:01:25.665016 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 10:01:25.666165 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:01:25.666165 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:01:25.666165 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:01:25.666165 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:01:25.666165 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:25.666165 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:25.666165 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:25.666165 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:25.666165 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:25.666165 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:25.666165 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:25.666165 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:01:25.666165 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:25.666165 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:25.666165 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:25.666165 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:25.667246 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:25.667246 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:25.667246 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:25.667246 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:25.667246 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 10:01:25.667246 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 10:01:25.667246 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 10:01:25.667246 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 10:01:25.667246 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 10:01:25.667246 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 10:01:25.667246 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 10:01:25.667246 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:25.667246 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 600/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 10:01:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:25.672298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecb05c-d4f6-4dee-844d-3c04bec7133a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:25.767129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecb05c-d4f6-4dee-844d-3c04bec7133a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:25.799530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45692527-a0d7-45ed-a8f2-4181ef002bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:25.800197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45692527-a0d7-45ed-a8f2-4181ef002bd9 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:25.800480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45692527-a0d7-45ed-a8f2-4181ef002bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:25.800790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45692527-a0d7-45ed-a8f2-4181ef002bd9 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:25.801533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45692527-a0d7-45ed-a8f2-4181ef002bd9 None admin] RBAC: Adding query filter params (name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:25.801840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45692527-a0d7-45ed-a8f2-4181ef002bd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:25.803271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45692527-a0d7-45ed-a8f2-4181ef002bd9 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:25.810768 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 609/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Mon May 2 10:01:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:25.816581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858307bc-bea1-4213-bdaf-653cff82b26b None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:25.910858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858307bc-bea1-4213-bdaf-653cff82b26b None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:25.942257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaad4ac-efb7-497a-90e0-f57d9ee3c207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:25.943041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaad4ac-efb7-497a-90e0-f57d9ee3c207 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:25.943324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaad4ac-efb7-497a-90e0-f57d9ee3c207 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:25.943600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaad4ac-efb7-497a-90e0-f57d9ee3c207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:25.954227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaad4ac-efb7-497a-90e0-f57d9ee3c207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:25.955681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaad4ac-efb7-497a-90e0-f57d9ee3c207 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:25.973029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-4eaad4ac-efb7-497a-90e0-f57d9ee3c207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:25.973029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:25.973029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:25.973029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:25.973029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:25.973029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:25.973029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:25.973029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:25.973029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:25.973029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:25.973029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:25.973029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:25.973029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 10:01:25.973029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 10:01:25.973029 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 10:01:25.974089 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 10:01:25.974089 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:25.974089 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:25.974089 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:25.974089 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:25.974089 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:25.974089 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:25.974089 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:25.974089 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:01:25.974089 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:25.974089 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:25.974089 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:25.974089 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:25.974089 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:25.974089 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:25.974089 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:25.974089 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:25.975173 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 10:01:25.975173 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:01:25.975173 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:25.975173 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:25.975173 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 601/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 10:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:25.979928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45692527-a0d7-45ed-a8f2-4181ef002bd9 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:26.074344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45692527-a0d7-45ed-a8f2-4181ef002bd9 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:26.108172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd2848-a428-407f-85df-e7c74e648da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:26.108856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd2848-a428-407f-85df-e7c74e648da3 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:26.109140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd2848-a428-407f-85df-e7c74e648da3 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:26.109419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd2848-a428-407f-85df-e7c74e648da3 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:26.110143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd2848-a428-407f-85df-e7c74e648da3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:26.110450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd2848-a428-407f-85df-e7c74e648da3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:26.111814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd2848-a428-407f-85df-e7c74e648da3 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:26.124120 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 610/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 10:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:26.129868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaad4ac-efb7-497a-90e0-f57d9ee3c207 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:26.223789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaad4ac-efb7-497a-90e0-f57d9ee3c207 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:26.256256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a9fbf-255a-416e-9942-83ad70b3c64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:26.257109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a9fbf-255a-416e-9942-83ad70b3c64e None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:26.257398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a9fbf-255a-416e-9942-83ad70b3c64e None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:26.257677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a9fbf-255a-416e-9942-83ad70b3c64e None admin] PATH_INFO: `/v3/users/placement` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:26.265460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a9fbf-255a-416e-9942-83ad70b3c64e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:26.266918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a9fbf-255a-416e-9942-83ad70b3c64e None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:26.280779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-a39a9fbf-255a-416e-9942-83ad70b3c64e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 02 10:01:26.280779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:26.280779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:26.280779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:26.280779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:26.280779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:26.280779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:26.280779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:26.280779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:26.280779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:26.280779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:26.280779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:26.280779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 10:01:26.280779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 10:01:26.280779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 10:01:26.280779 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 10:01:26.281924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:26.281924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:26.281924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 10:01:26.281924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:01:26.281924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 10:01:26.281924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:01:26.281924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:26.281924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:26.281924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:26.281924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:26.281924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:26.281924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:01:26.281924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:26.281924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:26.281924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:26.281924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:26.281924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:26.281924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:26.283065 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:26.283065 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:26.283065 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 10:01:26.283065 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 10:01:26.283065 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 10:01:26.283065 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 10:01:26.283065 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 10:01:26.283065 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 10:01:26.283065 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 02 10:01:26.283065 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:26.283065 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 602/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 10:01:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:26.287794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd2848-a428-407f-85df-e7c74e648da3 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:26.380925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd2848-a428-407f-85df-e7c74e648da3 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:26.411733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8aac87-8a3a-4d9a-80c1-b79383860e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:26.412406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8aac87-8a3a-4d9a-80c1-b79383860e2f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:26.412706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8aac87-8a3a-4d9a-80c1-b79383860e2f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:26.412984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8aac87-8a3a-4d9a-80c1-b79383860e2f None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:26.413806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8aac87-8a3a-4d9a-80c1-b79383860e2f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:26.414114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8aac87-8a3a-4d9a-80c1-b79383860e2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:26.416065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8aac87-8a3a-4d9a-80c1-b79383860e2f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:26.432832 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 611/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Mon May 2 10:01:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:26.438529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a9fbf-255a-416e-9942-83ad70b3c64e None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:26.532945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a9fbf-255a-416e-9942-83ad70b3c64e None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:26.565403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0d00f-fcea-4f60-a80d-9aa6fde4d6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:26.566044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0d00f-fcea-4f60-a80d-9aa6fde4d6cc None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:26.566327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0d00f-fcea-4f60-a80d-9aa6fde4d6cc None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:26.566603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0d00f-fcea-4f60-a80d-9aa6fde4d6cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:26.629535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0d00f-fcea-4f60-a80d-9aa6fde4d6cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:26.630967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0d00f-fcea-4f60-a80d-9aa6fde4d6cc None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:26.722463 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 603/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 10:01:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 10:01:26.728945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8aac87-8a3a-4d9a-80c1-b79383860e2f None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:26.822253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8aac87-8a3a-4d9a-80c1-b79383860e2f None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:26.854533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a211eaa-0a5d-43ef-858a-1d1d36d699f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:26.855303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a211eaa-0a5d-43ef-858a-1d1d36d699f5 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:26.855586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a211eaa-0a5d-43ef-858a-1d1d36d699f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:26.855860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a211eaa-0a5d-43ef-858a-1d1d36d699f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:26.865626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a211eaa-0a5d-43ef-858a-1d1d36d699f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:26.867070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a211eaa-0a5d-43ef-858a-1d1d36d699f5 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:26.883700 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-4a211eaa-0a5d-43ef-858a-1d1d36d699f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:26.883700 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:26.883700 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:26.883700 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:26.883700 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:26.883700 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:26.883700 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:26.883700 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:26.883700 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:26.883700 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:26.883700 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:26.883700 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:26.883700 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 10:01:26.883700 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 10:01:26.883700 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 10:01:26.889127 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 10:01:26.889127 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:26.889127 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:26.889127 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:26.889127 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:26.889127 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:26.889127 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:26.889127 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:26.889127 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:01:26.889127 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:26.889127 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:26.889127 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:26.889127 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:26.889127 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:26.889127 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:26.889127 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:26.889127 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:26.890203 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 10:01:26.890203 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:01:26.890203 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:26.890203 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:01:26.890203 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 612/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 10:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:26.890857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0d00f-fcea-4f60-a80d-9aa6fde4d6cc None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:26.983879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0d00f-fcea-4f60-a80d-9aa6fde4d6cc None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:27.015217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0901671-e2d9-4d1c-a0ff-dc8522e9b33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:27.015865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0901671-e2d9-4d1c-a0ff-dc8522e9b33a None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:27.016144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0901671-e2d9-4d1c-a0ff-dc8522e9b33a None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:27.016415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0901671-e2d9-4d1c-a0ff-dc8522e9b33a None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:27.017158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0901671-e2d9-4d1c-a0ff-dc8522e9b33a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:27.017464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0901671-e2d9-4d1c-a0ff-dc8522e9b33a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:27.018804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0901671-e2d9-4d1c-a0ff-dc8522e9b33a None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:27.030088 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 604/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 10:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:01:27.035734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a211eaa-0a5d-43ef-858a-1d1d36d699f5 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:27.128953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a211eaa-0a5d-43ef-858a-1d1d36d699f5 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:27.164376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c07f5-d800-4af9-99ff-fc08b05c2a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:27.165211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c07f5-d800-4af9-99ff-fc08b05c2a3d None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:27.165492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c07f5-d800-4af9-99ff-fc08b05c2a3d None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:27.165763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c07f5-d800-4af9-99ff-fc08b05c2a3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:27.172094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c07f5-d800-4af9-99ff-fc08b05c2a3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:27.173697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c07f5-d800-4af9-99ff-fc08b05c2a3d None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:27.186733 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-e27c07f5-d800-4af9-99ff-fc08b05c2a3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 10:01:27.186733 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:27.186733 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:27.186733 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:27.186733 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:27.186733 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:27.186733 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:27.186733 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:27.186733 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:27.186733 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:27.186733 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:27.186733 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:27.186733 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 10:01:27.186733 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 10:01:27.186733 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 10:01:27.187849 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 10:01:27.187849 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:27.187849 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:27.187849 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:27.187849 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:27.187849 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:27.187849 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:27.187849 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:27.187849 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:01:27.187849 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:27.187849 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:27.187849 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:27.187849 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:27.187849 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:27.187849 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:27.187849 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:27.187849 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:27.188967 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 10:01:27.188967 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 10:01:27.188967 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:01:27.188967 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:01:27.188967 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:01:27.188967 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:01:27.188967 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 10:01:27.188967 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:01:27.188967 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 613/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 10:01:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:27.193907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0901671-e2d9-4d1c-a0ff-dc8522e9b33a None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:27.287857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0901671-e2d9-4d1c-a0ff-dc8522e9b33a None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:27.319048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c592ec1-7e55-4d1b-b47b-fe860035f331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:27.319706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c592ec1-7e55-4d1b-b47b-fe860035f331 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:27.319991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c592ec1-7e55-4d1b-b47b-fe860035f331 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:27.320296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c592ec1-7e55-4d1b-b47b-fe860035f331 None admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:27.321136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c592ec1-7e55-4d1b-b47b-fe860035f331 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:27.321947 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c592ec1-7e55-4d1b-b47b-fe860035f331 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:27.323376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c592ec1-7e55-4d1b-b47b-fe860035f331 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:27.334867 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 605/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 10:01:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:27.341582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c07f5-d800-4af9-99ff-fc08b05c2a3d None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:27.436216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c07f5-d800-4af9-99ff-fc08b05c2a3d None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:27.468463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e550501-e1b6-4a5f-bb64-eb0b88194832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:27.469133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e550501-e1b6-4a5f-bb64-eb0b88194832 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:27.469412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e550501-e1b6-4a5f-bb64-eb0b88194832 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:27.469686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e550501-e1b6-4a5f-bb64-eb0b88194832 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:27.470496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e550501-e1b6-4a5f-bb64-eb0b88194832 None admin] RBAC: Adding query filter params (role.id=a47492f29bc144158c1c2ed9a4c39d39, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=eef155f5230d47c29fc3d74c2241130b) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:27.470803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e550501-e1b6-4a5f-bb64-eb0b88194832 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:27.472225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e550501-e1b6-4a5f-bb64-eb0b88194832 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:27.477442 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 614/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 10:01:27 2022] GET /identity/v3/role_assignments?user.id=eef155f5230d47c29fc3d74c2241130b&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=a47492f29bc144158c1c2ed9a4c39d39 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:29.756870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da470071-6e87-4e30-87b9-5d0288ff5826 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:29.757440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da470071-6e87-4e30-87b9-5d0288ff5826 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:29.757534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da470071-6e87-4e30-87b9-5d0288ff5826 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:29.759439 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 606/1220] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:01:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:01:29.764898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99e114-981b-411e-8162-805f1485d62f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:29.765334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99e114-981b-411e-8162-805f1485d62f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:29.765507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99e114-981b-411e-8162-805f1485d62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:29.782335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9d99e114-981b-411e-8162-805f1485d62f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:01:29.783522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9d99e114-981b-411e-8162-805f1485d62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:01:29.850669 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 615/1221] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:01:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 10:01:29.875831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da470071-6e87-4e30-87b9-5d0288ff5826 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:29.971997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da470071-6e87-4e30-87b9-5d0288ff5826 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:30.004038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5956e-323b-42f8-abac-3a3dba653ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:30.004849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5956e-323b-42f8-abac-3a3dba653ba3 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:30.005135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5956e-323b-42f8-abac-3a3dba653ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:30.005413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5956e-323b-42f8-abac-3a3dba653ba3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:30.019907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5956e-323b-42f8-abac-3a3dba653ba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:01:30.023497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-4ce5956e-323b-42f8-abac-3a3dba653ba3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 10:01:30.023497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:30.023497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:30.023497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:30.023497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:30.023497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:30.023497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:30.023497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:30.023497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:30.023497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:30.023497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:30.023497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:30.023497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 10:01:30.023497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 10:01:30.023497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 10:01:30.023497 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 10:01:30.024591 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:01:30.024591 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:01:30.024591 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:01:30.024591 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:01:30.024591 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:30.024591 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:30.024591 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:30.024591 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:30.024591 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:30.024591 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:30.024591 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:30.024591 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:01:30.024591 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:30.024591 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:30.024591 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:30.024591 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:30.025985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:30.025985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:30.025985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:30.025985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:30.025985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 10:01:30.025985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 10:01:30.025985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 10:01:30.025985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 10:01:30.025985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 10:01:30.025985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 10:01:30.025985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 10:01:30.025985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:30.025985 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 607/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 10:01:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:30.031546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99e114-981b-411e-8162-805f1485d62f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:30.127324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99e114-981b-411e-8162-805f1485d62f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:30.158877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcd607-0780-4eb5-b20c-0d6c6ba73bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:30.159531 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcd607-0780-4eb5-b20c-0d6c6ba73bde None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:30.159812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcd607-0780-4eb5-b20c-0d6c6ba73bde None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:30.160086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcd607-0780-4eb5-b20c-0d6c6ba73bde None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:30.160855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcd607-0780-4eb5-b20c-0d6c6ba73bde None admin] RBAC: Adding query filter params (name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:30.161160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcd607-0780-4eb5-b20c-0d6c6ba73bde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:30.162510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcd607-0780-4eb5-b20c-0d6c6ba73bde None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:30.170619 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 616/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Mon May 2 10:01:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:30.176377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5956e-323b-42f8-abac-3a3dba653ba3 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:30.272751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5956e-323b-42f8-abac-3a3dba653ba3 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:30.304060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fba26-56b7-44ff-86d6-56fb092f75d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:30.304809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fba26-56b7-44ff-86d6-56fb092f75d1 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:30.305091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fba26-56b7-44ff-86d6-56fb092f75d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:30.305415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fba26-56b7-44ff-86d6-56fb092f75d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:30.315917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fba26-56b7-44ff-86d6-56fb092f75d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:30.317403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fba26-56b7-44ff-86d6-56fb092f75d1 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:30.333416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-925fba26-56b7-44ff-86d6-56fb092f75d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:30.333416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:30.333416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:30.333416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:30.333416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:30.333416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:30.333416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:30.333416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:30.333416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:30.333416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:30.333416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:30.333416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:30.333416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 10:01:30.333416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 10:01:30.333416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 10:01:30.334472 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 10:01:30.334472 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:30.334472 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:30.334472 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:30.334472 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:30.334472 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:30.334472 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:30.334472 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:30.334472 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:01:30.334472 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:30.334472 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:30.334472 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:30.334472 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:30.334472 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:30.334472 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:30.334472 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:30.334472 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:30.335419 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 10:01:30.335419 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:01:30.335419 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:30.335419 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:30.335419 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 608/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 10:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:30.340412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcd607-0780-4eb5-b20c-0d6c6ba73bde None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:30.436146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcd607-0780-4eb5-b20c-0d6c6ba73bde None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:30.467414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a44a1-2a95-4922-84d5-348faa31c4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:30.468065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a44a1-2a95-4922-84d5-348faa31c4ac None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:30.468348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a44a1-2a95-4922-84d5-348faa31c4ac None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:30.468648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a44a1-2a95-4922-84d5-348faa31c4ac None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:30.469363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a44a1-2a95-4922-84d5-348faa31c4ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:30.469670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a44a1-2a95-4922-84d5-348faa31c4ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:30.471037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a44a1-2a95-4922-84d5-348faa31c4ac None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:30.482627 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 617/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 10:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:30.488383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fba26-56b7-44ff-86d6-56fb092f75d1 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:30.582528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fba26-56b7-44ff-86d6-56fb092f75d1 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:30.614879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde98fd-7435-42e0-92e3-d1f225964cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:30.615978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde98fd-7435-42e0-92e3-d1f225964cfc None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:30.616258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde98fd-7435-42e0-92e3-d1f225964cfc None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:30.616531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde98fd-7435-42e0-92e3-d1f225964cfc None admin] PATH_INFO: `/v3/users/placement` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:30.623569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde98fd-7435-42e0-92e3-d1f225964cfc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:30.625057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde98fd-7435-42e0-92e3-d1f225964cfc None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:30.638926 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-4fde98fd-7435-42e0-92e3-d1f225964cfc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 02 10:01:30.638926 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:30.638926 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:30.638926 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:30.638926 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:30.638926 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:30.638926 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:30.638926 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:30.638926 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:30.638926 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:30.638926 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:30.638926 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:30.638926 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 10:01:30.638926 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 10:01:30.638926 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 10:01:30.638926 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 10:01:30.640039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:30.640039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:30.640039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 10:01:30.640039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:01:30.640039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 10:01:30.640039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:01:30.640039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:30.640039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:30.640039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:30.640039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:30.640039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:30.640039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:01:30.640039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:30.640039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:30.640039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:30.640039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:30.640039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:30.640039 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:30.641422 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:30.641422 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:30.641422 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 10:01:30.641422 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 10:01:30.641422 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 10:01:30.641422 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 10:01:30.641422 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 10:01:30.641422 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 10:01:30.641422 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 02 10:01:30.641422 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:30.641422 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 609/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 10:01:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:30.645863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a44a1-2a95-4922-84d5-348faa31c4ac None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:30.740321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a44a1-2a95-4922-84d5-348faa31c4ac None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:30.773020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf54727-458c-4609-9b21-72454e040a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:30.773678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf54727-458c-4609-9b21-72454e040a95 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:30.773964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf54727-458c-4609-9b21-72454e040a95 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:30.774242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf54727-458c-4609-9b21-72454e040a95 None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:30.775097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf54727-458c-4609-9b21-72454e040a95 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:30.775408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf54727-458c-4609-9b21-72454e040a95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:30.776861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf54727-458c-4609-9b21-72454e040a95 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:30.794367 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 618/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Mon May 2 10:01:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:30.800367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde98fd-7435-42e0-92e3-d1f225964cfc None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:30.898889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde98fd-7435-42e0-92e3-d1f225964cfc None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:30.930371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97463937-e519-4bdd-b61f-2ae4109d979d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:30.931858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97463937-e519-4bdd-b61f-2ae4109d979d None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:30.932139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97463937-e519-4bdd-b61f-2ae4109d979d None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:30.932417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97463937-e519-4bdd-b61f-2ae4109d979d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:30.942366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97463937-e519-4bdd-b61f-2ae4109d979d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:30.944910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97463937-e519-4bdd-b61f-2ae4109d979d None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:30.959877 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-97463937-e519-4bdd-b61f-2ae4109d979d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:30.959877 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:30.959877 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:30.959877 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:30.959877 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:30.959877 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:30.959877 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:30.959877 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:30.959877 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:30.959877 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:30.959877 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:30.959877 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:30.959877 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 10:01:30.959877 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 10:01:30.959877 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 10:01:30.960908 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 10:01:30.960908 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:30.960908 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:30.960908 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:30.960908 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:30.960908 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:30.960908 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:30.960908 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:30.960908 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:01:30.960908 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:30.960908 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:30.960908 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:30.960908 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:30.960908 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:30.960908 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:30.960908 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:30.960908 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:30.962046 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 10:01:30.962046 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:01:30.962046 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:30.962046 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:30.962046 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 610/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 10:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:30.966982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf54727-458c-4609-9b21-72454e040a95 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:31.060423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf54727-458c-4609-9b21-72454e040a95 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:31.093721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59841fb-4594-4ded-93ee-57b023b7ed2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:31.094383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59841fb-4594-4ded-93ee-57b023b7ed2f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:31.094683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59841fb-4594-4ded-93ee-57b023b7ed2f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:31.094946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59841fb-4594-4ded-93ee-57b023b7ed2f None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:31.095782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59841fb-4594-4ded-93ee-57b023b7ed2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:31.096086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59841fb-4594-4ded-93ee-57b023b7ed2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:31.097480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59841fb-4594-4ded-93ee-57b023b7ed2f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:31.112762 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 619/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 10:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:31.114619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97463937-e519-4bdd-b61f-2ae4109d979d None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:31.209547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97463937-e519-4bdd-b61f-2ae4109d979d None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:31.242126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795dd3f-7174-4005-8f1f-d969718451d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:31.242902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795dd3f-7174-4005-8f1f-d969718451d4 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:31.243711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795dd3f-7174-4005-8f1f-d969718451d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:31.243987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795dd3f-7174-4005-8f1f-d969718451d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:31.250386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795dd3f-7174-4005-8f1f-d969718451d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:31.251866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795dd3f-7174-4005-8f1f-d969718451d4 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:31.266483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-5795dd3f-7174-4005-8f1f-d969718451d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 10:01:31.266483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:31.266483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:31.266483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:31.266483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:31.266483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:31.266483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:31.266483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:31.266483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:31.266483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:31.266483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:31.266483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:31.266483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 10:01:31.266483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 10:01:31.266483 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 10:01:31.267522 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 10:01:31.267522 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:31.267522 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:31.267522 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:31.267522 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:31.267522 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:31.267522 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:31.267522 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:31.267522 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:01:31.267522 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:31.267522 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:31.267522 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:31.267522 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:31.267522 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:31.267522 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:31.267522 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:31.267522 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:31.268709 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 10:01:31.268709 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 10:01:31.268709 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:01:31.268709 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:01:31.268709 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:01:31.268709 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:01:31.268709 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 10:01:31.268709 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:31.268709 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 611/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 10:01:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:31.273525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59841fb-4594-4ded-93ee-57b023b7ed2f None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:31.367148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59841fb-4594-4ded-93ee-57b023b7ed2f None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:31.399112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4fc5d-2043-42bb-8495-42902aaf06a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:31.399799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4fc5d-2043-42bb-8495-42902aaf06a3 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:31.400080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4fc5d-2043-42bb-8495-42902aaf06a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:31.400384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4fc5d-2043-42bb-8495-42902aaf06a3 None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:31.401203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4fc5d-2043-42bb-8495-42902aaf06a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:31.401518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4fc5d-2043-42bb-8495-42902aaf06a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:31.402955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4fc5d-2043-42bb-8495-42902aaf06a3 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:31.414470 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 620/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 10:01:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:31.420410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795dd3f-7174-4005-8f1f-d969718451d4 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:31.515137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795dd3f-7174-4005-8f1f-d969718451d4 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:31.546623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217ef0d-fdec-495d-8ae5-9a4f09f23dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:31.547568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217ef0d-fdec-495d-8ae5-9a4f09f23dc0 None admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:31.547857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217ef0d-fdec-495d-8ae5-9a4f09f23dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:31.548135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217ef0d-fdec-495d-8ae5-9a4f09f23dc0 None admin] PATH_INFO: `/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/eef155f5230d47c29fc3d74c2241130b/roles/a47492f29bc144158c1c2ed9a4c39d39` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:31.562170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217ef0d-fdec-495d-8ae5-9a4f09f23dc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=972cae0aa9694d6cad22fbdbcf916ff7, user_id=eef155f5230d47c29fc3d74c2241130b, role_id=a47492f29bc144158c1c2ed9a4c39d39)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:31.563605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217ef0d-fdec-495d-8ae5-9a4f09f23dc0 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:31.614737 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 612/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 10:01:31 2022] PUT /identity/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/eef155f5230d47c29fc3d74c2241130b/roles/a47492f29bc144158c1c2ed9a4c39d39 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:01:33.896947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2af44-bf10-4e42-8ee4-aa105c251293 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:33.897480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2af44-bf10-4e42-8ee4-aa105c251293 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:33.897480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2af44-bf10-4e42-8ee4-aa105c251293 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:33.898880 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 621/1233] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:01:33.904550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236386c-e178-4931-9a8d-a27e3fe96ce8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:33.905040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236386c-e178-4931-9a8d-a27e3fe96ce8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:33.905229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236386c-e178-4931-9a8d-a27e3fe96ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:33.921557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a236386c-e178-4931-9a8d-a27e3fe96ce8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:01:33.922790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a236386c-e178-4931-9a8d-a27e3fe96ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:01:33.985803 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 613/1234] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:01:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 10:01:34.010756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2af44-bf10-4e42-8ee4-aa105c251293 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:34.105227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2af44-bf10-4e42-8ee4-aa105c251293 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:34.137828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60a406-2bb1-47e8-a074-78d35a4a2ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:34.138612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60a406-2bb1-47e8-a074-78d35a4a2ec8 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:34.140458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60a406-2bb1-47e8-a074-78d35a4a2ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:34.140458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60a406-2bb1-47e8-a074-78d35a4a2ec8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:34.148796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60a406-2bb1-47e8-a074-78d35a4a2ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:01:34.157056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-2e60a406-2bb1-47e8-a074-78d35a4a2ec8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 02 10:01:34.157056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:34.157056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:34.157056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:34.157056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:34.157056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:34.157056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:34.157056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:34.157056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:34.157056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:34.157056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:34.157056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:34.157056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 10:01:34.157056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 10:01:34.157056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 10:01:34.157056 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 10:01:34.158180 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:01:34.158180 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:01:34.158180 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:01:34.158180 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:01:34.158180 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:34.158180 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:34.158180 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:34.158180 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:34.158180 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:34.158180 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:34.158180 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:34.158180 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:01:34.158180 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:34.158180 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:34.158180 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:34.158180 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:34.161009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:34.161009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:34.161009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:34.161009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:34.161009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 10:01:34.161009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 10:01:34.161009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 10:01:34.161009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 10:01:34.161009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 10:01:34.161009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 10:01:34.161009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 02 10:01:34.161009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:01:34.161009 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 622/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Mon May 2 10:01:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:34.164328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236386c-e178-4931-9a8d-a27e3fe96ce8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:34.257902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236386c-e178-4931-9a8d-a27e3fe96ce8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:34.291168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa267e7-e0f1-4df9-ada7-b1570b1bcd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:34.291824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa267e7-e0f1-4df9-ada7-b1570b1bcd4b None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:34.292105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa267e7-e0f1-4df9-ada7-b1570b1bcd4b None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:34.292379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa267e7-e0f1-4df9-ada7-b1570b1bcd4b None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:34.293146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa267e7-e0f1-4df9-ada7-b1570b1bcd4b None admin] RBAC: Adding query filter params (name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:34.293457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa267e7-e0f1-4df9-ada7-b1570b1bcd4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:34.294807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa267e7-e0f1-4df9-ada7-b1570b1bcd4b None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:34.302378 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 614/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Mon May 2 10:01:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:34.308657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60a406-2bb1-47e8-a074-78d35a4a2ec8 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:34.402137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60a406-2bb1-47e8-a074-78d35a4a2ec8 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:34.433936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60711873-6785-4862-9a2f-ce60ca5287fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:34.434832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60711873-6785-4862-9a2f-ce60ca5287fb None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:34.435117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60711873-6785-4862-9a2f-ce60ca5287fb None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:34.435392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60711873-6785-4862-9a2f-ce60ca5287fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:34.445515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60711873-6785-4862-9a2f-ce60ca5287fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:34.447557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60711873-6785-4862-9a2f-ce60ca5287fb None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:34.464416 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-60711873-6785-4862-9a2f-ce60ca5287fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:34.464416 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:34.464416 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:34.464416 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:34.464416 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:34.464416 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:34.464416 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:34.464416 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:34.464416 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:34.464416 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:34.464416 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:34.464416 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:34.464416 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 10:01:34.464416 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 10:01:34.464416 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 10:01:34.465486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 10:01:34.465486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:34.465486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:34.465486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:34.465486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:34.465486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:34.465486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:34.465486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:34.465486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:01:34.465486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:34.465486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:34.465486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:34.465486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:34.465486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:34.465486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:34.465486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:34.465486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:34.466535 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 10:01:34.466535 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:01:34.466535 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:34.466535 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:01:34.466535 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 623/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 10:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:34.471485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa267e7-e0f1-4df9-ada7-b1570b1bcd4b None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:34.565112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa267e7-e0f1-4df9-ada7-b1570b1bcd4b None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:34.596857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9b3c3-d7aa-4f5e-a60b-0b85b0275516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:34.597600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9b3c3-d7aa-4f5e-a60b-0b85b0275516 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:34.597884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9b3c3-d7aa-4f5e-a60b-0b85b0275516 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:34.598156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9b3c3-d7aa-4f5e-a60b-0b85b0275516 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:34.598868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9b3c3-d7aa-4f5e-a60b-0b85b0275516 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:34.599226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9b3c3-d7aa-4f5e-a60b-0b85b0275516 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:34.600649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9b3c3-d7aa-4f5e-a60b-0b85b0275516 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:34.612515 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 615/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 10:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:34.618490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60711873-6785-4862-9a2f-ce60ca5287fb None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:34.716050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60711873-6785-4862-9a2f-ce60ca5287fb None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:34.746964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0638c51-8d7f-4b84-a11b-55954eb08af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:34.747762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638c51-8d7f-4b84-a11b-55954eb08af3 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:34.748036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638c51-8d7f-4b84-a11b-55954eb08af3 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:34.748308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638c51-8d7f-4b84-a11b-55954eb08af3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:34.755612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0638c51-8d7f-4b84-a11b-55954eb08af3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:34.757080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0638c51-8d7f-4b84-a11b-55954eb08af3 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:34.770970 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-d0638c51-8d7f-4b84-a11b-55954eb08af3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 02 10:01:34.770970 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:34.770970 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:34.770970 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:34.770970 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:34.770970 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:34.770970 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:34.770970 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:34.770970 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:34.770970 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:34.770970 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:34.770970 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:34.770970 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 10:01:34.770970 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 10:01:34.770970 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 10:01:34.770970 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 10:01:34.772023 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:34.772023 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:34.772023 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 10:01:34.772023 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:01:34.772023 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 10:01:34.772023 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:01:34.772023 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:34.772023 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:34.772023 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:34.772023 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:34.772023 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:34.772023 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:01:34.772023 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:34.772023 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:34.772023 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:34.772023 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:34.772023 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:34.772023 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:34.773009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:34.773009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:34.773009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 10:01:34.773009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 10:01:34.773009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 10:01:34.773009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 10:01:34.773009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 10:01:34.773009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 10:01:34.773009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 02 10:01:34.773009 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:01:34.773009 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 624/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 10:01:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:34.778571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9b3c3-d7aa-4f5e-a60b-0b85b0275516 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:34.875005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9b3c3-d7aa-4f5e-a60b-0b85b0275516 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:34.907462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02babf5-79a4-4d2d-805a-09683dd198c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:34.908123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02babf5-79a4-4d2d-805a-09683dd198c7 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:34.908405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02babf5-79a4-4d2d-805a-09683dd198c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:34.908713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02babf5-79a4-4d2d-805a-09683dd198c7 None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:34.909549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02babf5-79a4-4d2d-805a-09683dd198c7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:34.909857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02babf5-79a4-4d2d-805a-09683dd198c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:34.911277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02babf5-79a4-4d2d-805a-09683dd198c7 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:34.928578 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 616/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Mon May 2 10:01:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:34.938510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0638c51-8d7f-4b84-a11b-55954eb08af3 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:35.032250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0638c51-8d7f-4b84-a11b-55954eb08af3 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:35.063742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf916057-3e83-424c-8a62-cb7485958bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:35.064381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf916057-3e83-424c-8a62-cb7485958bb0 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:35.064692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf916057-3e83-424c-8a62-cb7485958bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:35.064973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf916057-3e83-424c-8a62-cb7485958bb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:35.128278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf916057-3e83-424c-8a62-cb7485958bb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:35.129775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf916057-3e83-424c-8a62-cb7485958bb0 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:35.221782 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 625/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 10:01:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 10:01:35.228760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02babf5-79a4-4d2d-805a-09683dd198c7 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:35.324754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02babf5-79a4-4d2d-805a-09683dd198c7 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:35.357070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7a826-873d-493c-b77e-874df9188eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:35.357853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7a826-873d-493c-b77e-874df9188eb0 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:35.358140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7a826-873d-493c-b77e-874df9188eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:35.358445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7a826-873d-493c-b77e-874df9188eb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:35.368847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7a826-873d-493c-b77e-874df9188eb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:35.370373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7a826-873d-493c-b77e-874df9188eb0 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:35.387298 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-7cf7a826-873d-493c-b77e-874df9188eb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:35.387298 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:35.387298 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:35.387298 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:35.387298 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:35.387298 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:35.387298 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:35.387298 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:35.387298 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:35.387298 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:35.387298 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:35.387298 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:35.387298 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 10:01:35.387298 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 10:01:35.387298 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 10:01:35.388356 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 10:01:35.388356 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:35.388356 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:35.388356 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:35.388356 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:35.388356 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:35.388356 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:35.388356 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:35.388356 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:01:35.388356 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:35.388356 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:35.388356 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:35.388356 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:35.388356 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:35.388356 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:35.388356 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:35.388356 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:35.393874 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 10:01:35.393874 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:01:35.393874 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:35.393874 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:35.393874 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 617/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 10:01:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:35.394154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf916057-3e83-424c-8a62-cb7485958bb0 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:35.487365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf916057-3e83-424c-8a62-cb7485958bb0 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:35.519464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c4141-c3c1-4f47-af0e-df0f92a0bdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:35.520113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c4141-c3c1-4f47-af0e-df0f92a0bdb4 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:35.520396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c4141-c3c1-4f47-af0e-df0f92a0bdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:35.520696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c4141-c3c1-4f47-af0e-df0f92a0bdb4 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:35.521411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c4141-c3c1-4f47-af0e-df0f92a0bdb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:35.521715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c4141-c3c1-4f47-af0e-df0f92a0bdb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:35.523075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c4141-c3c1-4f47-af0e-df0f92a0bdb4 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:35.533658 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 626/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 10:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:35.539573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7a826-873d-493c-b77e-874df9188eb0 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:35.634767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7a826-873d-493c-b77e-874df9188eb0 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:35.666762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3120a6e-b3c1-452d-87fb-1b0f18e7b52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:35.667542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3120a6e-b3c1-452d-87fb-1b0f18e7b52c None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:35.667827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3120a6e-b3c1-452d-87fb-1b0f18e7b52c None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:35.668103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3120a6e-b3c1-452d-87fb-1b0f18e7b52c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:35.674559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3120a6e-b3c1-452d-87fb-1b0f18e7b52c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:35.675977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3120a6e-b3c1-452d-87fb-1b0f18e7b52c None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:35.689732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-d3120a6e-b3c1-452d-87fb-1b0f18e7b52c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 10:01:35.689732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:35.689732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:35.689732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:35.689732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:35.689732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:35.689732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:35.689732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:35.689732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:35.689732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:35.689732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:35.689732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:35.689732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 10:01:35.689732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 10:01:35.689732 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 10:01:35.690675 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 10:01:35.690675 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:35.690675 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:35.690675 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:35.690675 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:35.690675 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:35.690675 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:35.690675 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:35.690675 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:01:35.690675 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:35.690675 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:35.690675 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:35.690675 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:35.690675 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:35.690675 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:35.690675 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:35.690675 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:35.691931 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 10:01:35.691931 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 10:01:35.691931 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:01:35.691931 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:01:35.691931 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:01:35.691931 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:01:35.691931 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 10:01:35.691931 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:35.691931 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 618/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 10:01:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:35.696878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c4141-c3c1-4f47-af0e-df0f92a0bdb4 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:35.791909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c4141-c3c1-4f47-af0e-df0f92a0bdb4 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:35.823153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9b97f-ae78-4cc7-8827-6fd0dd02fbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:35.823805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9b97f-ae78-4cc7-8827-6fd0dd02fbf0 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:35.824085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9b97f-ae78-4cc7-8827-6fd0dd02fbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:35.824361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9b97f-ae78-4cc7-8827-6fd0dd02fbf0 None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:35.825169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9b97f-ae78-4cc7-8827-6fd0dd02fbf0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:35.825480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9b97f-ae78-4cc7-8827-6fd0dd02fbf0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:35.826919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9b97f-ae78-4cc7-8827-6fd0dd02fbf0 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:35.838708 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 627/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 10:01:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:35.844872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3120a6e-b3c1-452d-87fb-1b0f18e7b52c None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:35.939570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3120a6e-b3c1-452d-87fb-1b0f18e7b52c None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:35.970942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9722a35-8b58-482d-827f-7572ba5d3eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:35.973811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9722a35-8b58-482d-827f-7572ba5d3eb1 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:35.973811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9722a35-8b58-482d-827f-7572ba5d3eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:35.973811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9722a35-8b58-482d-827f-7572ba5d3eb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:35.973811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9722a35-8b58-482d-827f-7572ba5d3eb1 None admin] RBAC: Adding query filter params (role.id=a47492f29bc144158c1c2ed9a4c39d39, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=eef155f5230d47c29fc3d74c2241130b) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:35.973811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9722a35-8b58-482d-827f-7572ba5d3eb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:35.974730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9722a35-8b58-482d-827f-7572ba5d3eb1 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:35.980980 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 619/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 10:01:35 2022] GET /identity/v3/role_assignments?user.id=eef155f5230d47c29fc3d74c2241130b&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=a47492f29bc144158c1c2ed9a4c39d39 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:38.307729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275f74f-55ba-45a8-90a6-386a56c35ed7 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:38.308258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275f74f-55ba-45a8-90a6-386a56c35ed7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:38.308371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275f74f-55ba-45a8-90a6-386a56c35ed7 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:38.309679 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 628/1247] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 10:01:38.314871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c73fa4-c309-44bf-bf6b-b56cd991c848 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:38.315310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c73fa4-c309-44bf-bf6b-b56cd991c848 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:38.315433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c73fa4-c309-44bf-bf6b-b56cd991c848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:38.332193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d8c73fa4-c309-44bf-bf6b-b56cd991c848 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:01:38.333394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d8c73fa4-c309-44bf-bf6b-b56cd991c848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:01:38.396276 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 620/1248] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:01:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 10:01:38.421117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275f74f-55ba-45a8-90a6-386a56c35ed7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:38.517011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275f74f-55ba-45a8-90a6-386a56c35ed7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:38.548767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf2359-1e09-43b4-8b3f-029384725739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:38.549547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf2359-1e09-43b4-8b3f-029384725739 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:38.549830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf2359-1e09-43b4-8b3f-029384725739 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:38.550106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf2359-1e09-43b4-8b3f-029384725739 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:38.560573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf2359-1e09-43b4-8b3f-029384725739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:01:38.568189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-ffaf2359-1e09-43b4-8b3f-029384725739 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 10:01:38.568189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:38.568189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:38.568189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:38.568189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:38.568189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:38.568189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:38.568189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:38.568189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:38.568189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:38.568189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:38.568189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:38.568189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 10:01:38.568189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 10:01:38.568189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 10:01:38.568189 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 10:01:38.569347 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:01:38.569347 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:01:38.569347 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:01:38.569347 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:01:38.569347 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:38.569347 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:38.569347 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:38.569347 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:38.569347 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:38.569347 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:38.569347 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:38.569347 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:01:38.569347 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:38.569347 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:38.569347 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:38.569347 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:38.570269 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:38.570269 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:38.570269 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:38.570269 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:38.570269 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 10:01:38.570269 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 10:01:38.570269 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 10:01:38.570269 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 10:01:38.570269 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 10:01:38.570269 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 10:01:38.570269 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 10:01:38.570269 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:01:38.570269 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 629/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 10:01:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:38.575395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c73fa4-c309-44bf-bf6b-b56cd991c848 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:38.668271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c73fa4-c309-44bf-bf6b-b56cd991c848 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:38.700457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258ded1-1bf5-4b8f-a1d6-37882a272db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:38.701179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258ded1-1bf5-4b8f-a1d6-37882a272db6 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:38.701488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258ded1-1bf5-4b8f-a1d6-37882a272db6 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:38.701764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258ded1-1bf5-4b8f-a1d6-37882a272db6 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:38.702657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258ded1-1bf5-4b8f-a1d6-37882a272db6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:38.702877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258ded1-1bf5-4b8f-a1d6-37882a272db6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:38.704231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258ded1-1bf5-4b8f-a1d6-37882a272db6 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:38.712701 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 621/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 10:01:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:38.718297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf2359-1e09-43b4-8b3f-029384725739 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:38.812611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf2359-1e09-43b4-8b3f-029384725739 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:38.844367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e837a-e3e3-4191-a9c3-71104523762f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:38.845189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e837a-e3e3-4191-a9c3-71104523762f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:38.845473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e837a-e3e3-4191-a9c3-71104523762f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:38.845747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e837a-e3e3-4191-a9c3-71104523762f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:38.855777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e837a-e3e3-4191-a9c3-71104523762f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:38.857250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e837a-e3e3-4191-a9c3-71104523762f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:38.874762 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-c78e837a-e3e3-4191-a9c3-71104523762f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:38.874762 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:38.874762 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:38.874762 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:38.874762 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:38.874762 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:38.874762 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:38.874762 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:38.874762 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:38.874762 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:38.874762 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:38.874762 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:38.874762 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 10:01:38.874762 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 10:01:38.874762 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 10:01:38.875981 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 10:01:38.875981 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:38.875981 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:38.875981 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:38.875981 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:38.875981 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:38.875981 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:38.875981 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:38.875981 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:01:38.875981 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:38.875981 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:38.875981 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:38.875981 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:38.875981 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:38.875981 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:38.875981 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:38.875981 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:38.877233 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 10:01:38.877233 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:01:38.877233 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:38.877233 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:01:38.877233 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 630/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 10:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:38.881898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258ded1-1bf5-4b8f-a1d6-37882a272db6 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:38.979120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258ded1-1bf5-4b8f-a1d6-37882a272db6 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:39.012005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72080546-e7a1-4b4a-8e12-3d11c0d90b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:39.012672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72080546-e7a1-4b4a-8e12-3d11c0d90b06 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:39.012961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72080546-e7a1-4b4a-8e12-3d11c0d90b06 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:39.013232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72080546-e7a1-4b4a-8e12-3d11c0d90b06 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:39.013948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72080546-e7a1-4b4a-8e12-3d11c0d90b06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:39.014435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72080546-e7a1-4b4a-8e12-3d11c0d90b06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:39.015777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72080546-e7a1-4b4a-8e12-3d11c0d90b06 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:39.027313 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 622/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 10:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:39.033199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e837a-e3e3-4191-a9c3-71104523762f None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:39.129730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e837a-e3e3-4191-a9c3-71104523762f None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:39.161308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1e5a8-d553-4fde-b874-bd9a8e7aefd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:39.162144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1e5a8-d553-4fde-b874-bd9a8e7aefd3 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:39.162433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1e5a8-d553-4fde-b874-bd9a8e7aefd3 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:39.162709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1e5a8-d553-4fde-b874-bd9a8e7aefd3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:39.170425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1e5a8-d553-4fde-b874-bd9a8e7aefd3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:39.174200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1e5a8-d553-4fde-b874-bd9a8e7aefd3 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:39.186361 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-37c1e5a8-d553-4fde-b874-bd9a8e7aefd3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 02 10:01:39.186361 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:39.186361 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:39.186361 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:39.186361 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:39.186361 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:39.186361 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:39.186361 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:39.186361 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:39.186361 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:39.186361 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:39.186361 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:39.186361 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 10:01:39.186361 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 10:01:39.186361 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 10:01:39.186361 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 10:01:39.187474 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:39.187474 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:39.187474 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 10:01:39.187474 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:01:39.187474 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 10:01:39.187474 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:01:39.187474 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:39.187474 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:39.187474 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:39.187474 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:39.187474 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:39.187474 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:01:39.187474 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:39.187474 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:39.187474 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:39.187474 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:39.187474 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:39.187474 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:39.193308 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:39.193308 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:39.193308 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 10:01:39.193308 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 10:01:39.193308 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 10:01:39.193308 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 10:01:39.193308 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 10:01:39.193308 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 10:01:39.193308 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 02 10:01:39.193308 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:01:39.193308 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 631/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 10:01:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:39.194043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72080546-e7a1-4b4a-8e12-3d11c0d90b06 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:39.288809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72080546-e7a1-4b4a-8e12-3d11c0d90b06 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:39.321822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b107d96-877b-47d6-a0f6-93013910ed68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:39.322516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b107d96-877b-47d6-a0f6-93013910ed68 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:39.322804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b107d96-877b-47d6-a0f6-93013910ed68 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:39.323085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b107d96-877b-47d6-a0f6-93013910ed68 None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:39.323951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b107d96-877b-47d6-a0f6-93013910ed68 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:39.324264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b107d96-877b-47d6-a0f6-93013910ed68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:39.325727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b107d96-877b-47d6-a0f6-93013910ed68 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:39.342530 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 623/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Mon May 2 10:01:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:39.348177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1e5a8-d553-4fde-b874-bd9a8e7aefd3 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:39.443909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1e5a8-d553-4fde-b874-bd9a8e7aefd3 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:39.475835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a591e-3783-4bf8-9c6b-80ac58d5dab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:39.476516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a591e-3783-4bf8-9c6b-80ac58d5dab4 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:39.476831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a591e-3783-4bf8-9c6b-80ac58d5dab4 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:39.478015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a591e-3783-4bf8-9c6b-80ac58d5dab4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:39.542537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a591e-3783-4bf8-9c6b-80ac58d5dab4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:39.544056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a591e-3783-4bf8-9c6b-80ac58d5dab4 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:39.637696 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 632/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 10:01:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 10:01:39.643514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b107d96-877b-47d6-a0f6-93013910ed68 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:39.737788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b107d96-877b-47d6-a0f6-93013910ed68 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:39.768931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c0df2-50e6-4a07-a9cd-2b9a8f73f4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:39.769708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c0df2-50e6-4a07-a9cd-2b9a8f73f4cf None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:39.769989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c0df2-50e6-4a07-a9cd-2b9a8f73f4cf None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:39.770260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c0df2-50e6-4a07-a9cd-2b9a8f73f4cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:39.780724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c0df2-50e6-4a07-a9cd-2b9a8f73f4cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:39.782137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c0df2-50e6-4a07-a9cd-2b9a8f73f4cf None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:39.801478 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-f82c0df2-50e6-4a07-a9cd-2b9a8f73f4cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:39.801478 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:39.801478 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:39.801478 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:39.801478 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:39.801478 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:39.801478 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:39.801478 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:39.801478 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:39.801478 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:39.801478 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:39.801478 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:39.801478 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 10:01:39.801478 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 10:01:39.801478 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 10:01:39.802694 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 10:01:39.802694 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:39.802694 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:39.802694 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:39.802694 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:39.802694 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:39.802694 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:39.802694 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:39.802694 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:01:39.802694 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:39.802694 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:39.802694 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:39.802694 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:39.802694 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:39.802694 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:39.802694 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:39.802694 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:39.803736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 10:01:39.803736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:01:39.803736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:39.803736 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:39.803736 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 624/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 10:01:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:39.806253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a591e-3783-4bf8-9c6b-80ac58d5dab4 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:39.900397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a591e-3783-4bf8-9c6b-80ac58d5dab4 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:39.931598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544fb5a-2125-403f-9200-4ee839fc0645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:39.932252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544fb5a-2125-403f-9200-4ee839fc0645 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:39.932532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544fb5a-2125-403f-9200-4ee839fc0645 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:39.932844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544fb5a-2125-403f-9200-4ee839fc0645 None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:39.933628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544fb5a-2125-403f-9200-4ee839fc0645 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:39.933935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544fb5a-2125-403f-9200-4ee839fc0645 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:39.935285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544fb5a-2125-403f-9200-4ee839fc0645 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:39.946364 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 633/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 10:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:01:39.952142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c0df2-50e6-4a07-a9cd-2b9a8f73f4cf None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:40.046706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c0df2-50e6-4a07-a9cd-2b9a8f73f4cf None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:40.078736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2b34a-1bfe-48fe-8b03-2611c46b9210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:40.079464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2b34a-1bfe-48fe-8b03-2611c46b9210 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:40.079747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2b34a-1bfe-48fe-8b03-2611c46b9210 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:40.080045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2b34a-1bfe-48fe-8b03-2611c46b9210 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:40.086458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2b34a-1bfe-48fe-8b03-2611c46b9210 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:40.088466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2b34a-1bfe-48fe-8b03-2611c46b9210 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:40.101828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-e1f2b34a-1bfe-48fe-8b03-2611c46b9210 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 10:01:40.101828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:40.101828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:40.101828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:40.101828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:40.101828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:40.101828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:40.101828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:40.101828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:40.101828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:40.101828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:40.101828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:40.101828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 10:01:40.101828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 10:01:40.101828 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 10:01:40.102853 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 10:01:40.102853 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:40.102853 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:40.102853 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:40.102853 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:40.102853 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:40.102853 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:40.102853 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:40.102853 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:01:40.102853 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:40.102853 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:40.102853 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:40.102853 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:40.102853 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:40.102853 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:40.102853 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:40.102853 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:40.103869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 10:01:40.103869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 10:01:40.103869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:01:40.103869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:01:40.103869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:01:40.103869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:01:40.103869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 10:01:40.103869 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:40.103869 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 625/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 10:01:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 10:01:40.108839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544fb5a-2125-403f-9200-4ee839fc0645 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:40.203945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544fb5a-2125-403f-9200-4ee839fc0645 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:40.235642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcd32f-14f8-42ce-b616-a5b1a107bd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:40.236291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcd32f-14f8-42ce-b616-a5b1a107bd32 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:40.236573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcd32f-14f8-42ce-b616-a5b1a107bd32 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:40.236893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcd32f-14f8-42ce-b616-a5b1a107bd32 None admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:40.237705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dcd32f-14f8-42ce-b616-a5b1a107bd32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:40.238008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dcd32f-14f8-42ce-b616-a5b1a107bd32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:40.239484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dcd32f-14f8-42ce-b616-a5b1a107bd32 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:40.251598 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 634/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 10:01:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:40.257617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2b34a-1bfe-48fe-8b03-2611c46b9210 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:40.353365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2b34a-1bfe-48fe-8b03-2611c46b9210 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:40.386358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d326b-6978-409d-8c06-6369a06bd477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:40.387001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d326b-6978-409d-8c06-6369a06bd477 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:40.387284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d326b-6978-409d-8c06-6369a06bd477 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:40.387559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d326b-6978-409d-8c06-6369a06bd477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:40.388417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d326b-6978-409d-8c06-6369a06bd477 None admin] RBAC: Adding query filter params (role.id=dd8a47ade22941849ebdf8fbdf994b66, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=eef155f5230d47c29fc3d74c2241130b) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:40.388767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d326b-6978-409d-8c06-6369a06bd477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:40.390186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d326b-6978-409d-8c06-6369a06bd477 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:40.395555 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 626/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 10:01:40 2022] GET /identity/v3/role_assignments?user.id=eef155f5230d47c29fc3d74c2241130b&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=dd8a47ade22941849ebdf8fbdf994b66 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:42.676163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1ebd9-3200-4b62-a83a-72ce8cd49f8a None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:42.676770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1ebd9-3200-4b62-a83a-72ce8cd49f8a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:42.676770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1ebd9-3200-4b62-a83a-72ce8cd49f8a None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:42.678103 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 635/1261] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:01:42.683650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcc972-0425-4b83-8854-8b295d31c01f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:42.684084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcc972-0425-4b83-8854-8b295d31c01f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:42.684208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcc972-0425-4b83-8854-8b295d31c01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:42.700219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-30dcc972-0425-4b83-8854-8b295d31c01f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:01:42.701419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-30dcc972-0425-4b83-8854-8b295d31c01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:01:42.763495 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 627/1262] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:01:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 10:01:42.787193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1ebd9-3200-4b62-a83a-72ce8cd49f8a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:42.884716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1ebd9-3200-4b62-a83a-72ce8cd49f8a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:42.917793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4406d-71f3-47bb-9add-a31397719847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:42.918587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4406d-71f3-47bb-9add-a31397719847 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:42.918870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4406d-71f3-47bb-9add-a31397719847 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:42.919147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4406d-71f3-47bb-9add-a31397719847 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:42.929974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4406d-71f3-47bb-9add-a31397719847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:01:42.936595 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-0ea4406d-71f3-47bb-9add-a31397719847 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 10:01:42.936595 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:42.936595 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:42.936595 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:42.936595 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:42.936595 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:42.936595 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:42.936595 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:42.936595 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:42.936595 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:42.936595 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:42.936595 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:42.936595 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 10:01:42.936595 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 10:01:42.936595 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 10:01:42.936595 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 10:01:42.937835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:01:42.937835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:01:42.937835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:01:42.937835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:01:42.937835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:42.937835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:42.937835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:42.937835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:42.937835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:42.937835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:42.937835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:42.937835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:01:42.937835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:42.937835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:42.937835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:42.937835 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:42.938780 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:42.938780 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:42.938780 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:42.938780 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:42.938780 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 10:01:42.938780 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 10:01:42.938780 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 10:01:42.938780 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 10:01:42.938780 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 10:01:42.938780 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 10:01:42.938780 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 10:01:42.938780 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:01:42.938780 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 636/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 10:01:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:42.944066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcc972-0425-4b83-8854-8b295d31c01f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:43.037331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcc972-0425-4b83-8854-8b295d31c01f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:43.067947 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4bf2e-620b-425b-b3df-3ca9a3072334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:43.068672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4bf2e-620b-425b-b3df-3ca9a3072334 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:43.068955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4bf2e-620b-425b-b3df-3ca9a3072334 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:43.069228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4bf2e-620b-425b-b3df-3ca9a3072334 None admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:43.069959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4bf2e-620b-425b-b3df-3ca9a3072334 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:43.070261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4bf2e-620b-425b-b3df-3ca9a3072334 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:43.072098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4bf2e-620b-425b-b3df-3ca9a3072334 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:43.079726 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 628/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 10:01:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:43.085646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4406d-71f3-47bb-9add-a31397719847 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:43.180488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4406d-71f3-47bb-9add-a31397719847 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:43.212608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94083cfe-91c8-40d2-b76e-a736e82acb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:43.213509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94083cfe-91c8-40d2-b76e-a736e82acb30 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:43.213795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94083cfe-91c8-40d2-b76e-a736e82acb30 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:43.214065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94083cfe-91c8-40d2-b76e-a736e82acb30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:43.223983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94083cfe-91c8-40d2-b76e-a736e82acb30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:43.225447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94083cfe-91c8-40d2-b76e-a736e82acb30 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:43.241848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-94083cfe-91c8-40d2-b76e-a736e82acb30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:43.241848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:43.241848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:43.241848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:43.241848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:43.241848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:43.241848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:43.241848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:43.241848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:43.241848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:43.241848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:43.241848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:43.241848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 10:01:43.241848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 10:01:43.241848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 10:01:43.243371 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 10:01:43.243371 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:43.243371 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:43.243371 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:43.243371 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:43.243371 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:43.243371 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:43.243371 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:43.243371 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:01:43.243371 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:43.243371 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:43.243371 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:43.243371 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:43.243371 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:43.243371 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:43.243371 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:43.243371 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:43.244328 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 10:01:43.244328 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:01:43.244328 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:43.244328 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:01:43.244328 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 637/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 10:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:43.249548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4bf2e-620b-425b-b3df-3ca9a3072334 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:43.345242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4bf2e-620b-425b-b3df-3ca9a3072334 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:43.376749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23094a-1bba-43b6-8351-888b07e9bdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:43.377479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23094a-1bba-43b6-8351-888b07e9bdba None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:43.377758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23094a-1bba-43b6-8351-888b07e9bdba None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:43.378031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23094a-1bba-43b6-8351-888b07e9bdba None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:43.378742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23094a-1bba-43b6-8351-888b07e9bdba None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:43.379049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23094a-1bba-43b6-8351-888b07e9bdba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:43.380394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23094a-1bba-43b6-8351-888b07e9bdba None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:43.393247 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 629/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 10:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:43.399099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94083cfe-91c8-40d2-b76e-a736e82acb30 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:43.494911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94083cfe-91c8-40d2-b76e-a736e82acb30 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:43.526594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adaf7c5-094d-40aa-bb40-6750f3de7764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:43.527383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaf7c5-094d-40aa-bb40-6750f3de7764 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:43.527657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaf7c5-094d-40aa-bb40-6750f3de7764 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:43.527926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaf7c5-094d-40aa-bb40-6750f3de7764 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:43.535052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adaf7c5-094d-40aa-bb40-6750f3de7764 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:43.536479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adaf7c5-094d-40aa-bb40-6750f3de7764 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:43.550084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-1adaf7c5-094d-40aa-bb40-6750f3de7764 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 02 10:01:43.550084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:43.550084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:43.550084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:43.550084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:43.550084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:43.550084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:43.550084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:43.550084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:43.550084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:43.550084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:43.550084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:43.550084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 10:01:43.550084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 10:01:43.550084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 10:01:43.550084 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 10:01:43.551241 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:43.551241 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:43.551241 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 10:01:43.551241 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:01:43.551241 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 10:01:43.551241 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:01:43.551241 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:43.551241 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:43.551241 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:43.551241 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:43.551241 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:43.551241 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:01:43.551241 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:43.551241 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:43.551241 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:43.551241 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:43.551241 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:43.551241 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:43.552410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:43.552410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:43.552410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 10:01:43.552410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 10:01:43.552410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 10:01:43.552410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 10:01:43.552410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 10:01:43.552410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 10:01:43.552410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 02 10:01:43.552410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:01:43.552410 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 638/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 10:01:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:43.558517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23094a-1bba-43b6-8351-888b07e9bdba None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:43.656904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23094a-1bba-43b6-8351-888b07e9bdba None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:43.689574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e195b1-8670-4917-ae31-66c86631b989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:43.690236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e195b1-8670-4917-ae31-66c86631b989 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:43.690519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e195b1-8670-4917-ae31-66c86631b989 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:43.690800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e195b1-8670-4917-ae31-66c86631b989 None admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:43.691631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e195b1-8670-4917-ae31-66c86631b989 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:43.691943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e195b1-8670-4917-ae31-66c86631b989 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:43.693436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e195b1-8670-4917-ae31-66c86631b989 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:43.709548 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 630/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Mon May 2 10:01:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:43.715325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adaf7c5-094d-40aa-bb40-6750f3de7764 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:43.810547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adaf7c5-094d-40aa-bb40-6750f3de7764 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:43.842468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72df280-67e7-4a66-a001-8789e68d63e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:43.843246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72df280-67e7-4a66-a001-8789e68d63e9 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:43.843531 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72df280-67e7-4a66-a001-8789e68d63e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:43.843884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72df280-67e7-4a66-a001-8789e68d63e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:43.854489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72df280-67e7-4a66-a001-8789e68d63e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:43.855936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72df280-67e7-4a66-a001-8789e68d63e9 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:43.873188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-d72df280-67e7-4a66-a001-8789e68d63e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:43.873188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:43.873188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:43.873188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:43.873188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:43.873188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:43.873188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:43.873188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:43.873188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:43.873188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:43.873188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:43.873188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:43.873188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 10:01:43.873188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 10:01:43.873188 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 10:01:43.874230 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 10:01:43.874230 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:43.874230 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:43.874230 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:43.874230 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:43.874230 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:43.874230 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:43.874230 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:43.874230 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:01:43.874230 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:43.874230 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:43.874230 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:43.874230 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:43.874230 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:43.874230 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:43.874230 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:43.874230 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:43.875413 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 10:01:43.875413 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:01:43.875413 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:43.875413 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:01:43.875413 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 639/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 10:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:43.880247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e195b1-8670-4917-ae31-66c86631b989 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:43.975123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e195b1-8670-4917-ae31-66c86631b989 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:44.007934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7f028-4f1c-4410-8d46-7d271db8ceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:44.008643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7f028-4f1c-4410-8d46-7d271db8ceb4 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:44.008928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7f028-4f1c-4410-8d46-7d271db8ceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:44.009205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7f028-4f1c-4410-8d46-7d271db8ceb4 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:44.009922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7f028-4f1c-4410-8d46-7d271db8ceb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:44.010300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7f028-4f1c-4410-8d46-7d271db8ceb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:44.011682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7f028-4f1c-4410-8d46-7d271db8ceb4 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:44.022255 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 631/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 10:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:44.028678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72df280-67e7-4a66-a001-8789e68d63e9 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:44.126823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72df280-67e7-4a66-a001-8789e68d63e9 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:44.158564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcb6b5-8065-4786-9492-b2f1c06f7336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:44.159351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcb6b5-8065-4786-9492-b2f1c06f7336 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:44.159636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcb6b5-8065-4786-9492-b2f1c06f7336 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:44.159911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcb6b5-8065-4786-9492-b2f1c06f7336 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:44.166997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcb6b5-8065-4786-9492-b2f1c06f7336 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:44.168440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcb6b5-8065-4786-9492-b2f1c06f7336 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:44.182139 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-7dfcb6b5-8065-4786-9492-b2f1c06f7336 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 10:01:44.182139 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:44.182139 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:44.182139 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:44.182139 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:44.182139 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:44.182139 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:44.182139 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:44.182139 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:44.182139 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:44.182139 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:44.182139 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:44.182139 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 10:01:44.182139 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 10:01:44.182139 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 10:01:44.183220 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 10:01:44.183220 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:44.183220 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:44.183220 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:44.183220 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:44.183220 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:44.183220 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:44.183220 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:44.183220 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:01:44.183220 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:44.183220 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:44.183220 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:44.183220 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:44.183220 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:44.183220 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:44.183220 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:44.183220 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:44.184370 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 10:01:44.184370 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 10:01:44.184370 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:01:44.184370 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:01:44.184370 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:01:44.184370 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:01:44.184370 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 10:01:44.184370 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:01:44.184370 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 640/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 10:01:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:44.189399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7f028-4f1c-4410-8d46-7d271db8ceb4 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:44.284093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7f028-4f1c-4410-8d46-7d271db8ceb4 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:44.315996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd460b-beaa-4c59-b41f-8c0952474aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:44.316671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd460b-beaa-4c59-b41f-8c0952474aee None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:44.316955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd460b-beaa-4c59-b41f-8c0952474aee None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:44.317229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd460b-beaa-4c59-b41f-8c0952474aee None admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:44.318002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd460b-beaa-4c59-b41f-8c0952474aee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:44.318315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd460b-beaa-4c59-b41f-8c0952474aee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:44.319782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd460b-beaa-4c59-b41f-8c0952474aee None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:44.331096 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 632/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 10:01:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:44.337705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcb6b5-8065-4786-9492-b2f1c06f7336 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:44.433924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcb6b5-8065-4786-9492-b2f1c06f7336 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:44.466452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b49e8-23aa-400a-bf74-c1dd487e16d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:44.467327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b49e8-23aa-400a-bf74-c1dd487e16d7 None admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:44.467610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b49e8-23aa-400a-bf74-c1dd487e16d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:44.467885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b49e8-23aa-400a-bf74-c1dd487e16d7 None admin] PATH_INFO: `/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/eef155f5230d47c29fc3d74c2241130b/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:44.469800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b49e8-23aa-400a-bf74-c1dd487e16d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=972cae0aa9694d6cad22fbdbcf916ff7, user_id=eef155f5230d47c29fc3d74c2241130b, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:44.471272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b49e8-23aa-400a-bf74-c1dd487e16d7 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:44.555302 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 641/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Mon May 2 10:01:44 2022] PUT /identity/v3/projects/972cae0aa9694d6cad22fbdbcf916ff7/users/eef155f5230d47c29fc3d74c2241130b/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:01:46.831344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bafaf-fdf3-4289-b560-edaa3f9c621f None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:46.831910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bafaf-fdf3-4289-b560-edaa3f9c621f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:46.831910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bafaf-fdf3-4289-b560-edaa3f9c621f None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:46.833373 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 633/1274] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:01:46.838941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b23af-f7db-414b-8c6a-7c6fb670de33 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:46.843090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b23af-f7db-414b-8c6a-7c6fb670de33 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:46.843090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b23af-f7db-414b-8c6a-7c6fb670de33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:46.855496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5d2b23af-f7db-414b-8c6a-7c6fb670de33 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:01:46.856686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5d2b23af-f7db-414b-8c6a-7c6fb670de33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:01:46.920068 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 642/1275] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:01:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 10:01:46.944976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bafaf-fdf3-4289-b560-edaa3f9c621f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:47.040857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bafaf-fdf3-4289-b560-edaa3f9c621f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:47.072538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a422f-9e75-4905-9851-00d715ebe0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:47.073252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a422f-9e75-4905-9851-00d715ebe0b7 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:47.073531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a422f-9e75-4905-9851-00d715ebe0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:47.073801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a422f-9e75-4905-9851-00d715ebe0b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:47.083276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a422f-9e75-4905-9851-00d715ebe0b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:01:47.090845 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-047a422f-9e75-4905-9851-00d715ebe0b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 02 10:01:47.090845 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:47.090845 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:47.090845 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:47.090845 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:47.090845 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:47.090845 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:47.090845 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:47.090845 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:47.090845 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:47.090845 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:47.090845 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:47.090845 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 02 10:01:47.090845 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(role_id) May 02 10:01:47.090845 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 02 10:01:47.090845 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 02 10:01:47.091998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:01:47.091998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:01:47.091998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:01:47.091998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:01:47.091998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:47.091998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:47.091998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:47.091998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:47.091998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:47.091998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:47.091998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:47.091998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:01:47.091998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:47.091998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:47.091998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:47.091998 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:47.093041 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:47.093041 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:47.093041 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:47.093041 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:47.093041 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 10:01:47.093041 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 10:01:47.093041 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 10:01:47.093041 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 10:01:47.093041 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 10:01:47.093041 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 10:01:47.093041 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 02 10:01:47.093041 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:47.093041 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 634/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Mon May 2 10:01:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:47.098370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b23af-f7db-414b-8c6a-7c6fb670de33 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:47.192464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b23af-f7db-414b-8c6a-7c6fb670de33 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:47.224261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770576bd-625b-4de8-989d-fb8fcc4b7058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:47.224955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770576bd-625b-4de8-989d-fb8fcc4b7058 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:47.226640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770576bd-625b-4de8-989d-fb8fcc4b7058 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:47.226640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770576bd-625b-4de8-989d-fb8fcc4b7058 None admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:47.226640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770576bd-625b-4de8-989d-fb8fcc4b7058 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:47.226640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770576bd-625b-4de8-989d-fb8fcc4b7058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:47.227971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770576bd-625b-4de8-989d-fb8fcc4b7058 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:47.235532 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 643/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Mon May 2 10:01:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:47.241703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a422f-9e75-4905-9851-00d715ebe0b7 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:47.334472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a422f-9e75-4905-9851-00d715ebe0b7 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:47.367314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba38d2-1d18-4ee5-b71d-7ff05f5e457b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:47.368096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba38d2-1d18-4ee5-b71d-7ff05f5e457b None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:47.368377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba38d2-1d18-4ee5-b71d-7ff05f5e457b None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:47.368683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba38d2-1d18-4ee5-b71d-7ff05f5e457b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:47.379097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba38d2-1d18-4ee5-b71d-7ff05f5e457b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:47.380532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba38d2-1d18-4ee5-b71d-7ff05f5e457b None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:47.397586 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-5cba38d2-1d18-4ee5-b71d-7ff05f5e457b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:47.397586 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:47.397586 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:47.397586 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:47.397586 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:47.397586 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:47.397586 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:47.397586 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:47.397586 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:47.397586 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:47.397586 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:47.397586 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:47.397586 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 10:01:47.397586 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 10:01:47.397586 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 10:01:47.398544 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 10:01:47.398544 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:47.398544 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:47.398544 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:47.398544 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:47.398544 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:47.398544 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:47.398544 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:47.398544 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:01:47.398544 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:47.398544 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:47.398544 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:47.398544 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:47.398544 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:47.398544 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:47.398544 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:47.398544 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:47.400187 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 10:01:47.400187 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:01:47.400187 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:47.400187 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:47.400187 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 635/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 10:01:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 10:01:47.405354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770576bd-625b-4de8-989d-fb8fcc4b7058 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:47.501371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770576bd-625b-4de8-989d-fb8fcc4b7058 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:47.533919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265e944-da13-40d5-b8d2-c4c8fb8ca28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:47.534598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265e944-da13-40d5-b8d2-c4c8fb8ca28e None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:47.534876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265e944-da13-40d5-b8d2-c4c8fb8ca28e None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:47.535147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265e944-da13-40d5-b8d2-c4c8fb8ca28e None admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:47.535863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265e944-da13-40d5-b8d2-c4c8fb8ca28e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:47.536169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265e944-da13-40d5-b8d2-c4c8fb8ca28e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:47.537556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265e944-da13-40d5-b8d2-c4c8fb8ca28e None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:47.548728 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 644/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 10:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:47.555765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba38d2-1d18-4ee5-b71d-7ff05f5e457b None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:47.652159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba38d2-1d18-4ee5-b71d-7ff05f5e457b None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:47.684056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497e83f-0e77-41f6-92f6-2d936c44822b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:47.684902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497e83f-0e77-41f6-92f6-2d936c44822b None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:47.685185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497e83f-0e77-41f6-92f6-2d936c44822b None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:47.685461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497e83f-0e77-41f6-92f6-2d936c44822b None admin] PATH_INFO: `/v3/users/placement` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:47.693648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497e83f-0e77-41f6-92f6-2d936c44822b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:47.695110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497e83f-0e77-41f6-92f6-2d936c44822b None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:47.709462 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-a497e83f-0e77-41f6-92f6-2d936c44822b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 02 10:01:47.709462 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:47.709462 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:47.709462 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:47.709462 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:47.709462 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:47.709462 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:47.709462 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:47.709462 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:47.709462 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:47.709462 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:47.709462 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:47.709462 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 10:01:47.709462 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 10:01:47.709462 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 10:01:47.709462 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 10:01:47.710516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:47.710516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:47.710516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 10:01:47.710516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:01:47.710516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 10:01:47.710516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:01:47.710516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:47.710516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:47.710516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:47.710516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:47.710516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:47.710516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:01:47.710516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:47.710516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:47.710516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:47.710516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:47.710516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:47.710516 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:47.712027 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:47.712027 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:47.712027 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 10:01:47.712027 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 10:01:47.712027 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 10:01:47.712027 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 10:01:47.712027 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 10:01:47.712027 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 10:01:47.712027 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 02 10:01:47.712027 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:47.712027 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 636/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 10:01:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:47.717299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265e944-da13-40d5-b8d2-c4c8fb8ca28e None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:47.811674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265e944-da13-40d5-b8d2-c4c8fb8ca28e None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:47.844060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e0f1d-ad3b-4fba-8d59-27b5ed9040d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:47.844746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e0f1d-ad3b-4fba-8d59-27b5ed9040d9 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:47.845027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e0f1d-ad3b-4fba-8d59-27b5ed9040d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:47.845299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e0f1d-ad3b-4fba-8d59-27b5ed9040d9 None admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:47.846149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e0f1d-ad3b-4fba-8d59-27b5ed9040d9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:47.846455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e0f1d-ad3b-4fba-8d59-27b5ed9040d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:47.847915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e0f1d-ad3b-4fba-8d59-27b5ed9040d9 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:47.864116 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 645/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Mon May 2 10:01:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:01:47.870807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497e83f-0e77-41f6-92f6-2d936c44822b None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:47.964904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497e83f-0e77-41f6-92f6-2d936c44822b None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:47.996389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25fcc3-6fac-46db-b4f7-354742c3c987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:47.997050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25fcc3-6fac-46db-b4f7-354742c3c987 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:47.997326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25fcc3-6fac-46db-b4f7-354742c3c987 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:47.997601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25fcc3-6fac-46db-b4f7-354742c3c987 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:48.060108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25fcc3-6fac-46db-b4f7-354742c3c987 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:48.061554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25fcc3-6fac-46db-b4f7-354742c3c987 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:48.154238 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 637/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Mon May 2 10:01:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 02 10:01:48.160131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e0f1d-ad3b-4fba-8d59-27b5ed9040d9 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:48.252366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e0f1d-ad3b-4fba-8d59-27b5ed9040d9 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:48.284435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23855a55-6fcb-4431-8364-bf6fbd6daa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:48.285243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23855a55-6fcb-4431-8364-bf6fbd6daa53 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:48.285526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23855a55-6fcb-4431-8364-bf6fbd6daa53 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:48.285801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23855a55-6fcb-4431-8364-bf6fbd6daa53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:48.295721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23855a55-6fcb-4431-8364-bf6fbd6daa53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:48.297212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23855a55-6fcb-4431-8364-bf6fbd6daa53 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:48.314001 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-23855a55-6fcb-4431-8364-bf6fbd6daa53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:48.314001 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:48.314001 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:48.314001 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:48.314001 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:48.314001 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:48.314001 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:48.314001 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:48.314001 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:48.314001 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:48.314001 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:48.314001 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:48.314001 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 10:01:48.314001 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 10:01:48.314001 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 10:01:48.318706 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 10:01:48.318706 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:48.318706 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:48.318706 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:48.318706 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:48.318706 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:48.318706 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:48.318706 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:48.318706 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:01:48.318706 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:48.318706 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:48.318706 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:48.318706 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:48.318706 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:48.318706 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:48.318706 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:48.318706 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:48.319620 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 02 10:01:48.319620 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:01:48.319620 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 02 10:01:48.319620 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:01:48.319620 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 646/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 10:01:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:48.321644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25fcc3-6fac-46db-b4f7-354742c3c987 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:48.415202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25fcc3-6fac-46db-b4f7-354742c3c987 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:48.447012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d966fd6-9f1c-4031-8190-511753fe3349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:48.447658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d966fd6-9f1c-4031-8190-511753fe3349 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:48.447937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d966fd6-9f1c-4031-8190-511753fe3349 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:48.448210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d966fd6-9f1c-4031-8190-511753fe3349 None admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:48.448949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d966fd6-9f1c-4031-8190-511753fe3349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:48.449255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d966fd6-9f1c-4031-8190-511753fe3349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:48.450601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d966fd6-9f1c-4031-8190-511753fe3349 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:48.461782 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 638/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Mon May 2 10:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:48.467399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23855a55-6fcb-4431-8364-bf6fbd6daa53 None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:48.563283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23855a55-6fcb-4431-8364-bf6fbd6daa53 None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:48.596202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a13e6-6a61-45af-8700-3cade6cb7b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:48.597011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a13e6-6a61-45af-8700-3cade6cb7b4f None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:48.597289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a13e6-6a61-45af-8700-3cade6cb7b4f None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:48.597563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a13e6-6a61-45af-8700-3cade6cb7b4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:48.604718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a13e6-6a61-45af-8700-3cade6cb7b4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:48.606352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a13e6-6a61-45af-8700-3cade6cb7b4f None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:48.619872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-5e6a13e6-6a61-45af-8700-3cade6cb7b4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 02 10:01:48.619872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:48.619872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:48.619872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:48.619872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:48.619872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:48.619872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:48.619872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:48.619872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:48.619872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:48.619872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:48.619872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:48.619872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 02 10:01:48.619872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(project_id) May 02 10:01:48.619872 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 02 10:01:48.620997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 02 10:01:48.620997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:48.620997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:48.620997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:48.620997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:48.620997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:48.620997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:48.620997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:48.620997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:01:48.620997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:48.620997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:48.620997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:48.620997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:48.620997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:48.620997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:48.620997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:48.620997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:48.622101 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 02 10:01:48.622101 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 02 10:01:48.622101 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:01:48.622101 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:01:48.622101 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:01:48.622101 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:01:48.622101 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 02 10:01:48.622101 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:01:48.622101 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 647/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Mon May 2 10:01:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:48.627044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d966fd6-9f1c-4031-8190-511753fe3349 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:48.720839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d966fd6-9f1c-4031-8190-511753fe3349 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:48.752491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bd439-7a16-44a6-9274-c7dbf9d40b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:48.753170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bd439-7a16-44a6-9274-c7dbf9d40b2b None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:48.753450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bd439-7a16-44a6-9274-c7dbf9d40b2b None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:48.753775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bd439-7a16-44a6-9274-c7dbf9d40b2b None admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:48.754552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bd439-7a16-44a6-9274-c7dbf9d40b2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:48.754861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bd439-7a16-44a6-9274-c7dbf9d40b2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:48.756276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bd439-7a16-44a6-9274-c7dbf9d40b2b None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:48.767761 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 639/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Mon May 2 10:01:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:48.774556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a13e6-6a61-45af-8700-3cade6cb7b4f None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:48.870354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a13e6-6a61-45af-8700-3cade6cb7b4f None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:48.903017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09cb6b-8517-4934-808b-5bcffcc58f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:48.903661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09cb6b-8517-4934-808b-5bcffcc58f27 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:48.903946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09cb6b-8517-4934-808b-5bcffcc58f27 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:48.904223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09cb6b-8517-4934-808b-5bcffcc58f27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:48.905071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09cb6b-8517-4934-808b-5bcffcc58f27 None admin] RBAC: Adding query filter params (role.id=dd8a47ade22941849ebdf8fbdf994b66, scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7, user.id=eef155f5230d47c29fc3d74c2241130b) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:48.905389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09cb6b-8517-4934-808b-5bcffcc58f27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:48.906812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09cb6b-8517-4934-808b-5bcffcc58f27 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:48.912519 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 648/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Mon May 2 10:01:48 2022] GET /identity/v3/role_assignments?user.id=eef155f5230d47c29fc3d74c2241130b&scope.project.id=972cae0aa9694d6cad22fbdbcf916ff7&role.id=dd8a47ade22941849ebdf8fbdf994b66 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:51.277030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a70179-fdba-455e-977b-fc3ee002c546 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:51.277548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a70179-fdba-455e-977b-fc3ee002c546 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:51.277635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a70179-fdba-455e-977b-fc3ee002c546 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:51.278946 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 640/1288] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:01:51.284131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04698790-cd65-42c1-9b53-a0015bb0a6c7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:51.284557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04698790-cd65-42c1-9b53-a0015bb0a6c7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:51.284726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04698790-cd65-42c1-9b53-a0015bb0a6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:51.301428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-04698790-cd65-42c1-9b53-a0015bb0a6c7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:01:51.306863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-04698790-cd65-42c1-9b53-a0015bb0a6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:01:51.368010 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 649/1289] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:01:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 10:01:51.392061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a70179-fdba-455e-977b-fc3ee002c546 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:51.489054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a70179-fdba-455e-977b-fc3ee002c546 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:51.522018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e86bf4-0eea-47b4-a0f6-837945f431ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:51.522822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e86bf4-0eea-47b4-a0f6-837945f431ec None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:51.523101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e86bf4-0eea-47b4-a0f6-837945f431ec None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:51.523371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e86bf4-0eea-47b4-a0f6-837945f431ec None admin] PATH_INFO: `/v3/services/placement` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:51.524541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e86bf4-0eea-47b4-a0f6-837945f431ec None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:51.525909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e86bf4-0eea-47b4-a0f6-837945f431ec None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:51.537258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-73e86bf4-0eea-47b4-a0f6-837945f431ec None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 02 10:01:51.537258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:51.537258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 10:01:51.537258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 10:01:51.537258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 10:01:51.537258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 10:01:51.537258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 10:01:51.537258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 10:01:51.537258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 02 10:01:51.537258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:51.537258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:01:51.537258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:51.537258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:51.537258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:51.537258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:51.537258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:51.537258 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:51.538444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:51.538444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:51.538444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:51.538444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:51.538444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:51.538444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:51.538444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 10:01:51.538444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 10:01:51.538444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 10:01:51.538444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 10:01:51.538444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:51.538444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:51.538444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:51.538444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:51.538444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:51.538444 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:51.540230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:51.540230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:01:51.540230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:51.540230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:51.540230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:51.540230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:51.540230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:51.540230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:51.540230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:51.540230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:51.540230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 10:01:51.540230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 10:01:51.540230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 02 10:01:51.540230 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:51.545313 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 641/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Mon May 2 10:01:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:51.545397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04698790-cd65-42c1-9b53-a0015bb0a6c7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:51.637709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04698790-cd65-42c1-9b53-a0015bb0a6c7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:51.670686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33a50e-f026-4709-a52c-195f0273163a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:51.671461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33a50e-f026-4709-a52c-195f0273163a None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:51.671749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33a50e-f026-4709-a52c-195f0273163a None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:51.672025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33a50e-f026-4709-a52c-195f0273163a None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:51.672758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c33a50e-f026-4709-a52c-195f0273163a None admin] RBAC: Adding query filter params (name=placement) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:51.673066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c33a50e-f026-4709-a52c-195f0273163a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:51.674479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c33a50e-f026-4709-a52c-195f0273163a None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:51.679232 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 650/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Mon May 2 10:01:51 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:51.685374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e86bf4-0eea-47b4-a0f6-837945f431ec None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:51.779340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e86bf4-0eea-47b4-a0f6-837945f431ec None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:51.810063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35c327-372c-433d-b797-611a4b11f4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:51.810721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35c327-372c-433d-b797-611a4b11f4a8 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:51.811053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35c327-372c-433d-b797-611a4b11f4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:51.811327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35c327-372c-433d-b797-611a4b11f4a8 None admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:51.812020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35c327-372c-433d-b797-611a4b11f4a8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:51.812325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35c327-372c-433d-b797-611a4b11f4a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:51.813700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35c327-372c-433d-b797-611a4b11f4a8 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:51.817970 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 642/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Mon May 2 10:01:51 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:54.078826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934384c7-5d43-4188-a619-1f1185e564d5 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:54.079356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934384c7-5d43-4188-a619-1f1185e564d5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:54.079356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934384c7-5d43-4188-a619-1f1185e564d5 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:54.080731 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 651/1293] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:01:54.086414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc49fc-192b-43b0-b653-4a1a59427d3b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:54.086808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc49fc-192b-43b0-b653-4a1a59427d3b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:54.087005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc49fc-192b-43b0-b653-4a1a59427d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:54.104107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c0bc49fc-192b-43b0-b653-4a1a59427d3b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:01:54.105337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c0bc49fc-192b-43b0-b653-4a1a59427d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:01:54.168658 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 643/1294] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:01:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 10:01:54.192886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934384c7-5d43-4188-a619-1f1185e564d5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:54.288901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934384c7-5d43-4188-a619-1f1185e564d5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:54.320126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd550fb-8cc5-4c96-9d15-c76122c5ed7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:54.321314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd550fb-8cc5-4c96-9d15-c76122c5ed7c None admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:54.321597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd550fb-8cc5-4c96-9d15-c76122c5ed7c None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:54.321873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd550fb-8cc5-4c96-9d15-c76122c5ed7c None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:54.322626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd550fb-8cc5-4c96-9d15-c76122c5ed7c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:54.323991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd550fb-8cc5-4c96-9d15-c76122c5ed7c None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:54.403761 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 652/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Mon May 2 10:01:54 2022] POST /identity/v3/services => generated 246 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:01:56.672911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704483a-dd6b-4342-8fb8-2804660db62b None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:56.673487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704483a-dd6b-4342-8fb8-2804660db62b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:56.673487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704483a-dd6b-4342-8fb8-2804660db62b None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:56.674974 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 644/1296] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:01:56.680888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe28d3-e52c-4a33-a3ba-3a8715d877c6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:56.681284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe28d3-e52c-4a33-a3ba-3a8715d877c6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:56.681446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe28d3-e52c-4a33-a3ba-3a8715d877c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:56.697728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2dbe28d3-e52c-4a33-a3ba-3a8715d877c6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:01:56.698889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2dbe28d3-e52c-4a33-a3ba-3a8715d877c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:01:56.767628 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 653/1297] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:01:56 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 10:01:56.793550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704483a-dd6b-4342-8fb8-2804660db62b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:56.887921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704483a-dd6b-4342-8fb8-2804660db62b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:56.920071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a36a38-1362-4e47-8af2-dc1f14f3a444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:56.920906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a36a38-1362-4e47-8af2-dc1f14f3a444 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:56.921193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a36a38-1362-4e47-8af2-dc1f14f3a444 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:56.921474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a36a38-1362-4e47-8af2-dc1f14f3a444 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:56.922113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a36a38-1362-4e47-8af2-dc1f14f3a444 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:56.923514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a36a38-1362-4e47-8af2-dc1f14f3a444 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:56.934799 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-50a36a38-1362-4e47-8af2-dc1f14f3a444 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 02 10:01:56.934799 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:56.934799 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 10:01:56.934799 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 10:01:56.934799 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 10:01:56.934799 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 10:01:56.934799 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 10:01:56.934799 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 10:01:56.934799 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 02 10:01:56.934799 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:56.934799 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:01:56.934799 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:56.934799 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:56.934799 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:56.934799 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:56.934799 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:56.934799 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:56.939403 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:56.939403 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:56.939403 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:56.939403 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:56.939403 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:56.939403 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:56.939403 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 10:01:56.939403 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 10:01:56.939403 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 10:01:56.939403 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 10:01:56.939403 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:56.939403 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:56.939403 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:56.939403 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:56.939403 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:56.939403 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:56.940477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:56.940477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:01:56.940477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:56.940477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:56.940477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:56.940477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:56.940477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:56.940477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:56.940477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:56.940477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:56.940477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 10:01:56.940477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 10:01:56.940477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 02 10:01:56.940477 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:56.940477 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 645/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Mon May 2 10:01:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:56.942036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe28d3-e52c-4a33-a3ba-3a8715d877c6 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:57.034675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe28d3-e52c-4a33-a3ba-3a8715d877c6 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:57.066801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285ad91-6205-4a9b-a388-9a7e1868ec6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:57.067454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285ad91-6205-4a9b-a388-9a7e1868ec6d None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:57.067743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285ad91-6205-4a9b-a388-9a7e1868ec6d None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:57.068020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285ad91-6205-4a9b-a388-9a7e1868ec6d None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:57.068739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285ad91-6205-4a9b-a388-9a7e1868ec6d None admin] RBAC: Adding query filter params (name=placement) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:57.069047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285ad91-6205-4a9b-a388-9a7e1868ec6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:57.070437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285ad91-6205-4a9b-a388-9a7e1868ec6d None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:57.075268 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 654/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Mon May 2 10:01:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:57.081352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a36a38-1362-4e47-8af2-dc1f14f3a444 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:57.176828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a36a38-1362-4e47-8af2-dc1f14f3a444 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:57.208849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92cf4a-1167-46cf-aca8-8bcf83dafccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:57.209503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92cf4a-1167-46cf-aca8-8bcf83dafccf None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:57.209787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92cf4a-1167-46cf-aca8-8bcf83dafccf None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:57.210066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92cf4a-1167-46cf-aca8-8bcf83dafccf None admin] PATH_INFO: `/v3/endpoints` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:57.211463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92cf4a-1167-46cf-aca8-8bcf83dafccf None admin] RBAC: Adding query filter params (interface=public, service_id=5cd392b56de04e6085974578d6383f2c, region_id=RegionOne) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:01:57.211782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92cf4a-1167-46cf-aca8-8bcf83dafccf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:57.213161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92cf4a-1167-46cf-aca8-8bcf83dafccf None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:57.218016 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 646/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Mon May 2 10:01:57 2022] GET /identity/v3/endpoints?service_id=5cd392b56de04e6085974578d6383f2c&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:01:57.223741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285ad91-6205-4a9b-a388-9a7e1868ec6d None admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:57.316285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285ad91-6205-4a9b-a388-9a7e1868ec6d None admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:57.348079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936dc355-7586-464f-be98-a23fda2fe0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:57.348758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dc355-7586-464f-be98-a23fda2fe0d0 None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:57.349042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dc355-7586-464f-be98-a23fda2fe0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:57.349314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dc355-7586-464f-be98-a23fda2fe0d0 None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:57.349982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936dc355-7586-464f-be98-a23fda2fe0d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:57.351823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936dc355-7586-464f-be98-a23fda2fe0d0 None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:57.358264 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 655/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Mon May 2 10:01:57 2022] GET /identity/v3/services => generated 2191 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:01:59.641335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac36cc-641d-4711-9f41-57e8f840eb10 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:59.641870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac36cc-641d-4711-9f41-57e8f840eb10 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:59.641870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac36cc-641d-4711-9f41-57e8f840eb10 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:59.643258 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 647/1302] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:01:59.648235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f05902-248a-4d91-9c76-9f95153ff506 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:59.648918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f05902-248a-4d91-9c76-9f95153ff506 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:59.649095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f05902-248a-4d91-9c76-9f95153ff506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:59.665841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-98f05902-248a-4d91-9c76-9f95153ff506 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:01:59.667003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-98f05902-248a-4d91-9c76-9f95153ff506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:01:59.731032 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 656/1303] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:01:59 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 10:01:59.755221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac36cc-641d-4711-9f41-57e8f840eb10 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:01:59.853378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac36cc-641d-4711-9f41-57e8f840eb10 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:01:59.884997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39bfb5-ee7d-445b-8033-de0281f22952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:01:59.885789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39bfb5-ee7d-445b-8033-de0281f22952 None admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:01:59.886076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39bfb5-ee7d-445b-8033-de0281f22952 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:01:59.886356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39bfb5-ee7d-445b-8033-de0281f22952 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:01:59.887006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39bfb5-ee7d-445b-8033-de0281f22952 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:01:59.888392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39bfb5-ee7d-445b-8033-de0281f22952 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:01:59.900671 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-8e39bfb5-ee7d-445b-8033-de0281f22952 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 02 10:01:59.900671 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:59.900671 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 10:01:59.900671 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 10:01:59.900671 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 10:01:59.900671 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 10:01:59.900671 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 10:01:59.900671 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 10:01:59.900671 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 02 10:01:59.900671 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:59.900671 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:01:59.900671 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:59.900671 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:01:59.900671 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:01:59.900671 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:01:59.900671 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:01:59.900671 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:01:59.901876 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:01:59.901876 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:01:59.901876 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:01:59.901876 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:01:59.901876 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:01:59.901876 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:01:59.901876 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 10:01:59.901876 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 10:01:59.901876 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 10:01:59.901876 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 10:01:59.901876 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:01:59.901876 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:01:59.901876 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:01:59.901876 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:01:59.901876 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:01:59.901876 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:01:59.903021 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:01:59.903021 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:01:59.903021 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:01:59.903021 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:01:59.903021 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:01:59.903021 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:01:59.903021 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:01:59.903021 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:01:59.903021 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:01:59.903021 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:01:59.903021 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 10:01:59.903021 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 10:01:59.903021 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 02 10:01:59.903021 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:01:59.903021 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 648/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Mon May 2 10:01:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:01:59.907949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f05902-248a-4d91-9c76-9f95153ff506 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:02:00.001822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f05902-248a-4d91-9c76-9f95153ff506 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:02:00.033675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f3166-797b-457a-a02e-b54c9ac5539b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:02:00.034330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f3166-797b-457a-a02e-b54c9ac5539b None admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:02:00.034618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f3166-797b-457a-a02e-b54c9ac5539b None admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:02:00.034894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f3166-797b-457a-a02e-b54c9ac5539b None admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:02:00.035590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f3166-797b-457a-a02e-b54c9ac5539b None admin] RBAC: Adding query filter params (name=placement) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:02:00.035897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f3166-797b-457a-a02e-b54c9ac5539b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:02:00.037330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f3166-797b-457a-a02e-b54c9ac5539b None admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:02:00.043070 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 657/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Mon May 2 10:01:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:02:00.048698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39bfb5-ee7d-445b-8033-de0281f22952 None admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:02:00.144148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39bfb5-ee7d-445b-8033-de0281f22952 None admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:02:00.175561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a64c50-2468-45ba-b560-9575898f9f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:02:00.176149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a64c50-2468-45ba-b560-9575898f9f74 None admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:02:00.176431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a64c50-2468-45ba-b560-9575898f9f74 None admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:02:00.176740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a64c50-2468-45ba-b560-9575898f9f74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:02:00.177483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a64c50-2468-45ba-b560-9575898f9f74 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:02:00.178828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a64c50-2468-45ba-b560-9575898f9f74 None admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:02:00.277563 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 649/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Mon May 2 10:02:00 2022] POST /identity/v3/endpoints => generated 331 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:08:28.583340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159881e9-82f4-4d81-af80-0c160526b787 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:28.584345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159881e9-82f4-4d81-af80-0c160526b787 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:28.584905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159881e9-82f4-4d81-af80-0c160526b787 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:28.591622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a39ac4-62f3-4b14-b57c-3f0f5b6c7b00 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:28.592466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a39ac4-62f3-4b14-b57c-3f0f5b6c7b00 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:28.593021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a39ac4-62f3-4b14-b57c-3f0f5b6c7b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:28.596904 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 658/1307] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:08:28 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:08:28.715354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-79a39ac4-62f3-4b14-b57c-3f0f5b6c7b00 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:08:28.716854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-79a39ac4-62f3-4b14-b57c-3f0f5b6c7b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:28.852782 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 650/1308] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:08:28.891336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a44006-22bc-4579-9113-41db8a8a0644 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:28.891637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a44006-22bc-4579-9113-41db8a8a0644 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:28.891923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a44006-22bc-4579-9113-41db8a8a0644 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:28.893809 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 659/1309] 10.222.0.16 () {54 vars in 964 bytes} [Mon May 2 10:08:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:08:28.903679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce49869-8519-4b43-bd6e-35206778dd01 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:28.904115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce49869-8519-4b43-bd6e-35206778dd01 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:28.904211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce49869-8519-4b43-bd6e-35206778dd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:28.991807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6ce49869-8519-4b43-bd6e-35206778dd01 None None] MFA Rules not processed for user `4cd9fe10f94f43aeb3eb10009ee96ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:08:28.993055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6ce49869-8519-4b43-bd6e-35206778dd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:29.074442 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 651/1310] 10.222.0.16 () {58 vars in 1061 bytes} [Mon May 2 10:08:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:08:29.083864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a44006-22bc-4579-9113-41db8a8a0644 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:08:29.085536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b5a44006-22bc-4579-9113-41db8a8a0644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:29.191824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a44006-22bc-4579-9113-41db8a8a0644 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:08:29.265899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aab38a-fa68-4cd3-8ce9-5afdaa238c26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:08:29.266558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aab38a-fa68-4cd3-8ce9-5afdaa238c26 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:29.266841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aab38a-fa68-4cd3-8ce9-5afdaa238c26 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:29.267178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aab38a-fa68-4cd3-8ce9-5afdaa238c26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:29.268872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-20aab38a-fa68-4cd3-8ce9-5afdaa238c26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:29.375924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aab38a-fa68-4cd3-8ce9-5afdaa238c26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:08:29.377396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aab38a-fa68-4cd3-8ce9-5afdaa238c26 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:08:29.395669 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 660/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:08:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:08:32.026837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd880e6-fbc0-40f6-93ed-96504bb369d6 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:32.027376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd880e6-fbc0-40f6-93ed-96504bb369d6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:32.027376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd880e6-fbc0-40f6-93ed-96504bb369d6 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:32.029936 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 652/1312] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:08:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:08:32.033783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56148b36-7a81-4030-8e3e-373f27ea8610 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:32.034201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56148b36-7a81-4030-8e3e-373f27ea8610 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:32.034385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56148b36-7a81-4030-8e3e-373f27ea8610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:32.104334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-56148b36-7a81-4030-8e3e-373f27ea8610 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:08:32.105743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-56148b36-7a81-4030-8e3e-373f27ea8610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:32.200524 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 661/1313] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:08:32.255362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224208b-2e5c-4f4d-92ae-39befe12d473 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:32.255825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224208b-2e5c-4f4d-92ae-39befe12d473 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:32.256134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224208b-2e5c-4f4d-92ae-39befe12d473 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:32.257662 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 653/1314] 10.222.0.16 () {54 vars in 964 bytes} [Mon May 2 10:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:08:32.263747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fbf6e-fb9e-45ec-9d30-b5350720181b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:32.264216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fbf6e-fb9e-45ec-9d30-b5350720181b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:32.264589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fbf6e-fb9e-45ec-9d30-b5350720181b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:32.339519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-622fbf6e-fb9e-45ec-9d30-b5350720181b None None] MFA Rules not processed for user `4cd9fe10f94f43aeb3eb10009ee96ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:08:32.340998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-622fbf6e-fb9e-45ec-9d30-b5350720181b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:32.420361 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 662/1315] 10.222.0.16 () {58 vars in 1061 bytes} [Mon May 2 10:08:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:08:32.429540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224208b-2e5c-4f4d-92ae-39befe12d473 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:08:32.431064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4224208b-2e5c-4f4d-92ae-39befe12d473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:32.532225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224208b-2e5c-4f4d-92ae-39befe12d473 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:08:32.607714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f0fef-ddca-475d-aed0-a266c22e25ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:08:32.608438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f0fef-ddca-475d-aed0-a266c22e25ae service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:32.608848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f0fef-ddca-475d-aed0-a266c22e25ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:32.609225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f0fef-ddca-475d-aed0-a266c22e25ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:32.610959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2f0f0fef-ddca-475d-aed0-a266c22e25ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:32.725674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f0fef-ddca-475d-aed0-a266c22e25ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:08:32.727087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f0fef-ddca-475d-aed0-a266c22e25ae service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:08:32.746868 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 654/1316] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:08:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:08:35.794233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec19c9-f9d3-4ae7-b90c-6ad74f615c66 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:35.794765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec19c9-f9d3-4ae7-b90c-6ad74f615c66 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:35.794885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec19c9-f9d3-4ae7-b90c-6ad74f615c66 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:35.796167 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 663/1317] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:08:35.801788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b7ea8-795e-45f7-86b1-a69f3694ea36 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:35.802164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b7ea8-795e-45f7-86b1-a69f3694ea36 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:35.802345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b7ea8-795e-45f7-86b1-a69f3694ea36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:35.863302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ea3b7ea8-795e-45f7-86b1-a69f3694ea36 None None] MFA Rules not processed for user `630418688b8a4b6cb66207b368f6f37f`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:08:35.864500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ea3b7ea8-795e-45f7-86b1-a69f3694ea36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:35.955198 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 655/1318] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:08:35 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:08:35.996465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec19c9-f9d3-4ae7-b90c-6ad74f615c66 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:08:35.998003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-85ec19c9-f9d3-4ae7-b90c-6ad74f615c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:36.093819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec19c9-f9d3-4ae7-b90c-6ad74f615c66 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:08:36.164755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2aa777-ff0b-40ff-9ea9-c00bc2cd6fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:08:36.165399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aa777-ff0b-40ff-9ea9-c00bc2cd6fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:36.165684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aa777-ff0b-40ff-9ea9-c00bc2cd6fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:36.165962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aa777-ff0b-40ff-9ea9-c00bc2cd6fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:36.167574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ed2aa777-ff0b-40ff-9ea9-c00bc2cd6fb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:36.270355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2aa777-ff0b-40ff-9ea9-c00bc2cd6fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:08:36.271799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2aa777-ff0b-40ff-9ea9-c00bc2cd6fb5 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:08:36.289950 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 664/1319] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:08:35 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:08:39.595900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae04387-e9e5-4185-9c77-18105fb3211c None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:39.596461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae04387-e9e5-4185-9c77-18105fb3211c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:39.596461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae04387-e9e5-4185-9c77-18105fb3211c None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:39.597838 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 656/1320] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:08:39.603026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b7028-c246-49b1-a86e-43ad8d5d279f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:39.603428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b7028-c246-49b1-a86e-43ad8d5d279f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:39.603587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b7028-c246-49b1-a86e-43ad8d5d279f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:39.666195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5b0b7028-c246-49b1-a86e-43ad8d5d279f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:08:39.667386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5b0b7028-c246-49b1-a86e-43ad8d5d279f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:39.762604 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 665/1321] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:08:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:08:39.801756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae04387-e9e5-4185-9c77-18105fb3211c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:08:39.803286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-eae04387-e9e5-4185-9c77-18105fb3211c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:39.901789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae04387-e9e5-4185-9c77-18105fb3211c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:08:39.969262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b626bb8-e6d8-4492-8a6a-fba7b7f90e75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:08:39.969891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b626bb8-e6d8-4492-8a6a-fba7b7f90e75 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:39.970171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b626bb8-e6d8-4492-8a6a-fba7b7f90e75 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:39.970444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b626bb8-e6d8-4492-8a6a-fba7b7f90e75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:39.972576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3b626bb8-e6d8-4492-8a6a-fba7b7f90e75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:40.072996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b626bb8-e6d8-4492-8a6a-fba7b7f90e75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:08:40.074404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b626bb8-e6d8-4492-8a6a-fba7b7f90e75 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:08:40.091585 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 657/1322] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:08:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:08:43.542134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eed1d-4ffe-4646-8335-6392435f90d8 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:43.542690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eed1d-4ffe-4646-8335-6392435f90d8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:43.542690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564eed1d-4ffe-4646-8335-6392435f90d8 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:43.544062 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 666/1323] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:08:43.549189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99c18-eb07-47f2-9a71-4411709a84a9 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:43.549592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99c18-eb07-47f2-9a71-4411709a84a9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:43.549791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99c18-eb07-47f2-9a71-4411709a84a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:43.612945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-42e99c18-eb07-47f2-9a71-4411709a84a9 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:08:43.614138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-42e99c18-eb07-47f2-9a71-4411709a84a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:43.708108 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 658/1324] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:08:43.745035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564eed1d-4ffe-4646-8335-6392435f90d8 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:08:43.746641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-564eed1d-4ffe-4646-8335-6392435f90d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:43.846473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564eed1d-4ffe-4646-8335-6392435f90d8 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:08:43.916364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7223f6c-49e1-40d9-bf03-e00e39c9ad5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:08:43.917047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7223f6c-49e1-40d9-bf03-e00e39c9ad5f service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:43.917335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7223f6c-49e1-40d9-bf03-e00e39c9ad5f service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:43.917620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7223f6c-49e1-40d9-bf03-e00e39c9ad5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:43.919253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b7223f6c-49e1-40d9-bf03-e00e39c9ad5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:44.025935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7223f6c-49e1-40d9-bf03-e00e39c9ad5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:08:44.027395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7223f6c-49e1-40d9-bf03-e00e39c9ad5f service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:08:44.044778 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 667/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:08:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:08:46.417183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caecc83-17a3-4d93-a471-b0a10350af55 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:46.417718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caecc83-17a3-4d93-a471-b0a10350af55 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:46.417718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caecc83-17a3-4d93-a471-b0a10350af55 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:46.419146 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 659/1326] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:08:46.424509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d900262-e1cd-463f-870e-8f924c877f0a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:46.424971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d900262-e1cd-463f-870e-8f924c877f0a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:46.425112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d900262-e1cd-463f-870e-8f924c877f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:46.492148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9d900262-e1cd-463f-870e-8f924c877f0a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:08:46.493399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9d900262-e1cd-463f-870e-8f924c877f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:46.590375 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 668/1327] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:08:46.627913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caecc83-17a3-4d93-a471-b0a10350af55 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:08:46.629468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3caecc83-17a3-4d93-a471-b0a10350af55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:46.729659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caecc83-17a3-4d93-a471-b0a10350af55 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:08:46.800460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2b6e0-7d86-492b-9c03-b451d2ced31f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:08:46.801147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2b6e0-7d86-492b-9c03-b451d2ced31f service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:46.801436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2b6e0-7d86-492b-9c03-b451d2ced31f service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:46.801706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2b6e0-7d86-492b-9c03-b451d2ced31f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:46.803326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-80a2b6e0-7d86-492b-9c03-b451d2ced31f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:46.909229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2b6e0-7d86-492b-9c03-b451d2ced31f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:08:46.910661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2b6e0-7d86-492b-9c03-b451d2ced31f service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:08:46.928672 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 660/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:08:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:08:49.299614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2345e5-cce3-41e8-af06-a1628915ad63 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:49.300163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2345e5-cce3-41e8-af06-a1628915ad63 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:49.300163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2345e5-cce3-41e8-af06-a1628915ad63 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:49.301575 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 669/1329] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:08:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:08:49.306742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee5b62-0af2-4419-a2a3-a4f3530974b2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:49.307189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee5b62-0af2-4419-a2a3-a4f3530974b2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:49.307419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee5b62-0af2-4419-a2a3-a4f3530974b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:49.368848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-54ee5b62-0af2-4419-a2a3-a4f3530974b2 None None] MFA Rules not processed for user `630418688b8a4b6cb66207b368f6f37f`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:08:49.370040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-54ee5b62-0af2-4419-a2a3-a4f3530974b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:49.461588 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 661/1330] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:08:49 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:08:49.499811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2345e5-cce3-41e8-af06-a1628915ad63 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:08:49.501404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6c2345e5-cce3-41e8-af06-a1628915ad63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:49.600058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2345e5-cce3-41e8-af06-a1628915ad63 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:08:49.669205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b5a3c-0b41-4443-93b7-80ca28350362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:08:49.669762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b5a3c-0b41-4443-93b7-80ca28350362 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:49.670043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b5a3c-0b41-4443-93b7-80ca28350362 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:49.670318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b5a3c-0b41-4443-93b7-80ca28350362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:49.671921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-375b5a3c-0b41-4443-93b7-80ca28350362 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:49.776510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b5a3c-0b41-4443-93b7-80ca28350362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:08:49.777979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b5a3c-0b41-4443-93b7-80ca28350362 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:08:49.797031 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 670/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:08:49 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:08:52.557556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96719bb-1913-4f49-bdda-d0bb9fd89436 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:52.558038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96719bb-1913-4f49-bdda-d0bb9fd89436 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:52.558119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96719bb-1913-4f49-bdda-d0bb9fd89436 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:52.559889 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 662/1332] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:08:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:08:52.565757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600316d-2acf-4a71-a0ad-eee2c5c8f8ba None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:52.566240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600316d-2acf-4a71-a0ad-eee2c5c8f8ba None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:52.566323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600316d-2acf-4a71-a0ad-eee2c5c8f8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:52.634856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2600316d-2acf-4a71-a0ad-eee2c5c8f8ba None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:08:52.636061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2600316d-2acf-4a71-a0ad-eee2c5c8f8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:52.735885 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 671/1333] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:08:52.775927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96719bb-1913-4f49-bdda-d0bb9fd89436 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:08:52.777471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a96719bb-1913-4f49-bdda-d0bb9fd89436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:52.881022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96719bb-1913-4f49-bdda-d0bb9fd89436 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:08:52.957840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bb1e3-e6a2-4d06-b43b-4531fe0cff46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:08:52.958491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb1e3-e6a2-4d06-b43b-4531fe0cff46 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:52.958771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb1e3-e6a2-4d06-b43b-4531fe0cff46 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:52.959045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb1e3-e6a2-4d06-b43b-4531fe0cff46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:52.960772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-175bb1e3-e6a2-4d06-b43b-4531fe0cff46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:53.066407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bb1e3-e6a2-4d06-b43b-4531fe0cff46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:08:53.067950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bb1e3-e6a2-4d06-b43b-4531fe0cff46 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:08:53.086839 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 663/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:08:55.442421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc3450-4aee-4d42-b465-6b7071f9a05b None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:55.442959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc3450-4aee-4d42-b465-6b7071f9a05b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:55.442959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc3450-4aee-4d42-b465-6b7071f9a05b None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:55.444352 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 672/1335] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:08:55.449444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b210cf-d960-472c-addb-3cb97b92bec2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:55.449895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b210cf-d960-472c-addb-3cb97b92bec2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:55.450006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b210cf-d960-472c-addb-3cb97b92bec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:55.514568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f5b210cf-d960-472c-addb-3cb97b92bec2 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:08:55.516058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f5b210cf-d960-472c-addb-3cb97b92bec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:55.607894 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 664/1336] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:08:55.649124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc3450-4aee-4d42-b465-6b7071f9a05b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:08:55.650702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bedc3450-4aee-4d42-b465-6b7071f9a05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:55.752084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc3450-4aee-4d42-b465-6b7071f9a05b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:08:55.822511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc856f-9aec-472a-bb59-08b49f8587b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:08:55.823151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc856f-9aec-472a-bb59-08b49f8587b2 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:55.823439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc856f-9aec-472a-bb59-08b49f8587b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:55.823718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc856f-9aec-472a-bb59-08b49f8587b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:55.825394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2abc856f-9aec-472a-bb59-08b49f8587b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:55.929275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc856f-9aec-472a-bb59-08b49f8587b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:08:55.930732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc856f-9aec-472a-bb59-08b49f8587b2 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:08:55.947957 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 673/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:08:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:08:58.915209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b963b4-5ea2-41fc-84b8-a1051ddb34ac None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:58.915771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b963b4-5ea2-41fc-84b8-a1051ddb34ac None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:58.915771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b963b4-5ea2-41fc-84b8-a1051ddb34ac None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:58.917193 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 665/1338] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:08:58.922933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8872a9-b2d4-4b2e-81de-66d49f9da19c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:58.923456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8872a9-b2d4-4b2e-81de-66d49f9da19c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:58.924174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8872a9-b2d4-4b2e-81de-66d49f9da19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:58.991321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-1f8872a9-b2d4-4b2e-81de-66d49f9da19c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:08:58.992538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1f8872a9-b2d4-4b2e-81de-66d49f9da19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:59.085706 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 674/1339] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:08:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:08:59.122422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b963b4-5ea2-41fc-84b8-a1051ddb34ac None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:08:59.125793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a9b963b4-5ea2-41fc-84b8-a1051ddb34ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:59.232333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b963b4-5ea2-41fc-84b8-a1051ddb34ac None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:08:59.235956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9118753-155c-4e06-b867-0d8d83d3c466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:08:59.236572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9118753-155c-4e06-b867-0d8d83d3c466 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:08:59.236891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9118753-155c-4e06-b867-0d8d83d3c466 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:08:59.237175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9118753-155c-4e06-b867-0d8d83d3c466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:08:59.238935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c9118753-155c-4e06-b867-0d8d83d3c466 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:08:59.334877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9118753-155c-4e06-b867-0d8d83d3c466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:08:59.336296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9118753-155c-4e06-b867-0d8d83d3c466 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:08:59.355671 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 666/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:08:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:09:03.932368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258feafd-7859-465e-aad7-1444357a528e None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:03.932971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258feafd-7859-465e-aad7-1444357a528e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:03.932971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258feafd-7859-465e-aad7-1444357a528e None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:03.934243 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 675/1341] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:09:03.939520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cd882-016e-4f68-895b-8d7cf96c5f51 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:03.939935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cd882-016e-4f68-895b-8d7cf96c5f51 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:03.940087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cd882-016e-4f68-895b-8d7cf96c5f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:03.983882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-254cd882-016e-4f68-895b-8d7cf96c5f51 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:03.985044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-254cd882-016e-4f68-895b-8d7cf96c5f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:04.058169 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 667/1342] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:09:04.097749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258feafd-7859-465e-aad7-1444357a528e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:09:04.109832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258feafd-7859-465e-aad7-1444357a528e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:09:04.113884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08c401-fffa-461d-adc8-527cfce904b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:09:04.114517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08c401-fffa-461d-adc8-527cfce904b5 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:04.114799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08c401-fffa-461d-adc8-527cfce904b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:04.115073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08c401-fffa-461d-adc8-527cfce904b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:04.124017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08c401-fffa-461d-adc8-527cfce904b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:09:04.125495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08c401-fffa-461d-adc8-527cfce904b5 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:09:04.134792 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 676/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:09:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:09:07.409705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6258034-15eb-489f-8ac6-785422aa2a75 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:07.410263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6258034-15eb-489f-8ac6-785422aa2a75 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:07.410263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6258034-15eb-489f-8ac6-785422aa2a75 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:07.411641 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 668/1344] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:09:07.416913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce309059-f92a-4374-90d0-968bf1ab6a68 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:07.417320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce309059-f92a-4374-90d0-968bf1ab6a68 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:07.417482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce309059-f92a-4374-90d0-968bf1ab6a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:07.444140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ce309059-f92a-4374-90d0-968bf1ab6a68 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:07.445357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ce309059-f92a-4374-90d0-968bf1ab6a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:07.453104 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 677/1345] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:09:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:09:07.491633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6258034-15eb-489f-8ac6-785422aa2a75 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:09:07.502107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6258034-15eb-489f-8ac6-785422aa2a75 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:09:07.505603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2559b2-a9f6-4e91-ad96-479f8de7a68d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:09:07.506239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2559b2-a9f6-4e91-ad96-479f8de7a68d service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:07.506523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2559b2-a9f6-4e91-ad96-479f8de7a68d service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:07.506799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2559b2-a9f6-4e91-ad96-479f8de7a68d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:07.515654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2559b2-a9f6-4e91-ad96-479f8de7a68d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:09:07.517631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2559b2-a9f6-4e91-ad96-479f8de7a68d service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:09:07.527073 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 669/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:09:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:09:12.072739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfe550-68ca-4d24-8a3a-a4c83adbede2 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:12.073260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfe550-68ca-4d24-8a3a-a4c83adbede2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:12.073260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfe550-68ca-4d24-8a3a-a4c83adbede2 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:12.074610 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 678/1347] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:09:12.080394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909de02-6cce-4af1-86af-6746925618f6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:12.080889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909de02-6cce-4af1-86af-6746925618f6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:12.080889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909de02-6cce-4af1-86af-6746925618f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:12.098860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9909de02-6cce-4af1-86af-6746925618f6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:12.100075 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9909de02-6cce-4af1-86af-6746925618f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:12.108273 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 670/1348] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:09:12.147883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfe550-68ca-4d24-8a3a-a4c83adbede2 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:09:12.159016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfe550-68ca-4d24-8a3a-a4c83adbede2 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:09:12.162650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ab980-09d5-40d3-a87c-a32f7a0eab71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:09:12.163289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ab980-09d5-40d3-a87c-a32f7a0eab71 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:12.163592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ab980-09d5-40d3-a87c-a32f7a0eab71 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:12.163869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ab980-09d5-40d3-a87c-a32f7a0eab71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:12.172703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ab980-09d5-40d3-a87c-a32f7a0eab71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:09:12.174727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ab980-09d5-40d3-a87c-a32f7a0eab71 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:09:12.184398 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 679/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:09:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:09:17.618525 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3aafa-2052-4171-bb5a-c0f82ba77b9a None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:17.619002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3aafa-2052-4171-bb5a-c0f82ba77b9a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:17.619316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3aafa-2052-4171-bb5a-c0f82ba77b9a None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:17.621241 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 671/1350] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:09:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:09:17.626884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cc29d-8e18-4f0b-93aa-d2dbf7aafb7b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:17.627619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cc29d-8e18-4f0b-93aa-d2dbf7aafb7b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:17.628042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cc29d-8e18-4f0b-93aa-d2dbf7aafb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:17.722204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-311cc29d-8e18-4f0b-93aa-d2dbf7aafb7b None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:17.724149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-311cc29d-8e18-4f0b-93aa-d2dbf7aafb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:17.824911 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 680/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:09:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:09:22.457253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25aefc-c4b2-4941-8d56-9f126cb4da2f None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:22.458178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25aefc-c4b2-4941-8d56-9f126cb4da2f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:22.458638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25aefc-c4b2-4941-8d56-9f126cb4da2f None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:22.460360 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 672/1352] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:09:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:09:22.465864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d386645-5329-4eaf-a0fc-bbff6ce1bd22 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:22.466834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d386645-5329-4eaf-a0fc-bbff6ce1bd22 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:22.467192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d386645-5329-4eaf-a0fc-bbff6ce1bd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:22.487299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-1d386645-5329-4eaf-a0fc-bbff6ce1bd22 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:22.488708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1d386645-5329-4eaf-a0fc-bbff6ce1bd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:22.497777 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 681/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:09:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:09:24.033615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641af79a-1bf1-4d48-be5f-dbd597029293 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:24.034203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641af79a-1bf1-4d48-be5f-dbd597029293 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:24.034297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641af79a-1bf1-4d48-be5f-dbd597029293 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:24.035629 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 673/1354] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:09:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:09:24.040779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277e335-e05b-460a-b937-f93ec981e9db None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:24.041212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277e335-e05b-460a-b937-f93ec981e9db None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:24.041476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277e335-e05b-460a-b937-f93ec981e9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:24.059318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c277e335-e05b-460a-b937-f93ec981e9db None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:24.060488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c277e335-e05b-460a-b937-f93ec981e9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:24.068882 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 682/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:09:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:09:27.974995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd43f14-4d7d-4a9c-9fc8-3c68ccc2459b None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:27.975514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd43f14-4d7d-4a9c-9fc8-3c68ccc2459b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:27.975627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd43f14-4d7d-4a9c-9fc8-3c68ccc2459b None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:27.977094 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 674/1356] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 10:09:27.981998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7ca00-8e7e-4b31-8fef-9e2d99ce47c6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:27.982389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7ca00-8e7e-4b31-8fef-9e2d99ce47c6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:27.982548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7ca00-8e7e-4b31-8fef-9e2d99ce47c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:28.002202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-18b7ca00-8e7e-4b31-8fef-9e2d99ce47c6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:28.003396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-18b7ca00-8e7e-4b31-8fef-9e2d99ce47c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:28.012645 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 683/1357] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:09:28.061505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef248d-f053-445a-aad8-2a6b4b33eac9 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:28.061952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef248d-f053-445a-aad8-2a6b4b33eac9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:28.062381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef248d-f053-445a-aad8-2a6b4b33eac9 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:28.064496 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 675/1358] 10.222.0.16 () {54 vars in 960 bytes} [Mon May 2 10:09:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:09:28.069962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d97ecf-fba7-4f46-a812-8fe8204483a9 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:28.070376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d97ecf-fba7-4f46-a812-8fe8204483a9 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:28.070670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d97ecf-fba7-4f46-a812-8fe8204483a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:28.136678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d9d97ecf-fba7-4f46-a812-8fe8204483a9 None None] MFA Rules not processed for user `e6036dd39fb74289a8cbdcd6a21f8662`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:28.137804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d9d97ecf-fba7-4f46-a812-8fe8204483a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:28.221328 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 684/1359] 10.222.0.16 () {58 vars in 1057 bytes} [Mon May 2 10:09:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:09:28.229767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef248d-f053-445a-aad8-2a6b4b33eac9 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:09:28.244161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef248d-f053-445a-aad8-2a6b4b33eac9 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:09:28.249629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc297b7a-1ba9-44b3-873a-9b832053aacf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:09:28.250904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc297b7a-1ba9-44b3-873a-9b832053aacf service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:28.251193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc297b7a-1ba9-44b3-873a-9b832053aacf service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:28.251672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc297b7a-1ba9-44b3-873a-9b832053aacf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:28.259925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc297b7a-1ba9-44b3-873a-9b832053aacf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:09:28.261566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc297b7a-1ba9-44b3-873a-9b832053aacf service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:09:28.273530 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 676/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:09:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:09:30.831519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7a824-c241-4eee-b418-b1e053e87c02 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:30.832045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7a824-c241-4eee-b418-b1e053e87c02 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:30.832045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7a824-c241-4eee-b418-b1e053e87c02 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:30.836792 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 685/1361] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:09:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:09:30.843368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ef2b2-eb1a-47a2-8df4-8b2c78f5ed68 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:30.844455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ef2b2-eb1a-47a2-8df4-8b2c78f5ed68 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:30.844550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ef2b2-eb1a-47a2-8df4-8b2c78f5ed68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:30.862355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-485ef2b2-eb1a-47a2-8df4-8b2c78f5ed68 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:30.863565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-485ef2b2-eb1a-47a2-8df4-8b2c78f5ed68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:30.872023 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 677/1362] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:09:30.917512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7a824-c241-4eee-b418-b1e053e87c02 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:09:30.933233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7a824-c241-4eee-b418-b1e053e87c02 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:09:30.939187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3c5eb-455a-40ad-b567-bba161619a44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:09:30.939903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3c5eb-455a-40ad-b567-bba161619a44 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:30.940254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3c5eb-455a-40ad-b567-bba161619a44 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:30.940612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3c5eb-455a-40ad-b567-bba161619a44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:30.948981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3c5eb-455a-40ad-b567-bba161619a44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:09:30.950629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3c5eb-455a-40ad-b567-bba161619a44 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:09:30.960497 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 686/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:09:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:09:33.756109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a483b-299b-4a91-9934-838e5e512849 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:33.756658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a483b-299b-4a91-9934-838e5e512849 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:33.756658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a483b-299b-4a91-9934-838e5e512849 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:33.757994 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 678/1364] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:09:33.763396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58405426-5296-46b1-a1bd-406ceeedca57 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:33.763823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58405426-5296-46b1-a1bd-406ceeedca57 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:33.764090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58405426-5296-46b1-a1bd-406ceeedca57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:33.781547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-58405426-5296-46b1-a1bd-406ceeedca57 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:33.782742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-58405426-5296-46b1-a1bd-406ceeedca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:33.790510 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 687/1365] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:09:33.836136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e45d42-edc3-4751-84b6-70877a79e731 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:33.836426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e45d42-edc3-4751-84b6-70877a79e731 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:33.836735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e45d42-edc3-4751-84b6-70877a79e731 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:33.838108 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 679/1366] 10.222.0.16 () {54 vars in 960 bytes} [Mon May 2 10:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:09:33.843438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13fd08-7c55-4f89-8d63-f64dc5a07d43 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:33.843732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13fd08-7c55-4f89-8d63-f64dc5a07d43 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:33.844039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13fd08-7c55-4f89-8d63-f64dc5a07d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:33.863094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-1c13fd08-7c55-4f89-8d63-f64dc5a07d43 None None] MFA Rules not processed for user `e6036dd39fb74289a8cbdcd6a21f8662`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:33.864459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1c13fd08-7c55-4f89-8d63-f64dc5a07d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:33.874203 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 688/1367] 10.222.0.16 () {58 vars in 1057 bytes} [Mon May 2 10:09:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:09:33.882808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e45d42-edc3-4751-84b6-70877a79e731 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:09:33.897295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e45d42-edc3-4751-84b6-70877a79e731 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:09:33.902703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c26e4-3116-4381-b821-459f2aefd790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:09:33.903336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c26e4-3116-4381-b821-459f2aefd790 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:33.903622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c26e4-3116-4381-b821-459f2aefd790 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:33.903902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c26e4-3116-4381-b821-459f2aefd790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:33.912399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c26e4-3116-4381-b821-459f2aefd790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:09:33.914000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c26e4-3116-4381-b821-459f2aefd790 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:09:33.924070 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 680/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:09:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:09:36.491098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed9485-68c3-4076-b307-b81e01f436bf None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:36.491666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed9485-68c3-4076-b307-b81e01f436bf None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:36.491666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed9485-68c3-4076-b307-b81e01f436bf None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:36.495913 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 689/1369] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:09:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:09:36.509357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a7afd-50c8-47c6-977d-069bcbb73615 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:36.510733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a7afd-50c8-47c6-977d-069bcbb73615 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:36.511198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a7afd-50c8-47c6-977d-069bcbb73615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:36.542563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-423a7afd-50c8-47c6-977d-069bcbb73615 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:36.544006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-423a7afd-50c8-47c6-977d-069bcbb73615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:36.565343 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 681/1370] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:09:36.602363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed9485-68c3-4076-b307-b81e01f436bf None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:09:36.619319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed9485-68c3-4076-b307-b81e01f436bf None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:09:36.626358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e25107-14c7-4eed-bbbe-eb3eeba27cd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:09:36.627313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e25107-14c7-4eed-bbbe-eb3eeba27cd2 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:36.628003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e25107-14c7-4eed-bbbe-eb3eeba27cd2 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:36.628439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e25107-14c7-4eed-bbbe-eb3eeba27cd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:36.638534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e25107-14c7-4eed-bbbe-eb3eeba27cd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:09:36.640979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e25107-14c7-4eed-bbbe-eb3eeba27cd2 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:09:36.654270 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 690/1371] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:09:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:09:39.423926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c7575-b168-4802-8f9b-a8597f58c895 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:39.425228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c7575-b168-4802-8f9b-a8597f58c895 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:39.425669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c7575-b168-4802-8f9b-a8597f58c895 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:39.433467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5cf93-d9c4-40e9-a87e-9850d8c12231 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:39.434451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5cf93-d9c4-40e9-a87e-9850d8c12231 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:39.434954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5cf93-d9c4-40e9-a87e-9850d8c12231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:39.438381 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 682/1372] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:09:39 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:09:39.457509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c1f5cf93-d9c4-40e9-a87e-9850d8c12231 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:39.459157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c1f5cf93-d9c4-40e9-a87e-9850d8c12231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:39.477315 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 691/1373] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:09:39.522868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c7575-b168-4802-8f9b-a8597f58c895 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:09:39.539403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c7575-b168-4802-8f9b-a8597f58c895 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:09:39.548189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347485e6-3e0c-423f-a7d2-6c64e696fee3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:09:39.549950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347485e6-3e0c-423f-a7d2-6c64e696fee3 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:39.550656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347485e6-3e0c-423f-a7d2-6c64e696fee3 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:39.551332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347485e6-3e0c-423f-a7d2-6c64e696fee3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:39.563814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347485e6-3e0c-423f-a7d2-6c64e696fee3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:09:39.566298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347485e6-3e0c-423f-a7d2-6c64e696fee3 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:09:39.578845 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 683/1374] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:09:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:09:40.137029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff760e1e-3493-4b55-80f9-563c3b093ea4 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:40.137424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff760e1e-3493-4b55-80f9-563c3b093ea4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:40.137688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff760e1e-3493-4b55-80f9-563c3b093ea4 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:40.139220 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 692/1375] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:09:40.145663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff0865-53f0-49b7-8db5-d8a7ae756a15 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:40.146087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff0865-53f0-49b7-8db5-d8a7ae756a15 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:40.147206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff0865-53f0-49b7-8db5-d8a7ae756a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:40.167507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8fff0865-53f0-49b7-8db5-d8a7ae756a15 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:40.168837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8fff0865-53f0-49b7-8db5-d8a7ae756a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:40.177964 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 684/1376] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:09:40.461325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95801b-85cd-4c6e-b0ec-c601adb9bf14 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:40.461857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95801b-85cd-4c6e-b0ec-c601adb9bf14 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:40.461857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95801b-85cd-4c6e-b0ec-c601adb9bf14 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:40.463299 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 693/1377] 10.222.0.16 () {54 vars in 963 bytes} [Mon May 2 10:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:09:40.468254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea199b-5693-4b1f-bb36-3633f33c513f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:40.469399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea199b-5693-4b1f-bb36-3633f33c513f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:40.469399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea199b-5693-4b1f-bb36-3633f33c513f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:40.517759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-dbea199b-5693-4b1f-bb36-3633f33c513f None None] MFA Rules not processed for user `8eab371b02c34a13b629eacdf504dbdb`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:40.519025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dbea199b-5693-4b1f-bb36-3633f33c513f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:40.579118 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 685/1378] 10.222.0.16 () {58 vars in 1060 bytes} [Mon May 2 10:09:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:09:40.586817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95801b-85cd-4c6e-b0ec-c601adb9bf14 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:09:40.598315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95801b-85cd-4c6e-b0ec-c601adb9bf14 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:09:40.602016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be269023-5e1c-4ca4-b786-7fa97b972cda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:09:40.602648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be269023-5e1c-4ca4-b786-7fa97b972cda service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:40.602976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be269023-5e1c-4ca4-b786-7fa97b972cda service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:40.603258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be269023-5e1c-4ca4-b786-7fa97b972cda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:40.612585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be269023-5e1c-4ca4-b786-7fa97b972cda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:09:40.614146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be269023-5e1c-4ca4-b786-7fa97b972cda service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:09:40.624046 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 694/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:09:42.767425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf20e76-9c1b-4954-82d0-9ffe822b72e4 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:42.768029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf20e76-9c1b-4954-82d0-9ffe822b72e4 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:42.768029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf20e76-9c1b-4954-82d0-9ffe822b72e4 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:42.769619 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 686/1380] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:09:42.774986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b8c58-1637-4a94-b067-780a46281264 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:42.775505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b8c58-1637-4a94-b067-780a46281264 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:42.775621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b8c58-1637-4a94-b067-780a46281264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:42.801318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9b9b8c58-1637-4a94-b067-780a46281264 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:42.802519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9b9b8c58-1637-4a94-b067-780a46281264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:42.810620 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 695/1381] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:09:42.856021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf20e76-9c1b-4954-82d0-9ffe822b72e4 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:09:42.870783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf20e76-9c1b-4954-82d0-9ffe822b72e4 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:09:42.876850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1016827-6e0f-4f63-90a1-e376ece5c9cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:09:42.877482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1016827-6e0f-4f63-90a1-e376ece5c9cc service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:42.877763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1016827-6e0f-4f63-90a1-e376ece5c9cc service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:42.878070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1016827-6e0f-4f63-90a1-e376ece5c9cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:42.885976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1016827-6e0f-4f63-90a1-e376ece5c9cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:09:42.887539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1016827-6e0f-4f63-90a1-e376ece5c9cc service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:09:42.896760 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 687/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:09:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:09:45.410835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28292fc-9769-40e6-bf29-9ac71fdf933e None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:45.411441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28292fc-9769-40e6-bf29-9ac71fdf933e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:45.411699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28292fc-9769-40e6-bf29-9ac71fdf933e None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:45.413347 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 696/1383] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:09:45.418361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea5bc8-4075-4a04-9246-d97a12c2b301 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:45.418763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea5bc8-4075-4a04-9246-d97a12c2b301 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:45.418925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea5bc8-4075-4a04-9246-d97a12c2b301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:45.436472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f7ea5bc8-4075-4a04-9246-d97a12c2b301 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:45.438400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f7ea5bc8-4075-4a04-9246-d97a12c2b301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:45.446209 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 688/1384] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:09:45.489076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28292fc-9769-40e6-bf29-9ac71fdf933e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:09:45.504013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28292fc-9769-40e6-bf29-9ac71fdf933e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:09:45.518405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dac48-5ef9-4178-b462-cb7d452824fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:09:45.518405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dac48-5ef9-4178-b462-cb7d452824fa service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:45.518405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dac48-5ef9-4178-b462-cb7d452824fa service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:45.518405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dac48-5ef9-4178-b462-cb7d452824fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:45.519765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79dac48-5ef9-4178-b462-cb7d452824fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:09:45.521550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79dac48-5ef9-4178-b462-cb7d452824fa service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:09:45.531693 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 697/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:09:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:09:47.886228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ee2e0-682c-4c8b-b426-063a3814a582 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:47.886950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ee2e0-682c-4c8b-b426-063a3814a582 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:47.886950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ee2e0-682c-4c8b-b426-063a3814a582 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:47.888172 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 689/1386] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:09:47.894814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89520839-5f2a-4307-84d1-7a45805b5443 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:47.895457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89520839-5f2a-4307-84d1-7a45805b5443 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:47.895457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89520839-5f2a-4307-84d1-7a45805b5443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:47.914630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-89520839-5f2a-4307-84d1-7a45805b5443 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:47.915855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-89520839-5f2a-4307-84d1-7a45805b5443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:47.924048 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 698/1387] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:09:47.970410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ee2e0-682c-4c8b-b426-063a3814a582 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:09:47.988133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ee2e0-682c-4c8b-b426-063a3814a582 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:09:47.994173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d08c42-916c-4285-bf6b-30996424c479 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:09:47.995019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d08c42-916c-4285-bf6b-30996424c479 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:47.995472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d08c42-916c-4285-bf6b-30996424c479 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:47.995910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d08c42-916c-4285-bf6b-30996424c479 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:48.004872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d08c42-916c-4285-bf6b-30996424c479 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:09:48.006674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d08c42-916c-4285-bf6b-30996424c479 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:09:48.017503 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 690/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:09:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:09:50.869000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc8503-51c4-4898-97b5-9dacb199ae56 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:50.869705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc8503-51c4-4898-97b5-9dacb199ae56 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:50.869907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc8503-51c4-4898-97b5-9dacb199ae56 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:50.872108 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 699/1389] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:09:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:09:50.877848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f1285-6aee-4cf7-a137-3889eff6c435 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:50.878437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f1285-6aee-4cf7-a137-3889eff6c435 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:50.878751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f1285-6aee-4cf7-a137-3889eff6c435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:50.905076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-841f1285-6aee-4cf7-a137-3889eff6c435 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:50.907233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-841f1285-6aee-4cf7-a137-3889eff6c435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:50.916800 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 691/1390] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:09:50.963640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc8503-51c4-4898-97b5-9dacb199ae56 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:09:50.979469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc8503-51c4-4898-97b5-9dacb199ae56 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:09:50.985199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5350a15-3b26-45a6-ac59-00699d5d56b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:09:50.985879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5350a15-3b26-45a6-ac59-00699d5d56b3 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:50.986191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5350a15-3b26-45a6-ac59-00699d5d56b3 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:50.986555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5350a15-3b26-45a6-ac59-00699d5d56b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:50.995590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5350a15-3b26-45a6-ac59-00699d5d56b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:09:50.997215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5350a15-3b26-45a6-ac59-00699d5d56b3 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:09:51.006786 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 700/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:09:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:09:53.893010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853db393-c3ab-43aa-b2ad-29d1d75841fc None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:53.893916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853db393-c3ab-43aa-b2ad-29d1d75841fc None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:53.893916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853db393-c3ab-43aa-b2ad-29d1d75841fc None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:53.894931 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 692/1392] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 10:09:53.900838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6faa9-dcc7-42db-beb9-21cb38397e46 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:53.901351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6faa9-dcc7-42db-beb9-21cb38397e46 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:53.901552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6faa9-dcc7-42db-beb9-21cb38397e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:53.923326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-99d6faa9-dcc7-42db-beb9-21cb38397e46 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:53.928888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-99d6faa9-dcc7-42db-beb9-21cb38397e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:53.937191 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 701/1393] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:09:53.983526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853db393-c3ab-43aa-b2ad-29d1d75841fc None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:09:53.998800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853db393-c3ab-43aa-b2ad-29d1d75841fc None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:09:54.005896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e2ddd-ea32-4c1a-b412-5a8072e6156c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:09:54.006891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e2ddd-ea32-4c1a-b412-5a8072e6156c service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:54.007348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e2ddd-ea32-4c1a-b412-5a8072e6156c service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:54.007708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e2ddd-ea32-4c1a-b412-5a8072e6156c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:54.019224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e2ddd-ea32-4c1a-b412-5a8072e6156c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:09:54.025224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e2ddd-ea32-4c1a-b412-5a8072e6156c service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:09:54.032781 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 693/1394] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:09:56.640888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088493c1-1d8c-4cb8-94c7-8865486cd7eb None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:56.641519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088493c1-1d8c-4cb8-94c7-8865486cd7eb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:56.641519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088493c1-1d8c-4cb8-94c7-8865486cd7eb None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:56.642882 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 702/1395] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:09:56.648362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11db992-73dc-4dac-b696-442d086429b4 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:56.648857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11db992-73dc-4dac-b696-442d086429b4 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:56.648969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11db992-73dc-4dac-b696-442d086429b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:56.668435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c11db992-73dc-4dac-b696-442d086429b4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:56.670150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c11db992-73dc-4dac-b696-442d086429b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:56.678810 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 694/1396] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:09:56.724627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088493c1-1d8c-4cb8-94c7-8865486cd7eb None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:09:56.739672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088493c1-1d8c-4cb8-94c7-8865486cd7eb None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:09:56.745400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91698b18-687f-44b2-8883-33596d59dfe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:09:56.746068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91698b18-687f-44b2-8883-33596d59dfe4 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:56.746350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91698b18-687f-44b2-8883-33596d59dfe4 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:56.746622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91698b18-687f-44b2-8883-33596d59dfe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:56.755095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91698b18-687f-44b2-8883-33596d59dfe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:09:56.756722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91698b18-687f-44b2-8883-33596d59dfe4 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:09:56.766504 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 703/1397] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:09:57.367616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ead16-2c92-484f-9edf-a9cdd7dbcf12 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:57.368009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ead16-2c92-484f-9edf-a9cdd7dbcf12 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:57.368297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ead16-2c92-484f-9edf-a9cdd7dbcf12 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:57.369825 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 695/1398] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:09:57.375503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724560a-d825-472a-9b1f-95923913d391 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:57.375798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724560a-d825-472a-9b1f-95923913d391 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:57.376189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724560a-d825-472a-9b1f-95923913d391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:57.394077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8724560a-d825-472a-9b1f-95923913d391 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:57.395283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8724560a-d825-472a-9b1f-95923913d391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:57.403188 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 704/1399] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:09:57.460305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2d060-3044-4fdc-8036-f9db486fa83c None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:57.460717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2d060-3044-4fdc-8036-f9db486fa83c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:57.461095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2d060-3044-4fdc-8036-f9db486fa83c None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:57.462554 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 696/1400] 10.222.0.16 () {54 vars in 962 bytes} [Mon May 2 10:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:09:57.467630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aac608-9bdb-4b38-ae1d-18d3f1db10dc None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:57.467919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aac608-9bdb-4b38-ae1d-18d3f1db10dc None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:57.468197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aac608-9bdb-4b38-ae1d-18d3f1db10dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:57.516312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-75aac608-9bdb-4b38-ae1d-18d3f1db10dc None None] MFA Rules not processed for user `08bc0cd97b6f45339f5dcf1a264b5ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:57.517538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-75aac608-9bdb-4b38-ae1d-18d3f1db10dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:57.573871 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 705/1401] 10.222.0.16 () {58 vars in 1059 bytes} [Mon May 2 10:09:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:09:57.581953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2d060-3044-4fdc-8036-f9db486fa83c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:09:57.592232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2d060-3044-4fdc-8036-f9db486fa83c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:09:57.597596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abb9f6-2f34-44c6-88a0-2a658e201e5e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:09:57.597596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abb9f6-2f34-44c6-88a0-2a658e201e5e service glance] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:57.597596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abb9f6-2f34-44c6-88a0-2a658e201e5e service glance] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:57.597596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abb9f6-2f34-44c6-88a0-2a658e201e5e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:57.606333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02abb9f6-2f34-44c6-88a0-2a658e201e5e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:09:57.607781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02abb9f6-2f34-44c6-88a0-2a658e201e5e service glance] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:09:57.625175 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 697/1402] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:09:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:09:58.174796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b52be-5661-429a-b288-d35abda3fb5f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:58.175349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b52be-5661-429a-b288-d35abda3fb5f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:58.175349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b52be-5661-429a-b288-d35abda3fb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:58.226398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-621b52be-5661-429a-b288-d35abda3fb5f None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:58.227620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-621b52be-5661-429a-b288-d35abda3fb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:58.288503 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 706/1403] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:09:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:09:58.335847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876652c5-ef8c-4e2a-af81-8538cbae94af None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:58.336351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876652c5-ef8c-4e2a-af81-8538cbae94af None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:58.336464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876652c5-ef8c-4e2a-af81-8538cbae94af None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:58.337835 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 698/1404] 10.222.0.16 () {54 vars in 942 bytes} [Mon May 2 10:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:09:58.343923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ebdb1-0a9d-43fd-b8b2-a0902b8024d9 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:58.344211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ebdb1-0a9d-43fd-b8b2-a0902b8024d9 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:58.344488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ebdb1-0a9d-43fd-b8b2-a0902b8024d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:58.391692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7c3ebdb1-0a9d-43fd-b8b2-a0902b8024d9 None None] MFA Rules not processed for user `6573f5c0731c4a18bf2374c3ba006a57`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:58.392907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7c3ebdb1-0a9d-43fd-b8b2-a0902b8024d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:58.460246 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 707/1405] 10.222.0.16 () {58 vars in 1039 bytes} [Mon May 2 10:09:58 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:09:58.469922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876652c5-ef8c-4e2a-af81-8538cbae94af None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:09:58.482989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876652c5-ef8c-4e2a-af81-8538cbae94af None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:09:58.488412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284296f-0467-4cda-bb6b-9b37b9f10ea7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:09:58.489149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284296f-0467-4cda-bb6b-9b37b9f10ea7 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:58.489438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284296f-0467-4cda-bb6b-9b37b9f10ea7 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:58.489721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284296f-0467-4cda-bb6b-9b37b9f10ea7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:58.497770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284296f-0467-4cda-bb6b-9b37b9f10ea7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:09:58.499333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284296f-0467-4cda-bb6b-9b37b9f10ea7 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:09:58.507823 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 699/1406] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:09:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:09:59.330489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b80f7-8147-4cf9-8484-d43cd09f1a07 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:59.331077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b80f7-8147-4cf9-8484-d43cd09f1a07 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:59.331077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b80f7-8147-4cf9-8484-d43cd09f1a07 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:59.332314 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 708/1407] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:09:59.337420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903e536-5f0b-40da-a7ec-afe795e0d68c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:59.337882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903e536-5f0b-40da-a7ec-afe795e0d68c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:59.338373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903e536-5f0b-40da-a7ec-afe795e0d68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:59.357595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9903e536-5f0b-40da-a7ec-afe795e0d68c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:09:59.359297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9903e536-5f0b-40da-a7ec-afe795e0d68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:09:59.368629 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 700/1408] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:09:59.417213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b80f7-8147-4cf9-8484-d43cd09f1a07 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:09:59.432134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b80f7-8147-4cf9-8484-d43cd09f1a07 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:09:59.440945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd6888-34f5-4b99-8055-813bb9165c50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:09:59.441611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd6888-34f5-4b99-8055-813bb9165c50 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:09:59.441896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd6888-34f5-4b99-8055-813bb9165c50 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:09:59.442172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd6888-34f5-4b99-8055-813bb9165c50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:09:59.451063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd6888-34f5-4b99-8055-813bb9165c50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:09:59.452716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd6888-34f5-4b99-8055-813bb9165c50 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:09:59.462688 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 709/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:09:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:10:22.671999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a69871-17dd-4b4b-9baf-8a96e09dc24b None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:22.672675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a69871-17dd-4b4b-9baf-8a96e09dc24b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:22.672675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a69871-17dd-4b4b-9baf-8a96e09dc24b None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:22.674007 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 701/1410] 10.222.0.16 () {54 vars in 918 bytes} [Mon May 2 10:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:10:22.679687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421aa64-8f9a-4c7f-99cb-15e0404c9de7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:22.680183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421aa64-8f9a-4c7f-99cb-15e0404c9de7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:22.680310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421aa64-8f9a-4c7f-99cb-15e0404c9de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:22.698154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d421aa64-8f9a-4c7f-99cb-15e0404c9de7 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:10:22.699549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d421aa64-8f9a-4c7f-99cb-15e0404c9de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:10:22.707969 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 710/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Mon May 2 10:10:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:10:22.723275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151d1c8-916f-491c-8245-ec7a58de35dc None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:22.728234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151d1c8-916f-491c-8245-ec7a58de35dc None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:22.728234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151d1c8-916f-491c-8245-ec7a58de35dc None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:22.728234 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 702/1412] 10.222.0.16 () {54 vars in 918 bytes} [Mon May 2 10:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 10:10:22.730288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832be259-2154-4bef-ba05-e7e5fc3c3782 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:22.730571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832be259-2154-4bef-ba05-e7e5fc3c3782 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:22.730847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832be259-2154-4bef-ba05-e7e5fc3c3782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:22.749301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-832be259-2154-4bef-ba05-e7e5fc3c3782 None None] MFA Rules not processed for user `e6036dd39fb74289a8cbdcd6a21f8662`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:10:22.750479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-832be259-2154-4bef-ba05-e7e5fc3c3782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:10:22.759412 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 711/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Mon May 2 10:10:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:10:25.550891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924c6e3-cf94-4308-b2e8-72dcf63618cc None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:25.551464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924c6e3-cf94-4308-b2e8-72dcf63618cc None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:25.551464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924c6e3-cf94-4308-b2e8-72dcf63618cc None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:25.552918 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 10:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:10:25.558247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c31a03-9e66-4020-b595-87b309b8d72c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:25.558656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c31a03-9e66-4020-b595-87b309b8d72c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:25.558806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c31a03-9e66-4020-b595-87b309b8d72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:25.580589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-35c31a03-9e66-4020-b595-87b309b8d72c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:10:25.581820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-35c31a03-9e66-4020-b595-87b309b8d72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:10:25.589735 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 10:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:10:25.633857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924c6e3-cf94-4308-b2e8-72dcf63618cc None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:10:25.648063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924c6e3-cf94-4308-b2e8-72dcf63618cc None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:10:25.653622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58519b9-fee1-435c-a2d5-8bdfb549b136 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:10:25.654300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58519b9-fee1-435c-a2d5-8bdfb549b136 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:25.654585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58519b9-fee1-435c-a2d5-8bdfb549b136 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:25.654865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58519b9-fee1-435c-a2d5-8bdfb549b136 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:25.663610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58519b9-fee1-435c-a2d5-8bdfb549b136 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:10:25.665348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58519b9-fee1-435c-a2d5-8bdfb549b136 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:10:25.675455 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 704/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:10:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:10:27.067062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733dba4-dbad-4c2a-9132-b611d8f3482c None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:27.067633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733dba4-dbad-4c2a-9132-b611d8f3482c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:27.067633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733dba4-dbad-4c2a-9132-b611d8f3482c None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:27.069186 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 2 10:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:10:27.074219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442f4ba-513c-422d-a525-8023c666ebd5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:27.074648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442f4ba-513c-422d-a525-8023c666ebd5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:27.074784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442f4ba-513c-422d-a525-8023c666ebd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:27.093166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d442f4ba-513c-422d-a525-8023c666ebd5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:10:27.095106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d442f4ba-513c-422d-a525-8023c666ebd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:10:27.103678 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 2 10:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:10:27.309750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733dba4-dbad-4c2a-9132-b611d8f3482c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:10:27.324327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733dba4-dbad-4c2a-9132-b611d8f3482c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:10:27.330911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d195ea-0e8f-41a7-bea7-7ca4ff328b1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:10:27.331566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d195ea-0e8f-41a7-bea7-7ca4ff328b1b service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:27.331846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d195ea-0e8f-41a7-bea7-7ca4ff328b1b service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:27.332114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d195ea-0e8f-41a7-bea7-7ca4ff328b1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:27.340092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d195ea-0e8f-41a7-bea7-7ca4ff328b1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:10:27.341710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d195ea-0e8f-41a7-bea7-7ca4ff328b1b service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:10:27.350843 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 714/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:10:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:10:28.672948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe834e8-d76f-4ff4-be77-1b6206ed4678 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:28.673514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe834e8-d76f-4ff4-be77-1b6206ed4678 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:28.673514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe834e8-d76f-4ff4-be77-1b6206ed4678 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:28.674894 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 2 10:10:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:10:28.680106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13543ccb-9ee5-4be0-95be-69950d255d9c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:28.680549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13543ccb-9ee5-4be0-95be-69950d255d9c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:28.680691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13543ccb-9ee5-4be0-95be-69950d255d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:28.698250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-13543ccb-9ee5-4be0-95be-69950d255d9c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:10:28.699434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-13543ccb-9ee5-4be0-95be-69950d255d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:10:28.707217 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 2 10:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:10:28.862487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe834e8-d76f-4ff4-be77-1b6206ed4678 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:10:28.876572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe834e8-d76f-4ff4-be77-1b6206ed4678 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:10:28.881873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c19ead-6ae9-4cc7-8452-e7770a0d921e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:10:28.886830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c19ead-6ae9-4cc7-8452-e7770a0d921e service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:28.886830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c19ead-6ae9-4cc7-8452-e7770a0d921e service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:28.886830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c19ead-6ae9-4cc7-8452-e7770a0d921e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:28.890814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c19ead-6ae9-4cc7-8452-e7770a0d921e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:10:28.892361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c19ead-6ae9-4cc7-8452-e7770a0d921e service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:10:28.901416 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 707/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:10:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:10:30.228562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1edc7f-e8b6-442d-af69-8d1f2773fb44 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:30.229175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1edc7f-e8b6-442d-af69-8d1f2773fb44 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:30.229175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1edc7f-e8b6-442d-af69-8d1f2773fb44 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:30.230510 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 2 10:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:10:30.236268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e1245-3771-4045-8620-90d517754349 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:30.236750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e1245-3771-4045-8620-90d517754349 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:30.236933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e1245-3771-4045-8620-90d517754349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:30.254597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-5b0e1245-3771-4045-8620-90d517754349 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:10:30.255764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5b0e1245-3771-4045-8620-90d517754349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:10:30.263437 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 2 10:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:10:30.418837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1edc7f-e8b6-442d-af69-8d1f2773fb44 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:10:30.433789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1edc7f-e8b6-442d-af69-8d1f2773fb44 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:10:30.439348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17606d7c-0f5e-4e3a-93e8-1a1f5c1ceb58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:10:30.439981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17606d7c-0f5e-4e3a-93e8-1a1f5c1ceb58 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:30.440267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17606d7c-0f5e-4e3a-93e8-1a1f5c1ceb58 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:30.440546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17606d7c-0f5e-4e3a-93e8-1a1f5c1ceb58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:30.448681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17606d7c-0f5e-4e3a-93e8-1a1f5c1ceb58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:10:30.450256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17606d7c-0f5e-4e3a-93e8-1a1f5c1ceb58 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:10:30.460035 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 717/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:10:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:10:31.786588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b987777-03b9-492b-8d10-1d1e9c70ded3 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:31.787034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b987777-03b9-492b-8d10-1d1e9c70ded3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:31.787164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b987777-03b9-492b-8d10-1d1e9c70ded3 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:31.788532 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 2 10:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:10:31.793526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754489b-b38f-4651-9c70-a085a5fcaa97 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:31.801223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754489b-b38f-4651-9c70-a085a5fcaa97 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:31.801223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754489b-b38f-4651-9c70-a085a5fcaa97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:31.811736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d754489b-b38f-4651-9c70-a085a5fcaa97 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:10:31.813450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d754489b-b38f-4651-9c70-a085a5fcaa97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:10:31.821315 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 2 10:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:10:31.977944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b987777-03b9-492b-8d10-1d1e9c70ded3 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:10:31.992639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b987777-03b9-492b-8d10-1d1e9c70ded3 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:10:31.998257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfca3e-1d41-4244-8f2a-decd6c13a72a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:10:31.998887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfca3e-1d41-4244-8f2a-decd6c13a72a service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:31.999172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfca3e-1d41-4244-8f2a-decd6c13a72a service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:31.999451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfca3e-1d41-4244-8f2a-decd6c13a72a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:32.008012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfca3e-1d41-4244-8f2a-decd6c13a72a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:10:32.009630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfca3e-1d41-4244-8f2a-decd6c13a72a service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:10:32.019341 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 710/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:10:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:10:33.353955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e373f1-1d41-4323-842c-b563b51e3dd3 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:33.354490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e373f1-1d41-4323-842c-b563b51e3dd3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:33.354490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e373f1-1d41-4323-842c-b563b51e3dd3 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:33.355788 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 2 10:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:10:33.361329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02faec-6150-46f3-8dde-bc74f1123721 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:33.361788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02faec-6150-46f3-8dde-bc74f1123721 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:33.361897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02faec-6150-46f3-8dde-bc74f1123721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:33.379372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-cf02faec-6150-46f3-8dde-bc74f1123721 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:10:33.380622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-cf02faec-6150-46f3-8dde-bc74f1123721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:10:33.388512 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 2 10:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:10:33.548482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e373f1-1d41-4323-842c-b563b51e3dd3 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:10:33.562417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e373f1-1d41-4323-842c-b563b51e3dd3 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:10:33.567715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050339e0-d5ed-4226-858a-4fbb1e4f3dde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:10:33.568347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050339e0-d5ed-4226-858a-4fbb1e4f3dde service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:33.568657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050339e0-d5ed-4226-858a-4fbb1e4f3dde service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:33.568942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050339e0-d5ed-4226-858a-4fbb1e4f3dde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:33.576778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050339e0-d5ed-4226-858a-4fbb1e4f3dde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:10:33.578889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050339e0-d5ed-4226-858a-4fbb1e4f3dde service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:10:33.587956 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 720/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:10:34.888126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbc24b-a119-4168-a9d0-48da2452550c None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:34.888698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbc24b-a119-4168-a9d0-48da2452550c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:34.888834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbc24b-a119-4168-a9d0-48da2452550c None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:34.890102 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 2 10:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:10:34.895285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc518c-6ff7-4f03-83fe-c4264668494b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:34.895689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc518c-6ff7-4f03-83fe-c4264668494b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:34.895841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc518c-6ff7-4f03-83fe-c4264668494b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:34.913616 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-20dc518c-6ff7-4f03-83fe-c4264668494b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:10:34.914794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-20dc518c-6ff7-4f03-83fe-c4264668494b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:10:34.922977 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 2 10:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:10:35.079745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbc24b-a119-4168-a9d0-48da2452550c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:10:35.094178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbc24b-a119-4168-a9d0-48da2452550c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:10:35.099547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc8187-41e6-4e9f-ba02-a979487551b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:10:35.100183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc8187-41e6-4e9f-ba02-a979487551b5 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:35.100473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc8187-41e6-4e9f-ba02-a979487551b5 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:35.100787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc8187-41e6-4e9f-ba02-a979487551b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:35.109165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc8187-41e6-4e9f-ba02-a979487551b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:10:35.110741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc8187-41e6-4e9f-ba02-a979487551b5 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:10:35.120133 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 713/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:10:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:10:36.453786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfa212-49c8-4e1e-81a5-1a3cfb5e4276 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:36.454366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfa212-49c8-4e1e-81a5-1a3cfb5e4276 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:36.454366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfa212-49c8-4e1e-81a5-1a3cfb5e4276 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:36.458563 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 2 10:10:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:10:36.463619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e47fb9-414c-4e08-9b44-c3f970cebf17 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:36.464064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e47fb9-414c-4e08-9b44-c3f970cebf17 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:36.464178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e47fb9-414c-4e08-9b44-c3f970cebf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:36.481760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-96e47fb9-414c-4e08-9b44-c3f970cebf17 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:10:36.482967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-96e47fb9-414c-4e08-9b44-c3f970cebf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:10:36.491784 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 2 10:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:10:36.647897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfa212-49c8-4e1e-81a5-1a3cfb5e4276 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:10:36.661942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfa212-49c8-4e1e-81a5-1a3cfb5e4276 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:10:36.667268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52500ee9-128b-481d-a873-2c1cd5c8e484 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:10:36.667902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52500ee9-128b-481d-a873-2c1cd5c8e484 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:36.668190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52500ee9-128b-481d-a873-2c1cd5c8e484 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:36.668734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52500ee9-128b-481d-a873-2c1cd5c8e484 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:36.677093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52500ee9-128b-481d-a873-2c1cd5c8e484 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:10:36.678678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52500ee9-128b-481d-a873-2c1cd5c8e484 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:10:36.688796 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 723/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:10:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:10:38.013234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958db72c-3489-4e29-8be2-710d307fc2f5 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:38.013825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958db72c-3489-4e29-8be2-710d307fc2f5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:38.013825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958db72c-3489-4e29-8be2-710d307fc2f5 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:38.015660 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 2 10:10:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:10:38.020967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbac79-5930-45d1-85a9-80d1ae17a95d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:38.021384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbac79-5930-45d1-85a9-80d1ae17a95d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:38.021523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbac79-5930-45d1-85a9-80d1ae17a95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:38.039722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-99dbac79-5930-45d1-85a9-80d1ae17a95d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:10:38.040980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-99dbac79-5930-45d1-85a9-80d1ae17a95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:10:38.049154 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 2 10:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:10:38.206130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958db72c-3489-4e29-8be2-710d307fc2f5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:10:38.220900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958db72c-3489-4e29-8be2-710d307fc2f5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:10:38.226264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ef5d4-aeb8-4317-9fd0-0ca243047ef2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:10:38.226892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ef5d4-aeb8-4317-9fd0-0ca243047ef2 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:38.227176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ef5d4-aeb8-4317-9fd0-0ca243047ef2 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:38.227456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ef5d4-aeb8-4317-9fd0-0ca243047ef2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:38.235552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ef5d4-aeb8-4317-9fd0-0ca243047ef2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:10:38.237220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ef5d4-aeb8-4317-9fd0-0ca243047ef2 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:10:38.246629 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 716/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:10:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:10:40.431211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284d8ca-b397-437b-b857-43d393026b09 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:40.431814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284d8ca-b397-437b-b857-43d393026b09 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:40.431814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284d8ca-b397-437b-b857-43d393026b09 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:40.433148 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 10:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:10:40.438997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddfec9-6746-4136-a18c-9d5b1e2df6e4 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:40.439402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddfec9-6746-4136-a18c-9d5b1e2df6e4 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:40.439564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddfec9-6746-4136-a18c-9d5b1e2df6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:40.457217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a7ddfec9-6746-4136-a18c-9d5b1e2df6e4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:10:40.459898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a7ddfec9-6746-4136-a18c-9d5b1e2df6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:10:40.466246 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 10:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:10:40.506658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284d8ca-b397-437b-b857-43d393026b09 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:10:40.517555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284d8ca-b397-437b-b857-43d393026b09 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:10:40.521119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db5b21-d853-45f9-a03c-bf57bb6827ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:10:40.521754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db5b21-d853-45f9-a03c-bf57bb6827ce service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:40.522036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db5b21-d853-45f9-a03c-bf57bb6827ce service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:40.522315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db5b21-d853-45f9-a03c-bf57bb6827ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:40.531041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db5b21-d853-45f9-a03c-bf57bb6827ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:10:40.532525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db5b21-d853-45f9-a03c-bf57bb6827ce service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:10:40.542043 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 726/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:10:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:10:43.003967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b44e36-76c2-4c39-8b4b-1fa6292dfb99 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:43.004588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b44e36-76c2-4c39-8b4b-1fa6292dfb99 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:43.004588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b44e36-76c2-4c39-8b4b-1fa6292dfb99 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:43.006035 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 10:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:10:43.011608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a00343-f586-459f-803c-9806bf07749b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:43.012045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a00343-f586-459f-803c-9806bf07749b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:43.012166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a00343-f586-459f-803c-9806bf07749b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:43.030624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-01a00343-f586-459f-803c-9806bf07749b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:10:43.031818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-01a00343-f586-459f-803c-9806bf07749b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:10:43.039457 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 10:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:10:43.078548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b44e36-76c2-4c39-8b4b-1fa6292dfb99 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:10:43.088813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b44e36-76c2-4c39-8b4b-1fa6292dfb99 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:10:43.092191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef97851-19cf-481b-87e0-b7da5fb36c7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:10:43.092858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef97851-19cf-481b-87e0-b7da5fb36c7f service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:43.093209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef97851-19cf-481b-87e0-b7da5fb36c7f service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:43.093489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef97851-19cf-481b-87e0-b7da5fb36c7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:43.102706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef97851-19cf-481b-87e0-b7da5fb36c7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:10:43.104150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef97851-19cf-481b-87e0-b7da5fb36c7f service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:10:43.113448 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 719/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:10:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:10:45.790914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895b0bb-6805-449c-9548-4e97464c76b2 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:45.791478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895b0bb-6805-449c-9548-4e97464c76b2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:45.791478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895b0bb-6805-449c-9548-4e97464c76b2 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:45.793187 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 10:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:10:45.798653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937023b4-63ab-418a-998c-58b4e8433eea None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:45.799065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937023b4-63ab-418a-998c-58b4e8433eea None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:45.799223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937023b4-63ab-418a-998c-58b4e8433eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:45.816959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-937023b4-63ab-418a-998c-58b4e8433eea None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:10:45.818155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-937023b4-63ab-418a-998c-58b4e8433eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:10:45.825945 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 10:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:10:45.866929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895b0bb-6805-449c-9548-4e97464c76b2 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:10:45.868561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5895b0bb-6805-449c-9548-4e97464c76b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:10:45.881463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895b0bb-6805-449c-9548-4e97464c76b2 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:10:45.884914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ea3ad-ddd8-4c91-aa6e-9326200a7c74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:10:45.885542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ea3ad-ddd8-4c91-aa6e-9326200a7c74 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:45.885820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ea3ad-ddd8-4c91-aa6e-9326200a7c74 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:45.886092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ea3ad-ddd8-4c91-aa6e-9326200a7c74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:45.895198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ea3ad-ddd8-4c91-aa6e-9326200a7c74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:10:45.896645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ea3ad-ddd8-4c91-aa6e-9326200a7c74 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:10:45.905667 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 729/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:10:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:10:48.317541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439a84f-f970-4701-b538-241c2bb66c02 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:48.318101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439a84f-f970-4701-b538-241c2bb66c02 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:48.318101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439a84f-f970-4701-b538-241c2bb66c02 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:48.319480 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 10:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:10:48.324800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a03ce-e42e-4185-b157-bfeced0fbaa5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:48.325217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a03ce-e42e-4185-b157-bfeced0fbaa5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:48.325355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a03ce-e42e-4185-b157-bfeced0fbaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:48.342617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d57a03ce-e42e-4185-b157-bfeced0fbaa5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:10:48.344299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d57a03ce-e42e-4185-b157-bfeced0fbaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:10:48.352109 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 10:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:10:48.392458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439a84f-f970-4701-b538-241c2bb66c02 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:10:48.402911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439a84f-f970-4701-b538-241c2bb66c02 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:10:48.406944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb6b6a-0990-4f3c-8d60-b3a44ff0381d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:10:48.407595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb6b6a-0990-4f3c-8d60-b3a44ff0381d service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:48.407862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb6b6a-0990-4f3c-8d60-b3a44ff0381d service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:48.408145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb6b6a-0990-4f3c-8d60-b3a44ff0381d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:48.416817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb6b6a-0990-4f3c-8d60-b3a44ff0381d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:10:48.418240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb6b6a-0990-4f3c-8d60-b3a44ff0381d service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:10:48.428072 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 722/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:10:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:10:50.837021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71801622-e5ad-4179-9a4d-8e472467e236 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:50.837550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71801622-e5ad-4179-9a4d-8e472467e236 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:50.837550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71801622-e5ad-4179-9a4d-8e472467e236 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:50.838852 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 10:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:10:50.844031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c7c06-bc66-40af-9fae-e8bed8cbbef8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:50.844431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c7c06-bc66-40af-9fae-e8bed8cbbef8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:50.844624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c7c06-bc66-40af-9fae-e8bed8cbbef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:50.862178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-487c7c06-bc66-40af-9fae-e8bed8cbbef8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:10:50.863369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-487c7c06-bc66-40af-9fae-e8bed8cbbef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:10:50.871421 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 10:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:10:50.910239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71801622-e5ad-4179-9a4d-8e472467e236 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:10:50.920559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71801622-e5ad-4179-9a4d-8e472467e236 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:10:50.924483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd56ba-a438-4b88-8e66-204cbf8b5c41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:10:50.925143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd56ba-a438-4b88-8e66-204cbf8b5c41 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:50.925424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd56ba-a438-4b88-8e66-204cbf8b5c41 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:50.925700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd56ba-a438-4b88-8e66-204cbf8b5c41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:50.934246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd56ba-a438-4b88-8e66-204cbf8b5c41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:10:50.935671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd56ba-a438-4b88-8e66-204cbf8b5c41 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:10:50.945319 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 732/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:10:53.319026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab66fa-966e-4971-9989-952da61855df None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:53.319588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab66fa-966e-4971-9989-952da61855df None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:53.319588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab66fa-966e-4971-9989-952da61855df None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:53.320988 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 10:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:10:53.326342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea70074-bb29-4214-8f2e-098504fa6557 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:53.326760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea70074-bb29-4214-8f2e-098504fa6557 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:53.327418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea70074-bb29-4214-8f2e-098504fa6557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:53.345194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5ea70074-bb29-4214-8f2e-098504fa6557 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:10:53.346393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5ea70074-bb29-4214-8f2e-098504fa6557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:10:53.354360 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 10:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:10:53.393910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab66fa-966e-4971-9989-952da61855df None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:10:53.404977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab66fa-966e-4971-9989-952da61855df None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:10:53.409248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79615dfd-b69a-4e30-a7ba-f674fd2849b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:10:53.409426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79615dfd-b69a-4e30-a7ba-f674fd2849b4 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:53.409589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79615dfd-b69a-4e30-a7ba-f674fd2849b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:53.409864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79615dfd-b69a-4e30-a7ba-f674fd2849b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:53.418658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79615dfd-b69a-4e30-a7ba-f674fd2849b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:10:53.420249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79615dfd-b69a-4e30-a7ba-f674fd2849b4 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:10:53.429574 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 725/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:10:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:10:55.819777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a89556-6a8a-4162-ab55-abef9d582880 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:55.820289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a89556-6a8a-4162-ab55-abef9d582880 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:55.820289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a89556-6a8a-4162-ab55-abef9d582880 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:55.821675 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 10:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:10:55.827011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5549b8a-d97c-4596-8447-43f386e36278 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:55.827459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5549b8a-d97c-4596-8447-43f386e36278 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:55.827567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5549b8a-d97c-4596-8447-43f386e36278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:55.845623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e5549b8a-d97c-4596-8447-43f386e36278 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:10:55.846824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e5549b8a-d97c-4596-8447-43f386e36278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:10:55.854525 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 10:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:10:55.892731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a89556-6a8a-4162-ab55-abef9d582880 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:10:55.903352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a89556-6a8a-4162-ab55-abef9d582880 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:10:55.907326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb89e66-686f-446d-bdb7-ff258025666e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:10:55.907958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb89e66-686f-446d-bdb7-ff258025666e service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:55.908243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb89e66-686f-446d-bdb7-ff258025666e service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:55.908521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb89e66-686f-446d-bdb7-ff258025666e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:55.917175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb89e66-686f-446d-bdb7-ff258025666e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:10:55.918609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb89e66-686f-446d-bdb7-ff258025666e service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:10:55.928383 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 735/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:10:58.292848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f6684-32ee-4153-8118-cdd5e2393422 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:58.293403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f6684-32ee-4153-8118-cdd5e2393422 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:58.293403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f6684-32ee-4153-8118-cdd5e2393422 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:58.294718 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 10:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:10:58.300677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7eb3c-c90d-4021-baa1-ab0e42cfb027 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:58.301097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7eb3c-c90d-4021-baa1-ab0e42cfb027 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:58.301242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7eb3c-c90d-4021-baa1-ab0e42cfb027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:58.321056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-82e7eb3c-c90d-4021-baa1-ab0e42cfb027 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:10:58.322251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-82e7eb3c-c90d-4021-baa1-ab0e42cfb027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:10:58.330068 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 10:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:10:58.368026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f6684-32ee-4153-8118-cdd5e2393422 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:10:58.379131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f6684-32ee-4153-8118-cdd5e2393422 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:10:58.382665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c222275-8c61-46b9-8a94-8ece9c49dcc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:10:58.383294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c222275-8c61-46b9-8a94-8ece9c49dcc6 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:10:58.383579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c222275-8c61-46b9-8a94-8ece9c49dcc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:10:58.383862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c222275-8c61-46b9-8a94-8ece9c49dcc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:10:58.392632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c222275-8c61-46b9-8a94-8ece9c49dcc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:10:58.394049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c222275-8c61-46b9-8a94-8ece9c49dcc6 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:10:58.403255 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 728/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:10:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:11:00.736272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7734dc-21a4-4e48-b031-911fe6c4d6b3 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:00.736817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7734dc-21a4-4e48-b031-911fe6c4d6b3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:00.736817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7734dc-21a4-4e48-b031-911fe6c4d6b3 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:00.738124 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 10:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:11:00.743562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26412a34-9922-43e0-9cff-34e3066768c5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:00.743965 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26412a34-9922-43e0-9cff-34e3066768c5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:00.744154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26412a34-9922-43e0-9cff-34e3066768c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:00.761263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-26412a34-9922-43e0-9cff-34e3066768c5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:11:00.762440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-26412a34-9922-43e0-9cff-34e3066768c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:11:00.770567 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 10:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:11:00.808391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7734dc-21a4-4e48-b031-911fe6c4d6b3 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:11:00.819131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7734dc-21a4-4e48-b031-911fe6c4d6b3 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:11:00.822690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2a93c-424b-4084-ab97-15718bef9209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:11:00.823327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2a93c-424b-4084-ab97-15718bef9209 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:00.823612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2a93c-424b-4084-ab97-15718bef9209 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:00.823890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2a93c-424b-4084-ab97-15718bef9209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:00.833271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2a93c-424b-4084-ab97-15718bef9209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:11:00.834694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2a93c-424b-4084-ab97-15718bef9209 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:11:00.844591 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 738/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:11:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:11:03.157153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd529023-0f3d-4017-82e7-9f59faa1736b None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:03.157682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd529023-0f3d-4017-82e7-9f59faa1736b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:03.157807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd529023-0f3d-4017-82e7-9f59faa1736b None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:03.159152 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 10:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:11:03.164342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0d0d6-b080-497a-a1f3-a137228b4830 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:03.164808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0d0d6-b080-497a-a1f3-a137228b4830 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:03.164933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0d0d6-b080-497a-a1f3-a137228b4830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:03.182067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f2a0d0d6-b080-497a-a1f3-a137228b4830 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:11:03.183230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f2a0d0d6-b080-497a-a1f3-a137228b4830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:11:03.191407 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 10:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:11:03.228876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd529023-0f3d-4017-82e7-9f59faa1736b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:11:03.239904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd529023-0f3d-4017-82e7-9f59faa1736b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:11:03.243841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d30d96-6bae-47b3-bd52-24b149c14461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:11:03.244503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d30d96-6bae-47b3-bd52-24b149c14461 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:03.244902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d30d96-6bae-47b3-bd52-24b149c14461 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:03.245400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d30d96-6bae-47b3-bd52-24b149c14461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:03.255781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d30d96-6bae-47b3-bd52-24b149c14461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:11:03.257266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d30d96-6bae-47b3-bd52-24b149c14461 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:11:03.267963 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 731/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:11:37.792876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4deb6-803d-48cf-a2eb-322937e0fd44 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:37.794045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4deb6-803d-48cf-a2eb-322937e0fd44 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:37.794045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4deb6-803d-48cf-a2eb-322937e0fd44 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:37.795399 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 740/1471] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:11:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:11:37.800452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb786b1-d1dd-49d6-84f8-e949e56e3ad4 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:37.800919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb786b1-d1dd-49d6-84f8-e949e56e3ad4 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:37.801031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb786b1-d1dd-49d6-84f8-e949e56e3ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:37.817982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-feb786b1-d1dd-49d6-84f8-e949e56e3ad4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:11:37.819161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-feb786b1-d1dd-49d6-84f8-e949e56e3ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:11:37.826770 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 732/1472] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:11:37.876093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6780a-6380-400c-a50c-36a46101a37b None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:37.876382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6780a-6380-400c-a50c-36a46101a37b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:37.876717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6780a-6380-400c-a50c-36a46101a37b None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:37.878097 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 741/1473] 10.222.0.16 () {54 vars in 962 bytes} [Mon May 2 10:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:11:37.882822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748246f-ba20-4000-928c-446d0d55c82d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:37.883111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748246f-ba20-4000-928c-446d0d55c82d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:37.883414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748246f-ba20-4000-928c-446d0d55c82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:37.901239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c748246f-ba20-4000-928c-446d0d55c82d None None] MFA Rules not processed for user `08bc0cd97b6f45339f5dcf1a264b5ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:11:37.902414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c748246f-ba20-4000-928c-446d0d55c82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:11:37.909196 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 733/1474] 10.222.0.16 () {58 vars in 1059 bytes} [Mon May 2 10:11:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:11:37.916090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6780a-6380-400c-a50c-36a46101a37b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:11:37.927088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6780a-6380-400c-a50c-36a46101a37b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:11:37.930682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2b9c9-e511-4b7e-9ea8-ecdcdd986ed6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:11:37.931303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2b9c9-e511-4b7e-9ea8-ecdcdd986ed6 service glance] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:37.931585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2b9c9-e511-4b7e-9ea8-ecdcdd986ed6 service glance] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:37.931863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2b9c9-e511-4b7e-9ea8-ecdcdd986ed6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:37.940485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2b9c9-e511-4b7e-9ea8-ecdcdd986ed6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:11:37.941945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2b9c9-e511-4b7e-9ea8-ecdcdd986ed6 service glance] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:11:37.951548 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 742/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:11:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:11:40.357111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f37834-b43e-46ad-83b3-f8580e8e0457 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:40.357671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f37834-b43e-46ad-83b3-f8580e8e0457 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:40.357671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f37834-b43e-46ad-83b3-f8580e8e0457 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:40.358975 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 734/1476] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:11:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:11:40.364029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5aa60-5136-49fd-b3f9-ee1cb12de65c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:40.364449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5aa60-5136-49fd-b3f9-ee1cb12de65c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:40.364651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5aa60-5136-49fd-b3f9-ee1cb12de65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:40.382903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-13c5aa60-5136-49fd-b3f9-ee1cb12de65c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:11:40.384102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-13c5aa60-5136-49fd-b3f9-ee1cb12de65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:11:40.391999 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 743/1477] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:11:40.416369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f37834-b43e-46ad-83b3-f8580e8e0457 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:11:40.429259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f37834-b43e-46ad-83b3-f8580e8e0457 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:11:40.433656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacddb2-6cdf-491e-8df7-106d44fc4547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:11:40.434944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacddb2-6cdf-491e-8df7-106d44fc4547 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:40.435184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacddb2-6cdf-491e-8df7-106d44fc4547 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:40.435464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacddb2-6cdf-491e-8df7-106d44fc4547 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:40.436192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdacddb2-6cdf-491e-8df7-106d44fc4547 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:11:40.438004 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-bdacddb2-6cdf-491e-8df7-106d44fc4547 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:11:40.438004 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:11:40.438004 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:11:40.439136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdacddb2-6cdf-491e-8df7-106d44fc4547 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:11:40.457891 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 735/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Mon May 2 10:11:40 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:11:42.784703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29849d7-4c6b-4de0-b1c2-f91070f144f9 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:42.785278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29849d7-4c6b-4de0-b1c2-f91070f144f9 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:42.785278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29849d7-4c6b-4de0-b1c2-f91070f144f9 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:42.786652 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 744/1479] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:11:42.792351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a9bb3-f62a-4eee-8adb-427c4f6ae03c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:42.792791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a9bb3-f62a-4eee-8adb-427c4f6ae03c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:42.792983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a9bb3-f62a-4eee-8adb-427c4f6ae03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:42.810458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6a6a9bb3-f62a-4eee-8adb-427c4f6ae03c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:11:42.811648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6a6a9bb3-f62a-4eee-8adb-427c4f6ae03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:11:42.819826 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 736/1480] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:11:42.864420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29849d7-4c6b-4de0-b1c2-f91070f144f9 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:11:42.879154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29849d7-4c6b-4de0-b1c2-f91070f144f9 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:11:42.884381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888ca64-2224-423b-8bd5-0ef47df6e3e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:11:42.885048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888ca64-2224-423b-8bd5-0ef47df6e3e6 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:42.885330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888ca64-2224-423b-8bd5-0ef47df6e3e6 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:42.885604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888ca64-2224-423b-8bd5-0ef47df6e3e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:42.894126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888ca64-2224-423b-8bd5-0ef47df6e3e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:11:42.895694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888ca64-2224-423b-8bd5-0ef47df6e3e6 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:11:42.904860 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 745/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:11:45.412302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0159ae8-91ce-4d68-8835-d13d18158069 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:45.412913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0159ae8-91ce-4d68-8835-d13d18158069 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:45.412913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0159ae8-91ce-4d68-8835-d13d18158069 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:45.414272 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 737/1482] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:11:45.419953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707c8b2-3388-454a-815b-66e010f4c76d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:45.420358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707c8b2-3388-454a-815b-66e010f4c76d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:45.420514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707c8b2-3388-454a-815b-66e010f4c76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:45.437754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-1707c8b2-3388-454a-815b-66e010f4c76d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:11:45.438947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1707c8b2-3388-454a-815b-66e010f4c76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:11:45.446752 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 746/1483] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:11:45.483868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0159ae8-91ce-4d68-8835-d13d18158069 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:11:45.494568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0159ae8-91ce-4d68-8835-d13d18158069 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:11:45.498076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e679fb-41c7-450a-92d3-45b2fc7a0a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:11:45.498704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e679fb-41c7-450a-92d3-45b2fc7a0a2a service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:45.498988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e679fb-41c7-450a-92d3-45b2fc7a0a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:45.499267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e679fb-41c7-450a-92d3-45b2fc7a0a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:45.507873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e679fb-41c7-450a-92d3-45b2fc7a0a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:11:45.509323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e679fb-41c7-450a-92d3-45b2fc7a0a2a service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:11:45.518876 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 738/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:11:47.887980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd941150-922f-44e8-8c48-d2b764161822 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:47.888568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd941150-922f-44e8-8c48-d2b764161822 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:47.888568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd941150-922f-44e8-8c48-d2b764161822 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:47.890014 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 747/1485] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 10:11:47.895142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938349a-1ed9-4b41-915f-7d1c83354520 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:47.895589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938349a-1ed9-4b41-915f-7d1c83354520 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:47.895704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938349a-1ed9-4b41-915f-7d1c83354520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:47.912982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b938349a-1ed9-4b41-915f-7d1c83354520 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:11:47.914211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b938349a-1ed9-4b41-915f-7d1c83354520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:11:47.922472 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 739/1486] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:11:47.960898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd941150-922f-44e8-8c48-d2b764161822 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:11:47.971371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd941150-922f-44e8-8c48-d2b764161822 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:11:47.974843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a7cd4-71bc-49fc-af84-d91f78ef8bd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:11:47.975471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a7cd4-71bc-49fc-af84-d91f78ef8bd4 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:47.975756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a7cd4-71bc-49fc-af84-d91f78ef8bd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:47.976032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a7cd4-71bc-49fc-af84-d91f78ef8bd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:47.985115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a7cd4-71bc-49fc-af84-d91f78ef8bd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:11:47.986547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a7cd4-71bc-49fc-af84-d91f78ef8bd4 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:11:47.995808 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 748/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:11:50.419799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c983781-e785-4e76-a2ad-f7f5f565b5d3 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:50.420371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c983781-e785-4e76-a2ad-f7f5f565b5d3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:50.420371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c983781-e785-4e76-a2ad-f7f5f565b5d3 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:50.421780 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 740/1488] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:11:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:11:50.426945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d321701-8c58-4dc0-92af-62a1318d60a7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:50.427423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d321701-8c58-4dc0-92af-62a1318d60a7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:50.427710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d321701-8c58-4dc0-92af-62a1318d60a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:50.445687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7d321701-8c58-4dc0-92af-62a1318d60a7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:11:50.446914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7d321701-8c58-4dc0-92af-62a1318d60a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:11:50.455354 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 749/1489] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:11:50.496860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c983781-e785-4e76-a2ad-f7f5f565b5d3 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:11:50.507328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c983781-e785-4e76-a2ad-f7f5f565b5d3 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:11:50.510809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b6dd8-b6ad-4890-ae27-ed1af3299b27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:11:50.511439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b6dd8-b6ad-4890-ae27-ed1af3299b27 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:50.512337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b6dd8-b6ad-4890-ae27-ed1af3299b27 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:50.512624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b6dd8-b6ad-4890-ae27-ed1af3299b27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:50.521306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b6dd8-b6ad-4890-ae27-ed1af3299b27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:11:50.522727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b6dd8-b6ad-4890-ae27-ed1af3299b27 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:11:50.531722 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 741/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:11:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:11:53.176156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef9de4-a0c8-41cb-951b-bb2088533cf1 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:53.176710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef9de4-a0c8-41cb-951b-bb2088533cf1 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:53.176710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef9de4-a0c8-41cb-951b-bb2088533cf1 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:53.178079 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 750/1491] 10.222.0.16 () {54 vars in 926 bytes} [Mon May 2 10:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:11:53.183147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246d02d-803f-4d7e-8d61-0526317d0d4b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:53.184200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246d02d-803f-4d7e-8d61-0526317d0d4b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:53.184307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246d02d-803f-4d7e-8d61-0526317d0d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:53.201539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4246d02d-803f-4d7e-8d61-0526317d0d4b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:11:53.202723 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4246d02d-803f-4d7e-8d61-0526317d0d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:11:53.210386 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 742/1492] 10.222.0.16 () {58 vars in 1023 bytes} [Mon May 2 10:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:11:53.250222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef9de4-a0c8-41cb-951b-bb2088533cf1 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:11:53.260632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef9de4-a0c8-41cb-951b-bb2088533cf1 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:11:53.264204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024216e-de37-4978-aeae-7dce63ab38f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:11:53.264899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024216e-de37-4978-aeae-7dce63ab38f2 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:11:53.265183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024216e-de37-4978-aeae-7dce63ab38f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:11:53.265460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024216e-de37-4978-aeae-7dce63ab38f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:11:53.274293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024216e-de37-4978-aeae-7dce63ab38f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:11:53.275730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024216e-de37-4978-aeae-7dce63ab38f2 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:11:53.284767 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 751/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:13:56.266326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98de434-9762-409f-8c64-3b8df68bedba None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:13:56.266920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98de434-9762-409f-8c64-3b8df68bedba None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:13:56.266920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98de434-9762-409f-8c64-3b8df68bedba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:13:56.284274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d98de434-9762-409f-8c64-3b8df68bedba None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:13:56.285492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d98de434-9762-409f-8c64-3b8df68bedba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:13:56.293181 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 743/1494] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:13:56.300781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b2c04-dc17-429e-b68e-c121efdcea7c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:13:56.301240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b2c04-dc17-429e-b68e-c121efdcea7c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:13:56.301345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b2c04-dc17-429e-b68e-c121efdcea7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:13:56.318868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a74b2c04-dc17-429e-b68e-c121efdcea7c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:13:56.320025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a74b2c04-dc17-429e-b68e-c121efdcea7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:13:56.328232 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 752/1495] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:13:56.332391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98de434-9762-409f-8c64-3b8df68bedba None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:13:56.341767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98de434-9762-409f-8c64-3b8df68bedba None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:13:56.346226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b16254-8ac6-494b-9ad1-440499468096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:13:56.346869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b16254-8ac6-494b-9ad1-440499468096 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:13:56.347153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b16254-8ac6-494b-9ad1-440499468096 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:13:56.347431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b16254-8ac6-494b-9ad1-440499468096 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:13:56.348149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b16254-8ac6-494b-9ad1-440499468096 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:13:56.348576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b16254-8ac6-494b-9ad1-440499468096 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:13:56.349659 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-31b16254-8ac6-494b-9ad1-440499468096 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:13:56.349659 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:13:56.349659 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:13:56.350491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b16254-8ac6-494b-9ad1-440499468096 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:13:56.361695 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 744/1496] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:13:56.370375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b2c04-dc17-429e-b68e-c121efdcea7c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:13:56.379211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b2c04-dc17-429e-b68e-c121efdcea7c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:13:56.384312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e688bae-cf74-4042-9a9a-1fd956e2a9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:13:56.384986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e688bae-cf74-4042-9a9a-1fd956e2a9d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:13:56.385269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e688bae-cf74-4042-9a9a-1fd956e2a9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:13:56.385545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e688bae-cf74-4042-9a9a-1fd956e2a9d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:13:56.386226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e688bae-cf74-4042-9a9a-1fd956e2a9d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:13:56.387999 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-2e688bae-cf74-4042-9a9a-1fd956e2a9d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:13:56.387999 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:13:56.387999 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:13:56.389235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e688bae-cf74-4042-9a9a-1fd956e2a9d3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:13:56.514117 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 753/1497] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:13:56 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:13:56.518374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b16254-8ac6-494b-9ad1-440499468096 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:13:56.528082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b16254-8ac6-494b-9ad1-440499468096 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:13:56.583382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d32694-85f6-4e87-b728-8f9f10754746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:13:56.584054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d32694-85f6-4e87-b728-8f9f10754746 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:13:56.584341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d32694-85f6-4e87-b728-8f9f10754746 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:13:56.584652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d32694-85f6-4e87-b728-8f9f10754746 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:13:56.585351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d32694-85f6-4e87-b728-8f9f10754746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:13:56.586358 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-a1d32694-85f6-4e87-b728-8f9f10754746 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:13:56.586358 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:13:56.586358 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:13:56.587598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d32694-85f6-4e87-b728-8f9f10754746 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:13:56.684246 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 745/1498] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:13:56 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:13:56.688278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e688bae-cf74-4042-9a9a-1fd956e2a9d3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:13:56.698760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e688bae-cf74-4042-9a9a-1fd956e2a9d3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:13:56.703241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93318105-a073-44b8-81bd-92a97b54558c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:13:56.703899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93318105-a073-44b8-81bd-92a97b54558c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:13:56.704202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93318105-a073-44b8-81bd-92a97b54558c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:13:56.704482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93318105-a073-44b8-81bd-92a97b54558c admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:13:56.705294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93318105-a073-44b8-81bd-92a97b54558c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:13:56.706284 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-93318105-a073-44b8-81bd-92a97b54558c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:13:56.706284 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:13:56.706284 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:13:56.707166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93318105-a073-44b8-81bd-92a97b54558c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:13:56.719543 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 754/1499] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:13:56.723239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d32694-85f6-4e87-b728-8f9f10754746 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:13:56.733350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d32694-85f6-4e87-b728-8f9f10754746 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:13:56.737983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f11a4a-185c-407c-b762-c43f13102faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:13:56.738638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f11a4a-185c-407c-b762-c43f13102faf admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:13:56.738922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f11a4a-185c-407c-b762-c43f13102faf admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:13:56.739200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f11a4a-185c-407c-b762-c43f13102faf admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:13:56.740176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f11a4a-185c-407c-b762-c43f13102faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:13:56.741213 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-c2f11a4a-185c-407c-b762-c43f13102faf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:13:56.741213 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:13:56.741213 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:13:56.742086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f11a4a-185c-407c-b762-c43f13102faf admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:13:56.755429 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 746/1500] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:13:56.759372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93318105-a073-44b8-81bd-92a97b54558c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:13:56.769110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93318105-a073-44b8-81bd-92a97b54558c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:13:56.773564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf6a52-4576-4b2a-93c8-98ffe57e7be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:13:56.774429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf6a52-4576-4b2a-93c8-98ffe57e7be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:13:56.774712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf6a52-4576-4b2a-93c8-98ffe57e7be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:13:56.774988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf6a52-4576-4b2a-93c8-98ffe57e7be3 admin admin] PATH_INFO: `/v3/projects/af84596bc11649c2bc123d921d776867/users/b3c7a85e8e7444dfbecfe60838a7347b/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:13:56.789196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf6a52-4576-4b2a-93c8-98ffe57e7be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af84596bc11649c2bc123d921d776867, user_id=b3c7a85e8e7444dfbecfe60838a7347b, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:13:56.790764 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-57cf6a52-4576-4b2a-93c8-98ffe57e7be3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:13:56.790764 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:13:56.790764 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:13:56.792771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf6a52-4576-4b2a-93c8-98ffe57e7be3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:13:56.837688 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 755/1501] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:13:56 2022] PUT /identity/v3/projects/af84596bc11649c2bc123d921d776867/users/b3c7a85e8e7444dfbecfe60838a7347b/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:13:56.849223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86604da3-f896-41b8-9ed6-2b9409a22a43 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:13:56.849518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86604da3-f896-41b8-9ed6-2b9409a22a43 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:13:56.849803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86604da3-f896-41b8-9ed6-2b9409a22a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:13:56.876746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-86604da3-f896-41b8-9ed6-2b9409a22a43 None None] MFA Rules not processed for user `b3c7a85e8e7444dfbecfe60838a7347b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:13:56.878256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-86604da3-f896-41b8-9ed6-2b9409a22a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:13:56.938588 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 747/1502] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:13:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:13:56.949376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf6a52-4576-4b2a-93c8-98ffe57e7be3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:13:57.014934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf6a52-4576-4b2a-93c8-98ffe57e7be3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:13:57.020251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da7552-b5af-4c7d-84d1-acdd3f0d840d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:13:57.020919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da7552-b5af-4c7d-84d1-acdd3f0d840d service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:13:57.021201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da7552-b5af-4c7d-84d1-acdd3f0d840d service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:13:57.021477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da7552-b5af-4c7d-84d1-acdd3f0d840d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:13:57.029496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da7552-b5af-4c7d-84d1-acdd3f0d840d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:13:57.031077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da7552-b5af-4c7d-84d1-acdd3f0d840d service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:13:57.039520 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 756/1503] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:13:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:13:57.121576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb6748-ff67-454d-8d30-6da912472e00 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:13:57.121889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb6748-ff67-454d-8d30-6da912472e00 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:13:57.122169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb6748-ff67-454d-8d30-6da912472e00 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:13:57.123463 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 748/1504] 10.222.0.16 () {52 vars in 829 bytes} [Mon May 2 10:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:13:57.127088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da7552-b5af-4c7d-84d1-acdd3f0d840d service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:13:57.188284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da7552-b5af-4c7d-84d1-acdd3f0d840d service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:13:57.192832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5a2a9-c1be-4586-b95f-f1b236de50c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:13:57.193642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5a2a9-c1be-4586-b95f-f1b236de50c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:13:57.193923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5a2a9-c1be-4586-b95f-f1b236de50c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:13:57.194194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5a2a9-c1be-4586-b95f-f1b236de50c7 admin admin] PATH_INFO: `/v3/users/b3c7a85e8e7444dfbecfe60838a7347b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:13:57.195360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5a2a9-c1be-4586-b95f-f1b236de50c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3c7a85e8e7444dfbecfe60838a7347b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:13:57.196396 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-8fb5a2a9-c1be-4586-b95f-f1b236de50c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:13:57.196396 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:13:57.196396 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:13:57.197656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5a2a9-c1be-4586-b95f-f1b236de50c7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:13:57.358318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8fb5a2a9-c1be-4586-b95f-f1b236de50c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3c7a85e8e7444dfbecfe60838a7347b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:13:57.376377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8fb5a2a9-c1be-4586-b95f-f1b236de50c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3c7a85e8e7444dfbecfe60838a7347b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:13:57.377159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8fb5a2a9-c1be-4586-b95f-f1b236de50c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3c7a85e8e7444dfbecfe60838a7347b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:13:57.389702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8fb5a2a9-c1be-4586-b95f-f1b236de50c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3c7a85e8e7444dfbecfe60838a7347b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:13:57.443667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8fb5a2a9-c1be-4586-b95f-f1b236de50c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3c7a85e8e7444dfbecfe60838a7347b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:13:57.450187 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 757/1505] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:13:57 2022] DELETE /identity/v3/users/b3c7a85e8e7444dfbecfe60838a7347b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:13:57.454611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce76623-238d-455d-bef8-dde8346d5b00 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:13:57.455084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce76623-238d-455d-bef8-dde8346d5b00 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:13:57.459254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce76623-238d-455d-bef8-dde8346d5b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:13:57.472636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9ce76623-238d-455d-bef8-dde8346d5b00 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:13:57.473836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9ce76623-238d-455d-bef8-dde8346d5b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:13:57.530296 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 749/1506] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:13:57.540399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5a2a9-c1be-4586-b95f-f1b236de50c7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:13:57.541816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8fb5a2a9-c1be-4586-b95f-f1b236de50c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:13:57.596853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5a2a9-c1be-4586-b95f-f1b236de50c7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:13:57.600398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b18b05-78b2-417f-8fca-f533175d67ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:13:57.601080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b18b05-78b2-417f-8fca-f533175d67ec service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:13:57.601367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b18b05-78b2-417f-8fca-f533175d67ec service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:13:57.601645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b18b05-78b2-417f-8fca-f533175d67ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:13:57.610765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b18b05-78b2-417f-8fca-f533175d67ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:13:57.613865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b18b05-78b2-417f-8fca-f533175d67ec service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:13:57.621660 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 758/1507] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:13:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:13:58.126301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce76623-238d-455d-bef8-dde8346d5b00 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:13:58.129781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9ce76623-238d-455d-bef8-dde8346d5b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:13:58.140259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce76623-238d-455d-bef8-dde8346d5b00 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:13:58.145076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c27dab-6627-4441-8a6a-5358d5e5d704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:13:58.147756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c27dab-6627-4441-8a6a-5358d5e5d704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:13:58.151251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c27dab-6627-4441-8a6a-5358d5e5d704 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:13:58.151251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c27dab-6627-4441-8a6a-5358d5e5d704 admin admin] PATH_INFO: `/v3/projects/af84596bc11649c2bc123d921d776867` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:13:58.151251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c27dab-6627-4441-8a6a-5358d5e5d704 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af84596bc11649c2bc123d921d776867)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:13:58.151251 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-34c27dab-6627-4441-8a6a-5358d5e5d704 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:13:58.151251 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:13:58.151251 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:13:58.151954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c27dab-6627-4441-8a6a-5358d5e5d704 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:13:58.391046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-34c27dab-6627-4441-8a6a-5358d5e5d704 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af84596bc11649c2bc123d921d776867', 'request_id': 'req-34c27dab-6627-4441-8a6a-5358d5e5d704'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:13:58.483615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-34c27dab-6627-4441-8a6a-5358d5e5d704 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af84596bc11649c2bc123d921d776867', 'request_id': 'req-34c27dab-6627-4441-8a6a-5358d5e5d704'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:13:58.498673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-34c27dab-6627-4441-8a6a-5358d5e5d704 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af84596bc11649c2bc123d921d776867', 'request_id': 'req-34c27dab-6627-4441-8a6a-5358d5e5d704'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:13:58.509254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-34c27dab-6627-4441-8a6a-5358d5e5d704 admin admin] The token cache is being invalidate because project af84596bc11649c2bc123d921d776867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:13:58.509548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-34c27dab-6627-4441-8a6a-5358d5e5d704 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:13:58.510203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-34c27dab-6627-4441-8a6a-5358d5e5d704 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:13:58.511887 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 750/1508] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:13:58 2022] DELETE /identity/v3/projects/af84596bc11649c2bc123d921d776867 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:17:15.757249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7495ffe-111a-4dc2-8c65-fd8ed49cf1d5 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:17:15.757844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7495ffe-111a-4dc2-8c65-fd8ed49cf1d5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:17:15.757844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7495ffe-111a-4dc2-8c65-fd8ed49cf1d5 None None] PATH_INFO: `/v3` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:17:15.759092 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 759/1509] 10.222.0.24 () {54 vars in 925 bytes} [Mon May 2 10:17:15 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:17:15.765018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce9c41-a454-4c79-90b3-ab509db9db6f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:17:15.765467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce9c41-a454-4c79-90b3-ab509db9db6f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:17:15.765608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce9c41-a454-4c79-90b3-ab509db9db6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:17:15.783254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b9ce9c41-a454-4c79-90b3-ab509db9db6f None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:17:15.784593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b9ce9c41-a454-4c79-90b3-ab509db9db6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:17:15.844476 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 751/1510] 10.222.0.24 () {58 vars in 1015 bytes} [Mon May 2 10:17:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:17:17.839437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096ef2e-a006-477a-b17c-c2e0f5931bc5 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:17:17.840004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096ef2e-a006-477a-b17c-c2e0f5931bc5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:17:17.840128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096ef2e-a006-477a-b17c-c2e0f5931bc5 None None] PATH_INFO: `/v3` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:17:17.841380 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 760/1511] 10.222.0.15 () {54 vars in 925 bytes} [Mon May 2 10:17:17 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:17:17.870451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4d5a8-3441-4772-9d58-c18cba494615 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:17:17.870972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4d5a8-3441-4772-9d58-c18cba494615 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:17:17.871079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4d5a8-3441-4772-9d58-c18cba494615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:17:17.889400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-dff4d5a8-3441-4772-9d58-c18cba494615 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:17:17.890658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dff4d5a8-3441-4772-9d58-c18cba494615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:17:17.899337 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 752/1512] 10.222.0.15 () {58 vars in 1015 bytes} [Mon May 2 10:17:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:17:20.036853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d9462-4c1c-46eb-bf75-02a17141ca43 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:17:20.037376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d9462-4c1c-46eb-bf75-02a17141ca43 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:17:20.037376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d9462-4c1c-46eb-bf75-02a17141ca43 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:17:20.038668 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 761/1513] 10.222.0.16 () {54 vars in 960 bytes} [Mon May 2 10:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:17:20.044311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e709934-f000-43f0-a239-19c8ee0c613a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:17:20.044777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e709934-f000-43f0-a239-19c8ee0c613a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:17:20.044906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e709934-f000-43f0-a239-19c8ee0c613a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:17:20.063121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8e709934-f000-43f0-a239-19c8ee0c613a None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:17:20.064326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8e709934-f000-43f0-a239-19c8ee0c613a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:17:20.072762 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 753/1514] 10.222.0.16 () {58 vars in 1057 bytes} [Mon May 2 10:17:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:17:20.080147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d9462-4c1c-46eb-bf75-02a17141ca43 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:17:20.096496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d9462-4c1c-46eb-bf75-02a17141ca43 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:17:20.100959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78803f0-4f35-4b19-bf8d-489a9f36eae3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:17:20.101707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78803f0-4f35-4b19-bf8d-489a9f36eae3 service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:17:20.102063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78803f0-4f35-4b19-bf8d-489a9f36eae3 service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:17:20.102371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78803f0-4f35-4b19-bf8d-489a9f36eae3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:17:20.113032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78803f0-4f35-4b19-bf8d-489a9f36eae3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:17:20.115154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78803f0-4f35-4b19-bf8d-489a9f36eae3 service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:17:20.125960 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 762/1515] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:17:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:17:21.984808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d80d0a-a224-4fa5-82f4-766a5dc35358 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:17:21.985268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d80d0a-a224-4fa5-82f4-766a5dc35358 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:17:21.985380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d80d0a-a224-4fa5-82f4-766a5dc35358 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:17:21.986716 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 754/1516] 10.222.0.16 () {54 vars in 960 bytes} [Mon May 2 10:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:17:21.991787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df570d-3383-4891-924d-92dfc4629b94 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:17:21.992233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df570d-3383-4891-924d-92dfc4629b94 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:17:21.992342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df570d-3383-4891-924d-92dfc4629b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:17:22.010581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-63df570d-3383-4891-924d-92dfc4629b94 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:17:22.011772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-63df570d-3383-4891-924d-92dfc4629b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:17:22.020164 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 763/1517] 10.222.0.16 () {58 vars in 1057 bytes} [Mon May 2 10:17:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:17:22.028476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d80d0a-a224-4fa5-82f4-766a5dc35358 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:17:22.041235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d80d0a-a224-4fa5-82f4-766a5dc35358 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:17:22.046022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e838f-250a-4949-adbf-67e0621e4a4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:17:22.046643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e838f-250a-4949-adbf-67e0621e4a4c service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:17:22.046922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e838f-250a-4949-adbf-67e0621e4a4c service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:17:22.047197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e838f-250a-4949-adbf-67e0621e4a4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:17:22.055061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e838f-250a-4949-adbf-67e0621e4a4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:17:22.056630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e838f-250a-4949-adbf-67e0621e4a4c service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:17:22.066134 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 755/1518] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:17:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:17:59.065800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a9550-6897-43a8-8817-63c721d4c4ca None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:17:59.066308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a9550-6897-43a8-8817-63c721d4c4ca None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:17:59.066420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a9550-6897-43a8-8817-63c721d4c4ca None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:17:59.067716 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 764/1519] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 2 10:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:17:59.072562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de7e71-2c6c-446a-82ac-db19f55c6a61 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:17:59.073013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de7e71-2c6c-446a-82ac-db19f55c6a61 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:17:59.073171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de7e71-2c6c-446a-82ac-db19f55c6a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:17:59.091035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-69de7e71-2c6c-446a-82ac-db19f55c6a61 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:17:59.092232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-69de7e71-2c6c-446a-82ac-db19f55c6a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:17:59.147650 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 756/1520] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 2 10:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:17:59.307079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a9550-6897-43a8-8817-63c721d4c4ca None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:17:59.308700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-423a9550-6897-43a8-8817-63c721d4c4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:17:59.380054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a9550-6897-43a8-8817-63c721d4c4ca None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:17:59.385467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebb64c-2a6e-4fb3-b48a-6531c054380d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:17:59.386108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebb64c-2a6e-4fb3-b48a-6531c054380d service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:17:59.386398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebb64c-2a6e-4fb3-b48a-6531c054380d service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:17:59.386676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebb64c-2a6e-4fb3-b48a-6531c054380d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:17:59.394549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebb64c-2a6e-4fb3-b48a-6531c054380d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:17:59.396147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebb64c-2a6e-4fb3-b48a-6531c054380d service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:17:59.405849 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 765/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:18:00.711473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc1aaf-3d40-4a7f-bc31-1f11d5171b59 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:18:00.712494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc1aaf-3d40-4a7f-bc31-1f11d5171b59 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:18:00.712494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc1aaf-3d40-4a7f-bc31-1f11d5171b59 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:18:00.713853 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 2 10:18:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:18:00.718710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035a6e4-e877-44b3-af61-cb08c53e962a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:18:00.719138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035a6e4-e877-44b3-af61-cb08c53e962a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:18:00.719281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035a6e4-e877-44b3-af61-cb08c53e962a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:18:00.737482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5035a6e4-e877-44b3-af61-cb08c53e962a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:18:00.738699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5035a6e4-e877-44b3-af61-cb08c53e962a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:18:00.746849 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 2 10:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:18:00.904229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc1aaf-3d40-4a7f-bc31-1f11d5171b59 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:18:00.918642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc1aaf-3d40-4a7f-bc31-1f11d5171b59 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:18:00.923998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412adc78-6484-4dbe-a669-01d932d4e30a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:18:00.924648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412adc78-6484-4dbe-a669-01d932d4e30a service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:18:00.924937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412adc78-6484-4dbe-a669-01d932d4e30a service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:18:00.925211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412adc78-6484-4dbe-a669-01d932d4e30a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:18:00.933035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412adc78-6484-4dbe-a669-01d932d4e30a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:18:00.934596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412adc78-6484-4dbe-a669-01d932d4e30a service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:18:00.943753 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 758/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:18:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:18:05.053814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9fd4e-479e-4198-83b6-12c4e59812bb None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:18:05.054438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9fd4e-479e-4198-83b6-12c4e59812bb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:18:05.054438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9fd4e-479e-4198-83b6-12c4e59812bb None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:18:05.056340 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 10:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:18:05.061721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40382760-105d-4461-aa21-c2d672da347a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:18:05.062180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40382760-105d-4461-aa21-c2d672da347a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:18:05.062285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40382760-105d-4461-aa21-c2d672da347a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:18:05.080290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-40382760-105d-4461-aa21-c2d672da347a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:18:05.081525 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-40382760-105d-4461-aa21-c2d672da347a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:18:05.090613 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 10:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:18:05.133739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9fd4e-479e-4198-83b6-12c4e59812bb None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:18:05.136878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a3a9fd4e-479e-4198-83b6-12c4e59812bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:18:05.196709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9fd4e-479e-4198-83b6-12c4e59812bb None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:18:05.200338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b49e9-ea28-4b8e-bfe1-62b40f125354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:18:05.201023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b49e9-ea28-4b8e-bfe1-62b40f125354 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:18:05.201442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b49e9-ea28-4b8e-bfe1-62b40f125354 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:18:05.201727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b49e9-ea28-4b8e-bfe1-62b40f125354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:18:05.211064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b49e9-ea28-4b8e-bfe1-62b40f125354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:18:05.213099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b49e9-ea28-4b8e-bfe1-62b40f125354 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:18:05.222780 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 768/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:18:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:18:07.513762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135de1b0-9a54-4bde-a356-40573b5e7171 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:18:07.514377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135de1b0-9a54-4bde-a356-40573b5e7171 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:18:07.514377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135de1b0-9a54-4bde-a356-40573b5e7171 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:18:07.515711 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 2 10:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:18:07.520833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204d663-9c8e-4706-b351-2f0b4a7ebc65 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:18:07.521296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204d663-9c8e-4706-b351-2f0b4a7ebc65 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:18:07.521488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204d663-9c8e-4706-b351-2f0b4a7ebc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:18:07.540317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7204d663-9c8e-4706-b351-2f0b4a7ebc65 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:18:07.541549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7204d663-9c8e-4706-b351-2f0b4a7ebc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:18:07.549353 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 2 10:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:18:07.584797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135de1b0-9a54-4bde-a356-40573b5e7171 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:18:07.596184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135de1b0-9a54-4bde-a356-40573b5e7171 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:18:07.599823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3e716-e841-41d4-bbed-2db4e376ef68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:18:07.609112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3e716-e841-41d4-bbed-2db4e376ef68 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:18:07.609112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3e716-e841-41d4-bbed-2db4e376ef68 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:18:07.609112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3e716-e841-41d4-bbed-2db4e376ef68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:18:07.610482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3e716-e841-41d4-bbed-2db4e376ef68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:18:07.611899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3e716-e841-41d4-bbed-2db4e376ef68 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:18:07.621521 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 761/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:18:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:18:58.593197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538266e-c6f6-49e3-acc4-2e4cccfce45d None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:18:58.593789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538266e-c6f6-49e3-acc4-2e4cccfce45d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:18:58.593789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538266e-c6f6-49e3-acc4-2e4cccfce45d None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:18:58.595107 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 770/1531] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:18:58.600014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faced66c-1496-4de6-8f65-fba3392ca806 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:18:58.600490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faced66c-1496-4de6-8f65-fba3392ca806 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:18:58.600618 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faced66c-1496-4de6-8f65-fba3392ca806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:18:58.620349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-faced66c-1496-4de6-8f65-fba3392ca806 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:18:58.621573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-faced66c-1496-4de6-8f65-fba3392ca806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:18:58.629883 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 762/1532] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:18:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:37.541701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bdd06-0292-4cfb-ae3f-62985f3e6bcf None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:37.542817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bdd06-0292-4cfb-ae3f-62985f3e6bcf None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:37.543313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bdd06-0292-4cfb-ae3f-62985f3e6bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:37.574596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45448bb9-339d-4584-8f72-da6fc3077885 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:37.575141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45448bb9-339d-4584-8f72-da6fc3077885 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:37.575141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45448bb9-339d-4584-8f72-da6fc3077885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:37.656290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2f3bdd06-0292-4cfb-ae3f-62985f3e6bcf None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:37.657938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2f3bdd06-0292-4cfb-ae3f-62985f3e6bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:37.661632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-45448bb9-339d-4584-8f72-da6fc3077885 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:37.662796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-45448bb9-339d-4584-8f72-da6fc3077885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:37.718660 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 771/1533] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:37.724107 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 763/1534] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:19:37.725010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d7c06-94d0-4794-828f-0c88411461cb None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:37.725598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d7c06-94d0-4794-828f-0c88411461cb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:37.726080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d7c06-94d0-4794-828f-0c88411461cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:37.731838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6eeb1-2afe-4a42-9e5e-217770d75929 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:37.732197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6eeb1-2afe-4a42-9e5e-217770d75929 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:37.732393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6eeb1-2afe-4a42-9e5e-217770d75929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:37.751478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ef8d7c06-94d0-4794-828f-0c88411461cb None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:37.757617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ef8d7c06-94d0-4794-828f-0c88411461cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:37.757807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-96f6eeb1-2afe-4a42-9e5e-217770d75929 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:37.758881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-96f6eeb1-2afe-4a42-9e5e-217770d75929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:37.768136 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 772/1535] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:37.770028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9398bc-6e90-4980-868d-d90ae4aa1dae None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:37.770534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9398bc-6e90-4980-868d-d90ae4aa1dae None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:37.771357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9398bc-6e90-4980-868d-d90ae4aa1dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:37.779771 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 764/1536] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:19:37.786541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6eeb1-2afe-4a42-9e5e-217770d75929 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:37.793544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3b9398bc-6e90-4980-868d-d90ae4aa1dae None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:37.795027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3b9398bc-6e90-4980-868d-d90ae4aa1dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:37.802280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6eeb1-2afe-4a42-9e5e-217770d75929 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:37.808775 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 773/1537] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:37.812121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b78fa-ee9e-4bbb-baad-b91ea752d823 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:37.812121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b78fa-ee9e-4bbb-baad-b91ea752d823 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:37.812121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b78fa-ee9e-4bbb-baad-b91ea752d823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:37.814459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c96ed-31ea-4cbc-90cd-3b660e27d48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:37.815513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c96ed-31ea-4cbc-90cd-3b660e27d48c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:37.816005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c96ed-31ea-4cbc-90cd-3b660e27d48c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:37.816592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c96ed-31ea-4cbc-90cd-3b660e27d48c admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:37.820316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c96ed-31ea-4cbc-90cd-3b660e27d48c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:19:37.822491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c96ed-31ea-4cbc-90cd-3b660e27d48c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:37.824443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c96ed-31ea-4cbc-90cd-3b660e27d48c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:37.834175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-127b78fa-ee9e-4bbb-baad-b91ea752d823 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:37.835639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-127b78fa-ee9e-4bbb-baad-b91ea752d823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:37.839926 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 765/1538] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:19:37.840919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152c741-f765-412c-912b-dac620772993 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:37.840919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152c741-f765-412c-912b-dac620772993 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:37.840919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152c741-f765-412c-912b-dac620772993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:37.859835 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 774/1539] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:37.861252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb33c-a487-4047-8810-ffa8b1c51b02 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:37.861540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb33c-a487-4047-8810-ffa8b1c51b02 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:37.862116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb33c-a487-4047-8810-ffa8b1c51b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:37.865591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d152c741-f765-412c-912b-dac620772993 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:37.867072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d152c741-f765-412c-912b-dac620772993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:37.881476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d9bfb33c-a487-4047-8810-ffa8b1c51b02 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:37.882076 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 766/1540] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:37.882950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d9bfb33c-a487-4047-8810-ffa8b1c51b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:37.883349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d11063-5e1b-4c8f-b1f9-bb4a5b78808d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:37.883637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d11063-5e1b-4c8f-b1f9-bb4a5b78808d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:37.883917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d11063-5e1b-4c8f-b1f9-bb4a5b78808d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:37.901480 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 775/1541] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:37.902790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a4dcf-5793-45f2-88ed-f3cfbe0bea48 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:37.903082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a4dcf-5793-45f2-88ed-f3cfbe0bea48 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:37.903365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a4dcf-5793-45f2-88ed-f3cfbe0bea48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:37.914163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-52d11063-5e1b-4c8f-b1f9-bb4a5b78808d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:37.915535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-52d11063-5e1b-4c8f-b1f9-bb4a5b78808d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:37.922289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4f4a4dcf-5793-45f2-88ed-f3cfbe0bea48 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:37.923505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4f4a4dcf-5793-45f2-88ed-f3cfbe0bea48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:37.924474 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 767/1542] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:37.925463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d11063-5e1b-4c8f-b1f9-bb4a5b78808d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:37.931957 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 776/1543] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:37.932778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a4dcf-5793-45f2-88ed-f3cfbe0bea48 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:37.935807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d11063-5e1b-4c8f-b1f9-bb4a5b78808d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:37.941666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc5458-dc6e-43d8-9761-b7bc393bab9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:37.942727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a4dcf-5793-45f2-88ed-f3cfbe0bea48 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:37.943079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc5458-dc6e-43d8-9761-b7bc393bab9e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:37.943820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc5458-dc6e-43d8-9761-b7bc393bab9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:37.944278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc5458-dc6e-43d8-9761-b7bc393bab9e admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:37.945388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc5458-dc6e-43d8-9761-b7bc393bab9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:19:37.945883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc5458-dc6e-43d8-9761-b7bc393bab9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:37.948156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc5458-dc6e-43d8-9761-b7bc393bab9e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:37.948462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c09fbb-23da-41b5-b4c9-12cc81590491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:37.949156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c09fbb-23da-41b5-b4c9-12cc81590491 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:37.949444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c09fbb-23da-41b5-b4c9-12cc81590491 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:37.949722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c09fbb-23da-41b5-b4c9-12cc81590491 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:37.950413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c09fbb-23da-41b5-b4c9-12cc81590491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:37.952335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c09fbb-23da-41b5-b4c9-12cc81590491 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:37.964440 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 768/1544] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:19:37.965806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d72c3-73a5-44d6-ae03-4fedac0ad1a0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:37.966133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d72c3-73a5-44d6-ae03-4fedac0ad1a0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:37.966385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d72c3-73a5-44d6-ae03-4fedac0ad1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:37.985279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e54d72c3-73a5-44d6-ae03-4fedac0ad1a0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:37.986477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e54d72c3-73a5-44d6-ae03-4fedac0ad1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:37.994783 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 769/1545] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:37.996454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56841d1d-1f9d-42ae-a2f6-a935f524872a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:37.996778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56841d1d-1f9d-42ae-a2f6-a935f524872a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:37.997057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56841d1d-1f9d-42ae-a2f6-a935f524872a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:38.014654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-56841d1d-1f9d-42ae-a2f6-a935f524872a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:38.015797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-56841d1d-1f9d-42ae-a2f6-a935f524872a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:38.023372 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 770/1546] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:38.024102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56841d1d-1f9d-42ae-a2f6-a935f524872a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:38.033961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56841d1d-1f9d-42ae-a2f6-a935f524872a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:38.038558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b6d6b-d002-4390-94f0-36b7bc7a7cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:38.040956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b6d6b-d002-4390-94f0-36b7bc7a7cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:38.040956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b6d6b-d002-4390-94f0-36b7bc7a7cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:38.040956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b6d6b-d002-4390-94f0-36b7bc7a7cd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:38.040956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b6d6b-d002-4390-94f0-36b7bc7a7cd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:19:38.040956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b6d6b-d002-4390-94f0-36b7bc7a7cd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:38.042379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b6d6b-d002-4390-94f0-36b7bc7a7cd6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:38.048532 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 777/1547] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:19:37 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:38.050022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01947f-473e-476a-a055-ef1fc7ad5514 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:38.050318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01947f-473e-476a-a055-ef1fc7ad5514 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:38.050600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01947f-473e-476a-a055-ef1fc7ad5514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:38.064358 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 771/1548] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:19:38.064358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3a2d1-bfd0-44f6-a458-a7383008a1fa None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:38.064358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3a2d1-bfd0-44f6-a458-a7383008a1fa None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:38.064358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3a2d1-bfd0-44f6-a458-a7383008a1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:38.069132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-dc01947f-473e-476a-a055-ef1fc7ad5514 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:38.070453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-dc01947f-473e-476a-a055-ef1fc7ad5514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:38.077373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f4a3a2d1-bfd0-44f6-a458-a7383008a1fa None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:38.078528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f4a3a2d1-bfd0-44f6-a458-a7383008a1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:38.133517 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 778/1549] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:38.133517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6ced5-ef97-4c07-93d2-dc4a6ecb5992 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:38.133517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6ced5-ef97-4c07-93d2-dc4a6ecb5992 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:38.133517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6ced5-ef97-4c07-93d2-dc4a6ecb5992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:38.147532 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 772/1550] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:38.147532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3a2d1-bfd0-44f6-a458-a7383008a1fa None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:38.160875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3a2d1-bfd0-44f6-a458-a7383008a1fa None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:38.161919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-41e6ced5-ef97-4c07-93d2-dc4a6ecb5992 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:38.163136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-41e6ced5-ef97-4c07-93d2-dc4a6ecb5992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:38.165502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f5375-bdde-4a46-8c3e-1eb9c0ab1bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:38.166156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f5375-bdde-4a46-8c3e-1eb9c0ab1bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:38.166448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f5375-bdde-4a46-8c3e-1eb9c0ab1bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:38.166727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f5375-bdde-4a46-8c3e-1eb9c0ab1bb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:38.167448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f5375-bdde-4a46-8c3e-1eb9c0ab1bb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:38.168450 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-684f5375-bdde-4a46-8c3e-1eb9c0ab1bb4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:19:38.168450 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:19:38.168450 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:19:38.169689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f5375-bdde-4a46-8c3e-1eb9c0ab1bb4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:38.172230 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 779/1551] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:38.173126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6ced5-ef97-4c07-93d2-dc4a6ecb5992 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:38.185697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6ced5-ef97-4c07-93d2-dc4a6ecb5992 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:38.190367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1fd39-3e51-4c12-9bf7-b3a55d9fa173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:38.191018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1fd39-3e51-4c12-9bf7-b3a55d9fa173 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:38.191308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1fd39-3e51-4c12-9bf7-b3a55d9fa173 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:38.191587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1fd39-3e51-4c12-9bf7-b3a55d9fa173 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:38.192340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1fd39-3e51-4c12-9bf7-b3a55d9fa173 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:19:38.192680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1fd39-3e51-4c12-9bf7-b3a55d9fa173 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:38.193699 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-cae1fd39-3e51-4c12-9bf7-b3a55d9fa173 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:19:38.193699 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:19:38.193699 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:19:38.194609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1fd39-3e51-4c12-9bf7-b3a55d9fa173 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:38.206478 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 780/1552] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:19:38.207378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1fd39-3e51-4c12-9bf7-b3a55d9fa173 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:38.216538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1fd39-3e51-4c12-9bf7-b3a55d9fa173 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:38.221062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04124a62-af97-45a6-80f0-24d55a7e985d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:38.221729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04124a62-af97-45a6-80f0-24d55a7e985d admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:38.222010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04124a62-af97-45a6-80f0-24d55a7e985d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:38.222420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04124a62-af97-45a6-80f0-24d55a7e985d admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:38.223102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04124a62-af97-45a6-80f0-24d55a7e985d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:19:38.223406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04124a62-af97-45a6-80f0-24d55a7e985d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:38.225021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04124a62-af97-45a6-80f0-24d55a7e985d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:38.237056 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 781/1553] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:19:38.237931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04124a62-af97-45a6-80f0-24d55a7e985d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:38.247627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04124a62-af97-45a6-80f0-24d55a7e985d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:38.252116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fe195-1e14-48d8-b8f2-05335560143e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:38.252757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fe195-1e14-48d8-b8f2-05335560143e admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:38.253038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fe195-1e14-48d8-b8f2-05335560143e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:38.253310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fe195-1e14-48d8-b8f2-05335560143e admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:38.253968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1fe195-1e14-48d8-b8f2-05335560143e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:38.254938 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-ae1fe195-1e14-48d8-b8f2-05335560143e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:19:38.254938 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:19:38.254938 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:19:38.256169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1fe195-1e14-48d8-b8f2-05335560143e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:38.270496 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 773/1554] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:19:38 2022] POST /identity/v3/projects => generated 397 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:38.271435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f5375-bdde-4a46-8c3e-1eb9c0ab1bb4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:38.330811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f5375-bdde-4a46-8c3e-1eb9c0ab1bb4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:38.335399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53301dbc-f18b-4b94-b526-a93492154289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:38.336050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53301dbc-f18b-4b94-b526-a93492154289 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:38.336333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53301dbc-f18b-4b94-b526-a93492154289 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:38.336626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53301dbc-f18b-4b94-b526-a93492154289 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:38.337323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53301dbc-f18b-4b94-b526-a93492154289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:38.339226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53301dbc-f18b-4b94-b526-a93492154289 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:38.349220 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 782/1555] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:19:38 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:38.350210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fe195-1e14-48d8-b8f2-05335560143e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:38.360348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fe195-1e14-48d8-b8f2-05335560143e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:38.365019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4c5fc-be80-4e9e-8d2c-6b81ce1e274d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:38.365650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4c5fc-be80-4e9e-8d2c-6b81ce1e274d admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:38.365932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4c5fc-be80-4e9e-8d2c-6b81ce1e274d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:38.366207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4c5fc-be80-4e9e-8d2c-6b81ce1e274d admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:38.366915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4c5fc-be80-4e9e-8d2c-6b81ce1e274d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:19:38.367220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4c5fc-be80-4e9e-8d2c-6b81ce1e274d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:38.369465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4c5fc-be80-4e9e-8d2c-6b81ce1e274d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:38.381092 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 783/1556] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:19:38.382397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c2a2e-e1ca-4552-9533-bf38546f99ea None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:38.382682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c2a2e-e1ca-4552-9533-bf38546f99ea None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:38.382975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c2a2e-e1ca-4552-9533-bf38546f99ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:38.400437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-147c2a2e-e1ca-4552-9533-bf38546f99ea None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:38.401647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-147c2a2e-e1ca-4552-9533-bf38546f99ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:38.409420 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 784/1557] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:38.410162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c2a2e-e1ca-4552-9533-bf38546f99ea None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:38.421612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c2a2e-e1ca-4552-9533-bf38546f99ea None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:38.426123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fe147-963d-4468-b8ee-34a9e39b7c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:38.426734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fe147-963d-4468-b8ee-34a9e39b7c7a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:38.427016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fe147-963d-4468-b8ee-34a9e39b7c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:38.427293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fe147-963d-4468-b8ee-34a9e39b7c7a admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:38.428101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fe147-963d-4468-b8ee-34a9e39b7c7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:19:38.428365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fe147-963d-4468-b8ee-34a9e39b7c7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:38.429963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fe147-963d-4468-b8ee-34a9e39b7c7a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:38.437140 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 774/1558] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:19:38 2022] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:38.442209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53301dbc-f18b-4b94-b526-a93492154289 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:38.443803 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 785/1559] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:19:38.444402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fe147-963d-4468-b8ee-34a9e39b7c7a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:38.454066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fe147-963d-4468-b8ee-34a9e39b7c7a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:38.503170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53301dbc-f18b-4b94-b526-a93492154289 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:38.507648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6145e-cffa-4d8c-86a5-b013baf35c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:38.507853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a4d35-2518-4af9-a66c-ebd602687765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:38.508307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6145e-cffa-4d8c-86a5-b013baf35c38 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:38.508506 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a4d35-2518-4af9-a66c-ebd602687765 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:38.508665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6145e-cffa-4d8c-86a5-b013baf35c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:38.508825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a4d35-2518-4af9-a66c-ebd602687765 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:38.508916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6145e-cffa-4d8c-86a5-b013baf35c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:38.509108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a4d35-2518-4af9-a66c-ebd602687765 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:38.509581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6145e-cffa-4d8c-86a5-b013baf35c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:38.509794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a4d35-2518-4af9-a66c-ebd602687765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:38.511641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6145e-cffa-4d8c-86a5-b013baf35c38 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:38.511746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a4d35-2518-4af9-a66c-ebd602687765 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:38.592125 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 786/1560] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:19:38 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:38.592708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6145e-cffa-4d8c-86a5-b013baf35c38 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:38.624786 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 775/1561] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:19:38 2022] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:38.624786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a4d35-2518-4af9-a66c-ebd602687765 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:38.651606 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6145e-cffa-4d8c-86a5-b013baf35c38 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:38.680912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a4d35-2518-4af9-a66c-ebd602687765 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:38.686100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e60b2-ddd0-4f99-bd8a-6dd638da1d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:38.686789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e60b2-ddd0-4f99-bd8a-6dd638da1d56 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:38.687080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e60b2-ddd0-4f99-bd8a-6dd638da1d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:38.687358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e60b2-ddd0-4f99-bd8a-6dd638da1d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:38.688079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e60b2-ddd0-4f99-bd8a-6dd638da1d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:38.689715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e60b2-ddd0-4f99-bd8a-6dd638da1d56 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:38.699575 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 776/1562] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:38.700136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e60b2-ddd0-4f99-bd8a-6dd638da1d56 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:38.706513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6265c-65e1-4bfa-8c15-9561b609b5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:38.710008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6265c-65e1-4bfa-8c15-9561b609b5fc admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:38.710008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6265c-65e1-4bfa-8c15-9561b609b5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:38.710008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6265c-65e1-4bfa-8c15-9561b609b5fc admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:38.710008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6265c-65e1-4bfa-8c15-9561b609b5fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:38.710306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e60b2-ddd0-4f99-bd8a-6dd638da1d56 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:38.710417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6265c-65e1-4bfa-8c15-9561b609b5fc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:38.714336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54ed4e-7804-466e-9b26-de5414e587a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:38.715055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54ed4e-7804-466e-9b26-de5414e587a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:38.715317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54ed4e-7804-466e-9b26-de5414e587a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:38.715580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54ed4e-7804-466e-9b26-de5414e587a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:38.716259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54ed4e-7804-466e-9b26-de5414e587a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:38.718149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54ed4e-7804-466e-9b26-de5414e587a2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:38.877622 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 787/1563] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:19:38 2022] POST /identity/v3/users => generated 299 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:38.878633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6265c-65e1-4bfa-8c15-9561b609b5fc admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:38.888045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6265c-65e1-4bfa-8c15-9561b609b5fc admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:38.892589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4742574-a89f-4715-bc8a-1d16f315d8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:38.898030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4742574-a89f-4715-bc8a-1d16f315d8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:38.898030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4742574-a89f-4715-bc8a-1d16f315d8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:38.898030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4742574-a89f-4715-bc8a-1d16f315d8c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:38.898030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4742574-a89f-4715-bc8a-1d16f315d8c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:19:38.898030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4742574-a89f-4715-bc8a-1d16f315d8c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:38.898030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4742574-a89f-4715-bc8a-1d16f315d8c5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:38.905679 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 777/1564] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:19:38 2022] POST /identity/v3/projects => generated 389 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:38.906789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54ed4e-7804-466e-9b26-de5414e587a2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:38.909086 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 788/1565] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:19:38.909991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4742574-a89f-4715-bc8a-1d16f315d8c5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:38.920274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4742574-a89f-4715-bc8a-1d16f315d8c5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:38.967086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54ed4e-7804-466e-9b26-de5414e587a2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:38.971569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ca7f1-f1c4-4233-92f7-41dfa1fa7735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:38.972425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ca7f1-f1c4-4233-92f7-41dfa1fa7735 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:38.972704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ca7f1-f1c4-4233-92f7-41dfa1fa7735 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:38.972985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ca7f1-f1c4-4233-92f7-41dfa1fa7735 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:38.973604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786427a2-d699-45f1-aee9-1b4e6f1b6be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:38.973728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ca7f1-f1c4-4233-92f7-41dfa1fa7735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:38.974262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786427a2-d699-45f1-aee9-1b4e6f1b6be0 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:38.974566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786427a2-d699-45f1-aee9-1b4e6f1b6be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:38.974841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786427a2-d699-45f1-aee9-1b4e6f1b6be0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:38.975525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786427a2-d699-45f1-aee9-1b4e6f1b6be0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:38.975631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ca7f1-f1c4-4233-92f7-41dfa1fa7735 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:38.977473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786427a2-d699-45f1-aee9-1b4e6f1b6be0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:39.071387 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 778/1566] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:19:38 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:39.072199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ca7f1-f1c4-4233-92f7-41dfa1fa7735 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:39.081222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ca7f1-f1c4-4233-92f7-41dfa1fa7735 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:39.086001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a075e1-58a8-4191-b9b0-28c5cb5c0e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:39.086636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a075e1-58a8-4191-b9b0-28c5cb5c0e2b admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:39.086974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a075e1-58a8-4191-b9b0-28c5cb5c0e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:39.087256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a075e1-58a8-4191-b9b0-28c5cb5c0e2b admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:39.088416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a075e1-58a8-4191-b9b0-28c5cb5c0e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:39.090381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a075e1-58a8-4191-b9b0-28c5cb5c0e2b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:39.101252 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 789/1567] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:19:38 2022] POST /identity/v3/projects => generated 397 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:39.104583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786427a2-d699-45f1-aee9-1b4e6f1b6be0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:39.161128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786427a2-d699-45f1-aee9-1b4e6f1b6be0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:39.165795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b746ba7-4398-4ee5-bdd8-37d7bbd31815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:39.166457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b746ba7-4398-4ee5-bdd8-37d7bbd31815 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:39.166744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b746ba7-4398-4ee5-bdd8-37d7bbd31815 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:39.167079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b746ba7-4398-4ee5-bdd8-37d7bbd31815 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:39.167770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b746ba7-4398-4ee5-bdd8-37d7bbd31815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:39.169873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b746ba7-4398-4ee5-bdd8-37d7bbd31815 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:39.174940 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 779/1568] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:19:39 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:39.175909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a075e1-58a8-4191-b9b0-28c5cb5c0e2b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:39.186787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a075e1-58a8-4191-b9b0-28c5cb5c0e2b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:39.191282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff453d-465e-4e7b-bb51-8309f07a2d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:39.192024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff453d-465e-4e7b-bb51-8309f07a2d45 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:39.192315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff453d-465e-4e7b-bb51-8309f07a2d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:39.192593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff453d-465e-4e7b-bb51-8309f07a2d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:39.193394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff453d-465e-4e7b-bb51-8309f07a2d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:39.194956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff453d-465e-4e7b-bb51-8309f07a2d45 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:39.205406 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 780/1569] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:39.207309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff453d-465e-4e7b-bb51-8309f07a2d45 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:39.215885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff453d-465e-4e7b-bb51-8309f07a2d45 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:39.220349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39e64e-79b9-43a5-a02a-1b9d4f1390eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:39.220987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39e64e-79b9-43a5-a02a-1b9d4f1390eb admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:39.221271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39e64e-79b9-43a5-a02a-1b9d4f1390eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:39.221547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39e64e-79b9-43a5-a02a-1b9d4f1390eb admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:39.222230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39e64e-79b9-43a5-a02a-1b9d4f1390eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:39.223770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39e64e-79b9-43a5-a02a-1b9d4f1390eb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:39.233289 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 781/1570] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:39.234092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39e64e-79b9-43a5-a02a-1b9d4f1390eb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:39.243301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39e64e-79b9-43a5-a02a-1b9d4f1390eb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:39.248155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f222a-efea-4c06-bd4a-769fc39ffff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:39.248848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f222a-efea-4c06-bd4a-769fc39ffff1 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:39.249124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f222a-efea-4c06-bd4a-769fc39ffff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:39.249403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f222a-efea-4c06-bd4a-769fc39ffff1 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:39.250083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f222a-efea-4c06-bd4a-769fc39ffff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:39.251953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f222a-efea-4c06-bd4a-769fc39ffff1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:39.255007 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 790/1571] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:19:39 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:39.255007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b746ba7-4398-4ee5-bdd8-37d7bbd31815 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:39.263283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b746ba7-4398-4ee5-bdd8-37d7bbd31815 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:39.267930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab90582-0e1c-431b-8e8e-315d2088530b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:39.268563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab90582-0e1c-431b-8e8e-315d2088530b admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:39.268887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab90582-0e1c-431b-8e8e-315d2088530b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:39.269181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab90582-0e1c-431b-8e8e-315d2088530b admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:39.269937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab90582-0e1c-431b-8e8e-315d2088530b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:39.271878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab90582-0e1c-431b-8e8e-315d2088530b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:39.310729 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 782/1572] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:19:39 2022] POST /identity/v3/users => generated 295 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:39.311727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f222a-efea-4c06-bd4a-769fc39ffff1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:39.321049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f222a-efea-4c06-bd4a-769fc39ffff1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:39.326274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f490b4a-1344-449a-a887-d9dc13ea38a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:39.328866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f490b4a-1344-449a-a887-d9dc13ea38a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:39.328866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f490b4a-1344-449a-a887-d9dc13ea38a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:39.328866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f490b4a-1344-449a-a887-d9dc13ea38a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:39.328866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f490b4a-1344-449a-a887-d9dc13ea38a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:39.329804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f490b4a-1344-449a-a887-d9dc13ea38a6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:39.340759 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 783/1573] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:39.341514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f490b4a-1344-449a-a887-d9dc13ea38a6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:39.355644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f490b4a-1344-449a-a887-d9dc13ea38a6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:39.355806 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 791/1574] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:19:39 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:39.355806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab90582-0e1c-431b-8e8e-315d2088530b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:39.406049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfed47-3880-4de7-b018-e5f6c4758204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:39.406718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfed47-3880-4de7-b018-e5f6c4758204 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:39.407007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfed47-3880-4de7-b018-e5f6c4758204 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:39.407297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfed47-3880-4de7-b018-e5f6c4758204 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:39.407988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfed47-3880-4de7-b018-e5f6c4758204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:39.409977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfed47-3880-4de7-b018-e5f6c4758204 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:39.412388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab90582-0e1c-431b-8e8e-315d2088530b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:39.417138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccf887-43c3-47ef-9c45-075ee027ac50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:39.417796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccf887-43c3-47ef-9c45-075ee027ac50 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:39.418078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccf887-43c3-47ef-9c45-075ee027ac50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:39.418354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccf887-43c3-47ef-9c45-075ee027ac50 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:39.419071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccf887-43c3-47ef-9c45-075ee027ac50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:39.420700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccf887-43c3-47ef-9c45-075ee027ac50 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:39.430231 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 792/1575] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:39.431000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccf887-43c3-47ef-9c45-075ee027ac50 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:39.440020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccf887-43c3-47ef-9c45-075ee027ac50 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:39.444481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31cdc6-45f0-4533-9b78-a0b5a002b3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:39.445355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31cdc6-45f0-4533-9b78-a0b5a002b3ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:39.445637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31cdc6-45f0-4533-9b78-a0b5a002b3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:39.445909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31cdc6-45f0-4533-9b78-a0b5a002b3ff admin admin] PATH_INFO: `/v3/projects/20ebdc8b202e49338906cb8641faee94/users/af12f31b03914517a84a3648da847aba/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:39.460291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31cdc6-45f0-4533-9b78-a0b5a002b3ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=20ebdc8b202e49338906cb8641faee94, user_id=af12f31b03914517a84a3648da847aba, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:39.463693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31cdc6-45f0-4533-9b78-a0b5a002b3ff admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:39.511465 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 784/1576] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:19:39 2022] POST /identity/v3/users => generated 299 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:39.512330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfed47-3880-4de7-b018-e5f6c4758204 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:39.521382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfed47-3880-4de7-b018-e5f6c4758204 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:39.525847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755e282-b8db-48af-a428-789302bdf19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:39.526469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755e282-b8db-48af-a428-789302bdf19d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:39.526748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755e282-b8db-48af-a428-789302bdf19d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:39.527022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755e282-b8db-48af-a428-789302bdf19d admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:39.527804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755e282-b8db-48af-a428-789302bdf19d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:39.529457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755e282-b8db-48af-a428-789302bdf19d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:39.539344 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 785/1577] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:39.549046 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 793/1578] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:39 2022] PUT /identity/v3/projects/20ebdc8b202e49338906cb8641faee94/users/af12f31b03914517a84a3648da847aba/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:39.549189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755e282-b8db-48af-a428-789302bdf19d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:39.549287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31cdc6-45f0-4533-9b78-a0b5a002b3ff admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:39.552107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755e282-b8db-48af-a428-789302bdf19d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:39.605501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31cdc6-45f0-4533-9b78-a0b5a002b3ff admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:39.606241 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11e2e3-96f5-493a-ac56-d4402579dcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:39.606909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11e2e3-96f5-493a-ac56-d4402579dcb5 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:39.607150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11e2e3-96f5-493a-ac56-d4402579dcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:39.607460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11e2e3-96f5-493a-ac56-d4402579dcb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:39.608192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11e2e3-96f5-493a-ac56-d4402579dcb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:39.609826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11e2e3-96f5-493a-ac56-d4402579dcb5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:39.610267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94621003-2202-4acb-a299-f1d3f154ad77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:39.610926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94621003-2202-4acb-a299-f1d3f154ad77 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:39.611206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94621003-2202-4acb-a299-f1d3f154ad77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:39.611477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94621003-2202-4acb-a299-f1d3f154ad77 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:39.612196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94621003-2202-4acb-a299-f1d3f154ad77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:39.613829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94621003-2202-4acb-a299-f1d3f154ad77 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:39.619873 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 786/1579] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:39.620959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11e2e3-96f5-493a-ac56-d4402579dcb5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:39.627523 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 794/1580] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:39.627523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94621003-2202-4acb-a299-f1d3f154ad77 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:39.631606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11e2e3-96f5-493a-ac56-d4402579dcb5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:39.635354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94621003-2202-4acb-a299-f1d3f154ad77 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:39.636683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4889f-676a-46de-892d-6ede2357091b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:39.637323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4889f-676a-46de-892d-6ede2357091b admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:39.637607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4889f-676a-46de-892d-6ede2357091b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:39.637884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4889f-676a-46de-892d-6ede2357091b admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:39.638594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4889f-676a-46de-892d-6ede2357091b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:39.639921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6eb205-147a-4045-8841-7998f530c6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:39.640151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4889f-676a-46de-892d-6ede2357091b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:39.640547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6eb205-147a-4045-8841-7998f530c6f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:39.640860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6eb205-147a-4045-8841-7998f530c6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:39.641133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6eb205-147a-4045-8841-7998f530c6f0 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:39.641798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6eb205-147a-4045-8841-7998f530c6f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:39.643653 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6eb205-147a-4045-8841-7998f530c6f0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:39.649593 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 787/1581] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:39.650402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4889f-676a-46de-892d-6ede2357091b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:39.661091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4889f-676a-46de-892d-6ede2357091b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:39.665615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736a810-391d-49b8-8a55-11a25576b309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:39.666239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736a810-391d-49b8-8a55-11a25576b309 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:39.666522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736a810-391d-49b8-8a55-11a25576b309 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:39.666798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736a810-391d-49b8-8a55-11a25576b309 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:39.667498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736a810-391d-49b8-8a55-11a25576b309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:39.669112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736a810-391d-49b8-8a55-11a25576b309 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:39.678442 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 788/1582] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:39.679197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736a810-391d-49b8-8a55-11a25576b309 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:39.688633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736a810-391d-49b8-8a55-11a25576b309 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:39.693953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d0deb-bc62-4b0c-9a24-91c51009d8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:39.693953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d0deb-bc62-4b0c-9a24-91c51009d8ea admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:39.693953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d0deb-bc62-4b0c-9a24-91c51009d8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:39.694243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d0deb-bc62-4b0c-9a24-91c51009d8ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:39.694919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d0deb-bc62-4b0c-9a24-91c51009d8ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:39.696407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d0deb-bc62-4b0c-9a24-91c51009d8ea admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:39.707226 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 789/1583] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:39.708034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d0deb-bc62-4b0c-9a24-91c51009d8ea admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:39.710973 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 795/1584] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:19:39 2022] POST /identity/v3/users => generated 286 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:39.716957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871e9c4-cdcc-4419-a284-5d62b3164890 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:39.716957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871e9c4-cdcc-4419-a284-5d62b3164890 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:39.716957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871e9c4-cdcc-4419-a284-5d62b3164890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:39.717781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d0deb-bc62-4b0c-9a24-91c51009d8ea admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:39.722479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c791882-bbf3-474b-9c1e-fcba024f09b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:39.723341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c791882-bbf3-474b-9c1e-fcba024f09b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:39.723621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c791882-bbf3-474b-9c1e-fcba024f09b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:39.723895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c791882-bbf3-474b-9c1e-fcba024f09b3 admin admin] PATH_INFO: `/v3/projects/25e3a228719d4cbda0507cba959f1816/users/662c15e746b84fdbb497d700c9288931/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:39.738533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c871e9c4-cdcc-4419-a284-5d62b3164890 None None] MFA Rules not processed for user `af12f31b03914517a84a3648da847aba`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:39.738831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c791882-bbf3-474b-9c1e-fcba024f09b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e3a228719d4cbda0507cba959f1816, user_id=662c15e746b84fdbb497d700c9288931, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:39.739740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c871e9c4-cdcc-4419-a284-5d62b3164890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:39.739850 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-6c791882-bbf3-474b-9c1e-fcba024f09b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:19:39.739850 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:19:39.739850 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:19:39.741777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c791882-bbf3-474b-9c1e-fcba024f09b3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:39.801149 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 796/1585] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:39.802112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871e9c4-cdcc-4419-a284-5d62b3164890 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:39.812622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871e9c4-cdcc-4419-a284-5d62b3164890 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:39.819337 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 790/1586] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:39 2022] PUT /identity/v3/projects/25e3a228719d4cbda0507cba959f1816/users/662c15e746b84fdbb497d700c9288931/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:39.820163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c791882-bbf3-474b-9c1e-fcba024f09b3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:39.866773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502efb1-15e6-4e4c-a33a-af445d95cc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:39.869431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502efb1-15e6-4e4c-a33a-af445d95cc39 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:39.869431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502efb1-15e6-4e4c-a33a-af445d95cc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:39.869431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502efb1-15e6-4e4c-a33a-af445d95cc39 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:39.869431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502efb1-15e6-4e4c-a33a-af445d95cc39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:39.871274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502efb1-15e6-4e4c-a33a-af445d95cc39 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:39.880633 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 797/1587] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:39.881410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502efb1-15e6-4e4c-a33a-af445d95cc39 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:39.881651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c791882-bbf3-474b-9c1e-fcba024f09b3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:39.886701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef127f62-50f1-4414-825e-e7b4ae45de72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:39.887369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef127f62-50f1-4414-825e-e7b4ae45de72 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:39.887647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef127f62-50f1-4414-825e-e7b4ae45de72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:39.887923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef127f62-50f1-4414-825e-e7b4ae45de72 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:39.888664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef127f62-50f1-4414-825e-e7b4ae45de72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:39.890251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef127f62-50f1-4414-825e-e7b4ae45de72 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:39.893266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502efb1-15e6-4e4c-a33a-af445d95cc39 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:39.898053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1af40b-3f50-4897-a152-c63d259aafb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:39.903594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1af40b-3f50-4897-a152-c63d259aafb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:39.903594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1af40b-3f50-4897-a152-c63d259aafb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:39.903594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1af40b-3f50-4897-a152-c63d259aafb3 admin admin] PATH_INFO: `/v3/projects/60f844d1ae1c433381680cf9cb1f83a4/users/3e26ea8189f44cbfb6a8b395232ec6f1/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:39.903835 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 791/1588] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:39.903835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef127f62-50f1-4414-825e-e7b4ae45de72 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:39.910826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef127f62-50f1-4414-825e-e7b4ae45de72 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:39.913877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1af40b-3f50-4897-a152-c63d259aafb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f844d1ae1c433381680cf9cb1f83a4, user_id=3e26ea8189f44cbfb6a8b395232ec6f1, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:39.915334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c60e3-0ae8-4f75-b854-451d1128c561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:39.916722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c60e3-0ae8-4f75-b854-451d1128c561 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:39.917003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c60e3-0ae8-4f75-b854-451d1128c561 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:39.917088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1af40b-3f50-4897-a152-c63d259aafb3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:39.917278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c60e3-0ae8-4f75-b854-451d1128c561 admin admin] PATH_INFO: `/v3/projects/83b0196b9f684b1da4d70d97b20e37f1/users/c3cdce63521c4407b7575c924737c5fc/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:39.931962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c60e3-0ae8-4f75-b854-451d1128c561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b0196b9f684b1da4d70d97b20e37f1, user_id=c3cdce63521c4407b7575c924737c5fc, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:39.934654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c60e3-0ae8-4f75-b854-451d1128c561 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:39.979882 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 798/1589] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:39 2022] PUT /identity/v3/projects/60f844d1ae1c433381680cf9cb1f83a4/users/3e26ea8189f44cbfb6a8b395232ec6f1/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:39.980777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1af40b-3f50-4897-a152-c63d259aafb3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:39.998057 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 792/1590] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:39 2022] PUT /identity/v3/projects/83b0196b9f684b1da4d70d97b20e37f1/users/c3cdce63521c4407b7575c924737c5fc/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:39.999050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c60e3-0ae8-4f75-b854-451d1128c561 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:40.050053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1af40b-3f50-4897-a152-c63d259aafb3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:40.054507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3f460-4e7b-4ae2-97b8-a9a2b402805c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:40.055170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3f460-4e7b-4ae2-97b8-a9a2b402805c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:40.055454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3f460-4e7b-4ae2-97b8-a9a2b402805c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:40.055729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3f460-4e7b-4ae2-97b8-a9a2b402805c admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:40.057033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3f460-4e7b-4ae2-97b8-a9a2b402805c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:40.057574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c60e3-0ae8-4f75-b854-451d1128c561 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:40.058629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3f460-4e7b-4ae2-97b8-a9a2b402805c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:40.062065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3cc870-4e0a-4ad9-84b1-dc7b203b4744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:40.062722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cc870-4e0a-4ad9-84b1-dc7b203b4744 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:40.063003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cc870-4e0a-4ad9-84b1-dc7b203b4744 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:40.063280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cc870-4e0a-4ad9-84b1-dc7b203b4744 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:40.063995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cc870-4e0a-4ad9-84b1-dc7b203b4744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:40.065575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cc870-4e0a-4ad9-84b1-dc7b203b4744 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:40.068201 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 799/1591] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:40.069001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3f460-4e7b-4ae2-97b8-a9a2b402805c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:40.078047 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 793/1592] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:40.078047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e383633-f377-4ded-ba64-c8c3adc6c4cd None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:40.078047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e383633-f377-4ded-ba64-c8c3adc6c4cd None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:40.078047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e383633-f377-4ded-ba64-c8c3adc6c4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:40.078420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3f460-4e7b-4ae2-97b8-a9a2b402805c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:40.082628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b82ed-c9ff-4570-82ae-8fdc4c9e9641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:40.083265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b82ed-c9ff-4570-82ae-8fdc4c9e9641 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:40.083550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b82ed-c9ff-4570-82ae-8fdc4c9e9641 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:40.083830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b82ed-c9ff-4570-82ae-8fdc4c9e9641 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:40.084513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b82ed-c9ff-4570-82ae-8fdc4c9e9641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:40.086430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b82ed-c9ff-4570-82ae-8fdc4c9e9641 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:40.094148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4e383633-f377-4ded-ba64-c8c3adc6c4cd None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:40.095356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4e383633-f377-4ded-ba64-c8c3adc6c4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:40.107652 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 794/1593] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:40.108511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e383633-f377-4ded-ba64-c8c3adc6c4cd None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:40.121468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e383633-f377-4ded-ba64-c8c3adc6c4cd None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:40.123606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac32a96-f402-427c-90dc-336489330a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:40.124477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac32a96-f402-427c-90dc-336489330a4e admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:40.124814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac32a96-f402-427c-90dc-336489330a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:40.125090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac32a96-f402-427c-90dc-336489330a4e admin admin] PATH_INFO: `/v3/projects/a405e8c053514663a4413891a3fd9e82/users/abe0822b37d047f5adc46a8e5253a05b/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:40.138896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac32a96-f402-427c-90dc-336489330a4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a405e8c053514663a4413891a3fd9e82, user_id=abe0822b37d047f5adc46a8e5253a05b, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:40.141559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac32a96-f402-427c-90dc-336489330a4e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:40.201708 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 800/1594] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:19:40 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:40.202624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b82ed-c9ff-4570-82ae-8fdc4c9e9641 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:40.224934 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 795/1595] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:40 2022] PUT /identity/v3/projects/a405e8c053514663a4413891a3fd9e82/users/abe0822b37d047f5adc46a8e5253a05b/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:40.235681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fc3f9-0ee6-4dc8-85f4-4e63e2f5df12 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:40.236185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fc3f9-0ee6-4dc8-85f4-4e63e2f5df12 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:40.236461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fc3f9-0ee6-4dc8-85f4-4e63e2f5df12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:40.262220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-037fc3f9-0ee6-4dc8-85f4-4e63e2f5df12 None None] MFA Rules not processed for user `3e26ea8189f44cbfb6a8b395232ec6f1`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:40.262643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b82ed-c9ff-4570-82ae-8fdc4c9e9641 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:40.263407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-037fc3f9-0ee6-4dc8-85f4-4e63e2f5df12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:40.316066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9859eec-7460-47d2-a7b3-977bc0c44f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:40.317023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9859eec-7460-47d2-a7b3-977bc0c44f9d admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:40.317305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9859eec-7460-47d2-a7b3-977bc0c44f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:40.317582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9859eec-7460-47d2-a7b3-977bc0c44f9d admin admin] PATH_INFO: `/v3/projects/66d8d2aaecb944ea931a74ca8a8526f9/users/625d2d9692cd4191afa8cb7d4c82a74d/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:40.324721 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 796/1596] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:40.326022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7cb1e-f80b-4c9e-8a40-973ae8bed9b9 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:40.326319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7cb1e-f80b-4c9e-8a40-973ae8bed9b9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:40.326670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7cb1e-f80b-4c9e-8a40-973ae8bed9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:40.331877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9859eec-7460-47d2-a7b3-977bc0c44f9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d8d2aaecb944ea931a74ca8a8526f9, user_id=625d2d9692cd4191afa8cb7d4c82a74d, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:40.334600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9859eec-7460-47d2-a7b3-977bc0c44f9d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:40.353671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-36e7cb1e-f80b-4c9e-8a40-973ae8bed9b9 None None] MFA Rules not processed for user `c3cdce63521c4407b7575c924737c5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:40.354899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-36e7cb1e-f80b-4c9e-8a40-973ae8bed9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:40.400818 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 801/1597] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:40 2022] PUT /identity/v3/projects/66d8d2aaecb944ea931a74ca8a8526f9/users/625d2d9692cd4191afa8cb7d4c82a74d/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:40.401746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9859eec-7460-47d2-a7b3-977bc0c44f9d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:40.424801 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 797/1598] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:40.425715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7cb1e-f80b-4c9e-8a40-973ae8bed9b9 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:40.436105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7cb1e-f80b-4c9e-8a40-973ae8bed9b9 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:40.460934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9859eec-7460-47d2-a7b3-977bc0c44f9d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:40.466169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3323d-80df-4a49-9e82-81c906c2e07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:40.467099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3323d-80df-4a49-9e82-81c906c2e07b admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:40.467385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3323d-80df-4a49-9e82-81c906c2e07b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:40.467666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3323d-80df-4a49-9e82-81c906c2e07b admin admin] PATH_INFO: `/v3/projects/1657fdec4f38462c94cb54c8c47bddfd/users/ae05e30e790f43958bc78d5474d50a5c/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:40.483258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3323d-80df-4a49-9e82-81c906c2e07b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1657fdec4f38462c94cb54c8c47bddfd, user_id=ae05e30e790f43958bc78d5474d50a5c, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:40.486071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3323d-80df-4a49-9e82-81c906c2e07b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:40.490295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d75c05-5b3f-48a7-b012-651cf8c1da93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:40.493927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d75c05-5b3f-48a7-b012-651cf8c1da93 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:40.493927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d75c05-5b3f-48a7-b012-651cf8c1da93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:40.493927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d75c05-5b3f-48a7-b012-651cf8c1da93 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:40.493927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d75c05-5b3f-48a7-b012-651cf8c1da93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:40.493927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d75c05-5b3f-48a7-b012-651cf8c1da93 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:40.503586 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 798/1599] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:40.504502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d75c05-5b3f-48a7-b012-651cf8c1da93 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:40.579389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d75c05-5b3f-48a7-b012-651cf8c1da93 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:40.583184 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 802/1600] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:40 2022] PUT /identity/v3/projects/1657fdec4f38462c94cb54c8c47bddfd/users/ae05e30e790f43958bc78d5474d50a5c/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:40.584065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3323d-80df-4a49-9e82-81c906c2e07b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:40.628498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2dbd00-de15-4541-95d2-b281d9e2923d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:40.629197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dbd00-de15-4541-95d2-b281d9e2923d service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:40.629527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dbd00-de15-4541-95d2-b281d9e2923d service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:40.629846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dbd00-de15-4541-95d2-b281d9e2923d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:40.647543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3323d-80df-4a49-9e82-81c906c2e07b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:40.653056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cec45e-8e13-4f4d-83f8-96c67b3a522b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:40.653678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cec45e-8e13-4f4d-83f8-96c67b3a522b admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:40.653989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cec45e-8e13-4f4d-83f8-96c67b3a522b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:40.654266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cec45e-8e13-4f4d-83f8-96c67b3a522b admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:40.654982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cec45e-8e13-4f4d-83f8-96c67b3a522b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:40.657126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cec45e-8e13-4f4d-83f8-96c67b3a522b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:40.687535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2dbd00-de15-4541-95d2-b281d9e2923d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:40.689018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2dbd00-de15-4541-95d2-b281d9e2923d service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:40.698860 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 799/1601] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:19:40.700098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17537781-61df-4ac4-9a6c-f6885f0b23d2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:40.700390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17537781-61df-4ac4-9a6c-f6885f0b23d2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:40.700770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17537781-61df-4ac4-9a6c-f6885f0b23d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:40.726310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-17537781-61df-4ac4-9a6c-f6885f0b23d2 None None] MFA Rules not processed for user `abe0822b37d047f5adc46a8e5253a05b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:40.727699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-17537781-61df-4ac4-9a6c-f6885f0b23d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:40.745969 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 803/1602] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:19:40 2022] POST /identity/v3/users => generated 295 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:40.746947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cec45e-8e13-4f4d-83f8-96c67b3a522b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:40.759956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cec45e-8e13-4f4d-83f8-96c67b3a522b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:40.764771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc3086-9ac3-43c3-9cfe-e639a48ef358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:40.765504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc3086-9ac3-43c3-9cfe-e639a48ef358 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:40.765860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc3086-9ac3-43c3-9cfe-e639a48ef358 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:40.766259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc3086-9ac3-43c3-9cfe-e639a48ef358 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:40.767008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc3086-9ac3-43c3-9cfe-e639a48ef358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:40.769029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc3086-9ac3-43c3-9cfe-e639a48ef358 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:40.791476 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 800/1603] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:40.792871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b68e5-cbd1-40a3-a994-5a2c52bc478a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:40.793313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b68e5-cbd1-40a3-a994-5a2c52bc478a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:40.793563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b68e5-cbd1-40a3-a994-5a2c52bc478a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:40.817744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-832b68e5-cbd1-40a3-a994-5a2c52bc478a None None] MFA Rules not processed for user `625d2d9692cd4191afa8cb7d4c82a74d`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:40.818941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-832b68e5-cbd1-40a3-a994-5a2c52bc478a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:40.847485 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 804/1604] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:19:40 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:40.847485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc3086-9ac3-43c3-9cfe-e639a48ef358 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:40.890155 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 801/1605] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:40.891644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b68e5-cbd1-40a3-a994-5a2c52bc478a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:40.904071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b68e5-cbd1-40a3-a994-5a2c52bc478a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:40.908784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59899df2-65a0-410c-aa2c-4424fe554dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:40.909147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc3086-9ac3-43c3-9cfe-e639a48ef358 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:40.909902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59899df2-65a0-410c-aa2c-4424fe554dca admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:40.910184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59899df2-65a0-410c-aa2c-4424fe554dca admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:40.910460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59899df2-65a0-410c-aa2c-4424fe554dca admin admin] PATH_INFO: `/v3/projects/e75b37ef372e4e7da13d2251b08f510e/users/736ee9ad940b4ca991cfcb3318e18824/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:40.913964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d66478-19d5-4ec1-be93-aabe51451cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:40.914704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d66478-19d5-4ec1-be93-aabe51451cdc admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:40.914994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d66478-19d5-4ec1-be93-aabe51451cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:40.915420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d66478-19d5-4ec1-be93-aabe51451cdc admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:40.916116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d66478-19d5-4ec1-be93-aabe51451cdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:40.918079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d66478-19d5-4ec1-be93-aabe51451cdc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:40.925116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59899df2-65a0-410c-aa2c-4424fe554dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=e75b37ef372e4e7da13d2251b08f510e, user_id=736ee9ad940b4ca991cfcb3318e18824, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:40.927823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59899df2-65a0-410c-aa2c-4424fe554dca admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:41.020157 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 802/1606] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:40 2022] PUT /identity/v3/projects/e75b37ef372e4e7da13d2251b08f510e/users/736ee9ad940b4ca991cfcb3318e18824/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:41.024483 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 805/1607] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:19:40 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:41.024483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d66478-19d5-4ec1-be93-aabe51451cdc admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:41.026968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9993033-e1a2-4ffb-aa90-81d563a6e47c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:41.027366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9993033-e1a2-4ffb-aa90-81d563a6e47c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:41.027823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9993033-e1a2-4ffb-aa90-81d563a6e47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:41.062334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b9993033-e1a2-4ffb-aa90-81d563a6e47c None None] MFA Rules not processed for user `ae05e30e790f43958bc78d5474d50a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:41.064009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b9993033-e1a2-4ffb-aa90-81d563a6e47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:41.093773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d66478-19d5-4ec1-be93-aabe51451cdc admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:41.099318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831c8c6-e613-4e60-a52e-89265ffa3193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:41.100089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831c8c6-e613-4e60-a52e-89265ffa3193 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:41.100440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831c8c6-e613-4e60-a52e-89265ffa3193 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:41.100811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831c8c6-e613-4e60-a52e-89265ffa3193 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:41.101622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831c8c6-e613-4e60-a52e-89265ffa3193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:41.103295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831c8c6-e613-4e60-a52e-89265ffa3193 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:41.114593 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 806/1608] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:41.115331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831c8c6-e613-4e60-a52e-89265ffa3193 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:41.125906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831c8c6-e613-4e60-a52e-89265ffa3193 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:41.130901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547865b-d17e-47c4-a1c3-dba4db2c48df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:41.131555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547865b-d17e-47c4-a1c3-dba4db2c48df admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:41.131844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547865b-d17e-47c4-a1c3-dba4db2c48df admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:41.132126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547865b-d17e-47c4-a1c3-dba4db2c48df admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:41.132874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547865b-d17e-47c4-a1c3-dba4db2c48df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:41.135420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547865b-d17e-47c4-a1c3-dba4db2c48df admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:41.136399 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 803/1609] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:41.137316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9993033-e1a2-4ffb-aa90-81d563a6e47c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:41.148752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9993033-e1a2-4ffb-aa90-81d563a6e47c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:41.153616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d17874-a82c-4b9f-99b5-44be6b011031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:41.158570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d17874-a82c-4b9f-99b5-44be6b011031 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:41.158570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d17874-a82c-4b9f-99b5-44be6b011031 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:41.158570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d17874-a82c-4b9f-99b5-44be6b011031 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:41.158570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d17874-a82c-4b9f-99b5-44be6b011031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:41.158570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d17874-a82c-4b9f-99b5-44be6b011031 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:41.261267 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 804/1610] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:19:41 2022] POST /identity/v3/users => generated 298 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:41.262169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d17874-a82c-4b9f-99b5-44be6b011031 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:41.262832 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 807/1611] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:19:41 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:41.264112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547865b-d17e-47c4-a1c3-dba4db2c48df admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:41.276637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d17874-a82c-4b9f-99b5-44be6b011031 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:41.332177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547865b-d17e-47c4-a1c3-dba4db2c48df admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:41.337044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62de739-b458-4540-813c-8a669352af8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:41.337436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848246b-7297-44a2-a880-e003ef114b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:41.337804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62de739-b458-4540-813c-8a669352af8a admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:41.338051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62de739-b458-4540-813c-8a669352af8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:41.338298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848246b-7297-44a2-a880-e003ef114b0b admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:41.338412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62de739-b458-4540-813c-8a669352af8a admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:41.338780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848246b-7297-44a2-a880-e003ef114b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:41.339004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62de739-b458-4540-813c-8a669352af8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:41.339247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848246b-7297-44a2-a880-e003ef114b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:41.340058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848246b-7297-44a2-a880-e003ef114b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:41.341037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62de739-b458-4540-813c-8a669352af8a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:41.342295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848246b-7297-44a2-a880-e003ef114b0b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:41.432030 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 808/1612] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:19:41 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:41.433359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e487e-8670-4aff-be7c-91fee04f57af None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:41.433667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e487e-8670-4aff-be7c-91fee04f57af None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:41.433948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e487e-8670-4aff-be7c-91fee04f57af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:41.450310 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 805/1613] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:19:41 2022] POST /identity/v3/projects => generated 389 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:41.451308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848246b-7297-44a2-a880-e003ef114b0b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:41.463503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5e3e487e-8670-4aff-be7c-91fee04f57af None None] MFA Rules not processed for user `736ee9ad940b4ca991cfcb3318e18824`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:41.464879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5e3e487e-8670-4aff-be7c-91fee04f57af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:41.521361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848246b-7297-44a2-a880-e003ef114b0b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:41.526593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfb902-68a7-4ae3-8730-8db1ccda2e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:41.527717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfb902-68a7-4ae3-8730-8db1ccda2e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:41.528380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfb902-68a7-4ae3-8730-8db1ccda2e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:41.528649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfb902-68a7-4ae3-8730-8db1ccda2e83 admin admin] PATH_INFO: `/v3/projects/70d574d8a811442aaddf440bc481dcad/users/53920c0016c54ca2a94f89f4d323c34c/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:41.532328 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 809/1614] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:41.532764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e487e-8670-4aff-be7c-91fee04f57af None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:41.543840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e487e-8670-4aff-be7c-91fee04f57af None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:41.547686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfb902-68a7-4ae3-8730-8db1ccda2e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d574d8a811442aaddf440bc481dcad, user_id=53920c0016c54ca2a94f89f4d323c34c, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:41.549262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57331e-74b1-4665-9e56-ad0eac513031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:41.549926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57331e-74b1-4665-9e56-ad0eac513031 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:41.550212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57331e-74b1-4665-9e56-ad0eac513031 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:41.550496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57331e-74b1-4665-9e56-ad0eac513031 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:41.550674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfb902-68a7-4ae3-8730-8db1ccda2e83 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:41.551283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57331e-74b1-4665-9e56-ad0eac513031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:41.553253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57331e-74b1-4665-9e56-ad0eac513031 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:41.648550 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 806/1615] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:41 2022] PUT /identity/v3/projects/70d574d8a811442aaddf440bc481dcad/users/53920c0016c54ca2a94f89f4d323c34c/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:41.649444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfb902-68a7-4ae3-8730-8db1ccda2e83 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:41.682613 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 810/1616] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:19:41 2022] POST /identity/v3/projects => generated 397 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:41.682613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57331e-74b1-4665-9e56-ad0eac513031 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:41.710369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfb902-68a7-4ae3-8730-8db1ccda2e83 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:41.749009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57331e-74b1-4665-9e56-ad0eac513031 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:41.754256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a69e1-83c9-4ccd-b1c1-37cdac81ecc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:41.755141 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a69e1-83c9-4ccd-b1c1-37cdac81ecc5 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:41.755701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a69e1-83c9-4ccd-b1c1-37cdac81ecc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:41.755806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a69e1-83c9-4ccd-b1c1-37cdac81ecc5 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:41.756517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a69e1-83c9-4ccd-b1c1-37cdac81ecc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:41.758601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a69e1-83c9-4ccd-b1c1-37cdac81ecc5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:41.767328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99be8e8-76e3-4a2e-988e-fcf710ec84d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:41.768008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99be8e8-76e3-4a2e-988e-fcf710ec84d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:41.768297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99be8e8-76e3-4a2e-988e-fcf710ec84d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:41.768580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99be8e8-76e3-4a2e-988e-fcf710ec84d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:41.769341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99be8e8-76e3-4a2e-988e-fcf710ec84d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:41.770949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99be8e8-76e3-4a2e-988e-fcf710ec84d3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:41.781839 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 807/1617] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:41.782679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99be8e8-76e3-4a2e-988e-fcf710ec84d3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:41.792769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99be8e8-76e3-4a2e-988e-fcf710ec84d3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:41.797428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60199a1d-b077-4260-9558-0a9ea94ccdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:41.798059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60199a1d-b077-4260-9558-0a9ea94ccdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:41.798347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60199a1d-b077-4260-9558-0a9ea94ccdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:41.798629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60199a1d-b077-4260-9558-0a9ea94ccdf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:41.799337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60199a1d-b077-4260-9558-0a9ea94ccdf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:41.800957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60199a1d-b077-4260-9558-0a9ea94ccdf0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:41.810319 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 808/1618] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:41.811055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60199a1d-b077-4260-9558-0a9ea94ccdf0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:41.820941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60199a1d-b077-4260-9558-0a9ea94ccdf0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:41.825527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1a341-bde1-4ef4-b5b6-8356eb11c26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:41.826124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1a341-bde1-4ef4-b5b6-8356eb11c26d admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:41.826411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1a341-bde1-4ef4-b5b6-8356eb11c26d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:41.826696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1a341-bde1-4ef4-b5b6-8356eb11c26d admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:41.827354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1a341-bde1-4ef4-b5b6-8356eb11c26d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:41.829243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1a341-bde1-4ef4-b5b6-8356eb11c26d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:41.865467 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 811/1619] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:19:41 2022] POST /identity/v3/users => generated 296 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:41.866303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a69e1-83c9-4ccd-b1c1-37cdac81ecc5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:41.875870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a69e1-83c9-4ccd-b1c1-37cdac81ecc5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:41.880422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a084b1-a4ed-4707-9b89-183bc55790e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:41.881114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a084b1-a4ed-4707-9b89-183bc55790e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:41.881397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a084b1-a4ed-4707-9b89-183bc55790e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:41.890922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a084b1-a4ed-4707-9b89-183bc55790e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:41.890922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a084b1-a4ed-4707-9b89-183bc55790e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:41.890922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a084b1-a4ed-4707-9b89-183bc55790e2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:41.967227 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 809/1620] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:19:41 2022] POST /identity/v3/users => generated 301 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:41.968223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1a341-bde1-4ef4-b5b6-8356eb11c26d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:41.977801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1a341-bde1-4ef4-b5b6-8356eb11c26d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:41.983097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010024c1-44df-4974-8a3c-35d5537a2c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:41.983808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010024c1-44df-4974-8a3c-35d5537a2c48 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:41.984109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010024c1-44df-4974-8a3c-35d5537a2c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:41.984392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010024c1-44df-4974-8a3c-35d5537a2c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:41.985149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010024c1-44df-4974-8a3c-35d5537a2c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:41.987456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010024c1-44df-4974-8a3c-35d5537a2c48 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:41.997963 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 812/1621] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:19:41 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:41.997963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a084b1-a4ed-4707-9b89-183bc55790e2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:42.005814 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 810/1622] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:42.005814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010024c1-44df-4974-8a3c-35d5537a2c48 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:42.014351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010024c1-44df-4974-8a3c-35d5537a2c48 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:42.059120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a084b1-a4ed-4707-9b89-183bc55790e2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:42.064313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31fa62-875b-4c4f-82c5-575ce4ef048e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:42.065242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31fa62-875b-4c4f-82c5-575ce4ef048e admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:42.065618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31fa62-875b-4c4f-82c5-575ce4ef048e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:42.065900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31fa62-875b-4c4f-82c5-575ce4ef048e admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:42.066716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31fa62-875b-4c4f-82c5-575ce4ef048e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:42.068680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31fa62-875b-4c4f-82c5-575ce4ef048e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:42.072405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff184d-fa22-4214-8751-5c80948ff153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:42.073976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff184d-fa22-4214-8751-5c80948ff153 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:42.074266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff184d-fa22-4214-8751-5c80948ff153 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:42.074555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff184d-fa22-4214-8751-5c80948ff153 admin admin] PATH_INFO: `/v3/projects/11610c2f22414a8fb76d9adcaee4b57b/users/96f46ef818c04b4491a3795ed08c92ac/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:42.091169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff184d-fa22-4214-8751-5c80948ff153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11610c2f22414a8fb76d9adcaee4b57b, user_id=96f46ef818c04b4491a3795ed08c92ac, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:42.102377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff184d-fa22-4214-8751-5c80948ff153 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:42.151970 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 813/1623] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:19:41 2022] POST /identity/v3/users => generated 305 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:42.153092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31fa62-875b-4c4f-82c5-575ce4ef048e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:42.162798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31fa62-875b-4c4f-82c5-575ce4ef048e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:42.168173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b50068-6850-409b-87eb-d76e9696d9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:42.169211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b50068-6850-409b-87eb-d76e9696d9a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:42.169494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b50068-6850-409b-87eb-d76e9696d9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:42.169770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b50068-6850-409b-87eb-d76e9696d9a0 admin admin] PATH_INFO: `/v3/projects/59c5107bd5e0494cba2ca57013dacd65/users/ef9ff664d81042a8a0f807261f3d2984/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:42.177347 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 811/1624] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:42 2022] PUT /identity/v3/projects/11610c2f22414a8fb76d9adcaee4b57b/users/96f46ef818c04b4491a3795ed08c92ac/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:42.177347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff184d-fa22-4214-8751-5c80948ff153 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:42.186258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b50068-6850-409b-87eb-d76e9696d9a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c5107bd5e0494cba2ca57013dacd65, user_id=ef9ff664d81042a8a0f807261f3d2984, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:42.189204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b50068-6850-409b-87eb-d76e9696d9a0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:42.237329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff184d-fa22-4214-8751-5c80948ff153 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:42.242155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e4835-f407-48fa-b43a-8ad40146ce9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:42.242828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e4835-f407-48fa-b43a-8ad40146ce9d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:42.243115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e4835-f407-48fa-b43a-8ad40146ce9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:42.243482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e4835-f407-48fa-b43a-8ad40146ce9d admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:42.244250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e4835-f407-48fa-b43a-8ad40146ce9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:42.246183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e4835-f407-48fa-b43a-8ad40146ce9d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:42.255927 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 812/1625] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:42.256556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e4835-f407-48fa-b43a-8ad40146ce9d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:42.260502 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 814/1626] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:42 2022] PUT /identity/v3/projects/59c5107bd5e0494cba2ca57013dacd65/users/ef9ff664d81042a8a0f807261f3d2984/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:42.261393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b50068-6850-409b-87eb-d76e9696d9a0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:42.267174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e4835-f407-48fa-b43a-8ad40146ce9d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:42.320165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d056f2-49cf-4b4d-965c-5607facc527d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:42.320861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d056f2-49cf-4b4d-965c-5607facc527d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:42.321010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b50068-6850-409b-87eb-d76e9696d9a0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:42.321141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d056f2-49cf-4b4d-965c-5607facc527d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:42.321416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d056f2-49cf-4b4d-965c-5607facc527d admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:42.322624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d056f2-49cf-4b4d-965c-5607facc527d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:42.324340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d056f2-49cf-4b4d-965c-5607facc527d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:42.326114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0e712-0ce4-40c0-b112-951829cb9958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:42.326780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0e712-0ce4-40c0-b112-951829cb9958 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:42.327069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0e712-0ce4-40c0-b112-951829cb9958 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:42.327353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0e712-0ce4-40c0-b112-951829cb9958 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:42.328078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0e712-0ce4-40c0-b112-951829cb9958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:42.330105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0e712-0ce4-40c0-b112-951829cb9958 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:42.334074 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 813/1627] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:42.335060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d056f2-49cf-4b4d-965c-5607facc527d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:42.346121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d056f2-49cf-4b4d-965c-5607facc527d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:42.350757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd638647-9036-4d92-a643-0e305167517b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:42.351634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd638647-9036-4d92-a643-0e305167517b admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:42.351916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd638647-9036-4d92-a643-0e305167517b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:42.352193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd638647-9036-4d92-a643-0e305167517b admin admin] PATH_INFO: `/v3/projects/70d574d8a811442aaddf440bc481dcad/users/53920c0016c54ca2a94f89f4d323c34c/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:42.354190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd638647-9036-4d92-a643-0e305167517b admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d574d8a811442aaddf440bc481dcad, user_id=53920c0016c54ca2a94f89f4d323c34c, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:42.356848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd638647-9036-4d92-a643-0e305167517b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:42.367298 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 814/1628] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:42 2022] PUT /identity/v3/projects/70d574d8a811442aaddf440bc481dcad/users/53920c0016c54ca2a94f89f4d323c34c/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:42.368561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa586b6-007b-4eb7-824d-c577306e7289 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:42.368880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa586b6-007b-4eb7-824d-c577306e7289 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:42.369181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa586b6-007b-4eb7-824d-c577306e7289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:42.394776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-efa586b6-007b-4eb7-824d-c577306e7289 None None] MFA Rules not processed for user `662c15e746b84fdbb497d700c9288931`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:42.396111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-efa586b6-007b-4eb7-824d-c577306e7289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:42.396848 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 815/1629] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:19:42 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:42.397698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0e712-0ce4-40c0-b112-951829cb9958 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:42.408982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0e712-0ce4-40c0-b112-951829cb9958 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:42.459984 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 815/1630] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:42.461009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa586b6-007b-4eb7-824d-c577306e7289 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:42.463544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc730c-9c8f-4824-8e15-0f360bc4a6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:42.464221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc730c-9c8f-4824-8e15-0f360bc4a6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:42.464506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc730c-9c8f-4824-8e15-0f360bc4a6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:42.464832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc730c-9c8f-4824-8e15-0f360bc4a6f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:42.465598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc730c-9c8f-4824-8e15-0f360bc4a6f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:42.467253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc730c-9c8f-4824-8e15-0f360bc4a6f6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:42.472034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa586b6-007b-4eb7-824d-c577306e7289 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:42.476820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdd9cb-c471-4a39-b294-dcc7b3c20f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:42.477222 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 816/1631] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:42.477478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdd9cb-c471-4a39-b294-dcc7b3c20f96 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:42.477758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdd9cb-c471-4a39-b294-dcc7b3c20f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:42.478034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc730c-9c8f-4824-8e15-0f360bc4a6f6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:42.478108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdd9cb-c471-4a39-b294-dcc7b3c20f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:42.478787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdd9cb-c471-4a39-b294-dcc7b3c20f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:42.480541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdd9cb-c471-4a39-b294-dcc7b3c20f96 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:42.487427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc730c-9c8f-4824-8e15-0f360bc4a6f6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:42.493229 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 816/1632] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:42.493229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdd9cb-c471-4a39-b294-dcc7b3c20f96 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:42.493953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab190acb-6475-4d6a-aeae-564f3fb8205d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:42.493953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab190acb-6475-4d6a-aeae-564f3fb8205d admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:42.494204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab190acb-6475-4d6a-aeae-564f3fb8205d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:42.494482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab190acb-6475-4d6a-aeae-564f3fb8205d admin admin] PATH_INFO: `/v3/projects/56e5494cea8543dbbef0c5ca3fcd74ae/users/dd3d42b8634e47b98874e94f86c18468/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:42.501305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdd9cb-c471-4a39-b294-dcc7b3c20f96 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:42.506015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144b570-c8ff-4b90-bf73-22856b716624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:42.506750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144b570-c8ff-4b90-bf73-22856b716624 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:42.507153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144b570-c8ff-4b90-bf73-22856b716624 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:42.507409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144b570-c8ff-4b90-bf73-22856b716624 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:42.508120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144b570-c8ff-4b90-bf73-22856b716624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:42.508900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab190acb-6475-4d6a-aeae-564f3fb8205d admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e5494cea8543dbbef0c5ca3fcd74ae, user_id=dd3d42b8634e47b98874e94f86c18468, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:42.510326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144b570-c8ff-4b90-bf73-22856b716624 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:42.512162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab190acb-6475-4d6a-aeae-564f3fb8205d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:42.519968 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 817/1633] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:42.520854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144b570-c8ff-4b90-bf73-22856b716624 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:42.530259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144b570-c8ff-4b90-bf73-22856b716624 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:42.534886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee97cba-179d-482b-ba5f-c8a5058d3a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:42.535742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee97cba-179d-482b-ba5f-c8a5058d3a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:42.536030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee97cba-179d-482b-ba5f-c8a5058d3a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:42.536423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee97cba-179d-482b-ba5f-c8a5058d3a74 admin admin] PATH_INFO: `/v3/projects/dd84716a779541589ad60a7563a191de/users/a19ecd201b7f455e9a664b4ee16297ab/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:42.551238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee97cba-179d-482b-ba5f-c8a5058d3a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd84716a779541589ad60a7563a191de, user_id=a19ecd201b7f455e9a664b4ee16297ab, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:42.553957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee97cba-179d-482b-ba5f-c8a5058d3a74 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:42.608275 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 817/1634] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:42 2022] PUT /identity/v3/projects/56e5494cea8543dbbef0c5ca3fcd74ae/users/dd3d42b8634e47b98874e94f86c18468/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:42.611163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b28e99-4dea-4789-a0f0-dcd207e86716 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:42.611163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b28e99-4dea-4789-a0f0-dcd207e86716 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:42.611163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b28e99-4dea-4789-a0f0-dcd207e86716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:42.636026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d0b28e99-4dea-4789-a0f0-dcd207e86716 None None] MFA Rules not processed for user `53920c0016c54ca2a94f89f4d323c34c`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:42.637260 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 818/1635] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:42 2022] PUT /identity/v3/projects/dd84716a779541589ad60a7563a191de/users/a19ecd201b7f455e9a664b4ee16297ab/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:42.640093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d0b28e99-4dea-4789-a0f0-dcd207e86716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:42.640194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee97cba-179d-482b-ba5f-c8a5058d3a74 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:42.698840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee97cba-179d-482b-ba5f-c8a5058d3a74 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:42.702603 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 818/1636] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:42.703418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b28e99-4dea-4789-a0f0-dcd207e86716 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:42.703675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8025c-0d10-4c20-b07c-d22b14f5b839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:42.704487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8025c-0d10-4c20-b07c-d22b14f5b839 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:42.704804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8025c-0d10-4c20-b07c-d22b14f5b839 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:42.705083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8025c-0d10-4c20-b07c-d22b14f5b839 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:42.705814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8025c-0d10-4c20-b07c-d22b14f5b839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:42.707402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8025c-0d10-4c20-b07c-d22b14f5b839 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:42.715287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b28e99-4dea-4789-a0f0-dcd207e86716 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:42.720392 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 819/1637] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:42.720392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8025c-0d10-4c20-b07c-d22b14f5b839 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:42.723755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e50c46-3724-4ab1-8d7a-058316616bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:42.724420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e50c46-3724-4ab1-8d7a-058316616bec admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:42.724727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e50c46-3724-4ab1-8d7a-058316616bec admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:42.725006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e50c46-3724-4ab1-8d7a-058316616bec admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:42.725698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e50c46-3724-4ab1-8d7a-058316616bec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:42.727607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e50c46-3724-4ab1-8d7a-058316616bec admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:42.730305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8025c-0d10-4c20-b07c-d22b14f5b839 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:42.734864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9d5f4-01a3-489b-8628-b3ce4f818e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:42.735732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9d5f4-01a3-489b-8628-b3ce4f818e4d admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:42.736017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9d5f4-01a3-489b-8628-b3ce4f818e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:42.736295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9d5f4-01a3-489b-8628-b3ce4f818e4d admin admin] PATH_INFO: `/v3/projects/ddd294662f0f49c4b29f7549822cc68f/users/fc8b563ca0634e31b9f04a979fcc5218/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:42.755162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9d5f4-01a3-489b-8628-b3ce4f818e4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddd294662f0f49c4b29f7549822cc68f, user_id=fc8b563ca0634e31b9f04a979fcc5218, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:42.755162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9d5f4-01a3-489b-8628-b3ce4f818e4d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:42.856635 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 819/1638] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:19:42 2022] POST /identity/v3/projects => generated 395 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:42.857650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e50c46-3724-4ab1-8d7a-058316616bec admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:42.875616 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 820/1639] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:42 2022] PUT /identity/v3/projects/ddd294662f0f49c4b29f7549822cc68f/users/fc8b563ca0634e31b9f04a979fcc5218/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:42.876547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9d5f4-01a3-489b-8628-b3ce4f818e4d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:42.918805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e50c46-3724-4ab1-8d7a-058316616bec admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:42.935794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9d5f4-01a3-489b-8628-b3ce4f818e4d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:42.940468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b8490-f06b-47ac-bfbb-a6c5e34fd1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:42.941386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b8490-f06b-47ac-bfbb-a6c5e34fd1cb admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:42.941718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b8490-f06b-47ac-bfbb-a6c5e34fd1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:42.947519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b8490-f06b-47ac-bfbb-a6c5e34fd1cb admin admin] PATH_INFO: `/v3/projects/59c5107bd5e0494cba2ca57013dacd65/users/ef9ff664d81042a8a0f807261f3d2984/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:42.947519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b8490-f06b-47ac-bfbb-a6c5e34fd1cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c5107bd5e0494cba2ca57013dacd65, user_id=ef9ff664d81042a8a0f807261f3d2984, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:42.947519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b8490-f06b-47ac-bfbb-a6c5e34fd1cb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:42.956900 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 821/1640] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:42 2022] PUT /identity/v3/projects/59c5107bd5e0494cba2ca57013dacd65/users/ef9ff664d81042a8a0f807261f3d2984/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:42.957786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b8490-f06b-47ac-bfbb-a6c5e34fd1cb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:42.974852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26900334-8568-4485-8168-2664ec5c1546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:42.975773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26900334-8568-4485-8168-2664ec5c1546 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:42.976097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26900334-8568-4485-8168-2664ec5c1546 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:42.976353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26900334-8568-4485-8168-2664ec5c1546 admin admin] PATH_INFO: `/v3/projects/11610c2f22414a8fb76d9adcaee4b57b/users/96f46ef818c04b4491a3795ed08c92ac/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:42.978997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26900334-8568-4485-8168-2664ec5c1546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11610c2f22414a8fb76d9adcaee4b57b, user_id=96f46ef818c04b4491a3795ed08c92ac, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:42.981710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26900334-8568-4485-8168-2664ec5c1546 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:42.991570 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 820/1641] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:42 2022] PUT /identity/v3/projects/11610c2f22414a8fb76d9adcaee4b57b/users/96f46ef818c04b4491a3795ed08c92ac/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:42.992355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26900334-8568-4485-8168-2664ec5c1546 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:43.031945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b8490-f06b-47ac-bfbb-a6c5e34fd1cb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:43.051814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26900334-8568-4485-8168-2664ec5c1546 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:43.057187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4fea3-3566-4399-b976-a37748ceb407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:43.057844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4fea3-3566-4399-b976-a37748ceb407 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:43.058129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4fea3-3566-4399-b976-a37748ceb407 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:43.058406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4fea3-3566-4399-b976-a37748ceb407 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:43.059124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4fea3-3566-4399-b976-a37748ceb407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:43.060783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4fea3-3566-4399-b976-a37748ceb407 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:43.070877 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 821/1642] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:43.072088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a577f45-4753-4090-ab6b-77fc97faa28d None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:43.072379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a577f45-4753-4090-ab6b-77fc97faa28d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:43.072681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a577f45-4753-4090-ab6b-77fc97faa28d None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:43.074095 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 822/1643] 10.222.0.16 () {54 vars in 960 bytes} [Mon May 2 10:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:19:43.074625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a577f45-4753-4090-ab6b-77fc97faa28d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:43.086615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a577f45-4753-4090-ab6b-77fc97faa28d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:43.089282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc1422-c535-403f-986a-57cafc72f673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:43.089953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc1422-c535-403f-986a-57cafc72f673 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:43.090237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc1422-c535-403f-986a-57cafc72f673 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:43.090515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc1422-c535-403f-986a-57cafc72f673 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:43.091166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb74cba-1321-43cf-ba32-b28b7e710751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:43.091283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc1422-c535-403f-986a-57cafc72f673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:43.092183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb74cba-1321-43cf-ba32-b28b7e710751 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:43.092474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb74cba-1321-43cf-ba32-b28b7e710751 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:43.092786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb74cba-1321-43cf-ba32-b28b7e710751 admin admin] PATH_INFO: `/v3/projects/f6e66dc3240b4a42b43403096b218fe8/users/2f267a1dd21a4676bfbad106f83cf4a8/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:43.092881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc1422-c535-403f-986a-57cafc72f673 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:43.102649 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 822/1644] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:43.104106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc1422-c535-403f-986a-57cafc72f673 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:43.110777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb74cba-1321-43cf-ba32-b28b7e710751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e66dc3240b4a42b43403096b218fe8, user_id=2f267a1dd21a4676bfbad106f83cf4a8, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:43.113503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb74cba-1321-43cf-ba32-b28b7e710751 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:43.113920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc1422-c535-403f-986a-57cafc72f673 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:43.119188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615306be-1ae7-41a3-b6b7-4f7c274df639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:43.119842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615306be-1ae7-41a3-b6b7-4f7c274df639 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:43.120128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615306be-1ae7-41a3-b6b7-4f7c274df639 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:43.120402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615306be-1ae7-41a3-b6b7-4f7c274df639 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:43.121398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615306be-1ae7-41a3-b6b7-4f7c274df639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:43.123277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615306be-1ae7-41a3-b6b7-4f7c274df639 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:43.223514 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 823/1645] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:43 2022] PUT /identity/v3/projects/f6e66dc3240b4a42b43403096b218fe8/users/2f267a1dd21a4676bfbad106f83cf4a8/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:43.224332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb74cba-1321-43cf-ba32-b28b7e710751 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:43.235253 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 823/1646] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:19:43 2022] POST /identity/v3/users => generated 304 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:43.236586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b4160-eb6a-4a48-98fa-7cde6a95b4c3 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:43.236908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b4160-eb6a-4a48-98fa-7cde6a95b4c3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:43.237185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b4160-eb6a-4a48-98fa-7cde6a95b4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:43.262734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3a2b4160-eb6a-4a48-98fa-7cde6a95b4c3 None None] MFA Rules not processed for user `ef9ff664d81042a8a0f807261f3d2984`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:43.264395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3a2b4160-eb6a-4a48-98fa-7cde6a95b4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:43.284194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb74cba-1321-43cf-ba32-b28b7e710751 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:43.288904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd939e-878f-442b-a0f5-09a18dc39449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:43.289578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd939e-878f-442b-a0f5-09a18dc39449 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:43.289901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd939e-878f-442b-a0f5-09a18dc39449 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:43.290179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd939e-878f-442b-a0f5-09a18dc39449 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:43.291521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd939e-878f-442b-a0f5-09a18dc39449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:43.293153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd939e-878f-442b-a0f5-09a18dc39449 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:43.302650 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 824/1647] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:43.303856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71be16-b8da-4e85-9802-7bd9e01cc64a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:43.304148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71be16-b8da-4e85-9802-7bd9e01cc64a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:43.304433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71be16-b8da-4e85-9802-7bd9e01cc64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:43.329817 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 824/1648] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:43.330787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b4160-eb6a-4a48-98fa-7cde6a95b4c3 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:43.332317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7c71be16-b8da-4e85-9802-7bd9e01cc64a None None] MFA Rules not processed for user `96f46ef818c04b4491a3795ed08c92ac`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:43.333590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7c71be16-b8da-4e85-9802-7bd9e01cc64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:43.341336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b4160-eb6a-4a48-98fa-7cde6a95b4c3 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:43.346100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f1fdd-c445-40a3-ae2a-3af869fec83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:43.347000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f1fdd-c445-40a3-ae2a-3af869fec83f admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:43.347283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f1fdd-c445-40a3-ae2a-3af869fec83f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:43.347557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f1fdd-c445-40a3-ae2a-3af869fec83f admin admin] PATH_INFO: `/v3/projects/dd84716a779541589ad60a7563a191de/users/a19ecd201b7f455e9a664b4ee16297ab/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:43.349599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f1fdd-c445-40a3-ae2a-3af869fec83f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd84716a779541589ad60a7563a191de, user_id=a19ecd201b7f455e9a664b4ee16297ab, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:43.352431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f1fdd-c445-40a3-ae2a-3af869fec83f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:43.363386 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 825/1649] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:43 2022] PUT /identity/v3/projects/dd84716a779541589ad60a7563a191de/users/a19ecd201b7f455e9a664b4ee16297ab/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:43.364626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdd0e4-9d91-4b58-b76b-083bed38f43d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:43.364928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdd0e4-9d91-4b58-b76b-083bed38f43d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:43.365202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdd0e4-9d91-4b58-b76b-083bed38f43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:43.403684 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 825/1650] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:43.404508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71be16-b8da-4e85-9802-7bd9e01cc64a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:43.414098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71be16-b8da-4e85-9802-7bd9e01cc64a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:43.423650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-26bdd0e4-9d91-4b58-b76b-083bed38f43d None None] MFA Rules not processed for user `e6036dd39fb74289a8cbdcd6a21f8662`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:43.424958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-26bdd0e4-9d91-4b58-b76b-083bed38f43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:43.470950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56ca51-cc86-4078-83bc-4139fec62c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:43.472221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56ca51-cc86-4078-83bc-4139fec62c3c admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:43.472524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56ca51-cc86-4078-83bc-4139fec62c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:43.472862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56ca51-cc86-4078-83bc-4139fec62c3c admin admin] PATH_INFO: `/v3/projects/56e5494cea8543dbbef0c5ca3fcd74ae/users/dd3d42b8634e47b98874e94f86c18468/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:43.475017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56ca51-cc86-4078-83bc-4139fec62c3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e5494cea8543dbbef0c5ca3fcd74ae, user_id=dd3d42b8634e47b98874e94f86c18468, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:43.477737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56ca51-cc86-4078-83bc-4139fec62c3c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:43.488191 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 826/1651] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:43 2022] PUT /identity/v3/projects/56e5494cea8543dbbef0c5ca3fcd74ae/users/dd3d42b8634e47b98874e94f86c18468/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:43.488933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56ca51-cc86-4078-83bc-4139fec62c3c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:43.507116 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 826/1652] 10.222.0.16 () {58 vars in 1057 bytes} [Mon May 2 10:19:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:43.508019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdd0e4-9d91-4b58-b76b-083bed38f43d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:43.517919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdd0e4-9d91-4b58-b76b-083bed38f43d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:43.548725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56ca51-cc86-4078-83bc-4139fec62c3c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:43.553403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb4804-6d42-4c88-ad1d-0aab2da341a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:43.557046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb4804-6d42-4c88-ad1d-0aab2da341a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:43.557046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb4804-6d42-4c88-ad1d-0aab2da341a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:43.557046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb4804-6d42-4c88-ad1d-0aab2da341a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:43.557046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb4804-6d42-4c88-ad1d-0aab2da341a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:43.557046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb4804-6d42-4c88-ad1d-0aab2da341a2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:43.566606 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 827/1653] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:43.567375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb4804-6d42-4c88-ad1d-0aab2da341a2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:43.573056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00309809-ff80-4229-b588-105f6d80e683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:43.573725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00309809-ff80-4229-b588-105f6d80e683 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:43.574007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00309809-ff80-4229-b588-105f6d80e683 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:43.574309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00309809-ff80-4229-b588-105f6d80e683 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:43.575007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00309809-ff80-4229-b588-105f6d80e683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:43.576576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb4804-6d42-4c88-ad1d-0aab2da341a2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:43.576691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00309809-ff80-4229-b588-105f6d80e683 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:43.581143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70dfcc-ebdc-4cad-b1b1-976a3599392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:43.582002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70dfcc-ebdc-4cad-b1b1-976a3599392a admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:43.582288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70dfcc-ebdc-4cad-b1b1-976a3599392a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:43.582563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70dfcc-ebdc-4cad-b1b1-976a3599392a admin admin] PATH_INFO: `/v3/projects/ddd294662f0f49c4b29f7549822cc68f/users/fc8b563ca0634e31b9f04a979fcc5218/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:43.584461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70dfcc-ebdc-4cad-b1b1-976a3599392a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddd294662f0f49c4b29f7549822cc68f, user_id=fc8b563ca0634e31b9f04a979fcc5218, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:43.586113 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 827/1654] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:43.587102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70dfcc-ebdc-4cad-b1b1-976a3599392a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:43.587943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1068920-fe76-451f-b26a-27950e1b6b6d None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:43.588227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1068920-fe76-451f-b26a-27950e1b6b6d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:43.588505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1068920-fe76-451f-b26a-27950e1b6b6d None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:43.590204 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 828/1655] 10.222.0.16 () {54 vars in 960 bytes} [Mon May 2 10:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:19:43.591267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e9ca-8f41-457a-bca6-23fc2c06bace None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:43.591614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e9ca-8f41-457a-bca6-23fc2c06bace None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:43.591896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e9ca-8f41-457a-bca6-23fc2c06bace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:43.598558 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 828/1656] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:43 2022] PUT /identity/v3/projects/ddd294662f0f49c4b29f7549822cc68f/users/fc8b563ca0634e31b9f04a979fcc5218/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:43.599780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5766ac-c564-49ec-a587-1e387835e7a0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:43.600065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5766ac-c564-49ec-a587-1e387835e7a0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:43.600396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5766ac-c564-49ec-a587-1e387835e7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:43.617986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3500e9ca-8f41-457a-bca6-23fc2c06bace None None] MFA Rules not processed for user `a19ecd201b7f455e9a664b4ee16297ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:43.619237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3500e9ca-8f41-457a-bca6-23fc2c06bace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:43.626017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ef5766ac-c564-49ec-a587-1e387835e7a0 None None] MFA Rules not processed for user `dd3d42b8634e47b98874e94f86c18468`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:43.627183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ef5766ac-c564-49ec-a587-1e387835e7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:43.686132 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 829/1657] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:43.686798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500e9ca-8f41-457a-bca6-23fc2c06bace None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:43.691763 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 829/1658] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:43.692636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5766ac-c564-49ec-a587-1e387835e7a0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:43.751465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5766ac-c564-49ec-a587-1e387835e7a0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:43.756156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c74956-42e5-4e5c-aa46-af635dde8e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:43.756394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500e9ca-8f41-457a-bca6-23fc2c06bace None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:43.757089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c74956-42e5-4e5c-aa46-af635dde8e38 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:43.757381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c74956-42e5-4e5c-aa46-af635dde8e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:43.757659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c74956-42e5-4e5c-aa46-af635dde8e38 admin admin] PATH_INFO: `/v3/projects/f6e66dc3240b4a42b43403096b218fe8/users/2f267a1dd21a4676bfbad106f83cf4a8/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:43.760104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c74956-42e5-4e5c-aa46-af635dde8e38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e66dc3240b4a42b43403096b218fe8, user_id=2f267a1dd21a4676bfbad106f83cf4a8, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:43.762552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa30c1-75d7-4c78-81a8-6d0bd71f60d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:43.762915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c74956-42e5-4e5c-aa46-af635dde8e38 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:43.763187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa30c1-75d7-4c78-81a8-6d0bd71f60d5 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:43.763477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa30c1-75d7-4c78-81a8-6d0bd71f60d5 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:43.763762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa30c1-75d7-4c78-81a8-6d0bd71f60d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:43.783566 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 830/1659] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:43 2022] PUT /identity/v3/projects/f6e66dc3240b4a42b43403096b218fe8/users/2f267a1dd21a4676bfbad106f83cf4a8/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:43.783566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c74956-42e5-4e5c-aa46-af635dde8e38 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:43.823066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa30c1-75d7-4c78-81a8-6d0bd71f60d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:43.824589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa30c1-75d7-4c78-81a8-6d0bd71f60d5 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:43.834254 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 830/1660] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:19:43.835462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c74956-42e5-4e5c-aa46-af635dde8e38 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:43.835574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ef7c2-4e65-4503-8f82-a7f9607a6e68 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:43.835795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ef7c2-4e65-4503-8f82-a7f9607a6e68 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:43.836084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ef7c2-4e65-4503-8f82-a7f9607a6e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:43.845343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a6d1d-d56c-4da6-b4c8-95d5a97f7aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:43.846451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a6d1d-d56c-4da6-b4c8-95d5a97f7aa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:43.846746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a6d1d-d56c-4da6-b4c8-95d5a97f7aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:43.847020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a6d1d-d56c-4da6-b4c8-95d5a97f7aa7 admin admin] PATH_INFO: `/v3/projects/20384e7e9a0144bf8bb2b9d57290b02c/users/b11bbdc7eb564d049ad4220b168b48bc/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:43.854792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c40ef7c2-4e65-4503-8f82-a7f9607a6e68 None None] MFA Rules not processed for user `e6036dd39fb74289a8cbdcd6a21f8662`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:43.856010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c40ef7c2-4e65-4503-8f82-a7f9607a6e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:43.861222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a6d1d-d56c-4da6-b4c8-95d5a97f7aa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20384e7e9a0144bf8bb2b9d57290b02c, user_id=b11bbdc7eb564d049ad4220b168b48bc, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:43.864002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a6d1d-d56c-4da6-b4c8-95d5a97f7aa7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:43.921806 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 831/1661] 10.222.0.16 () {58 vars in 1057 bytes} [Mon May 2 10:19:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:43.923379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c49d2-f1f1-413b-9926-546d6610e338 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:43.923857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c49d2-f1f1-413b-9926-546d6610e338 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:43.924313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c49d2-f1f1-413b-9926-546d6610e338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:43.928038 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 831/1662] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:43 2022] PUT /identity/v3/projects/20384e7e9a0144bf8bb2b9d57290b02c/users/b11bbdc7eb564d049ad4220b168b48bc/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:43.930492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87379a9-5787-4e1e-9ae4-4ae782629c01 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:43.930492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87379a9-5787-4e1e-9ae4-4ae782629c01 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:43.930492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87379a9-5787-4e1e-9ae4-4ae782629c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:43.954179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ff8c49d2-f1f1-413b-9926-546d6610e338 None None] MFA Rules not processed for user `fc8b563ca0634e31b9f04a979fcc5218`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:43.955409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ff8c49d2-f1f1-413b-9926-546d6610e338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:43.957838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d87379a9-5787-4e1e-9ae4-4ae782629c01 None None] MFA Rules not processed for user `625d2d9692cd4191afa8cb7d4c82a74d`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:43.957838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d87379a9-5787-4e1e-9ae4-4ae782629c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:44.014306 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 832/1663] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:44.015415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d64471-295e-432f-9a67-abe4c69709f1 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:44.015711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d64471-295e-432f-9a67-abe4c69709f1 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:44.015997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d64471-295e-432f-9a67-abe4c69709f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:44.028230 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 832/1664] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:44.029374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c49d2-f1f1-413b-9926-546d6610e338 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:44.043397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c6d64471-295e-432f-9a67-abe4c69709f1 None None] MFA Rules not processed for user `2f267a1dd21a4676bfbad106f83cf4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:44.044744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c6d64471-295e-432f-9a67-abe4c69709f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:44.102433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c49d2-f1f1-413b-9926-546d6610e338 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:44.108408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434cb79-9cad-4ccb-a6fe-82b94a43f859 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:44.109102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434cb79-9cad-4ccb-a6fe-82b94a43f859 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:44.109388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434cb79-9cad-4ccb-a6fe-82b94a43f859 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:44.109671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434cb79-9cad-4ccb-a6fe-82b94a43f859 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:44.124517 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 833/1665] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:44 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:44.125394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d64471-295e-432f-9a67-abe4c69709f1 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:44.176875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434cb79-9cad-4ccb-a6fe-82b94a43f859 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:44.178456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434cb79-9cad-4ccb-a6fe-82b94a43f859 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:44.187711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d64471-295e-432f-9a67-abe4c69709f1 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:44.188415 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 833/1666] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:19:44.189298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434cb79-9cad-4ccb-a6fe-82b94a43f859 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:44.197332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbe5e3-1892-4e30-bdf1-01fc183a73cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:44.198384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbe5e3-1892-4e30-bdf1-01fc183a73cb admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:44.198670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbe5e3-1892-4e30-bdf1-01fc183a73cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:44.198946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbe5e3-1892-4e30-bdf1-01fc183a73cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:44.199989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbe5e3-1892-4e30-bdf1-01fc183a73cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:44.200433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434cb79-9cad-4ccb-a6fe-82b94a43f859 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:44.201766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbe5e3-1892-4e30-bdf1-01fc183a73cb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:44.206442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82534b25-7262-442a-969c-57a64e2b3b06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:44.207083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82534b25-7262-442a-969c-57a64e2b3b06 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:44.207372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82534b25-7262-442a-969c-57a64e2b3b06 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:44.207655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82534b25-7262-442a-969c-57a64e2b3b06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:44.212427 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 834/1667] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:44.216294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbe5e3-1892-4e30-bdf1-01fc183a73cb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:44.225610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbe5e3-1892-4e30-bdf1-01fc183a73cb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:44.230280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb1a58-ee90-4636-80cc-bcd7e62c1eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:44.231157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb1a58-ee90-4636-80cc-bcd7e62c1eb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:44.231448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb1a58-ee90-4636-80cc-bcd7e62c1eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:44.231730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb1a58-ee90-4636-80cc-bcd7e62c1eb0 admin admin] PATH_INFO: `/v3/projects/20384e7e9a0144bf8bb2b9d57290b02c/users/b11bbdc7eb564d049ad4220b168b48bc/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:44.233737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb1a58-ee90-4636-80cc-bcd7e62c1eb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20384e7e9a0144bf8bb2b9d57290b02c, user_id=b11bbdc7eb564d049ad4220b168b48bc, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:44.236415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb1a58-ee90-4636-80cc-bcd7e62c1eb0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:44.247861 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 835/1668] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:44 2022] PUT /identity/v3/projects/20384e7e9a0144bf8bb2b9d57290b02c/users/b11bbdc7eb564d049ad4220b168b48bc/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:19:44.265980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82534b25-7262-442a-969c-57a64e2b3b06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:44.267581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82534b25-7262-442a-969c-57a64e2b3b06 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:44.277043 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 834/1669] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:19:44.293319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb1a58-ee90-4636-80cc-bcd7e62c1eb0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:44.297835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82534b25-7262-442a-969c-57a64e2b3b06 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:44.308546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82534b25-7262-442a-969c-57a64e2b3b06 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:44.367568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2b895-927b-458f-b913-24c3d3da49b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:44.369159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2b895-927b-458f-b913-24c3d3da49b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:44.369514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2b895-927b-458f-b913-24c3d3da49b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:44.370057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2b895-927b-458f-b913-24c3d3da49b4 admin admin] PATH_INFO: `/v3/users/3e26ea8189f44cbfb6a8b395232ec6f1` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:44.371737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2b895-927b-458f-b913-24c3d3da49b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e26ea8189f44cbfb6a8b395232ec6f1)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:44.372859 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-ebe2b895-927b-458f-b913-24c3d3da49b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:19:44.372859 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:19:44.372859 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:19:44.374167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2b895-927b-458f-b913-24c3d3da49b4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:44.374629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb1a58-ee90-4636-80cc-bcd7e62c1eb0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:44.380271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81bc04-d334-49c4-b818-94e01293d09c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:44.380953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81bc04-d334-49c4-b818-94e01293d09c service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:44.381233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81bc04-d334-49c4-b818-94e01293d09c service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:44.381520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81bc04-d334-49c4-b818-94e01293d09c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:44.441893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81bc04-d334-49c4-b818-94e01293d09c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:44.443491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81bc04-d334-49c4-b818-94e01293d09c service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:44.453347 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 836/1670] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:19:44.492851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81bc04-d334-49c4-b818-94e01293d09c service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:44.504613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81bc04-d334-49c4-b818-94e01293d09c service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:44.512935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f4eb2-5de8-4704-a1d1-6357ab7cefbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:44.513781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f4eb2-5de8-4704-a1d1-6357ab7cefbd service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:44.514226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f4eb2-5de8-4704-a1d1-6357ab7cefbd service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:44.514651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f4eb2-5de8-4704-a1d1-6357ab7cefbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:44.568737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ebe2b895-927b-458f-b913-24c3d3da49b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e26ea8189f44cbfb6a8b395232ec6f1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:44.575699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f4eb2-5de8-4704-a1d1-6357ab7cefbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:44.577745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f4eb2-5de8-4704-a1d1-6357ab7cefbd service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:44.588864 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 837/1671] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:19:44.589978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f4eb2-5de8-4704-a1d1-6357ab7cefbd service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:44.590486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ebe2b895-927b-458f-b913-24c3d3da49b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e26ea8189f44cbfb6a8b395232ec6f1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:44.591259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ebe2b895-927b-458f-b913-24c3d3da49b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e26ea8189f44cbfb6a8b395232ec6f1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:44.602042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f4eb2-5de8-4704-a1d1-6357ab7cefbd service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:44.602584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ebe2b895-927b-458f-b913-24c3d3da49b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e26ea8189f44cbfb6a8b395232ec6f1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:44.608783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80e096-71a6-423b-ac63-e46a0bac83e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:44.609503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80e096-71a6-423b-ac63-e46a0bac83e5 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:44.609806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80e096-71a6-423b-ac63-e46a0bac83e5 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:44.610090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80e096-71a6-423b-ac63-e46a0bac83e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:44.655519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ebe2b895-927b-458f-b913-24c3d3da49b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e26ea8189f44cbfb6a8b395232ec6f1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:44.669402 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 835/1672] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:19:44 2022] DELETE /identity/v3/users/3e26ea8189f44cbfb6a8b395232ec6f1 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:19:44.671113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a939f9-f118-4ed2-b301-5d0ffeba8df0 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:44.671370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a939f9-f118-4ed2-b301-5d0ffeba8df0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:44.671780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a939f9-f118-4ed2-b301-5d0ffeba8df0 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:44.673340 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 836/1673] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:19:44.674985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b895d9-a781-4313-b8d0-84b7f7905f86 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:44.675275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b895d9-a781-4313-b8d0-84b7f7905f86 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:44.675563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b895d9-a781-4313-b8d0-84b7f7905f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:44.679271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80e096-71a6-423b-ac63-e46a0bac83e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:44.681850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80e096-71a6-423b-ac63-e46a0bac83e5 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:44.692231 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 838/1674] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:44 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:19:44.693639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc85c7-c238-4c87-a2c6-77fb3991c5e2 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:44.699352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e6b895d9-a781-4313-b8d0-84b7f7905f86 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:44.699569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc85c7-c238-4c87-a2c6-77fb3991c5e2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:44.699569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc85c7-c238-4c87-a2c6-77fb3991c5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:44.699737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e6b895d9-a781-4313-b8d0-84b7f7905f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:44.713473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b9cc85c7-c238-4c87-a2c6-77fb3991c5e2 None None] MFA Rules not processed for user `e6036dd39fb74289a8cbdcd6a21f8662`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:44.714706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b9cc85c7-c238-4c87-a2c6-77fb3991c5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:44.768638 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 837/1675] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:44.769594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b895d9-a781-4313-b8d0-84b7f7905f86 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:44.770988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e6b895d9-a781-4313-b8d0-84b7f7905f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:44.788137 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 839/1676] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:19:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:44.793560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc85c7-c238-4c87-a2c6-77fb3991c5e2 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:44.795420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b9cc85c7-c238-4c87-a2c6-77fb3991c5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:44.843171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b895d9-a781-4313-b8d0-84b7f7905f86 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:44.849632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3267a15-7c23-4271-8f4a-343479e75ed9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:44.850139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3267a15-7c23-4271-8f4a-343479e75ed9 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:44.850480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3267a15-7c23-4271-8f4a-343479e75ed9 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:44.853391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3267a15-7c23-4271-8f4a-343479e75ed9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:44.853935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a3267a15-7c23-4271-8f4a-343479e75ed9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:44.866315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc85c7-c238-4c87-a2c6-77fb3991c5e2 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:44.871111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971342a0-09e2-483d-9dc5-2ff343026d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:44.871984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971342a0-09e2-483d-9dc5-2ff343026d4d service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:44.872407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971342a0-09e2-483d-9dc5-2ff343026d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:44.873008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971342a0-09e2-483d-9dc5-2ff343026d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:44.883466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971342a0-09e2-483d-9dc5-2ff343026d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:44.885028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971342a0-09e2-483d-9dc5-2ff343026d4d service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:44.898201 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 840/1677] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:19:44.898997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971342a0-09e2-483d-9dc5-2ff343026d4d service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:44.900987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-971342a0-09e2-483d-9dc5-2ff343026d4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:44.923959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3267a15-7c23-4271-8f4a-343479e75ed9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:44.925584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3267a15-7c23-4271-8f4a-343479e75ed9 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:44.952895 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 838/1678] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:44 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:19:44.959200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971342a0-09e2-483d-9dc5-2ff343026d4d service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:44.964882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea39c7-5270-4a29-a9e4-05cb26da82cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:44.965016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea39c7-5270-4a29-a9e4-05cb26da82cc service glance] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:44.965494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea39c7-5270-4a29-a9e4-05cb26da82cc service glance] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:44.965965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea39c7-5270-4a29-a9e4-05cb26da82cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:44.988743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea39c7-5270-4a29-a9e4-05cb26da82cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:44.990516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea39c7-5270-4a29-a9e4-05cb26da82cc service glance] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:45.003968 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 841/1679] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:19:45.320885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3267a15-7c23-4271-8f4a-343479e75ed9 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:45.323007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a3267a15-7c23-4271-8f4a-343479e75ed9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:45.338459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3267a15-7c23-4271-8f4a-343479e75ed9 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:45.359706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d514799-21c7-4cea-b3f9-6c5e14b01b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:45.359706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d514799-21c7-4cea-b3f9-6c5e14b01b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:45.359706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d514799-21c7-4cea-b3f9-6c5e14b01b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:45.359706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d514799-21c7-4cea-b3f9-6c5e14b01b81 admin admin] PATH_INFO: `/v3/users/736ee9ad940b4ca991cfcb3318e18824` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:45.360280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d514799-21c7-4cea-b3f9-6c5e14b01b81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=736ee9ad940b4ca991cfcb3318e18824)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:45.361717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea39c7-5270-4a29-a9e4-05cb26da82cc service glance] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:45.362626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d514799-21c7-4cea-b3f9-6c5e14b01b81 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:45.363342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a8ea39c7-5270-4a29-a9e4-05cb26da82cc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:45.393174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea39c7-5270-4a29-a9e4-05cb26da82cc service glance] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:45.401034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a12d5-e31e-42d5-b8f4-41b21e6ef1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:45.402110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a12d5-e31e-42d5-b8f4-41b21e6ef1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:45.402824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a12d5-e31e-42d5-b8f4-41b21e6ef1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:45.408581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a12d5-e31e-42d5-b8f4-41b21e6ef1ba admin admin] PATH_INFO: `/v3/projects/60f844d1ae1c433381680cf9cb1f83a4` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:45.408581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a12d5-e31e-42d5-b8f4-41b21e6ef1ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f844d1ae1c433381680cf9cb1f83a4)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:45.408581 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-ed1a12d5-e31e-42d5-b8f4-41b21e6ef1ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:19:45.408581 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:19:45.408581 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:19:45.408581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a12d5-e31e-42d5-b8f4-41b21e6ef1ba admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:45.713134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2d514799-21c7-4cea-b3f9-6c5e14b01b81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '736ee9ad940b4ca991cfcb3318e18824'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:45.716053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed1a12d5-e31e-42d5-b8f4-41b21e6ef1ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f844d1ae1c433381680cf9cb1f83a4', 'request_id': 'req-ed1a12d5-e31e-42d5-b8f4-41b21e6ef1ba'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:45.731646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2d514799-21c7-4cea-b3f9-6c5e14b01b81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '736ee9ad940b4ca991cfcb3318e18824'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:45.732571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2d514799-21c7-4cea-b3f9-6c5e14b01b81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '736ee9ad940b4ca991cfcb3318e18824'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:45.736394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed1a12d5-e31e-42d5-b8f4-41b21e6ef1ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f844d1ae1c433381680cf9cb1f83a4', 'request_id': 'req-ed1a12d5-e31e-42d5-b8f4-41b21e6ef1ba'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:45.740984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2d514799-21c7-4cea-b3f9-6c5e14b01b81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '736ee9ad940b4ca991cfcb3318e18824'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:45.819472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed1a12d5-e31e-42d5-b8f4-41b21e6ef1ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f844d1ae1c433381680cf9cb1f83a4', 'request_id': 'req-ed1a12d5-e31e-42d5-b8f4-41b21e6ef1ba'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:45.832695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed1a12d5-e31e-42d5-b8f4-41b21e6ef1ba admin admin] The token cache is being invalidate because project 60f844d1ae1c433381680cf9cb1f83a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:19:45.833081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed1a12d5-e31e-42d5-b8f4-41b21e6ef1ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:45.833811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed1a12d5-e31e-42d5-b8f4-41b21e6ef1ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:45.835865 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 842/1680] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:19:45 2022] DELETE /identity/v3/projects/60f844d1ae1c433381680cf9cb1f83a4 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:45.837223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ca9e9-8717-4522-b929-3446e0b16115 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:45.837606 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ca9e9-8717-4522-b929-3446e0b16115 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:45.838128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ca9e9-8717-4522-b929-3446e0b16115 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:45.839666 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 843/1681] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:19:45.840439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ca9e9-8717-4522-b929-3446e0b16115 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:45.842585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ed9ca9e9-8717-4522-b929-3446e0b16115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:45.923438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2d514799-21c7-4cea-b3f9-6c5e14b01b81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '736ee9ad940b4ca991cfcb3318e18824'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:45.932979 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 839/1682] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:19:45 2022] DELETE /identity/v3/users/736ee9ad940b4ca991cfcb3318e18824 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:45.933641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e18fc4-fc5f-483a-a0ba-0b7696b87d92 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:45.934401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e18fc4-fc5f-483a-a0ba-0b7696b87d92 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:45.934401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e18fc4-fc5f-483a-a0ba-0b7696b87d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:45.936512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ca9e9-8717-4522-b929-3446e0b16115 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:45.993221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-30e18fc4-fc5f-483a-a0ba-0b7696b87d92 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:45.995156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-30e18fc4-fc5f-483a-a0ba-0b7696b87d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:46.009448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e638d75-52fe-4500-82b0-bb663e0ef715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:46.010672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e638d75-52fe-4500-82b0-bb663e0ef715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:46.011088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e638d75-52fe-4500-82b0-bb663e0ef715 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:46.011550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e638d75-52fe-4500-82b0-bb663e0ef715 admin admin] PATH_INFO: `/v3/users/96f46ef818c04b4491a3795ed08c92ac` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:46.013056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e638d75-52fe-4500-82b0-bb663e0ef715 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f46ef818c04b4491a3795ed08c92ac)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:46.015328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e638d75-52fe-4500-82b0-bb663e0ef715 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:46.077288 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 840/1683] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:19:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:46.078262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e18fc4-fc5f-483a-a0ba-0b7696b87d92 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:46.079590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-30e18fc4-fc5f-483a-a0ba-0b7696b87d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:46.091788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e18fc4-fc5f-483a-a0ba-0b7696b87d92 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:46.097133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831835d8-48e3-4a02-948e-9c5c77d905f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:46.097772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831835d8-48e3-4a02-948e-9c5c77d905f7 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:46.098060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831835d8-48e3-4a02-948e-9c5c77d905f7 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:46.098338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831835d8-48e3-4a02-948e-9c5c77d905f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:46.100421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-831835d8-48e3-4a02-948e-9c5c77d905f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:46.112943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831835d8-48e3-4a02-948e-9c5c77d905f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:46.114568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831835d8-48e3-4a02-948e-9c5c77d905f7 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:46.125397 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 841/1684] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:19:46.126662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00cb66-33df-4e53-9628-3dc8be969220 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:46.126934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00cb66-33df-4e53-9628-3dc8be969220 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:46.127218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00cb66-33df-4e53-9628-3dc8be969220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:46.153159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fc00cb66-33df-4e53-9628-3dc8be969220 None None] MFA Rules not processed for user `b11bbdc7eb564d049ad4220b168b48bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:46.154508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fc00cb66-33df-4e53-9628-3dc8be969220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:46.196490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9e638d75-52fe-4500-82b0-bb663e0ef715 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f46ef818c04b4491a3795ed08c92ac'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:46.210583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9e638d75-52fe-4500-82b0-bb663e0ef715 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f46ef818c04b4491a3795ed08c92ac'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:46.211573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9e638d75-52fe-4500-82b0-bb663e0ef715 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f46ef818c04b4491a3795ed08c92ac'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:46.219664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9e638d75-52fe-4500-82b0-bb663e0ef715 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f46ef818c04b4491a3795ed08c92ac'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:46.236017 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 842/1685] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:46.289679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526e10e-3719-43d0-b623-9940e63c1d0b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:46.289679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526e10e-3719-43d0-b623-9940e63c1d0b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:46.289679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526e10e-3719-43d0-b623-9940e63c1d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:46.289679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6526e10e-3719-43d0-b623-9940e63c1d0b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:46.289679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6526e10e-3719-43d0-b623-9940e63c1d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:46.289679 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 843/1686] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:46.291401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526e10e-3719-43d0-b623-9940e63c1d0b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:46.291401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6526e10e-3719-43d0-b623-9940e63c1d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:46.291401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526e10e-3719-43d0-b623-9940e63c1d0b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:46.291565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2e89b-59d1-4bef-a3f3-99624f0399f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:46.291565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2e89b-59d1-4bef-a3f3-99624f0399f0 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:46.292007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2e89b-59d1-4bef-a3f3-99624f0399f0 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:46.293002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2e89b-59d1-4bef-a3f3-99624f0399f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:46.303011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2e89b-59d1-4bef-a3f3-99624f0399f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:46.304820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2e89b-59d1-4bef-a3f3-99624f0399f0 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:46.322487 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 844/1687] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:19:46.328944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767fa75-6cf0-473c-866f-01874b29ebc0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:46.329496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767fa75-6cf0-473c-866f-01874b29ebc0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:46.329992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767fa75-6cf0-473c-866f-01874b29ebc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:46.360689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a767fa75-6cf0-473c-866f-01874b29ebc0 None None] MFA Rules not processed for user `662c15e746b84fdbb497d700c9288931`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:46.360689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a767fa75-6cf0-473c-866f-01874b29ebc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:46.369130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9e638d75-52fe-4500-82b0-bb663e0ef715 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f46ef818c04b4491a3795ed08c92ac'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:46.385196 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 844/1688] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:19:45 2022] DELETE /identity/v3/users/96f46ef818c04b4491a3795ed08c92ac => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:46.386532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e638d75-52fe-4500-82b0-bb663e0ef715 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:46.389404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9e638d75-52fe-4500-82b0-bb663e0ef715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:46.439726 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 845/1689] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:46.461710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e638d75-52fe-4500-82b0-bb663e0ef715 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:46.465877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdb281-ac75-478c-9a15-686fe5f164b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:46.466535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdb281-ac75-478c-9a15-686fe5f164b7 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:46.466819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdb281-ac75-478c-9a15-686fe5f164b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:46.467098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdb281-ac75-478c-9a15-686fe5f164b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:46.470217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bdbdb281-ac75-478c-9a15-686fe5f164b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:46.485496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767fa75-6cf0-473c-866f-01874b29ebc0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:46.487026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a767fa75-6cf0-473c-866f-01874b29ebc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:46.548116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdb281-ac75-478c-9a15-686fe5f164b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:46.549635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdb281-ac75-478c-9a15-686fe5f164b7 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:46.560714 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 845/1690] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:19:46.562336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f30c01-f611-4f2f-bd4c-c1439233c09e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:46.562637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f30c01-f611-4f2f-bd4c-c1439233c09e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:46.562927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f30c01-f611-4f2f-bd4c-c1439233c09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:46.580989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b0f30c01-f611-4f2f-bd4c-c1439233c09e None None] MFA Rules not processed for user `c3cdce63521c4407b7575c924737c5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:46.582288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b0f30c01-f611-4f2f-bd4c-c1439233c09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:46.583462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767fa75-6cf0-473c-866f-01874b29ebc0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:46.646970 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 846/1691] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:46.666808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a573e-6d8b-4e6b-af13-e462898a8a38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:46.667583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a573e-6d8b-4e6b-af13-e462898a8a38 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:46.667871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a573e-6d8b-4e6b-af13-e462898a8a38 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:46.668151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a573e-6d8b-4e6b-af13-e462898a8a38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:46.670034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0e3a573e-6d8b-4e6b-af13-e462898a8a38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:46.682768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f30c01-f611-4f2f-bd4c-c1439233c09e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:46.684165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b0f30c01-f611-4f2f-bd4c-c1439233c09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:46.700434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f30c01-f611-4f2f-bd4c-c1439233c09e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:46.717600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65d167-1bd6-4e99-97c5-003e6886ad2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:46.719186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65d167-1bd6-4e99-97c5-003e6886ad2d service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:46.719186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65d167-1bd6-4e99-97c5-003e6886ad2d service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:46.719186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65d167-1bd6-4e99-97c5-003e6886ad2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:46.720773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3b65d167-1bd6-4e99-97c5-003e6886ad2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:46.729894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a573e-6d8b-4e6b-af13-e462898a8a38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:46.731196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a573e-6d8b-4e6b-af13-e462898a8a38 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:46.731907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65d167-1bd6-4e99-97c5-003e6886ad2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:46.733551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65d167-1bd6-4e99-97c5-003e6886ad2d service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:46.743877 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 847/1692] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:19:46.748029 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 846/1693] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:19:46.839894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bd9a5-c19b-4693-950f-929557f3cbaf None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:46.840395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bd9a5-c19b-4693-950f-929557f3cbaf None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:46.840479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bd9a5-c19b-4693-950f-929557f3cbaf None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:46.842033 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 848/1694] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:19:46.848464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fce876-08f9-4a0a-974e-26811f6e1e52 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:46.849463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fce876-08f9-4a0a-974e-26811f6e1e52 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:46.849775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fce876-08f9-4a0a-974e-26811f6e1e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:46.871177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-66fce876-08f9-4a0a-974e-26811f6e1e52 None None] MFA Rules not processed for user `e6036dd39fb74289a8cbdcd6a21f8662`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:46.872416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-66fce876-08f9-4a0a-974e-26811f6e1e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:46.889496 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 847/1695] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:19:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:19:46.899299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bd9a5-c19b-4693-950f-929557f3cbaf None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:46.901801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c60bd9a5-c19b-4693-950f-929557f3cbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:46.991785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bd9a5-c19b-4693-950f-929557f3cbaf None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:46.997475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c8960-d254-4fde-abfd-100fd180df52 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:46.998356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c8960-d254-4fde-abfd-100fd180df52 service glance] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:46.998845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c8960-d254-4fde-abfd-100fd180df52 service glance] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:46.999375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c8960-d254-4fde-abfd-100fd180df52 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:47.012179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c8960-d254-4fde-abfd-100fd180df52 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:47.013674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c8960-d254-4fde-abfd-100fd180df52 service glance] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:47.024490 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 849/1696] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:19:47.039113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fce876-08f9-4a0a-974e-26811f6e1e52 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:47.041449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-66fce876-08f9-4a0a-974e-26811f6e1e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:47.060841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fce876-08f9-4a0a-974e-26811f6e1e52 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:47.065981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d5988-8422-4c3c-a1c5-6ab59a4439cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:47.066851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d5988-8422-4c3c-a1c5-6ab59a4439cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:47.067169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d5988-8422-4c3c-a1c5-6ab59a4439cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:47.067416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d5988-8422-4c3c-a1c5-6ab59a4439cc admin admin] PATH_INFO: `/v3/projects/e75b37ef372e4e7da13d2251b08f510e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:47.068910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d5988-8422-4c3c-a1c5-6ab59a4439cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e75b37ef372e4e7da13d2251b08f510e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:47.070864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d5988-8422-4c3c-a1c5-6ab59a4439cc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:47.184470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bba8ba-79cc-42dd-96f9-e6db3d0a6a16 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:47.184841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bba8ba-79cc-42dd-96f9-e6db3d0a6a16 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:47.185146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bba8ba-79cc-42dd-96f9-e6db3d0a6a16 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:47.186706 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 850/1697] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 10:19:47.194318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ade6-336d-48b3-b86a-660bedfcd040 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:47.194609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ade6-336d-48b3-b86a-660bedfcd040 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:47.194895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ade6-336d-48b3-b86a-660bedfcd040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:47.229061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a9d5988-8422-4c3c-a1c5-6ab59a4439cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e75b37ef372e4e7da13d2251b08f510e', 'request_id': 'req-5a9d5988-8422-4c3c-a1c5-6ab59a4439cc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:47.234418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0923ade6-336d-48b3-b86a-660bedfcd040 None None] MFA Rules not processed for user `4cd9fe10f94f43aeb3eb10009ee96ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:47.235651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0923ade6-336d-48b3-b86a-660bedfcd040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:47.295321 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 851/1698] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:19:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:19:47.297563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923ade6-336d-48b3-b86a-660bedfcd040 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:47.299919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0923ade6-336d-48b3-b86a-660bedfcd040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:47.325991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a9d5988-8422-4c3c-a1c5-6ab59a4439cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e75b37ef372e4e7da13d2251b08f510e', 'request_id': 'req-5a9d5988-8422-4c3c-a1c5-6ab59a4439cc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:47.332636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a9d5988-8422-4c3c-a1c5-6ab59a4439cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e75b37ef372e4e7da13d2251b08f510e', 'request_id': 'req-5a9d5988-8422-4c3c-a1c5-6ab59a4439cc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:47.363738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a9d5988-8422-4c3c-a1c5-6ab59a4439cc admin admin] The token cache is being invalidate because project e75b37ef372e4e7da13d2251b08f510e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:19:47.364059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a9d5988-8422-4c3c-a1c5-6ab59a4439cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:47.365090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a9d5988-8422-4c3c-a1c5-6ab59a4439cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:47.366959 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 848/1699] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:19:47 2022] DELETE /identity/v3/projects/e75b37ef372e4e7da13d2251b08f510e => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:19:47.371184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d5988-8422-4c3c-a1c5-6ab59a4439cc admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:47.372529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5a9d5988-8422-4c3c-a1c5-6ab59a4439cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:47.378988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923ade6-336d-48b3-b86a-660bedfcd040 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:47.384025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db334289-be5c-406b-8825-40ea9f67d8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:47.385118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db334289-be5c-406b-8825-40ea9f67d8cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:47.385402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db334289-be5c-406b-8825-40ea9f67d8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:47.386269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db334289-be5c-406b-8825-40ea9f67d8cd admin admin] PATH_INFO: `/v3/projects/11610c2f22414a8fb76d9adcaee4b57b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:47.387808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db334289-be5c-406b-8825-40ea9f67d8cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=11610c2f22414a8fb76d9adcaee4b57b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:47.389785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db334289-be5c-406b-8825-40ea9f67d8cd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:47.390318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d5988-8422-4c3c-a1c5-6ab59a4439cc admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:47.394351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625ce7a-d776-4b4c-9b5e-efa9b622d9f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:47.395267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625ce7a-d776-4b4c-9b5e-efa9b622d9f4 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:47.395729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625ce7a-d776-4b4c-9b5e-efa9b622d9f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:47.396314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625ce7a-d776-4b4c-9b5e-efa9b622d9f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:47.398491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7625ce7a-d776-4b4c-9b5e-efa9b622d9f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:47.408638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625ce7a-d776-4b4c-9b5e-efa9b622d9f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:47.415663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625ce7a-d776-4b4c-9b5e-efa9b622d9f4 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:47.419405 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 849/1700] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:19:47.421542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625ce7a-d776-4b4c-9b5e-efa9b622d9f4 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:47.422947 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7625ce7a-d776-4b4c-9b5e-efa9b622d9f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:47.438486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625ce7a-d776-4b4c-9b5e-efa9b622d9f4 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:47.444281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997df02-5d8a-43ce-946c-c3a379171008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:47.445440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997df02-5d8a-43ce-946c-c3a379171008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:47.445733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997df02-5d8a-43ce-946c-c3a379171008 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:47.446062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997df02-5d8a-43ce-946c-c3a379171008 admin admin] PATH_INFO: `/v3/users/2f267a1dd21a4676bfbad106f83cf4a8` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:47.447361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997df02-5d8a-43ce-946c-c3a379171008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f267a1dd21a4676bfbad106f83cf4a8)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:47.449911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997df02-5d8a-43ce-946c-c3a379171008 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:47.503790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-db334289-be5c-406b-8825-40ea9f67d8cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11610c2f22414a8fb76d9adcaee4b57b', 'request_id': 'req-db334289-be5c-406b-8825-40ea9f67d8cd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:47.510485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-db334289-be5c-406b-8825-40ea9f67d8cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11610c2f22414a8fb76d9adcaee4b57b', 'request_id': 'req-db334289-be5c-406b-8825-40ea9f67d8cd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:47.585337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-db334289-be5c-406b-8825-40ea9f67d8cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11610c2f22414a8fb76d9adcaee4b57b', 'request_id': 'req-db334289-be5c-406b-8825-40ea9f67d8cd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:47.595858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-db334289-be5c-406b-8825-40ea9f67d8cd admin admin] The token cache is being invalidate because project 11610c2f22414a8fb76d9adcaee4b57b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:19:47.596143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-db334289-be5c-406b-8825-40ea9f67d8cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:47.596832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-db334289-be5c-406b-8825-40ea9f67d8cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:47.598400 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 852/1701] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:19:47 2022] DELETE /identity/v3/projects/11610c2f22414a8fb76d9adcaee4b57b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:47.604735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f6f14-0db8-49a4-bd04-574267504a7c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:47.605095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f6f14-0db8-49a4-bd04-574267504a7c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:47.605383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f6f14-0db8-49a4-bd04-574267504a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:47.625417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a56f6f14-0db8-49a4-bd04-574267504a7c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:47.626617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a56f6f14-0db8-49a4-bd04-574267504a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:47.686406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f997df02-5d8a-43ce-946c-c3a379171008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f267a1dd21a4676bfbad106f83cf4a8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:47.708951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f997df02-5d8a-43ce-946c-c3a379171008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f267a1dd21a4676bfbad106f83cf4a8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:47.709890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f997df02-5d8a-43ce-946c-c3a379171008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f267a1dd21a4676bfbad106f83cf4a8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:47.718132 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 853/1702] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:47.721441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f997df02-5d8a-43ce-946c-c3a379171008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f267a1dd21a4676bfbad106f83cf4a8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:47.728593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfee006-e98d-46eb-9a15-686b60035c09 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:47.729413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfee006-e98d-46eb-9a15-686b60035c09 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:47.729945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfee006-e98d-46eb-9a15-686b60035c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:47.751995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7bfee006-e98d-46eb-9a15-686b60035c09 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:47.753343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7bfee006-e98d-46eb-9a15-686b60035c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:47.762945 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 854/1703] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:47.767478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfee006-e98d-46eb-9a15-686b60035c09 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:47.779262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfee006-e98d-46eb-9a15-686b60035c09 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:47.785439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830afe04-13e1-4b9d-a7d0-7ae63e11f838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:47.786281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830afe04-13e1-4b9d-a7d0-7ae63e11f838 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:47.786765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830afe04-13e1-4b9d-a7d0-7ae63e11f838 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:47.787118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830afe04-13e1-4b9d-a7d0-7ae63e11f838 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:47.788062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830afe04-13e1-4b9d-a7d0-7ae63e11f838 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:19:47.788446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830afe04-13e1-4b9d-a7d0-7ae63e11f838 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:47.790905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830afe04-13e1-4b9d-a7d0-7ae63e11f838 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:47.807838 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 855/1704] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:19:47.809726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830afe04-13e1-4b9d-a7d0-7ae63e11f838 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:47.846226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830afe04-13e1-4b9d-a7d0-7ae63e11f838 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:47.854091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22abff-7fcb-4a87-8fe8-d0b5132081ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:47.854529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22abff-7fcb-4a87-8fe8-d0b5132081ac admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:47.855297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22abff-7fcb-4a87-8fe8-d0b5132081ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:47.855684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22abff-7fcb-4a87-8fe8-d0b5132081ac admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:47.856676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22abff-7fcb-4a87-8fe8-d0b5132081ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:47.859007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22abff-7fcb-4a87-8fe8-d0b5132081ac admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:47.892965 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f997df02-5d8a-43ce-946c-c3a379171008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f267a1dd21a4676bfbad106f83cf4a8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:47.905802 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 850/1705] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:19:47 2022] DELETE /identity/v3/users/2f267a1dd21a4676bfbad106f83cf4a8 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:48.000960 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 856/1706] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:19:47 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:48.004841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997df02-5d8a-43ce-946c-c3a379171008 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:48.006383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f997df02-5d8a-43ce-946c-c3a379171008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:48.089498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997df02-5d8a-43ce-946c-c3a379171008 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:48.192955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ac1ae-748b-4896-af9f-4024efa43932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:48.195619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ac1ae-748b-4896-af9f-4024efa43932 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:48.195918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ac1ae-748b-4896-af9f-4024efa43932 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:48.196202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ac1ae-748b-4896-af9f-4024efa43932 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:48.197479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ac1ae-748b-4896-af9f-4024efa43932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:48.202702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ac1ae-748b-4896-af9f-4024efa43932 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:48.307008 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 851/1707] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:19:48 2022] POST /identity/v3/users => generated 289 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:19:48.310880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22abff-7fcb-4a87-8fe8-d0b5132081ac admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:48.320913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22abff-7fcb-4a87-8fe8-d0b5132081ac admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:48.326078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ede268-e896-4fad-9403-f2827bea32b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:48.326747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ede268-e896-4fad-9403-f2827bea32b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:48.330066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ede268-e896-4fad-9403-f2827bea32b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:48.330066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ede268-e896-4fad-9403-f2827bea32b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:48.330066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ede268-e896-4fad-9403-f2827bea32b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:48.330066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ede268-e896-4fad-9403-f2827bea32b1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:48.344337 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 857/1708] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:48.345551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ac1ae-748b-4896-af9f-4024efa43932 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:48.356178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ac1ae-748b-4896-af9f-4024efa43932 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:48.360910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacafd2c-9d50-4ce8-b83f-75de3384ca05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:48.361607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacafd2c-9d50-4ce8-b83f-75de3384ca05 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:48.361891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacafd2c-9d50-4ce8-b83f-75de3384ca05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:48.362170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacafd2c-9d50-4ce8-b83f-75de3384ca05 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:48.362933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacafd2c-9d50-4ce8-b83f-75de3384ca05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:48.364585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacafd2c-9d50-4ce8-b83f-75de3384ca05 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:48.376635 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 852/1709] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:48.379386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ede268-e896-4fad-9403-f2827bea32b1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:48.389984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ede268-e896-4fad-9403-f2827bea32b1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:48.394636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c32af8-4178-442c-aebd-706bd415e4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:48.395523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c32af8-4178-442c-aebd-706bd415e4bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:48.395811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c32af8-4178-442c-aebd-706bd415e4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:48.396154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c32af8-4178-442c-aebd-706bd415e4bc admin admin] PATH_INFO: `/v3/projects/975d62b4b18f41059bd8222ba2daee63/users/3c1bea55263d48f59806cde80c584bf0/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:48.413582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c32af8-4178-442c-aebd-706bd415e4bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=975d62b4b18f41059bd8222ba2daee63, user_id=3c1bea55263d48f59806cde80c584bf0, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:48.416330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c32af8-4178-442c-aebd-706bd415e4bc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:48.488503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacafd2c-9d50-4ce8-b83f-75de3384ca05 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:48.494166 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 858/1710] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:48 2022] PUT /identity/v3/projects/975d62b4b18f41059bd8222ba2daee63/users/3c1bea55263d48f59806cde80c584bf0/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:48.494440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bacafd2c-9d50-4ce8-b83f-75de3384ca05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:48.495987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5566aab-0a77-4c24-ac75-8bc504187c56 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:48.496307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5566aab-0a77-4c24-ac75-8bc504187c56 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:48.496588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5566aab-0a77-4c24-ac75-8bc504187c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:48.513595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacafd2c-9d50-4ce8-b83f-75de3384ca05 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:48.528520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d5566aab-0a77-4c24-ac75-8bc504187c56 None None] MFA Rules not processed for user `3c1bea55263d48f59806cde80c584bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:48.529770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d5566aab-0a77-4c24-ac75-8bc504187c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:48.592279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b75003-d55b-40ab-a451-62e5fdfde639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:48.593221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b75003-d55b-40ab-a451-62e5fdfde639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:48.593508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b75003-d55b-40ab-a451-62e5fdfde639 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:48.593786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b75003-d55b-40ab-a451-62e5fdfde639 admin admin] PATH_INFO: `/v3/projects/f6e66dc3240b4a42b43403096b218fe8` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:48.595330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b75003-d55b-40ab-a451-62e5fdfde639 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6e66dc3240b4a42b43403096b218fe8)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:48.598688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b75003-d55b-40ab-a451-62e5fdfde639 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:48.603537 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 859/1711] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:48.603537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5566aab-0a77-4c24-ac75-8bc504187c56 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:48.603537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d5566aab-0a77-4c24-ac75-8bc504187c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:48.690571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5566aab-0a77-4c24-ac75-8bc504187c56 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:48.696174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc75a2-4397-4e49-9411-71b28ae2718e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:48.697419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc75a2-4397-4e49-9411-71b28ae2718e service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:48.697705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc75a2-4397-4e49-9411-71b28ae2718e service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:48.698024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc75a2-4397-4e49-9411-71b28ae2718e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:48.699758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0ecc75a2-4397-4e49-9411-71b28ae2718e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:48.726243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-84b75003-d55b-40ab-a451-62e5fdfde639 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6e66dc3240b4a42b43403096b218fe8', 'request_id': 'req-84b75003-d55b-40ab-a451-62e5fdfde639'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:48.755285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc75a2-4397-4e49-9411-71b28ae2718e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:48.756899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc75a2-4397-4e49-9411-71b28ae2718e service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:48.766334 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 860/1712] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:19:48.767121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc75a2-4397-4e49-9411-71b28ae2718e service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:48.778346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc75a2-4397-4e49-9411-71b28ae2718e service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:48.823684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-84b75003-d55b-40ab-a451-62e5fdfde639 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6e66dc3240b4a42b43403096b218fe8', 'request_id': 'req-84b75003-d55b-40ab-a451-62e5fdfde639'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:48.831653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-84b75003-d55b-40ab-a451-62e5fdfde639 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6e66dc3240b4a42b43403096b218fe8', 'request_id': 'req-84b75003-d55b-40ab-a451-62e5fdfde639'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:48.842561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-84b75003-d55b-40ab-a451-62e5fdfde639 admin admin] The token cache is being invalidate because project f6e66dc3240b4a42b43403096b218fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:19:48.842852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-84b75003-d55b-40ab-a451-62e5fdfde639 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:48.843540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-84b75003-d55b-40ab-a451-62e5fdfde639 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:48.845565 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 853/1713] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:19:48 2022] DELETE /identity/v3/projects/f6e66dc3240b4a42b43403096b218fe8 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:48.849880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4dc32-9b2d-4679-9c0d-a6c3ae6070cf None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:48.850171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4dc32-9b2d-4679-9c0d-a6c3ae6070cf None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:48.850453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4dc32-9b2d-4679-9c0d-a6c3ae6070cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:48.868930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4d840-8512-457b-8423-79b1350e7b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:48.869608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4d840-8512-457b-8423-79b1350e7b13 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:48.869894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4d840-8512-457b-8423-79b1350e7b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:48.870176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4d840-8512-457b-8423-79b1350e7b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:48.871136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4d840-8512-457b-8423-79b1350e7b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:48.871769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4aa4dc32-9b2d-4679-9c0d-a6c3ae6070cf None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:48.873007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4aa4dc32-9b2d-4679-9c0d-a6c3ae6070cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:48.873128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4d840-8512-457b-8423-79b1350e7b13 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:48.881067 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 854/1714] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:19:48.888961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d82d9-5955-4719-9629-11db76e944ad None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:48.896876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d82d9-5955-4719-9629-11db76e944ad None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:48.896876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d82d9-5955-4719-9629-11db76e944ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:48.907134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fc2d82d9-5955-4719-9629-11db76e944ad None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:48.908399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fc2d82d9-5955-4719-9629-11db76e944ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:48.919332 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 855/1715] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:19:48.921922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d82d9-5955-4719-9629-11db76e944ad None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:48.931678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d82d9-5955-4719-9629-11db76e944ad None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:48.936863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921a33c-6f0b-4b19-a373-8bc2639f9e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:48.937520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921a33c-6f0b-4b19-a373-8bc2639f9e52 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:48.937801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921a33c-6f0b-4b19-a373-8bc2639f9e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:48.938111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921a33c-6f0b-4b19-a373-8bc2639f9e52 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:48.938800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921a33c-6f0b-4b19-a373-8bc2639f9e52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:19:48.939107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921a33c-6f0b-4b19-a373-8bc2639f9e52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:48.940800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921a33c-6f0b-4b19-a373-8bc2639f9e52 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:48.953175 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 856/1716] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:19:48.957133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921a33c-6f0b-4b19-a373-8bc2639f9e52 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:48.972958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921a33c-6f0b-4b19-a373-8bc2639f9e52 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:48.979422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc99964-988a-4605-bc0d-4c8bf0fba51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:48.980149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc99964-988a-4605-bc0d-4c8bf0fba51e admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:48.980444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc99964-988a-4605-bc0d-4c8bf0fba51e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:48.980767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc99964-988a-4605-bc0d-4c8bf0fba51e admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:48.981474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc99964-988a-4605-bc0d-4c8bf0fba51e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:48.983455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc99964-988a-4605-bc0d-4c8bf0fba51e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:49.024100 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 861/1717] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:19:48 2022] POST /identity/v3/projects => generated 377 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:49.025260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4d840-8512-457b-8423-79b1350e7b13 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:49.027339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-87d4d840-8512-457b-8423-79b1350e7b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:49.089256 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 857/1718] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:19:48 2022] POST /identity/v3/projects => generated 393 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:19:49.090393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc99964-988a-4605-bc0d-4c8bf0fba51e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:49.119603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4d840-8512-457b-8423-79b1350e7b13 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:49.195347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc99964-988a-4605-bc0d-4c8bf0fba51e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:49.214972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add0e10-23da-4ed0-ac7f-7301924b97ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:49.215819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add0e10-23da-4ed0-ac7f-7301924b97ca admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:49.216110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add0e10-23da-4ed0-ac7f-7301924b97ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:49.216218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231355f6-bae5-4902-b54f-66ef7aeabc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:49.216390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add0e10-23da-4ed0-ac7f-7301924b97ca admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:49.216999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231355f6-bae5-4902-b54f-66ef7aeabc96 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:49.217188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add0e10-23da-4ed0-ac7f-7301924b97ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:49.217268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231355f6-bae5-4902-b54f-66ef7aeabc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:49.217553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231355f6-bae5-4902-b54f-66ef7aeabc96 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:49.218549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231355f6-bae5-4902-b54f-66ef7aeabc96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:49.219443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add0e10-23da-4ed0-ac7f-7301924b97ca admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:49.220609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231355f6-bae5-4902-b54f-66ef7aeabc96 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:49.316454 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 858/1719] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:19:49 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:49.321444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add0e10-23da-4ed0-ac7f-7301924b97ca admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:49.330721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add0e10-23da-4ed0-ac7f-7301924b97ca admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:49.335261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3531227-af23-4a7b-88c2-e0a7ec72d603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:49.338089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3531227-af23-4a7b-88c2-e0a7ec72d603 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:49.340411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3531227-af23-4a7b-88c2-e0a7ec72d603 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:49.342238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3531227-af23-4a7b-88c2-e0a7ec72d603 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:49.343113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3531227-af23-4a7b-88c2-e0a7ec72d603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:49.344808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3531227-af23-4a7b-88c2-e0a7ec72d603 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:49.347457 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 862/1720] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:19:49 2022] POST /identity/v3/users => generated 295 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:49.351918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231355f6-bae5-4902-b54f-66ef7aeabc96 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:49.360857 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 859/1721] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:19:49.362190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3531227-af23-4a7b-88c2-e0a7ec72d603 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:49.364740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231355f6-bae5-4902-b54f-66ef7aeabc96 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:49.369644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52933b2a-9c4b-4ad2-b372-f2d85970b36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:49.370363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52933b2a-9c4b-4ad2-b372-f2d85970b36f admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:49.371020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52933b2a-9c4b-4ad2-b372-f2d85970b36f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:49.371306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52933b2a-9c4b-4ad2-b372-f2d85970b36f admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:49.372037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52933b2a-9c4b-4ad2-b372-f2d85970b36f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:49.372418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3531227-af23-4a7b-88c2-e0a7ec72d603 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:49.373682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52933b2a-9c4b-4ad2-b372-f2d85970b36f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:49.377451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0625d8-b6c1-452e-9463-73c6d3647ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:49.378263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0625d8-b6c1-452e-9463-73c6d3647ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:49.378723 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0625d8-b6c1-452e-9463-73c6d3647ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:49.379099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0625d8-b6c1-452e-9463-73c6d3647ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:49.380020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0625d8-b6c1-452e-9463-73c6d3647ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:49.381726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0625d8-b6c1-452e-9463-73c6d3647ea0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:49.384418 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 863/1722] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:49.389162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52933b2a-9c4b-4ad2-b372-f2d85970b36f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:49.396688 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 860/1723] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:49.399329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52933b2a-9c4b-4ad2-b372-f2d85970b36f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:49.401084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0625d8-b6c1-452e-9463-73c6d3647ea0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:49.405070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee2a16-e2c2-4bcd-b87d-3cbab200e5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:49.405960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee2a16-e2c2-4bcd-b87d-3cbab200e5d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:49.407078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee2a16-e2c2-4bcd-b87d-3cbab200e5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:49.407078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee2a16-e2c2-4bcd-b87d-3cbab200e5d4 admin admin] PATH_INFO: `/v3/projects/9051f063c82149c7a65b85fa5a93ba1d/users/e594c41acd384285800096d3fe31305c/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:49.411198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0625d8-b6c1-452e-9463-73c6d3647ea0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:49.416469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61dbed-b704-4d91-8e08-c67ccf5475ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:49.417453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61dbed-b704-4d91-8e08-c67ccf5475ee admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:49.417732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61dbed-b704-4d91-8e08-c67ccf5475ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:49.418005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61dbed-b704-4d91-8e08-c67ccf5475ee admin admin] PATH_INFO: `/v3/projects/5225762cb407423cb647044837c61346/users/54561050be124707b99e498995040486/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:49.425403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee2a16-e2c2-4bcd-b87d-3cbab200e5d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9051f063c82149c7a65b85fa5a93ba1d, user_id=e594c41acd384285800096d3fe31305c, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:49.428167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee2a16-e2c2-4bcd-b87d-3cbab200e5d4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:49.433747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61dbed-b704-4d91-8e08-c67ccf5475ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5225762cb407423cb647044837c61346, user_id=54561050be124707b99e498995040486, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:49.436335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61dbed-b704-4d91-8e08-c67ccf5475ee admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:49.566751 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 861/1724] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:49 2022] PUT /identity/v3/projects/5225762cb407423cb647044837c61346/users/54561050be124707b99e498995040486/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:49.567437 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 864/1725] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:49 2022] PUT /identity/v3/projects/9051f063c82149c7a65b85fa5a93ba1d/users/e594c41acd384285800096d3fe31305c/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:49.571494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61dbed-b704-4d91-8e08-c67ccf5475ee admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:49.578021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d3074-2ded-4da6-bc68-50c0fbb214a2 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:49.578663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d3074-2ded-4da6-bc68-50c0fbb214a2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:49.578949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d3074-2ded-4da6-bc68-50c0fbb214a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:49.607213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-cd0d3074-2ded-4da6-bc68-50c0fbb214a2 None None] MFA Rules not processed for user `54561050be124707b99e498995040486`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:49.608439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cd0d3074-2ded-4da6-bc68-50c0fbb214a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:49.641421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61dbed-b704-4d91-8e08-c67ccf5475ee admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:49.648829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf913a6-2026-4a34-bbd8-5e4f341cb7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:49.650348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf913a6-2026-4a34-bbd8-5e4f341cb7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:49.650656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf913a6-2026-4a34-bbd8-5e4f341cb7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:49.650895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf913a6-2026-4a34-bbd8-5e4f341cb7b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:49.652854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf913a6-2026-4a34-bbd8-5e4f341cb7b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:49.658508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf913a6-2026-4a34-bbd8-5e4f341cb7b4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:49.670769 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 862/1726] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:49.675994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf913a6-2026-4a34-bbd8-5e4f341cb7b4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:49.694655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf913a6-2026-4a34-bbd8-5e4f341cb7b4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:49.701062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f16b5-9026-49f0-8f1f-57948af681a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:49.713448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f16b5-9026-49f0-8f1f-57948af681a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:49.713738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f16b5-9026-49f0-8f1f-57948af681a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:49.717834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f16b5-9026-49f0-8f1f-57948af681a1 admin admin] PATH_INFO: `/v3/projects/9051f063c82149c7a65b85fa5a93ba1d/users/e594c41acd384285800096d3fe31305c/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:49.721530 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 865/1727] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:19:49.722176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f16b5-9026-49f0-8f1f-57948af681a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9051f063c82149c7a65b85fa5a93ba1d, user_id=e594c41acd384285800096d3fe31305c, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:49.725129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f16b5-9026-49f0-8f1f-57948af681a1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:49.728514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d3074-2ded-4da6-bc68-50c0fbb214a2 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:49.744816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d3074-2ded-4da6-bc68-50c0fbb214a2 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:49.757463 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 863/1728] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:49 2022] PUT /identity/v3/projects/9051f063c82149c7a65b85fa5a93ba1d/users/e594c41acd384285800096d3fe31305c/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:49.764291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471fea2-f01a-436c-9e3c-0c7acb1dc7e7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:49.764826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471fea2-f01a-436c-9e3c-0c7acb1dc7e7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:49.765252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471fea2-f01a-436c-9e3c-0c7acb1dc7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:49.798643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3471fea2-f01a-436c-9e3c-0c7acb1dc7e7 None None] MFA Rules not processed for user `e594c41acd384285800096d3fe31305c`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:49.800203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3471fea2-f01a-436c-9e3c-0c7acb1dc7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:49.809343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7fac9-cf90-43c8-bee0-cc77e2ab141d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:49.810018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7fac9-cf90-43c8-bee0-cc77e2ab141d admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:49.810299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7fac9-cf90-43c8-bee0-cc77e2ab141d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:49.810596 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7fac9-cf90-43c8-bee0-cc77e2ab141d admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:49.811733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7fac9-cf90-43c8-bee0-cc77e2ab141d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:49.813985 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7fac9-cf90-43c8-bee0-cc77e2ab141d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:49.894365 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 864/1729] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:19:49.908032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471fea2-f01a-436c-9e3c-0c7acb1dc7e7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:49.909685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3471fea2-f01a-436c-9e3c-0c7acb1dc7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:49.962612 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 866/1730] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:19:49 2022] POST /identity/v3/projects => generated 393 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:49.966684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7fac9-cf90-43c8-bee0-cc77e2ab141d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:49.984504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471fea2-f01a-436c-9e3c-0c7acb1dc7e7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:50.055257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7fac9-cf90-43c8-bee0-cc77e2ab141d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:50.061121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435265f-7d2c-44a1-89fb-79a7e10a1620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:50.061947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435265f-7d2c-44a1-89fb-79a7e10a1620 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:50.062263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435265f-7d2c-44a1-89fb-79a7e10a1620 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:50.063186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435265f-7d2c-44a1-89fb-79a7e10a1620 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:50.063745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435265f-7d2c-44a1-89fb-79a7e10a1620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:50.066073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435265f-7d2c-44a1-89fb-79a7e10a1620 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:50.069248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95135b55-15d0-42e1-887e-bae42f581586 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:50.069865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95135b55-15d0-42e1-887e-bae42f581586 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:50.070222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95135b55-15d0-42e1-887e-bae42f581586 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:50.070392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95135b55-15d0-42e1-887e-bae42f581586 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:50.162601 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 867/1731] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:19:49 2022] POST /identity/v3/users => generated 303 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:19:50.166715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435265f-7d2c-44a1-89fb-79a7e10a1620 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:50.178094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435265f-7d2c-44a1-89fb-79a7e10a1620 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:50.179039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95135b55-15d0-42e1-887e-bae42f581586 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:50.181246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95135b55-15d0-42e1-887e-bae42f581586 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:50.186336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242a089-63d5-4523-b44a-305d55267ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:50.187442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242a089-63d5-4523-b44a-305d55267ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:50.188587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242a089-63d5-4523-b44a-305d55267ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:50.188922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242a089-63d5-4523-b44a-305d55267ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:50.189988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242a089-63d5-4523-b44a-305d55267ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:50.192180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242a089-63d5-4523-b44a-305d55267ed4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:50.205022 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 865/1732] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:19:50.208430 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 868/1733] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:19:50.212815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95135b55-15d0-42e1-887e-bae42f581586 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:50.223582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95135b55-15d0-42e1-887e-bae42f581586 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:50.230767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e4a8f-538c-4da2-a21b-b16f5976981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:50.230767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e4a8f-538c-4da2-a21b-b16f5976981c admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:50.230767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e4a8f-538c-4da2-a21b-b16f5976981c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:50.230767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e4a8f-538c-4da2-a21b-b16f5976981c admin admin] PATH_INFO: `/v3/projects/2a90195e03474f0eba6c1eb5f3edd17b/users/2f1aa4d09b264747a8ae59412343a4d8/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:50.251601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e4a8f-538c-4da2-a21b-b16f5976981c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a90195e03474f0eba6c1eb5f3edd17b, user_id=2f1aa4d09b264747a8ae59412343a4d8, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:50.254411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e4a8f-538c-4da2-a21b-b16f5976981c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:50.351090 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 866/1734] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:50 2022] PUT /identity/v3/projects/2a90195e03474f0eba6c1eb5f3edd17b/users/2f1aa4d09b264747a8ae59412343a4d8/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:50.355903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242a089-63d5-4523-b44a-305d55267ed4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:50.369293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242a089-63d5-4523-b44a-305d55267ed4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:50.374014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e62b5-9cf0-46fe-9bc5-6e840d7489cd None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:50.374326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e62b5-9cf0-46fe-9bc5-6e840d7489cd None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:50.374602 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e62b5-9cf0-46fe-9bc5-6e840d7489cd None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:50.375974 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 867/1735] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:19:50.380843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e62b5-9cf0-46fe-9bc5-6e840d7489cd None None] Authenticating service token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:19:50.382986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-334e62b5-9cf0-46fe-9bc5-6e840d7489cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:50.441816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b8577-783b-47d4-89f0-98a01041647c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:50.442558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b8577-783b-47d4-89f0-98a01041647c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:50.442854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b8577-783b-47d4-89f0-98a01041647c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:50.443425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b8577-783b-47d4-89f0-98a01041647c admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:50.444259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b8577-783b-47d4-89f0-98a01041647c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:50.446312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b8577-783b-47d4-89f0-98a01041647c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:50.460644 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 869/1736] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:19:50.462936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b8577-783b-47d4-89f0-98a01041647c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:50.480198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b8577-783b-47d4-89f0-98a01041647c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:50.486160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef887b-e6ee-4869-97b1-bac96675cb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:50.487139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef887b-e6ee-4869-97b1-bac96675cb7b admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:50.487420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef887b-e6ee-4869-97b1-bac96675cb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:50.487711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef887b-e6ee-4869-97b1-bac96675cb7b admin admin] PATH_INFO: `/v3/projects/2a90195e03474f0eba6c1eb5f3edd17b/users/2f1aa4d09b264747a8ae59412343a4d8/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:50.489910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef887b-e6ee-4869-97b1-bac96675cb7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a90195e03474f0eba6c1eb5f3edd17b, user_id=2f1aa4d09b264747a8ae59412343a4d8, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:50.493244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef887b-e6ee-4869-97b1-bac96675cb7b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:50.497491 ncdv-master-1 devstack@keystone.service[91118]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-334e62b5-9cf0-46fe-9bc5-6e840d7489cd None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. May 02 10:19:50.497907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e62b5-9cf0-46fe-9bc5-6e840d7489cd None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:50.506014 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 870/1737] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:50 2022] PUT /identity/v3/projects/2a90195e03474f0eba6c1eb5f3edd17b/users/2f1aa4d09b264747a8ae59412343a4d8/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:19:50.525357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf15172-8bf5-4dbc-b2c1-8bf3ba09d84d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:50.525756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf15172-8bf5-4dbc-b2c1-8bf3ba09d84d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:50.526075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf15172-8bf5-4dbc-b2c1-8bf3ba09d84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:50.555332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6bf15172-8bf5-4dbc-b2c1-8bf3ba09d84d None None] MFA Rules not processed for user `2f1aa4d09b264747a8ae59412343a4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:50.557368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6bf15172-8bf5-4dbc-b2c1-8bf3ba09d84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:50.596516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e62b5-9cf0-46fe-9bc5-6e840d7489cd None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:50.660982 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 871/1738] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:50.662569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ae320-e01b-4db2-8d94-f732363be73c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:50.662973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ae320-e01b-4db2-8d94-f732363be73c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:50.663364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ae320-e01b-4db2-8d94-f732363be73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:50.702842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d46ae320-e01b-4db2-8d94-f732363be73c None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:50.702842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d46ae320-e01b-4db2-8d94-f732363be73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:50.708591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673d09b-4136-4a3a-a1c9-727d1c8d3871 tempest-FlavorsAccessTestJSON-820855900 tempest-FlavorsAccessTestJSON-820855900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e594c41acd384285800096d3fe31305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9051f063c82149c7a65b85fa5a93ba1d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:50.709653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673d09b-4136-4a3a-a1c9-727d1c8d3871 tempest-FlavorsAccessTestJSON-820855900 tempest-FlavorsAccessTestJSON-820855900-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:50.710012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673d09b-4136-4a3a-a1c9-727d1c8d3871 tempest-FlavorsAccessTestJSON-820855900 tempest-FlavorsAccessTestJSON-820855900-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:50.710366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673d09b-4136-4a3a-a1c9-727d1c8d3871 tempest-FlavorsAccessTestJSON-820855900 tempest-FlavorsAccessTestJSON-820855900-project-admin] PATH_INFO: `/v3/projects/975d62b4b18f41059bd8222ba2daee63` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:50.711663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673d09b-4136-4a3a-a1c9-727d1c8d3871 tempest-FlavorsAccessTestJSON-820855900 tempest-FlavorsAccessTestJSON-820855900-project-admin] RBAC: Authorizing `identity:get_project(project_id=975d62b4b18f41059bd8222ba2daee63)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:50.714612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673d09b-4136-4a3a-a1c9-727d1c8d3871 tempest-FlavorsAccessTestJSON-820855900 tempest-FlavorsAccessTestJSON-820855900-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:50.716590 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 868/1739] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:19:50 2022] GET /identity/v3/projects/975d62b4b18f41059bd8222ba2daee63 => generated 377 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:19:50.717666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673d09b-4136-4a3a-a1c9-727d1c8d3871 tempest-FlavorsAccessTestJSON-820855900 tempest-FlavorsAccessTestJSON-820855900-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:50.779077 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 872/1740] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:19:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:50.810833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673d09b-4136-4a3a-a1c9-727d1c8d3871 tempest-FlavorsAccessTestJSON-820855900 tempest-FlavorsAccessTestJSON-820855900-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:50.816835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968ba04-83ef-4835-9b2f-e419d3863617 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:50.817557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968ba04-83ef-4835-9b2f-e419d3863617 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:50.817867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968ba04-83ef-4835-9b2f-e419d3863617 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:50.818152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968ba04-83ef-4835-9b2f-e419d3863617 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:50.828652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968ba04-83ef-4835-9b2f-e419d3863617 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:50.828652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968ba04-83ef-4835-9b2f-e419d3863617 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:50.839436 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 869/1741] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:19:50.927163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ae320-e01b-4db2-8d94-f732363be73c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:50.964067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968ba04-83ef-4835-9b2f-e419d3863617 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:50.979423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968ba04-83ef-4835-9b2f-e419d3863617 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:50.989689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d05b58-5e66-4806-8402-c8fbfea27cf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:50.990627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d05b58-5e66-4806-8402-c8fbfea27cf8 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:50.990977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d05b58-5e66-4806-8402-c8fbfea27cf8 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:50.994751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d05b58-5e66-4806-8402-c8fbfea27cf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:50.994751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-61d05b58-5e66-4806-8402-c8fbfea27cf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:51.031358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ae320-e01b-4db2-8d94-f732363be73c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:51.041753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649bde8-c51d-4853-8504-0c7ddba24427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:51.043066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649bde8-c51d-4853-8504-0c7ddba24427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:51.043066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649bde8-c51d-4853-8504-0c7ddba24427 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:51.043299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649bde8-c51d-4853-8504-0c7ddba24427 admin admin] PATH_INFO: `/v3/users/54561050be124707b99e498995040486` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:51.045117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649bde8-c51d-4853-8504-0c7ddba24427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54561050be124707b99e498995040486)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:51.047871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649bde8-c51d-4853-8504-0c7ddba24427 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:51.067924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d05b58-5e66-4806-8402-c8fbfea27cf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:51.069938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d05b58-5e66-4806-8402-c8fbfea27cf8 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:51.095020 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 870/1742] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:19:51.183385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee064-e885-4447-b125-4ebc3af726f2 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:51.183991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee064-e885-4447-b125-4ebc3af726f2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:51.184072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bee064-e885-4447-b125-4ebc3af726f2 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:51.187961 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 871/1743] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:19:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 10:19:51.191285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bee064-e885-4447-b125-4ebc3af726f2 None None] Authenticating service token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:19:51.210096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bee064-e885-4447-b125-4ebc3af726f2 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:51.221877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bee064-e885-4447-b125-4ebc3af726f2 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:51.228121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a328314-c4c2-41f1-830c-1c20376e8f4c tempest-FlavorsAccessTestJSON-820855900 tempest-FlavorsAccessTestJSON-820855900-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e594c41acd384285800096d3fe31305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9051f063c82149c7a65b85fa5a93ba1d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:51.229203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a328314-c4c2-41f1-830c-1c20376e8f4c tempest-FlavorsAccessTestJSON-820855900 tempest-FlavorsAccessTestJSON-820855900-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:51.229563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a328314-c4c2-41f1-830c-1c20376e8f4c tempest-FlavorsAccessTestJSON-820855900 tempest-FlavorsAccessTestJSON-820855900-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:51.230170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a328314-c4c2-41f1-830c-1c20376e8f4c tempest-FlavorsAccessTestJSON-820855900 tempest-FlavorsAccessTestJSON-820855900-project-admin] PATH_INFO: `/v3/projects/975d62b4b18f41059bd8222ba2daee63` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:51.231634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a328314-c4c2-41f1-830c-1c20376e8f4c tempest-FlavorsAccessTestJSON-820855900 tempest-FlavorsAccessTestJSON-820855900-project-admin] RBAC: Authorizing `identity:get_project(project_id=975d62b4b18f41059bd8222ba2daee63)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:51.234060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a328314-c4c2-41f1-830c-1c20376e8f4c tempest-FlavorsAccessTestJSON-820855900 tempest-FlavorsAccessTestJSON-820855900-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:51.249061 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 872/1744] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:19:51 2022] GET /identity/v3/projects/975d62b4b18f41059bd8222ba2daee63 => generated 377 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:19:51.254565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a328314-c4c2-41f1-830c-1c20376e8f4c tempest-FlavorsAccessTestJSON-820855900 tempest-FlavorsAccessTestJSON-820855900-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:51.257024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4a328314-c4c2-41f1-830c-1c20376e8f4c tempest-FlavorsAccessTestJSON-820855900 tempest-FlavorsAccessTestJSON-820855900-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:51.330277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a328314-c4c2-41f1-830c-1c20376e8f4c tempest-FlavorsAccessTestJSON-820855900 tempest-FlavorsAccessTestJSON-820855900-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:51.335734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e4fc9-5768-47a5-bc56-08388d643c91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:51.336395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e4fc9-5768-47a5-bc56-08388d643c91 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:51.336732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e4fc9-5768-47a5-bc56-08388d643c91 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:51.337620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e4fc9-5768-47a5-bc56-08388d643c91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:51.347033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e4fc9-5768-47a5-bc56-08388d643c91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:51.348580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e4fc9-5768-47a5-bc56-08388d643c91 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:51.369796 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 873/1745] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:19:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 02 10:19:51.419812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3649bde8-c51d-4853-8504-0c7ddba24427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54561050be124707b99e498995040486'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:51.445145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3649bde8-c51d-4853-8504-0c7ddba24427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54561050be124707b99e498995040486'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:51.446047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3649bde8-c51d-4853-8504-0c7ddba24427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54561050be124707b99e498995040486'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:51.466220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3649bde8-c51d-4853-8504-0c7ddba24427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54561050be124707b99e498995040486'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:51.521529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432579db-03e9-4227-82f0-6c902b93c111 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:51.521993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432579db-03e9-4227-82f0-6c902b93c111 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:51.523863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432579db-03e9-4227-82f0-6c902b93c111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:51.557395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3649bde8-c51d-4853-8504-0c7ddba24427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54561050be124707b99e498995040486'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:51.564571 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 873/1746] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:19:50 2022] DELETE /identity/v3/users/54561050be124707b99e498995040486 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:51.569197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22793a71-4080-46e8-9792-d25f794d569b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:51.569598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22793a71-4080-46e8-9792-d25f794d569b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:51.569978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22793a71-4080-46e8-9792-d25f794d569b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:51.571185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-432579db-03e9-4227-82f0-6c902b93c111 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:51.577509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-432579db-03e9-4227-82f0-6c902b93c111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:51.626312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-22793a71-4080-46e8-9792-d25f794d569b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:51.628865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-22793a71-4080-46e8-9792-d25f794d569b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:51.764286 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 874/1747] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:19:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:19:51.774048 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 874/1748] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:51.780787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cffb97-1471-4458-bad9-c267136c0440 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:51.781151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cffb97-1471-4458-bad9-c267136c0440 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:51.782322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cffb97-1471-4458-bad9-c267136c0440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:51.782511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432579db-03e9-4227-82f0-6c902b93c111 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:51.785240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-432579db-03e9-4227-82f0-6c902b93c111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:51.875532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-84cffb97-1471-4458-bad9-c267136c0440 None None] MFA Rules not processed for user `4cd9fe10f94f43aeb3eb10009ee96ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:51.876820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-84cffb97-1471-4458-bad9-c267136c0440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:51.895427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432579db-03e9-4227-82f0-6c902b93c111 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:51.900932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea3c6a-696e-40a6-bc80-0c954975db72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:51.902096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea3c6a-696e-40a6-bc80-0c954975db72 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:51.902554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea3c6a-696e-40a6-bc80-0c954975db72 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:51.904145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea3c6a-696e-40a6-bc80-0c954975db72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:51.914324 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 875/1749] 10.222.0.15 () {58 vars in 1015 bytes} [Mon May 2 10:19:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:51.916108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cffb97-1471-4458-bad9-c267136c0440 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:51.918916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-84cffb97-1471-4458-bad9-c267136c0440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:51.942760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea3c6a-696e-40a6-bc80-0c954975db72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:51.952555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea3c6a-696e-40a6-bc80-0c954975db72 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:51.987974 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 875/1750] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:19:51.996008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea3c6a-696e-40a6-bc80-0c954975db72 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:52.011898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea3c6a-696e-40a6-bc80-0c954975db72 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:52.021202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f6692-2c63-4de9-87bb-901ff60abee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:52.022926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f6692-2c63-4de9-87bb-901ff60abee8 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:52.023441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f6692-2c63-4de9-87bb-901ff60abee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:52.024097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f6692-2c63-4de9-87bb-901ff60abee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:52.045348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f6692-2c63-4de9-87bb-901ff60abee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:52.048537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f6692-2c63-4de9-87bb-901ff60abee8 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:52.066483 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 876/1751] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:19:52.087437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cffb97-1471-4458-bad9-c267136c0440 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:52.095332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c46a2-9451-412b-90ab-0b9905358593 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:52.096241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c46a2-9451-412b-90ab-0b9905358593 service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:52.096911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c46a2-9451-412b-90ab-0b9905358593 service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:52.097359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c46a2-9451-412b-90ab-0b9905358593 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:52.132370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c46a2-9451-412b-90ab-0b9905358593 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:52.144929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c46a2-9451-412b-90ab-0b9905358593 service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:52.188212 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 876/1752] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:19:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:19:52.406796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f6692-2c63-4de9-87bb-901ff60abee8 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:52.409419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-009f6692-2c63-4de9-87bb-901ff60abee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:52.448994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f6692-2c63-4de9-87bb-901ff60abee8 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:52.464742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241f6cf-ad9a-42cb-9af7-fdfed557a671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:52.465663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241f6cf-ad9a-42cb-9af7-fdfed557a671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:52.468111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241f6cf-ad9a-42cb-9af7-fdfed557a671 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:52.468402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241f6cf-ad9a-42cb-9af7-fdfed557a671 admin admin] PATH_INFO: `/v3/users/af12f31b03914517a84a3648da847aba` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:52.471649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241f6cf-ad9a-42cb-9af7-fdfed557a671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af12f31b03914517a84a3648da847aba)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:52.477509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241f6cf-ad9a-42cb-9af7-fdfed557a671 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:52.718997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d241f6cf-ad9a-42cb-9af7-fdfed557a671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af12f31b03914517a84a3648da847aba'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:52.762991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d241f6cf-ad9a-42cb-9af7-fdfed557a671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af12f31b03914517a84a3648da847aba'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:52.764004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d241f6cf-ad9a-42cb-9af7-fdfed557a671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af12f31b03914517a84a3648da847aba'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:52.779827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d241f6cf-ad9a-42cb-9af7-fdfed557a671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af12f31b03914517a84a3648da847aba'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:52.794086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c46a2-9451-412b-90ab-0b9905358593 service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:52.796142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fc8c46a2-9451-412b-90ab-0b9905358593 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:52.851118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c46a2-9451-412b-90ab-0b9905358593 service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:52.882175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d7a1c-99c9-488f-b2c4-782a3db76dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:52.883468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d7a1c-99c9-488f-b2c4-782a3db76dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:52.887097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d7a1c-99c9-488f-b2c4-782a3db76dad admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:52.887097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d7a1c-99c9-488f-b2c4-782a3db76dad admin admin] PATH_INFO: `/v3/users/3c1bea55263d48f59806cde80c584bf0` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:52.887097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d7a1c-99c9-488f-b2c4-782a3db76dad admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c1bea55263d48f59806cde80c584bf0)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:52.896063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d7a1c-99c9-488f-b2c4-782a3db76dad admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:52.903430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d241f6cf-ad9a-42cb-9af7-fdfed557a671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af12f31b03914517a84a3648da847aba'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:52.910103 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 877/1753] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:19:52 2022] DELETE /identity/v3/users/af12f31b03914517a84a3648da847aba => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:52.914784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c151e9-dc3c-446d-a897-df1db998597a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:52.915746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c151e9-dc3c-446d-a897-df1db998597a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:52.916147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c151e9-dc3c-446d-a897-df1db998597a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:53.001535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-31c151e9-dc3c-446d-a897-df1db998597a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:53.003294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-31c151e9-dc3c-446d-a897-df1db998597a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:53.189214 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 878/1754] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:19:53.245460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c151e9-dc3c-446d-a897-df1db998597a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:53.245460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-31c151e9-dc3c-446d-a897-df1db998597a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:53.403080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c151e9-dc3c-446d-a897-df1db998597a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:53.407339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6dfc13-1dc5-4c7d-b1da-bee98eec918d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:53.408007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6dfc13-1dc5-4c7d-b1da-bee98eec918d service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:53.408271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6dfc13-1dc5-4c7d-b1da-bee98eec918d service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:53.408546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6dfc13-1dc5-4c7d-b1da-bee98eec918d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:53.449106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6dfc13-1dc5-4c7d-b1da-bee98eec918d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:53.450557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6dfc13-1dc5-4c7d-b1da-bee98eec918d service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:53.483685 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 879/1755] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:19:53.636071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-511d7a1c-99c9-488f-b2c4-782a3db76dad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c1bea55263d48f59806cde80c584bf0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:53.667387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-511d7a1c-99c9-488f-b2c4-782a3db76dad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c1bea55263d48f59806cde80c584bf0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:53.668141 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-511d7a1c-99c9-488f-b2c4-782a3db76dad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c1bea55263d48f59806cde80c584bf0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:53.676204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-511d7a1c-99c9-488f-b2c4-782a3db76dad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c1bea55263d48f59806cde80c584bf0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:53.774034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-511d7a1c-99c9-488f-b2c4-782a3db76dad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c1bea55263d48f59806cde80c584bf0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:53.783461 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 877/1756] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:19:52 2022] DELETE /identity/v3/users/3c1bea55263d48f59806cde80c584bf0 => generated 0 bytes in 988 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:53.786804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afef070-b2fd-4645-bb89-fab28dc0e5d4 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:53.787089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afef070-b2fd-4645-bb89-fab28dc0e5d4 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:53.787369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afef070-b2fd-4645-bb89-fab28dc0e5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:53.819800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1afef070-b2fd-4645-bb89-fab28dc0e5d4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:53.821591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1afef070-b2fd-4645-bb89-fab28dc0e5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:53.973159 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 880/1757] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:54.005828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d7a1c-99c9-488f-b2c4-782a3db76dad admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:54.007430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-511d7a1c-99c9-488f-b2c4-782a3db76dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:54.126373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d7a1c-99c9-488f-b2c4-782a3db76dad admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:54.130158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae3ca8-4758-4c67-9edb-6ecfc99154d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:54.130829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae3ca8-4758-4c67-9edb-6ecfc99154d2 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:54.131108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae3ca8-4758-4c67-9edb-6ecfc99154d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:54.131384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae3ca8-4758-4c67-9edb-6ecfc99154d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:54.158031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae3ca8-4758-4c67-9edb-6ecfc99154d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:54.159347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae3ca8-4758-4c67-9edb-6ecfc99154d2 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:54.176632 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 878/1758] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:19:54.430740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afef070-b2fd-4645-bb89-fab28dc0e5d4 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:54.432475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1afef070-b2fd-4645-bb89-fab28dc0e5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:54.458503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afef070-b2fd-4645-bb89-fab28dc0e5d4 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:54.487042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081c51a-f4c4-45df-8064-f92d984feacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:54.487941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081c51a-f4c4-45df-8064-f92d984feacf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:54.488341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081c51a-f4c4-45df-8064-f92d984feacf admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:54.488637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081c51a-f4c4-45df-8064-f92d984feacf admin admin] PATH_INFO: `/v3/projects/5225762cb407423cb647044837c61346` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:54.492035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081c51a-f4c4-45df-8064-f92d984feacf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5225762cb407423cb647044837c61346)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:54.511075 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081c51a-f4c4-45df-8064-f92d984feacf admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:54.677133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9081c51a-f4c4-45df-8064-f92d984feacf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5225762cb407423cb647044837c61346', 'request_id': 'req-9081c51a-f4c4-45df-8064-f92d984feacf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:54.762133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9081c51a-f4c4-45df-8064-f92d984feacf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5225762cb407423cb647044837c61346', 'request_id': 'req-9081c51a-f4c4-45df-8064-f92d984feacf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:54.770828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9081c51a-f4c4-45df-8064-f92d984feacf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5225762cb407423cb647044837c61346', 'request_id': 'req-9081c51a-f4c4-45df-8064-f92d984feacf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:54.809635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9081c51a-f4c4-45df-8064-f92d984feacf admin admin] The token cache is being invalidate because project 5225762cb407423cb647044837c61346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:19:54.810199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9081c51a-f4c4-45df-8064-f92d984feacf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:54.811710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9081c51a-f4c4-45df-8064-f92d984feacf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:54.820458 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 881/1759] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:19:54 2022] DELETE /identity/v3/projects/5225762cb407423cb647044837c61346 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:54.824364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae3ca8-4758-4c67-9edb-6ecfc99154d2 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:54.839763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae3ca8-4758-4c67-9edb-6ecfc99154d2 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:55.068364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88daaf-5409-4ce9-b4aa-87043c111f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:55.072096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88daaf-5409-4ce9-b4aa-87043c111f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:55.074685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88daaf-5409-4ce9-b4aa-87043c111f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:55.077295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88daaf-5409-4ce9-b4aa-87043c111f18 admin admin] PATH_INFO: `/v3/users/2f1aa4d09b264747a8ae59412343a4d8` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:55.085268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88daaf-5409-4ce9-b4aa-87043c111f18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f1aa4d09b264747a8ae59412343a4d8)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:55.094978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88daaf-5409-4ce9-b4aa-87043c111f18 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:55.265494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79e479-e26d-4444-97f8-a328b6900171 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:55.265793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79e479-e26d-4444-97f8-a328b6900171 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:55.266165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79e479-e26d-4444-97f8-a328b6900171 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:55.275118 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 882/1760] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:19:55 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:19:55.287806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae3e61-71bc-4114-b827-38234e452a3d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:55.288276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae3e61-71bc-4114-b827-38234e452a3d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:55.288785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae3e61-71bc-4114-b827-38234e452a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:55.358206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-94ae3e61-71bc-4114-b827-38234e452a3d None None] MFA Rules not processed for user `e6036dd39fb74289a8cbdcd6a21f8662`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:55.366012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-94ae3e61-71bc-4114-b827-38234e452a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:55.440419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ee88daaf-5409-4ce9-b4aa-87043c111f18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f1aa4d09b264747a8ae59412343a4d8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:55.479879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ee88daaf-5409-4ce9-b4aa-87043c111f18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f1aa4d09b264747a8ae59412343a4d8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:55.480964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ee88daaf-5409-4ce9-b4aa-87043c111f18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f1aa4d09b264747a8ae59412343a4d8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:55.516114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ee88daaf-5409-4ce9-b4aa-87043c111f18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f1aa4d09b264747a8ae59412343a4d8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:55.625447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ee88daaf-5409-4ce9-b4aa-87043c111f18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f1aa4d09b264747a8ae59412343a4d8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:55.630218 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 883/1761] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:19:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:55.646977 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 879/1762] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:19:54 2022] DELETE /identity/v3/users/2f1aa4d09b264747a8ae59412343a4d8 => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:55.715959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae3e61-71bc-4114-b827-38234e452a3d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:55.717819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-94ae3e61-71bc-4114-b827-38234e452a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:55.742435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae3e61-71bc-4114-b827-38234e452a3d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:55.934660 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd09abe-34e1-4f32-8c36-f630d3e3e81f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:55.936386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd09abe-34e1-4f32-8c36-f630d3e3e81f service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:55.937430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd09abe-34e1-4f32-8c36-f630d3e3e81f service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:55.937783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd09abe-34e1-4f32-8c36-f630d3e3e81f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:55.943096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bcd09abe-34e1-4f32-8c36-f630d3e3e81f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:55.987880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd09abe-34e1-4f32-8c36-f630d3e3e81f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:55.993217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd09abe-34e1-4f32-8c36-f630d3e3e81f service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:56.038588 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 884/1763] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:19:56.894644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88daaf-5409-4ce9-b4aa-87043c111f18 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:56.900225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ee88daaf-5409-4ce9-b4aa-87043c111f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:56.905848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f056e1-af7d-4a76-a1e7-95222bc4db2b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:56.906941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f056e1-af7d-4a76-a1e7-95222bc4db2b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:56.907383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f056e1-af7d-4a76-a1e7-95222bc4db2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:56.951148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-47f056e1-af7d-4a76-a1e7-95222bc4db2b None None] MFA Rules not processed for user `4cd9fe10f94f43aeb3eb10009ee96ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:56.953494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-47f056e1-af7d-4a76-a1e7-95222bc4db2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:57.054920 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 885/1764] 10.222.0.24 () {58 vars in 1015 bytes} [Mon May 2 10:19:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:19:57.085757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f056e1-af7d-4a76-a1e7-95222bc4db2b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:57.087515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-47f056e1-af7d-4a76-a1e7-95222bc4db2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:57.101760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f056e1-af7d-4a76-a1e7-95222bc4db2b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:57.110959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e8447-a18c-4386-8405-fef5c7d9c8a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:57.113765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e8447-a18c-4386-8405-fef5c7d9c8a7 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:57.114302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e8447-a18c-4386-8405-fef5c7d9c8a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:57.114796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e8447-a18c-4386-8405-fef5c7d9c8a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:57.131943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e8447-a18c-4386-8405-fef5c7d9c8a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:57.135376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e8447-a18c-4386-8405-fef5c7d9c8a7 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:57.145677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88daaf-5409-4ce9-b4aa-87043c111f18 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:57.158493 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 886/1765] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:19:57.162335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5aade-b0f9-4395-9655-4d4ca3eee1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:57.163549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5aade-b0f9-4395-9655-4d4ca3eee1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:57.163857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5aade-b0f9-4395-9655-4d4ca3eee1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:57.164923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5aade-b0f9-4395-9655-4d4ca3eee1dc admin admin] PATH_INFO: `/v3/projects/20ebdc8b202e49338906cb8641faee94` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:57.166249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5aade-b0f9-4395-9655-4d4ca3eee1dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=20ebdc8b202e49338906cb8641faee94)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:57.169711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5aade-b0f9-4395-9655-4d4ca3eee1dc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:57.354812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3db5aade-b0f9-4395-9655-4d4ca3eee1dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20ebdc8b202e49338906cb8641faee94', 'request_id': 'req-3db5aade-b0f9-4395-9655-4d4ca3eee1dc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:57.375368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3db5aade-b0f9-4395-9655-4d4ca3eee1dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20ebdc8b202e49338906cb8641faee94', 'request_id': 'req-3db5aade-b0f9-4395-9655-4d4ca3eee1dc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:57.387696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e8447-a18c-4386-8405-fef5c7d9c8a7 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:57.390086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e03e8447-a18c-4386-8405-fef5c7d9c8a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:57.421375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e8447-a18c-4386-8405-fef5c7d9c8a7 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:57.475134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3db5aade-b0f9-4395-9655-4d4ca3eee1dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20ebdc8b202e49338906cb8641faee94', 'request_id': 'req-3db5aade-b0f9-4395-9655-4d4ca3eee1dc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:57.493512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3db5aade-b0f9-4395-9655-4d4ca3eee1dc admin admin] The token cache is being invalidate because project 20ebdc8b202e49338906cb8641faee94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:19:57.504218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3db5aade-b0f9-4395-9655-4d4ca3eee1dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:57.504218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3db5aade-b0f9-4395-9655-4d4ca3eee1dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:57.504218 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 880/1766] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:19:56 2022] DELETE /identity/v3/projects/20ebdc8b202e49338906cb8641faee94 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:57.504218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5aade-b0f9-4395-9655-4d4ca3eee1dc admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:57.508489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3db5aade-b0f9-4395-9655-4d4ca3eee1dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:57.632882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754157d2-4aea-415e-91b6-53d982aa05d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:57.636326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754157d2-4aea-415e-91b6-53d982aa05d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:57.637282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754157d2-4aea-415e-91b6-53d982aa05d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:57.637642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754157d2-4aea-415e-91b6-53d982aa05d9 admin admin] PATH_INFO: `/v3/projects/2a90195e03474f0eba6c1eb5f3edd17b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:57.642852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754157d2-4aea-415e-91b6-53d982aa05d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a90195e03474f0eba6c1eb5f3edd17b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:57.649849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754157d2-4aea-415e-91b6-53d982aa05d9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:57.818292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5aade-b0f9-4395-9655-4d4ca3eee1dc admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:57.839313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215ad1b-fc1e-40a0-8b4e-68178ddf003f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:57.840623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215ad1b-fc1e-40a0-8b4e-68178ddf003f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:57.841385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215ad1b-fc1e-40a0-8b4e-68178ddf003f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:57.845170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215ad1b-fc1e-40a0-8b4e-68178ddf003f admin admin] PATH_INFO: `/v3/users/53920c0016c54ca2a94f89f4d323c34c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:57.845170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215ad1b-fc1e-40a0-8b4e-68178ddf003f admin admin] RBAC: Authorizing `identity:delete_user(user_id=53920c0016c54ca2a94f89f4d323c34c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:57.846522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215ad1b-fc1e-40a0-8b4e-68178ddf003f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:57.873494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-754157d2-4aea-415e-91b6-53d982aa05d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a90195e03474f0eba6c1eb5f3edd17b', 'request_id': 'req-754157d2-4aea-415e-91b6-53d982aa05d9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:57.963800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-754157d2-4aea-415e-91b6-53d982aa05d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a90195e03474f0eba6c1eb5f3edd17b', 'request_id': 'req-754157d2-4aea-415e-91b6-53d982aa05d9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:57.974230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-754157d2-4aea-415e-91b6-53d982aa05d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a90195e03474f0eba6c1eb5f3edd17b', 'request_id': 'req-754157d2-4aea-415e-91b6-53d982aa05d9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:58.030799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-754157d2-4aea-415e-91b6-53d982aa05d9 admin admin] The token cache is being invalidate because project 2a90195e03474f0eba6c1eb5f3edd17b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:19:58.035517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-754157d2-4aea-415e-91b6-53d982aa05d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:58.048413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-754157d2-4aea-415e-91b6-53d982aa05d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:58.058745 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 887/1767] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:19:57 2022] DELETE /identity/v3/projects/2a90195e03474f0eba6c1eb5f3edd17b => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:58.065204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754157d2-4aea-415e-91b6-53d982aa05d9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:58.071595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-754157d2-4aea-415e-91b6-53d982aa05d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:58.150916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8215ad1b-fc1e-40a0-8b4e-68178ddf003f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53920c0016c54ca2a94f89f4d323c34c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:58.170977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8215ad1b-fc1e-40a0-8b4e-68178ddf003f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53920c0016c54ca2a94f89f4d323c34c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:58.172713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8215ad1b-fc1e-40a0-8b4e-68178ddf003f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53920c0016c54ca2a94f89f4d323c34c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:58.194497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8215ad1b-fc1e-40a0-8b4e-68178ddf003f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53920c0016c54ca2a94f89f4d323c34c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:58.265251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8215ad1b-fc1e-40a0-8b4e-68178ddf003f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53920c0016c54ca2a94f89f4d323c34c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:58.275306 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 881/1768] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:19:57 2022] DELETE /identity/v3/users/53920c0016c54ca2a94f89f4d323c34c => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:58.276977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb41703-ca97-40eb-adab-a4501b9eef93 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:58.279668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb41703-ca97-40eb-adab-a4501b9eef93 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:58.281146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb41703-ca97-40eb-adab-a4501b9eef93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:58.286959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754157d2-4aea-415e-91b6-53d982aa05d9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:58.341960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8fb41703-ca97-40eb-adab-a4501b9eef93 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:58.349895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8fb41703-ca97-40eb-adab-a4501b9eef93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:58.450890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6235a7-b141-4923-9b42-e27b7e914748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:58.457409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6235a7-b141-4923-9b42-e27b7e914748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:58.457753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6235a7-b141-4923-9b42-e27b7e914748 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:58.458002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6235a7-b141-4923-9b42-e27b7e914748 admin admin] PATH_INFO: `/v3/projects/975d62b4b18f41059bd8222ba2daee63` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:58.462007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6235a7-b141-4923-9b42-e27b7e914748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=975d62b4b18f41059bd8222ba2daee63)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:58.466753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6235a7-b141-4923-9b42-e27b7e914748 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:58.536193 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 882/1769] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:58.545673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4dff3-4fa9-4ff9-a67e-c785195ffcfb None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:58.546397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4dff3-4fa9-4ff9-a67e-c785195ffcfb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:58.547057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4dff3-4fa9-4ff9-a67e-c785195ffcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:58.594444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a5b4dff3-4fa9-4ff9-a67e-c785195ffcfb None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:58.597283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a5b4dff3-4fa9-4ff9-a67e-c785195ffcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:58.668787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0c6235a7-b141-4923-9b42-e27b7e914748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '975d62b4b18f41059bd8222ba2daee63', 'request_id': 'req-0c6235a7-b141-4923-9b42-e27b7e914748'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:58.735215 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 883/1770] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:19:58.737335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc3716-f719-46e8-897d-dd17159778a0 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:58.737739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc3716-f719-46e8-897d-dd17159778a0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:58.738855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc3716-f719-46e8-897d-dd17159778a0 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:58.744190 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 884/1771] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:19:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:19:58.745355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc3716-f719-46e8-897d-dd17159778a0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:58.779389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0c6235a7-b141-4923-9b42-e27b7e914748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '975d62b4b18f41059bd8222ba2daee63', 'request_id': 'req-0c6235a7-b141-4923-9b42-e27b7e914748'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:58.787060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0c6235a7-b141-4923-9b42-e27b7e914748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '975d62b4b18f41059bd8222ba2daee63', 'request_id': 'req-0c6235a7-b141-4923-9b42-e27b7e914748'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:58.811909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0c6235a7-b141-4923-9b42-e27b7e914748 admin admin] The token cache is being invalidate because project 975d62b4b18f41059bd8222ba2daee63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:19:58.812272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0c6235a7-b141-4923-9b42-e27b7e914748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:58.813128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0c6235a7-b141-4923-9b42-e27b7e914748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:58.820390 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 888/1772] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:19:58 2022] DELETE /identity/v3/projects/975d62b4b18f41059bd8222ba2daee63 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:58.821824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db44d6-6dce-46d0-9382-5b85def25016 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:58.822116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db44d6-6dce-46d0-9382-5b85def25016 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:58.822401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db44d6-6dce-46d0-9382-5b85def25016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:58.823684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc3716-f719-46e8-897d-dd17159778a0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:58.833239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffa20b-a8ec-4877-be2e-45514b889c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:58.835393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffa20b-a8ec-4877-be2e-45514b889c93 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:58.835687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffa20b-a8ec-4877-be2e-45514b889c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:58.835972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffa20b-a8ec-4877-be2e-45514b889c93 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:58.839276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffa20b-a8ec-4877-be2e-45514b889c93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:19:58.839618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffa20b-a8ec-4877-be2e-45514b889c93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:58.843824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffa20b-a8ec-4877-be2e-45514b889c93 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:58.870574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d4db44d6-6dce-46d0-9382-5b85def25016 None None] MFA Rules not processed for user `e6036dd39fb74289a8cbdcd6a21f8662`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:19:58.874955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d4db44d6-6dce-46d0-9382-5b85def25016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:58.878822 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 885/1773] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:19:58.879749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffa20b-a8ec-4877-be2e-45514b889c93 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:58.884027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-46ffa20b-a8ec-4877-be2e-45514b889c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:58.926485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffa20b-a8ec-4877-be2e-45514b889c93 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:58.942898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9ee04-6027-4ade-838b-1432a1dbed00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:58.948804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9ee04-6027-4ade-838b-1432a1dbed00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:58.948804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9ee04-6027-4ade-838b-1432a1dbed00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:58.948804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9ee04-6027-4ade-838b-1432a1dbed00 admin admin] PATH_INFO: `/v3/users/e594c41acd384285800096d3fe31305c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:58.950970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9ee04-6027-4ade-838b-1432a1dbed00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e594c41acd384285800096d3fe31305c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:58.958100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9ee04-6027-4ade-838b-1432a1dbed00 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:59.111609 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 889/1774] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:19:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:19:59.111609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db44d6-6dce-46d0-9382-5b85def25016 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:59.111609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d4db44d6-6dce-46d0-9382-5b85def25016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:59.126941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db44d6-6dce-46d0-9382-5b85def25016 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:59.135491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8c2ed-16b9-4a11-9ffd-374bc4814cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:59.135491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8c2ed-16b9-4a11-9ffd-374bc4814cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:59.135491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8c2ed-16b9-4a11-9ffd-374bc4814cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:59.135491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8c2ed-16b9-4a11-9ffd-374bc4814cc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:59.135844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8c2ed-16b9-4a11-9ffd-374bc4814cc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:59.137601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8c2ed-16b9-4a11-9ffd-374bc4814cc7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:59.269635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-baf9ee04-6027-4ade-838b-1432a1dbed00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e594c41acd384285800096d3fe31305c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:59.278613 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 890/1775] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:19:59 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:59.279636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8c2ed-16b9-4a11-9ffd-374bc4814cc7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:59.283939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-95d8c2ed-16b9-4a11-9ffd-374bc4814cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:59.333757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-baf9ee04-6027-4ade-838b-1432a1dbed00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e594c41acd384285800096d3fe31305c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:59.333757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-baf9ee04-6027-4ade-838b-1432a1dbed00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e594c41acd384285800096d3fe31305c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:59.355957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-baf9ee04-6027-4ade-838b-1432a1dbed00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e594c41acd384285800096d3fe31305c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:59.432247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-baf9ee04-6027-4ade-838b-1432a1dbed00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e594c41acd384285800096d3fe31305c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:59.457344 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 886/1776] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:19:58 2022] DELETE /identity/v3/users/e594c41acd384285800096d3fe31305c => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:19:59.465370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9ee04-6027-4ade-838b-1432a1dbed00 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:59.468250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-baf9ee04-6027-4ade-838b-1432a1dbed00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:59.535130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8c2ed-16b9-4a11-9ffd-374bc4814cc7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:59.618577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9ee04-6027-4ade-838b-1432a1dbed00 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:59.631826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5cbe6-59b8-449c-bdd2-0fe95d6da7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:59.633964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5cbe6-59b8-449c-bdd2-0fe95d6da7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:59.635752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5cbe6-59b8-449c-bdd2-0fe95d6da7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:59.636352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5cbe6-59b8-449c-bdd2-0fe95d6da7f2 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:59.638405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5cbe6-59b8-449c-bdd2-0fe95d6da7f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:59.644792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5cbe6-59b8-449c-bdd2-0fe95d6da7f2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:59.705241 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb059223-b3a0-46f4-b6b0-3616c097f2cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:59.706129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb059223-b3a0-46f4-b6b0-3616c097f2cb service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:59.706643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb059223-b3a0-46f4-b6b0-3616c097f2cb service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:59.707129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb059223-b3a0-46f4-b6b0-3616c097f2cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:59.709904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bb059223-b3a0-46f4-b6b0-3616c097f2cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:59.724053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb059223-b3a0-46f4-b6b0-3616c097f2cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:59.735833 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 887/1777] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:19:59 2022] POST /identity/v3/users => generated 287 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:19:59.736921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5cbe6-59b8-449c-bdd2-0fe95d6da7f2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:59.737936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb059223-b3a0-46f4-b6b0-3616c097f2cb service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:59.740050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-88c5cbe6-59b8-449c-bdd2-0fe95d6da7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:19:59.762637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5cbe6-59b8-449c-bdd2-0fe95d6da7f2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:59.770280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bae52-0388-4957-a422-a2df22b0ea41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:59.771412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bae52-0388-4957-a422-a2df22b0ea41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:59.771916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bae52-0388-4957-a422-a2df22b0ea41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:59.772339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bae52-0388-4957-a422-a2df22b0ea41 admin admin] PATH_INFO: `/v3/projects/70d574d8a811442aaddf440bc481dcad` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:59.773805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7bae52-0388-4957-a422-a2df22b0ea41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70d574d8a811442aaddf440bc481dcad)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:59.777086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7bae52-0388-4957-a422-a2df22b0ea41 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:59.782044 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 891/1778] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:19:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:19:59.783374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb059223-b3a0-46f4-b6b0-3616c097f2cb service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:59.800852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb059223-b3a0-46f4-b6b0-3616c097f2cb service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:59.811671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e125e75-cf7a-4817-8aec-9022ed71ae4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:59.813230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e125e75-cf7a-4817-8aec-9022ed71ae4f admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:59.813690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e125e75-cf7a-4817-8aec-9022ed71ae4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:59.814103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e125e75-cf7a-4817-8aec-9022ed71ae4f admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:59.815025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e125e75-cf7a-4817-8aec-9022ed71ae4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:59.817165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e125e75-cf7a-4817-8aec-9022ed71ae4f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:59.829450 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 892/1779] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:19:59.834283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e125e75-cf7a-4817-8aec-9022ed71ae4f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:59.846950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e125e75-cf7a-4817-8aec-9022ed71ae4f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:59.853931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2af432-7a45-42ca-8a73-b24d843c506a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:19:59.854707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2af432-7a45-42ca-8a73-b24d843c506a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:19:59.854984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2af432-7a45-42ca-8a73-b24d843c506a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:19:59.855237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2af432-7a45-42ca-8a73-b24d843c506a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:19:59.855948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2af432-7a45-42ca-8a73-b24d843c506a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:19:59.862088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2af432-7a45-42ca-8a73-b24d843c506a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:19:59.888553 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 893/1780] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:19:59.893442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2af432-7a45-42ca-8a73-b24d843c506a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:19:59.911756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7c7bae52-0388-4957-a422-a2df22b0ea41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70d574d8a811442aaddf440bc481dcad', 'request_id': 'req-7c7bae52-0388-4957-a422-a2df22b0ea41'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:19:59.926405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2af432-7a45-42ca-8a73-b24d843c506a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:19:59.949040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7c7bae52-0388-4957-a422-a2df22b0ea41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70d574d8a811442aaddf440bc481dcad', 'request_id': 'req-7c7bae52-0388-4957-a422-a2df22b0ea41'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:00.035338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7c7bae52-0388-4957-a422-a2df22b0ea41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70d574d8a811442aaddf440bc481dcad', 'request_id': 'req-7c7bae52-0388-4957-a422-a2df22b0ea41'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:00.053463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7c7bae52-0388-4957-a422-a2df22b0ea41 admin admin] The token cache is being invalidate because project 70d574d8a811442aaddf440bc481dcad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:00.053828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7c7bae52-0388-4957-a422-a2df22b0ea41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:00.056379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7c7bae52-0388-4957-a422-a2df22b0ea41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:00.061094 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 888/1781] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:19:59 2022] DELETE /identity/v3/projects/70d574d8a811442aaddf440bc481dcad => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:00.066506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03885095-f7fe-45ca-819f-55174d20cadb None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:00.066835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03885095-f7fe-45ca-819f-55174d20cadb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:00.067625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03885095-f7fe-45ca-819f-55174d20cadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:00.080034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62b2ae-6eeb-4474-a323-3f5ba7e2ea7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:00.081942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62b2ae-6eeb-4474-a323-3f5ba7e2ea7a admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:00.082105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62b2ae-6eeb-4474-a323-3f5ba7e2ea7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:00.082365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62b2ae-6eeb-4474-a323-3f5ba7e2ea7a admin admin] PATH_INFO: `/v3/projects/1c3cc59c411a49caaede8817eada1414/users/ddecd6dd81604193898ec29de92098b0/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:00.105714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62b2ae-6eeb-4474-a323-3f5ba7e2ea7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3cc59c411a49caaede8817eada1414, user_id=ddecd6dd81604193898ec29de92098b0, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:00.105959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-03885095-f7fe-45ca-819f-55174d20cadb None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:00.106677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-03885095-f7fe-45ca-819f-55174d20cadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:00.107935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62b2ae-6eeb-4474-a323-3f5ba7e2ea7a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:00.118243 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 889/1782] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:00.128049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7b0cf-074e-405e-a166-c142b93924c4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:00.131021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7b0cf-074e-405e-a166-c142b93924c4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:00.132690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7b0cf-074e-405e-a166-c142b93924c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:00.190254 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 894/1783] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:19:59 2022] PUT /identity/v3/projects/1c3cc59c411a49caaede8817eada1414/users/ddecd6dd81604193898ec29de92098b0/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:00.196866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e7f7b0cf-074e-405e-a166-c142b93924c4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:00.198816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e7f7b0cf-074e-405e-a166-c142b93924c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:00.202327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebec59-80e1-43a5-9fa9-9c7718446ed3 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:00.202950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebec59-80e1-43a5-9fa9-9c7718446ed3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:00.204258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebec59-80e1-43a5-9fa9-9c7718446ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:00.276441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-80ebec59-80e1-43a5-9fa9-9c7718446ed3 None None] MFA Rules not processed for user `ddecd6dd81604193898ec29de92098b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:00.277849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-80ebec59-80e1-43a5-9fa9-9c7718446ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:00.359227 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 890/1784] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:00.360220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7b0cf-074e-405e-a166-c142b93924c4 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:00.388669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7b0cf-074e-405e-a166-c142b93924c4 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:00.407693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417960f-bbc6-4ed6-895a-057bed0f886a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:00.407906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417960f-bbc6-4ed6-895a-057bed0f886a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:00.408216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417960f-bbc6-4ed6-895a-057bed0f886a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:00.408543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417960f-bbc6-4ed6-895a-057bed0f886a admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:00.409415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417960f-bbc6-4ed6-895a-057bed0f886a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:00.409735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417960f-bbc6-4ed6-895a-057bed0f886a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:00.415182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417960f-bbc6-4ed6-895a-057bed0f886a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:00.476994 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 895/1785] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:00.478333 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 891/1786] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:00.479174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebec59-80e1-43a5-9fa9-9c7718446ed3 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:00.480844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-80ebec59-80e1-43a5-9fa9-9c7718446ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:00.482977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417960f-bbc6-4ed6-895a-057bed0f886a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:00.526623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417960f-bbc6-4ed6-895a-057bed0f886a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:00.545239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bba743-6104-44ae-9ad6-ad1f21745f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:00.545938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebec59-80e1-43a5-9fa9-9c7718446ed3 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:00.546188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bba743-6104-44ae-9ad6-ad1f21745f6e admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:00.546484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bba743-6104-44ae-9ad6-ad1f21745f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:00.546829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bba743-6104-44ae-9ad6-ad1f21745f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:00.547568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bba743-6104-44ae-9ad6-ad1f21745f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:00.549567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bba743-6104-44ae-9ad6-ad1f21745f6e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:00.562316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae34a3-253f-4985-8a09-1a4e34096a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:00.563009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae34a3-253f-4985-8a09-1a4e34096a40 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:00.563300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae34a3-253f-4985-8a09-1a4e34096a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:00.567469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae34a3-253f-4985-8a09-1a4e34096a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:00.570435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae34a3-253f-4985-8a09-1a4e34096a40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:00.574391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae34a3-253f-4985-8a09-1a4e34096a40 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:00.659692 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 892/1787] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:00 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:00.660867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bba743-6104-44ae-9ad6-ad1f21745f6e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:00.692052 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 896/1788] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:00 2022] POST /identity/v3/projects => generated 375 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:00.693261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae34a3-253f-4985-8a09-1a4e34096a40 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:00.890053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bba743-6104-44ae-9ad6-ad1f21745f6e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:00.897566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae34a3-253f-4985-8a09-1a4e34096a40 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:00.901720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c72e8-9856-479e-9422-540b488ae778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:00.904412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c72e8-9856-479e-9422-540b488ae778 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:00.905379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720242b-e216-4535-9bd8-c574469cb97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:00.906257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720242b-e216-4535-9bd8-c574469cb97e admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:00.906858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720242b-e216-4535-9bd8-c574469cb97e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:00.907311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720242b-e216-4535-9bd8-c574469cb97e admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:00.907441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c72e8-9856-479e-9422-540b488ae778 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:00.907850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c72e8-9856-479e-9422-540b488ae778 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:00.908625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720242b-e216-4535-9bd8-c574469cb97e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:00.909469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c72e8-9856-479e-9422-540b488ae778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:00.914858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720242b-e216-4535-9bd8-c574469cb97e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:00.916896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c72e8-9856-479e-9422-540b488ae778 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:01.017950 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 897/1789] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:00 2022] POST /identity/v3/users => generated 294 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:01.021338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720242b-e216-4535-9bd8-c574469cb97e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:01.038214 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 893/1790] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:00 2022] POST /identity/v3/users => generated 291 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:20:01.042104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c72e8-9856-479e-9422-540b488ae778 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:01.043809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720242b-e216-4535-9bd8-c574469cb97e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:01.064338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2db30-4b52-4947-bbaa-26588be9e92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:01.065329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2db30-4b52-4947-bbaa-26588be9e92b admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:01.065626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2db30-4b52-4947-bbaa-26588be9e92b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:01.066033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2db30-4b52-4947-bbaa-26588be9e92b admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:01.066920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2db30-4b52-4947-bbaa-26588be9e92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:01.069056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2db30-4b52-4947-bbaa-26588be9e92b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:01.086235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c72e8-9856-479e-9422-540b488ae778 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:01.095275 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 898/1791] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:01.097113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2db30-4b52-4947-bbaa-26588be9e92b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:01.110520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2db30-4b52-4947-bbaa-26588be9e92b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:01.111381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efd728-d348-413a-8ef1-c2bd2128c5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:01.112916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efd728-d348-413a-8ef1-c2bd2128c5db admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:01.116942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efd728-d348-413a-8ef1-c2bd2128c5db admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:01.117618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efd728-d348-413a-8ef1-c2bd2128c5db admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:01.119135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efd728-d348-413a-8ef1-c2bd2128c5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:01.121777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afd5be-62f9-41f3-a38c-08447ea6b890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:01.121949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efd728-d348-413a-8ef1-c2bd2128c5db admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:01.124463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afd5be-62f9-41f3-a38c-08447ea6b890 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:01.126695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afd5be-62f9-41f3-a38c-08447ea6b890 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:01.127616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afd5be-62f9-41f3-a38c-08447ea6b890 admin admin] PATH_INFO: `/v3/projects/0cdc6be3300d4f38ad3f64978e224a33/users/5a38e4ea5c294f0da94264e398042e71/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:01.160106 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 894/1792] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:20:01.164197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efd728-d348-413a-8ef1-c2bd2128c5db admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:01.189369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afd5be-62f9-41f3-a38c-08447ea6b890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cdc6be3300d4f38ad3f64978e224a33, user_id=5a38e4ea5c294f0da94264e398042e71, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:01.196070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afd5be-62f9-41f3-a38c-08447ea6b890 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:01.197972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efd728-d348-413a-8ef1-c2bd2128c5db admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:01.212929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e4cc5-9adf-4157-b4fd-36620f9368dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:01.214039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e4cc5-9adf-4157-b4fd-36620f9368dc admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:01.218769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e4cc5-9adf-4157-b4fd-36620f9368dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:01.220722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e4cc5-9adf-4157-b4fd-36620f9368dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:01.223670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e4cc5-9adf-4157-b4fd-36620f9368dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:01.230659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e4cc5-9adf-4157-b4fd-36620f9368dc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:01.265377 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 895/1793] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:01.267421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e4cc5-9adf-4157-b4fd-36620f9368dc admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:01.298751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e4cc5-9adf-4157-b4fd-36620f9368dc admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:01.299528 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 899/1794] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:01 2022] PUT /identity/v3/projects/0cdc6be3300d4f38ad3f64978e224a33/users/5a38e4ea5c294f0da94264e398042e71/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:01.303391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afd5be-62f9-41f3-a38c-08447ea6b890 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:01.462331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6d729-8eb8-4e7c-839e-f83df9d7ca24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:01.465510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6d729-8eb8-4e7c-839e-f83df9d7ca24 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:01.466328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6d729-8eb8-4e7c-839e-f83df9d7ca24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:01.466328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6d729-8eb8-4e7c-839e-f83df9d7ca24 admin admin] PATH_INFO: `/v3/projects/bede124781f041c381f476928232a1c4/users/10cd0b99f8c949d88eb13c009af320de/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:01.507635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6d729-8eb8-4e7c-839e-f83df9d7ca24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bede124781f041c381f476928232a1c4, user_id=10cd0b99f8c949d88eb13c009af320de, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:01.512902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afd5be-62f9-41f3-a38c-08447ea6b890 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:01.517271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6d729-8eb8-4e7c-839e-f83df9d7ca24 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:01.519134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c80ed-d2b1-445d-bea6-ba0a13b72281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:01.519992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c80ed-d2b1-445d-bea6-ba0a13b72281 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:01.520427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c80ed-d2b1-445d-bea6-ba0a13b72281 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:01.524200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c80ed-d2b1-445d-bea6-ba0a13b72281 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:01.525310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c80ed-d2b1-445d-bea6-ba0a13b72281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:01.527457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c80ed-d2b1-445d-bea6-ba0a13b72281 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:01.563011 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 900/1795] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:01.563011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c80ed-d2b1-445d-bea6-ba0a13b72281 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:01.579553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fc9c80ed-d2b1-445d-bea6-ba0a13b72281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:01.607940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c80ed-d2b1-445d-bea6-ba0a13b72281 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:01.623057 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 896/1796] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:01 2022] PUT /identity/v3/projects/bede124781f041c381f476928232a1c4/users/10cd0b99f8c949d88eb13c009af320de/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:01.624125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6d729-8eb8-4e7c-839e-f83df9d7ca24 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:01.641434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7093d1-8e7d-4e44-a632-8c51d39973b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:01.646475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7093d1-8e7d-4e44-a632-8c51d39973b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:01.646787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7093d1-8e7d-4e44-a632-8c51d39973b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:01.647049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7093d1-8e7d-4e44-a632-8c51d39973b4 admin admin] PATH_INFO: `/v3/projects/9051f063c82149c7a65b85fa5a93ba1d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:01.648415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7093d1-8e7d-4e44-a632-8c51d39973b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9051f063c82149c7a65b85fa5a93ba1d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:01.650967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7093d1-8e7d-4e44-a632-8c51d39973b4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:01.792861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ba7093d1-8e7d-4e44-a632-8c51d39973b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9051f063c82149c7a65b85fa5a93ba1d', 'request_id': 'req-ba7093d1-8e7d-4e44-a632-8c51d39973b4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:01.843517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6d729-8eb8-4e7c-839e-f83df9d7ca24 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:01.887976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ba7093d1-8e7d-4e44-a632-8c51d39973b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9051f063c82149c7a65b85fa5a93ba1d', 'request_id': 'req-ba7093d1-8e7d-4e44-a632-8c51d39973b4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:01.899126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ba7093d1-8e7d-4e44-a632-8c51d39973b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9051f063c82149c7a65b85fa5a93ba1d', 'request_id': 'req-ba7093d1-8e7d-4e44-a632-8c51d39973b4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:01.927786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ba7093d1-8e7d-4e44-a632-8c51d39973b4 admin admin] The token cache is being invalidate because project 9051f063c82149c7a65b85fa5a93ba1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:01.928087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ba7093d1-8e7d-4e44-a632-8c51d39973b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:01.929477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ba7093d1-8e7d-4e44-a632-8c51d39973b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:01.940289 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 901/1797] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:01 2022] DELETE /identity/v3/projects/9051f063c82149c7a65b85fa5a93ba1d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:01.940289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d967c40-0fa0-4623-a762-2f883f64c62e None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:01.940289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d967c40-0fa0-4623-a762-2f883f64c62e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:01.941337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d967c40-0fa0-4623-a762-2f883f64c62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:02.004288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1d967c40-0fa0-4623-a762-2f883f64c62e None None] MFA Rules not processed for user `10cd0b99f8c949d88eb13c009af320de`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:02.018092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1d967c40-0fa0-4623-a762-2f883f64c62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:02.050630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f499dc-6a29-4d3e-a799-ea98cf496e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:02.052715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f499dc-6a29-4d3e-a799-ea98cf496e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:02.053470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f499dc-6a29-4d3e-a799-ea98cf496e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:02.054032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f499dc-6a29-4d3e-a799-ea98cf496e40 admin admin] PATH_INFO: `/v3/projects/0cdc6be3300d4f38ad3f64978e224a33/users/5a38e4ea5c294f0da94264e398042e71/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:02.060091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f499dc-6a29-4d3e-a799-ea98cf496e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cdc6be3300d4f38ad3f64978e224a33, user_id=5a38e4ea5c294f0da94264e398042e71, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:02.063558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f499dc-6a29-4d3e-a799-ea98cf496e40 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:02.093284 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 897/1798] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:01 2022] PUT /identity/v3/projects/0cdc6be3300d4f38ad3f64978e224a33/users/5a38e4ea5c294f0da94264e398042e71/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:02.097076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4345601-6c64-4a6e-bd13-0daac3967fff None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:02.097699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4345601-6c64-4a6e-bd13-0daac3967fff None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:02.098204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4345601-6c64-4a6e-bd13-0daac3967fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:02.135018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e4345601-6c64-4a6e-bd13-0daac3967fff None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:02.136844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e4345601-6c64-4a6e-bd13-0daac3967fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:02.247672 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 902/1799] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:02.261685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c22e8e-45e6-4df1-b673-2aa741a38b0a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:02.262289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c22e8e-45e6-4df1-b673-2aa741a38b0a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:02.262289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c22e8e-45e6-4df1-b673-2aa741a38b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:02.292021 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 898/1800] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:02.301798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4345601-6c64-4a6e-bd13-0daac3967fff None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:02.304581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e4345601-6c64-4a6e-bd13-0daac3967fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:02.317641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-12c22e8e-45e6-4df1-b673-2aa741a38b0a None None] MFA Rules not processed for user `5a38e4ea5c294f0da94264e398042e71`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:02.319370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-12c22e8e-45e6-4df1-b673-2aa741a38b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:02.321409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4345601-6c64-4a6e-bd13-0daac3967fff None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:02.331242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0feeea-188a-44f6-b78b-1c0a9fd1ac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:02.332070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0feeea-188a-44f6-b78b-1c0a9fd1ac9c admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:02.332454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0feeea-188a-44f6-b78b-1c0a9fd1ac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:02.332869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0feeea-188a-44f6-b78b-1c0a9fd1ac9c admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:02.333800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0feeea-188a-44f6-b78b-1c0a9fd1ac9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:02.335911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0feeea-188a-44f6-b78b-1c0a9fd1ac9c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:02.448331 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 899/1801] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:02 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:02.451888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49dbae-7281-4bf7-aa15-7c60e4390d9d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:02.453201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49dbae-7281-4bf7-aa15-7c60e4390d9d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:02.454911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49dbae-7281-4bf7-aa15-7c60e4390d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:02.513492 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 903/1802] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:02.514556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c22e8e-45e6-4df1-b673-2aa741a38b0a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:02.525062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9e49dbae-7281-4bf7-aa15-7c60e4390d9d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:02.535165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9e49dbae-7281-4bf7-aa15-7c60e4390d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:02.568064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c22e8e-45e6-4df1-b673-2aa741a38b0a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:02.647929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a0d72-2cb9-4db8-961b-1bf705aef388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:02.648896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a0d72-2cb9-4db8-961b-1bf705aef388 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:02.649514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a0d72-2cb9-4db8-961b-1bf705aef388 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:02.649939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a0d72-2cb9-4db8-961b-1bf705aef388 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:02.651420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a0d72-2cb9-4db8-961b-1bf705aef388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:02.654969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a0d72-2cb9-4db8-961b-1bf705aef388 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:02.722922 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 900/1803] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:02.732962 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 904/1804] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:02 2022] POST /identity/v3/users => generated 298 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:02.733848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a0d72-2cb9-4db8-961b-1bf705aef388 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:02.734624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49dbae-7281-4bf7-aa15-7c60e4390d9d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:02.766009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a0d72-2cb9-4db8-961b-1bf705aef388 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:02.789952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343633b-1448-4265-8ccc-4df32c227dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:02.793954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343633b-1448-4265-8ccc-4df32c227dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:02.795253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343633b-1448-4265-8ccc-4df32c227dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:02.797213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343633b-1448-4265-8ccc-4df32c227dd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:02.798159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343633b-1448-4265-8ccc-4df32c227dd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:02.801542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343633b-1448-4265-8ccc-4df32c227dd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:02.806791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343633b-1448-4265-8ccc-4df32c227dd5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:02.858364 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 905/1805] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:02.859524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343633b-1448-4265-8ccc-4df32c227dd5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:02.896728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343633b-1448-4265-8ccc-4df32c227dd5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:02.932282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0059e-0087-4797-b475-504e56e443f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:02.933037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0059e-0087-4797-b475-504e56e443f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:02.933240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0059e-0087-4797-b475-504e56e443f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:02.933643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0059e-0087-4797-b475-504e56e443f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:02.934410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0059e-0087-4797-b475-504e56e443f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:02.947412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0059e-0087-4797-b475-504e56e443f1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:02.995068 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 906/1806] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:02.999605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0059e-0087-4797-b475-504e56e443f1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:03.000573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49dbae-7281-4bf7-aa15-7c60e4390d9d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:03.021249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2926e5-6f6c-4837-a811-a36302665ddc tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a38e4ea5c294f0da94264e398042e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cdc6be3300d4f38ad3f64978e224a33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:03.021890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2926e5-6f6c-4837-a811-a36302665ddc tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:03.022159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2926e5-6f6c-4837-a811-a36302665ddc tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:03.022449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2926e5-6f6c-4837-a811-a36302665ddc tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:03.023200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2926e5-6f6c-4837-a811-a36302665ddc tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:03.023614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2926e5-6f6c-4837-a811-a36302665ddc tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:03.038001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0059e-0087-4797-b475-504e56e443f1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:03.038321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2926e5-6f6c-4837-a811-a36302665ddc tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:03.059190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0210e-c8a8-419f-a5a1-1b343bdbb327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:03.059875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0210e-c8a8-419f-a5a1-1b343bdbb327 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:03.060169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0210e-c8a8-419f-a5a1-1b343bdbb327 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:03.060453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0210e-c8a8-419f-a5a1-1b343bdbb327 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:03.061196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0210e-c8a8-419f-a5a1-1b343bdbb327 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:03.063133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0210e-c8a8-419f-a5a1-1b343bdbb327 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:03.081915 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 901/1807] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:03.082971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2926e5-6f6c-4837-a811-a36302665ddc tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:03.122062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2926e5-6f6c-4837-a811-a36302665ddc tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:03.144514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335c47e-9106-471b-8581-9e7256f6c8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:03.145722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335c47e-9106-471b-8581-9e7256f6c8b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:03.146066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335c47e-9106-471b-8581-9e7256f6c8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:03.147125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335c47e-9106-471b-8581-9e7256f6c8b2 admin admin] PATH_INFO: `/v3/projects/7cdc8eca8bae47ef8eba8dc26506512b/users/cda906bfbc7245c29cb039f4fa10c1a3/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:03.189417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335c47e-9106-471b-8581-9e7256f6c8b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cdc8eca8bae47ef8eba8dc26506512b, user_id=cda906bfbc7245c29cb039f4fa10c1a3, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:03.192329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335c47e-9106-471b-8581-9e7256f6c8b2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:03.327118 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 907/1808] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:02 2022] POST /identity/v3/projects => generated 385 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:03.328730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0210e-c8a8-419f-a5a1-1b343bdbb327 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:03.346040 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 902/1809] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:03 2022] PUT /identity/v3/projects/7cdc8eca8bae47ef8eba8dc26506512b/users/cda906bfbc7245c29cb039f4fa10c1a3/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:03.346716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335c47e-9106-471b-8581-9e7256f6c8b2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:03.467783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335c47e-9106-471b-8581-9e7256f6c8b2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:03.478469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7cd86-1cba-4078-866e-bedbec8f9b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:03.478469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7cd86-1cba-4078-866e-bedbec8f9b12 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:03.478469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7cd86-1cba-4078-866e-bedbec8f9b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:03.478469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7cd86-1cba-4078-866e-bedbec8f9b12 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:03.478887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7cd86-1cba-4078-866e-bedbec8f9b12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:03.479431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7cd86-1cba-4078-866e-bedbec8f9b12 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:03.505591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0210e-c8a8-419f-a5a1-1b343bdbb327 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:03.600522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b7d6c-8829-4539-8201-6fab9c6630ce tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a38e4ea5c294f0da94264e398042e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cdc6be3300d4f38ad3f64978e224a33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:03.601399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b7d6c-8829-4539-8201-6fab9c6630ce tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:03.601761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b7d6c-8829-4539-8201-6fab9c6630ce tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:03.602068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b7d6c-8829-4539-8201-6fab9c6630ce tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:03.602945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b7d6c-8829-4539-8201-6fab9c6630ce tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:03.604837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b7d6c-8829-4539-8201-6fab9c6630ce tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:04.297910 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 903/1810] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:03 2022] POST /identity/v3/users => generated 293 bytes in 949 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:04.297910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7cd86-1cba-4078-866e-bedbec8f9b12 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:04.305968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7cd86-1cba-4078-866e-bedbec8f9b12 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:04.310641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18117e65-f5b7-4fa4-9960-6d9e84d71153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:04.311297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18117e65-f5b7-4fa4-9960-6d9e84d71153 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:04.311581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18117e65-f5b7-4fa4-9960-6d9e84d71153 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:04.311857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18117e65-f5b7-4fa4-9960-6d9e84d71153 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:04.312583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18117e65-f5b7-4fa4-9960-6d9e84d71153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:04.314249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18117e65-f5b7-4fa4-9960-6d9e84d71153 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:04.324891 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 904/1811] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:04.329239 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 908/1812] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:03 2022] POST /identity/v3/projects => generated 369 bytes in 997 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:04.329952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18117e65-f5b7-4fa4-9960-6d9e84d71153 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:04.330119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b7d6c-8829-4539-8201-6fab9c6630ce tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:04.342236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18117e65-f5b7-4fa4-9960-6d9e84d71153 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:04.403964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a42fe-142f-45d4-8329-201ee9daf301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:04.404773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a42fe-142f-45d4-8329-201ee9daf301 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:04.405056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a42fe-142f-45d4-8329-201ee9daf301 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:04.405335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a42fe-142f-45d4-8329-201ee9daf301 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:04.406060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a42fe-142f-45d4-8329-201ee9daf301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:04.406591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b7d6c-8829-4539-8201-6fab9c6630ce tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:04.407683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a42fe-142f-45d4-8329-201ee9daf301 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:04.411323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fa211-ee72-42eb-9226-4d5297e98e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:04.414621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fa211-ee72-42eb-9226-4d5297e98e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:04.414621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fa211-ee72-42eb-9226-4d5297e98e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:04.414621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fa211-ee72-42eb-9226-4d5297e98e8e admin admin] PATH_INFO: `/v3/projects/7cdc8eca8bae47ef8eba8dc26506512b/users/cda906bfbc7245c29cb039f4fa10c1a3/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:04.415610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fa211-ee72-42eb-9226-4d5297e98e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cdc8eca8bae47ef8eba8dc26506512b, user_id=cda906bfbc7245c29cb039f4fa10c1a3, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:04.418117 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 905/1813] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:04.418311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fa211-ee72-42eb-9226-4d5297e98e8e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:04.421520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a42fe-142f-45d4-8329-201ee9daf301 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:04.428745 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 909/1814] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:04 2022] PUT /identity/v3/projects/7cdc8eca8bae47ef8eba8dc26506512b/users/cda906bfbc7245c29cb039f4fa10c1a3/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:04.429590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fa211-ee72-42eb-9226-4d5297e98e8e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:04.480767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a42fe-142f-45d4-8329-201ee9daf301 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:04.492478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fa211-ee72-42eb-9226-4d5297e98e8e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:04.497904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6f46d-52e3-473e-a36d-a95791d9363c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:04.498672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6f46d-52e3-473e-a36d-a95791d9363c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:04.498972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6f46d-52e3-473e-a36d-a95791d9363c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:04.499254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6f46d-52e3-473e-a36d-a95791d9363c admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:04.499983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6f46d-52e3-473e-a36d-a95791d9363c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:04.501632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6f46d-52e3-473e-a36d-a95791d9363c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:04.511306 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 910/1815] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:04.512738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ae69-ca94-4957-851d-d50d4b9fc911 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:04.513031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ae69-ca94-4957-851d-d50d4b9fc911 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:04.513520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ae69-ca94-4957-851d-d50d4b9fc911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:04.533518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e35b2b-0eab-4628-94df-f88bbd64343e tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a38e4ea5c294f0da94264e398042e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cdc6be3300d4f38ad3f64978e224a33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:04.534214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e35b2b-0eab-4628-94df-f88bbd64343e tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:04.534496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e35b2b-0eab-4628-94df-f88bbd64343e tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:04.534779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e35b2b-0eab-4628-94df-f88bbd64343e tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:04.535499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e35b2b-0eab-4628-94df-f88bbd64343e tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:04.535810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e35b2b-0eab-4628-94df-f88bbd64343e tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:04.537449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e35b2b-0eab-4628-94df-f88bbd64343e tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:04.541008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1708ae69-ca94-4957-851d-d50d4b9fc911 None None] MFA Rules not processed for user `cda906bfbc7245c29cb039f4fa10c1a3`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:04.542221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1708ae69-ca94-4957-851d-d50d4b9fc911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:04.549216 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 906/1816] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:04.550021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e35b2b-0eab-4628-94df-f88bbd64343e tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:04.560069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e35b2b-0eab-4628-94df-f88bbd64343e tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:04.564463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a1988-9cb3-4315-b31d-90accbad2f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:04.565352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a1988-9cb3-4315-b31d-90accbad2f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:04.565635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a1988-9cb3-4315-b31d-90accbad2f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:04.565917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a1988-9cb3-4315-b31d-90accbad2f21 admin admin] PATH_INFO: `/v3/projects/fbbe331a123a42ab995f539e5de8f2ea/users/e44a06856323407da3c0e0fb0db93902/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:04.580074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a1988-9cb3-4315-b31d-90accbad2f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbbe331a123a42ab995f539e5de8f2ea, user_id=e44a06856323407da3c0e0fb0db93902, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:04.582763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a1988-9cb3-4315-b31d-90accbad2f21 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:04.608790 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 911/1817] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:04.609702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708ae69-ca94-4957-851d-d50d4b9fc911 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:04.611250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1708ae69-ca94-4957-851d-d50d4b9fc911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:04.682316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708ae69-ca94-4957-851d-d50d4b9fc911 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:04.683479 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 907/1818] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:04 2022] PUT /identity/v3/projects/fbbe331a123a42ab995f539e5de8f2ea/users/e44a06856323407da3c0e0fb0db93902/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:04.684259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a1988-9cb3-4315-b31d-90accbad2f21 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:04.685802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-108a1988-9cb3-4315-b31d-90accbad2f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:04.743626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24f5c1-2c24-4a0f-bae5-770b0840ac11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:04.744255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24f5c1-2c24-4a0f-bae5-770b0840ac11 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:04.744537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24f5c1-2c24-4a0f-bae5-770b0840ac11 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:04.744845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24f5c1-2c24-4a0f-bae5-770b0840ac11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:04.756716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a1988-9cb3-4315-b31d-90accbad2f21 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:04.762750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e674d-5d4a-4053-bd6f-454225a322fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:04.763397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e674d-5d4a-4053-bd6f-454225a322fc service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:04.763682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e674d-5d4a-4053-bd6f-454225a322fc service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:04.763964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e674d-5d4a-4053-bd6f-454225a322fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:04.800801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24f5c1-2c24-4a0f-bae5-770b0840ac11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:04.802420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24f5c1-2c24-4a0f-bae5-770b0840ac11 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:04.812254 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 912/1819] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:04.813471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b51f7b-089d-4415-aabf-fe35e7b96a3b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:04.813771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b51f7b-089d-4415-aabf-fe35e7b96a3b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:04.814136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b51f7b-089d-4415-aabf-fe35e7b96a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:04.820696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e674d-5d4a-4053-bd6f-454225a322fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:04.822824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e674d-5d4a-4053-bd6f-454225a322fc service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:04.832470 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 908/1820] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:04.833803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca592f6-6af9-4f32-9db9-89ffc77d954e None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:04.834092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca592f6-6af9-4f32-9db9-89ffc77d954e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:04.834398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca592f6-6af9-4f32-9db9-89ffc77d954e None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:04.835737 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 909/1821] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:20:04.840925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca592f6-6af9-4f32-9db9-89ffc77d954e None None] Authenticating service token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:20:04.842020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-75b51f7b-089d-4415-aabf-fe35e7b96a3b None None] MFA Rules not processed for user `e44a06856323407da3c0e0fb0db93902`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:04.843232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-75b51f7b-089d-4415-aabf-fe35e7b96a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:04.854845 ncdv-master-1 devstack@keystone.service[91119]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-5ca592f6-6af9-4f32-9db9-89ffc77d954e None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. May 02 10:20:04.855277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca592f6-6af9-4f32-9db9-89ffc77d954e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:04.864761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca592f6-6af9-4f32-9db9-89ffc77d954e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:04.869519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7316ecf-2786-4d16-8d0b-2bd5c315086a tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a38e4ea5c294f0da94264e398042e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cdc6be3300d4f38ad3f64978e224a33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:04.870368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7316ecf-2786-4d16-8d0b-2bd5c315086a tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:04.870652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7316ecf-2786-4d16-8d0b-2bd5c315086a tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:04.871184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7316ecf-2786-4d16-8d0b-2bd5c315086a tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] PATH_INFO: `/v3/projects/b1d9afc200d8419e9e76200ab0c10f51` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:04.872393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7316ecf-2786-4d16-8d0b-2bd5c315086a tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorizing `identity:get_project(project_id=b1d9afc200d8419e9e76200ab0c10f51)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:04.874562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7316ecf-2786-4d16-8d0b-2bd5c315086a tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:04.879586 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 910/1822] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:20:04 2022] GET /identity/v3/projects/b1d9afc200d8419e9e76200ab0c10f51 => generated 369 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:20:04.919413 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 913/1823] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:04.920559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7316ecf-2786-4d16-8d0b-2bd5c315086a tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:04.966321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0c340-35ac-4a08-b1d8-a77f6336276b None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:04.966683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0c340-35ac-4a08-b1d8-a77f6336276b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:04.966883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0c340-35ac-4a08-b1d8-a77f6336276b None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:04.968279 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 914/1824] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:20:04.973337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0c340-35ac-4a08-b1d8-a77f6336276b None None] Authenticating service token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:20:04.993188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0c340-35ac-4a08-b1d8-a77f6336276b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:04.998864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7316ecf-2786-4d16-8d0b-2bd5c315086a tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:05.003800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737778f-a4d7-423c-af3b-48145c8b6a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:05.004184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0c340-35ac-4a08-b1d8-a77f6336276b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:05.004464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737778f-a4d7-423c-af3b-48145c8b6a3b admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:05.004779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737778f-a4d7-423c-af3b-48145c8b6a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:05.005070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737778f-a4d7-423c-af3b-48145c8b6a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:05.005756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737778f-a4d7-423c-af3b-48145c8b6a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:05.007790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737778f-a4d7-423c-af3b-48145c8b6a3b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:05.009857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775d05b-23f0-4933-8d05-9118c704a68d tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a38e4ea5c294f0da94264e398042e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cdc6be3300d4f38ad3f64978e224a33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:05.010894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775d05b-23f0-4933-8d05-9118c704a68d tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:05.011127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775d05b-23f0-4933-8d05-9118c704a68d tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:05.011416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775d05b-23f0-4933-8d05-9118c704a68d tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] PATH_INFO: `/v3/projects/b1d9afc200d8419e9e76200ab0c10f51` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:05.012634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c775d05b-23f0-4933-8d05-9118c704a68d tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorizing `identity:get_project(project_id=b1d9afc200d8419e9e76200ab0c10f51)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:05.014685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c775d05b-23f0-4933-8d05-9118c704a68d tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:05.016561 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 915/1825] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:20:04 2022] GET /identity/v3/projects/b1d9afc200d8419e9e76200ab0c10f51 => generated 369 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:05.093029 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 911/1826] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:04 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:05.093864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775d05b-23f0-4933-8d05-9118c704a68d tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:05.108914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775d05b-23f0-4933-8d05-9118c704a68d tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:05.169624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014273cd-29f1-494b-b48c-b1d87a3a0bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:05.170636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014273cd-29f1-494b-b48c-b1d87a3a0bce admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:05.170636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014273cd-29f1-494b-b48c-b1d87a3a0bce admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:05.170912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014273cd-29f1-494b-b48c-b1d87a3a0bce admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:05.171599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014273cd-29f1-494b-b48c-b1d87a3a0bce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:05.173633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014273cd-29f1-494b-b48c-b1d87a3a0bce admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:05.299430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690ac95-facb-46b1-8dd7-a27df9885f36 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:05.299916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690ac95-facb-46b1-8dd7-a27df9885f36 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:05.300101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690ac95-facb-46b1-8dd7-a27df9885f36 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:05.301484 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 912/1827] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:20:05.306744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690ac95-facb-46b1-8dd7-a27df9885f36 None None] Authenticating service token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:20:05.320833 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 916/1828] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:05 2022] POST /identity/v3/users => generated 298 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:20:05.322548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014273cd-29f1-494b-b48c-b1d87a3a0bce admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:05.332572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014273cd-29f1-494b-b48c-b1d87a3a0bce admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:05.337666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0e798-8fbe-42e3-acb8-bebb5b94cb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:05.338840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0e798-8fbe-42e3-acb8-bebb5b94cb54 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:05.338840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0e798-8fbe-42e3-acb8-bebb5b94cb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:05.339066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0e798-8fbe-42e3-acb8-bebb5b94cb54 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:05.339720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0e798-8fbe-42e3-acb8-bebb5b94cb54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:05.341487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0e798-8fbe-42e3-acb8-bebb5b94cb54 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:05.352713 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 917/1829] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:05.356835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0e798-8fbe-42e3-acb8-bebb5b94cb54 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:05.366209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0e798-8fbe-42e3-acb8-bebb5b94cb54 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:05.371776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b32526-599f-4700-a099-a9f6ae65dbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:05.372677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b32526-599f-4700-a099-a9f6ae65dbf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:05.373080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b32526-599f-4700-a099-a9f6ae65dbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:05.373372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b32526-599f-4700-a099-a9f6ae65dbf3 admin admin] PATH_INFO: `/v3/projects/a710b3635c9745eebf4ce2d73293ea36/users/fdde02f8056f4cc49367bc51fec5bad7/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:05.386176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690ac95-facb-46b1-8dd7-a27df9885f36 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:05.390893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b32526-599f-4700-a099-a9f6ae65dbf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a710b3635c9745eebf4ce2d73293ea36, user_id=fdde02f8056f4cc49367bc51fec5bad7, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:05.396779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b32526-599f-4700-a099-a9f6ae65dbf3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:05.451434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690ac95-facb-46b1-8dd7-a27df9885f36 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:05.455948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d26f4-2e30-46cc-9daa-566d4a1adc28 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a38e4ea5c294f0da94264e398042e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cdc6be3300d4f38ad3f64978e224a33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:05.456965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d26f4-2e30-46cc-9daa-566d4a1adc28 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:05.457144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d26f4-2e30-46cc-9daa-566d4a1adc28 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:05.457425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d26f4-2e30-46cc-9daa-566d4a1adc28 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] PATH_INFO: `/v3/projects/b1d9afc200d8419e9e76200ab0c10f51` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:05.458633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d26f4-2e30-46cc-9daa-566d4a1adc28 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorizing `identity:get_project(project_id=b1d9afc200d8419e9e76200ab0c10f51)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:05.460764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d26f4-2e30-46cc-9daa-566d4a1adc28 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:05.462499 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 913/1830] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:20:05 2022] GET /identity/v3/projects/b1d9afc200d8419e9e76200ab0c10f51 => generated 369 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:20:05.484055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d26f4-2e30-46cc-9daa-566d4a1adc28 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:05.494518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d26f4-2e30-46cc-9daa-566d4a1adc28 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:05.499759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e74892-b683-46e9-8920-564c7ffd4194 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a38e4ea5c294f0da94264e398042e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cdc6be3300d4f38ad3f64978e224a33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:05.503230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e74892-b683-46e9-8920-564c7ffd4194 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:05.503230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e74892-b683-46e9-8920-564c7ffd4194 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:05.503230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e74892-b683-46e9-8920-564c7ffd4194 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] PATH_INFO: `/v3/projects/b1d9afc200d8419e9e76200ab0c10f51` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:05.503230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e74892-b683-46e9-8920-564c7ffd4194 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b1d9afc200d8419e9e76200ab0c10f51)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:05.504551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e74892-b683-46e9-8920-564c7ffd4194 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:05.505469 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 918/1831] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:05 2022] PUT /identity/v3/projects/a710b3635c9745eebf4ce2d73293ea36/users/fdde02f8056f4cc49367bc51fec5bad7/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:05.509823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b32526-599f-4700-a099-a9f6ae65dbf3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:05.570547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b32526-599f-4700-a099-a9f6ae65dbf3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:05.576090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388c172-d7d1-44bf-ab35-49468f2a4ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:05.576805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388c172-d7d1-44bf-ab35-49468f2a4ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:05.577094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388c172-d7d1-44bf-ab35-49468f2a4ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:05.577408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388c172-d7d1-44bf-ab35-49468f2a4ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:05.578157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388c172-d7d1-44bf-ab35-49468f2a4ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:05.579753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388c172-d7d1-44bf-ab35-49468f2a4ba6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:05.593969 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 919/1832] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:05.595607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388c172-d7d1-44bf-ab35-49468f2a4ba6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:05.605848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388c172-d7d1-44bf-ab35-49468f2a4ba6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:05.614745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48840692-d11f-4dff-83b0-cb4b047359c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:05.615902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48840692-d11f-4dff-83b0-cb4b047359c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:05.616305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48840692-d11f-4dff-83b0-cb4b047359c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:05.616803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48840692-d11f-4dff-83b0-cb4b047359c4 admin admin] PATH_INFO: `/v3/projects/a710b3635c9745eebf4ce2d73293ea36/users/fdde02f8056f4cc49367bc51fec5bad7/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:05.619565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48840692-d11f-4dff-83b0-cb4b047359c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a710b3635c9745eebf4ce2d73293ea36, user_id=fdde02f8056f4cc49367bc51fec5bad7, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:05.623328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48840692-d11f-4dff-83b0-cb4b047359c4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:05.642724 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 920/1833] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:05 2022] PUT /identity/v3/projects/a710b3635c9745eebf4ce2d73293ea36/users/fdde02f8056f4cc49367bc51fec5bad7/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:05.642724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48840692-d11f-4dff-83b0-cb4b047359c4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:05.650134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-23e74892-b683-46e9-8920-564c7ffd4194 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1d9afc200d8419e9e76200ab0c10f51', 'request_id': 'req-23e74892-b683-46e9-8920-564c7ffd4194'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:05.657912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-23e74892-b683-46e9-8920-564c7ffd4194 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1d9afc200d8419e9e76200ab0c10f51', 'request_id': 'req-23e74892-b683-46e9-8920-564c7ffd4194'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:05.718122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48840692-d11f-4dff-83b0-cb4b047359c4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:05.722963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04251c-764f-4c9d-82ef-c388a9f7634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:05.723905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04251c-764f-4c9d-82ef-c388a9f7634b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:05.724259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04251c-764f-4c9d-82ef-c388a9f7634b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:05.724630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04251c-764f-4c9d-82ef-c388a9f7634b admin admin] PATH_INFO: `/v3/users/10cd0b99f8c949d88eb13c009af320de` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:05.725922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04251c-764f-4c9d-82ef-c388a9f7634b admin admin] RBAC: Authorizing `identity:delete_user(user_id=10cd0b99f8c949d88eb13c009af320de)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:05.728513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04251c-764f-4c9d-82ef-c388a9f7634b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:05.756118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-23e74892-b683-46e9-8920-564c7ffd4194 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1d9afc200d8419e9e76200ab0c10f51', 'request_id': 'req-23e74892-b683-46e9-8920-564c7ffd4194'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:05.767544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-23e74892-b683-46e9-8920-564c7ffd4194 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] The token cache is being invalidate because project b1d9afc200d8419e9e76200ab0c10f51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:05.767872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-23e74892-b683-46e9-8920-564c7ffd4194 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:05.768521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-23e74892-b683-46e9-8920-564c7ffd4194 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:05.770141 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 914/1834] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:05 2022] DELETE /identity/v3/projects/b1d9afc200d8419e9e76200ab0c10f51 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:05.771409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066443f-3f0b-4216-970d-f2232dd8752f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:05.771695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066443f-3f0b-4216-970d-f2232dd8752f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:05.771970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066443f-3f0b-4216-970d-f2232dd8752f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:05.799066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6066443f-3f0b-4216-970d-f2232dd8752f None None] MFA Rules not processed for user `fdde02f8056f4cc49367bc51fec5bad7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:05.800262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6066443f-3f0b-4216-970d-f2232dd8752f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:05.869474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7f04251c-764f-4c9d-82ef-c388a9f7634b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10cd0b99f8c949d88eb13c009af320de'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:05.871289 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 915/1835] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:05.872700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fdf71-d041-4693-b87c-6d8f2a70f610 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:05.872992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fdf71-d041-4693-b87c-6d8f2a70f610 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:05.873268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469fdf71-d041-4693-b87c-6d8f2a70f610 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:05.874652 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 916/1836] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:20:05.881168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fdf71-d041-4693-b87c-6d8f2a70f610 None None] Authenticating service token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:20:05.883224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-469fdf71-d041-4693-b87c-6d8f2a70f610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:05.884979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7f04251c-764f-4c9d-82ef-c388a9f7634b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10cd0b99f8c949d88eb13c009af320de'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:05.885900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7f04251c-764f-4c9d-82ef-c388a9f7634b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10cd0b99f8c949d88eb13c009af320de'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:05.895627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7f04251c-764f-4c9d-82ef-c388a9f7634b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10cd0b99f8c949d88eb13c009af320de'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:05.962256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fdf71-d041-4693-b87c-6d8f2a70f610 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:05.964209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-469fdf71-d041-4693-b87c-6d8f2a70f610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:05.973763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7f04251c-764f-4c9d-82ef-c388a9f7634b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10cd0b99f8c949d88eb13c009af320de'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:05.984371 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 921/1837] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:05 2022] DELETE /identity/v3/users/10cd0b99f8c949d88eb13c009af320de => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:05.984371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04251c-764f-4c9d-82ef-c388a9f7634b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:05.984371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7f04251c-764f-4c9d-82ef-c388a9f7634b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:06.037426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469fdf71-d041-4693-b87c-6d8f2a70f610 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:06.063910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04251c-764f-4c9d-82ef-c388a9f7634b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:06.069973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdf6b5-9af5-42f7-8bd8-733aeb1909a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:06.070735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdf6b5-9af5-42f7-8bd8-733aeb1909a1 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:06.071158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdf6b5-9af5-42f7-8bd8-733aeb1909a1 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:06.071448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdf6b5-9af5-42f7-8bd8-733aeb1909a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:06.073269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a4bdf6b5-9af5-42f7-8bd8-733aeb1909a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:06.097605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ccf21-6399-4a26-8069-8793d22caf32 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a38e4ea5c294f0da94264e398042e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cdc6be3300d4f38ad3f64978e224a33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:06.097605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ccf21-6399-4a26-8069-8793d22caf32 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:06.097605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ccf21-6399-4a26-8069-8793d22caf32 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:06.098004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ccf21-6399-4a26-8069-8793d22caf32 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] PATH_INFO: `/v3/projects/1c3cc59c411a49caaede8817eada1414` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:06.098004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ccf21-6399-4a26-8069-8793d22caf32 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorizing `identity:get_project(project_id=1c3cc59c411a49caaede8817eada1414)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:06.099014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ccf21-6399-4a26-8069-8793d22caf32 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:06.117858 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 917/1838] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:20:05 2022] GET /identity/v3/projects/1c3cc59c411a49caaede8817eada1414 => generated 373 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:20:06.117858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15552230-0ef0-4dbf-a837-77252eefb4b6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:06.117858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15552230-0ef0-4dbf-a837-77252eefb4b6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:06.117858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15552230-0ef0-4dbf-a837-77252eefb4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:06.140979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdf6b5-9af5-42f7-8bd8-733aeb1909a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:06.142709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdf6b5-9af5-42f7-8bd8-733aeb1909a1 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:06.144738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-15552230-0ef0-4dbf-a837-77252eefb4b6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:06.146122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-15552230-0ef0-4dbf-a837-77252eefb4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:06.157262 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 922/1839] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:06.158309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdf6b5-9af5-42f7-8bd8-733aeb1909a1 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:06.159703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a4bdf6b5-9af5-42f7-8bd8-733aeb1909a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:06.174944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdf6b5-9af5-42f7-8bd8-733aeb1909a1 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:06.180086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c8e19-d107-4d7e-b8da-ba25b7b84335 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a38e4ea5c294f0da94264e398042e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cdc6be3300d4f38ad3f64978e224a33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:06.187516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c8e19-d107-4d7e-b8da-ba25b7b84335 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:06.187516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c8e19-d107-4d7e-b8da-ba25b7b84335 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:06.187516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c8e19-d107-4d7e-b8da-ba25b7b84335 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:06.187516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c8e19-d107-4d7e-b8da-ba25b7b84335 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:06.187516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c8e19-d107-4d7e-b8da-ba25b7b84335 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:06.187917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c8e19-d107-4d7e-b8da-ba25b7b84335 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:06.201544 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 923/1840] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:06.205265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c8e19-d107-4d7e-b8da-ba25b7b84335 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:06.219757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c8e19-d107-4d7e-b8da-ba25b7b84335 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:06.227019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4fb99-86a5-4ca5-b8bd-3e2a9b9e160d tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a38e4ea5c294f0da94264e398042e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cdc6be3300d4f38ad3f64978e224a33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:06.227780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4fb99-86a5-4ca5-b8bd-3e2a9b9e160d tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:06.228389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4fb99-86a5-4ca5-b8bd-3e2a9b9e160d tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:06.228863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4fb99-86a5-4ca5-b8bd-3e2a9b9e160d tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:06.229714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4fb99-86a5-4ca5-b8bd-3e2a9b9e160d tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:06.231677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4fb99-86a5-4ca5-b8bd-3e2a9b9e160d tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:06.238004 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 918/1841] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:06.253649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15552230-0ef0-4dbf-a837-77252eefb4b6 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:06.255574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-15552230-0ef0-4dbf-a837-77252eefb4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:06.329987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15552230-0ef0-4dbf-a837-77252eefb4b6 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:06.333676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a995b-aaa4-4cc1-b4ab-c841e078fbe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:06.334317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a995b-aaa4-4cc1-b4ab-c841e078fbe4 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:06.334599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a995b-aaa4-4cc1-b4ab-c841e078fbe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:06.334880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a995b-aaa4-4cc1-b4ab-c841e078fbe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:06.345317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a995b-aaa4-4cc1-b4ab-c841e078fbe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:06.347027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a995b-aaa4-4cc1-b4ab-c841e078fbe4 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:06.356568 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 924/1842] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:06 2022] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:06.357605 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 919/1843] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:20:06.357733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4fb99-86a5-4ca5-b8bd-3e2a9b9e160d tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:06.394220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a995b-aaa4-4cc1-b4ab-c841e078fbe4 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:06.395630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-394a995b-aaa4-4cc1-b4ab-c841e078fbe4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:06.416278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a995b-aaa4-4cc1-b4ab-c841e078fbe4 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:06.431208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4fb99-86a5-4ca5-b8bd-3e2a9b9e160d tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:06.437141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e07097-cd8f-48d8-91d4-c1dda3a443e6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a38e4ea5c294f0da94264e398042e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cdc6be3300d4f38ad3f64978e224a33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:06.438486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e07097-cd8f-48d8-91d4-c1dda3a443e6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:06.438925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e07097-cd8f-48d8-91d4-c1dda3a443e6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:06.439217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e07097-cd8f-48d8-91d4-c1dda3a443e6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:06.439972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e07097-cd8f-48d8-91d4-c1dda3a443e6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:06.440786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e07097-cd8f-48d8-91d4-c1dda3a443e6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:06.442558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e07097-cd8f-48d8-91d4-c1dda3a443e6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:06.460927 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 925/1844] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:20:06.487945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cb7b7-5f87-4e93-bbd7-308a882a0cbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:06.488657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cb7b7-5f87-4e93-bbd7-308a882a0cbd service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:06.488948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cb7b7-5f87-4e93-bbd7-308a882a0cbd service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:06.489230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cb7b7-5f87-4e93-bbd7-308a882a0cbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:06.491308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f25cb7b7-5f87-4e93-bbd7-308a882a0cbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:06.558503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25cb7b7-5f87-4e93-bbd7-308a882a0cbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:06.560370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25cb7b7-5f87-4e93-bbd7-308a882a0cbd service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:06.571913 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 920/1845] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:20:06.609148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1e75-fcf2-48a4-8440-16d956138fe2 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:06.609643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1e75-fcf2-48a4-8440-16d956138fe2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:06.610075 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1e75-fcf2-48a4-8440-16d956138fe2 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:06.611855 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 926/1846] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:20:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:20:06.618063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cb7b7-5f87-4e93-bbd7-308a882a0cbd service nova] Authenticating service token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:20:06.629897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cb7b7-5f87-4e93-bbd7-308a882a0cbd service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:06.640980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cb7b7-5f87-4e93-bbd7-308a882a0cbd service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:06.646717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a914def-c03c-413e-909b-2c8af66088f4 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a38e4ea5c294f0da94264e398042e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cdc6be3300d4f38ad3f64978e224a33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:06.647586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a914def-c03c-413e-909b-2c8af66088f4 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:06.648364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a914def-c03c-413e-909b-2c8af66088f4 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:06.648364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a914def-c03c-413e-909b-2c8af66088f4 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] PATH_INFO: `/v3/projects/8b7963c17485470f9f45ff3dfbfa13fd` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:06.649508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a914def-c03c-413e-909b-2c8af66088f4 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorizing `identity:get_project(project_id=8b7963c17485470f9f45ff3dfbfa13fd)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:06.651683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a914def-c03c-413e-909b-2c8af66088f4 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:06.653563 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 921/1847] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:20:06 2022] GET /identity/v3/projects/8b7963c17485470f9f45ff3dfbfa13fd => generated 371 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:06.828800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1e75-fcf2-48a4-8440-16d956138fe2 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:06.830739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-830b1e75-fcf2-48a4-8440-16d956138fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:06.834760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10526e5-b279-40df-8274-423649642309 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:06.835179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10526e5-b279-40df-8274-423649642309 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:06.835468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10526e5-b279-40df-8274-423649642309 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:06.838085 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 922/1848] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:20:06.843640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10526e5-b279-40df-8274-423649642309 None None] Authenticating service token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:20:06.877518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10526e5-b279-40df-8274-423649642309 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:06.887785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10526e5-b279-40df-8274-423649642309 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:06.892950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93920a8-31c0-412d-a749-a006aab5509f tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a38e4ea5c294f0da94264e398042e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cdc6be3300d4f38ad3f64978e224a33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:06.893524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93920a8-31c0-412d-a749-a006aab5509f tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:06.893933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93920a8-31c0-412d-a749-a006aab5509f tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:06.894386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93920a8-31c0-412d-a749-a006aab5509f tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] PATH_INFO: `/v3/projects/8b7963c17485470f9f45ff3dfbfa13fd` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:06.895820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93920a8-31c0-412d-a749-a006aab5509f tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorizing `identity:get_project(project_id=8b7963c17485470f9f45ff3dfbfa13fd)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:06.897933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93920a8-31c0-412d-a749-a006aab5509f tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:06.900321 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 923/1849] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:20:06 2022] GET /identity/v3/projects/8b7963c17485470f9f45ff3dfbfa13fd => generated 371 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:06.928503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1e75-fcf2-48a4-8440-16d956138fe2 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:06.934359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff1f4f-e127-4854-854c-d169cd8e1dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:06.935231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff1f4f-e127-4854-854c-d169cd8e1dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:06.938260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff1f4f-e127-4854-854c-d169cd8e1dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:06.938260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff1f4f-e127-4854-854c-d169cd8e1dd2 admin admin] PATH_INFO: `/v3/projects/bede124781f041c381f476928232a1c4` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:06.938260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff1f4f-e127-4854-854c-d169cd8e1dd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bede124781f041c381f476928232a1c4)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:06.939410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff1f4f-e127-4854-854c-d169cd8e1dd2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:06.957798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93920a8-31c0-412d-a749-a006aab5509f tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:06.970550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93920a8-31c0-412d-a749-a006aab5509f tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:06.976056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d327ea-55bf-47b0-a17b-bc394a3e7fa6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a38e4ea5c294f0da94264e398042e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cdc6be3300d4f38ad3f64978e224a33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:06.977537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d327ea-55bf-47b0-a17b-bc394a3e7fa6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:06.980565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d327ea-55bf-47b0-a17b-bc394a3e7fa6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:06.980565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d327ea-55bf-47b0-a17b-bc394a3e7fa6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:06.980565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d327ea-55bf-47b0-a17b-bc394a3e7fa6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:06.980565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d327ea-55bf-47b0-a17b-bc394a3e7fa6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:06.980891 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d327ea-55bf-47b0-a17b-bc394a3e7fa6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:07.000084 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 924/1850] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:20:07.001181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d327ea-55bf-47b0-a17b-bc394a3e7fa6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:07.011316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d327ea-55bf-47b0-a17b-bc394a3e7fa6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:07.016044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ae0b7-6b80-4266-a713-73b6f1c872ab tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a38e4ea5c294f0da94264e398042e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cdc6be3300d4f38ad3f64978e224a33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:07.016739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ae0b7-6b80-4266-a713-73b6f1c872ab tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:07.017027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ae0b7-6b80-4266-a713-73b6f1c872ab tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:07.017307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ae0b7-6b80-4266-a713-73b6f1c872ab tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:07.018010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ae0b7-6b80-4266-a713-73b6f1c872ab tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:07.019906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ae0b7-6b80-4266-a713-73b6f1c872ab tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:07.046038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4cff1f4f-e127-4854-854c-d169cd8e1dd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bede124781f041c381f476928232a1c4', 'request_id': 'req-4cff1f4f-e127-4854-854c-d169cd8e1dd2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:07.125112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4cff1f4f-e127-4854-854c-d169cd8e1dd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bede124781f041c381f476928232a1c4', 'request_id': 'req-4cff1f4f-e127-4854-854c-d169cd8e1dd2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:07.129384 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 925/1851] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:07 2022] POST /identity/v3/users => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:07.133310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ae0b7-6b80-4266-a713-73b6f1c872ab tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:07.133451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4cff1f4f-e127-4854-854c-d169cd8e1dd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bede124781f041c381f476928232a1c4', 'request_id': 'req-4cff1f4f-e127-4854-854c-d169cd8e1dd2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:07.144875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4cff1f4f-e127-4854-854c-d169cd8e1dd2 admin admin] The token cache is being invalidate because project bede124781f041c381f476928232a1c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:07.145141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4cff1f4f-e127-4854-854c-d169cd8e1dd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:07.145421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ae0b7-6b80-4266-a713-73b6f1c872ab tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:07.145945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4cff1f4f-e127-4854-854c-d169cd8e1dd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:07.147686 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 927/1852] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:06 2022] DELETE /identity/v3/projects/bede124781f041c381f476928232a1c4 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:07.154750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff1f4f-e127-4854-854c-d169cd8e1dd2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:07.156232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4cff1f4f-e127-4854-854c-d169cd8e1dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:07.201320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e3f23-c8b9-4963-8f76-f92e0e737354 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a38e4ea5c294f0da94264e398042e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cdc6be3300d4f38ad3f64978e224a33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:07.202134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e3f23-c8b9-4963-8f76-f92e0e737354 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:07.202498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e3f23-c8b9-4963-8f76-f92e0e737354 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:07.202778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e3f23-c8b9-4963-8f76-f92e0e737354 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:07.203505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e3f23-c8b9-4963-8f76-f92e0e737354 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:07.203815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e3f23-c8b9-4963-8f76-f92e0e737354 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:07.205526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e3f23-c8b9-4963-8f76-f92e0e737354 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:07.217679 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 926/1853] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:20:07.220385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff1f4f-e127-4854-854c-d169cd8e1dd2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:07.225321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f2704-60ea-4fa2-94a3-459c9b0e0102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:07.226207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f2704-60ea-4fa2-94a3-459c9b0e0102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:07.226515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f2704-60ea-4fa2-94a3-459c9b0e0102 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:07.226790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f2704-60ea-4fa2-94a3-459c9b0e0102 admin admin] PATH_INFO: `/v3/users/cda906bfbc7245c29cb039f4fa10c1a3` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:07.230209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f2704-60ea-4fa2-94a3-459c9b0e0102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cda906bfbc7245c29cb039f4fa10c1a3)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:07.232727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f2704-60ea-4fa2-94a3-459c9b0e0102 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:07.236073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a20a7f-afbc-4468-abfe-f4e6bfdf1f1b None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:07.236444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a20a7f-afbc-4468-abfe-f4e6bfdf1f1b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:07.236799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a20a7f-afbc-4468-abfe-f4e6bfdf1f1b None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:07.238405 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 927/1854] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:20:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 10:20:07.243972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a20a7f-afbc-4468-abfe-f4e6bfdf1f1b None None] Authenticating service token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:20:07.246649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e4a20a7f-afbc-4468-abfe-f4e6bfdf1f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:07.326421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a20a7f-afbc-4468-abfe-f4e6bfdf1f1b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:07.330147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e4a20a7f-afbc-4468-abfe-f4e6bfdf1f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:07.343849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a20a7f-afbc-4468-abfe-f4e6bfdf1f1b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:07.349971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c22960-c47b-489a-a17a-587ff3c5a5c5 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a38e4ea5c294f0da94264e398042e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cdc6be3300d4f38ad3f64978e224a33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:07.350843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c22960-c47b-489a-a17a-587ff3c5a5c5 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:07.351134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c22960-c47b-489a-a17a-587ff3c5a5c5 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:07.351408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c22960-c47b-489a-a17a-587ff3c5a5c5 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] PATH_INFO: `/v3/projects/8b7963c17485470f9f45ff3dfbfa13fd` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:07.353315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c22960-c47b-489a-a17a-587ff3c5a5c5 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorizing `identity:get_project(project_id=8b7963c17485470f9f45ff3dfbfa13fd)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:07.355442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c22960-c47b-489a-a17a-587ff3c5a5c5 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:07.357282 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 928/1855] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:20:07 2022] GET /identity/v3/projects/8b7963c17485470f9f45ff3dfbfa13fd => generated 371 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:07.432235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-135f2704-60ea-4fa2-94a3-459c9b0e0102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda906bfbc7245c29cb039f4fa10c1a3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:07.444831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-135f2704-60ea-4fa2-94a3-459c9b0e0102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda906bfbc7245c29cb039f4fa10c1a3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:07.445689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-135f2704-60ea-4fa2-94a3-459c9b0e0102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda906bfbc7245c29cb039f4fa10c1a3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:07.452594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-135f2704-60ea-4fa2-94a3-459c9b0e0102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda906bfbc7245c29cb039f4fa10c1a3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:07.539138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-135f2704-60ea-4fa2-94a3-459c9b0e0102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda906bfbc7245c29cb039f4fa10c1a3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:07.546441 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 928/1856] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:07 2022] DELETE /identity/v3/users/cda906bfbc7245c29cb039f4fa10c1a3 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:07.567857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42f614-fe47-400e-ae7b-e58d229e1a1b None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:07.568151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42f614-fe47-400e-ae7b-e58d229e1a1b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:07.568432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42f614-fe47-400e-ae7b-e58d229e1a1b None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:07.569883 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 929/1857] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:20:07.574655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f2704-60ea-4fa2-94a3-459c9b0e0102 admin admin] Authenticating service token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:20:07.576167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-135f2704-60ea-4fa2-94a3-459c9b0e0102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:07.651909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42f614-fe47-400e-ae7b-e58d229e1a1b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:07.652078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f2704-60ea-4fa2-94a3-459c9b0e0102 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:07.653387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-135f2704-60ea-4fa2-94a3-459c9b0e0102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:07.653656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3a42f614-fe47-400e-ae7b-e58d229e1a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:07.714889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f2704-60ea-4fa2-94a3-459c9b0e0102 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:07.719581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2079c0-d888-46e8-b9ac-d1ee2fb35a38 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a38e4ea5c294f0da94264e398042e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cdc6be3300d4f38ad3f64978e224a33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:07.719774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42f614-fe47-400e-ae7b-e58d229e1a1b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:07.720454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2079c0-d888-46e8-b9ac-d1ee2fb35a38 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:07.720779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2079c0-d888-46e8-b9ac-d1ee2fb35a38 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:07.721053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2079c0-d888-46e8-b9ac-d1ee2fb35a38 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] PATH_INFO: `/v3/projects/8b7963c17485470f9f45ff3dfbfa13fd` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:07.722264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2079c0-d888-46e8-b9ac-d1ee2fb35a38 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorizing `identity:get_project(project_id=8b7963c17485470f9f45ff3dfbfa13fd)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:07.724854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2079c0-d888-46e8-b9ac-d1ee2fb35a38 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:07.725831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6ca10-c9ad-4a3e-b4b1-abd7e31dc906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:07.726305 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 929/1858] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:20:07 2022] GET /identity/v3/projects/8b7963c17485470f9f45ff3dfbfa13fd => generated 371 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:07.726882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6ca10-c9ad-4a3e-b4b1-abd7e31dc906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:07.727169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6ca10-c9ad-4a3e-b4b1-abd7e31dc906 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:07.727592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6ca10-c9ad-4a3e-b4b1-abd7e31dc906 admin admin] PATH_INFO: `/v3/users/e44a06856323407da3c0e0fb0db93902` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:07.729049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6ca10-c9ad-4a3e-b4b1-abd7e31dc906 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e44a06856323407da3c0e0fb0db93902)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:07.731153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6ca10-c9ad-4a3e-b4b1-abd7e31dc906 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:07.764939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2079c0-d888-46e8-b9ac-d1ee2fb35a38 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:07.777728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2079c0-d888-46e8-b9ac-d1ee2fb35a38 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:07.784511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5bd164-3272-4aea-81c3-855f7585e803 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a38e4ea5c294f0da94264e398042e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cdc6be3300d4f38ad3f64978e224a33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:07.785497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bd164-3272-4aea-81c3-855f7585e803 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:07.785789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bd164-3272-4aea-81c3-855f7585e803 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:07.786125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bd164-3272-4aea-81c3-855f7585e803 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] PATH_INFO: `/v3/users/63073bdfef4c4ed5bd0e5e4921bac025` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:07.801071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5bd164-3272-4aea-81c3-855f7585e803 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorizing `identity:delete_user(user_id=63073bdfef4c4ed5bd0e5e4921bac025)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:07.803077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5bd164-3272-4aea-81c3-855f7585e803 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:07.916729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-26e6ca10-c9ad-4a3e-b4b1-abd7e31dc906 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e44a06856323407da3c0e0fb0db93902'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:07.929267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-26e6ca10-c9ad-4a3e-b4b1-abd7e31dc906 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e44a06856323407da3c0e0fb0db93902'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:07.930154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-26e6ca10-c9ad-4a3e-b4b1-abd7e31dc906 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e44a06856323407da3c0e0fb0db93902'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:07.938210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-26e6ca10-c9ad-4a3e-b4b1-abd7e31dc906 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e44a06856323407da3c0e0fb0db93902'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:07.946745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7d5bd164-3272-4aea-81c3-855f7585e803 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63073bdfef4c4ed5bd0e5e4921bac025'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:07.958598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7d5bd164-3272-4aea-81c3-855f7585e803 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63073bdfef4c4ed5bd0e5e4921bac025'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:07.959370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7d5bd164-3272-4aea-81c3-855f7585e803 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63073bdfef4c4ed5bd0e5e4921bac025'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:07.970464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7d5bd164-3272-4aea-81c3-855f7585e803 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63073bdfef4c4ed5bd0e5e4921bac025'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:08.024988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-26e6ca10-c9ad-4a3e-b4b1-abd7e31dc906 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e44a06856323407da3c0e0fb0db93902'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:08.031607 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 930/1859] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:07 2022] DELETE /identity/v3/users/e44a06856323407da3c0e0fb0db93902 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:08.035943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25203b5-d30d-4854-8508-e081a4ea92cb None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:08.036260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25203b5-d30d-4854-8508-e081a4ea92cb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:08.036543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25203b5-d30d-4854-8508-e081a4ea92cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:08.060217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e25203b5-d30d-4854-8508-e081a4ea92cb None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:08.060217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e25203b5-d30d-4854-8508-e081a4ea92cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:08.100232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7d5bd164-3272-4aea-81c3-855f7585e803 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63073bdfef4c4ed5bd0e5e4921bac025'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:08.107541 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 930/1860] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:07 2022] DELETE /identity/v3/users/63073bdfef4c4ed5bd0e5e4921bac025 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:08.108780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5bd164-3272-4aea-81c3-855f7585e803 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:08.112279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7d5bd164-3272-4aea-81c3-855f7585e803 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:08.139156 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 931/1861] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:20:08.140116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25203b5-d30d-4854-8508-e081a4ea92cb None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:08.141371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e25203b5-d30d-4854-8508-e081a4ea92cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:08.195432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5bd164-3272-4aea-81c3-855f7585e803 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:08.202290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1794b-9274-4718-8fcc-c24a9a2be0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:08.203167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1794b-9274-4718-8fcc-c24a9a2be0dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:08.203454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1794b-9274-4718-8fcc-c24a9a2be0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:08.203732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1794b-9274-4718-8fcc-c24a9a2be0dc admin admin] PATH_INFO: `/v3/projects/7cdc8eca8bae47ef8eba8dc26506512b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:08.205038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1794b-9274-4718-8fcc-c24a9a2be0dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cdc8eca8bae47ef8eba8dc26506512b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:08.206967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1794b-9274-4718-8fcc-c24a9a2be0dc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:08.213031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25203b5-d30d-4854-8508-e081a4ea92cb None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:08.269366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483b05c-f15f-4a1e-8b2b-511219ab9919 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a38e4ea5c294f0da94264e398042e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cdc6be3300d4f38ad3f64978e224a33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:08.270313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483b05c-f15f-4a1e-8b2b-511219ab9919 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:08.270663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483b05c-f15f-4a1e-8b2b-511219ab9919 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:08.271008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483b05c-f15f-4a1e-8b2b-511219ab9919 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] PATH_INFO: `/v3/projects/8b7963c17485470f9f45ff3dfbfa13fd` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:08.272239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483b05c-f15f-4a1e-8b2b-511219ab9919 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8b7963c17485470f9f45ff3dfbfa13fd)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:08.274343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483b05c-f15f-4a1e-8b2b-511219ab9919 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:08.323343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6bc1794b-9274-4718-8fcc-c24a9a2be0dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cdc8eca8bae47ef8eba8dc26506512b', 'request_id': 'req-6bc1794b-9274-4718-8fcc-c24a9a2be0dc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:08.399940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8483b05c-f15f-4a1e-8b2b-511219ab9919 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b7963c17485470f9f45ff3dfbfa13fd', 'request_id': 'req-8483b05c-f15f-4a1e-8b2b-511219ab9919'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:08.406196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8483b05c-f15f-4a1e-8b2b-511219ab9919 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b7963c17485470f9f45ff3dfbfa13fd', 'request_id': 'req-8483b05c-f15f-4a1e-8b2b-511219ab9919'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:08.422964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6bc1794b-9274-4718-8fcc-c24a9a2be0dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cdc8eca8bae47ef8eba8dc26506512b', 'request_id': 'req-6bc1794b-9274-4718-8fcc-c24a9a2be0dc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:08.429664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6bc1794b-9274-4718-8fcc-c24a9a2be0dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cdc8eca8bae47ef8eba8dc26506512b', 'request_id': 'req-6bc1794b-9274-4718-8fcc-c24a9a2be0dc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:08.440720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6bc1794b-9274-4718-8fcc-c24a9a2be0dc admin admin] The token cache is being invalidate because project 7cdc8eca8bae47ef8eba8dc26506512b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:08.441325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6bc1794b-9274-4718-8fcc-c24a9a2be0dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:08.441749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6bc1794b-9274-4718-8fcc-c24a9a2be0dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:08.443601 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 931/1862] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:08 2022] DELETE /identity/v3/projects/7cdc8eca8bae47ef8eba8dc26506512b => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:08.444220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1794b-9274-4718-8fcc-c24a9a2be0dc admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:08.445783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6bc1794b-9274-4718-8fcc-c24a9a2be0dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:08.494583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8483b05c-f15f-4a1e-8b2b-511219ab9919 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b7963c17485470f9f45ff3dfbfa13fd', 'request_id': 'req-8483b05c-f15f-4a1e-8b2b-511219ab9919'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:08.506628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1794b-9274-4718-8fcc-c24a9a2be0dc admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:08.509475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8483b05c-f15f-4a1e-8b2b-511219ab9919 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] The token cache is being invalidate because project 8b7963c17485470f9f45ff3dfbfa13fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:08.510464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8483b05c-f15f-4a1e-8b2b-511219ab9919 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:08.511212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8483b05c-f15f-4a1e-8b2b-511219ab9919 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:08.530560 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 932/1863] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:08 2022] DELETE /identity/v3/projects/8b7963c17485470f9f45ff3dfbfa13fd => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:08.533425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68439eea-10ad-4fb2-b4b8-ce94d8192718 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:08.533918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68439eea-10ad-4fb2-b4b8-ce94d8192718 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:08.534376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68439eea-10ad-4fb2-b4b8-ce94d8192718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:08.560061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daabae6-8edb-4d37-8ce3-b70a4e3cdcc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:08.560223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-68439eea-10ad-4fb2-b4b8-ce94d8192718 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:08.560777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daabae6-8edb-4d37-8ce3-b70a4e3cdcc6 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:08.561067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daabae6-8edb-4d37-8ce3-b70a4e3cdcc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:08.565827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daabae6-8edb-4d37-8ce3-b70a4e3cdcc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:08.568442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-68439eea-10ad-4fb2-b4b8-ce94d8192718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:08.568529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1daabae6-8edb-4d37-8ce3-b70a4e3cdcc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:08.628198 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 933/1864] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:08.629744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4178e-cc03-4203-a68b-fec66278feed None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:08.630083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4178e-cc03-4203-a68b-fec66278feed None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:08.630313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4178e-cc03-4203-a68b-fec66278feed None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:08.631574 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 934/1865] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:20:08.636417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf0ecf-f10c-4037-8520-db4e2c8a9d65 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:08.637948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf0ecf-f10c-4037-8520-db4e2c8a9d65 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:08.638243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf0ecf-f10c-4037-8520-db4e2c8a9d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:08.640509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daabae6-8edb-4d37-8ce3-b70a4e3cdcc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:08.642037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daabae6-8edb-4d37-8ce3-b70a4e3cdcc6 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:08.658544 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 932/1866] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:08.661505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daabae6-8edb-4d37-8ce3-b70a4e3cdcc6 service neutron] Authenticating service token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:20:08.663621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1daabae6-8edb-4d37-8ce3-b70a4e3cdcc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:08.666976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-97bf0ecf-f10c-4037-8520-db4e2c8a9d65 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:08.668353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-97bf0ecf-f10c-4037-8520-db4e2c8a9d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:08.681941 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 935/1867] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:08.685997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf0ecf-f10c-4037-8520-db4e2c8a9d65 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:08.698786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf0ecf-f10c-4037-8520-db4e2c8a9d65 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:08.706241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017ca54-27f1-4e9f-82f2-857819421886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:08.707269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017ca54-27f1-4e9f-82f2-857819421886 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:08.707804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017ca54-27f1-4e9f-82f2-857819421886 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:08.708455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017ca54-27f1-4e9f-82f2-857819421886 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:08.709324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017ca54-27f1-4e9f-82f2-857819421886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:08.709733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017ca54-27f1-4e9f-82f2-857819421886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:08.713007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017ca54-27f1-4e9f-82f2-857819421886 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:08.732783 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 936/1868] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:20:08.737067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017ca54-27f1-4e9f-82f2-857819421886 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:08.747698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017ca54-27f1-4e9f-82f2-857819421886 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:08.752672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13b65d-a827-4fd9-b2e2-3a8d246acf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:08.753379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13b65d-a827-4fd9-b2e2-3a8d246acf17 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:08.753663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13b65d-a827-4fd9-b2e2-3a8d246acf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:08.754141 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13b65d-a827-4fd9-b2e2-3a8d246acf17 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:08.754760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13b65d-a827-4fd9-b2e2-3a8d246acf17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:08.756825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13b65d-a827-4fd9-b2e2-3a8d246acf17 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:08.767925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daabae6-8edb-4d37-8ce3-b70a4e3cdcc6 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:08.769278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1daabae6-8edb-4d37-8ce3-b70a4e3cdcc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:08.831314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daabae6-8edb-4d37-8ce3-b70a4e3cdcc6 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:08.835971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48334e76-08e5-436a-a90c-7695455ba7b6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a38e4ea5c294f0da94264e398042e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cdc6be3300d4f38ad3f64978e224a33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:08.837442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48334e76-08e5-436a-a90c-7695455ba7b6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:08.837726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48334e76-08e5-436a-a90c-7695455ba7b6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:08.838008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48334e76-08e5-436a-a90c-7695455ba7b6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] PATH_INFO: `/v3/projects/1c3cc59c411a49caaede8817eada1414` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:08.839204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48334e76-08e5-436a-a90c-7695455ba7b6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorizing `identity:get_project(project_id=1c3cc59c411a49caaede8817eada1414)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:08.841399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48334e76-08e5-436a-a90c-7695455ba7b6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:08.843623 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 933/1869] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:20:08 2022] GET /identity/v3/projects/1c3cc59c411a49caaede8817eada1414 => generated 373 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:08.850737 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 937/1870] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:08 2022] POST /identity/v3/projects => generated 389 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:08.861621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48334e76-08e5-436a-a90c-7695455ba7b6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:08.874283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90255c-5868-4090-a663-32ab0a45ba39 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:08.874577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90255c-5868-4090-a663-32ab0a45ba39 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:08.874726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48334e76-08e5-436a-a90c-7695455ba7b6 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:08.874869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90255c-5868-4090-a663-32ab0a45ba39 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:08.876889 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 938/1871] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:20:08.888247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90255c-5868-4090-a663-32ab0a45ba39 None None] Authenticating service token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:20:08.890340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9e90255c-5868-4090-a663-32ab0a45ba39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:08.966313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0fbee-bba6-4239-90ee-36818e315efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:08.968181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0fbee-bba6-4239-90ee-36818e315efe admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:08.968658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0fbee-bba6-4239-90ee-36818e315efe admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:08.969718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0fbee-bba6-4239-90ee-36818e315efe admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:08.971406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0fbee-bba6-4239-90ee-36818e315efe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:08.975305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0fbee-bba6-4239-90ee-36818e315efe admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:09.013789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90255c-5868-4090-a663-32ab0a45ba39 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:09.089748 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 934/1872] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:08 2022] POST /identity/v3/users => generated 295 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:09.093913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90255c-5868-4090-a663-32ab0a45ba39 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:09.094299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0fbee-bba6-4239-90ee-36818e315efe admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:09.101302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ceec8-6635-4ca3-8943-b377e2b486a1 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a38e4ea5c294f0da94264e398042e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cdc6be3300d4f38ad3f64978e224a33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:09.103294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ceec8-6635-4ca3-8943-b377e2b486a1 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:09.103661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ceec8-6635-4ca3-8943-b377e2b486a1 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:09.104080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ceec8-6635-4ca3-8943-b377e2b486a1 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] PATH_INFO: `/v3/projects/1c3cc59c411a49caaede8817eada1414` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:09.105580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ceec8-6635-4ca3-8943-b377e2b486a1 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorizing `identity:get_project(project_id=1c3cc59c411a49caaede8817eada1414)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:09.107761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ceec8-6635-4ca3-8943-b377e2b486a1 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:09.110336 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 939/1873] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:20:08 2022] GET /identity/v3/projects/1c3cc59c411a49caaede8817eada1414 => generated 373 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:09.126397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0fbee-bba6-4239-90ee-36818e315efe admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:09.146832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff74da-0651-406d-ab92-bcf6ccffe8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:09.146832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff74da-0651-406d-ab92-bcf6ccffe8bb admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:09.146832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff74da-0651-406d-ab92-bcf6ccffe8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:09.147145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff74da-0651-406d-ab92-bcf6ccffe8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:09.147583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ceec8-6635-4ca3-8943-b377e2b486a1 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:09.148098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff74da-0651-406d-ab92-bcf6ccffe8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:09.151402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2d2ceec8-6635-4ca3-8943-b377e2b486a1 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:09.151516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff74da-0651-406d-ab92-bcf6ccffe8bb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:09.166356 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 935/1874] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:20:09.167748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff74da-0651-406d-ab92-bcf6ccffe8bb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:09.179093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ceec8-6635-4ca3-8943-b377e2b486a1 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:09.183755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff74da-0651-406d-ab92-bcf6ccffe8bb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:09.188940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2fff6-bc8d-4c17-8223-2c129a6ea54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:09.189818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2fff6-bc8d-4c17-8223-2c129a6ea54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:09.190438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2fff6-bc8d-4c17-8223-2c129a6ea54b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:09.190728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2fff6-bc8d-4c17-8223-2c129a6ea54b admin admin] PATH_INFO: `/v3/projects/fbbe331a123a42ab995f539e5de8f2ea` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:09.191402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4a75e-d1e2-461b-8b3f-31c6475e8a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:09.191976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2fff6-bc8d-4c17-8223-2c129a6ea54b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbbe331a123a42ab995f539e5de8f2ea)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:09.192292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4a75e-d1e2-461b-8b3f-31c6475e8a82 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:09.192617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4a75e-d1e2-461b-8b3f-31c6475e8a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:09.192921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4a75e-d1e2-461b-8b3f-31c6475e8a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:09.193697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4a75e-d1e2-461b-8b3f-31c6475e8a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:09.194028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2fff6-bc8d-4c17-8223-2c129a6ea54b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:09.195283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4a75e-d1e2-461b-8b3f-31c6475e8a82 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:09.217312 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 936/1875] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:09.223966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4a75e-d1e2-461b-8b3f-31c6475e8a82 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:09.234769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4a75e-d1e2-461b-8b3f-31c6475e8a82 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:09.239556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33978e9-d8da-456c-a039-287a6e03bc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:09.240441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33978e9-d8da-456c-a039-287a6e03bc69 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:09.240857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33978e9-d8da-456c-a039-287a6e03bc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:09.241141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33978e9-d8da-456c-a039-287a6e03bc69 admin admin] PATH_INFO: `/v3/projects/af9cc24c4cb146db8117f542befa07e5/users/7c6e4f537f71458f95a88e3d9fb94109/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:09.256252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33978e9-d8da-456c-a039-287a6e03bc69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af9cc24c4cb146db8117f542befa07e5, user_id=7c6e4f537f71458f95a88e3d9fb94109, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:09.259608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33978e9-d8da-456c-a039-287a6e03bc69 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:09.327853 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 937/1876] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:09 2022] PUT /identity/v3/projects/af9cc24c4cb146db8117f542befa07e5/users/7c6e4f537f71458f95a88e3d9fb94109/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:09.339803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab2b93-3a87-4683-8fd9-0711930ecc23 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:09.340155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab2b93-3a87-4683-8fd9-0711930ecc23 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:09.342526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab2b93-3a87-4683-8fd9-0711930ecc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:09.342789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6a2fff6-bc8d-4c17-8223-2c129a6ea54b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbbe331a123a42ab995f539e5de8f2ea', 'request_id': 'req-d6a2fff6-bc8d-4c17-8223-2c129a6ea54b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:09.350668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6a2fff6-bc8d-4c17-8223-2c129a6ea54b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbbe331a123a42ab995f539e5de8f2ea', 'request_id': 'req-d6a2fff6-bc8d-4c17-8223-2c129a6ea54b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:09.371418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-65ab2b93-3a87-4683-8fd9-0711930ecc23 None None] MFA Rules not processed for user `7c6e4f537f71458f95a88e3d9fb94109`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:09.371418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-65ab2b93-3a87-4683-8fd9-0711930ecc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:09.428462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6a2fff6-bc8d-4c17-8223-2c129a6ea54b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbbe331a123a42ab995f539e5de8f2ea', 'request_id': 'req-d6a2fff6-bc8d-4c17-8223-2c129a6ea54b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:09.432582 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 938/1877] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:09.437255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab2b93-3a87-4683-8fd9-0711930ecc23 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:09.439852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6a2fff6-bc8d-4c17-8223-2c129a6ea54b admin admin] The token cache is being invalidate because project fbbe331a123a42ab995f539e5de8f2ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:09.440170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6a2fff6-bc8d-4c17-8223-2c129a6ea54b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:09.440854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6a2fff6-bc8d-4c17-8223-2c129a6ea54b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:09.442400 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 940/1878] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:09 2022] DELETE /identity/v3/projects/fbbe331a123a42ab995f539e5de8f2ea => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:09.446676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2fff6-bc8d-4c17-8223-2c129a6ea54b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:09.448078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d6a2fff6-bc8d-4c17-8223-2c129a6ea54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:09.499176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab2b93-3a87-4683-8fd9-0711930ecc23 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:09.503759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949bedb-f000-4a2e-9fa0-b93fb7ea6758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:09.504418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949bedb-f000-4a2e-9fa0-b93fb7ea6758 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:09.504740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949bedb-f000-4a2e-9fa0-b93fb7ea6758 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:09.505022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949bedb-f000-4a2e-9fa0-b93fb7ea6758 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:09.505711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949bedb-f000-4a2e-9fa0-b93fb7ea6758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:09.507626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949bedb-f000-4a2e-9fa0-b93fb7ea6758 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:09.512309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2fff6-bc8d-4c17-8223-2c129a6ea54b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:09.517540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff39584-37d5-4757-a88e-b2adccaec753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:09.518445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff39584-37d5-4757-a88e-b2adccaec753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:09.518725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff39584-37d5-4757-a88e-b2adccaec753 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:09.519003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff39584-37d5-4757-a88e-b2adccaec753 admin admin] PATH_INFO: `/v3/users/fdde02f8056f4cc49367bc51fec5bad7` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:09.520388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff39584-37d5-4757-a88e-b2adccaec753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdde02f8056f4cc49367bc51fec5bad7)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:09.522401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff39584-37d5-4757-a88e-b2adccaec753 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:09.610195 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 939/1879] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:09 2022] POST /identity/v3/projects => generated 391 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:20:09.614441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949bedb-f000-4a2e-9fa0-b93fb7ea6758 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:09.616175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d949bedb-f000-4a2e-9fa0-b93fb7ea6758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:09.681571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949bedb-f000-4a2e-9fa0-b93fb7ea6758 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:09.686518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b43c7e-c509-49c5-8e9a-ae95c3987cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:09.687198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b43c7e-c509-49c5-8e9a-ae95c3987cbc admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:09.687487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b43c7e-c509-49c5-8e9a-ae95c3987cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:09.687765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b43c7e-c509-49c5-8e9a-ae95c3987cbc admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:09.688458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b43c7e-c509-49c5-8e9a-ae95c3987cbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:09.690416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b43c7e-c509-49c5-8e9a-ae95c3987cbc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:09.768931 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 940/1880] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:09 2022] POST /identity/v3/users => generated 302 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:20:09.772834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b43c7e-c509-49c5-8e9a-ae95c3987cbc admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:09.782734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b43c7e-c509-49c5-8e9a-ae95c3987cbc admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:09.788054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e68ca-962f-4325-9e43-612abfa7cb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:09.788756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e68ca-962f-4325-9e43-612abfa7cb8c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:09.789066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e68ca-962f-4325-9e43-612abfa7cb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:09.789358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e68ca-962f-4325-9e43-612abfa7cb8c admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:09.790087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e68ca-962f-4325-9e43-612abfa7cb8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:09.791677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e68ca-962f-4325-9e43-612abfa7cb8c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:09.801634 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 941/1881] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:09.806094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e68ca-962f-4325-9e43-612abfa7cb8c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:09.816119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e68ca-962f-4325-9e43-612abfa7cb8c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:09.821919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70270b66-ac9b-4e59-92b9-fc0b51c0c6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:09.822979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70270b66-ac9b-4e59-92b9-fc0b51c0c6f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:09.829202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70270b66-ac9b-4e59-92b9-fc0b51c0c6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:09.829202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70270b66-ac9b-4e59-92b9-fc0b51c0c6f3 admin admin] PATH_INFO: `/v3/projects/27d2535d4550489d84326bf6108d02c3/users/a3d9dc2b76324338800cc469cc22fc8a/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:09.835070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9ff39584-37d5-4757-a88e-b2adccaec753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdde02f8056f4cc49367bc51fec5bad7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:09.840846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70270b66-ac9b-4e59-92b9-fc0b51c0c6f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d2535d4550489d84326bf6108d02c3, user_id=a3d9dc2b76324338800cc469cc22fc8a, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:09.843559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70270b66-ac9b-4e59-92b9-fc0b51c0c6f3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:09.854249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9ff39584-37d5-4757-a88e-b2adccaec753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdde02f8056f4cc49367bc51fec5bad7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:09.855134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9ff39584-37d5-4757-a88e-b2adccaec753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdde02f8056f4cc49367bc51fec5bad7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:09.862213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9ff39584-37d5-4757-a88e-b2adccaec753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdde02f8056f4cc49367bc51fec5bad7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:09.939791 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 942/1882] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:09 2022] PUT /identity/v3/projects/27d2535d4550489d84326bf6108d02c3/users/a3d9dc2b76324338800cc469cc22fc8a/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:09.943751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70270b66-ac9b-4e59-92b9-fc0b51c0c6f3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:09.944813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9ff39584-37d5-4757-a88e-b2adccaec753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdde02f8056f4cc49367bc51fec5bad7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:09.951871 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 941/1883] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:09 2022] DELETE /identity/v3/users/fdde02f8056f4cc49367bc51fec5bad7 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:10.006526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70270b66-ac9b-4e59-92b9-fc0b51c0c6f3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:10.062592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bd468-2a33-45df-874d-400fdb126e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:10.067995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bd468-2a33-45df-874d-400fdb126e21 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:10.067995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bd468-2a33-45df-874d-400fdb126e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:10.067995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bd468-2a33-45df-874d-400fdb126e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:10.067995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bd468-2a33-45df-874d-400fdb126e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:10.067995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bd468-2a33-45df-874d-400fdb126e21 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:10.075690 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 943/1884] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:20:10.080053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff39584-37d5-4757-a88e-b2adccaec753 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:10.081605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9ff39584-37d5-4757-a88e-b2adccaec753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:10.096655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff39584-37d5-4757-a88e-b2adccaec753 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:10.100671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4d2e7-44be-43dd-b718-dd8108226836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:10.101176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4d2e7-44be-43dd-b718-dd8108226836 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:10.101459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4d2e7-44be-43dd-b718-dd8108226836 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:10.101734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4d2e7-44be-43dd-b718-dd8108226836 admin admin] PATH_INFO: `/v3/projects/27d2535d4550489d84326bf6108d02c3/users/a3d9dc2b76324338800cc469cc22fc8a/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:10.104427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4d2e7-44be-43dd-b718-dd8108226836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d2535d4550489d84326bf6108d02c3, user_id=a3d9dc2b76324338800cc469cc22fc8a, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:10.107122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4d2e7-44be-43dd-b718-dd8108226836 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:10.125119 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 942/1885] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:10 2022] PUT /identity/v3/projects/27d2535d4550489d84326bf6108d02c3/users/a3d9dc2b76324338800cc469cc22fc8a/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:10.135935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c58faa-058d-4156-adb4-643d8cf533f8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:10.136353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c58faa-058d-4156-adb4-643d8cf533f8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:10.136954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c58faa-058d-4156-adb4-643d8cf533f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:10.170490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f4c58faa-058d-4156-adb4-643d8cf533f8 None None] MFA Rules not processed for user `a3d9dc2b76324338800cc469cc22fc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:10.171951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f4c58faa-058d-4156-adb4-643d8cf533f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:10.272160 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 944/1886] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:10.381313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4d2e7-44be-43dd-b718-dd8108226836 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:10.383470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0fa4d2e7-44be-43dd-b718-dd8108226836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:10.389955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c58faa-058d-4156-adb4-643d8cf533f8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:10.391420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f4c58faa-058d-4156-adb4-643d8cf533f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:10.469858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c58faa-058d-4156-adb4-643d8cf533f8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:10.481175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9c064-8e3f-4b28-90b5-071301ea4026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:10.482333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9c064-8e3f-4b28-90b5-071301ea4026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:10.482623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9c064-8e3f-4b28-90b5-071301ea4026 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:10.482897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9c064-8e3f-4b28-90b5-071301ea4026 admin admin] PATH_INFO: `/v3/projects/a710b3635c9745eebf4ce2d73293ea36` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:10.484288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9c064-8e3f-4b28-90b5-071301ea4026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a710b3635c9745eebf4ce2d73293ea36)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:10.486919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9c064-8e3f-4b28-90b5-071301ea4026 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:10.493924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4d2e7-44be-43dd-b718-dd8108226836 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:10.502031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cfc760-1175-4ace-ae24-752269992d3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:10.510411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfc760-1175-4ace-ae24-752269992d3c service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:10.510411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfc760-1175-4ace-ae24-752269992d3c service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:10.510411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfc760-1175-4ace-ae24-752269992d3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:10.516412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cfc760-1175-4ace-ae24-752269992d3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:10.518667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cfc760-1175-4ace-ae24-752269992d3c service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:10.536997 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 943/1887] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:10.617754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624660e-9385-4994-a84d-43525ddb2a61 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:10.618554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624660e-9385-4994-a84d-43525ddb2a61 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:10.618847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624660e-9385-4994-a84d-43525ddb2a61 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:10.623983 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 944/1888] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:20:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 10:20:10.638657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ac745-c654-4095-8987-e05399896de2 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:10.638825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ac745-c654-4095-8987-e05399896de2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:10.639104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ac745-c654-4095-8987-e05399896de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:10.658735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-98a9c064-8e3f-4b28-90b5-071301ea4026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a710b3635c9745eebf4ce2d73293ea36', 'request_id': 'req-98a9c064-8e3f-4b28-90b5-071301ea4026'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:10.670259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5e3ac745-c654-4095-8987-e05399896de2 None None] MFA Rules not processed for user `e6036dd39fb74289a8cbdcd6a21f8662`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:10.671527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5e3ac745-c654-4095-8987-e05399896de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:10.735033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-98a9c064-8e3f-4b28-90b5-071301ea4026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a710b3635c9745eebf4ce2d73293ea36', 'request_id': 'req-98a9c064-8e3f-4b28-90b5-071301ea4026'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:10.745400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-98a9c064-8e3f-4b28-90b5-071301ea4026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a710b3635c9745eebf4ce2d73293ea36', 'request_id': 'req-98a9c064-8e3f-4b28-90b5-071301ea4026'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:10.759862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-98a9c064-8e3f-4b28-90b5-071301ea4026 admin admin] The token cache is being invalidate because project a710b3635c9745eebf4ce2d73293ea36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:10.760195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-98a9c064-8e3f-4b28-90b5-071301ea4026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:10.760584 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 945/1889] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:20:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:10.761960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-98a9c064-8e3f-4b28-90b5-071301ea4026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:10.762478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6393b-061b-4522-9bba-00d72f72bb68 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:10.769134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6393b-061b-4522-9bba-00d72f72bb68 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:10.769512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6393b-061b-4522-9bba-00d72f72bb68 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:10.771254 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 946/1890] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:20:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:20:10.772530 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 945/1891] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:10 2022] DELETE /identity/v3/projects/a710b3635c9745eebf4ce2d73293ea36 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:10.777032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6393b-061b-4522-9bba-00d72f72bb68 None None] Authenticating service token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:20:10.778085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843804f-c754-4f7e-a109-f86a1471a7ba None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:10.778507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843804f-c754-4f7e-a109-f86a1471a7ba None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:10.778792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843804f-c754-4f7e-a109-f86a1471a7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:10.779077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-abb6393b-061b-4522-9bba-00d72f72bb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:10.803948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c843804f-c754-4f7e-a109-f86a1471a7ba None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:10.804160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6393b-061b-4522-9bba-00d72f72bb68 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:10.804641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c843804f-c754-4f7e-a109-f86a1471a7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:10.805677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-abb6393b-061b-4522-9bba-00d72f72bb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:10.891547 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 946/1892] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:10.891746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6393b-061b-4522-9bba-00d72f72bb68 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:10.891853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843804f-c754-4f7e-a109-f86a1471a7ba None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:10.891853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c843804f-c754-4f7e-a109-f86a1471a7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:10.892005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e765b-9f41-4f3d-9848-3deab1f698b4 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a38e4ea5c294f0da94264e398042e71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cdc6be3300d4f38ad3f64978e224a33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:10.892005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e765b-9f41-4f3d-9848-3deab1f698b4 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:10.892005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e765b-9f41-4f3d-9848-3deab1f698b4 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:10.892250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e765b-9f41-4f3d-9848-3deab1f698b4 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] PATH_INFO: `/v3/projects/1c3cc59c411a49caaede8817eada1414` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:10.893551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e765b-9f41-4f3d-9848-3deab1f698b4 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorizing `identity:get_project(project_id=1c3cc59c411a49caaede8817eada1414)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:10.895612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e765b-9f41-4f3d-9848-3deab1f698b4 tempest-QuotasAdminTestJSON-1184313798 tempest-QuotasAdminTestJSON-1184313798-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:10.897810 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 947/1893] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:20:10 2022] GET /identity/v3/projects/1c3cc59c411a49caaede8817eada1414 => generated 373 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:10.899531 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55c4e1-2e68-4eec-aa7d-995d95268afd None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:10.899820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55c4e1-2e68-4eec-aa7d-995d95268afd None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:10.900096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55c4e1-2e68-4eec-aa7d-995d95268afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:10.918062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843804f-c754-4f7e-a109-f86a1471a7ba None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:10.918532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ea55c4e1-2e68-4eec-aa7d-995d95268afd None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:10.919717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ea55c4e1-2e68-4eec-aa7d-995d95268afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:10.927764 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 948/1894] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:10.932175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55c4e1-2e68-4eec-aa7d-995d95268afd None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:10.933732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fc890-a1a7-4d2a-bad5-9a1fbe402ee1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:10.934985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fc890-a1a7-4d2a-bad5-9a1fbe402ee1 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:10.936684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fc890-a1a7-4d2a-bad5-9a1fbe402ee1 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:10.937245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fc890-a1a7-4d2a-bad5-9a1fbe402ee1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:10.939870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fe2fc890-a1a7-4d2a-bad5-9a1fbe402ee1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:10.943132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55c4e1-2e68-4eec-aa7d-995d95268afd None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:10.948808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f65390-d022-47ac-bc03-e39bfe691b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:10.949610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f65390-d022-47ac-bc03-e39bfe691b8e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:10.950085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f65390-d022-47ac-bc03-e39bfe691b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:10.950360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f65390-d022-47ac-bc03-e39bfe691b8e admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:10.951190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f65390-d022-47ac-bc03-e39bfe691b8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:10.952192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f65390-d022-47ac-bc03-e39bfe691b8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:10.953325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f65390-d022-47ac-bc03-e39bfe691b8e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:10.960274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fc890-a1a7-4d2a-bad5-9a1fbe402ee1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:10.963538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fc890-a1a7-4d2a-bad5-9a1fbe402ee1 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:10.968770 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 949/1895] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:20:10.971779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f65390-d022-47ac-bc03-e39bfe691b8e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:10.976102 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 947/1896] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:10.983125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f65390-d022-47ac-bc03-e39bfe691b8e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:10.988113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e24a3a-a448-4fbe-8138-2c633d0c1f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:10.989120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e24a3a-a448-4fbe-8138-2c633d0c1f7c admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:10.989409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e24a3a-a448-4fbe-8138-2c633d0c1f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:10.989758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e24a3a-a448-4fbe-8138-2c633d0c1f7c admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:10.990380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e24a3a-a448-4fbe-8138-2c633d0c1f7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:10.992995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e24a3a-a448-4fbe-8138-2c633d0c1f7c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:11.063568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fc890-a1a7-4d2a-bad5-9a1fbe402ee1 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:11.067473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fe2fc890-a1a7-4d2a-bad5-9a1fbe402ee1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:11.082785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fc890-a1a7-4d2a-bad5-9a1fbe402ee1 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:11.088037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a268879-3661-4f02-80fa-a903d2a5ed73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:11.088561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a268879-3661-4f02-80fa-a903d2a5ed73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:11.088977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a268879-3661-4f02-80fa-a903d2a5ed73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:11.089359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a268879-3661-4f02-80fa-a903d2a5ed73 admin admin] PATH_INFO: `/v3/users/7c6e4f537f71458f95a88e3d9fb94109` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:11.090686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a268879-3661-4f02-80fa-a903d2a5ed73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c6e4f537f71458f95a88e3d9fb94109)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:11.093170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a268879-3661-4f02-80fa-a903d2a5ed73 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:11.113757 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 950/1897] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:10 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:20:11.115241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e24a3a-a448-4fbe-8138-2c633d0c1f7c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:11.196951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e24a3a-a448-4fbe-8138-2c633d0c1f7c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:11.202902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a45f7-a82c-4f12-a8c9-02789fee5f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:11.203641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a45f7-a82c-4f12-a8c9-02789fee5f1d admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:11.203931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a45f7-a82c-4f12-a8c9-02789fee5f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:11.204272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a45f7-a82c-4f12-a8c9-02789fee5f1d admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:11.205016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a45f7-a82c-4f12-a8c9-02789fee5f1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:11.207006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a45f7-a82c-4f12-a8c9-02789fee5f1d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:11.307720 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 951/1898] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:11 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:20:11.309467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a45f7-a82c-4f12-a8c9-02789fee5f1d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:11.320159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a45f7-a82c-4f12-a8c9-02789fee5f1d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:11.326387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0d72a-8470-4236-abde-fa3b288c70c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:11.327057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0d72a-8470-4236-abde-fa3b288c70c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:11.327505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0d72a-8470-4236-abde-fa3b288c70c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:11.327791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0d72a-8470-4236-abde-fa3b288c70c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:11.328720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0d72a-8470-4236-abde-fa3b288c70c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:11.330330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0d72a-8470-4236-abde-fa3b288c70c3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:11.340528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6a268879-3661-4f02-80fa-a903d2a5ed73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c6e4f537f71458f95a88e3d9fb94109'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:11.341748 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 952/1899] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:11.345649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0d72a-8470-4236-abde-fa3b288c70c3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:11.356035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0d72a-8470-4236-abde-fa3b288c70c3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:11.356689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6a268879-3661-4f02-80fa-a903d2a5ed73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c6e4f537f71458f95a88e3d9fb94109'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:11.357406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6a268879-3661-4f02-80fa-a903d2a5ed73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c6e4f537f71458f95a88e3d9fb94109'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:11.361242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c925e6-9380-478f-bf35-0f0c86d2140e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:11.361998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c925e6-9380-478f-bf35-0f0c86d2140e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:11.372451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c925e6-9380-478f-bf35-0f0c86d2140e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:11.372451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c925e6-9380-478f-bf35-0f0c86d2140e admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:11.372451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c925e6-9380-478f-bf35-0f0c86d2140e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:11.372795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6a268879-3661-4f02-80fa-a903d2a5ed73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c6e4f537f71458f95a88e3d9fb94109'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:11.372881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c925e6-9380-478f-bf35-0f0c86d2140e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:11.376113 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 953/1900] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:20:11.380191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c925e6-9380-478f-bf35-0f0c86d2140e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:11.389868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c925e6-9380-478f-bf35-0f0c86d2140e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:11.394770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6e484-e719-42f7-bd10-d9bc6beafb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:11.395518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6e484-e719-42f7-bd10-d9bc6beafb2d admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:11.395801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6e484-e719-42f7-bd10-d9bc6beafb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:11.396085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6e484-e719-42f7-bd10-d9bc6beafb2d admin admin] PATH_INFO: `/v3/projects/51d17ff2e5bd43418d0a955840c066b1/users/fcd7ddf293ec4abc98776bb35fe89b6e/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:11.410732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6e484-e719-42f7-bd10-d9bc6beafb2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d17ff2e5bd43418d0a955840c066b1, user_id=fcd7ddf293ec4abc98776bb35fe89b6e, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:11.413489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6e484-e719-42f7-bd10-d9bc6beafb2d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:11.486114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6a268879-3661-4f02-80fa-a903d2a5ed73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c6e4f537f71458f95a88e3d9fb94109'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:11.492492 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 948/1901] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:11 2022] DELETE /identity/v3/users/7c6e4f537f71458f95a88e3d9fb94109 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:11.497492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99525f9c-cb3a-47a7-b055-f65f1d11cf54 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:11.497783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99525f9c-cb3a-47a7-b055-f65f1d11cf54 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:11.498064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99525f9c-cb3a-47a7-b055-f65f1d11cf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:11.516748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-99525f9c-cb3a-47a7-b055-f65f1d11cf54 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:11.517986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-99525f9c-cb3a-47a7-b055-f65f1d11cf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:11.523892 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 954/1902] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:11 2022] PUT /identity/v3/projects/51d17ff2e5bd43418d0a955840c066b1/users/fcd7ddf293ec4abc98776bb35fe89b6e/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:11.533421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e9882-dc73-43a3-9918-671e69e3946f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:11.533715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e9882-dc73-43a3-9918-671e69e3946f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:11.534019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e9882-dc73-43a3-9918-671e69e3946f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:11.563501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6a0e9882-dc73-43a3-9918-671e69e3946f None None] MFA Rules not processed for user `fcd7ddf293ec4abc98776bb35fe89b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:11.564795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6a0e9882-dc73-43a3-9918-671e69e3946f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:11.585081 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 949/1903] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:20:11.591743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99525f9c-cb3a-47a7-b055-f65f1d11cf54 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:11.593348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-99525f9c-cb3a-47a7-b055-f65f1d11cf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:11.634984 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 955/1904] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:11.639389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e9882-dc73-43a3-9918-671e69e3946f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:11.640716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6a0e9882-dc73-43a3-9918-671e69e3946f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:11.650717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99525f9c-cb3a-47a7-b055-f65f1d11cf54 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:11.654099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e9882-dc73-43a3-9918-671e69e3946f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:11.654843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dd14b-da19-4600-a54b-432ac12a2016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:11.655502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dd14b-da19-4600-a54b-432ac12a2016 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:11.655791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dd14b-da19-4600-a54b-432ac12a2016 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:11.656076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dd14b-da19-4600-a54b-432ac12a2016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:11.659055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeafff2-66c3-424f-a693-4fb3f860e738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:11.659733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeafff2-66c3-424f-a693-4fb3f860e738 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:11.660017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeafff2-66c3-424f-a693-4fb3f860e738 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:11.660293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeafff2-66c3-424f-a693-4fb3f860e738 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:11.661017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeafff2-66c3-424f-a693-4fb3f860e738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:11.663290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeafff2-66c3-424f-a693-4fb3f860e738 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:11.665882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9dd14b-da19-4600-a54b-432ac12a2016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:11.667342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9dd14b-da19-4600-a54b-432ac12a2016 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:11.677063 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 950/1905] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:20:11.743808 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 956/1906] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:11 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:20:11.748138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dd14b-da19-4600-a54b-432ac12a2016 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:11.758106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dd14b-da19-4600-a54b-432ac12a2016 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:11.815221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89130fc-9844-4926-a49f-fbf522b43867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:11.815899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89130fc-9844-4926-a49f-fbf522b43867 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:11.816190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89130fc-9844-4926-a49f-fbf522b43867 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:11.816464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89130fc-9844-4926-a49f-fbf522b43867 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:11.817210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89130fc-9844-4926-a49f-fbf522b43867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:11.819155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89130fc-9844-4926-a49f-fbf522b43867 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:11.939813 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 951/1907] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:11 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:11.943686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeafff2-66c3-424f-a693-4fb3f860e738 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:11.953808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeafff2-66c3-424f-a693-4fb3f860e738 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:11.958436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb56776-bcec-4379-96d3-744ae02cb430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:11.959105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb56776-bcec-4379-96d3-744ae02cb430 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:11.959387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb56776-bcec-4379-96d3-744ae02cb430 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:11.959672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb56776-bcec-4379-96d3-744ae02cb430 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:11.960472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb56776-bcec-4379-96d3-744ae02cb430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:11.962651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb56776-bcec-4379-96d3-744ae02cb430 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:11.973536 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 957/1908] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:11.978383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89130fc-9844-4926-a49f-fbf522b43867 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:11.988849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89130fc-9844-4926-a49f-fbf522b43867 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:11.993772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05a8ff-e4b6-48ad-87b8-967bf7150c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:11.994712 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05a8ff-e4b6-48ad-87b8-967bf7150c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:11.994999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05a8ff-e4b6-48ad-87b8-967bf7150c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:12.003690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05a8ff-e4b6-48ad-87b8-967bf7150c70 admin admin] PATH_INFO: `/v3/projects/8c61ff3e07774a8d84ef24681c612f1b/users/7ca9fe96a88c49cb81441b598504ec5c/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:12.012166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05a8ff-e4b6-48ad-87b8-967bf7150c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c61ff3e07774a8d84ef24681c612f1b, user_id=7ca9fe96a88c49cb81441b598504ec5c, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:12.014963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05a8ff-e4b6-48ad-87b8-967bf7150c70 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:12.080339 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 952/1909] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:11 2022] PUT /identity/v3/projects/8c61ff3e07774a8d84ef24681c612f1b/users/7ca9fe96a88c49cb81441b598504ec5c/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:12.084407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb56776-bcec-4379-96d3-744ae02cb430 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:12.094889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb56776-bcec-4379-96d3-744ae02cb430 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:12.116641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05a8ff-e4b6-48ad-87b8-967bf7150c70 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:12.118415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4b05a8ff-e4b6-48ad-87b8-967bf7150c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:12.169641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d6c8c-d794-450f-a760-34e4a42d6526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:12.170314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d6c8c-d794-450f-a760-34e4a42d6526 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:12.170595 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d6c8c-d794-450f-a760-34e4a42d6526 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:12.171445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d6c8c-d794-450f-a760-34e4a42d6526 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:12.171920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d6c8c-d794-450f-a760-34e4a42d6526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:12.173582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d6c8c-d794-450f-a760-34e4a42d6526 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:12.183493 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 958/1910] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:12.187532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d6c8c-d794-450f-a760-34e4a42d6526 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:12.197478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d6c8c-d794-450f-a760-34e4a42d6526 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:12.200363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05a8ff-e4b6-48ad-87b8-967bf7150c70 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:12.202156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ffe33-812d-46bd-9b09-92d7b7d73f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:12.203025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ffe33-812d-46bd-9b09-92d7b7d73f6a admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:12.203307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ffe33-812d-46bd-9b09-92d7b7d73f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:12.203585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ffe33-812d-46bd-9b09-92d7b7d73f6a admin admin] PATH_INFO: `/v3/projects/8c61ff3e07774a8d84ef24681c612f1b/users/7ca9fe96a88c49cb81441b598504ec5c/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:12.205092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846215c-aa8f-4c25-ae55-489204f6081e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:12.205562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ffe33-812d-46bd-9b09-92d7b7d73f6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c61ff3e07774a8d84ef24681c612f1b, user_id=7ca9fe96a88c49cb81441b598504ec5c, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:12.205958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846215c-aa8f-4c25-ae55-489204f6081e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:12.206240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846215c-aa8f-4c25-ae55-489204f6081e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:12.206516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846215c-aa8f-4c25-ae55-489204f6081e admin admin] PATH_INFO: `/v3/projects/af9cc24c4cb146db8117f542befa07e5` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:12.207689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846215c-aa8f-4c25-ae55-489204f6081e admin admin] RBAC: Authorizing `identity:delete_project(project_id=af9cc24c4cb146db8117f542befa07e5)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:12.208278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ffe33-812d-46bd-9b09-92d7b7d73f6a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:12.209604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846215c-aa8f-4c25-ae55-489204f6081e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:12.219121 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 959/1911] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:12 2022] PUT /identity/v3/projects/8c61ff3e07774a8d84ef24681c612f1b/users/7ca9fe96a88c49cb81441b598504ec5c/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:12.230680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667f901-d580-496d-997a-c7e013b582c4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:12.230970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667f901-d580-496d-997a-c7e013b582c4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:12.231256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667f901-d580-496d-997a-c7e013b582c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:12.257301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5667f901-d580-496d-997a-c7e013b582c4 None None] MFA Rules not processed for user `7ca9fe96a88c49cb81441b598504ec5c`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:12.259059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5667f901-d580-496d-997a-c7e013b582c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:12.326958 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 960/1912] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:20:12.350702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6846215c-aa8f-4c25-ae55-489204f6081e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af9cc24c4cb146db8117f542befa07e5', 'request_id': 'req-6846215c-aa8f-4c25-ae55-489204f6081e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:12.434815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6846215c-aa8f-4c25-ae55-489204f6081e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af9cc24c4cb146db8117f542befa07e5', 'request_id': 'req-6846215c-aa8f-4c25-ae55-489204f6081e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:12.442619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6846215c-aa8f-4c25-ae55-489204f6081e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af9cc24c4cb146db8117f542befa07e5', 'request_id': 'req-6846215c-aa8f-4c25-ae55-489204f6081e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:12.455119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6846215c-aa8f-4c25-ae55-489204f6081e admin admin] The token cache is being invalidate because project af9cc24c4cb146db8117f542befa07e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:12.456267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6846215c-aa8f-4c25-ae55-489204f6081e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:12.457218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6846215c-aa8f-4c25-ae55-489204f6081e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:12.461957 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 953/1913] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:12 2022] DELETE /identity/v3/projects/af9cc24c4cb146db8117f542befa07e5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:12.466739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667f901-d580-496d-997a-c7e013b582c4 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:12.484480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846215c-aa8f-4c25-ae55-489204f6081e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:12.485911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6846215c-aa8f-4c25-ae55-489204f6081e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:12.539157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667f901-d580-496d-997a-c7e013b582c4 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:12.558564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846215c-aa8f-4c25-ae55-489204f6081e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:12.564548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3785a-c69c-4b54-ae52-f9ebd8f480ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:12.565329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3785a-c69c-4b54-ae52-f9ebd8f480ff service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:12.565645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3785a-c69c-4b54-ae52-f9ebd8f480ff service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:12.565921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3785a-c69c-4b54-ae52-f9ebd8f480ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:12.567706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-82c3785a-c69c-4b54-ae52-f9ebd8f480ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:12.598561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f103f4d-5edd-4d54-99b8-137fae6ec856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:12.599533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f103f4d-5edd-4d54-99b8-137fae6ec856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:12.599821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f103f4d-5edd-4d54-99b8-137fae6ec856 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:12.600106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f103f4d-5edd-4d54-99b8-137fae6ec856 admin admin] PATH_INFO: `/v3/users/a3d9dc2b76324338800cc469cc22fc8a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:12.601685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f103f4d-5edd-4d54-99b8-137fae6ec856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d9dc2b76324338800cc469cc22fc8a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:12.603630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f103f4d-5edd-4d54-99b8-137fae6ec856 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:12.628538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3785a-c69c-4b54-ae52-f9ebd8f480ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:12.630153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3785a-c69c-4b54-ae52-f9ebd8f480ff service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:12.640156 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 954/1914] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:20:12.808537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3f103f4d-5edd-4d54-99b8-137fae6ec856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d9dc2b76324338800cc469cc22fc8a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:12.820403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3f103f4d-5edd-4d54-99b8-137fae6ec856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d9dc2b76324338800cc469cc22fc8a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:12.821685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3f103f4d-5edd-4d54-99b8-137fae6ec856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d9dc2b76324338800cc469cc22fc8a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:12.828364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3f103f4d-5edd-4d54-99b8-137fae6ec856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d9dc2b76324338800cc469cc22fc8a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:12.905182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3f103f4d-5edd-4d54-99b8-137fae6ec856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d9dc2b76324338800cc469cc22fc8a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:12.916250 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 961/1915] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:12 2022] DELETE /identity/v3/users/a3d9dc2b76324338800cc469cc22fc8a => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:13.234825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3785a-c69c-4b54-ae52-f9ebd8f480ff service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:13.237268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-82c3785a-c69c-4b54-ae52-f9ebd8f480ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:13.251038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3785a-c69c-4b54-ae52-f9ebd8f480ff service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:13.306354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeeaf51-59ab-4506-8495-b885fff97048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:13.307245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeeaf51-59ab-4506-8495-b885fff97048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:13.307537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeeaf51-59ab-4506-8495-b885fff97048 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:13.307821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeeaf51-59ab-4506-8495-b885fff97048 admin admin] PATH_INFO: `/v3/users/ddecd6dd81604193898ec29de92098b0` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:13.309171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeeaf51-59ab-4506-8495-b885fff97048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddecd6dd81604193898ec29de92098b0)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:13.311116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeeaf51-59ab-4506-8495-b885fff97048 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:13.467096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f103f4d-5edd-4d54-99b8-137fae6ec856 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:13.468624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3f103f4d-5edd-4d54-99b8-137fae6ec856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:13.484138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f103f4d-5edd-4d54-99b8-137fae6ec856 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:13.489867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8760628-3beb-4ca3-845c-7f4faf42c65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:13.490747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8760628-3beb-4ca3-845c-7f4faf42c65e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:13.491049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8760628-3beb-4ca3-845c-7f4faf42c65e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:13.491329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8760628-3beb-4ca3-845c-7f4faf42c65e admin admin] PATH_INFO: `/v3/projects/27d2535d4550489d84326bf6108d02c3` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:13.492899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8760628-3beb-4ca3-845c-7f4faf42c65e admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d2535d4550489d84326bf6108d02c3)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:13.494773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8760628-3beb-4ca3-845c-7f4faf42c65e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:13.547994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0eeeaf51-59ab-4506-8495-b885fff97048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddecd6dd81604193898ec29de92098b0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:13.559770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0eeeaf51-59ab-4506-8495-b885fff97048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddecd6dd81604193898ec29de92098b0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:13.560466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0eeeaf51-59ab-4506-8495-b885fff97048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddecd6dd81604193898ec29de92098b0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:13.567325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0eeeaf51-59ab-4506-8495-b885fff97048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddecd6dd81604193898ec29de92098b0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:13.605674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e8760628-3beb-4ca3-845c-7f4faf42c65e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d2535d4550489d84326bf6108d02c3', 'request_id': 'req-e8760628-3beb-4ca3-845c-7f4faf42c65e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:13.612428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e8760628-3beb-4ca3-845c-7f4faf42c65e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d2535d4550489d84326bf6108d02c3', 'request_id': 'req-e8760628-3beb-4ca3-845c-7f4faf42c65e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:13.640045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0eeeaf51-59ab-4506-8495-b885fff97048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddecd6dd81604193898ec29de92098b0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:13.646423 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 955/1916] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:13 2022] DELETE /identity/v3/users/ddecd6dd81604193898ec29de92098b0 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:13.651170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938be7e-882e-4cdb-9007-ca1625bfbd1a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:13.651454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938be7e-882e-4cdb-9007-ca1625bfbd1a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:13.651731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938be7e-882e-4cdb-9007-ca1625bfbd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:13.668888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3938be7e-882e-4cdb-9007-ca1625bfbd1a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:13.670066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3938be7e-882e-4cdb-9007-ca1625bfbd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:13.725968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e8760628-3beb-4ca3-845c-7f4faf42c65e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d2535d4550489d84326bf6108d02c3', 'request_id': 'req-e8760628-3beb-4ca3-845c-7f4faf42c65e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:13.728721 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 956/1917] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:20:13.737672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e8760628-3beb-4ca3-845c-7f4faf42c65e admin admin] The token cache is being invalidate because project 27d2535d4550489d84326bf6108d02c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:13.738071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e8760628-3beb-4ca3-845c-7f4faf42c65e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:13.738167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938be7e-882e-4cdb-9007-ca1625bfbd1a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:13.739002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e8760628-3beb-4ca3-845c-7f4faf42c65e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:13.739509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3938be7e-882e-4cdb-9007-ca1625bfbd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:13.740683 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 962/1918] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:13 2022] DELETE /identity/v3/projects/27d2535d4550489d84326bf6108d02c3 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:13.746364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c7c92-2765-4436-8b33-0b70c4c4ce53 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:13.746666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c7c92-2765-4436-8b33-0b70c4c4ce53 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:13.746952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c7c92-2765-4436-8b33-0b70c4c4ce53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:13.764718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e80c7c92-2765-4436-8b33-0b70c4c4ce53 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:13.765821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e80c7c92-2765-4436-8b33-0b70c4c4ce53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:13.774074 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 963/1919] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:13.781709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f1d4f-c112-4327-b954-5278021e2cce None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:13.782000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f1d4f-c112-4327-b954-5278021e2cce None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:13.782317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f1d4f-c112-4327-b954-5278021e2cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:13.797446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938be7e-882e-4cdb-9007-ca1625bfbd1a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:13.800790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f74f1d4f-c112-4327-b954-5278021e2cce None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:13.801581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e2491-1399-404d-ba9e-e3f5bea675b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:13.802027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f74f1d4f-c112-4327-b954-5278021e2cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:13.802246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e2491-1399-404d-ba9e-e3f5bea675b9 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:13.802536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e2491-1399-404d-ba9e-e3f5bea675b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:13.802820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e2491-1399-404d-ba9e-e3f5bea675b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:13.804681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-527e2491-1399-404d-ba9e-e3f5bea675b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:13.810530 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 964/1920] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:20:13.814774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f1d4f-c112-4327-b954-5278021e2cce None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:13.817507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e2491-1399-404d-ba9e-e3f5bea675b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:13.818960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e2491-1399-404d-ba9e-e3f5bea675b9 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:13.824807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f1d4f-c112-4327-b954-5278021e2cce None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:13.829657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3742e-5f26-4674-b942-168fdaf7dd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:13.830255 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 957/1921] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:20:13.830398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3742e-5f26-4674-b942-168fdaf7dd6f admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:13.830589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3742e-5f26-4674-b942-168fdaf7dd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:13.831224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3742e-5f26-4674-b942-168fdaf7dd6f admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:13.831734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3742e-5f26-4674-b942-168fdaf7dd6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:13.832050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3742e-5f26-4674-b942-168fdaf7dd6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:13.833686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3742e-5f26-4674-b942-168fdaf7dd6f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:13.847174 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 965/1922] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:20:13.852348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e2491-1399-404d-ba9e-e3f5bea675b9 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:13.862312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e2491-1399-404d-ba9e-e3f5bea675b9 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:13.869126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3618a71-8cd5-4537-96db-c1d7e2b3924c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:13.869787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3618a71-8cd5-4537-96db-c1d7e2b3924c admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:13.870217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3618a71-8cd5-4537-96db-c1d7e2b3924c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:13.870501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3618a71-8cd5-4537-96db-c1d7e2b3924c admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:13.871468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3618a71-8cd5-4537-96db-c1d7e2b3924c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:13.873554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3618a71-8cd5-4537-96db-c1d7e2b3924c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:13.988340 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 958/1923] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:13 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:13.989308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3742e-5f26-4674-b942-168fdaf7dd6f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:13.999731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3742e-5f26-4674-b942-168fdaf7dd6f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:14.058840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb5d06-92cb-44e1-b54d-d7ad950b21f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:14.059736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb5d06-92cb-44e1-b54d-d7ad950b21f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:14.060018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb5d06-92cb-44e1-b54d-d7ad950b21f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:14.060321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb5d06-92cb-44e1-b54d-d7ad950b21f2 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:14.061058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb5d06-92cb-44e1-b54d-d7ad950b21f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:14.063211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb5d06-92cb-44e1-b54d-d7ad950b21f2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:14.166095 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 966/1924] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:13 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:20:14.167546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3618a71-8cd5-4537-96db-c1d7e2b3924c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:14.178869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3618a71-8cd5-4537-96db-c1d7e2b3924c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:14.183831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db78e2-9a3a-442f-9c6e-44289fbfc10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:14.184581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db78e2-9a3a-442f-9c6e-44289fbfc10e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:14.184968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db78e2-9a3a-442f-9c6e-44289fbfc10e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:14.185344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db78e2-9a3a-442f-9c6e-44289fbfc10e admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:14.186159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db78e2-9a3a-442f-9c6e-44289fbfc10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:14.187827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db78e2-9a3a-442f-9c6e-44289fbfc10e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:14.199072 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 959/1925] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:14.202881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb5d06-92cb-44e1-b54d-d7ad950b21f2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:14.213664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb5d06-92cb-44e1-b54d-d7ad950b21f2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:14.218765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436acbd-ee5a-4432-b944-fd9320bcce82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:14.219540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436acbd-ee5a-4432-b944-fd9320bcce82 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:14.219908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436acbd-ee5a-4432-b944-fd9320bcce82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:14.220200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436acbd-ee5a-4432-b944-fd9320bcce82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:14.220953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436acbd-ee5a-4432-b944-fd9320bcce82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:14.222655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436acbd-ee5a-4432-b944-fd9320bcce82 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:14.235257 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 967/1926] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:14.239283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db78e2-9a3a-442f-9c6e-44289fbfc10e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:14.251707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db78e2-9a3a-442f-9c6e-44289fbfc10e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:14.256875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f35d4c-e1db-4b3d-9385-a9e56c3b4d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:14.257832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f35d4c-e1db-4b3d-9385-a9e56c3b4d9e admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:14.258438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f35d4c-e1db-4b3d-9385-a9e56c3b4d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:14.258438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f35d4c-e1db-4b3d-9385-a9e56c3b4d9e admin admin] PATH_INFO: `/v3/projects/864b22ea2e294e98ab3a5e700387a1dc/users/1eebe9e9e20b4aeba87b87c65dbf03af/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:14.273381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f35d4c-e1db-4b3d-9385-a9e56c3b4d9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=864b22ea2e294e98ab3a5e700387a1dc, user_id=1eebe9e9e20b4aeba87b87c65dbf03af, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:14.276536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f35d4c-e1db-4b3d-9385-a9e56c3b4d9e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:14.306273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436acbd-ee5a-4432-b944-fd9320bcce82 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:14.309518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f436acbd-ee5a-4432-b944-fd9320bcce82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:14.321185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436acbd-ee5a-4432-b944-fd9320bcce82 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:14.325931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22d801-8d46-4449-ae48-e61285c11959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:14.327428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22d801-8d46-4449-ae48-e61285c11959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:14.327713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22d801-8d46-4449-ae48-e61285c11959 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:14.327991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22d801-8d46-4449-ae48-e61285c11959 admin admin] PATH_INFO: `/v3/projects/1c3cc59c411a49caaede8817eada1414` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:14.329231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22d801-8d46-4449-ae48-e61285c11959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c3cc59c411a49caaede8817eada1414)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:14.331149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22d801-8d46-4449-ae48-e61285c11959 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:14.391346 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 960/1927] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:14 2022] PUT /identity/v3/projects/864b22ea2e294e98ab3a5e700387a1dc/users/1eebe9e9e20b4aeba87b87c65dbf03af/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:14.403156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0047d-0590-48aa-942d-dd28dbcb1a76 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:14.403453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0047d-0590-48aa-942d-dd28dbcb1a76 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:14.403740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0047d-0590-48aa-942d-dd28dbcb1a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:14.429065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c0c0047d-0590-48aa-942d-dd28dbcb1a76 None None] MFA Rules not processed for user `1eebe9e9e20b4aeba87b87c65dbf03af`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:14.430294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c0c0047d-0590-48aa-942d-dd28dbcb1a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:14.454366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bc22d801-8d46-4449-ae48-e61285c11959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c3cc59c411a49caaede8817eada1414', 'request_id': 'req-bc22d801-8d46-4449-ae48-e61285c11959'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:14.460487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bc22d801-8d46-4449-ae48-e61285c11959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c3cc59c411a49caaede8817eada1414', 'request_id': 'req-bc22d801-8d46-4449-ae48-e61285c11959'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:14.494729 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 961/1928] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:20:14.499539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0047d-0590-48aa-942d-dd28dbcb1a76 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:14.551323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bc22d801-8d46-4449-ae48-e61285c11959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c3cc59c411a49caaede8817eada1414', 'request_id': 'req-bc22d801-8d46-4449-ae48-e61285c11959'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:14.561615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0047d-0590-48aa-942d-dd28dbcb1a76 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:14.563826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bc22d801-8d46-4449-ae48-e61285c11959 admin admin] The token cache is being invalidate because project 1c3cc59c411a49caaede8817eada1414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:14.567721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bc22d801-8d46-4449-ae48-e61285c11959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:14.567721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bc22d801-8d46-4449-ae48-e61285c11959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:14.567721 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 968/1929] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:14 2022] DELETE /identity/v3/projects/1c3cc59c411a49caaede8817eada1414 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:14.571247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22d801-8d46-4449-ae48-e61285c11959 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:14.572565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bc22d801-8d46-4449-ae48-e61285c11959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:14.620641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacef99-2803-429e-adc7-4c969c7f7130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:14.621591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacef99-2803-429e-adc7-4c969c7f7130 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:14.621878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacef99-2803-429e-adc7-4c969c7f7130 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:14.622160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacef99-2803-429e-adc7-4c969c7f7130 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:14.622870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacef99-2803-429e-adc7-4c969c7f7130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:14.624803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacef99-2803-429e-adc7-4c969c7f7130 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:14.636975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22d801-8d46-4449-ae48-e61285c11959 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:14.641700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2017b-f656-4d19-bea2-3ce9300621cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:14.642566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2017b-f656-4d19-bea2-3ce9300621cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:14.644759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2017b-f656-4d19-bea2-3ce9300621cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:14.644759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2017b-f656-4d19-bea2-3ce9300621cf admin admin] PATH_INFO: `/v3/users/5a38e4ea5c294f0da94264e398042e71` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:14.644759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2017b-f656-4d19-bea2-3ce9300621cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a38e4ea5c294f0da94264e398042e71)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:14.646398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2017b-f656-4d19-bea2-3ce9300621cf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:14.708688 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 962/1930] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:14 2022] POST /identity/v3/projects => generated 375 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:20:14.710560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacef99-2803-429e-adc7-4c969c7f7130 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:14.712889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-feacef99-2803-429e-adc7-4c969c7f7130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:14.776631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacef99-2803-429e-adc7-4c969c7f7130 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:14.781487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d588d1a-f34e-4d19-b4f9-85765d1895d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:14.782209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588d1a-f34e-4d19-b4f9-85765d1895d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:14.782496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588d1a-f34e-4d19-b4f9-85765d1895d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:14.782764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588d1a-f34e-4d19-b4f9-85765d1895d3 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:14.783503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d588d1a-f34e-4d19-b4f9-85765d1895d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:14.785489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d588d1a-f34e-4d19-b4f9-85765d1895d3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:14.826822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-33a2017b-f656-4d19-bea2-3ce9300621cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a38e4ea5c294f0da94264e398042e71'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:14.838545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-33a2017b-f656-4d19-bea2-3ce9300621cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a38e4ea5c294f0da94264e398042e71'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:14.839879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-33a2017b-f656-4d19-bea2-3ce9300621cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a38e4ea5c294f0da94264e398042e71'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:14.845840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-33a2017b-f656-4d19-bea2-3ce9300621cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a38e4ea5c294f0da94264e398042e71'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:14.910750 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 963/1931] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:14 2022] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:20:14.915158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d588d1a-f34e-4d19-b4f9-85765d1895d3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:14.924498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d588d1a-f34e-4d19-b4f9-85765d1895d3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:14.929182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7758c5a-0029-498f-acb5-ab8f9af9be48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:14.929852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7758c5a-0029-498f-acb5-ab8f9af9be48 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:14.930122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7758c5a-0029-498f-acb5-ab8f9af9be48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:14.930396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7758c5a-0029-498f-acb5-ab8f9af9be48 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:14.931105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7758c5a-0029-498f-acb5-ab8f9af9be48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:14.932788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7758c5a-0029-498f-acb5-ab8f9af9be48 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:14.942424 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 964/1932] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:20:14.946290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7758c5a-0029-498f-acb5-ab8f9af9be48 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:14.950565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-33a2017b-f656-4d19-bea2-3ce9300621cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a38e4ea5c294f0da94264e398042e71'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:14.955928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7758c5a-0029-498f-acb5-ab8f9af9be48 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:14.957416 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 969/1933] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:14 2022] DELETE /identity/v3/users/5a38e4ea5c294f0da94264e398042e71 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:15.028510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da2c6e-a287-4201-be8f-2bfba9ac747d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:15.030467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da2c6e-a287-4201-be8f-2bfba9ac747d admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:15.031190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da2c6e-a287-4201-be8f-2bfba9ac747d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:15.031581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da2c6e-a287-4201-be8f-2bfba9ac747d admin admin] PATH_INFO: `/v3/projects/d4a4c2f99e6a46918b681c9f1fe9a7e5/users/ac8abc725b5a4d41b874c9da83920ccd/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:15.052072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da2c6e-a287-4201-be8f-2bfba9ac747d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a4c2f99e6a46918b681c9f1fe9a7e5, user_id=ac8abc725b5a4d41b874c9da83920ccd, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:15.055081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da2c6e-a287-4201-be8f-2bfba9ac747d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:15.145561 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 965/1934] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:14 2022] PUT /identity/v3/projects/d4a4c2f99e6a46918b681c9f1fe9a7e5/users/ac8abc725b5a4d41b874c9da83920ccd/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:15.150229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2017b-f656-4d19-bea2-3ce9300621cf admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:15.151622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-33a2017b-f656-4d19-bea2-3ce9300621cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:15.164628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2017b-f656-4d19-bea2-3ce9300621cf admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:15.195878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da2c6e-a287-4201-be8f-2bfba9ac747d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:15.197714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-68da2c6e-a287-4201-be8f-2bfba9ac747d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:15.240232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac6998-6fec-4c0b-bb37-7f6eb0d1b8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:15.241569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac6998-6fec-4c0b-bb37-7f6eb0d1b8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:15.241867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac6998-6fec-4c0b-bb37-7f6eb0d1b8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:15.242143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac6998-6fec-4c0b-bb37-7f6eb0d1b8f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:15.243195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac6998-6fec-4c0b-bb37-7f6eb0d1b8f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:15.244888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac6998-6fec-4c0b-bb37-7f6eb0d1b8f4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:15.255933 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 970/1935] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:20:15.260272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac6998-6fec-4c0b-bb37-7f6eb0d1b8f4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:15.271456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac6998-6fec-4c0b-bb37-7f6eb0d1b8f4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:15.278782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e16a9f-08e8-4ac7-8953-ee822090dc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:15.278988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e16a9f-08e8-4ac7-8953-ee822090dc02 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:15.279266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e16a9f-08e8-4ac7-8953-ee822090dc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:15.279545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e16a9f-08e8-4ac7-8953-ee822090dc02 admin admin] PATH_INFO: `/v3/projects/d4a4c2f99e6a46918b681c9f1fe9a7e5/users/ac8abc725b5a4d41b874c9da83920ccd/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:15.282198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e16a9f-08e8-4ac7-8953-ee822090dc02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a4c2f99e6a46918b681c9f1fe9a7e5, user_id=ac8abc725b5a4d41b874c9da83920ccd, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:15.284947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e16a9f-08e8-4ac7-8953-ee822090dc02 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:15.298630 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 971/1936] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:15 2022] PUT /identity/v3/projects/d4a4c2f99e6a46918b681c9f1fe9a7e5/users/ac8abc725b5a4d41b874c9da83920ccd/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:15.303420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da2c6e-a287-4201-be8f-2bfba9ac747d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:15.309758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbe5f7-11ce-420a-9b76-fbefe8472ead None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:15.310101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbe5f7-11ce-420a-9b76-fbefe8472ead None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:15.310389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbe5f7-11ce-420a-9b76-fbefe8472ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:15.350552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-20dbe5f7-11ce-420a-9b76-fbefe8472ead None None] MFA Rules not processed for user `ac8abc725b5a4d41b874c9da83920ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:15.351818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-20dbe5f7-11ce-420a-9b76-fbefe8472ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:15.373804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cddea-0e8b-454e-bce6-750eea8a9759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:15.374471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cddea-0e8b-454e-bce6-750eea8a9759 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:15.374787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cddea-0e8b-454e-bce6-750eea8a9759 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:15.375215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cddea-0e8b-454e-bce6-750eea8a9759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:15.377069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ab9cddea-0e8b-454e-bce6-750eea8a9759 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:15.424791 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 972/1937] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:20:15.447371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cddea-0e8b-454e-bce6-750eea8a9759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:15.449295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cddea-0e8b-454e-bce6-750eea8a9759 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:15.466010 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 966/1938] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:15 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:15.468663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbe5f7-11ce-420a-9b76-fbefe8472ead None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:15.470079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-20dbe5f7-11ce-420a-9b76-fbefe8472ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:15.496868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cddea-0e8b-454e-bce6-750eea8a9759 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:15.496868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ab9cddea-0e8b-454e-bce6-750eea8a9759 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:15.513685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cddea-0e8b-454e-bce6-750eea8a9759 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:15.524139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f9b33-4085-4679-a4e0-8632f66f7e52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:15.524805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f9b33-4085-4679-a4e0-8632f66f7e52 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:15.525113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f9b33-4085-4679-a4e0-8632f66f7e52 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:15.525341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f9b33-4085-4679-a4e0-8632f66f7e52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:15.536326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f9b33-4085-4679-a4e0-8632f66f7e52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:15.537946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f9b33-4085-4679-a4e0-8632f66f7e52 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:15.548639 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 967/1939] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:20:15.572649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbe5f7-11ce-420a-9b76-fbefe8472ead None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:15.581102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b08662-21c1-407a-af07-ba398f29fe37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:15.583016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b08662-21c1-407a-af07-ba398f29fe37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:15.583260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b08662-21c1-407a-af07-ba398f29fe37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:15.583778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b08662-21c1-407a-af07-ba398f29fe37 admin admin] PATH_INFO: `/v3/projects/0cdc6be3300d4f38ad3f64978e224a33` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:15.585769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b08662-21c1-407a-af07-ba398f29fe37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cdc6be3300d4f38ad3f64978e224a33)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:15.587919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b08662-21c1-407a-af07-ba398f29fe37 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:15.716124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b0b08662-21c1-407a-af07-ba398f29fe37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cdc6be3300d4f38ad3f64978e224a33', 'request_id': 'req-b0b08662-21c1-407a-af07-ba398f29fe37'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:15.722409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b0b08662-21c1-407a-af07-ba398f29fe37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cdc6be3300d4f38ad3f64978e224a33', 'request_id': 'req-b0b08662-21c1-407a-af07-ba398f29fe37'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:15.780010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f9b33-4085-4679-a4e0-8632f66f7e52 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:15.784717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b0b08662-21c1-407a-af07-ba398f29fe37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cdc6be3300d4f38ad3f64978e224a33', 'request_id': 'req-b0b08662-21c1-407a-af07-ba398f29fe37'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:15.792777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f9b33-4085-4679-a4e0-8632f66f7e52 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:15.795913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b0b08662-21c1-407a-af07-ba398f29fe37 admin admin] The token cache is being invalidate because project 0cdc6be3300d4f38ad3f64978e224a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:15.796212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b0b08662-21c1-407a-af07-ba398f29fe37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:15.796953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b0b08662-21c1-407a-af07-ba398f29fe37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:15.798811 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 973/1940] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:15 2022] DELETE /identity/v3/projects/0cdc6be3300d4f38ad3f64978e224a33 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:15.805329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a797653-efe6-478f-a5c7-a848b969d8da None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:15.805560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a797653-efe6-478f-a5c7-a848b969d8da None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:15.805984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a797653-efe6-478f-a5c7-a848b969d8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:15.828560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6a797653-efe6-478f-a5c7-a848b969d8da None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:15.829847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6a797653-efe6-478f-a5c7-a848b969d8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:15.880722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68fdea-3538-46ca-b41c-5b56f56993cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:15.881415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68fdea-3538-46ca-b41c-5b56f56993cb service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:15.881704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68fdea-3538-46ca-b41c-5b56f56993cb service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:15.881987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68fdea-3538-46ca-b41c-5b56f56993cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:15.883811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-aa68fdea-3538-46ca-b41c-5b56f56993cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:15.898949 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 974/1941] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:20:15.907142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedce69-8990-4827-8b98-a643f9dc693f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:15.907436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedce69-8990-4827-8b98-a643f9dc693f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:15.907723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedce69-8990-4827-8b98-a643f9dc693f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:15.939808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-bfedce69-8990-4827-8b98-a643f9dc693f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:15.941229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bfedce69-8990-4827-8b98-a643f9dc693f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:15.951924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68fdea-3538-46ca-b41c-5b56f56993cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:15.952408 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 975/1942] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:20:15.953755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68fdea-3538-46ca-b41c-5b56f56993cb service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:15.956446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedce69-8990-4827-8b98-a643f9dc693f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:15.966033 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 968/1943] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:20:15.970326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedce69-8990-4827-8b98-a643f9dc693f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:15.975766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c64688-8d32-4436-a7af-3537512be1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:15.977322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c64688-8d32-4436-a7af-3537512be1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:15.977768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c64688-8d32-4436-a7af-3537512be1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:15.978644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c64688-8d32-4436-a7af-3537512be1e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:15.978822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c64688-8d32-4436-a7af-3537512be1e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:15.979111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c64688-8d32-4436-a7af-3537512be1e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:15.980762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c64688-8d32-4436-a7af-3537512be1e0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:16.002473 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 976/1944] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:16.003696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68fdea-3538-46ca-b41c-5b56f56993cb service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:16.016932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68fdea-3538-46ca-b41c-5b56f56993cb service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:16.023772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e7dd4-4c7c-4775-8fb9-29c709b01abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:16.025507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e7dd4-4c7c-4775-8fb9-29c709b01abc admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:16.025507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e7dd4-4c7c-4775-8fb9-29c709b01abc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:16.025507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e7dd4-4c7c-4775-8fb9-29c709b01abc admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:16.025994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e7dd4-4c7c-4775-8fb9-29c709b01abc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:16.027963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e7dd4-4c7c-4775-8fb9-29c709b01abc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:16.156573 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 969/1945] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:16 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:16.160677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c64688-8d32-4436-a7af-3537512be1e0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:16.171295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c64688-8d32-4436-a7af-3537512be1e0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:16.241661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f37b88-0d85-4ca9-95cd-86638e75a12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:16.245295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f37b88-0d85-4ca9-95cd-86638e75a12b admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:16.245592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f37b88-0d85-4ca9-95cd-86638e75a12b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:16.245880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f37b88-0d85-4ca9-95cd-86638e75a12b admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:16.246844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f37b88-0d85-4ca9-95cd-86638e75a12b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:16.248823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f37b88-0d85-4ca9-95cd-86638e75a12b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:16.332340 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 977/1946] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:16 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:20:16.337036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e7dd4-4c7c-4775-8fb9-29c709b01abc admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:16.347696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e7dd4-4c7c-4775-8fb9-29c709b01abc admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:16.353768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b095fec-a44d-4e0e-a70b-8593a7e85a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:16.354449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b095fec-a44d-4e0e-a70b-8593a7e85a1c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:16.354850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b095fec-a44d-4e0e-a70b-8593a7e85a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:16.355025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b095fec-a44d-4e0e-a70b-8593a7e85a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:16.355796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b095fec-a44d-4e0e-a70b-8593a7e85a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:16.360002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b095fec-a44d-4e0e-a70b-8593a7e85a1c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:16.368989 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 970/1947] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:16.373089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f37b88-0d85-4ca9-95cd-86638e75a12b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:16.384563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f37b88-0d85-4ca9-95cd-86638e75a12b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:16.390191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069af093-9600-4a34-a2d5-c47ba9184275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:16.391421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069af093-9600-4a34-a2d5-c47ba9184275 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:16.391421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069af093-9600-4a34-a2d5-c47ba9184275 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:16.391740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069af093-9600-4a34-a2d5-c47ba9184275 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:16.392575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069af093-9600-4a34-a2d5-c47ba9184275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:16.395090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069af093-9600-4a34-a2d5-c47ba9184275 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:16.408412 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 978/1948] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:20:16.412286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b095fec-a44d-4e0e-a70b-8593a7e85a1c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:16.426663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b095fec-a44d-4e0e-a70b-8593a7e85a1c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:16.432809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001d2a1-d3ef-4f2d-bd37-3bcdcdf4e071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:16.433734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001d2a1-d3ef-4f2d-bd37-3bcdcdf4e071 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:16.434111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001d2a1-d3ef-4f2d-bd37-3bcdcdf4e071 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:16.434410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001d2a1-d3ef-4f2d-bd37-3bcdcdf4e071 admin admin] PATH_INFO: `/v3/projects/a3e2b2da9de0451fa382ec2c763bd98b/users/b429cbe333eb4ecdb08c0ffab05056ee/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:16.452301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001d2a1-d3ef-4f2d-bd37-3bcdcdf4e071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3e2b2da9de0451fa382ec2c763bd98b, user_id=b429cbe333eb4ecdb08c0ffab05056ee, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:16.455120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001d2a1-d3ef-4f2d-bd37-3bcdcdf4e071 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:16.525133 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 971/1949] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:16 2022] PUT /identity/v3/projects/a3e2b2da9de0451fa382ec2c763bd98b/users/b429cbe333eb4ecdb08c0ffab05056ee/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:16.540784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6a60b-f51c-4b11-8272-edda579a9d4d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:16.541236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6a60b-f51c-4b11-8272-edda579a9d4d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:16.541610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6a60b-f51c-4b11-8272-edda579a9d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:16.572667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3cb6a60b-f51c-4b11-8272-edda579a9d4d None None] MFA Rules not processed for user `b429cbe333eb4ecdb08c0ffab05056ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:16.573824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3cb6a60b-f51c-4b11-8272-edda579a9d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:16.655406 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 979/1950] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:16.659954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001d2a1-d3ef-4f2d-bd37-3bcdcdf4e071 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:16.727593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001d2a1-d3ef-4f2d-bd37-3bcdcdf4e071 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:16.732347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f17b3-1045-401d-b583-0f92ba2d13ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:16.733038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f17b3-1045-401d-b583-0f92ba2d13ff admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:16.733368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f17b3-1045-401d-b583-0f92ba2d13ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:16.733650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f17b3-1045-401d-b583-0f92ba2d13ff admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:16.734374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f17b3-1045-401d-b583-0f92ba2d13ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:16.736273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f17b3-1045-401d-b583-0f92ba2d13ff admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:16.856841 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 972/1951] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:16 2022] POST /identity/v3/projects => generated 373 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:16.858685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6a60b-f51c-4b11-8272-edda579a9d4d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:16.872924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6a60b-f51c-4b11-8272-edda579a9d4d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:16.932147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78451627-6875-4c60-bb11-34bf5438fb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:16.932954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78451627-6875-4c60-bb11-34bf5438fb4b admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:16.933318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78451627-6875-4c60-bb11-34bf5438fb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:16.933595 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78451627-6875-4c60-bb11-34bf5438fb4b admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:16.934292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78451627-6875-4c60-bb11-34bf5438fb4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:16.936636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78451627-6875-4c60-bb11-34bf5438fb4b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:17.046408 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 980/1952] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:16 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:20:17.058925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f17b3-1045-401d-b583-0f92ba2d13ff admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:17.069208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f17b3-1045-401d-b583-0f92ba2d13ff admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:17.074741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda19104-8f0d-4221-9f04-0a1a7d32185d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:17.075352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda19104-8f0d-4221-9f04-0a1a7d32185d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:17.075640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda19104-8f0d-4221-9f04-0a1a7d32185d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:17.075931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda19104-8f0d-4221-9f04-0a1a7d32185d admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:17.076696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda19104-8f0d-4221-9f04-0a1a7d32185d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:17.078356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda19104-8f0d-4221-9f04-0a1a7d32185d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:17.088859 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 973/1953] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:17.093149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78451627-6875-4c60-bb11-34bf5438fb4b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:17.103409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78451627-6875-4c60-bb11-34bf5438fb4b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:17.114436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aae1b2-9766-4591-8e12-06246419a196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:17.115568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aae1b2-9766-4591-8e12-06246419a196 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:17.115847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aae1b2-9766-4591-8e12-06246419a196 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:17.116200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aae1b2-9766-4591-8e12-06246419a196 admin admin] PATH_INFO: `/v3/projects/fabae7594d964006ab259503ad144887/users/5b24f758b7c9466d98507d5846becf91/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:17.121521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a687359-8ffe-45ad-a441-3e2a0736372e None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:17.121905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a687359-8ffe-45ad-a441-3e2a0736372e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:17.122262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a687359-8ffe-45ad-a441-3e2a0736372e None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:17.124007 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 974/1954] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:20:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 10:20:17.130666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740d715-2b47-441c-86b4-f43db08e20d8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:17.131090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740d715-2b47-441c-86b4-f43db08e20d8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:17.131424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740d715-2b47-441c-86b4-f43db08e20d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:17.135312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aae1b2-9766-4591-8e12-06246419a196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fabae7594d964006ab259503ad144887, user_id=5b24f758b7c9466d98507d5846becf91, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:17.138166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aae1b2-9766-4591-8e12-06246419a196 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:17.150556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d740d715-2b47-441c-86b4-f43db08e20d8 None None] MFA Rules not processed for user `4cd9fe10f94f43aeb3eb10009ee96ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:17.151773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d740d715-2b47-441c-86b4-f43db08e20d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:17.201541 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 975/1955] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:20:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:20:17.213348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740d715-2b47-441c-86b4-f43db08e20d8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:17.215073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d740d715-2b47-441c-86b4-f43db08e20d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:17.227505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740d715-2b47-441c-86b4-f43db08e20d8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:17.229885 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 981/1956] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:17 2022] PUT /identity/v3/projects/fabae7594d964006ab259503ad144887/users/5b24f758b7c9466d98507d5846becf91/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:17.233819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aae1b2-9766-4591-8e12-06246419a196 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:17.276298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9244711-5cd4-412c-b71d-e95f101bc4b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:17.276977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9244711-5cd4-412c-b71d-e95f101bc4b2 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:17.277261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9244711-5cd4-412c-b71d-e95f101bc4b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:17.277658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9244711-5cd4-412c-b71d-e95f101bc4b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:17.287897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9244711-5cd4-412c-b71d-e95f101bc4b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:17.289419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9244711-5cd4-412c-b71d-e95f101bc4b2 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:17.295492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aae1b2-9766-4591-8e12-06246419a196 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:17.298592 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 976/1957] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:20:17.305979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9efd8-85a6-44d2-a76e-3a3e682e6eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:17.306704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9efd8-85a6-44d2-a76e-3a3e682e6eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:17.306960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9efd8-85a6-44d2-a76e-3a3e682e6eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:17.307236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9efd8-85a6-44d2-a76e-3a3e682e6eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:17.307976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9efd8-85a6-44d2-a76e-3a3e682e6eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:17.309632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9efd8-85a6-44d2-a76e-3a3e682e6eb4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:17.324122 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 982/1958] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:20:17.325756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9244711-5cd4-412c-b71d-e95f101bc4b2 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:17.336636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9244711-5cd4-412c-b71d-e95f101bc4b2 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:17.341883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460720d5-de55-4f95-9029-86ce0b07495e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:17.342887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460720d5-de55-4f95-9029-86ce0b07495e admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:17.343234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460720d5-de55-4f95-9029-86ce0b07495e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:17.343577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460720d5-de55-4f95-9029-86ce0b07495e admin admin] PATH_INFO: `/v3/projects/fabae7594d964006ab259503ad144887/users/5b24f758b7c9466d98507d5846becf91/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:17.345779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460720d5-de55-4f95-9029-86ce0b07495e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fabae7594d964006ab259503ad144887, user_id=5b24f758b7c9466d98507d5846becf91, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:17.350100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460720d5-de55-4f95-9029-86ce0b07495e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:17.360058 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 977/1959] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:17 2022] PUT /identity/v3/projects/fabae7594d964006ab259503ad144887/users/5b24f758b7c9466d98507d5846becf91/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:17.371981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fd1ca-70fb-4f89-99aa-e27b43397d7a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:17.372678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fd1ca-70fb-4f89-99aa-e27b43397d7a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:17.373357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fd1ca-70fb-4f89-99aa-e27b43397d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:17.401584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a29fd1ca-70fb-4f89-99aa-e27b43397d7a None None] MFA Rules not processed for user `5b24f758b7c9466d98507d5846becf91`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:17.403180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a29fd1ca-70fb-4f89-99aa-e27b43397d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:17.473898 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 983/1960] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:17.481800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460720d5-de55-4f95-9029-86ce0b07495e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:17.493530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460720d5-de55-4f95-9029-86ce0b07495e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:17.498695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb761b6d-0fca-48a4-b34d-21f4b09808e6 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b24f758b7c9466d98507d5846becf91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabae7594d964006ab259503ad144887', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:17.499369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb761b6d-0fca-48a4-b34d-21f4b09808e6 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:17.499656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb761b6d-0fca-48a4-b34d-21f4b09808e6 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:17.499940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb761b6d-0fca-48a4-b34d-21f4b09808e6 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:17.500698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb761b6d-0fca-48a4-b34d-21f4b09808e6 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:17.501049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb761b6d-0fca-48a4-b34d-21f4b09808e6 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:17.510859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb761b6d-0fca-48a4-b34d-21f4b09808e6 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:17.518855 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 978/1961] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:20:17.520113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fd1ca-70fb-4f89-99aa-e27b43397d7a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:17.529302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fd1ca-70fb-4f89-99aa-e27b43397d7a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:17.534125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1c775-79ae-4567-8973-ff43a97eedc4 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b24f758b7c9466d98507d5846becf91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabae7594d964006ab259503ad144887', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:17.534792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1c775-79ae-4567-8973-ff43a97eedc4 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:17.535081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1c775-79ae-4567-8973-ff43a97eedc4 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:17.535424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1c775-79ae-4567-8973-ff43a97eedc4 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:17.536127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1c775-79ae-4567-8973-ff43a97eedc4 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:17.538082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1c775-79ae-4567-8973-ff43a97eedc4 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:17.633431 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 984/1962] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:17 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:17.637258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb761b6d-0fca-48a4-b34d-21f4b09808e6 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:17.648321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb761b6d-0fca-48a4-b34d-21f4b09808e6 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:17.712587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c144f2e-9cab-499a-b17e-589342233b65 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b24f758b7c9466d98507d5846becf91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabae7594d964006ab259503ad144887', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:17.713288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c144f2e-9cab-499a-b17e-589342233b65 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:17.713578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c144f2e-9cab-499a-b17e-589342233b65 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:17.713864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c144f2e-9cab-499a-b17e-589342233b65 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:17.714602 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c144f2e-9cab-499a-b17e-589342233b65 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:17.714918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c144f2e-9cab-499a-b17e-589342233b65 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:17.716569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c144f2e-9cab-499a-b17e-589342233b65 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:17.728790 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 979/1963] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:20:17.846264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd1b8c-786f-44a3-8d9d-c08d80b98051 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:17.846557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd1b8c-786f-44a3-8d9d-c08d80b98051 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:17.846836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd1b8c-786f-44a3-8d9d-c08d80b98051 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:17.848349 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 985/1964] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:20:17.859034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bad819-aa7b-4e10-9774-488e1ddc3f6e None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:17.859310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bad819-aa7b-4e10-9774-488e1ddc3f6e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:17.859667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bad819-aa7b-4e10-9774-488e1ddc3f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:17.883425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-42bad819-aa7b-4e10-9774-488e1ddc3f6e None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:17.884839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-42bad819-aa7b-4e10-9774-488e1ddc3f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:17.954205 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 980/1965] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:20:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:17.955710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd1b8c-786f-44a3-8d9d-c08d80b98051 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:17.958029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fabd1b8c-786f-44a3-8d9d-c08d80b98051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:17.977885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bad819-aa7b-4e10-9774-488e1ddc3f6e None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:17.979374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-42bad819-aa7b-4e10-9774-488e1ddc3f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:17.995145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bad819-aa7b-4e10-9774-488e1ddc3f6e None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:18.001231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c810e7-2084-4327-a0a2-0fe58b5aa9ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:18.002539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c810e7-2084-4327-a0a2-0fe58b5aa9ae service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:18.002539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c810e7-2084-4327-a0a2-0fe58b5aa9ae service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:18.002539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c810e7-2084-4327-a0a2-0fe58b5aa9ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:18.012390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c810e7-2084-4327-a0a2-0fe58b5aa9ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:18.014041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c810e7-2084-4327-a0a2-0fe58b5aa9ae service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:18.025211 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 981/1966] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:20:18.044393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd1b8c-786f-44a3-8d9d-c08d80b98051 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:18.050688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d85517-f099-4e70-9e4c-c22bfafc4d32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:18.051362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d85517-f099-4e70-9e4c-c22bfafc4d32 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:18.051789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d85517-f099-4e70-9e4c-c22bfafc4d32 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:18.052083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d85517-f099-4e70-9e4c-c22bfafc4d32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:18.063577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d85517-f099-4e70-9e4c-c22bfafc4d32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:18.065414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d85517-f099-4e70-9e4c-c22bfafc4d32 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:18.077651 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 986/1967] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:18.093338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815310a9-5728-4fd2-af29-0980fc22db45 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:18.093639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815310a9-5728-4fd2-af29-0980fc22db45 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:18.093916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815310a9-5728-4fd2-af29-0980fc22db45 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:18.095416 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 982/1968] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:20:18.105410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d85517-f099-4e70-9e4c-c22bfafc4d32 service nova] Authenticating service token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:20:18.116546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d85517-f099-4e70-9e4c-c22bfafc4d32 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:18.124986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d85517-f099-4e70-9e4c-c22bfafc4d32 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:18.129760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b20ea6-d336-4049-a6d3-4fab8f6fbe78 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b24f758b7c9466d98507d5846becf91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabae7594d964006ab259503ad144887', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:18.130614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b20ea6-d336-4049-a6d3-4fab8f6fbe78 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:18.130902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b20ea6-d336-4049-a6d3-4fab8f6fbe78 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:18.131184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b20ea6-d336-4049-a6d3-4fab8f6fbe78 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] PATH_INFO: `/v3/projects/6df5335988bc4682b96d9f0a707a2078` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:18.132378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b20ea6-d336-4049-a6d3-4fab8f6fbe78 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorizing `identity:get_project(project_id=6df5335988bc4682b96d9f0a707a2078)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:18.135001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b20ea6-d336-4049-a6d3-4fab8f6fbe78 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:18.137380 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 987/1969] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:20:18 2022] GET /identity/v3/projects/6df5335988bc4682b96d9f0a707a2078 => generated 371 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:18.416710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815310a9-5728-4fd2-af29-0980fc22db45 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:18.419087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-815310a9-5728-4fd2-af29-0980fc22db45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:18.423625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b20ea6-d336-4049-a6d3-4fab8f6fbe78 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:18.437610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b20ea6-d336-4049-a6d3-4fab8f6fbe78 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:18.443387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8ac4c-c963-4907-931d-323e2e570fbe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:18.444035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8ac4c-c963-4907-931d-323e2e570fbe service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:18.445033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8ac4c-c963-4907-931d-323e2e570fbe service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:18.445033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8ac4c-c963-4907-931d-323e2e570fbe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:18.447067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7bf8ac4c-c963-4907-931d-323e2e570fbe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:18.464238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8ac4c-c963-4907-931d-323e2e570fbe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:18.466035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8ac4c-c963-4907-931d-323e2e570fbe service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:18.479737 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 988/1970] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:20:18.480733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ba1d9-497a-43cb-a4dd-bb83a4134393 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:18.481031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ba1d9-497a-43cb-a4dd-bb83a4134393 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:18.481313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ba1d9-497a-43cb-a4dd-bb83a4134393 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:18.484792 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 989/1971] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:20:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:20:18.494364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ba1d9-497a-43cb-a4dd-bb83a4134393 None None] Authenticating service token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:20:18.513752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ba1d9-497a-43cb-a4dd-bb83a4134393 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:18.524309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ba1d9-497a-43cb-a4dd-bb83a4134393 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:18.528677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815310a9-5728-4fd2-af29-0980fc22db45 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:18.528983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9f9d4-e237-4ae9-a330-b09e3a037100 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b24f758b7c9466d98507d5846becf91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabae7594d964006ab259503ad144887', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:18.529883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9f9d4-e237-4ae9-a330-b09e3a037100 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:18.530151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9f9d4-e237-4ae9-a330-b09e3a037100 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:18.530428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9f9d4-e237-4ae9-a330-b09e3a037100 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] PATH_INFO: `/v3/projects/6df5335988bc4682b96d9f0a707a2078` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:18.531628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9f9d4-e237-4ae9-a330-b09e3a037100 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorizing `identity:get_project(project_id=6df5335988bc4682b96d9f0a707a2078)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:18.533567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e6619-2c00-4c7b-bc68-efbb375fd762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:18.533701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9f9d4-e237-4ae9-a330-b09e3a037100 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:18.534438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e6619-2c00-4c7b-bc68-efbb375fd762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:18.534722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e6619-2c00-4c7b-bc68-efbb375fd762 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:18.535003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e6619-2c00-4c7b-bc68-efbb375fd762 admin admin] PATH_INFO: `/v3/users/1eebe9e9e20b4aeba87b87c65dbf03af` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:18.535463 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 990/1972] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:20:18 2022] GET /identity/v3/projects/6df5335988bc4682b96d9f0a707a2078 => generated 371 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:18.537430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e6619-2c00-4c7b-bc68-efbb375fd762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eebe9e9e20b4aeba87b87c65dbf03af)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:18.539414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e6619-2c00-4c7b-bc68-efbb375fd762 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:18.577295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9f9d4-e237-4ae9-a330-b09e3a037100 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:18.588192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9f9d4-e237-4ae9-a330-b09e3a037100 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:18.597010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479abe54-7d7d-4678-be62-4f5f6bb91e53 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b24f758b7c9466d98507d5846becf91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabae7594d964006ab259503ad144887', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:18.597720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479abe54-7d7d-4678-be62-4f5f6bb91e53 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:18.598005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479abe54-7d7d-4678-be62-4f5f6bb91e53 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:18.598281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479abe54-7d7d-4678-be62-4f5f6bb91e53 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:18.599612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479abe54-7d7d-4678-be62-4f5f6bb91e53 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:18.599925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479abe54-7d7d-4678-be62-4f5f6bb91e53 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:18.601629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479abe54-7d7d-4678-be62-4f5f6bb91e53 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:18.618898 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 991/1973] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:18.623028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479abe54-7d7d-4678-be62-4f5f6bb91e53 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:18.635553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479abe54-7d7d-4678-be62-4f5f6bb91e53 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:18.641248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753557b-9a30-4ea6-916d-2e02e4adbe48 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b24f758b7c9466d98507d5846becf91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabae7594d964006ab259503ad144887', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:18.642020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753557b-9a30-4ea6-916d-2e02e4adbe48 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:18.642546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753557b-9a30-4ea6-916d-2e02e4adbe48 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:18.643052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753557b-9a30-4ea6-916d-2e02e4adbe48 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:18.643989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753557b-9a30-4ea6-916d-2e02e4adbe48 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:18.646076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753557b-9a30-4ea6-916d-2e02e4adbe48 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:18.749991 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 992/1974] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:18 2022] POST /identity/v3/users => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:20:18.756982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753557b-9a30-4ea6-916d-2e02e4adbe48 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:18.761169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-545e6619-2c00-4c7b-bc68-efbb375fd762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eebe9e9e20b4aeba87b87c65dbf03af'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:18.768175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753557b-9a30-4ea6-916d-2e02e4adbe48 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:18.774332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9467752-94ac-4f83-8700-80bcc39afc3c tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b24f758b7c9466d98507d5846becf91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabae7594d964006ab259503ad144887', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:18.775006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9467752-94ac-4f83-8700-80bcc39afc3c tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:18.775763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9467752-94ac-4f83-8700-80bcc39afc3c tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:18.775763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9467752-94ac-4f83-8700-80bcc39afc3c tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:18.775962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-545e6619-2c00-4c7b-bc68-efbb375fd762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eebe9e9e20b4aeba87b87c65dbf03af'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:18.776476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-545e6619-2c00-4c7b-bc68-efbb375fd762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eebe9e9e20b4aeba87b87c65dbf03af'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:18.776645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9467752-94ac-4f83-8700-80bcc39afc3c tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:18.777022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9467752-94ac-4f83-8700-80bcc39afc3c tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:18.779722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9467752-94ac-4f83-8700-80bcc39afc3c tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:18.787204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-545e6619-2c00-4c7b-bc68-efbb375fd762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eebe9e9e20b4aeba87b87c65dbf03af'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:18.794554 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 993/1975] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:18.853995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a798a-f7e9-4502-879e-3e077e74b5fd None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:18.855166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a798a-f7e9-4502-879e-3e077e74b5fd None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:18.855166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a798a-f7e9-4502-879e-3e077e74b5fd None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:18.856185 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 994/1976] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:20:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:20:18.861703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a798a-f7e9-4502-879e-3e077e74b5fd None None] Authenticating service token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:20:18.878882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a798a-f7e9-4502-879e-3e077e74b5fd None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:18.887679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-545e6619-2c00-4c7b-bc68-efbb375fd762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eebe9e9e20b4aeba87b87c65dbf03af'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:18.899101 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 983/1977] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:18 2022] DELETE /identity/v3/users/1eebe9e9e20b4aeba87b87c65dbf03af => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:18.899246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a798a-f7e9-4502-879e-3e077e74b5fd None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:18.900208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357600e-7905-49a0-8ef1-a2490fe0228a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:18.900413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357600e-7905-49a0-8ef1-a2490fe0228a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:18.900731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357600e-7905-49a0-8ef1-a2490fe0228a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:18.921103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0357600e-7905-49a0-8ef1-a2490fe0228a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:18.922709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0357600e-7905-49a0-8ef1-a2490fe0228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:18.981660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2baf0-5770-4889-a69a-04c6e990d567 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b24f758b7c9466d98507d5846becf91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabae7594d964006ab259503ad144887', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:18.982619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2baf0-5770-4889-a69a-04c6e990d567 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:18.982895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2baf0-5770-4889-a69a-04c6e990d567 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:18.984535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2baf0-5770-4889-a69a-04c6e990d567 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] PATH_INFO: `/v3/projects/6df5335988bc4682b96d9f0a707a2078` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:18.987285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2baf0-5770-4889-a69a-04c6e990d567 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorizing `identity:get_project(project_id=6df5335988bc4682b96d9f0a707a2078)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:18.989447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2baf0-5770-4889-a69a-04c6e990d567 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:18.993384 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 984/1978] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:18.999339 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 995/1979] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:20:18 2022] GET /identity/v3/projects/6df5335988bc4682b96d9f0a707a2078 => generated 371 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:20:18.999569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357600e-7905-49a0-8ef1-a2490fe0228a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:19.001055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0357600e-7905-49a0-8ef1-a2490fe0228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:19.068284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357600e-7905-49a0-8ef1-a2490fe0228a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:19.072117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41b257-d3e4-4645-bf19-768ba84ba545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:19.073762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41b257-d3e4-4645-bf19-768ba84ba545 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:19.074153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41b257-d3e4-4645-bf19-768ba84ba545 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:19.074370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41b257-d3e4-4645-bf19-768ba84ba545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:19.086478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41b257-d3e4-4645-bf19-768ba84ba545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:19.092617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41b257-d3e4-4645-bf19-768ba84ba545 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:19.098925 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 985/1980] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:19.436436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f21436-0a8a-4f70-9da9-d97824988d74 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:19.436803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f21436-0a8a-4f70-9da9-d97824988d74 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:19.437086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f21436-0a8a-4f70-9da9-d97824988d74 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:19.439092 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 996/1981] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:20:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:20:19.444752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41b257-d3e4-4645-bf19-768ba84ba545 service neutron] Authenticating service token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:20:19.449256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dd41b257-d3e4-4645-bf19-768ba84ba545 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:19.453652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a38bc8-b5da-49af-82c2-69e89e0326a8 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:19.454165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a38bc8-b5da-49af-82c2-69e89e0326a8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:19.454471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a38bc8-b5da-49af-82c2-69e89e0326a8 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:19.455997 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 997/1982] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 10:20:19.464056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e968e-ffc2-46ca-95aa-fb0997564131 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:19.464438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e968e-ffc2-46ca-95aa-fb0997564131 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:19.464903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e968e-ffc2-46ca-95aa-fb0997564131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:19.498108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8f0e968e-ffc2-46ca-95aa-fb0997564131 None None] MFA Rules not processed for user `e6036dd39fb74289a8cbdcd6a21f8662`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:19.500292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8f0e968e-ffc2-46ca-95aa-fb0997564131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:19.558234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41b257-d3e4-4645-bf19-768ba84ba545 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:19.560080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dd41b257-d3e4-4645-bf19-768ba84ba545 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:19.574304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41b257-d3e4-4645-bf19-768ba84ba545 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:19.578950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012738e8-bcaf-454a-8caa-e44f1650a5e6 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b24f758b7c9466d98507d5846becf91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabae7594d964006ab259503ad144887', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:19.579752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012738e8-bcaf-454a-8caa-e44f1650a5e6 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:19.580036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012738e8-bcaf-454a-8caa-e44f1650a5e6 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:19.580311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012738e8-bcaf-454a-8caa-e44f1650a5e6 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] PATH_INFO: `/v3/projects/6df5335988bc4682b96d9f0a707a2078` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:19.581515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012738e8-bcaf-454a-8caa-e44f1650a5e6 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorizing `identity:get_project(project_id=6df5335988bc4682b96d9f0a707a2078)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:19.583740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012738e8-bcaf-454a-8caa-e44f1650a5e6 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:19.584340 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 998/1983] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:20:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:20:19.590129 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 986/1984] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:20:19 2022] GET /identity/v3/projects/6df5335988bc4682b96d9f0a707a2078 => generated 371 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:20:19.597713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e968e-ffc2-46ca-95aa-fb0997564131 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:19.599089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8f0e968e-ffc2-46ca-95aa-fb0997564131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:19.611308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e968e-ffc2-46ca-95aa-fb0997564131 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:19.614248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012738e8-bcaf-454a-8caa-e44f1650a5e6 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:19.617205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793978b-2784-4bed-ad55-f953e651413f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:19.617205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793978b-2784-4bed-ad55-f953e651413f service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:19.617205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793978b-2784-4bed-ad55-f953e651413f service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:19.617205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793978b-2784-4bed-ad55-f953e651413f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:19.624564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012738e8-bcaf-454a-8caa-e44f1650a5e6 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:19.627908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793978b-2784-4bed-ad55-f953e651413f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:19.629361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a719c9c-5b5b-489e-a691-a98c18c4dd2b tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b24f758b7c9466d98507d5846becf91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabae7594d964006ab259503ad144887', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:19.630063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793978b-2784-4bed-ad55-f953e651413f service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:19.630232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a719c9c-5b5b-489e-a691-a98c18c4dd2b tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:19.631501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a719c9c-5b5b-489e-a691-a98c18c4dd2b tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:19.631805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a719c9c-5b5b-489e-a691-a98c18c4dd2b tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] PATH_INFO: `/v3/users/d28c218630844fbebcf7e1c24621e2f4` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:19.643916 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 999/1985] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:19.650538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a719c9c-5b5b-489e-a691-a98c18c4dd2b tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d28c218630844fbebcf7e1c24621e2f4)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:19.652590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a719c9c-5b5b-489e-a691-a98c18c4dd2b tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:19.661024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437accb5-47ef-411c-aaa4-bb7e30291dc8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:19.661320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437accb5-47ef-411c-aaa4-bb7e30291dc8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:19.663179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437accb5-47ef-411c-aaa4-bb7e30291dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:19.680055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-437accb5-47ef-411c-aaa4-bb7e30291dc8 None None] MFA Rules not processed for user `4cd9fe10f94f43aeb3eb10009ee96ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:19.681459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-437accb5-47ef-411c-aaa4-bb7e30291dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:19.688155 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1000/1986] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:20:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:20:19.706597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437accb5-47ef-411c-aaa4-bb7e30291dc8 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:19.707945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437accb5-47ef-411c-aaa4-bb7e30291dc8 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:19.713284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a580127-3d36-413f-9728-7e9d319c3cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:19.713969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a580127-3d36-413f-9728-7e9d319c3cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:19.714252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a580127-3d36-413f-9728-7e9d319c3cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:19.714560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a580127-3d36-413f-9728-7e9d319c3cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:19.722313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a580127-3d36-413f-9728-7e9d319c3cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:19.723752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a580127-3d36-413f-9728-7e9d319c3cf5 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:19.733084 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1001/1987] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:20:19.734004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a580127-3d36-413f-9728-7e9d319c3cf5 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:19.735349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9a580127-3d36-413f-9728-7e9d319c3cf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:19.749933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a580127-3d36-413f-9728-7e9d319c3cf5 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:19.754529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12536f2-6a70-44a8-8dc1-cfa01c833bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:19.756110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12536f2-6a70-44a8-8dc1-cfa01c833bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:19.756110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12536f2-6a70-44a8-8dc1-cfa01c833bce admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:19.756110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12536f2-6a70-44a8-8dc1-cfa01c833bce admin admin] PATH_INFO: `/v3/projects/864b22ea2e294e98ab3a5e700387a1dc` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:19.757121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12536f2-6a70-44a8-8dc1-cfa01c833bce admin admin] RBAC: Authorizing `identity:delete_project(project_id=864b22ea2e294e98ab3a5e700387a1dc)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:19.759672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12536f2-6a70-44a8-8dc1-cfa01c833bce admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:19.835017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7a719c9c-5b5b-489e-a691-a98c18c4dd2b tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd28c218630844fbebcf7e1c24621e2f4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:19.848427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7a719c9c-5b5b-489e-a691-a98c18c4dd2b tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd28c218630844fbebcf7e1c24621e2f4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:19.850089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7a719c9c-5b5b-489e-a691-a98c18c4dd2b tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd28c218630844fbebcf7e1c24621e2f4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:19.870899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7a719c9c-5b5b-489e-a691-a98c18c4dd2b tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd28c218630844fbebcf7e1c24621e2f4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:19.915744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f12536f2-6a70-44a8-8dc1-cfa01c833bce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '864b22ea2e294e98ab3a5e700387a1dc', 'request_id': 'req-f12536f2-6a70-44a8-8dc1-cfa01c833bce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:19.922373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f12536f2-6a70-44a8-8dc1-cfa01c833bce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '864b22ea2e294e98ab3a5e700387a1dc', 'request_id': 'req-f12536f2-6a70-44a8-8dc1-cfa01c833bce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:19.943173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7a719c9c-5b5b-489e-a691-a98c18c4dd2b tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd28c218630844fbebcf7e1c24621e2f4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:19.950835 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 987/1988] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:19 2022] DELETE /identity/v3/users/d28c218630844fbebcf7e1c24621e2f4 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:19.954920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a719c9c-5b5b-489e-a691-a98c18c4dd2b tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:19.956576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7a719c9c-5b5b-489e-a691-a98c18c4dd2b tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:20.029946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a719c9c-5b5b-489e-a691-a98c18c4dd2b tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:20.038316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112035d-04cb-4644-bf44-13603a15c527 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b24f758b7c9466d98507d5846becf91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fabae7594d964006ab259503ad144887', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:20.039767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112035d-04cb-4644-bf44-13603a15c527 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:20.040064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112035d-04cb-4644-bf44-13603a15c527 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:20.040470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112035d-04cb-4644-bf44-13603a15c527 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] PATH_INFO: `/v3/projects/6df5335988bc4682b96d9f0a707a2078` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:20.041785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112035d-04cb-4644-bf44-13603a15c527 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6df5335988bc4682b96d9f0a707a2078)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:20.043742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112035d-04cb-4644-bf44-13603a15c527 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:20.047937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f12536f2-6a70-44a8-8dc1-cfa01c833bce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '864b22ea2e294e98ab3a5e700387a1dc', 'request_id': 'req-f12536f2-6a70-44a8-8dc1-cfa01c833bce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:20.061604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f12536f2-6a70-44a8-8dc1-cfa01c833bce admin admin] The token cache is being invalidate because project 864b22ea2e294e98ab3a5e700387a1dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:20.063297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f12536f2-6a70-44a8-8dc1-cfa01c833bce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:20.063297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f12536f2-6a70-44a8-8dc1-cfa01c833bce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:20.064712 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1002/1989] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:19 2022] DELETE /identity/v3/projects/864b22ea2e294e98ab3a5e700387a1dc => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:20.068369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12536f2-6a70-44a8-8dc1-cfa01c833bce admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:20.069864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f12536f2-6a70-44a8-8dc1-cfa01c833bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:20.133945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12536f2-6a70-44a8-8dc1-cfa01c833bce admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:20.193247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48140e4e-f58c-4586-8393-cad2f998a001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:20.194140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48140e4e-f58c-4586-8393-cad2f998a001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:20.194427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48140e4e-f58c-4586-8393-cad2f998a001 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:20.194707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48140e4e-f58c-4586-8393-cad2f998a001 admin admin] PATH_INFO: `/v3/users/ac8abc725b5a4d41b874c9da83920ccd` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:20.196586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48140e4e-f58c-4586-8393-cad2f998a001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac8abc725b5a4d41b874c9da83920ccd)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:20.198730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48140e4e-f58c-4586-8393-cad2f998a001 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:20.208779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b112035d-04cb-4644-bf44-13603a15c527 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6df5335988bc4682b96d9f0a707a2078', 'request_id': 'req-b112035d-04cb-4644-bf44-13603a15c527'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:20.303283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b112035d-04cb-4644-bf44-13603a15c527 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6df5335988bc4682b96d9f0a707a2078', 'request_id': 'req-b112035d-04cb-4644-bf44-13603a15c527'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:20.310673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b112035d-04cb-4644-bf44-13603a15c527 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6df5335988bc4682b96d9f0a707a2078', 'request_id': 'req-b112035d-04cb-4644-bf44-13603a15c527'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:20.323411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b112035d-04cb-4644-bf44-13603a15c527 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] The token cache is being invalidate because project 6df5335988bc4682b96d9f0a707a2078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:20.323709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b112035d-04cb-4644-bf44-13603a15c527 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:20.324547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b112035d-04cb-4644-bf44-13603a15c527 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:20.330403 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 988/1990] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:19 2022] DELETE /identity/v3/projects/6df5335988bc4682b96d9f0a707a2078 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:20.331474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112035d-04cb-4644-bf44-13603a15c527 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:20.333111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b112035d-04cb-4644-bf44-13603a15c527 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:20.399832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-48140e4e-f58c-4586-8393-cad2f998a001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac8abc725b5a4d41b874c9da83920ccd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:20.417421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112035d-04cb-4644-bf44-13603a15c527 tempest-QuotasAdminTestV257-844352184 tempest-QuotasAdminTestV257-844352184-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:20.420175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-48140e4e-f58c-4586-8393-cad2f998a001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac8abc725b5a4d41b874c9da83920ccd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:20.422299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-48140e4e-f58c-4586-8393-cad2f998a001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac8abc725b5a4d41b874c9da83920ccd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:20.422578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9461b22-da65-4754-abc9-7c8834ecca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:20.423647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9461b22-da65-4754-abc9-7c8834ecca64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:20.423811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9461b22-da65-4754-abc9-7c8834ecca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:20.424925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9461b22-da65-4754-abc9-7c8834ecca64 admin admin] PATH_INFO: `/v3/users/b429cbe333eb4ecdb08c0ffab05056ee` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:20.426209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9461b22-da65-4754-abc9-7c8834ecca64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b429cbe333eb4ecdb08c0ffab05056ee)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:20.428858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9461b22-da65-4754-abc9-7c8834ecca64 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:20.444558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-48140e4e-f58c-4586-8393-cad2f998a001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac8abc725b5a4d41b874c9da83920ccd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:20.544908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-48140e4e-f58c-4586-8393-cad2f998a001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac8abc725b5a4d41b874c9da83920ccd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:20.551266 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1003/1991] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:20 2022] DELETE /identity/v3/users/ac8abc725b5a4d41b874c9da83920ccd => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:20.552568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9d67e-305d-4b3a-88d7-99db0fa280c4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:20.552889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9d67e-305d-4b3a-88d7-99db0fa280c4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:20.553169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9d67e-305d-4b3a-88d7-99db0fa280c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:20.571417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d7f9d67e-305d-4b3a-88d7-99db0fa280c4 None None] MFA Rules not processed for user `625d2d9692cd4191afa8cb7d4c82a74d`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:20.572716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d7f9d67e-305d-4b3a-88d7-99db0fa280c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:20.641375 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1004/1992] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:20.653822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c9461b22-da65-4754-abc9-7c8834ecca64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b429cbe333eb4ecdb08c0ffab05056ee'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:20.671848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c9461b22-da65-4754-abc9-7c8834ecca64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b429cbe333eb4ecdb08c0ffab05056ee'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:20.674074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c9461b22-da65-4754-abc9-7c8834ecca64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b429cbe333eb4ecdb08c0ffab05056ee'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:20.683634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c9461b22-da65-4754-abc9-7c8834ecca64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b429cbe333eb4ecdb08c0ffab05056ee'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:20.809094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c9461b22-da65-4754-abc9-7c8834ecca64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b429cbe333eb4ecdb08c0ffab05056ee'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:20.819344 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 989/1993] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:20 2022] DELETE /identity/v3/users/b429cbe333eb4ecdb08c0ffab05056ee => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:20.828371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89165e91-b146-4d2f-afa8-5e887ef1842f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:20.828854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89165e91-b146-4d2f-afa8-5e887ef1842f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:20.829230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89165e91-b146-4d2f-afa8-5e887ef1842f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:20.847110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-89165e91-b146-4d2f-afa8-5e887ef1842f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:20.853646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-89165e91-b146-4d2f-afa8-5e887ef1842f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:20.970379 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1005/1994] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:20.984539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9461b22-da65-4754-abc9-7c8834ecca64 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:20.986299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c9461b22-da65-4754-abc9-7c8834ecca64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:21.074268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9461b22-da65-4754-abc9-7c8834ecca64 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:21.078930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b8c6f-7ef2-43bc-b57d-36ded81a5f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:21.080670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b8c6f-7ef2-43bc-b57d-36ded81a5f4b service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:21.080670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b8c6f-7ef2-43bc-b57d-36ded81a5f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:21.080670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b8c6f-7ef2-43bc-b57d-36ded81a5f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:21.096000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b8c6f-7ef2-43bc-b57d-36ded81a5f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:21.097483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b8c6f-7ef2-43bc-b57d-36ded81a5f4b service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:21.110964 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 990/1995] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:21.170517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89165e91-b146-4d2f-afa8-5e887ef1842f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:21.172104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-89165e91-b146-4d2f-afa8-5e887ef1842f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:21.184571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89165e91-b146-4d2f-afa8-5e887ef1842f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:21.195048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6719798-a3ad-4eac-b75a-812d296730f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:21.195048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6719798-a3ad-4eac-b75a-812d296730f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:21.195048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6719798-a3ad-4eac-b75a-812d296730f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:21.195048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6719798-a3ad-4eac-b75a-812d296730f8 admin admin] PATH_INFO: `/v3/projects/d4a4c2f99e6a46918b681c9f1fe9a7e5` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:21.195879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6719798-a3ad-4eac-b75a-812d296730f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4a4c2f99e6a46918b681c9f1fe9a7e5)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:21.197518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6719798-a3ad-4eac-b75a-812d296730f8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:21.327640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6719798-a3ad-4eac-b75a-812d296730f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4a4c2f99e6a46918b681c9f1fe9a7e5', 'request_id': 'req-d6719798-a3ad-4eac-b75a-812d296730f8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:21.334262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6719798-a3ad-4eac-b75a-812d296730f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4a4c2f99e6a46918b681c9f1fe9a7e5', 'request_id': 'req-d6719798-a3ad-4eac-b75a-812d296730f8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:21.390908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6719798-a3ad-4eac-b75a-812d296730f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4a4c2f99e6a46918b681c9f1fe9a7e5', 'request_id': 'req-d6719798-a3ad-4eac-b75a-812d296730f8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:21.403368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6719798-a3ad-4eac-b75a-812d296730f8 admin admin] The token cache is being invalidate because project d4a4c2f99e6a46918b681c9f1fe9a7e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:21.403677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6719798-a3ad-4eac-b75a-812d296730f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:21.404298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6719798-a3ad-4eac-b75a-812d296730f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:21.406375 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1006/1996] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:21 2022] DELETE /identity/v3/projects/d4a4c2f99e6a46918b681c9f1fe9a7e5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:21.411213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30741089-41c1-44f9-8f23-6b160c29c2c7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:21.411491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30741089-41c1-44f9-8f23-6b160c29c2c7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:21.411775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30741089-41c1-44f9-8f23-6b160c29c2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:21.433047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-30741089-41c1-44f9-8f23-6b160c29c2c7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:21.434385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-30741089-41c1-44f9-8f23-6b160c29c2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:21.517443 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 991/1997] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:21.519133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46596b1a-10e7-4e69-9f16-f578762bb1d6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:21.519459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46596b1a-10e7-4e69-9f16-f578762bb1d6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:21.519748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46596b1a-10e7-4e69-9f16-f578762bb1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:21.540738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-46596b1a-10e7-4e69-9f16-f578762bb1d6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:21.541994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-46596b1a-10e7-4e69-9f16-f578762bb1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:21.551064 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1007/1998] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:20:21.555851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30741089-41c1-44f9-8f23-6b160c29c2c7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:21.566555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30741089-41c1-44f9-8f23-6b160c29c2c7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:21.571870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfd945-92c3-41f4-bc88-dedc7cbc5b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:21.572576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfd945-92c3-41f4-bc88-dedc7cbc5b29 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:21.572910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfd945-92c3-41f4-bc88-dedc7cbc5b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:21.573178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfd945-92c3-41f4-bc88-dedc7cbc5b29 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:21.573921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfd945-92c3-41f4-bc88-dedc7cbc5b29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:21.574235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfd945-92c3-41f4-bc88-dedc7cbc5b29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:21.575822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfd945-92c3-41f4-bc88-dedc7cbc5b29 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:21.587523 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 992/1999] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:21.591870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46596b1a-10e7-4e69-9f16-f578762bb1d6 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:21.601551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46596b1a-10e7-4e69-9f16-f578762bb1d6 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:21.608075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd19881-c8ff-4034-b369-222b43b99e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:21.608781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd19881-c8ff-4034-b369-222b43b99e5f admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:21.609068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd19881-c8ff-4034-b369-222b43b99e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:21.609342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd19881-c8ff-4034-b369-222b43b99e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:21.610042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd19881-c8ff-4034-b369-222b43b99e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:21.611966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd19881-c8ff-4034-b369-222b43b99e5f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:21.733409 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1008/2000] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:21 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:20:21.737650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfd945-92c3-41f4-bc88-dedc7cbc5b29 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:21.748335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfd945-92c3-41f4-bc88-dedc7cbc5b29 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:21.771399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd19881-c8ff-4034-b369-222b43b99e5f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:21.773602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9bd19881-c8ff-4034-b369-222b43b99e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:21.811561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc203e6-6cf8-4324-910a-055a5f2b8d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:21.812377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc203e6-6cf8-4324-910a-055a5f2b8d93 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:21.812784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc203e6-6cf8-4324-910a-055a5f2b8d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:21.813170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc203e6-6cf8-4324-910a-055a5f2b8d93 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:21.814013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc203e6-6cf8-4324-910a-055a5f2b8d93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:21.816164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc203e6-6cf8-4324-910a-055a5f2b8d93 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:21.852890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd19881-c8ff-4034-b369-222b43b99e5f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:21.859205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6a80f-78d0-4058-a586-96ac9d7ce4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:21.860073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6a80f-78d0-4058-a586-96ac9d7ce4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:21.860376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6a80f-78d0-4058-a586-96ac9d7ce4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:21.860692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6a80f-78d0-4058-a586-96ac9d7ce4bd admin admin] PATH_INFO: `/v3/projects/a3e2b2da9de0451fa382ec2c763bd98b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:21.861971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6a80f-78d0-4058-a586-96ac9d7ce4bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3e2b2da9de0451fa382ec2c763bd98b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:21.863949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6a80f-78d0-4058-a586-96ac9d7ce4bd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:21.932996 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 993/2001] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:21 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:21.937310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc203e6-6cf8-4324-910a-055a5f2b8d93 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:21.948026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc203e6-6cf8-4324-910a-055a5f2b8d93 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:21.953025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5caa9-6d0f-4d26-a82e-1a03c6762ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:21.953720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5caa9-6d0f-4d26-a82e-1a03c6762ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:21.954143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5caa9-6d0f-4d26-a82e-1a03c6762ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:21.954432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5caa9-6d0f-4d26-a82e-1a03c6762ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:21.955170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5caa9-6d0f-4d26-a82e-1a03c6762ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:21.956825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5caa9-6d0f-4d26-a82e-1a03c6762ad2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:21.971854 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 994/2002] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:21.973217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5caa9-6d0f-4d26-a82e-1a03c6762ad2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:21.987122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5caa9-6d0f-4d26-a82e-1a03c6762ad2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:21.998597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468a297-711c-44f0-81dc-4b13745b6f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:21.999437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468a297-711c-44f0-81dc-4b13745b6f42 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:21.999897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468a297-711c-44f0-81dc-4b13745b6f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:22.000617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468a297-711c-44f0-81dc-4b13745b6f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:22.002015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468a297-711c-44f0-81dc-4b13745b6f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:22.004680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468a297-711c-44f0-81dc-4b13745b6f42 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:22.015636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-91a6a80f-78d0-4058-a586-96ac9d7ce4bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3e2b2da9de0451fa382ec2c763bd98b', 'request_id': 'req-91a6a80f-78d0-4058-a586-96ac9d7ce4bd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:22.018057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-91a6a80f-78d0-4058-a586-96ac9d7ce4bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3e2b2da9de0451fa382ec2c763bd98b', 'request_id': 'req-91a6a80f-78d0-4058-a586-96ac9d7ce4bd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:22.021814 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 995/2003] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:20:22.025576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468a297-711c-44f0-81dc-4b13745b6f42 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:22.036448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468a297-711c-44f0-81dc-4b13745b6f42 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:22.098851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f479062-dcb3-4ace-b893-1e4a93351a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:22.100026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f479062-dcb3-4ace-b893-1e4a93351a77 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:22.100223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f479062-dcb3-4ace-b893-1e4a93351a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:22.100504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f479062-dcb3-4ace-b893-1e4a93351a77 admin admin] PATH_INFO: `/v3/projects/719f21ad39f647578720c65c2b75d180/users/0691899106224ee5899563f71afb2a60/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:22.119099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f479062-dcb3-4ace-b893-1e4a93351a77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=719f21ad39f647578720c65c2b75d180, user_id=0691899106224ee5899563f71afb2a60, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:22.122184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f479062-dcb3-4ace-b893-1e4a93351a77 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:22.134193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-91a6a80f-78d0-4058-a586-96ac9d7ce4bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3e2b2da9de0451fa382ec2c763bd98b', 'request_id': 'req-91a6a80f-78d0-4058-a586-96ac9d7ce4bd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:22.145541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-91a6a80f-78d0-4058-a586-96ac9d7ce4bd admin admin] The token cache is being invalidate because project a3e2b2da9de0451fa382ec2c763bd98b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:22.147600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-91a6a80f-78d0-4058-a586-96ac9d7ce4bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:22.159556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-91a6a80f-78d0-4058-a586-96ac9d7ce4bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:22.162604 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1009/2004] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:21 2022] DELETE /identity/v3/projects/a3e2b2da9de0451fa382ec2c763bd98b => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:22.168337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6a80f-78d0-4058-a586-96ac9d7ce4bd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:22.169954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-91a6a80f-78d0-4058-a586-96ac9d7ce4bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:22.185563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6a80f-78d0-4058-a586-96ac9d7ce4bd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:22.190580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144afb77-51f7-4472-93ca-3d91d937ea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:22.191752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144afb77-51f7-4472-93ca-3d91d937ea39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:22.192063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144afb77-51f7-4472-93ca-3d91d937ea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:22.192348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144afb77-51f7-4472-93ca-3d91d937ea39 admin admin] PATH_INFO: `/v3/users/5b24f758b7c9466d98507d5846becf91` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:22.193612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144afb77-51f7-4472-93ca-3d91d937ea39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b24f758b7c9466d98507d5846becf91)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:22.195619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144afb77-51f7-4472-93ca-3d91d937ea39 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:22.214448 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 996/2005] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:22 2022] PUT /identity/v3/projects/719f21ad39f647578720c65c2b75d180/users/0691899106224ee5899563f71afb2a60/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:22.227883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900ab53-9436-410d-b9b2-851a203da9ff None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:22.228176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900ab53-9436-410d-b9b2-851a203da9ff None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:22.228461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900ab53-9436-410d-b9b2-851a203da9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:22.260442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e900ab53-9436-410d-b9b2-851a203da9ff None None] MFA Rules not processed for user `0691899106224ee5899563f71afb2a60`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:22.261489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e900ab53-9436-410d-b9b2-851a203da9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:22.330926 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 997/2006] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:20:22.335267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900ab53-9436-410d-b9b2-851a203da9ff None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:22.337127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e900ab53-9436-410d-b9b2-851a203da9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:22.415987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-144afb77-51f7-4472-93ca-3d91d937ea39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b24f758b7c9466d98507d5846becf91'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:22.428408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-144afb77-51f7-4472-93ca-3d91d937ea39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b24f758b7c9466d98507d5846becf91'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:22.429245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-144afb77-51f7-4472-93ca-3d91d937ea39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b24f758b7c9466d98507d5846becf91'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:22.431817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900ab53-9436-410d-b9b2-851a203da9ff None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:22.436899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-144afb77-51f7-4472-93ca-3d91d937ea39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b24f758b7c9466d98507d5846becf91'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:22.437071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7905f85-a353-4602-9091-052864fb1e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:22.437728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7905f85-a353-4602-9091-052864fb1e6d admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:22.438021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7905f85-a353-4602-9091-052864fb1e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:22.438307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7905f85-a353-4602-9091-052864fb1e6d admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:22.439154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7905f85-a353-4602-9091-052864fb1e6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:22.441308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7905f85-a353-4602-9091-052864fb1e6d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:22.556167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-144afb77-51f7-4472-93ca-3d91d937ea39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b24f758b7c9466d98507d5846becf91'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:22.562561 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1010/2007] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:22 2022] DELETE /identity/v3/users/5b24f758b7c9466d98507d5846becf91 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:22.566301 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 998/2008] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:22 2022] POST /identity/v3/projects => generated 375 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:20:22.567331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144afb77-51f7-4472-93ca-3d91d937ea39 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:22.568851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-144afb77-51f7-4472-93ca-3d91d937ea39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:22.641787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144afb77-51f7-4472-93ca-3d91d937ea39 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:22.700812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a33d1b-219d-4d7d-9898-6d161f833188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:22.701490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a33d1b-219d-4d7d-9898-6d161f833188 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:22.701774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a33d1b-219d-4d7d-9898-6d161f833188 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:22.702051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a33d1b-219d-4d7d-9898-6d161f833188 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:22.702737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a33d1b-219d-4d7d-9898-6d161f833188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:22.704821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a33d1b-219d-4d7d-9898-6d161f833188 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:22.812647 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1011/2009] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:22 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:22.816264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7905f85-a353-4602-9091-052864fb1e6d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:22.828167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7905f85-a353-4602-9091-052864fb1e6d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:22.833373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7a618-6062-4977-97b9-34bd89642b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:22.834045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7a618-6062-4977-97b9-34bd89642b1d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:22.834442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7a618-6062-4977-97b9-34bd89642b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:22.839164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7a618-6062-4977-97b9-34bd89642b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:22.839164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7a618-6062-4977-97b9-34bd89642b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:22.839164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7a618-6062-4977-97b9-34bd89642b1d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:22.848996 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 999/2010] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:20:22.853428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a33d1b-219d-4d7d-9898-6d161f833188 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:22.864418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a33d1b-219d-4d7d-9898-6d161f833188 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:22.869555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8121a37-2499-4851-9811-d2799bedbebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:22.870596 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8121a37-2499-4851-9811-d2799bedbebc admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:22.871336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8121a37-2499-4851-9811-d2799bedbebc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:22.871690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8121a37-2499-4851-9811-d2799bedbebc admin admin] PATH_INFO: `/v3/projects/b07ea8f635c843389eede0b311267490/users/e8abfe72b83d41559f88364dd44619c3/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:22.887688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8121a37-2499-4851-9811-d2799bedbebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07ea8f635c843389eede0b311267490, user_id=e8abfe72b83d41559f88364dd44619c3, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:22.891137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8121a37-2499-4851-9811-d2799bedbebc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:22.986802 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1012/2011] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:22 2022] PUT /identity/v3/projects/b07ea8f635c843389eede0b311267490/users/e8abfe72b83d41559f88364dd44619c3/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:22.990918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7a618-6062-4977-97b9-34bd89642b1d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:23.006116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7a618-6062-4977-97b9-34bd89642b1d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:23.108322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ba764-90b5-4c83-823a-e2f643f5e283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:23.109429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ba764-90b5-4c83-823a-e2f643f5e283 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:23.109870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ba764-90b5-4c83-823a-e2f643f5e283 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:23.110346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ba764-90b5-4c83-823a-e2f643f5e283 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:23.111274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ba764-90b5-4c83-823a-e2f643f5e283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:23.113193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ba764-90b5-4c83-823a-e2f643f5e283 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:23.124794 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1000/2012] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:23.129135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8121a37-2499-4851-9811-d2799bedbebc admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:23.141835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8121a37-2499-4851-9811-d2799bedbebc admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:23.147604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c12db8-f9ad-420b-8df2-8b8bc357fb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:23.148620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c12db8-f9ad-420b-8df2-8b8bc357fb9a admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:23.148849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c12db8-f9ad-420b-8df2-8b8bc357fb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:23.149136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c12db8-f9ad-420b-8df2-8b8bc357fb9a admin admin] PATH_INFO: `/v3/projects/b07ea8f635c843389eede0b311267490/users/e8abfe72b83d41559f88364dd44619c3/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:23.152067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c12db8-f9ad-420b-8df2-8b8bc357fb9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07ea8f635c843389eede0b311267490, user_id=e8abfe72b83d41559f88364dd44619c3, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:23.157275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c12db8-f9ad-420b-8df2-8b8bc357fb9a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:23.164537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ba764-90b5-4c83-823a-e2f643f5e283 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:23.166167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-699ba764-90b5-4c83-823a-e2f643f5e283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:23.182757 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1013/2013] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:23 2022] PUT /identity/v3/projects/b07ea8f635c843389eede0b311267490/users/e8abfe72b83d41559f88364dd44619c3/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:23.190000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ba764-90b5-4c83-823a-e2f643f5e283 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:23.193498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355bbf9-e40e-4248-a733-b0fff067c1b9 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:23.193993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355bbf9-e40e-4248-a733-b0fff067c1b9 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:23.196305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355bbf9-e40e-4248-a733-b0fff067c1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:23.245341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d355bbf9-e40e-4248-a733-b0fff067c1b9 None None] MFA Rules not processed for user `e8abfe72b83d41559f88364dd44619c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:23.248033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d355bbf9-e40e-4248-a733-b0fff067c1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:23.334311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd039b-2500-45f7-a6ac-828d8bd257ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:23.335251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd039b-2500-45f7-a6ac-828d8bd257ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:23.335537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd039b-2500-45f7-a6ac-828d8bd257ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:23.335849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd039b-2500-45f7-a6ac-828d8bd257ce admin admin] PATH_INFO: `/v3/projects/fabae7594d964006ab259503ad144887` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:23.337383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd039b-2500-45f7-a6ac-828d8bd257ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=fabae7594d964006ab259503ad144887)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:23.339466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd039b-2500-45f7-a6ac-828d8bd257ce admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:23.370953 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1014/2014] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:23.383110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d169a57-1e24-481e-8a86-a8ed79f04081 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:23.383402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d169a57-1e24-481e-8a86-a8ed79f04081 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:23.383681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d169a57-1e24-481e-8a86-a8ed79f04081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:23.400753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5d169a57-1e24-481e-8a86-a8ed79f04081 None None] MFA Rules not processed for user `0691899106224ee5899563f71afb2a60`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:23.401951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5d169a57-1e24-481e-8a86-a8ed79f04081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:23.454398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-88dd039b-2500-45f7-a6ac-828d8bd257ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fabae7594d964006ab259503ad144887', 'request_id': 'req-88dd039b-2500-45f7-a6ac-828d8bd257ce'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:23.466955 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1015/2015] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:20:23.468306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bed053-3f5c-4005-8a1d-3c9704cac712 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:23.468637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bed053-3f5c-4005-8a1d-3c9704cac712 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:23.469001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bed053-3f5c-4005-8a1d-3c9704cac712 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:23.470488 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1016/2016] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:20:23.476040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650aebf-20af-4068-bf94-c6ee62af1e8b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:23.477229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650aebf-20af-4068-bf94-c6ee62af1e8b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:23.477229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650aebf-20af-4068-bf94-c6ee62af1e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:23.496520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8650aebf-20af-4068-bf94-c6ee62af1e8b None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:23.497773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8650aebf-20af-4068-bf94-c6ee62af1e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:23.517784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-88dd039b-2500-45f7-a6ac-828d8bd257ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fabae7594d964006ab259503ad144887', 'request_id': 'req-88dd039b-2500-45f7-a6ac-828d8bd257ce'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:23.525675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-88dd039b-2500-45f7-a6ac-828d8bd257ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fabae7594d964006ab259503ad144887', 'request_id': 'req-88dd039b-2500-45f7-a6ac-828d8bd257ce'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:23.536834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-88dd039b-2500-45f7-a6ac-828d8bd257ce admin admin] The token cache is being invalidate because project fabae7594d964006ab259503ad144887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:23.537180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-88dd039b-2500-45f7-a6ac-828d8bd257ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:23.537939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-88dd039b-2500-45f7-a6ac-828d8bd257ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:23.540382 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1001/2017] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:23 2022] DELETE /identity/v3/projects/fabae7594d964006ab259503ad144887 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:23.541205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd039b-2500-45f7-a6ac-828d8bd257ce admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:23.542616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-88dd039b-2500-45f7-a6ac-828d8bd257ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:23.577440 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1017/2018] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:20:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:23.579069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19dfe1-22f2-43fc-90fa-421ce301b2fc None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:23.579396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19dfe1-22f2-43fc-90fa-421ce301b2fc None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:23.579679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19dfe1-22f2-43fc-90fa-421ce301b2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:23.603028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-bd19dfe1-22f2-43fc-90fa-421ce301b2fc None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:23.604238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bd19dfe1-22f2-43fc-90fa-421ce301b2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:23.635414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd039b-2500-45f7-a6ac-828d8bd257ce admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:23.644867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccaf0dd-b72e-4af3-88a5-05134892ecb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:23.646194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaf0dd-b72e-4af3-88a5-05134892ecb9 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:23.646489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaf0dd-b72e-4af3-88a5-05134892ecb9 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:23.646780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaf0dd-b72e-4af3-88a5-05134892ecb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:23.649291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7ccaf0dd-b72e-4af3-88a5-05134892ecb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:23.676918 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1018/2019] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:23.679061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19dfe1-22f2-43fc-90fa-421ce301b2fc None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:23.682446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bd19dfe1-22f2-43fc-90fa-421ce301b2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:23.701207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19dfe1-22f2-43fc-90fa-421ce301b2fc None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:23.709279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f64cd-64d9-4f84-838c-ab5a5bb5065a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:23.709946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f64cd-64d9-4f84-838c-ab5a5bb5065a service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:23.711319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f64cd-64d9-4f84-838c-ab5a5bb5065a service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:23.711608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f64cd-64d9-4f84-838c-ab5a5bb5065a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:23.715724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccaf0dd-b72e-4af3-88a5-05134892ecb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:23.717385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccaf0dd-b72e-4af3-88a5-05134892ecb9 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:23.724923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f64cd-64d9-4f84-838c-ab5a5bb5065a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:23.726945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f64cd-64d9-4f84-838c-ab5a5bb5065a service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:23.729673 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1002/2020] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:23.731212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7f7ec-4428-451e-82d8-461165682485 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:23.731565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7f7ec-4428-451e-82d8-461165682485 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:23.732015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7f7ec-4428-451e-82d8-461165682485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:23.737593 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1019/2021] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:23.759437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e5e7f7ec-4428-451e-82d8-461165682485 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:23.761247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e5e7f7ec-4428-451e-82d8-461165682485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:23.770698 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1003/2022] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:23.775080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f64cd-64d9-4f84-838c-ab5a5bb5065a service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:23.787875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f64cd-64d9-4f84-838c-ab5a5bb5065a service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:23.794078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccabce-b063-4433-99fc-f972e02504c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:23.796383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccabce-b063-4433-99fc-f972e02504c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:23.796831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccabce-b063-4433-99fc-f972e02504c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:23.797317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccabce-b063-4433-99fc-f972e02504c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:23.798191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccabce-b063-4433-99fc-f972e02504c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:23.798599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccabce-b063-4433-99fc-f972e02504c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:23.800274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccabce-b063-4433-99fc-f972e02504c3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:23.817115 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1020/2023] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:23.821592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7f7ec-4428-451e-82d8-461165682485 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:23.831131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7f7ec-4428-451e-82d8-461165682485 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:23.836533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8cd05-81c7-4250-a56a-7a3a3159a02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:23.837253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8cd05-81c7-4250-a56a-7a3a3159a02a admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:23.837538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8cd05-81c7-4250-a56a-7a3a3159a02a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:23.837985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8cd05-81c7-4250-a56a-7a3a3159a02a admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:23.838691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8cd05-81c7-4250-a56a-7a3a3159a02a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:23.840654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8cd05-81c7-4250-a56a-7a3a3159a02a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:23.935378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccabce-b063-4433-99fc-f972e02504c3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:23.941778 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1004/2024] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:23 2022] POST /identity/v3/projects => generated 391 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:23.946381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccabce-b063-4433-99fc-f972e02504c3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:24.015075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd11d8-384b-48ed-a564-04f275a359d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:24.015751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd11d8-384b-48ed-a564-04f275a359d4 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:24.016035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd11d8-384b-48ed-a564-04f275a359d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:24.016488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd11d8-384b-48ed-a564-04f275a359d4 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:24.017437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd11d8-384b-48ed-a564-04f275a359d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:24.025290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd11d8-384b-48ed-a564-04f275a359d4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:24.157335 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1021/2025] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:23 2022] POST /identity/v3/users => generated 296 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:24.168974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8cd05-81c7-4250-a56a-7a3a3159a02a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:24.179342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8cd05-81c7-4250-a56a-7a3a3159a02a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:24.186116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122c01c-330d-4b65-ac97-e0d224d212c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:24.186789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122c01c-330d-4b65-ac97-e0d224d212c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:24.187193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122c01c-330d-4b65-ac97-e0d224d212c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:24.187475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122c01c-330d-4b65-ac97-e0d224d212c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:24.188236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122c01c-330d-4b65-ac97-e0d224d212c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:24.189965 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122c01c-330d-4b65-ac97-e0d224d212c2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:24.200962 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1005/2026] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:20:24.205030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd11d8-384b-48ed-a564-04f275a359d4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:24.215597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd11d8-384b-48ed-a564-04f275a359d4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:24.220157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ae800-f410-4bf0-9799-05d020762230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:24.220843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ae800-f410-4bf0-9799-05d020762230 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:24.221122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ae800-f410-4bf0-9799-05d020762230 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:24.221424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ae800-f410-4bf0-9799-05d020762230 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:24.222179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ae800-f410-4bf0-9799-05d020762230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:24.223759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ae800-f410-4bf0-9799-05d020762230 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:24.233309 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1022/2027] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:24.243387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122c01c-330d-4b65-ac97-e0d224d212c2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:24.253309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122c01c-330d-4b65-ac97-e0d224d212c2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:24.258238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012be1d7-7c52-4d86-b0f4-55ad43fa897d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:24.263701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012be1d7-7c52-4d86-b0f4-55ad43fa897d admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:24.263701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012be1d7-7c52-4d86-b0f4-55ad43fa897d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:24.263701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012be1d7-7c52-4d86-b0f4-55ad43fa897d admin admin] PATH_INFO: `/v3/projects/3a44fa48ca094b72b836647f85322ba8/users/c7b9d57ee23a44a5a31872054878359d/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:24.275788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012be1d7-7c52-4d86-b0f4-55ad43fa897d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a44fa48ca094b72b836647f85322ba8, user_id=c7b9d57ee23a44a5a31872054878359d, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:24.278575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012be1d7-7c52-4d86-b0f4-55ad43fa897d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:24.318206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ae800-f410-4bf0-9799-05d020762230 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:24.319878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ca7ae800-f410-4bf0-9799-05d020762230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:24.341072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ae800-f410-4bf0-9799-05d020762230 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:24.346168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fcbe3-e985-47b7-8711-d213b60790c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:24.347083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fcbe3-e985-47b7-8711-d213b60790c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:24.347373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fcbe3-e985-47b7-8711-d213b60790c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:24.348264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fcbe3-e985-47b7-8711-d213b60790c7 admin admin] PATH_INFO: `/v3/users/abe0822b37d047f5adc46a8e5253a05b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:24.349591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58fcbe3-e985-47b7-8711-d213b60790c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abe0822b37d047f5adc46a8e5253a05b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:24.351628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58fcbe3-e985-47b7-8711-d213b60790c7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:24.422714 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1006/2028] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:24 2022] PUT /identity/v3/projects/3a44fa48ca094b72b836647f85322ba8/users/c7b9d57ee23a44a5a31872054878359d/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:24.435919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2021445-3eec-4fca-b93c-a373926c4af0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:24.436124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2021445-3eec-4fca-b93c-a373926c4af0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:24.436556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2021445-3eec-4fca-b93c-a373926c4af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:24.474541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b2021445-3eec-4fca-b93c-a373926c4af0 None None] MFA Rules not processed for user `c7b9d57ee23a44a5a31872054878359d`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:24.475830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b2021445-3eec-4fca-b93c-a373926c4af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:24.557032 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1007/2029] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:20:24.557305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e58fcbe3-e985-47b7-8711-d213b60790c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abe0822b37d047f5adc46a8e5253a05b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:24.564928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2021445-3eec-4fca-b93c-a373926c4af0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:24.585449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e58fcbe3-e985-47b7-8711-d213b60790c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abe0822b37d047f5adc46a8e5253a05b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:24.586809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e58fcbe3-e985-47b7-8711-d213b60790c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abe0822b37d047f5adc46a8e5253a05b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:24.596559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e58fcbe3-e985-47b7-8711-d213b60790c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abe0822b37d047f5adc46a8e5253a05b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:24.652693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e58fcbe3-e985-47b7-8711-d213b60790c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abe0822b37d047f5adc46a8e5253a05b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:24.663831 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1023/2030] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:24 2022] DELETE /identity/v3/users/abe0822b37d047f5adc46a8e5253a05b => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:24.665360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b159083-ed0d-4d45-87b7-23eefe3e4124 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:24.665635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b159083-ed0d-4d45-87b7-23eefe3e4124 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:24.665916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b159083-ed0d-4d45-87b7-23eefe3e4124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:24.668871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2021445-3eec-4fca-b93c-a373926c4af0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:24.701199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2b159083-ed0d-4d45-87b7-23eefe3e4124 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:24.702536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2b159083-ed0d-4d45-87b7-23eefe3e4124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:24.780863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1028b8-5c89-47bd-9362-df787238fe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:24.781545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1028b8-5c89-47bd-9362-df787238fe36 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:24.782070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1028b8-5c89-47bd-9362-df787238fe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:24.782242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1028b8-5c89-47bd-9362-df787238fe36 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:24.782948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1028b8-5c89-47bd-9362-df787238fe36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:24.785446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1028b8-5c89-47bd-9362-df787238fe36 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:24.812588 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1024/2031] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:24.825505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b159083-ed0d-4d45-87b7-23eefe3e4124 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:24.826936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2b159083-ed0d-4d45-87b7-23eefe3e4124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:24.898415 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1008/2032] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:24 2022] POST /identity/v3/projects => generated 391 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:24.898415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1028b8-5c89-47bd-9362-df787238fe36 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:24.900350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5e1028b8-5c89-47bd-9362-df787238fe36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:24.913538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b159083-ed0d-4d45-87b7-23eefe3e4124 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:24.972920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461aafa-175a-4ca3-964b-ecfed87e6d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:24.973661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461aafa-175a-4ca3-964b-ecfed87e6d68 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:24.974190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461aafa-175a-4ca3-964b-ecfed87e6d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:24.974544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461aafa-175a-4ca3-964b-ecfed87e6d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:24.982585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1028b8-5c89-47bd-9362-df787238fe36 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:24.987261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461aafa-175a-4ca3-964b-ecfed87e6d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:24.989687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461aafa-175a-4ca3-964b-ecfed87e6d68 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:24.990638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c7bcb-1a1e-4a1c-af34-90f5e14e77c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:24.992019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c7bcb-1a1e-4a1c-af34-90f5e14e77c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:24.994936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c7bcb-1a1e-4a1c-af34-90f5e14e77c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:24.995260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c7bcb-1a1e-4a1c-af34-90f5e14e77c1 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:24.996513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c7bcb-1a1e-4a1c-af34-90f5e14e77c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:25.000636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c7bcb-1a1e-4a1c-af34-90f5e14e77c1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:25.012161 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1025/2033] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:20:25.110948 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1009/2034] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:24 2022] POST /identity/v3/users => generated 302 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:20:25.114912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461aafa-175a-4ca3-964b-ecfed87e6d68 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:25.127594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461aafa-175a-4ca3-964b-ecfed87e6d68 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:25.132922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c501fa5-6605-4bdb-8843-195eb4a9d812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:25.134226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c501fa5-6605-4bdb-8843-195eb4a9d812 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:25.134645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c501fa5-6605-4bdb-8843-195eb4a9d812 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:25.134996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c501fa5-6605-4bdb-8843-195eb4a9d812 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:25.135802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c501fa5-6605-4bdb-8843-195eb4a9d812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:25.137744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c501fa5-6605-4bdb-8843-195eb4a9d812 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:25.156649 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1026/2035] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:25.165772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c7bcb-1a1e-4a1c-af34-90f5e14e77c1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:25.184560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c7bcb-1a1e-4a1c-af34-90f5e14e77c1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:25.192846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f5d88-ad11-4c63-ad8d-71b6cc9ed037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:25.193888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f5d88-ad11-4c63-ad8d-71b6cc9ed037 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:25.194182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f5d88-ad11-4c63-ad8d-71b6cc9ed037 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:25.194464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f5d88-ad11-4c63-ad8d-71b6cc9ed037 admin admin] PATH_INFO: `/v3/projects/de93440b4d844bab9449f3f4db07ee75/users/cafc4b3633c845b0a37b456095b690e6/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:25.213428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f5d88-ad11-4c63-ad8d-71b6cc9ed037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de93440b4d844bab9449f3f4db07ee75, user_id=cafc4b3633c845b0a37b456095b690e6, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:25.217331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f5d88-ad11-4c63-ad8d-71b6cc9ed037 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:25.329012 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1010/2036] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:25 2022] PUT /identity/v3/projects/de93440b4d844bab9449f3f4db07ee75/users/cafc4b3633c845b0a37b456095b690e6/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:25.332887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c501fa5-6605-4bdb-8843-195eb4a9d812 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:25.346247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c501fa5-6605-4bdb-8843-195eb4a9d812 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:25.460559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf3819-90be-4415-8943-a9f10e097e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:25.462108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf3819-90be-4415-8943-a9f10e097e5d admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:25.462543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf3819-90be-4415-8943-a9f10e097e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:25.463252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf3819-90be-4415-8943-a9f10e097e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:25.464474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf3819-90be-4415-8943-a9f10e097e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:25.466306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf3819-90be-4415-8943-a9f10e097e5d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:25.518403 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1027/2037] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:20:25.523751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f5d88-ad11-4c63-ad8d-71b6cc9ed037 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:25.559895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f5d88-ad11-4c63-ad8d-71b6cc9ed037 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:25.571186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f41177-e431-4230-af4e-f126fe91a799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:25.572337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f41177-e431-4230-af4e-f126fe91a799 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:25.572652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f41177-e431-4230-af4e-f126fe91a799 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:25.573544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f41177-e431-4230-af4e-f126fe91a799 admin admin] PATH_INFO: `/v3/projects/de93440b4d844bab9449f3f4db07ee75/users/cafc4b3633c845b0a37b456095b690e6/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:25.576053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f41177-e431-4230-af4e-f126fe91a799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de93440b4d844bab9449f3f4db07ee75, user_id=cafc4b3633c845b0a37b456095b690e6, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:25.580514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f41177-e431-4230-af4e-f126fe91a799 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:25.601898 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1011/2038] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:25 2022] PUT /identity/v3/projects/de93440b4d844bab9449f3f4db07ee75/users/cafc4b3633c845b0a37b456095b690e6/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:25.604231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee7a39-780e-4567-91f8-be707bd3f9f7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:25.604527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee7a39-780e-4567-91f8-be707bd3f9f7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:25.604871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee7a39-780e-4567-91f8-be707bd3f9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:25.647558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a6ee7a39-780e-4567-91f8-be707bd3f9f7 None None] MFA Rules not processed for user `cafc4b3633c845b0a37b456095b690e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:25.649424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a6ee7a39-780e-4567-91f8-be707bd3f9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:25.737715 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1028/2039] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:25.759099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f41177-e431-4230-af4e-f126fe91a799 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:25.762051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-09f41177-e431-4230-af4e-f126fe91a799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:25.831050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee7a39-780e-4567-91f8-be707bd3f9f7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:25.833249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a6ee7a39-780e-4567-91f8-be707bd3f9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:25.858872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f41177-e431-4230-af4e-f126fe91a799 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:25.866235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6475aba-cd19-4c61-99eb-e6a163a62037 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:25.867158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6475aba-cd19-4c61-99eb-e6a163a62037 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:25.867516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6475aba-cd19-4c61-99eb-e6a163a62037 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:25.867866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6475aba-cd19-4c61-99eb-e6a163a62037 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:25.870008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b6475aba-cd19-4c61-99eb-e6a163a62037 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:25.928615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee7a39-780e-4567-91f8-be707bd3f9f7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:25.942349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6475aba-cd19-4c61-99eb-e6a163a62037 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:25.944055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cb508-dd08-4d3c-8b7f-e673ef8f0ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:25.944341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6475aba-cd19-4c61-99eb-e6a163a62037 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:25.945561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cb508-dd08-4d3c-8b7f-e673ef8f0ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:25.945850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cb508-dd08-4d3c-8b7f-e673ef8f0ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:25.946131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cb508-dd08-4d3c-8b7f-e673ef8f0ea2 admin admin] PATH_INFO: `/v3/projects/a405e8c053514663a4413891a3fd9e82` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:25.947387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cb508-dd08-4d3c-8b7f-e673ef8f0ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a405e8c053514663a4413891a3fd9e82)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:25.949438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cb508-dd08-4d3c-8b7f-e673ef8f0ea2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:25.955520 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1012/2040] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:26.078078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-108cb508-dd08-4d3c-8b7f-e673ef8f0ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a405e8c053514663a4413891a3fd9e82', 'request_id': 'req-108cb508-dd08-4d3c-8b7f-e673ef8f0ea2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:26.087869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-108cb508-dd08-4d3c-8b7f-e673ef8f0ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a405e8c053514663a4413891a3fd9e82', 'request_id': 'req-108cb508-dd08-4d3c-8b7f-e673ef8f0ea2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:26.191049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-108cb508-dd08-4d3c-8b7f-e673ef8f0ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a405e8c053514663a4413891a3fd9e82', 'request_id': 'req-108cb508-dd08-4d3c-8b7f-e673ef8f0ea2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:26.205010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-108cb508-dd08-4d3c-8b7f-e673ef8f0ea2 admin admin] The token cache is being invalidate because project a405e8c053514663a4413891a3fd9e82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:26.210199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-108cb508-dd08-4d3c-8b7f-e673ef8f0ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:26.210199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-108cb508-dd08-4d3c-8b7f-e673ef8f0ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:26.210199 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1029/2041] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:25 2022] DELETE /identity/v3/projects/a405e8c053514663a4413891a3fd9e82 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:26.211958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6475aba-cd19-4c61-99eb-e6a163a62037 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:26.222959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6475aba-cd19-4c61-99eb-e6a163a62037 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:26.291111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518315d4-8fa7-45f9-93cb-00e28e9eedea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:26.292128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518315d4-8fa7-45f9-93cb-00e28e9eedea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:26.292453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518315d4-8fa7-45f9-93cb-00e28e9eedea admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:26.292833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518315d4-8fa7-45f9-93cb-00e28e9eedea admin admin] PATH_INFO: `/v3/users/dd3d42b8634e47b98874e94f86c18468` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:26.294168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518315d4-8fa7-45f9-93cb-00e28e9eedea admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd3d42b8634e47b98874e94f86c18468)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:26.296151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518315d4-8fa7-45f9-93cb-00e28e9eedea admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:26.488753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-518315d4-8fa7-45f9-93cb-00e28e9eedea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd3d42b8634e47b98874e94f86c18468'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:26.506745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-518315d4-8fa7-45f9-93cb-00e28e9eedea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd3d42b8634e47b98874e94f86c18468'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:26.508896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-518315d4-8fa7-45f9-93cb-00e28e9eedea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd3d42b8634e47b98874e94f86c18468'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:26.517438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-518315d4-8fa7-45f9-93cb-00e28e9eedea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd3d42b8634e47b98874e94f86c18468'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:26.598451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-518315d4-8fa7-45f9-93cb-00e28e9eedea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd3d42b8634e47b98874e94f86c18468'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:26.608654 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1013/2042] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:26 2022] DELETE /identity/v3/users/dd3d42b8634e47b98874e94f86c18468 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:27.267050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cb508-dd08-4d3c-8b7f-e673ef8f0ea2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:27.268744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-108cb508-dd08-4d3c-8b7f-e673ef8f0ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:27.300688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cb508-dd08-4d3c-8b7f-e673ef8f0ea2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:27.370539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e10605-9e28-4668-9d02-7a0336426c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:27.370539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e10605-9e28-4668-9d02-7a0336426c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:27.370539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e10605-9e28-4668-9d02-7a0336426c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:27.370539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e10605-9e28-4668-9d02-7a0336426c34 admin admin] PATH_INFO: `/v3/projects/56e5494cea8543dbbef0c5ca3fcd74ae` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:27.373106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518315d4-8fa7-45f9-93cb-00e28e9eedea admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:27.374616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-518315d4-8fa7-45f9-93cb-00e28e9eedea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:27.377095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e10605-9e28-4668-9d02-7a0336426c34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56e5494cea8543dbbef0c5ca3fcd74ae)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:27.379056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e10605-9e28-4668-9d02-7a0336426c34 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:27.450049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518315d4-8fa7-45f9-93cb-00e28e9eedea admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:27.455521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2c5af-fbd3-4690-b723-e2ba2e8ba614 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:27.456309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2c5af-fbd3-4690-b723-e2ba2e8ba614 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:27.456629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2c5af-fbd3-4690-b723-e2ba2e8ba614 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:27.456906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2c5af-fbd3-4690-b723-e2ba2e8ba614 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:27.458656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fae2c5af-fbd3-4690-b723-e2ba2e8ba614 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:27.534565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2c5af-fbd3-4690-b723-e2ba2e8ba614 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:27.536343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2c5af-fbd3-4690-b723-e2ba2e8ba614 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:27.559424 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1014/2043] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:20:27.559609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-42e10605-9e28-4668-9d02-7a0336426c34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e5494cea8543dbbef0c5ca3fcd74ae', 'request_id': 'req-42e10605-9e28-4668-9d02-7a0336426c34'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:27.566252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-42e10605-9e28-4668-9d02-7a0336426c34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e5494cea8543dbbef0c5ca3fcd74ae', 'request_id': 'req-42e10605-9e28-4668-9d02-7a0336426c34'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:27.668374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-42e10605-9e28-4668-9d02-7a0336426c34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e5494cea8543dbbef0c5ca3fcd74ae', 'request_id': 'req-42e10605-9e28-4668-9d02-7a0336426c34'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:27.681732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-42e10605-9e28-4668-9d02-7a0336426c34 admin admin] The token cache is being invalidate because project 56e5494cea8543dbbef0c5ca3fcd74ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:27.681942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-42e10605-9e28-4668-9d02-7a0336426c34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:27.682815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-42e10605-9e28-4668-9d02-7a0336426c34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:27.684391 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1030/2044] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:27 2022] DELETE /identity/v3/projects/56e5494cea8543dbbef0c5ca3fcd74ae => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:27.689509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5f06f-90a9-45f6-a305-c61de25510b6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:27.689801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5f06f-90a9-45f6-a305-c61de25510b6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:27.690079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5f06f-90a9-45f6-a305-c61de25510b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:27.711545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fef5f06f-90a9-45f6-a305-c61de25510b6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:27.712800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fef5f06f-90a9-45f6-a305-c61de25510b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:27.778691 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1015/2045] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:20:27.786930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1356c-e8eb-4ff3-9b48-e7aa72221ed9 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:27.787223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1356c-e8eb-4ff3-9b48-e7aa72221ed9 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:27.787504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1356c-e8eb-4ff3-9b48-e7aa72221ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:27.808314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-75e1356c-e8eb-4ff3-9b48-e7aa72221ed9 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:27.809818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-75e1356c-e8eb-4ff3-9b48-e7aa72221ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:27.820778 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1031/2046] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:27.825436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5f06f-90a9-45f6-a305-c61de25510b6 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:27.836360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5f06f-90a9-45f6-a305-c61de25510b6 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:27.842375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73145985-5d2b-4f16-91a5-d174c0d8d78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:27.843785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73145985-5d2b-4f16-91a5-d174c0d8d78f admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:27.844078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73145985-5d2b-4f16-91a5-d174c0d8d78f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:27.844359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73145985-5d2b-4f16-91a5-d174c0d8d78f admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:27.845143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73145985-5d2b-4f16-91a5-d174c0d8d78f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:27.845457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73145985-5d2b-4f16-91a5-d174c0d8d78f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:27.847112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73145985-5d2b-4f16-91a5-d174c0d8d78f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:27.861534 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1016/2047] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:27.865655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1356c-e8eb-4ff3-9b48-e7aa72221ed9 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:27.876248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1356c-e8eb-4ff3-9b48-e7aa72221ed9 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:27.881134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ce4ee-6fd2-4f16-9151-432ffd71637b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:27.882381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ce4ee-6fd2-4f16-9151-432ffd71637b admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:27.882381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ce4ee-6fd2-4f16-9151-432ffd71637b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:27.882581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ce4ee-6fd2-4f16-9151-432ffd71637b admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:27.884073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ce4ee-6fd2-4f16-9151-432ffd71637b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:27.886467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ce4ee-6fd2-4f16-9151-432ffd71637b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:27.973344 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1032/2048] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:27 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:20:27.978176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73145985-5d2b-4f16-91a5-d174c0d8d78f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:27.989945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73145985-5d2b-4f16-91a5-d174c0d8d78f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:28.068988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e2d37-5a31-434b-aba2-0b81de344f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:28.069093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e2d37-5a31-434b-aba2-0b81de344f58 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:28.069435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e2d37-5a31-434b-aba2-0b81de344f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:28.069938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e2d37-5a31-434b-aba2-0b81de344f58 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:28.070825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e2d37-5a31-434b-aba2-0b81de344f58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:28.072830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e2d37-5a31-434b-aba2-0b81de344f58 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:28.192897 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1017/2049] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:27 2022] POST /identity/v3/users => generated 291 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:28.194257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ce4ee-6fd2-4f16-9151-432ffd71637b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:28.204448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ce4ee-6fd2-4f16-9151-432ffd71637b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:28.208972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347c8f7-20d1-4c3e-a6ca-935b7a9e898f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:28.209627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347c8f7-20d1-4c3e-a6ca-935b7a9e898f admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:28.214219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347c8f7-20d1-4c3e-a6ca-935b7a9e898f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:28.218700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347c8f7-20d1-4c3e-a6ca-935b7a9e898f admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:28.228894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347c8f7-20d1-4c3e-a6ca-935b7a9e898f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:28.228894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347c8f7-20d1-4c3e-a6ca-935b7a9e898f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:28.242232 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1033/2050] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:28.243470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e2d37-5a31-434b-aba2-0b81de344f58 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:28.256494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e2d37-5a31-434b-aba2-0b81de344f58 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:28.267691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0bfaf-87c7-428d-a5e4-d44ef9f47370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:28.269037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0bfaf-87c7-428d-a5e4-d44ef9f47370 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:28.269489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0bfaf-87c7-428d-a5e4-d44ef9f47370 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:28.269696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0bfaf-87c7-428d-a5e4-d44ef9f47370 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:28.270849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0bfaf-87c7-428d-a5e4-d44ef9f47370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:28.272896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0bfaf-87c7-428d-a5e4-d44ef9f47370 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:28.285543 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1018/2051] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:28.290457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347c8f7-20d1-4c3e-a6ca-935b7a9e898f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:28.303828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347c8f7-20d1-4c3e-a6ca-935b7a9e898f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:28.309611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d37b5-7e98-4905-8dd5-aa7441c9a74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:28.310875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d37b5-7e98-4905-8dd5-aa7441c9a74a admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:28.311312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d37b5-7e98-4905-8dd5-aa7441c9a74a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:28.311997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d37b5-7e98-4905-8dd5-aa7441c9a74a admin admin] PATH_INFO: `/v3/projects/d43c19f69f9c487396c4d8268dd05ef3/users/a55f855d8abf4ca2a66477fcfc6ceeae/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:28.336789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d37b5-7e98-4905-8dd5-aa7441c9a74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d43c19f69f9c487396c4d8268dd05ef3, user_id=a55f855d8abf4ca2a66477fcfc6ceeae, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:28.340071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d37b5-7e98-4905-8dd5-aa7441c9a74a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:28.436882 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1034/2052] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:28 2022] PUT /identity/v3/projects/d43c19f69f9c487396c4d8268dd05ef3/users/a55f855d8abf4ca2a66477fcfc6ceeae/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:28.447370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bcdc0-e264-4572-bed7-a22fe53edb8b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:28.447874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bcdc0-e264-4572-bed7-a22fe53edb8b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:28.447969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bcdc0-e264-4572-bed7-a22fe53edb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:28.477024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4a8bcdc0-e264-4572-bed7-a22fe53edb8b None None] MFA Rules not processed for user `a55f855d8abf4ca2a66477fcfc6ceeae`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:28.478258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4a8bcdc0-e264-4572-bed7-a22fe53edb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:28.548904 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1019/2053] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:28.561154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d37b5-7e98-4905-8dd5-aa7441c9a74a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:28.562965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-704d37b5-7e98-4905-8dd5-aa7441c9a74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:28.652051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d37b5-7e98-4905-8dd5-aa7441c9a74a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:28.656520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c7cf3-9807-41a4-b3d6-5a3036dc4601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:28.658253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c7cf3-9807-41a4-b3d6-5a3036dc4601 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:28.659029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c7cf3-9807-41a4-b3d6-5a3036dc4601 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:28.660259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c7cf3-9807-41a4-b3d6-5a3036dc4601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:28.674171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c7cf3-9807-41a4-b3d6-5a3036dc4601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:28.678952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c7cf3-9807-41a4-b3d6-5a3036dc4601 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:28.692955 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1035/2054] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:28.924109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bcdc0-e264-4572-bed7-a22fe53edb8b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:28.925660 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4a8bcdc0-e264-4572-bed7-a22fe53edb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:29.008699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bcdc0-e264-4572-bed7-a22fe53edb8b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:29.016222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88275cb2-c695-4234-b76c-88a51ee04e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:29.017204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88275cb2-c695-4234-b76c-88a51ee04e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:29.017547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88275cb2-c695-4234-b76c-88a51ee04e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:29.017836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88275cb2-c695-4234-b76c-88a51ee04e78 admin admin] PATH_INFO: `/v3/users/fcd7ddf293ec4abc98776bb35fe89b6e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:29.019184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88275cb2-c695-4234-b76c-88a51ee04e78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcd7ddf293ec4abc98776bb35fe89b6e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:29.021363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88275cb2-c695-4234-b76c-88a51ee04e78 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:29.096555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c7cf3-9807-41a4-b3d6-5a3036dc4601 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:29.113964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c7cf3-9807-41a4-b3d6-5a3036dc4601 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:29.122911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f01ec-d6ea-43a9-b9b7-854bde1f0170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:29.123795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f01ec-d6ea-43a9-b9b7-854bde1f0170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:29.124080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f01ec-d6ea-43a9-b9b7-854bde1f0170 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:29.125032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f01ec-d6ea-43a9-b9b7-854bde1f0170 admin admin] PATH_INFO: `/v3/users/a55f855d8abf4ca2a66477fcfc6ceeae` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:29.125662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f01ec-d6ea-43a9-b9b7-854bde1f0170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a55f855d8abf4ca2a66477fcfc6ceeae)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:29.128095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f01ec-d6ea-43a9-b9b7-854bde1f0170 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:29.311208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-88275cb2-c695-4234-b76c-88a51ee04e78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcd7ddf293ec4abc98776bb35fe89b6e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:29.326304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-88275cb2-c695-4234-b76c-88a51ee04e78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcd7ddf293ec4abc98776bb35fe89b6e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:29.327329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-88275cb2-c695-4234-b76c-88a51ee04e78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcd7ddf293ec4abc98776bb35fe89b6e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:29.336341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9a2f01ec-d6ea-43a9-b9b7-854bde1f0170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a55f855d8abf4ca2a66477fcfc6ceeae'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:29.336928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-88275cb2-c695-4234-b76c-88a51ee04e78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcd7ddf293ec4abc98776bb35fe89b6e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:29.352139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9a2f01ec-d6ea-43a9-b9b7-854bde1f0170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a55f855d8abf4ca2a66477fcfc6ceeae'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:29.353050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9a2f01ec-d6ea-43a9-b9b7-854bde1f0170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a55f855d8abf4ca2a66477fcfc6ceeae'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:29.360855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9a2f01ec-d6ea-43a9-b9b7-854bde1f0170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a55f855d8abf4ca2a66477fcfc6ceeae'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:29.435342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-88275cb2-c695-4234-b76c-88a51ee04e78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcd7ddf293ec4abc98776bb35fe89b6e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:29.444178 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1020/2055] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:28 2022] DELETE /identity/v3/users/fcd7ddf293ec4abc98776bb35fe89b6e => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:29.447600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b964c-b3f6-4cc6-a0f6-ad3cbad8bbca None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:29.448145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b964c-b3f6-4cc6-a0f6-ad3cbad8bbca None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:29.448145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b964c-b3f6-4cc6-a0f6-ad3cbad8bbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:29.466529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-156b964c-b3f6-4cc6-a0f6-ad3cbad8bbca None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:29.467834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-156b964c-b3f6-4cc6-a0f6-ad3cbad8bbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:29.527695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9a2f01ec-d6ea-43a9-b9b7-854bde1f0170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a55f855d8abf4ca2a66477fcfc6ceeae'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:29.537935 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1036/2056] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:29 2022] DELETE /identity/v3/users/a55f855d8abf4ca2a66477fcfc6ceeae => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:29.540514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056fdaf-9604-4342-82b7-ece5dbc5968d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:29.540846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056fdaf-9604-4342-82b7-ece5dbc5968d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:29.541130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056fdaf-9604-4342-82b7-ece5dbc5968d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:29.563751 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1021/2057] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:29.564846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b964c-b3f6-4cc6-a0f6-ad3cbad8bbca None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:29.566724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-156b964c-b3f6-4cc6-a0f6-ad3cbad8bbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:29.587088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-1056fdaf-9604-4342-82b7-ece5dbc5968d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:29.588646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1056fdaf-9604-4342-82b7-ece5dbc5968d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:29.641167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b964c-b3f6-4cc6-a0f6-ad3cbad8bbca None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:29.670219 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1037/2058] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:29.681048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056fdaf-9604-4342-82b7-ece5dbc5968d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:29.714555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e2d90-d4d4-4af0-976f-89ad361bcd52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:29.715516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e2d90-d4d4-4af0-976f-89ad361bcd52 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:29.716025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e2d90-d4d4-4af0-976f-89ad361bcd52 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:29.716466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e2d90-d4d4-4af0-976f-89ad361bcd52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:29.727887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e2d90-d4d4-4af0-976f-89ad361bcd52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:29.729765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e2d90-d4d4-4af0-976f-89ad361bcd52 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:29.740405 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1022/2059] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:29.775023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056fdaf-9604-4342-82b7-ece5dbc5968d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:29.779081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55811db8-eeae-42ac-81ab-729183fef313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:29.779924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55811db8-eeae-42ac-81ab-729183fef313 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:29.780433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55811db8-eeae-42ac-81ab-729183fef313 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:29.780558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55811db8-eeae-42ac-81ab-729183fef313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:29.795179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55811db8-eeae-42ac-81ab-729183fef313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:29.796837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55811db8-eeae-42ac-81ab-729183fef313 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:29.807049 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1038/2060] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:30.534402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e2d90-d4d4-4af0-976f-89ad361bcd52 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:30.537608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bf7e2d90-d4d4-4af0-976f-89ad361bcd52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:30.577360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e2d90-d4d4-4af0-976f-89ad361bcd52 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:30.603963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79165749-cb50-46cf-8544-a8e73193cc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:30.605223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79165749-cb50-46cf-8544-a8e73193cc73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:30.615455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79165749-cb50-46cf-8544-a8e73193cc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:30.615455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79165749-cb50-46cf-8544-a8e73193cc73 admin admin] PATH_INFO: `/v3/projects/51d17ff2e5bd43418d0a955840c066b1` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:30.615455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79165749-cb50-46cf-8544-a8e73193cc73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d17ff2e5bd43418d0a955840c066b1)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:30.615455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79165749-cb50-46cf-8544-a8e73193cc73 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:30.651749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55811db8-eeae-42ac-81ab-729183fef313 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:30.653268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-55811db8-eeae-42ac-81ab-729183fef313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:30.668639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55811db8-eeae-42ac-81ab-729183fef313 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:30.674566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376a121-d6f2-4b59-b015-ba7bfc93f150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:30.675594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376a121-d6f2-4b59-b015-ba7bfc93f150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:30.675980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376a121-d6f2-4b59-b015-ba7bfc93f150 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:30.676354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376a121-d6f2-4b59-b015-ba7bfc93f150 admin admin] PATH_INFO: `/v3/projects/d43c19f69f9c487396c4d8268dd05ef3` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:30.678109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376a121-d6f2-4b59-b015-ba7bfc93f150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d43c19f69f9c487396c4d8268dd05ef3)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:30.680855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376a121-d6f2-4b59-b015-ba7bfc93f150 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:30.744499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-79165749-cb50-46cf-8544-a8e73193cc73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d17ff2e5bd43418d0a955840c066b1', 'request_id': 'req-79165749-cb50-46cf-8544-a8e73193cc73'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:30.801242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f376a121-d6f2-4b59-b015-ba7bfc93f150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd43c19f69f9c487396c4d8268dd05ef3', 'request_id': 'req-f376a121-d6f2-4b59-b015-ba7bfc93f150'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:30.808940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f376a121-d6f2-4b59-b015-ba7bfc93f150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd43c19f69f9c487396c4d8268dd05ef3', 'request_id': 'req-f376a121-d6f2-4b59-b015-ba7bfc93f150'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:30.822349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-79165749-cb50-46cf-8544-a8e73193cc73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d17ff2e5bd43418d0a955840c066b1', 'request_id': 'req-79165749-cb50-46cf-8544-a8e73193cc73'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:30.834754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-79165749-cb50-46cf-8544-a8e73193cc73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d17ff2e5bd43418d0a955840c066b1', 'request_id': 'req-79165749-cb50-46cf-8544-a8e73193cc73'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:30.859929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-79165749-cb50-46cf-8544-a8e73193cc73 admin admin] The token cache is being invalidate because project 51d17ff2e5bd43418d0a955840c066b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:30.860372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-79165749-cb50-46cf-8544-a8e73193cc73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:30.861073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-79165749-cb50-46cf-8544-a8e73193cc73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:30.863481 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1023/2061] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:30 2022] DELETE /identity/v3/projects/51d17ff2e5bd43418d0a955840c066b1 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:30.867832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79165749-cb50-46cf-8544-a8e73193cc73 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:30.869858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-79165749-cb50-46cf-8544-a8e73193cc73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:30.889175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f376a121-d6f2-4b59-b015-ba7bfc93f150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd43c19f69f9c487396c4d8268dd05ef3', 'request_id': 'req-f376a121-d6f2-4b59-b015-ba7bfc93f150'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:30.935060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f376a121-d6f2-4b59-b015-ba7bfc93f150 admin admin] The token cache is being invalidate because project d43c19f69f9c487396c4d8268dd05ef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:30.935589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f376a121-d6f2-4b59-b015-ba7bfc93f150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:30.938368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f376a121-d6f2-4b59-b015-ba7bfc93f150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:30.952834 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1039/2062] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:30 2022] DELETE /identity/v3/projects/d43c19f69f9c487396c4d8268dd05ef3 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:30.955414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9e482-d15b-4a33-b772-3bb51849d6e0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:30.955858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9e482-d15b-4a33-b772-3bb51849d6e0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:30.956307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9e482-d15b-4a33-b772-3bb51849d6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:30.985082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-44c9e482-d15b-4a33-b772-3bb51849d6e0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:30.987374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-44c9e482-d15b-4a33-b772-3bb51849d6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:30.995324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79165749-cb50-46cf-8544-a8e73193cc73 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:31.108512 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1040/2063] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:31.117705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9e482-d15b-4a33-b772-3bb51849d6e0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:31.117705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-44c9e482-d15b-4a33-b772-3bb51849d6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:31.119887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2da1a-f8dc-482e-8812-a610aedd7412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:31.120963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2da1a-f8dc-482e-8812-a610aedd7412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:31.121563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2da1a-f8dc-482e-8812-a610aedd7412 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:31.121838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2da1a-f8dc-482e-8812-a610aedd7412 admin admin] PATH_INFO: `/v3/users/7ca9fe96a88c49cb81441b598504ec5c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:31.123718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2da1a-f8dc-482e-8812-a610aedd7412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ca9fe96a88c49cb81441b598504ec5c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:31.126946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2da1a-f8dc-482e-8812-a610aedd7412 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:31.233184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9e482-d15b-4a33-b772-3bb51849d6e0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:31.240363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30849e94-abdc-43df-8c82-38911efd0140 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:31.241245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30849e94-abdc-43df-8c82-38911efd0140 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:31.241475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30849e94-abdc-43df-8c82-38911efd0140 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:31.241843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30849e94-abdc-43df-8c82-38911efd0140 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:31.243666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-30849e94-abdc-43df-8c82-38911efd0140 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:31.307389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30849e94-abdc-43df-8c82-38911efd0140 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:31.309173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30849e94-abdc-43df-8c82-38911efd0140 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:31.318924 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1041/2064] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:31.325639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cddf6-a260-431a-a9d5-925772983136 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:31.325639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cddf6-a260-431a-a9d5-925772983136 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:31.325639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cddf6-a260-431a-a9d5-925772983136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:31.343908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-1b9cddf6-a260-431a-a9d5-925772983136 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:31.344636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1b9cddf6-a260-431a-a9d5-925772983136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:31.353760 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1042/2065] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:31.358167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9cddf6-a260-431a-a9d5-925772983136 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:31.369224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9cddf6-a260-431a-a9d5-925772983136 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:31.373648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1ca2da1a-f8dc-482e-8812-a610aedd7412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ca9fe96a88c49cb81441b598504ec5c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:31.374625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695e590-0361-4e82-86be-85bcb1d2b9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:31.375330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695e590-0361-4e82-86be-85bcb1d2b9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:31.375785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695e590-0361-4e82-86be-85bcb1d2b9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:31.376074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695e590-0361-4e82-86be-85bcb1d2b9e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:31.376844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695e590-0361-4e82-86be-85bcb1d2b9e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:31.377228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695e590-0361-4e82-86be-85bcb1d2b9e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:31.378911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695e590-0361-4e82-86be-85bcb1d2b9e6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:31.391819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1ca2da1a-f8dc-482e-8812-a610aedd7412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ca9fe96a88c49cb81441b598504ec5c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:31.392545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1ca2da1a-f8dc-482e-8812-a610aedd7412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ca9fe96a88c49cb81441b598504ec5c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:31.394866 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1043/2066] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:20:31.399885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695e590-0361-4e82-86be-85bcb1d2b9e6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:31.404558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1ca2da1a-f8dc-482e-8812-a610aedd7412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ca9fe96a88c49cb81441b598504ec5c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:31.411740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695e590-0361-4e82-86be-85bcb1d2b9e6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:31.420401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174bd88-89d0-4260-94de-651ab08843f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:31.421367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174bd88-89d0-4260-94de-651ab08843f9 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:31.422004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174bd88-89d0-4260-94de-651ab08843f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:31.422495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174bd88-89d0-4260-94de-651ab08843f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:31.425257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174bd88-89d0-4260-94de-651ab08843f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:31.427415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174bd88-89d0-4260-94de-651ab08843f9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:31.499523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1ca2da1a-f8dc-482e-8812-a610aedd7412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ca9fe96a88c49cb81441b598504ec5c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:31.506728 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1024/2067] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:30 2022] DELETE /identity/v3/users/7ca9fe96a88c49cb81441b598504ec5c => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:31.561247 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1044/2068] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:31 2022] POST /identity/v3/projects => generated 403 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:31.569453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2da1a-f8dc-482e-8812-a610aedd7412 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:31.571584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1ca2da1a-f8dc-482e-8812-a610aedd7412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:31.655352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2da1a-f8dc-482e-8812-a610aedd7412 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:31.715796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a842e-633c-426e-9807-e84eeaa7003c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:31.716503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a842e-633c-426e-9807-e84eeaa7003c admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:31.716816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a842e-633c-426e-9807-e84eeaa7003c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:31.717096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a842e-633c-426e-9807-e84eeaa7003c admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:31.717792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a842e-633c-426e-9807-e84eeaa7003c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:31.719709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a842e-633c-426e-9807-e84eeaa7003c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:31.850247 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1025/2069] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:31 2022] POST /identity/v3/users => generated 302 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:20:31.851168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174bd88-89d0-4260-94de-651ab08843f9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:31.863024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174bd88-89d0-4260-94de-651ab08843f9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:31.869000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13e7df-869b-4289-a9fa-aa6435b488d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:31.869275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13e7df-869b-4289-a9fa-aa6435b488d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:31.869722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13e7df-869b-4289-a9fa-aa6435b488d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:31.870156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13e7df-869b-4289-a9fa-aa6435b488d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:31.870897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13e7df-869b-4289-a9fa-aa6435b488d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:31.872803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13e7df-869b-4289-a9fa-aa6435b488d0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:31.885452 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1045/2070] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:20:31.896259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a842e-633c-426e-9807-e84eeaa7003c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:31.907741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a842e-633c-426e-9807-e84eeaa7003c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:31.913282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e594d-2173-4550-8293-fbd43da09762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:31.913980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e594d-2173-4550-8293-fbd43da09762 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:31.914266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e594d-2173-4550-8293-fbd43da09762 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:31.914547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e594d-2173-4550-8293-fbd43da09762 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:31.915284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e594d-2173-4550-8293-fbd43da09762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:31.921584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e594d-2173-4550-8293-fbd43da09762 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:31.941525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13e7df-869b-4289-a9fa-aa6435b488d0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:31.942892 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1026/2071] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:20:31.952702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13e7df-869b-4289-a9fa-aa6435b488d0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:31.959089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5d4b2-5a4f-415f-a3f3-605d95f5ca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:31.961629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5d4b2-5a4f-415f-a3f3-605d95f5ca66 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:31.962078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5d4b2-5a4f-415f-a3f3-605d95f5ca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:31.962573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5d4b2-5a4f-415f-a3f3-605d95f5ca66 admin admin] PATH_INFO: `/v3/projects/405bc3f0d1b64dc8911be1fbc0449018/users/0360b7261526403786bc77b8945c815b/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:31.983642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5d4b2-5a4f-415f-a3f3-605d95f5ca66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=405bc3f0d1b64dc8911be1fbc0449018, user_id=0360b7261526403786bc77b8945c815b, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:31.986507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5d4b2-5a4f-415f-a3f3-605d95f5ca66 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:32.076006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1137a-4c1d-4b6e-a610-a581d750cfef None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:32.076787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1137a-4c1d-4b6e-a610-a581d750cfef None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:32.076979 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1046/2072] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:31 2022] PUT /identity/v3/projects/405bc3f0d1b64dc8911be1fbc0449018/users/0360b7261526403786bc77b8945c815b/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:32.077508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1137a-4c1d-4b6e-a610-a581d750cfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:32.106168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-70c1137a-4c1d-4b6e-a610-a581d750cfef None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:32.107508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-70c1137a-4c1d-4b6e-a610-a581d750cfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:32.220922 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1027/2073] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:32.232929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5d4b2-5a4f-415f-a3f3-605d95f5ca66 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:32.234668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1dd5d4b2-5a4f-415f-a3f3-605d95f5ca66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:32.301996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1137a-4c1d-4b6e-a610-a581d750cfef None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:32.305061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-70c1137a-4c1d-4b6e-a610-a581d750cfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:32.341178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5d4b2-5a4f-415f-a3f3-605d95f5ca66 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:32.345059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1137a-4c1d-4b6e-a610-a581d750cfef None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:32.353003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bc523-6f75-46b2-81a1-fb3ffb98f9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:32.353892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bc523-6f75-46b2-81a1-fb3ffb98f9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:32.354256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bc523-6f75-46b2-81a1-fb3ffb98f9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:32.354369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e07eb-0856-462d-a143-5a8a7a2c2cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:32.354700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bc523-6f75-46b2-81a1-fb3ffb98f9e2 admin admin] PATH_INFO: `/v3/projects/8c61ff3e07774a8d84ef24681c612f1b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:32.355599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e07eb-0856-462d-a143-5a8a7a2c2cba service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:32.356039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e07eb-0856-462d-a143-5a8a7a2c2cba service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:32.356148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bc523-6f75-46b2-81a1-fb3ffb98f9e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c61ff3e07774a8d84ef24681c612f1b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:32.357544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e07eb-0856-462d-a143-5a8a7a2c2cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:32.358463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bc523-6f75-46b2-81a1-fb3ffb98f9e2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:32.379205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e07eb-0856-462d-a143-5a8a7a2c2cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:32.380756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e07eb-0856-462d-a143-5a8a7a2c2cba service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:32.398579 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1047/2074] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:32.511999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f03bc523-6f75-46b2-81a1-fb3ffb98f9e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c61ff3e07774a8d84ef24681c612f1b', 'request_id': 'req-f03bc523-6f75-46b2-81a1-fb3ffb98f9e2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:32.608249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f03bc523-6f75-46b2-81a1-fb3ffb98f9e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c61ff3e07774a8d84ef24681c612f1b', 'request_id': 'req-f03bc523-6f75-46b2-81a1-fb3ffb98f9e2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:32.617842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f03bc523-6f75-46b2-81a1-fb3ffb98f9e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c61ff3e07774a8d84ef24681c612f1b', 'request_id': 'req-f03bc523-6f75-46b2-81a1-fb3ffb98f9e2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:32.635109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f03bc523-6f75-46b2-81a1-fb3ffb98f9e2 admin admin] The token cache is being invalidate because project 8c61ff3e07774a8d84ef24681c612f1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:32.635645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f03bc523-6f75-46b2-81a1-fb3ffb98f9e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:32.640057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f03bc523-6f75-46b2-81a1-fb3ffb98f9e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:32.641737 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1028/2075] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:32 2022] DELETE /identity/v3/projects/8c61ff3e07774a8d84ef24681c612f1b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:32.644014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbf01c-582d-4da6-bef8-8aea3c4aba31 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:32.644471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbf01c-582d-4da6-bef8-8aea3c4aba31 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:32.645059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbf01c-582d-4da6-bef8-8aea3c4aba31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:32.665544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-72bbf01c-582d-4da6-bef8-8aea3c4aba31 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:32.666768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-72bbf01c-582d-4da6-bef8-8aea3c4aba31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:32.782076 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1048/2076] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:20:32.791004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f98d75-246a-4294-bd48-3ba66a475af8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:32.791341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f98d75-246a-4294-bd48-3ba66a475af8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:32.791632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f98d75-246a-4294-bd48-3ba66a475af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:32.815382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e6f98d75-246a-4294-bd48-3ba66a475af8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:32.816971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e6f98d75-246a-4294-bd48-3ba66a475af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:32.825908 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1029/2077] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:32.830141 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbf01c-582d-4da6-bef8-8aea3c4aba31 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:32.841178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbf01c-582d-4da6-bef8-8aea3c4aba31 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:32.846616 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbb240-ac27-452e-ac2e-cc92755c71ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:32.849278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbb240-ac27-452e-ac2e-cc92755c71ef admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:32.849278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbb240-ac27-452e-ac2e-cc92755c71ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:32.849278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbb240-ac27-452e-ac2e-cc92755c71ef admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:32.849278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbb240-ac27-452e-ac2e-cc92755c71ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:32.849278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbb240-ac27-452e-ac2e-cc92755c71ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:32.850922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbb240-ac27-452e-ac2e-cc92755c71ef admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:32.863850 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1049/2078] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:32.868453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f98d75-246a-4294-bd48-3ba66a475af8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:32.879508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f98d75-246a-4294-bd48-3ba66a475af8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:32.889856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ef6fe-2e04-4942-9436-8adfe2a8a4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:32.889856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ef6fe-2e04-4942-9436-8adfe2a8a4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:32.889856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ef6fe-2e04-4942-9436-8adfe2a8a4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:32.889856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ef6fe-2e04-4942-9436-8adfe2a8a4c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:32.890174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ef6fe-2e04-4942-9436-8adfe2a8a4c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:32.890829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ef6fe-2e04-4942-9436-8adfe2a8a4c1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:33.002821 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1030/2079] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:32 2022] POST /identity/v3/projects => generated 411 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:33.003804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbb240-ac27-452e-ac2e-cc92755c71ef admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:33.019658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbb240-ac27-452e-ac2e-cc92755c71ef admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:33.089104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548893d9-843d-48d7-8118-b619e274462d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:33.090087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548893d9-843d-48d7-8118-b619e274462d admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:33.090486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548893d9-843d-48d7-8118-b619e274462d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:33.090983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548893d9-843d-48d7-8118-b619e274462d admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:33.091761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548893d9-843d-48d7-8118-b619e274462d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:33.093986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548893d9-843d-48d7-8118-b619e274462d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:33.204874 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1050/2080] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:33 2022] POST /identity/v3/users => generated 306 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:33.208560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ef6fe-2e04-4942-9436-8adfe2a8a4c1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:33.219321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ef6fe-2e04-4942-9436-8adfe2a8a4c1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:33.223810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e1533-4732-4272-9119-a17f6e1b36f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:33.224471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e1533-4732-4272-9119-a17f6e1b36f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:33.224800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e1533-4732-4272-9119-a17f6e1b36f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:33.225081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e1533-4732-4272-9119-a17f6e1b36f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:33.225804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e1533-4732-4272-9119-a17f6e1b36f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:33.227469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e1533-4732-4272-9119-a17f6e1b36f4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:33.240848 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1031/2081] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:33.242776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548893d9-843d-48d7-8118-b619e274462d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:33.252903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548893d9-843d-48d7-8118-b619e274462d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:33.258269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa3011-bbcb-4a34-a413-06baf9c6a627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:33.258939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa3011-bbcb-4a34-a413-06baf9c6a627 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:33.259224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa3011-bbcb-4a34-a413-06baf9c6a627 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:33.259499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa3011-bbcb-4a34-a413-06baf9c6a627 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:33.260222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa3011-bbcb-4a34-a413-06baf9c6a627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:33.261876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa3011-bbcb-4a34-a413-06baf9c6a627 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:33.292202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e1533-4732-4272-9119-a17f6e1b36f4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:33.293676 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1051/2082] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:33.307858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e1533-4732-4272-9119-a17f6e1b36f4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:33.313212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9399b61-98b5-43e5-b6f7-6ac6c6577f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:33.314305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9399b61-98b5-43e5-b6f7-6ac6c6577f34 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:33.316083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9399b61-98b5-43e5-b6f7-6ac6c6577f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:33.317074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9399b61-98b5-43e5-b6f7-6ac6c6577f34 admin admin] PATH_INFO: `/v3/projects/76e6b157004346959dee707f36ed93b1/users/2e14fc1bf2fe412c831699f0eec2db5d/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:33.337862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9399b61-98b5-43e5-b6f7-6ac6c6577f34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e6b157004346959dee707f36ed93b1, user_id=2e14fc1bf2fe412c831699f0eec2db5d, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:33.340457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9399b61-98b5-43e5-b6f7-6ac6c6577f34 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:33.408710 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1032/2083] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:33 2022] PUT /identity/v3/projects/76e6b157004346959dee707f36ed93b1/users/2e14fc1bf2fe412c831699f0eec2db5d/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:33.419709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51be8ef-38e2-40a4-9291-21dd158f8141 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:33.420098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51be8ef-38e2-40a4-9291-21dd158f8141 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:33.420471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51be8ef-38e2-40a4-9291-21dd158f8141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:33.454304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c51be8ef-38e2-40a4-9291-21dd158f8141 None None] MFA Rules not processed for user `2e14fc1bf2fe412c831699f0eec2db5d`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:33.455801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c51be8ef-38e2-40a4-9291-21dd158f8141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:33.535665 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1052/2084] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:33 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:33.539856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9399b61-98b5-43e5-b6f7-6ac6c6577f34 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:33.617714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9399b61-98b5-43e5-b6f7-6ac6c6577f34 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:33.622885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35df09f-d67d-4b28-8bfb-a4a1e1af8fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:33.623581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35df09f-d67d-4b28-8bfb-a4a1e1af8fde admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:33.624065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35df09f-d67d-4b28-8bfb-a4a1e1af8fde admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:33.624343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35df09f-d67d-4b28-8bfb-a4a1e1af8fde admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:33.625168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35df09f-d67d-4b28-8bfb-a4a1e1af8fde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:33.627101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35df09f-d67d-4b28-8bfb-a4a1e1af8fde admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:33.759476 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1033/2085] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:33 2022] POST /identity/v3/projects => generated 411 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:33.765894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51be8ef-38e2-40a4-9291-21dd158f8141 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:33.774594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51be8ef-38e2-40a4-9291-21dd158f8141 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:33.862868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d15f0-85e6-4681-a2ef-749302720ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:33.863889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d15f0-85e6-4681-a2ef-749302720ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:33.864921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d15f0-85e6-4681-a2ef-749302720ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:33.865201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d15f0-85e6-4681-a2ef-749302720ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:33.865890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d15f0-85e6-4681-a2ef-749302720ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:33.868914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d15f0-85e6-4681-a2ef-749302720ae3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:34.008996 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1053/2086] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:33 2022] POST /identity/v3/users => generated 312 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:34.013017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35df09f-d67d-4b28-8bfb-a4a1e1af8fde admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:34.026537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35df09f-d67d-4b28-8bfb-a4a1e1af8fde admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:34.034181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63d787-103b-4223-91e4-482f57e17c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:34.044326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63d787-103b-4223-91e4-482f57e17c6e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:34.044889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63d787-103b-4223-91e4-482f57e17c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:34.045367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63d787-103b-4223-91e4-482f57e17c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:34.046317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63d787-103b-4223-91e4-482f57e17c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:34.048310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63d787-103b-4223-91e4-482f57e17c6e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:34.065296 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1034/2087] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:34.069443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d15f0-85e6-4681-a2ef-749302720ae3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:34.084671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d15f0-85e6-4681-a2ef-749302720ae3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:34.094668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ac021-f7da-4909-ab18-0bfa9fc3cf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:34.095571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ac021-f7da-4909-ab18-0bfa9fc3cf41 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:34.096001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ac021-f7da-4909-ab18-0bfa9fc3cf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:34.096422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ac021-f7da-4909-ab18-0bfa9fc3cf41 admin admin] PATH_INFO: `/v3/projects/32beef58339e48e4b1b2cdc76d54dc1a/users/50fbefb143eb44b688c206add15d94f2/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:34.116471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ac021-f7da-4909-ab18-0bfa9fc3cf41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32beef58339e48e4b1b2cdc76d54dc1a, user_id=50fbefb143eb44b688c206add15d94f2, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:34.120015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ac021-f7da-4909-ab18-0bfa9fc3cf41 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:34.180100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63d787-103b-4223-91e4-482f57e17c6e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:34.182761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fa63d787-103b-4223-91e4-482f57e17c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:34.202100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63d787-103b-4223-91e4-482f57e17c6e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:34.207097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e4cff-bd92-40ca-8948-fc504abcecbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:34.207976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e4cff-bd92-40ca-8948-fc504abcecbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:34.208317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e4cff-bd92-40ca-8948-fc504abcecbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:34.208526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e4cff-bd92-40ca-8948-fc504abcecbe admin admin] PATH_INFO: `/v3/users/c7b9d57ee23a44a5a31872054878359d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:34.212381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e4cff-bd92-40ca-8948-fc504abcecbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7b9d57ee23a44a5a31872054878359d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:34.212381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e4cff-bd92-40ca-8948-fc504abcecbe admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:34.239714 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1054/2088] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:34 2022] PUT /identity/v3/projects/32beef58339e48e4b1b2cdc76d54dc1a/users/50fbefb143eb44b688c206add15d94f2/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:20:34.240747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ac021-f7da-4909-ab18-0bfa9fc3cf41 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:34.356875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ac021-f7da-4909-ab18-0bfa9fc3cf41 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:34.377241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3f6d0-755d-4fa7-bc7b-c978a29b1153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:34.378407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3f6d0-755d-4fa7-bc7b-c978a29b1153 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:34.378713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3f6d0-755d-4fa7-bc7b-c978a29b1153 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:34.378997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3f6d0-755d-4fa7-bc7b-c978a29b1153 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:34.379775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3f6d0-755d-4fa7-bc7b-c978a29b1153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:34.384829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3f6d0-755d-4fa7-bc7b-c978a29b1153 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:34.403851 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1055/2089] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:34.405062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3f6d0-755d-4fa7-bc7b-c978a29b1153 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:34.407095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c8b3f6d0-755d-4fa7-bc7b-c978a29b1153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:34.427053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3f6d0-755d-4fa7-bc7b-c978a29b1153 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:34.436901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052aa23-7ba4-4a30-b8cb-a19bb6157ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:34.437791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052aa23-7ba4-4a30-b8cb-a19bb6157ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:34.438071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052aa23-7ba4-4a30-b8cb-a19bb6157ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:34.438346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052aa23-7ba4-4a30-b8cb-a19bb6157ad1 admin admin] PATH_INFO: `/v3/users/c3cdce63521c4407b7575c924737c5fc` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:34.440030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052aa23-7ba4-4a30-b8cb-a19bb6157ad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3cdce63521c4407b7575c924737c5fc)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:34.441666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052aa23-7ba4-4a30-b8cb-a19bb6157ad1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:34.479181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6c1e4cff-bd92-40ca-8948-fc504abcecbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7b9d57ee23a44a5a31872054878359d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:34.522540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6c1e4cff-bd92-40ca-8948-fc504abcecbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7b9d57ee23a44a5a31872054878359d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:34.524731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6c1e4cff-bd92-40ca-8948-fc504abcecbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7b9d57ee23a44a5a31872054878359d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:34.541561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6c1e4cff-bd92-40ca-8948-fc504abcecbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7b9d57ee23a44a5a31872054878359d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:34.729272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6c1e4cff-bd92-40ca-8948-fc504abcecbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7b9d57ee23a44a5a31872054878359d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:34.740918 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1035/2090] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:34 2022] DELETE /identity/v3/users/c7b9d57ee23a44a5a31872054878359d => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:34.755568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e4cff-bd92-40ca-8948-fc504abcecbe admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:34.755568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6c1e4cff-bd92-40ca-8948-fc504abcecbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:34.836545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e4cff-bd92-40ca-8948-fc504abcecbe admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:34.842575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1265ee-fd64-4d09-89da-01425def6ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:34.843619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1265ee-fd64-4d09-89da-01425def6ede admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:34.844326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1265ee-fd64-4d09-89da-01425def6ede admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:34.844874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1265ee-fd64-4d09-89da-01425def6ede admin admin] PATH_INFO: `/v3/projects/32beef58339e48e4b1b2cdc76d54dc1a/users/50fbefb143eb44b688c206add15d94f2/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:34.847269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1265ee-fd64-4d09-89da-01425def6ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=32beef58339e48e4b1b2cdc76d54dc1a, user_id=50fbefb143eb44b688c206add15d94f2, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:34.850172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1265ee-fd64-4d09-89da-01425def6ede admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:34.872928 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1036/2091] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:34 2022] PUT /identity/v3/projects/32beef58339e48e4b1b2cdc76d54dc1a/users/50fbefb143eb44b688c206add15d94f2/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:34.874925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a76207-a0b0-46e8-9c12-b6b4ec19a5a0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:34.875538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a76207-a0b0-46e8-9c12-b6b4ec19a5a0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:34.876035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a76207-a0b0-46e8-9c12-b6b4ec19a5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:34.899380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-33a76207-a0b0-46e8-9c12-b6b4ec19a5a0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:34.901066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-33a76207-a0b0-46e8-9c12-b6b4ec19a5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:35.008548 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1037/2092] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:35.008548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a4187-418b-41fa-bba1-fd27bbd42f23 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:35.008548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a4187-418b-41fa-bba1-fd27bbd42f23 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:35.008548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a4187-418b-41fa-bba1-fd27bbd42f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:35.045470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c72a4187-418b-41fa-bba1-fd27bbd42f23 None None] MFA Rules not processed for user `50fbefb143eb44b688c206add15d94f2`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:35.048389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c72a4187-418b-41fa-bba1-fd27bbd42f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:35.151132 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1038/2093] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:35 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:35.153690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a4187-418b-41fa-bba1-fd27bbd42f23 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:35.155019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c72a4187-418b-41fa-bba1-fd27bbd42f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:35.188825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9052aa23-7ba4-4a30-b8cb-a19bb6157ad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3cdce63521c4407b7575c924737c5fc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:35.208119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9052aa23-7ba4-4a30-b8cb-a19bb6157ad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3cdce63521c4407b7575c924737c5fc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:35.209989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9052aa23-7ba4-4a30-b8cb-a19bb6157ad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3cdce63521c4407b7575c924737c5fc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:35.219359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9052aa23-7ba4-4a30-b8cb-a19bb6157ad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3cdce63521c4407b7575c924737c5fc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:35.258474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a4187-418b-41fa-bba1-fd27bbd42f23 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:35.262637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8faf5e-edaf-4bdb-8562-6e3d52556595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:35.263213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8faf5e-edaf-4bdb-8562-6e3d52556595 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:35.263499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8faf5e-edaf-4bdb-8562-6e3d52556595 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:35.263773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8faf5e-edaf-4bdb-8562-6e3d52556595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:35.273387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8faf5e-edaf-4bdb-8562-6e3d52556595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:35.274940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8faf5e-edaf-4bdb-8562-6e3d52556595 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:35.284897 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1039/2094] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:35.286152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316ea99-48c2-4ed7-85c6-1508ecb01201 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:35.286446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316ea99-48c2-4ed7-85c6-1508ecb01201 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:35.286720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316ea99-48c2-4ed7-85c6-1508ecb01201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:35.310708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4316ea99-48c2-4ed7-85c6-1508ecb01201 None None] MFA Rules not processed for user `662c15e746b84fdbb497d700c9288931`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:35.312409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4316ea99-48c2-4ed7-85c6-1508ecb01201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:35.322731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9052aa23-7ba4-4a30-b8cb-a19bb6157ad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3cdce63521c4407b7575c924737c5fc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:35.336246 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1056/2095] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:34 2022] DELETE /identity/v3/users/c3cdce63521c4407b7575c924737c5fc => generated 0 bytes in 928 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:35.338165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052aa23-7ba4-4a30-b8cb-a19bb6157ad1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:35.340235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9052aa23-7ba4-4a30-b8cb-a19bb6157ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:35.452009 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1040/2096] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:35.453604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e840723-f29d-418d-b09e-0d1137919a14 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:35.453898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e840723-f29d-418d-b09e-0d1137919a14 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:35.454179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e840723-f29d-418d-b09e-0d1137919a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:35.485821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052aa23-7ba4-4a30-b8cb-a19bb6157ad1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:35.495004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9e840723-f29d-418d-b09e-0d1137919a14 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:35.495806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa793f73-a647-44af-8d63-46177ee6042a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:35.497015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa793f73-a647-44af-8d63-46177ee6042a service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:35.497755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa793f73-a647-44af-8d63-46177ee6042a service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:35.498047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9e840723-f29d-418d-b09e-0d1137919a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:35.498367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa793f73-a647-44af-8d63-46177ee6042a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:35.501048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-aa793f73-a647-44af-8d63-46177ee6042a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:35.618513 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1041/2097] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:35.631043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e840723-f29d-418d-b09e-0d1137919a14 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:35.633035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9e840723-f29d-418d-b09e-0d1137919a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:35.648000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa793f73-a647-44af-8d63-46177ee6042a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:35.650833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa793f73-a647-44af-8d63-46177ee6042a service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:35.670451 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1057/2098] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:35 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:35.705050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa793f73-a647-44af-8d63-46177ee6042a service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:35.705050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-aa793f73-a647-44af-8d63-46177ee6042a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:35.731096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa793f73-a647-44af-8d63-46177ee6042a service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:35.735589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e840723-f29d-418d-b09e-0d1137919a14 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:35.737178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c35845-7d03-4177-b041-edde10b38ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:35.738661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c35845-7d03-4177-b041-edde10b38ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:35.738956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c35845-7d03-4177-b041-edde10b38ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:35.739682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c35845-7d03-4177-b041-edde10b38ed6 admin admin] PATH_INFO: `/v3/projects/3a44fa48ca094b72b836647f85322ba8` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:35.741296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c35845-7d03-4177-b041-edde10b38ed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a44fa48ca094b72b836647f85322ba8)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:35.746680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630304e-6a3e-4855-8575-2048c24a5f86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:35.748061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630304e-6a3e-4855-8575-2048c24a5f86 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:35.749402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630304e-6a3e-4855-8575-2048c24a5f86 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:35.749827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630304e-6a3e-4855-8575-2048c24a5f86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:35.756667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c35845-7d03-4177-b041-edde10b38ed6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:35.781194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630304e-6a3e-4855-8575-2048c24a5f86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:35.786838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630304e-6a3e-4855-8575-2048c24a5f86 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:35.813713 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1042/2099] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:20:35.931144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a0c35845-7d03-4177-b041-edde10b38ed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a44fa48ca094b72b836647f85322ba8', 'request_id': 'req-a0c35845-7d03-4177-b041-edde10b38ed6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:35.939108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a0c35845-7d03-4177-b041-edde10b38ed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a44fa48ca094b72b836647f85322ba8', 'request_id': 'req-a0c35845-7d03-4177-b041-edde10b38ed6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:36.008562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a0c35845-7d03-4177-b041-edde10b38ed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a44fa48ca094b72b836647f85322ba8', 'request_id': 'req-a0c35845-7d03-4177-b041-edde10b38ed6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:36.027861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a0c35845-7d03-4177-b041-edde10b38ed6 admin admin] The token cache is being invalidate because project 3a44fa48ca094b72b836647f85322ba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:36.028851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a0c35845-7d03-4177-b041-edde10b38ed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:36.030973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a0c35845-7d03-4177-b041-edde10b38ed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:36.039463 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1058/2100] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:35 2022] DELETE /identity/v3/projects/3a44fa48ca094b72b836647f85322ba8 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:36.040095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630304e-6a3e-4855-8575-2048c24a5f86 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:36.067614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630304e-6a3e-4855-8575-2048c24a5f86 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:36.159429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262ca7c-340b-407a-8274-eda3311bdbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:36.160318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262ca7c-340b-407a-8274-eda3311bdbe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:36.161021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262ca7c-340b-407a-8274-eda3311bdbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:36.161021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262ca7c-340b-407a-8274-eda3311bdbe5 admin admin] PATH_INFO: `/v3/users/cafc4b3633c845b0a37b456095b690e6` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:36.166457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262ca7c-340b-407a-8274-eda3311bdbe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cafc4b3633c845b0a37b456095b690e6)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:36.166457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262ca7c-340b-407a-8274-eda3311bdbe5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:36.243933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c35845-7d03-4177-b041-edde10b38ed6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:36.246119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a0c35845-7d03-4177-b041-edde10b38ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:36.268793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c35845-7d03-4177-b041-edde10b38ed6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:36.275733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f0e91-5d76-4251-beed-8786e0faa325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:36.275980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0e91-5d76-4251-beed-8786e0faa325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:36.276263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0e91-5d76-4251-beed-8786e0faa325 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:36.276569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0e91-5d76-4251-beed-8786e0faa325 admin admin] PATH_INFO: `/v3/projects/83b0196b9f684b1da4d70d97b20e37f1` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:36.278468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f0e91-5d76-4251-beed-8786e0faa325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83b0196b9f684b1da4d70d97b20e37f1)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:36.280578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f0e91-5d76-4251-beed-8786e0faa325 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:36.419030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d262ca7c-340b-407a-8274-eda3311bdbe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cafc4b3633c845b0a37b456095b690e6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:36.437635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d262ca7c-340b-407a-8274-eda3311bdbe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cafc4b3633c845b0a37b456095b690e6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:36.438416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d262ca7c-340b-407a-8274-eda3311bdbe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cafc4b3633c845b0a37b456095b690e6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:36.448455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d262ca7c-340b-407a-8274-eda3311bdbe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cafc4b3633c845b0a37b456095b690e6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:36.479256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2d1f0e91-5d76-4251-beed-8786e0faa325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83b0196b9f684b1da4d70d97b20e37f1', 'request_id': 'req-2d1f0e91-5d76-4251-beed-8786e0faa325'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:36.498880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2d1f0e91-5d76-4251-beed-8786e0faa325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83b0196b9f684b1da4d70d97b20e37f1', 'request_id': 'req-2d1f0e91-5d76-4251-beed-8786e0faa325'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:36.531661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d262ca7c-340b-407a-8274-eda3311bdbe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cafc4b3633c845b0a37b456095b690e6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:36.540435 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1043/2101] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:36 2022] DELETE /identity/v3/users/cafc4b3633c845b0a37b456095b690e6 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:36.685573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262ca7c-340b-407a-8274-eda3311bdbe5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:36.685573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d262ca7c-340b-407a-8274-eda3311bdbe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:36.715198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2d1f0e91-5d76-4251-beed-8786e0faa325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83b0196b9f684b1da4d70d97b20e37f1', 'request_id': 'req-2d1f0e91-5d76-4251-beed-8786e0faa325'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:36.737466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2d1f0e91-5d76-4251-beed-8786e0faa325 admin admin] The token cache is being invalidate because project 83b0196b9f684b1da4d70d97b20e37f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:36.738539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2d1f0e91-5d76-4251-beed-8786e0faa325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:36.740078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2d1f0e91-5d76-4251-beed-8786e0faa325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:36.745796 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1059/2102] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:36 2022] DELETE /identity/v3/projects/83b0196b9f684b1da4d70d97b20e37f1 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:36.748884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f0e91-5d76-4251-beed-8786e0faa325 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:36.752245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2d1f0e91-5d76-4251-beed-8786e0faa325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:36.799695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262ca7c-340b-407a-8274-eda3311bdbe5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:36.816806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba671f-86dd-466c-9bc2-d7548acc9126 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:36.817580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba671f-86dd-466c-9bc2-d7548acc9126 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:36.817874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba671f-86dd-466c-9bc2-d7548acc9126 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:36.818155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba671f-86dd-466c-9bc2-d7548acc9126 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:36.826853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7fba671f-86dd-466c-9bc2-d7548acc9126 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:36.883794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f0e91-5d76-4251-beed-8786e0faa325 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:36.909291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba671f-86dd-466c-9bc2-d7548acc9126 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:36.910901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba671f-86dd-466c-9bc2-d7548acc9126 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:36.922235 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1044/2103] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:36 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:20:36.923095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba671f-86dd-466c-9bc2-d7548acc9126 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:36.924728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7fba671f-86dd-466c-9bc2-d7548acc9126 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:36.970982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14d022-5367-482c-b76c-140292c5e08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:36.970982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14d022-5367-482c-b76c-140292c5e08d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:36.970982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14d022-5367-482c-b76c-140292c5e08d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:36.970982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14d022-5367-482c-b76c-140292c5e08d admin admin] PATH_INFO: `/v3/users/ef9ff664d81042a8a0f807261f3d2984` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:36.971285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14d022-5367-482c-b76c-140292c5e08d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef9ff664d81042a8a0f807261f3d2984)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:36.973753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14d022-5367-482c-b76c-140292c5e08d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:37.024658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba671f-86dd-466c-9bc2-d7548acc9126 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:37.030361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a57182-212a-4d7d-9c48-69a7d974d4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:37.032055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a57182-212a-4d7d-9c48-69a7d974d4a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:37.032542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a57182-212a-4d7d-9c48-69a7d974d4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:37.033089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a57182-212a-4d7d-9c48-69a7d974d4a5 admin admin] PATH_INFO: `/v3/projects/de93440b4d844bab9449f3f4db07ee75` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:37.035082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a57182-212a-4d7d-9c48-69a7d974d4a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de93440b4d844bab9449f3f4db07ee75)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:37.053684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a57182-212a-4d7d-9c48-69a7d974d4a5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:37.235361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-da14d022-5367-482c-b76c-140292c5e08d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef9ff664d81042a8a0f807261f3d2984'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:37.256648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c4a57182-212a-4d7d-9c48-69a7d974d4a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de93440b4d844bab9449f3f4db07ee75', 'request_id': 'req-c4a57182-212a-4d7d-9c48-69a7d974d4a5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:37.266318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-da14d022-5367-482c-b76c-140292c5e08d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef9ff664d81042a8a0f807261f3d2984'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:37.269002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-da14d022-5367-482c-b76c-140292c5e08d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef9ff664d81042a8a0f807261f3d2984'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:37.294730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-da14d022-5367-482c-b76c-140292c5e08d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef9ff664d81042a8a0f807261f3d2984'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:37.392080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c4a57182-212a-4d7d-9c48-69a7d974d4a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de93440b4d844bab9449f3f4db07ee75', 'request_id': 'req-c4a57182-212a-4d7d-9c48-69a7d974d4a5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:37.407964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c4a57182-212a-4d7d-9c48-69a7d974d4a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de93440b4d844bab9449f3f4db07ee75', 'request_id': 'req-c4a57182-212a-4d7d-9c48-69a7d974d4a5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:37.435805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c4a57182-212a-4d7d-9c48-69a7d974d4a5 admin admin] The token cache is being invalidate because project de93440b4d844bab9449f3f4db07ee75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:37.437596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c4a57182-212a-4d7d-9c48-69a7d974d4a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:37.442752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c4a57182-212a-4d7d-9c48-69a7d974d4a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:37.447039 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1045/2104] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:36 2022] DELETE /identity/v3/projects/de93440b4d844bab9449f3f4db07ee75 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:37.452076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a57182-212a-4d7d-9c48-69a7d974d4a5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:37.453702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c4a57182-212a-4d7d-9c48-69a7d974d4a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:37.465172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-da14d022-5367-482c-b76c-140292c5e08d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef9ff664d81042a8a0f807261f3d2984'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:37.481479 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1060/2105] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:36 2022] DELETE /identity/v3/users/ef9ff664d81042a8a0f807261f3d2984 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:37.498292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c86b3-9615-4ad4-b7aa-fb2c9bc5f0a5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:37.498292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c86b3-9615-4ad4-b7aa-fb2c9bc5f0a5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:37.498292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c86b3-9615-4ad4-b7aa-fb2c9bc5f0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:37.527667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-050c86b3-9615-4ad4-b7aa-fb2c9bc5f0a5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:37.529286 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-050c86b3-9615-4ad4-b7aa-fb2c9bc5f0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:37.624348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a57182-212a-4d7d-9c48-69a7d974d4a5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:37.654631 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1061/2106] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:37.665450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e3e42-db3d-4e89-a7f8-60fd47cd92cf None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:37.665991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e3e42-db3d-4e89-a7f8-60fd47cd92cf None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:37.668218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e3e42-db3d-4e89-a7f8-60fd47cd92cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:37.706502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5e0e3e42-db3d-4e89-a7f8-60fd47cd92cf None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:37.714160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5e0e3e42-db3d-4e89-a7f8-60fd47cd92cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:37.726672 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1062/2107] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:37.746980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacf39c-e384-49c0-9f51-a8520caac5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:37.748044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacf39c-e384-49c0-9f51-a8520caac5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:37.748531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacf39c-e384-49c0-9f51-a8520caac5af admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:37.749064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacf39c-e384-49c0-9f51-a8520caac5af admin admin] PATH_INFO: `/v3/users/2e14fc1bf2fe412c831699f0eec2db5d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:37.750719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faacf39c-e384-49c0-9f51-a8520caac5af admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e14fc1bf2fe412c831699f0eec2db5d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:37.753098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faacf39c-e384-49c0-9f51-a8520caac5af admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:37.761953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e3e42-db3d-4e89-a7f8-60fd47cd92cf None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:37.778247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e3e42-db3d-4e89-a7f8-60fd47cd92cf None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:37.787909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ee241-418b-4aec-a0fd-4b89a062af90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:37.789753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ee241-418b-4aec-a0fd-4b89a062af90 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:37.790044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ee241-418b-4aec-a0fd-4b89a062af90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:37.790322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ee241-418b-4aec-a0fd-4b89a062af90 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:37.791089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ee241-418b-4aec-a0fd-4b89a062af90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:37.791402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ee241-418b-4aec-a0fd-4b89a062af90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:37.794829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ee241-418b-4aec-a0fd-4b89a062af90 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:37.825931 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1063/2108] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:20:37.830407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ee241-418b-4aec-a0fd-4b89a062af90 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:37.853084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ee241-418b-4aec-a0fd-4b89a062af90 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:37.861868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86cb1e-cafa-4310-800c-42e12129c29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:37.863414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86cb1e-cafa-4310-800c-42e12129c29b admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:37.863899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86cb1e-cafa-4310-800c-42e12129c29b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:37.864370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86cb1e-cafa-4310-800c-42e12129c29b admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:37.865401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86cb1e-cafa-4310-800c-42e12129c29b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:37.868276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86cb1e-cafa-4310-800c-42e12129c29b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:37.980106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-faacf39c-e384-49c0-9f51-a8520caac5af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e14fc1bf2fe412c831699f0eec2db5d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:38.001190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-faacf39c-e384-49c0-9f51-a8520caac5af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e14fc1bf2fe412c831699f0eec2db5d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:38.005061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-faacf39c-e384-49c0-9f51-a8520caac5af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e14fc1bf2fe412c831699f0eec2db5d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:38.020630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-faacf39c-e384-49c0-9f51-a8520caac5af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e14fc1bf2fe412c831699f0eec2db5d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:38.048284 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1064/2109] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:37 2022] POST /identity/v3/projects => generated 395 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:20:38.052852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86cb1e-cafa-4310-800c-42e12129c29b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:38.125476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-faacf39c-e384-49c0-9f51-a8520caac5af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e14fc1bf2fe412c831699f0eec2db5d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:38.129657 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1046/2110] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:37 2022] DELETE /identity/v3/users/2e14fc1bf2fe412c831699f0eec2db5d => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:38.134905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81833874-c3f8-422b-8e34-e29adb41f64e None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:38.135209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81833874-c3f8-422b-8e34-e29adb41f64e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:38.135484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81833874-c3f8-422b-8e34-e29adb41f64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:38.173393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-81833874-c3f8-422b-8e34-e29adb41f64e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:38.174806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-81833874-c3f8-422b-8e34-e29adb41f64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:38.192226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86cb1e-cafa-4310-800c-42e12129c29b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:38.274169 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1047/2111] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:38.290643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81833874-c3f8-422b-8e34-e29adb41f64e None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:38.296324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-81833874-c3f8-422b-8e34-e29adb41f64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:38.302318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bc2c1-d79e-4396-b0f1-1221de7530d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:38.303055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bc2c1-d79e-4396-b0f1-1221de7530d4 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:38.303940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bc2c1-d79e-4396-b0f1-1221de7530d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:38.304229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bc2c1-d79e-4396-b0f1-1221de7530d4 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:38.305477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bc2c1-d79e-4396-b0f1-1221de7530d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:38.308654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bc2c1-d79e-4396-b0f1-1221de7530d4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:38.368511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81833874-c3f8-422b-8e34-e29adb41f64e None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:38.373581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc5fff-aec4-43af-b630-290b3ba1e910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:38.374318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc5fff-aec4-43af-b630-290b3ba1e910 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:38.374635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc5fff-aec4-43af-b630-290b3ba1e910 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:38.375060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc5fff-aec4-43af-b630-290b3ba1e910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:38.387893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc5fff-aec4-43af-b630-290b3ba1e910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:38.390178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc5fff-aec4-43af-b630-290b3ba1e910 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:38.403276 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1048/2112] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:38.427206 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1065/2113] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:38 2022] POST /identity/v3/users => generated 298 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:20:38.434120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc5fff-aec4-43af-b630-290b3ba1e910 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:38.435648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4fdc5fff-aec4-43af-b630-290b3ba1e910 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:38.450130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc5fff-aec4-43af-b630-290b3ba1e910 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:38.455289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bc2c1-d79e-4396-b0f1-1221de7530d4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:38.455715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde6490-a5b4-4695-a3c8-3ef1e323c32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:38.456716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde6490-a5b4-4695-a3c8-3ef1e323c32d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:38.464167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde6490-a5b4-4695-a3c8-3ef1e323c32d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:38.464167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde6490-a5b4-4695-a3c8-3ef1e323c32d admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:38.464352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bf0bc2c1-d79e-4396-b0f1-1221de7530d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:38.464429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde6490-a5b4-4695-a3c8-3ef1e323c32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:38.464429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde6490-a5b4-4695-a3c8-3ef1e323c32d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:38.472013 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1049/2114] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:20:38.475674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde6490-a5b4-4695-a3c8-3ef1e323c32d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:38.476700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bc2c1-d79e-4396-b0f1-1221de7530d4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:38.488148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426a6ea-3781-4130-a3fc-10af60720289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:38.489582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426a6ea-3781-4130-a3fc-10af60720289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:38.490023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426a6ea-3781-4130-a3fc-10af60720289 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:38.492266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426a6ea-3781-4130-a3fc-10af60720289 admin admin] PATH_INFO: `/v3/projects/59c5107bd5e0494cba2ca57013dacd65` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:38.494080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426a6ea-3781-4130-a3fc-10af60720289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59c5107bd5e0494cba2ca57013dacd65)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:38.499940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde6490-a5b4-4695-a3c8-3ef1e323c32d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:38.507647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f63cfc-5297-4c86-a6f5-310828abeb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:38.508335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f63cfc-5297-4c86-a6f5-310828abeb93 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:38.508622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f63cfc-5297-4c86-a6f5-310828abeb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:38.508910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f63cfc-5297-4c86-a6f5-310828abeb93 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:38.509644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f63cfc-5297-4c86-a6f5-310828abeb93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:38.511224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f63cfc-5297-4c86-a6f5-310828abeb93 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:38.511439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426a6ea-3781-4130-a3fc-10af60720289 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:38.532171 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1050/2115] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:38.533340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f63cfc-5297-4c86-a6f5-310828abeb93 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:38.549133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f63cfc-5297-4c86-a6f5-310828abeb93 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:38.562052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2380f-3569-4da0-8815-1e8d0bac09f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:38.563637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2380f-3569-4da0-8815-1e8d0bac09f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:38.564543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2380f-3569-4da0-8815-1e8d0bac09f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:38.564856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2380f-3569-4da0-8815-1e8d0bac09f5 admin admin] PATH_INFO: `/v3/projects/3ae5511847b2419ab961fbe7f0ba8144/users/144730b5a6d6404d84b3f8aa090a83c0/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:38.581573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2380f-3569-4da0-8815-1e8d0bac09f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae5511847b2419ab961fbe7f0ba8144, user_id=144730b5a6d6404d84b3f8aa090a83c0, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:38.584272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2380f-3569-4da0-8815-1e8d0bac09f5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:38.665007 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1051/2116] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:38 2022] PUT /identity/v3/projects/3ae5511847b2419ab961fbe7f0ba8144/users/144730b5a6d6404d84b3f8aa090a83c0/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:38.683746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8426a6ea-3781-4130-a3fc-10af60720289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59c5107bd5e0494cba2ca57013dacd65', 'request_id': 'req-8426a6ea-3781-4130-a3fc-10af60720289'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:38.684264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2d76c-e708-40e4-9cc4-7ebdab4f50b3 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:38.684574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2d76c-e708-40e4-9cc4-7ebdab4f50b3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:38.685317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2d76c-e708-40e4-9cc4-7ebdab4f50b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:38.693205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8426a6ea-3781-4130-a3fc-10af60720289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59c5107bd5e0494cba2ca57013dacd65', 'request_id': 'req-8426a6ea-3781-4130-a3fc-10af60720289'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:38.726532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-adb2d76c-e708-40e4-9cc4-7ebdab4f50b3 None None] MFA Rules not processed for user `144730b5a6d6404d84b3f8aa090a83c0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:38.728517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-adb2d76c-e708-40e4-9cc4-7ebdab4f50b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:38.807448 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1052/2117] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:38.807645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8426a6ea-3781-4130-a3fc-10af60720289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59c5107bd5e0494cba2ca57013dacd65', 'request_id': 'req-8426a6ea-3781-4130-a3fc-10af60720289'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:38.818296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2d76c-e708-40e4-9cc4-7ebdab4f50b3 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:38.823537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8426a6ea-3781-4130-a3fc-10af60720289 admin admin] The token cache is being invalidate because project 59c5107bd5e0494cba2ca57013dacd65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:38.824302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8426a6ea-3781-4130-a3fc-10af60720289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:38.827433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8426a6ea-3781-4130-a3fc-10af60720289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:38.829608 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1066/2118] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:38 2022] DELETE /identity/v3/projects/59c5107bd5e0494cba2ca57013dacd65 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:38.835753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4df5c-dd97-4315-a9a9-e3784c260822 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:38.836524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4df5c-dd97-4315-a9a9-e3784c260822 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:38.836524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4df5c-dd97-4315-a9a9-e3784c260822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:38.890556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ced4df5c-dd97-4315-a9a9-e3784c260822 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:38.903402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ced4df5c-dd97-4315-a9a9-e3784c260822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:39.003485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2d76c-e708-40e4-9cc4-7ebdab4f50b3 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:39.008757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5db5ea-fda3-4f6e-b3f6-69d930d80969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:39.014348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5db5ea-fda3-4f6e-b3f6-69d930d80969 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:39.014348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5db5ea-fda3-4f6e-b3f6-69d930d80969 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:39.014348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5db5ea-fda3-4f6e-b3f6-69d930d80969 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:39.014348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5db5ea-fda3-4f6e-b3f6-69d930d80969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:39.014348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5db5ea-fda3-4f6e-b3f6-69d930d80969 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:39.070649 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1067/2119] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:20:39.078781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a8389-95b8-4a5a-bb45-e1b26a6c6a60 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:39.079288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a8389-95b8-4a5a-bb45-e1b26a6c6a60 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:39.079512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a8389-95b8-4a5a-bb45-e1b26a6c6a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:39.121667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-482a8389-95b8-4a5a-bb45-e1b26a6c6a60 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:39.125500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-482a8389-95b8-4a5a-bb45-e1b26a6c6a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:39.150121 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1068/2120] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:20:39.150832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a8389-95b8-4a5a-bb45-e1b26a6c6a60 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:39.166533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-482a8389-95b8-4a5a-bb45-e1b26a6c6a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:39.174287 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1053/2121] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:38 2022] POST /identity/v3/projects => generated 395 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:39.174287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5db5ea-fda3-4f6e-b3f6-69d930d80969 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:39.176264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-eb5db5ea-fda3-4f6e-b3f6-69d930d80969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:39.182564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a8389-95b8-4a5a-bb45-e1b26a6c6a60 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:39.269643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf15c18-4677-4b5d-985e-146024510b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:39.270560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf15c18-4677-4b5d-985e-146024510b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:39.271158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf15c18-4677-4b5d-985e-146024510b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:39.271743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf15c18-4677-4b5d-985e-146024510b75 admin admin] PATH_INFO: `/v3/projects/76e6b157004346959dee707f36ed93b1` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:39.273953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf15c18-4677-4b5d-985e-146024510b75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76e6b157004346959dee707f36ed93b1)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:39.276464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf15c18-4677-4b5d-985e-146024510b75 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:39.309304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5db5ea-fda3-4f6e-b3f6-69d930d80969 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:39.327963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735866ca-4a23-4938-a2fb-9a2a0d54f34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:39.329267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735866ca-4a23-4938-a2fb-9a2a0d54f34c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:39.329267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735866ca-4a23-4938-a2fb-9a2a0d54f34c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:39.329519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735866ca-4a23-4938-a2fb-9a2a0d54f34c admin admin] PATH_INFO: `/v3/users/ae05e30e790f43958bc78d5474d50a5c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:39.331190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735866ca-4a23-4938-a2fb-9a2a0d54f34c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae05e30e790f43958bc78d5474d50a5c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:39.333170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735866ca-4a23-4938-a2fb-9a2a0d54f34c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:39.432258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1cf15c18-4677-4b5d-985e-146024510b75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76e6b157004346959dee707f36ed93b1', 'request_id': 'req-1cf15c18-4677-4b5d-985e-146024510b75'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:39.442817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1cf15c18-4677-4b5d-985e-146024510b75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76e6b157004346959dee707f36ed93b1', 'request_id': 'req-1cf15c18-4677-4b5d-985e-146024510b75'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:39.550966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-735866ca-4a23-4938-a2fb-9a2a0d54f34c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae05e30e790f43958bc78d5474d50a5c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:39.556789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1cf15c18-4677-4b5d-985e-146024510b75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76e6b157004346959dee707f36ed93b1', 'request_id': 'req-1cf15c18-4677-4b5d-985e-146024510b75'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:39.565560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-735866ca-4a23-4938-a2fb-9a2a0d54f34c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae05e30e790f43958bc78d5474d50a5c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:39.566326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-735866ca-4a23-4938-a2fb-9a2a0d54f34c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae05e30e790f43958bc78d5474d50a5c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:39.579095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1cf15c18-4677-4b5d-985e-146024510b75 admin admin] The token cache is being invalidate because project 76e6b157004346959dee707f36ed93b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:39.579402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1cf15c18-4677-4b5d-985e-146024510b75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:39.580427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1cf15c18-4677-4b5d-985e-146024510b75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:39.581947 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1069/2122] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:39 2022] DELETE /identity/v3/projects/76e6b157004346959dee707f36ed93b1 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:39.582882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf15c18-4677-4b5d-985e-146024510b75 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:39.584262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1cf15c18-4677-4b5d-985e-146024510b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:39.591754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-735866ca-4a23-4938-a2fb-9a2a0d54f34c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae05e30e790f43958bc78d5474d50a5c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:39.682388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-735866ca-4a23-4938-a2fb-9a2a0d54f34c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae05e30e790f43958bc78d5474d50a5c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:39.690401 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1054/2123] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:39 2022] DELETE /identity/v3/users/ae05e30e790f43958bc78d5474d50a5c => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:39.693713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735866ca-4a23-4938-a2fb-9a2a0d54f34c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:39.693713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-735866ca-4a23-4938-a2fb-9a2a0d54f34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:39.768548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf15c18-4677-4b5d-985e-146024510b75 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:39.851926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735866ca-4a23-4938-a2fb-9a2a0d54f34c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:39.860650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56196ab4-66e8-4c11-8e52-b24dd61b43a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:39.861658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56196ab4-66e8-4c11-8e52-b24dd61b43a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:39.862172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56196ab4-66e8-4c11-8e52-b24dd61b43a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:39.862528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56196ab4-66e8-4c11-8e52-b24dd61b43a0 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:39.863324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56196ab4-66e8-4c11-8e52-b24dd61b43a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:39.865544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56196ab4-66e8-4c11-8e52-b24dd61b43a0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:39.893282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2767d-5e12-4984-a086-28095dd737a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:39.894075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2767d-5e12-4984-a086-28095dd737a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:39.894386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2767d-5e12-4984-a086-28095dd737a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:39.894675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2767d-5e12-4984-a086-28095dd737a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:39.895393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2767d-5e12-4984-a086-28095dd737a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:39.895703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2767d-5e12-4984-a086-28095dd737a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:39.897386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2767d-5e12-4984-a086-28095dd737a8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:39.910554 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1070/2124] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:39.911495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2767d-5e12-4984-a086-28095dd737a8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:39.913854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9fe2767d-5e12-4984-a086-28095dd737a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:39.926615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2767d-5e12-4984-a086-28095dd737a8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:39.933414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485570b-2f55-4b0c-a3e9-7a866d7e4ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:39.941791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485570b-2f55-4b0c-a3e9-7a866d7e4ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:39.941791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485570b-2f55-4b0c-a3e9-7a866d7e4ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:39.941791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485570b-2f55-4b0c-a3e9-7a866d7e4ddd admin admin] PATH_INFO: `/v3/users/50fbefb143eb44b688c206add15d94f2` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:39.941791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485570b-2f55-4b0c-a3e9-7a866d7e4ddd admin admin] RBAC: Authorizing `identity:delete_user(user_id=50fbefb143eb44b688c206add15d94f2)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:39.941791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485570b-2f55-4b0c-a3e9-7a866d7e4ddd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:39.973504 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1055/2125] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:39 2022] POST /identity/v3/users => generated 304 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:39.979045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a0a42-0072-438d-b47f-73c9f7645dc8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:39.979335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a0a42-0072-438d-b47f-73c9f7645dc8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:39.979621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a0a42-0072-438d-b47f-73c9f7645dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:40.013245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4f8a0a42-0072-438d-b47f-73c9f7645dc8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:40.014832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4f8a0a42-0072-438d-b47f-73c9f7645dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:40.028848 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1056/2126] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:40.028848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a0a42-0072-438d-b47f-73c9f7645dc8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:40.028848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4f8a0a42-0072-438d-b47f-73c9f7645dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:40.044091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a0a42-0072-438d-b47f-73c9f7645dc8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:40.050293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496b0f7-82d6-49ce-a167-911daf5e2282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:40.050993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496b0f7-82d6-49ce-a167-911daf5e2282 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:40.051513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496b0f7-82d6-49ce-a167-911daf5e2282 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:40.051961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496b0f7-82d6-49ce-a167-911daf5e2282 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:40.052750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6496b0f7-82d6-49ce-a167-911daf5e2282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:40.055327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6496b0f7-82d6-49ce-a167-911daf5e2282 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:40.210012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5485570b-2f55-4b0c-a3e9-7a866d7e4ddd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50fbefb143eb44b688c206add15d94f2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:40.234272 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1057/2127] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:40 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:40.238703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496b0f7-82d6-49ce-a167-911daf5e2282 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:40.255710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5485570b-2f55-4b0c-a3e9-7a866d7e4ddd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50fbefb143eb44b688c206add15d94f2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:40.257798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5485570b-2f55-4b0c-a3e9-7a866d7e4ddd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50fbefb143eb44b688c206add15d94f2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:40.272272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5485570b-2f55-4b0c-a3e9-7a866d7e4ddd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50fbefb143eb44b688c206add15d94f2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:40.357922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496b0f7-82d6-49ce-a167-911daf5e2282 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:40.363124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b00d55-8d8f-4af4-9c8f-c8e2d8805821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:40.363812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b00d55-8d8f-4af4-9c8f-c8e2d8805821 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:40.364120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b00d55-8d8f-4af4-9c8f-c8e2d8805821 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:40.365249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b00d55-8d8f-4af4-9c8f-c8e2d8805821 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:40.365596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b00d55-8d8f-4af4-9c8f-c8e2d8805821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:40.367766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b00d55-8d8f-4af4-9c8f-c8e2d8805821 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:40.385101 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1058/2128] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:40.387431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b00d55-8d8f-4af4-9c8f-c8e2d8805821 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:40.389725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-40b00d55-8d8f-4af4-9c8f-c8e2d8805821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:40.402570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5485570b-2f55-4b0c-a3e9-7a866d7e4ddd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50fbefb143eb44b688c206add15d94f2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:40.410741 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1071/2129] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:39 2022] DELETE /identity/v3/users/50fbefb143eb44b688c206add15d94f2 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:40.411717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485570b-2f55-4b0c-a3e9-7a866d7e4ddd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:40.415728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5485570b-2f55-4b0c-a3e9-7a866d7e4ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:40.500783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485570b-2f55-4b0c-a3e9-7a866d7e4ddd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:40.510680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2063c-7b21-49e6-9055-36aa0ee7f70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:40.512347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2063c-7b21-49e6-9055-36aa0ee7f70c admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:40.513154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2063c-7b21-49e6-9055-36aa0ee7f70c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:40.513605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2063c-7b21-49e6-9055-36aa0ee7f70c admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:40.514996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2063c-7b21-49e6-9055-36aa0ee7f70c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:40.515509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b00d55-8d8f-4af4-9c8f-c8e2d8805821 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:40.517767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2063c-7b21-49e6-9055-36aa0ee7f70c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:40.604020 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1072/2130] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:40 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:40.605042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2063c-7b21-49e6-9055-36aa0ee7f70c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:40.609843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e8b2063c-7b21-49e6-9055-36aa0ee7f70c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:40.611055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ed009-c6c6-4efb-a708-109b00347ea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:40.612278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ed009-c6c6-4efb-a708-109b00347ea2 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:40.612700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ed009-c6c6-4efb-a708-109b00347ea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:40.613084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ed009-c6c6-4efb-a708-109b00347ea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:40.615817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-927ed009-c6c6-4efb-a708-109b00347ea2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:40.630299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ed009-c6c6-4efb-a708-109b00347ea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:40.632453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ed009-c6c6-4efb-a708-109b00347ea2 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:40.645767 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1059/2131] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:40.646570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ed009-c6c6-4efb-a708-109b00347ea2 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:40.659808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ed009-c6c6-4efb-a708-109b00347ea2 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:40.665003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2063c-7b21-49e6-9055-36aa0ee7f70c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:40.665869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1e9b2-a53b-4dac-941d-6e690e08065b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:40.666739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1e9b2-a53b-4dac-941d-6e690e08065b admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:40.667173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1e9b2-a53b-4dac-941d-6e690e08065b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:40.667548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1e9b2-a53b-4dac-941d-6e690e08065b admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:40.668535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1e9b2-a53b-4dac-941d-6e690e08065b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:40.670417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1e9b2-a53b-4dac-941d-6e690e08065b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:40.683159 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1060/2132] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:40.684107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1e9b2-a53b-4dac-941d-6e690e08065b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:40.686742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-26a1e9b2-a53b-4dac-941d-6e690e08065b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:40.687186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d0426-1716-4af4-b1c2-48d61ac81dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:40.692148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d0426-1716-4af4-b1c2-48d61ac81dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:40.692148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d0426-1716-4af4-b1c2-48d61ac81dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:40.692148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d0426-1716-4af4-b1c2-48d61ac81dfc admin admin] PATH_INFO: `/v3/projects/bb454cfb71424cbab78e836fdb97792e/users/5a985baff1384548876468dcf580eb29/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:40.727597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d0426-1716-4af4-b1c2-48d61ac81dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb454cfb71424cbab78e836fdb97792e, user_id=5a985baff1384548876468dcf580eb29, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:40.730884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d0426-1716-4af4-b1c2-48d61ac81dfc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:40.825704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1e9b2-a53b-4dac-941d-6e690e08065b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:40.838911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecae59-afbb-417a-9834-18ac32e7e523 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:40.840292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecae59-afbb-417a-9834-18ac32e7e523 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:40.840738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecae59-afbb-417a-9834-18ac32e7e523 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:40.841167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecae59-afbb-417a-9834-18ac32e7e523 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:40.846116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a0ecae59-afbb-417a-9834-18ac32e7e523 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:40.869010 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1073/2133] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:40 2022] PUT /identity/v3/projects/bb454cfb71424cbab78e836fdb97792e/users/5a985baff1384548876468dcf580eb29/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:40.870174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d0426-1716-4af4-b1c2-48d61ac81dfc admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:40.982525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d0426-1716-4af4-b1c2-48d61ac81dfc admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:40.987888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad36f8-a4bc-4d6a-a053-cea66f2772ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:40.988547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad36f8-a4bc-4d6a-a053-cea66f2772ea admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:40.988869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad36f8-a4bc-4d6a-a053-cea66f2772ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:40.989146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad36f8-a4bc-4d6a-a053-cea66f2772ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:40.989946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad36f8-a4bc-4d6a-a053-cea66f2772ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:40.991236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecae59-afbb-417a-9834-18ac32e7e523 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:40.992146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad36f8-a4bc-4d6a-a053-cea66f2772ea admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:40.994036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecae59-afbb-417a-9834-18ac32e7e523 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:41.008853 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1061/2134] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:40 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:41.010139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecae59-afbb-417a-9834-18ac32e7e523 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:41.027517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecae59-afbb-417a-9834-18ac32e7e523 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:41.034076 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1074/2135] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:41.034274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab1fea-0699-470a-8a3a-fa7613092900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:41.037510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab1fea-0699-470a-8a3a-fa7613092900 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:41.037510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab1fea-0699-470a-8a3a-fa7613092900 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:41.037510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab1fea-0699-470a-8a3a-fa7613092900 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:41.037510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab1fea-0699-470a-8a3a-fa7613092900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:41.038428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab1fea-0699-470a-8a3a-fa7613092900 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:41.043445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad36f8-a4bc-4d6a-a053-cea66f2772ea admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:41.068627 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1062/2136] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:41.071253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab1fea-0699-470a-8a3a-fa7613092900 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:41.105782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab1fea-0699-470a-8a3a-fa7613092900 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:41.118173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3870986-a14e-46e4-8e29-ac1d06b70a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:41.120713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3870986-a14e-46e4-8e29-ac1d06b70a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:41.120713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3870986-a14e-46e4-8e29-ac1d06b70a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:41.120713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3870986-a14e-46e4-8e29-ac1d06b70a63 admin admin] PATH_INFO: `/v3/projects/bb454cfb71424cbab78e836fdb97792e/users/5a985baff1384548876468dcf580eb29/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:41.128529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3870986-a14e-46e4-8e29-ac1d06b70a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb454cfb71424cbab78e836fdb97792e, user_id=5a985baff1384548876468dcf580eb29, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:41.130164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad36f8-a4bc-4d6a-a053-cea66f2772ea admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:41.133588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3870986-a14e-46e4-8e29-ac1d06b70a63 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:41.150141 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873ed2f-06db-4549-aefb-c0a263aa7411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:41.153180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873ed2f-06db-4549-aefb-c0a263aa7411 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:41.155346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873ed2f-06db-4549-aefb-c0a263aa7411 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:41.155758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873ed2f-06db-4549-aefb-c0a263aa7411 admin admin] PATH_INFO: `/v3/projects/be65968774104e589193bea13015c88f/users/6b9c039bb7734998b33e5dc95807c85b/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:41.186878 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1063/2137] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:41 2022] PUT /identity/v3/projects/bb454cfb71424cbab78e836fdb97792e/users/5a985baff1384548876468dcf580eb29/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:41.186878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3870986-a14e-46e4-8e29-ac1d06b70a63 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:41.199113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873ed2f-06db-4549-aefb-c0a263aa7411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be65968774104e589193bea13015c88f, user_id=6b9c039bb7734998b33e5dc95807c85b, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:41.200208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b3870986-a14e-46e4-8e29-ac1d06b70a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:41.202483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873ed2f-06db-4549-aefb-c0a263aa7411 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:41.310507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3870986-a14e-46e4-8e29-ac1d06b70a63 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:41.314209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1958cd3-d81f-4b47-ae11-10db817c704b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:41.315210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1958cd3-d81f-4b47-ae11-10db817c704b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:41.316059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1958cd3-d81f-4b47-ae11-10db817c704b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:41.316471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1958cd3-d81f-4b47-ae11-10db817c704b admin admin] PATH_INFO: `/v3/projects/32beef58339e48e4b1b2cdc76d54dc1a` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:41.317863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1958cd3-d81f-4b47-ae11-10db817c704b admin admin] RBAC: Authorizing `identity:delete_project(project_id=32beef58339e48e4b1b2cdc76d54dc1a)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:41.320966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1958cd3-d81f-4b47-ae11-10db817c704b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:41.351397 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1075/2138] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:41 2022] PUT /identity/v3/projects/be65968774104e589193bea13015c88f/users/6b9c039bb7734998b33e5dc95807c85b/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:41.356217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6687b44-fa52-49fe-b0e9-3a2c9991021a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:41.357058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6687b44-fa52-49fe-b0e9-3a2c9991021a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:41.361125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6687b44-fa52-49fe-b0e9-3a2c9991021a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:41.435935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e6687b44-fa52-49fe-b0e9-3a2c9991021a None None] MFA Rules not processed for user `5a985baff1384548876468dcf580eb29`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:41.437377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e6687b44-fa52-49fe-b0e9-3a2c9991021a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:41.510325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d1958cd3-d81f-4b47-ae11-10db817c704b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32beef58339e48e4b1b2cdc76d54dc1a', 'request_id': 'req-d1958cd3-d81f-4b47-ae11-10db817c704b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:41.568755 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1076/2139] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:41.570071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c6d6c-0687-4e59-be31-cc6896e28c92 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:41.570379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c6d6c-0687-4e59-be31-cc6896e28c92 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:41.571704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c6d6c-0687-4e59-be31-cc6896e28c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:41.607772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d1958cd3-d81f-4b47-ae11-10db817c704b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32beef58339e48e4b1b2cdc76d54dc1a', 'request_id': 'req-d1958cd3-d81f-4b47-ae11-10db817c704b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:41.617347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d1958cd3-d81f-4b47-ae11-10db817c704b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32beef58339e48e4b1b2cdc76d54dc1a', 'request_id': 'req-d1958cd3-d81f-4b47-ae11-10db817c704b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:41.633695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d1958cd3-d81f-4b47-ae11-10db817c704b admin admin] The token cache is being invalidate because project 32beef58339e48e4b1b2cdc76d54dc1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:41.634058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d1958cd3-d81f-4b47-ae11-10db817c704b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:41.634772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d1958cd3-d81f-4b47-ae11-10db817c704b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:41.640490 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1064/2140] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:41 2022] DELETE /identity/v3/projects/32beef58339e48e4b1b2cdc76d54dc1a => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:41.640490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1958cd3-d81f-4b47-ae11-10db817c704b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:41.640740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d1958cd3-d81f-4b47-ae11-10db817c704b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:41.646448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-1e4c6d6c-0687-4e59-be31-cc6896e28c92 None None] MFA Rules not processed for user `6b9c039bb7734998b33e5dc95807c85b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:41.647811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1e4c6d6c-0687-4e59-be31-cc6896e28c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:41.757189 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1077/2141] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:41.760845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c6d6c-0687-4e59-be31-cc6896e28c92 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:41.760931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1958cd3-d81f-4b47-ae11-10db817c704b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:41.762199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1e4c6d6c-0687-4e59-be31-cc6896e28c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:41.766521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf9b37-1687-466c-a7ca-15e7b80f8529 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:41.767384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf9b37-1687-466c-a7ca-15e7b80f8529 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:41.767877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf9b37-1687-466c-a7ca-15e7b80f8529 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:41.768231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf9b37-1687-466c-a7ca-15e7b80f8529 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:41.770751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-72bf9b37-1687-466c-a7ca-15e7b80f8529 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:41.847446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf9b37-1687-466c-a7ca-15e7b80f8529 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:41.849333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf9b37-1687-466c-a7ca-15e7b80f8529 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:41.850583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c6d6c-0687-4e59-be31-cc6896e28c92 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:41.857924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee0282-3bf9-4da9-a1d8-5f8052bd7757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:41.859060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee0282-3bf9-4da9-a1d8-5f8052bd7757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:41.859538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee0282-3bf9-4da9-a1d8-5f8052bd7757 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:41.860200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee0282-3bf9-4da9-a1d8-5f8052bd7757 admin admin] PATH_INFO: `/v3/projects/1657fdec4f38462c94cb54c8c47bddfd` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:41.861409 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1065/2142] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:41.861948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee0282-3bf9-4da9-a1d8-5f8052bd7757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1657fdec4f38462c94cb54c8c47bddfd)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:41.862920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25dbfd-5cb9-4968-9792-cfc0f035a141 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:41.863440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25dbfd-5cb9-4968-9792-cfc0f035a141 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:41.863790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25dbfd-5cb9-4968-9792-cfc0f035a141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:41.864772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee0282-3bf9-4da9-a1d8-5f8052bd7757 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:41.887968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-da25dbfd-5cb9-4968-9792-cfc0f035a141 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:41.895135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-da25dbfd-5cb9-4968-9792-cfc0f035a141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:41.906827 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1066/2143] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:41.918794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25dbfd-5cb9-4968-9792-cfc0f035a141 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:41.921104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-da25dbfd-5cb9-4968-9792-cfc0f035a141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:41.938193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25dbfd-5cb9-4968-9792-cfc0f035a141 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:41.944714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89369a-94b1-4fb7-8bb0-ab103f04e4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:41.944714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89369a-94b1-4fb7-8bb0-ab103f04e4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:41.945276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89369a-94b1-4fb7-8bb0-ab103f04e4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:41.945593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89369a-94b1-4fb7-8bb0-ab103f04e4d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:41.946335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89369a-94b1-4fb7-8bb0-ab103f04e4d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:41.948301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89369a-94b1-4fb7-8bb0-ab103f04e4d4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:42.016549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-93ee0282-3bf9-4da9-a1d8-5f8052bd7757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1657fdec4f38462c94cb54c8c47bddfd', 'request_id': 'req-93ee0282-3bf9-4da9-a1d8-5f8052bd7757'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:42.027071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-93ee0282-3bf9-4da9-a1d8-5f8052bd7757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1657fdec4f38462c94cb54c8c47bddfd', 'request_id': 'req-93ee0282-3bf9-4da9-a1d8-5f8052bd7757'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:42.067206 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1067/2144] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:41 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:42.068871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faba653-3c17-4dbe-b527-e009384955c1 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:42.069238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faba653-3c17-4dbe-b527-e009384955c1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:42.069439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faba653-3c17-4dbe-b527-e009384955c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:42.113599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4faba653-3c17-4dbe-b527-e009384955c1 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:42.114862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4faba653-3c17-4dbe-b527-e009384955c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:42.135398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-93ee0282-3bf9-4da9-a1d8-5f8052bd7757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1657fdec4f38462c94cb54c8c47bddfd', 'request_id': 'req-93ee0282-3bf9-4da9-a1d8-5f8052bd7757'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:42.156262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-93ee0282-3bf9-4da9-a1d8-5f8052bd7757 admin admin] The token cache is being invalidate because project 1657fdec4f38462c94cb54c8c47bddfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:42.156565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-93ee0282-3bf9-4da9-a1d8-5f8052bd7757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:42.159317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-93ee0282-3bf9-4da9-a1d8-5f8052bd7757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:42.165994 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1078/2145] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:41 2022] DELETE /identity/v3/projects/1657fdec4f38462c94cb54c8c47bddfd => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:42.167076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee0282-3bf9-4da9-a1d8-5f8052bd7757 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:42.169111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-93ee0282-3bf9-4da9-a1d8-5f8052bd7757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:42.204136 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1068/2146] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:42.205086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faba653-3c17-4dbe-b527-e009384955c1 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:42.209701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4faba653-3c17-4dbe-b527-e009384955c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:42.226998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faba653-3c17-4dbe-b527-e009384955c1 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:42.235051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcef202-459b-4e99-9ef1-3519998ddc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:42.236702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcef202-459b-4e99-9ef1-3519998ddc5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:42.237109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcef202-459b-4e99-9ef1-3519998ddc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:42.238123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcef202-459b-4e99-9ef1-3519998ddc5a admin admin] PATH_INFO: `/v3/users/fc8b563ca0634e31b9f04a979fcc5218` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:42.239089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcef202-459b-4e99-9ef1-3519998ddc5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc8b563ca0634e31b9f04a979fcc5218)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:42.241767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcef202-459b-4e99-9ef1-3519998ddc5a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:42.287583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee0282-3bf9-4da9-a1d8-5f8052bd7757 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:42.293073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12c773-def2-4a23-8a73-b180772cfebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:42.294438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12c773-def2-4a23-8a73-b180772cfebc admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:42.295138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12c773-def2-4a23-8a73-b180772cfebc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:42.295721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12c773-def2-4a23-8a73-b180772cfebc admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:42.296545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12c773-def2-4a23-8a73-b180772cfebc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:42.298875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12c773-def2-4a23-8a73-b180772cfebc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:42.389497 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1079/2147] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:42 2022] POST /identity/v3/users => generated 298 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:42.390353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12c773-def2-4a23-8a73-b180772cfebc admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:42.402987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12c773-def2-4a23-8a73-b180772cfebc admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:42.407757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd742b-0de3-4a89-af70-580c99ce7b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:42.408464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd742b-0de3-4a89-af70-580c99ce7b17 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:42.408788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd742b-0de3-4a89-af70-580c99ce7b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:42.409066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd742b-0de3-4a89-af70-580c99ce7b17 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:42.409828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd742b-0de3-4a89-af70-580c99ce7b17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:42.410171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd742b-0de3-4a89-af70-580c99ce7b17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:42.411817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd742b-0de3-4a89-af70-580c99ce7b17 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:42.429624 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1080/2148] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:42.430663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd742b-0de3-4a89-af70-580c99ce7b17 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:42.434075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4efd742b-0de3-4a89-af70-580c99ce7b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:42.454009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dbcef202-459b-4e99-9ef1-3519998ddc5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc8b563ca0634e31b9f04a979fcc5218'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:42.473979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dbcef202-459b-4e99-9ef1-3519998ddc5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc8b563ca0634e31b9f04a979fcc5218'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:42.474904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dbcef202-459b-4e99-9ef1-3519998ddc5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc8b563ca0634e31b9f04a979fcc5218'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:42.481864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dbcef202-459b-4e99-9ef1-3519998ddc5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc8b563ca0634e31b9f04a979fcc5218'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:42.538148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd742b-0de3-4a89-af70-580c99ce7b17 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:42.544659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7650d6-f0e7-4d4f-91cd-548779d570db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:42.545604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7650d6-f0e7-4d4f-91cd-548779d570db service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:42.545892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7650d6-f0e7-4d4f-91cd-548779d570db service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:42.546179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7650d6-f0e7-4d4f-91cd-548779d570db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:42.548191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6c7650d6-f0e7-4d4f-91cd-548779d570db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:42.577289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dbcef202-459b-4e99-9ef1-3519998ddc5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc8b563ca0634e31b9f04a979fcc5218'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:42.588791 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1069/2149] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:42 2022] DELETE /identity/v3/users/fc8b563ca0634e31b9f04a979fcc5218 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:42.589974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcef202-459b-4e99-9ef1-3519998ddc5a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:42.591496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dbcef202-459b-4e99-9ef1-3519998ddc5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:42.660079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7650d6-f0e7-4d4f-91cd-548779d570db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:42.661855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7650d6-f0e7-4d4f-91cd-548779d570db service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:42.673156 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1081/2150] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:42.674163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7650d6-f0e7-4d4f-91cd-548779d570db service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:42.690737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7650d6-f0e7-4d4f-91cd-548779d570db service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:42.716670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcef202-459b-4e99-9ef1-3519998ddc5a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:42.730472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278294bb-6ee9-4cc1-af7f-16d500d9463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:42.733288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278294bb-6ee9-4cc1-af7f-16d500d9463a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:42.733288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278294bb-6ee9-4cc1-af7f-16d500d9463a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:42.733288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278294bb-6ee9-4cc1-af7f-16d500d9463a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:42.733288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278294bb-6ee9-4cc1-af7f-16d500d9463a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:42.739459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278294bb-6ee9-4cc1-af7f-16d500d9463a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:42.767566 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1070/2151] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:42.768538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278294bb-6ee9-4cc1-af7f-16d500d9463a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:42.770454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-278294bb-6ee9-4cc1-af7f-16d500d9463a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:42.788687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278294bb-6ee9-4cc1-af7f-16d500d9463a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:42.801213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc97433-7186-466f-916a-84bb4834924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:42.802196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc97433-7186-466f-916a-84bb4834924d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:42.802550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc97433-7186-466f-916a-84bb4834924d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:42.802896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc97433-7186-466f-916a-84bb4834924d admin admin] PATH_INFO: `/v3/users/144730b5a6d6404d84b3f8aa090a83c0` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:42.805015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc97433-7186-466f-916a-84bb4834924d admin admin] RBAC: Authorizing `identity:delete_user(user_id=144730b5a6d6404d84b3f8aa090a83c0)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:42.808175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc97433-7186-466f-916a-84bb4834924d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:42.812461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12576f6-10af-48fb-b1b4-46c38dd3cc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:42.813582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12576f6-10af-48fb-b1b4-46c38dd3cc91 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:42.813874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12576f6-10af-48fb-b1b4-46c38dd3cc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:42.814650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12576f6-10af-48fb-b1b4-46c38dd3cc91 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:42.814881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12576f6-10af-48fb-b1b4-46c38dd3cc91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:42.817329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12576f6-10af-48fb-b1b4-46c38dd3cc91 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:43.187920 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1082/2152] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:42 2022] POST /identity/v3/projects => generated 371 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:43.189483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12576f6-10af-48fb-b1b4-46c38dd3cc91 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:43.194947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f12576f6-10af-48fb-b1b4-46c38dd3cc91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:43.283333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12576f6-10af-48fb-b1b4-46c38dd3cc91 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:43.288182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e67f8-438b-48be-9bcf-f449eb7f9035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:43.291873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e67f8-438b-48be-9bcf-f449eb7f9035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:43.291873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e67f8-438b-48be-9bcf-f449eb7f9035 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:43.291873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e67f8-438b-48be-9bcf-f449eb7f9035 admin admin] PATH_INFO: `/v3/users/625d2d9692cd4191afa8cb7d4c82a74d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:43.291873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e67f8-438b-48be-9bcf-f449eb7f9035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=625d2d9692cd4191afa8cb7d4c82a74d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:43.293729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e67f8-438b-48be-9bcf-f449eb7f9035 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:43.299562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8fc97433-7186-466f-916a-84bb4834924d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144730b5a6d6404d84b3f8aa090a83c0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:43.311669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8fc97433-7186-466f-916a-84bb4834924d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144730b5a6d6404d84b3f8aa090a83c0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:43.312417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8fc97433-7186-466f-916a-84bb4834924d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144730b5a6d6404d84b3f8aa090a83c0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:43.322444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8fc97433-7186-466f-916a-84bb4834924d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144730b5a6d6404d84b3f8aa090a83c0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:43.384879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8fc97433-7186-466f-916a-84bb4834924d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144730b5a6d6404d84b3f8aa090a83c0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:43.391183 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1071/2153] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:42 2022] DELETE /identity/v3/users/144730b5a6d6404d84b3f8aa090a83c0 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:43.394762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc97433-7186-466f-916a-84bb4834924d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:43.396092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8fc97433-7186-466f-916a-84bb4834924d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:43.500404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc97433-7186-466f-916a-84bb4834924d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:43.512153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-659e67f8-438b-48be-9bcf-f449eb7f9035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '625d2d9692cd4191afa8cb7d4c82a74d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:43.518752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22db9a-ceda-4ccc-bb20-b67232501f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:43.519767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22db9a-ceda-4ccc-bb20-b67232501f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:43.521249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22db9a-ceda-4ccc-bb20-b67232501f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:43.521605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22db9a-ceda-4ccc-bb20-b67232501f97 admin admin] PATH_INFO: `/v3/projects/f9ea23daef7142c3bedd1868bb13b05f/users/19ab9c8dcb194494a7ac38e286edb1d9/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:43.535621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-659e67f8-438b-48be-9bcf-f449eb7f9035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '625d2d9692cd4191afa8cb7d4c82a74d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:43.536636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-659e67f8-438b-48be-9bcf-f449eb7f9035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '625d2d9692cd4191afa8cb7d4c82a74d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:43.539436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22db9a-ceda-4ccc-bb20-b67232501f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ea23daef7142c3bedd1868bb13b05f, user_id=19ab9c8dcb194494a7ac38e286edb1d9, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:43.542789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22db9a-ceda-4ccc-bb20-b67232501f97 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:43.546668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-659e67f8-438b-48be-9bcf-f449eb7f9035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '625d2d9692cd4191afa8cb7d4c82a74d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:43.651519 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1072/2154] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:43 2022] PUT /identity/v3/projects/f9ea23daef7142c3bedd1868bb13b05f/users/19ab9c8dcb194494a7ac38e286edb1d9/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:43.653116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d4c18-d4eb-4217-99d5-886e06c37589 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:43.653494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d4c18-d4eb-4217-99d5-886e06c37589 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:43.653985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d4c18-d4eb-4217-99d5-886e06c37589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:43.669567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-659e67f8-438b-48be-9bcf-f449eb7f9035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '625d2d9692cd4191afa8cb7d4c82a74d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:43.681494 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1083/2155] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:43 2022] DELETE /identity/v3/users/625d2d9692cd4191afa8cb7d4c82a74d => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:43.685713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e67f8-438b-48be-9bcf-f449eb7f9035 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:43.688056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-659e67f8-438b-48be-9bcf-f449eb7f9035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:43.689293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b21d4c18-d4eb-4217-99d5-886e06c37589 None None] MFA Rules not processed for user `0360b7261526403786bc77b8945c815b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:43.690714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b21d4c18-d4eb-4217-99d5-886e06c37589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:43.826029 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1073/2156] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:43.827672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d4c18-d4eb-4217-99d5-886e06c37589 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:43.833050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b21d4c18-d4eb-4217-99d5-886e06c37589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:43.835995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e67f8-438b-48be-9bcf-f449eb7f9035 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:43.850526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d4c18-d4eb-4217-99d5-886e06c37589 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:43.853079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4f18c-90ea-403c-85ad-1025a26ead36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:43.854155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4f18c-90ea-403c-85ad-1025a26ead36 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:43.854444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4f18c-90ea-403c-85ad-1025a26ead36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:43.854727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4f18c-90ea-403c-85ad-1025a26ead36 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:43.855429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4f18c-90ea-403c-85ad-1025a26ead36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:43.856399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8586d01-41cd-46ad-9b90-b6d53eb52549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:43.857422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8586d01-41cd-46ad-9b90-b6d53eb52549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:43.857809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8586d01-41cd-46ad-9b90-b6d53eb52549 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:43.858190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8586d01-41cd-46ad-9b90-b6d53eb52549 admin admin] PATH_INFO: `/v3/projects/ddd294662f0f49c4b29f7549822cc68f` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:43.859321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4f18c-90ea-403c-85ad-1025a26ead36 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:43.859604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8586d01-41cd-46ad-9b90-b6d53eb52549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddd294662f0f49c4b29f7549822cc68f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:43.861646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8586d01-41cd-46ad-9b90-b6d53eb52549 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:44.172294 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1084/2157] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:43 2022] POST /identity/v3/users => generated 286 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:44.174720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a765f7-f5f4-4287-bfcd-3a78985a72c4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:44.178642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a765f7-f5f4-4287-bfcd-3a78985a72c4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:44.179851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a765f7-f5f4-4287-bfcd-3a78985a72c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:44.203709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c8586d01-41cd-46ad-9b90-b6d53eb52549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddd294662f0f49c4b29f7549822cc68f', 'request_id': 'req-c8586d01-41cd-46ad-9b90-b6d53eb52549'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:44.232877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-00a765f7-f5f4-4287-bfcd-3a78985a72c4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:44.234218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-00a765f7-f5f4-4287-bfcd-3a78985a72c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:44.294296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c8586d01-41cd-46ad-9b90-b6d53eb52549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddd294662f0f49c4b29f7549822cc68f', 'request_id': 'req-c8586d01-41cd-46ad-9b90-b6d53eb52549'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:44.308278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c8586d01-41cd-46ad-9b90-b6d53eb52549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddd294662f0f49c4b29f7549822cc68f', 'request_id': 'req-c8586d01-41cd-46ad-9b90-b6d53eb52549'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:44.323879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c8586d01-41cd-46ad-9b90-b6d53eb52549 admin admin] The token cache is being invalidate because project ddd294662f0f49c4b29f7549822cc68f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:44.324231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c8586d01-41cd-46ad-9b90-b6d53eb52549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:44.327706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c8586d01-41cd-46ad-9b90-b6d53eb52549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:44.329567 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1074/2158] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:43 2022] DELETE /identity/v3/projects/ddd294662f0f49c4b29f7549822cc68f => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:44.335206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8586d01-41cd-46ad-9b90-b6d53eb52549 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:44.335206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c8586d01-41cd-46ad-9b90-b6d53eb52549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:44.368772 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1085/2159] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:44.370556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbf31a-718d-4fe2-91d2-1b8f82bcb77b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:44.370934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbf31a-718d-4fe2-91d2-1b8f82bcb77b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:44.371690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbf31a-718d-4fe2-91d2-1b8f82bcb77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:44.410563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-aecbf31a-718d-4fe2-91d2-1b8f82bcb77b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:44.410563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-aecbf31a-718d-4fe2-91d2-1b8f82bcb77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:44.422517 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1086/2160] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:44.426941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbf31a-718d-4fe2-91d2-1b8f82bcb77b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:44.430508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-aecbf31a-718d-4fe2-91d2-1b8f82bcb77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:44.453038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbf31a-718d-4fe2-91d2-1b8f82bcb77b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:44.460036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981649a-aa6b-4443-ac1e-405b0e401ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:44.461216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981649a-aa6b-4443-ac1e-405b0e401ebe admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:44.462232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981649a-aa6b-4443-ac1e-405b0e401ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:44.462598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981649a-aa6b-4443-ac1e-405b0e401ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:44.463463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981649a-aa6b-4443-ac1e-405b0e401ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:44.465987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981649a-aa6b-4443-ac1e-405b0e401ebe admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:44.509041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8586d01-41cd-46ad-9b90-b6d53eb52549 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:44.515072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f5e62-f67d-4714-b69a-ebe9897e5b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:44.515072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f5e62-f67d-4714-b69a-ebe9897e5b83 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:44.515326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f5e62-f67d-4714-b69a-ebe9897e5b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:44.516540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f5e62-f67d-4714-b69a-ebe9897e5b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:44.517527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f5e62-f67d-4714-b69a-ebe9897e5b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:44.519260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f5e62-f67d-4714-b69a-ebe9897e5b83 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:44.534404 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1075/2161] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:44.535418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f5e62-f67d-4714-b69a-ebe9897e5b83 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:44.540949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-623f5e62-f67d-4714-b69a-ebe9897e5b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:44.555019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f5e62-f67d-4714-b69a-ebe9897e5b83 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:44.561469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6f179-fd67-4923-87b6-e363bf9e4c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:44.562169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6f179-fd67-4923-87b6-e363bf9e4c44 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:44.562557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6f179-fd67-4923-87b6-e363bf9e4c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:44.563157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6f179-fd67-4923-87b6-e363bf9e4c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:44.564063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed6f179-fd67-4923-87b6-e363bf9e4c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:44.565861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed6f179-fd67-4923-87b6-e363bf9e4c44 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:44.577767 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1087/2162] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:44 2022] POST /identity/v3/projects => generated 401 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:44.578186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308d020-3e5e-42e2-be6d-b648c94548cf None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:44.578484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308d020-3e5e-42e2-be6d-b648c94548cf None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:44.578761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308d020-3e5e-42e2-be6d-b648c94548cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:44.583651 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1076/2163] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:44.583651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6f179-fd67-4923-87b6-e363bf9e4c44 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:44.584554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-aed6f179-fd67-4923-87b6-e363bf9e4c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:44.609322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b308d020-3e5e-42e2-be6d-b648c94548cf None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:44.610432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b308d020-3e5e-42e2-be6d-b648c94548cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:44.684428 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1088/2164] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:44.687010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308d020-3e5e-42e2-be6d-b648c94548cf None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:44.689149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b308d020-3e5e-42e2-be6d-b648c94548cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:44.700020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6f179-fd67-4923-87b6-e363bf9e4c44 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:44.763058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f1805-e791-46f2-93cc-c0060b4cdb03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:44.763718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f1805-e791-46f2-93cc-c0060b4cdb03 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:44.764000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f1805-e791-46f2-93cc-c0060b4cdb03 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:44.764279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f1805-e791-46f2-93cc-c0060b4cdb03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:44.765425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308d020-3e5e-42e2-be6d-b648c94548cf None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:44.769620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d33b4-d8bc-4bea-b396-f44429f7203d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:44.770498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d33b4-d8bc-4bea-b396-f44429f7203d service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:44.770963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d33b4-d8bc-4bea-b396-f44429f7203d service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:44.771443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d33b4-d8bc-4bea-b396-f44429f7203d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:44.776577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f1805-e791-46f2-93cc-c0060b4cdb03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:44.778118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f1805-e791-46f2-93cc-c0060b4cdb03 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:44.782673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d33b4-d8bc-4bea-b396-f44429f7203d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:44.786380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d33b4-d8bc-4bea-b396-f44429f7203d service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:44.790317 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1077/2165] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:44.791301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f1805-e791-46f2-93cc-c0060b4cdb03 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:44.799172 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1089/2166] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:44.800316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d33b4-d8bc-4bea-b396-f44429f7203d service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:44.801292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f1805-e791-46f2-93cc-c0060b4cdb03 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:44.806736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ff126-527d-46c1-a672-e85b1688a1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:44.807644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ff126-527d-46c1-a672-e85b1688a1bf admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:44.807924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ff126-527d-46c1-a672-e85b1688a1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:44.808201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ff126-527d-46c1-a672-e85b1688a1bf admin admin] PATH_INFO: `/v3/projects/f9ea23daef7142c3bedd1868bb13b05f/users/19ab9c8dcb194494a7ac38e286edb1d9/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:44.810285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ff126-527d-46c1-a672-e85b1688a1bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ea23daef7142c3bedd1868bb13b05f, user_id=19ab9c8dcb194494a7ac38e286edb1d9, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:44.813013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ff126-527d-46c1-a672-e85b1688a1bf admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:44.814132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d33b4-d8bc-4bea-b396-f44429f7203d service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:44.820397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8570c54-d5d0-4b5c-a7fa-8e30f8ce0780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:44.821513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8570c54-d5d0-4b5c-a7fa-8e30f8ce0780 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:44.821993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8570c54-d5d0-4b5c-a7fa-8e30f8ce0780 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:44.822488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8570c54-d5d0-4b5c-a7fa-8e30f8ce0780 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:44.824784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8570c54-d5d0-4b5c-a7fa-8e30f8ce0780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:44.825705 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1078/2167] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:44 2022] PUT /identity/v3/projects/f9ea23daef7142c3bedd1868bb13b05f/users/19ab9c8dcb194494a7ac38e286edb1d9/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:44.826556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ff126-527d-46c1-a672-e85b1688a1bf admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:44.827658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8570c54-d5d0-4b5c-a7fa-8e30f8ce0780 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:44.898799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ff126-527d-46c1-a672-e85b1688a1bf admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:44.904138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07918d69-5e54-40c2-a193-a0b2b2ae3d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:44.905005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07918d69-5e54-40c2-a193-a0b2b2ae3d65 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:44.905288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07918d69-5e54-40c2-a193-a0b2b2ae3d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:44.905703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07918d69-5e54-40c2-a193-a0b2b2ae3d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:44.906444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07918d69-5e54-40c2-a193-a0b2b2ae3d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:44.908280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07918d69-5e54-40c2-a193-a0b2b2ae3d65 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:44.924821 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1079/2168] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:44.926635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c97d97-ea14-4fc2-8dfa-77d35f0f7df6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:44.927382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c97d97-ea14-4fc2-8dfa-77d35f0f7df6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:44.927904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c97d97-ea14-4fc2-8dfa-77d35f0f7df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:44.936320 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1090/2169] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:44 2022] POST /identity/v3/users => generated 307 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:44.938264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e396177-f883-44c7-a0d7-3133f1fe728b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:44.938649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e396177-f883-44c7-a0d7-3133f1fe728b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:44.938829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e396177-f883-44c7-a0d7-3133f1fe728b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:44.965766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-68c97d97-ea14-4fc2-8dfa-77d35f0f7df6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:44.967469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-68c97d97-ea14-4fc2-8dfa-77d35f0f7df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:44.981351 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1080/2170] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:44.982526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c97d97-ea14-4fc2-8dfa-77d35f0f7df6 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:45.005751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c97d97-ea14-4fc2-8dfa-77d35f0f7df6 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:45.012487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70881020-3403-4a76-a5f5-2a8f39018b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:45.013736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70881020-3403-4a76-a5f5-2a8f39018b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:45.014177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70881020-3403-4a76-a5f5-2a8f39018b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:45.017202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70881020-3403-4a76-a5f5-2a8f39018b57 admin admin] PATH_INFO: `/v3/projects/f63d3cc11e804e6083e7a8343b47bac5/users/e3a708797f8a483181d8b2e977e1d37b/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:45.017984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0e396177-f883-44c7-a0d7-3133f1fe728b None None] MFA Rules not processed for user `19ab9c8dcb194494a7ac38e286edb1d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:45.019474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0e396177-f883-44c7-a0d7-3133f1fe728b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:45.070868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70881020-3403-4a76-a5f5-2a8f39018b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f63d3cc11e804e6083e7a8343b47bac5, user_id=e3a708797f8a483181d8b2e977e1d37b, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:45.077902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70881020-3403-4a76-a5f5-2a8f39018b57 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:45.151224 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1091/2171] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:45.152634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e396177-f883-44c7-a0d7-3133f1fe728b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:45.165283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e396177-f883-44c7-a0d7-3133f1fe728b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:45.174300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d620518-6269-4d3b-b521-c920fa578e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:45.175881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d620518-6269-4d3b-b521-c920fa578e60 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:45.177502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d620518-6269-4d3b-b521-c920fa578e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:45.177502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d620518-6269-4d3b-b521-c920fa578e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:45.178465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d620518-6269-4d3b-b521-c920fa578e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:45.180159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d620518-6269-4d3b-b521-c920fa578e60 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:45.191768 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1092/2172] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:45.196642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d620518-6269-4d3b-b521-c920fa578e60 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:45.212580 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1081/2173] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:44 2022] PUT /identity/v3/projects/f63d3cc11e804e6083e7a8343b47bac5/users/e3a708797f8a483181d8b2e977e1d37b/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:45.215943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70881020-3403-4a76-a5f5-2a8f39018b57 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:45.223083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d620518-6269-4d3b-b521-c920fa578e60 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:45.225348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-70881020-3403-4a76-a5f5-2a8f39018b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:45.358292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70881020-3403-4a76-a5f5-2a8f39018b57 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:45.365980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7bd61-be6b-49f7-9cb1-c122035da316 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:45.366735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7bd61-be6b-49f7-9cb1-c122035da316 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:45.367115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7bd61-be6b-49f7-9cb1-c122035da316 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:45.367473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7bd61-be6b-49f7-9cb1-c122035da316 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:45.430684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63d0af-ca30-4163-b2b8-5529f243710b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:45.431824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63d0af-ca30-4163-b2b8-5529f243710b admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:45.436645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63d0af-ca30-4163-b2b8-5529f243710b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:45.436645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63d0af-ca30-4163-b2b8-5529f243710b admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:45.436645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be63d0af-ca30-4163-b2b8-5529f243710b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:45.436645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be63d0af-ca30-4163-b2b8-5529f243710b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:45.436645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be63d0af-ca30-4163-b2b8-5529f243710b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:45.458074 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1093/2174] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:45.458940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63d0af-ca30-4163-b2b8-5529f243710b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:45.471636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63d0af-ca30-4163-b2b8-5529f243710b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:45.477143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a135a-8612-405b-acfa-757a84ea0c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:45.477994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a135a-8612-405b-acfa-757a84ea0c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:45.478285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a135a-8612-405b-acfa-757a84ea0c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:45.478569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a135a-8612-405b-acfa-757a84ea0c8e admin admin] PATH_INFO: `/v3/projects/f22dc1bb214f4b0284fec31d2424e0c8/users/c4b69f1d0d4a4bcaaead3a2337d0734e/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:45.489888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7bd61-be6b-49f7-9cb1-c122035da316 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:45.495373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7bd61-be6b-49f7-9cb1-c122035da316 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:45.496889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a135a-8612-405b-acfa-757a84ea0c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22dc1bb214f4b0284fec31d2424e0c8, user_id=c4b69f1d0d4a4bcaaead3a2337d0734e, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:45.499745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a135a-8612-405b-acfa-757a84ea0c8e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:45.510416 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1082/2175] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:45.511816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd90519-3620-42ec-a03e-544b9bb6ffc2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:45.512118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd90519-3620-42ec-a03e-544b9bb6ffc2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:45.512402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd90519-3620-42ec-a03e-544b9bb6ffc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:45.556527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1fd90519-3620-42ec-a03e-544b9bb6ffc2 None None] MFA Rules not processed for user `e3a708797f8a483181d8b2e977e1d37b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:45.557602 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1fd90519-3620-42ec-a03e-544b9bb6ffc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:45.576303 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1094/2176] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:45 2022] PUT /identity/v3/projects/f22dc1bb214f4b0284fec31d2424e0c8/users/c4b69f1d0d4a4bcaaead3a2337d0734e/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:45.577502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a135a-8612-405b-acfa-757a84ea0c8e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:45.579349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-335a135a-8612-405b-acfa-757a84ea0c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:45.643520 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1083/2177] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:45.647057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd90519-3620-42ec-a03e-544b9bb6ffc2 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:45.657182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd90519-3620-42ec-a03e-544b9bb6ffc2 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:45.721081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a135a-8612-405b-acfa-757a84ea0c8e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:45.733767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da41af-3771-475d-9208-4abeef97c18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:45.737116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da41af-3771-475d-9208-4abeef97c18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:45.737638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da41af-3771-475d-9208-4abeef97c18a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:45.738303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da41af-3771-475d-9208-4abeef97c18a admin admin] PATH_INFO: `/v3/projects/66d8d2aaecb944ea931a74ca8a8526f9` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:45.739934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da41af-3771-475d-9208-4abeef97c18a admin admin] RBAC: Authorizing `identity:delete_project(project_id=66d8d2aaecb944ea931a74ca8a8526f9)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:45.742840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da41af-3771-475d-9208-4abeef97c18a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:45.755438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca07c48-5f95-45ea-bbb0-a5feed63f319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:45.756363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca07c48-5f95-45ea-bbb0-a5feed63f319 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:45.757422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca07c48-5f95-45ea-bbb0-a5feed63f319 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:45.757874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca07c48-5f95-45ea-bbb0-a5feed63f319 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:45.758728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca07c48-5f95-45ea-bbb0-a5feed63f319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:45.760696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca07c48-5f95-45ea-bbb0-a5feed63f319 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:45.924977 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1084/2178] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:45 2022] POST /identity/v3/projects => generated 391 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:45.926300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca07c48-5f95-45ea-bbb0-a5feed63f319 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:45.989186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-27da41af-3771-475d-9208-4abeef97c18a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66d8d2aaecb944ea931a74ca8a8526f9', 'request_id': 'req-27da41af-3771-475d-9208-4abeef97c18a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:46.000133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-27da41af-3771-475d-9208-4abeef97c18a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66d8d2aaecb944ea931a74ca8a8526f9', 'request_id': 'req-27da41af-3771-475d-9208-4abeef97c18a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:46.013716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca07c48-5f95-45ea-bbb0-a5feed63f319 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:46.088458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cccbb0-9c83-4012-ae1b-65de6a4afc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:46.088713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-27da41af-3771-475d-9208-4abeef97c18a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66d8d2aaecb944ea931a74ca8a8526f9', 'request_id': 'req-27da41af-3771-475d-9208-4abeef97c18a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:46.089044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cccbb0-9c83-4012-ae1b-65de6a4afc89 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:46.089334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cccbb0-9c83-4012-ae1b-65de6a4afc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:46.089615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cccbb0-9c83-4012-ae1b-65de6a4afc89 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:46.090724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cccbb0-9c83-4012-ae1b-65de6a4afc89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:46.092364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cccbb0-9c83-4012-ae1b-65de6a4afc89 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:46.123939 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1085/2179] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:46.124920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cccbb0-9c83-4012-ae1b-65de6a4afc89 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:46.125350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-27da41af-3771-475d-9208-4abeef97c18a admin admin] The token cache is being invalidate because project 66d8d2aaecb944ea931a74ca8a8526f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:46.125656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-27da41af-3771-475d-9208-4abeef97c18a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:46.126438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-27da41af-3771-475d-9208-4abeef97c18a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:46.132779 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1095/2180] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:45 2022] DELETE /identity/v3/projects/66d8d2aaecb944ea931a74ca8a8526f9 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:46.133713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da41af-3771-475d-9208-4abeef97c18a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:46.133852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-79cccbb0-9c83-4012-ae1b-65de6a4afc89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:46.137748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-27da41af-3771-475d-9208-4abeef97c18a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:46.164007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da41af-3771-475d-9208-4abeef97c18a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:46.164224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cccbb0-9c83-4012-ae1b-65de6a4afc89 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:46.168213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2678d8-794c-49b0-a7b9-b2f0718346e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:46.169108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734cbac-13bb-42e0-87a4-cf2d3880a23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:46.170231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734cbac-13bb-42e0-87a4-cf2d3880a23f admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:46.170523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734cbac-13bb-42e0-87a4-cf2d3880a23f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:46.170814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734cbac-13bb-42e0-87a4-cf2d3880a23f admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:46.171519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734cbac-13bb-42e0-87a4-cf2d3880a23f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:46.172905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2678d8-794c-49b0-a7b9-b2f0718346e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:46.173313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2678d8-794c-49b0-a7b9-b2f0718346e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:46.173553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734cbac-13bb-42e0-87a4-cf2d3880a23f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:46.173802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2678d8-794c-49b0-a7b9-b2f0718346e9 admin admin] PATH_INFO: `/v3/projects/3ae5511847b2419ab961fbe7f0ba8144` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:46.175487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2678d8-794c-49b0-a7b9-b2f0718346e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ae5511847b2419ab961fbe7f0ba8144)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:46.180008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2678d8-794c-49b0-a7b9-b2f0718346e9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:46.276198 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1086/2181] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:46 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:46.276198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734cbac-13bb-42e0-87a4-cf2d3880a23f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:46.276198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7734cbac-13bb-42e0-87a4-cf2d3880a23f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:46.315923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed2678d8-794c-49b0-a7b9-b2f0718346e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ae5511847b2419ab961fbe7f0ba8144', 'request_id': 'req-ed2678d8-794c-49b0-a7b9-b2f0718346e9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:46.322143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed2678d8-794c-49b0-a7b9-b2f0718346e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ae5511847b2419ab961fbe7f0ba8144', 'request_id': 'req-ed2678d8-794c-49b0-a7b9-b2f0718346e9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:46.351228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734cbac-13bb-42e0-87a4-cf2d3880a23f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:46.407257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8730a-40db-4fce-a886-632715727c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:46.407931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8730a-40db-4fce-a886-632715727c67 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:46.408214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8730a-40db-4fce-a886-632715727c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:46.408491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8730a-40db-4fce-a886-632715727c67 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:46.409219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8730a-40db-4fce-a886-632715727c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:46.411171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8730a-40db-4fce-a886-632715727c67 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:46.413632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed2678d8-794c-49b0-a7b9-b2f0718346e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ae5511847b2419ab961fbe7f0ba8144', 'request_id': 'req-ed2678d8-794c-49b0-a7b9-b2f0718346e9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:46.427777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed2678d8-794c-49b0-a7b9-b2f0718346e9 admin admin] The token cache is being invalidate because project 3ae5511847b2419ab961fbe7f0ba8144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:46.428079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed2678d8-794c-49b0-a7b9-b2f0718346e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:46.429083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed2678d8-794c-49b0-a7b9-b2f0718346e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:46.430970 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1096/2182] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:46 2022] DELETE /identity/v3/projects/3ae5511847b2419ab961fbe7f0ba8144 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:46.434816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2678d8-794c-49b0-a7b9-b2f0718346e9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:46.436207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ed2678d8-794c-49b0-a7b9-b2f0718346e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:46.450700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2678d8-794c-49b0-a7b9-b2f0718346e9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:46.456172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964ea7b-6d4e-40c3-81bc-35f684b9d5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:46.457473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964ea7b-6d4e-40c3-81bc-35f684b9d5c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:46.457741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964ea7b-6d4e-40c3-81bc-35f684b9d5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:46.458092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964ea7b-6d4e-40c3-81bc-35f684b9d5c4 admin admin] PATH_INFO: `/v3/projects/f22dc1bb214f4b0284fec31d2424e0c8/users/c4b69f1d0d4a4bcaaead3a2337d0734e/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:46.460836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964ea7b-6d4e-40c3-81bc-35f684b9d5c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22dc1bb214f4b0284fec31d2424e0c8, user_id=c4b69f1d0d4a4bcaaead3a2337d0734e, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:46.463673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964ea7b-6d4e-40c3-81bc-35f684b9d5c4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:46.475335 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1097/2183] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:46 2022] PUT /identity/v3/projects/f22dc1bb214f4b0284fec31d2424e0c8/users/c4b69f1d0d4a4bcaaead3a2337d0734e/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:46.477045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964ea7b-6d4e-40c3-81bc-35f684b9d5c4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:46.478730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d964ea7b-6d4e-40c3-81bc-35f684b9d5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:46.506925 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1087/2184] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:46 2022] POST /identity/v3/users => generated 296 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:46.508125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8730a-40db-4fce-a886-632715727c67 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:46.513902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2ab8730a-40db-4fce-a886-632715727c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:46.532018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8730a-40db-4fce-a886-632715727c67 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:46.562397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964ea7b-6d4e-40c3-81bc-35f684b9d5c4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:46.568049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194aa4f-c958-469b-8f46-0ddd90125b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:46.568977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194aa4f-c958-469b-8f46-0ddd90125b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:46.569561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194aa4f-c958-469b-8f46-0ddd90125b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:46.569998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194aa4f-c958-469b-8f46-0ddd90125b94 admin admin] PATH_INFO: `/v3/users/a19ecd201b7f455e9a664b4ee16297ab` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:46.571266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194aa4f-c958-469b-8f46-0ddd90125b94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a19ecd201b7f455e9a664b4ee16297ab)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:46.573408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194aa4f-c958-469b-8f46-0ddd90125b94 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:46.604817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df572053-7d5c-4ce6-ab5d-645b3d79cdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:46.611136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df572053-7d5c-4ce6-ab5d-645b3d79cdf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:46.611136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df572053-7d5c-4ce6-ab5d-645b3d79cdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:46.611136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df572053-7d5c-4ce6-ab5d-645b3d79cdf3 admin admin] PATH_INFO: `/v3/users/0691899106224ee5899563f71afb2a60` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:46.611612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df572053-7d5c-4ce6-ab5d-645b3d79cdf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0691899106224ee5899563f71afb2a60)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:46.613818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df572053-7d5c-4ce6-ab5d-645b3d79cdf3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:46.797881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b194aa4f-c958-469b-8f46-0ddd90125b94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a19ecd201b7f455e9a664b4ee16297ab'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:46.810402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b194aa4f-c958-469b-8f46-0ddd90125b94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a19ecd201b7f455e9a664b4ee16297ab'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:46.811226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b194aa4f-c958-469b-8f46-0ddd90125b94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a19ecd201b7f455e9a664b4ee16297ab'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:46.818154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b194aa4f-c958-469b-8f46-0ddd90125b94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a19ecd201b7f455e9a664b4ee16297ab'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:46.853479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-df572053-7d5c-4ce6-ab5d-645b3d79cdf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0691899106224ee5899563f71afb2a60'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:46.867958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-df572053-7d5c-4ce6-ab5d-645b3d79cdf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0691899106224ee5899563f71afb2a60'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:46.868829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-df572053-7d5c-4ce6-ab5d-645b3d79cdf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0691899106224ee5899563f71afb2a60'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:46.877087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-df572053-7d5c-4ce6-ab5d-645b3d79cdf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0691899106224ee5899563f71afb2a60'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:46.885951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b194aa4f-c958-469b-8f46-0ddd90125b94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a19ecd201b7f455e9a664b4ee16297ab'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:46.894131 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1098/2185] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:46 2022] DELETE /identity/v3/users/a19ecd201b7f455e9a664b4ee16297ab => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:46.898819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194aa4f-c958-469b-8f46-0ddd90125b94 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:46.900033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b194aa4f-c958-469b-8f46-0ddd90125b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:46.962221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-df572053-7d5c-4ce6-ab5d-645b3d79cdf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0691899106224ee5899563f71afb2a60'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:46.972516 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1088/2186] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:46 2022] DELETE /identity/v3/users/0691899106224ee5899563f71afb2a60 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:46.973555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df572053-7d5c-4ce6-ab5d-645b3d79cdf3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:46.976407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-df572053-7d5c-4ce6-ab5d-645b3d79cdf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:47.067378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194aa4f-c958-469b-8f46-0ddd90125b94 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:47.170062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab68bf-e4fb-4ab4-8f48-18e8412a1f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:47.171595 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab68bf-e4fb-4ab4-8f48-18e8412a1f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:47.172010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab68bf-e4fb-4ab4-8f48-18e8412a1f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:47.174280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df572053-7d5c-4ce6-ab5d-645b3d79cdf3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:47.174771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab68bf-e4fb-4ab4-8f48-18e8412a1f6d admin admin] PATH_INFO: `/v3/users/6b9c039bb7734998b33e5dc95807c85b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:47.176358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab68bf-e4fb-4ab4-8f48-18e8412a1f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b9c039bb7734998b33e5dc95807c85b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:47.179847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab68bf-e4fb-4ab4-8f48-18e8412a1f6d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:47.182655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d2b85-805c-4c1a-ab57-7efe3eae4176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:47.183541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d2b85-805c-4c1a-ab57-7efe3eae4176 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:47.183962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d2b85-805c-4c1a-ab57-7efe3eae4176 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:47.184379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d2b85-805c-4c1a-ab57-7efe3eae4176 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:47.185249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d2b85-805c-4c1a-ab57-7efe3eae4176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:47.188366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d2b85-805c-4c1a-ab57-7efe3eae4176 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:47.330455 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1089/2187] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:46 2022] POST /identity/v3/users => generated 293 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:47.331883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d2b85-805c-4c1a-ab57-7efe3eae4176 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:47.333834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-597d2b85-805c-4c1a-ab57-7efe3eae4176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:47.348558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d2b85-805c-4c1a-ab57-7efe3eae4176 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:47.355443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f08d97-1147-4987-b030-182c216b192b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:47.356363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f08d97-1147-4987-b030-182c216b192b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:47.356717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f08d97-1147-4987-b030-182c216b192b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:47.356958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f08d97-1147-4987-b030-182c216b192b admin admin] PATH_INFO: `/v3/users/5a985baff1384548876468dcf580eb29` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:47.358929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f08d97-1147-4987-b030-182c216b192b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a985baff1384548876468dcf580eb29)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:47.361555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f08d97-1147-4987-b030-182c216b192b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:47.418330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-79ab68bf-e4fb-4ab4-8f48-18e8412a1f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b9c039bb7734998b33e5dc95807c85b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:47.431305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-79ab68bf-e4fb-4ab4-8f48-18e8412a1f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b9c039bb7734998b33e5dc95807c85b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:47.432039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-79ab68bf-e4fb-4ab4-8f48-18e8412a1f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b9c039bb7734998b33e5dc95807c85b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:47.439003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-79ab68bf-e4fb-4ab4-8f48-18e8412a1f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b9c039bb7734998b33e5dc95807c85b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:47.500730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-79ab68bf-e4fb-4ab4-8f48-18e8412a1f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b9c039bb7734998b33e5dc95807c85b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:47.512828 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1099/2188] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:46 2022] DELETE /identity/v3/users/6b9c039bb7734998b33e5dc95807c85b => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:47.512828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab68bf-e4fb-4ab4-8f48-18e8412a1f6d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:47.513446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-79ab68bf-e4fb-4ab4-8f48-18e8412a1f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:47.569473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e0f08d97-1147-4987-b030-182c216b192b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a985baff1384548876468dcf580eb29'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:47.597481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e0f08d97-1147-4987-b030-182c216b192b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a985baff1384548876468dcf580eb29'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:47.598867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e0f08d97-1147-4987-b030-182c216b192b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a985baff1384548876468dcf580eb29'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:47.610865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e0f08d97-1147-4987-b030-182c216b192b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a985baff1384548876468dcf580eb29'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:47.614258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab68bf-e4fb-4ab4-8f48-18e8412a1f6d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:47.620932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfac3d4-8533-4cd8-85e9-5f70fbcd1ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:47.621997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfac3d4-8533-4cd8-85e9-5f70fbcd1ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:47.622310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfac3d4-8533-4cd8-85e9-5f70fbcd1ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:47.622588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfac3d4-8533-4cd8-85e9-5f70fbcd1ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:47.623351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfac3d4-8533-4cd8-85e9-5f70fbcd1ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:47.625104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfac3d4-8533-4cd8-85e9-5f70fbcd1ce5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:47.636535 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1100/2189] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:47.637981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f375cd5-0398-4020-8f1f-42ab4516394d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:47.638275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f375cd5-0398-4020-8f1f-42ab4516394d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:47.638568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f375cd5-0398-4020-8f1f-42ab4516394d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:47.656903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3f375cd5-0398-4020-8f1f-42ab4516394d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:47.658204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3f375cd5-0398-4020-8f1f-42ab4516394d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:47.666325 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1101/2190] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:47.667230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f375cd5-0398-4020-8f1f-42ab4516394d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:47.668561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3f375cd5-0398-4020-8f1f-42ab4516394d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:47.672298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e0f08d97-1147-4987-b030-182c216b192b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a985baff1384548876468dcf580eb29'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:47.681322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f375cd5-0398-4020-8f1f-42ab4516394d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:47.687635 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1090/2191] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:47 2022] DELETE /identity/v3/users/5a985baff1384548876468dcf580eb29 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:47.687635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f08d97-1147-4987-b030-182c216b192b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:47.687635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e0f08d97-1147-4987-b030-182c216b192b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:47.692772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77698316-5939-4043-a9f4-58f80b1e0513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:47.693469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77698316-5939-4043-a9f4-58f80b1e0513 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:47.693752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77698316-5939-4043-a9f4-58f80b1e0513 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:47.694028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77698316-5939-4043-a9f4-58f80b1e0513 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:47.695090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77698316-5939-4043-a9f4-58f80b1e0513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:47.697496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77698316-5939-4043-a9f4-58f80b1e0513 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:47.710496 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1102/2192] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:47.711976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e022a-eb6f-4c5e-975a-4e51814b6de7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:47.713686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e022a-eb6f-4c5e-975a-4e51814b6de7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:47.713976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e022a-eb6f-4c5e-975a-4e51814b6de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:47.732773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-780e022a-eb6f-4c5e-975a-4e51814b6de7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:47.733983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-780e022a-eb6f-4c5e-975a-4e51814b6de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:47.771773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f08d97-1147-4987-b030-182c216b192b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:47.778286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82727261-bdc9-4a73-ab68-e126eebde36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:47.779574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82727261-bdc9-4a73-ab68-e126eebde36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:47.779978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82727261-bdc9-4a73-ab68-e126eebde36a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:47.780400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82727261-bdc9-4a73-ab68-e126eebde36a admin admin] PATH_INFO: `/v3/projects/dd84716a779541589ad60a7563a191de` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:47.782454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82727261-bdc9-4a73-ab68-e126eebde36a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd84716a779541589ad60a7563a191de)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:47.784840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82727261-bdc9-4a73-ab68-e126eebde36a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:47.805965 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1103/2193] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:47.806997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e022a-eb6f-4c5e-975a-4e51814b6de7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:47.808434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-780e022a-eb6f-4c5e-975a-4e51814b6de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:47.821097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e022a-eb6f-4c5e-975a-4e51814b6de7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:47.834567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a4e1a-f32c-4ecc-b5c6-375f3d9306dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:47.835882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a4e1a-f32c-4ecc-b5c6-375f3d9306dd admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:47.836316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a4e1a-f32c-4ecc-b5c6-375f3d9306dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:47.836658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a4e1a-f32c-4ecc-b5c6-375f3d9306dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:47.837429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a4e1a-f32c-4ecc-b5c6-375f3d9306dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:47.842050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a4e1a-f32c-4ecc-b5c6-375f3d9306dd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:47.856885 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1104/2194] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:47.856885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a4e1a-f32c-4ecc-b5c6-375f3d9306dd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:47.856885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-558a4e1a-f32c-4ecc-b5c6-375f3d9306dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:47.921738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a4e1a-f32c-4ecc-b5c6-375f3d9306dd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:47.927038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbde47-fea5-4190-8eef-cf963fae512f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:47.927790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbde47-fea5-4190-8eef-cf963fae512f service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:47.928126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbde47-fea5-4190-8eef-cf963fae512f service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:47.928347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbde47-fea5-4190-8eef-cf963fae512f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:47.931525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-56dbde47-fea5-4190-8eef-cf963fae512f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:47.947579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbde47-fea5-4190-8eef-cf963fae512f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:47.949200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbde47-fea5-4190-8eef-cf963fae512f service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:47.954752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-82727261-bdc9-4a73-ab68-e126eebde36a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd84716a779541589ad60a7563a191de', 'request_id': 'req-82727261-bdc9-4a73-ab68-e126eebde36a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:47.968211 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1105/2195] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:47.969932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbde47-fea5-4190-8eef-cf963fae512f service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:47.971081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-56dbde47-fea5-4190-8eef-cf963fae512f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:47.985220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbde47-fea5-4190-8eef-cf963fae512f service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:48.045395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-82727261-bdc9-4a73-ab68-e126eebde36a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd84716a779541589ad60a7563a191de', 'request_id': 'req-82727261-bdc9-4a73-ab68-e126eebde36a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:48.054475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-82727261-bdc9-4a73-ab68-e126eebde36a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd84716a779541589ad60a7563a191de', 'request_id': 'req-82727261-bdc9-4a73-ab68-e126eebde36a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:48.076995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-82727261-bdc9-4a73-ab68-e126eebde36a admin admin] The token cache is being invalidate because project dd84716a779541589ad60a7563a191de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:48.077826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-82727261-bdc9-4a73-ab68-e126eebde36a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:48.080237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-82727261-bdc9-4a73-ab68-e126eebde36a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:48.081789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc2022-27ba-46f3-817d-de684f6831e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:48.082715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc2022-27ba-46f3-817d-de684f6831e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:48.083083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc2022-27ba-46f3-817d-de684f6831e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:48.083261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc2022-27ba-46f3-817d-de684f6831e6 admin admin] PATH_INFO: `/v3/projects/d6dd5bacdef2423289ad6e616be5f19b/users/47853e4aa36c4e82893a7040d89d637b/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:48.083670 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1091/2196] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:47 2022] DELETE /identity/v3/projects/dd84716a779541589ad60a7563a191de => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:48.085672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82727261-bdc9-4a73-ab68-e126eebde36a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:48.099769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-82727261-bdc9-4a73-ab68-e126eebde36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:48.118916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc2022-27ba-46f3-817d-de684f6831e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6dd5bacdef2423289ad6e616be5f19b, user_id=47853e4aa36c4e82893a7040d89d637b, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:48.123461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc2022-27ba-46f3-817d-de684f6831e6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:48.212279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82727261-bdc9-4a73-ab68-e126eebde36a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:48.222637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da612c83-fa3e-4a9f-8cbc-98af94518ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:48.222637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da612c83-fa3e-4a9f-8cbc-98af94518ecf service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:48.222637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da612c83-fa3e-4a9f-8cbc-98af94518ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:48.222637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da612c83-fa3e-4a9f-8cbc-98af94518ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:48.223182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-da612c83-fa3e-4a9f-8cbc-98af94518ecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:48.245202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da612c83-fa3e-4a9f-8cbc-98af94518ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:48.254467 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1106/2197] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:47 2022] PUT /identity/v3/projects/d6dd5bacdef2423289ad6e616be5f19b/users/47853e4aa36c4e82893a7040d89d637b/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:48.255429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc2022-27ba-46f3-817d-de684f6831e6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:48.258394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da612c83-fa3e-4a9f-8cbc-98af94518ecf service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:48.263392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-00fc2022-27ba-46f3-817d-de684f6831e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:48.280906 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1092/2198] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:48.280906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c78e1-b5b6-4a17-8bce-4fd027e50d2d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:48.280906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c78e1-b5b6-4a17-8bce-4fd027e50d2d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:48.281135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c78e1-b5b6-4a17-8bce-4fd027e50d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:48.325571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3e2c78e1-b5b6-4a17-8bce-4fd027e50d2d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:48.325571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3e2c78e1-b5b6-4a17-8bce-4fd027e50d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:48.440024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc2022-27ba-46f3-817d-de684f6831e6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:48.447982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97647057-8cb4-434d-9ca2-6fab24282600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:48.449525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97647057-8cb4-434d-9ca2-6fab24282600 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:48.449816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97647057-8cb4-434d-9ca2-6fab24282600 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:48.450144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97647057-8cb4-434d-9ca2-6fab24282600 admin admin] PATH_INFO: `/v3/projects/dfd2674341c94263a211d012d3ffe7b6/users/702e6ff21e6f44ef9b6d9bb12e890417/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:48.468797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97647057-8cb4-434d-9ca2-6fab24282600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfd2674341c94263a211d012d3ffe7b6, user_id=702e6ff21e6f44ef9b6d9bb12e890417, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:48.471833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97647057-8cb4-434d-9ca2-6fab24282600 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:48.481718 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1093/2199] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:48.489708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c78e1-b5b6-4a17-8bce-4fd027e50d2d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:48.492246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3e2c78e1-b5b6-4a17-8bce-4fd027e50d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:48.506104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c78e1-b5b6-4a17-8bce-4fd027e50d2d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:48.512158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e79d2-d9ea-479c-9014-e587484cea13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:48.512851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e79d2-d9ea-479c-9014-e587484cea13 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:48.513178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e79d2-d9ea-479c-9014-e587484cea13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:48.513439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e79d2-d9ea-479c-9014-e587484cea13 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:48.514249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e79d2-d9ea-479c-9014-e587484cea13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:48.516099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e79d2-d9ea-479c-9014-e587484cea13 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:48.528641 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1094/2200] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:48.532497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e79d2-d9ea-479c-9014-e587484cea13 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:48.534548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5c0e79d2-d9ea-479c-9014-e587484cea13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:48.550607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e79d2-d9ea-479c-9014-e587484cea13 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:48.561898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806738f8-4bcf-4314-8f92-3a5144fcf24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:48.562826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806738f8-4bcf-4314-8f92-3a5144fcf24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:48.563222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806738f8-4bcf-4314-8f92-3a5144fcf24e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:48.567735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806738f8-4bcf-4314-8f92-3a5144fcf24e admin admin] PATH_INFO: `/v3/projects/bb454cfb71424cbab78e836fdb97792e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:48.567735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806738f8-4bcf-4314-8f92-3a5144fcf24e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb454cfb71424cbab78e836fdb97792e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:48.567735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806738f8-4bcf-4314-8f92-3a5144fcf24e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:48.574390 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1107/2201] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:48 2022] PUT /identity/v3/projects/dfd2674341c94263a211d012d3ffe7b6/users/702e6ff21e6f44ef9b6d9bb12e890417/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:48.587579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97647057-8cb4-434d-9ca2-6fab24282600 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:48.590725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-97647057-8cb4-434d-9ca2-6fab24282600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:48.696018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-806738f8-4bcf-4314-8f92-3a5144fcf24e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb454cfb71424cbab78e836fdb97792e', 'request_id': 'req-806738f8-4bcf-4314-8f92-3a5144fcf24e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:48.702359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97647057-8cb4-434d-9ca2-6fab24282600 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:48.776836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-806738f8-4bcf-4314-8f92-3a5144fcf24e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb454cfb71424cbab78e836fdb97792e', 'request_id': 'req-806738f8-4bcf-4314-8f92-3a5144fcf24e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:48.787198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-806738f8-4bcf-4314-8f92-3a5144fcf24e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb454cfb71424cbab78e836fdb97792e', 'request_id': 'req-806738f8-4bcf-4314-8f92-3a5144fcf24e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:48.794525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042da9dc-de07-405a-834f-c9e1ce6293d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:48.796176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042da9dc-de07-405a-834f-c9e1ce6293d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:48.796658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042da9dc-de07-405a-834f-c9e1ce6293d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:48.797090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042da9dc-de07-405a-834f-c9e1ce6293d7 admin admin] PATH_INFO: `/v3/projects/719f21ad39f647578720c65c2b75d180` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:48.799557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042da9dc-de07-405a-834f-c9e1ce6293d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=719f21ad39f647578720c65c2b75d180)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:48.800277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-806738f8-4bcf-4314-8f92-3a5144fcf24e admin admin] The token cache is being invalidate because project bb454cfb71424cbab78e836fdb97792e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:48.800673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-806738f8-4bcf-4314-8f92-3a5144fcf24e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:48.801438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-806738f8-4bcf-4314-8f92-3a5144fcf24e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:48.803638 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1095/2202] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:48 2022] DELETE /identity/v3/projects/bb454cfb71424cbab78e836fdb97792e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:48.804167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042da9dc-de07-405a-834f-c9e1ce6293d7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:48.804976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15909f9b-91ad-48c0-836d-4702b16dd09a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:48.808469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15909f9b-91ad-48c0-836d-4702b16dd09a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:48.808469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15909f9b-91ad-48c0-836d-4702b16dd09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:48.826509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-15909f9b-91ad-48c0-836d-4702b16dd09a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:48.828229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-15909f9b-91ad-48c0-836d-4702b16dd09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:48.841374 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1096/2203] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:48.842311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15909f9b-91ad-48c0-836d-4702b16dd09a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:48.843866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-15909f9b-91ad-48c0-836d-4702b16dd09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:48.856993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15909f9b-91ad-48c0-836d-4702b16dd09a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:48.862892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13364e1-af8f-41f5-8f02-1251f25287cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:48.863297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13364e1-af8f-41f5-8f02-1251f25287cf admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:48.866063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13364e1-af8f-41f5-8f02-1251f25287cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:48.866063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13364e1-af8f-41f5-8f02-1251f25287cf admin admin] PATH_INFO: `/v3/projects/d6dd5bacdef2423289ad6e616be5f19b/users/47853e4aa36c4e82893a7040d89d637b/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:48.869817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13364e1-af8f-41f5-8f02-1251f25287cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6dd5bacdef2423289ad6e616be5f19b, user_id=47853e4aa36c4e82893a7040d89d637b, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:48.873020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13364e1-af8f-41f5-8f02-1251f25287cf admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:48.888696 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1097/2204] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:48 2022] PUT /identity/v3/projects/d6dd5bacdef2423289ad6e616be5f19b/users/47853e4aa36c4e82893a7040d89d637b/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:48.891049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bd591-df39-4883-9102-d5efc2af5aba None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:48.891578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bd591-df39-4883-9102-d5efc2af5aba None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:48.892587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bd591-df39-4883-9102-d5efc2af5aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:48.944891 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-042da9dc-de07-405a-834f-c9e1ce6293d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '719f21ad39f647578720c65c2b75d180', 'request_id': 'req-042da9dc-de07-405a-834f-c9e1ce6293d7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:48.948720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-aa7bd591-df39-4883-9102-d5efc2af5aba None None] MFA Rules not processed for user `702e6ff21e6f44ef9b6d9bb12e890417`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:48.952058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-aa7bd591-df39-4883-9102-d5efc2af5aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:48.957687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-042da9dc-de07-405a-834f-c9e1ce6293d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '719f21ad39f647578720c65c2b75d180', 'request_id': 'req-042da9dc-de07-405a-834f-c9e1ce6293d7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:49.028464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-042da9dc-de07-405a-834f-c9e1ce6293d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '719f21ad39f647578720c65c2b75d180', 'request_id': 'req-042da9dc-de07-405a-834f-c9e1ce6293d7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:49.041709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-042da9dc-de07-405a-834f-c9e1ce6293d7 admin admin] The token cache is being invalidate because project 719f21ad39f647578720c65c2b75d180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:49.041932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-042da9dc-de07-405a-834f-c9e1ce6293d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:49.042731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-042da9dc-de07-405a-834f-c9e1ce6293d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:49.047400 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1108/2205] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:48 2022] DELETE /identity/v3/projects/719f21ad39f647578720c65c2b75d180 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:49.049036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051fa83-094c-48a1-abf5-0e502928bb10 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:49.049329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051fa83-094c-48a1-abf5-0e502928bb10 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:49.049762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051fa83-094c-48a1-abf5-0e502928bb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:49.050115 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1098/2206] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:49.051072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bd591-df39-4883-9102-d5efc2af5aba None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:49.069341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0051fa83-094c-48a1-abf5-0e502928bb10 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:49.070570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0051fa83-094c-48a1-abf5-0e502928bb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:49.142227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bd591-df39-4883-9102-d5efc2af5aba None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:49.148942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2509c-b2e7-4a0a-aff3-5b72ed530e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:49.149662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2509c-b2e7-4a0a-aff3-5b72ed530e6d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:49.149954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2509c-b2e7-4a0a-aff3-5b72ed530e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:49.150233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2509c-b2e7-4a0a-aff3-5b72ed530e6d admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:49.151871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2509c-b2e7-4a0a-aff3-5b72ed530e6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:49.151994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2509c-b2e7-4a0a-aff3-5b72ed530e6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:49.155600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2509c-b2e7-4a0a-aff3-5b72ed530e6d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:49.169021 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1109/2207] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:49.169951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051fa83-094c-48a1-abf5-0e502928bb10 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:49.171234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0051fa83-094c-48a1-abf5-0e502928bb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:49.180819 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1099/2208] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:49.180819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bc9da-ebf0-4062-ac4b-3519895dd8d5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:49.180819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bc9da-ebf0-4062-ac4b-3519895dd8d5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:49.180819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bc9da-ebf0-4062-ac4b-3519895dd8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:49.185041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051fa83-094c-48a1-abf5-0e502928bb10 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:49.190948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3332d2e-6c76-47ef-8aa8-62adb662e368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:49.191855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3332d2e-6c76-47ef-8aa8-62adb662e368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:49.192189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3332d2e-6c76-47ef-8aa8-62adb662e368 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:49.192481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3332d2e-6c76-47ef-8aa8-62adb662e368 admin admin] PATH_INFO: `/v3/projects/be65968774104e589193bea13015c88f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:49.194717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3332d2e-6c76-47ef-8aa8-62adb662e368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be65968774104e589193bea13015c88f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:49.196826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3332d2e-6c76-47ef-8aa8-62adb662e368 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:49.208575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-256bc9da-ebf0-4062-ac4b-3519895dd8d5 None None] MFA Rules not processed for user `47853e4aa36c4e82893a7040d89d637b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:49.212183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-256bc9da-ebf0-4062-ac4b-3519895dd8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:49.307960 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1100/2209] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:49.313720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bc9da-ebf0-4062-ac4b-3519895dd8d5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:49.313720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-256bc9da-ebf0-4062-ac4b-3519895dd8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:49.317451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e3332d2e-6c76-47ef-8aa8-62adb662e368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be65968774104e589193bea13015c88f', 'request_id': 'req-e3332d2e-6c76-47ef-8aa8-62adb662e368'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:49.327754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bc9da-ebf0-4062-ac4b-3519895dd8d5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:49.329348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e3332d2e-6c76-47ef-8aa8-62adb662e368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be65968774104e589193bea13015c88f', 'request_id': 'req-e3332d2e-6c76-47ef-8aa8-62adb662e368'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:49.392431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c1591-96e7-43a7-bcad-93bd61dcc72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:49.393799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c1591-96e7-43a7-bcad-93bd61dcc72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:49.393799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c1591-96e7-43a7-bcad-93bd61dcc72e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:49.394026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c1591-96e7-43a7-bcad-93bd61dcc72e admin admin] PATH_INFO: `/v3/users/e8abfe72b83d41559f88364dd44619c3` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:49.395270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c1591-96e7-43a7-bcad-93bd61dcc72e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8abfe72b83d41559f88364dd44619c3)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:49.397487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c1591-96e7-43a7-bcad-93bd61dcc72e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:49.424410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e3332d2e-6c76-47ef-8aa8-62adb662e368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be65968774104e589193bea13015c88f', 'request_id': 'req-e3332d2e-6c76-47ef-8aa8-62adb662e368'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:49.437726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e3332d2e-6c76-47ef-8aa8-62adb662e368 admin admin] The token cache is being invalidate because project be65968774104e589193bea13015c88f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:49.438327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e3332d2e-6c76-47ef-8aa8-62adb662e368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:49.439835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e3332d2e-6c76-47ef-8aa8-62adb662e368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:49.443118 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1110/2210] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:49 2022] DELETE /identity/v3/projects/be65968774104e589193bea13015c88f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:49.443873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3332d2e-6c76-47ef-8aa8-62adb662e368 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:49.445878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e3332d2e-6c76-47ef-8aa8-62adb662e368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:49.459886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3332d2e-6c76-47ef-8aa8-62adb662e368 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:49.464858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e801b68-d00c-44ba-aaa4-c911fb8bd0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:49.465610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e801b68-d00c-44ba-aaa4-c911fb8bd0de admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:49.466255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e801b68-d00c-44ba-aaa4-c911fb8bd0de admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:49.466255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e801b68-d00c-44ba-aaa4-c911fb8bd0de admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:49.466875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e801b68-d00c-44ba-aaa4-c911fb8bd0de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:49.469066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e801b68-d00c-44ba-aaa4-c911fb8bd0de admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:49.560546 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1111/2211] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:49 2022] POST /identity/v3/projects => generated 391 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:49.562272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c307bf-ed81-4567-97f7-d7c9f9e18413 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:49.562777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c307bf-ed81-4567-97f7-d7c9f9e18413 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:49.563060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c307bf-ed81-4567-97f7-d7c9f9e18413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:49.584039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f9c307bf-ed81-4567-97f7-d7c9f9e18413 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:49.585373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f9c307bf-ed81-4567-97f7-d7c9f9e18413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:49.595627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-681c1591-96e7-43a7-bcad-93bd61dcc72e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8abfe72b83d41559f88364dd44619c3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:49.609429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-681c1591-96e7-43a7-bcad-93bd61dcc72e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8abfe72b83d41559f88364dd44619c3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:49.610170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-681c1591-96e7-43a7-bcad-93bd61dcc72e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8abfe72b83d41559f88364dd44619c3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:49.618582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-681c1591-96e7-43a7-bcad-93bd61dcc72e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8abfe72b83d41559f88364dd44619c3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:49.646705 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1112/2212] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:49.647564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c307bf-ed81-4567-97f7-d7c9f9e18413 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:49.648885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f9c307bf-ed81-4567-97f7-d7c9f9e18413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:49.662657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c307bf-ed81-4567-97f7-d7c9f9e18413 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:49.668793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb590d-a42a-44ae-aeb8-b728f073f8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:49.669528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb590d-a42a-44ae-aeb8-b728f073f8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:49.669979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb590d-a42a-44ae-aeb8-b728f073f8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:49.670356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb590d-a42a-44ae-aeb8-b728f073f8c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:49.671168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb590d-a42a-44ae-aeb8-b728f073f8c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:49.673255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb590d-a42a-44ae-aeb8-b728f073f8c1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:49.702641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-681c1591-96e7-43a7-bcad-93bd61dcc72e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8abfe72b83d41559f88364dd44619c3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:49.711565 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1101/2213] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:49 2022] DELETE /identity/v3/users/e8abfe72b83d41559f88364dd44619c3 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:49.712576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c1591-96e7-43a7-bcad-93bd61dcc72e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:49.714340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-681c1591-96e7-43a7-bcad-93bd61dcc72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:49.808586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c1591-96e7-43a7-bcad-93bd61dcc72e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:49.815076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf98bab-9db5-4479-8b3a-362da5da0348 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47853e4aa36c4e82893a7040d89d637b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6dd5bacdef2423289ad6e616be5f19b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:49.815935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf98bab-9db5-4479-8b3a-362da5da0348 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:49.816139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf98bab-9db5-4479-8b3a-362da5da0348 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:49.818675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf98bab-9db5-4479-8b3a-362da5da0348 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:49.820063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf98bab-9db5-4479-8b3a-362da5da0348 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:49.824334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf98bab-9db5-4479-8b3a-362da5da0348 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:49.826807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf98bab-9db5-4479-8b3a-362da5da0348 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:49.842343 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1113/2214] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:49 2022] POST /identity/v3/projects => generated 395 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:49.844221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb590d-a42a-44ae-aeb8-b728f073f8c1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:49.845411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-12bb590d-a42a-44ae-aeb8-b728f073f8c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:49.845662 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1102/2215] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:49.846627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf98bab-9db5-4479-8b3a-362da5da0348 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:49.848228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-edf98bab-9db5-4479-8b3a-362da5da0348 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:49.935796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb590d-a42a-44ae-aeb8-b728f073f8c1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:49.937952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf98bab-9db5-4479-8b3a-362da5da0348 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:49.941042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bf5ff-a0f8-41c2-a202-31d9b76bb117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:49.941981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bf5ff-a0f8-41c2-a202-31d9b76bb117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:49.942283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bf5ff-a0f8-41c2-a202-31d9b76bb117 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:49.942554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bf5ff-a0f8-41c2-a202-31d9b76bb117 admin admin] PATH_INFO: `/v3/users/19ab9c8dcb194494a7ac38e286edb1d9` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:49.944275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bf5ff-a0f8-41c2-a202-31d9b76bb117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ab9c8dcb194494a7ac38e286edb1d9)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:49.946277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bf5ff-a0f8-41c2-a202-31d9b76bb117 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:49.953697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1ccd9-ecbb-463c-a6c7-d96d43bafb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:49.953697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1ccd9-ecbb-463c-a6c7-d96d43bafb07 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:49.953697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1ccd9-ecbb-463c-a6c7-d96d43bafb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:49.953697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1ccd9-ecbb-463c-a6c7-d96d43bafb07 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:49.953982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1ccd9-ecbb-463c-a6c7-d96d43bafb07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:49.955381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1ccd9-ecbb-463c-a6c7-d96d43bafb07 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:50.089952 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1103/2216] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:49 2022] POST /identity/v3/users => generated 302 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:50.089952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1ccd9-ecbb-463c-a6c7-d96d43bafb07 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:50.097262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fef1ccd9-ecbb-463c-a6c7-d96d43bafb07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:50.122600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1ccd9-ecbb-463c-a6c7-d96d43bafb07 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:50.147789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6bb48-f357-4031-b054-9806f46242f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:50.148926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6bb48-f357-4031-b054-9806f46242f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:50.149616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6bb48-f357-4031-b054-9806f46242f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:50.150100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6bb48-f357-4031-b054-9806f46242f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:50.150994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6bb48-f357-4031-b054-9806f46242f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:50.151460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6bb48-f357-4031-b054-9806f46242f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:50.153354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6bb48-f357-4031-b054-9806f46242f3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:50.173457 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1104/2217] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:50.174575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6bb48-f357-4031-b054-9806f46242f3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:50.178735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-44e6bb48-f357-4031-b054-9806f46242f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:50.207138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6bb48-f357-4031-b054-9806f46242f3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:50.208552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e64bf5ff-a0f8-41c2-a202-31d9b76bb117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ab9c8dcb194494a7ac38e286edb1d9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:50.215613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bde8af-5c8a-46f6-8f94-1d0d538f7bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:50.220844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bde8af-5c8a-46f6-8f94-1d0d538f7bbe admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:50.220844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bde8af-5c8a-46f6-8f94-1d0d538f7bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:50.220844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bde8af-5c8a-46f6-8f94-1d0d538f7bbe admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:50.220844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bde8af-5c8a-46f6-8f94-1d0d538f7bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:50.227239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bde8af-5c8a-46f6-8f94-1d0d538f7bbe admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:50.241864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e64bf5ff-a0f8-41c2-a202-31d9b76bb117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ab9c8dcb194494a7ac38e286edb1d9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:50.244296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e64bf5ff-a0f8-41c2-a202-31d9b76bb117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ab9c8dcb194494a7ac38e286edb1d9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:50.257410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e64bf5ff-a0f8-41c2-a202-31d9b76bb117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ab9c8dcb194494a7ac38e286edb1d9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:50.321606 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1105/2218] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:50 2022] POST /identity/v3/users => generated 298 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:50.322353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bde8af-5c8a-46f6-8f94-1d0d538f7bbe admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:50.355729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e64bf5ff-a0f8-41c2-a202-31d9b76bb117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ab9c8dcb194494a7ac38e286edb1d9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:50.362660 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1114/2219] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:49 2022] DELETE /identity/v3/users/19ab9c8dcb194494a7ac38e286edb1d9 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:50.367233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bf5ff-a0f8-41c2-a202-31d9b76bb117 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:50.369620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e64bf5ff-a0f8-41c2-a202-31d9b76bb117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:50.411976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bde8af-5c8a-46f6-8f94-1d0d538f7bbe admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:50.477537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bf5ff-a0f8-41c2-a202-31d9b76bb117 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:50.483541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5980f8-d67e-404c-9937-05e086f6ea45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:50.484771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5980f8-d67e-404c-9937-05e086f6ea45 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:50.485209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5980f8-d67e-404c-9937-05e086f6ea45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:50.486012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5980f8-d67e-404c-9937-05e086f6ea45 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:50.486998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5980f8-d67e-404c-9937-05e086f6ea45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:50.489231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5980f8-d67e-404c-9937-05e086f6ea45 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:50.503919 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1115/2220] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:50.505357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5980f8-d67e-404c-9937-05e086f6ea45 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:50.508646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9e5980f8-d67e-404c-9937-05e086f6ea45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:50.526285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5980f8-d67e-404c-9937-05e086f6ea45 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:50.532401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03039e-abba-45fc-84ed-184c269cb0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:50.533303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03039e-abba-45fc-84ed-184c269cb0f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:50.533868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03039e-abba-45fc-84ed-184c269cb0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:50.533868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03039e-abba-45fc-84ed-184c269cb0f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:50.534626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03039e-abba-45fc-84ed-184c269cb0f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:50.536792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03039e-abba-45fc-84ed-184c269cb0f4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:50.543830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b91e1-52e3-446c-a567-3207b0f75118 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47853e4aa36c4e82893a7040d89d637b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6dd5bacdef2423289ad6e616be5f19b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:50.545305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b91e1-52e3-446c-a567-3207b0f75118 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:50.545739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b91e1-52e3-446c-a567-3207b0f75118 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:50.546206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b91e1-52e3-446c-a567-3207b0f75118 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:50.547055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b91e1-52e3-446c-a567-3207b0f75118 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:50.552843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b91e1-52e3-446c-a567-3207b0f75118 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:50.667854 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1106/2221] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:50 2022] POST /identity/v3/projects => generated 371 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:50.669484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b91e1-52e3-446c-a567-3207b0f75118 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:50.674645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c92b91e1-52e3-446c-a567-3207b0f75118 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:50.678173 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1116/2222] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:50 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:50.680837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03039e-abba-45fc-84ed-184c269cb0f4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:50.685607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6c03039e-abba-45fc-84ed-184c269cb0f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:50.771023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b91e1-52e3-446c-a567-3207b0f75118 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:50.776871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80960c-3a7b-40fa-a5cf-3b9deee7330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:50.777917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80960c-3a7b-40fa-a5cf-3b9deee7330a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:50.779374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80960c-3a7b-40fa-a5cf-3b9deee7330a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:50.779374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80960c-3a7b-40fa-a5cf-3b9deee7330a admin admin] PATH_INFO: `/v3/projects/b07ea8f635c843389eede0b311267490` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:50.782105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03039e-abba-45fc-84ed-184c269cb0f4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:50.785721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80960c-3a7b-40fa-a5cf-3b9deee7330a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b07ea8f635c843389eede0b311267490)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:50.788503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80960c-3a7b-40fa-a5cf-3b9deee7330a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:50.795206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccc2d7-6d10-4b1f-a7f8-d8673c3678cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:50.796195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccc2d7-6d10-4b1f-a7f8-d8673c3678cb admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:50.796692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccc2d7-6d10-4b1f-a7f8-d8673c3678cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:50.797121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccc2d7-6d10-4b1f-a7f8-d8673c3678cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:50.797998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ccc2d7-6d10-4b1f-a7f8-d8673c3678cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:50.799808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ccc2d7-6d10-4b1f-a7f8-d8673c3678cb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:50.814348 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1117/2223] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:50.814348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccc2d7-6d10-4b1f-a7f8-d8673c3678cb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:50.824453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccc2d7-6d10-4b1f-a7f8-d8673c3678cb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:50.830249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e6675-656c-459a-96e2-5ba0844201f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:50.831352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e6675-656c-459a-96e2-5ba0844201f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:50.831603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e6675-656c-459a-96e2-5ba0844201f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:50.833881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e6675-656c-459a-96e2-5ba0844201f4 admin admin] PATH_INFO: `/v3/projects/f0c1a1fd2e6f4c2486bfd63750ae7d64/users/b06d1e15c6ac439e867fc1ac00631b0c/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:50.849964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e6675-656c-459a-96e2-5ba0844201f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c1a1fd2e6f4c2486bfd63750ae7d64, user_id=b06d1e15c6ac439e867fc1ac00631b0c, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:50.853451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e6675-656c-459a-96e2-5ba0844201f4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:50.986960 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1118/2224] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:50 2022] PUT /identity/v3/projects/f0c1a1fd2e6f4c2486bfd63750ae7d64/users/b06d1e15c6ac439e867fc1ac00631b0c/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:50.986960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e6675-656c-459a-96e2-5ba0844201f4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:50.989686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f74e6675-656c-459a-96e2-5ba0844201f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:51.001796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4f80960c-3a7b-40fa-a5cf-3b9deee7330a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b07ea8f635c843389eede0b311267490', 'request_id': 'req-4f80960c-3a7b-40fa-a5cf-3b9deee7330a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:51.088100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4f80960c-3a7b-40fa-a5cf-3b9deee7330a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b07ea8f635c843389eede0b311267490', 'request_id': 'req-4f80960c-3a7b-40fa-a5cf-3b9deee7330a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:51.096969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e6675-656c-459a-96e2-5ba0844201f4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:51.108798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4f80960c-3a7b-40fa-a5cf-3b9deee7330a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b07ea8f635c843389eede0b311267490', 'request_id': 'req-4f80960c-3a7b-40fa-a5cf-3b9deee7330a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:51.131109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab49b1-5060-41bc-a055-2d568ccb0084 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47853e4aa36c4e82893a7040d89d637b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6dd5bacdef2423289ad6e616be5f19b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:51.133450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab49b1-5060-41bc-a055-2d568ccb0084 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:51.134602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab49b1-5060-41bc-a055-2d568ccb0084 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:51.135317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab49b1-5060-41bc-a055-2d568ccb0084 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:51.139280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4f80960c-3a7b-40fa-a5cf-3b9deee7330a admin admin] The token cache is being invalidate because project b07ea8f635c843389eede0b311267490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:51.139599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab49b1-5060-41bc-a055-2d568ccb0084 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:51.140023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab49b1-5060-41bc-a055-2d568ccb0084 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:51.141890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab49b1-5060-41bc-a055-2d568ccb0084 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:51.142324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4f80960c-3a7b-40fa-a5cf-3b9deee7330a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:51.143859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4f80960c-3a7b-40fa-a5cf-3b9deee7330a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:51.145935 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1107/2225] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:50 2022] DELETE /identity/v3/projects/b07ea8f635c843389eede0b311267490 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:51.150197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80960c-3a7b-40fa-a5cf-3b9deee7330a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:51.152951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4f80960c-3a7b-40fa-a5cf-3b9deee7330a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:51.175801 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1119/2226] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:51.175801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab49b1-5060-41bc-a055-2d568ccb0084 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:51.182173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-63ab49b1-5060-41bc-a055-2d568ccb0084 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:51.297946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab49b1-5060-41bc-a055-2d568ccb0084 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:51.298148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80960c-3a7b-40fa-a5cf-3b9deee7330a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:51.306837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe648377-b8b9-4c52-b4fc-58c386b2c225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:51.308086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe648377-b8b9-4c52-b4fc-58c386b2c225 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:51.308958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe648377-b8b9-4c52-b4fc-58c386b2c225 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:51.309414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe648377-b8b9-4c52-b4fc-58c386b2c225 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:51.310733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe648377-b8b9-4c52-b4fc-58c386b2c225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:51.311213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bdb98-53e5-4c5f-bcc5-22555ae5febe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:51.312019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bdb98-53e5-4c5f-bcc5-22555ae5febe admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:51.312334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bdb98-53e5-4c5f-bcc5-22555ae5febe admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:51.312815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bdb98-53e5-4c5f-bcc5-22555ae5febe admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:51.317042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5bdb98-53e5-4c5f-bcc5-22555ae5febe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:51.317122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe648377-b8b9-4c52-b4fc-58c386b2c225 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:51.317235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5bdb98-53e5-4c5f-bcc5-22555ae5febe admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:51.331748 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1120/2227] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:51.333162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe648377-b8b9-4c52-b4fc-58c386b2c225 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:51.335759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fe648377-b8b9-4c52-b4fc-58c386b2c225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:51.352849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe648377-b8b9-4c52-b4fc-58c386b2c225 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:51.359557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ac535-69b1-4058-86ed-23206813ebe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:51.360406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ac535-69b1-4058-86ed-23206813ebe9 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:51.360982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ac535-69b1-4058-86ed-23206813ebe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:51.361368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ac535-69b1-4058-86ed-23206813ebe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:51.364547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ac535-69b1-4058-86ed-23206813ebe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:51.366522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ac535-69b1-4058-86ed-23206813ebe9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:51.386225 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1121/2228] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:51.386225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ac535-69b1-4058-86ed-23206813ebe9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:51.387394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-790ac535-69b1-4058-86ed-23206813ebe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:51.402796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ac535-69b1-4058-86ed-23206813ebe9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:51.410923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed327ee-0c5d-4f69-aad3-337f17c5c63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:51.412816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed327ee-0c5d-4f69-aad3-337f17c5c63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:51.413356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed327ee-0c5d-4f69-aad3-337f17c5c63c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:51.413715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed327ee-0c5d-4f69-aad3-337f17c5c63c admin admin] PATH_INFO: `/v3/projects/f9ea23daef7142c3bedd1868bb13b05f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:51.415639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed327ee-0c5d-4f69-aad3-337f17c5c63c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9ea23daef7142c3bedd1868bb13b05f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:51.418252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed327ee-0c5d-4f69-aad3-337f17c5c63c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:51.453675 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1108/2229] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:51 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:51.455424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19c798-e68a-49c4-a77c-c2a4659471e7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:51.455772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19c798-e68a-49c4-a77c-c2a4659471e7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:51.456072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19c798-e68a-49c4-a77c-c2a4659471e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:51.504648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3a19c798-e68a-49c4-a77c-c2a4659471e7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:51.509789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3a19c798-e68a-49c4-a77c-c2a4659471e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:51.540148 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1109/2230] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:51.541115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19c798-e68a-49c4-a77c-c2a4659471e7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:51.542434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3a19c798-e68a-49c4-a77c-c2a4659471e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:51.660736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4ed327ee-0c5d-4f69-aad3-337f17c5c63c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9ea23daef7142c3bedd1868bb13b05f', 'request_id': 'req-4ed327ee-0c5d-4f69-aad3-337f17c5c63c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:51.677615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4ed327ee-0c5d-4f69-aad3-337f17c5c63c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9ea23daef7142c3bedd1868bb13b05f', 'request_id': 'req-4ed327ee-0c5d-4f69-aad3-337f17c5c63c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:51.725756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19c798-e68a-49c4-a77c-c2a4659471e7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:51.753507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4ed327ee-0c5d-4f69-aad3-337f17c5c63c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9ea23daef7142c3bedd1868bb13b05f', 'request_id': 'req-4ed327ee-0c5d-4f69-aad3-337f17c5c63c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:51.768635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4ed327ee-0c5d-4f69-aad3-337f17c5c63c admin admin] The token cache is being invalidate because project f9ea23daef7142c3bedd1868bb13b05f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:51.769371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4ed327ee-0c5d-4f69-aad3-337f17c5c63c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:51.770338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4ed327ee-0c5d-4f69-aad3-337f17c5c63c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:51.772847 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1122/2231] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:51 2022] DELETE /identity/v3/projects/f9ea23daef7142c3bedd1868bb13b05f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:51.774633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed327ee-0c5d-4f69-aad3-337f17c5c63c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:51.777069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4ed327ee-0c5d-4f69-aad3-337f17c5c63c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:51.823981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b5c82-8b16-4af1-8cec-efbe263756b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:51.824921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b5c82-8b16-4af1-8cec-efbe263756b0 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:51.825033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b5c82-8b16-4af1-8cec-efbe263756b0 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:51.825227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b5c82-8b16-4af1-8cec-efbe263756b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:51.827164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-658b5c82-8b16-4af1-8cec-efbe263756b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:51.846276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed327ee-0c5d-4f69-aad3-337f17c5c63c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:51.852960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103b907-5446-497f-9987-c7a0e644ba01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:51.853871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103b907-5446-497f-9987-c7a0e644ba01 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:51.854160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103b907-5446-497f-9987-c7a0e644ba01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:51.854443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103b907-5446-497f-9987-c7a0e644ba01 admin admin] PATH_INFO: `/v3/projects/659aad68dfff4491b919d91a8cb36569/users/594f59a3d3d340c6895e1c67d8d5f599/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:51.871869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103b907-5446-497f-9987-c7a0e644ba01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=659aad68dfff4491b919d91a8cb36569, user_id=594f59a3d3d340c6895e1c67d8d5f599, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:51.874787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103b907-5446-497f-9987-c7a0e644ba01 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:51.894992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b5c82-8b16-4af1-8cec-efbe263756b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:51.896635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b5c82-8b16-4af1-8cec-efbe263756b0 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:51.907865 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1110/2232] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:51.908837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b5c82-8b16-4af1-8cec-efbe263756b0 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:51.910254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-658b5c82-8b16-4af1-8cec-efbe263756b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:51.924984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b5c82-8b16-4af1-8cec-efbe263756b0 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:51.931966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267baf66-bcf6-4226-bf35-6b5553cc8aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:51.933824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267baf66-bcf6-4226-bf35-6b5553cc8aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:51.934246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267baf66-bcf6-4226-bf35-6b5553cc8aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:51.934534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267baf66-bcf6-4226-bf35-6b5553cc8aa0 admin admin] PATH_INFO: `/v3/projects/f0c1a1fd2e6f4c2486bfd63750ae7d64/users/b06d1e15c6ac439e867fc1ac00631b0c/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:51.941337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267baf66-bcf6-4226-bf35-6b5553cc8aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c1a1fd2e6f4c2486bfd63750ae7d64, user_id=b06d1e15c6ac439e867fc1ac00631b0c, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:51.952684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267baf66-bcf6-4226-bf35-6b5553cc8aa0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:51.965782 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1123/2233] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:51 2022] PUT /identity/v3/projects/659aad68dfff4491b919d91a8cb36569/users/594f59a3d3d340c6895e1c67d8d5f599/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:51.965782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103b907-5446-497f-9987-c7a0e644ba01 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:51.975862 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1111/2234] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:51 2022] PUT /identity/v3/projects/f0c1a1fd2e6f4c2486bfd63750ae7d64/users/b06d1e15c6ac439e867fc1ac00631b0c/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:51.977255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3103b907-5446-497f-9987-c7a0e644ba01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:51.977600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edb514-7b88-4bd6-844c-126b9299bdd7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:51.984380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edb514-7b88-4bd6-844c-126b9299bdd7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:51.984380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edb514-7b88-4bd6-844c-126b9299bdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:52.015199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-34edb514-7b88-4bd6-844c-126b9299bdd7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:52.016766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-34edb514-7b88-4bd6-844c-126b9299bdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:52.061469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103b907-5446-497f-9987-c7a0e644ba01 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:52.088980 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1112/2235] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:52.090885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de860000-2369-464d-aef7-85db60c8cae9 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:52.091181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de860000-2369-464d-aef7-85db60c8cae9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:52.091466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de860000-2369-464d-aef7-85db60c8cae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:52.127055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-de860000-2369-464d-aef7-85db60c8cae9 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:52.128688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-de860000-2369-464d-aef7-85db60c8cae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:52.142834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a04a08-4f6a-4092-8e65-6c50b35c8f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:52.149265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a04a08-4f6a-4092-8e65-6c50b35c8f82 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:52.149265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a04a08-4f6a-4092-8e65-6c50b35c8f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:52.149265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a04a08-4f6a-4092-8e65-6c50b35c8f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:52.149265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a04a08-4f6a-4092-8e65-6c50b35c8f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:52.149265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a04a08-4f6a-4092-8e65-6c50b35c8f82 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:52.150037 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1113/2236] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:52.151572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e23c8e-b6c9-476a-bae8-3bfa39021ca2 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:52.151868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e23c8e-b6c9-476a-bae8-3bfa39021ca2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:52.152148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e23c8e-b6c9-476a-bae8-3bfa39021ca2 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:52.154488 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1114/2237] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:20:52.155102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37824be-8b5a-40f8-bb24-b76d4cd3aa40 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:52.155396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37824be-8b5a-40f8-bb24-b76d4cd3aa40 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:52.155677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37824be-8b5a-40f8-bb24-b76d4cd3aa40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:52.176814 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1124/2238] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:52.179411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca6dd4-29ac-412a-8e52-e7a55d4bdf05 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:52.179798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca6dd4-29ac-412a-8e52-e7a55d4bdf05 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:52.180160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca6dd4-29ac-412a-8e52-e7a55d4bdf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:52.198526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c37824be-8b5a-40f8-bb24-b76d4cd3aa40 None None] MFA Rules not processed for user `594f59a3d3d340c6895e1c67d8d5f599`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:52.200771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c37824be-8b5a-40f8-bb24-b76d4cd3aa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:52.231535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e4ca6dd4-29ac-412a-8e52-e7a55d4bdf05 None None] MFA Rules not processed for user `b06d1e15c6ac439e867fc1ac00631b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:52.232798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e4ca6dd4-29ac-412a-8e52-e7a55d4bdf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:52.297566 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1115/2239] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:52.299396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37824be-8b5a-40f8-bb24-b76d4cd3aa40 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:52.314283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37824be-8b5a-40f8-bb24-b76d4cd3aa40 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:52.321958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751d473-8c39-49ec-b93c-7921f2a439ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:52.323005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751d473-8c39-49ec-b93c-7921f2a439ef admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:52.323494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751d473-8c39-49ec-b93c-7921f2a439ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:52.324055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751d473-8c39-49ec-b93c-7921f2a439ef admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:52.325488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751d473-8c39-49ec-b93c-7921f2a439ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:52.326118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751d473-8c39-49ec-b93c-7921f2a439ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:52.329408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751d473-8c39-49ec-b93c-7921f2a439ef admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:52.348694 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1116/2240] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:52.350985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484467f4-c2c1-477c-bf17-284f1f894068 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:52.351338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484467f4-c2c1-477c-bf17-284f1f894068 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:52.351624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484467f4-c2c1-477c-bf17-284f1f894068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:52.388901 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1125/2241] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:52.389970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca6dd4-29ac-412a-8e52-e7a55d4bdf05 None None] Authenticating service token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:20:52.391410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-484467f4-c2c1-477c-bf17-284f1f894068 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:52.393542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-484467f4-c2c1-477c-bf17-284f1f894068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:52.399731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e4ca6dd4-29ac-412a-8e52-e7a55d4bdf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:52.417203 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1117/2242] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:52.418940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484467f4-c2c1-477c-bf17-284f1f894068 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:52.440729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484467f4-c2c1-477c-bf17-284f1f894068 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:52.458573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915b048-742c-4ce3-9875-b9f9a72788be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:52.459427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915b048-742c-4ce3-9875-b9f9a72788be admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:52.460238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915b048-742c-4ce3-9875-b9f9a72788be admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:52.460524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915b048-742c-4ce3-9875-b9f9a72788be admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:52.461313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915b048-742c-4ce3-9875-b9f9a72788be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:52.464168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915b048-742c-4ce3-9875-b9f9a72788be admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:52.485177 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1118/2243] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:52.486153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915b048-742c-4ce3-9875-b9f9a72788be admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:52.501223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915b048-742c-4ce3-9875-b9f9a72788be admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:52.506300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f50d4-cbcc-4f49-983c-f67410fbc675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:52.507491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f50d4-cbcc-4f49-983c-f67410fbc675 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:52.507780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f50d4-cbcc-4f49-983c-f67410fbc675 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:52.508053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f50d4-cbcc-4f49-983c-f67410fbc675 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:52.508834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f50d4-cbcc-4f49-983c-f67410fbc675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:52.511133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f50d4-cbcc-4f49-983c-f67410fbc675 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:52.550242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca6dd4-29ac-412a-8e52-e7a55d4bdf05 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:52.639897 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1119/2244] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:52 2022] POST /identity/v3/projects => generated 395 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:52.641634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f50d4-cbcc-4f49-983c-f67410fbc675 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:52.674217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca6dd4-29ac-412a-8e52-e7a55d4bdf05 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:52.749929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c8dfb-5d95-475d-b8f1-da246d187a14 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47853e4aa36c4e82893a7040d89d637b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6dd5bacdef2423289ad6e616be5f19b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:52.750867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c8dfb-5d95-475d-b8f1-da246d187a14 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:52.752003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c8dfb-5d95-475d-b8f1-da246d187a14 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:52.752003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c8dfb-5d95-475d-b8f1-da246d187a14 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] PATH_INFO: `/v3/projects/fa6eb57488d84d5faeb7dd17835460fe` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:52.755154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c8dfb-5d95-475d-b8f1-da246d187a14 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorizing `identity:get_project(project_id=fa6eb57488d84d5faeb7dd17835460fe)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:52.757980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c8dfb-5d95-475d-b8f1-da246d187a14 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:52.761575 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1126/2245] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:20:52 2022] GET /identity/v3/projects/fa6eb57488d84d5faeb7dd17835460fe => generated 371 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:52.764118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c8dfb-5d95-475d-b8f1-da246d187a14 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:52.837961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f50d4-cbcc-4f49-983c-f67410fbc675 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:52.843975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558afec4-f4ff-4e20-a02c-d0838a11f014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:52.844476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558afec4-f4ff-4e20-a02c-d0838a11f014 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:52.844805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558afec4-f4ff-4e20-a02c-d0838a11f014 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:52.845088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558afec4-f4ff-4e20-a02c-d0838a11f014 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:52.846046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558afec4-f4ff-4e20-a02c-d0838a11f014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:52.847981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558afec4-f4ff-4e20-a02c-d0838a11f014 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:52.870835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c8dfb-5d95-475d-b8f1-da246d187a14 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:52.875875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290d3ce-71f4-4600-99a7-8110b163500c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:52.876789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290d3ce-71f4-4600-99a7-8110b163500c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:52.877070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290d3ce-71f4-4600-99a7-8110b163500c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:52.877345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290d3ce-71f4-4600-99a7-8110b163500c admin admin] PATH_INFO: `/v3/users/702e6ff21e6f44ef9b6d9bb12e890417` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:52.878738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290d3ce-71f4-4600-99a7-8110b163500c admin admin] RBAC: Authorizing `identity:delete_user(user_id=702e6ff21e6f44ef9b6d9bb12e890417)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:52.880938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290d3ce-71f4-4600-99a7-8110b163500c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:53.032500 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1120/2246] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:52 2022] POST /identity/v3/projects => generated 381 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:53.033344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558afec4-f4ff-4e20-a02c-d0838a11f014 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:53.160802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3290d3ce-71f4-4600-99a7-8110b163500c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '702e6ff21e6f44ef9b6d9bb12e890417'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:53.177182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558afec4-f4ff-4e20-a02c-d0838a11f014 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:53.184046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add29301-b7a6-42fb-96e2-f61cdf535ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:53.185053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add29301-b7a6-42fb-96e2-f61cdf535ebf admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:53.185194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add29301-b7a6-42fb-96e2-f61cdf535ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:53.185363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add29301-b7a6-42fb-96e2-f61cdf535ebf admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:53.186168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add29301-b7a6-42fb-96e2-f61cdf535ebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:53.186479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add29301-b7a6-42fb-96e2-f61cdf535ebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:53.188145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add29301-b7a6-42fb-96e2-f61cdf535ebf admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:53.196438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3290d3ce-71f4-4600-99a7-8110b163500c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '702e6ff21e6f44ef9b6d9bb12e890417'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:53.198176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3290d3ce-71f4-4600-99a7-8110b163500c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '702e6ff21e6f44ef9b6d9bb12e890417'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:53.204231 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1121/2247] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:53.205194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add29301-b7a6-42fb-96e2-f61cdf535ebf admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:53.215580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add29301-b7a6-42fb-96e2-f61cdf535ebf admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:53.220705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842d5b5-46b2-4833-8beb-6725cbedf820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:53.221611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d5b5-46b2-4833-8beb-6725cbedf820 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:53.221918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d5b5-46b2-4833-8beb-6725cbedf820 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:53.222357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d5b5-46b2-4833-8beb-6725cbedf820 admin admin] PATH_INFO: `/v3/projects/8f6f08a44c6448529e12c65f5c01384c/users/5a4826566d7d486db4e9fd217bccac2a/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:53.227806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3290d3ce-71f4-4600-99a7-8110b163500c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '702e6ff21e6f44ef9b6d9bb12e890417'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:53.245046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842d5b5-46b2-4833-8beb-6725cbedf820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6f08a44c6448529e12c65f5c01384c, user_id=5a4826566d7d486db4e9fd217bccac2a, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:53.248863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842d5b5-46b2-4833-8beb-6725cbedf820 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:53.297217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3290d3ce-71f4-4600-99a7-8110b163500c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '702e6ff21e6f44ef9b6d9bb12e890417'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:53.305828 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1127/2248] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:52 2022] DELETE /identity/v3/users/702e6ff21e6f44ef9b6d9bb12e890417 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:53.306989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290d3ce-71f4-4600-99a7-8110b163500c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:53.309472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3290d3ce-71f4-4600-99a7-8110b163500c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:53.340750 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1122/2249] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:53 2022] PUT /identity/v3/projects/8f6f08a44c6448529e12c65f5c01384c/users/5a4826566d7d486db4e9fd217bccac2a/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:53.342001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842d5b5-46b2-4833-8beb-6725cbedf820 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:53.343841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c842d5b5-46b2-4833-8beb-6725cbedf820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:53.399595 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290d3ce-71f4-4600-99a7-8110b163500c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:53.434916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842d5b5-46b2-4833-8beb-6725cbedf820 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:53.441020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6e8e0-6945-433b-909b-0e9aaf03ff67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:53.442070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6e8e0-6945-433b-909b-0e9aaf03ff67 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:53.447086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6e8e0-6945-433b-909b-0e9aaf03ff67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:53.447086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6e8e0-6945-433b-909b-0e9aaf03ff67 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:53.447086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6e8e0-6945-433b-909b-0e9aaf03ff67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:53.447086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6e8e0-6945-433b-909b-0e9aaf03ff67 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:53.507368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30828332-7513-4a83-ad78-4576a17a61c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:53.508285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30828332-7513-4a83-ad78-4576a17a61c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:53.508749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30828332-7513-4a83-ad78-4576a17a61c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:53.509135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30828332-7513-4a83-ad78-4576a17a61c2 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:53.509908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30828332-7513-4a83-ad78-4576a17a61c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:53.512123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30828332-7513-4a83-ad78-4576a17a61c2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:53.531493 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1123/2250] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:53 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:53.534827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3a9b2-ca86-4992-83a0-20b53211e19b None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:53.535185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3a9b2-ca86-4992-83a0-20b53211e19b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:53.536127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3a9b2-ca86-4992-83a0-20b53211e19b None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:53.544974 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1124/2251] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:20:53 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:20:53.545837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3a9b2-ca86-4992-83a0-20b53211e19b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:53.547848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d7b3a9b2-ca86-4992-83a0-20b53211e19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:53.566140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3a9b2-ca86-4992-83a0-20b53211e19b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:53.572127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dbe7a-3cee-46e2-95a2-d7bd3f427427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:53.572991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dbe7a-3cee-46e2-95a2-d7bd3f427427 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:53.573381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dbe7a-3cee-46e2-95a2-d7bd3f427427 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:53.573767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dbe7a-3cee-46e2-95a2-d7bd3f427427 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:53.574640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dbe7a-3cee-46e2-95a2-d7bd3f427427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:53.576697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dbe7a-3cee-46e2-95a2-d7bd3f427427 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:53.603428 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1128/2252] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:53 2022] POST /identity/v3/users => generated 304 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:53.605036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7da3ef-81e8-4132-a4e9-113401504eff None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:53.606822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7da3ef-81e8-4132-a4e9-113401504eff None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:53.607462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7da3ef-81e8-4132-a4e9-113401504eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:53.633312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6e7da3ef-81e8-4132-a4e9-113401504eff None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:53.634882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6e7da3ef-81e8-4132-a4e9-113401504eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:53.646612 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1129/2253] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:53.648687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c8b94-6d27-47e0-963e-35f30f533071 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:53.649227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c8b94-6d27-47e0-963e-35f30f533071 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:53.658287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c8b94-6d27-47e0-963e-35f30f533071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:53.681242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-766c8b94-6d27-47e0-963e-35f30f533071 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:53.681912 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1125/2254] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:53 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:53.683083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-766c8b94-6d27-47e0-963e-35f30f533071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:53.684350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dbe7a-3cee-46e2-95a2-d7bd3f427427 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:53.779406 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1130/2255] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:53.781224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c8b94-6d27-47e0-963e-35f30f533071 None None] Authenticating service token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:20:53.783056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-766c8b94-6d27-47e0-963e-35f30f533071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:53.799828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dbe7a-3cee-46e2-95a2-d7bd3f427427 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:53.816819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dd4d4-46ca-48a2-9ba7-887c84acfb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:53.817588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dd4d4-46ca-48a2-9ba7-887c84acfb32 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:53.817983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dd4d4-46ca-48a2-9ba7-887c84acfb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:53.818338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dd4d4-46ca-48a2-9ba7-887c84acfb32 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:53.820940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40dd4d4-46ca-48a2-9ba7-887c84acfb32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:53.823907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40dd4d4-46ca-48a2-9ba7-887c84acfb32 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:53.844520 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1126/2256] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:53.851687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dd4d4-46ca-48a2-9ba7-887c84acfb32 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:53.872842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dd4d4-46ca-48a2-9ba7-887c84acfb32 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:53.886998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df91d2-08f4-43e7-b0a3-4b3c1b5f1133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:53.887700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df91d2-08f4-43e7-b0a3-4b3c1b5f1133 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:53.888005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df91d2-08f4-43e7-b0a3-4b3c1b5f1133 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:53.889631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df91d2-08f4-43e7-b0a3-4b3c1b5f1133 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:53.891216 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df91d2-08f4-43e7-b0a3-4b3c1b5f1133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:53.893793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df91d2-08f4-43e7-b0a3-4b3c1b5f1133 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:53.926926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c8b94-6d27-47e0-963e-35f30f533071 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:53.927060 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1127/2257] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:53.927060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df91d2-08f4-43e7-b0a3-4b3c1b5f1133 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:53.927226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-43df91d2-08f4-43e7-b0a3-4b3c1b5f1133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:53.936345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-766c8b94-6d27-47e0-963e-35f30f533071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:54.045179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df91d2-08f4-43e7-b0a3-4b3c1b5f1133 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:54.049327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1af247-6a10-4b78-b1f7-06749a5abbcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:54.050026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1af247-6a10-4b78-b1f7-06749a5abbcf service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:54.050342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1af247-6a10-4b78-b1f7-06749a5abbcf service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:54.051489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c8b94-6d27-47e0-963e-35f30f533071 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:54.051607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1af247-6a10-4b78-b1f7-06749a5abbcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:54.056193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166f8ae-11fc-45b3-a3bc-97db93154502 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47853e4aa36c4e82893a7040d89d637b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6dd5bacdef2423289ad6e616be5f19b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:54.057628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166f8ae-11fc-45b3-a3bc-97db93154502 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:54.057913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166f8ae-11fc-45b3-a3bc-97db93154502 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:54.058188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166f8ae-11fc-45b3-a3bc-97db93154502 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] PATH_INFO: `/v3/projects/fa6eb57488d84d5faeb7dd17835460fe` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:54.059510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166f8ae-11fc-45b3-a3bc-97db93154502 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorizing `identity:get_project(project_id=fa6eb57488d84d5faeb7dd17835460fe)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:54.061888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166f8ae-11fc-45b3-a3bc-97db93154502 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:54.064252 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1131/2258] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:20:53 2022] GET /identity/v3/projects/fa6eb57488d84d5faeb7dd17835460fe => generated 371 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:54.065395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1af247-6a10-4b78-b1f7-06749a5abbcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:54.066944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1af247-6a10-4b78-b1f7-06749a5abbcf service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:54.078519 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1128/2259] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:54.079354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1af247-6a10-4b78-b1f7-06749a5abbcf service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:54.085678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166f8ae-11fc-45b3-a3bc-97db93154502 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:54.090546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1af247-6a10-4b78-b1f7-06749a5abbcf service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:54.105653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b357d-0f10-4d43-89c0-2b652ff50bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:54.110229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b357d-0f10-4d43-89c0-2b652ff50bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:54.110229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b357d-0f10-4d43-89c0-2b652ff50bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:54.110229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b357d-0f10-4d43-89c0-2b652ff50bb4 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:54.110229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b357d-0f10-4d43-89c0-2b652ff50bb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:54.110772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b357d-0f10-4d43-89c0-2b652ff50bb4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:54.115094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166f8ae-11fc-45b3-a3bc-97db93154502 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:54.119723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e717e-43ba-42fb-b744-0dcdb7e85f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:54.120507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e717e-43ba-42fb-b744-0dcdb7e85f39 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:54.120915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e717e-43ba-42fb-b744-0dcdb7e85f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:54.121203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e717e-43ba-42fb-b744-0dcdb7e85f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:54.132307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e717e-43ba-42fb-b744-0dcdb7e85f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:54.135458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e717e-43ba-42fb-b744-0dcdb7e85f39 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:54.146206 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1132/2260] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:54.147078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e717e-43ba-42fb-b744-0dcdb7e85f39 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:54.158108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e717e-43ba-42fb-b744-0dcdb7e85f39 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:54.162613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53644f8c-b469-4b10-94b9-11fc1618e2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:54.163387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53644f8c-b469-4b10-94b9-11fc1618e2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:54.163751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53644f8c-b469-4b10-94b9-11fc1618e2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:54.164094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53644f8c-b469-4b10-94b9-11fc1618e2d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:54.166023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53644f8c-b469-4b10-94b9-11fc1618e2d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:54.166646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53644f8c-b469-4b10-94b9-11fc1618e2d0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:54.180383 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1133/2261] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:54.180383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53644f8c-b469-4b10-94b9-11fc1618e2d0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:54.190220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53644f8c-b469-4b10-94b9-11fc1618e2d0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:54.195971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552d396-7f9e-46ec-9ff6-3044e9a7614f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:54.197014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552d396-7f9e-46ec-9ff6-3044e9a7614f admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:54.197369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552d396-7f9e-46ec-9ff6-3044e9a7614f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:54.197725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552d396-7f9e-46ec-9ff6-3044e9a7614f admin admin] PATH_INFO: `/v3/projects/a4524ce8eafa4df6be549375f4a7d2da/users/727422c06ae941c38621a7e49c62cb66/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:54.214061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552d396-7f9e-46ec-9ff6-3044e9a7614f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4524ce8eafa4df6be549375f4a7d2da, user_id=727422c06ae941c38621a7e49c62cb66, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:54.215069 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1129/2262] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:54 2022] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:54.217205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552d396-7f9e-46ec-9ff6-3044e9a7614f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:54.219634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1bd21-7c4f-4848-99df-40497f07e102 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:54.219937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1bd21-7c4f-4848-99df-40497f07e102 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:54.220227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1bd21-7c4f-4848-99df-40497f07e102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:54.245769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6dd1bd21-7c4f-4848-99df-40497f07e102 None None] MFA Rules not processed for user `c4b69f1d0d4a4bcaaead3a2337d0734e`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:54.247221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6dd1bd21-7c4f-4848-99df-40497f07e102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:54.300528 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1134/2263] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:54 2022] PUT /identity/v3/projects/a4524ce8eafa4df6be549375f4a7d2da/users/727422c06ae941c38621a7e49c62cb66/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:54.301407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552d396-7f9e-46ec-9ff6-3044e9a7614f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:54.324989 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1130/2264] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:54 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:54.327464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1bd21-7c4f-4848-99df-40497f07e102 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:54.341123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1bd21-7c4f-4848-99df-40497f07e102 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:54.378096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552d396-7f9e-46ec-9ff6-3044e9a7614f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:54.385961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbbc0d-ae26-4b71-b750-8616af93622d tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47853e4aa36c4e82893a7040d89d637b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6dd5bacdef2423289ad6e616be5f19b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:54.385961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbbc0d-ae26-4b71-b750-8616af93622d tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:54.386246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbbc0d-ae26-4b71-b750-8616af93622d tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:54.386496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbbc0d-ae26-4b71-b750-8616af93622d tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:54.387234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbbc0d-ae26-4b71-b750-8616af93622d tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:54.387546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbbc0d-ae26-4b71-b750-8616af93622d tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:54.389603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbbc0d-ae26-4b71-b750-8616af93622d tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:54.408770 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1135/2265] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:54.410333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbbc0d-ae26-4b71-b750-8616af93622d tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:54.414391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6d9da-6899-4b98-a8e0-cc2bf5e4f35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:54.415456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6d9da-6899-4b98-a8e0-cc2bf5e4f35d admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:54.415752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6d9da-6899-4b98-a8e0-cc2bf5e4f35d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:54.416036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6d9da-6899-4b98-a8e0-cc2bf5e4f35d admin admin] PATH_INFO: `/v3/projects/8f30fec6fdee4788af310ffa15c23ab7/users/17581b53723f42bdbe7dd12ea1f691cd/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:54.429970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbbc0d-ae26-4b71-b750-8616af93622d tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:54.437937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7d97c-1fa7-4b36-8305-da26d6250255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:54.439109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7d97c-1fa7-4b36-8305-da26d6250255 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:54.440100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7d97c-1fa7-4b36-8305-da26d6250255 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:54.441078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7d97c-1fa7-4b36-8305-da26d6250255 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:54.442108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6d9da-6899-4b98-a8e0-cc2bf5e4f35d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f30fec6fdee4788af310ffa15c23ab7, user_id=17581b53723f42bdbe7dd12ea1f691cd, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:54.446154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6d9da-6899-4b98-a8e0-cc2bf5e4f35d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:54.451724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7d97c-1fa7-4b36-8305-da26d6250255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:54.451724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7d97c-1fa7-4b36-8305-da26d6250255 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:54.461873 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1136/2266] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:54.462729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7d97c-1fa7-4b36-8305-da26d6250255 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:54.474528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7d97c-1fa7-4b36-8305-da26d6250255 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:54.480269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09a58d-9679-47c3-981d-a9eeba7b8ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:54.480269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09a58d-9679-47c3-981d-a9eeba7b8ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:54.480269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09a58d-9679-47c3-981d-a9eeba7b8ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:54.480685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09a58d-9679-47c3-981d-a9eeba7b8ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:54.481387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09a58d-9679-47c3-981d-a9eeba7b8ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:54.482999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09a58d-9679-47c3-981d-a9eeba7b8ec7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:54.496696 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1137/2267] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:54.498336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09a58d-9679-47c3-981d-a9eeba7b8ec7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:54.500426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4c09a58d-9679-47c3-981d-a9eeba7b8ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:54.533601 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1131/2268] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:54 2022] PUT /identity/v3/projects/8f30fec6fdee4788af310ffa15c23ab7/users/17581b53723f42bdbe7dd12ea1f691cd/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:54.534282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6d9da-6899-4b98-a8e0-cc2bf5e4f35d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:54.587823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09a58d-9679-47c3-981d-a9eeba7b8ec7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:54.622668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6d9da-6899-4b98-a8e0-cc2bf5e4f35d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:54.629138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f76ca-a7b3-42bd-86b4-a1ad56dee793 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47853e4aa36c4e82893a7040d89d637b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6dd5bacdef2423289ad6e616be5f19b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:54.631128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f76ca-a7b3-42bd-86b4-a1ad56dee793 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:54.632779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f76ca-a7b3-42bd-86b4-a1ad56dee793 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:54.633154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f76ca-a7b3-42bd-86b4-a1ad56dee793 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:54.633855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f76ca-a7b3-42bd-86b4-a1ad56dee793 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:54.636717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f76ca-a7b3-42bd-86b4-a1ad56dee793 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:54.669312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e29e2-7856-4a5d-955a-8f19bc0f43ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:54.670129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e29e2-7856-4a5d-955a-8f19bc0f43ca service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:54.670406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e29e2-7856-4a5d-955a-8f19bc0f43ca service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:54.670699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e29e2-7856-4a5d-955a-8f19bc0f43ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:54.672821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-984e29e2-7856-4a5d-955a-8f19bc0f43ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:54.733012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e29e2-7856-4a5d-955a-8f19bc0f43ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:54.734625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e29e2-7856-4a5d-955a-8f19bc0f43ca service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:54.745898 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1132/2269] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:54 2022] POST /identity/v3/users => generated 381 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:54.745898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f76ca-a7b3-42bd-86b4-a1ad56dee793 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:54.746143 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1138/2270] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:54 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:54.746143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e29e2-7856-4a5d-955a-8f19bc0f43ca service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:54.824223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e29e2-7856-4a5d-955a-8f19bc0f43ca service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:54.824462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f76ca-a7b3-42bd-86b4-a1ad56dee793 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:54.829244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226b187-bf51-4d45-a12f-ff90ec5fbb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:54.829913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226b187-bf51-4d45-a12f-ff90ec5fbb97 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:54.830093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c96c9a-503a-44ed-9513-48f2e26f328d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:54.830237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226b187-bf51-4d45-a12f-ff90ec5fbb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:54.830462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226b187-bf51-4d45-a12f-ff90ec5fbb97 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:54.831041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c96c9a-503a-44ed-9513-48f2e26f328d admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:54.831174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226b187-bf51-4d45-a12f-ff90ec5fbb97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:54.831351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c96c9a-503a-44ed-9513-48f2e26f328d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:54.831623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c96c9a-503a-44ed-9513-48f2e26f328d admin admin] PATH_INFO: `/v3/projects/a4524ce8eafa4df6be549375f4a7d2da/users/727422c06ae941c38621a7e49c62cb66/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:54.832932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226b187-bf51-4d45-a12f-ff90ec5fbb97 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:54.833687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c96c9a-503a-44ed-9513-48f2e26f328d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4524ce8eafa4df6be549375f4a7d2da, user_id=727422c06ae941c38621a7e49c62cb66, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:54.839147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c96c9a-503a-44ed-9513-48f2e26f328d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:54.845987 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1133/2271] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:54.847738 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1139/2272] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:54 2022] PUT /identity/v3/projects/a4524ce8eafa4df6be549375f4a7d2da/users/727422c06ae941c38621a7e49c62cb66/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:54.848578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c96c9a-503a-44ed-9513-48f2e26f328d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:54.851118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf524f5e-b43a-4bf7-b18c-16544fee2bf1 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:54.851420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf524f5e-b43a-4bf7-b18c-16544fee2bf1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:54.851847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf524f5e-b43a-4bf7-b18c-16544fee2bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:54.856027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-81c96c9a-503a-44ed-9513-48f2e26f328d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:54.874005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-cf524f5e-b43a-4bf7-b18c-16544fee2bf1 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:54.875323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-cf524f5e-b43a-4bf7-b18c-16544fee2bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:54.947525 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1134/2273] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:54.948435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf524f5e-b43a-4bf7-b18c-16544fee2bf1 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:54.977555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c96c9a-503a-44ed-9513-48f2e26f328d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:54.992223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f7702-d19b-46a2-a470-85d2aff31e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:54.993306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f7702-d19b-46a2-a470-85d2aff31e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:54.993874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f7702-d19b-46a2-a470-85d2aff31e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:54.995197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f7702-d19b-46a2-a470-85d2aff31e25 admin admin] PATH_INFO: `/v3/projects/dfd2674341c94263a211d012d3ffe7b6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:54.997019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f7702-d19b-46a2-a470-85d2aff31e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfd2674341c94263a211d012d3ffe7b6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:54.998991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f7702-d19b-46a2-a470-85d2aff31e25 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:55.044832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf524f5e-b43a-4bf7-b18c-16544fee2bf1 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:55.049598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142d058-2978-4a73-95eb-514067aeb3d4 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47853e4aa36c4e82893a7040d89d637b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6dd5bacdef2423289ad6e616be5f19b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:55.050526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142d058-2978-4a73-95eb-514067aeb3d4 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:55.050825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142d058-2978-4a73-95eb-514067aeb3d4 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:55.051108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142d058-2978-4a73-95eb-514067aeb3d4 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:55.052111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142d058-2978-4a73-95eb-514067aeb3d4 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:55.052436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142d058-2978-4a73-95eb-514067aeb3d4 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:55.054546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142d058-2978-4a73-95eb-514067aeb3d4 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:55.067490 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1135/2274] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:55.068557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142d058-2978-4a73-95eb-514067aeb3d4 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:55.145347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e65f7702-d19b-46a2-a470-85d2aff31e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfd2674341c94263a211d012d3ffe7b6', 'request_id': 'req-e65f7702-d19b-46a2-a470-85d2aff31e25'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:55.152718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142d058-2978-4a73-95eb-514067aeb3d4 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:55.152889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e65f7702-d19b-46a2-a470-85d2aff31e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfd2674341c94263a211d012d3ffe7b6', 'request_id': 'req-e65f7702-d19b-46a2-a470-85d2aff31e25'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:55.223252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d244ce-b787-4688-86ba-0b176ef0ccd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:55.223912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d244ce-b787-4688-86ba-0b176ef0ccd5 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:55.224199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d244ce-b787-4688-86ba-0b176ef0ccd5 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:55.224480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d244ce-b787-4688-86ba-0b176ef0ccd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:55.228501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e65f7702-d19b-46a2-a470-85d2aff31e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfd2674341c94263a211d012d3ffe7b6', 'request_id': 'req-e65f7702-d19b-46a2-a470-85d2aff31e25'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:55.243762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e65f7702-d19b-46a2-a470-85d2aff31e25 admin admin] The token cache is being invalidate because project dfd2674341c94263a211d012d3ffe7b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:55.244075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e65f7702-d19b-46a2-a470-85d2aff31e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:55.245888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e65f7702-d19b-46a2-a470-85d2aff31e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:55.252523 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1140/2275] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:54 2022] DELETE /identity/v3/projects/dfd2674341c94263a211d012d3ffe7b6 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:55.253934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f7702-d19b-46a2-a470-85d2aff31e25 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:55.256497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e65f7702-d19b-46a2-a470-85d2aff31e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:55.306959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d244ce-b787-4688-86ba-0b176ef0ccd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:55.309016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d244ce-b787-4688-86ba-0b176ef0ccd5 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:55.320082 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1136/2276] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:55 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:55.321535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef7abb-3f28-4277-9d1a-1a5d698fa3bf None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:55.321833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef7abb-3f28-4277-9d1a-1a5d698fa3bf None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:55.322164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef7abb-3f28-4277-9d1a-1a5d698fa3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:55.353816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9cef7abb-3f28-4277-9d1a-1a5d698fa3bf None None] MFA Rules not processed for user `727422c06ae941c38621a7e49c62cb66`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:55.359531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9cef7abb-3f28-4277-9d1a-1a5d698fa3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:55.365444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f7702-d19b-46a2-a470-85d2aff31e25 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:55.370697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d900b7c-6ad7-4ed6-b031-cfad247613b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:55.372179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d900b7c-6ad7-4ed6-b031-cfad247613b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:55.372468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d900b7c-6ad7-4ed6-b031-cfad247613b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:55.372802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d900b7c-6ad7-4ed6-b031-cfad247613b9 admin admin] PATH_INFO: `/v3/projects/00534d20e27e4935b1227e59f813906d/users/c3c6f32721844e64a543a175f7c4d319/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:55.392300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d900b7c-6ad7-4ed6-b031-cfad247613b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00534d20e27e4935b1227e59f813906d, user_id=c3c6f32721844e64a543a175f7c4d319, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:55.396060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d900b7c-6ad7-4ed6-b031-cfad247613b9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:55.441716 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1137/2277] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:55.442982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef7abb-3f28-4277-9d1a-1a5d698fa3bf None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:55.444060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9cef7abb-3f28-4277-9d1a-1a5d698fa3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:55.490702 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1141/2278] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:55 2022] PUT /identity/v3/projects/00534d20e27e4935b1227e59f813906d/users/c3c6f32721844e64a543a175f7c4d319/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:55.491722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a1023-3ace-44e9-a7f6-ba004efad732 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:55.492214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a1023-3ace-44e9-a7f6-ba004efad732 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:55.493070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a1023-3ace-44e9-a7f6-ba004efad732 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:55.495204 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1142/2279] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:20:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:20:55.496138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a1023-3ace-44e9-a7f6-ba004efad732 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:55.499005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-639a1023-3ace-44e9-a7f6-ba004efad732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:55.549916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef7abb-3f28-4277-9d1a-1a5d698fa3bf None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:55.591283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a1023-3ace-44e9-a7f6-ba004efad732 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:55.598703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a28e2-66e2-45a5-ab6a-2d7a62a282f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:55.599679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a28e2-66e2-45a5-ab6a-2d7a62a282f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:55.600013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a28e2-66e2-45a5-ab6a-2d7a62a282f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:55.600895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a28e2-66e2-45a5-ab6a-2d7a62a282f5 admin admin] PATH_INFO: `/v3/users/b06d1e15c6ac439e867fc1ac00631b0c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:55.602579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a28e2-66e2-45a5-ab6a-2d7a62a282f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b06d1e15c6ac439e867fc1ac00631b0c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:55.605594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a28e2-66e2-45a5-ab6a-2d7a62a282f5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:55.619631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f82d3d-f370-48d8-a168-f9e96fabb679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:55.620429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f82d3d-f370-48d8-a168-f9e96fabb679 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:55.620808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f82d3d-f370-48d8-a168-f9e96fabb679 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:55.621314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f82d3d-f370-48d8-a168-f9e96fabb679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:55.624459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-78f82d3d-f370-48d8-a168-f9e96fabb679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:55.641875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f82d3d-f370-48d8-a168-f9e96fabb679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:55.644710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f82d3d-f370-48d8-a168-f9e96fabb679 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:55.656032 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1138/2280] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:55.665810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f82d3d-f370-48d8-a168-f9e96fabb679 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:55.671200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-78f82d3d-f370-48d8-a168-f9e96fabb679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:55.683361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f82d3d-f370-48d8-a168-f9e96fabb679 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:55.693361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a7eca-8f94-489c-b16b-3b2a703c4d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:55.694702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a7eca-8f94-489c-b16b-3b2a703c4d82 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:55.695052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a7eca-8f94-489c-b16b-3b2a703c4d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:55.695336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a7eca-8f94-489c-b16b-3b2a703c4d82 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:55.696226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a7eca-8f94-489c-b16b-3b2a703c4d82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:55.698371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a7eca-8f94-489c-b16b-3b2a703c4d82 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:55.855804 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1139/2281] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:55 2022] POST /identity/v3/projects => generated 395 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:55.857302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1cbc6-1ef6-472d-aac2-e5351486606e None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:55.858337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1cbc6-1ef6-472d-aac2-e5351486606e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:55.858631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1cbc6-1ef6-472d-aac2-e5351486606e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:55.875508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7d2a28e2-66e2-45a5-ab6a-2d7a62a282f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b06d1e15c6ac439e867fc1ac00631b0c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:55.891419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7d2a28e2-66e2-45a5-ab6a-2d7a62a282f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b06d1e15c6ac439e867fc1ac00631b0c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:55.893952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7d2a28e2-66e2-45a5-ab6a-2d7a62a282f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b06d1e15c6ac439e867fc1ac00631b0c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:55.902945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7d2a28e2-66e2-45a5-ab6a-2d7a62a282f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b06d1e15c6ac439e867fc1ac00631b0c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:55.919357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-70a1cbc6-1ef6-472d-aac2-e5351486606e None None] MFA Rules not processed for user `c3c6f32721844e64a543a175f7c4d319`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:55.920691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-70a1cbc6-1ef6-472d-aac2-e5351486606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:55.985789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7d2a28e2-66e2-45a5-ab6a-2d7a62a282f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b06d1e15c6ac439e867fc1ac00631b0c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:56.003557 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1140/2282] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:56.005303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1cbc6-1ef6-472d-aac2-e5351486606e None None] Authenticating service token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:20:56.009010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-70a1cbc6-1ef6-472d-aac2-e5351486606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:56.009873 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1143/2283] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:55 2022] DELETE /identity/v3/users/b06d1e15c6ac439e867fc1ac00631b0c => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:56.011319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a28e2-66e2-45a5-ab6a-2d7a62a282f5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:56.026697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7d2a28e2-66e2-45a5-ab6a-2d7a62a282f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:56.159724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a28e2-66e2-45a5-ab6a-2d7a62a282f5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:56.165195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337dc3a7-ed39-4c99-9f2f-43ff24bfc366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:56.165966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dc3a7-ed39-4c99-9f2f-43ff24bfc366 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:56.166250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dc3a7-ed39-4c99-9f2f-43ff24bfc366 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:56.166527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dc3a7-ed39-4c99-9f2f-43ff24bfc366 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:56.167313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337dc3a7-ed39-4c99-9f2f-43ff24bfc366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:56.168638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1cbc6-1ef6-472d-aac2-e5351486606e None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:56.169445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337dc3a7-ed39-4c99-9f2f-43ff24bfc366 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:56.169892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-70a1cbc6-1ef6-472d-aac2-e5351486606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:56.247530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1cbc6-1ef6-472d-aac2-e5351486606e None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:56.284648 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1144/2284] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:56 2022] POST /identity/v3/users => generated 298 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:56.286399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90077b33-9ac3-4f1c-94f2-b178ae6d58d8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:56.287477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90077b33-9ac3-4f1c-94f2-b178ae6d58d8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:56.287477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90077b33-9ac3-4f1c-94f2-b178ae6d58d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:56.327624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-90077b33-9ac3-4f1c-94f2-b178ae6d58d8 None None] MFA Rules not processed for user `5a4826566d7d486db4e9fd217bccac2a`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:56.328934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-90077b33-9ac3-4f1c-94f2-b178ae6d58d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:56.344216 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25542a6d-0913-4851-bd48-2c6d559ed24b tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47853e4aa36c4e82893a7040d89d637b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6dd5bacdef2423289ad6e616be5f19b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:56.344940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25542a6d-0913-4851-bd48-2c6d559ed24b tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:56.345555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25542a6d-0913-4851-bd48-2c6d559ed24b tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:56.345864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25542a6d-0913-4851-bd48-2c6d559ed24b tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] PATH_INFO: `/v3/projects/fa6eb57488d84d5faeb7dd17835460fe` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:56.354943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25542a6d-0913-4851-bd48-2c6d559ed24b tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorizing `identity:get_project(project_id=fa6eb57488d84d5faeb7dd17835460fe)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:56.362276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25542a6d-0913-4851-bd48-2c6d559ed24b tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:56.394112 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1141/2285] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:20:56 2022] GET /identity/v3/projects/fa6eb57488d84d5faeb7dd17835460fe => generated 371 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:56.395118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25542a6d-0913-4851-bd48-2c6d559ed24b tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:56.400171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-25542a6d-0913-4851-bd48-2c6d559ed24b tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:56.434161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25542a6d-0913-4851-bd48-2c6d559ed24b tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:56.446004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a173b76-07e1-4eee-acfc-8a7247efb637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:56.446689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a173b76-07e1-4eee-acfc-8a7247efb637 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:56.447295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a173b76-07e1-4eee-acfc-8a7247efb637 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:56.447295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a173b76-07e1-4eee-acfc-8a7247efb637 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:56.448061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a173b76-07e1-4eee-acfc-8a7247efb637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:56.452325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a173b76-07e1-4eee-acfc-8a7247efb637 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:56.470154 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1145/2286] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:56.471180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90077b33-9ac3-4f1c-94f2-b178ae6d58d8 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:56.489083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90077b33-9ac3-4f1c-94f2-b178ae6d58d8 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:56.498715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a224c0-8dde-4086-8163-31723f6b6e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:56.499731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a224c0-8dde-4086-8163-31723f6b6e4e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:56.500241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a224c0-8dde-4086-8163-31723f6b6e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:56.501663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a224c0-8dde-4086-8163-31723f6b6e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:56.502626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a224c0-8dde-4086-8163-31723f6b6e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:56.504888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a224c0-8dde-4086-8163-31723f6b6e4e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:56.518966 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1146/2287] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:56.521573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c7666-f0c6-4682-b92e-73b8168b18fd None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:56.522135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c7666-f0c6-4682-b92e-73b8168b18fd None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:56.522744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c7666-f0c6-4682-b92e-73b8168b18fd None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:56.528487 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1147/2288] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:20:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:20:56.530960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c7666-f0c6-4682-b92e-73b8168b18fd None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:56.531723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e57c7666-f0c6-4682-b92e-73b8168b18fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:56.549769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c7666-f0c6-4682-b92e-73b8168b18fd None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:56.555833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354a908-6fe8-41f9-b499-beafde1676c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:56.556821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354a908-6fe8-41f9-b499-beafde1676c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:56.559637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354a908-6fe8-41f9-b499-beafde1676c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:56.559637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354a908-6fe8-41f9-b499-beafde1676c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:56.559637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354a908-6fe8-41f9-b499-beafde1676c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:56.560912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354a908-6fe8-41f9-b499-beafde1676c8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:56.590739 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1142/2289] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:56 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:56.599893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a173b76-07e1-4eee-acfc-8a7247efb637 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:56.681270 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1148/2290] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:56 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:56.685885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6793d2-7c5a-4124-ad70-1b698808af9d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:56.686202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6793d2-7c5a-4124-ad70-1b698808af9d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:56.686486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6793d2-7c5a-4124-ad70-1b698808af9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:56.732377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ce6793d2-7c5a-4124-ad70-1b698808af9d None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:56.737911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ce6793d2-7c5a-4124-ad70-1b698808af9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:56.747975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a173b76-07e1-4eee-acfc-8a7247efb637 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:56.821490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41110c-1b09-4441-89de-6c81d660cce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:56.822182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41110c-1b09-4441-89de-6c81d660cce9 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:56.822471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41110c-1b09-4441-89de-6c81d660cce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:56.822804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41110c-1b09-4441-89de-6c81d660cce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:56.823546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41110c-1b09-4441-89de-6c81d660cce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:56.825406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41110c-1b09-4441-89de-6c81d660cce9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:56.825650 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1149/2291] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:20:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:56.826878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6793d2-7c5a-4124-ad70-1b698808af9d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:56.837965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6793d2-7c5a-4124-ad70-1b698808af9d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:56.844066 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1143/2292] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:56.845030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41110c-1b09-4441-89de-6c81d660cce9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:56.845436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785f305-61ba-4ea6-a78a-233a714419c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:56.846197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785f305-61ba-4ea6-a78a-233a714419c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:56.847139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785f305-61ba-4ea6-a78a-233a714419c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:56.847139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785f305-61ba-4ea6-a78a-233a714419c2 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:56.847324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2b41110c-1b09-4441-89de-6c81d660cce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:56.847620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785f305-61ba-4ea6-a78a-233a714419c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:56.856750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785f305-61ba-4ea6-a78a-233a714419c2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:56.863055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41110c-1b09-4441-89de-6c81d660cce9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:56.870103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546fa4a-9d1d-4581-bd48-b6962611321c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:56.871206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546fa4a-9d1d-4581-bd48-b6962611321c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:56.871773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546fa4a-9d1d-4581-bd48-b6962611321c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:56.872055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546fa4a-9d1d-4581-bd48-b6962611321c admin admin] PATH_INFO: `/v3/projects/f0c1a1fd2e6f4c2486bfd63750ae7d64` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:56.873328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546fa4a-9d1d-4581-bd48-b6962611321c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0c1a1fd2e6f4c2486bfd63750ae7d64)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:56.875730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546fa4a-9d1d-4581-bd48-b6962611321c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:56.955575 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1150/2293] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:56 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:56.955575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785f305-61ba-4ea6-a78a-233a714419c2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:56.968271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785f305-61ba-4ea6-a78a-233a714419c2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:56.973177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bf47a-2260-4331-8152-b494bc35aafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:56.973938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bf47a-2260-4331-8152-b494bc35aafa admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:56.974293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bf47a-2260-4331-8152-b494bc35aafa admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:56.974672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bf47a-2260-4331-8152-b494bc35aafa admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:56.976126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bf47a-2260-4331-8152-b494bc35aafa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:56.981359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bf47a-2260-4331-8152-b494bc35aafa admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:57.033367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6546fa4a-9d1d-4581-bd48-b6962611321c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0c1a1fd2e6f4c2486bfd63750ae7d64', 'request_id': 'req-6546fa4a-9d1d-4581-bd48-b6962611321c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:57.092339 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1151/2294] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:56 2022] POST /identity/v3/users => generated 298 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:57.092339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51fe82-de05-4281-a9f9-0cf4921b65a5 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:57.092339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51fe82-de05-4281-a9f9-0cf4921b65a5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:57.092339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51fe82-de05-4281-a9f9-0cf4921b65a5 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:57.094209 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1152/2295] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:20:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:20:57.100731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51fe82-de05-4281-a9f9-0cf4921b65a5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:57.117260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6546fa4a-9d1d-4581-bd48-b6962611321c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0c1a1fd2e6f4c2486bfd63750ae7d64', 'request_id': 'req-6546fa4a-9d1d-4581-bd48-b6962611321c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:57.130606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6546fa4a-9d1d-4581-bd48-b6962611321c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0c1a1fd2e6f4c2486bfd63750ae7d64', 'request_id': 'req-6546fa4a-9d1d-4581-bd48-b6962611321c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:57.147982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6546fa4a-9d1d-4581-bd48-b6962611321c admin admin] The token cache is being invalidate because project f0c1a1fd2e6f4c2486bfd63750ae7d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:57.148630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6546fa4a-9d1d-4581-bd48-b6962611321c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:57.149670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6546fa4a-9d1d-4581-bd48-b6962611321c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:57.152474 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1144/2296] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:56 2022] DELETE /identity/v3/projects/f0c1a1fd2e6f4c2486bfd63750ae7d64 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:57.153756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546fa4a-9d1d-4581-bd48-b6962611321c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:57.155289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6546fa4a-9d1d-4581-bd48-b6962611321c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:57.200207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51fe82-de05-4281-a9f9-0cf4921b65a5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:57.205625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad130881-eae9-457d-9ef9-430a6bceee88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:57.206675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad130881-eae9-457d-9ef9-430a6bceee88 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:57.207102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad130881-eae9-457d-9ef9-430a6bceee88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:57.208089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad130881-eae9-457d-9ef9-430a6bceee88 admin admin] PATH_INFO: `/v3/projects/f752e442b73f4163bd865c2cf1512f1a/users/155c764ee16f4f9f85bd8cdeec2b2113/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:57.230188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad130881-eae9-457d-9ef9-430a6bceee88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f752e442b73f4163bd865c2cf1512f1a, user_id=155c764ee16f4f9f85bd8cdeec2b2113, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:57.233466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad130881-eae9-457d-9ef9-430a6bceee88 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:57.250275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546fa4a-9d1d-4581-bd48-b6962611321c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:57.256861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b806793-6134-40b8-8492-de9299b73e51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:57.257805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b806793-6134-40b8-8492-de9299b73e51 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:57.258093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b806793-6134-40b8-8492-de9299b73e51 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:57.258392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b806793-6134-40b8-8492-de9299b73e51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:57.260292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5b806793-6134-40b8-8492-de9299b73e51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:57.273714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b806793-6134-40b8-8492-de9299b73e51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:57.275432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b806793-6134-40b8-8492-de9299b73e51 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:57.286622 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1145/2297] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:57.287431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b806793-6134-40b8-8492-de9299b73e51 service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:57.288815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5b806793-6134-40b8-8492-de9299b73e51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:57.302969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b806793-6134-40b8-8492-de9299b73e51 service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:57.314293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158f064-9002-4553-af9c-42a5bb7e9a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:57.314796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158f064-9002-4553-af9c-42a5bb7e9a43 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:57.315085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158f064-9002-4553-af9c-42a5bb7e9a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:57.316727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158f064-9002-4553-af9c-42a5bb7e9a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:57.316727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158f064-9002-4553-af9c-42a5bb7e9a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:57.317773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158f064-9002-4553-af9c-42a5bb7e9a43 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:57.330292 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1146/2298] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:57.331601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158f064-9002-4553-af9c-42a5bb7e9a43 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:57.333668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5158f064-9002-4553-af9c-42a5bb7e9a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:57.352626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158f064-9002-4553-af9c-42a5bb7e9a43 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:57.357679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a28a71-9577-4f02-a6ff-7c43561a4670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:57.358533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a28a71-9577-4f02-a6ff-7c43561a4670 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:57.358997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a28a71-9577-4f02-a6ff-7c43561a4670 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:57.359440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a28a71-9577-4f02-a6ff-7c43561a4670 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:57.360324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a28a71-9577-4f02-a6ff-7c43561a4670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:57.362195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a28a71-9577-4f02-a6ff-7c43561a4670 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:57.380326 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1153/2299] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:57 2022] PUT /identity/v3/projects/f752e442b73f4163bd865c2cf1512f1a/users/155c764ee16f4f9f85bd8cdeec2b2113/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:57.381198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad130881-eae9-457d-9ef9-430a6bceee88 admin admin] Authenticating service token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:20:57.387286 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ad130881-eae9-457d-9ef9-430a6bceee88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:57.392679 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1147/2300] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:57.392679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ba3e0-b042-4934-ae8d-e8a3cd78277e None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:57.392679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ba3e0-b042-4934-ae8d-e8a3cd78277e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:57.392679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ba3e0-b042-4934-ae8d-e8a3cd78277e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:57.415356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fb2ba3e0-b042-4934-ae8d-e8a3cd78277e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:57.416579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fb2ba3e0-b042-4934-ae8d-e8a3cd78277e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:57.488866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad130881-eae9-457d-9ef9-430a6bceee88 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:57.491339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ad130881-eae9-457d-9ef9-430a6bceee88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:57.499074 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1148/2301] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:57.499074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ba3e0-b042-4934-ae8d-e8a3cd78277e None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:57.522329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ba3e0-b042-4934-ae8d-e8a3cd78277e None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:57.537931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa1091-a081-4705-a4e0-2ae418f63df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:57.540863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa1091-a081-4705-a4e0-2ae418f63df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:57.541159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa1091-a081-4705-a4e0-2ae418f63df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:57.542608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa1091-a081-4705-a4e0-2ae418f63df3 admin admin] PATH_INFO: `/v3/projects/bec75a22264846e290d8fa22ec347b86/users/580eb09a148440e5918fee1e04932d11/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:57.568266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa1091-a081-4705-a4e0-2ae418f63df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec75a22264846e290d8fa22ec347b86, user_id=580eb09a148440e5918fee1e04932d11, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:57.572691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa1091-a081-4705-a4e0-2ae418f63df3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:57.595695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad130881-eae9-457d-9ef9-430a6bceee88 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:57.603551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463157af-74fb-4a03-8354-45923029bdcd tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47853e4aa36c4e82893a7040d89d637b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6dd5bacdef2423289ad6e616be5f19b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:57.605074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463157af-74fb-4a03-8354-45923029bdcd tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:57.605624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463157af-74fb-4a03-8354-45923029bdcd tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:57.606151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463157af-74fb-4a03-8354-45923029bdcd tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] PATH_INFO: `/v3/projects/fa6eb57488d84d5faeb7dd17835460fe` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:57.607612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463157af-74fb-4a03-8354-45923029bdcd tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorizing `identity:get_project(project_id=fa6eb57488d84d5faeb7dd17835460fe)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:57.610034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463157af-74fb-4a03-8354-45923029bdcd tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:57.612205 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1154/2302] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:20:57 2022] GET /identity/v3/projects/fa6eb57488d84d5faeb7dd17835460fe => generated 371 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:57.613801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6ad16-ab5f-47c2-8c6f-376af28d6076 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:57.619831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6ad16-ab5f-47c2-8c6f-376af28d6076 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:57.619831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6ad16-ab5f-47c2-8c6f-376af28d6076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:57.657227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-50a6ad16-ab5f-47c2-8c6f-376af28d6076 None None] MFA Rules not processed for user `155c764ee16f4f9f85bd8cdeec2b2113`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:57.659357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-50a6ad16-ab5f-47c2-8c6f-376af28d6076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:57.683262 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1149/2303] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:57 2022] PUT /identity/v3/projects/bec75a22264846e290d8fa22ec347b86/users/580eb09a148440e5918fee1e04932d11/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:57.685375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa1091-a081-4705-a4e0-2ae418f63df3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:57.792308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa1091-a081-4705-a4e0-2ae418f63df3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:57.798648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2062f-0ac1-48b7-946e-397805eb3c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:57.800391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2062f-0ac1-48b7-946e-397805eb3c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:57.800723 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2062f-0ac1-48b7-946e-397805eb3c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:57.801011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2062f-0ac1-48b7-946e-397805eb3c9b admin admin] PATH_INFO: `/v3/projects/f4decc5104ea4ef59a8563d2ff68c64e/users/5c3833ef97804dc08e4c57b75d76bd24/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:57.804534 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1155/2304] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:57.808665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed5414-1034-46d5-b05d-a267b21e64f4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:57.809487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed5414-1034-46d5-b05d-a267b21e64f4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:57.809788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed5414-1034-46d5-b05d-a267b21e64f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:57.846265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2062f-0ac1-48b7-946e-397805eb3c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4decc5104ea4ef59a8563d2ff68c64e, user_id=5c3833ef97804dc08e4c57b75d76bd24, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:57.848009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-47ed5414-1034-46d5-b05d-a267b21e64f4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:57.848988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2062f-0ac1-48b7-946e-397805eb3c9b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:57.851897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-47ed5414-1034-46d5-b05d-a267b21e64f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:57.866654 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1156/2305] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:57.867526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed5414-1034-46d5-b05d-a267b21e64f4 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:57.947782 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1150/2306] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:57 2022] PUT /identity/v3/projects/f4decc5104ea4ef59a8563d2ff68c64e/users/5c3833ef97804dc08e4c57b75d76bd24/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:57.957559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2062f-0ac1-48b7-946e-397805eb3c9b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:58.027560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed5414-1034-46d5-b05d-a267b21e64f4 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:58.123381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2062f-0ac1-48b7-946e-397805eb3c9b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:58.130429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126fbff-767e-4fcc-a759-6374d20f0132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:58.131183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126fbff-767e-4fcc-a759-6374d20f0132 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:58.131562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126fbff-767e-4fcc-a759-6374d20f0132 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:58.131851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126fbff-767e-4fcc-a759-6374d20f0132 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:58.132628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126fbff-767e-4fcc-a759-6374d20f0132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:58.141563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126fbff-767e-4fcc-a759-6374d20f0132 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:58.159192 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1151/2307] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:58.159192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126fbff-767e-4fcc-a759-6374d20f0132 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:58.174060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126fbff-767e-4fcc-a759-6374d20f0132 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:58.181945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8eaf0-01ff-421b-83ba-81e7e48b497a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:58.182639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8eaf0-01ff-421b-83ba-81e7e48b497a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:58.182928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8eaf0-01ff-421b-83ba-81e7e48b497a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:58.183260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8eaf0-01ff-421b-83ba-81e7e48b497a admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:58.184212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8eaf0-01ff-421b-83ba-81e7e48b497a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:20:58.184977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8eaf0-01ff-421b-83ba-81e7e48b497a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:58.186781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8eaf0-01ff-421b-83ba-81e7e48b497a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:58.188261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a8373-f204-4e55-88fc-57f99ffeb20f tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47853e4aa36c4e82893a7040d89d637b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6dd5bacdef2423289ad6e616be5f19b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:58.189597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a8373-f204-4e55-88fc-57f99ffeb20f tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:58.190268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a8373-f204-4e55-88fc-57f99ffeb20f tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:58.190747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a8373-f204-4e55-88fc-57f99ffeb20f tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] PATH_INFO: `/v3/users/91b5d8fc6ae048deb73d97800a603dab` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:58.208757 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1152/2308] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:58.210658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8eaf0-01ff-421b-83ba-81e7e48b497a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:58.211140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a8373-f204-4e55-88fc-57f99ffeb20f tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorizing `identity:delete_user(user_id=91b5d8fc6ae048deb73d97800a603dab)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:58.227297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8eaf0-01ff-421b-83ba-81e7e48b497a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:58.228976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a8373-f204-4e55-88fc-57f99ffeb20f tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:58.233929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5922b4-59ce-4ade-997d-9edba27225c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:58.234718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5922b4-59ce-4ade-997d-9edba27225c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:58.235173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5922b4-59ce-4ade-997d-9edba27225c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:58.235612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5922b4-59ce-4ade-997d-9edba27225c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:58.236380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5922b4-59ce-4ade-997d-9edba27225c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:58.240477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5922b4-59ce-4ade-997d-9edba27225c7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:58.254983 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1153/2309] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:58.255824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5922b4-59ce-4ade-997d-9edba27225c7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:58.389404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5922b4-59ce-4ade-997d-9edba27225c7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:58.402622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348e1d8-11f4-47b6-ae90-45a6763e83d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:58.403488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348e1d8-11f4-47b6-ae90-45a6763e83d0 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:58.403782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348e1d8-11f4-47b6-ae90-45a6763e83d0 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:58.404064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348e1d8-11f4-47b6-ae90-45a6763e83d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:58.406460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-821a8373-f204-4e55-88fc-57f99ffeb20f tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91b5d8fc6ae048deb73d97800a603dab'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:58.409555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8348e1d8-11f4-47b6-ae90-45a6763e83d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:58.440547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-821a8373-f204-4e55-88fc-57f99ffeb20f tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91b5d8fc6ae048deb73d97800a603dab'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:58.441820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-821a8373-f204-4e55-88fc-57f99ffeb20f tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91b5d8fc6ae048deb73d97800a603dab'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:58.458136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-821a8373-f204-4e55-88fc-57f99ffeb20f tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91b5d8fc6ae048deb73d97800a603dab'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:58.506609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348e1d8-11f4-47b6-ae90-45a6763e83d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:58.508585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348e1d8-11f4-47b6-ae90-45a6763e83d0 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:58.520862 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1154/2310] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:20:58.523628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348e1d8-11f4-47b6-ae90-45a6763e83d0 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:58.534691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348e1d8-11f4-47b6-ae90-45a6763e83d0 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:58.541022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e350cce-2869-4136-88ff-d40e7bc8166e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:58.542088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e350cce-2869-4136-88ff-d40e7bc8166e admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:58.543286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e350cce-2869-4136-88ff-d40e7bc8166e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:58.543286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e350cce-2869-4136-88ff-d40e7bc8166e admin admin] PATH_INFO: `/v3/projects/bec75a22264846e290d8fa22ec347b86/users/580eb09a148440e5918fee1e04932d11/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:58.545497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e350cce-2869-4136-88ff-d40e7bc8166e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec75a22264846e290d8fa22ec347b86, user_id=580eb09a148440e5918fee1e04932d11, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:58.548373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e350cce-2869-4136-88ff-d40e7bc8166e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:58.559550 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1155/2311] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:58 2022] PUT /identity/v3/projects/bec75a22264846e290d8fa22ec347b86/users/580eb09a148440e5918fee1e04932d11/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:58.560519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e350cce-2869-4136-88ff-d40e7bc8166e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:58.622861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-821a8373-f204-4e55-88fc-57f99ffeb20f tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91b5d8fc6ae048deb73d97800a603dab'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:58.636233 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1157/2312] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:57 2022] DELETE /identity/v3/users/91b5d8fc6ae048deb73d97800a603dab => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:58.638864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a8373-f204-4e55-88fc-57f99ffeb20f tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:58.638864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-821a8373-f204-4e55-88fc-57f99ffeb20f tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:58.673703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e350cce-2869-4136-88ff-d40e7bc8166e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:58.793623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d27ef-0e25-4374-9a9f-f30a828975d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:58.794376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d27ef-0e25-4374-9a9f-f30a828975d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:58.794656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d27ef-0e25-4374-9a9f-f30a828975d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:58.794941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d27ef-0e25-4374-9a9f-f30a828975d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:58.795656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d27ef-0e25-4374-9a9f-f30a828975d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:58.806170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d27ef-0e25-4374-9a9f-f30a828975d0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:58.829571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a8373-f204-4e55-88fc-57f99ffeb20f tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:58.844759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716a765-6a70-4383-941d-056f0d769517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:58.850290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716a765-6a70-4383-941d-056f0d769517 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:58.850572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716a765-6a70-4383-941d-056f0d769517 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:58.850854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716a765-6a70-4383-941d-056f0d769517 admin admin] PATH_INFO: `/v3/projects/f4decc5104ea4ef59a8563d2ff68c64e/users/5c3833ef97804dc08e4c57b75d76bd24/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:58.853272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716a765-6a70-4383-941d-056f0d769517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4decc5104ea4ef59a8563d2ff68c64e, user_id=5c3833ef97804dc08e4c57b75d76bd24, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:58.856371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716a765-6a70-4383-941d-056f0d769517 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:58.872146 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1158/2313] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:20:58 2022] PUT /identity/v3/projects/f4decc5104ea4ef59a8563d2ff68c64e/users/5c3833ef97804dc08e4c57b75d76bd24/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:58.874027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672953d-673a-42bf-90af-5de92d60f81c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:58.874392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672953d-673a-42bf-90af-5de92d60f81c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:58.874759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672953d-673a-42bf-90af-5de92d60f81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:58.911714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8672953d-673a-42bf-90af-5de92d60f81c None None] MFA Rules not processed for user `580eb09a148440e5918fee1e04932d11`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:20:58.913218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8672953d-673a-42bf-90af-5de92d60f81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:58.933821 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1156/2314] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:20:58 2022] POST /identity/v3/projects => generated 399 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:58.933821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d27ef-0e25-4374-9a9f-f30a828975d0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:58.939850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-cb1d27ef-0e25-4374-9a9f-f30a828975d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:59.067079 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1159/2315] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:20:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:20:59.067079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c63a7f-c5e3-4340-a25f-2aa59d039b9c None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:59.067079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c63a7f-c5e3-4340-a25f-2aa59d039b9c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:59.067079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c63a7f-c5e3-4340-a25f-2aa59d039b9c None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:59.067866 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1160/2316] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:20:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:20:59.068703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c63a7f-c5e3-4340-a25f-2aa59d039b9c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:59.071296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d3c63a7f-c5e3-4340-a25f-2aa59d039b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:59.119940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d27ef-0e25-4374-9a9f-f30a828975d0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:59.134332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25631eac-3b72-4ca6-99d3-b7bac0012aa2 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47853e4aa36c4e82893a7040d89d637b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6dd5bacdef2423289ad6e616be5f19b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:59.135249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25631eac-3b72-4ca6-99d3-b7bac0012aa2 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:59.137325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25631eac-3b72-4ca6-99d3-b7bac0012aa2 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:59.137690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25631eac-3b72-4ca6-99d3-b7bac0012aa2 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] PATH_INFO: `/v3/projects/fa6eb57488d84d5faeb7dd17835460fe` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:59.139543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25631eac-3b72-4ca6-99d3-b7bac0012aa2 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fa6eb57488d84d5faeb7dd17835460fe)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:59.144050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25631eac-3b72-4ca6-99d3-b7bac0012aa2 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:59.229373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c63a7f-c5e3-4340-a25f-2aa59d039b9c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:59.242040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa433d-63af-4237-9ec9-2953b4d21921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:59.242752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa433d-63af-4237-9ec9-2953b4d21921 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:59.243034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa433d-63af-4237-9ec9-2953b4d21921 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:59.243316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa433d-63af-4237-9ec9-2953b4d21921 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:59.244058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa433d-63af-4237-9ec9-2953b4d21921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:59.246169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa433d-63af-4237-9ec9-2953b4d21921 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:59.353878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-25631eac-3b72-4ca6-99d3-b7bac0012aa2 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa6eb57488d84d5faeb7dd17835460fe', 'request_id': 'req-25631eac-3b72-4ca6-99d3-b7bac0012aa2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:59.372968 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1161/2317] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:20:59 2022] POST /identity/v3/users => generated 300 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:20:59.372968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa433d-63af-4237-9ec9-2953b4d21921 admin admin] Authenticating service token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:20:59.375259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d2fa433d-63af-4237-9ec9-2953b4d21921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:59.445454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-25631eac-3b72-4ca6-99d3-b7bac0012aa2 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa6eb57488d84d5faeb7dd17835460fe', 'request_id': 'req-25631eac-3b72-4ca6-99d3-b7bac0012aa2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:59.454343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-25631eac-3b72-4ca6-99d3-b7bac0012aa2 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa6eb57488d84d5faeb7dd17835460fe', 'request_id': 'req-25631eac-3b72-4ca6-99d3-b7bac0012aa2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:59.482244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-25631eac-3b72-4ca6-99d3-b7bac0012aa2 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] The token cache is being invalidate because project fa6eb57488d84d5faeb7dd17835460fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:20:59.482537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-25631eac-3b72-4ca6-99d3-b7bac0012aa2 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:59.483217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-25631eac-3b72-4ca6-99d3-b7bac0012aa2 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:20:59.484844 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1157/2318] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:20:58 2022] DELETE /identity/v3/projects/fa6eb57488d84d5faeb7dd17835460fe => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:20:59.485773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25631eac-3b72-4ca6-99d3-b7bac0012aa2 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:59.487980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-25631eac-3b72-4ca6-99d3-b7bac0012aa2 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:59.538979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa433d-63af-4237-9ec9-2953b4d21921 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:59.540925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d2fa433d-63af-4237-9ec9-2953b4d21921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:59.683546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa433d-63af-4237-9ec9-2953b4d21921 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:59.692427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25631eac-3b72-4ca6-99d3-b7bac0012aa2 tempest-QuotasAdminTestV236-505873937 tempest-QuotasAdminTestV236-505873937-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:59.699969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb605f9-82f0-4985-acf9-420aef22b5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:59.701198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb605f9-82f0-4985-acf9-420aef22b5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:59.701492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb605f9-82f0-4985-acf9-420aef22b5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:59.702265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb605f9-82f0-4985-acf9-420aef22b5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:59.705296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb605f9-82f0-4985-acf9-420aef22b5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:59.713053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb605f9-82f0-4985-acf9-420aef22b5c5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:59.737903 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1158/2319] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:59.738829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb605f9-82f0-4985-acf9-420aef22b5c5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:59.742146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ccb605f9-82f0-4985-acf9-420aef22b5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:59.768865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb605f9-82f0-4985-acf9-420aef22b5c5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:59.776806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6ca92-e2c5-41f5-a3ff-bfa728da3ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:59.777680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914301c-fa7c-4861-9909-c7e557aad3bd tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '727422c06ae941c38621a7e49c62cb66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4524ce8eafa4df6be549375f4a7d2da', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:59.778261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6ca92-e2c5-41f5-a3ff-bfa728da3ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:59.778554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6ca92-e2c5-41f5-a3ff-bfa728da3ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:59.778886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6ca92-e2c5-41f5-a3ff-bfa728da3ef0 admin admin] PATH_INFO: `/v3/users/e3a708797f8a483181d8b2e977e1d37b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:59.779664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914301c-fa7c-4861-9909-c7e557aad3bd tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:59.780217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914301c-fa7c-4861-9909-c7e557aad3bd tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:59.780801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914301c-fa7c-4861-9909-c7e557aad3bd tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] PATH_INFO: `/v3/projects/659aad68dfff4491b919d91a8cb36569` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:59.782395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914301c-fa7c-4861-9909-c7e557aad3bd tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] RBAC: Authorizing `identity:get_project(project_id=659aad68dfff4491b919d91a8cb36569)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:59.786178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914301c-fa7c-4861-9909-c7e557aad3bd tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:59.790143 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1162/2320] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:20:59 2022] GET /identity/v3/projects/659aad68dfff4491b919d91a8cb36569 => generated 395 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:20:59.791651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914301c-fa7c-4861-9909-c7e557aad3bd tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:59.805459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914301c-fa7c-4861-9909-c7e557aad3bd tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:59.811427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9661b5-b66d-4650-8ef2-116589b0f4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:59.812338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9661b5-b66d-4650-8ef2-116589b0f4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:59.812773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9661b5-b66d-4650-8ef2-116589b0f4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:59.813151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9661b5-b66d-4650-8ef2-116589b0f4b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:59.814010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9661b5-b66d-4650-8ef2-116589b0f4b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:59.815799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9661b5-b66d-4650-8ef2-116589b0f4b9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:59.824086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6ca92-e2c5-41f5-a3ff-bfa728da3ef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a708797f8a483181d8b2e977e1d37b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:20:59.834142 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1163/2321] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:20:59.834142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9661b5-b66d-4650-8ef2-116589b0f4b9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:20:59.835365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1f9661b5-b66d-4650-8ef2-116589b0f4b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:20:59.841233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6ca92-e2c5-41f5-a3ff-bfa728da3ef0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:20:59.941764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9661b5-b66d-4650-8ef2-116589b0f4b9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:20:59.952926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aed4c1-9e1c-4cb2-894f-c10b4cda098a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:20:59.954081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aed4c1-9e1c-4cb2-894f-c10b4cda098a service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:20:59.954632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aed4c1-9e1c-4cb2-894f-c10b4cda098a service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:20:59.954991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aed4c1-9e1c-4cb2-894f-c10b4cda098a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:20:59.957795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b8aed4c1-9e1c-4cb2-894f-c10b4cda098a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:00.062080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aed4c1-9e1c-4cb2-894f-c10b4cda098a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:00.067198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aed4c1-9e1c-4cb2-894f-c10b4cda098a service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:00.089388 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1164/2322] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:20:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:00.090508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aed4c1-9e1c-4cb2-894f-c10b4cda098a service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:00.107107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aed4c1-9e1c-4cb2-894f-c10b4cda098a service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:00.107950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c86fea-eb81-4a3d-87df-ae5b42893737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:00.108987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c86fea-eb81-4a3d-87df-ae5b42893737 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:00.109372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c86fea-eb81-4a3d-87df-ae5b42893737 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:00.109866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c86fea-eb81-4a3d-87df-ae5b42893737 admin admin] PATH_INFO: `/v3/projects/1cac3c24f0d542edb2cbf4d83fb357ea/users/861ab85ac83d4004901e692577d1d972/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:00.141153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c86fea-eb81-4a3d-87df-ae5b42893737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cac3c24f0d542edb2cbf4d83fb357ea, user_id=861ab85ac83d4004901e692577d1d972, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:00.144548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c86fea-eb81-4a3d-87df-ae5b42893737 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:00.152492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-77e6ca92-e2c5-41f5-a3ff-bfa728da3ef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a708797f8a483181d8b2e977e1d37b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:00.168478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-77e6ca92-e2c5-41f5-a3ff-bfa728da3ef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a708797f8a483181d8b2e977e1d37b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:00.170342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-77e6ca92-e2c5-41f5-a3ff-bfa728da3ef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a708797f8a483181d8b2e977e1d37b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:00.179437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-77e6ca92-e2c5-41f5-a3ff-bfa728da3ef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a708797f8a483181d8b2e977e1d37b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:00.240714 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1165/2323] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:21:00 2022] PUT /identity/v3/projects/1cac3c24f0d542edb2cbf4d83fb357ea/users/861ab85ac83d4004901e692577d1d972/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:00.247648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73530a02-bc57-4547-81e2-b093b8f2193e None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:00.248163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73530a02-bc57-4547-81e2-b093b8f2193e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:00.248692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73530a02-bc57-4547-81e2-b093b8f2193e None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:00.250300 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1166/2324] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:21:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 10:21:00.253259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e25596-41e4-4895-a583-31ff7ca1c645 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:00.253553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e25596-41e4-4895-a583-31ff7ca1c645 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:00.253837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e25596-41e4-4895-a583-31ff7ca1c645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:00.297882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-25e25596-41e4-4895-a583-31ff7ca1c645 None None] MFA Rules not processed for user `861ab85ac83d4004901e692577d1d972`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:00.298866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-77e6ca92-e2c5-41f5-a3ff-bfa728da3ef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a708797f8a483181d8b2e977e1d37b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:00.299350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-25e25596-41e4-4895-a583-31ff7ca1c645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:00.306257 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1159/2325] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:20:59 2022] DELETE /identity/v3/users/e3a708797f8a483181d8b2e977e1d37b => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:00.310716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6ca92-e2c5-41f5-a3ff-bfa728da3ef0 admin admin] Authenticating service token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:21:00.317036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-77e6ca92-e2c5-41f5-a3ff-bfa728da3ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:00.420588 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1167/2326] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:21:00.420588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ea755-2c94-4b4c-944c-cfef68b2b690 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:00.423574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ea755-2c94-4b4c-944c-cfef68b2b690 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:00.423900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ea755-2c94-4b4c-944c-cfef68b2b690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:00.445782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-557ea755-2c94-4b4c-944c-cfef68b2b690 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:00.447197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-557ea755-2c94-4b4c-944c-cfef68b2b690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:00.451496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6ca92-e2c5-41f5-a3ff-bfa728da3ef0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:00.452691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-77e6ca92-e2c5-41f5-a3ff-bfa728da3ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:00.563312 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1168/2327] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:00.564410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ea755-2c94-4b4c-944c-cfef68b2b690 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:00.577138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-557ea755-2c94-4b4c-944c-cfef68b2b690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:00.584821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6ca92-e2c5-41f5-a3ff-bfa728da3ef0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:00.590196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e671a-edf2-4278-9311-02b7c984c052 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '727422c06ae941c38621a7e49c62cb66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4524ce8eafa4df6be549375f4a7d2da', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:00.591434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e671a-edf2-4278-9311-02b7c984c052 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:00.591830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e671a-edf2-4278-9311-02b7c984c052 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:00.592573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e671a-edf2-4278-9311-02b7c984c052 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] PATH_INFO: `/v3/projects/659aad68dfff4491b919d91a8cb36569` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:00.593917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e671a-edf2-4278-9311-02b7c984c052 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] RBAC: Authorizing `identity:get_project(project_id=659aad68dfff4491b919d91a8cb36569)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:00.596212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e671a-edf2-4278-9311-02b7c984c052 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:00.598441 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1160/2328] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:21:00 2022] GET /identity/v3/projects/659aad68dfff4491b919d91a8cb36569 => generated 395 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:21:00.599791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e671a-edf2-4278-9311-02b7c984c052 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:00.604591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d99e671a-edf2-4278-9311-02b7c984c052 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:00.605925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ea755-2c94-4b4c-944c-cfef68b2b690 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:00.620156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d9b52-33f2-4d7f-8bf8-95a9d974e525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:00.620875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d9b52-33f2-4d7f-8bf8-95a9d974e525 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:00.621164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d9b52-33f2-4d7f-8bf8-95a9d974e525 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:00.621445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d9b52-33f2-4d7f-8bf8-95a9d974e525 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:00.622404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d9b52-33f2-4d7f-8bf8-95a9d974e525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:00.624355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d9b52-33f2-4d7f-8bf8-95a9d974e525 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:00.638343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e671a-edf2-4278-9311-02b7c984c052 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:00.649508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bd373-515f-456d-8c42-25db6adc5a9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:00.651282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bd373-515f-456d-8c42-25db6adc5a9a service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:00.651831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bd373-515f-456d-8c42-25db6adc5a9a service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:00.652866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bd373-515f-456d-8c42-25db6adc5a9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:00.658506 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-769bd373-515f-456d-8c42-25db6adc5a9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:00.760934 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1169/2329] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:21:00 2022] POST /identity/v3/projects => generated 399 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:00.762121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d9b52-33f2-4d7f-8bf8-95a9d974e525 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:00.765301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b19d9b52-33f2-4d7f-8bf8-95a9d974e525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:00.767088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bd373-515f-456d-8c42-25db6adc5a9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:00.769422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bd373-515f-456d-8c42-25db6adc5a9a service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:00.783578 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1161/2330] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:00.786973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b743e0-c13d-480e-997b-471dd93e7c90 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:00.787591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b743e0-c13d-480e-997b-471dd93e7c90 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:00.808192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b743e0-c13d-480e-997b-471dd93e7c90 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:00.814550 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1162/2331] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:21:00 2022] GET /identity => generated 270 bytes in 30 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:21:00.816933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b743e0-c13d-480e-997b-471dd93e7c90 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:00.904234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d9b52-33f2-4d7f-8bf8-95a9d974e525 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:00.913105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7955a6e-f548-45a5-a0dd-32032965258d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:00.914135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7955a6e-f548-45a5-a0dd-32032965258d service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:00.914641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7955a6e-f548-45a5-a0dd-32032965258d service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:00.915244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7955a6e-f548-45a5-a0dd-32032965258d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:01.022893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b743e0-c13d-480e-997b-471dd93e7c90 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:01.038769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc617f2-ed8b-47e8-b8fc-9c067c422848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:01.039470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc617f2-ed8b-47e8-b8fc-9c067c422848 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:01.039760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc617f2-ed8b-47e8-b8fc-9c067c422848 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:01.040040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc617f2-ed8b-47e8-b8fc-9c067c422848 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:01.041510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc617f2-ed8b-47e8-b8fc-9c067c422848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:01.043499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc617f2-ed8b-47e8-b8fc-9c067c422848 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:01.076146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7955a6e-f548-45a5-a0dd-32032965258d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:01.078269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7955a6e-f548-45a5-a0dd-32032965258d service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:01.093373 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1170/2332] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:01.094397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7955a6e-f548-45a5-a0dd-32032965258d service neutron] Authenticating service token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:21:01.153963 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1163/2333] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:21:00 2022] POST /identity/v3/users => generated 306 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:01.154900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc617f2-ed8b-47e8-b8fc-9c067c422848 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:01.177749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc617f2-ed8b-47e8-b8fc-9c067c422848 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:01.200123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0d618-675e-4ee4-83a3-14329aae6cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:01.201024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0d618-675e-4ee4-83a3-14329aae6cba admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:01.201172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0d618-675e-4ee4-83a3-14329aae6cba admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:01.201427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0d618-675e-4ee4-83a3-14329aae6cba admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:01.202174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0d618-675e-4ee4-83a3-14329aae6cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:01.203896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0d618-675e-4ee4-83a3-14329aae6cba admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:01.231501 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1164/2334] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:01.232055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0d618-675e-4ee4-83a3-14329aae6cba admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:01.255318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0d618-675e-4ee4-83a3-14329aae6cba admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:01.271481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e2ad8-b6e2-493f-9e28-40a254dbad12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:01.273202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e2ad8-b6e2-493f-9e28-40a254dbad12 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:01.273923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e2ad8-b6e2-493f-9e28-40a254dbad12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:01.274034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e2ad8-b6e2-493f-9e28-40a254dbad12 admin admin] PATH_INFO: `/v3/projects/ba6a7b44b12e458da01c6185dd7b2363/users/4886dd9e480943b788d77e81eef669e0/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:01.277348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7955a6e-f548-45a5-a0dd-32032965258d service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:01.306119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e2ad8-b6e2-493f-9e28-40a254dbad12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6a7b44b12e458da01c6185dd7b2363, user_id=4886dd9e480943b788d77e81eef669e0, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:01.315030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e2ad8-b6e2-493f-9e28-40a254dbad12 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:01.378156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7955a6e-f548-45a5-a0dd-32032965258d service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:01.386002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd130c-1998-41c5-ae72-813bd561db6a tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '727422c06ae941c38621a7e49c62cb66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4524ce8eafa4df6be549375f4a7d2da', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:01.387425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd130c-1998-41c5-ae72-813bd561db6a tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:01.392218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd130c-1998-41c5-ae72-813bd561db6a tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:01.392218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd130c-1998-41c5-ae72-813bd561db6a tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] PATH_INFO: `/v3/projects/659aad68dfff4491b919d91a8cb36569` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:01.392218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd130c-1998-41c5-ae72-813bd561db6a tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] RBAC: Authorizing `identity:get_project(project_id=659aad68dfff4491b919d91a8cb36569)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:01.393309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd130c-1998-41c5-ae72-813bd561db6a tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:01.400932 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1171/2335] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:21:01 2022] GET /identity/v3/projects/659aad68dfff4491b919d91a8cb36569 => generated 395 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:21:01.407767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd130c-1998-41c5-ae72-813bd561db6a tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:01.410611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0cbd130c-1998-41c5-ae72-813bd561db6a tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:01.425634 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1165/2336] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:21:01 2022] PUT /identity/v3/projects/ba6a7b44b12e458da01c6185dd7b2363/users/4886dd9e480943b788d77e81eef669e0/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:01.425634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e2ad8-b6e2-493f-9e28-40a254dbad12 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:01.453147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd130c-1998-41c5-ae72-813bd561db6a tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:01.595140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e2ad8-b6e2-493f-9e28-40a254dbad12 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:01.605470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed66453-844e-4c1d-b779-5c01c36ed298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:01.606469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed66453-844e-4c1d-b779-5c01c36ed298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:01.606690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed66453-844e-4c1d-b779-5c01c36ed298 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:01.606925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed66453-844e-4c1d-b779-5c01c36ed298 admin admin] PATH_INFO: `/v3/users/c3c6f32721844e64a543a175f7c4d319` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:01.609344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a0e06-4668-4a7e-8e28-8683839241b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:01.610040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a0e06-4668-4a7e-8e28-8683839241b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:01.610322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a0e06-4668-4a7e-8e28-8683839241b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:01.610601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a0e06-4668-4a7e-8e28-8683839241b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:01.611359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a0e06-4668-4a7e-8e28-8683839241b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:01.612412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed66453-844e-4c1d-b779-5c01c36ed298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3c6f32721844e64a543a175f7c4d319)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:01.614414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed66453-844e-4c1d-b779-5c01c36ed298 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:01.617693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a0e06-4668-4a7e-8e28-8683839241b9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:01.641791 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1166/2337] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:01.653111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a0e06-4668-4a7e-8e28-8683839241b9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:01.680382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a0e06-4668-4a7e-8e28-8683839241b9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:01.692088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf89145-a069-4755-8830-459ff2bef31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:01.694778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf89145-a069-4755-8830-459ff2bef31e admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:01.694778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf89145-a069-4755-8830-459ff2bef31e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:01.694778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf89145-a069-4755-8830-459ff2bef31e admin admin] PATH_INFO: `/v3/projects/ba6a7b44b12e458da01c6185dd7b2363/users/4886dd9e480943b788d77e81eef669e0/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:01.696577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf89145-a069-4755-8830-459ff2bef31e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6a7b44b12e458da01c6185dd7b2363, user_id=4886dd9e480943b788d77e81eef669e0, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:01.699390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf89145-a069-4755-8830-459ff2bef31e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:01.721382 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1167/2338] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:21:01 2022] PUT /identity/v3/projects/ba6a7b44b12e458da01c6185dd7b2363/users/4886dd9e480943b788d77e81eef669e0/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:01.722862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a98e3-f697-4299-a76e-3c48e5d62dad None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:01.723159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a98e3-f697-4299-a76e-3c48e5d62dad None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:01.723447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a98e3-f697-4299-a76e-3c48e5d62dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:01.793427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-256a98e3-f697-4299-a76e-3c48e5d62dad None None] MFA Rules not processed for user `4886dd9e480943b788d77e81eef669e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:01.795365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-256a98e3-f697-4299-a76e-3c48e5d62dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:01.950367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eed66453-844e-4c1d-b779-5c01c36ed298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3c6f32721844e64a543a175f7c4d319'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:01.978228 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1168/2339] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:01 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:01.989901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eed66453-844e-4c1d-b779-5c01c36ed298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3c6f32721844e64a543a175f7c4d319'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:01.991829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eed66453-844e-4c1d-b779-5c01c36ed298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3c6f32721844e64a543a175f7c4d319'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:02.002485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a98e3-f697-4299-a76e-3c48e5d62dad None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:02.031008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eed66453-844e-4c1d-b779-5c01c36ed298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3c6f32721844e64a543a175f7c4d319'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:02.099563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eed66453-844e-4c1d-b779-5c01c36ed298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3c6f32721844e64a543a175f7c4d319'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:02.108003 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1172/2340] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:21:01 2022] DELETE /identity/v3/users/c3c6f32721844e64a543a175f7c4d319 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:02.112304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2c6c6-0b0a-4290-a484-6decc4f959aa None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:02.112771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2c6c6-0b0a-4290-a484-6decc4f959aa None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:02.113762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2c6c6-0b0a-4290-a484-6decc4f959aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:02.161834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0ae2c6c6-0b0a-4290-a484-6decc4f959aa None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:02.162446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a98e3-f697-4299-a76e-3c48e5d62dad None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:02.165252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0ae2c6c6-0b0a-4290-a484-6decc4f959aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:02.339279 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1173/2341] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:21:02.343306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cbe1d-5611-4cc6-a912-bf2ef029affa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:02.344094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cbe1d-5611-4cc6-a912-bf2ef029affa service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:02.344629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cbe1d-5611-4cc6-a912-bf2ef029affa service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:02.345136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cbe1d-5611-4cc6-a912-bf2ef029affa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:02.347219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-624cbe1d-5611-4cc6-a912-bf2ef029affa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:02.362281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2c6c6-0b0a-4290-a484-6decc4f959aa None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:02.364106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0ae2c6c6-0b0a-4290-a484-6decc4f959aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:02.437612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2c6c6-0b0a-4290-a484-6decc4f959aa None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:02.441756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5712aa-c809-4ed1-95f8-01b127bb96c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:02.442558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5712aa-c809-4ed1-95f8-01b127bb96c6 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:02.442952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5712aa-c809-4ed1-95f8-01b127bb96c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:02.443336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5712aa-c809-4ed1-95f8-01b127bb96c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:02.451852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624cbe1d-5611-4cc6-a912-bf2ef029affa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:02.454389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624cbe1d-5611-4cc6-a912-bf2ef029affa service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:02.456936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5712aa-c809-4ed1-95f8-01b127bb96c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:02.458887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5712aa-c809-4ed1-95f8-01b127bb96c6 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:02.478403 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1174/2342] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:02.480616 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1169/2343] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:02 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:21:02.689109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5712aa-c809-4ed1-95f8-01b127bb96c6 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:02.691425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5b5712aa-c809-4ed1-95f8-01b127bb96c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:02.715650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5712aa-c809-4ed1-95f8-01b127bb96c6 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:02.719379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cbe1d-5611-4cc6-a912-bf2ef029affa service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:02.720957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-624cbe1d-5611-4cc6-a912-bf2ef029affa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:02.728070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5be242-d8fb-4256-97a9-afac7ada8f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:02.728983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5be242-d8fb-4256-97a9-afac7ada8f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:02.729270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5be242-d8fb-4256-97a9-afac7ada8f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:02.729553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5be242-d8fb-4256-97a9-afac7ada8f65 admin admin] PATH_INFO: `/v3/projects/f63d3cc11e804e6083e7a8343b47bac5` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:02.732057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5be242-d8fb-4256-97a9-afac7ada8f65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f63d3cc11e804e6083e7a8343b47bac5)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:02.734037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5be242-d8fb-4256-97a9-afac7ada8f65 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:02.740150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cbe1d-5611-4cc6-a912-bf2ef029affa service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:02.747450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612184ea-24f6-4e26-b066-4a52653c419a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:02.748122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612184ea-24f6-4e26-b066-4a52653c419a service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:02.748404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612184ea-24f6-4e26-b066-4a52653c419a service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:02.748705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612184ea-24f6-4e26-b066-4a52653c419a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:02.750948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-612184ea-24f6-4e26-b066-4a52653c419a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:02.876720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612184ea-24f6-4e26-b066-4a52653c419a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:02.878603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612184ea-24f6-4e26-b066-4a52653c419a service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:02.892391 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1170/2344] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:02.893687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612184ea-24f6-4e26-b066-4a52653c419a service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:02.895340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-612184ea-24f6-4e26-b066-4a52653c419a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:02.920572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dd5be242-d8fb-4256-97a9-afac7ada8f65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f63d3cc11e804e6083e7a8343b47bac5', 'request_id': 'req-dd5be242-d8fb-4256-97a9-afac7ada8f65'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:02.920791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612184ea-24f6-4e26-b066-4a52653c419a service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:02.923097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dd5be242-d8fb-4256-97a9-afac7ada8f65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f63d3cc11e804e6083e7a8343b47bac5', 'request_id': 'req-dd5be242-d8fb-4256-97a9-afac7ada8f65'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:03.039623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dd5be242-d8fb-4256-97a9-afac7ada8f65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f63d3cc11e804e6083e7a8343b47bac5', 'request_id': 'req-dd5be242-d8fb-4256-97a9-afac7ada8f65'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:03.056305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dd5be242-d8fb-4256-97a9-afac7ada8f65 admin admin] The token cache is being invalidate because project f63d3cc11e804e6083e7a8343b47bac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:21:03.056305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dd5be242-d8fb-4256-97a9-afac7ada8f65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:03.057033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dd5be242-d8fb-4256-97a9-afac7ada8f65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:03.058631 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1175/2345] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:21:02 2022] DELETE /identity/v3/projects/f63d3cc11e804e6083e7a8343b47bac5 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:03.062432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1420e3-09ea-4a88-a270-0d564038af6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:03.063418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1420e3-09ea-4a88-a270-0d564038af6b service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:03.063907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1420e3-09ea-4a88-a270-0d564038af6b service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:03.064387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1420e3-09ea-4a88-a270-0d564038af6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:03.066830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fb1420e3-09ea-4a88-a270-0d564038af6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:03.070339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34299d98-1721-4df5-86ab-ae932b5b7c60 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:03.070631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34299d98-1721-4df5-86ab-ae932b5b7c60 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:03.072306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34299d98-1721-4df5-86ab-ae932b5b7c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:03.109715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-34299d98-1721-4df5-86ab-ae932b5b7c60 None None] MFA Rules not processed for user `0360b7261526403786bc77b8945c815b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:03.111154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-34299d98-1721-4df5-86ab-ae932b5b7c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:03.263538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1420e3-09ea-4a88-a270-0d564038af6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:03.267841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1420e3-09ea-4a88-a270-0d564038af6b service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:03.293396 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1176/2346] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:03.299323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34299d98-1721-4df5-86ab-ae932b5b7c60 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:03.301333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-34299d98-1721-4df5-86ab-ae932b5b7c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:03.309955 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1171/2347] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:02 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:03.338068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b26678-fc4f-4a82-9be7-b41f8df2f1b3 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:03.338357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b26678-fc4f-4a82-9be7-b41f8df2f1b3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:03.338640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b26678-fc4f-4a82-9be7-b41f8df2f1b3 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:03.342710 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1172/2348] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:21:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:21:03.348342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b26678-fc4f-4a82-9be7-b41f8df2f1b3 None None] Authenticating service token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:21:03.354355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c1b26678-fc4f-4a82-9be7-b41f8df2f1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:03.404081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b26678-fc4f-4a82-9be7-b41f8df2f1b3 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:03.406256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c1b26678-fc4f-4a82-9be7-b41f8df2f1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:03.466718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34299d98-1721-4df5-86ab-ae932b5b7c60 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:03.469416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd27b7-716a-4312-b549-9972a3c97897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:03.470470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd27b7-716a-4312-b549-9972a3c97897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:03.470736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd27b7-716a-4312-b549-9972a3c97897 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:03.471140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd27b7-716a-4312-b549-9972a3c97897 admin admin] PATH_INFO: `/v3/users/47853e4aa36c4e82893a7040d89d637b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:03.472472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd27b7-716a-4312-b549-9972a3c97897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47853e4aa36c4e82893a7040d89d637b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:03.482706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd27b7-716a-4312-b549-9972a3c97897 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:03.547050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b26678-fc4f-4a82-9be7-b41f8df2f1b3 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:03.559031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a0d0b-3075-4283-89e1-dde06f3d40d5 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '727422c06ae941c38621a7e49c62cb66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4524ce8eafa4df6be549375f4a7d2da', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:03.559970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a0d0b-3075-4283-89e1-dde06f3d40d5 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:03.560410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a0d0b-3075-4283-89e1-dde06f3d40d5 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:03.564188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a0d0b-3075-4283-89e1-dde06f3d40d5 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] PATH_INFO: `/v3/projects/659aad68dfff4491b919d91a8cb36569` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:03.564188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a0d0b-3075-4283-89e1-dde06f3d40d5 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] RBAC: Authorizing `identity:get_project(project_id=659aad68dfff4491b919d91a8cb36569)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:03.575323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a0d0b-3075-4283-89e1-dde06f3d40d5 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:03.597208 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1173/2349] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:21:03 2022] GET /identity/v3/projects/659aad68dfff4491b919d91a8cb36569 => generated 395 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:21:03.599753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a3480-fe52-432c-8579-94cb7f8376d2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:03.601798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a3480-fe52-432c-8579-94cb7f8376d2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:03.602283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a3480-fe52-432c-8579-94cb7f8376d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:03.653244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-524a3480-fe52-432c-8579-94cb7f8376d2 None None] MFA Rules not processed for user `5c3833ef97804dc08e4c57b75d76bd24`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:03.654964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-524a3480-fe52-432c-8579-94cb7f8376d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:03.762370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-22fd27b7-716a-4312-b549-9972a3c97897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47853e4aa36c4e82893a7040d89d637b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:03.803730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-22fd27b7-716a-4312-b549-9972a3c97897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47853e4aa36c4e82893a7040d89d637b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:03.807356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-22fd27b7-716a-4312-b549-9972a3c97897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47853e4aa36c4e82893a7040d89d637b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:03.831528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-22fd27b7-716a-4312-b549-9972a3c97897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47853e4aa36c4e82893a7040d89d637b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:03.892782 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1174/2350] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:03.894524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b2b39-33d9-45f0-a8b8-a92423a72e85 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:03.894821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b2b39-33d9-45f0-a8b8-a92423a72e85 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:03.895103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b2b39-33d9-45f0-a8b8-a92423a72e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:03.905454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-22fd27b7-716a-4312-b549-9972a3c97897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47853e4aa36c4e82893a7040d89d637b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:03.915631 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1177/2351] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:21:03 2022] DELETE /identity/v3/users/47853e4aa36c4e82893a7040d89d637b => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:03.916939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd27b7-716a-4312-b549-9972a3c97897 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:03.935713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ac9b2b39-33d9-45f0-a8b8-a92423a72e85 None None] MFA Rules not processed for user `5a4826566d7d486db4e9fd217bccac2a`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:03.936030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-22fd27b7-716a-4312-b549-9972a3c97897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:03.936983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ac9b2b39-33d9-45f0-a8b8-a92423a72e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:04.009387 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1175/2352] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:04.066768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd27b7-716a-4312-b549-9972a3c97897 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:04.072646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8eb5c-208d-494e-8c90-d2c13bbc15d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:04.073718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8eb5c-208d-494e-8c90-d2c13bbc15d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:04.074263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8eb5c-208d-494e-8c90-d2c13bbc15d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:04.074841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8eb5c-208d-494e-8c90-d2c13bbc15d2 admin admin] PATH_INFO: `/v3/projects/00534d20e27e4935b1227e59f813906d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:04.076221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8eb5c-208d-494e-8c90-d2c13bbc15d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00534d20e27e4935b1227e59f813906d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:04.078374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8eb5c-208d-494e-8c90-d2c13bbc15d2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:04.224341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1ef8eb5c-208d-494e-8c90-d2c13bbc15d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00534d20e27e4935b1227e59f813906d', 'request_id': 'req-1ef8eb5c-208d-494e-8c90-d2c13bbc15d2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:04.244459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1ef8eb5c-208d-494e-8c90-d2c13bbc15d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00534d20e27e4935b1227e59f813906d', 'request_id': 'req-1ef8eb5c-208d-494e-8c90-d2c13bbc15d2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:04.344777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d8634-55ee-4db8-960c-900d9ce5644a None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:04.345705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d8634-55ee-4db8-960c-900d9ce5644a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:04.346164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d8634-55ee-4db8-960c-900d9ce5644a None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:04.348171 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1176/2353] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:21:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:21:04.354320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d8634-55ee-4db8-960c-900d9ce5644a None None] Authenticating service token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:21:04.356433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ec5d8634-55ee-4db8-960c-900d9ce5644a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:04.361984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1ef8eb5c-208d-494e-8c90-d2c13bbc15d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00534d20e27e4935b1227e59f813906d', 'request_id': 'req-1ef8eb5c-208d-494e-8c90-d2c13bbc15d2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:04.378301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1ef8eb5c-208d-494e-8c90-d2c13bbc15d2 admin admin] The token cache is being invalidate because project 00534d20e27e4935b1227e59f813906d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:21:04.378626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1ef8eb5c-208d-494e-8c90-d2c13bbc15d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:04.380793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1ef8eb5c-208d-494e-8c90-d2c13bbc15d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:04.389638 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1178/2354] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:21:03 2022] DELETE /identity/v3/projects/00534d20e27e4935b1227e59f813906d => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:04.391681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8eb5c-208d-494e-8c90-d2c13bbc15d2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:04.393234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1ef8eb5c-208d-494e-8c90-d2c13bbc15d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:04.477839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d8634-55ee-4db8-960c-900d9ce5644a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:04.479279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ec5d8634-55ee-4db8-960c-900d9ce5644a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:04.537147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8eb5c-208d-494e-8c90-d2c13bbc15d2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:04.555293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fdd30-811c-4493-9891-d4399184b846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:04.556126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fdd30-811c-4493-9891-d4399184b846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:04.556408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fdd30-811c-4493-9891-d4399184b846 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:04.556706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fdd30-811c-4493-9891-d4399184b846 admin admin] PATH_INFO: `/v3/users/580eb09a148440e5918fee1e04932d11` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:04.559561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fdd30-811c-4493-9891-d4399184b846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=580eb09a148440e5918fee1e04932d11)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:04.561729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fdd30-811c-4493-9891-d4399184b846 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:04.631787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d8634-55ee-4db8-960c-900d9ce5644a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:04.637849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6567a-8c9b-4f7d-b1df-6e015338e270 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '727422c06ae941c38621a7e49c62cb66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4524ce8eafa4df6be549375f4a7d2da', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:04.638774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6567a-8c9b-4f7d-b1df-6e015338e270 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:04.639066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6567a-8c9b-4f7d-b1df-6e015338e270 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:04.639398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6567a-8c9b-4f7d-b1df-6e015338e270 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] PATH_INFO: `/v3/projects/659aad68dfff4491b919d91a8cb36569` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:04.640716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6567a-8c9b-4f7d-b1df-6e015338e270 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] RBAC: Authorizing `identity:get_project(project_id=659aad68dfff4491b919d91a8cb36569)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:04.642911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6567a-8c9b-4f7d-b1df-6e015338e270 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:04.645158 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1177/2355] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:21:04 2022] GET /identity/v3/projects/659aad68dfff4491b919d91a8cb36569 => generated 395 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:21:04.792837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6567a-8c9b-4f7d-b1df-6e015338e270 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:04.795266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-89d6567a-8c9b-4f7d-b1df-6e015338e270 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:04.818011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6567a-8c9b-4f7d-b1df-6e015338e270 tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:04.825535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fcc6b-44a3-4f95-bc82-3297f4dc9cf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:04.826398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fcc6b-44a3-4f95-bc82-3297f4dc9cf4 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:04.826716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fcc6b-44a3-4f95-bc82-3297f4dc9cf4 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:04.827109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fcc6b-44a3-4f95-bc82-3297f4dc9cf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:04.829221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d56fcc6b-44a3-4f95-bc82-3297f4dc9cf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:04.870730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6e1fdd30-811c-4493-9891-d4399184b846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '580eb09a148440e5918fee1e04932d11'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:04.915633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6e1fdd30-811c-4493-9891-d4399184b846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '580eb09a148440e5918fee1e04932d11'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:04.916071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fcc6b-44a3-4f95-bc82-3297f4dc9cf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:04.916538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6e1fdd30-811c-4493-9891-d4399184b846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '580eb09a148440e5918fee1e04932d11'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:04.917841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fcc6b-44a3-4f95-bc82-3297f4dc9cf4 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:04.937449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6e1fdd30-811c-4493-9891-d4399184b846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '580eb09a148440e5918fee1e04932d11'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:04.940342 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1178/2356] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:21:04.941596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fcc6b-44a3-4f95-bc82-3297f4dc9cf4 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:04.943156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d56fcc6b-44a3-4f95-bc82-3297f4dc9cf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:04.960977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fcc6b-44a3-4f95-bc82-3297f4dc9cf4 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:04.966745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c44257-a328-4402-a05b-765af69dd3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:04.967848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c44257-a328-4402-a05b-765af69dd3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:04.968142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c44257-a328-4402-a05b-765af69dd3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:04.968418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c44257-a328-4402-a05b-765af69dd3c0 admin admin] PATH_INFO: `/v3/projects/d6dd5bacdef2423289ad6e616be5f19b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:04.969721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c44257-a328-4402-a05b-765af69dd3c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6dd5bacdef2423289ad6e616be5f19b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:04.971791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c44257-a328-4402-a05b-765af69dd3c0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:05.040110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6e1fdd30-811c-4493-9891-d4399184b846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '580eb09a148440e5918fee1e04932d11'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:05.051047 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1179/2357] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:21:04 2022] DELETE /identity/v3/users/580eb09a148440e5918fee1e04932d11 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:05.052550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb8617-12ef-49af-837b-8aca42c44ebb None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:05.053528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb8617-12ef-49af-837b-8aca42c44ebb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:05.053826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb8617-12ef-49af-837b-8aca42c44ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:05.085455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-13bb8617-12ef-49af-837b-8aca42c44ebb None None] MFA Rules not processed for user `17581b53723f42bdbe7dd12ea1f691cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:05.087118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-13bb8617-12ef-49af-837b-8aca42c44ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:05.117507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-96c44257-a328-4402-a05b-765af69dd3c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6dd5bacdef2423289ad6e616be5f19b', 'request_id': 'req-96c44257-a328-4402-a05b-765af69dd3c0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:05.205334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-96c44257-a328-4402-a05b-765af69dd3c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6dd5bacdef2423289ad6e616be5f19b', 'request_id': 'req-96c44257-a328-4402-a05b-765af69dd3c0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:05.214811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-96c44257-a328-4402-a05b-765af69dd3c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6dd5bacdef2423289ad6e616be5f19b', 'request_id': 'req-96c44257-a328-4402-a05b-765af69dd3c0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:05.221862 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1180/2358] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:05.227043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb8617-12ef-49af-837b-8aca42c44ebb None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:05.235650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-13bb8617-12ef-49af-837b-8aca42c44ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:05.235814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-96c44257-a328-4402-a05b-765af69dd3c0 admin admin] The token cache is being invalidate because project d6dd5bacdef2423289ad6e616be5f19b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:21:05.236231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-96c44257-a328-4402-a05b-765af69dd3c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:05.238700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-96c44257-a328-4402-a05b-765af69dd3c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:05.248657 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1179/2359] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:21:04 2022] DELETE /identity/v3/projects/d6dd5bacdef2423289ad6e616be5f19b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:05.251056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcc548-49d0-4447-a2ea-39f7e3a022ea None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:05.251417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcc548-49d0-4447-a2ea-39f7e3a022ea None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:05.251786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcc548-49d0-4447-a2ea-39f7e3a022ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:05.295486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1adcc548-49d0-4447-a2ea-39f7e3a022ea None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:05.302282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1adcc548-49d0-4447-a2ea-39f7e3a022ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:05.401610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb8617-12ef-49af-837b-8aca42c44ebb None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:05.456525 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1180/2360] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:05.457554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcc548-49d0-4447-a2ea-39f7e3a022ea None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:05.461459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1adcc548-49d0-4447-a2ea-39f7e3a022ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:05.479380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcc548-49d0-4447-a2ea-39f7e3a022ea None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:05.491805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec5de0-4ac8-4862-9b9d-d763636c4966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:05.492749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec5de0-4ac8-4862-9b9d-d763636c4966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:05.493036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec5de0-4ac8-4862-9b9d-d763636c4966 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:05.493316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec5de0-4ac8-4862-9b9d-d763636c4966 admin admin] PATH_INFO: `/v3/users/861ab85ac83d4004901e692577d1d972` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:05.494545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec5de0-4ac8-4862-9b9d-d763636c4966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=861ab85ac83d4004901e692577d1d972)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:05.496809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec5de0-4ac8-4862-9b9d-d763636c4966 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:05.505936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432d354-1f50-4791-b24f-249dd28d874c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:05.507038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432d354-1f50-4791-b24f-249dd28d874c admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:05.507594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432d354-1f50-4791-b24f-249dd28d874c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:05.508074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432d354-1f50-4791-b24f-249dd28d874c admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:05.528877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432d354-1f50-4791-b24f-249dd28d874c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:05.530850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432d354-1f50-4791-b24f-249dd28d874c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:05.653086 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1181/2361] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:21:05 2022] POST /identity/v3/projects => generated 385 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:05.654409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82717b3b-4acd-455e-9d35-8ff8ce427808 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:05.654730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82717b3b-4acd-455e-9d35-8ff8ce427808 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:05.654978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82717b3b-4acd-455e-9d35-8ff8ce427808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:05.707472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-82717b3b-4acd-455e-9d35-8ff8ce427808 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:05.708792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-82717b3b-4acd-455e-9d35-8ff8ce427808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:05.751925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-05ec5de0-4ac8-4862-9b9d-d763636c4966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '861ab85ac83d4004901e692577d1d972'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:05.773700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-05ec5de0-4ac8-4862-9b9d-d763636c4966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '861ab85ac83d4004901e692577d1d972'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:05.774521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-05ec5de0-4ac8-4862-9b9d-d763636c4966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '861ab85ac83d4004901e692577d1d972'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:05.783631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-05ec5de0-4ac8-4862-9b9d-d763636c4966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '861ab85ac83d4004901e692577d1d972'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:05.816731 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1182/2362] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:05.816731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82717b3b-4acd-455e-9d35-8ff8ce427808 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:05.816731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-82717b3b-4acd-455e-9d35-8ff8ce427808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:05.841048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82717b3b-4acd-455e-9d35-8ff8ce427808 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:05.846640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a390147-13ee-4d50-8595-2e567aa9c08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:05.847391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a390147-13ee-4d50-8595-2e567aa9c08b admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:05.847676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a390147-13ee-4d50-8595-2e567aa9c08b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:05.847952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a390147-13ee-4d50-8595-2e567aa9c08b admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:05.852579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a390147-13ee-4d50-8595-2e567aa9c08b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:05.852579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a390147-13ee-4d50-8595-2e567aa9c08b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:05.958762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-05ec5de0-4ac8-4862-9b9d-d763636c4966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '861ab85ac83d4004901e692577d1d972'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:05.971698 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1181/2363] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:21:05 2022] DELETE /identity/v3/users/861ab85ac83d4004901e692577d1d972 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:05.973574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba455e92-1c7c-46f3-a820-8904fd15d20f None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:05.974088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba455e92-1c7c-46f3-a820-8904fd15d20f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:05.974678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba455e92-1c7c-46f3-a820-8904fd15d20f None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:05.977645 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1182/2364] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:21:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:21:05.978728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba455e92-1c7c-46f3-a820-8904fd15d20f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:05.981127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ba455e92-1c7c-46f3-a820-8904fd15d20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:06.048499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba455e92-1c7c-46f3-a820-8904fd15d20f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:06.053163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf59d4-1e71-4d8b-b747-614b1d0cf93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:06.053826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf59d4-1e71-4d8b-b747-614b1d0cf93d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:06.054106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf59d4-1e71-4d8b-b747-614b1d0cf93d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:06.054384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf59d4-1e71-4d8b-b747-614b1d0cf93d admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:06.055115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf59d4-1e71-4d8b-b747-614b1d0cf93d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:21:06.055430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf59d4-1e71-4d8b-b747-614b1d0cf93d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:06.057041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf59d4-1e71-4d8b-b747-614b1d0cf93d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:06.068277 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1183/2365] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:21:06.069227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf59d4-1e71-4d8b-b747-614b1d0cf93d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:06.070868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-51cf59d4-1e71-4d8b-b747-614b1d0cf93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:06.082988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf59d4-1e71-4d8b-b747-614b1d0cf93d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:06.088157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da12bfc-d4d0-4d7a-98f7-a7472fb543a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:06.089048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da12bfc-d4d0-4d7a-98f7-a7472fb543a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:06.089330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da12bfc-d4d0-4d7a-98f7-a7472fb543a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:06.089608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da12bfc-d4d0-4d7a-98f7-a7472fb543a2 admin admin] PATH_INFO: `/v3/projects/bec75a22264846e290d8fa22ec347b86` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:06.090885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da12bfc-d4d0-4d7a-98f7-a7472fb543a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec75a22264846e290d8fa22ec347b86)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:06.092806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da12bfc-d4d0-4d7a-98f7-a7472fb543a2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:06.231039 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1183/2366] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:21:05 2022] POST /identity/v3/users => generated 299 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:06.232416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c221d-cbc1-480e-9c71-9f44761d2b9a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:06.232906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c221d-cbc1-480e-9c71-9f44761d2b9a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:06.233246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c221d-cbc1-480e-9c71-9f44761d2b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:06.251122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-710c221d-cbc1-480e-9c71-9f44761d2b9a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:06.252426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-710c221d-cbc1-480e-9c71-9f44761d2b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:06.262413 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1184/2367] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:06.262413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c221d-cbc1-480e-9c71-9f44761d2b9a None None] Authenticating service token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:21:06.268819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-710c221d-cbc1-480e-9c71-9f44761d2b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:06.311421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9da12bfc-d4d0-4d7a-98f7-a7472fb543a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec75a22264846e290d8fa22ec347b86', 'request_id': 'req-9da12bfc-d4d0-4d7a-98f7-a7472fb543a2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:06.398095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9da12bfc-d4d0-4d7a-98f7-a7472fb543a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec75a22264846e290d8fa22ec347b86', 'request_id': 'req-9da12bfc-d4d0-4d7a-98f7-a7472fb543a2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:06.406617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9da12bfc-d4d0-4d7a-98f7-a7472fb543a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec75a22264846e290d8fa22ec347b86', 'request_id': 'req-9da12bfc-d4d0-4d7a-98f7-a7472fb543a2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:06.429837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9da12bfc-d4d0-4d7a-98f7-a7472fb543a2 admin admin] The token cache is being invalidate because project bec75a22264846e290d8fa22ec347b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:21:06.430379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9da12bfc-d4d0-4d7a-98f7-a7472fb543a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:06.431771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9da12bfc-d4d0-4d7a-98f7-a7472fb543a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:06.436877 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1184/2368] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:21:06 2022] DELETE /identity/v3/projects/bec75a22264846e290d8fa22ec347b86 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:06.436877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da12bfc-d4d0-4d7a-98f7-a7472fb543a2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:06.444007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9da12bfc-d4d0-4d7a-98f7-a7472fb543a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:06.451441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c221d-cbc1-480e-9c71-9f44761d2b9a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:06.454042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-710c221d-cbc1-480e-9c71-9f44761d2b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:06.567018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c221d-cbc1-480e-9c71-9f44761d2b9a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:06.575829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da12bfc-d4d0-4d7a-98f7-a7472fb543a2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:06.581005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82a0d8-746f-4690-bc7f-053658e40838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:06.581755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82a0d8-746f-4690-bc7f-053658e40838 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:06.582040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82a0d8-746f-4690-bc7f-053658e40838 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:06.582317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82a0d8-746f-4690-bc7f-053658e40838 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:06.583013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82a0d8-746f-4690-bc7f-053658e40838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:06.587390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82a0d8-746f-4690-bc7f-053658e40838 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:06.648148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f07fd2-5e9d-46c3-989c-49c5d12c33dd tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '727422c06ae941c38621a7e49c62cb66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4524ce8eafa4df6be549375f4a7d2da', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:06.649205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f07fd2-5e9d-46c3-989c-49c5d12c33dd tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:06.649572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f07fd2-5e9d-46c3-989c-49c5d12c33dd tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:06.649926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f07fd2-5e9d-46c3-989c-49c5d12c33dd tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] PATH_INFO: `/v3/projects/f752e442b73f4163bd865c2cf1512f1a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:06.651213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f07fd2-5e9d-46c3-989c-49c5d12c33dd tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] RBAC: Authorizing `identity:get_project(project_id=f752e442b73f4163bd865c2cf1512f1a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:06.653466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f07fd2-5e9d-46c3-989c-49c5d12c33dd tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:06.660830 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1185/2369] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:21:06 2022] GET /identity/v3/projects/f752e442b73f4163bd865c2cf1512f1a => generated 395 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:21:06.663085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f07fd2-5e9d-46c3-989c-49c5d12c33dd tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:06.681843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f6f07fd2-5e9d-46c3-989c-49c5d12c33dd tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:06.704035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f07fd2-5e9d-46c3-989c-49c5d12c33dd tempest-FlavorsAccessNegativeTestJSON-1493570994 tempest-FlavorsAccessNegativeTestJSON-1493570994-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:06.732467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b05068-11b1-44af-9b10-52c5b705f561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:06.733254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b05068-11b1-44af-9b10-52c5b705f561 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:06.733549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b05068-11b1-44af-9b10-52c5b705f561 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:06.733826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b05068-11b1-44af-9b10-52c5b705f561 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:06.734652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b05068-11b1-44af-9b10-52c5b705f561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:06.737069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b05068-11b1-44af-9b10-52c5b705f561 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:06.744127 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1185/2370] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:21:06 2022] POST /identity/v3/projects => generated 371 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:06.749921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82a0d8-746f-4690-bc7f-053658e40838 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:06.749921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dc82a0d8-746f-4690-bc7f-053658e40838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:06.774790 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1186/2371] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:06.775788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b206e9-65d0-47a0-95db-3de910124216 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:06.776091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b206e9-65d0-47a0-95db-3de910124216 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:06.776376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b206e9-65d0-47a0-95db-3de910124216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:06.809247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-16b206e9-65d0-47a0-95db-3de910124216 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:06.809247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-16b206e9-65d0-47a0-95db-3de910124216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:06.887968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82a0d8-746f-4690-bc7f-053658e40838 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:06.902944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2d0e1-5071-43bc-9854-3482f6b9ae03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:06.903831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2d0e1-5071-43bc-9854-3482f6b9ae03 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:06.905533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2d0e1-5071-43bc-9854-3482f6b9ae03 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:06.906659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2d0e1-5071-43bc-9854-3482f6b9ae03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:06.912815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2ef2d0e1-5071-43bc-9854-3482f6b9ae03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:06.990995 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1187/2372] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:06.991978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b206e9-65d0-47a0-95db-3de910124216 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:07.038060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b206e9-65d0-47a0-95db-3de910124216 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:07.052628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323176c8-c1ce-4167-94c8-381ba5bcfbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:07.053860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323176c8-c1ce-4167-94c8-381ba5bcfbe8 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:07.054320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323176c8-c1ce-4167-94c8-381ba5bcfbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:07.054756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323176c8-c1ce-4167-94c8-381ba5bcfbe8 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:07.056013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323176c8-c1ce-4167-94c8-381ba5bcfbe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:07.073604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323176c8-c1ce-4167-94c8-381ba5bcfbe8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:07.091877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2d0e1-5071-43bc-9854-3482f6b9ae03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:07.096750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2d0e1-5071-43bc-9854-3482f6b9ae03 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:07.116255 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1186/2373] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:07.123804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2d0e1-5071-43bc-9854-3482f6b9ae03 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:07.143566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2d0e1-5071-43bc-9854-3482f6b9ae03 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:07.151834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc17888-7af6-48b7-9017-e449426b23b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:07.156507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc17888-7af6-48b7-9017-e449426b23b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:07.156853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc17888-7af6-48b7-9017-e449426b23b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:07.157145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc17888-7af6-48b7-9017-e449426b23b7 admin admin] PATH_INFO: `/v3/projects/cf5ed488b8864dba9a7fa2aa7f09d06b/users/d08e62ebc2e14a1a800ee35406c6625b/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:07.182596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc17888-7af6-48b7-9017-e449426b23b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5ed488b8864dba9a7fa2aa7f09d06b, user_id=d08e62ebc2e14a1a800ee35406c6625b, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:07.187200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc17888-7af6-48b7-9017-e449426b23b7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:07.224126 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1188/2374] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:21:06 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:07.227190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323176c8-c1ce-4167-94c8-381ba5bcfbe8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:07.233842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-323176c8-c1ce-4167-94c8-381ba5bcfbe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:07.247508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323176c8-c1ce-4167-94c8-381ba5bcfbe8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:07.259543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684c8c2-ac38-4810-823d-5985e03a634d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:07.260871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684c8c2-ac38-4810-823d-5985e03a634d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:07.261355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684c8c2-ac38-4810-823d-5985e03a634d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:07.261854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684c8c2-ac38-4810-823d-5985e03a634d admin admin] PATH_INFO: `/v3/users/594f59a3d3d340c6895e1c67d8d5f599` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:07.263294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684c8c2-ac38-4810-823d-5985e03a634d admin admin] RBAC: Authorizing `identity:delete_user(user_id=594f59a3d3d340c6895e1c67d8d5f599)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:07.265926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684c8c2-ac38-4810-823d-5985e03a634d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:07.327831 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1187/2375] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:21:07 2022] PUT /identity/v3/projects/cf5ed488b8864dba9a7fa2aa7f09d06b/users/d08e62ebc2e14a1a800ee35406c6625b/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:07.330815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540269ee-acc8-4141-ad17-2700cb085acc None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:07.330815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540269ee-acc8-4141-ad17-2700cb085acc None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:07.330815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540269ee-acc8-4141-ad17-2700cb085acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:07.369504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-540269ee-acc8-4141-ad17-2700cb085acc None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:07.373076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-540269ee-acc8-4141-ad17-2700cb085acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:07.487246 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1188/2376] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:07.497880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540269ee-acc8-4141-ad17-2700cb085acc None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:07.518124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1684c8c2-ac38-4810-823d-5985e03a634d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '594f59a3d3d340c6895e1c67d8d5f599'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:07.526407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540269ee-acc8-4141-ad17-2700cb085acc None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:07.533661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1684c8c2-ac38-4810-823d-5985e03a634d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '594f59a3d3d340c6895e1c67d8d5f599'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:07.534429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1684c8c2-ac38-4810-823d-5985e03a634d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '594f59a3d3d340c6895e1c67d8d5f599'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:07.540471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6769c-c860-459b-bac3-f7a460da2d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:07.543206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6769c-c860-459b-bac3-f7a460da2d3d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:07.543669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6769c-c860-459b-bac3-f7a460da2d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:07.544126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6769c-c860-459b-bac3-f7a460da2d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:07.550619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6769c-c860-459b-bac3-f7a460da2d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:07.552928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6769c-c860-459b-bac3-f7a460da2d3d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:07.576469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1684c8c2-ac38-4810-823d-5985e03a634d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '594f59a3d3d340c6895e1c67d8d5f599'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:07.583035 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1189/2377] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:07.583933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6769c-c860-459b-bac3-f7a460da2d3d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:07.610293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6769c-c860-459b-bac3-f7a460da2d3d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:07.621306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b128a-056e-44d3-a690-816163851568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:07.622348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b128a-056e-44d3-a690-816163851568 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:07.622638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b128a-056e-44d3-a690-816163851568 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:07.623125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b128a-056e-44d3-a690-816163851568 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:07.623988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b128a-056e-44d3-a690-816163851568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:07.626112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b128a-056e-44d3-a690-816163851568 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:07.642176 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1190/2378] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:07.643865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b128a-056e-44d3-a690-816163851568 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:07.678272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b128a-056e-44d3-a690-816163851568 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:07.686653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee6e88-e285-4051-880e-af7214ab9822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:07.691061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee6e88-e285-4051-880e-af7214ab9822 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:07.691349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee6e88-e285-4051-880e-af7214ab9822 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:07.691628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee6e88-e285-4051-880e-af7214ab9822 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:07.692388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee6e88-e285-4051-880e-af7214ab9822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:21:07.693001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee6e88-e285-4051-880e-af7214ab9822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:07.694065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1684c8c2-ac38-4810-823d-5985e03a634d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '594f59a3d3d340c6895e1c67d8d5f599'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:07.695637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee6e88-e285-4051-880e-af7214ab9822 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:07.714514 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1189/2379] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:21:07 2022] DELETE /identity/v3/users/594f59a3d3d340c6895e1c67d8d5f599 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:07.714514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684c8c2-ac38-4810-823d-5985e03a634d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:07.714514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1684c8c2-ac38-4810-823d-5985e03a634d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:07.714785 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1191/2380] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:21:07.714785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee6e88-e285-4051-880e-af7214ab9822 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:07.716824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-15ee6e88-e285-4051-880e-af7214ab9822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:07.730713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee6e88-e285-4051-880e-af7214ab9822 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:07.814373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684c8c2-ac38-4810-823d-5985e03a634d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:07.823243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64356473-7ff3-4e17-9c82-8bbc29c8ea5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:07.823243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64356473-7ff3-4e17-9c82-8bbc29c8ea5d admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:07.823661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bbd25-b428-4d16-930e-9a341facd2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:07.823781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64356473-7ff3-4e17-9c82-8bbc29c8ea5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:07.823781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64356473-7ff3-4e17-9c82-8bbc29c8ea5d admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:07.823959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bbd25-b428-4d16-930e-9a341facd2ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:07.823959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bbd25-b428-4d16-930e-9a341facd2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:07.824123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64356473-7ff3-4e17-9c82-8bbc29c8ea5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:07.824220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bbd25-b428-4d16-930e-9a341facd2ce admin admin] PATH_INFO: `/v3/projects/cf5ed488b8864dba9a7fa2aa7f09d06b/users/d08e62ebc2e14a1a800ee35406c6625b/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:07.824307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64356473-7ff3-4e17-9c82-8bbc29c8ea5d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:07.826587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665bbd25-b428-4d16-930e-9a341facd2ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5ed488b8864dba9a7fa2aa7f09d06b, user_id=d08e62ebc2e14a1a800ee35406c6625b, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:07.830570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665bbd25-b428-4d16-930e-9a341facd2ce admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:07.836207 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1190/2381] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:07.836952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64356473-7ff3-4e17-9c82-8bbc29c8ea5d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:07.838784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-64356473-7ff3-4e17-9c82-8bbc29c8ea5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:07.851415 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1192/2382] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:21:07 2022] PUT /identity/v3/projects/cf5ed488b8864dba9a7fa2aa7f09d06b/users/d08e62ebc2e14a1a800ee35406c6625b/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:07.852797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bae4d1-0712-42f6-a52d-3d0fc67b965b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:07.853189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bae4d1-0712-42f6-a52d-3d0fc67b965b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:07.853462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64356473-7ff3-4e17-9c82-8bbc29c8ea5d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:07.853806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bae4d1-0712-42f6-a52d-3d0fc67b965b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:07.893509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b4bae4d1-0712-42f6-a52d-3d0fc67b965b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:07.895796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b4bae4d1-0712-42f6-a52d-3d0fc67b965b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:07.916855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea94cc-b361-434d-8582-eab7592a6024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:07.917530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea94cc-b361-434d-8582-eab7592a6024 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:07.917812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea94cc-b361-434d-8582-eab7592a6024 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:07.920188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea94cc-b361-434d-8582-eab7592a6024 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:07.921034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea94cc-b361-434d-8582-eab7592a6024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:07.923261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea94cc-b361-434d-8582-eab7592a6024 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:07.985774 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1193/2383] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:07.986902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bae4d1-0712-42f6-a52d-3d0fc67b965b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:07.988410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b4bae4d1-0712-42f6-a52d-3d0fc67b965b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:08.002207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bae4d1-0712-42f6-a52d-3d0fc67b965b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:08.007649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724ce44-bcfd-42e3-ab2d-4c062328bd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:08.008655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724ce44-bcfd-42e3-ab2d-4c062328bd78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:08.008844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724ce44-bcfd-42e3-ab2d-4c062328bd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:08.009126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724ce44-bcfd-42e3-ab2d-4c062328bd78 admin admin] PATH_INFO: `/v3/projects/1cac3c24f0d542edb2cbf4d83fb357ea` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:08.010332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724ce44-bcfd-42e3-ab2d-4c062328bd78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cac3c24f0d542edb2cbf4d83fb357ea)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:08.012315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724ce44-bcfd-42e3-ab2d-4c062328bd78 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:08.027741 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1191/2384] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:21:07 2022] POST /identity/v3/projects => generated 409 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:08.029236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea94cc-b361-434d-8582-eab7592a6024 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:08.180257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea94cc-b361-434d-8582-eab7592a6024 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:08.186375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b2285-a578-40fb-8065-d885f0f1de24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:08.187293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b2285-a578-40fb-8065-d885f0f1de24 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:08.187632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b2285-a578-40fb-8065-d885f0f1de24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:08.187912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b2285-a578-40fb-8065-d885f0f1de24 admin admin] PATH_INFO: `/v3/projects/c98e1459928b44bdb40d8c711d9655e6/users/800264e9cfea412cbada30fc2b420157/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:08.219266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b2285-a578-40fb-8065-d885f0f1de24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c98e1459928b44bdb40d8c711d9655e6, user_id=800264e9cfea412cbada30fc2b420157, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:08.222902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b2285-a578-40fb-8065-d885f0f1de24 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:08.374456 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1192/2385] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:21:08 2022] PUT /identity/v3/projects/c98e1459928b44bdb40d8c711d9655e6/users/800264e9cfea412cbada30fc2b420157/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:08.375151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b2285-a578-40fb-8065-d885f0f1de24 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:08.380489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ad0b2285-a578-40fb-8065-d885f0f1de24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:08.410890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4724ce44-bcfd-42e3-ab2d-4c062328bd78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cac3c24f0d542edb2cbf4d83fb357ea', 'request_id': 'req-4724ce44-bcfd-42e3-ab2d-4c062328bd78'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:08.492008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4724ce44-bcfd-42e3-ab2d-4c062328bd78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cac3c24f0d542edb2cbf4d83fb357ea', 'request_id': 'req-4724ce44-bcfd-42e3-ab2d-4c062328bd78'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:08.509384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4724ce44-bcfd-42e3-ab2d-4c062328bd78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cac3c24f0d542edb2cbf4d83fb357ea', 'request_id': 'req-4724ce44-bcfd-42e3-ab2d-4c062328bd78'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:08.557717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4724ce44-bcfd-42e3-ab2d-4c062328bd78 admin admin] The token cache is being invalidate because project 1cac3c24f0d542edb2cbf4d83fb357ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:21:08.563929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4724ce44-bcfd-42e3-ab2d-4c062328bd78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:08.563929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4724ce44-bcfd-42e3-ab2d-4c062328bd78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:08.564128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b2285-a578-40fb-8065-d885f0f1de24 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:08.565371 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1194/2386] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:21:07 2022] DELETE /identity/v3/projects/1cac3c24f0d542edb2cbf4d83fb357ea => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:08.566789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724ce44-bcfd-42e3-ab2d-4c062328bd78 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:08.570245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4724ce44-bcfd-42e3-ab2d-4c062328bd78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:08.661270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31560c-2d40-4442-9bfa-bdfd7f08b833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:08.675628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31560c-2d40-4442-9bfa-bdfd7f08b833 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:08.676101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31560c-2d40-4442-9bfa-bdfd7f08b833 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:08.676749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31560c-2d40-4442-9bfa-bdfd7f08b833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:08.683648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0e31560c-2d40-4442-9bfa-bdfd7f08b833 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:08.687661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724ce44-bcfd-42e3-ab2d-4c062328bd78 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:08.695707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93604d84-4cfe-4a62-bbd5-fb62187ff470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:08.695707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93604d84-4cfe-4a62-bbd5-fb62187ff470 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:08.695707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93604d84-4cfe-4a62-bbd5-fb62187ff470 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:08.696118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93604d84-4cfe-4a62-bbd5-fb62187ff470 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:08.697747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93604d84-4cfe-4a62-bbd5-fb62187ff470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:08.700714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93604d84-4cfe-4a62-bbd5-fb62187ff470 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:08.713740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31560c-2d40-4442-9bfa-bdfd7f08b833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:08.715845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31560c-2d40-4442-9bfa-bdfd7f08b833 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:08.739495 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1193/2387] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:08.741120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c217a7-b638-47b7-a148-b9ca57713034 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:08.741416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c217a7-b638-47b7-a148-b9ca57713034 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:08.743346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c217a7-b638-47b7-a148-b9ca57713034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:08.792685 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1195/2388] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:21:08 2022] POST /identity/v3/users => generated 305 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:08.793946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93604d84-4cfe-4a62-bbd5-fb62187ff470 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:08.798834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-93604d84-4cfe-4a62-bbd5-fb62187ff470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:08.800594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-21c217a7-b638-47b7-a148-b9ca57713034 None None] MFA Rules not processed for user `800264e9cfea412cbada30fc2b420157`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:08.807337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-21c217a7-b638-47b7-a148-b9ca57713034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:08.828358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93604d84-4cfe-4a62-bbd5-fb62187ff470 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:08.842337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b9e08-27e3-47e5-af34-540d5b8ec894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:08.843295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b9e08-27e3-47e5-af34-540d5b8ec894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:08.843584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b9e08-27e3-47e5-af34-540d5b8ec894 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:08.843860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b9e08-27e3-47e5-af34-540d5b8ec894 admin admin] PATH_INFO: `/v3/users/4886dd9e480943b788d77e81eef669e0` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:08.846701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b9e08-27e3-47e5-af34-540d5b8ec894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4886dd9e480943b788d77e81eef669e0)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:08.852880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b9e08-27e3-47e5-af34-540d5b8ec894 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:09.002682 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1194/2389] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:09.007326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c217a7-b638-47b7-a148-b9ca57713034 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:09.043050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c217a7-b638-47b7-a148-b9ca57713034 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:09.048650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b156a2-0b43-44fa-b107-9201f43fbeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:09.049422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b156a2-0b43-44fa-b107-9201f43fbeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:09.049714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b156a2-0b43-44fa-b107-9201f43fbeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:09.050000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b156a2-0b43-44fa-b107-9201f43fbeb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:09.050740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b156a2-0b43-44fa-b107-9201f43fbeb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:09.053249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b156a2-0b43-44fa-b107-9201f43fbeb8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:09.073972 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1195/2390] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:09.073972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b156a2-0b43-44fa-b107-9201f43fbeb8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:09.075517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f8b156a2-0b43-44fa-b107-9201f43fbeb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:09.179377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b156a2-0b43-44fa-b107-9201f43fbeb8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:09.207235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f5976-3249-42a6-9d44-802bdd02ed30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:09.207908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f5976-3249-42a6-9d44-802bdd02ed30 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:09.208193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f5976-3249-42a6-9d44-802bdd02ed30 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:09.208474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f5976-3249-42a6-9d44-802bdd02ed30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:09.214080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-789b9e08-27e3-47e5-af34-540d5b8ec894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4886dd9e480943b788d77e81eef669e0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:09.223841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f5976-3249-42a6-9d44-802bdd02ed30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:09.225624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f5976-3249-42a6-9d44-802bdd02ed30 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:09.230400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-789b9e08-27e3-47e5-af34-540d5b8ec894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4886dd9e480943b788d77e81eef669e0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:09.231373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-789b9e08-27e3-47e5-af34-540d5b8ec894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4886dd9e480943b788d77e81eef669e0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:09.240415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-789b9e08-27e3-47e5-af34-540d5b8ec894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4886dd9e480943b788d77e81eef669e0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:09.262959 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1196/2391] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:09.267716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f5976-3249-42a6-9d44-802bdd02ed30 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:09.302726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f5976-3249-42a6-9d44-802bdd02ed30 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:09.316494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-789b9e08-27e3-47e5-af34-540d5b8ec894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4886dd9e480943b788d77e81eef669e0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:09.332032 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1196/2392] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:21:08 2022] DELETE /identity/v3/users/4886dd9e480943b788d77e81eef669e0 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:09.332837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155263ff-befb-4891-8895-d38c3d2bb91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:09.333664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155263ff-befb-4891-8895-d38c3d2bb91d admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:09.334694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155263ff-befb-4891-8895-d38c3d2bb91d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:09.335171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155263ff-befb-4891-8895-d38c3d2bb91d admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:09.336056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155263ff-befb-4891-8895-d38c3d2bb91d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:09.339299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155263ff-befb-4891-8895-d38c3d2bb91d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:09.355839 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1197/2393] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:09.361848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b9e08-27e3-47e5-af34-540d5b8ec894 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:09.363550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-789b9e08-27e3-47e5-af34-540d5b8ec894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:09.464648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b9e08-27e3-47e5-af34-540d5b8ec894 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:09.469616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32ca48-4938-45b5-8aa1-30f4660ad4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:09.470748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32ca48-4938-45b5-8aa1-30f4660ad4e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:09.471342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32ca48-4938-45b5-8aa1-30f4660ad4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:09.471790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32ca48-4938-45b5-8aa1-30f4660ad4e2 admin admin] PATH_INFO: `/v3/projects/8dd7d72ad31a49a2ad65c451202a2e9e/users/ca3c52988d9a4983a5703bcf7d811e57/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:09.489219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb32ca48-4938-45b5-8aa1-30f4660ad4e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd7d72ad31a49a2ad65c451202a2e9e, user_id=ca3c52988d9a4983a5703bcf7d811e57, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:09.492747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb32ca48-4938-45b5-8aa1-30f4660ad4e2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:09.600232 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1197/2394] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:21:09 2022] PUT /identity/v3/projects/8dd7d72ad31a49a2ad65c451202a2e9e/users/ca3c52988d9a4983a5703bcf7d811e57/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:09.613073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6b3d3-431c-4262-9d7e-94dd568fb60e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:09.613532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6b3d3-431c-4262-9d7e-94dd568fb60e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:09.613613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6b3d3-431c-4262-9d7e-94dd568fb60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:09.657750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f0d6b3d3-431c-4262-9d7e-94dd568fb60e None None] MFA Rules not processed for user `ca3c52988d9a4983a5703bcf7d811e57`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:09.659073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f0d6b3d3-431c-4262-9d7e-94dd568fb60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:09.780274 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1198/2395] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:09 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:09.781781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32ca48-4938-45b5-8aa1-30f4660ad4e2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:09.889999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32ca48-4938-45b5-8aa1-30f4660ad4e2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:09.895271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95579a75-943d-4720-ba35-d745e446607a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:09.899174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95579a75-943d-4720-ba35-d745e446607a admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:09.899174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95579a75-943d-4720-ba35-d745e446607a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:09.899174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95579a75-943d-4720-ba35-d745e446607a admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:09.899174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95579a75-943d-4720-ba35-d745e446607a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:09.899513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95579a75-943d-4720-ba35-d745e446607a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:09.987170 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1198/2396] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:21:09 2022] POST /identity/v3/projects => generated 409 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:09.992766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6b3d3-431c-4262-9d7e-94dd568fb60e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:10.005827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6b3d3-431c-4262-9d7e-94dd568fb60e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:10.101287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95579a75-943d-4720-ba35-d745e446607a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:10.101287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-95579a75-943d-4720-ba35-d745e446607a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:10.150546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad16fbb-fad3-45e7-a09d-0ed65a5f1d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:10.151250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad16fbb-fad3-45e7-a09d-0ed65a5f1d8f admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:10.151670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad16fbb-fad3-45e7-a09d-0ed65a5f1d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:10.151967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad16fbb-fad3-45e7-a09d-0ed65a5f1d8f admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:10.153107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad16fbb-fad3-45e7-a09d-0ed65a5f1d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:10.160144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad16fbb-fad3-45e7-a09d-0ed65a5f1d8f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:10.234600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95579a75-943d-4720-ba35-d745e446607a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:10.240330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e32376-4a56-4516-933a-3594ec917da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:10.241738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e32376-4a56-4516-933a-3594ec917da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:10.242268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e32376-4a56-4516-933a-3594ec917da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:10.247700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e32376-4a56-4516-933a-3594ec917da3 admin admin] PATH_INFO: `/v3/projects/659aad68dfff4491b919d91a8cb36569` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:10.247700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e32376-4a56-4516-933a-3594ec917da3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=659aad68dfff4491b919d91a8cb36569)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:10.247700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e32376-4a56-4516-933a-3594ec917da3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:10.277436 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1199/2397] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:21:09 2022] POST /identity/v3/users => generated 311 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:10.286299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad16fbb-fad3-45e7-a09d-0ed65a5f1d8f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:10.292377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad16fbb-fad3-45e7-a09d-0ed65a5f1d8f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:10.299899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f623550-0db2-4197-abd4-7e3dbcf7aa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:10.301477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f623550-0db2-4197-abd4-7e3dbcf7aa23 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:10.302039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f623550-0db2-4197-abd4-7e3dbcf7aa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:10.303487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f623550-0db2-4197-abd4-7e3dbcf7aa23 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:10.304705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f623550-0db2-4197-abd4-7e3dbcf7aa23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:10.309573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f623550-0db2-4197-abd4-7e3dbcf7aa23 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:10.324194 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1200/2398] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:21:10.325510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f623550-0db2-4197-abd4-7e3dbcf7aa23 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:10.338766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f623550-0db2-4197-abd4-7e3dbcf7aa23 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:10.345221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6628a7-fc02-4f78-894c-65ac5d6bb79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:10.347049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6628a7-fc02-4f78-894c-65ac5d6bb79a admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:10.347546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6628a7-fc02-4f78-894c-65ac5d6bb79a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:10.348026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6628a7-fc02-4f78-894c-65ac5d6bb79a admin admin] PATH_INFO: `/v3/projects/2ca246559e624db4a8061498588ca8eb/users/c52ce2af30bb45a29ae3c3e2445b4a13/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:10.372067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6628a7-fc02-4f78-894c-65ac5d6bb79a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca246559e624db4a8061498588ca8eb, user_id=c52ce2af30bb45a29ae3c3e2445b4a13, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:10.375618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6628a7-fc02-4f78-894c-65ac5d6bb79a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:10.481382 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1201/2399] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:21:10 2022] PUT /identity/v3/projects/2ca246559e624db4a8061498588ca8eb/users/c52ce2af30bb45a29ae3c3e2445b4a13/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:10.485687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6628a7-fc02-4f78-894c-65ac5d6bb79a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:10.509242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e2e32376-4a56-4516-933a-3594ec917da3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '659aad68dfff4491b919d91a8cb36569', 'request_id': 'req-e2e32376-4a56-4516-933a-3594ec917da3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:10.588202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6628a7-fc02-4f78-894c-65ac5d6bb79a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:10.612201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e2e32376-4a56-4516-933a-3594ec917da3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '659aad68dfff4491b919d91a8cb36569', 'request_id': 'req-e2e32376-4a56-4516-933a-3594ec917da3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:10.620115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e2e32376-4a56-4516-933a-3594ec917da3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '659aad68dfff4491b919d91a8cb36569', 'request_id': 'req-e2e32376-4a56-4516-933a-3594ec917da3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:10.646086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e2e32376-4a56-4516-933a-3594ec917da3 admin admin] The token cache is being invalidate because project 659aad68dfff4491b919d91a8cb36569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:21:10.647555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e2e32376-4a56-4516-933a-3594ec917da3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:10.649138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e2e32376-4a56-4516-933a-3594ec917da3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:10.656751 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1199/2400] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:21:10 2022] DELETE /identity/v3/projects/659aad68dfff4491b919d91a8cb36569 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:21:10.657951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e32376-4a56-4516-933a-3594ec917da3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:10.659969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e2e32376-4a56-4516-933a-3594ec917da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:10.735633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1cb63-0da7-4066-be1c-0d356fdada7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:10.736323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1cb63-0da7-4066-be1c-0d356fdada7e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:10.736631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1cb63-0da7-4066-be1c-0d356fdada7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:10.736913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1cb63-0da7-4066-be1c-0d356fdada7e admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:10.737654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1cb63-0da7-4066-be1c-0d356fdada7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:10.739274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1cb63-0da7-4066-be1c-0d356fdada7e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:10.761629 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1202/2401] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:10.763673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1cb63-0da7-4066-be1c-0d356fdada7e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:10.766071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-93d1cb63-0da7-4066-be1c-0d356fdada7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:10.801506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1cb63-0da7-4066-be1c-0d356fdada7e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:10.806906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728f401-a3a4-4a8a-ac4d-59cccc1cde4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:10.808849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728f401-a3a4-4a8a-ac4d-59cccc1cde4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:10.808849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728f401-a3a4-4a8a-ac4d-59cccc1cde4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:10.808849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728f401-a3a4-4a8a-ac4d-59cccc1cde4b admin admin] PATH_INFO: `/v3/users/727422c06ae941c38621a7e49c62cb66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:10.810076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728f401-a3a4-4a8a-ac4d-59cccc1cde4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=727422c06ae941c38621a7e49c62cb66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:10.812075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728f401-a3a4-4a8a-ac4d-59cccc1cde4b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:10.822240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e32376-4a56-4516-933a-3594ec917da3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:10.828277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dad144-1051-465e-ac39-9fe7bb993599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:10.829303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dad144-1051-465e-ac39-9fe7bb993599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:10.829594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dad144-1051-465e-ac39-9fe7bb993599 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:10.829873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dad144-1051-465e-ac39-9fe7bb993599 admin admin] PATH_INFO: `/v3/projects/ba6a7b44b12e458da01c6185dd7b2363` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:10.831141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dad144-1051-465e-ac39-9fe7bb993599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba6a7b44b12e458da01c6185dd7b2363)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:10.833497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dad144-1051-465e-ac39-9fe7bb993599 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:11.166393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b1dad144-1051-465e-ac39-9fe7bb993599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba6a7b44b12e458da01c6185dd7b2363', 'request_id': 'req-b1dad144-1051-465e-ac39-9fe7bb993599'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:11.168216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5728f401-a3a4-4a8a-ac4d-59cccc1cde4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '727422c06ae941c38621a7e49c62cb66'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:11.185997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5728f401-a3a4-4a8a-ac4d-59cccc1cde4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '727422c06ae941c38621a7e49c62cb66'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:11.186743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5728f401-a3a4-4a8a-ac4d-59cccc1cde4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '727422c06ae941c38621a7e49c62cb66'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:11.196828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5728f401-a3a4-4a8a-ac4d-59cccc1cde4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '727422c06ae941c38621a7e49c62cb66'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:11.249415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b1dad144-1051-465e-ac39-9fe7bb993599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba6a7b44b12e458da01c6185dd7b2363', 'request_id': 'req-b1dad144-1051-465e-ac39-9fe7bb993599'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:11.268905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b1dad144-1051-465e-ac39-9fe7bb993599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba6a7b44b12e458da01c6185dd7b2363', 'request_id': 'req-b1dad144-1051-465e-ac39-9fe7bb993599'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:11.304668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b1dad144-1051-465e-ac39-9fe7bb993599 admin admin] The token cache is being invalidate because project ba6a7b44b12e458da01c6185dd7b2363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:21:11.304979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b1dad144-1051-465e-ac39-9fe7bb993599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:11.305933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b1dad144-1051-465e-ac39-9fe7bb993599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:11.310082 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1200/2402] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:21:10 2022] DELETE /identity/v3/projects/ba6a7b44b12e458da01c6185dd7b2363 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:11.311038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dad144-1051-465e-ac39-9fe7bb993599 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:11.317373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b1dad144-1051-465e-ac39-9fe7bb993599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:11.344134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5728f401-a3a4-4a8a-ac4d-59cccc1cde4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '727422c06ae941c38621a7e49c62cb66'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:11.354312 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1203/2403] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:21:10 2022] DELETE /identity/v3/users/727422c06ae941c38621a7e49c62cb66 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:11.355698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb76a23-4fd3-4319-b714-066f1c0d0138 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:11.355988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb76a23-4fd3-4319-b714-066f1c0d0138 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:11.356269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb76a23-4fd3-4319-b714-066f1c0d0138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:11.416072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-acb76a23-4fd3-4319-b714-066f1c0d0138 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:11.419279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-acb76a23-4fd3-4319-b714-066f1c0d0138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:11.500400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dad144-1051-465e-ac39-9fe7bb993599 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:11.564562 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1204/2404] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:11.568141 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166df2f-1af3-4d0a-a2e7-44cac13b225b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:11.568475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166df2f-1af3-4d0a-a2e7-44cac13b225b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:11.569916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166df2f-1af3-4d0a-a2e7-44cac13b225b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:11.632361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a166df2f-1af3-4d0a-a2e7-44cac13b225b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:11.637373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a166df2f-1af3-4d0a-a2e7-44cac13b225b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:11.651695 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1205/2405] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:11.656202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166df2f-1af3-4d0a-a2e7-44cac13b225b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:11.668834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc052c-d78a-4dfd-86bc-2a1c40f68082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:11.670847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc052c-d78a-4dfd-86bc-2a1c40f68082 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:11.671551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc052c-d78a-4dfd-86bc-2a1c40f68082 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:11.672213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc052c-d78a-4dfd-86bc-2a1c40f68082 admin admin] PATH_INFO: `/v3/projects/2ca246559e624db4a8061498588ca8eb/users/c52ce2af30bb45a29ae3c3e2445b4a13/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:11.673975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166df2f-1af3-4d0a-a2e7-44cac13b225b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:11.677249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc052c-d78a-4dfd-86bc-2a1c40f68082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca246559e624db4a8061498588ca8eb, user_id=c52ce2af30bb45a29ae3c3e2445b4a13, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:11.682720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8db514-7b27-42b1-bee9-fafd16e50e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:11.683877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8db514-7b27-42b1-bee9-fafd16e50e30 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:11.684538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8db514-7b27-42b1-bee9-fafd16e50e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:11.684997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8db514-7b27-42b1-bee9-fafd16e50e30 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:11.686556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8db514-7b27-42b1-bee9-fafd16e50e30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:21:11.687147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc052c-d78a-4dfd-86bc-2a1c40f68082 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:11.687344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8db514-7b27-42b1-bee9-fafd16e50e30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:11.690233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8db514-7b27-42b1-bee9-fafd16e50e30 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:11.710639 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1206/2406] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:21:11.715441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8db514-7b27-42b1-bee9-fafd16e50e30 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:11.721237 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1201/2407] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:21:11 2022] PUT /identity/v3/projects/2ca246559e624db4a8061498588ca8eb/users/c52ce2af30bb45a29ae3c3e2445b4a13/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:11.732705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15883f-dca1-43ef-8825-893bd29a4197 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:11.732901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15883f-dca1-43ef-8825-893bd29a4197 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:11.733106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15883f-dca1-43ef-8825-893bd29a4197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:11.735268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8db514-7b27-42b1-bee9-fafd16e50e30 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:11.801985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6f15883f-dca1-43ef-8825-893bd29a4197 None None] MFA Rules not processed for user `c52ce2af30bb45a29ae3c3e2445b4a13`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:11.803482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6f15883f-dca1-43ef-8825-893bd29a4197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:11.856385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852343e-d079-42d8-9a2d-dc4ca572f9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:11.857705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852343e-d079-42d8-9a2d-dc4ca572f9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:11.857705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852343e-d079-42d8-9a2d-dc4ca572f9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:11.857874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852343e-d079-42d8-9a2d-dc4ca572f9e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:11.858566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852343e-d079-42d8-9a2d-dc4ca572f9e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:11.860549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852343e-d079-42d8-9a2d-dc4ca572f9e7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:11.952079 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1202/2408] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:11 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:21:12.008953 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1207/2409] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:21:11 2022] POST /identity/v3/projects => generated 387 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:12.013002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15883f-dca1-43ef-8825-893bd29a4197 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:12.036959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15883f-dca1-43ef-8825-893bd29a4197 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:12.156147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146db021-0952-451c-a8a7-81dc441cdda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:12.157162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146db021-0952-451c-a8a7-81dc441cdda8 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:12.157622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146db021-0952-451c-a8a7-81dc441cdda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:12.158062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146db021-0952-451c-a8a7-81dc441cdda8 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:12.158917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146db021-0952-451c-a8a7-81dc441cdda8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:12.161075 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146db021-0952-451c-a8a7-81dc441cdda8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:12.299238 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1203/2410] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:21:12 2022] POST /identity/v3/users => generated 294 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:21:12.303974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852343e-d079-42d8-9a2d-dc4ca572f9e7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:12.314812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852343e-d079-42d8-9a2d-dc4ca572f9e7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:12.330347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe661c-ef4b-43d2-b60e-8efb6465fd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:12.331043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe661c-ef4b-43d2-b60e-8efb6465fd96 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:12.331328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe661c-ef4b-43d2-b60e-8efb6465fd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:12.331606 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe661c-ef4b-43d2-b60e-8efb6465fd96 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:12.332341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe661c-ef4b-43d2-b60e-8efb6465fd96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:12.334551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe661c-ef4b-43d2-b60e-8efb6465fd96 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:12.361090 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1208/2411] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:12.376362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146db021-0952-451c-a8a7-81dc441cdda8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:12.406671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146db021-0952-451c-a8a7-81dc441cdda8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:12.431891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e22f7-236b-420a-b516-27200235e199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:12.432681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e22f7-236b-420a-b516-27200235e199 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:12.432975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e22f7-236b-420a-b516-27200235e199 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:12.433259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e22f7-236b-420a-b516-27200235e199 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:12.434425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e22f7-236b-420a-b516-27200235e199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:12.436446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e22f7-236b-420a-b516-27200235e199 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:12.466736 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1204/2412] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:12.466923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe661c-ef4b-43d2-b60e-8efb6465fd96 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:12.483888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe661c-ef4b-43d2-b60e-8efb6465fd96 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:12.494424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e36a4-d5a1-468d-9aa5-38a1cc474d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:12.494424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e36a4-d5a1-468d-9aa5-38a1cc474d4a admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:12.494424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e36a4-d5a1-468d-9aa5-38a1cc474d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:12.494424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e36a4-d5a1-468d-9aa5-38a1cc474d4a admin admin] PATH_INFO: `/v3/projects/999c6e3e38a44d369c3782428f8e0e75/users/cb3183cbca2346dd887162951f451fb1/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:12.514444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e36a4-d5a1-468d-9aa5-38a1cc474d4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=999c6e3e38a44d369c3782428f8e0e75, user_id=cb3183cbca2346dd887162951f451fb1, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:12.522425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e36a4-d5a1-468d-9aa5-38a1cc474d4a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:12.581860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e22f7-236b-420a-b516-27200235e199 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:12.583663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-844e22f7-236b-420a-b516-27200235e199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:12.640291 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1209/2413] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:21:12 2022] PUT /identity/v3/projects/999c6e3e38a44d369c3782428f8e0e75/users/cb3183cbca2346dd887162951f451fb1/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:12.653770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934dcd3-bd20-4f92-8e8f-9387760e0867 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:12.654548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934dcd3-bd20-4f92-8e8f-9387760e0867 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:12.654983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934dcd3-bd20-4f92-8e8f-9387760e0867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:12.689456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9934dcd3-bd20-4f92-8e8f-9387760e0867 None None] MFA Rules not processed for user `cb3183cbca2346dd887162951f451fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:12.691606 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9934dcd3-bd20-4f92-8e8f-9387760e0867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:12.748340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e22f7-236b-420a-b516-27200235e199 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:12.841519 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1210/2414] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:12.853232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa84c44-e8d2-45f3-84b2-d2b9bbfa3949 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:12.854022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934dcd3-bd20-4f92-8e8f-9387760e0867 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:12.854720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa84c44-e8d2-45f3-84b2-d2b9bbfa3949 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:12.855417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa84c44-e8d2-45f3-84b2-d2b9bbfa3949 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:12.856012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa84c44-e8d2-45f3-84b2-d2b9bbfa3949 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:12.946290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934dcd3-bd20-4f92-8e8f-9387760e0867 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:12.947510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa84c44-e8d2-45f3-84b2-d2b9bbfa3949 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:12.952363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa84c44-e8d2-45f3-84b2-d2b9bbfa3949 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:12.958019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bbd38-83a2-403b-b3dc-b69f0ba36577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:12.964625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bbd38-83a2-403b-b3dc-b69f0ba36577 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:12.965221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bbd38-83a2-403b-b3dc-b69f0ba36577 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:12.965901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bbd38-83a2-403b-b3dc-b69f0ba36577 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:12.967963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bbd38-83a2-403b-b3dc-b69f0ba36577 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:12.970780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bbd38-83a2-403b-b3dc-b69f0ba36577 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:12.989420 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1205/2415] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:12 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:21:13.110966 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1211/2416] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:21:12 2022] POST /identity/v3/projects => generated 385 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:13.115003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa84c44-e8d2-45f3-84b2-d2b9bbfa3949 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:13.129963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa84c44-e8d2-45f3-84b2-d2b9bbfa3949 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:13.210738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bbd38-83a2-403b-b3dc-b69f0ba36577 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:13.214441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7f2bbd38-83a2-403b-b3dc-b69f0ba36577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:13.281288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9ce3e-3723-48a6-9e28-d59325187421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:13.282247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9ce3e-3723-48a6-9e28-d59325187421 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:13.282685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9ce3e-3723-48a6-9e28-d59325187421 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:13.283040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9ce3e-3723-48a6-9e28-d59325187421 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:13.283826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9ce3e-3723-48a6-9e28-d59325187421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:13.285989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9ce3e-3723-48a6-9e28-d59325187421 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:13.374218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bbd38-83a2-403b-b3dc-b69f0ba36577 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:13.385022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09172b-3283-4ace-a850-38b33b61e0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:13.386022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09172b-3283-4ace-a850-38b33b61e0c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:13.386370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09172b-3283-4ace-a850-38b33b61e0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:13.386898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09172b-3283-4ace-a850-38b33b61e0c5 admin admin] PATH_INFO: `/v3/projects/a4524ce8eafa4df6be549375f4a7d2da` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:13.389431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09172b-3283-4ace-a850-38b33b61e0c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4524ce8eafa4df6be549375f4a7d2da)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:13.391544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09172b-3283-4ace-a850-38b33b61e0c5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:13.393695 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1206/2417] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:21:13 2022] POST /identity/v3/users => generated 299 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:13.397220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9ce3e-3723-48a6-9e28-d59325187421 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:13.419535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9ce3e-3723-48a6-9e28-d59325187421 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:13.434864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d828f-6f5e-4140-9b3d-e1f632b6b1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:13.437297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d828f-6f5e-4140-9b3d-e1f632b6b1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:13.437297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d828f-6f5e-4140-9b3d-e1f632b6b1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:13.437297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d828f-6f5e-4140-9b3d-e1f632b6b1d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:13.437297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d828f-6f5e-4140-9b3d-e1f632b6b1d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:13.443778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d828f-6f5e-4140-9b3d-e1f632b6b1d3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:13.479017 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1207/2418] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:13.480209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d828f-6f5e-4140-9b3d-e1f632b6b1d3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:13.491667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d828f-6f5e-4140-9b3d-e1f632b6b1d3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:13.497778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efc367-cc50-4e9d-81a3-79503df01a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:13.498882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efc367-cc50-4e9d-81a3-79503df01a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:13.499308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efc367-cc50-4e9d-81a3-79503df01a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:13.500083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efc367-cc50-4e9d-81a3-79503df01a34 admin admin] PATH_INFO: `/v3/projects/b61e9bcfa5fd47d296c86f5f3f1300cd/users/7b62473f5e5c41b3af19bb77eca46655/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:13.518385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99efc367-cc50-4e9d-81a3-79503df01a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b61e9bcfa5fd47d296c86f5f3f1300cd, user_id=7b62473f5e5c41b3af19bb77eca46655, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:13.522320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99efc367-cc50-4e9d-81a3-79503df01a34 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:13.608947 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1208/2419] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:21:13 2022] PUT /identity/v3/projects/b61e9bcfa5fd47d296c86f5f3f1300cd/users/7b62473f5e5c41b3af19bb77eca46655/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:13.609959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efc367-cc50-4e9d-81a3-79503df01a34 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:13.613623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-99efc367-cc50-4e9d-81a3-79503df01a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:13.619411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fb09172b-3283-4ace-a850-38b33b61e0c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4524ce8eafa4df6be549375f4a7d2da', 'request_id': 'req-fb09172b-3283-4ace-a850-38b33b61e0c5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:13.627500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fb09172b-3283-4ace-a850-38b33b61e0c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4524ce8eafa4df6be549375f4a7d2da', 'request_id': 'req-fb09172b-3283-4ace-a850-38b33b61e0c5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:13.699151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fb09172b-3283-4ace-a850-38b33b61e0c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4524ce8eafa4df6be549375f4a7d2da', 'request_id': 'req-fb09172b-3283-4ace-a850-38b33b61e0c5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:13.717608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fb09172b-3283-4ace-a850-38b33b61e0c5 admin admin] The token cache is being invalidate because project a4524ce8eafa4df6be549375f4a7d2da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:21:13.717969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fb09172b-3283-4ace-a850-38b33b61e0c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:13.719478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fb09172b-3283-4ace-a850-38b33b61e0c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:13.725077 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1212/2420] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:21:13 2022] DELETE /identity/v3/projects/a4524ce8eafa4df6be549375f4a7d2da => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:21:13.725077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09172b-3283-4ace-a850-38b33b61e0c5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:13.741385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fb09172b-3283-4ace-a850-38b33b61e0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:13.821354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efc367-cc50-4e9d-81a3-79503df01a34 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:13.893020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09172b-3283-4ace-a850-38b33b61e0c5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:13.898686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c87f7-8dff-4929-8dd3-7c5084e4817b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:13.899517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c87f7-8dff-4929-8dd3-7c5084e4817b admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:13.899635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c87f7-8dff-4929-8dd3-7c5084e4817b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:13.899835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c87f7-8dff-4929-8dd3-7c5084e4817b admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:13.900654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c87f7-8dff-4929-8dd3-7c5084e4817b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:13.902453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c87f7-8dff-4929-8dd3-7c5084e4817b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:13.915566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad560b85-ab48-4256-8f0e-de6db20407d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:13.916296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad560b85-ab48-4256-8f0e-de6db20407d4 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:13.916543 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1213/2421] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:13.917950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad560b85-ab48-4256-8f0e-de6db20407d4 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:13.917950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad560b85-ab48-4256-8f0e-de6db20407d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:13.918181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c87f7-8dff-4929-8dd3-7c5084e4817b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:13.918909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ad560b85-ab48-4256-8f0e-de6db20407d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:13.919572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ce3c87f7-8dff-4929-8dd3-7c5084e4817b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:13.933253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c87f7-8dff-4929-8dd3-7c5084e4817b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:13.938668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4d96d-4ea0-410a-8cb1-ef9f391f1695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:13.939709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4d96d-4ea0-410a-8cb1-ef9f391f1695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:13.940197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4d96d-4ea0-410a-8cb1-ef9f391f1695 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:13.940545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4d96d-4ea0-410a-8cb1-ef9f391f1695 admin admin] PATH_INFO: `/v3/users/155c764ee16f4f9f85bd8cdeec2b2113` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:13.946423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4d96d-4ea0-410a-8cb1-ef9f391f1695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=155c764ee16f4f9f85bd8cdeec2b2113)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:13.946423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4d96d-4ea0-410a-8cb1-ef9f391f1695 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:14.017746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad560b85-ab48-4256-8f0e-de6db20407d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:14.019867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad560b85-ab48-4256-8f0e-de6db20407d4 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:14.032148 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1209/2422] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:13 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:14.033065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad560b85-ab48-4256-8f0e-de6db20407d4 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:14.057254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad560b85-ab48-4256-8f0e-de6db20407d4 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:14.070653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f88570-068f-4818-ab0d-e9183ffc3dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:14.071764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f88570-068f-4818-ab0d-e9183ffc3dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:14.072240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f88570-068f-4818-ab0d-e9183ffc3dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:14.072558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f88570-068f-4818-ab0d-e9183ffc3dcc admin admin] PATH_INFO: `/v3/projects/b61e9bcfa5fd47d296c86f5f3f1300cd/users/7b62473f5e5c41b3af19bb77eca46655/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:14.075178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f88570-068f-4818-ab0d-e9183ffc3dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b61e9bcfa5fd47d296c86f5f3f1300cd, user_id=7b62473f5e5c41b3af19bb77eca46655, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:14.082676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f88570-068f-4818-ab0d-e9183ffc3dcc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:14.105407 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1210/2423] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:21:14 2022] PUT /identity/v3/projects/b61e9bcfa5fd47d296c86f5f3f1300cd/users/7b62473f5e5c41b3af19bb77eca46655/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:14.121129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691a3fa-2d15-4ad6-bcd7-04697eaac8f3 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:14.121603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691a3fa-2d15-4ad6-bcd7-04697eaac8f3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:14.122276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691a3fa-2d15-4ad6-bcd7-04697eaac8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:14.169038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a691a3fa-2d15-4ad6-bcd7-04697eaac8f3 None None] MFA Rules not processed for user `7b62473f5e5c41b3af19bb77eca46655`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:14.172987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a691a3fa-2d15-4ad6-bcd7-04697eaac8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:14.219564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-39d4d96d-4ea0-410a-8cb1-ef9f391f1695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '155c764ee16f4f9f85bd8cdeec2b2113'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:14.235356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-39d4d96d-4ea0-410a-8cb1-ef9f391f1695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '155c764ee16f4f9f85bd8cdeec2b2113'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:14.236992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-39d4d96d-4ea0-410a-8cb1-ef9f391f1695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '155c764ee16f4f9f85bd8cdeec2b2113'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:14.247182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-39d4d96d-4ea0-410a-8cb1-ef9f391f1695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '155c764ee16f4f9f85bd8cdeec2b2113'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:14.301299 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1211/2424] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:14.312099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe578ef-71f1-4e8e-9365-4f2c4c8bd11c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:14.312631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe578ef-71f1-4e8e-9365-4f2c4c8bd11c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:14.313094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe578ef-71f1-4e8e-9365-4f2c4c8bd11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:14.322784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-39d4d96d-4ea0-410a-8cb1-ef9f391f1695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '155c764ee16f4f9f85bd8cdeec2b2113'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:14.334191 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1214/2425] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:21:13 2022] DELETE /identity/v3/users/155c764ee16f4f9f85bd8cdeec2b2113 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:14.344500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-abe578ef-71f1-4e8e-9365-4f2c4c8bd11c None None] MFA Rules not processed for user `cb3183cbca2346dd887162951f451fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:14.346757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-abe578ef-71f1-4e8e-9365-4f2c4c8bd11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:14.434590 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1212/2426] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:21:14.519844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4d96d-4ea0-410a-8cb1-ef9f391f1695 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:14.521615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-39d4d96d-4ea0-410a-8cb1-ef9f391f1695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:14.617735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4d96d-4ea0-410a-8cb1-ef9f391f1695 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:14.625071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4c319-75aa-41b8-b3f0-9ef7da5be79e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:14.626028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4c319-75aa-41b8-b3f0-9ef7da5be79e service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:14.626533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4c319-75aa-41b8-b3f0-9ef7da5be79e service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:14.627022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4c319-75aa-41b8-b3f0-9ef7da5be79e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:14.635553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-82f4c319-75aa-41b8-b3f0-9ef7da5be79e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:14.643243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4c319-75aa-41b8-b3f0-9ef7da5be79e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:14.645064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4c319-75aa-41b8-b3f0-9ef7da5be79e service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:14.657864 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1215/2427] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:21:14.929387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a53b1-5acd-4244-bd22-71e50fb94e15 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:14.930104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a53b1-5acd-4244-bd22-71e50fb94e15 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:14.930104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a53b1-5acd-4244-bd22-71e50fb94e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:14.949742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-835a53b1-5acd-4244-bd22-71e50fb94e15 None None] MFA Rules not processed for user `662c15e746b84fdbb497d700c9288931`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:14.951051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-835a53b1-5acd-4244-bd22-71e50fb94e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:15.022313 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1213/2428] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:15.292429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4c319-75aa-41b8-b3f0-9ef7da5be79e service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:15.296786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-82f4c319-75aa-41b8-b3f0-9ef7da5be79e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:15.384863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4c319-75aa-41b8-b3f0-9ef7da5be79e service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:15.390084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6e2ad-6ee5-458a-9d91-ff5d5a9a4c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:15.390990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6e2ad-6ee5-458a-9d91-ff5d5a9a4c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:15.391278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6e2ad-6ee5-458a-9d91-ff5d5a9a4c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:15.391554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6e2ad-6ee5-458a-9d91-ff5d5a9a4c8c admin admin] PATH_INFO: `/v3/projects/f752e442b73f4163bd865c2cf1512f1a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:15.392891 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6e2ad-6ee5-458a-9d91-ff5d5a9a4c8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f752e442b73f4163bd865c2cf1512f1a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:15.395936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6e2ad-6ee5-458a-9d91-ff5d5a9a4c8c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:15.527012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6ce6e2ad-6ee5-458a-9d91-ff5d5a9a4c8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f752e442b73f4163bd865c2cf1512f1a', 'request_id': 'req-6ce6e2ad-6ee5-458a-9d91-ff5d5a9a4c8c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:15.534056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6ce6e2ad-6ee5-458a-9d91-ff5d5a9a4c8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f752e442b73f4163bd865c2cf1512f1a', 'request_id': 'req-6ce6e2ad-6ee5-458a-9d91-ff5d5a9a4c8c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:15.594221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a53b1-5acd-4244-bd22-71e50fb94e15 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:15.596094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-835a53b1-5acd-4244-bd22-71e50fb94e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:15.597468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6ce6e2ad-6ee5-458a-9d91-ff5d5a9a4c8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f752e442b73f4163bd865c2cf1512f1a', 'request_id': 'req-6ce6e2ad-6ee5-458a-9d91-ff5d5a9a4c8c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:15.620347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a53b1-5acd-4244-bd22-71e50fb94e15 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:15.621393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6ce6e2ad-6ee5-458a-9d91-ff5d5a9a4c8c admin admin] The token cache is being invalidate because project f752e442b73f4163bd865c2cf1512f1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:21:15.622329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6ce6e2ad-6ee5-458a-9d91-ff5d5a9a4c8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:15.623421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6ce6e2ad-6ee5-458a-9d91-ff5d5a9a4c8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:15.626564 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1216/2429] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:21:15 2022] DELETE /identity/v3/projects/f752e442b73f4163bd865c2cf1512f1a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:15.633703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dcdc0-fc11-436c-94d9-16e0dd210859 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:15.640800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dcdc0-fc11-436c-94d9-16e0dd210859 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:15.640800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dcdc0-fc11-436c-94d9-16e0dd210859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:15.674956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-090dcdc0-fc11-436c-94d9-16e0dd210859 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:15.676094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-090dcdc0-fc11-436c-94d9-16e0dd210859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:15.727425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2e530-c427-4438-ae56-6229b3bad1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:15.728316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2e530-c427-4438-ae56-6229b3bad1d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:15.728652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2e530-c427-4438-ae56-6229b3bad1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:15.729995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2e530-c427-4438-ae56-6229b3bad1d7 admin admin] PATH_INFO: `/v3/users/ca3c52988d9a4983a5703bcf7d811e57` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:15.730517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2e530-c427-4438-ae56-6229b3bad1d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca3c52988d9a4983a5703bcf7d811e57)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:15.732717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2e530-c427-4438-ae56-6229b3bad1d7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:15.765777 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1217/2430] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:21:15.779980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf3555-1757-4d1b-8492-82985a8d23e9 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:15.780535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf3555-1757-4d1b-8492-82985a8d23e9 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:15.781211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf3555-1757-4d1b-8492-82985a8d23e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:15.818365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0ecf3555-1757-4d1b-8492-82985a8d23e9 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:15.819609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0ecf3555-1757-4d1b-8492-82985a8d23e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:15.831348 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1218/2431] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:15.836056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf3555-1757-4d1b-8492-82985a8d23e9 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:15.846311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf3555-1757-4d1b-8492-82985a8d23e9 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:15.852406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1c0d5-9f66-428a-b840-5b91a69b63c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:15.853138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1c0d5-9f66-428a-b840-5b91a69b63c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:15.853433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1c0d5-9f66-428a-b840-5b91a69b63c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:15.853705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1c0d5-9f66-428a-b840-5b91a69b63c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:15.854437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1c0d5-9f66-428a-b840-5b91a69b63c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:21:15.854881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1c0d5-9f66-428a-b840-5b91a69b63c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:15.856536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1c0d5-9f66-428a-b840-5b91a69b63c5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:15.868954 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1219/2432] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:21:15.873906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1c0d5-9f66-428a-b840-5b91a69b63c5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:15.892767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1c0d5-9f66-428a-b840-5b91a69b63c5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:15.903235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9aa2e530-c427-4438-ae56-6229b3bad1d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca3c52988d9a4983a5703bcf7d811e57'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:15.904864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47972b54-85a3-4f52-bad1-446d34582113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:15.906873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47972b54-85a3-4f52-bad1-446d34582113 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:15.907333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47972b54-85a3-4f52-bad1-446d34582113 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:15.907975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47972b54-85a3-4f52-bad1-446d34582113 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:15.909984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47972b54-85a3-4f52-bad1-446d34582113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:15.912920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47972b54-85a3-4f52-bad1-446d34582113 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:15.919186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9aa2e530-c427-4438-ae56-6229b3bad1d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca3c52988d9a4983a5703bcf7d811e57'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:15.920305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9aa2e530-c427-4438-ae56-6229b3bad1d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca3c52988d9a4983a5703bcf7d811e57'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:15.930341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9aa2e530-c427-4438-ae56-6229b3bad1d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca3c52988d9a4983a5703bcf7d811e57'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:16.007151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9aa2e530-c427-4438-ae56-6229b3bad1d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca3c52988d9a4983a5703bcf7d811e57'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:16.015691 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1214/2433] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:21:15 2022] DELETE /identity/v3/users/ca3c52988d9a4983a5703bcf7d811e57 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:16.020215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7bd53-55ca-4227-a731-87c1f99753c7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:16.020817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7bd53-55ca-4227-a731-87c1f99753c7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:16.021442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7bd53-55ca-4227-a731-87c1f99753c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:16.022307 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1220/2434] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:21:15 2022] POST /identity/v3/projects => generated 401 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:16.026826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47972b54-85a3-4f52-bad1-446d34582113 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:16.030938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-47972b54-85a3-4f52-bad1-446d34582113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:16.047778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c6b7bd53-55ca-4227-a731-87c1f99753c7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:16.049787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c6b7bd53-55ca-4227-a731-87c1f99753c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:16.129954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47972b54-85a3-4f52-bad1-446d34582113 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:16.135930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799c014-7d1c-49a6-aa25-77b0557d7929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:16.137157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799c014-7d1c-49a6-aa25-77b0557d7929 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:16.137580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799c014-7d1c-49a6-aa25-77b0557d7929 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:16.138166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799c014-7d1c-49a6-aa25-77b0557d7929 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:16.138982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799c014-7d1c-49a6-aa25-77b0557d7929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:16.142332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799c014-7d1c-49a6-aa25-77b0557d7929 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:16.146772 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1215/2435] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:16.154207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7bd53-55ca-4227-a731-87c1f99753c7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:16.156552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c6b7bd53-55ca-4227-a731-87c1f99753c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:16.221303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7bd53-55ca-4227-a731-87c1f99753c7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:16.226943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0282cd-458b-469d-a88d-db94679c2f2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:16.228714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0282cd-458b-469d-a88d-db94679c2f2c service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:16.229275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0282cd-458b-469d-a88d-db94679c2f2c service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:16.229734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0282cd-458b-469d-a88d-db94679c2f2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:16.240855 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1221/2436] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:21:16 2022] POST /identity/v3/users => generated 301 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:16.242163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799c014-7d1c-49a6-aa25-77b0557d7929 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:16.244393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0282cd-458b-469d-a88d-db94679c2f2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:16.247078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0282cd-458b-469d-a88d-db94679c2f2c service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:16.265269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799c014-7d1c-49a6-aa25-77b0557d7929 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:16.272523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0a834-e138-4446-917e-78fb23dbed93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:16.273235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0a834-e138-4446-917e-78fb23dbed93 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:16.273524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0a834-e138-4446-917e-78fb23dbed93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:16.273794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0a834-e138-4446-917e-78fb23dbed93 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:16.274402 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1216/2437] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:21:16.274737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0a834-e138-4446-917e-78fb23dbed93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:16.277060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0a834-e138-4446-917e-78fb23dbed93 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:16.291345 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1222/2438] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:16.295515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0282cd-458b-469d-a88d-db94679c2f2c service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:16.308507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0282cd-458b-469d-a88d-db94679c2f2c service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:16.320183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d66fa3-e812-4dc1-a52a-3ac21b4d385c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:16.322053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d66fa3-e812-4dc1-a52a-3ac21b4d385c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:16.322380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d66fa3-e812-4dc1-a52a-3ac21b4d385c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:16.323695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d66fa3-e812-4dc1-a52a-3ac21b4d385c admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:16.338109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d66fa3-e812-4dc1-a52a-3ac21b4d385c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:16.342596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d66fa3-e812-4dc1-a52a-3ac21b4d385c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:16.367722 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1217/2439] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:16.371362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0a834-e138-4446-917e-78fb23dbed93 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:16.387103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0a834-e138-4446-917e-78fb23dbed93 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:16.402919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ca0b0-fb2c-4911-b99f-fcbdae241c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:16.404637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ca0b0-fb2c-4911-b99f-fcbdae241c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:16.405155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ca0b0-fb2c-4911-b99f-fcbdae241c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:16.406372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ca0b0-fb2c-4911-b99f-fcbdae241c0d admin admin] PATH_INFO: `/v3/projects/c7452c6772324b18b3760ad2d641bb3f/users/9606f6462ab74aebbb677e3f70a7ca2f/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:16.427890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ca0b0-fb2c-4911-b99f-fcbdae241c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7452c6772324b18b3760ad2d641bb3f, user_id=9606f6462ab74aebbb677e3f70a7ca2f, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:16.429649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ca0b0-fb2c-4911-b99f-fcbdae241c0d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:16.517114 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1223/2440] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:21:16 2022] PUT /identity/v3/projects/c7452c6772324b18b3760ad2d641bb3f/users/9606f6462ab74aebbb677e3f70a7ca2f/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:21:16.530104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fede4a0-4d50-48fa-aa68-e6d187d2d836 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:16.530593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fede4a0-4d50-48fa-aa68-e6d187d2d836 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:16.531048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fede4a0-4d50-48fa-aa68-e6d187d2d836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:16.590003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3fede4a0-4d50-48fa-aa68-e6d187d2d836 None None] MFA Rules not processed for user `9606f6462ab74aebbb677e3f70a7ca2f`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:16.591671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3fede4a0-4d50-48fa-aa68-e6d187d2d836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:16.837520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ca0b0-fb2c-4911-b99f-fcbdae241c0d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:16.838695 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1218/2441] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:16.987492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ca0b0-fb2c-4911-b99f-fcbdae241c0d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:16.998986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3b679-a562-49d6-a04d-e0850c9b12e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:16.999741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3b679-a562-49d6-a04d-e0850c9b12e3 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:17.001700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3b679-a562-49d6-a04d-e0850c9b12e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:17.002063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3b679-a562-49d6-a04d-e0850c9b12e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:17.002866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3b679-a562-49d6-a04d-e0850c9b12e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:17.005220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3b679-a562-49d6-a04d-e0850c9b12e3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:17.115809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fede4a0-4d50-48fa-aa68-e6d187d2d836 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:17.117716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3fede4a0-4d50-48fa-aa68-e6d187d2d836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:17.134188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fede4a0-4d50-48fa-aa68-e6d187d2d836 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:17.204462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5240287-cf38-4530-a9be-90561ce9097a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:17.205497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5240287-cf38-4530-a9be-90561ce9097a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:17.206333 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1224/2442] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:21:16 2022] POST /identity/v3/projects => generated 403 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:21:17.207096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3b679-a562-49d6-a04d-e0850c9b12e3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:17.208581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5240287-cf38-4530-a9be-90561ce9097a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:17.208999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5240287-cf38-4530-a9be-90561ce9097a admin admin] PATH_INFO: `/v3/projects/8dd7d72ad31a49a2ad65c451202a2e9e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:17.214204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5240287-cf38-4530-a9be-90561ce9097a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd7d72ad31a49a2ad65c451202a2e9e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:17.220285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5240287-cf38-4530-a9be-90561ce9097a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:17.390156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3b679-a562-49d6-a04d-e0850c9b12e3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:17.395009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b5240287-cf38-4530-a9be-90561ce9097a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd7d72ad31a49a2ad65c451202a2e9e', 'request_id': 'req-b5240287-cf38-4530-a9be-90561ce9097a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:17.487471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b5240287-cf38-4530-a9be-90561ce9097a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd7d72ad31a49a2ad65c451202a2e9e', 'request_id': 'req-b5240287-cf38-4530-a9be-90561ce9097a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:17.495229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b5240287-cf38-4530-a9be-90561ce9097a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd7d72ad31a49a2ad65c451202a2e9e', 'request_id': 'req-b5240287-cf38-4530-a9be-90561ce9097a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:17.514592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b5240287-cf38-4530-a9be-90561ce9097a admin admin] The token cache is being invalidate because project 8dd7d72ad31a49a2ad65c451202a2e9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:21:17.516537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b5240287-cf38-4530-a9be-90561ce9097a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:17.527583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b5240287-cf38-4530-a9be-90561ce9097a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:17.536218 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1219/2443] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:21:17 2022] DELETE /identity/v3/projects/8dd7d72ad31a49a2ad65c451202a2e9e => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:21:17.537873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ced52-8aa9-4a9d-b524-f5144aac167d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:17.538808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ced52-8aa9-4a9d-b524-f5144aac167d admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:17.539318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ced52-8aa9-4a9d-b524-f5144aac167d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:17.551803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ced52-8aa9-4a9d-b524-f5144aac167d admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:17.556482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ced52-8aa9-4a9d-b524-f5144aac167d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:17.558372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5240287-cf38-4530-a9be-90561ce9097a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:17.562019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b5240287-cf38-4530-a9be-90561ce9097a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:17.564751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ced52-8aa9-4a9d-b524-f5144aac167d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:17.632928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5240287-cf38-4530-a9be-90561ce9097a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:17.648460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd4282-e782-4112-adc6-acd5bbb055ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:17.649871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd4282-e782-4112-adc6-acd5bbb055ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:17.651132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd4282-e782-4112-adc6-acd5bbb055ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:17.651606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd4282-e782-4112-adc6-acd5bbb055ea admin admin] PATH_INFO: `/v3/users/c52ce2af30bb45a29ae3c3e2445b4a13` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:17.654576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd4282-e782-4112-adc6-acd5bbb055ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=c52ce2af30bb45a29ae3c3e2445b4a13)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:17.659135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd4282-e782-4112-adc6-acd5bbb055ea admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:17.717472 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1225/2444] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:21:17 2022] POST /identity/v3/users => generated 308 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:17.721720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ced52-8aa9-4a9d-b524-f5144aac167d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:17.723894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-954ced52-8aa9-4a9d-b524-f5144aac167d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:17.738867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ced52-8aa9-4a9d-b524-f5144aac167d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:17.744349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab7f41-6dc5-42ac-acfd-b4542d843928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:17.745350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab7f41-6dc5-42ac-acfd-b4542d843928 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:17.745795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab7f41-6dc5-42ac-acfd-b4542d843928 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:17.746253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab7f41-6dc5-42ac-acfd-b4542d843928 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:17.747402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab7f41-6dc5-42ac-acfd-b4542d843928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:17.750012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab7f41-6dc5-42ac-acfd-b4542d843928 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:17.761815 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1226/2445] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:21:17.766059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab7f41-6dc5-42ac-acfd-b4542d843928 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:17.777051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab7f41-6dc5-42ac-acfd-b4542d843928 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:17.781961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bb864-a3bc-491b-ab99-342e5554be4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:17.783001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bb864-a3bc-491b-ab99-342e5554be4c admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:17.783347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bb864-a3bc-491b-ab99-342e5554be4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:17.783636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bb864-a3bc-491b-ab99-342e5554be4c admin admin] PATH_INFO: `/v3/projects/1dce9d8459484d27822f2a3700044027/users/7492b6cfdacf4806a92b4d6b8ce006cb/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:17.800709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bb864-a3bc-491b-ab99-342e5554be4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dce9d8459484d27822f2a3700044027, user_id=7492b6cfdacf4806a92b4d6b8ce006cb, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:17.803617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bb864-a3bc-491b-ab99-342e5554be4c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:17.899042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c6cd4282-e782-4112-adc6-acd5bbb055ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c52ce2af30bb45a29ae3c3e2445b4a13'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:17.915625 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1227/2446] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:21:17 2022] PUT /identity/v3/projects/1dce9d8459484d27822f2a3700044027/users/7492b6cfdacf4806a92b4d6b8ce006cb/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:17.915625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bb864-a3bc-491b-ab99-342e5554be4c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:17.919705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-150bb864-a3bc-491b-ab99-342e5554be4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:17.939222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c6cd4282-e782-4112-adc6-acd5bbb055ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c52ce2af30bb45a29ae3c3e2445b4a13'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:17.941419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c6cd4282-e782-4112-adc6-acd5bbb055ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c52ce2af30bb45a29ae3c3e2445b4a13'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:17.963832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c6cd4282-e782-4112-adc6-acd5bbb055ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c52ce2af30bb45a29ae3c3e2445b4a13'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:18.023402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bb864-a3bc-491b-ab99-342e5554be4c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:18.031252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887825b7-9140-408a-8784-42ab52b583a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:18.038212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887825b7-9140-408a-8784-42ab52b583a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:18.038212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887825b7-9140-408a-8784-42ab52b583a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:18.038212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887825b7-9140-408a-8784-42ab52b583a7 admin admin] PATH_INFO: `/v3/users/800264e9cfea412cbada30fc2b420157` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:18.038212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887825b7-9140-408a-8784-42ab52b583a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=800264e9cfea412cbada30fc2b420157)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:18.038212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887825b7-9140-408a-8784-42ab52b583a7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:18.080822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c6cd4282-e782-4112-adc6-acd5bbb055ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c52ce2af30bb45a29ae3c3e2445b4a13'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:18.121577 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1220/2447] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:21:17 2022] DELETE /identity/v3/users/c52ce2af30bb45a29ae3c3e2445b4a13 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:18.124223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd4282-e782-4112-adc6-acd5bbb055ea admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:18.129352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c6cd4282-e782-4112-adc6-acd5bbb055ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:18.309909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd4282-e782-4112-adc6-acd5bbb055ea admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:18.310932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-887825b7-9140-408a-8784-42ab52b583a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '800264e9cfea412cbada30fc2b420157'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:18.320348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9965f-046f-41bd-aa58-033918f0cb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:18.321194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9965f-046f-41bd-aa58-033918f0cb0d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:18.321555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9965f-046f-41bd-aa58-033918f0cb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:18.322247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9965f-046f-41bd-aa58-033918f0cb0d admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:18.323154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9965f-046f-41bd-aa58-033918f0cb0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:18.324987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9965f-046f-41bd-aa58-033918f0cb0d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:18.351975 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1221/2448] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:18.352063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-887825b7-9140-408a-8784-42ab52b583a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '800264e9cfea412cbada30fc2b420157'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:18.352063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-887825b7-9140-408a-8784-42ab52b583a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '800264e9cfea412cbada30fc2b420157'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:18.354095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9965f-046f-41bd-aa58-033918f0cb0d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:18.373482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-887825b7-9140-408a-8784-42ab52b583a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '800264e9cfea412cbada30fc2b420157'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:18.378387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9965f-046f-41bd-aa58-033918f0cb0d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:18.413494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab4d2f-7662-4b4c-8683-b076b5bfe4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:18.415298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab4d2f-7662-4b4c-8683-b076b5bfe4a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:18.417349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab4d2f-7662-4b4c-8683-b076b5bfe4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:18.418881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab4d2f-7662-4b4c-8683-b076b5bfe4a8 admin admin] PATH_INFO: `/v3/projects/1dce9d8459484d27822f2a3700044027/users/7492b6cfdacf4806a92b4d6b8ce006cb/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:18.426687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab4d2f-7662-4b4c-8683-b076b5bfe4a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dce9d8459484d27822f2a3700044027, user_id=7492b6cfdacf4806a92b4d6b8ce006cb, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:18.432589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab4d2f-7662-4b4c-8683-b076b5bfe4a8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:18.455979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-887825b7-9140-408a-8784-42ab52b583a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '800264e9cfea412cbada30fc2b420157'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:18.466142 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1228/2449] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:21:17 2022] DELETE /identity/v3/users/800264e9cfea412cbada30fc2b420157 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:18.470677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f4aaa-be2c-4d79-a16f-bd6a347a8e1c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:18.471169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f4aaa-be2c-4d79-a16f-bd6a347a8e1c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:18.471603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f4aaa-be2c-4d79-a16f-bd6a347a8e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:18.480033 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1222/2450] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:21:18 2022] PUT /identity/v3/projects/1dce9d8459484d27822f2a3700044027/users/7492b6cfdacf4806a92b4d6b8ce006cb/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:18.490135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6ada5-690b-4c03-9613-73b601b741a5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:18.490430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6ada5-690b-4c03-9613-73b601b741a5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:18.490860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6ada5-690b-4c03-9613-73b601b741a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:18.511992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-888f4aaa-be2c-4d79-a16f-bd6a347a8e1c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:18.516736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-888f4aaa-be2c-4d79-a16f-bd6a347a8e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:18.542581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2ce6ada5-690b-4c03-9613-73b601b741a5 None None] MFA Rules not processed for user `7492b6cfdacf4806a92b4d6b8ce006cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:18.544000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2ce6ada5-690b-4c03-9613-73b601b741a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:18.655647 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1229/2451] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:21:18.683288 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1223/2452] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:18 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:18.690995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f4aaa-be2c-4d79-a16f-bd6a347a8e1c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:18.692572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-888f4aaa-be2c-4d79-a16f-bd6a347a8e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:18.783728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6ada5-690b-4c03-9613-73b601b741a5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:18.785936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f4aaa-be2c-4d79-a16f-bd6a347a8e1c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:18.786110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2ce6ada5-690b-4c03-9613-73b601b741a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:18.821524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dde5d0-8618-4972-8398-2619067c60de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:18.826176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dde5d0-8618-4972-8398-2619067c60de service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:18.826176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dde5d0-8618-4972-8398-2619067c60de service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:18.829650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dde5d0-8618-4972-8398-2619067c60de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:18.868830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dde5d0-8618-4972-8398-2619067c60de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:18.870309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dde5d0-8618-4972-8398-2619067c60de service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:18.894658 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1230/2453] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:18.927517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6ada5-690b-4c03-9613-73b601b741a5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:18.946378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e42283-e1c9-4fed-af26-d5a8146f3fc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:18.947518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e42283-e1c9-4fed-af26-d5a8146f3fc2 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:18.947802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e42283-e1c9-4fed-af26-d5a8146f3fc2 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:18.948165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e42283-e1c9-4fed-af26-d5a8146f3fc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:18.967319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e42283-e1c9-4fed-af26-d5a8146f3fc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:18.969068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e42283-e1c9-4fed-af26-d5a8146f3fc2 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:19.000012 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1224/2454] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:18 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:21:19.212973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dde5d0-8618-4972-8398-2619067c60de service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:19.232846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dde5d0-8618-4972-8398-2619067c60de service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:19.245526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16154f-0d64-4809-85a8-5bc95212ea6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:19.246197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16154f-0d64-4809-85a8-5bc95212ea6e service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:19.246481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16154f-0d64-4809-85a8-5bc95212ea6e service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:19.247014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16154f-0d64-4809-85a8-5bc95212ea6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:19.250091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cd16154f-0d64-4809-85a8-5bc95212ea6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:19.390723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16154f-0d64-4809-85a8-5bc95212ea6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:19.393526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16154f-0d64-4809-85a8-5bc95212ea6e service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:19.405575 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1231/2455] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:21:19.726099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e42283-e1c9-4fed-af26-d5a8146f3fc2 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:19.728584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-31e42283-e1c9-4fed-af26-d5a8146f3fc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:19.751744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e42283-e1c9-4fed-af26-d5a8146f3fc2 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:19.767475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be6799-40f5-48eb-a132-fad1f59e341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:19.769613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be6799-40f5-48eb-a132-fad1f59e341a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:19.770053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be6799-40f5-48eb-a132-fad1f59e341a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:19.770333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be6799-40f5-48eb-a132-fad1f59e341a admin admin] PATH_INFO: `/v3/projects/2ca246559e624db4a8061498588ca8eb` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:19.772272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be6799-40f5-48eb-a132-fad1f59e341a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca246559e624db4a8061498588ca8eb)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:19.775671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be6799-40f5-48eb-a132-fad1f59e341a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:19.819832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16154f-0d64-4809-85a8-5bc95212ea6e service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:19.829978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cd16154f-0d64-4809-85a8-5bc95212ea6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:19.857756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16154f-0d64-4809-85a8-5bc95212ea6e service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:19.864720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ccd2d-70e8-4747-a004-7f9087e91384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:19.865624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ccd2d-70e8-4747-a004-7f9087e91384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:19.865903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ccd2d-70e8-4747-a004-7f9087e91384 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:19.866179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ccd2d-70e8-4747-a004-7f9087e91384 admin admin] PATH_INFO: `/v3/projects/c98e1459928b44bdb40d8c711d9655e6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:19.867426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ccd2d-70e8-4747-a004-7f9087e91384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c98e1459928b44bdb40d8c711d9655e6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:19.869607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ccd2d-70e8-4747-a004-7f9087e91384 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:19.953616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-21be6799-40f5-48eb-a132-fad1f59e341a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca246559e624db4a8061498588ca8eb', 'request_id': 'req-21be6799-40f5-48eb-a132-fad1f59e341a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:20.053623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-21be6799-40f5-48eb-a132-fad1f59e341a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca246559e624db4a8061498588ca8eb', 'request_id': 'req-21be6799-40f5-48eb-a132-fad1f59e341a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:20.066387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-21be6799-40f5-48eb-a132-fad1f59e341a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca246559e624db4a8061498588ca8eb', 'request_id': 'req-21be6799-40f5-48eb-a132-fad1f59e341a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:20.091973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-21be6799-40f5-48eb-a132-fad1f59e341a admin admin] The token cache is being invalidate because project 2ca246559e624db4a8061498588ca8eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:21:20.092382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-21be6799-40f5-48eb-a132-fad1f59e341a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:20.093235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-21be6799-40f5-48eb-a132-fad1f59e341a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:20.095258 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1225/2456] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:21:19 2022] DELETE /identity/v3/projects/2ca246559e624db4a8061498588ca8eb => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:20.100330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c603a2-e284-4365-84b5-9da210cb9c1e None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:20.101195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c603a2-e284-4365-84b5-9da210cb9c1e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:20.101588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c603a2-e284-4365-84b5-9da210cb9c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:20.141894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b16ccd2d-70e8-4747-a004-7f9087e91384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c98e1459928b44bdb40d8c711d9655e6', 'request_id': 'req-b16ccd2d-70e8-4747-a004-7f9087e91384'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:20.149211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-83c603a2-e284-4365-84b5-9da210cb9c1e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:20.156528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-83c603a2-e284-4365-84b5-9da210cb9c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:20.158855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b16ccd2d-70e8-4747-a004-7f9087e91384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c98e1459928b44bdb40d8c711d9655e6', 'request_id': 'req-b16ccd2d-70e8-4747-a004-7f9087e91384'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:20.230013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b16ccd2d-70e8-4747-a004-7f9087e91384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c98e1459928b44bdb40d8c711d9655e6', 'request_id': 'req-b16ccd2d-70e8-4747-a004-7f9087e91384'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:20.251235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b16ccd2d-70e8-4747-a004-7f9087e91384 admin admin] The token cache is being invalidate because project c98e1459928b44bdb40d8c711d9655e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:21:20.252338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b16ccd2d-70e8-4747-a004-7f9087e91384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:20.260806 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1226/2457] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:20.262304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b16ccd2d-70e8-4747-a004-7f9087e91384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:20.266357 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1232/2458] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:21:19 2022] DELETE /identity/v3/projects/c98e1459928b44bdb40d8c711d9655e6 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:20.268889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed43af-dfc6-4e0c-8d1d-8e3103f76b57 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:20.269325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed43af-dfc6-4e0c-8d1d-8e3103f76b57 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:20.272736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed43af-dfc6-4e0c-8d1d-8e3103f76b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:20.272946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdad99-1877-457b-afc4-ec6c665758d6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:20.273050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdad99-1877-457b-afc4-ec6c665758d6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:20.273256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdad99-1877-457b-afc4-ec6c665758d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:20.295876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-74cdad99-1877-457b-afc4-ec6c665758d6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:20.297547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-74cdad99-1877-457b-afc4-ec6c665758d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:20.298933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-86ed43af-dfc6-4e0c-8d1d-8e3103f76b57 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:20.300708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-86ed43af-dfc6-4e0c-8d1d-8e3103f76b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:20.319210 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1227/2459] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:20.324408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed43af-dfc6-4e0c-8d1d-8e3103f76b57 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:20.344215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed43af-dfc6-4e0c-8d1d-8e3103f76b57 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:20.347672 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1233/2460] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:20.350488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71146c2a-964d-4d49-8daf-afe7acc4398f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:20.356218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6685abd-b5aa-499d-b65e-5466d41265c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:20.356427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71146c2a-964d-4d49-8daf-afe7acc4398f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:20.356687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71146c2a-964d-4d49-8daf-afe7acc4398f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:20.358326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6685abd-b5aa-499d-b65e-5466d41265c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:20.366426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6685abd-b5aa-499d-b65e-5466d41265c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:20.366426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6685abd-b5aa-499d-b65e-5466d41265c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:20.366426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6685abd-b5aa-499d-b65e-5466d41265c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:21:20.366426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6685abd-b5aa-499d-b65e-5466d41265c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:20.368123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6685abd-b5aa-499d-b65e-5466d41265c9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:20.401156 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1228/2461] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:21:20.402593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6685abd-b5aa-499d-b65e-5466d41265c9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:20.415939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-71146c2a-964d-4d49-8daf-afe7acc4398f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:20.419929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-71146c2a-964d-4d49-8daf-afe7acc4398f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:20.426627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6685abd-b5aa-499d-b65e-5466d41265c9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:20.443524 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1234/2462] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:20.446688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71146c2a-964d-4d49-8daf-afe7acc4398f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:20.451114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c671cc-56ba-4d2c-9704-4f90512ff1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:20.451810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c671cc-56ba-4d2c-9704-4f90512ff1ed admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:20.452156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c671cc-56ba-4d2c-9704-4f90512ff1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:20.454319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c671cc-56ba-4d2c-9704-4f90512ff1ed admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:20.454319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c671cc-56ba-4d2c-9704-4f90512ff1ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:20.455215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c671cc-56ba-4d2c-9704-4f90512ff1ed admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:20.466183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71146c2a-964d-4d49-8daf-afe7acc4398f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:20.479497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c576e44-11eb-4717-a315-19f759ed57cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:20.480179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c576e44-11eb-4717-a315-19f759ed57cd admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:20.480459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c576e44-11eb-4717-a315-19f759ed57cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:20.481110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c576e44-11eb-4717-a315-19f759ed57cd admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:20.481853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c576e44-11eb-4717-a315-19f759ed57cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:21:20.482166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c576e44-11eb-4717-a315-19f759ed57cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:20.485020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c576e44-11eb-4717-a315-19f759ed57cd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:20.500699 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1235/2463] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:21:20.501929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c576e44-11eb-4717-a315-19f759ed57cd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:20.505161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8c576e44-11eb-4717-a315-19f759ed57cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:20.526183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c576e44-11eb-4717-a315-19f759ed57cd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:20.531948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a9e3e-0f64-420d-b37e-8a5ad6e04e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:20.532873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a9e3e-0f64-420d-b37e-8a5ad6e04e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:20.533162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a9e3e-0f64-420d-b37e-8a5ad6e04e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:20.533628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a9e3e-0f64-420d-b37e-8a5ad6e04e7f admin admin] PATH_INFO: `/v3/users/9606f6462ab74aebbb677e3f70a7ca2f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:20.534931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a9e3e-0f64-420d-b37e-8a5ad6e04e7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9606f6462ab74aebbb677e3f70a7ca2f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:20.537511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a9e3e-0f64-420d-b37e-8a5ad6e04e7f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:20.572112 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1229/2464] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:21:20 2022] POST /identity/v3/projects => generated 405 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:20.576133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c671cc-56ba-4d2c-9704-4f90512ff1ed admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:20.637644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c671cc-56ba-4d2c-9704-4f90512ff1ed admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:20.642423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770baa28-ddd8-4eee-b90d-edf8e24701a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:20.643195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770baa28-ddd8-4eee-b90d-edf8e24701a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:20.643480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770baa28-ddd8-4eee-b90d-edf8e24701a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:20.643841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770baa28-ddd8-4eee-b90d-edf8e24701a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:20.644645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770baa28-ddd8-4eee-b90d-edf8e24701a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:20.646705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770baa28-ddd8-4eee-b90d-edf8e24701a6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:20.823962 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1230/2465] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:21:20 2022] POST /identity/v3/projects => generated 385 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:20.823962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770baa28-ddd8-4eee-b90d-edf8e24701a6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:20.926312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-372a9e3e-0f64-420d-b37e-8a5ad6e04e7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9606f6462ab74aebbb677e3f70a7ca2f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:20.972818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770baa28-ddd8-4eee-b90d-edf8e24701a6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:20.976757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-372a9e3e-0f64-420d-b37e-8a5ad6e04e7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9606f6462ab74aebbb677e3f70a7ca2f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:20.979199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-372a9e3e-0f64-420d-b37e-8a5ad6e04e7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9606f6462ab74aebbb677e3f70a7ca2f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:20.994938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6bdac-34e2-451e-bd80-15587253be3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:20.995805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6bdac-34e2-451e-bd80-15587253be3a admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:20.996621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6bdac-34e2-451e-bd80-15587253be3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:20.997175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6bdac-34e2-451e-bd80-15587253be3a admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:20.999571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6bdac-34e2-451e-bd80-15587253be3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:21.006113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-372a9e3e-0f64-420d-b37e-8a5ad6e04e7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9606f6462ab74aebbb677e3f70a7ca2f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:21.010709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6bdac-34e2-451e-bd80-15587253be3a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:21.136845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-372a9e3e-0f64-420d-b37e-8a5ad6e04e7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9606f6462ab74aebbb677e3f70a7ca2f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:21.144727 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1236/2466] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:21:20 2022] DELETE /identity/v3/users/9606f6462ab74aebbb677e3f70a7ca2f => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:21.145576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a9e3e-0f64-420d-b37e-8a5ad6e04e7f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:21.148688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-372a9e3e-0f64-420d-b37e-8a5ad6e04e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:21.180593 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1231/2467] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:21:20 2022] POST /identity/v3/users => generated 303 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:21.182260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09aced3-7685-4718-8bf5-47f2ef79e7a7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:21.182806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09aced3-7685-4718-8bf5-47f2ef79e7a7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:21.182905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09aced3-7685-4718-8bf5-47f2ef79e7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:21.241387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a09aced3-7685-4718-8bf5-47f2ef79e7a7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:21.243824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a09aced3-7685-4718-8bf5-47f2ef79e7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:21.320807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a9e3e-0f64-420d-b37e-8a5ad6e04e7f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:21.333276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425970d-58f1-4ccb-80d8-3941602ad9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:21.335359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425970d-58f1-4ccb-80d8-3941602ad9ee admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:21.336847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425970d-58f1-4ccb-80d8-3941602ad9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:21.338187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425970d-58f1-4ccb-80d8-3941602ad9ee admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:21.339374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425970d-58f1-4ccb-80d8-3941602ad9ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:21.342739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425970d-58f1-4ccb-80d8-3941602ad9ee admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:21.376958 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1232/2468] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:21.378084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09aced3-7685-4718-8bf5-47f2ef79e7a7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:21.379920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a09aced3-7685-4718-8bf5-47f2ef79e7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:21.395705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09aced3-7685-4718-8bf5-47f2ef79e7a7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:21.401854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa23eee-b769-419a-ba34-8851cb302d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:21.402799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa23eee-b769-419a-ba34-8851cb302d3f admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:21.403094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa23eee-b769-419a-ba34-8851cb302d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:21.403473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa23eee-b769-419a-ba34-8851cb302d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:21.404371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa23eee-b769-419a-ba34-8851cb302d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:21.406335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa23eee-b769-419a-ba34-8851cb302d3f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:21.422554 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1233/2469] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:21.431120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa23eee-b769-419a-ba34-8851cb302d3f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:21.449240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa23eee-b769-419a-ba34-8851cb302d3f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:21.461765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b6947-6ed3-4742-b607-5e1656da12c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:21.462799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b6947-6ed3-4742-b607-5e1656da12c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:21.463238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b6947-6ed3-4742-b607-5e1656da12c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:21.463683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b6947-6ed3-4742-b607-5e1656da12c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:21.464674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b6947-6ed3-4742-b607-5e1656da12c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:21.466463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b6947-6ed3-4742-b607-5e1656da12c7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:21.475993 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1237/2470] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:21:21 2022] POST /identity/v3/users => generated 293 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:21.480635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425970d-58f1-4ccb-80d8-3941602ad9ee admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:21.487858 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1234/2471] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:21.489604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b6947-6ed3-4742-b607-5e1656da12c7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:21.497014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425970d-58f1-4ccb-80d8-3941602ad9ee admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:21.505338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b6947-6ed3-4742-b607-5e1656da12c7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:21.513069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e3b78-f343-46ec-936b-0a1c1308dd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:21.513894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e3b78-f343-46ec-936b-0a1c1308dd8e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:21.514370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143cc89c-0c1b-4fcc-959c-c9335d138b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:21.515485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cc89c-0c1b-4fcc-959c-c9335d138b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:21.515980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e3b78-f343-46ec-936b-0a1c1308dd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:21.516124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cc89c-0c1b-4fcc-959c-c9335d138b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:21.516477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e3b78-f343-46ec-936b-0a1c1308dd8e admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:21.516881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cc89c-0c1b-4fcc-959c-c9335d138b5f admin admin] PATH_INFO: `/v3/projects/d46063a5dc8c41598cf95a80726c6082/users/b98645267a5945c7a4ed7d57ec80a6a4/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:21.518048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e3b78-f343-46ec-936b-0a1c1308dd8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:21.524124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e3b78-f343-46ec-936b-0a1c1308dd8e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:21.540818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143cc89c-0c1b-4fcc-959c-c9335d138b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46063a5dc8c41598cf95a80726c6082, user_id=b98645267a5945c7a4ed7d57ec80a6a4, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:21.544968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143cc89c-0c1b-4fcc-959c-c9335d138b5f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:21.546443 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1238/2472] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:21.550402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e3b78-f343-46ec-936b-0a1c1308dd8e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:21.585227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e3b78-f343-46ec-936b-0a1c1308dd8e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:21.595801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e80a5-8ca1-4b85-828a-9f99a508e97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:21.596720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e80a5-8ca1-4b85-828a-9f99a508e97c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:21.597155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e80a5-8ca1-4b85-828a-9f99a508e97c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:21.597611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e80a5-8ca1-4b85-828a-9f99a508e97c admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:21.598491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e80a5-8ca1-4b85-828a-9f99a508e97c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:21.605003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e80a5-8ca1-4b85-828a-9f99a508e97c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:21.634243 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1239/2473] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:21:21.644278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e80a5-8ca1-4b85-828a-9f99a508e97c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:21.644278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f67e80a5-8ca1-4b85-828a-9f99a508e97c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:21.671780 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1235/2474] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:21:21 2022] PUT /identity/v3/projects/d46063a5dc8c41598cf95a80726c6082/users/b98645267a5945c7a4ed7d57ec80a6a4/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:21.673495 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143cc89c-0c1b-4fcc-959c-c9335d138b5f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:21.801948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143cc89c-0c1b-4fcc-959c-c9335d138b5f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:21.815303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8212d-ddef-437d-80ca-7c8c492bc748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:21.816257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8212d-ddef-437d-80ca-7c8c492bc748 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:21.816541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8212d-ddef-437d-80ca-7c8c492bc748 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:21.816914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8212d-ddef-437d-80ca-7c8c492bc748 admin admin] PATH_INFO: `/v3/projects/794ae6913d5546dbadfb32cb27b15d3c/users/26be0fc413e94efa9d98b869a834e69f/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:21.827194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e80a5-8ca1-4b85-828a-9f99a508e97c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:21.850189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8212d-ddef-437d-80ca-7c8c492bc748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=794ae6913d5546dbadfb32cb27b15d3c, user_id=26be0fc413e94efa9d98b869a834e69f, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:21.853581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8212d-ddef-437d-80ca-7c8c492bc748 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:21.935403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfae64-e440-49bf-b22a-909ba7198a25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:21.936073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfae64-e440-49bf-b22a-909ba7198a25 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:21.936538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfae64-e440-49bf-b22a-909ba7198a25 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:21.936669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfae64-e440-49bf-b22a-909ba7198a25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:21.946541 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1236/2475] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:21:21 2022] PUT /identity/v3/projects/794ae6913d5546dbadfb32cb27b15d3c/users/26be0fc413e94efa9d98b869a834e69f/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:21.947859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636ba54-c2db-4eee-8a7f-ee7afe9dd67a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:21.948151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636ba54-c2db-4eee-8a7f-ee7afe9dd67a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:21.948430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636ba54-c2db-4eee-8a7f-ee7afe9dd67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:21.962386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfae64-e440-49bf-b22a-909ba7198a25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:21.963550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfae64-e440-49bf-b22a-909ba7198a25 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:21.986918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d636ba54-c2db-4eee-8a7f-ee7afe9dd67a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:21.987890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d636ba54-c2db-4eee-8a7f-ee7afe9dd67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:21.993225 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1240/2476] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:21.994601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf6b57-80cf-42f9-83c0-293c8bfe63dc None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:21.994893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf6b57-80cf-42f9-83c0-293c8bfe63dc None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:21.997889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf6b57-80cf-42f9-83c0-293c8bfe63dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:22.027308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e6cf6b57-80cf-42f9-83c0-293c8bfe63dc None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:22.028549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e6cf6b57-80cf-42f9-83c0-293c8bfe63dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:22.074903 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1237/2477] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:22.095362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636ba54-c2db-4eee-8a7f-ee7afe9dd67a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:22.099023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d636ba54-c2db-4eee-8a7f-ee7afe9dd67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:22.163454 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1241/2478] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:22.179676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf6b57-80cf-42f9-83c0-293c8bfe63dc None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:22.181818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e6cf6b57-80cf-42f9-83c0-293c8bfe63dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:22.204538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636ba54-c2db-4eee-8a7f-ee7afe9dd67a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:22.212134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bcf2c-1e55-4ea3-83fc-fba825535d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:22.216200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bcf2c-1e55-4ea3-83fc-fba825535d2c service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:22.216200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bcf2c-1e55-4ea3-83fc-fba825535d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:22.216200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bcf2c-1e55-4ea3-83fc-fba825535d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:22.225261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bcf2c-1e55-4ea3-83fc-fba825535d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:22.226792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bcf2c-1e55-4ea3-83fc-fba825535d2c service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:22.237056 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1238/2479] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:22.244068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf6b57-80cf-42f9-83c0-293c8bfe63dc None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:22.248087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1435fb1-d4d4-4dec-8ea5-5ed46b9f19a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:22.248758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1435fb1-d4d4-4dec-8ea5-5ed46b9f19a2 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:22.249044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1435fb1-d4d4-4dec-8ea5-5ed46b9f19a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:22.249323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1435fb1-d4d4-4dec-8ea5-5ed46b9f19a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:22.260360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1435fb1-d4d4-4dec-8ea5-5ed46b9f19a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:22.262383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1435fb1-d4d4-4dec-8ea5-5ed46b9f19a2 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:22.274489 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1242/2480] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:22.404507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e651a86-750f-4d8f-8caf-788ff62c4d35 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:22.404999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e651a86-750f-4d8f-8caf-788ff62c4d35 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:22.405255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e651a86-750f-4d8f-8caf-788ff62c4d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:22.446191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3e651a86-750f-4d8f-8caf-788ff62c4d35 None None] MFA Rules not processed for user `d08e62ebc2e14a1a800ee35406c6625b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:22.448867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3e651a86-750f-4d8f-8caf-788ff62c4d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:22.642860 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1239/2481] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:22.651459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1435fb1-d4d4-4dec-8ea5-5ed46b9f19a2 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:22.654276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a1435fb1-d4d4-4dec-8ea5-5ed46b9f19a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:22.768515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1435fb1-d4d4-4dec-8ea5-5ed46b9f19a2 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:22.775334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ba67f-e78f-4e90-a0ef-e39eb3d47c12 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:22.776184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ba67f-e78f-4e90-a0ef-e39eb3d47c12 service glance] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:22.776591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ba67f-e78f-4e90-a0ef-e39eb3d47c12 service glance] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:22.777002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ba67f-e78f-4e90-a0ef-e39eb3d47c12 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:22.787605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ba67f-e78f-4e90-a0ef-e39eb3d47c12 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:22.789449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ba67f-e78f-4e90-a0ef-e39eb3d47c12 service glance] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:22.821600 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1243/2482] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:23.828744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e651a86-750f-4d8f-8caf-788ff62c4d35 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:23.830382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3e651a86-750f-4d8f-8caf-788ff62c4d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:23.859554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e651a86-750f-4d8f-8caf-788ff62c4d35 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:23.872675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc98650-7912-4cce-85c1-f565249bd2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:23.873915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc98650-7912-4cce-85c1-f565249bd2c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:23.874396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc98650-7912-4cce-85c1-f565249bd2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:23.875185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc98650-7912-4cce-85c1-f565249bd2c7 admin admin] PATH_INFO: `/v3/projects/c7452c6772324b18b3760ad2d641bb3f` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:23.876593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc98650-7912-4cce-85c1-f565249bd2c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7452c6772324b18b3760ad2d641bb3f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:23.880251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc98650-7912-4cce-85c1-f565249bd2c7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:24.105335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6cc98650-7912-4cce-85c1-f565249bd2c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7452c6772324b18b3760ad2d641bb3f', 'request_id': 'req-6cc98650-7912-4cce-85c1-f565249bd2c7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:24.202750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6cc98650-7912-4cce-85c1-f565249bd2c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7452c6772324b18b3760ad2d641bb3f', 'request_id': 'req-6cc98650-7912-4cce-85c1-f565249bd2c7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:24.221328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6cc98650-7912-4cce-85c1-f565249bd2c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7452c6772324b18b3760ad2d641bb3f', 'request_id': 'req-6cc98650-7912-4cce-85c1-f565249bd2c7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:24.250170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6cc98650-7912-4cce-85c1-f565249bd2c7 admin admin] The token cache is being invalidate because project c7452c6772324b18b3760ad2d641bb3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:21:24.250463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6cc98650-7912-4cce-85c1-f565249bd2c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:24.261729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6cc98650-7912-4cce-85c1-f565249bd2c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:24.263844 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1240/2483] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:21:23 2022] DELETE /identity/v3/projects/c7452c6772324b18b3760ad2d641bb3f => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:24.267784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ba67f-e78f-4e90-a0ef-e39eb3d47c12 service glance] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:24.293595 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ba67f-e78f-4e90-a0ef-e39eb3d47c12 service glance] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:24.416942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356dccd2-f8e2-4237-83f1-176d43b1dd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:24.418126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dccd2-f8e2-4237-83f1-176d43b1dd14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:24.418655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dccd2-f8e2-4237-83f1-176d43b1dd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:24.419234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dccd2-f8e2-4237-83f1-176d43b1dd14 admin admin] PATH_INFO: `/v3/users/7492b6cfdacf4806a92b4d6b8ce006cb` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:24.421104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356dccd2-f8e2-4237-83f1-176d43b1dd14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7492b6cfdacf4806a92b4d6b8ce006cb)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:24.428220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356dccd2-f8e2-4237-83f1-176d43b1dd14 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:24.669583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-356dccd2-f8e2-4237-83f1-176d43b1dd14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7492b6cfdacf4806a92b4d6b8ce006cb'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:24.700548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-356dccd2-f8e2-4237-83f1-176d43b1dd14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7492b6cfdacf4806a92b4d6b8ce006cb'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:24.701734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-356dccd2-f8e2-4237-83f1-176d43b1dd14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7492b6cfdacf4806a92b4d6b8ce006cb'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:24.717277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-356dccd2-f8e2-4237-83f1-176d43b1dd14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7492b6cfdacf4806a92b4d6b8ce006cb'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:24.778630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-356dccd2-f8e2-4237-83f1-176d43b1dd14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7492b6cfdacf4806a92b4d6b8ce006cb'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:24.786892 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1244/2484] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:21:24 2022] DELETE /identity/v3/users/7492b6cfdacf4806a92b4d6b8ce006cb => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:26.818957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc98650-7912-4cce-85c1-f565249bd2c7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:26.820648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6cc98650-7912-4cce-85c1-f565249bd2c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:26.867776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc98650-7912-4cce-85c1-f565249bd2c7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:27.157291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd5c71-1df7-4874-b8f3-c31e99fc854d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:27.158197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd5c71-1df7-4874-b8f3-c31e99fc854d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:27.158485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd5c71-1df7-4874-b8f3-c31e99fc854d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:27.158764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd5c71-1df7-4874-b8f3-c31e99fc854d admin admin] PATH_INFO: `/v3/projects/1dce9d8459484d27822f2a3700044027` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:27.163852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd5c71-1df7-4874-b8f3-c31e99fc854d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dce9d8459484d27822f2a3700044027)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:27.173885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd5c71-1df7-4874-b8f3-c31e99fc854d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:27.368097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-05dd5c71-1df7-4874-b8f3-c31e99fc854d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dce9d8459484d27822f2a3700044027', 'request_id': 'req-05dd5c71-1df7-4874-b8f3-c31e99fc854d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:27.470083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-05dd5c71-1df7-4874-b8f3-c31e99fc854d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dce9d8459484d27822f2a3700044027', 'request_id': 'req-05dd5c71-1df7-4874-b8f3-c31e99fc854d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:27.477878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-05dd5c71-1df7-4874-b8f3-c31e99fc854d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dce9d8459484d27822f2a3700044027', 'request_id': 'req-05dd5c71-1df7-4874-b8f3-c31e99fc854d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:27.501164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-05dd5c71-1df7-4874-b8f3-c31e99fc854d admin admin] The token cache is being invalidate because project 1dce9d8459484d27822f2a3700044027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:21:27.502026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-05dd5c71-1df7-4874-b8f3-c31e99fc854d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:27.504512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-05dd5c71-1df7-4874-b8f3-c31e99fc854d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:27.515072 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1241/2485] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:21:26 2022] DELETE /identity/v3/projects/1dce9d8459484d27822f2a3700044027 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:27.516846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13df60-7774-499c-94d7-3170dc1b3c90 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:27.517556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13df60-7774-499c-94d7-3170dc1b3c90 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:27.517556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13df60-7774-499c-94d7-3170dc1b3c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:27.567322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ff13df60-7774-499c-94d7-3170dc1b3c90 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:27.574114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ff13df60-7774-499c-94d7-3170dc1b3c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:27.786703 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1245/2486] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:21:27.800125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5578be-2158-4de4-a0eb-4f8046e032f8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:27.800475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5578be-2158-4de4-a0eb-4f8046e032f8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:27.800787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5578be-2158-4de4-a0eb-4f8046e032f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:27.841061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-7b5578be-2158-4de4-a0eb-4f8046e032f8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:27.851284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7b5578be-2158-4de4-a0eb-4f8046e032f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:27.881583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13df60-7774-499c-94d7-3170dc1b3c90 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:27.887043 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1242/2487] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:27.897421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13df60-7774-499c-94d7-3170dc1b3c90 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:27.906776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd9214-b498-49c7-a7de-0532a5ea1d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:27.907698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd9214-b498-49c7-a7de-0532a5ea1d67 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:27.908131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd9214-b498-49c7-a7de-0532a5ea1d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:27.908588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd9214-b498-49c7-a7de-0532a5ea1d67 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:27.909587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd9214-b498-49c7-a7de-0532a5ea1d67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:21:27.910037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd9214-b498-49c7-a7de-0532a5ea1d67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:27.912345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd9214-b498-49c7-a7de-0532a5ea1d67 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:27.933079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5578be-2158-4de4-a0eb-4f8046e032f8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:27.943098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5578be-2158-4de4-a0eb-4f8046e032f8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:27.943366 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1246/2488] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:21:27.953300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a7bdd-ab6e-48fa-8768-a3b82707767a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:27.954160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a7bdd-ab6e-48fa-8768-a3b82707767a admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:27.954594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a7bdd-ab6e-48fa-8768-a3b82707767a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:27.956162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a7bdd-ab6e-48fa-8768-a3b82707767a admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:27.956162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a7bdd-ab6e-48fa-8768-a3b82707767a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:27.958404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a7bdd-ab6e-48fa-8768-a3b82707767a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:28.115665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd9214-b498-49c7-a7de-0532a5ea1d67 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:28.120966 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1243/2489] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:21:27 2022] POST /identity/v3/projects => generated 371 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:28.131937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd9214-b498-49c7-a7de-0532a5ea1d67 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:28.281391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca687ae-7ec8-4980-891c-a1330372eee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:28.282120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca687ae-7ec8-4980-891c-a1330372eee4 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:28.282356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca687ae-7ec8-4980-891c-a1330372eee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:28.282639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca687ae-7ec8-4980-891c-a1330372eee4 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:28.283341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca687ae-7ec8-4980-891c-a1330372eee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:28.285325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca687ae-7ec8-4980-891c-a1330372eee4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:28.401499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a7bdd-ab6e-48fa-8768-a3b82707767a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:28.409730 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1247/2490] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:21:28 2022] POST /identity/v3/users => generated 286 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:28.414107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a7bdd-ab6e-48fa-8768-a3b82707767a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:28.452477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec206270-44c5-4dba-a365-b6bca9c4424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:28.453675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec206270-44c5-4dba-a365-b6bca9c4424e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:28.453977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec206270-44c5-4dba-a365-b6bca9c4424e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:28.454264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec206270-44c5-4dba-a365-b6bca9c4424e admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:28.455007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec206270-44c5-4dba-a365-b6bca9c4424e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:28.464721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec206270-44c5-4dba-a365-b6bca9c4424e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:28.536168 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1244/2491] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:21:28.536466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca687ae-7ec8-4980-891c-a1330372eee4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:28.558700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca687ae-7ec8-4980-891c-a1330372eee4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:28.600038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930bc6f-6131-4e7c-9974-260ecff13e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:28.600952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930bc6f-6131-4e7c-9974-260ecff13e62 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:28.602231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930bc6f-6131-4e7c-9974-260ecff13e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:28.603361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930bc6f-6131-4e7c-9974-260ecff13e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:28.608925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930bc6f-6131-4e7c-9974-260ecff13e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:28.611063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930bc6f-6131-4e7c-9974-260ecff13e62 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:28.654930 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1248/2492] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:28.655476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec206270-44c5-4dba-a365-b6bca9c4424e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:28.673565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec206270-44c5-4dba-a365-b6bca9c4424e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:28.694053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6360d-16b4-4126-bb0c-7b182ff2bf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:28.696782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6360d-16b4-4126-bb0c-7b182ff2bf6d admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:28.707262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6360d-16b4-4126-bb0c-7b182ff2bf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:28.708161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6360d-16b4-4126-bb0c-7b182ff2bf6d admin admin] PATH_INFO: `/v3/projects/1b2130a8035040089eef66d1efbf65df/users/1ea3eddf81624b41a4410ea85e17eabe/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:28.750511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555ad39-7ee9-4290-86a3-dd51639b07c9 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:28.751049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555ad39-7ee9-4290-86a3-dd51639b07c9 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:28.751509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555ad39-7ee9-4290-86a3-dd51639b07c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:28.787550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6360d-16b4-4126-bb0c-7b182ff2bf6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b2130a8035040089eef66d1efbf65df, user_id=1ea3eddf81624b41a4410ea85e17eabe, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:28.794760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6360d-16b4-4126-bb0c-7b182ff2bf6d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:28.868936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e555ad39-7ee9-4290-86a3-dd51639b07c9 None None] MFA Rules not processed for user `b98645267a5945c7a4ed7d57ec80a6a4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:28.877851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e555ad39-7ee9-4290-86a3-dd51639b07c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:28.909478 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1245/2493] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:21:28 2022] PUT /identity/v3/projects/1b2130a8035040089eef66d1efbf65df/users/1ea3eddf81624b41a4410ea85e17eabe/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:28.914821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaef392-b7a4-41c3-a542-dcb2c7f2ecd1 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:28.915517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaef392-b7a4-41c3-a542-dcb2c7f2ecd1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:28.917736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaef392-b7a4-41c3-a542-dcb2c7f2ecd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:28.990294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-caaef392-b7a4-41c3-a542-dcb2c7f2ecd1 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:28.991745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-caaef392-b7a4-41c3-a542-dcb2c7f2ecd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:29.032538 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1249/2494] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:28 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:29.044448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555ad39-7ee9-4290-86a3-dd51639b07c9 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:29.046235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e555ad39-7ee9-4290-86a3-dd51639b07c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:29.069296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555ad39-7ee9-4290-86a3-dd51639b07c9 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:29.128445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da83986-75a4-478b-8d6a-64421638ce5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:29.129245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da83986-75a4-478b-8d6a-64421638ce5e admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:29.129436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da83986-75a4-478b-8d6a-64421638ce5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:29.129849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da83986-75a4-478b-8d6a-64421638ce5e admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:29.131114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da83986-75a4-478b-8d6a-64421638ce5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:29.133100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da83986-75a4-478b-8d6a-64421638ce5e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:29.198600 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1246/2495] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:29.206749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaef392-b7a4-41c3-a542-dcb2c7f2ecd1 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:29.208415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-caaef392-b7a4-41c3-a542-dcb2c7f2ecd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:29.233545 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1250/2496] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:21:29 2022] POST /identity/v3/projects => generated 401 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:29.237623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da83986-75a4-478b-8d6a-64421638ce5e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:29.335972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaef392-b7a4-41c3-a542-dcb2c7f2ecd1 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:29.371283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da83986-75a4-478b-8d6a-64421638ce5e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:29.390190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa8423-2926-4f53-a149-ac5936e1ad68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:29.394093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa8423-2926-4f53-a149-ac5936e1ad68 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:29.394093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa8423-2926-4f53-a149-ac5936e1ad68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:29.394093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa8423-2926-4f53-a149-ac5936e1ad68 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:29.394093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa8423-2926-4f53-a149-ac5936e1ad68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:29.394093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa8423-2926-4f53-a149-ac5936e1ad68 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:29.458748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9e089-16fb-42c1-ac21-e696894cccc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:29.459692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9e089-16fb-42c1-ac21-e696894cccc9 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:29.460042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9e089-16fb-42c1-ac21-e696894cccc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:29.460386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9e089-16fb-42c1-ac21-e696894cccc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:29.482055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9e089-16fb-42c1-ac21-e696894cccc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:29.486593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9e089-16fb-42c1-ac21-e696894cccc9 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:29.511702 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1247/2497] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:29.525532 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1251/2498] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:21:29 2022] POST /identity/v3/users => generated 307 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:21:29.531126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9e089-16fb-42c1-ac21-e696894cccc9 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:29.547546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9e089-16fb-42c1-ac21-e696894cccc9 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:29.562722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7ea8e-c4dd-4814-a05b-e99b0ddca64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:29.563693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7ea8e-c4dd-4814-a05b-e99b0ddca64d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:29.564096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7ea8e-c4dd-4814-a05b-e99b0ddca64d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:29.565187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7ea8e-c4dd-4814-a05b-e99b0ddca64d admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:29.566187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7ea8e-c4dd-4814-a05b-e99b0ddca64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:29.570757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b7ea8e-c4dd-4814-a05b-e99b0ddca64d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:29.601439 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1248/2499] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:29.602189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa8423-2926-4f53-a149-ac5936e1ad68 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:29.612479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa8423-2926-4f53-a149-ac5936e1ad68 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:29.633753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2945f47-8a1d-40a1-a30e-7341fa9ca0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:29.634688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2945f47-8a1d-40a1-a30e-7341fa9ca0d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:29.634978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2945f47-8a1d-40a1-a30e-7341fa9ca0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:29.635264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2945f47-8a1d-40a1-a30e-7341fa9ca0d3 admin admin] PATH_INFO: `/v3/projects/c573179de3d64f9fb673b60f6826b033/users/93506ad436954e0f8d9247d09ff756aa/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:29.675475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2945f47-8a1d-40a1-a30e-7341fa9ca0d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c573179de3d64f9fb673b60f6826b033, user_id=93506ad436954e0f8d9247d09ff756aa, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:29.680768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2945f47-8a1d-40a1-a30e-7341fa9ca0d3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:29.781911 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1252/2500] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:21:29 2022] PUT /identity/v3/projects/c573179de3d64f9fb673b60f6826b033/users/93506ad436954e0f8d9247d09ff756aa/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:21:29.785924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7ea8e-c4dd-4814-a05b-e99b0ddca64d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:29.801315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7ea8e-c4dd-4814-a05b-e99b0ddca64d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:29.989433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ecfe2-34a5-4c0b-884a-34903f089750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:29.990139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ecfe2-34a5-4c0b-884a-34903f089750 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:29.990473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ecfe2-34a5-4c0b-884a-34903f089750 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:29.990808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ecfe2-34a5-4c0b-884a-34903f089750 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:29.991559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ecfe2-34a5-4c0b-884a-34903f089750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:29.993205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ecfe2-34a5-4c0b-884a-34903f089750 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:30.019874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2945f47-8a1d-40a1-a30e-7341fa9ca0d3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:30.022335 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1249/2501] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:30.041311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2945f47-8a1d-40a1-a30e-7341fa9ca0d3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:30.051196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de25f61-fa30-47b7-b5b2-74d54e910363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:30.052157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de25f61-fa30-47b7-b5b2-74d54e910363 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:30.055685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de25f61-fa30-47b7-b5b2-74d54e910363 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:30.055685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de25f61-fa30-47b7-b5b2-74d54e910363 admin admin] PATH_INFO: `/v3/projects/c573179de3d64f9fb673b60f6826b033/users/93506ad436954e0f8d9247d09ff756aa/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:30.055685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de25f61-fa30-47b7-b5b2-74d54e910363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c573179de3d64f9fb673b60f6826b033, user_id=93506ad436954e0f8d9247d09ff756aa, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:30.057977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de25f61-fa30-47b7-b5b2-74d54e910363 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:30.088815 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1253/2502] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:21:30 2022] PUT /identity/v3/projects/c573179de3d64f9fb673b60f6826b033/users/93506ad436954e0f8d9247d09ff756aa/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:33.013017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a18f0-bc63-4a48-ba64-3323b033806f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:33.014465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a18f0-bc63-4a48-ba64-3323b033806f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:33.014961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a18f0-bc63-4a48-ba64-3323b033806f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:33.111665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c67a18f0-bc63-4a48-ba64-3323b033806f None None] MFA Rules not processed for user `1ea3eddf81624b41a4410ea85e17eabe`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:33.122574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c67a18f0-bc63-4a48-ba64-3323b033806f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:33.294567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de25f61-fa30-47b7-b5b2-74d54e910363 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:33.295088 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1250/2503] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:33.463035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de25f61-fa30-47b7-b5b2-74d54e910363 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:33.480414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfedd7-b1ff-4c07-a1f5-acf9369767bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:33.481563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfedd7-b1ff-4c07-a1f5-acf9369767bc admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:33.482209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfedd7-b1ff-4c07-a1f5-acf9369767bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:33.482762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfedd7-b1ff-4c07-a1f5-acf9369767bc admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:33.483698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfedd7-b1ff-4c07-a1f5-acf9369767bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:33.486081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfedd7-b1ff-4c07-a1f5-acf9369767bc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:33.608644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c987c66-b588-43ba-9e49-9273f39f4f82 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:33.609197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c987c66-b588-43ba-9e49-9273f39f4f82 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:33.609641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c987c66-b588-43ba-9e49-9273f39f4f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:33.637860 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1254/2504] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:21:33 2022] POST /identity/v3/projects => generated 369 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:33.639117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfedd7-b1ff-4c07-a1f5-acf9369767bc admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:33.697620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8c987c66-b588-43ba-9e49-9273f39f4f82 None None] MFA Rules not processed for user `93506ad436954e0f8d9247d09ff756aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:33.699863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8c987c66-b588-43ba-9e49-9273f39f4f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:33.919021 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1251/2505] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:33 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:33.931666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfedd7-b1ff-4c07-a1f5-acf9369767bc admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:33.960743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4b9c1-5eca-4a1d-a49e-e0df68015ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:33.961796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4b9c1-5eca-4a1d-a49e-e0df68015ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:33.962277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4b9c1-5eca-4a1d-a49e-e0df68015ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:33.966716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4b9c1-5eca-4a1d-a49e-e0df68015ea7 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:33.967672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4b9c1-5eca-4a1d-a49e-e0df68015ea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:33.970555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4b9c1-5eca-4a1d-a49e-e0df68015ea7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:34.071096 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1255/2506] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:21:33 2022] POST /identity/v3/users => generated 291 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:34.076239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c987c66-b588-43ba-9e49-9273f39f4f82 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:34.117377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c987c66-b588-43ba-9e49-9273f39f4f82 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:34.130293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f3a5b-a21d-4235-b218-26562eaf2eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:34.132869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f3a5b-a21d-4235-b218-26562eaf2eda admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:34.133167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f3a5b-a21d-4235-b218-26562eaf2eda admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:34.133445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f3a5b-a21d-4235-b218-26562eaf2eda admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:34.134198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f3a5b-a21d-4235-b218-26562eaf2eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:34.144451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f3a5b-a21d-4235-b218-26562eaf2eda admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:34.214712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4b9c1-5eca-4a1d-a49e-e0df68015ea7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:34.236960 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1252/2507] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:21:34.241743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4b9c1-5eca-4a1d-a49e-e0df68015ea7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:34.260913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20834ca9-2c99-4d30-b0cd-94b23105e04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:34.261793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20834ca9-2c99-4d30-b0cd-94b23105e04c admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:34.261916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20834ca9-2c99-4d30-b0cd-94b23105e04c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:34.262165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20834ca9-2c99-4d30-b0cd-94b23105e04c admin admin] PATH_INFO: `/v3/projects/11d4f336c09944c68796029ff93dcf1e/users/1da5ba60aea64ed0b8d9d23f19780c79/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:34.318613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20834ca9-2c99-4d30-b0cd-94b23105e04c admin admin] RBAC: Authorizing `identity:create_grant(project_id=11d4f336c09944c68796029ff93dcf1e, user_id=1da5ba60aea64ed0b8d9d23f19780c79, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:34.327056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20834ca9-2c99-4d30-b0cd-94b23105e04c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:34.418976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f3a5b-a21d-4235-b218-26562eaf2eda admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:34.427216 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1256/2508] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:21:34 2022] PUT /identity/v3/projects/11d4f336c09944c68796029ff93dcf1e/users/1da5ba60aea64ed0b8d9d23f19780c79/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:34.437841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f3a5b-a21d-4235-b218-26562eaf2eda admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:34.683467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfd49f-8c7e-4442-bf87-1ce3a9642266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:34.684455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfd49f-8c7e-4442-bf87-1ce3a9642266 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:34.684928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfd49f-8c7e-4442-bf87-1ce3a9642266 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:34.685444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfd49f-8c7e-4442-bf87-1ce3a9642266 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:34.686766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfd49f-8c7e-4442-bf87-1ce3a9642266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:34.689537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfd49f-8c7e-4442-bf87-1ce3a9642266 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:34.720247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20834ca9-2c99-4d30-b0cd-94b23105e04c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:34.721542 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1253/2509] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:34.735336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20834ca9-2c99-4d30-b0cd-94b23105e04c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:34.758418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1011f-5e69-4819-b30b-ae87d4fb1773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:34.761184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1011f-5e69-4819-b30b-ae87d4fb1773 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:34.763147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1011f-5e69-4819-b30b-ae87d4fb1773 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:34.763460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1011f-5e69-4819-b30b-ae87d4fb1773 admin admin] PATH_INFO: `/v3/projects/11d4f336c09944c68796029ff93dcf1e/users/1da5ba60aea64ed0b8d9d23f19780c79/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:34.772945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1011f-5e69-4819-b30b-ae87d4fb1773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11d4f336c09944c68796029ff93dcf1e, user_id=1da5ba60aea64ed0b8d9d23f19780c79, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:34.786725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1011f-5e69-4819-b30b-ae87d4fb1773 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:34.825073 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1257/2510] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:21:34 2022] PUT /identity/v3/projects/11d4f336c09944c68796029ff93dcf1e/users/1da5ba60aea64ed0b8d9d23f19780c79/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:36.642716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1077a-ade9-48b5-82da-a5b05aa63dcb None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:36.643826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1077a-ade9-48b5-82da-a5b05aa63dcb None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:36.644278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1077a-ade9-48b5-82da-a5b05aa63dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:36.741093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-93c1077a-ade9-48b5-82da-a5b05aa63dcb None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:36.742635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-93c1077a-ade9-48b5-82da-a5b05aa63dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:36.873125 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1254/2511] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:21:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:36.942885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1011f-5e69-4819-b30b-ae87d4fb1773 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:36.946056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a2b1011f-5e69-4819-b30b-ae87d4fb1773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:37.182730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1011f-5e69-4819-b30b-ae87d4fb1773 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:37.188788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf0100-33d2-47f0-908f-2926ee6f4d5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:37.189564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf0100-33d2-47f0-908f-2926ee6f4d5b service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:37.189691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf0100-33d2-47f0-908f-2926ee6f4d5b service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:37.189974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf0100-33d2-47f0-908f-2926ee6f4d5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:37.199549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf0100-33d2-47f0-908f-2926ee6f4d5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:37.201199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf0100-33d2-47f0-908f-2926ee6f4d5b service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:37.209743 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1258/2512] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:21:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:21:38.284552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee5e79-78e1-48ba-b9db-6683c6df7050 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:38.285406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee5e79-78e1-48ba-b9db-6683c6df7050 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:38.285833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee5e79-78e1-48ba-b9db-6683c6df7050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:38.337526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d4ee5e79-78e1-48ba-b9db-6683c6df7050 None None] MFA Rules not processed for user `26be0fc413e94efa9d98b869a834e69f`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:38.339061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d4ee5e79-78e1-48ba-b9db-6683c6df7050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:38.466683 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1255/2513] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:38.478706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf0100-33d2-47f0-908f-2926ee6f4d5b service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:38.481398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-69bf0100-33d2-47f0-908f-2926ee6f4d5b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:38.608814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f8202-dde5-4514-b7b9-7703e9531f6c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:38.609722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f8202-dde5-4514-b7b9-7703e9531f6c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:38.610015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f8202-dde5-4514-b7b9-7703e9531f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:38.653237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf0100-33d2-47f0-908f-2926ee6f4d5b service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:38.666290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d87f8202-dde5-4514-b7b9-7703e9531f6c None None] MFA Rules not processed for user `1da5ba60aea64ed0b8d9d23f19780c79`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:38.668552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d87f8202-dde5-4514-b7b9-7703e9531f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:38.671613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be507377-8343-43f9-929a-d8a260e16b8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:38.672288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be507377-8343-43f9-929a-d8a260e16b8b service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:38.672572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be507377-8343-43f9-929a-d8a260e16b8b service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:38.672871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be507377-8343-43f9-929a-d8a260e16b8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:38.689150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be507377-8343-43f9-929a-d8a260e16b8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:38.692869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be507377-8343-43f9-929a-d8a260e16b8b service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:38.726042 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1259/2514] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:38.847884 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1256/2515] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:38 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:38.860436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043caa4-06fd-4bfd-a23c-2ff019422a59 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:38.860970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043caa4-06fd-4bfd-a23c-2ff019422a59 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:38.861405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043caa4-06fd-4bfd-a23c-2ff019422a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:38.897398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6043caa4-06fd-4bfd-a23c-2ff019422a59 None None] MFA Rules not processed for user `1ea3eddf81624b41a4410ea85e17eabe`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:38.907549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6043caa4-06fd-4bfd-a23c-2ff019422a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:38.908651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f8202-dde5-4514-b7b9-7703e9531f6c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:39.043882 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1260/2516] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:39.044945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043caa4-06fd-4bfd-a23c-2ff019422a59 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:39.047206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6043caa4-06fd-4bfd-a23c-2ff019422a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:39.054294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f8202-dde5-4514-b7b9-7703e9531f6c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:39.068554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e863a-84d5-4fe0-8513-ef6eb0a19e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:39.069477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e863a-84d5-4fe0-8513-ef6eb0a19e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:39.069761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e863a-84d5-4fe0-8513-ef6eb0a19e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:39.070037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e863a-84d5-4fe0-8513-ef6eb0a19e51 admin admin] PATH_INFO: `/v3/users/b98645267a5945c7a4ed7d57ec80a6a4` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:39.071566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e863a-84d5-4fe0-8513-ef6eb0a19e51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b98645267a5945c7a4ed7d57ec80a6a4)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:39.074656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e863a-84d5-4fe0-8513-ef6eb0a19e51 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:39.081860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043caa4-06fd-4bfd-a23c-2ff019422a59 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:39.111875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260fd52-085e-4ddc-8176-38d00bda786b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:39.112555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260fd52-085e-4ddc-8176-38d00bda786b service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:39.112880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260fd52-085e-4ddc-8176-38d00bda786b service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:39.113162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260fd52-085e-4ddc-8176-38d00bda786b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:39.133558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260fd52-085e-4ddc-8176-38d00bda786b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:39.138494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260fd52-085e-4ddc-8176-38d00bda786b service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:39.158601 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1261/2517] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:39.340097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-314e863a-84d5-4fe0-8513-ef6eb0a19e51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b98645267a5945c7a4ed7d57ec80a6a4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:39.375181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-314e863a-84d5-4fe0-8513-ef6eb0a19e51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b98645267a5945c7a4ed7d57ec80a6a4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:39.376003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-314e863a-84d5-4fe0-8513-ef6eb0a19e51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b98645267a5945c7a4ed7d57ec80a6a4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:39.394968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-314e863a-84d5-4fe0-8513-ef6eb0a19e51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b98645267a5945c7a4ed7d57ec80a6a4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:39.485677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-314e863a-84d5-4fe0-8513-ef6eb0a19e51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b98645267a5945c7a4ed7d57ec80a6a4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:39.501198 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1257/2518] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:21:38 2022] DELETE /identity/v3/users/b98645267a5945c7a4ed7d57ec80a6a4 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:21:39.984918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260fd52-085e-4ddc-8176-38d00bda786b service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:40.006704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260fd52-085e-4ddc-8176-38d00bda786b service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:40.195579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550f10f-7076-457c-bdf2-7e5dcdf76ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:40.200641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550f10f-7076-457c-bdf2-7e5dcdf76ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:40.201723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550f10f-7076-457c-bdf2-7e5dcdf76ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:40.202851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550f10f-7076-457c-bdf2-7e5dcdf76ad4 admin admin] PATH_INFO: `/v3/projects/d46063a5dc8c41598cf95a80726c6082` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:40.217563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550f10f-7076-457c-bdf2-7e5dcdf76ad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d46063a5dc8c41598cf95a80726c6082)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:40.234693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550f10f-7076-457c-bdf2-7e5dcdf76ad4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:40.441755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9550f10f-7076-457c-bdf2-7e5dcdf76ad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd46063a5dc8c41598cf95a80726c6082', 'request_id': 'req-9550f10f-7076-457c-bdf2-7e5dcdf76ad4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:40.472774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9550f10f-7076-457c-bdf2-7e5dcdf76ad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd46063a5dc8c41598cf95a80726c6082', 'request_id': 'req-9550f10f-7076-457c-bdf2-7e5dcdf76ad4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:40.613247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9550f10f-7076-457c-bdf2-7e5dcdf76ad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd46063a5dc8c41598cf95a80726c6082', 'request_id': 'req-9550f10f-7076-457c-bdf2-7e5dcdf76ad4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:40.630229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9550f10f-7076-457c-bdf2-7e5dcdf76ad4 admin admin] The token cache is being invalidate because project d46063a5dc8c41598cf95a80726c6082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:21:40.630701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9550f10f-7076-457c-bdf2-7e5dcdf76ad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:40.631517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9550f10f-7076-457c-bdf2-7e5dcdf76ad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:40.637151 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1262/2519] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:21:39 2022] DELETE /identity/v3/projects/d46063a5dc8c41598cf95a80726c6082 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:40.638585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e863a-84d5-4fe0-8513-ef6eb0a19e51 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:40.640392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-314e863a-84d5-4fe0-8513-ef6eb0a19e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:40.689792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e863a-84d5-4fe0-8513-ef6eb0a19e51 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:40.861074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ca6c1-4b63-4477-bb4d-5f6d31775d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:40.866109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ca6c1-4b63-4477-bb4d-5f6d31775d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:40.866109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ca6c1-4b63-4477-bb4d-5f6d31775d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:40.866109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ca6c1-4b63-4477-bb4d-5f6d31775d62 admin admin] PATH_INFO: `/v3/users/93506ad436954e0f8d9247d09ff756aa` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:40.867352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ca6c1-4b63-4477-bb4d-5f6d31775d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93506ad436954e0f8d9247d09ff756aa)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:40.870436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ca6c1-4b63-4477-bb4d-5f6d31775d62 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:41.167850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-138ca6c1-4b63-4477-bb4d-5f6d31775d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93506ad436954e0f8d9247d09ff756aa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:41.192067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-138ca6c1-4b63-4477-bb4d-5f6d31775d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93506ad436954e0f8d9247d09ff756aa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:41.193311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-138ca6c1-4b63-4477-bb4d-5f6d31775d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93506ad436954e0f8d9247d09ff756aa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:41.263468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-138ca6c1-4b63-4477-bb4d-5f6d31775d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93506ad436954e0f8d9247d09ff756aa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:41.345211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-138ca6c1-4b63-4477-bb4d-5f6d31775d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93506ad436954e0f8d9247d09ff756aa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:41.357214 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1258/2520] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:21:40 2022] DELETE /identity/v3/users/93506ad436954e0f8d9247d09ff756aa => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:21:41.539076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550f10f-7076-457c-bdf2-7e5dcdf76ad4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:41.541102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9550f10f-7076-457c-bdf2-7e5dcdf76ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:41.767844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ca6c1-4b63-4477-bb4d-5f6d31775d62 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:41.771888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-138ca6c1-4b63-4477-bb4d-5f6d31775d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:41.854665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550f10f-7076-457c-bdf2-7e5dcdf76ad4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:42.016640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ca6c1-4b63-4477-bb4d-5f6d31775d62 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:42.052169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae0519-38ae-437f-be0c-017992c1729a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:42.053908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae0519-38ae-437f-be0c-017992c1729a service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:42.054200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae0519-38ae-437f-be0c-017992c1729a service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:42.055351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae0519-38ae-437f-be0c-017992c1729a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:42.061698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-42ae0519-38ae-437f-be0c-017992c1729a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:42.093813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f2470-8c61-46d8-bb43-24055f9d860c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:42.096305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f2470-8c61-46d8-bb43-24055f9d860c service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:42.096305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f2470-8c61-46d8-bb43-24055f9d860c service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:42.097479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f2470-8c61-46d8-bb43-24055f9d860c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:42.104434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-215f2470-8c61-46d8-bb43-24055f9d860c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:42.273567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae0519-38ae-437f-be0c-017992c1729a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:42.278048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae0519-38ae-437f-be0c-017992c1729a service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:42.305763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f2470-8c61-46d8-bb43-24055f9d860c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:42.310440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f2470-8c61-46d8-bb43-24055f9d860c service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:42.320444 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1259/2521] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:42.321615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae0519-38ae-437f-be0c-017992c1729a service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:42.328901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-42ae0519-38ae-437f-be0c-017992c1729a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:42.356104 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1263/2522] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 817 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:42.517293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae0519-38ae-437f-be0c-017992c1729a service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:42.527285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c4c56-9166-40fa-aa57-954b2910cb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:42.528189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c4c56-9166-40fa-aa57-954b2910cb5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:42.528473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c4c56-9166-40fa-aa57-954b2910cb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:42.528782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c4c56-9166-40fa-aa57-954b2910cb5e admin admin] PATH_INFO: `/v3/projects/c573179de3d64f9fb673b60f6826b033` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:42.530746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c4c56-9166-40fa-aa57-954b2910cb5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c573179de3d64f9fb673b60f6826b033)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:42.537137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c4c56-9166-40fa-aa57-954b2910cb5e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:42.770494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c33c4c56-9166-40fa-aa57-954b2910cb5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c573179de3d64f9fb673b60f6826b033', 'request_id': 'req-c33c4c56-9166-40fa-aa57-954b2910cb5e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:42.881146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c33c4c56-9166-40fa-aa57-954b2910cb5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c573179de3d64f9fb673b60f6826b033', 'request_id': 'req-c33c4c56-9166-40fa-aa57-954b2910cb5e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:42.891748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c33c4c56-9166-40fa-aa57-954b2910cb5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c573179de3d64f9fb673b60f6826b033', 'request_id': 'req-c33c4c56-9166-40fa-aa57-954b2910cb5e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:42.916317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c33c4c56-9166-40fa-aa57-954b2910cb5e admin admin] The token cache is being invalidate because project c573179de3d64f9fb673b60f6826b033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:21:42.919688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c33c4c56-9166-40fa-aa57-954b2910cb5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:42.920734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c33c4c56-9166-40fa-aa57-954b2910cb5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:21:42.924898 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1260/2523] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:21:42 2022] DELETE /identity/v3/projects/c573179de3d64f9fb673b60f6826b033 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:21:42.932462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dbf14-1b13-4354-8889-7d660029580d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:42.933013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dbf14-1b13-4354-8889-7d660029580d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:42.933125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dbf14-1b13-4354-8889-7d660029580d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:42.956429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d43dbf14-1b13-4354-8889-7d660029580d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:42.958050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d43dbf14-1b13-4354-8889-7d660029580d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:42.970168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68cc75-0894-4cda-83e2-a8c9ea6b80bf None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:42.970496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68cc75-0894-4cda-83e2-a8c9ea6b80bf None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:42.970871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68cc75-0894-4cda-83e2-a8c9ea6b80bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:43.005001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1e68cc75-0894-4cda-83e2-a8c9ea6b80bf None None] MFA Rules not processed for user `cb3183cbca2346dd887162951f451fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:43.011500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1e68cc75-0894-4cda-83e2-a8c9ea6b80bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:43.108622 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1264/2524] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:43.111021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acf8c2-9dd1-4916-b6b5-387c6f9e10e4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:43.111526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acf8c2-9dd1-4916-b6b5-387c6f9e10e4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:43.111949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acf8c2-9dd1-4916-b6b5-387c6f9e10e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:43.151814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-59acf8c2-9dd1-4916-b6b5-387c6f9e10e4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:43.153469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-59acf8c2-9dd1-4916-b6b5-387c6f9e10e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:43.178937 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1265/2525] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:43.180188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acf8c2-9dd1-4916-b6b5-387c6f9e10e4 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:43.211032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acf8c2-9dd1-4916-b6b5-387c6f9e10e4 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:43.213025 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1261/2526] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:21:43.226269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb509b-fe98-4309-a55b-3b586c6e73bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:43.227141 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb509b-fe98-4309-a55b-3b586c6e73bc admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:43.227526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb509b-fe98-4309-a55b-3b586c6e73bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:43.227948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb509b-fe98-4309-a55b-3b586c6e73bc admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:43.228878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb509b-fe98-4309-a55b-3b586c6e73bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:21:43.229294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb509b-fe98-4309-a55b-3b586c6e73bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:43.231544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb509b-fe98-4309-a55b-3b586c6e73bc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:43.271839 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1266/2527] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:21:43.275509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68cc75-0894-4cda-83e2-a8c9ea6b80bf None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:43.294928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68cc75-0894-4cda-83e2-a8c9ea6b80bf None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:43.335318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fc230-0d9f-4a0a-8f08-ac55d9d122ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:43.336112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fc230-0d9f-4a0a-8f08-ac55d9d122ea admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:43.337588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fc230-0d9f-4a0a-8f08-ac55d9d122ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:43.340304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fc230-0d9f-4a0a-8f08-ac55d9d122ea admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:43.340304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fc230-0d9f-4a0a-8f08-ac55d9d122ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:43.355348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fc230-0d9f-4a0a-8f08-ac55d9d122ea admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:43.771078 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1262/2528] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:21:43 2022] POST /identity/v3/projects => generated 381 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:43.772807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb509b-fe98-4309-a55b-3b586c6e73bc admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:43.805663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb509b-fe98-4309-a55b-3b586c6e73bc admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:43.986270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486fd06-edbf-49a3-8335-ec6a9a999dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:43.986969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486fd06-edbf-49a3-8335-ec6a9a999dde admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:43.987256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486fd06-edbf-49a3-8335-ec6a9a999dde admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:43.987536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486fd06-edbf-49a3-8335-ec6a9a999dde admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:43.988242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486fd06-edbf-49a3-8335-ec6a9a999dde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:43.990812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486fd06-edbf-49a3-8335-ec6a9a999dde admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:44.099842 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1267/2529] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:21:43 2022] POST /identity/v3/users => generated 291 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:21:44.101596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fc230-0d9f-4a0a-8f08-ac55d9d122ea admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:44.120315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fc230-0d9f-4a0a-8f08-ac55d9d122ea admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:44.132279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45111ee7-4755-4a1a-b683-2955b295fcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:44.135645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45111ee7-4755-4a1a-b683-2955b295fcad admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:44.136834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45111ee7-4755-4a1a-b683-2955b295fcad admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:44.137964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45111ee7-4755-4a1a-b683-2955b295fcad admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:44.146260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45111ee7-4755-4a1a-b683-2955b295fcad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:44.182161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45111ee7-4755-4a1a-b683-2955b295fcad admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:44.194726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf253819-040f-464b-9521-eb4d39cd16c1 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:44.195011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf253819-040f-464b-9521-eb4d39cd16c1 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:44.195293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf253819-040f-464b-9521-eb4d39cd16c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:44.232189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-cf253819-040f-464b-9521-eb4d39cd16c1 None None] MFA Rules not processed for user `26be0fc413e94efa9d98b869a834e69f`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:44.235298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cf253819-040f-464b-9521-eb4d39cd16c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:44.250034 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1263/2530] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:44.252530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45111ee7-4755-4a1a-b683-2955b295fcad admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:44.289135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45111ee7-4755-4a1a-b683-2955b295fcad admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:44.313293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb56d49-ede8-43cf-8dba-8cb88c5ee359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:44.314837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb56d49-ede8-43cf-8dba-8cb88c5ee359 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:44.315271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb56d49-ede8-43cf-8dba-8cb88c5ee359 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:44.315692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb56d49-ede8-43cf-8dba-8cb88c5ee359 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:44.316744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb56d49-ede8-43cf-8dba-8cb88c5ee359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:44.320594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb56d49-ede8-43cf-8dba-8cb88c5ee359 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:44.332498 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1264/2531] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:21:44.336467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb56d49-ede8-43cf-8dba-8cb88c5ee359 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:44.346562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb56d49-ede8-43cf-8dba-8cb88c5ee359 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:44.353078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba38a77-8377-4f93-b7ae-b8bf3dc81dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:44.359803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba38a77-8377-4f93-b7ae-b8bf3dc81dba admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:44.360303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba38a77-8377-4f93-b7ae-b8bf3dc81dba admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:44.360770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba38a77-8377-4f93-b7ae-b8bf3dc81dba admin admin] PATH_INFO: `/v3/projects/9403ec149eb24254b818f66c96b95ba2/users/5f60baebf1b5472db677cffc8ca8b0c3/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:44.369237 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1268/2532] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:21:44.408403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba38a77-8377-4f93-b7ae-b8bf3dc81dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=9403ec149eb24254b818f66c96b95ba2, user_id=5f60baebf1b5472db677cffc8ca8b0c3, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:44.412332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba38a77-8377-4f93-b7ae-b8bf3dc81dba admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:44.518517 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1265/2533] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:21:44 2022] PUT /identity/v3/projects/9403ec149eb24254b818f66c96b95ba2/users/5f60baebf1b5472db677cffc8ca8b0c3/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:21:44.529323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24489c9f-95a3-40cf-b94f-c80c8354c1dd None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:44.529611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24489c9f-95a3-40cf-b94f-c80c8354c1dd None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:44.529892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24489c9f-95a3-40cf-b94f-c80c8354c1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:44.582503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-24489c9f-95a3-40cf-b94f-c80c8354c1dd None None] MFA Rules not processed for user `5f60baebf1b5472db677cffc8ca8b0c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:44.583952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-24489c9f-95a3-40cf-b94f-c80c8354c1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:44.709552 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1269/2534] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:44.721635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309500e4-ddc3-427f-9fec-48f7e03500b6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:44.721932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309500e4-ddc3-427f-9fec-48f7e03500b6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:44.722207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309500e4-ddc3-427f-9fec-48f7e03500b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:44.762874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-309500e4-ddc3-427f-9fec-48f7e03500b6 None None] MFA Rules not processed for user `5f60baebf1b5472db677cffc8ca8b0c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:44.768297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-309500e4-ddc3-427f-9fec-48f7e03500b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:44.792733 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1266/2535] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:21:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:21:44.807994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24489c9f-95a3-40cf-b94f-c80c8354c1dd None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:44.809934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-24489c9f-95a3-40cf-b94f-c80c8354c1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:45.000125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24489c9f-95a3-40cf-b94f-c80c8354c1dd None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:45.021814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5592de7-e9bc-4d31-b3ca-545f84eb0422 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:45.022522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5592de7-e9bc-4d31-b3ca-545f84eb0422 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:45.022888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5592de7-e9bc-4d31-b3ca-545f84eb0422 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:45.023365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5592de7-e9bc-4d31-b3ca-545f84eb0422 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:45.034797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5592de7-e9bc-4d31-b3ca-545f84eb0422 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:45.038660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5592de7-e9bc-4d31-b3ca-545f84eb0422 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:45.059841 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1270/2536] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:55.862670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64926d1-fe1f-49b6-9068-05ab1149b940 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:55.864110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64926d1-fe1f-49b6-9068-05ab1149b940 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:55.864542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64926d1-fe1f-49b6-9068-05ab1149b940 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:55.866294 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1267/2537] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:21:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:21:55.871911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a834393-4386-4fc7-8af2-cdf77e82e485 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:55.873224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a834393-4386-4fc7-8af2-cdf77e82e485 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:55.873224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a834393-4386-4fc7-8af2-cdf77e82e485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:55.896206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3a834393-4386-4fc7-8af2-cdf77e82e485 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:55.898034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3a834393-4386-4fc7-8af2-cdf77e82e485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:55.983592 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1271/2538] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:21:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:21:56.006192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64926d1-fe1f-49b6-9068-05ab1149b940 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:56.012046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a64926d1-fe1f-49b6-9068-05ab1149b940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:56.035294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64926d1-fe1f-49b6-9068-05ab1149b940 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:56.042391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978aac86-0ef6-43ff-af2d-8aedde16a7a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:56.043060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978aac86-0ef6-43ff-af2d-8aedde16a7a5 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:56.043346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978aac86-0ef6-43ff-af2d-8aedde16a7a5 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:56.043631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978aac86-0ef6-43ff-af2d-8aedde16a7a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:56.052953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978aac86-0ef6-43ff-af2d-8aedde16a7a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:56.054601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978aac86-0ef6-43ff-af2d-8aedde16a7a5 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:56.066746 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1268/2539] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:56.602544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a834393-4386-4fc7-8af2-cdf77e82e485 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:56.604147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3a834393-4386-4fc7-8af2-cdf77e82e485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:56.625264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a834393-4386-4fc7-8af2-cdf77e82e485 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:56.637897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835764f6-b432-46c2-aef1-f53b3150531f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:56.637897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835764f6-b432-46c2-aef1-f53b3150531f service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:56.637897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835764f6-b432-46c2-aef1-f53b3150531f service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:56.637897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835764f6-b432-46c2-aef1-f53b3150531f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:56.638216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-835764f6-b432-46c2-aef1-f53b3150531f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:56.696528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835764f6-b432-46c2-aef1-f53b3150531f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:56.698409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835764f6-b432-46c2-aef1-f53b3150531f service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:56.709190 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1272/2540] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:57.973942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978aac86-0ef6-43ff-af2d-8aedde16a7a5 service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:58.009234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978aac86-0ef6-43ff-af2d-8aedde16a7a5 service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:58.015359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017ab17-ba7d-4342-80ad-03bc3a2c43d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:58.016514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017ab17-ba7d-4342-80ad-03bc3a2c43d2 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:58.016514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017ab17-ba7d-4342-80ad-03bc3a2c43d2 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:58.016514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017ab17-ba7d-4342-80ad-03bc3a2c43d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:58.019139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5017ab17-ba7d-4342-80ad-03bc3a2c43d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:58.090101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017ab17-ba7d-4342-80ad-03bc3a2c43d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:58.092022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017ab17-ba7d-4342-80ad-03bc3a2c43d2 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:58.105710 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1269/2541] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:57 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:21:59.280488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfc0b4-01dc-49f9-ac12-dab8a73a13fa None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:59.281073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfc0b4-01dc-49f9-ac12-dab8a73a13fa None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:59.281073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfc0b4-01dc-49f9-ac12-dab8a73a13fa None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:59.282427 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1273/2542] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:21:59.291138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169fe98-3d89-478d-842b-3258cecdbd72 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:59.292023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169fe98-3d89-478d-842b-3258cecdbd72 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:59.292467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169fe98-3d89-478d-842b-3258cecdbd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:59.328579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a169fe98-3d89-478d-842b-3258cecdbd72 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:21:59.335363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a169fe98-3d89-478d-842b-3258cecdbd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:21:59.349198 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1270/2543] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:21:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:21:59.382877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfc0b4-01dc-49f9-ac12-dab8a73a13fa None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:21:59.415942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfc0b4-01dc-49f9-ac12-dab8a73a13fa None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:21:59.431276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7aae1-f650-4036-bc3d-72d891ecb98d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:21:59.432228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7aae1-f650-4036-bc3d-72d891ecb98d service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:21:59.434858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7aae1-f650-4036-bc3d-72d891ecb98d service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:21:59.434858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7aae1-f650-4036-bc3d-72d891ecb98d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:21:59.454130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7aae1-f650-4036-bc3d-72d891ecb98d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:21:59.458525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7aae1-f650-4036-bc3d-72d891ecb98d service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:21:59.474404 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1274/2544] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:21:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:22:01.045778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f30c8-4557-402f-ae3d-8ba0f3670bb4 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:01.047126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f30c8-4557-402f-ae3d-8ba0f3670bb4 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:01.047491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f30c8-4557-402f-ae3d-8ba0f3670bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:01.070573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-252f30c8-4557-402f-ae3d-8ba0f3670bb4 None None] MFA Rules not processed for user `17581b53723f42bdbe7dd12ea1f691cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:01.072259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-252f30c8-4557-402f-ae3d-8ba0f3670bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:01.096904 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1271/2545] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:01.549324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22788cfe-c91a-4b69-b264-4a54648a6269 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:01.552004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22788cfe-c91a-4b69-b264-4a54648a6269 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:01.552004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22788cfe-c91a-4b69-b264-4a54648a6269 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:01.552004 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1275/2546] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:22:01.560108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a6d3f-3569-4759-bb5a-96aa2ef5c8b6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:01.560400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a6d3f-3569-4759-bb5a-96aa2ef5c8b6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:01.560735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a6d3f-3569-4759-bb5a-96aa2ef5c8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:01.581951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a07a6d3f-3569-4759-bb5a-96aa2ef5c8b6 None None] MFA Rules not processed for user `e6036dd39fb74289a8cbdcd6a21f8662`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:01.584081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a07a6d3f-3569-4759-bb5a-96aa2ef5c8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:01.603872 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1272/2547] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:22:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:01.614555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22788cfe-c91a-4b69-b264-4a54648a6269 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:01.616525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-22788cfe-c91a-4b69-b264-4a54648a6269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:01.693790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22788cfe-c91a-4b69-b264-4a54648a6269 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:01.699253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89795e0a-1ac4-4d98-9241-70ac860d1873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:01.699912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795e0a-1ac4-4d98-9241-70ac860d1873 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:01.700229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795e0a-1ac4-4d98-9241-70ac860d1873 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:01.700506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795e0a-1ac4-4d98-9241-70ac860d1873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:01.713803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89795e0a-1ac4-4d98-9241-70ac860d1873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:01.715254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89795e0a-1ac4-4d98-9241-70ac860d1873 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:01.728863 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1276/2548] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:22:01.751114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaa0d5-39c2-44e2-af0f-24752fe55054 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:01.751407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaa0d5-39c2-44e2-af0f-24752fe55054 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:01.751691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaa0d5-39c2-44e2-af0f-24752fe55054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:01.773872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ddaaa0d5-39c2-44e2-af0f-24752fe55054 None None] MFA Rules not processed for user `4cd9fe10f94f43aeb3eb10009ee96ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:01.775390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ddaaa0d5-39c2-44e2-af0f-24752fe55054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:01.782164 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1273/2549] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:22:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:01.793334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89795e0a-1ac4-4d98-9241-70ac860d1873 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:01.806670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89795e0a-1ac4-4d98-9241-70ac860d1873 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:01.810874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4066c-c4dd-4d64-acc5-ad2c005ae883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:01.815129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4066c-c4dd-4d64-acc5-ad2c005ae883 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:01.815129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4066c-c4dd-4d64-acc5-ad2c005ae883 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:01.815129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4066c-c4dd-4d64-acc5-ad2c005ae883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:01.822943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4066c-c4dd-4d64-acc5-ad2c005ae883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:01.824405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4066c-c4dd-4d64-acc5-ad2c005ae883 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:01.834020 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1277/2550] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:22:02.858428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b87d9a-f2e6-4003-97ac-00f0105d9090 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:02.858428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b87d9a-f2e6-4003-97ac-00f0105d9090 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:02.858428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b87d9a-f2e6-4003-97ac-00f0105d9090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:02.873584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-22b87d9a-f2e6-4003-97ac-00f0105d9090 None None] MFA Rules not processed for user `0360b7261526403786bc77b8945c815b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:02.875373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-22b87d9a-f2e6-4003-97ac-00f0105d9090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:02.937352 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1274/2551] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:05.739283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bb6a6-0983-49ba-ad64-a1634a5baa88 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:05.739773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bb6a6-0983-49ba-ad64-a1634a5baa88 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:05.739854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bb6a6-0983-49ba-ad64-a1634a5baa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:05.764032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-cd3bb6a6-0983-49ba-ad64-a1634a5baa88 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:05.766354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cd3bb6a6-0983-49ba-ad64-a1634a5baa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:05.830781 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1278/2552] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:22:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:05.860727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b87d9a-f2e6-4003-97ac-00f0105d9090 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:05.866544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-22b87d9a-f2e6-4003-97ac-00f0105d9090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:05.948126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b87d9a-f2e6-4003-97ac-00f0105d9090 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:05.954703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9387ba-5528-4d0d-a4f9-174e292e03d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:05.955614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9387ba-5528-4d0d-a4f9-174e292e03d8 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:05.956083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9387ba-5528-4d0d-a4f9-174e292e03d8 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:05.956720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9387ba-5528-4d0d-a4f9-174e292e03d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:05.967002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9387ba-5528-4d0d-a4f9-174e292e03d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:05.968901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9387ba-5528-4d0d-a4f9-174e292e03d8 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:05.978618 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1275/2553] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:22:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:22:17.920404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bb6a6-0983-49ba-ad64-a1634a5baa88 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:17.922030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cd3bb6a6-0983-49ba-ad64-a1634a5baa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:18.157935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bb6a6-0983-49ba-ad64-a1634a5baa88 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:18.166583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ff906-23b9-420d-a357-2eb4eed4c0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:18.167796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ff906-23b9-420d-a357-2eb4eed4c0be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:18.168304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ff906-23b9-420d-a357-2eb4eed4c0be admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:18.168794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ff906-23b9-420d-a357-2eb4eed4c0be admin admin] PATH_INFO: `/v3/users/5a4826566d7d486db4e9fd217bccac2a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:18.173247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ff906-23b9-420d-a357-2eb4eed4c0be admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a4826566d7d486db4e9fd217bccac2a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:18.176531 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ff906-23b9-420d-a357-2eb4eed4c0be admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:18.442384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-021ff906-23b9-420d-a357-2eb4eed4c0be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a4826566d7d486db4e9fd217bccac2a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:18.478719 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-021ff906-23b9-420d-a357-2eb4eed4c0be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a4826566d7d486db4e9fd217bccac2a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:18.480933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-021ff906-23b9-420d-a357-2eb4eed4c0be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a4826566d7d486db4e9fd217bccac2a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:18.509014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-021ff906-23b9-420d-a357-2eb4eed4c0be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a4826566d7d486db4e9fd217bccac2a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:18.599499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-021ff906-23b9-420d-a357-2eb4eed4c0be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a4826566d7d486db4e9fd217bccac2a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:18.608500 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1279/2554] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:22:17 2022] DELETE /identity/v3/users/5a4826566d7d486db4e9fd217bccac2a => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:19.920921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9387ba-5528-4d0d-a4f9-174e292e03d8 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:19.946292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9387ba-5528-4d0d-a4f9-174e292e03d8 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:20.048795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007889ca-1fdb-4aab-8eba-0eaaf609cfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:20.050636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007889ca-1fdb-4aab-8eba-0eaaf609cfeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:20.051138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007889ca-1fdb-4aab-8eba-0eaaf609cfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:20.051616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007889ca-1fdb-4aab-8eba-0eaaf609cfeb admin admin] PATH_INFO: `/v3/users/5f60baebf1b5472db677cffc8ca8b0c3` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:20.053476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007889ca-1fdb-4aab-8eba-0eaaf609cfeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f60baebf1b5472db677cffc8ca8b0c3)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:20.055750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007889ca-1fdb-4aab-8eba-0eaaf609cfeb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:21.119737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ff906-23b9-420d-a357-2eb4eed4c0be admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:21.121288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-021ff906-23b9-420d-a357-2eb4eed4c0be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:21.223109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ff906-23b9-420d-a357-2eb4eed4c0be admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:21.228219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a3f17-43b9-43d0-80be-7daeabf8b24f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:21.228930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a3f17-43b9-43d0-80be-7daeabf8b24f service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:21.229335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a3f17-43b9-43d0-80be-7daeabf8b24f service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:21.229622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a3f17-43b9-43d0-80be-7daeabf8b24f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:21.231446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f72a3f17-43b9-43d0-80be-7daeabf8b24f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:21.243700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a3f17-43b9-43d0-80be-7daeabf8b24f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:21.245048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a3f17-43b9-43d0-80be-7daeabf8b24f service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:21.260939 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1280/2555] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:22:21.640971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a3f17-43b9-43d0-80be-7daeabf8b24f service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:21.642507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f72a3f17-43b9-43d0-80be-7daeabf8b24f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:21.659050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a3f17-43b9-43d0-80be-7daeabf8b24f service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:21.669382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5251d1-84cb-44b9-8d97-3165beca4c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:21.670269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5251d1-84cb-44b9-8d97-3165beca4c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:21.670553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5251d1-84cb-44b9-8d97-3165beca4c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:21.670836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5251d1-84cb-44b9-8d97-3165beca4c90 admin admin] PATH_INFO: `/v3/projects/8f6f08a44c6448529e12c65f5c01384c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:21.672580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5251d1-84cb-44b9-8d97-3165beca4c90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f6f08a44c6448529e12c65f5c01384c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:21.674659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5251d1-84cb-44b9-8d97-3165beca4c90 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:21.809622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-007889ca-1fdb-4aab-8eba-0eaaf609cfeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f60baebf1b5472db677cffc8ca8b0c3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:21.822232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-007889ca-1fdb-4aab-8eba-0eaaf609cfeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f60baebf1b5472db677cffc8ca8b0c3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:21.823107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-007889ca-1fdb-4aab-8eba-0eaaf609cfeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f60baebf1b5472db677cffc8ca8b0c3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:21.830102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-007889ca-1fdb-4aab-8eba-0eaaf609cfeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f60baebf1b5472db677cffc8ca8b0c3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:21.875098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9c5251d1-84cb-44b9-8d97-3165beca4c90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f6f08a44c6448529e12c65f5c01384c', 'request_id': 'req-9c5251d1-84cb-44b9-8d97-3165beca4c90'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:21.884430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9c5251d1-84cb-44b9-8d97-3165beca4c90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f6f08a44c6448529e12c65f5c01384c', 'request_id': 'req-9c5251d1-84cb-44b9-8d97-3165beca4c90'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:21.949027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-007889ca-1fdb-4aab-8eba-0eaaf609cfeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f60baebf1b5472db677cffc8ca8b0c3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:21.955704 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1276/2556] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:22:19 2022] DELETE /identity/v3/users/5f60baebf1b5472db677cffc8ca8b0c3 => generated 0 bytes in 2035 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:22:21.956813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007889ca-1fdb-4aab-8eba-0eaaf609cfeb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:21.958306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-007889ca-1fdb-4aab-8eba-0eaaf609cfeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:22.028183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007889ca-1fdb-4aab-8eba-0eaaf609cfeb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:22.033596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c35817-2bc1-4139-8e5f-9a109e942ec3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:22.034258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c35817-2bc1-4139-8e5f-9a109e942ec3 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:22.035042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c35817-2bc1-4139-8e5f-9a109e942ec3 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:22.035320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c35817-2bc1-4139-8e5f-9a109e942ec3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:22.037964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-64c35817-2bc1-4139-8e5f-9a109e942ec3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:22.040945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9c5251d1-84cb-44b9-8d97-3165beca4c90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f6f08a44c6448529e12c65f5c01384c', 'request_id': 'req-9c5251d1-84cb-44b9-8d97-3165beca4c90'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:22.052828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c35817-2bc1-4139-8e5f-9a109e942ec3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:22.054447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c35817-2bc1-4139-8e5f-9a109e942ec3 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:22.058774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9c5251d1-84cb-44b9-8d97-3165beca4c90 admin admin] The token cache is being invalidate because project 8f6f08a44c6448529e12c65f5c01384c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:22:22.059156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9c5251d1-84cb-44b9-8d97-3165beca4c90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:22.059890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9c5251d1-84cb-44b9-8d97-3165beca4c90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:22.064557 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1281/2557] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:22:21 2022] DELETE /identity/v3/projects/8f6f08a44c6448529e12c65f5c01384c => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:22.064557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fda02a-13e2-43d2-9a1e-dfc035710447 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:22.064557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fda02a-13e2-43d2-9a1e-dfc035710447 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:22.064557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fda02a-13e2-43d2-9a1e-dfc035710447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:22.066537 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1277/2558] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:22:22.067358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c35817-2bc1-4139-8e5f-9a109e942ec3 service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:22.069293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-64c35817-2bc1-4139-8e5f-9a109e942ec3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:22.087017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-94fda02a-13e2-43d2-9a1e-dfc035710447 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:22.088405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-94fda02a-13e2-43d2-9a1e-dfc035710447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:22.156741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c35817-2bc1-4139-8e5f-9a109e942ec3 service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:22.163045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ebadb-213b-4e5a-b910-9f4fcb7d7b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:22.166237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ebadb-213b-4e5a-b910-9f4fcb7d7b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:22.166237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ebadb-213b-4e5a-b910-9f4fcb7d7b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:22.166237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ebadb-213b-4e5a-b910-9f4fcb7d7b34 admin admin] PATH_INFO: `/v3/users/5c3833ef97804dc08e4c57b75d76bd24` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:22.166237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ebadb-213b-4e5a-b910-9f4fcb7d7b34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3833ef97804dc08e4c57b75d76bd24)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:22.168929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ebadb-213b-4e5a-b910-9f4fcb7d7b34 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:22.197232 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1282/2559] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:22.213593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fda02a-13e2-43d2-9a1e-dfc035710447 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:22.215094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-94fda02a-13e2-43d2-9a1e-dfc035710447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:22.276186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fda02a-13e2-43d2-9a1e-dfc035710447 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:22.279886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccbd7c-a33e-4046-83ed-ef3ca313cf56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:22.280533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccbd7c-a33e-4046-83ed-ef3ca313cf56 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:22.280852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccbd7c-a33e-4046-83ed-ef3ca313cf56 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:22.281136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccbd7c-a33e-4046-83ed-ef3ca313cf56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:22.291734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccbd7c-a33e-4046-83ed-ef3ca313cf56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:22.293225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccbd7c-a33e-4046-83ed-ef3ca313cf56 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:22.303446 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1283/2560] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:22:22.402258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d42ebadb-213b-4e5a-b910-9f4fcb7d7b34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3833ef97804dc08e4c57b75d76bd24'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:22.417318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d42ebadb-213b-4e5a-b910-9f4fcb7d7b34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3833ef97804dc08e4c57b75d76bd24'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:22.418066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d42ebadb-213b-4e5a-b910-9f4fcb7d7b34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3833ef97804dc08e4c57b75d76bd24'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:22.429480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d42ebadb-213b-4e5a-b910-9f4fcb7d7b34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3833ef97804dc08e4c57b75d76bd24'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:22.532090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d42ebadb-213b-4e5a-b910-9f4fcb7d7b34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3833ef97804dc08e4c57b75d76bd24'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:22.539754 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1278/2561] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:22:22 2022] DELETE /identity/v3/users/5c3833ef97804dc08e4c57b75d76bd24 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:22.573857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccbd7c-a33e-4046-83ed-ef3ca313cf56 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:22.576768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-12ccbd7c-a33e-4046-83ed-ef3ca313cf56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:22.591390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccbd7c-a33e-4046-83ed-ef3ca313cf56 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:22.651589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32d123-2849-44d9-ac98-8d223746c4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:22.652461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32d123-2849-44d9-ac98-8d223746c4cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:22.652791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32d123-2849-44d9-ac98-8d223746c4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:22.653074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32d123-2849-44d9-ac98-8d223746c4cf admin admin] PATH_INFO: `/v3/projects/9403ec149eb24254b818f66c96b95ba2` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:22.654380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32d123-2849-44d9-ac98-8d223746c4cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9403ec149eb24254b818f66c96b95ba2)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:22.656433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32d123-2849-44d9-ac98-8d223746c4cf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:22.773834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eb32d123-2849-44d9-ac98-8d223746c4cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9403ec149eb24254b818f66c96b95ba2', 'request_id': 'req-eb32d123-2849-44d9-ac98-8d223746c4cf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:22.780401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eb32d123-2849-44d9-ac98-8d223746c4cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9403ec149eb24254b818f66c96b95ba2', 'request_id': 'req-eb32d123-2849-44d9-ac98-8d223746c4cf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:22.789008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ebadb-213b-4e5a-b910-9f4fcb7d7b34 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:22.790566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d42ebadb-213b-4e5a-b910-9f4fcb7d7b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:22.817361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ebadb-213b-4e5a-b910-9f4fcb7d7b34 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:22.866308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eb32d123-2849-44d9-ac98-8d223746c4cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9403ec149eb24254b818f66c96b95ba2', 'request_id': 'req-eb32d123-2849-44d9-ac98-8d223746c4cf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:22.878793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eb32d123-2849-44d9-ac98-8d223746c4cf admin admin] The token cache is being invalidate because project 9403ec149eb24254b818f66c96b95ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:22:22.879432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eb32d123-2849-44d9-ac98-8d223746c4cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:22.880306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eb32d123-2849-44d9-ac98-8d223746c4cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:22.882441 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1284/2562] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:22:22 2022] DELETE /identity/v3/projects/9403ec149eb24254b818f66c96b95ba2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:22.887654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ce231-1f89-4fd1-bcf6-e82b8ed8d70a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:22.887943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ce231-1f89-4fd1-bcf6-e82b8ed8d70a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:22.888262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ce231-1f89-4fd1-bcf6-e82b8ed8d70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:22.893254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e999c0-418f-46c6-95b6-5fa10e4b222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:22.898728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e999c0-418f-46c6-95b6-5fa10e4b222a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:22.898728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e999c0-418f-46c6-95b6-5fa10e4b222a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:22.898728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e999c0-418f-46c6-95b6-5fa10e4b222a admin admin] PATH_INFO: `/v3/projects/f4decc5104ea4ef59a8563d2ff68c64e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:22.898728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e999c0-418f-46c6-95b6-5fa10e4b222a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4decc5104ea4ef59a8563d2ff68c64e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:22.899121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e999c0-418f-46c6-95b6-5fa10e4b222a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:22.908941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-104ce231-1f89-4fd1-bcf6-e82b8ed8d70a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:22.910233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-104ce231-1f89-4fd1-bcf6-e82b8ed8d70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:22.923300 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1285/2563] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:22:22.931528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e62bb-78e8-4656-9813-573dc4858ef8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:22.931816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e62bb-78e8-4656-9813-573dc4858ef8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:22.932287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e62bb-78e8-4656-9813-573dc4858ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:22.951969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-778e62bb-78e8-4656-9813-573dc4858ef8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:22.953263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-778e62bb-78e8-4656-9813-573dc4858ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:22.962167 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1286/2564] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:22.966526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e62bb-78e8-4656-9813-573dc4858ef8 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:22.975838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e62bb-78e8-4656-9813-573dc4858ef8 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:22.980775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595f5e4-56c4-49d7-bd1c-1c27e7c6bbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:22.981540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595f5e4-56c4-49d7-bd1c-1c27e7c6bbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:22.981991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595f5e4-56c4-49d7-bd1c-1c27e7c6bbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:22.982351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595f5e4-56c4-49d7-bd1c-1c27e7c6bbf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:22.983159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595f5e4-56c4-49d7-bd1c-1c27e7c6bbf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:22:22.983570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595f5e4-56c4-49d7-bd1c-1c27e7c6bbf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:22.985320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595f5e4-56c4-49d7-bd1c-1c27e7c6bbf1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:22.998368 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1287/2565] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:22:23.002468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595f5e4-56c4-49d7-bd1c-1c27e7c6bbf1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:23.013016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595f5e4-56c4-49d7-bd1c-1c27e7c6bbf1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:23.018308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76306179-d93d-4342-adc7-00abde82709c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:23.022440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76306179-d93d-4342-adc7-00abde82709c admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:23.022440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76306179-d93d-4342-adc7-00abde82709c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:23.022440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76306179-d93d-4342-adc7-00abde82709c admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:23.022440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76306179-d93d-4342-adc7-00abde82709c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:23.022804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76306179-d93d-4342-adc7-00abde82709c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:23.081204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f8e999c0-418f-46c6-95b6-5fa10e4b222a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4decc5104ea4ef59a8563d2ff68c64e', 'request_id': 'req-f8e999c0-418f-46c6-95b6-5fa10e4b222a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:23.188196 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1288/2566] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:22:23 2022] POST /identity/v3/projects => generated 401 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:22:23.192654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76306179-d93d-4342-adc7-00abde82709c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:23.203610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f8e999c0-418f-46c6-95b6-5fa10e4b222a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4decc5104ea4ef59a8563d2ff68c64e', 'request_id': 'req-f8e999c0-418f-46c6-95b6-5fa10e4b222a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:23.210311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f8e999c0-418f-46c6-95b6-5fa10e4b222a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4decc5104ea4ef59a8563d2ff68c64e', 'request_id': 'req-f8e999c0-418f-46c6-95b6-5fa10e4b222a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:23.223452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f8e999c0-418f-46c6-95b6-5fa10e4b222a admin admin] The token cache is being invalidate because project f4decc5104ea4ef59a8563d2ff68c64e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:22:23.223874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f8e999c0-418f-46c6-95b6-5fa10e4b222a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:23.224546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f8e999c0-418f-46c6-95b6-5fa10e4b222a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:23.230948 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1279/2567] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:22:22 2022] DELETE /identity/v3/projects/f4decc5104ea4ef59a8563d2ff68c64e => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:23.232646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be5ded-757c-42cd-9bdf-f5a8a957c009 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:23.232946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be5ded-757c-42cd-9bdf-f5a8a957c009 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:23.233229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be5ded-757c-42cd-9bdf-f5a8a957c009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:23.255606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e3be5ded-757c-42cd-9bdf-f5a8a957c009 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:23.256870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e3be5ded-757c-42cd-9bdf-f5a8a957c009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:23.271359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76306179-d93d-4342-adc7-00abde82709c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:23.276585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f83a86-55cc-4052-8137-9f8228bf27b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:23.277377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f83a86-55cc-4052-8137-9f8228bf27b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:23.277732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f83a86-55cc-4052-8137-9f8228bf27b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:23.278090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f83a86-55cc-4052-8137-9f8228bf27b1 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:23.278902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f83a86-55cc-4052-8137-9f8228bf27b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:23.281578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f83a86-55cc-4052-8137-9f8228bf27b1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:23.341456 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1280/2568] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:22:23.350492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2d338-3f81-43d1-bb89-e5ed9ba15ad9 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:23.350995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2d338-3f81-43d1-bb89-e5ed9ba15ad9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:23.351209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2d338-3f81-43d1-bb89-e5ed9ba15ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:23.357700 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1289/2569] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:22:23 2022] POST /identity/v3/users => generated 301 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:22:23.364302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f83a86-55cc-4052-8137-9f8228bf27b1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:23.366002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-30f83a86-55cc-4052-8137-9f8228bf27b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:23.382133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c3b2d338-3f81-43d1-bb89-e5ed9ba15ad9 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:23.383853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f83a86-55cc-4052-8137-9f8228bf27b1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:23.383982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c3b2d338-3f81-43d1-bb89-e5ed9ba15ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:23.398111 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1281/2570] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:23.400234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2d338-3f81-43d1-bb89-e5ed9ba15ad9 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:23.401193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd2fac-39a8-496f-96a1-5bacca51ca23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:23.403843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd2fac-39a8-496f-96a1-5bacca51ca23 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:23.418470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd2fac-39a8-496f-96a1-5bacca51ca23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:23.418470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd2fac-39a8-496f-96a1-5bacca51ca23 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:23.418470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd2fac-39a8-496f-96a1-5bacca51ca23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:23.418470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd2fac-39a8-496f-96a1-5bacca51ca23 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:23.418845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2d338-3f81-43d1-bb89-e5ed9ba15ad9 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:23.418845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee0703-2fe2-438c-b865-815cd2432f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:23.418845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee0703-2fe2-438c-b865-815cd2432f92 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:23.418845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee0703-2fe2-438c-b865-815cd2432f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:23.419165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee0703-2fe2-438c-b865-815cd2432f92 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:23.419165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee0703-2fe2-438c-b865-815cd2432f92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:22:23.419165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee0703-2fe2-438c-b865-815cd2432f92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:23.419885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee0703-2fe2-438c-b865-815cd2432f92 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:23.423110 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1290/2571] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:22:23.424159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd2fac-39a8-496f-96a1-5bacca51ca23 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:23.434008 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1282/2572] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:22:23.435888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd2fac-39a8-496f-96a1-5bacca51ca23 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:23.439160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee0703-2fe2-438c-b865-815cd2432f92 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:23.457888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44917da9-7de8-4287-9822-c9e327f3205f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:23.458579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44917da9-7de8-4287-9822-c9e327f3205f admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:23.458866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44917da9-7de8-4287-9822-c9e327f3205f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:23.459148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44917da9-7de8-4287-9822-c9e327f3205f admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:23.461107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee0703-2fe2-438c-b865-815cd2432f92 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:23.467335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf75b84-6cd9-4aa8-938b-0d11fdde7941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:23.468048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44917da9-7de8-4287-9822-c9e327f3205f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:23.468550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf75b84-6cd9-4aa8-938b-0d11fdde7941 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:23.471301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf75b84-6cd9-4aa8-938b-0d11fdde7941 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:23.471301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf75b84-6cd9-4aa8-938b-0d11fdde7941 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:23.471566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44917da9-7de8-4287-9822-c9e327f3205f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:23.471686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf75b84-6cd9-4aa8-938b-0d11fdde7941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:23.472727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf75b84-6cd9-4aa8-938b-0d11fdde7941 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:23.494758 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1291/2573] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:22:23.497241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44917da9-7de8-4287-9822-c9e327f3205f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:23.509123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44917da9-7de8-4287-9822-c9e327f3205f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:23.516419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7f4e4-0d4c-498c-83e8-397f87e74a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:23.517283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7f4e4-0d4c-498c-83e8-397f87e74a0f admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:23.517569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7f4e4-0d4c-498c-83e8-397f87e74a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:23.517850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7f4e4-0d4c-498c-83e8-397f87e74a0f admin admin] PATH_INFO: `/v3/projects/8786b972e479415d9b6b4e957cdc0212/users/4d353e4a41544b2095a04ea662a79e2f/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:23.532802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7f4e4-0d4c-498c-83e8-397f87e74a0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8786b972e479415d9b6b4e957cdc0212, user_id=4d353e4a41544b2095a04ea662a79e2f, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:23.536301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7f4e4-0d4c-498c-83e8-397f87e74a0f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:23.651662 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1283/2574] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:22:23 2022] POST /identity/v3/projects => generated 371 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:22:23.651662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf75b84-6cd9-4aa8-938b-0d11fdde7941 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:23.658315 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1292/2575] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:22:23 2022] PUT /identity/v3/projects/8786b972e479415d9b6b4e957cdc0212/users/4d353e4a41544b2095a04ea662a79e2f/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:22:23.670292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787ab31-9367-46b6-84d4-42e441299992 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:23.674024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787ab31-9367-46b6-84d4-42e441299992 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:23.674024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787ab31-9367-46b6-84d4-42e441299992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:23.698749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d787ab31-9367-46b6-84d4-42e441299992 None None] MFA Rules not processed for user `4d353e4a41544b2095a04ea662a79e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:23.699962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d787ab31-9367-46b6-84d4-42e441299992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:23.712711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf75b84-6cd9-4aa8-938b-0d11fdde7941 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:23.762892 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1293/2576] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:22:23.766244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a86524-3dab-4578-ace7-98f5e6fd1a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:23.766970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a86524-3dab-4578-ace7-98f5e6fd1a44 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:23.767268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a86524-3dab-4578-ace7-98f5e6fd1a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:23.767574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a86524-3dab-4578-ace7-98f5e6fd1a44 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:23.768275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a86524-3dab-4578-ace7-98f5e6fd1a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:23.770854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a86524-3dab-4578-ace7-98f5e6fd1a44 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:23.774692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787ab31-9367-46b6-84d4-42e441299992 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:23.783323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d787ab31-9367-46b6-84d4-42e441299992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:23.846733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787ab31-9367-46b6-84d4-42e441299992 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:23.853225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08768e-4b07-4203-8938-bbc1a95d77b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:23.853877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08768e-4b07-4203-8938-bbc1a95d77b8 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:23.854161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08768e-4b07-4203-8938-bbc1a95d77b8 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:23.854442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08768e-4b07-4203-8938-bbc1a95d77b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:23.862743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08768e-4b07-4203-8938-bbc1a95d77b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:23.864410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08768e-4b07-4203-8938-bbc1a95d77b8 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:23.873994 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1294/2577] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:23 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:22:23.908903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08768e-4b07-4203-8938-bbc1a95d77b8 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:23.917574 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1284/2578] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:22:23 2022] POST /identity/v3/users => generated 286 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:22:23.919020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a86524-3dab-4578-ace7-98f5e6fd1a44 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:23.921978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08768e-4b07-4203-8938-bbc1a95d77b8 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:23.928988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb1cb8-b199-453a-a70b-d6e088ea2f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:23.929513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a86524-3dab-4578-ace7-98f5e6fd1a44 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:23.930087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb1cb8-b199-453a-a70b-d6e088ea2f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:23.930468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb1cb8-b199-453a-a70b-d6e088ea2f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:23.931029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb1cb8-b199-453a-a70b-d6e088ea2f50 admin admin] PATH_INFO: `/v3/users/4d353e4a41544b2095a04ea662a79e2f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:23.932381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb1cb8-b199-453a-a70b-d6e088ea2f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d353e4a41544b2095a04ea662a79e2f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:23.934643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb1cb8-b199-453a-a70b-d6e088ea2f50 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:23.937369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c24eb1-3927-4c21-9e02-7980a266503d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:23.937369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c24eb1-3927-4c21-9e02-7980a266503d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:23.937369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c24eb1-3927-4c21-9e02-7980a266503d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:23.937369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c24eb1-3927-4c21-9e02-7980a266503d admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:23.937779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c24eb1-3927-4c21-9e02-7980a266503d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:23.939391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c24eb1-3927-4c21-9e02-7980a266503d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:23.950476 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1285/2579] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:22:23.954842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c24eb1-3927-4c21-9e02-7980a266503d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:23.966125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c24eb1-3927-4c21-9e02-7980a266503d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:23.970923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce15d48-ffa4-4b62-80df-6c9377b2789c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:23.971655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce15d48-ffa4-4b62-80df-6c9377b2789c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:23.972681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce15d48-ffa4-4b62-80df-6c9377b2789c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:23.973031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce15d48-ffa4-4b62-80df-6c9377b2789c admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:23.973830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce15d48-ffa4-4b62-80df-6c9377b2789c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:23.975478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce15d48-ffa4-4b62-80df-6c9377b2789c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:23.986460 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1286/2580] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:22:23.990748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce15d48-ffa4-4b62-80df-6c9377b2789c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:24.002758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce15d48-ffa4-4b62-80df-6c9377b2789c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:24.008270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f8391-fc60-414d-ac5f-6295846ccd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:24.009324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f8391-fc60-414d-ac5f-6295846ccd9f admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:24.010031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f8391-fc60-414d-ac5f-6295846ccd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:24.010031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f8391-fc60-414d-ac5f-6295846ccd9f admin admin] PATH_INFO: `/v3/projects/eec791a7b8534970a7a5a6e534c1a0fb/users/b2068b18d7414d7687643b7893e940dd/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:24.028266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f8391-fc60-414d-ac5f-6295846ccd9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec791a7b8534970a7a5a6e534c1a0fb, user_id=b2068b18d7414d7687643b7893e940dd, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:24.031201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f8391-fc60-414d-ac5f-6295846ccd9f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:24.115792 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1287/2581] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:22:23 2022] PUT /identity/v3/projects/eec791a7b8534970a7a5a6e534c1a0fb/users/b2068b18d7414d7687643b7893e940dd/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:22:24.124634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5231f10-4813-47d8-97bb-85fc790ecf1c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:24.125093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5231f10-4813-47d8-97bb-85fc790ecf1c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:24.125382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5231f10-4813-47d8-97bb-85fc790ecf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:24.156474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-28bb1cb8-b199-453a-a70b-d6e088ea2f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d353e4a41544b2095a04ea662a79e2f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:24.171670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-28bb1cb8-b199-453a-a70b-d6e088ea2f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d353e4a41544b2095a04ea662a79e2f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:24.172439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-28bb1cb8-b199-453a-a70b-d6e088ea2f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d353e4a41544b2095a04ea662a79e2f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:24.178263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f5231f10-4813-47d8-97bb-85fc790ecf1c None None] MFA Rules not processed for user `b2068b18d7414d7687643b7893e940dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:24.179550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f5231f10-4813-47d8-97bb-85fc790ecf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:24.180566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-28bb1cb8-b199-453a-a70b-d6e088ea2f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d353e4a41544b2095a04ea662a79e2f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:24.255435 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1288/2582] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:22:24.260586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-28bb1cb8-b199-453a-a70b-d6e088ea2f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d353e4a41544b2095a04ea662a79e2f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:24.266744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5231f10-4813-47d8-97bb-85fc790ecf1c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:24.269604 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1295/2583] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:22:23 2022] DELETE /identity/v3/users/4d353e4a41544b2095a04ea662a79e2f => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:22:24.274501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823fdb5-b246-46b7-8f30-8a3326611373 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:24.275097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823fdb5-b246-46b7-8f30-8a3326611373 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:24.275201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823fdb5-b246-46b7-8f30-8a3326611373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:24.306781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f823fdb5-b246-46b7-8f30-8a3326611373 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:24.308003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f823fdb5-b246-46b7-8f30-8a3326611373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:24.350483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5231f10-4813-47d8-97bb-85fc790ecf1c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:24.371943 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1296/2584] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:22:24.382358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823fdb5-b246-46b7-8f30-8a3326611373 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:24.384040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f823fdb5-b246-46b7-8f30-8a3326611373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:24.435726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900e0f3-ae6f-4fb6-ba33-a1c55f3c735a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:24.436477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900e0f3-ae6f-4fb6-ba33-a1c55f3c735a service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:24.436709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900e0f3-ae6f-4fb6-ba33-a1c55f3c735a service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:24.436988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900e0f3-ae6f-4fb6-ba33-a1c55f3c735a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:24.439314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f900e0f3-ae6f-4fb6-ba33-a1c55f3c735a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:24.448275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823fdb5-b246-46b7-8f30-8a3326611373 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:24.453631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edee3c-a339-4737-895c-d7272ef36c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:24.458506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edee3c-a339-4737-895c-d7272ef36c5e service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:24.458506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edee3c-a339-4737-895c-d7272ef36c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:24.458506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edee3c-a339-4737-895c-d7272ef36c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:24.486735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edee3c-a339-4737-895c-d7272ef36c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:24.489236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edee3c-a339-4737-895c-d7272ef36c5e service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:24.506428 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1297/2585] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:22:24.560943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900e0f3-ae6f-4fb6-ba33-a1c55f3c735a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:24.562618 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900e0f3-ae6f-4fb6-ba33-a1c55f3c735a service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:24.573525 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1289/2586] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:22:25.043129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edee3c-a339-4737-895c-d7272ef36c5e service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:25.044848 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b1edee3c-a339-4737-895c-d7272ef36c5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:25.073997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edee3c-a339-4737-895c-d7272ef36c5e service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:25.089621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f76134-8f10-406f-8290-1822ddbacdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:25.090742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f76134-8f10-406f-8290-1822ddbacdeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:25.091025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f76134-8f10-406f-8290-1822ddbacdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:25.091307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f76134-8f10-406f-8290-1822ddbacdeb admin admin] PATH_INFO: `/v3/projects/8786b972e479415d9b6b4e957cdc0212` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:25.093974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f76134-8f10-406f-8290-1822ddbacdeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8786b972e479415d9b6b4e957cdc0212)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:25.101387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f76134-8f10-406f-8290-1822ddbacdeb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:25.259335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-61f76134-8f10-406f-8290-1822ddbacdeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8786b972e479415d9b6b4e957cdc0212', 'request_id': 'req-61f76134-8f10-406f-8290-1822ddbacdeb'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:25.270315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-61f76134-8f10-406f-8290-1822ddbacdeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8786b972e479415d9b6b4e957cdc0212', 'request_id': 'req-61f76134-8f10-406f-8290-1822ddbacdeb'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:25.336977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900e0f3-ae6f-4fb6-ba33-a1c55f3c735a service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:25.338113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f900e0f3-ae6f-4fb6-ba33-a1c55f3c735a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:25.352329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-61f76134-8f10-406f-8290-1822ddbacdeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8786b972e479415d9b6b4e957cdc0212', 'request_id': 'req-61f76134-8f10-406f-8290-1822ddbacdeb'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:25.355790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900e0f3-ae6f-4fb6-ba33-a1c55f3c735a service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:25.368980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-61f76134-8f10-406f-8290-1822ddbacdeb admin admin] The token cache is being invalidate because project 8786b972e479415d9b6b4e957cdc0212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:22:25.370003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-61f76134-8f10-406f-8290-1822ddbacdeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:25.371183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-61f76134-8f10-406f-8290-1822ddbacdeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:25.374179 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1298/2587] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:22:25 2022] DELETE /identity/v3/projects/8786b972e479415d9b6b4e957cdc0212 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:25.378944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ada16-2883-443a-850c-a2c133eb6862 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:25.379411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ada16-2883-443a-850c-a2c133eb6862 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:25.380973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ada16-2883-443a-850c-a2c133eb6862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:25.409170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3b7ada16-2883-443a-850c-a2c133eb6862 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:25.412016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3b7ada16-2883-443a-850c-a2c133eb6862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:25.453520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f554f8b-9cf1-4296-9237-00032b9280ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:25.453520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f554f8b-9cf1-4296-9237-00032b9280ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:25.453520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f554f8b-9cf1-4296-9237-00032b9280ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:25.453828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f554f8b-9cf1-4296-9237-00032b9280ad admin admin] PATH_INFO: `/v3/users/b2068b18d7414d7687643b7893e940dd` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:25.462778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f554f8b-9cf1-4296-9237-00032b9280ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2068b18d7414d7687643b7893e940dd)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:25.464905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f554f8b-9cf1-4296-9237-00032b9280ad admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:25.496800 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1299/2588] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:25.503587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b475bd-f2fd-4418-986a-5dbbb4231841 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:25.504020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b475bd-f2fd-4418-986a-5dbbb4231841 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:25.506722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b475bd-f2fd-4418-986a-5dbbb4231841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:25.529745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-00b475bd-f2fd-4418-986a-5dbbb4231841 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:25.529745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-00b475bd-f2fd-4418-986a-5dbbb4231841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:25.537848 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1300/2589] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:25.541966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b475bd-f2fd-4418-986a-5dbbb4231841 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:25.551417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b475bd-f2fd-4418-986a-5dbbb4231841 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:25.556033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7206795-27cd-4cd5-bf3b-e80f36649720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:25.556821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7206795-27cd-4cd5-bf3b-e80f36649720 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:25.556991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7206795-27cd-4cd5-bf3b-e80f36649720 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:25.558346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7206795-27cd-4cd5-bf3b-e80f36649720 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:25.558346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7206795-27cd-4cd5-bf3b-e80f36649720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:22:25.558346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7206795-27cd-4cd5-bf3b-e80f36649720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:25.559856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7206795-27cd-4cd5-bf3b-e80f36649720 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:25.571704 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1301/2590] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:22:25.576174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7206795-27cd-4cd5-bf3b-e80f36649720 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:25.586741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7206795-27cd-4cd5-bf3b-e80f36649720 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:25.591479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6047e-cd06-4084-8aa3-cbb8e0c54e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:25.592128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6047e-cd06-4084-8aa3-cbb8e0c54e75 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:25.592417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6047e-cd06-4084-8aa3-cbb8e0c54e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:25.592805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6047e-cd06-4084-8aa3-cbb8e0c54e75 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:25.593555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6047e-cd06-4084-8aa3-cbb8e0c54e75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:25.595457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6047e-cd06-4084-8aa3-cbb8e0c54e75 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:25.677408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9f554f8b-9cf1-4296-9237-00032b9280ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2068b18d7414d7687643b7893e940dd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:25.689001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9f554f8b-9cf1-4296-9237-00032b9280ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2068b18d7414d7687643b7893e940dd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:25.689697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9f554f8b-9cf1-4296-9237-00032b9280ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2068b18d7414d7687643b7893e940dd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:25.694085 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1302/2591] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:22:25 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:22:25.697346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9f554f8b-9cf1-4296-9237-00032b9280ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2068b18d7414d7687643b7893e940dd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:25.698387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6047e-cd06-4084-8aa3-cbb8e0c54e75 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:25.763576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6047e-cd06-4084-8aa3-cbb8e0c54e75 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:25.769420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bc6b5-0dda-468f-a4f2-8ffb52009f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:25.770879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bc6b5-0dda-468f-a4f2-8ffb52009f67 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:25.772734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bc6b5-0dda-468f-a4f2-8ffb52009f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:25.772734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bc6b5-0dda-468f-a4f2-8ffb52009f67 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:25.772734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bc6b5-0dda-468f-a4f2-8ffb52009f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:25.774318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bc6b5-0dda-468f-a4f2-8ffb52009f67 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:25.801473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9f554f8b-9cf1-4296-9237-00032b9280ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2068b18d7414d7687643b7893e940dd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:25.810118 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1290/2592] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:22:25 2022] DELETE /identity/v3/users/b2068b18d7414d7687643b7893e940dd => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:22:25.815076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03692e9c-4215-417d-805a-23e36f5ccce5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:25.815374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03692e9c-4215-417d-805a-23e36f5ccce5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:25.816229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03692e9c-4215-417d-805a-23e36f5ccce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:25.850066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-03692e9c-4215-417d-805a-23e36f5ccce5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:25.852488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-03692e9c-4215-417d-805a-23e36f5ccce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:25.897663 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1303/2593] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:22:25 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:22:25.902876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bc6b5-0dda-468f-a4f2-8ffb52009f67 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:25.907444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b17bc6b5-0dda-468f-a4f2-8ffb52009f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:25.949972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bc6b5-0dda-468f-a4f2-8ffb52009f67 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:25.970096 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1291/2594] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:25.994829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03692e9c-4215-417d-805a-23e36f5ccce5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:25.997221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-03692e9c-4215-417d-805a-23e36f5ccce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:26.095102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6a2f1-635d-4b3e-bad1-fd138b2158df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:26.096007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6a2f1-635d-4b3e-bad1-fd138b2158df admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:26.096285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6a2f1-635d-4b3e-bad1-fd138b2158df admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:26.096570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6a2f1-635d-4b3e-bad1-fd138b2158df admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:26.103688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6a2f1-635d-4b3e-bad1-fd138b2158df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:26.105550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6a2f1-635d-4b3e-bad1-fd138b2158df admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:26.123813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03692e9c-4215-417d-805a-23e36f5ccce5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:26.133655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efff5ed-3eb8-47dc-9a8d-4ac544555296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:26.134360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efff5ed-3eb8-47dc-9a8d-4ac544555296 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:26.134645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efff5ed-3eb8-47dc-9a8d-4ac544555296 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:26.135314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efff5ed-3eb8-47dc-9a8d-4ac544555296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:26.141486 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1304/2595] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:22:26.145322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6a2f1-635d-4b3e-bad1-fd138b2158df admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:26.150934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efff5ed-3eb8-47dc-9a8d-4ac544555296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:26.152397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efff5ed-3eb8-47dc-9a8d-4ac544555296 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:26.160621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6a2f1-635d-4b3e-bad1-fd138b2158df admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:26.167304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2187191-4abe-4123-9af2-194ba6b530c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:26.167996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2187191-4abe-4123-9af2-194ba6b530c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:26.168286 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2187191-4abe-4123-9af2-194ba6b530c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:26.168569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2187191-4abe-4123-9af2-194ba6b530c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:26.169425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2187191-4abe-4123-9af2-194ba6b530c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:26.171121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2187191-4abe-4123-9af2-194ba6b530c7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:26.178531 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1292/2596] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:22:26.190231 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1305/2597] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:22:26.190467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efff5ed-3eb8-47dc-9a8d-4ac544555296 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:26.203434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efff5ed-3eb8-47dc-9a8d-4ac544555296 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:26.211635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242a036-b7dd-4bfa-903b-42a2a03a17ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:26.212508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242a036-b7dd-4bfa-903b-42a2a03a17ca admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:26.213103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242a036-b7dd-4bfa-903b-42a2a03a17ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:26.213401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242a036-b7dd-4bfa-903b-42a2a03a17ca admin admin] PATH_INFO: `/v3/projects/1f8417cf4382458ca38ede18c333244e/users/713098621b494c22aebfd74c05aaefd8/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:26.241647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242a036-b7dd-4bfa-903b-42a2a03a17ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8417cf4382458ca38ede18c333244e, user_id=713098621b494c22aebfd74c05aaefd8, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:26.245552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242a036-b7dd-4bfa-903b-42a2a03a17ca admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:26.931848 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1293/2598] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:22:26 2022] PUT /identity/v3/projects/1f8417cf4382458ca38ede18c333244e/users/713098621b494c22aebfd74c05aaefd8/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:22:26.942723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7300f-b666-434c-8e5f-fdbac85ff426 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:26.943393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7300f-b666-434c-8e5f-fdbac85ff426 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:26.948475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7300f-b666-434c-8e5f-fdbac85ff426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:26.999613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-cfc7300f-b666-434c-8e5f-fdbac85ff426 None None] MFA Rules not processed for user `713098621b494c22aebfd74c05aaefd8`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:27.002147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cfc7300f-b666-434c-8e5f-fdbac85ff426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:27.123124 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1306/2599] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:22:27.138019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242a036-b7dd-4bfa-903b-42a2a03a17ca admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:27.140497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4242a036-b7dd-4bfa-903b-42a2a03a17ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:27.224594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242a036-b7dd-4bfa-903b-42a2a03a17ca admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:27.231654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856e1dd-a662-41a2-93a7-39c4efd5530e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:27.232314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856e1dd-a662-41a2-93a7-39c4efd5530e service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:27.233867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856e1dd-a662-41a2-93a7-39c4efd5530e service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:27.233867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856e1dd-a662-41a2-93a7-39c4efd5530e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:27.240852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856e1dd-a662-41a2-93a7-39c4efd5530e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:27.242435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856e1dd-a662-41a2-93a7-39c4efd5530e service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:27.251784 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1294/2600] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:22:27.261068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7300f-b666-434c-8e5f-fdbac85ff426 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:27.262714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cfc7300f-b666-434c-8e5f-fdbac85ff426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:27.404156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7300f-b666-434c-8e5f-fdbac85ff426 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:27.423168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05844ed-561e-435e-817c-71d49cdc27a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:27.424138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05844ed-561e-435e-817c-71d49cdc27a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:27.424365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05844ed-561e-435e-817c-71d49cdc27a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:27.424987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05844ed-561e-435e-817c-71d49cdc27a2 admin admin] PATH_INFO: `/v3/projects/eec791a7b8534970a7a5a6e534c1a0fb` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:27.428832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05844ed-561e-435e-817c-71d49cdc27a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec791a7b8534970a7a5a6e534c1a0fb)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:27.431383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05844ed-561e-435e-817c-71d49cdc27a2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:27.591901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f05844ed-561e-435e-817c-71d49cdc27a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec791a7b8534970a7a5a6e534c1a0fb', 'request_id': 'req-f05844ed-561e-435e-817c-71d49cdc27a2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:27.602222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f05844ed-561e-435e-817c-71d49cdc27a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec791a7b8534970a7a5a6e534c1a0fb', 'request_id': 'req-f05844ed-561e-435e-817c-71d49cdc27a2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:27.713119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f05844ed-561e-435e-817c-71d49cdc27a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec791a7b8534970a7a5a6e534c1a0fb', 'request_id': 'req-f05844ed-561e-435e-817c-71d49cdc27a2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:27.728163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f05844ed-561e-435e-817c-71d49cdc27a2 admin admin] The token cache is being invalidate because project eec791a7b8534970a7a5a6e534c1a0fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:22:27.728732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f05844ed-561e-435e-817c-71d49cdc27a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:27.729621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f05844ed-561e-435e-817c-71d49cdc27a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:27.732831 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1307/2601] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:22:27 2022] DELETE /identity/v3/projects/eec791a7b8534970a7a5a6e534c1a0fb => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:27.736550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc05f84-9812-4000-b6c2-e8fab2c12f91 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:27.736969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc05f84-9812-4000-b6c2-e8fab2c12f91 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:27.737885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc05f84-9812-4000-b6c2-e8fab2c12f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:27.763299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-cdc05f84-9812-4000-b6c2-e8fab2c12f91 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:27.781902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-cdc05f84-9812-4000-b6c2-e8fab2c12f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:27.918365 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1295/2602] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:22:27.918646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe95f1-ab6a-4ae2-87ba-8f31e7a98a93 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:27.919087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe95f1-ab6a-4ae2-87ba-8f31e7a98a93 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:27.919516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe95f1-ab6a-4ae2-87ba-8f31e7a98a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:27.943668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-efbe95f1-ab6a-4ae2-87ba-8f31e7a98a93 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:27.947251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-efbe95f1-ab6a-4ae2-87ba-8f31e7a98a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:27.961682 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1308/2603] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:22:27.971052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc05f84-9812-4000-b6c2-e8fab2c12f91 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:27.982573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc05f84-9812-4000-b6c2-e8fab2c12f91 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:27.995651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d680e-9f84-4327-a399-e8808e0430f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:27.996643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d680e-9f84-4327-a399-e8808e0430f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:27.997239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d680e-9f84-4327-a399-e8808e0430f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:27.997887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d680e-9f84-4327-a399-e8808e0430f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:27.998900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d680e-9f84-4327-a399-e8808e0430f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:22:27.999308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d680e-9f84-4327-a399-e8808e0430f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:28.001205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d680e-9f84-4327-a399-e8808e0430f7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:28.024590 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1296/2604] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:22:28.026097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe95f1-ab6a-4ae2-87ba-8f31e7a98a93 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:28.038611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe95f1-ab6a-4ae2-87ba-8f31e7a98a93 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:28.047033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d90c4-a16e-416b-b2cd-f40575c4fedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:28.047033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d90c4-a16e-416b-b2cd-f40575c4fedf admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:28.047033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d90c4-a16e-416b-b2cd-f40575c4fedf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:28.047864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d90c4-a16e-416b-b2cd-f40575c4fedf admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:28.048572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d90c4-a16e-416b-b2cd-f40575c4fedf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:28.053215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d90c4-a16e-416b-b2cd-f40575c4fedf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:28.243022 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1309/2605] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:22:28 2022] POST /identity/v3/projects => generated 389 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:22:28.248888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d680e-9f84-4327-a399-e8808e0430f7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:28.261666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d680e-9f84-4327-a399-e8808e0430f7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:28.338741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bf270-97af-4625-8efc-55053e99749c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:28.343125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bf270-97af-4625-8efc-55053e99749c admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:28.343125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bf270-97af-4625-8efc-55053e99749c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:28.343125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bf270-97af-4625-8efc-55053e99749c admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:28.343125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790bf270-97af-4625-8efc-55053e99749c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:28.343125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790bf270-97af-4625-8efc-55053e99749c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:28.422632 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1297/2606] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:22:28 2022] POST /identity/v3/users => generated 295 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:22:28.423973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d90c4-a16e-416b-b2cd-f40575c4fedf admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:28.434880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d90c4-a16e-416b-b2cd-f40575c4fedf admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:28.446943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a989e-efe8-421b-9129-0418dd7293a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:28.449107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a989e-efe8-421b-9129-0418dd7293a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:28.449537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a989e-efe8-421b-9129-0418dd7293a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:28.449828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a989e-efe8-421b-9129-0418dd7293a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:28.450599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a989e-efe8-421b-9129-0418dd7293a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:28.452274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a989e-efe8-421b-9129-0418dd7293a1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:28.468713 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1310/2607] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:22:28.469933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bf270-97af-4625-8efc-55053e99749c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:28.482517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bf270-97af-4625-8efc-55053e99749c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:28.487197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338e847-13ec-46ea-ba7d-b6413e3d7ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:28.487909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338e847-13ec-46ea-ba7d-b6413e3d7ffb admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:28.488199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338e847-13ec-46ea-ba7d-b6413e3d7ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:28.488479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338e847-13ec-46ea-ba7d-b6413e3d7ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:28.489254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338e847-13ec-46ea-ba7d-b6413e3d7ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:28.491236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338e847-13ec-46ea-ba7d-b6413e3d7ffb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:28.501390 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1298/2608] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:22:28.506079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a989e-efe8-421b-9129-0418dd7293a1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:28.516239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a989e-efe8-421b-9129-0418dd7293a1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:28.521487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874c5e4-db25-4a0b-941e-fb62acef3fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:28.522363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874c5e4-db25-4a0b-941e-fb62acef3fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:28.522643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874c5e4-db25-4a0b-941e-fb62acef3fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:28.522930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874c5e4-db25-4a0b-941e-fb62acef3fa1 admin admin] PATH_INFO: `/v3/projects/642189cc67754e20a2a1191c961606c5/users/c3830d74fc184ea8944f1d45331581f8/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:28.540911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874c5e4-db25-4a0b-941e-fb62acef3fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=642189cc67754e20a2a1191c961606c5, user_id=c3830d74fc184ea8944f1d45331581f8, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:28.543964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874c5e4-db25-4a0b-941e-fb62acef3fa1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:28.627295 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1311/2609] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:22:28 2022] PUT /identity/v3/projects/642189cc67754e20a2a1191c961606c5/users/c3830d74fc184ea8944f1d45331581f8/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:28.632840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e52ea-7f20-451b-8e82-40ce755eae83 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:28.633203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e52ea-7f20-451b-8e82-40ce755eae83 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:28.633551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e52ea-7f20-451b-8e82-40ce755eae83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:28.661171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-254e52ea-7f20-451b-8e82-40ce755eae83 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:28.661171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-254e52ea-7f20-451b-8e82-40ce755eae83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:28.725907 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1299/2610] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:28.735654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874c5e4-db25-4a0b-941e-fb62acef3fa1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:28.738117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0874c5e4-db25-4a0b-941e-fb62acef3fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:28.820208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874c5e4-db25-4a0b-941e-fb62acef3fa1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:28.825260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8b030-847e-4e30-a913-d530cc519bff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:28.826091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8b030-847e-4e30-a913-d530cc519bff service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:28.826508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8b030-847e-4e30-a913-d530cc519bff service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:28.827053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8b030-847e-4e30-a913-d530cc519bff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:28.840333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8b030-847e-4e30-a913-d530cc519bff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:28.842072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8b030-847e-4e30-a913-d530cc519bff service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:28.859758 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1312/2611] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:22:29.524609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e52ea-7f20-451b-8e82-40ce755eae83 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:29.526147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-254e52ea-7f20-451b-8e82-40ce755eae83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:29.540537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e52ea-7f20-451b-8e82-40ce755eae83 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:29.546067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f117d1-3e09-4c59-b02e-06f02088dcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:29.547447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f117d1-3e09-4c59-b02e-06f02088dcbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:29.547905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f117d1-3e09-4c59-b02e-06f02088dcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:29.548347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f117d1-3e09-4c59-b02e-06f02088dcbb admin admin] PATH_INFO: `/v3/users/cb3183cbca2346dd887162951f451fb1` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:29.550490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f117d1-3e09-4c59-b02e-06f02088dcbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb3183cbca2346dd887162951f451fb1)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:29.552786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f117d1-3e09-4c59-b02e-06f02088dcbb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:29.861289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-89f117d1-3e09-4c59-b02e-06f02088dcbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb3183cbca2346dd887162951f451fb1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:29.877520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-89f117d1-3e09-4c59-b02e-06f02088dcbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb3183cbca2346dd887162951f451fb1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:29.878492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-89f117d1-3e09-4c59-b02e-06f02088dcbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb3183cbca2346dd887162951f451fb1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:29.887348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-89f117d1-3e09-4c59-b02e-06f02088dcbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb3183cbca2346dd887162951f451fb1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:29.967972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-89f117d1-3e09-4c59-b02e-06f02088dcbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb3183cbca2346dd887162951f451fb1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:29.977881 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1300/2612] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:22:29 2022] DELETE /identity/v3/users/cb3183cbca2346dd887162951f451fb1 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:29.987426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc968c-182c-4632-aa00-53be3917af6c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:29.987962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc968c-182c-4632-aa00-53be3917af6c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:29.987962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc968c-182c-4632-aa00-53be3917af6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:30.008632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-eafc968c-182c-4632-aa00-53be3917af6c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:30.010337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-eafc968c-182c-4632-aa00-53be3917af6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:30.112810 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1313/2613] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:30.122242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f117d1-3e09-4c59-b02e-06f02088dcbb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:30.123927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-89f117d1-3e09-4c59-b02e-06f02088dcbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:30.183648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f117d1-3e09-4c59-b02e-06f02088dcbb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:30.187622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c210af2-8286-432b-ade1-8e3f781ba1eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:30.188269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c210af2-8286-432b-ade1-8e3f781ba1eb service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:30.188550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c210af2-8286-432b-ade1-8e3f781ba1eb service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:30.188872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c210af2-8286-432b-ade1-8e3f781ba1eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:30.203433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c210af2-8286-432b-ade1-8e3f781ba1eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:30.210870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c210af2-8286-432b-ade1-8e3f781ba1eb service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:30.229995 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1301/2614] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:22:30.602256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc968c-182c-4632-aa00-53be3917af6c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:30.604078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-eafc968c-182c-4632-aa00-53be3917af6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:30.625175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc968c-182c-4632-aa00-53be3917af6c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:30.632757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43815d8-3758-4156-a052-f1b3d6a27eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:30.634339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43815d8-3758-4156-a052-f1b3d6a27eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:30.635583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43815d8-3758-4156-a052-f1b3d6a27eec admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:30.636573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43815d8-3758-4156-a052-f1b3d6a27eec admin admin] PATH_INFO: `/v3/projects/999c6e3e38a44d369c3782428f8e0e75` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:30.638599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43815d8-3758-4156-a052-f1b3d6a27eec admin admin] RBAC: Authorizing `identity:delete_project(project_id=999c6e3e38a44d369c3782428f8e0e75)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:30.643198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43815d8-3758-4156-a052-f1b3d6a27eec admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:30.774841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c210af2-8286-432b-ade1-8e3f781ba1eb service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:30.777922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0c210af2-8286-432b-ade1-8e3f781ba1eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:30.800784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c210af2-8286-432b-ade1-8e3f781ba1eb service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:30.813605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e43815d8-3758-4156-a052-f1b3d6a27eec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '999c6e3e38a44d369c3782428f8e0e75', 'request_id': 'req-e43815d8-3758-4156-a052-f1b3d6a27eec'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:30.826846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e43815d8-3758-4156-a052-f1b3d6a27eec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '999c6e3e38a44d369c3782428f8e0e75', 'request_id': 'req-e43815d8-3758-4156-a052-f1b3d6a27eec'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:30.887284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e43815d8-3758-4156-a052-f1b3d6a27eec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '999c6e3e38a44d369c3782428f8e0e75', 'request_id': 'req-e43815d8-3758-4156-a052-f1b3d6a27eec'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:30.907027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e43815d8-3758-4156-a052-f1b3d6a27eec admin admin] The token cache is being invalidate because project 999c6e3e38a44d369c3782428f8e0e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:22:30.907372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e43815d8-3758-4156-a052-f1b3d6a27eec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:30.912362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e43815d8-3758-4156-a052-f1b3d6a27eec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:30.915014 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1314/2615] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:22:30 2022] DELETE /identity/v3/projects/999c6e3e38a44d369c3782428f8e0e75 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:30.918802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43815d8-3758-4156-a052-f1b3d6a27eec admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:30.929849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e43815d8-3758-4156-a052-f1b3d6a27eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:30.932955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c56cd4-7464-4801-b300-22032b023b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:30.934174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c56cd4-7464-4801-b300-22032b023b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:30.934684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c56cd4-7464-4801-b300-22032b023b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:30.935191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c56cd4-7464-4801-b300-22032b023b33 admin admin] PATH_INFO: `/v3/users/713098621b494c22aebfd74c05aaefd8` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:30.937099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c56cd4-7464-4801-b300-22032b023b33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=713098621b494c22aebfd74c05aaefd8)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:30.939345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c56cd4-7464-4801-b300-22032b023b33 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:30.959087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43815d8-3758-4156-a052-f1b3d6a27eec admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:30.974996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e3f69-583e-4802-ab60-64f73e714ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:30.975819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e3f69-583e-4802-ab60-64f73e714ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:30.976377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e3f69-583e-4802-ab60-64f73e714ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:30.976555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e3f69-583e-4802-ab60-64f73e714ad6 admin admin] PATH_INFO: `/v3/users/7b62473f5e5c41b3af19bb77eca46655` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:30.982194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e3f69-583e-4802-ab60-64f73e714ad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b62473f5e5c41b3af19bb77eca46655)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:30.984997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e3f69-583e-4802-ab60-64f73e714ad6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:31.210236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-07c56cd4-7464-4801-b300-22032b023b33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713098621b494c22aebfd74c05aaefd8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:31.229665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-07c56cd4-7464-4801-b300-22032b023b33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713098621b494c22aebfd74c05aaefd8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:31.230383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-07c56cd4-7464-4801-b300-22032b023b33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713098621b494c22aebfd74c05aaefd8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:31.237979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-07c56cd4-7464-4801-b300-22032b023b33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713098621b494c22aebfd74c05aaefd8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:31.285904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-130e3f69-583e-4802-ab60-64f73e714ad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b62473f5e5c41b3af19bb77eca46655'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:31.303796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-130e3f69-583e-4802-ab60-64f73e714ad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b62473f5e5c41b3af19bb77eca46655'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:31.304540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-130e3f69-583e-4802-ab60-64f73e714ad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b62473f5e5c41b3af19bb77eca46655'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:31.312904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-130e3f69-583e-4802-ab60-64f73e714ad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b62473f5e5c41b3af19bb77eca46655'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:31.366848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-07c56cd4-7464-4801-b300-22032b023b33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713098621b494c22aebfd74c05aaefd8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:31.383017 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1302/2616] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:22:30 2022] DELETE /identity/v3/users/713098621b494c22aebfd74c05aaefd8 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:31.385766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adadf5d-177d-4002-983f-95e15404fd1f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:31.386259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adadf5d-177d-4002-983f-95e15404fd1f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:31.389351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adadf5d-177d-4002-983f-95e15404fd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:31.437383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6adadf5d-177d-4002-983f-95e15404fd1f None None] MFA Rules not processed for user `662c15e746b84fdbb497d700c9288931`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:31.438866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6adadf5d-177d-4002-983f-95e15404fd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:31.444443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-130e3f69-583e-4802-ab60-64f73e714ad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b62473f5e5c41b3af19bb77eca46655'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:31.455656 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1315/2617] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:22:30 2022] DELETE /identity/v3/users/7b62473f5e5c41b3af19bb77eca46655 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:31.458658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62a40a-e8ff-4f0c-9f58-c1dfaf32302f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:31.459175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62a40a-e8ff-4f0c-9f58-c1dfaf32302f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:31.460415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62a40a-e8ff-4f0c-9f58-c1dfaf32302f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:31.501483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5c62a40a-e8ff-4f0c-9f58-c1dfaf32302f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:31.502882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5c62a40a-e8ff-4f0c-9f58-c1dfaf32302f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:31.599700 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1303/2618] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:31.646957 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1316/2619] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:31.677559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adadf5d-177d-4002-983f-95e15404fd1f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:31.683175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6adadf5d-177d-4002-983f-95e15404fd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:31.837647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adadf5d-177d-4002-983f-95e15404fd1f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:31.909680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109941c-5b6c-4bc5-9637-e6614dd3aefc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:31.911294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109941c-5b6c-4bc5-9637-e6614dd3aefc service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:31.911294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109941c-5b6c-4bc5-9637-e6614dd3aefc service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:31.911294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109941c-5b6c-4bc5-9637-e6614dd3aefc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:31.923480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109941c-5b6c-4bc5-9637-e6614dd3aefc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:31.925660 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109941c-5b6c-4bc5-9637-e6614dd3aefc service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:31.944398 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1304/2620] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:22:32.221908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62a40a-e8ff-4f0c-9f58-c1dfaf32302f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:32.225851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5c62a40a-e8ff-4f0c-9f58-c1dfaf32302f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:32.248155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62a40a-e8ff-4f0c-9f58-c1dfaf32302f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:32.266879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927865a0-d3a2-477b-b66f-fbc2d0c8bb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:32.267922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927865a0-d3a2-477b-b66f-fbc2d0c8bb11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:32.268222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927865a0-d3a2-477b-b66f-fbc2d0c8bb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:32.268687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927865a0-d3a2-477b-b66f-fbc2d0c8bb11 admin admin] PATH_INFO: `/v3/projects/b61e9bcfa5fd47d296c86f5f3f1300cd` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:32.273474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927865a0-d3a2-477b-b66f-fbc2d0c8bb11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b61e9bcfa5fd47d296c86f5f3f1300cd)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:32.275994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927865a0-d3a2-477b-b66f-fbc2d0c8bb11 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:32.482054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-927865a0-d3a2-477b-b66f-fbc2d0c8bb11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b61e9bcfa5fd47d296c86f5f3f1300cd', 'request_id': 'req-927865a0-d3a2-477b-b66f-fbc2d0c8bb11'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:32.493306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-927865a0-d3a2-477b-b66f-fbc2d0c8bb11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b61e9bcfa5fd47d296c86f5f3f1300cd', 'request_id': 'req-927865a0-d3a2-477b-b66f-fbc2d0c8bb11'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:32.590126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-927865a0-d3a2-477b-b66f-fbc2d0c8bb11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b61e9bcfa5fd47d296c86f5f3f1300cd', 'request_id': 'req-927865a0-d3a2-477b-b66f-fbc2d0c8bb11'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:32.635001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-927865a0-d3a2-477b-b66f-fbc2d0c8bb11 admin admin] The token cache is being invalidate because project b61e9bcfa5fd47d296c86f5f3f1300cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:22:32.635313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-927865a0-d3a2-477b-b66f-fbc2d0c8bb11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:32.640443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-927865a0-d3a2-477b-b66f-fbc2d0c8bb11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:32.650765 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1317/2621] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:22:32 2022] DELETE /identity/v3/projects/b61e9bcfa5fd47d296c86f5f3f1300cd => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:32.657052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05f520-516a-4b04-a1d7-bf16f4bb8bc0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:32.657386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05f520-516a-4b04-a1d7-bf16f4bb8bc0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:32.657639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05f520-516a-4b04-a1d7-bf16f4bb8bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:32.685292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-7c05f520-516a-4b04-a1d7-bf16f4bb8bc0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:32.687052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7c05f520-516a-4b04-a1d7-bf16f4bb8bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:32.793348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91c044-f25a-4d2b-afa2-14cbe8e82473 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:32.797703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91c044-f25a-4d2b-afa2-14cbe8e82473 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:32.797703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91c044-f25a-4d2b-afa2-14cbe8e82473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:32.798610 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1305/2622] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:32.821629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9f91c044-f25a-4d2b-afa2-14cbe8e82473 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:32.833431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9f91c044-f25a-4d2b-afa2-14cbe8e82473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:32.848662 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1318/2623] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:32.850056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05f520-516a-4b04-a1d7-bf16f4bb8bc0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:32.863511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05f520-516a-4b04-a1d7-bf16f4bb8bc0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:32.869508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16df447-f3a2-4a92-a6d9-7f7646f8367e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:32.870297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16df447-f3a2-4a92-a6d9-7f7646f8367e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:32.870583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16df447-f3a2-4a92-a6d9-7f7646f8367e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:32.870864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16df447-f3a2-4a92-a6d9-7f7646f8367e admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:32.873366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16df447-f3a2-4a92-a6d9-7f7646f8367e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:22:32.873366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16df447-f3a2-4a92-a6d9-7f7646f8367e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:32.880406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16df447-f3a2-4a92-a6d9-7f7646f8367e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:32.908706 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1306/2624] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:22:32.910598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91c044-f25a-4d2b-afa2-14cbe8e82473 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:32.924190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91c044-f25a-4d2b-afa2-14cbe8e82473 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:32.932725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed855116-81cf-4e41-a59b-0f07e4f2c18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:32.933834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed855116-81cf-4e41-a59b-0f07e4f2c18d admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:32.934200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed855116-81cf-4e41-a59b-0f07e4f2c18d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:32.934563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed855116-81cf-4e41-a59b-0f07e4f2c18d admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:32.935345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed855116-81cf-4e41-a59b-0f07e4f2c18d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:32.938791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed855116-81cf-4e41-a59b-0f07e4f2c18d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:33.060586 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1319/2625] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:22:32 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:22:33.063448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16df447-f3a2-4a92-a6d9-7f7646f8367e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:33.075266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16df447-f3a2-4a92-a6d9-7f7646f8367e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:33.216388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e9a34-2077-4439-82e2-9b7b39ca6a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:33.217305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e9a34-2077-4439-82e2-9b7b39ca6a7a admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:33.217775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e9a34-2077-4439-82e2-9b7b39ca6a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:33.218453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e9a34-2077-4439-82e2-9b7b39ca6a7a admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:33.219345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e9a34-2077-4439-82e2-9b7b39ca6a7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:33.221835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e9a34-2077-4439-82e2-9b7b39ca6a7a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:33.365137 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1307/2626] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:22:33 2022] POST /identity/v3/users => generated 294 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:22:33.370068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed855116-81cf-4e41-a59b-0f07e4f2c18d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:33.389321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed855116-81cf-4e41-a59b-0f07e4f2c18d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:33.402540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98dc97-1ebe-4e53-847e-01f74540680a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:33.403367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98dc97-1ebe-4e53-847e-01f74540680a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:33.403656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98dc97-1ebe-4e53-847e-01f74540680a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:33.403929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98dc97-1ebe-4e53-847e-01f74540680a admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:33.404867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98dc97-1ebe-4e53-847e-01f74540680a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:33.408842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98dc97-1ebe-4e53-847e-01f74540680a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:33.447759 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1320/2627] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:22:33.452097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e9a34-2077-4439-82e2-9b7b39ca6a7a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:33.472879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e9a34-2077-4439-82e2-9b7b39ca6a7a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:33.478687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444342c3-0dfb-44c3-9d5c-82fbb4f7658c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:33.479746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444342c3-0dfb-44c3-9d5c-82fbb4f7658c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:33.480276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444342c3-0dfb-44c3-9d5c-82fbb4f7658c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:33.480830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444342c3-0dfb-44c3-9d5c-82fbb4f7658c admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:33.481768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444342c3-0dfb-44c3-9d5c-82fbb4f7658c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:33.483609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444342c3-0dfb-44c3-9d5c-82fbb4f7658c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:33.495554 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1308/2628] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:22:33.500312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98dc97-1ebe-4e53-847e-01f74540680a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:33.512154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98dc97-1ebe-4e53-847e-01f74540680a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:33.517784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1d77e-22bf-4c88-b56c-e7ccb4eefa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:33.518977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1d77e-22bf-4c88-b56c-e7ccb4eefa05 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:33.519318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1d77e-22bf-4c88-b56c-e7ccb4eefa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:33.519598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1d77e-22bf-4c88-b56c-e7ccb4eefa05 admin admin] PATH_INFO: `/v3/projects/120ab30a31794f19bdf25abd4b8e2998/users/f5148ce2d0d54b6997d0982f88328936/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:33.535510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1d77e-22bf-4c88-b56c-e7ccb4eefa05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=120ab30a31794f19bdf25abd4b8e2998, user_id=f5148ce2d0d54b6997d0982f88328936, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:33.538202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1d77e-22bf-4c88-b56c-e7ccb4eefa05 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:33.596359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444342c3-0dfb-44c3-9d5c-82fbb4f7658c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:33.599320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-444342c3-0dfb-44c3-9d5c-82fbb4f7658c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:33.619038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444342c3-0dfb-44c3-9d5c-82fbb4f7658c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:33.642822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb7403-64fa-4c15-ac31-a7bb4b0da484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:33.644373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb7403-64fa-4c15-ac31-a7bb4b0da484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:33.645815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb7403-64fa-4c15-ac31-a7bb4b0da484 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:33.646854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb7403-64fa-4c15-ac31-a7bb4b0da484 admin admin] PATH_INFO: `/v3/projects/1f8417cf4382458ca38ede18c333244e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:33.648853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb7403-64fa-4c15-ac31-a7bb4b0da484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f8417cf4382458ca38ede18c333244e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:33.651744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb7403-64fa-4c15-ac31-a7bb4b0da484 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:33.673180 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1321/2629] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:22:33 2022] PUT /identity/v3/projects/120ab30a31794f19bdf25abd4b8e2998/users/f5148ce2d0d54b6997d0982f88328936/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:22:33.685126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e26824-469a-476e-84ff-fd6e0926633e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:33.685426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e26824-469a-476e-84ff-fd6e0926633e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:33.685888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e26824-469a-476e-84ff-fd6e0926633e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:33.774662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-62e26824-469a-476e-84ff-fd6e0926633e None None] MFA Rules not processed for user `f5148ce2d0d54b6997d0982f88328936`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:33.786715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-62e26824-469a-476e-84ff-fd6e0926633e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:33.878306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ffb7403-64fa-4c15-ac31-a7bb4b0da484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f8417cf4382458ca38ede18c333244e', 'request_id': 'req-8ffb7403-64fa-4c15-ac31-a7bb4b0da484'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:33.909547 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1322/2630] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:33.913737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e26824-469a-476e-84ff-fd6e0926633e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:33.983729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ffb7403-64fa-4c15-ac31-a7bb4b0da484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f8417cf4382458ca38ede18c333244e', 'request_id': 'req-8ffb7403-64fa-4c15-ac31-a7bb4b0da484'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:33.996403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ffb7403-64fa-4c15-ac31-a7bb4b0da484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f8417cf4382458ca38ede18c333244e', 'request_id': 'req-8ffb7403-64fa-4c15-ac31-a7bb4b0da484'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:34.024636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ffb7403-64fa-4c15-ac31-a7bb4b0da484 admin admin] The token cache is being invalidate because project 1f8417cf4382458ca38ede18c333244e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:22:34.026181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ffb7403-64fa-4c15-ac31-a7bb4b0da484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:34.026519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e26824-469a-476e-84ff-fd6e0926633e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:34.028342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ffb7403-64fa-4c15-ac31-a7bb4b0da484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:34.031726 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1309/2631] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:22:33 2022] DELETE /identity/v3/projects/1f8417cf4382458ca38ede18c333244e => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:34.054591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d8e36-d424-4f25-8d6f-a4c108ec1612 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:34.056863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d8e36-d424-4f25-8d6f-a4c108ec1612 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:34.057417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d8e36-d424-4f25-8d6f-a4c108ec1612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:34.090693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9d5d8e36-d424-4f25-8d6f-a4c108ec1612 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:34.092212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9d5d8e36-d424-4f25-8d6f-a4c108ec1612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:34.134683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c4bac-e00b-4f6b-b9b0-98e117b65cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:34.135895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c4bac-e00b-4f6b-b9b0-98e117b65cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:34.137414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c4bac-e00b-4f6b-b9b0-98e117b65cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:34.137925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c4bac-e00b-4f6b-b9b0-98e117b65cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:34.139126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c4bac-e00b-4f6b-b9b0-98e117b65cb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:34.141581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c4bac-e00b-4f6b-b9b0-98e117b65cb4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:34.243383 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1310/2632] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:34.252262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9f9d3-96ec-46a3-9100-35ae647a594c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:34.252558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9f9d3-96ec-46a3-9100-35ae647a594c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:34.252920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9f9d3-96ec-46a3-9100-35ae647a594c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:34.260631 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1323/2633] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:22:33 2022] POST /identity/v3/projects => generated 385 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:22:34.265245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c4bac-e00b-4f6b-b9b0-98e117b65cb4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:34.276498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-869c4bac-e00b-4f6b-b9b0-98e117b65cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:34.307198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9ca9f9d3-96ec-46a3-9100-35ae647a594c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:34.312077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9ca9f9d3-96ec-46a3-9100-35ae647a594c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:34.385245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c4bac-e00b-4f6b-b9b0-98e117b65cb4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:34.391304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4917dce-33f9-4316-b942-39b0082fb66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:34.392392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4917dce-33f9-4316-b942-39b0082fb66b admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:34.393193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4917dce-33f9-4316-b942-39b0082fb66b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:34.393810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4917dce-33f9-4316-b942-39b0082fb66b admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:34.394693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4917dce-33f9-4316-b942-39b0082fb66b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:34.397737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4917dce-33f9-4316-b942-39b0082fb66b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:34.493810 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1324/2634] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:22:34 2022] POST /identity/v3/users => generated 299 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:22:34.498737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4917dce-33f9-4316-b942-39b0082fb66b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:34.523347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4917dce-33f9-4316-b942-39b0082fb66b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:34.525663 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1311/2635] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:34.534695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9f9d3-96ec-46a3-9100-35ae647a594c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:34.538758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1c6e6-a9ba-4cb1-8f89-f5bd8f97cbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:34.539884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1c6e6-a9ba-4cb1-8f89-f5bd8f97cbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:34.540250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1c6e6-a9ba-4cb1-8f89-f5bd8f97cbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:34.542401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1c6e6-a9ba-4cb1-8f89-f5bd8f97cbc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:34.543252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1c6e6-a9ba-4cb1-8f89-f5bd8f97cbc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:34.548973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9f9d3-96ec-46a3-9100-35ae647a594c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:34.553393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1c6e6-a9ba-4cb1-8f89-f5bd8f97cbc8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:34.564000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10794ea6-f412-4765-bf83-73b730d903ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:34.565099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10794ea6-f412-4765-bf83-73b730d903ff admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:34.566166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10794ea6-f412-4765-bf83-73b730d903ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:34.566640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10794ea6-f412-4765-bf83-73b730d903ff admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:34.567605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10794ea6-f412-4765-bf83-73b730d903ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:22:34.568133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10794ea6-f412-4765-bf83-73b730d903ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:34.570268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10794ea6-f412-4765-bf83-73b730d903ff admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:34.593389 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1325/2636] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:22:34.595282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1c6e6-a9ba-4cb1-8f89-f5bd8f97cbc8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:34.601567 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1312/2637] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:22:34.605489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10794ea6-f412-4765-bf83-73b730d903ff admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:34.623722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10794ea6-f412-4765-bf83-73b730d903ff admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:34.630876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1c6e6-a9ba-4cb1-8f89-f5bd8f97cbc8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:34.637023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec6e8a-a9bc-4768-b91c-c3646717e927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:34.637904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec6e8a-a9bc-4768-b91c-c3646717e927 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:34.638202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec6e8a-a9bc-4768-b91c-c3646717e927 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:34.638512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec6e8a-a9bc-4768-b91c-c3646717e927 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:34.639230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec6e8a-a9bc-4768-b91c-c3646717e927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:34.644434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec6e8a-a9bc-4768-b91c-c3646717e927 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:34.646985 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503f67e-3271-429d-b074-2576d9e0ede8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:34.650571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503f67e-3271-429d-b074-2576d9e0ede8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:34.650870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503f67e-3271-429d-b074-2576d9e0ede8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:34.651160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503f67e-3271-429d-b074-2576d9e0ede8 admin admin] PATH_INFO: `/v3/projects/822f558fd5db4958a1a71d67fb468462/users/4b0fc8fa64e44df3b08518e5cab9ef91/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:34.700649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503f67e-3271-429d-b074-2576d9e0ede8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=822f558fd5db4958a1a71d67fb468462, user_id=4b0fc8fa64e44df3b08518e5cab9ef91, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:34.708862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503f67e-3271-429d-b074-2576d9e0ede8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:34.811180 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1313/2638] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:22:34 2022] POST /identity/v3/projects => generated 395 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:22:34.815515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec6e8a-a9bc-4768-b91c-c3646717e927 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:34.844377 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1326/2639] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:22:34 2022] PUT /identity/v3/projects/822f558fd5db4958a1a71d67fb468462/users/4b0fc8fa64e44df3b08518e5cab9ef91/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:34.845516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503f67e-3271-429d-b074-2576d9e0ede8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:34.948884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec6e8a-a9bc-4768-b91c-c3646717e927 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:34.991954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503f67e-3271-429d-b074-2576d9e0ede8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:35.012306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242ebf8-e495-49e5-9e49-18a3a621ce30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:35.013137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242ebf8-e495-49e5-9e49-18a3a621ce30 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:35.014369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242ebf8-e495-49e5-9e49-18a3a621ce30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:35.014369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242ebf8-e495-49e5-9e49-18a3a621ce30 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:35.015107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242ebf8-e495-49e5-9e49-18a3a621ce30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:35.028224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242ebf8-e495-49e5-9e49-18a3a621ce30 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:35.032640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72453c41-46b5-486a-b27d-4d79cef74174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:35.034487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72453c41-46b5-486a-b27d-4d79cef74174 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:35.035101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72453c41-46b5-486a-b27d-4d79cef74174 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:35.035831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72453c41-46b5-486a-b27d-4d79cef74174 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:35.036919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72453c41-46b5-486a-b27d-4d79cef74174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:35.039219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72453c41-46b5-486a-b27d-4d79cef74174 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:35.053410 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1327/2640] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:22:35.054776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242ebf8-e495-49e5-9e49-18a3a621ce30 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:35.068181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242ebf8-e495-49e5-9e49-18a3a621ce30 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:35.074379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b12c7-623c-4512-bc74-e7ac4e54622e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:35.075297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b12c7-623c-4512-bc74-e7ac4e54622e admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:35.075580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b12c7-623c-4512-bc74-e7ac4e54622e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:35.075860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b12c7-623c-4512-bc74-e7ac4e54622e admin admin] PATH_INFO: `/v3/projects/822f558fd5db4958a1a71d67fb468462/users/4b0fc8fa64e44df3b08518e5cab9ef91/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:35.078078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b12c7-623c-4512-bc74-e7ac4e54622e admin admin] RBAC: Authorizing `identity:create_grant(project_id=822f558fd5db4958a1a71d67fb468462, user_id=4b0fc8fa64e44df3b08518e5cab9ef91, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:35.081384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b12c7-623c-4512-bc74-e7ac4e54622e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:35.110513 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1328/2641] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:22:35 2022] PUT /identity/v3/projects/822f558fd5db4958a1a71d67fb468462/users/4b0fc8fa64e44df3b08518e5cab9ef91/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:22:35.120960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315a5f8-072f-42ff-9076-f568dde42953 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:35.121846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315a5f8-072f-42ff-9076-f568dde42953 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:35.121846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315a5f8-072f-42ff-9076-f568dde42953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:35.163421 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1314/2642] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:22:34 2022] POST /identity/v3/users => generated 298 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:22:35.168061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72453c41-46b5-486a-b27d-4d79cef74174 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:35.191150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72453c41-46b5-486a-b27d-4d79cef74174 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:35.194546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9315a5f8-072f-42ff-9076-f568dde42953 None None] MFA Rules not processed for user `4b0fc8fa64e44df3b08518e5cab9ef91`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:35.195837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9315a5f8-072f-42ff-9076-f568dde42953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:35.315136 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1329/2643] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:35.326234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af50fc-9a6a-41b2-a0dd-3db1f92da034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:35.326933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af50fc-9a6a-41b2-a0dd-3db1f92da034 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:35.327226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af50fc-9a6a-41b2-a0dd-3db1f92da034 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:35.327509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af50fc-9a6a-41b2-a0dd-3db1f92da034 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:35.329811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af50fc-9a6a-41b2-a0dd-3db1f92da034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:35.333110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af50fc-9a6a-41b2-a0dd-3db1f92da034 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:35.347180 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1315/2644] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:22:35.352271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315a5f8-072f-42ff-9076-f568dde42953 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:35.368395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315a5f8-072f-42ff-9076-f568dde42953 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:35.375818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af50fc-9a6a-41b2-a0dd-3db1f92da034 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:35.379339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-75af50fc-9a6a-41b2-a0dd-3db1f92da034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:35.386370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887a79e-2296-4e46-a5ef-13bd822957ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:35.386370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887a79e-2296-4e46-a5ef-13bd822957ca admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:35.386699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887a79e-2296-4e46-a5ef-13bd822957ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:35.387036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887a79e-2296-4e46-a5ef-13bd822957ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:35.387859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887a79e-2296-4e46-a5ef-13bd822957ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:35.389734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887a79e-2296-4e46-a5ef-13bd822957ca admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:35.404345 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1330/2645] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:22:35.410964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887a79e-2296-4e46-a5ef-13bd822957ca admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:35.439498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887a79e-2296-4e46-a5ef-13bd822957ca admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:35.453124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f230a53-c01e-4a4b-b72e-c519dbfa509b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:35.454147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f230a53-c01e-4a4b-b72e-c519dbfa509b admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:35.454706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f230a53-c01e-4a4b-b72e-c519dbfa509b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:35.456874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f230a53-c01e-4a4b-b72e-c519dbfa509b admin admin] PATH_INFO: `/v3/projects/38cdc00227934f51aae6a768746bdddf/users/396f40d05bf14293aaef2a2463a3d226/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:35.495720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f230a53-c01e-4a4b-b72e-c519dbfa509b admin admin] RBAC: Authorizing `identity:create_grant(project_id=38cdc00227934f51aae6a768746bdddf, user_id=396f40d05bf14293aaef2a2463a3d226, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:35.498802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f230a53-c01e-4a4b-b72e-c519dbfa509b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:35.552594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af50fc-9a6a-41b2-a0dd-3db1f92da034 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:35.567166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8a300-a639-4ebb-9a2d-0248f65a15e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:35.568098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8a300-a639-4ebb-9a2d-0248f65a15e2 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:35.568536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8a300-a639-4ebb-9a2d-0248f65a15e2 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:35.568947 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8a300-a639-4ebb-9a2d-0248f65a15e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:35.586168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8a300-a639-4ebb-9a2d-0248f65a15e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:35.588518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8a300-a639-4ebb-9a2d-0248f65a15e2 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:35.601441 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1316/2646] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:22:35.634136 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1331/2647] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:22:35 2022] PUT /identity/v3/projects/38cdc00227934f51aae6a768746bdddf/users/396f40d05bf14293aaef2a2463a3d226/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:35.652188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ba43d-e9ef-42a7-a1bf-849e4a85ce1c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:35.652484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ba43d-e9ef-42a7-a1bf-849e4a85ce1c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:35.653049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ba43d-e9ef-42a7-a1bf-849e4a85ce1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:35.675842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d66ba43d-e9ef-42a7-a1bf-849e4a85ce1c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:35.677650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d66ba43d-e9ef-42a7-a1bf-849e4a85ce1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:35.813524 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1317/2648] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:35.870215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f230a53-c01e-4a4b-b72e-c519dbfa509b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:35.875557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1f230a53-c01e-4a4b-b72e-c519dbfa509b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:36.021692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f230a53-c01e-4a4b-b72e-c519dbfa509b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:36.033787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03209ee8-7e7d-4457-8666-b283d6bdace5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:36.034666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03209ee8-7e7d-4457-8666-b283d6bdace5 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:36.035010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03209ee8-7e7d-4457-8666-b283d6bdace5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:36.035325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03209ee8-7e7d-4457-8666-b283d6bdace5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:36.061425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03209ee8-7e7d-4457-8666-b283d6bdace5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:36.064328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03209ee8-7e7d-4457-8666-b283d6bdace5 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:36.115668 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1332/2649] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:22:38.249417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146def3-010c-4eeb-af1c-1efb35017e4c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:38.249949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146def3-010c-4eeb-af1c-1efb35017e4c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:38.249949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146def3-010c-4eeb-af1c-1efb35017e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:38.297617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2146def3-010c-4eeb-af1c-1efb35017e4c None None] MFA Rules not processed for user `396f40d05bf14293aaef2a2463a3d226`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:38.303265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2146def3-010c-4eeb-af1c-1efb35017e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:38.465862 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1318/2650] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:38.484950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03209ee8-7e7d-4457-8666-b283d6bdace5 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:38.591766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03209ee8-7e7d-4457-8666-b283d6bdace5 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:38.599071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc05809-b4db-419b-9ada-77f211539594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:38.601357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc05809-b4db-419b-9ada-77f211539594 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:38.601653 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc05809-b4db-419b-9ada-77f211539594 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:38.601931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc05809-b4db-419b-9ada-77f211539594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:38.611794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc05809-b4db-419b-9ada-77f211539594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:38.614053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc05809-b4db-419b-9ada-77f211539594 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:38.625712 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1333/2651] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:22:38.723687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146def3-010c-4eeb-af1c-1efb35017e4c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:38.740386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146def3-010c-4eeb-af1c-1efb35017e4c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:38.747080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c56de-3b44-41f0-b52f-2855775d3f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:38.748233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c56de-3b44-41f0-b52f-2855775d3f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:38.749277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c56de-3b44-41f0-b52f-2855775d3f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:38.749277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c56de-3b44-41f0-b52f-2855775d3f7b admin admin] PATH_INFO: `/v3/users/f5148ce2d0d54b6997d0982f88328936` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:38.751171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c56de-3b44-41f0-b52f-2855775d3f7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5148ce2d0d54b6997d0982f88328936)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:38.753628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c56de-3b44-41f0-b52f-2855775d3f7b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:39.028115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-523c56de-3b44-41f0-b52f-2855775d3f7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5148ce2d0d54b6997d0982f88328936'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:39.048520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-523c56de-3b44-41f0-b52f-2855775d3f7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5148ce2d0d54b6997d0982f88328936'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:39.049884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-523c56de-3b44-41f0-b52f-2855775d3f7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5148ce2d0d54b6997d0982f88328936'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:39.060095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-523c56de-3b44-41f0-b52f-2855775d3f7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5148ce2d0d54b6997d0982f88328936'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:39.162425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-523c56de-3b44-41f0-b52f-2855775d3f7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5148ce2d0d54b6997d0982f88328936'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:39.174210 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1319/2652] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:22:38 2022] DELETE /identity/v3/users/f5148ce2d0d54b6997d0982f88328936 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:39.177215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edaab6-2335-41f1-88b5-13343701fe62 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:39.177591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edaab6-2335-41f1-88b5-13343701fe62 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:39.177941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edaab6-2335-41f1-88b5-13343701fe62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:39.199669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b5edaab6-2335-41f1-88b5-13343701fe62 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:39.201412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b5edaab6-2335-41f1-88b5-13343701fe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:39.269522 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1334/2653] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:39.280148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c56de-3b44-41f0-b52f-2855775d3f7b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:39.281856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-523c56de-3b44-41f0-b52f-2855775d3f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:39.350049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c56de-3b44-41f0-b52f-2855775d3f7b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:39.354735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2450188-909c-447d-8c19-852982f2c518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:39.355409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2450188-909c-447d-8c19-852982f2c518 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:39.355975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2450188-909c-447d-8c19-852982f2c518 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:39.356266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2450188-909c-447d-8c19-852982f2c518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:39.368789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2450188-909c-447d-8c19-852982f2c518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:39.370428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2450188-909c-447d-8c19-852982f2c518 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:39.381589 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1320/2654] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:22:39.727659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67b181-b425-422d-9e9d-9bbe0d912475 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:39.728111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67b181-b425-422d-9e9d-9bbe0d912475 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:39.728208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67b181-b425-422d-9e9d-9bbe0d912475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:39.786724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ea67b181-b425-422d-9e9d-9bbe0d912475 None None] MFA Rules not processed for user `c3830d74fc184ea8944f1d45331581f8`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:39.788053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ea67b181-b425-422d-9e9d-9bbe0d912475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:39.866204 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1335/2655] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:22:39.878018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2450188-909c-447d-8c19-852982f2c518 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:39.879353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e2450188-909c-447d-8c19-852982f2c518 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:39.978211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67b181-b425-422d-9e9d-9bbe0d912475 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:39.980988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ea67b181-b425-422d-9e9d-9bbe0d912475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:39.990341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2450188-909c-447d-8c19-852982f2c518 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:39.998699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8751a9-0cff-44e4-8004-569f67263eca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:39.999783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8751a9-0cff-44e4-8004-569f67263eca service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:40.009956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8751a9-0cff-44e4-8004-569f67263eca service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:40.010260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8751a9-0cff-44e4-8004-569f67263eca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:40.012502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67b181-b425-422d-9e9d-9bbe0d912475 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:40.020402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986a215-2549-4766-8636-a5361a6defca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:40.022187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986a215-2549-4766-8636-a5361a6defca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:40.022530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986a215-2549-4766-8636-a5361a6defca admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:40.022816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986a215-2549-4766-8636-a5361a6defca admin admin] PATH_INFO: `/v3/projects/120ab30a31794f19bdf25abd4b8e2998` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:40.024246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986a215-2549-4766-8636-a5361a6defca admin admin] RBAC: Authorizing `identity:delete_project(project_id=120ab30a31794f19bdf25abd4b8e2998)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:40.029706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8751a9-0cff-44e4-8004-569f67263eca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:40.030614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986a215-2549-4766-8636-a5361a6defca admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:40.032344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8751a9-0cff-44e4-8004-569f67263eca service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:40.050140 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1321/2656] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:22:40.248895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b986a215-2549-4766-8636-a5361a6defca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '120ab30a31794f19bdf25abd4b8e2998', 'request_id': 'req-b986a215-2549-4766-8636-a5361a6defca'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:40.287158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b986a215-2549-4766-8636-a5361a6defca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '120ab30a31794f19bdf25abd4b8e2998', 'request_id': 'req-b986a215-2549-4766-8636-a5361a6defca'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:40.418647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b986a215-2549-4766-8636-a5361a6defca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '120ab30a31794f19bdf25abd4b8e2998', 'request_id': 'req-b986a215-2549-4766-8636-a5361a6defca'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:40.447947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b986a215-2549-4766-8636-a5361a6defca admin admin] The token cache is being invalidate because project 120ab30a31794f19bdf25abd4b8e2998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:22:40.448648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b986a215-2549-4766-8636-a5361a6defca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:40.449342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b986a215-2549-4766-8636-a5361a6defca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:40.456521 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1336/2657] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:22:39 2022] DELETE /identity/v3/projects/120ab30a31794f19bdf25abd4b8e2998 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:40.464752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8751a9-0cff-44e4-8004-569f67263eca service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:40.495828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8751a9-0cff-44e4-8004-569f67263eca service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:40.584642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df9414-e0a3-4ed2-8cf5-9e0619ec81b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:40.585802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df9414-e0a3-4ed2-8cf5-9e0619ec81b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:40.586263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df9414-e0a3-4ed2-8cf5-9e0619ec81b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:40.586702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df9414-e0a3-4ed2-8cf5-9e0619ec81b3 admin admin] PATH_INFO: `/v3/users/4b0fc8fa64e44df3b08518e5cab9ef91` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:40.588259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df9414-e0a3-4ed2-8cf5-9e0619ec81b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b0fc8fa64e44df3b08518e5cab9ef91)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:40.590431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df9414-e0a3-4ed2-8cf5-9e0619ec81b3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:40.871980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-28df9414-e0a3-4ed2-8cf5-9e0619ec81b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b0fc8fa64e44df3b08518e5cab9ef91'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:40.896291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-28df9414-e0a3-4ed2-8cf5-9e0619ec81b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b0fc8fa64e44df3b08518e5cab9ef91'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:40.897182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-28df9414-e0a3-4ed2-8cf5-9e0619ec81b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b0fc8fa64e44df3b08518e5cab9ef91'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:40.917427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-28df9414-e0a3-4ed2-8cf5-9e0619ec81b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b0fc8fa64e44df3b08518e5cab9ef91'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:40.998418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-28df9414-e0a3-4ed2-8cf5-9e0619ec81b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b0fc8fa64e44df3b08518e5cab9ef91'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:41.006441 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1322/2658] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:22:40 2022] DELETE /identity/v3/users/4b0fc8fa64e44df3b08518e5cab9ef91 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:41.153028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986a215-2549-4766-8636-a5361a6defca admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:41.154968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b986a215-2549-4766-8636-a5361a6defca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:41.169904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986a215-2549-4766-8636-a5361a6defca admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:41.242184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44544ce-2769-46fd-938a-773c22ec006c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:41.243127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44544ce-2769-46fd-938a-773c22ec006c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:41.243424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44544ce-2769-46fd-938a-773c22ec006c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:41.244168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44544ce-2769-46fd-938a-773c22ec006c admin admin] PATH_INFO: `/v3/users/396f40d05bf14293aaef2a2463a3d226` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:41.245706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44544ce-2769-46fd-938a-773c22ec006c admin admin] RBAC: Authorizing `identity:delete_user(user_id=396f40d05bf14293aaef2a2463a3d226)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:41.249790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44544ce-2769-46fd-938a-773c22ec006c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:41.501527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f44544ce-2769-46fd-938a-773c22ec006c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '396f40d05bf14293aaef2a2463a3d226'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:41.523550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f44544ce-2769-46fd-938a-773c22ec006c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '396f40d05bf14293aaef2a2463a3d226'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:41.523550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f44544ce-2769-46fd-938a-773c22ec006c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '396f40d05bf14293aaef2a2463a3d226'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:41.532531 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f44544ce-2769-46fd-938a-773c22ec006c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '396f40d05bf14293aaef2a2463a3d226'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:41.603724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f44544ce-2769-46fd-938a-773c22ec006c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '396f40d05bf14293aaef2a2463a3d226'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:41.613934 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1337/2659] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:22:41 2022] DELETE /identity/v3/users/396f40d05bf14293aaef2a2463a3d226 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:41.907822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df9414-e0a3-4ed2-8cf5-9e0619ec81b3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:41.910394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-28df9414-e0a3-4ed2-8cf5-9e0619ec81b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:41.944026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df9414-e0a3-4ed2-8cf5-9e0619ec81b3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:42.028057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7796e-6a3d-4d5f-8180-24225e403798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:42.029289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7796e-6a3d-4d5f-8180-24225e403798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:42.029704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7796e-6a3d-4d5f-8180-24225e403798 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:42.030085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7796e-6a3d-4d5f-8180-24225e403798 admin admin] PATH_INFO: `/v3/projects/822f558fd5db4958a1a71d67fb468462` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:42.031518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7796e-6a3d-4d5f-8180-24225e403798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=822f558fd5db4958a1a71d67fb468462)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:42.034557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7796e-6a3d-4d5f-8180-24225e403798 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:42.093714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44544ce-2769-46fd-938a-773c22ec006c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:42.097781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f44544ce-2769-46fd-938a-773c22ec006c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:42.112892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44544ce-2769-46fd-938a-773c22ec006c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:42.123443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6875e88-7408-435e-8108-860b8c446b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:42.124566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6875e88-7408-435e-8108-860b8c446b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:42.124989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6875e88-7408-435e-8108-860b8c446b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:42.125367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6875e88-7408-435e-8108-860b8c446b42 admin admin] PATH_INFO: `/v3/projects/38cdc00227934f51aae6a768746bdddf` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:42.126806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6875e88-7408-435e-8108-860b8c446b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38cdc00227934f51aae6a768746bdddf)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:42.130302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6875e88-7408-435e-8108-860b8c446b42 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:42.197305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3ce7796e-6a3d-4d5f-8180-24225e403798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '822f558fd5db4958a1a71d67fb468462', 'request_id': 'req-3ce7796e-6a3d-4d5f-8180-24225e403798'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:42.284580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3ce7796e-6a3d-4d5f-8180-24225e403798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '822f558fd5db4958a1a71d67fb468462', 'request_id': 'req-3ce7796e-6a3d-4d5f-8180-24225e403798'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:42.295626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3ce7796e-6a3d-4d5f-8180-24225e403798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '822f558fd5db4958a1a71d67fb468462', 'request_id': 'req-3ce7796e-6a3d-4d5f-8180-24225e403798'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:42.313277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3ce7796e-6a3d-4d5f-8180-24225e403798 admin admin] The token cache is being invalidate because project 822f558fd5db4958a1a71d67fb468462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:22:42.313462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3ce7796e-6a3d-4d5f-8180-24225e403798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:42.326399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3ce7796e-6a3d-4d5f-8180-24225e403798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:42.330515 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1323/2660] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:22:41 2022] DELETE /identity/v3/projects/822f558fd5db4958a1a71d67fb468462 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:42.335482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e9e3f-7f19-4024-ae36-a4b1b4438fda None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:42.335852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e9e3f-7f19-4024-ae36-a4b1b4438fda None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:42.336022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e9e3f-7f19-4024-ae36-a4b1b4438fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:42.346386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e6875e88-7408-435e-8108-860b8c446b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38cdc00227934f51aae6a768746bdddf', 'request_id': 'req-e6875e88-7408-435e-8108-860b8c446b42'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:42.357146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e6875e88-7408-435e-8108-860b8c446b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38cdc00227934f51aae6a768746bdddf', 'request_id': 'req-e6875e88-7408-435e-8108-860b8c446b42'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:42.368232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-420e9e3f-7f19-4024-ae36-a4b1b4438fda None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:42.369640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-420e9e3f-7f19-4024-ae36-a4b1b4438fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:42.468403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e6875e88-7408-435e-8108-860b8c446b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38cdc00227934f51aae6a768746bdddf', 'request_id': 'req-e6875e88-7408-435e-8108-860b8c446b42'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:42.493429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e6875e88-7408-435e-8108-860b8c446b42 admin admin] The token cache is being invalidate because project 38cdc00227934f51aae6a768746bdddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:22:42.493726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e6875e88-7408-435e-8108-860b8c446b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:42.497046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e6875e88-7408-435e-8108-860b8c446b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:42.499752 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1338/2661] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:22:42 2022] DELETE /identity/v3/projects/38cdc00227934f51aae6a768746bdddf => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:42.511109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30917ead-3f55-453d-8464-2db15b0970bb None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:42.511109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30917ead-3f55-453d-8464-2db15b0970bb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:42.511109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30917ead-3f55-453d-8464-2db15b0970bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:42.563774 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1324/2662] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:22:42.564825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-30917ead-3f55-453d-8464-2db15b0970bb None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:42.572745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-30917ead-3f55-453d-8464-2db15b0970bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:42.573333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055d182-b172-42d1-a5bc-62c286c8c77e None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:42.573625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055d182-b172-42d1-a5bc-62c286c8c77e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:42.573896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055d182-b172-42d1-a5bc-62c286c8c77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:42.610101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0055d182-b172-42d1-a5bc-62c286c8c77e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:42.610307 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1339/2663] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:42.610409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0055d182-b172-42d1-a5bc-62c286c8c77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:42.613496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee180722-4f48-4d66-9ecb-ec391bf8c2dc None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:42.614050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee180722-4f48-4d66-9ecb-ec391bf8c2dc None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:42.618693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee180722-4f48-4d66-9ecb-ec391bf8c2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:42.636519 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1325/2664] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:42.642211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055d182-b172-42d1-a5bc-62c286c8c77e None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:42.653849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055d182-b172-42d1-a5bc-62c286c8c77e None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:42.661779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ee180722-4f48-4d66-9ecb-ec391bf8c2dc None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:42.662963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ee180722-4f48-4d66-9ecb-ec391bf8c2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:42.671584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a13c8-f0fc-4be8-88d3-5eed76e34416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:42.672293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a13c8-f0fc-4be8-88d3-5eed76e34416 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:42.672578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a13c8-f0fc-4be8-88d3-5eed76e34416 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:42.672976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a13c8-f0fc-4be8-88d3-5eed76e34416 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:42.673724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a13c8-f0fc-4be8-88d3-5eed76e34416 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:22:42.674037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a13c8-f0fc-4be8-88d3-5eed76e34416 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:42.679042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a13c8-f0fc-4be8-88d3-5eed76e34416 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:42.680939 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1340/2665] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:22:42.686526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee180722-4f48-4d66-9ecb-ec391bf8c2dc None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:42.703528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee180722-4f48-4d66-9ecb-ec391bf8c2dc None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:42.717386 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1326/2666] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:22:42.721293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a13c8-f0fc-4be8-88d3-5eed76e34416 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:42.723171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcbf72-710b-43da-b2c0-80d753279ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:42.725591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcbf72-710b-43da-b2c0-80d753279ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:42.725591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcbf72-710b-43da-b2c0-80d753279ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:42.725591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcbf72-710b-43da-b2c0-80d753279ce0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:42.727035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcbf72-710b-43da-b2c0-80d753279ce0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:22:42.727708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcbf72-710b-43da-b2c0-80d753279ce0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:42.731138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcbf72-710b-43da-b2c0-80d753279ce0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:42.733318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a13c8-f0fc-4be8-88d3-5eed76e34416 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:42.754668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93cfe9d-cc49-4273-8453-633ecf330d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:42.754668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cfe9d-cc49-4273-8453-633ecf330d47 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:42.754668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cfe9d-cc49-4273-8453-633ecf330d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:42.754668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cfe9d-cc49-4273-8453-633ecf330d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:42.755026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93cfe9d-cc49-4273-8453-633ecf330d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:42.760510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93cfe9d-cc49-4273-8453-633ecf330d47 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:42.764139 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1341/2667] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:22:42.766506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcbf72-710b-43da-b2c0-80d753279ce0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:42.788157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcbf72-710b-43da-b2c0-80d753279ce0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:42.837923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7371354-ed3e-40c6-b7e8-14ca54f9d249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:42.839089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7371354-ed3e-40c6-b7e8-14ca54f9d249 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:42.839781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7371354-ed3e-40c6-b7e8-14ca54f9d249 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:42.840254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7371354-ed3e-40c6-b7e8-14ca54f9d249 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:42.841227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7371354-ed3e-40c6-b7e8-14ca54f9d249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:42.843369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7371354-ed3e-40c6-b7e8-14ca54f9d249 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:42.904544 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1327/2668] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:22:42 2022] POST /identity/v3/projects => generated 375 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:22:42.904544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e7db1-17c8-4b91-a238-b8c290e3e7a8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:42.904544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e7db1-17c8-4b91-a238-b8c290e3e7a8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:42.904544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e7db1-17c8-4b91-a238-b8c290e3e7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:42.923242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-483e7db1-17c8-4b91-a238-b8c290e3e7a8 None None] MFA Rules not processed for user `1ea3eddf81624b41a4410ea85e17eabe`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:42.925181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-483e7db1-17c8-4b91-a238-b8c290e3e7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:42.974635 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1342/2669] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:22:42 2022] POST /identity/v3/projects => generated 359 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:22:42.976491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7371354-ed3e-40c6-b7e8-14ca54f9d249 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:43.002928 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1328/2670] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:43.004976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e7db1-17c8-4b91-a238-b8c290e3e7a8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:43.115261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7371354-ed3e-40c6-b7e8-14ca54f9d249 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:43.121977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65252f06-3c6a-486d-9e44-9d840f040d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:43.123394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65252f06-3c6a-486d-9e44-9d840f040d73 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:43.123788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65252f06-3c6a-486d-9e44-9d840f040d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:43.124919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65252f06-3c6a-486d-9e44-9d840f040d73 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:43.125770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65252f06-3c6a-486d-9e44-9d840f040d73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:43.128520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65252f06-3c6a-486d-9e44-9d840f040d73 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:43.133447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e7db1-17c8-4b91-a238-b8c290e3e7a8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:43.139536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6f8c6-411c-491a-a15c-8d50d15eb4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:43.141083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6f8c6-411c-491a-a15c-8d50d15eb4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:43.141952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6f8c6-411c-491a-a15c-8d50d15eb4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:43.142533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6f8c6-411c-491a-a15c-8d50d15eb4d5 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:43.143753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6f8c6-411c-491a-a15c-8d50d15eb4d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:43.148455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6f8c6-411c-491a-a15c-8d50d15eb4d5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:43.227567 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1343/2671] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:22:42 2022] POST /identity/v3/users => generated 288 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:22:43.231895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65252f06-3c6a-486d-9e44-9d840f040d73 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:43.254134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65252f06-3c6a-486d-9e44-9d840f040d73 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:43.260382 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1329/2672] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:22:43 2022] POST /identity/v3/users => generated 280 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:22:43.261438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6f8c6-411c-491a-a15c-8d50d15eb4d5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:43.261574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3feca-e700-475b-85cf-43eede471ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:43.262273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3feca-e700-475b-85cf-43eede471ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:43.262557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3feca-e700-475b-85cf-43eede471ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:43.262833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3feca-e700-475b-85cf-43eede471ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:43.263566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3feca-e700-475b-85cf-43eede471ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:43.265367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3feca-e700-475b-85cf-43eede471ea0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:43.276097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6f8c6-411c-491a-a15c-8d50d15eb4d5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:43.281322 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1344/2673] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:22:43.282599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3feca-e700-475b-85cf-43eede471ea0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:43.284739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a7ee0-6266-4308-a37f-85448e7fa92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:43.293033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a7ee0-6266-4308-a37f-85448e7fa92a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:43.293547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a7ee0-6266-4308-a37f-85448e7fa92a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:43.294157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a7ee0-6266-4308-a37f-85448e7fa92a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:43.295111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a7ee0-6266-4308-a37f-85448e7fa92a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:43.295247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3feca-e700-475b-85cf-43eede471ea0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:43.297276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a7ee0-6266-4308-a37f-85448e7fa92a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:43.301518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356ff12-ff9c-4b56-a8bc-3026df267962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:43.305089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356ff12-ff9c-4b56-a8bc-3026df267962 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:43.305404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356ff12-ff9c-4b56-a8bc-3026df267962 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:43.305696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356ff12-ff9c-4b56-a8bc-3026df267962 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:43.309450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356ff12-ff9c-4b56-a8bc-3026df267962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:43.309450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356ff12-ff9c-4b56-a8bc-3026df267962 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:43.311514 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1330/2674] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:22:43.315335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a7ee0-6266-4308-a37f-85448e7fa92a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:43.327049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a7ee0-6266-4308-a37f-85448e7fa92a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:43.334722 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1345/2675] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:22:43.339747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356ff12-ff9c-4b56-a8bc-3026df267962 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:43.340701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02172294-d14f-4b29-9075-0b021891ec22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:43.341931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02172294-d14f-4b29-9075-0b021891ec22 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:43.341931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02172294-d14f-4b29-9075-0b021891ec22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:43.342331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02172294-d14f-4b29-9075-0b021891ec22 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:43.343830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02172294-d14f-4b29-9075-0b021891ec22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:43.345493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02172294-d14f-4b29-9075-0b021891ec22 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:43.363282 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1331/2676] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:22:43.369781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02172294-d14f-4b29-9075-0b021891ec22 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:43.383942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02172294-d14f-4b29-9075-0b021891ec22 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:43.390425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356ff12-ff9c-4b56-a8bc-3026df267962 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:43.390921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3d573-44c3-49d0-94b6-ec89c1697992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:43.392061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3d573-44c3-49d0-94b6-ec89c1697992 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:43.392351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3d573-44c3-49d0-94b6-ec89c1697992 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:43.392650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3d573-44c3-49d0-94b6-ec89c1697992 admin admin] PATH_INFO: `/v3/projects/5085df751a6144d3a788ba0a3c763fe6/users/b26f27d0f79c45c8ab3df396d6146682/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:43.409984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec5c85-6e6c-4c56-8d7f-65d034f1d42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:43.411047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec5c85-6e6c-4c56-8d7f-65d034f1d42b admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:43.411453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec5c85-6e6c-4c56-8d7f-65d034f1d42b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:43.411843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec5c85-6e6c-4c56-8d7f-65d034f1d42b admin admin] PATH_INFO: `/v3/projects/2e61ca4e44174db58ae79d92a8de3458/users/0dfb786bf30a49bfbcb7ce975891b1b1/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:43.415474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3d573-44c3-49d0-94b6-ec89c1697992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5085df751a6144d3a788ba0a3c763fe6, user_id=b26f27d0f79c45c8ab3df396d6146682, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:43.421946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3d573-44c3-49d0-94b6-ec89c1697992 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:43.449563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec5c85-6e6c-4c56-8d7f-65d034f1d42b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e61ca4e44174db58ae79d92a8de3458, user_id=0dfb786bf30a49bfbcb7ce975891b1b1, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:43.452445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec5c85-6e6c-4c56-8d7f-65d034f1d42b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:43.526556 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1332/2677] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:22:43 2022] PUT /identity/v3/projects/5085df751a6144d3a788ba0a3c763fe6/users/b26f27d0f79c45c8ab3df396d6146682/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:43.539958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecd845-532f-4f02-a5ee-bcdb5bfa0284 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:43.540254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecd845-532f-4f02-a5ee-bcdb5bfa0284 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:43.540539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecd845-532f-4f02-a5ee-bcdb5bfa0284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:43.555294 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1346/2678] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:22:43 2022] PUT /identity/v3/projects/2e61ca4e44174db58ae79d92a8de3458/users/0dfb786bf30a49bfbcb7ce975891b1b1/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:22:43.566869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106b7f2-094b-4ba9-926e-ff1002e54d64 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:43.567435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106b7f2-094b-4ba9-926e-ff1002e54d64 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:43.567871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106b7f2-094b-4ba9-926e-ff1002e54d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:43.578779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8eecd845-532f-4f02-a5ee-bcdb5bfa0284 None None] MFA Rules not processed for user `b26f27d0f79c45c8ab3df396d6146682`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:43.581168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8eecd845-532f-4f02-a5ee-bcdb5bfa0284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:43.618100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c106b7f2-094b-4ba9-926e-ff1002e54d64 None None] MFA Rules not processed for user `0dfb786bf30a49bfbcb7ce975891b1b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:43.619628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c106b7f2-094b-4ba9-926e-ff1002e54d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:43.687624 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1333/2679] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:43 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:22:43.701264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecd845-532f-4f02-a5ee-bcdb5bfa0284 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:43.704078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8eecd845-532f-4f02-a5ee-bcdb5bfa0284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:43.738162 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1347/2680] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:22:43.743818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106b7f2-094b-4ba9-926e-ff1002e54d64 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:43.835802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecd845-532f-4f02-a5ee-bcdb5bfa0284 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:43.836431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106b7f2-094b-4ba9-926e-ff1002e54d64 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:43.842910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802610a-0fe9-4b3e-a937-a98a86850d3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:43.843694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802610a-0fe9-4b3e-a937-a98a86850d3d service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:43.848052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802610a-0fe9-4b3e-a937-a98a86850d3d service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:43.848235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbad4c3-1166-40e7-bf04-597246c4af46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:43.848357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802610a-0fe9-4b3e-a937-a98a86850d3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:43.848456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbad4c3-1166-40e7-bf04-597246c4af46 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:43.848456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbad4c3-1166-40e7-bf04-597246c4af46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:43.848456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbad4c3-1166-40e7-bf04-597246c4af46 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:43.848456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbad4c3-1166-40e7-bf04-597246c4af46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:43.850283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbad4c3-1166-40e7-bf04-597246c4af46 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:43.855138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a802610a-0fe9-4b3e-a937-a98a86850d3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:43.858337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a802610a-0fe9-4b3e-a937-a98a86850d3d service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:43.872382 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1334/2681] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:43 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:22:43.919586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802610a-0fe9-4b3e-a937-a98a86850d3d service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:43.931810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802610a-0fe9-4b3e-a937-a98a86850d3d service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:43.936759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30481514-b66a-4a27-a680-bafa733423ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:43.937647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30481514-b66a-4a27-a680-bafa733423ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:43.937940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30481514-b66a-4a27-a680-bafa733423ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:43.938221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30481514-b66a-4a27-a680-bafa733423ad admin admin] PATH_INFO: `/v3/users/b26f27d0f79c45c8ab3df396d6146682` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:43.940940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30481514-b66a-4a27-a680-bafa733423ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=b26f27d0f79c45c8ab3df396d6146682)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:43.942706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30481514-b66a-4a27-a680-bafa733423ad admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:44.035707 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1348/2682] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:22:43 2022] POST /identity/v3/projects => generated 373 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:22:44.039244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbad4c3-1166-40e7-bf04-597246c4af46 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:44.126889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbad4c3-1166-40e7-bf04-597246c4af46 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:44.132320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9ed86-30b1-42d8-a4cf-22d83206e69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:44.133023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9ed86-30b1-42d8-a4cf-22d83206e69f admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:44.133309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9ed86-30b1-42d8-a4cf-22d83206e69f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:44.133618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9ed86-30b1-42d8-a4cf-22d83206e69f admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:44.134318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9ed86-30b1-42d8-a4cf-22d83206e69f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:44.136297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9ed86-30b1-42d8-a4cf-22d83206e69f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:44.220760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-30481514-b66a-4a27-a680-bafa733423ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b26f27d0f79c45c8ab3df396d6146682'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:44.243048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-30481514-b66a-4a27-a680-bafa733423ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b26f27d0f79c45c8ab3df396d6146682'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:44.243866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-30481514-b66a-4a27-a680-bafa733423ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b26f27d0f79c45c8ab3df396d6146682'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:44.253865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-30481514-b66a-4a27-a680-bafa733423ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b26f27d0f79c45c8ab3df396d6146682'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:44.322028 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1349/2683] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:22:44 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:22:44.325998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9ed86-30b1-42d8-a4cf-22d83206e69f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:44.336316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9ed86-30b1-42d8-a4cf-22d83206e69f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:44.341183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562e612-55ca-4de2-b4b3-2a0cd5470c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:44.341839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562e612-55ca-4de2-b4b3-2a0cd5470c60 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:44.342126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562e612-55ca-4de2-b4b3-2a0cd5470c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:44.342407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562e612-55ca-4de2-b4b3-2a0cd5470c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:44.343153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562e612-55ca-4de2-b4b3-2a0cd5470c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:44.344841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562e612-55ca-4de2-b4b3-2a0cd5470c60 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:44.355078 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1350/2684] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:22:44.359293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562e612-55ca-4de2-b4b3-2a0cd5470c60 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:44.370116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562e612-55ca-4de2-b4b3-2a0cd5470c60 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:44.375325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dba2ac-a152-43cf-ac80-f126e73d6348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:44.376204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dba2ac-a152-43cf-ac80-f126e73d6348 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:44.376494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dba2ac-a152-43cf-ac80-f126e73d6348 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:44.376821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dba2ac-a152-43cf-ac80-f126e73d6348 admin admin] PATH_INFO: `/v3/projects/e936ab75ffa14873a9294543700627a4/users/ba666f0a9b7b48908e27bd9648020824/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:44.391833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dba2ac-a152-43cf-ac80-f126e73d6348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e936ab75ffa14873a9294543700627a4, user_id=ba666f0a9b7b48908e27bd9648020824, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:44.394561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dba2ac-a152-43cf-ac80-f126e73d6348 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:44.403285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-30481514-b66a-4a27-a680-bafa733423ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b26f27d0f79c45c8ab3df396d6146682'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:44.410279 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1335/2685] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:22:43 2022] DELETE /identity/v3/users/b26f27d0f79c45c8ab3df396d6146682 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:22:44.414751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0d419-9a72-4d32-b29c-5414e912bcca None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:44.415106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0d419-9a72-4d32-b29c-5414e912bcca None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:44.415457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0d419-9a72-4d32-b29c-5414e912bcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:44.433528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4ef0d419-9a72-4d32-b29c-5414e912bcca None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:44.434848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4ef0d419-9a72-4d32-b29c-5414e912bcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:44.498492 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1336/2686] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:22:44.503809 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1351/2687] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:22:44 2022] PUT /identity/v3/projects/e936ab75ffa14873a9294543700627a4/users/ba666f0a9b7b48908e27bd9648020824/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:22:44.507649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0d419-9a72-4d32-b29c-5414e912bcca None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:44.509203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4ef0d419-9a72-4d32-b29c-5414e912bcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:44.509324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dba2ac-a152-43cf-ac80-f126e73d6348 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:44.510821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a9dba2ac-a152-43cf-ac80-f126e73d6348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:44.521643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0d419-9a72-4d32-b29c-5414e912bcca None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:44.578911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dba2ac-a152-43cf-ac80-f126e73d6348 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:44.583230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c14e1-a739-494f-a98b-bac46a52f6e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:44.584090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c14e1-a739-494f-a98b-bac46a52f6e1 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:44.584547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c14e1-a739-494f-a98b-bac46a52f6e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:44.585003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c14e1-a739-494f-a98b-bac46a52f6e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:44.594758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693bad3-afae-472d-9615-0769da1cb323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:44.595770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693bad3-afae-472d-9615-0769da1cb323 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:44.597396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693bad3-afae-472d-9615-0769da1cb323 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:44.597396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693bad3-afae-472d-9615-0769da1cb323 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:44.598560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693bad3-afae-472d-9615-0769da1cb323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:44.605473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693bad3-afae-472d-9615-0769da1cb323 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:44.619664 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1337/2688] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:22:44.624763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693bad3-afae-472d-9615-0769da1cb323 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:44.635729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693bad3-afae-472d-9615-0769da1cb323 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:44.640855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc647606-cf4e-434c-a4bb-e0d18e072575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:44.641746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc647606-cf4e-434c-a4bb-e0d18e072575 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:44.642030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc647606-cf4e-434c-a4bb-e0d18e072575 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:44.642309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc647606-cf4e-434c-a4bb-e0d18e072575 admin admin] PATH_INFO: `/v3/projects/e936ab75ffa14873a9294543700627a4/users/ba666f0a9b7b48908e27bd9648020824/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:44.645368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc647606-cf4e-434c-a4bb-e0d18e072575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e936ab75ffa14873a9294543700627a4, user_id=ba666f0a9b7b48908e27bd9648020824, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:44.648026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc647606-cf4e-434c-a4bb-e0d18e072575 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:44.664194 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1338/2689] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:22:44 2022] PUT /identity/v3/projects/e936ab75ffa14873a9294543700627a4/users/ba666f0a9b7b48908e27bd9648020824/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:44.669564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c14e1-a739-494f-a98b-bac46a52f6e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:44.671128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c14e1-a739-494f-a98b-bac46a52f6e1 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:44.675175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab20fc-6323-496d-b343-ee259eff3eed None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:44.676318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab20fc-6323-496d-b343-ee259eff3eed None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:44.676828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab20fc-6323-496d-b343-ee259eff3eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:44.684335 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1352/2690] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:22:44.706204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-75ab20fc-6323-496d-b343-ee259eff3eed None None] MFA Rules not processed for user `ba666f0a9b7b48908e27bd9648020824`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:44.707786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-75ab20fc-6323-496d-b343-ee259eff3eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:44.781928 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1339/2691] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:44.794269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ead279-37aa-485c-bb3b-132144005298 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:44.794768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ead279-37aa-485c-bb3b-132144005298 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:44.795050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ead279-37aa-485c-bb3b-132144005298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:44.815544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c5ead279-37aa-485c-bb3b-132144005298 None None] MFA Rules not processed for user `0dfb786bf30a49bfbcb7ce975891b1b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:44.816871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c5ead279-37aa-485c-bb3b-132144005298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:44.872143 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1353/2692] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:44.885406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab20fc-6323-496d-b343-ee259eff3eed None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:44.888290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-75ab20fc-6323-496d-b343-ee259eff3eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:44.964561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab20fc-6323-496d-b343-ee259eff3eed None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:44.970245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119b0ff-739e-403d-b726-d709f0ab5487 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:44.970938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119b0ff-739e-403d-b726-d709f0ab5487 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:44.971766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119b0ff-739e-403d-b726-d709f0ab5487 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:44.972047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119b0ff-739e-403d-b726-d709f0ab5487 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:44.974044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1119b0ff-739e-403d-b726-d709f0ab5487 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:44.984942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119b0ff-739e-403d-b726-d709f0ab5487 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:44.987055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119b0ff-739e-403d-b726-d709f0ab5487 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:45.000300 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1340/2693] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:22:45.510808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ead279-37aa-485c-bb3b-132144005298 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:45.512313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c5ead279-37aa-485c-bb3b-132144005298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:45.693448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ead279-37aa-485c-bb3b-132144005298 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:45.699323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30c5b8-6aa8-4071-99cd-6c9f9a527be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:45.700583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30c5b8-6aa8-4071-99cd-6c9f9a527be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:45.701045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30c5b8-6aa8-4071-99cd-6c9f9a527be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:45.701469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30c5b8-6aa8-4071-99cd-6c9f9a527be2 admin admin] PATH_INFO: `/v3/projects/5085df751a6144d3a788ba0a3c763fe6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:45.702938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30c5b8-6aa8-4071-99cd-6c9f9a527be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5085df751a6144d3a788ba0a3c763fe6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:45.705093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30c5b8-6aa8-4071-99cd-6c9f9a527be2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:45.856057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8e30c5b8-6aa8-4071-99cd-6c9f9a527be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5085df751a6144d3a788ba0a3c763fe6', 'request_id': 'req-8e30c5b8-6aa8-4071-99cd-6c9f9a527be2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:45.863302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8e30c5b8-6aa8-4071-99cd-6c9f9a527be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5085df751a6144d3a788ba0a3c763fe6', 'request_id': 'req-8e30c5b8-6aa8-4071-99cd-6c9f9a527be2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:45.985957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8e30c5b8-6aa8-4071-99cd-6c9f9a527be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5085df751a6144d3a788ba0a3c763fe6', 'request_id': 'req-8e30c5b8-6aa8-4071-99cd-6c9f9a527be2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:45.998292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8e30c5b8-6aa8-4071-99cd-6c9f9a527be2 admin admin] The token cache is being invalidate because project 5085df751a6144d3a788ba0a3c763fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:22:45.998585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8e30c5b8-6aa8-4071-99cd-6c9f9a527be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:45.999230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8e30c5b8-6aa8-4071-99cd-6c9f9a527be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:46.000884 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1354/2694] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:22:45 2022] DELETE /identity/v3/projects/5085df751a6144d3a788ba0a3c763fe6 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:46.005776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe555aa6-3fb1-4e33-9113-b90d58143599 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:46.006261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe555aa6-3fb1-4e33-9113-b90d58143599 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:46.006352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe555aa6-3fb1-4e33-9113-b90d58143599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:46.024712 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fe555aa6-3fb1-4e33-9113-b90d58143599 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:46.025943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fe555aa6-3fb1-4e33-9113-b90d58143599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:46.115413 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1341/2695] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:46.185707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b21f41-11ec-4e46-89ad-43819536000c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:46.186104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b21f41-11ec-4e46-89ad-43819536000c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:46.186469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b21f41-11ec-4e46-89ad-43819536000c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:46.213009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d0b21f41-11ec-4e46-89ad-43819536000c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:46.214418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d0b21f41-11ec-4e46-89ad-43819536000c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:46.251352 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1355/2696] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:46.255044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe555aa6-3fb1-4e33-9113-b90d58143599 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:46.267216 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe555aa6-3fb1-4e33-9113-b90d58143599 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:46.290478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041b7e7-3066-477b-8932-a0e49a49652e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:46.292315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041b7e7-3066-477b-8932-a0e49a49652e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:46.292811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041b7e7-3066-477b-8932-a0e49a49652e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:46.295702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041b7e7-3066-477b-8932-a0e49a49652e admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:46.297243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041b7e7-3066-477b-8932-a0e49a49652e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:22:46.297676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041b7e7-3066-477b-8932-a0e49a49652e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:46.299619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041b7e7-3066-477b-8932-a0e49a49652e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:46.324145 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1342/2697] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:22:46.328713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b21f41-11ec-4e46-89ad-43819536000c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:46.343625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b21f41-11ec-4e46-89ad-43819536000c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:46.368506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917f400-5ee3-4efd-98b1-6b8d5afa5fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:46.369233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917f400-5ee3-4efd-98b1-6b8d5afa5fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:46.369519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917f400-5ee3-4efd-98b1-6b8d5afa5fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:46.369799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917f400-5ee3-4efd-98b1-6b8d5afa5fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:46.370509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917f400-5ee3-4efd-98b1-6b8d5afa5fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:46.372732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917f400-5ee3-4efd-98b1-6b8d5afa5fc6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:46.472581 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1356/2698] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:22:46 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:22:46.472974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041b7e7-3066-477b-8932-a0e49a49652e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:46.488077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041b7e7-3066-477b-8932-a0e49a49652e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:46.549916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da2752-d250-44c1-b772-fa829b8d9a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:46.550793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da2752-d250-44c1-b772-fa829b8d9a64 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:46.551204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da2752-d250-44c1-b772-fa829b8d9a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:46.551920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da2752-d250-44c1-b772-fa829b8d9a64 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:46.552212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da2752-d250-44c1-b772-fa829b8d9a64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:46.554298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da2752-d250-44c1-b772-fa829b8d9a64 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:46.597307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917f400-5ee3-4efd-98b1-6b8d5afa5fc6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:46.599151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f917f400-5ee3-4efd-98b1-6b8d5afa5fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:46.616230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917f400-5ee3-4efd-98b1-6b8d5afa5fc6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:46.627679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9cb5c-3258-46ed-a6f2-854be4b0e302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:46.627679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9cb5c-3258-46ed-a6f2-854be4b0e302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:46.627679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9cb5c-3258-46ed-a6f2-854be4b0e302 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:46.627679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9cb5c-3258-46ed-a6f2-854be4b0e302 admin admin] PATH_INFO: `/v3/users/c3830d74fc184ea8944f1d45331581f8` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:46.628039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9cb5c-3258-46ed-a6f2-854be4b0e302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3830d74fc184ea8944f1d45331581f8)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:46.629341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9cb5c-3258-46ed-a6f2-854be4b0e302 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:46.695480 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1343/2699] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:22:46 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:22:46.696799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da2752-d250-44c1-b772-fa829b8d9a64 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:46.710002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da2752-d250-44c1-b772-fa829b8d9a64 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:46.716572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70e7a2-cd8d-43a9-abdd-c6a0c0ed20ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:46.718690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70e7a2-cd8d-43a9-abdd-c6a0c0ed20ec admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:46.718690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70e7a2-cd8d-43a9-abdd-c6a0c0ed20ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:46.718690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70e7a2-cd8d-43a9-abdd-c6a0c0ed20ec admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:46.719634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70e7a2-cd8d-43a9-abdd-c6a0c0ed20ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:46.721369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70e7a2-cd8d-43a9-abdd-c6a0c0ed20ec admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:46.732376 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1344/2700] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:22:46.736405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70e7a2-cd8d-43a9-abdd-c6a0c0ed20ec admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:46.746828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70e7a2-cd8d-43a9-abdd-c6a0c0ed20ec admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:46.752066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c7e90-083e-453a-984f-f7e34fb63a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:46.753330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c7e90-083e-453a-984f-f7e34fb63a87 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:46.753613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c7e90-083e-453a-984f-f7e34fb63a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:46.753889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c7e90-083e-453a-984f-f7e34fb63a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:46.754640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c7e90-083e-453a-984f-f7e34fb63a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:46.756232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c7e90-083e-453a-984f-f7e34fb63a87 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:46.767035 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1345/2701] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:22:46.773385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c7e90-083e-453a-984f-f7e34fb63a87 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:46.783276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c7e90-083e-453a-984f-f7e34fb63a87 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:46.788172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17dbfe-2c2d-4410-96b8-44b4bc73943b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:46.789186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17dbfe-2c2d-4410-96b8-44b4bc73943b admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:46.789424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17dbfe-2c2d-4410-96b8-44b4bc73943b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:46.789690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17dbfe-2c2d-4410-96b8-44b4bc73943b admin admin] PATH_INFO: `/v3/projects/f4fdfb032d52499c85596cd9caf4e16e/users/bdd19fd987ef4db293736056226ae089/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:46.818711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17dbfe-2c2d-4410-96b8-44b4bc73943b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4fdfb032d52499c85596cd9caf4e16e, user_id=bdd19fd987ef4db293736056226ae089, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:46.821512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17dbfe-2c2d-4410-96b8-44b4bc73943b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:46.837911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-abd9cb5c-3258-46ed-a6f2-854be4b0e302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3830d74fc184ea8944f1d45331581f8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:46.849560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-abd9cb5c-3258-46ed-a6f2-854be4b0e302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3830d74fc184ea8944f1d45331581f8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:46.854424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-abd9cb5c-3258-46ed-a6f2-854be4b0e302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3830d74fc184ea8944f1d45331581f8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:46.861348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-abd9cb5c-3258-46ed-a6f2-854be4b0e302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3830d74fc184ea8944f1d45331581f8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:46.926941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-abd9cb5c-3258-46ed-a6f2-854be4b0e302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3830d74fc184ea8944f1d45331581f8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:46.938240 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1346/2702] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:22:46 2022] PUT /identity/v3/projects/f4fdfb032d52499c85596cd9caf4e16e/users/bdd19fd987ef4db293736056226ae089/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:22:46.940206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01bd26-3c13-4613-bd32-10b6f0e49b2d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:46.940500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01bd26-3c13-4613-bd32-10b6f0e49b2d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:46.940806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01bd26-3c13-4613-bd32-10b6f0e49b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:46.948187 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1357/2703] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:22:46 2022] DELETE /identity/v3/users/c3830d74fc184ea8944f1d45331581f8 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:22:46.963603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ab01bd26-3c13-4613-bd32-10b6f0e49b2d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:46.964971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ab01bd26-3c13-4613-bd32-10b6f0e49b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:47.027901 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1347/2704] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:47.042058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9cb5c-3258-46ed-a6f2-854be4b0e302 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:47.043505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-abd9cb5c-3258-46ed-a6f2-854be4b0e302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:47.134681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9cb5c-3258-46ed-a6f2-854be4b0e302 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:47.138802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d9c1e-b686-4c23-927d-f413ae968c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:47.139438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d9c1e-b686-4c23-927d-f413ae968c71 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:47.139754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d9c1e-b686-4c23-927d-f413ae968c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:47.140032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d9c1e-b686-4c23-927d-f413ae968c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:47.150330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d9c1e-b686-4c23-927d-f413ae968c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:47.151779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d9c1e-b686-4c23-927d-f413ae968c71 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:47.161571 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1358/2705] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:22:47.269859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01bd26-3c13-4613-bd32-10b6f0e49b2d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:47.271297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ab01bd26-3c13-4613-bd32-10b6f0e49b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:47.283721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01bd26-3c13-4613-bd32-10b6f0e49b2d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:47.288517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619151d6-f828-491c-a957-768009f5e4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:47.289567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619151d6-f828-491c-a957-768009f5e4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:47.290047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619151d6-f828-491c-a957-768009f5e4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:47.290386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619151d6-f828-491c-a957-768009f5e4f6 admin admin] PATH_INFO: `/v3/projects/642189cc67754e20a2a1191c961606c5` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:47.311474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619151d6-f828-491c-a957-768009f5e4f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=642189cc67754e20a2a1191c961606c5)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:47.311474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619151d6-f828-491c-a957-768009f5e4f6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:47.507695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-619151d6-f828-491c-a957-768009f5e4f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '642189cc67754e20a2a1191c961606c5', 'request_id': 'req-619151d6-f828-491c-a957-768009f5e4f6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:47.586057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-619151d6-f828-491c-a957-768009f5e4f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '642189cc67754e20a2a1191c961606c5', 'request_id': 'req-619151d6-f828-491c-a957-768009f5e4f6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:47.595653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-619151d6-f828-491c-a957-768009f5e4f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '642189cc67754e20a2a1191c961606c5', 'request_id': 'req-619151d6-f828-491c-a957-768009f5e4f6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:47.610924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-619151d6-f828-491c-a957-768009f5e4f6 admin admin] The token cache is being invalidate because project 642189cc67754e20a2a1191c961606c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:22:47.611228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-619151d6-f828-491c-a957-768009f5e4f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:47.612497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-619151d6-f828-491c-a957-768009f5e4f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:47.614806 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1348/2706] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:22:47 2022] DELETE /identity/v3/projects/642189cc67754e20a2a1191c961606c5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:47.624862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb76fd5-4f12-4486-99b8-5eee18a687fd None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:47.625259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb76fd5-4f12-4486-99b8-5eee18a687fd None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:47.625414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb76fd5-4f12-4486-99b8-5eee18a687fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:47.647069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8bb76fd5-4f12-4486-99b8-5eee18a687fd None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:47.648213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8bb76fd5-4f12-4486-99b8-5eee18a687fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:47.732130 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1359/2707] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:22:47.736383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee8b3f-972c-40fe-a167-88cb8050a439 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:47.736383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee8b3f-972c-40fe-a167-88cb8050a439 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:47.736383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee8b3f-972c-40fe-a167-88cb8050a439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:47.757922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-03ee8b3f-972c-40fe-a167-88cb8050a439 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:47.759184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-03ee8b3f-972c-40fe-a167-88cb8050a439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:47.770004 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1349/2708] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:47.772685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb76fd5-4f12-4486-99b8-5eee18a687fd None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:47.782660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb76fd5-4f12-4486-99b8-5eee18a687fd None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:47.789407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94079bc7-7ad8-46d9-bb1d-f7de22f4758f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:47.789407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94079bc7-7ad8-46d9-bb1d-f7de22f4758f admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:47.789407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94079bc7-7ad8-46d9-bb1d-f7de22f4758f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:47.789407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94079bc7-7ad8-46d9-bb1d-f7de22f4758f admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:47.790171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94079bc7-7ad8-46d9-bb1d-f7de22f4758f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:22:47.790480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94079bc7-7ad8-46d9-bb1d-f7de22f4758f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:47.792065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94079bc7-7ad8-46d9-bb1d-f7de22f4758f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:47.804424 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1360/2709] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:22:47.808964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee8b3f-972c-40fe-a167-88cb8050a439 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:47.819225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee8b3f-972c-40fe-a167-88cb8050a439 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:47.824068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e1dec-d574-4377-9540-8aa016a64b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:47.825833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e1dec-d574-4377-9540-8aa016a64b32 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:47.827331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e1dec-d574-4377-9540-8aa016a64b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:47.829441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e1dec-d574-4377-9540-8aa016a64b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:47.829441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e1dec-d574-4377-9540-8aa016a64b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:47.830604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e1dec-d574-4377-9540-8aa016a64b32 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:47.941480 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1350/2710] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:22:47 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:22:47.945712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94079bc7-7ad8-46d9-bb1d-f7de22f4758f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:47.955647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94079bc7-7ad8-46d9-bb1d-f7de22f4758f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:48.021239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475b5b1-168d-4adf-a4df-9441e97548ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:48.022231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475b5b1-168d-4adf-a4df-9441e97548ca admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:48.022529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475b5b1-168d-4adf-a4df-9441e97548ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:48.022809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475b5b1-168d-4adf-a4df-9441e97548ca admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:48.023546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475b5b1-168d-4adf-a4df-9441e97548ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:48.025625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475b5b1-168d-4adf-a4df-9441e97548ca admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:48.130010 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1361/2711] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:22:47 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:22:48.134588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e1dec-d574-4377-9540-8aa016a64b32 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:48.149509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e1dec-d574-4377-9540-8aa016a64b32 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:48.154385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83e810-cf57-4b31-a09b-f6ede33cdf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:48.155000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83e810-cf57-4b31-a09b-f6ede33cdf30 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:48.155453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83e810-cf57-4b31-a09b-f6ede33cdf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:48.155740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83e810-cf57-4b31-a09b-f6ede33cdf30 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:48.156544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83e810-cf57-4b31-a09b-f6ede33cdf30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:48.158918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83e810-cf57-4b31-a09b-f6ede33cdf30 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:48.170056 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1351/2712] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:22:48.174863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475b5b1-168d-4adf-a4df-9441e97548ca admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:48.185111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475b5b1-168d-4adf-a4df-9441e97548ca admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:48.189877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd248947-d1e4-4184-8daa-de5dd6e40e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:48.190579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd248947-d1e4-4184-8daa-de5dd6e40e65 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:48.190860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd248947-d1e4-4184-8daa-de5dd6e40e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:48.191154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd248947-d1e4-4184-8daa-de5dd6e40e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:48.191915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd248947-d1e4-4184-8daa-de5dd6e40e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:48.193564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd248947-d1e4-4184-8daa-de5dd6e40e65 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:48.203583 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1362/2713] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:22:48.209600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83e810-cf57-4b31-a09b-f6ede33cdf30 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:48.220283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83e810-cf57-4b31-a09b-f6ede33cdf30 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:48.226669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f667e9-00f8-4478-af74-707e93ffdaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:48.227747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f667e9-00f8-4478-af74-707e93ffdaa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:48.228068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f667e9-00f8-4478-af74-707e93ffdaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:48.228350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f667e9-00f8-4478-af74-707e93ffdaa0 admin admin] PATH_INFO: `/v3/projects/50ba431a6e894157abc90e36eb1ded86/users/d34d24dc6ae049cb8f8b90e88a3a9db4/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:48.245791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f667e9-00f8-4478-af74-707e93ffdaa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50ba431a6e894157abc90e36eb1ded86, user_id=d34d24dc6ae049cb8f8b90e88a3a9db4, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:48.249376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f667e9-00f8-4478-af74-707e93ffdaa0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:48.315951 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1352/2714] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:22:48 2022] PUT /identity/v3/projects/50ba431a6e894157abc90e36eb1ded86/users/d34d24dc6ae049cb8f8b90e88a3a9db4/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:22:48.386491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e22e4-275c-4946-8258-7438f0050613 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:48.386858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e22e4-275c-4946-8258-7438f0050613 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:48.387062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e22e4-275c-4946-8258-7438f0050613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:48.416781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a72e22e4-275c-4946-8258-7438f0050613 None None] MFA Rules not processed for user `d34d24dc6ae049cb8f8b90e88a3a9db4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:48.417916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a72e22e4-275c-4946-8258-7438f0050613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:48.496385 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1363/2715] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:48.505538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f667e9-00f8-4478-af74-707e93ffdaa0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:48.507962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-77f667e9-00f8-4478-af74-707e93ffdaa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:48.572999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f667e9-00f8-4478-af74-707e93ffdaa0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:48.576980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22f25a-83bc-4be5-a1a2-b0aafe7d9e37 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:48.577645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22f25a-83bc-4be5-a1a2-b0aafe7d9e37 service glance] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:48.578070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22f25a-83bc-4be5-a1a2-b0aafe7d9e37 service glance] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:48.578360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22f25a-83bc-4be5-a1a2-b0aafe7d9e37 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:48.587606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22f25a-83bc-4be5-a1a2-b0aafe7d9e37 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:48.589142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22f25a-83bc-4be5-a1a2-b0aafe7d9e37 service glance] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:48.599171 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1353/2716] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:22:48.975457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fcb40-6550-4c12-a9cf-057b0e8476d8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:48.975925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fcb40-6550-4c12-a9cf-057b0e8476d8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:48.979038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fcb40-6550-4c12-a9cf-057b0e8476d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:48.995786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7f7fcb40-6550-4c12-a9cf-057b0e8476d8 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:48.997017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7f7fcb40-6550-4c12-a9cf-057b0e8476d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:49.056358 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1364/2717] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:22:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:49.081898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22f25a-83bc-4be5-a1a2-b0aafe7d9e37 service glance] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:49.083825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ac22f25a-83bc-4be5-a1a2-b0aafe7d9e37 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:49.184459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22f25a-83bc-4be5-a1a2-b0aafe7d9e37 service glance] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:49.189478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3113e42-5af9-4e1f-bddd-410ff708a0f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:49.190165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3113e42-5af9-4e1f-bddd-410ff708a0f3 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:49.190541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3113e42-5af9-4e1f-bddd-410ff708a0f3 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:49.190824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3113e42-5af9-4e1f-bddd-410ff708a0f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:49.199428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3113e42-5af9-4e1f-bddd-410ff708a0f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:49.201065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3113e42-5af9-4e1f-bddd-410ff708a0f3 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:49.209615 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1354/2718] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:22:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 02 10:22:49.266803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273182c-7108-4efc-b68c-bdfc0e49e7c4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:49.267097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273182c-7108-4efc-b68c-bdfc0e49e7c4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:49.267383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273182c-7108-4efc-b68c-bdfc0e49e7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:49.294969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7273182c-7108-4efc-b68c-bdfc0e49e7c4 None None] MFA Rules not processed for user `bdd19fd987ef4db293736056226ae089`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:49.296187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7273182c-7108-4efc-b68c-bdfc0e49e7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:49.370564 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1365/2719] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:49.379595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3113e42-5af9-4e1f-bddd-410ff708a0f3 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:49.381560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f3113e42-5af9-4e1f-bddd-410ff708a0f3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:49.453843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3113e42-5af9-4e1f-bddd-410ff708a0f3 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:49.459831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994039a-c153-4264-878f-b57cfddb7e1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:49.460486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994039a-c153-4264-878f-b57cfddb7e1a service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:49.460800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994039a-c153-4264-878f-b57cfddb7e1a service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:49.461079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994039a-c153-4264-878f-b57cfddb7e1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:49.468939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994039a-c153-4264-878f-b57cfddb7e1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:49.470549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994039a-c153-4264-878f-b57cfddb7e1a service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:49.484051 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1355/2720] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:22:50.913737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273182c-7108-4efc-b68c-bdfc0e49e7c4 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:50.917036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7273182c-7108-4efc-b68c-bdfc0e49e7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:51.018402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273182c-7108-4efc-b68c-bdfc0e49e7c4 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:51.023677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca22eab-a4ab-49bc-a111-a4fbdc10048d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:51.024826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca22eab-a4ab-49bc-a111-a4fbdc10048d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:51.025176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca22eab-a4ab-49bc-a111-a4fbdc10048d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:51.025520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca22eab-a4ab-49bc-a111-a4fbdc10048d admin admin] PATH_INFO: `/v3/users/bdd19fd987ef4db293736056226ae089` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:51.026911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca22eab-a4ab-49bc-a111-a4fbdc10048d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdd19fd987ef4db293736056226ae089)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:51.029099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca22eab-a4ab-49bc-a111-a4fbdc10048d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:51.242992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7ca22eab-a4ab-49bc-a111-a4fbdc10048d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdd19fd987ef4db293736056226ae089'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:51.269577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7ca22eab-a4ab-49bc-a111-a4fbdc10048d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdd19fd987ef4db293736056226ae089'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:51.271952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7ca22eab-a4ab-49bc-a111-a4fbdc10048d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdd19fd987ef4db293736056226ae089'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:51.279990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7ca22eab-a4ab-49bc-a111-a4fbdc10048d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdd19fd987ef4db293736056226ae089'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:51.368053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7ca22eab-a4ab-49bc-a111-a4fbdc10048d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdd19fd987ef4db293736056226ae089'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:51.372985 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1366/2721] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:22:50 2022] DELETE /identity/v3/users/bdd19fd987ef4db293736056226ae089 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:52.231624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994039a-c153-4264-878f-b57cfddb7e1a service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:52.231624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994039a-c153-4264-878f-b57cfddb7e1a service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:52.270162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52703d-240d-42b5-8928-de5773e11703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:52.271033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52703d-240d-42b5-8928-de5773e11703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:52.271318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52703d-240d-42b5-8928-de5773e11703 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:52.271598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52703d-240d-42b5-8928-de5773e11703 admin admin] PATH_INFO: `/v3/projects/f4fdfb032d52499c85596cd9caf4e16e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:52.272815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52703d-240d-42b5-8928-de5773e11703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4fdfb032d52499c85596cd9caf4e16e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:52.274711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52703d-240d-42b5-8928-de5773e11703 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:52.463028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-de52703d-240d-42b5-8928-de5773e11703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4fdfb032d52499c85596cd9caf4e16e', 'request_id': 'req-de52703d-240d-42b5-8928-de5773e11703'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:52.667559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-de52703d-240d-42b5-8928-de5773e11703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4fdfb032d52499c85596cd9caf4e16e', 'request_id': 'req-de52703d-240d-42b5-8928-de5773e11703'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:52.667559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-de52703d-240d-42b5-8928-de5773e11703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4fdfb032d52499c85596cd9caf4e16e', 'request_id': 'req-de52703d-240d-42b5-8928-de5773e11703'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:52.667559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-de52703d-240d-42b5-8928-de5773e11703 admin admin] The token cache is being invalidate because project f4fdfb032d52499c85596cd9caf4e16e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:22:52.667559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-de52703d-240d-42b5-8928-de5773e11703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:52.668771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-de52703d-240d-42b5-8928-de5773e11703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:52.668771 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1356/2722] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:22:52 2022] DELETE /identity/v3/projects/f4fdfb032d52499c85596cd9caf4e16e => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:52.678258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083d2cd-eaa9-4c51-90d1-3f1608dc9825 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:52.678753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083d2cd-eaa9-4c51-90d1-3f1608dc9825 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:52.678856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083d2cd-eaa9-4c51-90d1-3f1608dc9825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:52.698205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f083d2cd-eaa9-4c51-90d1-3f1608dc9825 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:52.699456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f083d2cd-eaa9-4c51-90d1-3f1608dc9825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:52.762203 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1367/2723] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:52.770874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45478e-3a59-481e-a247-5876392e3b52 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:52.771183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45478e-3a59-481e-a247-5876392e3b52 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:52.771445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45478e-3a59-481e-a247-5876392e3b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:52.791408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fe45478e-3a59-481e-a247-5876392e3b52 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:52.792808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fe45478e-3a59-481e-a247-5876392e3b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:52.801624 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1357/2724] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:52.806179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083d2cd-eaa9-4c51-90d1-3f1608dc9825 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:52.818650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083d2cd-eaa9-4c51-90d1-3f1608dc9825 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:52.824747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b64a55-f903-4a7f-bf7a-9eb3d68e2b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:52.825433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b64a55-f903-4a7f-bf7a-9eb3d68e2b07 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:52.825723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b64a55-f903-4a7f-bf7a-9eb3d68e2b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:52.825993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b64a55-f903-4a7f-bf7a-9eb3d68e2b07 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:52.826789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b64a55-f903-4a7f-bf7a-9eb3d68e2b07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:22:52.827101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b64a55-f903-4a7f-bf7a-9eb3d68e2b07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:52.828747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b64a55-f903-4a7f-bf7a-9eb3d68e2b07 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:52.850526 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1368/2725] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:22:52.854910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45478e-3a59-481e-a247-5876392e3b52 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:52.865502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45478e-3a59-481e-a247-5876392e3b52 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:52.870543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68919f61-ceb7-471c-9cb4-a141093a2600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:52.871155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68919f61-ceb7-471c-9cb4-a141093a2600 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:52.871442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68919f61-ceb7-471c-9cb4-a141093a2600 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:52.871721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68919f61-ceb7-471c-9cb4-a141093a2600 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:52.872417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68919f61-ceb7-471c-9cb4-a141093a2600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:52.880094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68919f61-ceb7-471c-9cb4-a141093a2600 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:53.049750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b64a55-f903-4a7f-bf7a-9eb3d68e2b07 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:53.050210 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1358/2726] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:22:52 2022] POST /identity/v3/projects => generated 393 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:22:53.060221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b64a55-f903-4a7f-bf7a-9eb3d68e2b07 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:53.132231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efa6ba-d6a9-49bf-90c5-36bd09822002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:53.134319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efa6ba-d6a9-49bf-90c5-36bd09822002 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:53.134319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efa6ba-d6a9-49bf-90c5-36bd09822002 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:53.134319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efa6ba-d6a9-49bf-90c5-36bd09822002 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:53.134319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efa6ba-d6a9-49bf-90c5-36bd09822002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:53.136210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efa6ba-d6a9-49bf-90c5-36bd09822002 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:53.291463 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1369/2727] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:22:53 2022] POST /identity/v3/users => generated 297 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:22:53.292745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68919f61-ceb7-471c-9cb4-a141093a2600 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:53.305614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68919f61-ceb7-471c-9cb4-a141093a2600 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:53.311630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464f9fa-e8af-4307-bf05-a44ce9ec69c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:53.311975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464f9fa-e8af-4307-bf05-a44ce9ec69c6 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:53.312264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464f9fa-e8af-4307-bf05-a44ce9ec69c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:53.312749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464f9fa-e8af-4307-bf05-a44ce9ec69c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:53.313594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464f9fa-e8af-4307-bf05-a44ce9ec69c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:53.315722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464f9fa-e8af-4307-bf05-a44ce9ec69c6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:53.328272 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1359/2728] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:22:53.336788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efa6ba-d6a9-49bf-90c5-36bd09822002 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:53.349489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efa6ba-d6a9-49bf-90c5-36bd09822002 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:53.357366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a97163-a796-4a77-a3bf-58bedc6b417c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:53.358712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a97163-a796-4a77-a3bf-58bedc6b417c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:53.358712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a97163-a796-4a77-a3bf-58bedc6b417c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:53.358712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a97163-a796-4a77-a3bf-58bedc6b417c admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:53.359302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a97163-a796-4a77-a3bf-58bedc6b417c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:53.360954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a97163-a796-4a77-a3bf-58bedc6b417c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:53.371562 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1370/2729] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:22:53.376119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464f9fa-e8af-4307-bf05-a44ce9ec69c6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:53.386078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464f9fa-e8af-4307-bf05-a44ce9ec69c6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:53.390647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3e0eb-31f4-4286-9d7f-3d9e550c093b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:53.391519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3e0eb-31f4-4286-9d7f-3d9e550c093b admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:53.391798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3e0eb-31f4-4286-9d7f-3d9e550c093b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:53.392074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3e0eb-31f4-4286-9d7f-3d9e550c093b admin admin] PATH_INFO: `/v3/projects/df25ec067b694b75859a41ecc012eb89/users/cc47e87a70dc4c49b2a17f6bde30b880/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:53.406577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3e0eb-31f4-4286-9d7f-3d9e550c093b admin admin] RBAC: Authorizing `identity:create_grant(project_id=df25ec067b694b75859a41ecc012eb89, user_id=cc47e87a70dc4c49b2a17f6bde30b880, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:53.409783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3e0eb-31f4-4286-9d7f-3d9e550c093b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:53.508701 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1360/2730] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:22:53 2022] PUT /identity/v3/projects/df25ec067b694b75859a41ecc012eb89/users/cc47e87a70dc4c49b2a17f6bde30b880/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:22:53.518233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28347fd-f3d7-463d-a645-47ecc7c11d27 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:53.518599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28347fd-f3d7-463d-a645-47ecc7c11d27 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:53.518951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28347fd-f3d7-463d-a645-47ecc7c11d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:53.538332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a28347fd-f3d7-463d-a645-47ecc7c11d27 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:53.539424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a28347fd-f3d7-463d-a645-47ecc7c11d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:53.610768 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1371/2731] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:22:53.618802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3e0eb-31f4-4286-9d7f-3d9e550c093b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:53.620721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3ec3e0eb-31f4-4286-9d7f-3d9e550c093b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:53.689575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3e0eb-31f4-4286-9d7f-3d9e550c093b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:53.694286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88f5c8-3ce4-4685-9508-a60fc295f63c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:53.695180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88f5c8-3ce4-4685-9508-a60fc295f63c service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:53.695555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88f5c8-3ce4-4685-9508-a60fc295f63c service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:53.698721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88f5c8-3ce4-4685-9508-a60fc295f63c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:53.709325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88f5c8-3ce4-4685-9508-a60fc295f63c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:53.716442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88f5c8-3ce4-4685-9508-a60fc295f63c service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:53.722801 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1361/2732] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:22:54.618198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902de3f-4284-4b5c-a327-6f9dec0ea3db None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:54.626356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902de3f-4284-4b5c-a327-6f9dec0ea3db None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:54.626356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902de3f-4284-4b5c-a327-6f9dec0ea3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:54.638857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0902de3f-4284-4b5c-a327-6f9dec0ea3db None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:54.640083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0902de3f-4284-4b5c-a327-6f9dec0ea3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:54.698870 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1372/2733] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:22:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:54.713030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88f5c8-3ce4-4685-9508-a60fc295f63c service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:54.714525 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1a88f5c8-3ce4-4685-9508-a60fc295f63c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:54.795282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88f5c8-3ce4-4685-9508-a60fc295f63c service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:54.801163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea0516-65ab-4d91-954c-5b864ad931c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:54.802058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea0516-65ab-4d91-954c-5b864ad931c5 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:54.802343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea0516-65ab-4d91-954c-5b864ad931c5 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:54.802621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea0516-65ab-4d91-954c-5b864ad931c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:54.811023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea0516-65ab-4d91-954c-5b864ad931c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:54.812610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea0516-65ab-4d91-954c-5b864ad931c5 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:54.821098 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1362/2734] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:22:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:22:55.321177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902de3f-4284-4b5c-a327-6f9dec0ea3db None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:55.322591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0902de3f-4284-4b5c-a327-6f9dec0ea3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:55.336872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902de3f-4284-4b5c-a327-6f9dec0ea3db None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:55.341423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e76b6-bb5a-4b26-86ac-ba5a6abcd742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:55.342293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e76b6-bb5a-4b26-86ac-ba5a6abcd742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:55.342575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e76b6-bb5a-4b26-86ac-ba5a6abcd742 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:55.342851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e76b6-bb5a-4b26-86ac-ba5a6abcd742 admin admin] PATH_INFO: `/v3/users/d34d24dc6ae049cb8f8b90e88a3a9db4` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:55.344120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e76b6-bb5a-4b26-86ac-ba5a6abcd742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d34d24dc6ae049cb8f8b90e88a3a9db4)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:55.346705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e76b6-bb5a-4b26-86ac-ba5a6abcd742 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:55.556096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ad2e76b6-bb5a-4b26-86ac-ba5a6abcd742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd34d24dc6ae049cb8f8b90e88a3a9db4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:55.567451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ad2e76b6-bb5a-4b26-86ac-ba5a6abcd742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd34d24dc6ae049cb8f8b90e88a3a9db4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:55.568116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ad2e76b6-bb5a-4b26-86ac-ba5a6abcd742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd34d24dc6ae049cb8f8b90e88a3a9db4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:55.575613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ad2e76b6-bb5a-4b26-86ac-ba5a6abcd742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd34d24dc6ae049cb8f8b90e88a3a9db4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:55.657564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ad2e76b6-bb5a-4b26-86ac-ba5a6abcd742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd34d24dc6ae049cb8f8b90e88a3a9db4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:55.667037 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1373/2735] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:22:55 2022] DELETE /identity/v3/users/d34d24dc6ae049cb8f8b90e88a3a9db4 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:55.669528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ef45e-c65c-4e1e-8d6d-6bba1a9e5309 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:55.669821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ef45e-c65c-4e1e-8d6d-6bba1a9e5309 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:55.670313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ef45e-c65c-4e1e-8d6d-6bba1a9e5309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:55.687625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f60ef45e-c65c-4e1e-8d6d-6bba1a9e5309 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:55.688866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f60ef45e-c65c-4e1e-8d6d-6bba1a9e5309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:55.761785 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1363/2736] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:55.772646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e76b6-bb5a-4b26-86ac-ba5a6abcd742 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:55.774154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ad2e76b6-bb5a-4b26-86ac-ba5a6abcd742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:55.843839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e76b6-bb5a-4b26-86ac-ba5a6abcd742 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:55.852299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f2b4d-46bb-42a9-b057-2bd87d167f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:55.853022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f2b4d-46bb-42a9-b057-2bd87d167f4c service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:55.853307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f2b4d-46bb-42a9-b057-2bd87d167f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:55.853586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f2b4d-46bb-42a9-b057-2bd87d167f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:55.867607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f2b4d-46bb-42a9-b057-2bd87d167f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:55.869393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f2b4d-46bb-42a9-b057-2bd87d167f4c service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:55.882079 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1374/2737] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:22:56.557351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ef45e-c65c-4e1e-8d6d-6bba1a9e5309 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:56.558829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f60ef45e-c65c-4e1e-8d6d-6bba1a9e5309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:56.571035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ef45e-c65c-4e1e-8d6d-6bba1a9e5309 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:56.579749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e3f88-82c7-4bcd-b2fa-126fb883db0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:56.579749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e3f88-82c7-4bcd-b2fa-126fb883db0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:56.579749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e3f88-82c7-4bcd-b2fa-126fb883db0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:56.579749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e3f88-82c7-4bcd-b2fa-126fb883db0e admin admin] PATH_INFO: `/v3/projects/50ba431a6e894157abc90e36eb1ded86` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:56.580727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e3f88-82c7-4bcd-b2fa-126fb883db0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=50ba431a6e894157abc90e36eb1ded86)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:56.582125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e3f88-82c7-4bcd-b2fa-126fb883db0e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:56.708573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b03e3f88-82c7-4bcd-b2fa-126fb883db0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50ba431a6e894157abc90e36eb1ded86', 'request_id': 'req-b03e3f88-82c7-4bcd-b2fa-126fb883db0e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:56.800433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b03e3f88-82c7-4bcd-b2fa-126fb883db0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50ba431a6e894157abc90e36eb1ded86', 'request_id': 'req-b03e3f88-82c7-4bcd-b2fa-126fb883db0e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:56.807182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b03e3f88-82c7-4bcd-b2fa-126fb883db0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50ba431a6e894157abc90e36eb1ded86', 'request_id': 'req-b03e3f88-82c7-4bcd-b2fa-126fb883db0e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:56.817470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b03e3f88-82c7-4bcd-b2fa-126fb883db0e admin admin] The token cache is being invalidate because project 50ba431a6e894157abc90e36eb1ded86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:22:56.817762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b03e3f88-82c7-4bcd-b2fa-126fb883db0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:56.818397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b03e3f88-82c7-4bcd-b2fa-126fb883db0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:56.820054 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1364/2738] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:22:56 2022] DELETE /identity/v3/projects/50ba431a6e894157abc90e36eb1ded86 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:56.825173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9061adf-d359-4e44-925a-740714458ec4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:56.825652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9061adf-d359-4e44-925a-740714458ec4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:56.825747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9061adf-d359-4e44-925a-740714458ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:56.844706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a9061adf-d359-4e44-925a-740714458ec4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:56.846499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a9061adf-d359-4e44-925a-740714458ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:56.910884 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1375/2739] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:56.913045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2946f-dadf-4e2d-ac62-1854e9bdff97 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:56.913338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2946f-dadf-4e2d-ac62-1854e9bdff97 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:56.913621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2946f-dadf-4e2d-ac62-1854e9bdff97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:56.931813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b2c2946f-dadf-4e2d-ac62-1854e9bdff97 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:56.933007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b2c2946f-dadf-4e2d-ac62-1854e9bdff97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:56.941240 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1365/2740] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:56.945806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9061adf-d359-4e44-925a-740714458ec4 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:56.956162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9061adf-d359-4e44-925a-740714458ec4 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:56.960850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d62101-c4b9-4ffc-85e1-122007b50555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:56.963511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d62101-c4b9-4ffc-85e1-122007b50555 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:56.963511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d62101-c4b9-4ffc-85e1-122007b50555 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:56.963511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d62101-c4b9-4ffc-85e1-122007b50555 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:56.963511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d62101-c4b9-4ffc-85e1-122007b50555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:22:56.963511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d62101-c4b9-4ffc-85e1-122007b50555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:56.964762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d62101-c4b9-4ffc-85e1-122007b50555 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:56.976945 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1376/2741] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:22:56.981935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2946f-dadf-4e2d-ac62-1854e9bdff97 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:56.994635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2946f-dadf-4e2d-ac62-1854e9bdff97 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:56.999783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ddbb3-f12a-4bab-ad9e-6cc707e94a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:57.000444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ddbb3-f12a-4bab-ad9e-6cc707e94a05 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:57.000763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ddbb3-f12a-4bab-ad9e-6cc707e94a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:57.001043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ddbb3-f12a-4bab-ad9e-6cc707e94a05 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:57.001771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ddbb3-f12a-4bab-ad9e-6cc707e94a05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:57.003701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ddbb3-f12a-4bab-ad9e-6cc707e94a05 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:57.151469 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1366/2742] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:22:56 2022] POST /identity/v3/projects => generated 397 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:22:57.153654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d62101-c4b9-4ffc-85e1-122007b50555 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:57.165313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d62101-c4b9-4ffc-85e1-122007b50555 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:57.222159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e518f6a-7cfd-4d23-9504-3d1745e9df5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:57.222828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e518f6a-7cfd-4d23-9504-3d1745e9df5b admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:57.223116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e518f6a-7cfd-4d23-9504-3d1745e9df5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:57.223395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e518f6a-7cfd-4d23-9504-3d1745e9df5b admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:57.224082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e518f6a-7cfd-4d23-9504-3d1745e9df5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:57.226041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e518f6a-7cfd-4d23-9504-3d1745e9df5b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:57.335740 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1377/2743] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:22:57 2022] POST /identity/v3/users => generated 299 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:22:57.337060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ddbb3-f12a-4bab-ad9e-6cc707e94a05 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:57.347797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ddbb3-f12a-4bab-ad9e-6cc707e94a05 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:57.352554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d85822-a798-415d-84c0-90f2d5309b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:57.353273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d85822-a798-415d-84c0-90f2d5309b63 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:57.353556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d85822-a798-415d-84c0-90f2d5309b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:57.353956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d85822-a798-415d-84c0-90f2d5309b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:57.354692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d85822-a798-415d-84c0-90f2d5309b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:57.356289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d85822-a798-415d-84c0-90f2d5309b63 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:57.370838 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1367/2744] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:22:57.375899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e518f6a-7cfd-4d23-9504-3d1745e9df5b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:57.383229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e518f6a-7cfd-4d23-9504-3d1745e9df5b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:57.387967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ecfe32-2448-4ee4-a9a7-b0bfb1fb5e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:57.388767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecfe32-2448-4ee4-a9a7-b0bfb1fb5e0a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:57.389054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecfe32-2448-4ee4-a9a7-b0bfb1fb5e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:57.389332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecfe32-2448-4ee4-a9a7-b0bfb1fb5e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:57.390057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ecfe32-2448-4ee4-a9a7-b0bfb1fb5e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:57.391681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ecfe32-2448-4ee4-a9a7-b0bfb1fb5e0a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:57.403250 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1378/2745] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:22:57.407596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d85822-a798-415d-84c0-90f2d5309b63 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:57.417935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d85822-a798-415d-84c0-90f2d5309b63 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:57.423016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab232e-1166-4880-bc30-cca14c119278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:57.423981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab232e-1166-4880-bc30-cca14c119278 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:57.424330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab232e-1166-4880-bc30-cca14c119278 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:57.424706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab232e-1166-4880-bc30-cca14c119278 admin admin] PATH_INFO: `/v3/projects/77208acc23624f818df4f1466284dd3b/users/2603659ae8af469cac7c78efd4e36676/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:57.440174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab232e-1166-4880-bc30-cca14c119278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77208acc23624f818df4f1466284dd3b, user_id=2603659ae8af469cac7c78efd4e36676, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:57.442975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab232e-1166-4880-bc30-cca14c119278 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:57.552903 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1368/2746] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:22:57 2022] PUT /identity/v3/projects/77208acc23624f818df4f1466284dd3b/users/2603659ae8af469cac7c78efd4e36676/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:57.557364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf478abd-ece3-46b5-b55d-367468627aac None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:57.557656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf478abd-ece3-46b5-b55d-367468627aac None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:57.557939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf478abd-ece3-46b5-b55d-367468627aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:57.587007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-cf478abd-ece3-46b5-b55d-367468627aac None None] MFA Rules not processed for user `2603659ae8af469cac7c78efd4e36676`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:57.588797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cf478abd-ece3-46b5-b55d-367468627aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:57.659374 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1379/2747] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:57.672057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab232e-1166-4880-bc30-cca14c119278 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:57.681403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-84ab232e-1166-4880-bc30-cca14c119278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:57.759680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab232e-1166-4880-bc30-cca14c119278 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:57.766342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a20002-33d5-4a38-b4eb-9dfd139e0725 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:57.767562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a20002-33d5-4a38-b4eb-9dfd139e0725 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:57.767562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a20002-33d5-4a38-b4eb-9dfd139e0725 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:57.767885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a20002-33d5-4a38-b4eb-9dfd139e0725 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:57.778185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a20002-33d5-4a38-b4eb-9dfd139e0725 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:57.779955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a20002-33d5-4a38-b4eb-9dfd139e0725 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:57.791501 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1369/2748] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:57 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:22:58.021759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf478abd-ece3-46b5-b55d-367468627aac None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:58.092518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf478abd-ece3-46b5-b55d-367468627aac None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:58.110889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f2e14-8fb6-4105-809e-dee277fdf0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:58.112619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f2e14-8fb6-4105-809e-dee277fdf0d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:58.112925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f2e14-8fb6-4105-809e-dee277fdf0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:58.113419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f2e14-8fb6-4105-809e-dee277fdf0d5 admin admin] PATH_INFO: `/v3/users/2603659ae8af469cac7c78efd4e36676` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:58.114784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f2e14-8fb6-4105-809e-dee277fdf0d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2603659ae8af469cac7c78efd4e36676)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:58.116866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f2e14-8fb6-4105-809e-dee277fdf0d5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:58.342837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-479f2e14-8fb6-4105-809e-dee277fdf0d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2603659ae8af469cac7c78efd4e36676'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:58.357934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-479f2e14-8fb6-4105-809e-dee277fdf0d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2603659ae8af469cac7c78efd4e36676'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:58.358850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-479f2e14-8fb6-4105-809e-dee277fdf0d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2603659ae8af469cac7c78efd4e36676'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:58.365699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-479f2e14-8fb6-4105-809e-dee277fdf0d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2603659ae8af469cac7c78efd4e36676'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:58.466676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-479f2e14-8fb6-4105-809e-dee277fdf0d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2603659ae8af469cac7c78efd4e36676'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:58.481572 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1380/2749] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:22:58 2022] DELETE /identity/v3/users/2603659ae8af469cac7c78efd4e36676 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:58.485664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edb926-b16e-4aa1-8ba5-8c77f8ef9bd7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:58.486168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edb926-b16e-4aa1-8ba5-8c77f8ef9bd7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:58.486498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edb926-b16e-4aa1-8ba5-8c77f8ef9bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:58.512064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-87edb926-b16e-4aa1-8ba5-8c77f8ef9bd7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:58.513782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-87edb926-b16e-4aa1-8ba5-8c77f8ef9bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:58.591916 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1370/2750] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:22:58.602768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f2e14-8fb6-4105-809e-dee277fdf0d5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:58.604372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-479f2e14-8fb6-4105-809e-dee277fdf0d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:58.664807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f2e14-8fb6-4105-809e-dee277fdf0d5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:58.670133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216756d-d720-46a9-8e84-52ec7891f47e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:58.670809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216756d-d720-46a9-8e84-52ec7891f47e service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:58.671094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216756d-d720-46a9-8e84-52ec7891f47e service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:58.671375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216756d-d720-46a9-8e84-52ec7891f47e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:58.683288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216756d-d720-46a9-8e84-52ec7891f47e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:58.684787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216756d-d720-46a9-8e84-52ec7891f47e service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:58.697061 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1381/2751] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:22:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:22:59.421533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edb926-b16e-4aa1-8ba5-8c77f8ef9bd7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:59.421533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-87edb926-b16e-4aa1-8ba5-8c77f8ef9bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:59.434494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edb926-b16e-4aa1-8ba5-8c77f8ef9bd7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:59.442495 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485819f-0b1d-48d2-a553-35c3bdd2713c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:59.443533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485819f-0b1d-48d2-a553-35c3bdd2713c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:59.443822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485819f-0b1d-48d2-a553-35c3bdd2713c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:59.444130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485819f-0b1d-48d2-a553-35c3bdd2713c admin admin] PATH_INFO: `/v3/projects/77208acc23624f818df4f1466284dd3b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:59.445712 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485819f-0b1d-48d2-a553-35c3bdd2713c admin admin] RBAC: Authorizing `identity:delete_project(project_id=77208acc23624f818df4f1466284dd3b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:59.447668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485819f-0b1d-48d2-a553-35c3bdd2713c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:59.624566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7485819f-0b1d-48d2-a553-35c3bdd2713c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77208acc23624f818df4f1466284dd3b', 'request_id': 'req-7485819f-0b1d-48d2-a553-35c3bdd2713c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:59.740676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7485819f-0b1d-48d2-a553-35c3bdd2713c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77208acc23624f818df4f1466284dd3b', 'request_id': 'req-7485819f-0b1d-48d2-a553-35c3bdd2713c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:59.750020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7485819f-0b1d-48d2-a553-35c3bdd2713c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77208acc23624f818df4f1466284dd3b', 'request_id': 'req-7485819f-0b1d-48d2-a553-35c3bdd2713c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:59.763580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7485819f-0b1d-48d2-a553-35c3bdd2713c admin admin] The token cache is being invalidate because project 77208acc23624f818df4f1466284dd3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:22:59.764389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7485819f-0b1d-48d2-a553-35c3bdd2713c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:59.765585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7485819f-0b1d-48d2-a553-35c3bdd2713c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:22:59.768459 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1371/2752] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:22:59 2022] DELETE /identity/v3/projects/77208acc23624f818df4f1466284dd3b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:22:59.773651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c86f8f-5a41-412a-a637-941de192f02d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:59.774159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c86f8f-5a41-412a-a637-941de192f02d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:59.774386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c86f8f-5a41-412a-a637-941de192f02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:59.794619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a8c86f8f-5a41-412a-a637-941de192f02d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:59.795866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a8c86f8f-5a41-412a-a637-941de192f02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:59.884929 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1382/2753] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:22:59.893808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea318134-3e0d-452d-9e4c-b2c30a4b4af6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:59.894471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea318134-3e0d-452d-9e4c-b2c30a4b4af6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:59.894759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea318134-3e0d-452d-9e4c-b2c30a4b4af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:59.916257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ea318134-3e0d-452d-9e4c-b2c30a4b4af6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:22:59.917561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ea318134-3e0d-452d-9e4c-b2c30a4b4af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:22:59.934626 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1372/2754] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:22:59.939557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c86f8f-5a41-412a-a637-941de192f02d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:59.950312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c86f8f-5a41-412a-a637-941de192f02d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:22:59.958051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac176a2-8287-459c-9461-231842bafd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:22:59.959009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac176a2-8287-459c-9461-231842bafd13 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:22:59.959601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac176a2-8287-459c-9461-231842bafd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:22:59.960231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac176a2-8287-459c-9461-231842bafd13 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:22:59.961202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac176a2-8287-459c-9461-231842bafd13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:22:59.961686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac176a2-8287-459c-9461-231842bafd13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:22:59.964176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac176a2-8287-459c-9461-231842bafd13 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:22:59.979388 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1383/2755] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:22:59.983976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea318134-3e0d-452d-9e4c-b2c30a4b4af6 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:22:59.994308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea318134-3e0d-452d-9e4c-b2c30a4b4af6 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:00.000011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5798b42-7164-4760-9535-9193a4b6ac80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:00.000729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798b42-7164-4760-9535-9193a4b6ac80 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:00.001020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798b42-7164-4760-9535-9193a4b6ac80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:00.001327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5798b42-7164-4760-9535-9193a4b6ac80 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:00.002067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5798b42-7164-4760-9535-9193a4b6ac80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:00.004435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5798b42-7164-4760-9535-9193a4b6ac80 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:00.103884 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1373/2756] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:22:59 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:23:00.106455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac176a2-8287-459c-9461-231842bafd13 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:00.118305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac176a2-8287-459c-9461-231842bafd13 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:00.181450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a830023-e494-450d-9cd9-9a0c7918a94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:00.182064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a830023-e494-450d-9cd9-9a0c7918a94d admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:00.182403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a830023-e494-450d-9cd9-9a0c7918a94d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:00.182888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a830023-e494-450d-9cd9-9a0c7918a94d admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:00.183595 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a830023-e494-450d-9cd9-9a0c7918a94d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:00.185600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a830023-e494-450d-9cd9-9a0c7918a94d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:00.363587 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1384/2757] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:23:00 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:23:00.368628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5ae59-bfdb-42fa-bb52-bd2c46ed48d1 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:00.369072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5ae59-bfdb-42fa-bb52-bd2c46ed48d1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:00.369598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5ae59-bfdb-42fa-bb52-bd2c46ed48d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:00.373466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a830023-e494-450d-9cd9-9a0c7918a94d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:00.401943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a830023-e494-450d-9cd9-9a0c7918a94d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:00.409326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45274351-2790-4ccb-8302-e21e3227b1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:00.410428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45274351-2790-4ccb-8302-e21e3227b1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:00.410809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45274351-2790-4ccb-8302-e21e3227b1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:00.411140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45274351-2790-4ccb-8302-e21e3227b1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:00.412008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45274351-2790-4ccb-8302-e21e3227b1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:00.413927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45274351-2790-4ccb-8302-e21e3227b1d0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:00.422619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-25f5ae59-bfdb-42fa-bb52-bd2c46ed48d1 None None] MFA Rules not processed for user `cc47e87a70dc4c49b2a17f6bde30b880`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:00.426870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-25f5ae59-bfdb-42fa-bb52-bd2c46ed48d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:00.433895 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1385/2758] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:23:00.438853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45274351-2790-4ccb-8302-e21e3227b1d0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:00.452011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45274351-2790-4ccb-8302-e21e3227b1d0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:00.461254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef45dc4-c595-4fc7-af38-202b4e219b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:00.467132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef45dc4-c595-4fc7-af38-202b4e219b93 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:00.467132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef45dc4-c595-4fc7-af38-202b4e219b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:00.467132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef45dc4-c595-4fc7-af38-202b4e219b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:00.467132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef45dc4-c595-4fc7-af38-202b4e219b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:00.468745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef45dc4-c595-4fc7-af38-202b4e219b93 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:00.482236 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1386/2759] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:23:00.489126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef45dc4-c595-4fc7-af38-202b4e219b93 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:00.501357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef45dc4-c595-4fc7-af38-202b4e219b93 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:00.509201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0119649-63f6-424a-95d0-8d4de18f0942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:00.510158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0119649-63f6-424a-95d0-8d4de18f0942 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:00.510440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0119649-63f6-424a-95d0-8d4de18f0942 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:00.511684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0119649-63f6-424a-95d0-8d4de18f0942 admin admin] PATH_INFO: `/v3/projects/ff8017d66d544a968e6b1f8fadd1d964/users/89a2cea2ed054773b017122f68826044/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:00.519906 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1374/2760] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:23:00.521654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15305a-e51e-40ec-9d07-5d46c227ee45 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:00.522118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15305a-e51e-40ec-9d07-5d46c227ee45 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:00.522402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb15305a-e51e-40ec-9d07-5d46c227ee45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:00.528652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0119649-63f6-424a-95d0-8d4de18f0942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff8017d66d544a968e6b1f8fadd1d964, user_id=89a2cea2ed054773b017122f68826044, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:00.532031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0119649-63f6-424a-95d0-8d4de18f0942 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:00.546063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-cb15305a-e51e-40ec-9d07-5d46c227ee45 None None] MFA Rules not processed for user `cc47e87a70dc4c49b2a17f6bde30b880`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:00.547598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-cb15305a-e51e-40ec-9d07-5d46c227ee45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:00.555704 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1375/2761] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:00.567643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15305a-e51e-40ec-9d07-5d46c227ee45 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:00.569124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-cb15305a-e51e-40ec-9d07-5d46c227ee45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:00.614212 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1387/2762] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:23:00 2022] PUT /identity/v3/projects/ff8017d66d544a968e6b1f8fadd1d964/users/89a2cea2ed054773b017122f68826044/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:00.624968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785252e0-c07c-4dde-9373-f5548658bced None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:00.625259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785252e0-c07c-4dde-9373-f5548658bced None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:00.625542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785252e0-c07c-4dde-9373-f5548658bced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:00.657527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb15305a-e51e-40ec-9d07-5d46c227ee45 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:00.658338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-785252e0-c07c-4dde-9373-f5548658bced None None] MFA Rules not processed for user `89a2cea2ed054773b017122f68826044`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:00.659607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-785252e0-c07c-4dde-9373-f5548658bced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:00.734372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1ca82-ea9b-4558-8560-d7e6db515c11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:00.735022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1ca82-ea9b-4558-8560-d7e6db515c11 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:00.740254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1ca82-ea9b-4558-8560-d7e6db515c11 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:00.740254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1ca82-ea9b-4558-8560-d7e6db515c11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:00.752742 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1388/2763] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:23:00.803987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1ca82-ea9b-4558-8560-d7e6db515c11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:00.806002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1ca82-ea9b-4558-8560-d7e6db515c11 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:00.817460 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1376/2764] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:23:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:23:00.910138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785252e0-c07c-4dde-9373-f5548658bced None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:00.911750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-785252e0-c07c-4dde-9373-f5548658bced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:00.933105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785252e0-c07c-4dde-9373-f5548658bced None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:00.939378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60420641-21fc-4010-982a-3a638b48ba1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:00.940252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60420641-21fc-4010-982a-3a638b48ba1d service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:00.940537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60420641-21fc-4010-982a-3a638b48ba1d service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:00.940847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60420641-21fc-4010-982a-3a638b48ba1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:00.954503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60420641-21fc-4010-982a-3a638b48ba1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:00.954503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60420641-21fc-4010-982a-3a638b48ba1d service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:00.961958 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1389/2765] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:23:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:23:01.760690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baa552-6209-4060-b655-a7f2bf3178b2 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:01.761161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baa552-6209-4060-b655-a7f2bf3178b2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:01.761474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baa552-6209-4060-b655-a7f2bf3178b2 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:01.763793 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1377/2766] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:23:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:23:01.769973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aef03f-f702-4f44-b39e-796829c1c5bd None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:01.770271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aef03f-f702-4f44-b39e-796829c1c5bd None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:01.770558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aef03f-f702-4f44-b39e-796829c1c5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:01.792421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-41aef03f-f702-4f44-b39e-796829c1c5bd None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:01.793729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-41aef03f-f702-4f44-b39e-796829c1c5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:01.869012 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1390/2767] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:23:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:01.893796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35baa552-6209-4060-b655-a7f2bf3178b2 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:01.895688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-35baa552-6209-4060-b655-a7f2bf3178b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:01.916423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35baa552-6209-4060-b655-a7f2bf3178b2 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:01.922796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe17a68-ffb5-40a3-95cb-77f07609ea33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:01.923839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe17a68-ffb5-40a3-95cb-77f07609ea33 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:01.924130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe17a68-ffb5-40a3-95cb-77f07609ea33 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:01.929257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe17a68-ffb5-40a3-95cb-77f07609ea33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:01.953549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe17a68-ffb5-40a3-95cb-77f07609ea33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:01.956021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe17a68-ffb5-40a3-95cb-77f07609ea33 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:01.976791 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1378/2768] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:23:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:23:02.797282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aef03f-f702-4f44-b39e-796829c1c5bd None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:02.872376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aef03f-f702-4f44-b39e-796829c1c5bd None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:02.885253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a8cdb-883f-43cb-a47d-9d8be14739e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:02.885253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a8cdb-883f-43cb-a47d-9d8be14739e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:02.885253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a8cdb-883f-43cb-a47d-9d8be14739e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:02.885253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a8cdb-883f-43cb-a47d-9d8be14739e8 admin admin] PATH_INFO: `/v3/users/89a2cea2ed054773b017122f68826044` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:02.886308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a8cdb-883f-43cb-a47d-9d8be14739e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89a2cea2ed054773b017122f68826044)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:02.886308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a8cdb-883f-43cb-a47d-9d8be14739e8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:03.138018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-246a8cdb-883f-43cb-a47d-9d8be14739e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89a2cea2ed054773b017122f68826044'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:03.151993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-246a8cdb-883f-43cb-a47d-9d8be14739e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89a2cea2ed054773b017122f68826044'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:03.157027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-246a8cdb-883f-43cb-a47d-9d8be14739e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89a2cea2ed054773b017122f68826044'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:03.165398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-246a8cdb-883f-43cb-a47d-9d8be14739e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89a2cea2ed054773b017122f68826044'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:03.234443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-246a8cdb-883f-43cb-a47d-9d8be14739e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89a2cea2ed054773b017122f68826044'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:03.242657 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1391/2769] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:23:02 2022] DELETE /identity/v3/users/89a2cea2ed054773b017122f68826044 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:03.247372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45b453-e46e-4e38-9e2f-eaba205677a5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:03.248089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45b453-e46e-4e38-9e2f-eaba205677a5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:03.248089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45b453-e46e-4e38-9e2f-eaba205677a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:03.271640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-af45b453-e46e-4e38-9e2f-eaba205677a5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:03.272907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-af45b453-e46e-4e38-9e2f-eaba205677a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:03.353608 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1379/2770] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:03.364488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a8cdb-883f-43cb-a47d-9d8be14739e8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:03.366369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-246a8cdb-883f-43cb-a47d-9d8be14739e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:03.459080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a8cdb-883f-43cb-a47d-9d8be14739e8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:03.463199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55aa76-ec47-4817-b36c-2daa1f9a8135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:03.464050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55aa76-ec47-4817-b36c-2daa1f9a8135 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:03.464504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55aa76-ec47-4817-b36c-2daa1f9a8135 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:03.464954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55aa76-ec47-4817-b36c-2daa1f9a8135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:03.477035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55aa76-ec47-4817-b36c-2daa1f9a8135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:03.479805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55aa76-ec47-4817-b36c-2daa1f9a8135 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:03.496837 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1392/2771] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:23:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:23:04.070081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45b453-e46e-4e38-9e2f-eaba205677a5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:04.072110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-af45b453-e46e-4e38-9e2f-eaba205677a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:04.085221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45b453-e46e-4e38-9e2f-eaba205677a5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:04.090335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9988aff-7386-4dba-81ce-49a99e839c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:04.091714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9988aff-7386-4dba-81ce-49a99e839c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:04.092001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9988aff-7386-4dba-81ce-49a99e839c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:04.092277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9988aff-7386-4dba-81ce-49a99e839c83 admin admin] PATH_INFO: `/v3/projects/ff8017d66d544a968e6b1f8fadd1d964` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:04.093533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9988aff-7386-4dba-81ce-49a99e839c83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff8017d66d544a968e6b1f8fadd1d964)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:04.096830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9988aff-7386-4dba-81ce-49a99e839c83 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:04.344982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c9988aff-7386-4dba-81ce-49a99e839c83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff8017d66d544a968e6b1f8fadd1d964', 'request_id': 'req-c9988aff-7386-4dba-81ce-49a99e839c83'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:04.450657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c9988aff-7386-4dba-81ce-49a99e839c83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff8017d66d544a968e6b1f8fadd1d964', 'request_id': 'req-c9988aff-7386-4dba-81ce-49a99e839c83'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:04.465390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c9988aff-7386-4dba-81ce-49a99e839c83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff8017d66d544a968e6b1f8fadd1d964', 'request_id': 'req-c9988aff-7386-4dba-81ce-49a99e839c83'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:04.478304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c9988aff-7386-4dba-81ce-49a99e839c83 admin admin] The token cache is being invalidate because project ff8017d66d544a968e6b1f8fadd1d964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:23:04.478961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c9988aff-7386-4dba-81ce-49a99e839c83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:04.479722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c9988aff-7386-4dba-81ce-49a99e839c83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:04.481402 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1380/2772] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:23:04 2022] DELETE /identity/v3/projects/ff8017d66d544a968e6b1f8fadd1d964 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:04.486496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167a84d-4c7d-431e-a5dd-f2f3bb838e02 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:04.487353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167a84d-4c7d-431e-a5dd-f2f3bb838e02 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:04.487353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167a84d-4c7d-431e-a5dd-f2f3bb838e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:04.506880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4167a84d-4c7d-431e-a5dd-f2f3bb838e02 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:04.508212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4167a84d-4c7d-431e-a5dd-f2f3bb838e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:04.590359 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1393/2773] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:04.599954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7375e29-99e7-4c0a-bca3-a4fccc7d50ae None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:04.600335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7375e29-99e7-4c0a-bca3-a4fccc7d50ae None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:04.600787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7375e29-99e7-4c0a-bca3-a4fccc7d50ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:04.630039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c7375e29-99e7-4c0a-bca3-a4fccc7d50ae None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:04.632828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c7375e29-99e7-4c0a-bca3-a4fccc7d50ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:04.654359 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1381/2774] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:23:04.658984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167a84d-4c7d-431e-a5dd-f2f3bb838e02 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:04.670605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167a84d-4c7d-431e-a5dd-f2f3bb838e02 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:04.676144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56528e-b65f-40f4-828c-2c4d8aad2bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:04.682248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56528e-b65f-40f4-828c-2c4d8aad2bda admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:04.682248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56528e-b65f-40f4-828c-2c4d8aad2bda admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:04.682248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56528e-b65f-40f4-828c-2c4d8aad2bda admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:04.682248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56528e-b65f-40f4-828c-2c4d8aad2bda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:23:04.682248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56528e-b65f-40f4-828c-2c4d8aad2bda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:04.682248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56528e-b65f-40f4-828c-2c4d8aad2bda admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:04.693498 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1394/2775] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:23:04.697901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7375e29-99e7-4c0a-bca3-a4fccc7d50ae None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:04.710949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7375e29-99e7-4c0a-bca3-a4fccc7d50ae None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:04.720542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e436ae-34ae-4674-9d9a-3ddfceb1fffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:04.721538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e436ae-34ae-4674-9d9a-3ddfceb1fffd admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:04.721916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e436ae-34ae-4674-9d9a-3ddfceb1fffd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:04.722349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e436ae-34ae-4674-9d9a-3ddfceb1fffd admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:04.723128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e436ae-34ae-4674-9d9a-3ddfceb1fffd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:04.728694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e436ae-34ae-4674-9d9a-3ddfceb1fffd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:04.867588 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1382/2776] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:23:04 2022] POST /identity/v3/projects => generated 389 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:23:04.868891 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56528e-b65f-40f4-828c-2c4d8aad2bda admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:04.879920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56528e-b65f-40f4-828c-2c4d8aad2bda admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:04.948642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161e543-9b8e-440f-8a51-071c8917ec0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:04.949592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161e543-9b8e-440f-8a51-071c8917ec0f admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:04.950057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161e543-9b8e-440f-8a51-071c8917ec0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:04.950486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161e543-9b8e-440f-8a51-071c8917ec0f admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:04.951494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161e543-9b8e-440f-8a51-071c8917ec0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:04.954254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161e543-9b8e-440f-8a51-071c8917ec0f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:05.043093 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1395/2777] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:23:04 2022] POST /identity/v3/users => generated 295 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:23:05.049007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e436ae-34ae-4674-9d9a-3ddfceb1fffd admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:05.060012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e436ae-34ae-4674-9d9a-3ddfceb1fffd admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:05.065632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b1cae-a245-4433-ba93-2db67c89c9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:05.066523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b1cae-a245-4433-ba93-2db67c89c9ca admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:05.066806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b1cae-a245-4433-ba93-2db67c89c9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:05.067085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b1cae-a245-4433-ba93-2db67c89c9ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:05.067962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b1cae-a245-4433-ba93-2db67c89c9ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:05.069769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b1cae-a245-4433-ba93-2db67c89c9ca admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:05.081876 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1383/2778] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:23:05.085857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161e543-9b8e-440f-8a51-071c8917ec0f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:05.102304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161e543-9b8e-440f-8a51-071c8917ec0f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:05.107687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9752f6-d7c9-4098-b012-202a76fd9984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:05.108361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9752f6-d7c9-4098-b012-202a76fd9984 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:05.112751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9752f6-d7c9-4098-b012-202a76fd9984 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:05.112751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9752f6-d7c9-4098-b012-202a76fd9984 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:05.112751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9752f6-d7c9-4098-b012-202a76fd9984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:05.112751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9752f6-d7c9-4098-b012-202a76fd9984 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:05.124006 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1396/2779] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:23:05.128413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b1cae-a245-4433-ba93-2db67c89c9ca admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:05.141567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b1cae-a245-4433-ba93-2db67c89c9ca admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:05.146915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcb355-7600-4090-a80d-afb64f465229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:05.148113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcb355-7600-4090-a80d-afb64f465229 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:05.148542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcb355-7600-4090-a80d-afb64f465229 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:05.149009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcb355-7600-4090-a80d-afb64f465229 admin admin] PATH_INFO: `/v3/projects/f5040e3da1d14e19a9db95788a4a8fc1/users/3e6a67afc80148bdb3e674f7c3389eca/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:05.178171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcb355-7600-4090-a80d-afb64f465229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5040e3da1d14e19a9db95788a4a8fc1, user_id=3e6a67afc80148bdb3e674f7c3389eca, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:05.178171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcb355-7600-4090-a80d-afb64f465229 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:05.250356 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1384/2780] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:23:05 2022] PUT /identity/v3/projects/f5040e3da1d14e19a9db95788a4a8fc1/users/3e6a67afc80148bdb3e674f7c3389eca/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:05.261173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f8265-4e13-4bd5-a6b3-9e1f4da8d5cb None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:05.261467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f8265-4e13-4bd5-a6b3-9e1f4da8d5cb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:05.261966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f8265-4e13-4bd5-a6b3-9e1f4da8d5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:05.280573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f71f8265-4e13-4bd5-a6b3-9e1f4da8d5cb None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:05.282032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f71f8265-4e13-4bd5-a6b3-9e1f4da8d5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:05.358938 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1397/2781] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:05.416785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcb355-7600-4090-a80d-afb64f465229 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:05.421206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e8dcb355-7600-4090-a80d-afb64f465229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:05.509029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcb355-7600-4090-a80d-afb64f465229 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:05.515052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a84a05-021f-46bb-ad9f-4d9c7e1760fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:05.515846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a84a05-021f-46bb-ad9f-4d9c7e1760fc service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:05.516238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a84a05-021f-46bb-ad9f-4d9c7e1760fc service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:05.516702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a84a05-021f-46bb-ad9f-4d9c7e1760fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:05.539793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a84a05-021f-46bb-ad9f-4d9c7e1760fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:05.541626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a84a05-021f-46bb-ad9f-4d9c7e1760fc service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:05.560328 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1385/2782] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:23:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:23:07.330923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6148f51-9f6a-4539-ad32-76c05f7b0d02 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:07.331545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6148f51-9f6a-4539-ad32-76c05f7b0d02 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:07.331545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6148f51-9f6a-4539-ad32-76c05f7b0d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:07.368498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a6148f51-9f6a-4539-ad32-76c05f7b0d02 None None] MFA Rules not processed for user `3e6a67afc80148bdb3e674f7c3389eca`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:07.369771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a6148f51-9f6a-4539-ad32-76c05f7b0d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:07.446384 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1398/2783] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:07.458712 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a84a05-021f-46bb-ad9f-4d9c7e1760fc service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:07.460194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-03a84a05-021f-46bb-ad9f-4d9c7e1760fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:07.546658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a84a05-021f-46bb-ad9f-4d9c7e1760fc service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:07.546658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ed1ea-667e-4b49-b4ba-f29cf01b968d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:07.546658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ed1ea-667e-4b49-b4ba-f29cf01b968d service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:07.546658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ed1ea-667e-4b49-b4ba-f29cf01b968d service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:07.547500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ed1ea-667e-4b49-b4ba-f29cf01b968d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:07.553134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ed1ea-667e-4b49-b4ba-f29cf01b968d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:07.554725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ed1ea-667e-4b49-b4ba-f29cf01b968d service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:07.564077 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1386/2784] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:23:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:23:13.187631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b4e0b-fe0d-4823-822a-3876675491a8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:13.188151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b4e0b-fe0d-4823-822a-3876675491a8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:13.188425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b4e0b-fe0d-4823-822a-3876675491a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:13.211336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b01b4e0b-fe0d-4823-822a-3876675491a8 None None] MFA Rules not processed for user `1ea3eddf81624b41a4410ea85e17eabe`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:13.212896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b01b4e0b-fe0d-4823-822a-3876675491a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:13.276261 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1399/2785] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:21.022285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ed1ea-667e-4b49-b4ba-f29cf01b968d service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:21.034746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ed1ea-667e-4b49-b4ba-f29cf01b968d service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:21.039376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74965b55-92eb-4001-a38a-b915dc16c6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:21.040733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74965b55-92eb-4001-a38a-b915dc16c6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:21.040733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74965b55-92eb-4001-a38a-b915dc16c6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:21.040916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74965b55-92eb-4001-a38a-b915dc16c6cd admin admin] PATH_INFO: `/v3/users/3e6a67afc80148bdb3e674f7c3389eca` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:21.042020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74965b55-92eb-4001-a38a-b915dc16c6cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e6a67afc80148bdb3e674f7c3389eca)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:21.043905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74965b55-92eb-4001-a38a-b915dc16c6cd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:21.254677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74965b55-92eb-4001-a38a-b915dc16c6cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e6a67afc80148bdb3e674f7c3389eca'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:21.269405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74965b55-92eb-4001-a38a-b915dc16c6cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e6a67afc80148bdb3e674f7c3389eca'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:21.270601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74965b55-92eb-4001-a38a-b915dc16c6cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e6a67afc80148bdb3e674f7c3389eca'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:21.278645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74965b55-92eb-4001-a38a-b915dc16c6cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e6a67afc80148bdb3e674f7c3389eca'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:21.396748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74965b55-92eb-4001-a38a-b915dc16c6cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e6a67afc80148bdb3e674f7c3389eca'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:21.404215 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1387/2786] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:23:21 2022] DELETE /identity/v3/users/3e6a67afc80148bdb3e674f7c3389eca => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:21.809873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b4e0b-fe0d-4823-822a-3876675491a8 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:21.832269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b4e0b-fe0d-4823-822a-3876675491a8 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:21.975034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c754574-baca-46d8-b7c0-7547af19f4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:21.977918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c754574-baca-46d8-b7c0-7547af19f4f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:21.979467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c754574-baca-46d8-b7c0-7547af19f4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:21.979916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c754574-baca-46d8-b7c0-7547af19f4f0 admin admin] PATH_INFO: `/v3/projects/f5040e3da1d14e19a9db95788a4a8fc1` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:21.981393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c754574-baca-46d8-b7c0-7547af19f4f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5040e3da1d14e19a9db95788a4a8fc1)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:21.984669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c754574-baca-46d8-b7c0-7547af19f4f0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:22.124622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3c754574-baca-46d8-b7c0-7547af19f4f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5040e3da1d14e19a9db95788a4a8fc1', 'request_id': 'req-3c754574-baca-46d8-b7c0-7547af19f4f0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:22.138192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3c754574-baca-46d8-b7c0-7547af19f4f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5040e3da1d14e19a9db95788a4a8fc1', 'request_id': 'req-3c754574-baca-46d8-b7c0-7547af19f4f0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:22.256863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3c754574-baca-46d8-b7c0-7547af19f4f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5040e3da1d14e19a9db95788a4a8fc1', 'request_id': 'req-3c754574-baca-46d8-b7c0-7547af19f4f0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:22.272641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3c754574-baca-46d8-b7c0-7547af19f4f0 admin admin] The token cache is being invalidate because project f5040e3da1d14e19a9db95788a4a8fc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:23:22.274352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3c754574-baca-46d8-b7c0-7547af19f4f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:22.276222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3c754574-baca-46d8-b7c0-7547af19f4f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:22.278576 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1400/2787] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:23:21 2022] DELETE /identity/v3/projects/f5040e3da1d14e19a9db95788a4a8fc1 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:22.298849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c0cef-681f-4ef3-a930-c4c2f5bbfc35 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:22.299718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c0cef-681f-4ef3-a930-c4c2f5bbfc35 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:22.300150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c0cef-681f-4ef3-a930-c4c2f5bbfc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:22.326091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-007c0cef-681f-4ef3-a930-c4c2f5bbfc35 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:22.327586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-007c0cef-681f-4ef3-a930-c4c2f5bbfc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:22.431287 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1388/2788] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:23:22.440353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403843f-0638-4c0d-b0db-d2c6fa2f4979 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:22.440671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403843f-0638-4c0d-b0db-d2c6fa2f4979 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:22.441053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403843f-0638-4c0d-b0db-d2c6fa2f4979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:22.462529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d403843f-0638-4c0d-b0db-d2c6fa2f4979 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:22.464075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d403843f-0638-4c0d-b0db-d2c6fa2f4979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:22.473677 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1401/2789] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:22.482793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c0cef-681f-4ef3-a930-c4c2f5bbfc35 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:22.493358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c0cef-681f-4ef3-a930-c4c2f5bbfc35 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:22.500242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8061d2-43c4-4dd2-b9d6-f95eb955da2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:22.501642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8061d2-43c4-4dd2-b9d6-f95eb955da2f admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:22.502938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8061d2-43c4-4dd2-b9d6-f95eb955da2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:22.502938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8061d2-43c4-4dd2-b9d6-f95eb955da2f admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:22.503179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8061d2-43c4-4dd2-b9d6-f95eb955da2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:23:22.503579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8061d2-43c4-4dd2-b9d6-f95eb955da2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:22.505467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8061d2-43c4-4dd2-b9d6-f95eb955da2f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:22.521098 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1389/2790] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:23:22.530978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403843f-0638-4c0d-b0db-d2c6fa2f4979 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:22.545152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403843f-0638-4c0d-b0db-d2c6fa2f4979 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:22.551959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c07f1-3bbd-496f-8236-fc62a8071a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:22.553226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c07f1-3bbd-496f-8236-fc62a8071a2c admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:22.553839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c07f1-3bbd-496f-8236-fc62a8071a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:22.554298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c07f1-3bbd-496f-8236-fc62a8071a2c admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:22.555184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c07f1-3bbd-496f-8236-fc62a8071a2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:22.557505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c07f1-3bbd-496f-8236-fc62a8071a2c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:22.700880 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1402/2791] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:23:22 2022] POST /identity/v3/projects => generated 401 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:23:22.712798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8061d2-43c4-4dd2-b9d6-f95eb955da2f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:22.726705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8061d2-43c4-4dd2-b9d6-f95eb955da2f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:22.792249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468ddad-dd31-4c93-9ac0-cc16080a44f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:22.792961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468ddad-dd31-4c93-9ac0-cc16080a44f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:22.793242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468ddad-dd31-4c93-9ac0-cc16080a44f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:22.793521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468ddad-dd31-4c93-9ac0-cc16080a44f4 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:22.794214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468ddad-dd31-4c93-9ac0-cc16080a44f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:22.796117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468ddad-dd31-4c93-9ac0-cc16080a44f4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:22.909195 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1390/2792] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:23:22 2022] POST /identity/v3/users => generated 301 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:23:22.910685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c07f1-3bbd-496f-8236-fc62a8071a2c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:22.920871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c07f1-3bbd-496f-8236-fc62a8071a2c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:22.925592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389179b-31ff-44d1-8b73-a95961ae5d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:22.926320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389179b-31ff-44d1-8b73-a95961ae5d61 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:22.926673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389179b-31ff-44d1-8b73-a95961ae5d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:22.927203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389179b-31ff-44d1-8b73-a95961ae5d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:22.928024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389179b-31ff-44d1-8b73-a95961ae5d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:22.929965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389179b-31ff-44d1-8b73-a95961ae5d61 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:22.942835 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1403/2793] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:23:22.946751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468ddad-dd31-4c93-9ac0-cc16080a44f4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:22.957702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468ddad-dd31-4c93-9ac0-cc16080a44f4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:22.962510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143057b6-50fb-45f5-8a8b-a62174074c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:22.963173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143057b6-50fb-45f5-8a8b-a62174074c71 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:22.963481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143057b6-50fb-45f5-8a8b-a62174074c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:22.963759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143057b6-50fb-45f5-8a8b-a62174074c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:22.964485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143057b6-50fb-45f5-8a8b-a62174074c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:22.966099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143057b6-50fb-45f5-8a8b-a62174074c71 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:22.976876 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1391/2794] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:23:22.981523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389179b-31ff-44d1-8b73-a95961ae5d61 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:22.992720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389179b-31ff-44d1-8b73-a95961ae5d61 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:22.997418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce4b61-fa2d-47fb-bb8b-bf5a9f36b4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:22.998586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce4b61-fa2d-47fb-bb8b-bf5a9f36b4ad admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:22.998867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce4b61-fa2d-47fb-bb8b-bf5a9f36b4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:22.999144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce4b61-fa2d-47fb-bb8b-bf5a9f36b4ad admin admin] PATH_INFO: `/v3/projects/5e6ac2474f6b4a76a69742d3f99e4250/users/dd8bbea47a91440aaa987f36d751cc58/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:23.015029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce4b61-fa2d-47fb-bb8b-bf5a9f36b4ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e6ac2474f6b4a76a69742d3f99e4250, user_id=dd8bbea47a91440aaa987f36d751cc58, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:23.017216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce4b61-fa2d-47fb-bb8b-bf5a9f36b4ad admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:23.125676 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1404/2795] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:23:22 2022] PUT /identity/v3/projects/5e6ac2474f6b4a76a69742d3f99e4250/users/dd8bbea47a91440aaa987f36d751cc58/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:23.139235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6192e2-59ca-4e3c-aca3-b6981500ff4f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:23.139531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6192e2-59ca-4e3c-aca3-b6981500ff4f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:23.139814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6192e2-59ca-4e3c-aca3-b6981500ff4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:23.170997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-5a6192e2-59ca-4e3c-aca3-b6981500ff4f None None] MFA Rules not processed for user `dd8bbea47a91440aaa987f36d751cc58`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:23.172297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5a6192e2-59ca-4e3c-aca3-b6981500ff4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:23.286338 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1392/2796] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:23.299697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce4b61-fa2d-47fb-bb8b-bf5a9f36b4ad admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:23.374545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce4b61-fa2d-47fb-bb8b-bf5a9f36b4ad admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:23.380427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31838a-5aac-48d0-8abb-29bf7433c6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:23.381389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31838a-5aac-48d0-8abb-29bf7433c6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:23.381797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31838a-5aac-48d0-8abb-29bf7433c6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:23.382040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31838a-5aac-48d0-8abb-29bf7433c6cd admin admin] PATH_INFO: `/v3/users/dd8bbea47a91440aaa987f36d751cc58` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:23.383270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31838a-5aac-48d0-8abb-29bf7433c6cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd8bbea47a91440aaa987f36d751cc58)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:23.385428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31838a-5aac-48d0-8abb-29bf7433c6cd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:23.607873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3c31838a-5aac-48d0-8abb-29bf7433c6cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd8bbea47a91440aaa987f36d751cc58'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:23.622241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3c31838a-5aac-48d0-8abb-29bf7433c6cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd8bbea47a91440aaa987f36d751cc58'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:23.623353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3c31838a-5aac-48d0-8abb-29bf7433c6cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd8bbea47a91440aaa987f36d751cc58'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:23.630526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3c31838a-5aac-48d0-8abb-29bf7433c6cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd8bbea47a91440aaa987f36d751cc58'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:23.722802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3c31838a-5aac-48d0-8abb-29bf7433c6cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd8bbea47a91440aaa987f36d751cc58'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:23.734083 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1405/2797] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:23:23 2022] DELETE /identity/v3/users/dd8bbea47a91440aaa987f36d751cc58 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:23.736991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a3d0d-8a23-4d21-a17a-b1e0c2f58557 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:23.737443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a3d0d-8a23-4d21-a17a-b1e0c2f58557 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:23.737558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a3d0d-8a23-4d21-a17a-b1e0c2f58557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:23.773693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-640a3d0d-8a23-4d21-a17a-b1e0c2f58557 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:23.776510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-640a3d0d-8a23-4d21-a17a-b1e0c2f58557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:23.885888 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1393/2798] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:23.895610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31838a-5aac-48d0-8abb-29bf7433c6cd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:23.897218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3c31838a-5aac-48d0-8abb-29bf7433c6cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:23.980339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31838a-5aac-48d0-8abb-29bf7433c6cd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:23.984181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdb8b3-8a4e-4d00-8389-47111c7574fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:23.985596 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdb8b3-8a4e-4d00-8389-47111c7574fd service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:23.985886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdb8b3-8a4e-4d00-8389-47111c7574fd service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:23.986169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdb8b3-8a4e-4d00-8389-47111c7574fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:23.998431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdb8b3-8a4e-4d00-8389-47111c7574fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:23.999913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdb8b3-8a4e-4d00-8389-47111c7574fd service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:24.013345 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1406/2799] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:23:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:23:24.655103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a3d0d-8a23-4d21-a17a-b1e0c2f58557 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:24.656579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-640a3d0d-8a23-4d21-a17a-b1e0c2f58557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:24.669747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a3d0d-8a23-4d21-a17a-b1e0c2f58557 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:24.684143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d9609-72e4-4add-af36-c4623ba529e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:24.685779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d9609-72e4-4add-af36-c4623ba529e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:24.686230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d9609-72e4-4add-af36-c4623ba529e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:24.686666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d9609-72e4-4add-af36-c4623ba529e1 admin admin] PATH_INFO: `/v3/projects/5e6ac2474f6b4a76a69742d3f99e4250` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:24.690058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d9609-72e4-4add-af36-c4623ba529e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e6ac2474f6b4a76a69742d3f99e4250)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:24.702409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d9609-72e4-4add-af36-c4623ba529e1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:24.806284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-498d9609-72e4-4add-af36-c4623ba529e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e6ac2474f6b4a76a69742d3f99e4250', 'request_id': 'req-498d9609-72e4-4add-af36-c4623ba529e1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:24.865649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-498d9609-72e4-4add-af36-c4623ba529e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e6ac2474f6b4a76a69742d3f99e4250', 'request_id': 'req-498d9609-72e4-4add-af36-c4623ba529e1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:24.873626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-498d9609-72e4-4add-af36-c4623ba529e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e6ac2474f6b4a76a69742d3f99e4250', 'request_id': 'req-498d9609-72e4-4add-af36-c4623ba529e1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:24.887540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-498d9609-72e4-4add-af36-c4623ba529e1 admin admin] The token cache is being invalidate because project 5e6ac2474f6b4a76a69742d3f99e4250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:23:24.888423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-498d9609-72e4-4add-af36-c4623ba529e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:24.889456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-498d9609-72e4-4add-af36-c4623ba529e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:24.891465 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1394/2800] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:23:24 2022] DELETE /identity/v3/projects/5e6ac2474f6b4a76a69742d3f99e4250 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:24.902995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b73ca-cc8a-4a95-988a-2a0dae688b7f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:24.903286 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b73ca-cc8a-4a95-988a-2a0dae688b7f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:24.903565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b73ca-cc8a-4a95-988a-2a0dae688b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:24.924389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-776b73ca-cc8a-4a95-988a-2a0dae688b7f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:24.925652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-776b73ca-cc8a-4a95-988a-2a0dae688b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:24.996777 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1407/2801] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:25.003515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f7be1-ef64-49d3-95af-14386a2a54ce None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:25.003808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f7be1-ef64-49d3-95af-14386a2a54ce None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:25.004097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f7be1-ef64-49d3-95af-14386a2a54ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:25.024432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a38f7be1-ef64-49d3-95af-14386a2a54ce None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:25.025908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a38f7be1-ef64-49d3-95af-14386a2a54ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:25.038305 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1395/2802] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:25.039676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b73ca-cc8a-4a95-988a-2a0dae688b7f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:25.051070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b73ca-cc8a-4a95-988a-2a0dae688b7f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:25.056399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fd47f-3c76-4407-bd07-d34bd9c731c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:25.057975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fd47f-3c76-4407-bd07-d34bd9c731c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:25.058373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fd47f-3c76-4407-bd07-d34bd9c731c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:25.058788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fd47f-3c76-4407-bd07-d34bd9c731c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:25.059650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fd47f-3c76-4407-bd07-d34bd9c731c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:23:25.060074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fd47f-3c76-4407-bd07-d34bd9c731c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:25.066852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fd47f-3c76-4407-bd07-d34bd9c731c7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:25.080929 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1408/2803] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:23:25.085527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f7be1-ef64-49d3-95af-14386a2a54ce None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:25.097299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f7be1-ef64-49d3-95af-14386a2a54ce None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:25.103831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afdc37-f08d-474c-8f96-bc50e28384a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:25.104757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afdc37-f08d-474c-8f96-bc50e28384a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:25.105231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afdc37-f08d-474c-8f96-bc50e28384a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:25.105674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afdc37-f08d-474c-8f96-bc50e28384a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:25.106552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11afdc37-f08d-474c-8f96-bc50e28384a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:25.108907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11afdc37-f08d-474c-8f96-bc50e28384a2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:25.239128 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1396/2804] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:23:25 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:23:25.243378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fd47f-3c76-4407-bd07-d34bd9c731c7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:25.254549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fd47f-3c76-4407-bd07-d34bd9c731c7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:25.316726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2da786-b3f8-4330-bef7-26edf5eb968d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:25.317458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2da786-b3f8-4330-bef7-26edf5eb968d admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:25.317757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2da786-b3f8-4330-bef7-26edf5eb968d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:25.318036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2da786-b3f8-4330-bef7-26edf5eb968d admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:25.318749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2da786-b3f8-4330-bef7-26edf5eb968d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:25.320806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2da786-b3f8-4330-bef7-26edf5eb968d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:25.477043 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1409/2805] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:23:25 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:23:25.478459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afdc37-f08d-474c-8f96-bc50e28384a2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:25.506804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afdc37-f08d-474c-8f96-bc50e28384a2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:25.506804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff93fc-2e5a-4303-807d-97749b2cbbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:25.506804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff93fc-2e5a-4303-807d-97749b2cbbed admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:25.506804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff93fc-2e5a-4303-807d-97749b2cbbed admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:25.507273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff93fc-2e5a-4303-807d-97749b2cbbed admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:25.507273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff93fc-2e5a-4303-807d-97749b2cbbed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:25.507273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff93fc-2e5a-4303-807d-97749b2cbbed admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:25.512502 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1397/2806] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:23:25.516958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2da786-b3f8-4330-bef7-26edf5eb968d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:25.527972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2da786-b3f8-4330-bef7-26edf5eb968d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:25.533345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34eb79a-5f18-4feb-8f5b-bf00847d3a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:25.534108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eb79a-5f18-4feb-8f5b-bf00847d3a09 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:25.534403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eb79a-5f18-4feb-8f5b-bf00847d3a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:25.534681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eb79a-5f18-4feb-8f5b-bf00847d3a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:25.535430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34eb79a-5f18-4feb-8f5b-bf00847d3a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:25.537083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34eb79a-5f18-4feb-8f5b-bf00847d3a09 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:25.550043 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1410/2807] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:23:25.553761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff93fc-2e5a-4303-807d-97749b2cbbed admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:25.564469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff93fc-2e5a-4303-807d-97749b2cbbed admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:25.569419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d5316-e420-4544-a25d-14a0a7c36e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:25.570345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d5316-e420-4544-a25d-14a0a7c36e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:25.570631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d5316-e420-4544-a25d-14a0a7c36e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:25.570912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d5316-e420-4544-a25d-14a0a7c36e12 admin admin] PATH_INFO: `/v3/projects/e3c5102fde294e5fb3dbf22336934db9/users/1cf4f9c1eeb94bff96fa42d2f20d805f/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:25.587413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d5316-e420-4544-a25d-14a0a7c36e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3c5102fde294e5fb3dbf22336934db9, user_id=1cf4f9c1eeb94bff96fa42d2f20d805f, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:25.590224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d5316-e420-4544-a25d-14a0a7c36e12 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:25.706878 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1398/2808] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:23:25 2022] PUT /identity/v3/projects/e3c5102fde294e5fb3dbf22336934db9/users/1cf4f9c1eeb94bff96fa42d2f20d805f/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:23:25.712408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7168d0-5c56-404e-a744-8a3f1c0e8b9c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:25.712737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7168d0-5c56-404e-a744-8a3f1c0e8b9c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:25.713199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7168d0-5c56-404e-a744-8a3f1c0e8b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:25.745252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9a7168d0-5c56-404e-a744-8a3f1c0e8b9c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:25.745252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9a7168d0-5c56-404e-a744-8a3f1c0e8b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:25.822080 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1411/2809] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:25.833052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d5316-e420-4544-a25d-14a0a7c36e12 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:25.835682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4b8d5316-e420-4544-a25d-14a0a7c36e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:25.929776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d5316-e420-4544-a25d-14a0a7c36e12 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:25.931697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80849a-eda6-4ece-93c8-bd7278a89e7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:25.932478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80849a-eda6-4ece-93c8-bd7278a89e7f service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:25.932898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80849a-eda6-4ece-93c8-bd7278a89e7f service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:25.933215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80849a-eda6-4ece-93c8-bd7278a89e7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:25.945685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80849a-eda6-4ece-93c8-bd7278a89e7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:25.948045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80849a-eda6-4ece-93c8-bd7278a89e7f service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:25.966693 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1399/2810] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:23:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:23:30.740265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7168d0-5c56-404e-a744-8a3f1c0e8b9c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:30.748357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9a7168d0-5c56-404e-a744-8a3f1c0e8b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:30.773172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7168d0-5c56-404e-a744-8a3f1c0e8b9c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:30.783411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e2451-0516-4f2f-8290-28b92c49bb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:30.784298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e2451-0516-4f2f-8290-28b92c49bb59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:30.784582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e2451-0516-4f2f-8290-28b92c49bb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:30.785081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e2451-0516-4f2f-8290-28b92c49bb59 admin admin] PATH_INFO: `/v3/users/0360b7261526403786bc77b8945c815b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:30.798432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e2451-0516-4f2f-8290-28b92c49bb59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0360b7261526403786bc77b8945c815b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:30.798432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e2451-0516-4f2f-8290-28b92c49bb59 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:31.038388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-df8e2451-0516-4f2f-8290-28b92c49bb59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0360b7261526403786bc77b8945c815b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:31.052805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-df8e2451-0516-4f2f-8290-28b92c49bb59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0360b7261526403786bc77b8945c815b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:31.053549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-df8e2451-0516-4f2f-8290-28b92c49bb59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0360b7261526403786bc77b8945c815b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:31.061296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-df8e2451-0516-4f2f-8290-28b92c49bb59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0360b7261526403786bc77b8945c815b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:31.165944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-df8e2451-0516-4f2f-8290-28b92c49bb59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0360b7261526403786bc77b8945c815b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:31.176276 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1412/2811] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:23:30 2022] DELETE /identity/v3/users/0360b7261526403786bc77b8945c815b => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:31.845876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80849a-eda6-4ece-93c8-bd7278a89e7f service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:31.858275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80849a-eda6-4ece-93c8-bd7278a89e7f service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:31.912736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e2451-0516-4f2f-8290-28b92c49bb59 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:31.914192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-df8e2451-0516-4f2f-8290-28b92c49bb59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:31.961033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ffcd8-b337-4083-b032-ba6987267a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:31.962509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ffcd8-b337-4083-b032-ba6987267a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:31.963049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ffcd8-b337-4083-b032-ba6987267a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:31.963607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ffcd8-b337-4083-b032-ba6987267a40 admin admin] PATH_INFO: `/v3/projects/405bc3f0d1b64dc8911be1fbc0449018` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:31.965609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ffcd8-b337-4083-b032-ba6987267a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=405bc3f0d1b64dc8911be1fbc0449018)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:31.968695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ffcd8-b337-4083-b032-ba6987267a40 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:32.061143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e2451-0516-4f2f-8290-28b92c49bb59 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:32.068270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993b388-dc95-449c-896b-474deac10d1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:32.069237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993b388-dc95-449c-896b-474deac10d1e service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:32.069904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993b388-dc95-449c-896b-474deac10d1e service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:32.070203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993b388-dc95-449c-896b-474deac10d1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:32.072403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a993b388-dc95-449c-896b-474deac10d1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:32.147226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6d3ffcd8-b337-4083-b032-ba6987267a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '405bc3f0d1b64dc8911be1fbc0449018', 'request_id': 'req-6d3ffcd8-b337-4083-b032-ba6987267a40'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:32.176056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993b388-dc95-449c-896b-474deac10d1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:32.178102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993b388-dc95-449c-896b-474deac10d1e service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:32.192875 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1413/2812] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:23:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:23:32.275008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6d3ffcd8-b337-4083-b032-ba6987267a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '405bc3f0d1b64dc8911be1fbc0449018', 'request_id': 'req-6d3ffcd8-b337-4083-b032-ba6987267a40'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:32.288643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6d3ffcd8-b337-4083-b032-ba6987267a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '405bc3f0d1b64dc8911be1fbc0449018', 'request_id': 'req-6d3ffcd8-b337-4083-b032-ba6987267a40'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:32.325742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6d3ffcd8-b337-4083-b032-ba6987267a40 admin admin] The token cache is being invalidate because project 405bc3f0d1b64dc8911be1fbc0449018 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:23:32.326340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6d3ffcd8-b337-4083-b032-ba6987267a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:32.327252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6d3ffcd8-b337-4083-b032-ba6987267a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:32.330681 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1400/2813] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:23:31 2022] DELETE /identity/v3/projects/405bc3f0d1b64dc8911be1fbc0449018 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:32.334618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993b388-dc95-449c-896b-474deac10d1e service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:32.336200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a993b388-dc95-449c-896b-474deac10d1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:32.358348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993b388-dc95-449c-896b-474deac10d1e service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:32.473517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a57f6-0a43-4a27-9a73-cccd8a096a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:32.476338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a57f6-0a43-4a27-9a73-cccd8a096a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:32.477389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a57f6-0a43-4a27-9a73-cccd8a096a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:32.479111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a57f6-0a43-4a27-9a73-cccd8a096a4e admin admin] PATH_INFO: `/v3/users/c4b69f1d0d4a4bcaaead3a2337d0734e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:32.481487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a57f6-0a43-4a27-9a73-cccd8a096a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4b69f1d0d4a4bcaaead3a2337d0734e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:32.484030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a57f6-0a43-4a27-9a73-cccd8a096a4e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:32.774514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-505a57f6-0a43-4a27-9a73-cccd8a096a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4b69f1d0d4a4bcaaead3a2337d0734e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:32.808952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-505a57f6-0a43-4a27-9a73-cccd8a096a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4b69f1d0d4a4bcaaead3a2337d0734e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:32.809976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-505a57f6-0a43-4a27-9a73-cccd8a096a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4b69f1d0d4a4bcaaead3a2337d0734e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:32.832319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-505a57f6-0a43-4a27-9a73-cccd8a096a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4b69f1d0d4a4bcaaead3a2337d0734e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:32.964717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-505a57f6-0a43-4a27-9a73-cccd8a096a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4b69f1d0d4a4bcaaead3a2337d0734e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:32.969552 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1414/2814] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:23:32 2022] DELETE /identity/v3/users/c4b69f1d0d4a4bcaaead3a2337d0734e => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:33.602387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ffcd8-b337-4083-b032-ba6987267a40 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:33.604265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6d3ffcd8-b337-4083-b032-ba6987267a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:33.635846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ffcd8-b337-4083-b032-ba6987267a40 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:33.660647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e50268-8d98-4864-8140-1d63573e10f9 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:33.661171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e50268-8d98-4864-8140-1d63573e10f9 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:33.661551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e50268-8d98-4864-8140-1d63573e10f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:33.683092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f1e50268-8d98-4864-8140-1d63573e10f9 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:33.684367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f1e50268-8d98-4864-8140-1d63573e10f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:33.746611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8f42c-e021-4755-8f30-3d3dceac0099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:33.747662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8f42c-e021-4755-8f30-3d3dceac0099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:33.748542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8f42c-e021-4755-8f30-3d3dceac0099 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:33.749021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8f42c-e021-4755-8f30-3d3dceac0099 admin admin] PATH_INFO: `/v3/projects/f22dc1bb214f4b0284fec31d2424e0c8` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:33.750584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8f42c-e021-4755-8f30-3d3dceac0099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f22dc1bb214f4b0284fec31d2424e0c8)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:33.755492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8f42c-e021-4755-8f30-3d3dceac0099 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:33.809963 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1415/2815] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:23:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 02 10:23:33.824009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e50268-8d98-4864-8140-1d63573e10f9 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:33.829683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f1e50268-8d98-4864-8140-1d63573e10f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:33.924952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e50268-8d98-4864-8140-1d63573e10f9 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:33.934062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb006c-7498-4ff0-b6b0-945b4e273a59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:33.934822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb006c-7498-4ff0-b6b0-945b4e273a59 service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:33.935116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb006c-7498-4ff0-b6b0-945b4e273a59 service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:33.935792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb006c-7498-4ff0-b6b0-945b4e273a59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:33.952665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb006c-7498-4ff0-b6b0-945b4e273a59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:33.955103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb006c-7498-4ff0-b6b0-945b4e273a59 service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:33.964706 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1416/2816] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:23:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:23:33.988315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f9c8f42c-e021-4755-8f30-3d3dceac0099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f22dc1bb214f4b0284fec31d2424e0c8', 'request_id': 'req-f9c8f42c-e021-4755-8f30-3d3dceac0099'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:34.112420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f9c8f42c-e021-4755-8f30-3d3dceac0099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f22dc1bb214f4b0284fec31d2424e0c8', 'request_id': 'req-f9c8f42c-e021-4755-8f30-3d3dceac0099'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:34.122724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f9c8f42c-e021-4755-8f30-3d3dceac0099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f22dc1bb214f4b0284fec31d2424e0c8', 'request_id': 'req-f9c8f42c-e021-4755-8f30-3d3dceac0099'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:34.137786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f9c8f42c-e021-4755-8f30-3d3dceac0099 admin admin] The token cache is being invalidate because project f22dc1bb214f4b0284fec31d2424e0c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:23:34.138085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f9c8f42c-e021-4755-8f30-3d3dceac0099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:34.138780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f9c8f42c-e021-4755-8f30-3d3dceac0099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:34.141748 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1401/2817] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:23:33 2022] DELETE /identity/v3/projects/f22dc1bb214f4b0284fec31d2424e0c8 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:34.154506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728b01a-2783-4936-bb56-f7be19934728 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:34.154897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728b01a-2783-4936-bb56-f7be19934728 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:34.155037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728b01a-2783-4936-bb56-f7be19934728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:34.175214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4728b01a-2783-4936-bb56-f7be19934728 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:34.176438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4728b01a-2783-4936-bb56-f7be19934728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:34.408926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c27c11-67e8-4bf0-99f9-767aad419ced None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:34.409276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c27c11-67e8-4bf0-99f9-767aad419ced None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:34.409487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c27c11-67e8-4bf0-99f9-767aad419ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:34.412898 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1417/2818] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:34.457776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-55c27c11-67e8-4bf0-99f9-767aad419ced None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:34.459269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-55c27c11-67e8-4bf0-99f9-767aad419ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:34.477554 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1402/2819] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:23:34.481452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728b01a-2783-4936-bb56-f7be19934728 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:34.499412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728b01a-2783-4936-bb56-f7be19934728 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:34.510155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b3989-42e6-4788-a8b6-50b1018c8326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:34.521817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b3989-42e6-4788-a8b6-50b1018c8326 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:34.521817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b3989-42e6-4788-a8b6-50b1018c8326 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:34.521817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b3989-42e6-4788-a8b6-50b1018c8326 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:34.521817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b3989-42e6-4788-a8b6-50b1018c8326 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:23:34.521817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b3989-42e6-4788-a8b6-50b1018c8326 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:34.521817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b3989-42e6-4788-a8b6-50b1018c8326 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:34.541236 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1418/2820] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:23:34.541728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c27c11-67e8-4bf0-99f9-767aad419ced None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:34.581774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c27c11-67e8-4bf0-99f9-767aad419ced None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:34.592165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ae6c3-d74c-459d-82b0-5b2d003ea3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:34.593535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ae6c3-d74c-459d-82b0-5b2d003ea3bc admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:34.593820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ae6c3-d74c-459d-82b0-5b2d003ea3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:34.594807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ae6c3-d74c-459d-82b0-5b2d003ea3bc admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:34.595901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ae6c3-d74c-459d-82b0-5b2d003ea3bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:34.598041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ae6c3-d74c-459d-82b0-5b2d003ea3bc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:34.705413 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1403/2821] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:23:34 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:23:34.709225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b3989-42e6-4788-a8b6-50b1018c8326 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:34.719757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b3989-42e6-4788-a8b6-50b1018c8326 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:34.933738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b76790-56e8-4929-a072-83d6aacdd0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:34.934452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b76790-56e8-4929-a072-83d6aacdd0ca admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:34.935251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b76790-56e8-4929-a072-83d6aacdd0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:34.935251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b76790-56e8-4929-a072-83d6aacdd0ca admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:34.935704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b76790-56e8-4929-a072-83d6aacdd0ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:34.942069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b76790-56e8-4929-a072-83d6aacdd0ca admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:35.055822 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1419/2822] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:23:34 2022] POST /identity/v3/users => generated 288 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:23:35.066223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ae6c3-d74c-459d-82b0-5b2d003ea3bc admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:35.082216 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ae6c3-d74c-459d-82b0-5b2d003ea3bc admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:35.120393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520429f-3eb3-45a6-870a-390070c516a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:35.121850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520429f-3eb3-45a6-870a-390070c516a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:35.125642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520429f-3eb3-45a6-870a-390070c516a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:35.126206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520429f-3eb3-45a6-870a-390070c516a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:35.128347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520429f-3eb3-45a6-870a-390070c516a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:35.134701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520429f-3eb3-45a6-870a-390070c516a3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:35.179743 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1404/2823] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:23:35.183571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b76790-56e8-4929-a072-83d6aacdd0ca admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:35.199314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b76790-56e8-4929-a072-83d6aacdd0ca admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:35.215164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc2e12-2181-4b96-82e7-965d1effb735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:35.215999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc2e12-2181-4b96-82e7-965d1effb735 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:35.216484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc2e12-2181-4b96-82e7-965d1effb735 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:35.217120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc2e12-2181-4b96-82e7-965d1effb735 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:35.218751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc2e12-2181-4b96-82e7-965d1effb735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:35.222579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc2e12-2181-4b96-82e7-965d1effb735 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:35.242641 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1420/2824] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:23:35.246990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520429f-3eb3-45a6-870a-390070c516a3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:35.263882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520429f-3eb3-45a6-870a-390070c516a3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:35.277113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec260e4c-17c7-4fe6-a87c-9a24c3fc7519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:35.278100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec260e4c-17c7-4fe6-a87c-9a24c3fc7519 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:35.278445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec260e4c-17c7-4fe6-a87c-9a24c3fc7519 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:35.279066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec260e4c-17c7-4fe6-a87c-9a24c3fc7519 admin admin] PATH_INFO: `/v3/projects/44740464e31d44f4b9d11d7bb649cd00/users/a3d64f0037594ff08c8de4c495e1b42c/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:35.309585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec260e4c-17c7-4fe6-a87c-9a24c3fc7519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44740464e31d44f4b9d11d7bb649cd00, user_id=a3d64f0037594ff08c8de4c495e1b42c, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:35.312404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec260e4c-17c7-4fe6-a87c-9a24c3fc7519 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:35.407277 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1405/2825] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:23:35 2022] PUT /identity/v3/projects/44740464e31d44f4b9d11d7bb649cd00/users/a3d64f0037594ff08c8de4c495e1b42c/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:23:35.409897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea3c24-2802-43e6-ba09-fc7ba6d505b8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:35.410322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea3c24-2802-43e6-ba09-fc7ba6d505b8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:35.410710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea3c24-2802-43e6-ba09-fc7ba6d505b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:35.473515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-eeea3c24-2802-43e6-ba09-fc7ba6d505b8 None None] MFA Rules not processed for user `a3d64f0037594ff08c8de4c495e1b42c`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:35.475091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-eeea3c24-2802-43e6-ba09-fc7ba6d505b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:35.710630 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1421/2826] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:35.715364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec260e4c-17c7-4fe6-a87c-9a24c3fc7519 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:35.859428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec260e4c-17c7-4fe6-a87c-9a24c3fc7519 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:35.866782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1990c71-2325-4f15-95cf-bef0ab9118c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:35.869388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1990c71-2325-4f15-95cf-bef0ab9118c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:35.869683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1990c71-2325-4f15-95cf-bef0ab9118c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:35.869988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1990c71-2325-4f15-95cf-bef0ab9118c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:35.870692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1990c71-2325-4f15-95cf-bef0ab9118c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:35.876327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1990c71-2325-4f15-95cf-bef0ab9118c1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:36.017394 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1406/2827] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:23:35 2022] POST /identity/v3/projects => generated 371 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:23:36.021767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea3c24-2802-43e6-ba09-fc7ba6d505b8 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:36.036645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea3c24-2802-43e6-ba09-fc7ba6d505b8 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:36.142499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dac005-7e6b-45d9-ad7d-25b4c190af4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:36.144239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dac005-7e6b-45d9-ad7d-25b4c190af4f admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:36.144700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dac005-7e6b-45d9-ad7d-25b4c190af4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:36.145413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dac005-7e6b-45d9-ad7d-25b4c190af4f admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:36.146271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dac005-7e6b-45d9-ad7d-25b4c190af4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:36.148441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dac005-7e6b-45d9-ad7d-25b4c190af4f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:36.234880 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1422/2828] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:23:36 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:23:36.238905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1990c71-2325-4f15-95cf-bef0ab9118c1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:36.251265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1990c71-2325-4f15-95cf-bef0ab9118c1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:36.257050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8a1d5-ff4a-4597-bbc4-6ac2f2b8a896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:36.258384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8a1d5-ff4a-4597-bbc4-6ac2f2b8a896 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:36.258894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8a1d5-ff4a-4597-bbc4-6ac2f2b8a896 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:36.259561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8a1d5-ff4a-4597-bbc4-6ac2f2b8a896 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:36.260571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8a1d5-ff4a-4597-bbc4-6ac2f2b8a896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:36.262932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8a1d5-ff4a-4597-bbc4-6ac2f2b8a896 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:36.281985 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1407/2829] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:23:36.282335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dac005-7e6b-45d9-ad7d-25b4c190af4f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:36.293558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dac005-7e6b-45d9-ad7d-25b4c190af4f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:36.300508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4a95c-c671-449a-88a4-fe9c10562d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:36.301589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4a95c-c671-449a-88a4-fe9c10562d2d admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:36.301955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4a95c-c671-449a-88a4-fe9c10562d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:36.302300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4a95c-c671-449a-88a4-fe9c10562d2d admin admin] PATH_INFO: `/v3/projects/542c1edaf487417f8f98b07a6fcc8eb4/users/00b716e1ed204b3d982fa39110a8cf48/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:36.359998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4a95c-c671-449a-88a4-fe9c10562d2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=542c1edaf487417f8f98b07a6fcc8eb4, user_id=00b716e1ed204b3d982fa39110a8cf48, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:36.363013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4a95c-c671-449a-88a4-fe9c10562d2d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:36.450214 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1423/2830] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:23:36 2022] PUT /identity/v3/projects/542c1edaf487417f8f98b07a6fcc8eb4/users/00b716e1ed204b3d982fa39110a8cf48/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:23:36.459176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8a1d5-ff4a-4597-bbc4-6ac2f2b8a896 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:36.484536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8a1d5-ff4a-4597-bbc4-6ac2f2b8a896 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:36.679953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778de11e-7af5-4523-a588-9399e80b6a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:36.680667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778de11e-7af5-4523-a588-9399e80b6a3d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:36.681211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778de11e-7af5-4523-a588-9399e80b6a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:36.681734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778de11e-7af5-4523-a588-9399e80b6a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:36.682700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778de11e-7af5-4523-a588-9399e80b6a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:36.684565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778de11e-7af5-4523-a588-9399e80b6a3d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:36.711517 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1408/2831] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:23:36.715326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4a95c-c671-449a-88a4-fe9c10562d2d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:36.732389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4a95c-c671-449a-88a4-fe9c10562d2d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:36.772124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00197f11-dfde-4e0a-b8f2-3472792b8937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:36.773417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00197f11-dfde-4e0a-b8f2-3472792b8937 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:36.773864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00197f11-dfde-4e0a-b8f2-3472792b8937 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:36.774319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00197f11-dfde-4e0a-b8f2-3472792b8937 admin admin] PATH_INFO: `/v3/projects/542c1edaf487417f8f98b07a6fcc8eb4/users/00b716e1ed204b3d982fa39110a8cf48/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:36.782595 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00197f11-dfde-4e0a-b8f2-3472792b8937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=542c1edaf487417f8f98b07a6fcc8eb4, user_id=00b716e1ed204b3d982fa39110a8cf48, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:36.786469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00197f11-dfde-4e0a-b8f2-3472792b8937 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:36.823371 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1424/2832] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:23:36 2022] PUT /identity/v3/projects/542c1edaf487417f8f98b07a6fcc8eb4/users/00b716e1ed204b3d982fa39110a8cf48/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:36.834860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8f78c-87a8-4c91-94af-c2e2340f6491 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:36.835393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8f78c-87a8-4c91-94af-c2e2340f6491 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:36.835393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8f78c-87a8-4c91-94af-c2e2340f6491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:36.933697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fee8f78c-87a8-4c91-94af-c2e2340f6491 None None] MFA Rules not processed for user `00b716e1ed204b3d982fa39110a8cf48`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:36.935816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fee8f78c-87a8-4c91-94af-c2e2340f6491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:37.070256 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1409/2833] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:36 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:23:37.081788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00197f11-dfde-4e0a-b8f2-3472792b8937 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:37.083586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-00197f11-dfde-4e0a-b8f2-3472792b8937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:37.196203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00197f11-dfde-4e0a-b8f2-3472792b8937 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:37.205342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0a237-09fa-4eb2-87cb-3c0c61630670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:37.206264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0a237-09fa-4eb2-87cb-3c0c61630670 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:37.206708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0a237-09fa-4eb2-87cb-3c0c61630670 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:37.207699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0a237-09fa-4eb2-87cb-3c0c61630670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:37.231819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0a237-09fa-4eb2-87cb-3c0c61630670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:37.231819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0a237-09fa-4eb2-87cb-3c0c61630670 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:37.252576 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1425/2834] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:23:37 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:23:38.077661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bb102-d6d7-4af7-be40-4a92890c8e24 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:38.078145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bb102-d6d7-4af7-be40-4a92890c8e24 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:38.078231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bb102-d6d7-4af7-be40-4a92890c8e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:38.139060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-502bb102-d6d7-4af7-be40-4a92890c8e24 None None] MFA Rules not processed for user `1cf4f9c1eeb94bff96fa42d2f20d805f`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:38.142226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-502bb102-d6d7-4af7-be40-4a92890c8e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:38.228292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0a237-09fa-4eb2-87cb-3c0c61630670 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:38.229866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-04a0a237-09fa-4eb2-87cb-3c0c61630670 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:38.239970 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1410/2835] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:38.250913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0a237-09fa-4eb2-87cb-3c0c61630670 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:38.258405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6f13f-8f8c-49f0-ba2d-efdfc73249e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:38.259847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6f13f-8f8c-49f0-ba2d-efdfc73249e3 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:38.260333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6f13f-8f8c-49f0-ba2d-efdfc73249e3 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:38.261461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6f13f-8f8c-49f0-ba2d-efdfc73249e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:38.333242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6f13f-8f8c-49f0-ba2d-efdfc73249e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:38.338371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6f13f-8f8c-49f0-ba2d-efdfc73249e3 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:38.350534 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1426/2836] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:23:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:23:38.482609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bb102-d6d7-4af7-be40-4a92890c8e24 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:38.482609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bb102-d6d7-4af7-be40-4a92890c8e24 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:38.482609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ab032-4cf3-43de-af08-3154c6d29bbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:38.482609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ab032-4cf3-43de-af08-3154c6d29bbb service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:38.483644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ab032-4cf3-43de-af08-3154c6d29bbb service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:38.483644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ab032-4cf3-43de-af08-3154c6d29bbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:38.492871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ab032-4cf3-43de-af08-3154c6d29bbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:38.495417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ab032-4cf3-43de-af08-3154c6d29bbb service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:38.547774 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1411/2837] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:23:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:23:39.497456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6f13f-8f8c-49f0-ba2d-efdfc73249e3 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:39.616022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6f13f-8f8c-49f0-ba2d-efdfc73249e3 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:39.632447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07c04b-2940-4143-b8b2-66f8a795c591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:39.633252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07c04b-2940-4143-b8b2-66f8a795c591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:39.634223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07c04b-2940-4143-b8b2-66f8a795c591 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:39.636887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07c04b-2940-4143-b8b2-66f8a795c591 admin admin] PATH_INFO: `/v3/users/a3d64f0037594ff08c8de4c495e1b42c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:39.638290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07c04b-2940-4143-b8b2-66f8a795c591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d64f0037594ff08c8de4c495e1b42c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:39.641274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07c04b-2940-4143-b8b2-66f8a795c591 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:39.849279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6d07c04b-2940-4143-b8b2-66f8a795c591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d64f0037594ff08c8de4c495e1b42c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:39.861320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6d07c04b-2940-4143-b8b2-66f8a795c591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d64f0037594ff08c8de4c495e1b42c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:39.865352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6d07c04b-2940-4143-b8b2-66f8a795c591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d64f0037594ff08c8de4c495e1b42c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:39.869121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6d07c04b-2940-4143-b8b2-66f8a795c591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d64f0037594ff08c8de4c495e1b42c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:39.982566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6d07c04b-2940-4143-b8b2-66f8a795c591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d64f0037594ff08c8de4c495e1b42c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:39.990306 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1427/2838] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:23:39 2022] DELETE /identity/v3/users/a3d64f0037594ff08c8de4c495e1b42c => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:39.994871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484329f-4cfe-471e-8a66-7965cfaf1284 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:39.995320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484329f-4cfe-471e-8a66-7965cfaf1284 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:39.995436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484329f-4cfe-471e-8a66-7965cfaf1284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:40.013517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b484329f-4cfe-471e-8a66-7965cfaf1284 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:40.015030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b484329f-4cfe-471e-8a66-7965cfaf1284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:40.075503 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1412/2839] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:23:40.085449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07c04b-2940-4143-b8b2-66f8a795c591 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:40.086975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6d07c04b-2940-4143-b8b2-66f8a795c591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:40.157033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07c04b-2940-4143-b8b2-66f8a795c591 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:40.161470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1e9ad-138a-40e9-9eda-cb3721c09aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:40.162208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1e9ad-138a-40e9-9eda-cb3721c09aca service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:40.162597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1e9ad-138a-40e9-9eda-cb3721c09aca service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:40.162953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1e9ad-138a-40e9-9eda-cb3721c09aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:40.173340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1e9ad-138a-40e9-9eda-cb3721c09aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:40.175612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1e9ad-138a-40e9-9eda-cb3721c09aca service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:40.197189 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1428/2840] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:23:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:23:41.448291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484329f-4cfe-471e-8a66-7965cfaf1284 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:41.449860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b484329f-4cfe-471e-8a66-7965cfaf1284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:41.472396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484329f-4cfe-471e-8a66-7965cfaf1284 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:41.478150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc12b8b-6211-4024-b821-687c2dcf8125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:41.479038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc12b8b-6211-4024-b821-687c2dcf8125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:41.479319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc12b8b-6211-4024-b821-687c2dcf8125 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:41.479596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc12b8b-6211-4024-b821-687c2dcf8125 admin admin] PATH_INFO: `/v3/projects/44740464e31d44f4b9d11d7bb649cd00` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:41.481691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc12b8b-6211-4024-b821-687c2dcf8125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44740464e31d44f4b9d11d7bb649cd00)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:41.483774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc12b8b-6211-4024-b821-687c2dcf8125 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:41.718373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8fc12b8b-6211-4024-b821-687c2dcf8125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44740464e31d44f4b9d11d7bb649cd00', 'request_id': 'req-8fc12b8b-6211-4024-b821-687c2dcf8125'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:41.851293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8fc12b8b-6211-4024-b821-687c2dcf8125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44740464e31d44f4b9d11d7bb649cd00', 'request_id': 'req-8fc12b8b-6211-4024-b821-687c2dcf8125'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:41.869708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8fc12b8b-6211-4024-b821-687c2dcf8125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44740464e31d44f4b9d11d7bb649cd00', 'request_id': 'req-8fc12b8b-6211-4024-b821-687c2dcf8125'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:41.884121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8fc12b8b-6211-4024-b821-687c2dcf8125 admin admin] The token cache is being invalidate because project 44740464e31d44f4b9d11d7bb649cd00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:23:41.886597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8fc12b8b-6211-4024-b821-687c2dcf8125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:41.891731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8fc12b8b-6211-4024-b821-687c2dcf8125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:41.893588 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1413/2841] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:23:41 2022] DELETE /identity/v3/projects/44740464e31d44f4b9d11d7bb649cd00 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:41.898004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1e9ad-138a-40e9-9eda-cb3721c09aca service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:41.909856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1e9ad-138a-40e9-9eda-cb3721c09aca service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:42.022859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530981e7-ef69-44f6-878e-7711212dfc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:42.036432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530981e7-ef69-44f6-878e-7711212dfc2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:42.039354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530981e7-ef69-44f6-878e-7711212dfc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:42.039906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530981e7-ef69-44f6-878e-7711212dfc2d admin admin] PATH_INFO: `/v3/users/00b716e1ed204b3d982fa39110a8cf48` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:42.042757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530981e7-ef69-44f6-878e-7711212dfc2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=00b716e1ed204b3d982fa39110a8cf48)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:42.049192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530981e7-ef69-44f6-878e-7711212dfc2d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:42.311682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-530981e7-ef69-44f6-878e-7711212dfc2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00b716e1ed204b3d982fa39110a8cf48'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:42.356587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-530981e7-ef69-44f6-878e-7711212dfc2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00b716e1ed204b3d982fa39110a8cf48'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:42.357870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-530981e7-ef69-44f6-878e-7711212dfc2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00b716e1ed204b3d982fa39110a8cf48'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:42.380970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-530981e7-ef69-44f6-878e-7711212dfc2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00b716e1ed204b3d982fa39110a8cf48'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:42.475556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-530981e7-ef69-44f6-878e-7711212dfc2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00b716e1ed204b3d982fa39110a8cf48'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:42.505274 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1429/2842] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:23:41 2022] DELETE /identity/v3/users/00b716e1ed204b3d982fa39110a8cf48 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:42.738489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a001258-6781-4a3e-bfce-f30ecd8661d2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:42.738946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a001258-6781-4a3e-bfce-f30ecd8661d2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:42.739038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a001258-6781-4a3e-bfce-f30ecd8661d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:42.790043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8a001258-6781-4a3e-bfce-f30ecd8661d2 None None] MFA Rules not processed for user `1cf4f9c1eeb94bff96fa42d2f20d805f`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:42.791347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8a001258-6781-4a3e-bfce-f30ecd8661d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:42.925203 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1414/2843] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:43.238727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530981e7-ef69-44f6-878e-7711212dfc2d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:43.240210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-530981e7-ef69-44f6-878e-7711212dfc2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:43.368657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530981e7-ef69-44f6-878e-7711212dfc2d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:43.382519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df1d5b-d55d-4038-84c8-81f41fc98b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:43.383398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df1d5b-d55d-4038-84c8-81f41fc98b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:43.383680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df1d5b-d55d-4038-84c8-81f41fc98b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:43.383964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df1d5b-d55d-4038-84c8-81f41fc98b8c admin admin] PATH_INFO: `/v3/projects/542c1edaf487417f8f98b07a6fcc8eb4` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:43.389634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df1d5b-d55d-4038-84c8-81f41fc98b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=542c1edaf487417f8f98b07a6fcc8eb4)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:43.392248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df1d5b-d55d-4038-84c8-81f41fc98b8c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:43.549021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-86df1d5b-d55d-4038-84c8-81f41fc98b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '542c1edaf487417f8f98b07a6fcc8eb4', 'request_id': 'req-86df1d5b-d55d-4038-84c8-81f41fc98b8c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:43.564797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-86df1d5b-d55d-4038-84c8-81f41fc98b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '542c1edaf487417f8f98b07a6fcc8eb4', 'request_id': 'req-86df1d5b-d55d-4038-84c8-81f41fc98b8c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:43.676919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-86df1d5b-d55d-4038-84c8-81f41fc98b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '542c1edaf487417f8f98b07a6fcc8eb4', 'request_id': 'req-86df1d5b-d55d-4038-84c8-81f41fc98b8c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:43.697757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-86df1d5b-d55d-4038-84c8-81f41fc98b8c admin admin] The token cache is being invalidate because project 542c1edaf487417f8f98b07a6fcc8eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:23:43.703934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-86df1d5b-d55d-4038-84c8-81f41fc98b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:43.703934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-86df1d5b-d55d-4038-84c8-81f41fc98b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:43.706870 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1430/2844] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:23:43 2022] DELETE /identity/v3/projects/542c1edaf487417f8f98b07a6fcc8eb4 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:43.711603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b66908-a52d-4eb7-b007-ca315d92e9f9 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:43.711898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b66908-a52d-4eb7-b007-ca315d92e9f9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:43.712256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b66908-a52d-4eb7-b007-ca315d92e9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:43.736374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-68b66908-a52d-4eb7-b007-ca315d92e9f9 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:43.738427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-68b66908-a52d-4eb7-b007-ca315d92e9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:43.807704 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1415/2845] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:43.816459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea297d4-a3d0-4e15-9bba-eed0b3116b8a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:43.816840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea297d4-a3d0-4e15-9bba-eed0b3116b8a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:43.819387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea297d4-a3d0-4e15-9bba-eed0b3116b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:43.838506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-eea297d4-a3d0-4e15-9bba-eed0b3116b8a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:43.839910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-eea297d4-a3d0-4e15-9bba-eed0b3116b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:43.849049 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1431/2846] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:43.853352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b66908-a52d-4eb7-b007-ca315d92e9f9 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:43.873607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b66908-a52d-4eb7-b007-ca315d92e9f9 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:43.896260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43cfb89-c960-4d73-a993-693803f8889e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:43.897117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43cfb89-c960-4d73-a993-693803f8889e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:43.897407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43cfb89-c960-4d73-a993-693803f8889e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:43.897742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43cfb89-c960-4d73-a993-693803f8889e admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:43.898497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43cfb89-c960-4d73-a993-693803f8889e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:23:43.898815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43cfb89-c960-4d73-a993-693803f8889e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:43.900469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43cfb89-c960-4d73-a993-693803f8889e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:43.943307 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1416/2847] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:23:43.944208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea297d4-a3d0-4e15-9bba-eed0b3116b8a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:43.961101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea297d4-a3d0-4e15-9bba-eed0b3116b8a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:43.978578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4568050-2792-46c8-9120-3a8887e3d92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:43.979384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4568050-2792-46c8-9120-3a8887e3d92e admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:43.979672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4568050-2792-46c8-9120-3a8887e3d92e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:43.979952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4568050-2792-46c8-9120-3a8887e3d92e admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:43.980694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4568050-2792-46c8-9120-3a8887e3d92e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:44.001022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4568050-2792-46c8-9120-3a8887e3d92e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:44.116687 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1432/2848] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:23:43 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:23:44.121371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43cfb89-c960-4d73-a993-693803f8889e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:44.141860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43cfb89-c960-4d73-a993-693803f8889e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:44.218808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ba9b7-22af-4027-b68b-27bb601ff360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:44.219503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ba9b7-22af-4027-b68b-27bb601ff360 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:44.219883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ba9b7-22af-4027-b68b-27bb601ff360 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:44.220176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ba9b7-22af-4027-b68b-27bb601ff360 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:44.220950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ba9b7-22af-4027-b68b-27bb601ff360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:44.223040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ba9b7-22af-4027-b68b-27bb601ff360 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:44.300998 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1417/2849] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:23:44 2022] POST /identity/v3/users => generated 294 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:23:44.305497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4568050-2792-46c8-9120-3a8887e3d92e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:44.322557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4568050-2792-46c8-9120-3a8887e3d92e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:44.360398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1a75d-38c4-4888-ba05-64771fa5ab28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:44.366781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1a75d-38c4-4888-ba05-64771fa5ab28 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:44.367565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1a75d-38c4-4888-ba05-64771fa5ab28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:44.369058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1a75d-38c4-4888-ba05-64771fa5ab28 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:44.371573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1a75d-38c4-4888-ba05-64771fa5ab28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:44.375896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1a75d-38c4-4888-ba05-64771fa5ab28 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:44.423979 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1433/2850] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:23:44.427612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ba9b7-22af-4027-b68b-27bb601ff360 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:44.442019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ba9b7-22af-4027-b68b-27bb601ff360 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:44.447626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff18c56-f24a-4214-b78c-776056516fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:44.448591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff18c56-f24a-4214-b78c-776056516fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:44.449221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff18c56-f24a-4214-b78c-776056516fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:44.451966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff18c56-f24a-4214-b78c-776056516fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:44.451966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff18c56-f24a-4214-b78c-776056516fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:44.458884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff18c56-f24a-4214-b78c-776056516fa8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:44.471244 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1418/2851] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:23:44.475172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1a75d-38c4-4888-ba05-64771fa5ab28 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:44.486725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1a75d-38c4-4888-ba05-64771fa5ab28 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:44.492436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389a3ff-ba4a-47c1-8a3a-01dc85c403f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:44.493812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389a3ff-ba4a-47c1-8a3a-01dc85c403f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:44.494303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389a3ff-ba4a-47c1-8a3a-01dc85c403f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:44.494789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389a3ff-ba4a-47c1-8a3a-01dc85c403f8 admin admin] PATH_INFO: `/v3/projects/48dd04411d604dd9844e2fee0f12f9d8/users/f6f6f8f3e2804c7ca1ebfcb2cfc30a9b/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:44.513324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389a3ff-ba4a-47c1-8a3a-01dc85c403f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48dd04411d604dd9844e2fee0f12f9d8, user_id=f6f6f8f3e2804c7ca1ebfcb2cfc30a9b, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:44.516843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389a3ff-ba4a-47c1-8a3a-01dc85c403f8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:44.602730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c95a1e-fc7d-4936-8d13-be7043b724cc None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:44.603108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c95a1e-fc7d-4936-8d13-be7043b724cc None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:44.603462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c95a1e-fc7d-4936-8d13-be7043b724cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:44.607345 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1434/2852] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:23:44 2022] PUT /identity/v3/projects/48dd04411d604dd9844e2fee0f12f9d8/users/f6f6f8f3e2804c7ca1ebfcb2cfc30a9b/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:44.640427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f4c95a1e-fc7d-4936-8d13-be7043b724cc None None] MFA Rules not processed for user `f6f6f8f3e2804c7ca1ebfcb2cfc30a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:44.641706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f4c95a1e-fc7d-4936-8d13-be7043b724cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:44.728037 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1419/2853] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:23:44.732809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389a3ff-ba4a-47c1-8a3a-01dc85c403f8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:44.823439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389a3ff-ba4a-47c1-8a3a-01dc85c403f8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:44.829999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fdfe6-e060-4b79-bd85-58cf73c9a5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:44.832169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fdfe6-e060-4b79-bd85-58cf73c9a5d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:44.832169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fdfe6-e060-4b79-bd85-58cf73c9a5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:44.832169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fdfe6-e060-4b79-bd85-58cf73c9a5d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:44.832421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fdfe6-e060-4b79-bd85-58cf73c9a5d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:44.834561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fdfe6-e060-4b79-bd85-58cf73c9a5d6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:44.964123 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1435/2854] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:23:44 2022] POST /identity/v3/projects => generated 387 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:23:44.968578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c95a1e-fc7d-4936-8d13-be7043b724cc None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:44.992384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c95a1e-fc7d-4936-8d13-be7043b724cc None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:45.151215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d2094-44e2-44b8-a8b6-68639510f4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:45.152447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d2094-44e2-44b8-a8b6-68639510f4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:45.152840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d2094-44e2-44b8-a8b6-68639510f4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:45.153197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d2094-44e2-44b8-a8b6-68639510f4a1 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:45.154076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d2094-44e2-44b8-a8b6-68639510f4a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:45.157502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d2094-44e2-44b8-a8b6-68639510f4a1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:45.267699 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1420/2855] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:23:44 2022] POST /identity/v3/users => generated 300 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:23:45.271518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fdfe6-e060-4b79-bd85-58cf73c9a5d6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:45.289050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fdfe6-e060-4b79-bd85-58cf73c9a5d6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:45.298286 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80f632-f91a-42b0-91fc-fc6db9542e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:45.300090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80f632-f91a-42b0-91fc-fc6db9542e48 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:45.300449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80f632-f91a-42b0-91fc-fc6db9542e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:45.301023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80f632-f91a-42b0-91fc-fc6db9542e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:45.304640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80f632-f91a-42b0-91fc-fc6db9542e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:45.304640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80f632-f91a-42b0-91fc-fc6db9542e48 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:45.323655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d2094-44e2-44b8-a8b6-68639510f4a1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:45.326590 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1436/2856] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:23:45.338533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d2094-44e2-44b8-a8b6-68639510f4a1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:45.348140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ea078-b01f-480d-85ac-e3af07404036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:45.349653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ea078-b01f-480d-85ac-e3af07404036 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:45.350162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ea078-b01f-480d-85ac-e3af07404036 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:45.350855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ea078-b01f-480d-85ac-e3af07404036 admin admin] PATH_INFO: `/v3/projects/dcd38df815b042bdac44dcde55754d11/users/77a67de591c14c6681311c0ee3371115/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:45.370032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ea078-b01f-480d-85ac-e3af07404036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd38df815b042bdac44dcde55754d11, user_id=77a67de591c14c6681311c0ee3371115, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:45.372822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ea078-b01f-480d-85ac-e3af07404036 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:45.457279 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1421/2857] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:23:45 2022] PUT /identity/v3/projects/dcd38df815b042bdac44dcde55754d11/users/77a67de591c14c6681311c0ee3371115/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:23:45.461324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80f632-f91a-42b0-91fc-fc6db9542e48 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:45.471894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80f632-f91a-42b0-91fc-fc6db9542e48 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:45.526010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f94f1-f5a3-4d06-9c5f-4aa8c12c7248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:45.526694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f94f1-f5a3-4d06-9c5f-4aa8c12c7248 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:45.526981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f94f1-f5a3-4d06-9c5f-4aa8c12c7248 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:45.527263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f94f1-f5a3-4d06-9c5f-4aa8c12c7248 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:45.527992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f94f1-f5a3-4d06-9c5f-4aa8c12c7248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:45.529875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f94f1-f5a3-4d06-9c5f-4aa8c12c7248 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:45.546513 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1437/2858] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:23:45.548226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ea078-b01f-480d-85ac-e3af07404036 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:45.569704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ea078-b01f-480d-85ac-e3af07404036 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:45.575927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4bd55-f1c1-404b-8710-4ad664927f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:45.577096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4bd55-f1c1-404b-8710-4ad664927f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:45.577690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4bd55-f1c1-404b-8710-4ad664927f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:45.579456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4bd55-f1c1-404b-8710-4ad664927f5d admin admin] PATH_INFO: `/v3/projects/dcd38df815b042bdac44dcde55754d11/users/77a67de591c14c6681311c0ee3371115/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:45.581764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4bd55-f1c1-404b-8710-4ad664927f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd38df815b042bdac44dcde55754d11, user_id=77a67de591c14c6681311c0ee3371115, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:45.584516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4bd55-f1c1-404b-8710-4ad664927f5d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:45.600201 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1422/2859] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:23:45 2022] PUT /identity/v3/projects/dcd38df815b042bdac44dcde55754d11/users/77a67de591c14c6681311c0ee3371115/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:45.611224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275df9b8-21fe-44a8-a0d7-c091c3039c1b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:45.611524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275df9b8-21fe-44a8-a0d7-c091c3039c1b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:45.611807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275df9b8-21fe-44a8-a0d7-c091c3039c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:45.643719 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-275df9b8-21fe-44a8-a0d7-c091c3039c1b None None] MFA Rules not processed for user `77a67de591c14c6681311c0ee3371115`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:45.644976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-275df9b8-21fe-44a8-a0d7-c091c3039c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:45.723364 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1438/2860] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:45.731776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4bd55-f1c1-404b-8710-4ad664927f5d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:45.734290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d2b4bd55-f1c1-404b-8710-4ad664927f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:45.853689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4bd55-f1c1-404b-8710-4ad664927f5d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:45.860250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3104b-8da0-488f-89de-69d510ac24b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:45.861026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3104b-8da0-488f-89de-69d510ac24b9 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:45.861542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3104b-8da0-488f-89de-69d510ac24b9 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:45.862012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3104b-8da0-488f-89de-69d510ac24b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:45.872036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b3104b-8da0-488f-89de-69d510ac24b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:45.873954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b3104b-8da0-488f-89de-69d510ac24b9 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:45.884838 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1423/2861] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:23:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:23:45.932552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275df9b8-21fe-44a8-a0d7-c091c3039c1b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:45.946838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275df9b8-21fe-44a8-a0d7-c091c3039c1b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:45.959944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5b390-7b4a-4c52-b431-fb4f2a7bad28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:45.960632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5b390-7b4a-4c52-b431-fb4f2a7bad28 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:45.964868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5b390-7b4a-4c52-b431-fb4f2a7bad28 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:45.964868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5b390-7b4a-4c52-b431-fb4f2a7bad28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:46.048591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5b390-7b4a-4c52-b431-fb4f2a7bad28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:46.050534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5b390-7b4a-4c52-b431-fb4f2a7bad28 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:46.063175 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1439/2862] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:23:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:23:46.714871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3104b-8da0-488f-89de-69d510ac24b9 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:46.792707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3104b-8da0-488f-89de-69d510ac24b9 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:46.798107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2761662-a6a0-4e44-8122-2f566ee135da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:46.799924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2761662-a6a0-4e44-8122-2f566ee135da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:46.800387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2761662-a6a0-4e44-8122-2f566ee135da admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:46.800857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2761662-a6a0-4e44-8122-2f566ee135da admin admin] PATH_INFO: `/v3/users/f6f6f8f3e2804c7ca1ebfcb2cfc30a9b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:46.802984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2761662-a6a0-4e44-8122-2f566ee135da admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6f6f8f3e2804c7ca1ebfcb2cfc30a9b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:46.805275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2761662-a6a0-4e44-8122-2f566ee135da admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:47.017743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b2761662-a6a0-4e44-8122-2f566ee135da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6f6f8f3e2804c7ca1ebfcb2cfc30a9b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:47.033889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b2761662-a6a0-4e44-8122-2f566ee135da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6f6f8f3e2804c7ca1ebfcb2cfc30a9b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:47.034534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b2761662-a6a0-4e44-8122-2f566ee135da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6f6f8f3e2804c7ca1ebfcb2cfc30a9b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:47.047999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b2761662-a6a0-4e44-8122-2f566ee135da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6f6f8f3e2804c7ca1ebfcb2cfc30a9b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:47.142081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b2761662-a6a0-4e44-8122-2f566ee135da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6f6f8f3e2804c7ca1ebfcb2cfc30a9b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:47.148550 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1424/2863] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:23:46 2022] DELETE /identity/v3/users/f6f6f8f3e2804c7ca1ebfcb2cfc30a9b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:23:47.153315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cb6d5-a581-48c1-9a4d-a216683effe5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:47.153781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cb6d5-a581-48c1-9a4d-a216683effe5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:47.153878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cb6d5-a581-48c1-9a4d-a216683effe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:47.171376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b06cb6d5-a581-48c1-9a4d-a216683effe5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:47.173166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b06cb6d5-a581-48c1-9a4d-a216683effe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:47.256268 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1440/2864] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:47.265639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2761662-a6a0-4e44-8122-2f566ee135da admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:47.267126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b2761662-a6a0-4e44-8122-2f566ee135da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:47.482311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2761662-a6a0-4e44-8122-2f566ee135da admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:47.488090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfb521-7200-4c9f-a25f-a3d17d1b0533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:47.489513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfb521-7200-4c9f-a25f-a3d17d1b0533 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:47.489513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfb521-7200-4c9f-a25f-a3d17d1b0533 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:47.489779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfb521-7200-4c9f-a25f-a3d17d1b0533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:47.503347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfb521-7200-4c9f-a25f-a3d17d1b0533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:47.505043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfb521-7200-4c9f-a25f-a3d17d1b0533 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:47.517767 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1425/2865] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:23:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:23:48.429709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06cb6d5-a581-48c1-9a4d-a216683effe5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:48.432274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b06cb6d5-a581-48c1-9a4d-a216683effe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:48.448102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06cb6d5-a581-48c1-9a4d-a216683effe5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:48.474442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b88441-a8b5-4f9d-ad1b-fbfd38d50485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:48.475780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b88441-a8b5-4f9d-ad1b-fbfd38d50485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:48.476304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b88441-a8b5-4f9d-ad1b-fbfd38d50485 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:48.476849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b88441-a8b5-4f9d-ad1b-fbfd38d50485 admin admin] PATH_INFO: `/v3/projects/48dd04411d604dd9844e2fee0f12f9d8` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:48.479633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b88441-a8b5-4f9d-ad1b-fbfd38d50485 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48dd04411d604dd9844e2fee0f12f9d8)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:48.497630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b88441-a8b5-4f9d-ad1b-fbfd38d50485 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:48.681442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b6b88441-a8b5-4f9d-ad1b-fbfd38d50485 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48dd04411d604dd9844e2fee0f12f9d8', 'request_id': 'req-b6b88441-a8b5-4f9d-ad1b-fbfd38d50485'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:48.688203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b6b88441-a8b5-4f9d-ad1b-fbfd38d50485 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48dd04411d604dd9844e2fee0f12f9d8', 'request_id': 'req-b6b88441-a8b5-4f9d-ad1b-fbfd38d50485'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:48.739287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b6b88441-a8b5-4f9d-ad1b-fbfd38d50485 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48dd04411d604dd9844e2fee0f12f9d8', 'request_id': 'req-b6b88441-a8b5-4f9d-ad1b-fbfd38d50485'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:48.753845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b6b88441-a8b5-4f9d-ad1b-fbfd38d50485 admin admin] The token cache is being invalidate because project 48dd04411d604dd9844e2fee0f12f9d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:23:48.754582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b6b88441-a8b5-4f9d-ad1b-fbfd38d50485 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:48.755186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b6b88441-a8b5-4f9d-ad1b-fbfd38d50485 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:48.760619 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1441/2866] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:23:48 2022] DELETE /identity/v3/projects/48dd04411d604dd9844e2fee0f12f9d8 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:48.761884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfb521-7200-4c9f-a25f-a3d17d1b0533 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:48.775154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfb521-7200-4c9f-a25f-a3d17d1b0533 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:48.878262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb375a95-1fc0-48c1-b691-f40d12c245f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:48.884776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb375a95-1fc0-48c1-b691-f40d12c245f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:48.884776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb375a95-1fc0-48c1-b691-f40d12c245f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:48.884776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb375a95-1fc0-48c1-b691-f40d12c245f3 admin admin] PATH_INFO: `/v3/users/77a67de591c14c6681311c0ee3371115` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:48.884776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb375a95-1fc0-48c1-b691-f40d12c245f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77a67de591c14c6681311c0ee3371115)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:48.884776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb375a95-1fc0-48c1-b691-f40d12c245f3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:49.112590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fb375a95-1fc0-48c1-b691-f40d12c245f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77a67de591c14c6681311c0ee3371115'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:49.148021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fb375a95-1fc0-48c1-b691-f40d12c245f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77a67de591c14c6681311c0ee3371115'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:49.149998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fb375a95-1fc0-48c1-b691-f40d12c245f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77a67de591c14c6681311c0ee3371115'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:49.167289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fb375a95-1fc0-48c1-b691-f40d12c245f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77a67de591c14c6681311c0ee3371115'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:49.253921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fb375a95-1fc0-48c1-b691-f40d12c245f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77a67de591c14c6681311c0ee3371115'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:49.260700 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1426/2867] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:23:48 2022] DELETE /identity/v3/users/77a67de591c14c6681311c0ee3371115 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:49.574307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92181d72-6b02-4665-a5a4-2707cabdc565 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:49.576146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92181d72-6b02-4665-a5a4-2707cabdc565 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:49.577282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92181d72-6b02-4665-a5a4-2707cabdc565 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:49.580707 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1442/2868] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:23:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:23:49.603072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34818bfd-9e6f-4156-a836-e37a9e4c5343 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:49.603531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34818bfd-9e6f-4156-a836-e37a9e4c5343 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:49.603968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34818bfd-9e6f-4156-a836-e37a9e4c5343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:49.631145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-34818bfd-9e6f-4156-a836-e37a9e4c5343 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:49.632957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-34818bfd-9e6f-4156-a836-e37a9e4c5343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:49.804686 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1427/2869] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:23:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:49.821587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92181d72-6b02-4665-a5a4-2707cabdc565 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:49.824745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-92181d72-6b02-4665-a5a4-2707cabdc565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:49.849276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92181d72-6b02-4665-a5a4-2707cabdc565 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:49.857410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de82718-8f0b-442e-a5dc-e17755eb1b8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:49.858919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de82718-8f0b-442e-a5dc-e17755eb1b8c service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:49.859396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de82718-8f0b-442e-a5dc-e17755eb1b8c service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:49.862028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de82718-8f0b-442e-a5dc-e17755eb1b8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:49.872348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de82718-8f0b-442e-a5dc-e17755eb1b8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:49.875484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de82718-8f0b-442e-a5dc-e17755eb1b8c service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:49.898534 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1443/2870] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:23:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:23:50.511273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34818bfd-9e6f-4156-a836-e37a9e4c5343 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:50.511273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-34818bfd-9e6f-4156-a836-e37a9e4c5343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:50.617938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34818bfd-9e6f-4156-a836-e37a9e4c5343 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:50.622648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904db998-cb01-4abf-b64e-79d125237167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:50.623928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904db998-cb01-4abf-b64e-79d125237167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:50.624216 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904db998-cb01-4abf-b64e-79d125237167 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:50.624508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904db998-cb01-4abf-b64e-79d125237167 admin admin] PATH_INFO: `/v3/projects/dcd38df815b042bdac44dcde55754d11` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:50.626292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904db998-cb01-4abf-b64e-79d125237167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd38df815b042bdac44dcde55754d11)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:50.628210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904db998-cb01-4abf-b64e-79d125237167 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:50.785292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-904db998-cb01-4abf-b64e-79d125237167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd38df815b042bdac44dcde55754d11', 'request_id': 'req-904db998-cb01-4abf-b64e-79d125237167'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:50.885687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-904db998-cb01-4abf-b64e-79d125237167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd38df815b042bdac44dcde55754d11', 'request_id': 'req-904db998-cb01-4abf-b64e-79d125237167'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:50.895407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-904db998-cb01-4abf-b64e-79d125237167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd38df815b042bdac44dcde55754d11', 'request_id': 'req-904db998-cb01-4abf-b64e-79d125237167'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:50.912307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-904db998-cb01-4abf-b64e-79d125237167 admin admin] The token cache is being invalidate because project dcd38df815b042bdac44dcde55754d11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:23:50.913260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-904db998-cb01-4abf-b64e-79d125237167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:50.914231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-904db998-cb01-4abf-b64e-79d125237167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:50.920213 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1428/2871] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:23:50 2022] DELETE /identity/v3/projects/dcd38df815b042bdac44dcde55754d11 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:50.926263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92210cd6-1c44-4617-b9ac-bfc778f38044 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:50.926781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92210cd6-1c44-4617-b9ac-bfc778f38044 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:50.926781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92210cd6-1c44-4617-b9ac-bfc778f38044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:50.954943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-92210cd6-1c44-4617-b9ac-bfc778f38044 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:50.957362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-92210cd6-1c44-4617-b9ac-bfc778f38044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:51.026148 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1444/2872] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:51.034483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80caf375-4883-4114-9421-d30cec58d199 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:51.035171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80caf375-4883-4114-9421-d30cec58d199 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:51.035457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80caf375-4883-4114-9421-d30cec58d199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:51.055417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-80caf375-4883-4114-9421-d30cec58d199 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:51.056874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-80caf375-4883-4114-9421-d30cec58d199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:51.070066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92210cd6-1c44-4617-b9ac-bfc778f38044 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:51.072803 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1429/2873] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:51.081617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92210cd6-1c44-4617-b9ac-bfc778f38044 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:51.086695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee8794-198d-48b1-b983-2715e3ec4570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:51.087517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee8794-198d-48b1-b983-2715e3ec4570 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:51.087910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee8794-198d-48b1-b983-2715e3ec4570 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:51.088293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee8794-198d-48b1-b983-2715e3ec4570 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:51.089444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee8794-198d-48b1-b983-2715e3ec4570 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:23:51.090023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee8794-198d-48b1-b983-2715e3ec4570 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:51.091911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee8794-198d-48b1-b983-2715e3ec4570 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:51.120215 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1445/2874] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:23:51.120921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80caf375-4883-4114-9421-d30cec58d199 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:51.131112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80caf375-4883-4114-9421-d30cec58d199 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:51.136097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6cf49-6b42-42fd-b589-4fa8ee6b751a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:51.136811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6cf49-6b42-42fd-b589-4fa8ee6b751a admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:51.137097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6cf49-6b42-42fd-b589-4fa8ee6b751a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:51.137953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6cf49-6b42-42fd-b589-4fa8ee6b751a admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:51.138082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6cf49-6b42-42fd-b589-4fa8ee6b751a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:51.140133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6cf49-6b42-42fd-b589-4fa8ee6b751a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:51.230239 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1430/2875] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:23:51 2022] POST /identity/v3/projects => generated 391 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:23:51.235072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee8794-198d-48b1-b983-2715e3ec4570 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:51.246597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee8794-198d-48b1-b983-2715e3ec4570 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:51.308380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df748ade-09bc-44bb-a81b-1a75c6e6f465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:51.309344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df748ade-09bc-44bb-a81b-1a75c6e6f465 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:51.309615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df748ade-09bc-44bb-a81b-1a75c6e6f465 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:51.309901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df748ade-09bc-44bb-a81b-1a75c6e6f465 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:51.310596 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df748ade-09bc-44bb-a81b-1a75c6e6f465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:51.313204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df748ade-09bc-44bb-a81b-1a75c6e6f465 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:51.402654 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1446/2876] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:23:51 2022] POST /identity/v3/users => generated 296 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:23:51.403366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6cf49-6b42-42fd-b589-4fa8ee6b751a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:51.415154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6cf49-6b42-42fd-b589-4fa8ee6b751a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:51.420314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb69b4c-19b0-4b4e-862b-eefccde8f720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:51.421343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb69b4c-19b0-4b4e-862b-eefccde8f720 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:51.421846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb69b4c-19b0-4b4e-862b-eefccde8f720 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:51.422355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb69b4c-19b0-4b4e-862b-eefccde8f720 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:51.423393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb69b4c-19b0-4b4e-862b-eefccde8f720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:51.425221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb69b4c-19b0-4b4e-862b-eefccde8f720 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:51.436241 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1431/2877] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:23:51.441504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df748ade-09bc-44bb-a81b-1a75c6e6f465 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:51.455391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df748ade-09bc-44bb-a81b-1a75c6e6f465 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:51.460523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa01ef-bf15-4dd9-a05b-8292c09a1bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:51.461469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa01ef-bf15-4dd9-a05b-8292c09a1bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:51.461986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa01ef-bf15-4dd9-a05b-8292c09a1bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:51.462517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa01ef-bf15-4dd9-a05b-8292c09a1bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:51.463454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa01ef-bf15-4dd9-a05b-8292c09a1bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:51.465439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa01ef-bf15-4dd9-a05b-8292c09a1bc6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:51.477886 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1447/2878] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:23:51.482152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb69b4c-19b0-4b4e-862b-eefccde8f720 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:51.493213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb69b4c-19b0-4b4e-862b-eefccde8f720 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:51.497691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe81292-9a74-4971-b43b-a31cb5da29c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:51.498925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe81292-9a74-4971-b43b-a31cb5da29c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:51.499283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe81292-9a74-4971-b43b-a31cb5da29c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:51.500241 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe81292-9a74-4971-b43b-a31cb5da29c0 admin admin] PATH_INFO: `/v3/projects/ad36c46edca140d088096859d5ec1c35/users/4b4e5d6b3ba94ef28570770c08266bf7/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:51.516280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe81292-9a74-4971-b43b-a31cb5da29c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad36c46edca140d088096859d5ec1c35, user_id=4b4e5d6b3ba94ef28570770c08266bf7, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:51.519097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe81292-9a74-4971-b43b-a31cb5da29c0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:51.587780 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1432/2879] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:23:51 2022] PUT /identity/v3/projects/ad36c46edca140d088096859d5ec1c35/users/4b4e5d6b3ba94ef28570770c08266bf7/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:23:51.593897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44429e35-fad6-4b90-9ba7-075afc43e9b0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:51.594192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44429e35-fad6-4b90-9ba7-075afc43e9b0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:51.594474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44429e35-fad6-4b90-9ba7-075afc43e9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:51.625275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-44429e35-fad6-4b90-9ba7-075afc43e9b0 None None] MFA Rules not processed for user `4b4e5d6b3ba94ef28570770c08266bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:51.626693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-44429e35-fad6-4b90-9ba7-075afc43e9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:51.701284 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1448/2880] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:51.705788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe81292-9a74-4971-b43b-a31cb5da29c0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:51.788114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe81292-9a74-4971-b43b-a31cb5da29c0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:51.793504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70960c-ccea-43fb-bed3-91e0b3dff6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:51.794247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70960c-ccea-43fb-bed3-91e0b3dff6be admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:51.794747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70960c-ccea-43fb-bed3-91e0b3dff6be admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:51.795268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70960c-ccea-43fb-bed3-91e0b3dff6be admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:51.796154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70960c-ccea-43fb-bed3-91e0b3dff6be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:51.811429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70960c-ccea-43fb-bed3-91e0b3dff6be admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:51.953868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44429e35-fad6-4b90-9ba7-075afc43e9b0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:51.970367 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1433/2881] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:23:51 2022] POST /identity/v3/projects => generated 391 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:23:51.978223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44429e35-fad6-4b90-9ba7-075afc43e9b0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:52.183949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d1c8a-d6cc-4169-ad98-db21da4d9679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:52.184898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d1c8a-d6cc-4169-ad98-db21da4d9679 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:52.185194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d1c8a-d6cc-4169-ad98-db21da4d9679 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:52.185713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d1c8a-d6cc-4169-ad98-db21da4d9679 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:52.186435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d1c8a-d6cc-4169-ad98-db21da4d9679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:52.189904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d1c8a-d6cc-4169-ad98-db21da4d9679 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:52.263032 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1449/2882] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:23:51 2022] POST /identity/v3/users => generated 302 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:23:52.267456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70960c-ccea-43fb-bed3-91e0b3dff6be admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:52.299938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70960c-ccea-43fb-bed3-91e0b3dff6be admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:52.322330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f035e6-91d7-4b53-979b-e37b9b412eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:52.323723 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f035e6-91d7-4b53-979b-e37b9b412eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:52.324733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f035e6-91d7-4b53-979b-e37b9b412eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:52.326742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f035e6-91d7-4b53-979b-e37b9b412eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:52.327949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f035e6-91d7-4b53-979b-e37b9b412eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:52.333799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f035e6-91d7-4b53-979b-e37b9b412eb0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:52.366561 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1434/2883] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:23:52.367401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d1c8a-d6cc-4169-ad98-db21da4d9679 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:52.388794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d1c8a-d6cc-4169-ad98-db21da4d9679 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:52.422304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c8e2e-ae36-4062-8b0b-d12e6fb7e7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:52.423255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c8e2e-ae36-4062-8b0b-d12e6fb7e7d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:52.423514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c8e2e-ae36-4062-8b0b-d12e6fb7e7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:52.423795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c8e2e-ae36-4062-8b0b-d12e6fb7e7d1 admin admin] PATH_INFO: `/v3/projects/869690fafdea406383b1ba8db3db0120/users/f08b696118d84e2a9675ba5882e751ae/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:52.470543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c8e2e-ae36-4062-8b0b-d12e6fb7e7d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869690fafdea406383b1ba8db3db0120, user_id=f08b696118d84e2a9675ba5882e751ae, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:52.473352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c8e2e-ae36-4062-8b0b-d12e6fb7e7d1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:52.567103 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1450/2884] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:23:52 2022] PUT /identity/v3/projects/869690fafdea406383b1ba8db3db0120/users/f08b696118d84e2a9675ba5882e751ae/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:52.571207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f035e6-91d7-4b53-979b-e37b9b412eb0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:52.582894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f035e6-91d7-4b53-979b-e37b9b412eb0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:52.767800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6fc9b-1a02-40ba-9d71-311e5edb0c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:52.768864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6fc9b-1a02-40ba-9d71-311e5edb0c48 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:52.771609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6fc9b-1a02-40ba-9d71-311e5edb0c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:52.771609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6fc9b-1a02-40ba-9d71-311e5edb0c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:52.771801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6fc9b-1a02-40ba-9d71-311e5edb0c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:52.777820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6fc9b-1a02-40ba-9d71-311e5edb0c48 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:52.802344 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1435/2885] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:23:52.803023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c8e2e-ae36-4062-8b0b-d12e6fb7e7d1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:52.823355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c8e2e-ae36-4062-8b0b-d12e6fb7e7d1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:52.835260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3a9eb-55bd-437f-b87c-f4769cfea9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:52.835260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3a9eb-55bd-437f-b87c-f4769cfea9e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:52.835260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3a9eb-55bd-437f-b87c-f4769cfea9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:52.835260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3a9eb-55bd-437f-b87c-f4769cfea9e3 admin admin] PATH_INFO: `/v3/projects/869690fafdea406383b1ba8db3db0120/users/f08b696118d84e2a9675ba5882e751ae/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:52.837309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3a9eb-55bd-437f-b87c-f4769cfea9e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869690fafdea406383b1ba8db3db0120, user_id=f08b696118d84e2a9675ba5882e751ae, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:52.840558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3a9eb-55bd-437f-b87c-f4769cfea9e3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:52.865942 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1451/2886] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:23:52 2022] PUT /identity/v3/projects/869690fafdea406383b1ba8db3db0120/users/f08b696118d84e2a9675ba5882e751ae/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:52.886759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a94298-25e1-43c7-a67d-51839bb44e18 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:52.886759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a94298-25e1-43c7-a67d-51839bb44e18 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:52.886759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a94298-25e1-43c7-a67d-51839bb44e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:52.918621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-28a94298-25e1-43c7-a67d-51839bb44e18 None None] MFA Rules not processed for user `f08b696118d84e2a9675ba5882e751ae`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:52.920234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-28a94298-25e1-43c7-a67d-51839bb44e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:53.038748 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1436/2887] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:54.038236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3a9eb-55bd-437f-b87c-f4769cfea9e3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:54.039972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-79b3a9eb-55bd-437f-b87c-f4769cfea9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:54.120866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3a9eb-55bd-437f-b87c-f4769cfea9e3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:54.127241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54367214-c40f-42a0-9c55-85fa0afffc2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:54.128062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54367214-c40f-42a0-9c55-85fa0afffc2e service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:54.128547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54367214-c40f-42a0-9c55-85fa0afffc2e service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:54.129035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54367214-c40f-42a0-9c55-85fa0afffc2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:54.137862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54367214-c40f-42a0-9c55-85fa0afffc2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:54.139459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54367214-c40f-42a0-9c55-85fa0afffc2e service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:54.151433 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1452/2888] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:23:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:23:55.612473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c40d6d-8cfb-49c1-bbaf-b28705b11ac0 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:55.613535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c40d6d-8cfb-49c1-bbaf-b28705b11ac0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:55.615762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c40d6d-8cfb-49c1-bbaf-b28705b11ac0 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:55.615762 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1437/2889] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:23:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:23:55.622160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43787b-0e2b-4df5-a86f-9d03aaeda272 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:55.622658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43787b-0e2b-4df5-a86f-9d03aaeda272 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:55.622922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43787b-0e2b-4df5-a86f-9d03aaeda272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:55.659540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-de43787b-0e2b-4df5-a86f-9d03aaeda272 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:55.661709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-de43787b-0e2b-4df5-a86f-9d03aaeda272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:55.759394 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1453/2890] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:23:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:55.770617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c40d6d-8cfb-49c1-bbaf-b28705b11ac0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:55.772999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-69c40d6d-8cfb-49c1-bbaf-b28705b11ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:55.814133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c40d6d-8cfb-49c1-bbaf-b28705b11ac0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:55.830684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53346b1d-09fc-4e28-a367-2037d4db0c5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:55.831350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53346b1d-09fc-4e28-a367-2037d4db0c5e service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:55.831814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53346b1d-09fc-4e28-a367-2037d4db0c5e service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:55.833486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53346b1d-09fc-4e28-a367-2037d4db0c5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:55.857503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53346b1d-09fc-4e28-a367-2037d4db0c5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:55.864343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53346b1d-09fc-4e28-a367-2037d4db0c5e service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:55.891121 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1438/2891] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:23:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:23:56.787882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43787b-0e2b-4df5-a86f-9d03aaeda272 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:56.789509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-de43787b-0e2b-4df5-a86f-9d03aaeda272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:56.886109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43787b-0e2b-4df5-a86f-9d03aaeda272 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:56.891662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565c160-9d6f-450d-aadd-1c82778eb175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:56.892681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565c160-9d6f-450d-aadd-1c82778eb175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:56.893284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565c160-9d6f-450d-aadd-1c82778eb175 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:56.893673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565c160-9d6f-450d-aadd-1c82778eb175 admin admin] PATH_INFO: `/v3/users/17581b53723f42bdbe7dd12ea1f691cd` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:56.895021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565c160-9d6f-450d-aadd-1c82778eb175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17581b53723f42bdbe7dd12ea1f691cd)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:56.900692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565c160-9d6f-450d-aadd-1c82778eb175 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:57.128323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8565c160-9d6f-450d-aadd-1c82778eb175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17581b53723f42bdbe7dd12ea1f691cd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:57.142196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8565c160-9d6f-450d-aadd-1c82778eb175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17581b53723f42bdbe7dd12ea1f691cd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:57.143245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8565c160-9d6f-450d-aadd-1c82778eb175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17581b53723f42bdbe7dd12ea1f691cd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:57.151894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8565c160-9d6f-450d-aadd-1c82778eb175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17581b53723f42bdbe7dd12ea1f691cd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:57.231855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8565c160-9d6f-450d-aadd-1c82778eb175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17581b53723f42bdbe7dd12ea1f691cd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:57.247196 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1454/2892] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:23:56 2022] DELETE /identity/v3/users/17581b53723f42bdbe7dd12ea1f691cd => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:57.503754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53346b1d-09fc-4e28-a367-2037d4db0c5e service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:57.521620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53346b1d-09fc-4e28-a367-2037d4db0c5e service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:57.595726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ffd75-f063-4a4a-827f-37b84198c363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:57.596648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ffd75-f063-4a4a-827f-37b84198c363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:57.597225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ffd75-f063-4a4a-827f-37b84198c363 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:57.597676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ffd75-f063-4a4a-827f-37b84198c363 admin admin] PATH_INFO: `/v3/projects/8f30fec6fdee4788af310ffa15c23ab7` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:57.599111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ffd75-f063-4a4a-827f-37b84198c363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f30fec6fdee4788af310ffa15c23ab7)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:57.601110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ffd75-f063-4a4a-827f-37b84198c363 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:57.745091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c03ffd75-f063-4a4a-827f-37b84198c363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f30fec6fdee4788af310ffa15c23ab7', 'request_id': 'req-c03ffd75-f063-4a4a-827f-37b84198c363'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:57.807711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c03ffd75-f063-4a4a-827f-37b84198c363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f30fec6fdee4788af310ffa15c23ab7', 'request_id': 'req-c03ffd75-f063-4a4a-827f-37b84198c363'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:57.815470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c03ffd75-f063-4a4a-827f-37b84198c363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f30fec6fdee4788af310ffa15c23ab7', 'request_id': 'req-c03ffd75-f063-4a4a-827f-37b84198c363'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:57.829458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c03ffd75-f063-4a4a-827f-37b84198c363 admin admin] The token cache is being invalidate because project 8f30fec6fdee4788af310ffa15c23ab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:23:57.830675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c03ffd75-f063-4a4a-827f-37b84198c363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:57.830785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c03ffd75-f063-4a4a-827f-37b84198c363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:57.833049 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1439/2893] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:23:57 2022] DELETE /identity/v3/projects/8f30fec6fdee4788af310ffa15c23ab7 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:57.836705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565c160-9d6f-450d-aadd-1c82778eb175 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:57.838933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8565c160-9d6f-450d-aadd-1c82778eb175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:57.856418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565c160-9d6f-450d-aadd-1c82778eb175 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:57.934895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076ab55-ad33-4254-904c-cc6757f8754f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:57.937794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076ab55-ad33-4254-904c-cc6757f8754f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:57.938494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076ab55-ad33-4254-904c-cc6757f8754f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:57.939102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076ab55-ad33-4254-904c-cc6757f8754f admin admin] PATH_INFO: `/v3/users/d08e62ebc2e14a1a800ee35406c6625b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:57.941815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076ab55-ad33-4254-904c-cc6757f8754f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d08e62ebc2e14a1a800ee35406c6625b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:57.943989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076ab55-ad33-4254-904c-cc6757f8754f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:58.159176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5076ab55-ad33-4254-904c-cc6757f8754f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd08e62ebc2e14a1a800ee35406c6625b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:58.182240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5076ab55-ad33-4254-904c-cc6757f8754f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd08e62ebc2e14a1a800ee35406c6625b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:58.183104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5076ab55-ad33-4254-904c-cc6757f8754f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd08e62ebc2e14a1a800ee35406c6625b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:58.193284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5076ab55-ad33-4254-904c-cc6757f8754f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd08e62ebc2e14a1a800ee35406c6625b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:58.266087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5076ab55-ad33-4254-904c-cc6757f8754f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd08e62ebc2e14a1a800ee35406c6625b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:58.276125 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1455/2894] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:23:57 2022] DELETE /identity/v3/users/d08e62ebc2e14a1a800ee35406c6625b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:23:58.338655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ffd75-f063-4a4a-827f-37b84198c363 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:58.340061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c03ffd75-f063-4a4a-827f-37b84198c363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:58.360797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ffd75-f063-4a4a-827f-37b84198c363 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:58.446352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36b8cd-22fc-4a9d-ba0b-0328cc459e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:58.447378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36b8cd-22fc-4a9d-ba0b-0328cc459e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:58.447663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36b8cd-22fc-4a9d-ba0b-0328cc459e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:58.448287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36b8cd-22fc-4a9d-ba0b-0328cc459e8d admin admin] PATH_INFO: `/v3/users/4b4e5d6b3ba94ef28570770c08266bf7` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:58.450419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36b8cd-22fc-4a9d-ba0b-0328cc459e8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b4e5d6b3ba94ef28570770c08266bf7)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:58.453299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36b8cd-22fc-4a9d-ba0b-0328cc459e8d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:58.706553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0a36b8cd-22fc-4a9d-ba0b-0328cc459e8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b4e5d6b3ba94ef28570770c08266bf7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:58.720833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076ab55-ad33-4254-904c-cc6757f8754f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:58.723011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5076ab55-ad33-4254-904c-cc6757f8754f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:58.752164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076ab55-ad33-4254-904c-cc6757f8754f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:58.760427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb3b87-ecbd-4ec1-8a43-d7bf4640851e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:58.761762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb3b87-ecbd-4ec1-8a43-d7bf4640851e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:58.762148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb3b87-ecbd-4ec1-8a43-d7bf4640851e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:58.767764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb3b87-ecbd-4ec1-8a43-d7bf4640851e admin admin] PATH_INFO: `/v3/projects/cf5ed488b8864dba9a7fa2aa7f09d06b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:58.767764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb3b87-ecbd-4ec1-8a43-d7bf4640851e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf5ed488b8864dba9a7fa2aa7f09d06b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:58.767764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb3b87-ecbd-4ec1-8a43-d7bf4640851e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:58.798024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0a36b8cd-22fc-4a9d-ba0b-0328cc459e8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b4e5d6b3ba94ef28570770c08266bf7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:58.805885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0a36b8cd-22fc-4a9d-ba0b-0328cc459e8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b4e5d6b3ba94ef28570770c08266bf7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:58.836837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0a36b8cd-22fc-4a9d-ba0b-0328cc459e8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b4e5d6b3ba94ef28570770c08266bf7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:58.922375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0a36b8cd-22fc-4a9d-ba0b-0328cc459e8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b4e5d6b3ba94ef28570770c08266bf7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:58.927176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30eb3b87-ecbd-4ec1-8a43-d7bf4640851e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf5ed488b8864dba9a7fa2aa7f09d06b', 'request_id': 'req-30eb3b87-ecbd-4ec1-8a43-d7bf4640851e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:58.941300 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1440/2895] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:23:58 2022] DELETE /identity/v3/users/4b4e5d6b3ba94ef28570770c08266bf7 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:58.944120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30eb3b87-ecbd-4ec1-8a43-d7bf4640851e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf5ed488b8864dba9a7fa2aa7f09d06b', 'request_id': 'req-30eb3b87-ecbd-4ec1-8a43-d7bf4640851e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:58.946626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1864295-cf09-4512-8d00-46dbc57ad982 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:58.947302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1864295-cf09-4512-8d00-46dbc57ad982 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:58.947836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1864295-cf09-4512-8d00-46dbc57ad982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:58.972894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d1864295-cf09-4512-8d00-46dbc57ad982 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:58.974389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d1864295-cf09-4512-8d00-46dbc57ad982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:59.065568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30eb3b87-ecbd-4ec1-8a43-d7bf4640851e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf5ed488b8864dba9a7fa2aa7f09d06b', 'request_id': 'req-30eb3b87-ecbd-4ec1-8a43-d7bf4640851e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:59.075027 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1441/2896] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:59.092672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30eb3b87-ecbd-4ec1-8a43-d7bf4640851e admin admin] The token cache is being invalidate because project cf5ed488b8864dba9a7fa2aa7f09d06b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:23:59.092953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1864295-cf09-4512-8d00-46dbc57ad982 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:59.094472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30eb3b87-ecbd-4ec1-8a43-d7bf4640851e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:59.095051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d1864295-cf09-4512-8d00-46dbc57ad982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:59.095501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30eb3b87-ecbd-4ec1-8a43-d7bf4640851e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:23:59.102896 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1456/2897] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:23:58 2022] DELETE /identity/v3/projects/cf5ed488b8864dba9a7fa2aa7f09d06b => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:23:59.105169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb81f1-e2a8-4289-93a2-43ce8760fcd4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:59.105797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb81f1-e2a8-4289-93a2-43ce8760fcd4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:59.106362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb81f1-e2a8-4289-93a2-43ce8760fcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:59.147768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2aeb81f1-e2a8-4289-93a2-43ce8760fcd4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:59.149453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2aeb81f1-e2a8-4289-93a2-43ce8760fcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:59.160383 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1457/2898] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:59.170097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddc8f5-554a-43ca-89eb-e4cbe852dd30 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:59.170614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddc8f5-554a-43ca-89eb-e4cbe852dd30 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:59.171078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddc8f5-554a-43ca-89eb-e4cbe852dd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:59.195767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e5ddc8f5-554a-43ca-89eb-e4cbe852dd30 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:59.197605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e5ddc8f5-554a-43ca-89eb-e4cbe852dd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:59.200018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1864295-cf09-4512-8d00-46dbc57ad982 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:59.207533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576aa0b-b82a-405c-8255-16d2788f3b40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:59.208268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576aa0b-b82a-405c-8255-16d2788f3b40 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:59.208648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576aa0b-b82a-405c-8255-16d2788f3b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:59.209512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576aa0b-b82a-405c-8255-16d2788f3b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:59.210295 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1458/2899] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:23:59.214270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddc8f5-554a-43ca-89eb-e4cbe852dd30 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:59.215570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0576aa0b-b82a-405c-8255-16d2788f3b40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:59.228067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddc8f5-554a-43ca-89eb-e4cbe852dd30 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:59.234824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576aa0b-b82a-405c-8255-16d2788f3b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:59.237492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfd651-6bb7-4e39-915f-bfdf7cfb1467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:59.237929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576aa0b-b82a-405c-8255-16d2788f3b40 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:59.239776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfd651-6bb7-4e39-915f-bfdf7cfb1467 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:59.240084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfd651-6bb7-4e39-915f-bfdf7cfb1467 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:59.240681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfd651-6bb7-4e39-915f-bfdf7cfb1467 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:59.241867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cfd651-6bb7-4e39-915f-bfdf7cfb1467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:23:59.242334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cfd651-6bb7-4e39-915f-bfdf7cfb1467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:59.247692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cfd651-6bb7-4e39-915f-bfdf7cfb1467 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:59.254276 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1442/2900] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:23:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:23:59.272671 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1459/2901] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:23:59.274800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576aa0b-b82a-405c-8255-16d2788f3b40 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:59.291624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576aa0b-b82a-405c-8255-16d2788f3b40 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:59.297870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a302d-22f6-4957-98da-4cfcd777252c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:59.298540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a302d-22f6-4957-98da-4cfcd777252c admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:59.298821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a302d-22f6-4957-98da-4cfcd777252c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:59.299098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a302d-22f6-4957-98da-4cfcd777252c admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:59.300176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a302d-22f6-4957-98da-4cfcd777252c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:59.305573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a302d-22f6-4957-98da-4cfcd777252c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:59.413433 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1443/2902] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:23:59 2022] POST /identity/v3/projects => generated 361 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:23:59.417390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfd651-6bb7-4e39-915f-bfdf7cfb1467 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:59.428416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfd651-6bb7-4e39-915f-bfdf7cfb1467 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:59.497230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0e4d8-8c85-4866-8815-8f8530be69df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:59.497847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0e4d8-8c85-4866-8815-8f8530be69df admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:59.498394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0e4d8-8c85-4866-8815-8f8530be69df admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:59.498676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0e4d8-8c85-4866-8815-8f8530be69df admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:59.499933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0e4d8-8c85-4866-8815-8f8530be69df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:59.502318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0e4d8-8c85-4866-8815-8f8530be69df admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:59.588472 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1460/2903] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:23:59 2022] POST /identity/v3/users => generated 281 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:23:59.592896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a302d-22f6-4957-98da-4cfcd777252c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:59.603870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a302d-22f6-4957-98da-4cfcd777252c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:59.614158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b947c8-1348-433b-b841-1e1a58683775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:59.615727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b947c8-1348-433b-b841-1e1a58683775 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:59.615727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b947c8-1348-433b-b841-1e1a58683775 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:59.615931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b947c8-1348-433b-b841-1e1a58683775 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:59.616761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b947c8-1348-433b-b841-1e1a58683775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:59.618458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b947c8-1348-433b-b841-1e1a58683775 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:59.630975 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1444/2904] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:23:59.634736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0e4d8-8c85-4866-8815-8f8530be69df admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:59.646489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0e4d8-8c85-4866-8815-8f8530be69df admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:59.652064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c89f8b-f922-4131-b193-2193a5edc1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:59.656059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c89f8b-f922-4131-b193-2193a5edc1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:59.656059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c89f8b-f922-4131-b193-2193a5edc1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:59.656059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c89f8b-f922-4131-b193-2193a5edc1d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:59.656059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c89f8b-f922-4131-b193-2193a5edc1d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:59.656840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c89f8b-f922-4131-b193-2193a5edc1d3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:59.668069 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1461/2905] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:23:59.672507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b947c8-1348-433b-b841-1e1a58683775 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:59.685271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b947c8-1348-433b-b841-1e1a58683775 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:23:59.692580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6104f44-ed33-4872-9f53-c370713d22c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:23:59.693665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6104f44-ed33-4872-9f53-c370713d22c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:59.694011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6104f44-ed33-4872-9f53-c370713d22c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:59.694571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6104f44-ed33-4872-9f53-c370713d22c1 admin admin] PATH_INFO: `/v3/projects/a1ea8413418742c49c7aadca80d951ed/users/e83fd687fcc74495a7ea73f0e001419b/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:59.714697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6104f44-ed33-4872-9f53-c370713d22c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ea8413418742c49c7aadca80d951ed, user_id=e83fd687fcc74495a7ea73f0e001419b, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:23:59.718324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6104f44-ed33-4872-9f53-c370713d22c1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:23:59.848123 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1445/2906] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:23:59 2022] PUT /identity/v3/projects/a1ea8413418742c49c7aadca80d951ed/users/e83fd687fcc74495a7ea73f0e001419b/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:23:59.853248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094f482-55d2-4c05-a385-4ec75826c94c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:23:59.853643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094f482-55d2-4c05-a385-4ec75826c94c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:23:59.854057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094f482-55d2-4c05-a385-4ec75826c94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:23:59.877737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9094f482-55d2-4c05-a385-4ec75826c94c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:23:59.879152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9094f482-55d2-4c05-a385-4ec75826c94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:23:59.952561 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1462/2907] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:23:59.979759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6104f44-ed33-4872-9f53-c370713d22c1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:23:59.981696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a6104f44-ed33-4872-9f53-c370713d22c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:00.064066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6104f44-ed33-4872-9f53-c370713d22c1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:00.068635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be8445-f9d8-42c5-b4d4-523209779902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:00.069272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be8445-f9d8-42c5-b4d4-523209779902 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:00.069553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be8445-f9d8-42c5-b4d4-523209779902 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:00.069914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be8445-f9d8-42c5-b4d4-523209779902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:00.081089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be8445-f9d8-42c5-b4d4-523209779902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:00.082445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be8445-f9d8-42c5-b4d4-523209779902 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:00.094467 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1446/2908] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:23:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:24:00.674743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094f482-55d2-4c05-a385-4ec75826c94c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:00.676206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9094f482-55d2-4c05-a385-4ec75826c94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:00.688338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094f482-55d2-4c05-a385-4ec75826c94c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:00.694827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbc212-764a-425e-941e-63381dc08fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:00.696060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbc212-764a-425e-941e-63381dc08fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:00.696364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbc212-764a-425e-941e-63381dc08fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:00.705766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbc212-764a-425e-941e-63381dc08fcb admin admin] PATH_INFO: `/v3/projects/ad36c46edca140d088096859d5ec1c35` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:00.705766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbc212-764a-425e-941e-63381dc08fcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad36c46edca140d088096859d5ec1c35)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:00.705766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbc212-764a-425e-941e-63381dc08fcb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:00.948950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-efbbc212-764a-425e-941e-63381dc08fcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad36c46edca140d088096859d5ec1c35', 'request_id': 'req-efbbc212-764a-425e-941e-63381dc08fcb'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:00.968477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-efbbc212-764a-425e-941e-63381dc08fcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad36c46edca140d088096859d5ec1c35', 'request_id': 'req-efbbc212-764a-425e-941e-63381dc08fcb'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:01.108543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-efbbc212-764a-425e-941e-63381dc08fcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad36c46edca140d088096859d5ec1c35', 'request_id': 'req-efbbc212-764a-425e-941e-63381dc08fcb'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:01.129130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-efbbc212-764a-425e-941e-63381dc08fcb admin admin] The token cache is being invalidate because project ad36c46edca140d088096859d5ec1c35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:24:01.129742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-efbbc212-764a-425e-941e-63381dc08fcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:01.130595 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-efbbc212-764a-425e-941e-63381dc08fcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:01.135021 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1463/2909] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:24:00 2022] DELETE /identity/v3/projects/ad36c46edca140d088096859d5ec1c35 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:01.139143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be8445-f9d8-42c5-b4d4-523209779902 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:01.155850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be8445-f9d8-42c5-b4d4-523209779902 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:01.295473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13353c-645b-47c9-afb9-47557babe437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:01.298641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13353c-645b-47c9-afb9-47557babe437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:01.299047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13353c-645b-47c9-afb9-47557babe437 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:01.299802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13353c-645b-47c9-afb9-47557babe437 admin admin] PATH_INFO: `/v3/users/f08b696118d84e2a9675ba5882e751ae` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:01.302053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13353c-645b-47c9-afb9-47557babe437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f08b696118d84e2a9675ba5882e751ae)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:01.306371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13353c-645b-47c9-afb9-47557babe437 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:01.531333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-da13353c-645b-47c9-afb9-47557babe437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f08b696118d84e2a9675ba5882e751ae'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:01.559359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-da13353c-645b-47c9-afb9-47557babe437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f08b696118d84e2a9675ba5882e751ae'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:01.561229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-da13353c-645b-47c9-afb9-47557babe437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f08b696118d84e2a9675ba5882e751ae'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:01.576554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-da13353c-645b-47c9-afb9-47557babe437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f08b696118d84e2a9675ba5882e751ae'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:01.662121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-da13353c-645b-47c9-afb9-47557babe437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f08b696118d84e2a9675ba5882e751ae'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:01.669021 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1447/2910] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:24:01 2022] DELETE /identity/v3/users/f08b696118d84e2a9675ba5882e751ae => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:02.437781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbc212-764a-425e-941e-63381dc08fcb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:02.437781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-efbbc212-764a-425e-941e-63381dc08fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:02.461836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbc212-764a-425e-941e-63381dc08fcb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:02.548364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32868a17-1156-4a47-8195-7a4fe2a0c6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:02.549514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32868a17-1156-4a47-8195-7a4fe2a0c6dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:02.549962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32868a17-1156-4a47-8195-7a4fe2a0c6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:02.550484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32868a17-1156-4a47-8195-7a4fe2a0c6dc admin admin] PATH_INFO: `/v3/projects/869690fafdea406383b1ba8db3db0120` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:02.551757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32868a17-1156-4a47-8195-7a4fe2a0c6dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=869690fafdea406383b1ba8db3db0120)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:02.554247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32868a17-1156-4a47-8195-7a4fe2a0c6dc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:02.747551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-32868a17-1156-4a47-8195-7a4fe2a0c6dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869690fafdea406383b1ba8db3db0120', 'request_id': 'req-32868a17-1156-4a47-8195-7a4fe2a0c6dc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:02.757343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-32868a17-1156-4a47-8195-7a4fe2a0c6dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869690fafdea406383b1ba8db3db0120', 'request_id': 'req-32868a17-1156-4a47-8195-7a4fe2a0c6dc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:02.856463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-32868a17-1156-4a47-8195-7a4fe2a0c6dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869690fafdea406383b1ba8db3db0120', 'request_id': 'req-32868a17-1156-4a47-8195-7a4fe2a0c6dc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:02.880083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-32868a17-1156-4a47-8195-7a4fe2a0c6dc admin admin] The token cache is being invalidate because project 869690fafdea406383b1ba8db3db0120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:24:02.880576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-32868a17-1156-4a47-8195-7a4fe2a0c6dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:02.881772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-32868a17-1156-4a47-8195-7a4fe2a0c6dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:02.884086 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1464/2911] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:24:02 2022] DELETE /identity/v3/projects/869690fafdea406383b1ba8db3db0120 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:02.889506 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647e207-a494-4da0-9d19-9fabe8b60be6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:02.890063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647e207-a494-4da0-9d19-9fabe8b60be6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:02.890488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647e207-a494-4da0-9d19-9fabe8b60be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:02.937354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1647e207-a494-4da0-9d19-9fabe8b60be6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:02.937566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1647e207-a494-4da0-9d19-9fabe8b60be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:03.037625 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1448/2912] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:03.047803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cb24d-e7d2-480e-8b2d-aa78f806cd09 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:03.048585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cb24d-e7d2-480e-8b2d-aa78f806cd09 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:03.049051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cb24d-e7d2-480e-8b2d-aa78f806cd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:03.080634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a76cb24d-e7d2-480e-8b2d-aa78f806cd09 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:03.082030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a76cb24d-e7d2-480e-8b2d-aa78f806cd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:03.110245 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1465/2913] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:03.115907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cb24d-e7d2-480e-8b2d-aa78f806cd09 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:03.116125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f1a47-13ef-4485-83f8-791a35bbc549 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:03.120841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f1a47-13ef-4485-83f8-791a35bbc549 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:03.121355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f1a47-13ef-4485-83f8-791a35bbc549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:03.129789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cb24d-e7d2-480e-8b2d-aa78f806cd09 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:03.136465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf291434-69a7-4519-93e9-ff4f6ef81514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:03.137521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf291434-69a7-4519-93e9-ff4f6ef81514 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:03.138040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf291434-69a7-4519-93e9-ff4f6ef81514 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:03.138478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf291434-69a7-4519-93e9-ff4f6ef81514 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:03.140520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf291434-69a7-4519-93e9-ff4f6ef81514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:24:03.141071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf291434-69a7-4519-93e9-ff4f6ef81514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:03.144237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf291434-69a7-4519-93e9-ff4f6ef81514 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:03.174594 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1466/2914] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:24:03.179623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf291434-69a7-4519-93e9-ff4f6ef81514 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:03.184499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8b5f1a47-13ef-4485-83f8-791a35bbc549 None None] MFA Rules not processed for user `e83fd687fcc74495a7ea73f0e001419b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:03.187359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8b5f1a47-13ef-4485-83f8-791a35bbc549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:03.199818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf291434-69a7-4519-93e9-ff4f6ef81514 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:03.210313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b37bd-f870-4104-9244-4f543b6b7f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:03.211816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b37bd-f870-4104-9244-4f543b6b7f2c admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:03.212340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b37bd-f870-4104-9244-4f543b6b7f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:03.213338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b37bd-f870-4104-9244-4f543b6b7f2c admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:03.214273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b37bd-f870-4104-9244-4f543b6b7f2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:03.217151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b37bd-f870-4104-9244-4f543b6b7f2c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:03.304412 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1449/2915] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:03.306057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe67fb-668e-4c56-ba23-b8b1e01162d1 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:03.306357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe67fb-668e-4c56-ba23-b8b1e01162d1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:03.306642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe67fb-668e-4c56-ba23-b8b1e01162d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:03.317365 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1467/2916] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:24:03 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:24:03.323043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b37bd-f870-4104-9244-4f543b6b7f2c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:03.348260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-adfe67fb-668e-4c56-ba23-b8b1e01162d1 None None] MFA Rules not processed for user `e83fd687fcc74495a7ea73f0e001419b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:03.349654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-adfe67fb-668e-4c56-ba23-b8b1e01162d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:03.423963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b37bd-f870-4104-9244-4f543b6b7f2c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:03.429559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f61a9-3050-48bb-9aa3-5c641ce80934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:03.430530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f61a9-3050-48bb-9aa3-5c641ce80934 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:03.431014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f61a9-3050-48bb-9aa3-5c641ce80934 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:03.431478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f61a9-3050-48bb-9aa3-5c641ce80934 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:03.432399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f61a9-3050-48bb-9aa3-5c641ce80934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:03.435417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f61a9-3050-48bb-9aa3-5c641ce80934 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:03.474683 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1450/2917] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:03.543009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe67fb-668e-4c56-ba23-b8b1e01162d1 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:03.544409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-adfe67fb-668e-4c56-ba23-b8b1e01162d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:03.556221 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1468/2918] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:24:03 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:03.561779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f61a9-3050-48bb-9aa3-5c641ce80934 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:03.572517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f61a9-3050-48bb-9aa3-5c641ce80934 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:03.578045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263bb59-f0af-4f3a-89ad-054d7958401d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:03.578729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263bb59-f0af-4f3a-89ad-054d7958401d admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:03.579014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263bb59-f0af-4f3a-89ad-054d7958401d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:03.579294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263bb59-f0af-4f3a-89ad-054d7958401d admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:03.580027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263bb59-f0af-4f3a-89ad-054d7958401d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:03.581681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263bb59-f0af-4f3a-89ad-054d7958401d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:03.592332 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1469/2919] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:03.596952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263bb59-f0af-4f3a-89ad-054d7958401d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:03.607776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263bb59-f0af-4f3a-89ad-054d7958401d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:03.612693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca6219-6aed-4f5b-9e21-1037b55d503a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:03.613638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca6219-6aed-4f5b-9e21-1037b55d503a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:03.613824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca6219-6aed-4f5b-9e21-1037b55d503a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:03.614143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca6219-6aed-4f5b-9e21-1037b55d503a admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:03.614822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca6219-6aed-4f5b-9e21-1037b55d503a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:03.616455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca6219-6aed-4f5b-9e21-1037b55d503a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:03.626997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe67fb-668e-4c56-ba23-b8b1e01162d1 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:03.627892 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1470/2920] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:24:03.631373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca6219-6aed-4f5b-9e21-1037b55d503a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:03.633157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a7edc-8ba5-449b-b146-f2ac72805710 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:03.633806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a7edc-8ba5-449b-b146-f2ac72805710 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:03.634087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a7edc-8ba5-449b-b146-f2ac72805710 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:03.634364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a7edc-8ba5-449b-b146-f2ac72805710 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:03.641632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca6219-6aed-4f5b-9e21-1037b55d503a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:03.643589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a7edc-8ba5-449b-b146-f2ac72805710 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:03.644503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a7edc-8ba5-449b-b146-f2ac72805710 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:03.646283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699691e-9a22-4d96-bab9-f494de57950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:03.647143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699691e-9a22-4d96-bab9-f494de57950a admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:03.647423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699691e-9a22-4d96-bab9-f494de57950a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:03.647698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699691e-9a22-4d96-bab9-f494de57950a admin admin] PATH_INFO: `/v3/projects/c06b7c255a734f14ac9e55933366ae51/users/3325879f044649bab5ca6dadba2e80fc/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:03.653217 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1451/2921] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:24:03.662388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699691e-9a22-4d96-bab9-f494de57950a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c06b7c255a734f14ac9e55933366ae51, user_id=3325879f044649bab5ca6dadba2e80fc, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:03.665185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699691e-9a22-4d96-bab9-f494de57950a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:03.739176 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1471/2922] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:24:03 2022] PUT /identity/v3/projects/c06b7c255a734f14ac9e55933366ae51/users/3325879f044649bab5ca6dadba2e80fc/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:24:03.750733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa713d-c2fe-4bb2-b91c-1f4707045328 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:03.751024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa713d-c2fe-4bb2-b91c-1f4707045328 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:03.751298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa713d-c2fe-4bb2-b91c-1f4707045328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:03.781089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-68aa713d-c2fe-4bb2-b91c-1f4707045328 None None] MFA Rules not processed for user `3325879f044649bab5ca6dadba2e80fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:03.781089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-68aa713d-c2fe-4bb2-b91c-1f4707045328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:03.861804 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1452/2923] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:03.863160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699691e-9a22-4d96-bab9-f494de57950a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:03.934183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699691e-9a22-4d96-bab9-f494de57950a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:03.940657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8801f87-50c5-4c7b-ba49-a45e76efe87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:03.941330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8801f87-50c5-4c7b-ba49-a45e76efe87f admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:03.941622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8801f87-50c5-4c7b-ba49-a45e76efe87f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:03.941901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8801f87-50c5-4c7b-ba49-a45e76efe87f admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:03.942626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8801f87-50c5-4c7b-ba49-a45e76efe87f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:03.944556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8801f87-50c5-4c7b-ba49-a45e76efe87f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:04.026980 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1472/2924] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:24:03 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:04.028164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa713d-c2fe-4bb2-b91c-1f4707045328 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:04.039139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa713d-c2fe-4bb2-b91c-1f4707045328 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:04.098756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2c6fb-3d2d-4190-a6d7-521427c6c330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:04.099499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2c6fb-3d2d-4190-a6d7-521427c6c330 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:04.099794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2c6fb-3d2d-4190-a6d7-521427c6c330 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:04.100322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2c6fb-3d2d-4190-a6d7-521427c6c330 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:04.101106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2c6fb-3d2d-4190-a6d7-521427c6c330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:04.103397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2c6fb-3d2d-4190-a6d7-521427c6c330 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:04.208527 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1453/2925] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:24:04 2022] POST /identity/v3/users => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:24:04.213123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8801f87-50c5-4c7b-ba49-a45e76efe87f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:04.224313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8801f87-50c5-4c7b-ba49-a45e76efe87f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:04.229148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9324009-240a-436f-86cf-94bfd0b1c07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:04.229836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9324009-240a-436f-86cf-94bfd0b1c07b admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:04.230122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9324009-240a-436f-86cf-94bfd0b1c07b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:04.230397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9324009-240a-436f-86cf-94bfd0b1c07b admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:04.231131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9324009-240a-436f-86cf-94bfd0b1c07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:04.232919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9324009-240a-436f-86cf-94bfd0b1c07b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:04.262734 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1473/2926] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:04.267238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2c6fb-3d2d-4190-a6d7-521427c6c330 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:04.278727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2c6fb-3d2d-4190-a6d7-521427c6c330 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:04.292103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834069b-9344-4868-b401-c6c318645276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:04.293004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834069b-9344-4868-b401-c6c318645276 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:04.293296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834069b-9344-4868-b401-c6c318645276 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:04.293581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834069b-9344-4868-b401-c6c318645276 admin admin] PATH_INFO: `/v3/projects/e27d4c704af4470f9492a47723b6e660/users/016170a31e4840af952e04b26f0b11ad/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:04.310654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834069b-9344-4868-b401-c6c318645276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e27d4c704af4470f9492a47723b6e660, user_id=016170a31e4840af952e04b26f0b11ad, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:04.314246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834069b-9344-4868-b401-c6c318645276 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:04.405432 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1454/2927] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:24:04 2022] PUT /identity/v3/projects/e27d4c704af4470f9492a47723b6e660/users/016170a31e4840af952e04b26f0b11ad/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:04.409602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9324009-240a-436f-86cf-94bfd0b1c07b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:04.419419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9324009-240a-436f-86cf-94bfd0b1c07b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:04.472818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef6f25-e607-4a0e-a480-82cfa5e1c06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:04.473474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef6f25-e607-4a0e-a480-82cfa5e1c06a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:04.473756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef6f25-e607-4a0e-a480-82cfa5e1c06a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:04.474038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef6f25-e607-4a0e-a480-82cfa5e1c06a admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:04.474741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef6f25-e607-4a0e-a480-82cfa5e1c06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:04.476332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef6f25-e607-4a0e-a480-82cfa5e1c06a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:04.486476 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1474/2928] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:04.490514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834069b-9344-4868-b401-c6c318645276 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:04.502257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834069b-9344-4868-b401-c6c318645276 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:04.507675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c421b-5991-4dd4-8316-3246ffc320ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:04.508747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c421b-5991-4dd4-8316-3246ffc320ac admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:04.508978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c421b-5991-4dd4-8316-3246ffc320ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:04.512857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c421b-5991-4dd4-8316-3246ffc320ac admin admin] PATH_INFO: `/v3/projects/e27d4c704af4470f9492a47723b6e660/users/016170a31e4840af952e04b26f0b11ad/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:04.512857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c421b-5991-4dd4-8316-3246ffc320ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=e27d4c704af4470f9492a47723b6e660, user_id=016170a31e4840af952e04b26f0b11ad, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:04.514816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c421b-5991-4dd4-8316-3246ffc320ac admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:04.526184 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1455/2929] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:24:04 2022] PUT /identity/v3/projects/e27d4c704af4470f9492a47723b6e660/users/016170a31e4840af952e04b26f0b11ad/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:24:04.536164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba2a85-6365-46bf-b7b5-35c03fdb649f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:04.537090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba2a85-6365-46bf-b7b5-35c03fdb649f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:04.537647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba2a85-6365-46bf-b7b5-35c03fdb649f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:04.574487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ddba2a85-6365-46bf-b7b5-35c03fdb649f None None] MFA Rules not processed for user `016170a31e4840af952e04b26f0b11ad`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:04.575711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ddba2a85-6365-46bf-b7b5-35c03fdb649f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:04.690935 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1475/2930] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:04.745307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c421b-5991-4dd4-8316-3246ffc320ac admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:04.816861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c421b-5991-4dd4-8316-3246ffc320ac admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:04.822285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b78416-31ab-4361-a4de-984778a3b5ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:04.822930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b78416-31ab-4361-a4de-984778a3b5ee service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:04.823213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b78416-31ab-4361-a4de-984778a3b5ee service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:04.823489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b78416-31ab-4361-a4de-984778a3b5ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:04.832921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b78416-31ab-4361-a4de-984778a3b5ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:04.834511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b78416-31ab-4361-a4de-984778a3b5ee service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:04.843603 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1456/2931] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:24:04.923743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba2a85-6365-46bf-b7b5-35c03fdb649f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:04.990342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba2a85-6365-46bf-b7b5-35c03fdb649f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:05.002872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de62c0d-263e-4134-b2d9-283564ab876e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:05.003731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de62c0d-263e-4134-b2d9-283564ab876e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:05.004014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de62c0d-263e-4134-b2d9-283564ab876e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:05.004288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de62c0d-263e-4134-b2d9-283564ab876e admin admin] PATH_INFO: `/v3/users/3325879f044649bab5ca6dadba2e80fc` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:05.005534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de62c0d-263e-4134-b2d9-283564ab876e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3325879f044649bab5ca6dadba2e80fc)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:05.007479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de62c0d-263e-4134-b2d9-283564ab876e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:05.213242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4de62c0d-263e-4134-b2d9-283564ab876e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3325879f044649bab5ca6dadba2e80fc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:05.234712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4de62c0d-263e-4134-b2d9-283564ab876e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3325879f044649bab5ca6dadba2e80fc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:05.235553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4de62c0d-263e-4134-b2d9-283564ab876e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3325879f044649bab5ca6dadba2e80fc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:05.243284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4de62c0d-263e-4134-b2d9-283564ab876e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3325879f044649bab5ca6dadba2e80fc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:05.337780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4de62c0d-263e-4134-b2d9-283564ab876e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3325879f044649bab5ca6dadba2e80fc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:05.351053 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1476/2932] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:24:04 2022] DELETE /identity/v3/users/3325879f044649bab5ca6dadba2e80fc => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:05.353698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b7ffd-cb9d-4ae7-a593-1f1d22f2a717 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:05.354300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b7ffd-cb9d-4ae7-a593-1f1d22f2a717 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:05.354300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b7ffd-cb9d-4ae7-a593-1f1d22f2a717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:05.378263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ee8b7ffd-cb9d-4ae7-a593-1f1d22f2a717 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:05.379528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ee8b7ffd-cb9d-4ae7-a593-1f1d22f2a717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:05.471966 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1457/2933] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:05.483087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de62c0d-263e-4134-b2d9-283564ab876e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:05.484845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4de62c0d-263e-4134-b2d9-283564ab876e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:05.554563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de62c0d-263e-4134-b2d9-283564ab876e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:05.558523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394f96e-ebf4-450d-8911-1b2c40356964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:05.559282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394f96e-ebf4-450d-8911-1b2c40356964 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:05.559631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394f96e-ebf4-450d-8911-1b2c40356964 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:05.559998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394f96e-ebf4-450d-8911-1b2c40356964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:05.570336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394f96e-ebf4-450d-8911-1b2c40356964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:05.571801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394f96e-ebf4-450d-8911-1b2c40356964 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:05.584771 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1477/2934] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:24:06.126642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b7ffd-cb9d-4ae7-a593-1f1d22f2a717 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:06.128432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ee8b7ffd-cb9d-4ae7-a593-1f1d22f2a717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:06.143014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b7ffd-cb9d-4ae7-a593-1f1d22f2a717 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:06.148355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d539d9-a0c3-4bdd-a648-aaa854091902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:06.157923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d539d9-a0c3-4bdd-a648-aaa854091902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:06.158436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d539d9-a0c3-4bdd-a648-aaa854091902 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:06.158786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d539d9-a0c3-4bdd-a648-aaa854091902 admin admin] PATH_INFO: `/v3/projects/c06b7c255a734f14ac9e55933366ae51` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:06.161040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d539d9-a0c3-4bdd-a648-aaa854091902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c06b7c255a734f14ac9e55933366ae51)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:06.163020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d539d9-a0c3-4bdd-a648-aaa854091902 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:06.275076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-90d539d9-a0c3-4bdd-a648-aaa854091902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c06b7c255a734f14ac9e55933366ae51', 'request_id': 'req-90d539d9-a0c3-4bdd-a648-aaa854091902'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:06.363883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-90d539d9-a0c3-4bdd-a648-aaa854091902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c06b7c255a734f14ac9e55933366ae51', 'request_id': 'req-90d539d9-a0c3-4bdd-a648-aaa854091902'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:06.370764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-90d539d9-a0c3-4bdd-a648-aaa854091902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c06b7c255a734f14ac9e55933366ae51', 'request_id': 'req-90d539d9-a0c3-4bdd-a648-aaa854091902'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:06.382460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-90d539d9-a0c3-4bdd-a648-aaa854091902 admin admin] The token cache is being invalidate because project c06b7c255a734f14ac9e55933366ae51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:24:06.382645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-90d539d9-a0c3-4bdd-a648-aaa854091902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:06.383211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-90d539d9-a0c3-4bdd-a648-aaa854091902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:06.385091 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1458/2935] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:24:06 2022] DELETE /identity/v3/projects/c06b7c255a734f14ac9e55933366ae51 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:06.389146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394f96e-ebf4-450d-8911-1b2c40356964 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:06.399310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394f96e-ebf4-450d-8911-1b2c40356964 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:06.456199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981aa59b-ee2a-4340-80e8-94db9f67875d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:06.457177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981aa59b-ee2a-4340-80e8-94db9f67875d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:06.457509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981aa59b-ee2a-4340-80e8-94db9f67875d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:06.457726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981aa59b-ee2a-4340-80e8-94db9f67875d admin admin] PATH_INFO: `/v3/users/016170a31e4840af952e04b26f0b11ad` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:06.460264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981aa59b-ee2a-4340-80e8-94db9f67875d admin admin] RBAC: Authorizing `identity:delete_user(user_id=016170a31e4840af952e04b26f0b11ad)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:06.462795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981aa59b-ee2a-4340-80e8-94db9f67875d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:06.668037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-981aa59b-ee2a-4340-80e8-94db9f67875d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '016170a31e4840af952e04b26f0b11ad'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:06.679959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-981aa59b-ee2a-4340-80e8-94db9f67875d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '016170a31e4840af952e04b26f0b11ad'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:06.680768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-981aa59b-ee2a-4340-80e8-94db9f67875d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '016170a31e4840af952e04b26f0b11ad'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:06.687497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-981aa59b-ee2a-4340-80e8-94db9f67875d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '016170a31e4840af952e04b26f0b11ad'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:06.765179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-981aa59b-ee2a-4340-80e8-94db9f67875d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '016170a31e4840af952e04b26f0b11ad'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:06.771951 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1478/2936] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:24:06 2022] DELETE /identity/v3/users/016170a31e4840af952e04b26f0b11ad => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:07.606028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d539d9-a0c3-4bdd-a648-aaa854091902 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:07.609669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-90d539d9-a0c3-4bdd-a648-aaa854091902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:07.629603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d539d9-a0c3-4bdd-a648-aaa854091902 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:07.711062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4292f2-1e6e-485c-8cef-40135d17156b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:07.712101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4292f2-1e6e-485c-8cef-40135d17156b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:07.712498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4292f2-1e6e-485c-8cef-40135d17156b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:07.713016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4292f2-1e6e-485c-8cef-40135d17156b admin admin] PATH_INFO: `/v3/projects/e27d4c704af4470f9492a47723b6e660` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:07.714259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4292f2-1e6e-485c-8cef-40135d17156b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e27d4c704af4470f9492a47723b6e660)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:07.716425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4292f2-1e6e-485c-8cef-40135d17156b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:07.889453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9b4292f2-1e6e-485c-8cef-40135d17156b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e27d4c704af4470f9492a47723b6e660', 'request_id': 'req-9b4292f2-1e6e-485c-8cef-40135d17156b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:08.010445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9b4292f2-1e6e-485c-8cef-40135d17156b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e27d4c704af4470f9492a47723b6e660', 'request_id': 'req-9b4292f2-1e6e-485c-8cef-40135d17156b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:08.017628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9b4292f2-1e6e-485c-8cef-40135d17156b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e27d4c704af4470f9492a47723b6e660', 'request_id': 'req-9b4292f2-1e6e-485c-8cef-40135d17156b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:08.031296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9b4292f2-1e6e-485c-8cef-40135d17156b admin admin] The token cache is being invalidate because project e27d4c704af4470f9492a47723b6e660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:24:08.031622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9b4292f2-1e6e-485c-8cef-40135d17156b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:08.032270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9b4292f2-1e6e-485c-8cef-40135d17156b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:08.033971 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1459/2937] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:24:07 2022] DELETE /identity/v3/projects/e27d4c704af4470f9492a47723b6e660 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:08.039167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d3172-d88d-4927-bbbd-76acc80bf749 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:08.039668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d3172-d88d-4927-bbbd-76acc80bf749 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:08.039766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d3172-d88d-4927-bbbd-76acc80bf749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:08.057717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e52d3172-d88d-4927-bbbd-76acc80bf749 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:08.058927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e52d3172-d88d-4927-bbbd-76acc80bf749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:08.131876 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1479/2938] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:08.140726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e6cc0-16b1-492a-93f4-26706b6d9093 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:08.141133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e6cc0-16b1-492a-93f4-26706b6d9093 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:08.141478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e6cc0-16b1-492a-93f4-26706b6d9093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:08.165927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a23e6cc0-16b1-492a-93f4-26706b6d9093 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:08.168259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a23e6cc0-16b1-492a-93f4-26706b6d9093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:08.182476 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1460/2939] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:08.188146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d3172-d88d-4927-bbbd-76acc80bf749 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:08.205343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d3172-d88d-4927-bbbd-76acc80bf749 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:08.211463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e92c6-085a-4f49-9495-0520d7e32150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:08.212353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e92c6-085a-4f49-9495-0520d7e32150 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:08.212955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e92c6-085a-4f49-9495-0520d7e32150 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:08.213391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e92c6-085a-4f49-9495-0520d7e32150 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:08.214275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e92c6-085a-4f49-9495-0520d7e32150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:24:08.214748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e92c6-085a-4f49-9495-0520d7e32150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:08.216551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e92c6-085a-4f49-9495-0520d7e32150 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:08.230979 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1480/2940] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:24:08.236622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e6cc0-16b1-492a-93f4-26706b6d9093 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:08.262820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e6cc0-16b1-492a-93f4-26706b6d9093 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:08.267953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb3162-8f2f-4b24-bddc-9c2a13dccdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:08.268662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb3162-8f2f-4b24-bddc-9c2a13dccdfa admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:08.268932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb3162-8f2f-4b24-bddc-9c2a13dccdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:08.269219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb3162-8f2f-4b24-bddc-9c2a13dccdfa admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:08.269919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb3162-8f2f-4b24-bddc-9c2a13dccdfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:08.272024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb3162-8f2f-4b24-bddc-9c2a13dccdfa admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:08.401432 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1461/2941] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:24:08 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:24:08.405745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e92c6-085a-4f49-9495-0520d7e32150 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:08.425214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e92c6-085a-4f49-9495-0520d7e32150 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:08.517714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7ff1b-d898-4070-8862-19dc97548434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:08.518416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7ff1b-d898-4070-8862-19dc97548434 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:08.518702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7ff1b-d898-4070-8862-19dc97548434 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:08.518981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7ff1b-d898-4070-8862-19dc97548434 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:08.519680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7ff1b-d898-4070-8862-19dc97548434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:08.521732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7ff1b-d898-4070-8862-19dc97548434 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:08.625710 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1481/2942] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:24:08 2022] POST /identity/v3/users => generated 288 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:24:08.626694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb3162-8f2f-4b24-bddc-9c2a13dccdfa admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:08.637944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb3162-8f2f-4b24-bddc-9c2a13dccdfa admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:08.643474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53d69d-4187-446e-b20e-ccd5ee47b5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:08.644370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53d69d-4187-446e-b20e-ccd5ee47b5bc admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:08.644889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53d69d-4187-446e-b20e-ccd5ee47b5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:08.645264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53d69d-4187-446e-b20e-ccd5ee47b5bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:08.646205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53d69d-4187-446e-b20e-ccd5ee47b5bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:08.648192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53d69d-4187-446e-b20e-ccd5ee47b5bc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:08.661125 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1462/2943] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:24:08.665471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7ff1b-d898-4070-8862-19dc97548434 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:08.680121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7ff1b-d898-4070-8862-19dc97548434 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:08.687557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88a7f4-0ac8-40d5-ba24-9c019b595e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:08.688366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88a7f4-0ac8-40d5-ba24-9c019b595e38 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:08.688941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88a7f4-0ac8-40d5-ba24-9c019b595e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:08.689365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88a7f4-0ac8-40d5-ba24-9c019b595e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:08.691359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88a7f4-0ac8-40d5-ba24-9c019b595e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:08.693142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88a7f4-0ac8-40d5-ba24-9c019b595e38 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:08.707496 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1482/2944] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:24:08.712760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53d69d-4187-446e-b20e-ccd5ee47b5bc admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:08.724778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53d69d-4187-446e-b20e-ccd5ee47b5bc admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:08.730236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72050f26-0188-424a-83f9-cd6185df44ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:08.731226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72050f26-0188-424a-83f9-cd6185df44ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:08.731593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72050f26-0188-424a-83f9-cd6185df44ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:08.731979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72050f26-0188-424a-83f9-cd6185df44ff admin admin] PATH_INFO: `/v3/projects/8f3a87b199b24854bb1e0699f7402e8d/users/4249f4ad303744e88e5f01d339a762b7/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:08.753217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72050f26-0188-424a-83f9-cd6185df44ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3a87b199b24854bb1e0699f7402e8d, user_id=4249f4ad303744e88e5f01d339a762b7, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:08.756291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72050f26-0188-424a-83f9-cd6185df44ff admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:08.861187 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1463/2945] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:24:08 2022] PUT /identity/v3/projects/8f3a87b199b24854bb1e0699f7402e8d/users/4249f4ad303744e88e5f01d339a762b7/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:08.872301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadeec9-af97-4e9f-b394-43840549d845 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:08.872818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadeec9-af97-4e9f-b394-43840549d845 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:08.873458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadeec9-af97-4e9f-b394-43840549d845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:08.915725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ffadeec9-af97-4e9f-b394-43840549d845 None None] MFA Rules not processed for user `4249f4ad303744e88e5f01d339a762b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:08.924740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ffadeec9-af97-4e9f-b394-43840549d845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:09.077740 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1483/2946] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:09.085567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72050f26-0188-424a-83f9-cd6185df44ff admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:09.162464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72050f26-0188-424a-83f9-cd6185df44ff admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:09.171521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e6ab4-0560-4e83-9f8b-b4137e57a789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:09.172701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e6ab4-0560-4e83-9f8b-b4137e57a789 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:09.172987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e6ab4-0560-4e83-9f8b-b4137e57a789 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:09.173261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e6ab4-0560-4e83-9f8b-b4137e57a789 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:09.173995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e6ab4-0560-4e83-9f8b-b4137e57a789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:09.176215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e6ab4-0560-4e83-9f8b-b4137e57a789 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:09.291361 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1464/2947] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:24:09 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:09.295026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffadeec9-af97-4e9f-b394-43840549d845 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:09.307262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffadeec9-af97-4e9f-b394-43840549d845 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:09.401291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6109f8-bbf6-4f0f-a849-cf9f4e9705b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:09.402298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6109f8-bbf6-4f0f-a849-cf9f4e9705b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:09.402881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6109f8-bbf6-4f0f-a849-cf9f4e9705b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:09.403399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6109f8-bbf6-4f0f-a849-cf9f4e9705b7 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:09.404412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6109f8-bbf6-4f0f-a849-cf9f4e9705b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:09.407607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6109f8-bbf6-4f0f-a849-cf9f4e9705b7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:09.805212 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1484/2948] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:24:09 2022] POST /identity/v3/users => generated 293 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:09.809108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e6ab4-0560-4e83-9f8b-b4137e57a789 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:09.819470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e6ab4-0560-4e83-9f8b-b4137e57a789 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:09.827942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab458784-37eb-465e-9660-8772185ac40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:09.831429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab458784-37eb-465e-9660-8772185ac40b admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:09.831429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab458784-37eb-465e-9660-8772185ac40b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:09.831429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab458784-37eb-465e-9660-8772185ac40b admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:09.831429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab458784-37eb-465e-9660-8772185ac40b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:09.831988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab458784-37eb-465e-9660-8772185ac40b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:09.844494 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1465/2949] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:09.848724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6109f8-bbf6-4f0f-a849-cf9f4e9705b7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:09.861077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6109f8-bbf6-4f0f-a849-cf9f4e9705b7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:09.868661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d9efd-7542-4df1-afc1-9573b8191b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:09.868950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d9efd-7542-4df1-afc1-9573b8191b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:09.869236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d9efd-7542-4df1-afc1-9573b8191b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:09.869505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d9efd-7542-4df1-afc1-9573b8191b1a admin admin] PATH_INFO: `/v3/projects/ec017741bbc04f0783dbb90c49061b1f/users/8301d074b6c845d2a5a6c03bef6b6b94/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:09.892016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d9efd-7542-4df1-afc1-9573b8191b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec017741bbc04f0783dbb90c49061b1f, user_id=8301d074b6c845d2a5a6c03bef6b6b94, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:09.895324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d9efd-7542-4df1-afc1-9573b8191b1a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:09.994666 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1485/2950] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:24:09 2022] PUT /identity/v3/projects/ec017741bbc04f0783dbb90c49061b1f/users/8301d074b6c845d2a5a6c03bef6b6b94/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:24:09.997494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab458784-37eb-465e-9660-8772185ac40b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:10.026560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab458784-37eb-465e-9660-8772185ac40b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:10.117575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba01d0c-0c69-4404-975e-65c870453f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:10.118556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba01d0c-0c69-4404-975e-65c870453f19 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:10.118556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba01d0c-0c69-4404-975e-65c870453f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:10.118772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba01d0c-0c69-4404-975e-65c870453f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:10.119502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba01d0c-0c69-4404-975e-65c870453f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:10.121374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba01d0c-0c69-4404-975e-65c870453f19 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:10.136922 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1466/2951] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:10.138866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d9efd-7542-4df1-afc1-9573b8191b1a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:10.160913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d9efd-7542-4df1-afc1-9573b8191b1a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:10.166802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63224642-eff4-4280-8d38-05641057d137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:10.168254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63224642-eff4-4280-8d38-05641057d137 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:10.168928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63224642-eff4-4280-8d38-05641057d137 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:10.169770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63224642-eff4-4280-8d38-05641057d137 admin admin] PATH_INFO: `/v3/projects/ec017741bbc04f0783dbb90c49061b1f/users/8301d074b6c845d2a5a6c03bef6b6b94/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:10.172348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63224642-eff4-4280-8d38-05641057d137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec017741bbc04f0783dbb90c49061b1f, user_id=8301d074b6c845d2a5a6c03bef6b6b94, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:10.175908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63224642-eff4-4280-8d38-05641057d137 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:10.193866 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1486/2952] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:24:10 2022] PUT /identity/v3/projects/ec017741bbc04f0783dbb90c49061b1f/users/8301d074b6c845d2a5a6c03bef6b6b94/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:10.200936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef6328-7af9-47c5-b35e-d5075cfaa226 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:10.201252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef6328-7af9-47c5-b35e-d5075cfaa226 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:10.201558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef6328-7af9-47c5-b35e-d5075cfaa226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:10.231620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-01ef6328-7af9-47c5-b35e-d5075cfaa226 None None] MFA Rules not processed for user `8301d074b6c845d2a5a6c03bef6b6b94`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:10.232887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-01ef6328-7af9-47c5-b35e-d5075cfaa226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:10.314024 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1467/2953] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:10.324447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fea4d-b5e8-461a-825a-472e7b8fc6a6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:10.325152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fea4d-b5e8-461a-825a-472e7b8fc6a6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:10.325443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fea4d-b5e8-461a-825a-472e7b8fc6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:10.345397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7f3fea4d-b5e8-461a-825a-472e7b8fc6a6 None None] MFA Rules not processed for user `4249f4ad303744e88e5f01d339a762b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:10.346808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7f3fea4d-b5e8-461a-825a-472e7b8fc6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:10.463872 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1487/2954] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:24:10.471791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef6328-7af9-47c5-b35e-d5075cfaa226 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:10.474072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-01ef6328-7af9-47c5-b35e-d5075cfaa226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:10.575086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef6328-7af9-47c5-b35e-d5075cfaa226 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:10.582193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53213dde-7eba-459c-8a6f-675e087dc7bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:10.582815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53213dde-7eba-459c-8a6f-675e087dc7bb service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:10.583106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53213dde-7eba-459c-8a6f-675e087dc7bb service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:10.583445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53213dde-7eba-459c-8a6f-675e087dc7bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:10.599995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53213dde-7eba-459c-8a6f-675e087dc7bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:10.603157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53213dde-7eba-459c-8a6f-675e087dc7bb service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:10.614335 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1468/2955] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:24:13.237094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fea4d-b5e8-461a-825a-472e7b8fc6a6 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:13.240181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7f3fea4d-b5e8-461a-825a-472e7b8fc6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:13.323876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fea4d-b5e8-461a-825a-472e7b8fc6a6 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:13.328715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf5538-0963-46df-ab73-d647aa81b717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:13.330000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf5538-0963-46df-ab73-d647aa81b717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:13.330361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf5538-0963-46df-ab73-d647aa81b717 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:13.330709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf5538-0963-46df-ab73-d647aa81b717 admin admin] PATH_INFO: `/v3/users/0dfb786bf30a49bfbcb7ce975891b1b1` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:13.332021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf5538-0963-46df-ab73-d647aa81b717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dfb786bf30a49bfbcb7ce975891b1b1)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:13.334477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf5538-0963-46df-ab73-d647aa81b717 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:13.611233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53213dde-7eba-459c-8a6f-675e087dc7bb service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:13.613140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-53213dde-7eba-459c-8a6f-675e087dc7bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:13.633378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-65bf5538-0963-46df-ab73-d647aa81b717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dfb786bf30a49bfbcb7ce975891b1b1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:13.645869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53213dde-7eba-459c-8a6f-675e087dc7bb service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:13.649986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-65bf5538-0963-46df-ab73-d647aa81b717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dfb786bf30a49bfbcb7ce975891b1b1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:13.650849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab0c23-2c23-4ae3-b538-6b6f482fb448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:13.650979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-65bf5538-0963-46df-ab73-d647aa81b717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dfb786bf30a49bfbcb7ce975891b1b1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:13.651752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab0c23-2c23-4ae3-b538-6b6f482fb448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:13.652034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab0c23-2c23-4ae3-b538-6b6f482fb448 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:13.652322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab0c23-2c23-4ae3-b538-6b6f482fb448 admin admin] PATH_INFO: `/v3/users/cc47e87a70dc4c49b2a17f6bde30b880` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:13.653549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab0c23-2c23-4ae3-b538-6b6f482fb448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc47e87a70dc4c49b2a17f6bde30b880)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:13.656132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab0c23-2c23-4ae3-b538-6b6f482fb448 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:13.663412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-65bf5538-0963-46df-ab73-d647aa81b717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dfb786bf30a49bfbcb7ce975891b1b1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:13.822835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-65bf5538-0963-46df-ab73-d647aa81b717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dfb786bf30a49bfbcb7ce975891b1b1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:13.826613 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1488/2956] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:24:13 2022] DELETE /identity/v3/users/0dfb786bf30a49bfbcb7ce975891b1b1 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:13.830865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec87b8-1277-44d2-b387-9ca38a1309d7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:13.831418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec87b8-1277-44d2-b387-9ca38a1309d7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:13.831701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec87b8-1277-44d2-b387-9ca38a1309d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:13.862339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b7ec87b8-1277-44d2-b387-9ca38a1309d7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:13.863713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b7ec87b8-1277-44d2-b387-9ca38a1309d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:13.935982 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1489/2957] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:24:13.946810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec87b8-1277-44d2-b387-9ca38a1309d7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:13.949728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b7ec87b8-1277-44d2-b387-9ca38a1309d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:14.001370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f4ab0c23-2c23-4ae3-b538-6b6f482fb448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc47e87a70dc4c49b2a17f6bde30b880'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:14.036030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f4ab0c23-2c23-4ae3-b538-6b6f482fb448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc47e87a70dc4c49b2a17f6bde30b880'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:14.036030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f4ab0c23-2c23-4ae3-b538-6b6f482fb448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc47e87a70dc4c49b2a17f6bde30b880'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:14.038109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec87b8-1277-44d2-b387-9ca38a1309d7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:14.042278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9a19a-c98c-49ec-8781-40311bf4d5ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:14.042978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f4ab0c23-2c23-4ae3-b538-6b6f482fb448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc47e87a70dc4c49b2a17f6bde30b880'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:14.043401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9a19a-c98c-49ec-8781-40311bf4d5ab service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:14.043940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9a19a-c98c-49ec-8781-40311bf4d5ab service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:14.044210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9a19a-c98c-49ec-8781-40311bf4d5ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:14.055776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9a19a-c98c-49ec-8781-40311bf4d5ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:14.058855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9a19a-c98c-49ec-8781-40311bf4d5ab service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:14.068239 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1490/2958] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:24:14.127479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f4ab0c23-2c23-4ae3-b538-6b6f482fb448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc47e87a70dc4c49b2a17f6bde30b880'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:14.134803 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1469/2959] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:24:13 2022] DELETE /identity/v3/users/cc47e87a70dc4c49b2a17f6bde30b880 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:14.413251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9a19a-c98c-49ec-8781-40311bf4d5ab service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:14.414541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3bf9a19a-c98c-49ec-8781-40311bf4d5ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:14.432353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9a19a-c98c-49ec-8781-40311bf4d5ab service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:14.496106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac353ce-2dbb-4721-a2e6-21a0d13c9792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:14.497951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac353ce-2dbb-4721-a2e6-21a0d13c9792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:14.498455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac353ce-2dbb-4721-a2e6-21a0d13c9792 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:14.499589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac353ce-2dbb-4721-a2e6-21a0d13c9792 admin admin] PATH_INFO: `/v3/projects/df25ec067b694b75859a41ecc012eb89` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:14.500938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac353ce-2dbb-4721-a2e6-21a0d13c9792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df25ec067b694b75859a41ecc012eb89)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:14.503941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac353ce-2dbb-4721-a2e6-21a0d13c9792 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:14.684088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6ac353ce-2dbb-4721-a2e6-21a0d13c9792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df25ec067b694b75859a41ecc012eb89', 'request_id': 'req-6ac353ce-2dbb-4721-a2e6-21a0d13c9792'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:14.690979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6ac353ce-2dbb-4721-a2e6-21a0d13c9792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df25ec067b694b75859a41ecc012eb89', 'request_id': 'req-6ac353ce-2dbb-4721-a2e6-21a0d13c9792'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:14.801962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6ac353ce-2dbb-4721-a2e6-21a0d13c9792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df25ec067b694b75859a41ecc012eb89', 'request_id': 'req-6ac353ce-2dbb-4721-a2e6-21a0d13c9792'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:14.823260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6ac353ce-2dbb-4721-a2e6-21a0d13c9792 admin admin] The token cache is being invalidate because project df25ec067b694b75859a41ecc012eb89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:24:14.823569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6ac353ce-2dbb-4721-a2e6-21a0d13c9792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:14.824239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6ac353ce-2dbb-4721-a2e6-21a0d13c9792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:14.826271 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1491/2960] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:24:14 2022] DELETE /identity/v3/projects/df25ec067b694b75859a41ecc012eb89 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:14.831458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7ef90-931d-4bd7-ac18-981806b46d0d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:14.840807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7ef90-931d-4bd7-ac18-981806b46d0d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:14.840807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7ef90-931d-4bd7-ac18-981806b46d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:14.857440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6809a85-68f9-4b6b-b899-70a74a8417aa None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:14.857733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6809a85-68f9-4b6b-b899-70a74a8417aa None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:14.858014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6809a85-68f9-4b6b-b899-70a74a8417aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:14.867440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b7f7ef90-931d-4bd7-ac18-981806b46d0d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:14.869135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b7f7ef90-931d-4bd7-ac18-981806b46d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:14.885793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f6809a85-68f9-4b6b-b899-70a74a8417aa None None] MFA Rules not processed for user `1ea3eddf81624b41a4410ea85e17eabe`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:14.887269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f6809a85-68f9-4b6b-b899-70a74a8417aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:14.967461 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1492/2961] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:14.967461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6809a85-68f9-4b6b-b899-70a74a8417aa None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:14.971005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f6809a85-68f9-4b6b-b899-70a74a8417aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:15.034597 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1470/2962] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:15.052198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42132225-76b2-4254-896d-0f2632da8c6b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:15.052710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42132225-76b2-4254-896d-0f2632da8c6b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:15.053186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42132225-76b2-4254-896d-0f2632da8c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:15.076521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-42132225-76b2-4254-896d-0f2632da8c6b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:15.078840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-42132225-76b2-4254-896d-0f2632da8c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:15.091677 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1471/2963] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:15.096499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42132225-76b2-4254-896d-0f2632da8c6b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:15.117956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42132225-76b2-4254-896d-0f2632da8c6b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:15.119403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6809a85-68f9-4b6b-b899-70a74a8417aa None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:15.128824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45600216-7ef5-44a7-9f28-8d55a773d136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:15.129573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e960d4-471a-437b-9832-65e7429a5e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:15.130136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45600216-7ef5-44a7-9f28-8d55a773d136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:15.130136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45600216-7ef5-44a7-9f28-8d55a773d136 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:15.130516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e960d4-471a-437b-9832-65e7429a5e21 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:15.130631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45600216-7ef5-44a7-9f28-8d55a773d136 admin admin] PATH_INFO: `/v3/projects/2e61ca4e44174db58ae79d92a8de3458` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:15.130934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e960d4-471a-437b-9832-65e7429a5e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:15.131288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e960d4-471a-437b-9832-65e7429a5e21 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:15.132107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e960d4-471a-437b-9832-65e7429a5e21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:24:15.132418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45600216-7ef5-44a7-9f28-8d55a773d136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e61ca4e44174db58ae79d92a8de3458)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:15.132539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e960d4-471a-437b-9832-65e7429a5e21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:15.134223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e960d4-471a-437b-9832-65e7429a5e21 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:15.134730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45600216-7ef5-44a7-9f28-8d55a773d136 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:15.162681 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1472/2964] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:24:15.168408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e960d4-471a-437b-9832-65e7429a5e21 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:15.186889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e960d4-471a-437b-9832-65e7429a5e21 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:15.192113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79296eae-b69e-43e3-8806-242c2875a2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:15.192834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79296eae-b69e-43e3-8806-242c2875a2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:15.193121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79296eae-b69e-43e3-8806-242c2875a2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:15.193402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79296eae-b69e-43e3-8806-242c2875a2d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:15.194118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79296eae-b69e-43e3-8806-242c2875a2d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:15.196076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79296eae-b69e-43e3-8806-242c2875a2d4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:15.306909 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1473/2965] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:24:15 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:24:15.311565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79296eae-b69e-43e3-8806-242c2875a2d4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:15.313445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-45600216-7ef5-44a7-9f28-8d55a773d136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e61ca4e44174db58ae79d92a8de3458', 'request_id': 'req-45600216-7ef5-44a7-9f28-8d55a773d136'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:15.328924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-45600216-7ef5-44a7-9f28-8d55a773d136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e61ca4e44174db58ae79d92a8de3458', 'request_id': 'req-45600216-7ef5-44a7-9f28-8d55a773d136'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:15.391059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79296eae-b69e-43e3-8806-242c2875a2d4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:15.399320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3798243-4d3a-449e-9b50-d6887ba6bb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:15.399320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3798243-4d3a-449e-9b50-d6887ba6bb8f admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:15.399320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3798243-4d3a-449e-9b50-d6887ba6bb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:15.399320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3798243-4d3a-449e-9b50-d6887ba6bb8f admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:15.399653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3798243-4d3a-449e-9b50-d6887ba6bb8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:15.400264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3798243-4d3a-449e-9b50-d6887ba6bb8f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:15.427991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-45600216-7ef5-44a7-9f28-8d55a773d136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e61ca4e44174db58ae79d92a8de3458', 'request_id': 'req-45600216-7ef5-44a7-9f28-8d55a773d136'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:15.440120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-45600216-7ef5-44a7-9f28-8d55a773d136 admin admin] The token cache is being invalidate because project 2e61ca4e44174db58ae79d92a8de3458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:24:15.440411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-45600216-7ef5-44a7-9f28-8d55a773d136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:15.441121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-45600216-7ef5-44a7-9f28-8d55a773d136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:15.442774 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1493/2966] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:24:14 2022] DELETE /identity/v3/projects/2e61ca4e44174db58ae79d92a8de3458 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:15.446762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45600216-7ef5-44a7-9f28-8d55a773d136 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:15.448759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-45600216-7ef5-44a7-9f28-8d55a773d136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:15.539097 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1474/2967] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:24:15 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:15.543913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3798243-4d3a-449e-9b50-d6887ba6bb8f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:15.546904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f3798243-4d3a-449e-9b50-d6887ba6bb8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:15.579931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45600216-7ef5-44a7-9f28-8d55a773d136 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:15.581216 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3798243-4d3a-449e-9b50-d6887ba6bb8f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:15.594499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddbb3f-7ca9-4dc1-a2b0-9784211ae0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:15.596351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580e590-e781-448d-bba4-db9a06295dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:15.597333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580e590-e781-448d-bba4-db9a06295dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:15.597894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddbb3f-7ca9-4dc1-a2b0-9784211ae0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:15.605223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580e590-e781-448d-bba4-db9a06295dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:15.605223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580e590-e781-448d-bba4-db9a06295dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:15.605509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddbb3f-7ca9-4dc1-a2b0-9784211ae0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:15.605509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddbb3f-7ca9-4dc1-a2b0-9784211ae0d3 admin admin] PATH_INFO: `/v3/users/ba666f0a9b7b48908e27bd9648020824` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:15.605704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580e590-e781-448d-bba4-db9a06295dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:15.605795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ddbb3f-7ca9-4dc1-a2b0-9784211ae0d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba666f0a9b7b48908e27bd9648020824)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:15.606020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580e590-e781-448d-bba4-db9a06295dd0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:15.607973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ddbb3f-7ca9-4dc1-a2b0-9784211ae0d3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:15.638431 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1475/2968] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:15.644582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580e590-e781-448d-bba4-db9a06295dd0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:15.658498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580e590-e781-448d-bba4-db9a06295dd0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:15.664622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a99c9-a2b2-4bb1-96b8-35859dfafe3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:15.665641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a99c9-a2b2-4bb1-96b8-35859dfafe3e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:15.668392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a99c9-a2b2-4bb1-96b8-35859dfafe3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:15.668392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a99c9-a2b2-4bb1-96b8-35859dfafe3e admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:15.668392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a99c9-a2b2-4bb1-96b8-35859dfafe3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:15.668891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a99c9-a2b2-4bb1-96b8-35859dfafe3e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:15.679440 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1476/2969] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:15.683263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a99c9-a2b2-4bb1-96b8-35859dfafe3e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:15.693088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a99c9-a2b2-4bb1-96b8-35859dfafe3e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:15.697805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db70cde-3937-4a57-abcc-3d5e68a703e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:15.698724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db70cde-3937-4a57-abcc-3d5e68a703e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:15.699074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db70cde-3937-4a57-abcc-3d5e68a703e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:15.699498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db70cde-3937-4a57-abcc-3d5e68a703e7 admin admin] PATH_INFO: `/v3/projects/1ab612a661a049a38f1ec4ab8db19b0f/users/9814ecdf047a462da6b347ebb1a80226/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:15.714800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db70cde-3937-4a57-abcc-3d5e68a703e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab612a661a049a38f1ec4ab8db19b0f, user_id=9814ecdf047a462da6b347ebb1a80226, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:15.718185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db70cde-3937-4a57-abcc-3d5e68a703e7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:15.828957 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1477/2970] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:24:15 2022] PUT /identity/v3/projects/1ab612a661a049a38f1ec4ab8db19b0f/users/9814ecdf047a462da6b347ebb1a80226/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:15.834047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaefad3-4fae-4985-a5ee-464c66527cf8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:15.835028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaefad3-4fae-4985-a5ee-464c66527cf8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:15.835495 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaefad3-4fae-4985-a5ee-464c66527cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:15.845898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-12ddbb3f-7ca9-4dc1-a2b0-9784211ae0d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba666f0a9b7b48908e27bd9648020824'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:15.860023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-12ddbb3f-7ca9-4dc1-a2b0-9784211ae0d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba666f0a9b7b48908e27bd9648020824'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:15.860959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-12ddbb3f-7ca9-4dc1-a2b0-9784211ae0d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba666f0a9b7b48908e27bd9648020824'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:15.870519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-12ddbb3f-7ca9-4dc1-a2b0-9784211ae0d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba666f0a9b7b48908e27bd9648020824'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:15.877041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8aaefad3-4fae-4985-a5ee-464c66527cf8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:15.878267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8aaefad3-4fae-4985-a5ee-464c66527cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:15.996804 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1478/2971] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:16.054742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaefad3-4fae-4985-a5ee-464c66527cf8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:16.056175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8aaefad3-4fae-4985-a5ee-464c66527cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:16.082761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-12ddbb3f-7ca9-4dc1-a2b0-9784211ae0d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba666f0a9b7b48908e27bd9648020824'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:16.089954 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1494/2972] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:24:15 2022] DELETE /identity/v3/users/ba666f0a9b7b48908e27bd9648020824 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:24:16.136513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaefad3-4fae-4985-a5ee-464c66527cf8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:16.251317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586da72-3495-43d1-8300-76ab016e803b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:16.252285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586da72-3495-43d1-8300-76ab016e803b service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:16.252285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586da72-3495-43d1-8300-76ab016e803b service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:16.252586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586da72-3495-43d1-8300-76ab016e803b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:16.254471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0586da72-3495-43d1-8300-76ab016e803b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:16.331075 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586da72-3495-43d1-8300-76ab016e803b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:16.332511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586da72-3495-43d1-8300-76ab016e803b service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:16.343006 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1479/2973] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:24:16.796279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddbb3f-7ca9-4dc1-a2b0-9784211ae0d3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:16.798011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-12ddbb3f-7ca9-4dc1-a2b0-9784211ae0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:16.828736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddbb3f-7ca9-4dc1-a2b0-9784211ae0d3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:16.843761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe01c59-af7a-49d1-8123-6046b13057c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:16.844717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe01c59-af7a-49d1-8123-6046b13057c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:16.844996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe01c59-af7a-49d1-8123-6046b13057c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:16.845270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe01c59-af7a-49d1-8123-6046b13057c9 admin admin] PATH_INFO: `/v3/projects/e936ab75ffa14873a9294543700627a4` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:16.846681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe01c59-af7a-49d1-8123-6046b13057c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e936ab75ffa14873a9294543700627a4)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:16.848864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe01c59-af7a-49d1-8123-6046b13057c9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:17.046113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bfe01c59-af7a-49d1-8123-6046b13057c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e936ab75ffa14873a9294543700627a4', 'request_id': 'req-bfe01c59-af7a-49d1-8123-6046b13057c9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:17.052426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bfe01c59-af7a-49d1-8123-6046b13057c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e936ab75ffa14873a9294543700627a4', 'request_id': 'req-bfe01c59-af7a-49d1-8123-6046b13057c9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:17.178519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bfe01c59-af7a-49d1-8123-6046b13057c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e936ab75ffa14873a9294543700627a4', 'request_id': 'req-bfe01c59-af7a-49d1-8123-6046b13057c9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:17.189692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bfe01c59-af7a-49d1-8123-6046b13057c9 admin admin] The token cache is being invalidate because project e936ab75ffa14873a9294543700627a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:24:17.189986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bfe01c59-af7a-49d1-8123-6046b13057c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:17.190595 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bfe01c59-af7a-49d1-8123-6046b13057c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:17.194978 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1495/2974] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:24:16 2022] DELETE /identity/v3/projects/e936ab75ffa14873a9294543700627a4 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:17.200373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac9ee7-412d-4420-ab62-bc7b8dd80234 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:17.202673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac9ee7-412d-4420-ab62-bc7b8dd80234 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:17.202673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac9ee7-412d-4420-ab62-bc7b8dd80234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:17.220849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-06ac9ee7-412d-4420-ab62-bc7b8dd80234 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:17.222051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-06ac9ee7-412d-4420-ab62-bc7b8dd80234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:17.281718 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1480/2975] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:17.289717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b16044-2886-437c-ad2d-cae20c328b8f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:17.290012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b16044-2886-437c-ad2d-cae20c328b8f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:17.290295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b16044-2886-437c-ad2d-cae20c328b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:17.309251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a6b16044-2886-437c-ad2d-cae20c328b8f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:17.310477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a6b16044-2886-437c-ad2d-cae20c328b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:17.318458 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1496/2976] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:17.333698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac9ee7-412d-4420-ab62-bc7b8dd80234 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:17.357709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac9ee7-412d-4420-ab62-bc7b8dd80234 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:17.366183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68620be-3d23-4644-85db-07913e2e6ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:17.367706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68620be-3d23-4644-85db-07913e2e6ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:17.368202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68620be-3d23-4644-85db-07913e2e6ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:17.368792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68620be-3d23-4644-85db-07913e2e6ae9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:17.370385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68620be-3d23-4644-85db-07913e2e6ae9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:24:17.371417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68620be-3d23-4644-85db-07913e2e6ae9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:17.374094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68620be-3d23-4644-85db-07913e2e6ae9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:17.404757 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1481/2977] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:24:17.406000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b16044-2886-437c-ad2d-cae20c328b8f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:17.416043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b16044-2886-437c-ad2d-cae20c328b8f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:17.421168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567426e5-8478-4817-a13b-4d801c2b7ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:17.422378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567426e5-8478-4817-a13b-4d801c2b7ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:17.422853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567426e5-8478-4817-a13b-4d801c2b7ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:17.423269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567426e5-8478-4817-a13b-4d801c2b7ae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:17.424121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567426e5-8478-4817-a13b-4d801c2b7ae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:17.426474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567426e5-8478-4817-a13b-4d801c2b7ae5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:17.545576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68620be-3d23-4644-85db-07913e2e6ae9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:17.546648 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1497/2978] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:24:17 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:17.557381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68620be-3d23-4644-85db-07913e2e6ae9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:17.619237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dd81d-3f84-4b43-a916-b59c9d86400a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:17.619918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dd81d-3f84-4b43-a916-b59c9d86400a admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:17.620209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dd81d-3f84-4b43-a916-b59c9d86400a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:17.620516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dd81d-3f84-4b43-a916-b59c9d86400a admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:17.621269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0dd81d-3f84-4b43-a916-b59c9d86400a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:17.623480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0dd81d-3f84-4b43-a916-b59c9d86400a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:17.706159 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1482/2979] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:24:17 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:24:17.710106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567426e5-8478-4817-a13b-4d801c2b7ae5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:17.722019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567426e5-8478-4817-a13b-4d801c2b7ae5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:17.730401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68907f25-5df7-424e-a220-7f943a009199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:17.730401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68907f25-5df7-424e-a220-7f943a009199 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:17.730401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68907f25-5df7-424e-a220-7f943a009199 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:17.730401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68907f25-5df7-424e-a220-7f943a009199 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:17.730765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68907f25-5df7-424e-a220-7f943a009199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:17.731516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68907f25-5df7-424e-a220-7f943a009199 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:17.744933 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1498/2980] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:17.750820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dd81d-3f84-4b43-a916-b59c9d86400a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:17.769457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dd81d-3f84-4b43-a916-b59c9d86400a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:17.778414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67172d48-8a42-41d6-bd1a-a99b26c6d1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:17.782263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67172d48-8a42-41d6-bd1a-a99b26c6d1fe admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:17.782263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67172d48-8a42-41d6-bd1a-a99b26c6d1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:17.782263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67172d48-8a42-41d6-bd1a-a99b26c6d1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:17.782263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67172d48-8a42-41d6-bd1a-a99b26c6d1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:17.782912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67172d48-8a42-41d6-bd1a-a99b26c6d1fe admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:17.798483 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1483/2981] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:17.805186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68907f25-5df7-424e-a220-7f943a009199 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:17.817588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68907f25-5df7-424e-a220-7f943a009199 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:17.824220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2470b8f-6650-48dd-8f38-d58b2601590c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:17.825585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2470b8f-6650-48dd-8f38-d58b2601590c admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:17.826062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2470b8f-6650-48dd-8f38-d58b2601590c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:17.827708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2470b8f-6650-48dd-8f38-d58b2601590c admin admin] PATH_INFO: `/v3/projects/7c574b7f69574d07a15d94de1c32abff/users/cdea898da7874658a94a81629d03f5f1/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:17.857125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2470b8f-6650-48dd-8f38-d58b2601590c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c574b7f69574d07a15d94de1c32abff, user_id=cdea898da7874658a94a81629d03f5f1, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:17.861877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2470b8f-6650-48dd-8f38-d58b2601590c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:17.957129 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1499/2982] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:24:17 2022] PUT /identity/v3/projects/7c574b7f69574d07a15d94de1c32abff/users/cdea898da7874658a94a81629d03f5f1/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:17.968489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcefd50-1dd3-4ac4-af9d-9b191769e08b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:17.968797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcefd50-1dd3-4ac4-af9d-9b191769e08b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:17.969020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcefd50-1dd3-4ac4-af9d-9b191769e08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:18.028096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fdcefd50-1dd3-4ac4-af9d-9b191769e08b None None] MFA Rules not processed for user `cdea898da7874658a94a81629d03f5f1`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:18.029429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fdcefd50-1dd3-4ac4-af9d-9b191769e08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:18.097087 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1484/2983] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:18.117670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2470b8f-6650-48dd-8f38-d58b2601590c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:18.236204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2470b8f-6650-48dd-8f38-d58b2601590c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:18.245397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd72c88-df90-4c3f-b6e1-d1b22a0d6ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:18.246134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd72c88-df90-4c3f-b6e1-d1b22a0d6ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:18.246615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd72c88-df90-4c3f-b6e1-d1b22a0d6ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:18.247048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd72c88-df90-4c3f-b6e1-d1b22a0d6ed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:18.247943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd72c88-df90-4c3f-b6e1-d1b22a0d6ed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:18.265775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd72c88-df90-4c3f-b6e1-d1b22a0d6ed4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:18.275322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d6d20-c52f-4506-917d-b4b746b906d5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:18.275896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d6d20-c52f-4506-917d-b4b746b906d5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:18.275896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d6d20-c52f-4506-917d-b4b746b906d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:18.311425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-121d6d20-c52f-4506-917d-b4b746b906d5 None None] MFA Rules not processed for user `9814ecdf047a462da6b347ebb1a80226`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:18.312823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-121d6d20-c52f-4506-917d-b4b746b906d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:18.372724 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1500/2984] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:24:18 2022] POST /identity/v3/projects => generated 377 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:18.375191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd72c88-df90-4c3f-b6e1-d1b22a0d6ed4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:18.393554 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1485/2985] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:24:18.477208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd72c88-df90-4c3f-b6e1-d1b22a0d6ed4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:18.483036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36def4b6-5dd2-49f2-81ce-a5cd9b214130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:18.483036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36def4b6-5dd2-49f2-81ce-a5cd9b214130 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:18.483376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36def4b6-5dd2-49f2-81ce-a5cd9b214130 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:18.483715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36def4b6-5dd2-49f2-81ce-a5cd9b214130 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:18.484452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36def4b6-5dd2-49f2-81ce-a5cd9b214130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:18.486491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36def4b6-5dd2-49f2-81ce-a5cd9b214130 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:18.569245 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1501/2986] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:24:18 2022] POST /identity/v3/users => generated 295 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:24:18.573362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d6d20-c52f-4506-917d-b4b746b906d5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:18.604529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d6d20-c52f-4506-917d-b4b746b906d5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:18.618796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544c8fc-35f1-446b-9e78-fa4a662f9ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:18.619746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544c8fc-35f1-446b-9e78-fa4a662f9ceb admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:18.621276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544c8fc-35f1-446b-9e78-fa4a662f9ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:18.621276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544c8fc-35f1-446b-9e78-fa4a662f9ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:18.621564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544c8fc-35f1-446b-9e78-fa4a662f9ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:18.628802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544c8fc-35f1-446b-9e78-fa4a662f9ceb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:18.647309 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1486/2987] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:18.657526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36def4b6-5dd2-49f2-81ce-a5cd9b214130 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:18.668004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36def4b6-5dd2-49f2-81ce-a5cd9b214130 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:18.673100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d7000-4506-4455-81c3-78d92f804433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:18.677184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d7000-4506-4455-81c3-78d92f804433 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:18.677184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d7000-4506-4455-81c3-78d92f804433 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:18.677184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d7000-4506-4455-81c3-78d92f804433 admin admin] PATH_INFO: `/v3/projects/c9bf110fe0c7476489bf63353c1c4073/users/90272f144e8c4736807cbb146631a090/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:18.689910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d7000-4506-4455-81c3-78d92f804433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9bf110fe0c7476489bf63353c1c4073, user_id=90272f144e8c4736807cbb146631a090, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:18.692592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d7000-4506-4455-81c3-78d92f804433 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:18.867873 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1502/2988] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:24:18 2022] PUT /identity/v3/projects/c9bf110fe0c7476489bf63353c1c4073/users/90272f144e8c4736807cbb146631a090/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:18.871998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544c8fc-35f1-446b-9e78-fa4a662f9ceb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:18.882873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544c8fc-35f1-446b-9e78-fa4a662f9ceb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:18.940498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098be41-fd3e-44a6-860b-755bbc9f632a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:18.941207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098be41-fd3e-44a6-860b-755bbc9f632a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:18.941486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098be41-fd3e-44a6-860b-755bbc9f632a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:18.941756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098be41-fd3e-44a6-860b-755bbc9f632a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:18.942472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098be41-fd3e-44a6-860b-755bbc9f632a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:18.944102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098be41-fd3e-44a6-860b-755bbc9f632a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:18.954651 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1487/2989] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:18.958722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d7000-4506-4455-81c3-78d92f804433 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:18.973988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d7000-4506-4455-81c3-78d92f804433 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:18.979394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a88f4e-12c5-4d5e-8d71-8751b0c462d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:18.980333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a88f4e-12c5-4d5e-8d71-8751b0c462d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:18.980662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a88f4e-12c5-4d5e-8d71-8751b0c462d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:18.980966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a88f4e-12c5-4d5e-8d71-8751b0c462d8 admin admin] PATH_INFO: `/v3/projects/c9bf110fe0c7476489bf63353c1c4073/users/90272f144e8c4736807cbb146631a090/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:18.983053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a88f4e-12c5-4d5e-8d71-8751b0c462d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9bf110fe0c7476489bf63353c1c4073, user_id=90272f144e8c4736807cbb146631a090, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:18.985997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a88f4e-12c5-4d5e-8d71-8751b0c462d8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:18.997303 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1503/2990] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:24:18 2022] PUT /identity/v3/projects/c9bf110fe0c7476489bf63353c1c4073/users/90272f144e8c4736807cbb146631a090/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:19.008902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea9c27-9f55-4043-9e5c-489287614fbe None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:19.013055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea9c27-9f55-4043-9e5c-489287614fbe None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:19.013055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea9c27-9f55-4043-9e5c-489287614fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:19.036389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1aea9c27-9f55-4043-9e5c-489287614fbe None None] MFA Rules not processed for user `90272f144e8c4736807cbb146631a090`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:19.037675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1aea9c27-9f55-4043-9e5c-489287614fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:19.136648 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1488/2991] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:19.148545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a88f4e-12c5-4d5e-8d71-8751b0c462d8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:19.150283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b6a88f4e-12c5-4d5e-8d71-8751b0c462d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:19.174246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea9c27-9f55-4043-9e5c-489287614fbe None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:19.175808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1aea9c27-9f55-4043-9e5c-489287614fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:19.251321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a88f4e-12c5-4d5e-8d71-8751b0c462d8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:19.254029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea9c27-9f55-4043-9e5c-489287614fbe None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:19.256952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426772b-52ce-41c6-b3f4-dcae4dad4cc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:19.257612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426772b-52ce-41c6-b3f4-dcae4dad4cc8 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:19.257880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426772b-52ce-41c6-b3f4-dcae4dad4cc8 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:19.258158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426772b-52ce-41c6-b3f4-dcae4dad4cc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:19.259411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123b2cf-fe28-4656-a73b-f5eeb2f1bd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:19.260383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123b2cf-fe28-4656-a73b-f5eeb2f1bd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:19.260802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123b2cf-fe28-4656-a73b-f5eeb2f1bd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:19.261196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123b2cf-fe28-4656-a73b-f5eeb2f1bd24 admin admin] PATH_INFO: `/v3/users/9814ecdf047a462da6b347ebb1a80226` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:19.262510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123b2cf-fe28-4656-a73b-f5eeb2f1bd24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9814ecdf047a462da6b347ebb1a80226)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:19.264621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123b2cf-fe28-4656-a73b-f5eeb2f1bd24 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:19.272956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426772b-52ce-41c6-b3f4-dcae4dad4cc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:19.272956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426772b-52ce-41c6-b3f4-dcae4dad4cc8 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:19.277613 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1504/2992] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:24:19.446182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426772b-52ce-41c6-b3f4-dcae4dad4cc8 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:19.458067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426772b-52ce-41c6-b3f4-dcae4dad4cc8 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:19.463277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7198ab-92fb-4640-a1af-ad00af6afd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:19.464391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7198ab-92fb-4640-a1af-ad00af6afd8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:19.464870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7198ab-92fb-4640-a1af-ad00af6afd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:19.465320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7198ab-92fb-4640-a1af-ad00af6afd8f admin admin] PATH_INFO: `/v3/users/cdea898da7874658a94a81629d03f5f1` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:19.467044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7198ab-92fb-4640-a1af-ad00af6afd8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdea898da7874658a94a81629d03f5f1)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:19.469242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7198ab-92fb-4640-a1af-ad00af6afd8f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:19.530547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e123b2cf-fe28-4656-a73b-f5eeb2f1bd24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9814ecdf047a462da6b347ebb1a80226'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:19.551740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e123b2cf-fe28-4656-a73b-f5eeb2f1bd24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9814ecdf047a462da6b347ebb1a80226'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:19.551740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e123b2cf-fe28-4656-a73b-f5eeb2f1bd24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9814ecdf047a462da6b347ebb1a80226'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:19.564419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e123b2cf-fe28-4656-a73b-f5eeb2f1bd24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9814ecdf047a462da6b347ebb1a80226'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:19.678856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e123b2cf-fe28-4656-a73b-f5eeb2f1bd24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9814ecdf047a462da6b347ebb1a80226'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:19.685648 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1489/2993] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:24:19 2022] DELETE /identity/v3/users/9814ecdf047a462da6b347ebb1a80226 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:24:19.718010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9d7198ab-92fb-4640-a1af-ad00af6afd8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdea898da7874658a94a81629d03f5f1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:19.739892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9d7198ab-92fb-4640-a1af-ad00af6afd8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdea898da7874658a94a81629d03f5f1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:19.740634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9d7198ab-92fb-4640-a1af-ad00af6afd8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdea898da7874658a94a81629d03f5f1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:19.747983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9d7198ab-92fb-4640-a1af-ad00af6afd8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdea898da7874658a94a81629d03f5f1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:19.847926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9d7198ab-92fb-4640-a1af-ad00af6afd8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdea898da7874658a94a81629d03f5f1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:19.856509 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1505/2994] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:24:19 2022] DELETE /identity/v3/users/cdea898da7874658a94a81629d03f5f1 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:19.863529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b503e-536f-46ce-83e8-19971e0ef561 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:19.864143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b503e-536f-46ce-83e8-19971e0ef561 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:19.864522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b503e-536f-46ce-83e8-19971e0ef561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:19.915464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-890b503e-536f-46ce-83e8-19971e0ef561 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:19.917158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-890b503e-536f-46ce-83e8-19971e0ef561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:20.042821 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1490/2995] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:20.053517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7198ab-92fb-4640-a1af-ad00af6afd8f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:20.055765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9d7198ab-92fb-4640-a1af-ad00af6afd8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:20.124272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b503e-536f-46ce-83e8-19971e0ef561 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:20.127667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-890b503e-536f-46ce-83e8-19971e0ef561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:20.154099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b503e-536f-46ce-83e8-19971e0ef561 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:20.166905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d68327-9b84-44f6-b6db-a49e3c45be88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:20.168787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d68327-9b84-44f6-b6db-a49e3c45be88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:20.171287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d68327-9b84-44f6-b6db-a49e3c45be88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:20.171675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d68327-9b84-44f6-b6db-a49e3c45be88 admin admin] PATH_INFO: `/v3/projects/1ab612a661a049a38f1ec4ab8db19b0f` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:20.175382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d68327-9b84-44f6-b6db-a49e3c45be88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ab612a661a049a38f1ec4ab8db19b0f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:20.183021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d68327-9b84-44f6-b6db-a49e3c45be88 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:20.199502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7198ab-92fb-4640-a1af-ad00af6afd8f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:20.211423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567c598-4b5b-4177-8d60-8dc528400b97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:20.214814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567c598-4b5b-4177-8d60-8dc528400b97 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:20.216168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567c598-4b5b-4177-8d60-8dc528400b97 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:20.216746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567c598-4b5b-4177-8d60-8dc528400b97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:20.238898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567c598-4b5b-4177-8d60-8dc528400b97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:20.238898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567c598-4b5b-4177-8d60-8dc528400b97 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:20.246573 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1506/2996] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:24:20.329634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d2d68327-9b84-44f6-b6db-a49e3c45be88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ab612a661a049a38f1ec4ab8db19b0f', 'request_id': 'req-d2d68327-9b84-44f6-b6db-a49e3c45be88'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:20.411546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d2d68327-9b84-44f6-b6db-a49e3c45be88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ab612a661a049a38f1ec4ab8db19b0f', 'request_id': 'req-d2d68327-9b84-44f6-b6db-a49e3c45be88'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:20.422721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d2d68327-9b84-44f6-b6db-a49e3c45be88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ab612a661a049a38f1ec4ab8db19b0f', 'request_id': 'req-d2d68327-9b84-44f6-b6db-a49e3c45be88'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:20.439670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d2d68327-9b84-44f6-b6db-a49e3c45be88 admin admin] The token cache is being invalidate because project 1ab612a661a049a38f1ec4ab8db19b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:24:20.439972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d2d68327-9b84-44f6-b6db-a49e3c45be88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:20.441529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d2d68327-9b84-44f6-b6db-a49e3c45be88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:20.454347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8606080-b80d-49fa-84e6-ac4aea96ece3 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:20.454650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8606080-b80d-49fa-84e6-ac4aea96ece3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:20.454954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8606080-b80d-49fa-84e6-ac4aea96ece3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:20.456314 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1491/2997] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:24:20 2022] DELETE /identity/v3/projects/1ab612a661a049a38f1ec4ab8db19b0f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:20.480836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b8606080-b80d-49fa-84e6-ac4aea96ece3 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:20.482041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b8606080-b80d-49fa-84e6-ac4aea96ece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:20.554561 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1507/2998] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:20.562607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee440e9-31c7-4b2a-aad4-4469238fcb61 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:20.563044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee440e9-31c7-4b2a-aad4-4469238fcb61 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:20.563163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee440e9-31c7-4b2a-aad4-4469238fcb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:20.584936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4ee440e9-31c7-4b2a-aad4-4469238fcb61 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:20.586559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4ee440e9-31c7-4b2a-aad4-4469238fcb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:20.595764 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1492/2999] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:20.600708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8606080-b80d-49fa-84e6-ac4aea96ece3 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:20.610909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8606080-b80d-49fa-84e6-ac4aea96ece3 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:20.615785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f91e03-6bb7-4627-9ffd-ddeea71de0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:20.616351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f91e03-6bb7-4627-9ffd-ddeea71de0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:20.616664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f91e03-6bb7-4627-9ffd-ddeea71de0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:20.616988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f91e03-6bb7-4627-9ffd-ddeea71de0b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:20.618017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f91e03-6bb7-4627-9ffd-ddeea71de0b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:24:20.618325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f91e03-6bb7-4627-9ffd-ddeea71de0b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:20.620125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f91e03-6bb7-4627-9ffd-ddeea71de0b5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:20.641031 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1508/3000] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:24:20.641495 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee440e9-31c7-4b2a-aad4-4469238fcb61 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:20.652764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee440e9-31c7-4b2a-aad4-4469238fcb61 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:20.658426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacad700-01e3-4b74-ae4e-0b970276e67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:20.659536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacad700-01e3-4b74-ae4e-0b970276e67a admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:20.660377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacad700-01e3-4b74-ae4e-0b970276e67a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:20.661334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacad700-01e3-4b74-ae4e-0b970276e67a admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:20.662258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacad700-01e3-4b74-ae4e-0b970276e67a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:20.664402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacad700-01e3-4b74-ae4e-0b970276e67a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:20.815381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f91e03-6bb7-4627-9ffd-ddeea71de0b5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:20.817827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-46f91e03-6bb7-4627-9ffd-ddeea71de0b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:20.833748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f91e03-6bb7-4627-9ffd-ddeea71de0b5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:20.839049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e03a3-7bcd-49af-a809-3d4a878c8035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:20.839906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e03a3-7bcd-49af-a809-3d4a878c8035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:20.840347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e03a3-7bcd-49af-a809-3d4a878c8035 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:20.840658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e03a3-7bcd-49af-a809-3d4a878c8035 admin admin] PATH_INFO: `/v3/projects/7c574b7f69574d07a15d94de1c32abff` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:20.841869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e03a3-7bcd-49af-a809-3d4a878c8035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c574b7f69574d07a15d94de1c32abff)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:20.844076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e03a3-7bcd-49af-a809-3d4a878c8035 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:20.844798 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1493/3001] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:24:20 2022] POST /identity/v3/projects => generated 365 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:24:20.849076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacad700-01e3-4b74-ae4e-0b970276e67a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:20.913576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacad700-01e3-4b74-ae4e-0b970276e67a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:20.918151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c934530-9580-4928-b659-d48e23a9b8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:20.918813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c934530-9580-4928-b659-d48e23a9b8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:20.919099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c934530-9580-4928-b659-d48e23a9b8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:20.919377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c934530-9580-4928-b659-d48e23a9b8e2 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:20.920060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c934530-9580-4928-b659-d48e23a9b8e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:20.922536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c934530-9580-4928-b659-d48e23a9b8e2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:20.960956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5b9e03a3-7bcd-49af-a809-3d4a878c8035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c574b7f69574d07a15d94de1c32abff', 'request_id': 'req-5b9e03a3-7bcd-49af-a809-3d4a878c8035'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:20.967522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5b9e03a3-7bcd-49af-a809-3d4a878c8035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c574b7f69574d07a15d94de1c32abff', 'request_id': 'req-5b9e03a3-7bcd-49af-a809-3d4a878c8035'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:21.024670 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1494/3002] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:24:20 2022] POST /identity/v3/users => generated 283 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:24:21.028803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c934530-9580-4928-b659-d48e23a9b8e2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:21.038413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c934530-9580-4928-b659-d48e23a9b8e2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:21.047703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5b9e03a3-7bcd-49af-a809-3d4a878c8035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c574b7f69574d07a15d94de1c32abff', 'request_id': 'req-5b9e03a3-7bcd-49af-a809-3d4a878c8035'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:21.058672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5b9e03a3-7bcd-49af-a809-3d4a878c8035 admin admin] The token cache is being invalidate because project 7c574b7f69574d07a15d94de1c32abff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:24:21.059290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5b9e03a3-7bcd-49af-a809-3d4a878c8035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:21.059594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5b9e03a3-7bcd-49af-a809-3d4a878c8035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:21.061860 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1509/3003] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:24:20 2022] DELETE /identity/v3/projects/7c574b7f69574d07a15d94de1c32abff => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:21.065641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e03a3-7bcd-49af-a809-3d4a878c8035 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:21.067108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5b9e03a3-7bcd-49af-a809-3d4a878c8035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:21.097447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84364a-90d2-4fa3-b479-ca0f4b932e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:21.098049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84364a-90d2-4fa3-b479-ca0f4b932e6b admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:21.098336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84364a-90d2-4fa3-b479-ca0f4b932e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:21.098747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84364a-90d2-4fa3-b479-ca0f4b932e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:21.099493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84364a-90d2-4fa3-b479-ca0f4b932e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:21.101244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84364a-90d2-4fa3-b479-ca0f4b932e6b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:21.115235 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1495/3004] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:24:21.116707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84364a-90d2-4fa3-b479-ca0f4b932e6b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:21.119361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-cd84364a-90d2-4fa3-b479-ca0f4b932e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:21.133125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84364a-90d2-4fa3-b479-ca0f4b932e6b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:21.138176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6166e-1d3f-416c-b75e-981977cb994b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:21.138840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6166e-1d3f-416c-b75e-981977cb994b admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:21.139168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6166e-1d3f-416c-b75e-981977cb994b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:21.139436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6166e-1d3f-416c-b75e-981977cb994b admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:21.140161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6166e-1d3f-416c-b75e-981977cb994b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:21.142095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6166e-1d3f-416c-b75e-981977cb994b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:21.145832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e03a3-7bcd-49af-a809-3d4a878c8035 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:21.150731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ec894-03b5-4b76-a34e-98fad8b2be9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:21.151742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ec894-03b5-4b76-a34e-98fad8b2be9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:21.152099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ec894-03b5-4b76-a34e-98fad8b2be9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:21.152443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ec894-03b5-4b76-a34e-98fad8b2be9a admin admin] PATH_INFO: `/v3/users/90272f144e8c4736807cbb146631a090` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:21.153739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ec894-03b5-4b76-a34e-98fad8b2be9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=90272f144e8c4736807cbb146631a090)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:21.158523 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1496/3005] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:24:21.158691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ec894-03b5-4b76-a34e-98fad8b2be9a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:21.159998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6166e-1d3f-416c-b75e-981977cb994b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:21.170018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6166e-1d3f-416c-b75e-981977cb994b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:21.176635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5b282-c40d-4e97-a92f-2878cb22197c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:21.176635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5b282-c40d-4e97-a92f-2878cb22197c admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:21.177063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5b282-c40d-4e97-a92f-2878cb22197c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:21.177442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5b282-c40d-4e97-a92f-2878cb22197c admin admin] PATH_INFO: `/v3/projects/c84f02990f1047059d0c84080e41ac69/users/9eedf3ca32c6439d9b4991968690fb3c/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:21.192624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5b282-c40d-4e97-a92f-2878cb22197c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c84f02990f1047059d0c84080e41ac69, user_id=9eedf3ca32c6439d9b4991968690fb3c, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:21.195371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5b282-c40d-4e97-a92f-2878cb22197c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:21.338850 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1497/3006] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:24:21 2022] PUT /identity/v3/projects/c84f02990f1047059d0c84080e41ac69/users/9eedf3ca32c6439d9b4991968690fb3c/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:24:21.357709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee706c-0fc1-45fb-a80d-55e05d28dccf None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:21.358501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee706c-0fc1-45fb-a80d-55e05d28dccf None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:21.358789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee706c-0fc1-45fb-a80d-55e05d28dccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:21.382462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-de7ec894-03b5-4b76-a34e-98fad8b2be9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90272f144e8c4736807cbb146631a090'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:21.384329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f9ee706c-0fc1-45fb-a80d-55e05d28dccf None None] MFA Rules not processed for user `9eedf3ca32c6439d9b4991968690fb3c`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:21.385585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f9ee706c-0fc1-45fb-a80d-55e05d28dccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:21.394552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-de7ec894-03b5-4b76-a34e-98fad8b2be9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90272f144e8c4736807cbb146631a090'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:21.400038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-de7ec894-03b5-4b76-a34e-98fad8b2be9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90272f144e8c4736807cbb146631a090'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:21.402030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-de7ec894-03b5-4b76-a34e-98fad8b2be9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90272f144e8c4736807cbb146631a090'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:21.449747 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1498/3007] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:24:21.454366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee706c-0fc1-45fb-a80d-55e05d28dccf None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:21.481544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-de7ec894-03b5-4b76-a34e-98fad8b2be9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90272f144e8c4736807cbb146631a090'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:21.488997 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1510/3008] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:24:21 2022] DELETE /identity/v3/users/90272f144e8c4736807cbb146631a090 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:24:21.541504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee706c-0fc1-45fb-a80d-55e05d28dccf None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:21.618375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57feee4-3cec-44db-9040-a5ca11130c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:21.618853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57feee4-3cec-44db-9040-a5ca11130c43 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:21.619035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57feee4-3cec-44db-9040-a5ca11130c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:21.619319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57feee4-3cec-44db-9040-a5ca11130c43 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:21.620015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57feee4-3cec-44db-9040-a5ca11130c43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:21.622196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57feee4-3cec-44db-9040-a5ca11130c43 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:21.785968 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1499/3009] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:24:21 2022] POST /identity/v3/projects => generated 367 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:21.789519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ec894-03b5-4b76-a34e-98fad8b2be9a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:21.790944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-de7ec894-03b5-4b76-a34e-98fad8b2be9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:21.821333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ec894-03b5-4b76-a34e-98fad8b2be9a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:21.890295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da298bd-421b-4ce6-9e9a-bd3d9d459bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:21.890295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da298bd-421b-4ce6-9e9a-bd3d9d459bdb admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:21.890295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da298bd-421b-4ce6-9e9a-bd3d9d459bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:21.890295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da298bd-421b-4ce6-9e9a-bd3d9d459bdb admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:21.890669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da298bd-421b-4ce6-9e9a-bd3d9d459bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:21.892269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da298bd-421b-4ce6-9e9a-bd3d9d459bdb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:21.978903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57feee4-3cec-44db-9040-a5ca11130c43 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:21.982481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d57feee4-3cec-44db-9040-a5ca11130c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:21.990673 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1511/3010] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:24:21 2022] POST /identity/v3/users => generated 290 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:21.995183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da298bd-421b-4ce6-9e9a-bd3d9d459bdb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:22.015862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da298bd-421b-4ce6-9e9a-bd3d9d459bdb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:22.019139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57feee4-3cec-44db-9040-a5ca11130c43 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:22.021498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d62c65-3ccb-43e9-95e6-840aed7f4291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:22.026404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d62c65-3ccb-43e9-95e6-840aed7f4291 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:22.026404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d62c65-3ccb-43e9-95e6-840aed7f4291 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:22.026404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d62c65-3ccb-43e9-95e6-840aed7f4291 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:22.026404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d62c65-3ccb-43e9-95e6-840aed7f4291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:22.029961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d62c65-3ccb-43e9-95e6-840aed7f4291 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:22.034802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a5aa2-3cde-4512-bc27-0087ceb1d5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:22.035974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a5aa2-3cde-4512-bc27-0087ceb1d5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:22.036510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a5aa2-3cde-4512-bc27-0087ceb1d5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:22.037889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a5aa2-3cde-4512-bc27-0087ceb1d5e7 admin admin] PATH_INFO: `/v3/projects/c9bf110fe0c7476489bf63353c1c4073` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:22.039354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a5aa2-3cde-4512-bc27-0087ceb1d5e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9bf110fe0c7476489bf63353c1c4073)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:22.041572 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1512/3011] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:22.044896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a5aa2-3cde-4512-bc27-0087ceb1d5e7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:22.046486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d62c65-3ccb-43e9-95e6-840aed7f4291 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:22.062312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d62c65-3ccb-43e9-95e6-840aed7f4291 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:22.070357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c46cf4-7423-4513-a362-29ef0b54a68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:22.071515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c46cf4-7423-4513-a362-29ef0b54a68e admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:22.071960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c46cf4-7423-4513-a362-29ef0b54a68e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:22.072591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c46cf4-7423-4513-a362-29ef0b54a68e admin admin] PATH_INFO: `/v3/projects/2f9ea8e1456b4bdfa19313b2d8241fd8/users/f31a9e308e33473c83df5a5db2f9718c/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:22.091987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c46cf4-7423-4513-a362-29ef0b54a68e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9ea8e1456b4bdfa19313b2d8241fd8, user_id=f31a9e308e33473c83df5a5db2f9718c, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:22.094871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c46cf4-7423-4513-a362-29ef0b54a68e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:22.269888 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1513/3012] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:24:22 2022] PUT /identity/v3/projects/2f9ea8e1456b4bdfa19313b2d8241fd8/users/f31a9e308e33473c83df5a5db2f9718c/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:24:22.273699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c46cf4-7423-4513-a362-29ef0b54a68e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:22.282326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-092a5aa2-3cde-4512-bc27-0087ceb1d5e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9bf110fe0c7476489bf63353c1c4073', 'request_id': 'req-092a5aa2-3cde-4512-bc27-0087ceb1d5e7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:22.347374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c46cf4-7423-4513-a362-29ef0b54a68e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:22.360488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-092a5aa2-3cde-4512-bc27-0087ceb1d5e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9bf110fe0c7476489bf63353c1c4073', 'request_id': 'req-092a5aa2-3cde-4512-bc27-0087ceb1d5e7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:22.372442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-092a5aa2-3cde-4512-bc27-0087ceb1d5e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9bf110fe0c7476489bf63353c1c4073', 'request_id': 'req-092a5aa2-3cde-4512-bc27-0087ceb1d5e7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:22.385861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-092a5aa2-3cde-4512-bc27-0087ceb1d5e7 admin admin] The token cache is being invalidate because project c9bf110fe0c7476489bf63353c1c4073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:24:22.386172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-092a5aa2-3cde-4512-bc27-0087ceb1d5e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:22.386794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-092a5aa2-3cde-4512-bc27-0087ceb1d5e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:22.389074 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1500/3013] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:24:21 2022] DELETE /identity/v3/projects/c9bf110fe0c7476489bf63353c1c4073 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:24:22.393824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a83250-a9b7-4bc6-83c9-a04ad8b01f64 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:22.394689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a83250-a9b7-4bc6-83c9-a04ad8b01f64 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:22.395241 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a83250-a9b7-4bc6-83c9-a04ad8b01f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:22.407110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d5f78-82fe-49bd-adae-3ca5ce1718c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:22.407954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d5f78-82fe-49bd-adae-3ca5ce1718c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:22.408091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d5f78-82fe-49bd-adae-3ca5ce1718c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:22.408344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d5f78-82fe-49bd-adae-3ca5ce1718c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:22.409133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d5f78-82fe-49bd-adae-3ca5ce1718c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:22.410892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d5f78-82fe-49bd-adae-3ca5ce1718c8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:22.415040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f3a83250-a9b7-4bc6-83c9-a04ad8b01f64 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:22.416525 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f3a83250-a9b7-4bc6-83c9-a04ad8b01f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:22.421311 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1514/3014] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:24:22.425657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d5f78-82fe-49bd-adae-3ca5ce1718c8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:22.427548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ef1d5f78-82fe-49bd-adae-3ca5ce1718c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:22.429133 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1501/3015] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:22.437906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed7c8e-2cbb-475f-92e5-df198ca60167 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:22.438339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed7c8e-2cbb-475f-92e5-df198ca60167 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:22.439210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed7c8e-2cbb-475f-92e5-df198ca60167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:22.441312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d5f78-82fe-49bd-adae-3ca5ce1718c8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:22.446134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c7d81-15e0-460f-a1cd-a5a49302e5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:22.447064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c7d81-15e0-460f-a1cd-a5a49302e5c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:22.447351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c7d81-15e0-460f-a1cd-a5a49302e5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:22.447631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c7d81-15e0-460f-a1cd-a5a49302e5c4 admin admin] PATH_INFO: `/v3/projects/2f9ea8e1456b4bdfa19313b2d8241fd8/users/f31a9e308e33473c83df5a5db2f9718c/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:22.449880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c7d81-15e0-460f-a1cd-a5a49302e5c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9ea8e1456b4bdfa19313b2d8241fd8, user_id=f31a9e308e33473c83df5a5db2f9718c, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:22.452657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c7d81-15e0-460f-a1cd-a5a49302e5c4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:22.463434 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1515/3016] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:24:22 2022] PUT /identity/v3/projects/2f9ea8e1456b4bdfa19313b2d8241fd8/users/f31a9e308e33473c83df5a5db2f9718c/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:22.470275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-dbed7c8e-2cbb-475f-92e5-df198ca60167 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:22.471781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dbed7c8e-2cbb-475f-92e5-df198ca60167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:22.474320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cc280-d04e-4c90-ae92-cfde25fb25ee None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:22.474692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cc280-d04e-4c90-ae92-cfde25fb25ee None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:22.475054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cc280-d04e-4c90-ae92-cfde25fb25ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:22.504721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4f6cc280-d04e-4c90-ae92-cfde25fb25ee None None] MFA Rules not processed for user `f31a9e308e33473c83df5a5db2f9718c`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:22.506070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4f6cc280-d04e-4c90-ae92-cfde25fb25ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:22.536547 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1502/3017] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:24:22.540799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed7c8e-2cbb-475f-92e5-df198ca60167 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:22.550433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed7c8e-2cbb-475f-92e5-df198ca60167 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:22.555271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d2a48-f79a-4bab-9a81-227f21b4ce81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:22.561559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d2a48-f79a-4bab-9a81-227f21b4ce81 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:22.561559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d2a48-f79a-4bab-9a81-227f21b4ce81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:22.561559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d2a48-f79a-4bab-9a81-227f21b4ce81 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:22.561559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d2a48-f79a-4bab-9a81-227f21b4ce81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:24:22.561559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d2a48-f79a-4bab-9a81-227f21b4ce81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:22.561559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d2a48-f79a-4bab-9a81-227f21b4ce81 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:22.576352 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1503/3018] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:24:22.577789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d2a48-f79a-4bab-9a81-227f21b4ce81 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:22.584056 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1516/3019] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:22 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:22.585168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cc280-d04e-4c90-ae92-cfde25fb25ee None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:22.589806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d2a48-f79a-4bab-9a81-227f21b4ce81 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:22.595467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148920a6-1e34-44bb-b266-89d454be583c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:22.596255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148920a6-1e34-44bb-b266-89d454be583c admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:22.596370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cc280-d04e-4c90-ae92-cfde25fb25ee None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:22.596548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148920a6-1e34-44bb-b266-89d454be583c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:22.596843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148920a6-1e34-44bb-b266-89d454be583c admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:22.597538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148920a6-1e34-44bb-b266-89d454be583c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:22.599562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148920a6-1e34-44bb-b266-89d454be583c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:22.602406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977e686-9dfe-423a-b719-e5160b96e9a8 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f31a9e308e33473c83df5a5db2f9718c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9ea8e1456b4bdfa19313b2d8241fd8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:22.603070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977e686-9dfe-423a-b719-e5160b96e9a8 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:22.603388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977e686-9dfe-423a-b719-e5160b96e9a8 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:22.603671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977e686-9dfe-423a-b719-e5160b96e9a8 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] PATH_INFO: `/v3/regions` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:22.604387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977e686-9dfe-423a-b719-e5160b96e9a8 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:22.606196 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-1977e686-9dfe-423a-b719-e5160b96e9a8 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:24:22.606196 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:24:22.606196 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:24:22.611270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977e686-9dfe-423a-b719-e5160b96e9a8 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:22.721361 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1504/3020] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:24:22 2022] POST /identity/v3/projects => generated 395 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:24:22.725497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148920a6-1e34-44bb-b266-89d454be583c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:22.748966 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1517/3021] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:24:22 2022] POST /identity/v3/regions => generated 224 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:22.750272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977e686-9dfe-423a-b719-e5160b96e9a8 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:22.772436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977e686-9dfe-423a-b719-e5160b96e9a8 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:22.786999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148920a6-1e34-44bb-b266-89d454be583c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:22.804887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287f639-9767-4661-b0c7-ab3e56396fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:22.804887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287f639-9767-4661-b0c7-ab3e56396fea admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:22.805222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287f639-9767-4661-b0c7-ab3e56396fea admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:22.805425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287f639-9767-4661-b0c7-ab3e56396fea admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:22.806609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287f639-9767-4661-b0c7-ab3e56396fea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:22.809344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287f639-9767-4661-b0c7-ab3e56396fea admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:22.849910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c0dd2-2441-4ad2-87ae-5e59450c87e2 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f31a9e308e33473c83df5a5db2f9718c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9ea8e1456b4bdfa19313b2d8241fd8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:22.850712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c0dd2-2441-4ad2-87ae-5e59450c87e2 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:22.852954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c0dd2-2441-4ad2-87ae-5e59450c87e2 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:22.853255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c0dd2-2441-4ad2-87ae-5e59450c87e2 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] PATH_INFO: `/v3/regions` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:22.854142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c0dd2-2441-4ad2-87ae-5e59450c87e2 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:22.855802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c0dd2-2441-4ad2-87ae-5e59450c87e2 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:22.955280 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1505/3022] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:24:22 2022] POST /identity/v3/users => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:24:22.956286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287f639-9767-4661-b0c7-ab3e56396fea admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:22.966070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287f639-9767-4661-b0c7-ab3e56396fea admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:22.972010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e79ec-d8aa-4d79-8457-86f82dd16813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:22.972755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e79ec-d8aa-4d79-8457-86f82dd16813 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:22.973042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e79ec-d8aa-4d79-8457-86f82dd16813 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:22.973713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e79ec-d8aa-4d79-8457-86f82dd16813 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:22.974047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e79ec-d8aa-4d79-8457-86f82dd16813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:22.975721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e79ec-d8aa-4d79-8457-86f82dd16813 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:22.986418 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1506/3023] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:22.990368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e79ec-d8aa-4d79-8457-86f82dd16813 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:23.001851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e79ec-d8aa-4d79-8457-86f82dd16813 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:23.009107 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1518/3024] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:24:22 2022] POST /identity/v3/regions => generated 224 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:24:23.017995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c0dd2-2441-4ad2-87ae-5e59450c87e2 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:23.032271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bf440-d763-46f6-b57e-6107c424b033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:23.033108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bf440-d763-46f6-b57e-6107c424b033 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:23.033565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bf440-d763-46f6-b57e-6107c424b033 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:23.033897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bf440-d763-46f6-b57e-6107c424b033 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:23.034894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054bf440-d763-46f6-b57e-6107c424b033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:23.037536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054bf440-d763-46f6-b57e-6107c424b033 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:23.041343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c0dd2-2441-4ad2-87ae-5e59450c87e2 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:23.047340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b90f97-9bad-4022-9bab-c8c5b796967a tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f31a9e308e33473c83df5a5db2f9718c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9ea8e1456b4bdfa19313b2d8241fd8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:23.048363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b90f97-9bad-4022-9bab-c8c5b796967a tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:23.048690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b90f97-9bad-4022-9bab-c8c5b796967a tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:23.048993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b90f97-9bad-4022-9bab-c8c5b796967a tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] PATH_INFO: `/v3/regions/94042ce8-b45a-422b-84df-aac763c2b80d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:23.049713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b90f97-9bad-4022-9bab-c8c5b796967a tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorizing `identity:create_region(region_id=94042ce8-b45a-422b-84df-aac763c2b80d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:23.051763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b90f97-9bad-4022-9bab-c8c5b796967a tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:23.066115 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1507/3025] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:24:23.070243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bf440-d763-46f6-b57e-6107c424b033 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:23.081673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bf440-d763-46f6-b57e-6107c424b033 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:23.086543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6362a8-8717-431b-9066-45872fb305e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:23.087420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6362a8-8717-431b-9066-45872fb305e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:23.087699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6362a8-8717-431b-9066-45872fb305e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:23.087974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6362a8-8717-431b-9066-45872fb305e6 admin admin] PATH_INFO: `/v3/projects/bb31dc76a4c24164becf90f8b970adc2/users/2856471176174dd7a2465a816eef3acc/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:23.112869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6362a8-8717-431b-9066-45872fb305e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb31dc76a4c24164becf90f8b970adc2, user_id=2856471176174dd7a2465a816eef3acc, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:23.116022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6362a8-8717-431b-9066-45872fb305e6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:23.131788 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1519/3026] 10.222.0.16 () {60 vars in 1258 bytes} [Mon May 2 10:24:23 2022] PUT /identity/v3/regions/94042ce8-b45a-422b-84df-aac763c2b80d => generated 231 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:23.133319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b90f97-9bad-4022-9bab-c8c5b796967a tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:23.156187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b90f97-9bad-4022-9bab-c8c5b796967a tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:23.161605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25cc58-9344-4a8b-ae3e-9a74dcd933d5 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f31a9e308e33473c83df5a5db2f9718c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9ea8e1456b4bdfa19313b2d8241fd8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:23.162551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25cc58-9344-4a8b-ae3e-9a74dcd933d5 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:23.162899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25cc58-9344-4a8b-ae3e-9a74dcd933d5 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:23.163237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25cc58-9344-4a8b-ae3e-9a74dcd933d5 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] PATH_INFO: `/v3/regions/94042ce8-b45a-422b-84df-aac763c2b80d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:23.163957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25cc58-9344-4a8b-ae3e-9a74dcd933d5 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorizing `identity:delete_region(region_id=94042ce8-b45a-422b-84df-aac763c2b80d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:23.165087 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-3b25cc58-9344-4a8b-ae3e-9a74dcd933d5 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:24:23.165087 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:24:23.165087 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:24:23.165978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25cc58-9344-4a8b-ae3e-9a74dcd933d5 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:23.226514 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1508/3027] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:24:23 2022] PUT /identity/v3/projects/bb31dc76a4c24164becf90f8b970adc2/users/2856471176174dd7a2465a816eef3acc/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:24:23.231648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f64aa1-8c7b-4c2c-bd73-abb6d5dfe989 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:23.231946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f64aa1-8c7b-4c2c-bd73-abb6d5dfe989 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:23.232233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f64aa1-8c7b-4c2c-bd73-abb6d5dfe989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:23.249656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a6f64aa1-8c7b-4c2c-bd73-abb6d5dfe989 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:23.250864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a6f64aa1-8c7b-4c2c-bd73-abb6d5dfe989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:23.316727 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1509/3028] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:24:23.326414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f64aa1-8c7b-4c2c-bd73-abb6d5dfe989 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:23.328244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a6f64aa1-8c7b-4c2c-bd73-abb6d5dfe989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:23.354745 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1520/3029] 10.222.0.16 () {58 vars in 1241 bytes} [Mon May 2 10:24:23 2022] DELETE /identity/v3/regions/94042ce8-b45a-422b-84df-aac763c2b80d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:23.359690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25cc58-9344-4a8b-ae3e-9a74dcd933d5 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:23.382937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25cc58-9344-4a8b-ae3e-9a74dcd933d5 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:23.399429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f64aa1-8c7b-4c2c-bd73-abb6d5dfe989 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:23.413846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82828d1-b487-4b5b-ac41-73bb1ca63d83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:23.414701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82828d1-b487-4b5b-ac41-73bb1ca63d83 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:23.414989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82828d1-b487-4b5b-ac41-73bb1ca63d83 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:23.415293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82828d1-b487-4b5b-ac41-73bb1ca63d83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:23.424555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82828d1-b487-4b5b-ac41-73bb1ca63d83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:23.426022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82828d1-b487-4b5b-ac41-73bb1ca63d83 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:23.439333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd483d-5570-4167-8449-9ce3df412256 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f31a9e308e33473c83df5a5db2f9718c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9ea8e1456b4bdfa19313b2d8241fd8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:23.440213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd483d-5570-4167-8449-9ce3df412256 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:23.440352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd483d-5570-4167-8449-9ce3df412256 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:23.440562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd483d-5570-4167-8449-9ce3df412256 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] PATH_INFO: `/v3/regions` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:23.441319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd483d-5570-4167-8449-9ce3df412256 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:23.443067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd483d-5570-4167-8449-9ce3df412256 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:23.445597 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1510/3030] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:24:23.566229 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1521/3031] 10.222.0.16 () {60 vars in 1149 bytes} [Mon May 2 10:24:23 2022] POST /identity/v3/regions => generated 253 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:23.570429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82828d1-b487-4b5b-ac41-73bb1ca63d83 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:23.581974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82828d1-b487-4b5b-ac41-73bb1ca63d83 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:23.608121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb677587-ccfa-4c5f-929f-6d9b5ceff400 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f31a9e308e33473c83df5a5db2f9718c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9ea8e1456b4bdfa19313b2d8241fd8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:23.609136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb677587-ccfa-4c5f-929f-6d9b5ceff400 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:23.613953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb677587-ccfa-4c5f-929f-6d9b5ceff400 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:23.613953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb677587-ccfa-4c5f-929f-6d9b5ceff400 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] PATH_INFO: `/v3/regions/9fdb996316924b08a5532696e1518ec6` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:23.613953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb677587-ccfa-4c5f-929f-6d9b5ceff400 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorizing `identity:update_region(region_id=9fdb996316924b08a5532696e1518ec6)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:23.613953 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-eb677587-ccfa-4c5f-929f-6d9b5ceff400 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:24:23.613953 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:24:23.613953 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:24:23.614928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb677587-ccfa-4c5f-929f-6d9b5ceff400 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:23.720280 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1511/3032] 10.222.0.16 () {60 vars in 1249 bytes} [Mon May 2 10:24:23 2022] PATCH /identity/v3/regions/9fdb996316924b08a5532696e1518ec6 => generated 254 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:24:23.724373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd483d-5570-4167-8449-9ce3df412256 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:23.735677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd483d-5570-4167-8449-9ce3df412256 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:23.751303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbf19c-a606-49c0-9223-c93d7a9f43d2 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f31a9e308e33473c83df5a5db2f9718c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9ea8e1456b4bdfa19313b2d8241fd8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:23.752122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbf19c-a606-49c0-9223-c93d7a9f43d2 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:23.752461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbf19c-a606-49c0-9223-c93d7a9f43d2 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:23.752774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbf19c-a606-49c0-9223-c93d7a9f43d2 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] PATH_INFO: `/v3/regions/9fdb996316924b08a5532696e1518ec6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:23.753418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbf19c-a606-49c0-9223-c93d7a9f43d2 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorizing `identity:get_region(region_id=9fdb996316924b08a5532696e1518ec6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:23.754486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbf19c-a606-49c0-9223-c93d7a9f43d2 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:23.760171 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1522/3033] 10.222.0.16 () {58 vars in 1226 bytes} [Mon May 2 10:24:23 2022] GET /identity/v3/regions/9fdb996316924b08a5532696e1518ec6 => generated 254 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:24:23.764634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb677587-ccfa-4c5f-929f-6d9b5ceff400 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:23.775495 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb677587-ccfa-4c5f-929f-6d9b5ceff400 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:23.780614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e6ef5-4362-42a9-86b4-fbadfa810fdd tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f31a9e308e33473c83df5a5db2f9718c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9ea8e1456b4bdfa19313b2d8241fd8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:23.784275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e6ef5-4362-42a9-86b4-fbadfa810fdd tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:23.784275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e6ef5-4362-42a9-86b4-fbadfa810fdd tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:23.784275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e6ef5-4362-42a9-86b4-fbadfa810fdd tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] PATH_INFO: `/v3/regions/9fdb996316924b08a5532696e1518ec6` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:23.784275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e6ef5-4362-42a9-86b4-fbadfa810fdd tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorizing `identity:delete_region(region_id=9fdb996316924b08a5532696e1518ec6)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:23.784786 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-b05e6ef5-4362-42a9-86b4-fbadfa810fdd tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:24:23.784786 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:24:23.784786 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:24:23.784786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e6ef5-4362-42a9-86b4-fbadfa810fdd tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:23.883480 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1512/3034] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:24:23 2022] DELETE /identity/v3/regions/9fdb996316924b08a5532696e1518ec6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:24:23.887396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbf19c-a606-49c0-9223-c93d7a9f43d2 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:23.902760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbf19c-a606-49c0-9223-c93d7a9f43d2 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:23.919939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fb55c-d7ca-489f-8716-7de969760a7a tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f31a9e308e33473c83df5a5db2f9718c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9ea8e1456b4bdfa19313b2d8241fd8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:23.919939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fb55c-d7ca-489f-8716-7de969760a7a tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:23.919939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fb55c-d7ca-489f-8716-7de969760a7a tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:23.924932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fb55c-d7ca-489f-8716-7de969760a7a tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] PATH_INFO: `/v3/regions` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:23.924932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fb55c-d7ca-489f-8716-7de969760a7a tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:23.924932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fb55c-d7ca-489f-8716-7de969760a7a tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:23.933363 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1523/3035] 10.222.0.16 () {58 vars in 1127 bytes} [Mon May 2 10:24:23 2022] GET /identity/v3/regions => generated 670 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:24:23.938216 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e6ef5-4362-42a9-86b4-fbadfa810fdd tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:23.954335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e6ef5-4362-42a9-86b4-fbadfa810fdd tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:23.963807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa0a08-460d-4d35-aad0-61409dfec273 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f31a9e308e33473c83df5a5db2f9718c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9ea8e1456b4bdfa19313b2d8241fd8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:23.965054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa0a08-460d-4d35-aad0-61409dfec273 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:23.965380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa0a08-460d-4d35-aad0-61409dfec273 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:23.965989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa0a08-460d-4d35-aad0-61409dfec273 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] PATH_INFO: `/v3/regions/9fdb996316924b08a5532696e1518ec6` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:23.966760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa0a08-460d-4d35-aad0-61409dfec273 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorizing `identity:delete_region(region_id=9fdb996316924b08a5532696e1518ec6)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:23.968429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa0a08-460d-4d35-aad0-61409dfec273 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:23.988099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-28aa0a08-460d-4d35-aad0-61409dfec273 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Could not find region: 9fdb996316924b08a5532696e1518ec6.: keystone.exception.RegionNotFound: Could not find region: 9fdb996316924b08a5532696e1518ec6. May 02 10:24:23.988099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:24:23.988099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region May 02 10:24:23.988099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) May 02 10:24:23.988099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region May 02 10:24:23.988099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) May 02 10:24:23.988099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region May 02 10:24:23.988099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) May 02 10:24:23.988099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 9fdb996316924b08a5532696e1518ec6. May 02 10:24:23.988099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:24:23.988099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:24:23.988099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:24:23.988099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:24:23.988099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:24:23.988099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:24:23.988099 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:24:23.989280 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:24:23.989280 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:24:23.989280 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:24:23.989280 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:24:23.989280 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:24:23.989280 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:24:23.989280 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:24:23.989280 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete May 02 10:24:23.989280 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( May 02 10:24:23.989280 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:24:23.989280 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:24:23.989280 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region May 02 10:24:23.989280 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) May 02 10:24:23.989280 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 9fdb996316924b08a5532696e1518ec6. May 02 10:24:23.989280 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:24:23.992779 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1513/3036] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:24:23 2022] DELETE /identity/v3/regions/9fdb996316924b08a5532696e1518ec6 => generated 112 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:24:23.994585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fb55c-d7ca-489f-8716-7de969760a7a tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:24.005670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fb55c-d7ca-489f-8716-7de969760a7a tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:24.010507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd0705-0fb8-41a1-b184-85b47adf23a8 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f31a9e308e33473c83df5a5db2f9718c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9ea8e1456b4bdfa19313b2d8241fd8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:24.011412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd0705-0fb8-41a1-b184-85b47adf23a8 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:24.011696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd0705-0fb8-41a1-b184-85b47adf23a8 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:24.011973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd0705-0fb8-41a1-b184-85b47adf23a8 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] PATH_INFO: `/v3/regions` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:24.012676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd0705-0fb8-41a1-b184-85b47adf23a8 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:24.013808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd0705-0fb8-41a1-b184-85b47adf23a8 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:24.019426 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1524/3037] 10.222.0.16 () {58 vars in 1127 bytes} [Mon May 2 10:24:23 2022] GET /identity/v3/regions => generated 670 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:24:24.024515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa0a08-460d-4d35-aad0-61409dfec273 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:24.035065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa0a08-460d-4d35-aad0-61409dfec273 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:24.039793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72124e1f-dbed-4c89-b065-f973b0d1f77b tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f31a9e308e33473c83df5a5db2f9718c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9ea8e1456b4bdfa19313b2d8241fd8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:24.040452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72124e1f-dbed-4c89-b065-f973b0d1f77b tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:24.040772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72124e1f-dbed-4c89-b065-f973b0d1f77b tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:24.041050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72124e1f-dbed-4c89-b065-f973b0d1f77b tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] PATH_INFO: `/v3/regions` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:24.041798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72124e1f-dbed-4c89-b065-f973b0d1f77b tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:24.042869 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-72124e1f-dbed-4c89-b065-f973b0d1f77b tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:24:24.042869 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:24:24.042869 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:24:24.043680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72124e1f-dbed-4c89-b065-f973b0d1f77b tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:24.142837 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1514/3038] 10.222.0.16 () {60 vars in 1149 bytes} [Mon May 2 10:24:24 2022] POST /identity/v3/regions => generated 254 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:24.144024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd0705-0fb8-41a1-b184-85b47adf23a8 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:24.154290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd0705-0fb8-41a1-b184-85b47adf23a8 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:24.171791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c0b90-38e1-4853-878b-7d5f51126e84 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f31a9e308e33473c83df5a5db2f9718c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9ea8e1456b4bdfa19313b2d8241fd8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:24.172585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c0b90-38e1-4853-878b-7d5f51126e84 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:24.173024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c0b90-38e1-4853-878b-7d5f51126e84 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:24.173403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c0b90-38e1-4853-878b-7d5f51126e84 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] PATH_INFO: `/v3/regions` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:24.174188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c0b90-38e1-4853-878b-7d5f51126e84 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Adding query filter params (parent_region_id=2d458f25e4ea44e4bb1af7954a518bfa) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:24:24.174574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c0b90-38e1-4853-878b-7d5f51126e84 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:24.175751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c0b90-38e1-4853-878b-7d5f51126e84 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:24.181327 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1525/3039] 10.222.0.16 () {58 vars in 1226 bytes} [Mon May 2 10:24:24 2022] GET /identity/v3/regions?parent_region_id=2d458f25e4ea44e4bb1af7954a518bfa => generated 400 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:24:24.186562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72124e1f-dbed-4c89-b065-f973b0d1f77b tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:24.197323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72124e1f-dbed-4c89-b065-f973b0d1f77b tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:24.206353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b68f5e-e393-40ca-b2ff-912777d4f6da tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f31a9e308e33473c83df5a5db2f9718c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9ea8e1456b4bdfa19313b2d8241fd8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:24.207353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b68f5e-e393-40ca-b2ff-912777d4f6da tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:24.207751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b68f5e-e393-40ca-b2ff-912777d4f6da tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:24.208132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b68f5e-e393-40ca-b2ff-912777d4f6da tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] PATH_INFO: `/v3/regions/a42922ab07a9477bafdf480d9ed6c098` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:24.209004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b68f5e-e393-40ca-b2ff-912777d4f6da tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorizing `identity:delete_region(region_id=a42922ab07a9477bafdf480d9ed6c098)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:24.210877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b68f5e-e393-40ca-b2ff-912777d4f6da tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:24.322073 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1515/3040] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:24:24 2022] DELETE /identity/v3/regions/a42922ab07a9477bafdf480d9ed6c098 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:24.327032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c0b90-38e1-4853-878b-7d5f51126e84 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:24.337007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c0b90-38e1-4853-878b-7d5f51126e84 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:24.358538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e5928-5e8c-4208-bbef-6ec4f650cb43 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f31a9e308e33473c83df5a5db2f9718c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9ea8e1456b4bdfa19313b2d8241fd8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:24.360349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e5928-5e8c-4208-bbef-6ec4f650cb43 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:24.360733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e5928-5e8c-4208-bbef-6ec4f650cb43 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:24.360967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e5928-5e8c-4208-bbef-6ec4f650cb43 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] PATH_INFO: `/v3/regions/4eec6640bc5d4965b3da2cb2e5624b12` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:24.361993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e5928-5e8c-4208-bbef-6ec4f650cb43 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorizing `identity:delete_region(region_id=4eec6640bc5d4965b3da2cb2e5624b12)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:24.363624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e5928-5e8c-4208-bbef-6ec4f650cb43 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:24.484365 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1526/3041] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:24:24 2022] DELETE /identity/v3/regions/4eec6640bc5d4965b3da2cb2e5624b12 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:24.488369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b68f5e-e393-40ca-b2ff-912777d4f6da tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:24.500868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b68f5e-e393-40ca-b2ff-912777d4f6da tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:24.523365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf237829-6741-4976-ad67-66115175e777 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f31a9e308e33473c83df5a5db2f9718c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9ea8e1456b4bdfa19313b2d8241fd8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:24.524567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf237829-6741-4976-ad67-66115175e777 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:24.525076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf237829-6741-4976-ad67-66115175e777 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:24.525541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf237829-6741-4976-ad67-66115175e777 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] PATH_INFO: `/v3/regions/2d458f25e4ea44e4bb1af7954a518bfa` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:24.526529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf237829-6741-4976-ad67-66115175e777 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorizing `identity:delete_region(region_id=2d458f25e4ea44e4bb1af7954a518bfa)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:24.528825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf237829-6741-4976-ad67-66115175e777 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:24.642130 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1516/3042] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:24:24 2022] DELETE /identity/v3/regions/2d458f25e4ea44e4bb1af7954a518bfa => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:24.646137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e5928-5e8c-4208-bbef-6ec4f650cb43 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:24.667985 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e5928-5e8c-4208-bbef-6ec4f650cb43 tempest-RegionsTestJSON-1549948704 tempest-RegionsTestJSON-1549948704-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:24.684485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1957ee-df3b-4ada-9546-4745de7e17b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:24.685429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1957ee-df3b-4ada-9546-4745de7e17b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:24.688643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1957ee-df3b-4ada-9546-4745de7e17b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:24.688643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1957ee-df3b-4ada-9546-4745de7e17b9 admin admin] PATH_INFO: `/v3/users/9eedf3ca32c6439d9b4991968690fb3c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:24.693445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1957ee-df3b-4ada-9546-4745de7e17b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eedf3ca32c6439d9b4991968690fb3c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:24.696281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1957ee-df3b-4ada-9546-4745de7e17b9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:24.978971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0e1957ee-df3b-4ada-9546-4745de7e17b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eedf3ca32c6439d9b4991968690fb3c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:24.990974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0e1957ee-df3b-4ada-9546-4745de7e17b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eedf3ca32c6439d9b4991968690fb3c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:24.991696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0e1957ee-df3b-4ada-9546-4745de7e17b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eedf3ca32c6439d9b4991968690fb3c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:24.999320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0e1957ee-df3b-4ada-9546-4745de7e17b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eedf3ca32c6439d9b4991968690fb3c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:25.202681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0e1957ee-df3b-4ada-9546-4745de7e17b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eedf3ca32c6439d9b4991968690fb3c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:25.222356 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1527/3043] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:24:24 2022] DELETE /identity/v3/users/9eedf3ca32c6439d9b4991968690fb3c => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:25.224199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b7bc0-c5d9-4078-8a42-8fd79c29b58c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:25.224707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b7bc0-c5d9-4078-8a42-8fd79c29b58c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:25.224807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b7bc0-c5d9-4078-8a42-8fd79c29b58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:25.247060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-298b7bc0-c5d9-4078-8a42-8fd79c29b58c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:25.249248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-298b7bc0-c5d9-4078-8a42-8fd79c29b58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:25.308482 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1517/3044] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:25.320393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1957ee-df3b-4ada-9546-4745de7e17b9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:25.320393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0e1957ee-df3b-4ada-9546-4745de7e17b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:25.426396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1957ee-df3b-4ada-9546-4745de7e17b9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:25.435434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd81ab9-e0b8-4d35-bbc2-862027ff4058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:25.440192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd81ab9-e0b8-4d35-bbc2-862027ff4058 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:25.440768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd81ab9-e0b8-4d35-bbc2-862027ff4058 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:25.441307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd81ab9-e0b8-4d35-bbc2-862027ff4058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:25.454889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd81ab9-e0b8-4d35-bbc2-862027ff4058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:25.456506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd81ab9-e0b8-4d35-bbc2-862027ff4058 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:25.469923 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1528/3045] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:24:25.661728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd62f1-f205-4e12-9974-eec963e2c634 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:25.662380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd62f1-f205-4e12-9974-eec963e2c634 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:25.663045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd62f1-f205-4e12-9974-eec963e2c634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:25.687076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-84bd62f1-f205-4e12-9974-eec963e2c634 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:25.689114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-84bd62f1-f205-4e12-9974-eec963e2c634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:25.783355 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1518/3046] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:24:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:25.813037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd81ab9-e0b8-4d35-bbc2-862027ff4058 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:25.816478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bfd81ab9-e0b8-4d35-bbc2-862027ff4058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:25.956622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd81ab9-e0b8-4d35-bbc2-862027ff4058 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:25.974781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eb428-c5ef-4ac9-bf7c-a732eb663c45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:25.975820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eb428-c5ef-4ac9-bf7c-a732eb663c45 service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:25.978640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eb428-c5ef-4ac9-bf7c-a732eb663c45 service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:25.978640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eb428-c5ef-4ac9-bf7c-a732eb663c45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:25.992833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761eb428-c5ef-4ac9-bf7c-a732eb663c45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:25.995096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761eb428-c5ef-4ac9-bf7c-a732eb663c45 service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:26.029151 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1529/3047] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:24:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:24:26.411295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd62f1-f205-4e12-9974-eec963e2c634 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:26.413648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-84bd62f1-f205-4e12-9974-eec963e2c634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:26.437643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd62f1-f205-4e12-9974-eec963e2c634 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:26.443072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f102203-d1ee-4664-a3fb-9f68bfdf065d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:26.444104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f102203-d1ee-4664-a3fb-9f68bfdf065d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:26.444879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f102203-d1ee-4664-a3fb-9f68bfdf065d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:26.445407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f102203-d1ee-4664-a3fb-9f68bfdf065d admin admin] PATH_INFO: `/v3/projects/c84f02990f1047059d0c84080e41ac69` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:26.446895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f102203-d1ee-4664-a3fb-9f68bfdf065d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c84f02990f1047059d0c84080e41ac69)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:26.449269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f102203-d1ee-4664-a3fb-9f68bfdf065d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:26.570656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7f102203-d1ee-4664-a3fb-9f68bfdf065d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c84f02990f1047059d0c84080e41ac69', 'request_id': 'req-7f102203-d1ee-4664-a3fb-9f68bfdf065d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:26.696691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7f102203-d1ee-4664-a3fb-9f68bfdf065d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c84f02990f1047059d0c84080e41ac69', 'request_id': 'req-7f102203-d1ee-4664-a3fb-9f68bfdf065d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:26.705282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7f102203-d1ee-4664-a3fb-9f68bfdf065d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c84f02990f1047059d0c84080e41ac69', 'request_id': 'req-7f102203-d1ee-4664-a3fb-9f68bfdf065d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:26.747289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7f102203-d1ee-4664-a3fb-9f68bfdf065d admin admin] The token cache is being invalidate because project c84f02990f1047059d0c84080e41ac69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:24:26.747773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7f102203-d1ee-4664-a3fb-9f68bfdf065d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:26.751163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7f102203-d1ee-4664-a3fb-9f68bfdf065d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:26.755013 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1519/3048] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:24:26 2022] DELETE /identity/v3/projects/c84f02990f1047059d0c84080e41ac69 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:26.758948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eb428-c5ef-4ac9-bf7c-a732eb663c45 service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:26.785101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eb428-c5ef-4ac9-bf7c-a732eb663c45 service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:27.012483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d49ae-95ba-465c-b209-ebe7236ef554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:27.013187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d49ae-95ba-465c-b209-ebe7236ef554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:27.013961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d49ae-95ba-465c-b209-ebe7236ef554 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:27.014399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d49ae-95ba-465c-b209-ebe7236ef554 admin admin] PATH_INFO: `/v3/users/f31a9e308e33473c83df5a5db2f9718c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:27.015574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d49ae-95ba-465c-b209-ebe7236ef554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f31a9e308e33473c83df5a5db2f9718c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:27.018859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d49ae-95ba-465c-b209-ebe7236ef554 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:27.290347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-aa5d49ae-95ba-465c-b209-ebe7236ef554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f31a9e308e33473c83df5a5db2f9718c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:27.313819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-aa5d49ae-95ba-465c-b209-ebe7236ef554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f31a9e308e33473c83df5a5db2f9718c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:27.319126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-aa5d49ae-95ba-465c-b209-ebe7236ef554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f31a9e308e33473c83df5a5db2f9718c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:27.323990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-aa5d49ae-95ba-465c-b209-ebe7236ef554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f31a9e308e33473c83df5a5db2f9718c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:27.399721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-aa5d49ae-95ba-465c-b209-ebe7236ef554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f31a9e308e33473c83df5a5db2f9718c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:27.416320 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1530/3049] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:24:26 2022] DELETE /identity/v3/users/f31a9e308e33473c83df5a5db2f9718c => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:28.146641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f102203-d1ee-4664-a3fb-9f68bfdf065d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:28.148091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7f102203-d1ee-4664-a3fb-9f68bfdf065d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:28.169246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f102203-d1ee-4664-a3fb-9f68bfdf065d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:28.237620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5024400-dc15-4356-a2c5-86aca66b7d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:28.238921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5024400-dc15-4356-a2c5-86aca66b7d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:28.239374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5024400-dc15-4356-a2c5-86aca66b7d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:28.239808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5024400-dc15-4356-a2c5-86aca66b7d1c admin admin] PATH_INFO: `/v3/projects/2f9ea8e1456b4bdfa19313b2d8241fd8` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:28.241262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5024400-dc15-4356-a2c5-86aca66b7d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f9ea8e1456b4bdfa19313b2d8241fd8)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:28.243714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5024400-dc15-4356-a2c5-86aca66b7d1c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:28.420907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d5024400-dc15-4356-a2c5-86aca66b7d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f9ea8e1456b4bdfa19313b2d8241fd8', 'request_id': 'req-d5024400-dc15-4356-a2c5-86aca66b7d1c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:28.562023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d5024400-dc15-4356-a2c5-86aca66b7d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f9ea8e1456b4bdfa19313b2d8241fd8', 'request_id': 'req-d5024400-dc15-4356-a2c5-86aca66b7d1c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:28.575592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d5024400-dc15-4356-a2c5-86aca66b7d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f9ea8e1456b4bdfa19313b2d8241fd8', 'request_id': 'req-d5024400-dc15-4356-a2c5-86aca66b7d1c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:28.615278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d5024400-dc15-4356-a2c5-86aca66b7d1c admin admin] The token cache is being invalidate because project 2f9ea8e1456b4bdfa19313b2d8241fd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:24:28.615578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d5024400-dc15-4356-a2c5-86aca66b7d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:28.618347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d5024400-dc15-4356-a2c5-86aca66b7d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:28.620727 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1520/3050] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:24:28 2022] DELETE /identity/v3/projects/2f9ea8e1456b4bdfa19313b2d8241fd8 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:28.626510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16961b6-f34f-48c4-98e8-6666dbc4331a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:28.631730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16961b6-f34f-48c4-98e8-6666dbc4331a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:28.631730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16961b6-f34f-48c4-98e8-6666dbc4331a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:28.708740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a16961b6-f34f-48c4-98e8-6666dbc4331a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:28.710028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a16961b6-f34f-48c4-98e8-6666dbc4331a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:28.880475 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1531/3051] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:28.881248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58abc8-21fd-4441-9bfb-052b7c24d5f6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:28.882429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58abc8-21fd-4441-9bfb-052b7c24d5f6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:28.882871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58abc8-21fd-4441-9bfb-052b7c24d5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:28.930488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0e58abc8-21fd-4441-9bfb-052b7c24d5f6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:28.932519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0e58abc8-21fd-4441-9bfb-052b7c24d5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:28.948385 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1521/3052] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:28.953826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16961b6-f34f-48c4-98e8-6666dbc4331a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:28.965823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16961b6-f34f-48c4-98e8-6666dbc4331a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:28.972810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d0a80-0af6-4e77-aeed-8e10890e7e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:28.974157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d0a80-0af6-4e77-aeed-8e10890e7e6f admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:28.974660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d0a80-0af6-4e77-aeed-8e10890e7e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:28.975153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d0a80-0af6-4e77-aeed-8e10890e7e6f admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:28.976018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d0a80-0af6-4e77-aeed-8e10890e7e6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:24:28.976836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d0a80-0af6-4e77-aeed-8e10890e7e6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:28.978612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d0a80-0af6-4e77-aeed-8e10890e7e6f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:29.000720 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1532/3053] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:24:29.004875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58abc8-21fd-4441-9bfb-052b7c24d5f6 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:29.022080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58abc8-21fd-4441-9bfb-052b7c24d5f6 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:29.028465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bcb9f-5c17-44ee-9a60-d9e62e45bae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:29.030269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bcb9f-5c17-44ee-9a60-d9e62e45bae4 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:29.030758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bcb9f-5c17-44ee-9a60-d9e62e45bae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:29.031304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bcb9f-5c17-44ee-9a60-d9e62e45bae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:29.032810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2bcb9f-5c17-44ee-9a60-d9e62e45bae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:29.035337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2bcb9f-5c17-44ee-9a60-d9e62e45bae4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:29.137301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d0a80-0af6-4e77-aeed-8e10890e7e6f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:29.139345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c47d0a80-0af6-4e77-aeed-8e10890e7e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:29.173087 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1522/3054] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:24:29 2022] POST /identity/v3/projects => generated 371 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:29.174086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bcb9f-5c17-44ee-9a60-d9e62e45bae4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:29.298237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bcb9f-5c17-44ee-9a60-d9e62e45bae4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:29.311216 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822363c-08d3-4d5e-9dec-e0f9eb904162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:29.312146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822363c-08d3-4d5e-9dec-e0f9eb904162 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:29.312536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822363c-08d3-4d5e-9dec-e0f9eb904162 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:29.313034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822363c-08d3-4d5e-9dec-e0f9eb904162 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:29.313858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822363c-08d3-4d5e-9dec-e0f9eb904162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:29.315920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822363c-08d3-4d5e-9dec-e0f9eb904162 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:29.344024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d0a80-0af6-4e77-aeed-8e10890e7e6f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:29.439609 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1523/3055] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:24:29 2022] POST /identity/v3/users => generated 286 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:29.440961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822363c-08d3-4d5e-9dec-e0f9eb904162 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:29.443610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e0b35-d1ec-4f0f-83e0-ed6b7841893d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:29.444944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e0b35-d1ec-4f0f-83e0-ed6b7841893d service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:29.445234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e0b35-d1ec-4f0f-83e0-ed6b7841893d service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:29.445510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e0b35-d1ec-4f0f-83e0-ed6b7841893d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:29.448796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c70e0b35-d1ec-4f0f-83e0-ed6b7841893d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:29.454505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822363c-08d3-4d5e-9dec-e0f9eb904162 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:29.461246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7279881-3994-437a-b963-d9c35eb7a954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:29.462058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7279881-3994-437a-b963-d9c35eb7a954 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:29.462978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7279881-3994-437a-b963-d9c35eb7a954 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:29.463490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7279881-3994-437a-b963-d9c35eb7a954 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:29.464987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7279881-3994-437a-b963-d9c35eb7a954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:29.466951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7279881-3994-437a-b963-d9c35eb7a954 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:29.488450 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1524/3056] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:29.489721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7279881-3994-437a-b963-d9c35eb7a954 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:29.502178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7279881-3994-437a-b963-d9c35eb7a954 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:29.511817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297672e-f836-4c5e-8ef0-74b2ea9b6470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:29.512964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297672e-f836-4c5e-8ef0-74b2ea9b6470 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:29.513517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297672e-f836-4c5e-8ef0-74b2ea9b6470 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:29.514561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297672e-f836-4c5e-8ef0-74b2ea9b6470 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:29.515680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297672e-f836-4c5e-8ef0-74b2ea9b6470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:29.517421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297672e-f836-4c5e-8ef0-74b2ea9b6470 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:29.530491 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1525/3057] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:29.535219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297672e-f836-4c5e-8ef0-74b2ea9b6470 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:29.546775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297672e-f836-4c5e-8ef0-74b2ea9b6470 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:29.551459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e0b35-d1ec-4f0f-83e0-ed6b7841893d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:29.553755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e0b35-d1ec-4f0f-83e0-ed6b7841893d service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:29.555791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d95c3-e173-4757-b4cd-66e062a3351d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:29.557105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d95c3-e173-4757-b4cd-66e062a3351d admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:29.557543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d95c3-e173-4757-b4cd-66e062a3351d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:29.557973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d95c3-e173-4757-b4cd-66e062a3351d admin admin] PATH_INFO: `/v3/projects/b9fe880f4cca48998e29b3611296e9be/users/1dc45f8ebea34fbfb4f840bf04faea2b/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:29.584680 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1533/3058] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:24:29.592731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d95c3-e173-4757-b4cd-66e062a3351d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9fe880f4cca48998e29b3611296e9be, user_id=1dc45f8ebea34fbfb4f840bf04faea2b, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:29.595733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d95c3-e173-4757-b4cd-66e062a3351d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:29.712789 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1526/3059] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:24:29 2022] PUT /identity/v3/projects/b9fe880f4cca48998e29b3611296e9be/users/1dc45f8ebea34fbfb4f840bf04faea2b/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:29.722316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8f898-4f9b-46b9-8a46-fffd7b00e5c1 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:29.724259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8f898-4f9b-46b9-8a46-fffd7b00e5c1 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:29.724816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8f898-4f9b-46b9-8a46-fffd7b00e5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:29.779114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b1d8f898-4f9b-46b9-8a46-fffd7b00e5c1 None None] MFA Rules not processed for user `1dc45f8ebea34fbfb4f840bf04faea2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:29.782078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b1d8f898-4f9b-46b9-8a46-fffd7b00e5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:29.910738 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1534/3060] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:29.912029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d95c3-e173-4757-b4cd-66e062a3351d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:29.934770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d95c3-e173-4757-b4cd-66e062a3351d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:29.944385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a57b7-e225-4d62-9b29-502fbb66042e tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc45f8ebea34fbfb4f840bf04faea2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9fe880f4cca48998e29b3611296e9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:29.945765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a57b7-e225-4d62-9b29-502fbb66042e tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:29.946279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a57b7-e225-4d62-9b29-502fbb66042e tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:29.946674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a57b7-e225-4d62-9b29-502fbb66042e tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] PATH_INFO: `/v3/users/1dc45f8ebea34fbfb4f840bf04faea2b/application_credentials` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:29.947693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a57b7-e225-4d62-9b29-502fbb66042e tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: Authorizing `identity:create_application_credential(user_id=1dc45f8ebea34fbfb4f840bf04faea2b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:29.949011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a57b7-e225-4d62-9b29-502fbb66042e tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:30.134410 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1527/3061] 10.222.0.16 () {60 vars in 1314 bytes} [Mon May 2 10:24:29 2022] POST /identity/v3/users/1dc45f8ebea34fbfb4f840bf04faea2b/application_credentials => generated 921 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:30.138360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8f898-4f9b-46b9-8a46-fffd7b00e5c1 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:30.152744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8f898-4f9b-46b9-8a46-fffd7b00e5c1 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:30.159681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a379c79-f4f0-40df-b996-6ab0bc8b4864 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc45f8ebea34fbfb4f840bf04faea2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9fe880f4cca48998e29b3611296e9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:30.161586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a379c79-f4f0-40df-b996-6ab0bc8b4864 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:30.162136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a379c79-f4f0-40df-b996-6ab0bc8b4864 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:30.162777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a379c79-f4f0-40df-b996-6ab0bc8b4864 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] PATH_INFO: `/v3/users/1dc45f8ebea34fbfb4f840bf04faea2b/access_rules/11244fbbaaa547aeb3cc6768f8d143d2` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:30.164462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a379c79-f4f0-40df-b996-6ab0bc8b4864 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: Authorizing `identity:delete_access_rule(user_id=1dc45f8ebea34fbfb4f840bf04faea2b, access_rule_id=11244fbbaaa547aeb3cc6768f8d143d2)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:30.166235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a379c79-f4f0-40df-b996-6ab0bc8b4864 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:30.246568 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-3a379c79-f4f0-40df-b996-6ab0bc8b4864 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use May 02 10:24:30.246568 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:24:30.246568 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule May 02 10:24:30.246568 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application session.delete(ref) May 02 10:24:30.246568 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 02 10:24:30.246568 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application next(self.gen) May 02 10:24:30.246568 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 02 10:24:30.246568 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application yield resource May 02 10:24:30.246568 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 02 10:24:30.246568 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application next(self.gen) May 02 10:24:30.246568 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 02 10:24:30.246568 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.session.rollback() May 02 10:24:30.246568 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 02 10:24:30.246568 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.force_reraise() May 02 10:24:30.246568 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 02 10:24:30.246568 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise self.value May 02 10:24:30.247717 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 02 10:24:30.247717 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 02 10:24:30.247717 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 02 10:24:30.247717 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application session.commit() May 02 10:24:30.247717 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 02 10:24:30.247717 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 02 10:24:30.247717 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 02 10:24:30.247717 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._prepare_impl() May 02 10:24:30.247717 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 02 10:24:30.247717 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.session.flush() May 02 10:24:30.247717 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 02 10:24:30.247717 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._flush(objects) May 02 10:24:30.247717 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 02 10:24:30.247717 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 02 10:24:30.247717 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 02 10:24:30.247717 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application compat.raise_( May 02 10:24:30.250036 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 02 10:24:30.250036 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception May 02 10:24:30.250036 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 02 10:24:30.250036 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application flush_context.execute() May 02 10:24:30.250036 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 02 10:24:30.250036 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rec.execute(self) May 02 10:24:30.250036 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute May 02 10:24:30.250036 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) May 02 10:24:30.250036 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes May 02 10:24:30.250036 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._synchronize( May 02 10:24:30.250036 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize May 02 10:24:30.250036 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) May 02 10:24:30.250036 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear May 02 10:24:30.250036 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise AssertionError( May 02 10:24:30.250036 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' May 02 10:24:30.250036 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:24:30.252020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:24:30.252020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:24:30.252020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:24:30.252020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:24:30.252020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:24:30.252020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:24:30.252020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:24:30.252020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:24:30.252020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:24:30.252020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:24:30.252020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:24:30.252020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:24:30.252020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:24:30.252020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete May 02 10:24:30.252020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( May 02 10:24:30.252020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:24:30.252020 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:24:30.254410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule May 02 10:24:30.254410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) May 02 10:24:30.254410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule May 02 10:24:30.254410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( May 02 10:24:30.254410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use May 02 10:24:30.254410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:24:30.254410 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1535/3062] 10.222.0.16 () {58 vars in 1361 bytes} [Mon May 2 10:24:30 2022] DELETE /identity/v3/users/1dc45f8ebea34fbfb4f840bf04faea2b/access_rules/11244fbbaaa547aeb3cc6768f8d143d2 => generated 89 bytes in 110 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) May 02 10:24:30.258493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a57b7-e225-4d62-9b29-502fbb66042e tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:30.272964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a57b7-e225-4d62-9b29-502fbb66042e tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:30.278797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ba6c3-6474-41e0-bffb-fd9005e90b1c tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc45f8ebea34fbfb4f840bf04faea2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9fe880f4cca48998e29b3611296e9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:30.282844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ba6c3-6474-41e0-bffb-fd9005e90b1c tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:30.283381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ba6c3-6474-41e0-bffb-fd9005e90b1c tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:30.283917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ba6c3-6474-41e0-bffb-fd9005e90b1c tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] PATH_INFO: `/v3/users/1dc45f8ebea34fbfb4f840bf04faea2b/application_credentials/7bb6eeb7be8d4a0192f2cf1a17e5f4b6` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:30.307578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ba6c3-6474-41e0-bffb-fd9005e90b1c tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: Authorizing `identity:delete_application_credential(user_id=1dc45f8ebea34fbfb4f840bf04faea2b, application_credential_id=7bb6eeb7be8d4a0192f2cf1a17e5f4b6)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:30.309561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ba6c3-6474-41e0-bffb-fd9005e90b1c tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:30.428151 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1528/3063] 10.222.0.16 () {58 vars in 1394 bytes} [Mon May 2 10:24:30 2022] DELETE /identity/v3/users/1dc45f8ebea34fbfb4f840bf04faea2b/application_credentials/7bb6eeb7be8d4a0192f2cf1a17e5f4b6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:30.432197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a379c79-f4f0-40df-b996-6ab0bc8b4864 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:30.443423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a379c79-f4f0-40df-b996-6ab0bc8b4864 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:30.449315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51820b4-bcff-4420-8a6d-fdd48e94da22 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc45f8ebea34fbfb4f840bf04faea2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9fe880f4cca48998e29b3611296e9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:30.461846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51820b4-bcff-4420-8a6d-fdd48e94da22 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:30.462340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51820b4-bcff-4420-8a6d-fdd48e94da22 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:30.462662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51820b4-bcff-4420-8a6d-fdd48e94da22 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] PATH_INFO: `/v3/users/1dc45f8ebea34fbfb4f840bf04faea2b/access_rules` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:30.464260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51820b4-bcff-4420-8a6d-fdd48e94da22 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: Authorizing `identity:list_access_rules(user_id=1dc45f8ebea34fbfb4f840bf04faea2b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:30.473665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51820b4-bcff-4420-8a6d-fdd48e94da22 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:30.483139 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1536/3064] 10.222.0.16 () {58 vars in 1259 bytes} [Mon May 2 10:24:30 2022] GET /identity/v3/users/1dc45f8ebea34fbfb4f840bf04faea2b/access_rules => generated 369 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:24:30.490497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ba6c3-6474-41e0-bffb-fd9005e90b1c tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:30.499288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ba6c3-6474-41e0-bffb-fd9005e90b1c tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:30.506526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af46c29-79ce-46a8-aea9-dde3479c9fd9 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc45f8ebea34fbfb4f840bf04faea2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9fe880f4cca48998e29b3611296e9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:30.524363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af46c29-79ce-46a8-aea9-dde3479c9fd9 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:30.527994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af46c29-79ce-46a8-aea9-dde3479c9fd9 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:30.527994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af46c29-79ce-46a8-aea9-dde3479c9fd9 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] PATH_INFO: `/v3/users/1dc45f8ebea34fbfb4f840bf04faea2b/access_rules/11244fbbaaa547aeb3cc6768f8d143d2` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:30.527994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af46c29-79ce-46a8-aea9-dde3479c9fd9 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: Authorizing `identity:delete_access_rule(user_id=1dc45f8ebea34fbfb4f840bf04faea2b, access_rule_id=11244fbbaaa547aeb3cc6768f8d143d2)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:30.529313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af46c29-79ce-46a8-aea9-dde3479c9fd9 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:30.612711 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1529/3065] 10.222.0.16 () {58 vars in 1361 bytes} [Mon May 2 10:24:30 2022] DELETE /identity/v3/users/1dc45f8ebea34fbfb4f840bf04faea2b/access_rules/11244fbbaaa547aeb3cc6768f8d143d2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:24:30.616987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51820b4-bcff-4420-8a6d-fdd48e94da22 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:30.628304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51820b4-bcff-4420-8a6d-fdd48e94da22 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:30.641007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ebcc1-01fe-47fb-9488-dad140b94daa tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc45f8ebea34fbfb4f840bf04faea2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9fe880f4cca48998e29b3611296e9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:30.641917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ebcc1-01fe-47fb-9488-dad140b94daa tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:30.642205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ebcc1-01fe-47fb-9488-dad140b94daa tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:30.643162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ebcc1-01fe-47fb-9488-dad140b94daa tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] PATH_INFO: `/v3/users/1dc45f8ebea34fbfb4f840bf04faea2b/access_rules` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:30.644529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ebcc1-01fe-47fb-9488-dad140b94daa tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: Authorizing `identity:list_access_rules(user_id=1dc45f8ebea34fbfb4f840bf04faea2b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:30.646963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ebcc1-01fe-47fb-9488-dad140b94daa tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:30.658722 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1537/3066] 10.222.0.16 () {58 vars in 1259 bytes} [Mon May 2 10:24:30 2022] GET /identity/v3/users/1dc45f8ebea34fbfb4f840bf04faea2b/access_rules => generated 158 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:24:30.660376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af46c29-79ce-46a8-aea9-dde3479c9fd9 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:30.674061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af46c29-79ce-46a8-aea9-dde3479c9fd9 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:30.679109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0d29d-8aeb-450a-8b8f-3fd30472d6d0 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc45f8ebea34fbfb4f840bf04faea2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9fe880f4cca48998e29b3611296e9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:30.680928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0d29d-8aeb-450a-8b8f-3fd30472d6d0 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:30.681380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0d29d-8aeb-450a-8b8f-3fd30472d6d0 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:30.681856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0d29d-8aeb-450a-8b8f-3fd30472d6d0 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] PATH_INFO: `/v3/users/1dc45f8ebea34fbfb4f840bf04faea2b/application_credentials` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:30.683089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0d29d-8aeb-450a-8b8f-3fd30472d6d0 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: Authorizing `identity:create_application_credential(user_id=1dc45f8ebea34fbfb4f840bf04faea2b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:30.684718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0d29d-8aeb-450a-8b8f-3fd30472d6d0 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:30.948490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ebcc1-01fe-47fb-9488-dad140b94daa tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:30.951875 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1530/3067] 10.222.0.16 () {60 vars in 1314 bytes} [Mon May 2 10:24:30 2022] POST /identity/v3/users/1dc45f8ebea34fbfb4f840bf04faea2b/application_credentials => generated 920 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:30.969810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ebcc1-01fe-47fb-9488-dad140b94daa tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:30.978742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c52581-9427-4941-989f-39d63afaf061 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc45f8ebea34fbfb4f840bf04faea2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9fe880f4cca48998e29b3611296e9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:30.979890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c52581-9427-4941-989f-39d63afaf061 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:30.980171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c52581-9427-4941-989f-39d63afaf061 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:30.980456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c52581-9427-4941-989f-39d63afaf061 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] PATH_INFO: `/v3/users/1dc45f8ebea34fbfb4f840bf04faea2b/access_rules` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:30.989603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c52581-9427-4941-989f-39d63afaf061 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: Authorizing `identity:list_access_rules(user_id=1dc45f8ebea34fbfb4f840bf04faea2b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:30.991227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c52581-9427-4941-989f-39d63afaf061 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:31.020370 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1538/3068] 10.222.0.16 () {58 vars in 1259 bytes} [Mon May 2 10:24:30 2022] GET /identity/v3/users/1dc45f8ebea34fbfb4f840bf04faea2b/access_rules => generated 369 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:24:31.022012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0d29d-8aeb-450a-8b8f-3fd30472d6d0 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:31.045928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0d29d-8aeb-450a-8b8f-3fd30472d6d0 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:31.070804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a0e36-f39a-46ef-a77b-d90ec7fcb411 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc45f8ebea34fbfb4f840bf04faea2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9fe880f4cca48998e29b3611296e9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:31.072694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a0e36-f39a-46ef-a77b-d90ec7fcb411 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:31.077956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a0e36-f39a-46ef-a77b-d90ec7fcb411 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:31.078253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a0e36-f39a-46ef-a77b-d90ec7fcb411 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] PATH_INFO: `/v3/users/1dc45f8ebea34fbfb4f840bf04faea2b/application_credentials` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:31.079044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a0e36-f39a-46ef-a77b-d90ec7fcb411 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: Authorizing `identity:create_application_credential(user_id=1dc45f8ebea34fbfb4f840bf04faea2b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:31.080228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a0e36-f39a-46ef-a77b-d90ec7fcb411 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:31.210421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a93481-17ad-4cec-872d-1d25cee28c95 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:31.210763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a93481-17ad-4cec-872d-1d25cee28c95 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:31.210974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a93481-17ad-4cec-872d-1d25cee28c95 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:31.212626 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1539/3069] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:24:31.225813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca8a17-a01a-4ef8-8895-eb301675ffe5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:31.227141 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca8a17-a01a-4ef8-8895-eb301675ffe5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:31.227638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca8a17-a01a-4ef8-8895-eb301675ffe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:31.307282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8aca8a17-a01a-4ef8-8895-eb301675ffe5 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:31.312903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8aca8a17-a01a-4ef8-8895-eb301675ffe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:31.443290 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1531/3070] 10.222.0.16 () {60 vars in 1314 bytes} [Mon May 2 10:24:31 2022] POST /identity/v3/users/1dc45f8ebea34fbfb4f840bf04faea2b/application_credentials => generated 921 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:31.446332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a0e36-f39a-46ef-a77b-d90ec7fcb411 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:31.472461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a0e36-f39a-46ef-a77b-d90ec7fcb411 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:31.496804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28b387-4f7b-4fe6-87ad-28d030500f12 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc45f8ebea34fbfb4f840bf04faea2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9fe880f4cca48998e29b3611296e9be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:31.509029 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1540/3071] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:24:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:24:31.511195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28b387-4f7b-4fe6-87ad-28d030500f12 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:31.513090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28b387-4f7b-4fe6-87ad-28d030500f12 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:31.514041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28b387-4f7b-4fe6-87ad-28d030500f12 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] PATH_INFO: `/v3/users/1dc45f8ebea34fbfb4f840bf04faea2b/access_rules/19b96f02ad0e44a5a141e37c0f8ba5d7` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:31.524771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28b387-4f7b-4fe6-87ad-28d030500f12 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: Authorizing `identity:get_access_rule(user_id=1dc45f8ebea34fbfb4f840bf04faea2b, access_rule_id=19b96f02ad0e44a5a141e37c0f8ba5d7)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:31.526302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28b387-4f7b-4fe6-87ad-28d030500f12 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:31.545887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca8a17-a01a-4ef8-8895-eb301675ffe5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:31.547333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8aca8a17-a01a-4ef8-8895-eb301675ffe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:31.564859 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1532/3072] 10.222.0.16 () {58 vars in 1358 bytes} [Mon May 2 10:24:31 2022] GET /identity/v3/users/1dc45f8ebea34fbfb4f840bf04faea2b/access_rules/19b96f02ad0e44a5a141e37c0f8ba5d7 => generated 229 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:24:31.565045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28b387-4f7b-4fe6-87ad-28d030500f12 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:31.569292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca8a17-a01a-4ef8-8895-eb301675ffe5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:31.581255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33f74f-f318-448b-956b-b560a7cba1df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:31.582026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33f74f-f318-448b-956b-b560a7cba1df service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:31.584170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33f74f-f318-448b-956b-b560a7cba1df service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:31.584732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33f74f-f318-448b-956b-b560a7cba1df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:31.606388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33f74f-f318-448b-956b-b560a7cba1df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:31.608266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33f74f-f318-448b-956b-b560a7cba1df service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:31.645228 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1541/3073] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:24:31.794593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28b387-4f7b-4fe6-87ad-28d030500f12 tempest-AccessRulesV3Test-1136066873 tempest-AccessRulesV3Test-1136066873-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:31.814833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73b514-88d2-4bb4-a541-5a5971d9cdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:31.815913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73b514-88d2-4bb4-a541-5a5971d9cdef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:31.816781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73b514-88d2-4bb4-a541-5a5971d9cdef admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:31.817077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73b514-88d2-4bb4-a541-5a5971d9cdef admin admin] PATH_INFO: `/v3/users/1dc45f8ebea34fbfb4f840bf04faea2b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:31.822029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73b514-88d2-4bb4-a541-5a5971d9cdef admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dc45f8ebea34fbfb4f840bf04faea2b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:31.829632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73b514-88d2-4bb4-a541-5a5971d9cdef admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:32.147037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8d73b514-88d2-4bb4-a541-5a5971d9cdef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dc45f8ebea34fbfb4f840bf04faea2b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:32.432206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8d73b514-88d2-4bb4-a541-5a5971d9cdef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dc45f8ebea34fbfb4f840bf04faea2b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:32.434061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8d73b514-88d2-4bb4-a541-5a5971d9cdef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dc45f8ebea34fbfb4f840bf04faea2b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:32.444240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8d73b514-88d2-4bb4-a541-5a5971d9cdef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dc45f8ebea34fbfb4f840bf04faea2b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:32.595702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8d73b514-88d2-4bb4-a541-5a5971d9cdef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dc45f8ebea34fbfb4f840bf04faea2b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:32.603983 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1533/3074] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:24:31 2022] DELETE /identity/v3/users/1dc45f8ebea34fbfb4f840bf04faea2b => generated 0 bytes in 1039 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:32.611685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ceb70-d9de-47c3-82a6-74266ed72dc0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:32.612217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ceb70-d9de-47c3-82a6-74266ed72dc0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:32.612317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ceb70-d9de-47c3-82a6-74266ed72dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:32.665030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-729ceb70-d9de-47c3-82a6-74266ed72dc0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:32.666544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-729ceb70-d9de-47c3-82a6-74266ed72dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:32.835017 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1542/3075] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:32.855089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73b514-88d2-4bb4-a541-5a5971d9cdef admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:32.858527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8d73b514-88d2-4bb4-a541-5a5971d9cdef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:32.964423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73b514-88d2-4bb4-a541-5a5971d9cdef admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:32.970230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e8042-9d1a-4280-af14-81751755fa87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:32.970751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e8042-9d1a-4280-af14-81751755fa87 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:32.971280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e8042-9d1a-4280-af14-81751755fa87 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:32.971755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e8042-9d1a-4280-af14-81751755fa87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:32.999036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e8042-9d1a-4280-af14-81751755fa87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:33.000877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e8042-9d1a-4280-af14-81751755fa87 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:33.018487 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1534/3076] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:24:33.350343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1aa7c8-d502-422f-9fa3-6ca1bec423c5 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:33.356077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1aa7c8-d502-422f-9fa3-6ca1bec423c5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:33.356077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1aa7c8-d502-422f-9fa3-6ca1bec423c5 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:33.356077 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1543/3077] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:24:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:24:33.360823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d6703-6072-470a-a1b0-85e585521e8d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:33.361165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d6703-6072-470a-a1b0-85e585521e8d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:33.361445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d6703-6072-470a-a1b0-85e585521e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:33.380085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1b3d6703-6072-470a-a1b0-85e585521e8d None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:33.381429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1b3d6703-6072-470a-a1b0-85e585521e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:33.445885 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1535/3078] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:24:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:33.493571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1aa7c8-d502-422f-9fa3-6ca1bec423c5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:33.493571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ae1aa7c8-d502-422f-9fa3-6ca1bec423c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:33.554073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1aa7c8-d502-422f-9fa3-6ca1bec423c5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:33.568411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9f90c-4c04-4c13-8711-af185ddc2e21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:33.569269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9f90c-4c04-4c13-8711-af185ddc2e21 service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:33.569835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9f90c-4c04-4c13-8711-af185ddc2e21 service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:33.570219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9f90c-4c04-4c13-8711-af185ddc2e21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:33.580629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9f90c-4c04-4c13-8711-af185ddc2e21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:33.583343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9f90c-4c04-4c13-8711-af185ddc2e21 service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:33.597098 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1544/3079] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:24:33.969338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d6703-6072-470a-a1b0-85e585521e8d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:33.971995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1b3d6703-6072-470a-a1b0-85e585521e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:33.995004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d6703-6072-470a-a1b0-85e585521e8d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:34.006350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea31b2-073c-4644-a50c-5409627bd2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:34.007337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea31b2-073c-4644-a50c-5409627bd2f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:34.007694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea31b2-073c-4644-a50c-5409627bd2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:34.008049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea31b2-073c-4644-a50c-5409627bd2f6 admin admin] PATH_INFO: `/v3/projects/b9fe880f4cca48998e29b3611296e9be` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:34.009581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea31b2-073c-4644-a50c-5409627bd2f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9fe880f4cca48998e29b3611296e9be)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:34.011627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea31b2-073c-4644-a50c-5409627bd2f6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:34.173386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a7ea31b2-073c-4644-a50c-5409627bd2f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9fe880f4cca48998e29b3611296e9be', 'request_id': 'req-a7ea31b2-073c-4644-a50c-5409627bd2f6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:34.265594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177fe2a-894b-4b0b-a9ff-3421171574f5 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:34.266137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177fe2a-894b-4b0b-a9ff-3421171574f5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:34.266259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177fe2a-894b-4b0b-a9ff-3421171574f5 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:34.267993 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1545/3080] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 10:24:34.278099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a7ea31b2-073c-4644-a50c-5409627bd2f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9fe880f4cca48998e29b3611296e9be', 'request_id': 'req-a7ea31b2-073c-4644-a50c-5409627bd2f6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:34.281331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a7c72-384c-443b-ac61-e0a1ff26c463 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:34.281845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a7c72-384c-443b-ac61-e0a1ff26c463 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:34.288330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a7c72-384c-443b-ac61-e0a1ff26c463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:34.288557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a7ea31b2-073c-4644-a50c-5409627bd2f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9fe880f4cca48998e29b3611296e9be', 'request_id': 'req-a7ea31b2-073c-4644-a50c-5409627bd2f6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:34.313977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a7ea31b2-073c-4644-a50c-5409627bd2f6 admin admin] The token cache is being invalidate because project b9fe880f4cca48998e29b3611296e9be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:24:34.318168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a7ea31b2-073c-4644-a50c-5409627bd2f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:34.318168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a7ea31b2-073c-4644-a50c-5409627bd2f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:34.318374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7d4a7c72-384c-443b-ac61-e0a1ff26c463 None None] MFA Rules not processed for user `e6036dd39fb74289a8cbdcd6a21f8662`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:34.319916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7d4a7c72-384c-443b-ac61-e0a1ff26c463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:34.327526 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1536/3081] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:24:33 2022] DELETE /identity/v3/projects/b9fe880f4cca48998e29b3611296e9be => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:34.329738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb228ee-0b3f-4c44-b0e2-df4e78a51711 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:34.330163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb228ee-0b3f-4c44-b0e2-df4e78a51711 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:34.330522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb228ee-0b3f-4c44-b0e2-df4e78a51711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:34.402853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4fb228ee-0b3f-4c44-b0e2-df4e78a51711 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:34.406873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4fb228ee-0b3f-4c44-b0e2-df4e78a51711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:34.460666 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1546/3082] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:24:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:24:34.499397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a7c72-384c-443b-ac61-e0a1ff26c463 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:34.501491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7d4a7c72-384c-443b-ac61-e0a1ff26c463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:34.551629 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1537/3083] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:34.559285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e57ab-e41c-4120-997a-563a520b20cd None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:34.561469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e57ab-e41c-4120-997a-563a520b20cd None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:34.561469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e57ab-e41c-4120-997a-563a520b20cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:34.596382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ce1e57ab-e41c-4120-997a-563a520b20cd None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:34.598799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ce1e57ab-e41c-4120-997a-563a520b20cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:34.608434 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1538/3084] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:34.612959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e57ab-e41c-4120-997a-563a520b20cd None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:34.625670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e57ab-e41c-4120-997a-563a520b20cd None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:34.632743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca699c-b37b-47f9-9b41-4a7f1b60ee7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:34.636840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca699c-b37b-47f9-9b41-4a7f1b60ee7d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:34.638070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca699c-b37b-47f9-9b41-4a7f1b60ee7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:34.639585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca699c-b37b-47f9-9b41-4a7f1b60ee7d admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:34.641129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca699c-b37b-47f9-9b41-4a7f1b60ee7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:24:34.645283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca699c-b37b-47f9-9b41-4a7f1b60ee7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:34.645283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca699c-b37b-47f9-9b41-4a7f1b60ee7d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:34.657284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a7c72-384c-443b-ac61-e0a1ff26c463 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:34.658561 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1539/3085] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:24:34.662174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0eed8-48ca-43f2-8805-9af1a74247ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:34.663226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0eed8-48ca-43f2-8805-9af1a74247ed service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:34.663680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0eed8-48ca-43f2-8805-9af1a74247ed service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:34.663964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca699c-b37b-47f9-9b41-4a7f1b60ee7d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:34.664102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0eed8-48ca-43f2-8805-9af1a74247ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:34.680381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca699c-b37b-47f9-9b41-4a7f1b60ee7d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:34.690654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcd314-aa5f-441a-92ff-4cf22b9a59e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:34.691699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcd314-aa5f-441a-92ff-4cf22b9a59e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:34.692243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcd314-aa5f-441a-92ff-4cf22b9a59e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:34.692848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcd314-aa5f-441a-92ff-4cf22b9a59e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:34.694614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dcd314-aa5f-441a-92ff-4cf22b9a59e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:34.697855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dcd314-aa5f-441a-92ff-4cf22b9a59e9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:34.706910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0eed8-48ca-43f2-8805-9af1a74247ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:34.713558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0eed8-48ca-43f2-8805-9af1a74247ed service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:34.734917 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1547/3086] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:24:34.819032 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1540/3087] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:24:34 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:34.822857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0eed8-48ca-43f2-8805-9af1a74247ed service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:34.843586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0eed8-48ca-43f2-8805-9af1a74247ed service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:34.973695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f19f62-1abf-4bd3-9cfd-76d8aa65fbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:34.974652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f19f62-1abf-4bd3-9cfd-76d8aa65fbcb admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:34.974933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f19f62-1abf-4bd3-9cfd-76d8aa65fbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:34.975206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f19f62-1abf-4bd3-9cfd-76d8aa65fbcb admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:34.975901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f19f62-1abf-4bd3-9cfd-76d8aa65fbcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:34.978153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f19f62-1abf-4bd3-9cfd-76d8aa65fbcb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:35.146895 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1548/3088] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:24:34 2022] POST /identity/v3/users => generated 300 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:35.153173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcd314-aa5f-441a-92ff-4cf22b9a59e9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:35.167392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcd314-aa5f-441a-92ff-4cf22b9a59e9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:35.176242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b259d93-a2ee-4909-bb21-bd03c2e48541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:35.177225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b259d93-a2ee-4909-bb21-bd03c2e48541 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:35.177351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b259d93-a2ee-4909-bb21-bd03c2e48541 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:35.177623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b259d93-a2ee-4909-bb21-bd03c2e48541 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:35.178820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b259d93-a2ee-4909-bb21-bd03c2e48541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:35.180705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b259d93-a2ee-4909-bb21-bd03c2e48541 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:35.196400 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1541/3089] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:35.197606 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f19f62-1abf-4bd3-9cfd-76d8aa65fbcb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:35.212544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f19f62-1abf-4bd3-9cfd-76d8aa65fbcb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:35.219662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91689008-5b68-4d63-b6a2-e27fc4a6c89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:35.221554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91689008-5b68-4d63-b6a2-e27fc4a6c89d admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:35.222281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91689008-5b68-4d63-b6a2-e27fc4a6c89d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:35.225989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91689008-5b68-4d63-b6a2-e27fc4a6c89d admin admin] PATH_INFO: `/v3/projects/c26319a9757644619eea0f96396a0458/users/16dcf7ac85944972adb3bcbcbd943c66/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:35.261622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91689008-5b68-4d63-b6a2-e27fc4a6c89d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26319a9757644619eea0f96396a0458, user_id=16dcf7ac85944972adb3bcbcbd943c66, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:35.269908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91689008-5b68-4d63-b6a2-e27fc4a6c89d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:35.362265 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1549/3090] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:24:35 2022] PUT /identity/v3/projects/c26319a9757644619eea0f96396a0458/users/16dcf7ac85944972adb3bcbcbd943c66/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:35.366643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b259d93-a2ee-4909-bb21-bd03c2e48541 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:35.393811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b259d93-a2ee-4909-bb21-bd03c2e48541 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:35.472369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e638cb-5295-478e-b642-39c7d195f3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:35.473077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e638cb-5295-478e-b642-39c7d195f3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:35.473538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e638cb-5295-478e-b642-39c7d195f3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:35.474018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e638cb-5295-478e-b642-39c7d195f3e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:35.475030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e638cb-5295-478e-b642-39c7d195f3e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:35.477849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e638cb-5295-478e-b642-39c7d195f3e7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:35.526582 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1542/3091] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:24:35.531054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91689008-5b68-4d63-b6a2-e27fc4a6c89d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:35.547119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91689008-5b68-4d63-b6a2-e27fc4a6c89d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:35.555081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f4b28-6e8c-4f15-88a6-1e3e95be3940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:35.556851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f4b28-6e8c-4f15-88a6-1e3e95be3940 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:35.557420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f4b28-6e8c-4f15-88a6-1e3e95be3940 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:35.558556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f4b28-6e8c-4f15-88a6-1e3e95be3940 admin admin] PATH_INFO: `/v3/projects/c26319a9757644619eea0f96396a0458/users/16dcf7ac85944972adb3bcbcbd943c66/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:35.561862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f4b28-6e8c-4f15-88a6-1e3e95be3940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26319a9757644619eea0f96396a0458, user_id=16dcf7ac85944972adb3bcbcbd943c66, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:35.564768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f4b28-6e8c-4f15-88a6-1e3e95be3940 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:35.586869 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1550/3092] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:24:35 2022] PUT /identity/v3/projects/c26319a9757644619eea0f96396a0458/users/16dcf7ac85944972adb3bcbcbd943c66/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:35.600455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cc773-f681-4f11-b70c-b97bac802cab None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:35.607969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cc773-f681-4f11-b70c-b97bac802cab None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:35.607969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cc773-f681-4f11-b70c-b97bac802cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:35.660442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e76cc773-f681-4f11-b70c-b97bac802cab None None] MFA Rules not processed for user `16dcf7ac85944972adb3bcbcbd943c66`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:35.670150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e76cc773-f681-4f11-b70c-b97bac802cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:35.778988 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1543/3093] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:35.783570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f4b28-6e8c-4f15-88a6-1e3e95be3940 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:35.895544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f4b28-6e8c-4f15-88a6-1e3e95be3940 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:35.904995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9ce29-d65c-494c-b226-5a718406b152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:35.906034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9ce29-d65c-494c-b226-5a718406b152 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:35.908194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9ce29-d65c-494c-b226-5a718406b152 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:35.908194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9ce29-d65c-494c-b226-5a718406b152 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:35.910076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9ce29-d65c-494c-b226-5a718406b152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:35.914417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9ce29-d65c-494c-b226-5a718406b152 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:36.081629 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1551/3094] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:24:35 2022] POST /identity/v3/projects => generated 387 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:36.086421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cc773-f681-4f11-b70c-b97bac802cab None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:36.110947 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cc773-f681-4f11-b70c-b97bac802cab None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:36.226290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59d853-ebc6-4ed8-ae40-4bff7d0d143b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:36.227520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59d853-ebc6-4ed8-ae40-4bff7d0d143b admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:36.228270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59d853-ebc6-4ed8-ae40-4bff7d0d143b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:36.228830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59d853-ebc6-4ed8-ae40-4bff7d0d143b admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:36.233616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59d853-ebc6-4ed8-ae40-4bff7d0d143b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:36.236127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59d853-ebc6-4ed8-ae40-4bff7d0d143b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:36.375910 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1544/3095] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:24:36 2022] POST /identity/v3/users => generated 294 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:24:36.379532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9ce29-d65c-494c-b226-5a718406b152 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:36.398388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9ce29-d65c-494c-b226-5a718406b152 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:36.441406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78517c07-5731-4bb3-a534-1b7d1370c74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:36.447291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78517c07-5731-4bb3-a534-1b7d1370c74b admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:36.448412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78517c07-5731-4bb3-a534-1b7d1370c74b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:36.449074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78517c07-5731-4bb3-a534-1b7d1370c74b admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:36.450519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78517c07-5731-4bb3-a534-1b7d1370c74b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:36.454692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78517c07-5731-4bb3-a534-1b7d1370c74b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:36.487381 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1552/3096] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:36.491510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59d853-ebc6-4ed8-ae40-4bff7d0d143b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:36.506051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59d853-ebc6-4ed8-ae40-4bff7d0d143b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:36.518878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9697f2-bcb1-43b4-a32c-a70e9bccb146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:36.520308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9697f2-bcb1-43b4-a32c-a70e9bccb146 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:36.520892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9697f2-bcb1-43b4-a32c-a70e9bccb146 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:36.521389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9697f2-bcb1-43b4-a32c-a70e9bccb146 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:36.522366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9697f2-bcb1-43b4-a32c-a70e9bccb146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:36.524795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9697f2-bcb1-43b4-a32c-a70e9bccb146 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:36.540200 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1545/3097] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:36.544529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78517c07-5731-4bb3-a534-1b7d1370c74b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:36.574465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78517c07-5731-4bb3-a534-1b7d1370c74b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:36.583451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa7d69-795f-47c1-9c9c-7c876c7a135d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:36.585224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa7d69-795f-47c1-9c9c-7c876c7a135d admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:36.585741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa7d69-795f-47c1-9c9c-7c876c7a135d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:36.586240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa7d69-795f-47c1-9c9c-7c876c7a135d admin admin] PATH_INFO: `/v3/projects/9cd9c4fd3f3c4200a4085d21cbd4badd/users/63bf5c1186bf49f8bcf852fe99076180/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:36.606927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa7d69-795f-47c1-9c9c-7c876c7a135d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd9c4fd3f3c4200a4085d21cbd4badd, user_id=63bf5c1186bf49f8bcf852fe99076180, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:36.611143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa7d69-795f-47c1-9c9c-7c876c7a135d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:36.708534 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1553/3098] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:24:36 2022] PUT /identity/v3/projects/9cd9c4fd3f3c4200a4085d21cbd4badd/users/63bf5c1186bf49f8bcf852fe99076180/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:36.719103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4b560-1dec-409b-a38a-11d006ff88ab None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:36.720215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4b560-1dec-409b-a38a-11d006ff88ab None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:36.720783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4b560-1dec-409b-a38a-11d006ff88ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:36.835413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-10b4b560-1dec-409b-a38a-11d006ff88ab None None] MFA Rules not processed for user `63bf5c1186bf49f8bcf852fe99076180`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:36.837679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-10b4b560-1dec-409b-a38a-11d006ff88ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:37.034265 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1546/3099] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:37.057181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa7d69-795f-47c1-9c9c-7c876c7a135d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:37.058932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-31aa7d69-795f-47c1-9c9c-7c876c7a135d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:37.286431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa7d69-795f-47c1-9c9c-7c876c7a135d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:37.296280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22bc35-c172-4593-8ba5-7ed6a0dbdef6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:37.297323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22bc35-c172-4593-8ba5-7ed6a0dbdef6 service glance] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:37.297831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22bc35-c172-4593-8ba5-7ed6a0dbdef6 service glance] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:37.298326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22bc35-c172-4593-8ba5-7ed6a0dbdef6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:37.441054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22bc35-c172-4593-8ba5-7ed6a0dbdef6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:37.443990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22bc35-c172-4593-8ba5-7ed6a0dbdef6 service glance] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:37.465073 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1554/3100] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:24:37.781005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301a1c8-8774-4283-8cbc-6896bf90dd77 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:37.781989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301a1c8-8774-4283-8cbc-6896bf90dd77 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:37.782531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301a1c8-8774-4283-8cbc-6896bf90dd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:37.882654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b301a1c8-8774-4283-8cbc-6896bf90dd77 None None] MFA Rules not processed for user `2856471176174dd7a2465a816eef3acc`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:37.885676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b301a1c8-8774-4283-8cbc-6896bf90dd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:38.083098 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1547/3101] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:38.096725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c0959-6793-4441-89a3-0f6adb041578 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:38.096725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c0959-6793-4441-89a3-0f6adb041578 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:38.096725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c0959-6793-4441-89a3-0f6adb041578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:38.128400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-242c0959-6793-4441-89a3-0f6adb041578 None None] MFA Rules not processed for user `2856471176174dd7a2465a816eef3acc`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:38.131750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-242c0959-6793-4441-89a3-0f6adb041578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:38.173159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301a1c8-8774-4283-8cbc-6896bf90dd77 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:38.174725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b301a1c8-8774-4283-8cbc-6896bf90dd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:38.181756 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1555/3102] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:38.399533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301a1c8-8774-4283-8cbc-6896bf90dd77 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:38.423668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4570a0-4eb4-4573-9038-517b64637a64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:38.424841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4570a0-4eb4-4573-9038-517b64637a64 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:38.425138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4570a0-4eb4-4573-9038-517b64637a64 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:38.425420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4570a0-4eb4-4573-9038-517b64637a64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:38.439991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4570a0-4eb4-4573-9038-517b64637a64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:38.442160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4570a0-4eb4-4573-9038-517b64637a64 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:38.461469 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1548/3103] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:24:39.966027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c0959-6793-4441-89a3-0f6adb041578 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:40.201778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c0959-6793-4441-89a3-0f6adb041578 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:40.220470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f367a8-5a8b-4571-8d3a-3edfe3a3d1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:40.221845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f367a8-5a8b-4571-8d3a-3edfe3a3d1f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:40.222316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f367a8-5a8b-4571-8d3a-3edfe3a3d1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:40.226660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f367a8-5a8b-4571-8d3a-3edfe3a3d1f6 admin admin] PATH_INFO: `/v3/users/16dcf7ac85944972adb3bcbcbd943c66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:40.233230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f367a8-5a8b-4571-8d3a-3edfe3a3d1f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16dcf7ac85944972adb3bcbcbd943c66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:40.246614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f367a8-5a8b-4571-8d3a-3edfe3a3d1f6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:41.061172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-01f367a8-5a8b-4571-8d3a-3edfe3a3d1f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16dcf7ac85944972adb3bcbcbd943c66'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:41.105580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-01f367a8-5a8b-4571-8d3a-3edfe3a3d1f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16dcf7ac85944972adb3bcbcbd943c66'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:41.111698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-01f367a8-5a8b-4571-8d3a-3edfe3a3d1f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16dcf7ac85944972adb3bcbcbd943c66'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:41.121737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-01f367a8-5a8b-4571-8d3a-3edfe3a3d1f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16dcf7ac85944972adb3bcbcbd943c66'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:41.198983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-01f367a8-5a8b-4571-8d3a-3edfe3a3d1f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16dcf7ac85944972adb3bcbcbd943c66'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:41.206676 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1556/3104] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:24:39 2022] DELETE /identity/v3/users/16dcf7ac85944972adb3bcbcbd943c66 => generated 0 bytes in 1241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:41.212077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce279669-7f40-48d6-8b15-0dd6680c265b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:41.212534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce279669-7f40-48d6-8b15-0dd6680c265b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:41.212694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce279669-7f40-48d6-8b15-0dd6680c265b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:41.246835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ce279669-7f40-48d6-8b15-0dd6680c265b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:41.253201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ce279669-7f40-48d6-8b15-0dd6680c265b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:41.343020 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1549/3105] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:41.350105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f367a8-5a8b-4571-8d3a-3edfe3a3d1f6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:41.351561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-01f367a8-5a8b-4571-8d3a-3edfe3a3d1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:41.461622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f367a8-5a8b-4571-8d3a-3edfe3a3d1f6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:41.465673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7532072-5c28-450c-9684-53569d887f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:41.466587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7532072-5c28-450c-9684-53569d887f27 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:41.467092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7532072-5c28-450c-9684-53569d887f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:41.468314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7532072-5c28-450c-9684-53569d887f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:41.505724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7532072-5c28-450c-9684-53569d887f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:41.507580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7532072-5c28-450c-9684-53569d887f27 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:41.521164 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1557/3106] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:24:42.289986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce279669-7f40-48d6-8b15-0dd6680c265b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:42.292326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ce279669-7f40-48d6-8b15-0dd6680c265b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:42.319023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce279669-7f40-48d6-8b15-0dd6680c265b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:42.331180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892b62a-b60b-45e0-b9ec-8e49a867ed7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:42.342062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892b62a-b60b-45e0-b9ec-8e49a867ed7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:42.342062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892b62a-b60b-45e0-b9ec-8e49a867ed7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:42.342062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892b62a-b60b-45e0-b9ec-8e49a867ed7f admin admin] PATH_INFO: `/v3/projects/c26319a9757644619eea0f96396a0458` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:42.342062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892b62a-b60b-45e0-b9ec-8e49a867ed7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c26319a9757644619eea0f96396a0458)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:42.342062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892b62a-b60b-45e0-b9ec-8e49a867ed7f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:42.473026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b892b62a-b60b-45e0-b9ec-8e49a867ed7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c26319a9757644619eea0f96396a0458', 'request_id': 'req-b892b62a-b60b-45e0-b9ec-8e49a867ed7f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:42.618832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b892b62a-b60b-45e0-b9ec-8e49a867ed7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c26319a9757644619eea0f96396a0458', 'request_id': 'req-b892b62a-b60b-45e0-b9ec-8e49a867ed7f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:42.623765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b892b62a-b60b-45e0-b9ec-8e49a867ed7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c26319a9757644619eea0f96396a0458', 'request_id': 'req-b892b62a-b60b-45e0-b9ec-8e49a867ed7f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:42.647204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b892b62a-b60b-45e0-b9ec-8e49a867ed7f admin admin] The token cache is being invalidate because project c26319a9757644619eea0f96396a0458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:24:42.647928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b892b62a-b60b-45e0-b9ec-8e49a867ed7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:42.649049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b892b62a-b60b-45e0-b9ec-8e49a867ed7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:42.664065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7532072-5c28-450c-9684-53569d887f27 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:42.665838 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1550/3107] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:24:42 2022] DELETE /identity/v3/projects/c26319a9757644619eea0f96396a0458 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:42.677563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7532072-5c28-450c-9684-53569d887f27 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:42.791412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331a491-b6d8-4a5f-bdf5-b9287e759bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:42.793441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331a491-b6d8-4a5f-bdf5-b9287e759bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:42.793889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331a491-b6d8-4a5f-bdf5-b9287e759bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:42.794350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331a491-b6d8-4a5f-bdf5-b9287e759bc4 admin admin] PATH_INFO: `/v3/users/63bf5c1186bf49f8bcf852fe99076180` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:42.796869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331a491-b6d8-4a5f-bdf5-b9287e759bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63bf5c1186bf49f8bcf852fe99076180)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:42.799139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331a491-b6d8-4a5f-bdf5-b9287e759bc4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:43.053159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e331a491-b6d8-4a5f-bdf5-b9287e759bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63bf5c1186bf49f8bcf852fe99076180'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:43.068126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e331a491-b6d8-4a5f-bdf5-b9287e759bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63bf5c1186bf49f8bcf852fe99076180'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:43.069136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e331a491-b6d8-4a5f-bdf5-b9287e759bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63bf5c1186bf49f8bcf852fe99076180'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:43.096358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e331a491-b6d8-4a5f-bdf5-b9287e759bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63bf5c1186bf49f8bcf852fe99076180'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:43.270093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e331a491-b6d8-4a5f-bdf5-b9287e759bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63bf5c1186bf49f8bcf852fe99076180'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:43.282375 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1558/3108] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:24:42 2022] DELETE /identity/v3/users/63bf5c1186bf49f8bcf852fe99076180 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:43.853881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892b62a-b60b-45e0-b9ec-8e49a867ed7f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:43.856091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b892b62a-b60b-45e0-b9ec-8e49a867ed7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:43.890250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892b62a-b60b-45e0-b9ec-8e49a867ed7f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:44.045645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76f055-c07c-47b0-b8dc-a82963fb7faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:44.047303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76f055-c07c-47b0-b8dc-a82963fb7faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:44.047590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76f055-c07c-47b0-b8dc-a82963fb7faa admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:44.047867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76f055-c07c-47b0-b8dc-a82963fb7faa admin admin] PATH_INFO: `/v3/projects/9cd9c4fd3f3c4200a4085d21cbd4badd` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:44.050378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76f055-c07c-47b0-b8dc-a82963fb7faa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cd9c4fd3f3c4200a4085d21cbd4badd)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:44.053972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76f055-c07c-47b0-b8dc-a82963fb7faa admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:44.236192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fb76f055-c07c-47b0-b8dc-a82963fb7faa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd9c4fd3f3c4200a4085d21cbd4badd', 'request_id': 'req-fb76f055-c07c-47b0-b8dc-a82963fb7faa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:44.338029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fb76f055-c07c-47b0-b8dc-a82963fb7faa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd9c4fd3f3c4200a4085d21cbd4badd', 'request_id': 'req-fb76f055-c07c-47b0-b8dc-a82963fb7faa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:44.350196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fb76f055-c07c-47b0-b8dc-a82963fb7faa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd9c4fd3f3c4200a4085d21cbd4badd', 'request_id': 'req-fb76f055-c07c-47b0-b8dc-a82963fb7faa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:44.386878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fb76f055-c07c-47b0-b8dc-a82963fb7faa admin admin] The token cache is being invalidate because project 9cd9c4fd3f3c4200a4085d21cbd4badd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:24:44.387281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fb76f055-c07c-47b0-b8dc-a82963fb7faa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:44.388356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fb76f055-c07c-47b0-b8dc-a82963fb7faa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:44.391137 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1551/3109] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:24:43 2022] DELETE /identity/v3/projects/9cd9c4fd3f3c4200a4085d21cbd4badd => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:44.398065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bae88b-231c-4f0b-a321-cfda3cd8213e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:44.398540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bae88b-231c-4f0b-a321-cfda3cd8213e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:44.399566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bae88b-231c-4f0b-a321-cfda3cd8213e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:44.437418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-93bae88b-231c-4f0b-a321-cfda3cd8213e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:44.439183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-93bae88b-231c-4f0b-a321-cfda3cd8213e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:44.496701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76f055-c07c-47b0-b8dc-a82963fb7faa admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:44.498692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fb76f055-c07c-47b0-b8dc-a82963fb7faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:44.551832 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1559/3110] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:44.557296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87363eb1-1ddc-4c9e-a3cd-6cf04e5e8824 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:44.557296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87363eb1-1ddc-4c9e-a3cd-6cf04e5e8824 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:44.557296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87363eb1-1ddc-4c9e-a3cd-6cf04e5e8824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:44.580839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-87363eb1-1ddc-4c9e-a3cd-6cf04e5e8824 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:44.583696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-87363eb1-1ddc-4c9e-a3cd-6cf04e5e8824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:44.595348 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1560/3111] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:44.599897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87363eb1-1ddc-4c9e-a3cd-6cf04e5e8824 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:44.637111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87363eb1-1ddc-4c9e-a3cd-6cf04e5e8824 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:44.650149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be6ee2-6ca2-4002-bee3-6716053522fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:44.654936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be6ee2-6ca2-4002-bee3-6716053522fe admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:44.654936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be6ee2-6ca2-4002-bee3-6716053522fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:44.654936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be6ee2-6ca2-4002-bee3-6716053522fe admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:44.654936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be6ee2-6ca2-4002-bee3-6716053522fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:24:44.654936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be6ee2-6ca2-4002-bee3-6716053522fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:44.657230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be6ee2-6ca2-4002-bee3-6716053522fe admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:44.666553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76f055-c07c-47b0-b8dc-a82963fb7faa admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:44.671085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8dc5c-9fed-454b-9bb8-de767e58aeb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:44.672427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8dc5c-9fed-454b-9bb8-de767e58aeb6 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:44.672763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8dc5c-9fed-454b-9bb8-de767e58aeb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:44.673050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8dc5c-9fed-454b-9bb8-de767e58aeb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:44.675926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-eae8dc5c-9fed-454b-9bb8-de767e58aeb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:44.692108 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1561/3112] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:24:44.694692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be6ee2-6ca2-4002-bee3-6716053522fe admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:44.745334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be6ee2-6ca2-4002-bee3-6716053522fe admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:44.758643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94c514-409e-4384-9dca-d8b49db1a65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:44.760160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94c514-409e-4384-9dca-d8b49db1a65c admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:44.760469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94c514-409e-4384-9dca-d8b49db1a65c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:44.760796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94c514-409e-4384-9dca-d8b49db1a65c admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:44.763052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94c514-409e-4384-9dca-d8b49db1a65c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:44.771325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94c514-409e-4384-9dca-d8b49db1a65c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:44.821510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8dc5c-9fed-454b-9bb8-de767e58aeb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:44.823323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8dc5c-9fed-454b-9bb8-de767e58aeb6 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:44.840385 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1552/3113] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:24:44.947501 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1562/3114] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:24:44 2022] POST /identity/v3/projects => generated 367 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:44.948936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8dc5c-9fed-454b-9bb8-de767e58aeb6 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:44.980331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8dc5c-9fed-454b-9bb8-de767e58aeb6 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:45.130806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35873574-141e-40fa-8ef4-83e7dc39faed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:45.131809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35873574-141e-40fa-8ef4-83e7dc39faed admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:45.131809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35873574-141e-40fa-8ef4-83e7dc39faed admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:45.132104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35873574-141e-40fa-8ef4-83e7dc39faed admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:45.132857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35873574-141e-40fa-8ef4-83e7dc39faed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:45.134897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35873574-141e-40fa-8ef4-83e7dc39faed admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:45.448995 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1553/3115] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:24:44 2022] POST /identity/v3/users => generated 284 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:24:45.452190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94c514-409e-4384-9dca-d8b49db1a65c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:45.466011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94c514-409e-4384-9dca-d8b49db1a65c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:45.472566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903965c-5974-4bfa-9dac-35c2cfd01945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:45.476388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903965c-5974-4bfa-9dac-35c2cfd01945 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:45.476388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903965c-5974-4bfa-9dac-35c2cfd01945 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:45.476388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903965c-5974-4bfa-9dac-35c2cfd01945 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:45.476388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903965c-5974-4bfa-9dac-35c2cfd01945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:45.478540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903965c-5974-4bfa-9dac-35c2cfd01945 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:45.516982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35873574-141e-40fa-8ef4-83e7dc39faed admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:45.517539 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1563/3116] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:45.534337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35873574-141e-40fa-8ef4-83e7dc39faed admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:45.540322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794b126-cf61-40f5-a8af-7baabaa77903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:45.541519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794b126-cf61-40f5-a8af-7baabaa77903 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:45.541519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794b126-cf61-40f5-a8af-7baabaa77903 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:45.541885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794b126-cf61-40f5-a8af-7baabaa77903 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:45.542699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794b126-cf61-40f5-a8af-7baabaa77903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:45.544940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794b126-cf61-40f5-a8af-7baabaa77903 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:45.559143 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1554/3117] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:24:45.561813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903965c-5974-4bfa-9dac-35c2cfd01945 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:45.582128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903965c-5974-4bfa-9dac-35c2cfd01945 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:45.588256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4eb325-656f-4527-89db-6a4857fe93e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:45.589204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4eb325-656f-4527-89db-6a4857fe93e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:45.589484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4eb325-656f-4527-89db-6a4857fe93e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:45.589910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4eb325-656f-4527-89db-6a4857fe93e8 admin admin] PATH_INFO: `/v3/projects/2f16747e1ab64892a2a6061b5c2a81bf/users/dbffd5199a0c4af6b3f5f5bcb5ce1fee/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:45.611899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4eb325-656f-4527-89db-6a4857fe93e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f16747e1ab64892a2a6061b5c2a81bf, user_id=dbffd5199a0c4af6b3f5f5bcb5ce1fee, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:45.614823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4eb325-656f-4527-89db-6a4857fe93e8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:45.824043 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1564/3118] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:24:45 2022] PUT /identity/v3/projects/2f16747e1ab64892a2a6061b5c2a81bf/users/dbffd5199a0c4af6b3f5f5bcb5ce1fee/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:45.843160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1be20-fd16-4564-9466-fabc9d0c428c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:45.843535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1be20-fd16-4564-9466-fabc9d0c428c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:45.843871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1be20-fd16-4564-9466-fabc9d0c428c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:45.950362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-50b1be20-fd16-4564-9466-fabc9d0c428c None None] MFA Rules not processed for user `dbffd5199a0c4af6b3f5f5bcb5ce1fee`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:45.959286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-50b1be20-fd16-4564-9466-fabc9d0c428c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:46.150357 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1555/3119] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:24:46.155172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4eb325-656f-4527-89db-6a4857fe93e8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:46.302087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4eb325-656f-4527-89db-6a4857fe93e8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:46.307839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce9a73-62df-4144-be58-52586e640305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:46.308790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce9a73-62df-4144-be58-52586e640305 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:46.309241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce9a73-62df-4144-be58-52586e640305 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:46.310094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce9a73-62df-4144-be58-52586e640305 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:46.311101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce9a73-62df-4144-be58-52586e640305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:46.313881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce9a73-62df-4144-be58-52586e640305 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:46.440820 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1565/3120] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:24:46 2022] POST /identity/v3/projects => generated 367 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:24:46.444701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1be20-fd16-4564-9466-fabc9d0c428c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:46.456189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1be20-fd16-4564-9466-fabc9d0c428c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:46.521946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b658bf-30c5-4212-8aed-3d52dcc45b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:46.522629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b658bf-30c5-4212-8aed-3d52dcc45b98 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:46.522912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b658bf-30c5-4212-8aed-3d52dcc45b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:46.523188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b658bf-30c5-4212-8aed-3d52dcc45b98 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:46.523881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b658bf-30c5-4212-8aed-3d52dcc45b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:46.526136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b658bf-30c5-4212-8aed-3d52dcc45b98 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:46.532380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce9a73-62df-4144-be58-52586e640305 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:46.534204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-62ce9a73-62df-4144-be58-52586e640305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:46.623202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce9a73-62df-4144-be58-52586e640305 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:46.630158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27895d-0e38-4258-9d98-f000a248b3ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:46.630958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27895d-0e38-4258-9d98-f000a248b3ef service glance] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:46.631350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27895d-0e38-4258-9d98-f000a248b3ef service glance] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:46.631736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27895d-0e38-4258-9d98-f000a248b3ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:46.634282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cb27895d-0e38-4258-9d98-f000a248b3ef service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:46.668121 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1556/3121] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:24:46 2022] POST /identity/v3/users => generated 284 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:24:46.669380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b658bf-30c5-4212-8aed-3d52dcc45b98 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:46.681575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b658bf-30c5-4212-8aed-3d52dcc45b98 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:46.696946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58037f1f-1f9a-4ef0-819c-8ce3c70c616c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:46.696946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58037f1f-1f9a-4ef0-819c-8ce3c70c616c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:46.696946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58037f1f-1f9a-4ef0-819c-8ce3c70c616c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:46.696946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58037f1f-1f9a-4ef0-819c-8ce3c70c616c admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:46.697395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58037f1f-1f9a-4ef0-819c-8ce3c70c616c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:46.697395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58037f1f-1f9a-4ef0-819c-8ce3c70c616c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:46.711738 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1557/3122] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:46.716378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58037f1f-1f9a-4ef0-819c-8ce3c70c616c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:46.730891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58037f1f-1f9a-4ef0-819c-8ce3c70c616c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:46.748630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6aa22-2856-42f8-83f3-b6c625aa218e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:46.749512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6aa22-2856-42f8-83f3-b6c625aa218e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:46.749901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6aa22-2856-42f8-83f3-b6c625aa218e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:46.750298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6aa22-2856-42f8-83f3-b6c625aa218e admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:46.751174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6aa22-2856-42f8-83f3-b6c625aa218e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:46.753186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6aa22-2856-42f8-83f3-b6c625aa218e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:46.766361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27895d-0e38-4258-9d98-f000a248b3ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:46.767675 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1558/3123] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:46.768758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27895d-0e38-4258-9d98-f000a248b3ef service glance] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:46.771775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6aa22-2856-42f8-83f3-b6c625aa218e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:46.783524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6aa22-2856-42f8-83f3-b6c625aa218e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:46.789860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd2e7d-dae7-40b6-94d2-d9d8185ce7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:46.790957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd2e7d-dae7-40b6-94d2-d9d8185ce7cd admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:46.791347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd2e7d-dae7-40b6-94d2-d9d8185ce7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:46.791775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd2e7d-dae7-40b6-94d2-d9d8185ce7cd admin admin] PATH_INFO: `/v3/projects/bc5bf7955972427894d764feadb2a865/users/8e2b658622fb4daf950a5453d72c1256/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:46.796209 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1566/3124] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:24:46.822017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd2e7d-dae7-40b6-94d2-d9d8185ce7cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5bf7955972427894d764feadb2a865, user_id=8e2b658622fb4daf950a5453d72c1256, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:46.825448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd2e7d-dae7-40b6-94d2-d9d8185ce7cd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:46.947624 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1559/3125] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:24:46 2022] PUT /identity/v3/projects/bc5bf7955972427894d764feadb2a865/users/8e2b658622fb4daf950a5453d72c1256/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:46.954817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a3328-bfb8-4e29-926a-5642a54f7b1e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:46.955241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a3328-bfb8-4e29-926a-5642a54f7b1e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:46.956050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a3328-bfb8-4e29-926a-5642a54f7b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:47.026131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-cb6a3328-bfb8-4e29-926a-5642a54f7b1e None None] MFA Rules not processed for user `8e2b658622fb4daf950a5453d72c1256`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:47.032223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cb6a3328-bfb8-4e29-926a-5642a54f7b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:47.181850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a3bd5-e586-4d1b-a08d-0eaeca7be80a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:47.183971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a3bd5-e586-4d1b-a08d-0eaeca7be80a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:47.189050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a3bd5-e586-4d1b-a08d-0eaeca7be80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:47.217463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-171a3bd5-e586-4d1b-a08d-0eaeca7be80a None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:47.220535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-171a3bd5-e586-4d1b-a08d-0eaeca7be80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:47.222493 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1567/3126] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:47.247238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a3328-bfb8-4e29-926a-5642a54f7b1e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:47.247238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cb6a3328-bfb8-4e29-926a-5642a54f7b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:47.297559 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1560/3127] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:24:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:47.311270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a3bd5-e586-4d1b-a08d-0eaeca7be80a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:47.312739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-171a3bd5-e586-4d1b-a08d-0eaeca7be80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:47.333523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a3328-bfb8-4e29-926a-5642a54f7b1e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:47.337133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6109926-7cc5-438f-bdfd-c76e6146c1ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:47.337782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6109926-7cc5-438f-bdfd-c76e6146c1ab service glance] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:47.338066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6109926-7cc5-438f-bdfd-c76e6146c1ab service glance] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:47.338341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6109926-7cc5-438f-bdfd-c76e6146c1ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:47.382581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a3bd5-e586-4d1b-a08d-0eaeca7be80a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:47.387572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4bfc03-079a-43c3-8dc1-b3a7020613a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:47.388247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bfc03-079a-43c3-8dc1-b3a7020613a4 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:47.388581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bfc03-079a-43c3-8dc1-b3a7020613a4 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:47.388917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bfc03-079a-43c3-8dc1-b3a7020613a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:47.394968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6109926-7cc5-438f-bdfd-c76e6146c1ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:47.396413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6109926-7cc5-438f-bdfd-c76e6146c1ab service glance] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:47.397277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4bfc03-079a-43c3-8dc1-b3a7020613a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:47.398921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4bfc03-079a-43c3-8dc1-b3a7020613a4 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:47.405662 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1568/3128] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:47 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:24:47.407761 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1561/3129] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:24:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:24:47.433018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62d697-9f37-4126-894a-683f3575cfc5 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:47.433306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62d697-9f37-4126-894a-683f3575cfc5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:47.433590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62d697-9f37-4126-894a-683f3575cfc5 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:47.435044 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1569/3130] 10.222.0.16 () {54 vars in 963 bytes} [Mon May 2 10:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:24:47.439947 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73fcc2-3c74-42af-a60e-037360ce31ef None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:47.440243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73fcc2-3c74-42af-a60e-037360ce31ef None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:47.440523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73fcc2-3c74-42af-a60e-037360ce31ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:47.487521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-5c73fcc2-3c74-42af-a60e-037360ce31ef None None] MFA Rules not processed for user `8eab371b02c34a13b629eacdf504dbdb`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:47.488862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5c73fcc2-3c74-42af-a60e-037360ce31ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:47.561407 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1562/3131] 10.222.0.16 () {58 vars in 1060 bytes} [Mon May 2 10:24:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:47.562669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62d697-9f37-4126-894a-683f3575cfc5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:47.574892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62d697-9f37-4126-894a-683f3575cfc5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:47.579111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04c6bf-df4f-45f8-81c4-2dbdd25e8a7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:47.579866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04c6bf-df4f-45f8-81c4-2dbdd25e8a7a service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:47.580248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04c6bf-df4f-45f8-81c4-2dbdd25e8a7a service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:47.581221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04c6bf-df4f-45f8-81c4-2dbdd25e8a7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:47.583716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8f04c6bf-df4f-45f8-81c4-2dbdd25e8a7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:47.656640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04c6bf-df4f-45f8-81c4-2dbdd25e8a7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:47.658218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04c6bf-df4f-45f8-81c4-2dbdd25e8a7a service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:47.680948 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1570/3132] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:24:47.746235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73fcc2-3c74-42af-a60e-037360ce31ef None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:47.771409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73fcc2-3c74-42af-a60e-037360ce31ef None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:47.771409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fd703-d371-4703-8a20-9e03fdb32792 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:47.771409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fd703-d371-4703-8a20-9e03fdb32792 service glance] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:47.771409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fd703-d371-4703-8a20-9e03fdb32792 service glance] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:47.771817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fd703-d371-4703-8a20-9e03fdb32792 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:47.778422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fd703-d371-4703-8a20-9e03fdb32792 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:47.780747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fd703-d371-4703-8a20-9e03fdb32792 service glance] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:47.789525 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1563/3133] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:47 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:24:48.954418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32f8ae-cc9b-407a-8584-e4f01332853f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:48.954927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32f8ae-cc9b-407a-8584-e4f01332853f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:48.955034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32f8ae-cc9b-407a-8584-e4f01332853f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:48.972663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7c32f8ae-cc9b-407a-8584-e4f01332853f None None] MFA Rules not processed for user `e83fd687fcc74495a7ea73f0e001419b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:48.973878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7c32f8ae-cc9b-407a-8584-e4f01332853f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:49.047211 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1571/3134] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:49.702594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fd703-d371-4703-8a20-9e03fdb32792 service glance] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:49.704144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4c3fd703-d371-4703-8a20-9e03fdb32792 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:49.780297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fd703-d371-4703-8a20-9e03fdb32792 service glance] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:49.786085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52766d32-9ae2-4958-8b1f-8206fd6db7e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:49.786733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52766d32-9ae2-4958-8b1f-8206fd6db7e4 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:49.787007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52766d32-9ae2-4958-8b1f-8206fd6db7e4 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:49.787338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52766d32-9ae2-4958-8b1f-8206fd6db7e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:49.789257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-52766d32-9ae2-4958-8b1f-8206fd6db7e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:49.801973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52766d32-9ae2-4958-8b1f-8206fd6db7e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:49.803623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52766d32-9ae2-4958-8b1f-8206fd6db7e4 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:49.814088 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1564/3135] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:24:50.854468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32f8ae-cc9b-407a-8584-e4f01332853f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:50.974420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32f8ae-cc9b-407a-8584-e4f01332853f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:50.980947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62739ddd-4385-482c-a37f-fac836325907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:50.983607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62739ddd-4385-482c-a37f-fac836325907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:50.984714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62739ddd-4385-482c-a37f-fac836325907 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:50.985257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62739ddd-4385-482c-a37f-fac836325907 admin admin] PATH_INFO: `/v3/users/dbffd5199a0c4af6b3f5f5bcb5ce1fee` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:50.987225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62739ddd-4385-482c-a37f-fac836325907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbffd5199a0c4af6b3f5f5bcb5ce1fee)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:50.989452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62739ddd-4385-482c-a37f-fac836325907 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:51.258510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-62739ddd-4385-482c-a37f-fac836325907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbffd5199a0c4af6b3f5f5bcb5ce1fee'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:51.270849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-62739ddd-4385-482c-a37f-fac836325907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbffd5199a0c4af6b3f5f5bcb5ce1fee'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:51.271557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-62739ddd-4385-482c-a37f-fac836325907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbffd5199a0c4af6b3f5f5bcb5ce1fee'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:51.278944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-62739ddd-4385-482c-a37f-fac836325907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbffd5199a0c4af6b3f5f5bcb5ce1fee'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:51.345177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-62739ddd-4385-482c-a37f-fac836325907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbffd5199a0c4af6b3f5f5bcb5ce1fee'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:51.354982 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1572/3136] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:24:50 2022] DELETE /identity/v3/users/dbffd5199a0c4af6b3f5f5bcb5ce1fee => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:51.358396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cf858-f465-4d3a-9fe2-6413d46a0704 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:51.358853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cf858-f465-4d3a-9fe2-6413d46a0704 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:51.358941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cf858-f465-4d3a-9fe2-6413d46a0704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:51.379173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-399cf858-f465-4d3a-9fe2-6413d46a0704 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:51.381040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-399cf858-f465-4d3a-9fe2-6413d46a0704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:51.455568 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1565/3137] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:51.479008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62739ddd-4385-482c-a37f-fac836325907 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:51.484984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-62739ddd-4385-482c-a37f-fac836325907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:51.544025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62739ddd-4385-482c-a37f-fac836325907 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:51.547806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144c769-a16a-4af0-9bc6-e47ba1e4eee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:51.548460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144c769-a16a-4af0-9bc6-e47ba1e4eee0 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:51.548830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144c769-a16a-4af0-9bc6-e47ba1e4eee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:51.549112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144c769-a16a-4af0-9bc6-e47ba1e4eee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:51.568644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144c769-a16a-4af0-9bc6-e47ba1e4eee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:51.569992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144c769-a16a-4af0-9bc6-e47ba1e4eee0 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:51.586739 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1573/3138] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:24:51.588641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393eb6c1-6821-43b1-9f3b-26aa9f0501fa None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:51.589304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393eb6c1-6821-43b1-9f3b-26aa9f0501fa None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:51.589511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393eb6c1-6821-43b1-9f3b-26aa9f0501fa None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:51.590878 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1566/3139] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:24:51.599432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be4d33-eab0-4953-9283-e04bd81ee11a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:51.600901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be4d33-eab0-4953-9283-e04bd81ee11a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:51.601262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be4d33-eab0-4953-9283-e04bd81ee11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:51.623819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-53be4d33-eab0-4953-9283-e04bd81ee11a None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:51.625366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-53be4d33-eab0-4953-9283-e04bd81ee11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:51.696222 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1574/3140] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:24:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:51.720675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393eb6c1-6821-43b1-9f3b-26aa9f0501fa None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:51.722439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-393eb6c1-6821-43b1-9f3b-26aa9f0501fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:51.742017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393eb6c1-6821-43b1-9f3b-26aa9f0501fa None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:51.747327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402732db-53a5-413a-a675-51805f8395d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:51.747980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402732db-53a5-413a-a675-51805f8395d7 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:51.748271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402732db-53a5-413a-a675-51805f8395d7 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:51.748844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402732db-53a5-413a-a675-51805f8395d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:51.757435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402732db-53a5-413a-a675-51805f8395d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:51.759005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402732db-53a5-413a-a675-51805f8395d7 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:51.770328 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1567/3141] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:24:52.111969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be4d33-eab0-4953-9283-e04bd81ee11a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:52.113672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-53be4d33-eab0-4953-9283-e04bd81ee11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:52.137525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be4d33-eab0-4953-9283-e04bd81ee11a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:52.143341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3c762-2f41-42ec-834e-cad231efff5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:52.144208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3c762-2f41-42ec-834e-cad231efff5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:52.144493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3c762-2f41-42ec-834e-cad231efff5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:52.144805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3c762-2f41-42ec-834e-cad231efff5e admin admin] PATH_INFO: `/v3/projects/2f16747e1ab64892a2a6061b5c2a81bf` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:52.145994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3c762-2f41-42ec-834e-cad231efff5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f16747e1ab64892a2a6061b5c2a81bf)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:52.148060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3c762-2f41-42ec-834e-cad231efff5e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:52.350013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ddd3c762-2f41-42ec-834e-cad231efff5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f16747e1ab64892a2a6061b5c2a81bf', 'request_id': 'req-ddd3c762-2f41-42ec-834e-cad231efff5e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:52.356325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ddd3c762-2f41-42ec-834e-cad231efff5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f16747e1ab64892a2a6061b5c2a81bf', 'request_id': 'req-ddd3c762-2f41-42ec-834e-cad231efff5e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:52.466721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ddd3c762-2f41-42ec-834e-cad231efff5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f16747e1ab64892a2a6061b5c2a81bf', 'request_id': 'req-ddd3c762-2f41-42ec-834e-cad231efff5e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:52.477257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ddd3c762-2f41-42ec-834e-cad231efff5e admin admin] The token cache is being invalidate because project 2f16747e1ab64892a2a6061b5c2a81bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:24:52.477542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ddd3c762-2f41-42ec-834e-cad231efff5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:52.478156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ddd3c762-2f41-42ec-834e-cad231efff5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:52.479714 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1575/3142] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:24:52 2022] DELETE /identity/v3/projects/2f16747e1ab64892a2a6061b5c2a81bf => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:52.484343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402732db-53a5-413a-a675-51805f8395d7 service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:52.496042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402732db-53a5-413a-a675-51805f8395d7 service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:52.593785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcce7d8-4e50-4a93-837a-2811e0ce0881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:52.594751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcce7d8-4e50-4a93-837a-2811e0ce0881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:52.595088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcce7d8-4e50-4a93-837a-2811e0ce0881 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:52.595358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcce7d8-4e50-4a93-837a-2811e0ce0881 admin admin] PATH_INFO: `/v3/users/8e2b658622fb4daf950a5453d72c1256` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:52.596670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcce7d8-4e50-4a93-837a-2811e0ce0881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e2b658622fb4daf950a5453d72c1256)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:52.606139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcce7d8-4e50-4a93-837a-2811e0ce0881 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:52.983092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9bcce7d8-4e50-4a93-837a-2811e0ce0881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e2b658622fb4daf950a5453d72c1256'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:53.007759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9bcce7d8-4e50-4a93-837a-2811e0ce0881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e2b658622fb4daf950a5453d72c1256'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:53.009821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9bcce7d8-4e50-4a93-837a-2811e0ce0881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e2b658622fb4daf950a5453d72c1256'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:53.021902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9bcce7d8-4e50-4a93-837a-2811e0ce0881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e2b658622fb4daf950a5453d72c1256'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:53.144256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9bcce7d8-4e50-4a93-837a-2811e0ce0881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e2b658622fb4daf950a5453d72c1256'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:53.158256 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1568/3143] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:24:52 2022] DELETE /identity/v3/users/8e2b658622fb4daf950a5453d72c1256 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:53.508262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3c762-2f41-42ec-834e-cad231efff5e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:53.509928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ddd3c762-2f41-42ec-834e-cad231efff5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:53.580573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3c762-2f41-42ec-834e-cad231efff5e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:53.635777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2747e6-67d5-455a-ba24-c93d7cc1e4e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:53.636442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2747e6-67d5-455a-ba24-c93d7cc1e4e3 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:53.636805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2747e6-67d5-455a-ba24-c93d7cc1e4e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:53.637126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2747e6-67d5-455a-ba24-c93d7cc1e4e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:53.639626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ec2747e6-67d5-455a-ba24-c93d7cc1e4e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:53.657538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2747e6-67d5-455a-ba24-c93d7cc1e4e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:53.657538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2747e6-67d5-455a-ba24-c93d7cc1e4e3 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:53.664120 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1576/3144] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:24:53.704962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcce7d8-4e50-4a93-837a-2811e0ce0881 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:53.707085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9bcce7d8-4e50-4a93-837a-2811e0ce0881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:53.781473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcce7d8-4e50-4a93-837a-2811e0ce0881 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:53.787340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94b0c6-0e8c-48ed-acc8-548bb682f540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:53.788540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94b0c6-0e8c-48ed-acc8-548bb682f540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:53.789108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94b0c6-0e8c-48ed-acc8-548bb682f540 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:53.789633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94b0c6-0e8c-48ed-acc8-548bb682f540 admin admin] PATH_INFO: `/v3/projects/bc5bf7955972427894d764feadb2a865` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:53.791691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94b0c6-0e8c-48ed-acc8-548bb682f540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc5bf7955972427894d764feadb2a865)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:53.794882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94b0c6-0e8c-48ed-acc8-548bb682f540 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:53.905708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e94b0c6-0e8c-48ed-acc8-548bb682f540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc5bf7955972427894d764feadb2a865', 'request_id': 'req-3e94b0c6-0e8c-48ed-acc8-548bb682f540'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:54.012720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e94b0c6-0e8c-48ed-acc8-548bb682f540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc5bf7955972427894d764feadb2a865', 'request_id': 'req-3e94b0c6-0e8c-48ed-acc8-548bb682f540'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:54.022234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e94b0c6-0e8c-48ed-acc8-548bb682f540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc5bf7955972427894d764feadb2a865', 'request_id': 'req-3e94b0c6-0e8c-48ed-acc8-548bb682f540'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:54.033942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e94b0c6-0e8c-48ed-acc8-548bb682f540 admin admin] The token cache is being invalidate because project bc5bf7955972427894d764feadb2a865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:24:54.034301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e94b0c6-0e8c-48ed-acc8-548bb682f540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:54.034932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e94b0c6-0e8c-48ed-acc8-548bb682f540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:24:54.040711 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1569/3145] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:24:53 2022] DELETE /identity/v3/projects/bc5bf7955972427894d764feadb2a865 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:54.045181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867e8d1-b5e7-4727-b3e4-2c2de71faf56 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:54.046249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867e8d1-b5e7-4727-b3e4-2c2de71faf56 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:54.046743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867e8d1-b5e7-4727-b3e4-2c2de71faf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:54.121154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3867e8d1-b5e7-4727-b3e4-2c2de71faf56 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:54.122466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3867e8d1-b5e7-4727-b3e4-2c2de71faf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:54.202062 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1577/3146] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:54.211292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d98d95-d456-4104-a42b-1576df2670a1 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:54.213180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d98d95-d456-4104-a42b-1576df2670a1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:54.216730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d98d95-d456-4104-a42b-1576df2670a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:54.234927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-17d98d95-d456-4104-a42b-1576df2670a1 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:54.236230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-17d98d95-d456-4104-a42b-1576df2670a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:54.245176 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1570/3147] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:54.249295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867e8d1-b5e7-4727-b3e4-2c2de71faf56 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:54.260051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867e8d1-b5e7-4727-b3e4-2c2de71faf56 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:54.265272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268d3fa-372d-405a-bd35-48194fd53a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:54.266576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268d3fa-372d-405a-bd35-48194fd53a2e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:54.266576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268d3fa-372d-405a-bd35-48194fd53a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:54.266576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268d3fa-372d-405a-bd35-48194fd53a2e admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:54.267451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268d3fa-372d-405a-bd35-48194fd53a2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:24:54.267894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268d3fa-372d-405a-bd35-48194fd53a2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:54.269607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268d3fa-372d-405a-bd35-48194fd53a2e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:54.284721 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1578/3148] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:24:54.289075 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d98d95-d456-4104-a42b-1576df2670a1 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:54.298798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c7fab-3b88-4c52-aec1-17bbea3c6a15 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:54.299191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c7fab-3b88-4c52-aec1-17bbea3c6a15 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:54.299339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d98d95-d456-4104-a42b-1576df2670a1 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:54.299691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c7fab-3b88-4c52-aec1-17bbea3c6a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:54.305059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee94aa-95a2-438f-9e93-bb723035293a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:54.307624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee94aa-95a2-438f-9e93-bb723035293a admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:54.307624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee94aa-95a2-438f-9e93-bb723035293a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:54.307624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee94aa-95a2-438f-9e93-bb723035293a admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:54.307624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee94aa-95a2-438f-9e93-bb723035293a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:54.309058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee94aa-95a2-438f-9e93-bb723035293a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:54.330801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-084c7fab-3b88-4c52-aec1-17bbea3c6a15 None None] MFA Rules not processed for user `1cf4f9c1eeb94bff96fa42d2f20d805f`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:54.330801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-084c7fab-3b88-4c52-aec1-17bbea3c6a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:54.416879 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1579/3149] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:54.432509 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1571/3150] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:24:54 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:54.434187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c7fab-3b88-4c52-aec1-17bbea3c6a15 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:54.446627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c7fab-3b88-4c52-aec1-17bbea3c6a15 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:54.515931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b1e9a-7e7f-4638-8595-260f9fa8f9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:54.517435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b1e9a-7e7f-4638-8595-260f9fa8f9ab admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:54.517876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b1e9a-7e7f-4638-8595-260f9fa8f9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:54.518306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b1e9a-7e7f-4638-8595-260f9fa8f9ab admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:54.519203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b1e9a-7e7f-4638-8595-260f9fa8f9ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:54.521415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b1e9a-7e7f-4638-8595-260f9fa8f9ab admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:54.657254 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1580/3151] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:24:54 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:54.661275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee94aa-95a2-438f-9e93-bb723035293a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:54.678530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee94aa-95a2-438f-9e93-bb723035293a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:54.684521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e98f57-cfc8-4667-aff4-1ea30f5e61b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:54.685658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e98f57-cfc8-4667-aff4-1ea30f5e61b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:54.685944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e98f57-cfc8-4667-aff4-1ea30f5e61b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:54.686228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e98f57-cfc8-4667-aff4-1ea30f5e61b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:54.687263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e98f57-cfc8-4667-aff4-1ea30f5e61b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:54.689350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e98f57-cfc8-4667-aff4-1ea30f5e61b0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:54.703363 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1572/3152] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:54.709861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b1e9a-7e7f-4638-8595-260f9fa8f9ab admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:54.722516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b1e9a-7e7f-4638-8595-260f9fa8f9ab admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:54.727379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbbc14-66d4-42b0-a6c0-bb03f1cda8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:54.728056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbbc14-66d4-42b0-a6c0-bb03f1cda8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:54.728345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbbc14-66d4-42b0-a6c0-bb03f1cda8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:54.728676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbbc14-66d4-42b0-a6c0-bb03f1cda8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:54.729413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbbc14-66d4-42b0-a6c0-bb03f1cda8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:54.731149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbbc14-66d4-42b0-a6c0-bb03f1cda8a8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:54.742682 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1581/3153] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:54.746025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e98f57-cfc8-4667-aff4-1ea30f5e61b0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:54.759214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e98f57-cfc8-4667-aff4-1ea30f5e61b0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:54.766396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946028b4-18f8-455b-9b86-f3be0e2093d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:54.767516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946028b4-18f8-455b-9b86-f3be0e2093d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:54.767996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946028b4-18f8-455b-9b86-f3be0e2093d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:54.768457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946028b4-18f8-455b-9b86-f3be0e2093d9 admin admin] PATH_INFO: `/v3/projects/8bc20eb284a14780b832c3c567850937/users/317b0225417142bcbe8751fd27cdf4ae/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:54.788374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946028b4-18f8-455b-9b86-f3be0e2093d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bc20eb284a14780b832c3c567850937, user_id=317b0225417142bcbe8751fd27cdf4ae, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:54.791962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946028b4-18f8-455b-9b86-f3be0e2093d9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:54.902775 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1573/3154] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:24:54 2022] PUT /identity/v3/projects/8bc20eb284a14780b832c3c567850937/users/317b0225417142bcbe8751fd27cdf4ae/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:54.916142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e56df-f579-44de-b307-448aa92bca21 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:54.916433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e56df-f579-44de-b307-448aa92bca21 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:54.916742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e56df-f579-44de-b307-448aa92bca21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:54.944716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6d1e56df-f579-44de-b307-448aa92bca21 None None] MFA Rules not processed for user `317b0225417142bcbe8751fd27cdf4ae`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:54.946215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6d1e56df-f579-44de-b307-448aa92bca21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:55.046118 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1582/3155] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:55.050586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946028b4-18f8-455b-9b86-f3be0e2093d9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:55.162413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946028b4-18f8-455b-9b86-f3be0e2093d9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:55.170191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a4130-be17-46ea-ad32-14e7cecc97b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:55.170191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a4130-be17-46ea-ad32-14e7cecc97b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:55.170473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a4130-be17-46ea-ad32-14e7cecc97b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:55.170906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a4130-be17-46ea-ad32-14e7cecc97b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:55.172118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a4130-be17-46ea-ad32-14e7cecc97b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:55.174813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a4130-be17-46ea-ad32-14e7cecc97b1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:55.313434 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1574/3156] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:24:55 2022] POST /identity/v3/projects => generated 385 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:24:55.318156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e56df-f579-44de-b307-448aa92bca21 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:55.330535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e56df-f579-44de-b307-448aa92bca21 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:55.394911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82136860-38e7-42b1-938c-319f0a7571b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:55.395621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82136860-38e7-42b1-938c-319f0a7571b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:55.395911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82136860-38e7-42b1-938c-319f0a7571b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:55.396191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82136860-38e7-42b1-938c-319f0a7571b1 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:55.396929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82136860-38e7-42b1-938c-319f0a7571b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:55.398951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82136860-38e7-42b1-938c-319f0a7571b1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:55.476312 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1583/3157] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:24:55 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:24:55.480584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a4130-be17-46ea-ad32-14e7cecc97b1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:55.496951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a4130-be17-46ea-ad32-14e7cecc97b1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:55.503234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30cd5f9-856f-45fc-a10a-c8d8edb1f6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:55.503918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cd5f9-856f-45fc-a10a-c8d8edb1f6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:55.504204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cd5f9-856f-45fc-a10a-c8d8edb1f6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:55.504488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cd5f9-856f-45fc-a10a-c8d8edb1f6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:55.505310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30cd5f9-856f-45fc-a10a-c8d8edb1f6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:55.506911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30cd5f9-856f-45fc-a10a-c8d8edb1f6e2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:55.518052 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1575/3158] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:55.522191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82136860-38e7-42b1-938c-319f0a7571b1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:55.532375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82136860-38e7-42b1-938c-319f0a7571b1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:55.537134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6ad1c-0933-47cc-96e6-6a30ed3a9b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:55.538028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6ad1c-0933-47cc-96e6-6a30ed3a9b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:55.538313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6ad1c-0933-47cc-96e6-6a30ed3a9b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:55.538595 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6ad1c-0933-47cc-96e6-6a30ed3a9b3b admin admin] PATH_INFO: `/v3/projects/fad8c5ef80c54e60953517fbaaeed299/users/b87592d223fb4513a820226bd0422212/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:55.554094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6ad1c-0933-47cc-96e6-6a30ed3a9b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad8c5ef80c54e60953517fbaaeed299, user_id=b87592d223fb4513a820226bd0422212, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:55.556760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6ad1c-0933-47cc-96e6-6a30ed3a9b3b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:55.633087 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1584/3159] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:24:55 2022] PUT /identity/v3/projects/fad8c5ef80c54e60953517fbaaeed299/users/b87592d223fb4513a820226bd0422212/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:55.636985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30cd5f9-856f-45fc-a10a-c8d8edb1f6e2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:55.647193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30cd5f9-856f-45fc-a10a-c8d8edb1f6e2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:55.711903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658557ac-5a44-49da-9109-5d9085b1e06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:55.712973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658557ac-5a44-49da-9109-5d9085b1e06a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:55.713476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658557ac-5a44-49da-9109-5d9085b1e06a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:55.713953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658557ac-5a44-49da-9109-5d9085b1e06a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:55.714881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658557ac-5a44-49da-9109-5d9085b1e06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:55.717539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658557ac-5a44-49da-9109-5d9085b1e06a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:55.730914 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1576/3160] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:24:55.735386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6ad1c-0933-47cc-96e6-6a30ed3a9b3b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:55.745821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6ad1c-0933-47cc-96e6-6a30ed3a9b3b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:55.751414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7a8fb-025c-4031-bc8c-fba11300324d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:55.752583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7a8fb-025c-4031-bc8c-fba11300324d admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:55.753111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7a8fb-025c-4031-bc8c-fba11300324d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:55.753633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7a8fb-025c-4031-bc8c-fba11300324d admin admin] PATH_INFO: `/v3/projects/fad8c5ef80c54e60953517fbaaeed299/users/b87592d223fb4513a820226bd0422212/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:55.755857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7a8fb-025c-4031-bc8c-fba11300324d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad8c5ef80c54e60953517fbaaeed299, user_id=b87592d223fb4513a820226bd0422212, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:55.758760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7a8fb-025c-4031-bc8c-fba11300324d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:55.773059 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1585/3161] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:24:55 2022] PUT /identity/v3/projects/fad8c5ef80c54e60953517fbaaeed299/users/b87592d223fb4513a820226bd0422212/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:24:55.785760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9688c-e045-4f3a-8e83-fa620947f155 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:55.786312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9688c-e045-4f3a-8e83-fa620947f155 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:55.786312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9688c-e045-4f3a-8e83-fa620947f155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:55.817482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b9b9688c-e045-4f3a-8e83-fa620947f155 None None] MFA Rules not processed for user `b87592d223fb4513a820226bd0422212`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:55.818704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b9b9688c-e045-4f3a-8e83-fa620947f155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:55.901288 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1577/3162] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:24:55.919717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7a8fb-025c-4031-bc8c-fba11300324d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:55.921489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-00e7a8fb-025c-4031-bc8c-fba11300324d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:56.073865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7a8fb-025c-4031-bc8c-fba11300324d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:56.083851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45d209-d2bd-4c2d-947b-4a1ec8287f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:56.084828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45d209-d2bd-4c2d-947b-4a1ec8287f22 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:56.086389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45d209-d2bd-4c2d-947b-4a1ec8287f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:56.086826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45d209-d2bd-4c2d-947b-4a1ec8287f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:56.213830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45d209-d2bd-4c2d-947b-4a1ec8287f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:56.215316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45d209-d2bd-4c2d-947b-4a1ec8287f22 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:56.228133 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1586/3163] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:24:57.063978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9688c-e045-4f3a-8e83-fa620947f155 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:57.078392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9688c-e045-4f3a-8e83-fa620947f155 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:57.088431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c7c5b-d3aa-4578-9154-390e590ac011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:57.089534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c7c5b-d3aa-4578-9154-390e590ac011 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:57.090042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c7c5b-d3aa-4578-9154-390e590ac011 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:57.090595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c7c5b-d3aa-4578-9154-390e590ac011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:57.106303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c7c5b-d3aa-4578-9154-390e590ac011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:57.108803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c7c5b-d3aa-4578-9154-390e590ac011 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:57.121341 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1578/3164] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:24:57.249011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45d209-d2bd-4c2d-947b-4a1ec8287f22 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:24:57.250648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7c45d209-d2bd-4c2d-947b-4a1ec8287f22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:57.347308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45d209-d2bd-4c2d-947b-4a1ec8287f22 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:24:57.354471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea017da2-0277-4624-9d78-ab5e3da0c7da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:24:57.355105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea017da2-0277-4624-9d78-ab5e3da0c7da service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:57.355464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea017da2-0277-4624-9d78-ab5e3da0c7da service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:57.355705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea017da2-0277-4624-9d78-ab5e3da0c7da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:57.358429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ea017da2-0277-4624-9d78-ab5e3da0c7da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:57.373332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea017da2-0277-4624-9d78-ab5e3da0c7da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:24:57.377710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea017da2-0277-4624-9d78-ab5e3da0c7da service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:24:57.399302 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1587/3165] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:24:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:24:59.740411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78048d1-790f-4019-8c67-c63ac1dd2a0b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:24:59.745326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78048d1-790f-4019-8c67-c63ac1dd2a0b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:24:59.745326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78048d1-790f-4019-8c67-c63ac1dd2a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:24:59.762363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e78048d1-790f-4019-8c67-c63ac1dd2a0b None None] MFA Rules not processed for user `2856471176174dd7a2465a816eef3acc`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:24:59.764447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e78048d1-790f-4019-8c67-c63ac1dd2a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:24:59.856926 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1579/3166] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:24:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:00.257808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea017da2-0277-4624-9d78-ab5e3da0c7da service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:00.270851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea017da2-0277-4624-9d78-ab5e3da0c7da service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:00.276969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78e630-2881-4da0-824b-39e0b12d6163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:00.280981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78e630-2881-4da0-824b-39e0b12d6163 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:00.280981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78e630-2881-4da0-824b-39e0b12d6163 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:00.280981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78e630-2881-4da0-824b-39e0b12d6163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:00.281801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ee78e630-2881-4da0-824b-39e0b12d6163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:00.296180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78e630-2881-4da0-824b-39e0b12d6163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:00.297944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78e630-2881-4da0-824b-39e0b12d6163 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:00.313461 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1588/3167] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:25:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:25:01.746673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78048d1-790f-4019-8c67-c63ac1dd2a0b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:01.755443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e78048d1-790f-4019-8c67-c63ac1dd2a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:01.779277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78048d1-790f-4019-8c67-c63ac1dd2a0b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:01.785141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0c07c-7f86-4f04-9dd6-84fa3a944470 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:01.786391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0c07c-7f86-4f04-9dd6-84fa3a944470 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:01.786828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0c07c-7f86-4f04-9dd6-84fa3a944470 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:01.787210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0c07c-7f86-4f04-9dd6-84fa3a944470 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:01.790152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-06e0c07c-7f86-4f04-9dd6-84fa3a944470 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:01.806031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0c07c-7f86-4f04-9dd6-84fa3a944470 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:01.808193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0c07c-7f86-4f04-9dd6-84fa3a944470 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:01.823384 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1580/3168] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:25:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:25:08.183368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78e630-2881-4da0-824b-39e0b12d6163 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:08.185784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ee78e630-2881-4da0-824b-39e0b12d6163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:08.200588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78e630-2881-4da0-824b-39e0b12d6163 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:08.220860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927fbfd-327d-436c-8962-c168a2539784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:08.226564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927fbfd-327d-436c-8962-c168a2539784 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:08.226564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927fbfd-327d-436c-8962-c168a2539784 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:08.226564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927fbfd-327d-436c-8962-c168a2539784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:08.226564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6927fbfd-327d-436c-8962-c168a2539784 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:08.339045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927fbfd-327d-436c-8962-c168a2539784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:08.343328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927fbfd-327d-436c-8962-c168a2539784 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:08.363706 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1589/3169] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:25:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:25:11.126474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0c07c-7f86-4f04-9dd6-84fa3a944470 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:11.128045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-06e0c07c-7f86-4f04-9dd6-84fa3a944470 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:11.150521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0c07c-7f86-4f04-9dd6-84fa3a944470 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:11.157821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3447a-a6e0-4305-91d7-7a9586a9c168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:11.159015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3447a-a6e0-4305-91d7-7a9586a9c168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:11.159352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3447a-a6e0-4305-91d7-7a9586a9c168 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:11.159654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3447a-a6e0-4305-91d7-7a9586a9c168 admin admin] PATH_INFO: `/v3/users/662c15e746b84fdbb497d700c9288931` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:11.161462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3447a-a6e0-4305-91d7-7a9586a9c168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=662c15e746b84fdbb497d700c9288931)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:11.163365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3447a-a6e0-4305-91d7-7a9586a9c168 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:11.705842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bdb3447a-a6e0-4305-91d7-7a9586a9c168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '662c15e746b84fdbb497d700c9288931'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:11.719045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bdb3447a-a6e0-4305-91d7-7a9586a9c168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '662c15e746b84fdbb497d700c9288931'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:11.720895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bdb3447a-a6e0-4305-91d7-7a9586a9c168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '662c15e746b84fdbb497d700c9288931'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:11.727886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bdb3447a-a6e0-4305-91d7-7a9586a9c168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '662c15e746b84fdbb497d700c9288931'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:11.826722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bdb3447a-a6e0-4305-91d7-7a9586a9c168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '662c15e746b84fdbb497d700c9288931'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:11.833360 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1581/3170] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:25:11 2022] DELETE /identity/v3/users/662c15e746b84fdbb497d700c9288931 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:12.547636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927fbfd-327d-436c-8962-c168a2539784 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:12.564129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927fbfd-327d-436c-8962-c168a2539784 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:12.729029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af229085-0bb3-4a14-aa89-f6f567ed0c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:12.730338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af229085-0bb3-4a14-aa89-f6f567ed0c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:12.730839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af229085-0bb3-4a14-aa89-f6f567ed0c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:12.731431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af229085-0bb3-4a14-aa89-f6f567ed0c0d admin admin] PATH_INFO: `/v3/projects/25e3a228719d4cbda0507cba959f1816` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:12.732953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af229085-0bb3-4a14-aa89-f6f567ed0c0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=25e3a228719d4cbda0507cba959f1816)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:12.735110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af229085-0bb3-4a14-aa89-f6f567ed0c0d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:12.947448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-af229085-0bb3-4a14-aa89-f6f567ed0c0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25e3a228719d4cbda0507cba959f1816', 'request_id': 'req-af229085-0bb3-4a14-aa89-f6f567ed0c0d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:12.958027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-af229085-0bb3-4a14-aa89-f6f567ed0c0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25e3a228719d4cbda0507cba959f1816', 'request_id': 'req-af229085-0bb3-4a14-aa89-f6f567ed0c0d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:13.110253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-af229085-0bb3-4a14-aa89-f6f567ed0c0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25e3a228719d4cbda0507cba959f1816', 'request_id': 'req-af229085-0bb3-4a14-aa89-f6f567ed0c0d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:13.128187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-af229085-0bb3-4a14-aa89-f6f567ed0c0d admin admin] The token cache is being invalidate because project 25e3a228719d4cbda0507cba959f1816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:25:13.129810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-af229085-0bb3-4a14-aa89-f6f567ed0c0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:13.129810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-af229085-0bb3-4a14-aa89-f6f567ed0c0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:13.132114 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1590/3171] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:25:12 2022] DELETE /identity/v3/projects/25e3a228719d4cbda0507cba959f1816 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:13.135879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3447a-a6e0-4305-91d7-7a9586a9c168 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:13.138556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bdb3447a-a6e0-4305-91d7-7a9586a9c168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:13.158491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3447a-a6e0-4305-91d7-7a9586a9c168 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:13.250942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b4658-255d-4575-b645-e7a6da98097a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:13.252990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b4658-255d-4575-b645-e7a6da98097a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:13.253462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b4658-255d-4575-b645-e7a6da98097a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:13.254096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b4658-255d-4575-b645-e7a6da98097a admin admin] PATH_INFO: `/v3/users/b11bbdc7eb564d049ad4220b168b48bc` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:13.255415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b4658-255d-4575-b645-e7a6da98097a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b11bbdc7eb564d049ad4220b168b48bc)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:13.258401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b4658-255d-4575-b645-e7a6da98097a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:13.515052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b03b4658-255d-4575-b645-e7a6da98097a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b11bbdc7eb564d049ad4220b168b48bc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:13.563536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b03b4658-255d-4575-b645-e7a6da98097a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b11bbdc7eb564d049ad4220b168b48bc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:13.566145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b03b4658-255d-4575-b645-e7a6da98097a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b11bbdc7eb564d049ad4220b168b48bc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:13.577761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b03b4658-255d-4575-b645-e7a6da98097a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b11bbdc7eb564d049ad4220b168b48bc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:13.657759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b03b4658-255d-4575-b645-e7a6da98097a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b11bbdc7eb564d049ad4220b168b48bc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:13.666760 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1582/3172] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:25:13 2022] DELETE /identity/v3/users/b11bbdc7eb564d049ad4220b168b48bc => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:14.717665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af229085-0bb3-4a14-aa89-f6f567ed0c0d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:14.720778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-af229085-0bb3-4a14-aa89-f6f567ed0c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:14.741889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af229085-0bb3-4a14-aa89-f6f567ed0c0d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:14.840048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdcfc6-6367-4a37-858f-4af8bb356fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:14.841221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdcfc6-6367-4a37-858f-4af8bb356fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:14.841631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdcfc6-6367-4a37-858f-4af8bb356fce admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:14.842033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdcfc6-6367-4a37-858f-4af8bb356fce admin admin] PATH_INFO: `/v3/projects/20384e7e9a0144bf8bb2b9d57290b02c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:14.843682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdcfc6-6367-4a37-858f-4af8bb356fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=20384e7e9a0144bf8bb2b9d57290b02c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:14.846067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdcfc6-6367-4a37-858f-4af8bb356fce admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:14.993484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b2fdcfc6-6367-4a37-858f-4af8bb356fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20384e7e9a0144bf8bb2b9d57290b02c', 'request_id': 'req-b2fdcfc6-6367-4a37-858f-4af8bb356fce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:15.003371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b2fdcfc6-6367-4a37-858f-4af8bb356fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20384e7e9a0144bf8bb2b9d57290b02c', 'request_id': 'req-b2fdcfc6-6367-4a37-858f-4af8bb356fce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:15.043026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b4658-255d-4575-b645-e7a6da98097a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:15.044824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b03b4658-255d-4575-b645-e7a6da98097a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:15.075030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b2fdcfc6-6367-4a37-858f-4af8bb356fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20384e7e9a0144bf8bb2b9d57290b02c', 'request_id': 'req-b2fdcfc6-6367-4a37-858f-4af8bb356fce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:15.091924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b2fdcfc6-6367-4a37-858f-4af8bb356fce admin admin] The token cache is being invalidate because project 20384e7e9a0144bf8bb2b9d57290b02c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:25:15.092229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b2fdcfc6-6367-4a37-858f-4af8bb356fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:15.097144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b2fdcfc6-6367-4a37-858f-4af8bb356fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:15.103814 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1591/3173] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:25:14 2022] DELETE /identity/v3/projects/20384e7e9a0144bf8bb2b9d57290b02c => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:15.110447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27761616-f4ac-4690-8f3a-2c16b556ad4b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:15.117755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27761616-f4ac-4690-8f3a-2c16b556ad4b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:15.118167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27761616-f4ac-4690-8f3a-2c16b556ad4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:15.164497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-27761616-f4ac-4690-8f3a-2c16b556ad4b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:15.166913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-27761616-f4ac-4690-8f3a-2c16b556ad4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:15.181024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b4658-255d-4575-b645-e7a6da98097a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:15.290913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90457df4-ec92-4757-bf01-14180816185a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:15.291868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90457df4-ec92-4757-bf01-14180816185a service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:15.292365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90457df4-ec92-4757-bf01-14180816185a service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:15.292860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90457df4-ec92-4757-bf01-14180816185a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:15.295602 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-90457df4-ec92-4757-bf01-14180816185a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:15.302047 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1592/3174] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:15.310468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90457df4-ec92-4757-bf01-14180816185a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:15.316770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90457df4-ec92-4757-bf01-14180816185a service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:15.316922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a686d-4497-4733-9177-145ce6517cc0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:15.316922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a686d-4497-4733-9177-145ce6517cc0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:15.316922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a686d-4497-4733-9177-145ce6517cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:15.327910 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1583/3175] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:25:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:25:15.346477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3e7a686d-4497-4733-9177-145ce6517cc0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:15.347786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3e7a686d-4497-4733-9177-145ce6517cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:15.372211 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1593/3176] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:15.377207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90457df4-ec92-4757-bf01-14180816185a service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:15.392834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90457df4-ec92-4757-bf01-14180816185a service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:15.403862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7160a23-c288-4056-840f-c410b2eb098b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:15.404550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7160a23-c288-4056-840f-c410b2eb098b admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:15.404861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7160a23-c288-4056-840f-c410b2eb098b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:15.405145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7160a23-c288-4056-840f-c410b2eb098b admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:15.405940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7160a23-c288-4056-840f-c410b2eb098b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:25:15.406259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7160a23-c288-4056-840f-c410b2eb098b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:15.407867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7160a23-c288-4056-840f-c410b2eb098b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:15.426707 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1584/3177] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:25:15.428679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a686d-4497-4733-9177-145ce6517cc0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:15.444192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a686d-4497-4733-9177-145ce6517cc0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:15.451337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1391aa-b6bf-4b7d-baca-c613cde06d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:15.452809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1391aa-b6bf-4b7d-baca-c613cde06d3d admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:15.453371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1391aa-b6bf-4b7d-baca-c613cde06d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:15.453756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1391aa-b6bf-4b7d-baca-c613cde06d3d admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:15.454563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1391aa-b6bf-4b7d-baca-c613cde06d3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:15.456868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1391aa-b6bf-4b7d-baca-c613cde06d3d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:15.605149 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1594/3178] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:25:15 2022] POST /identity/v3/projects => generated 381 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:25:15.609683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7160a23-c288-4056-840f-c410b2eb098b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:15.624907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7160a23-c288-4056-840f-c410b2eb098b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:15.724754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f48d35-fa96-4046-a443-8a60521dcd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:15.725622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f48d35-fa96-4046-a443-8a60521dcd80 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:15.726439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f48d35-fa96-4046-a443-8a60521dcd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:15.726986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f48d35-fa96-4046-a443-8a60521dcd80 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:15.727783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f48d35-fa96-4046-a443-8a60521dcd80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:15.730053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f48d35-fa96-4046-a443-8a60521dcd80 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:15.892007 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1585/3179] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:25:15 2022] POST /identity/v3/users => generated 291 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:25:15.894039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1391aa-b6bf-4b7d-baca-c613cde06d3d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:15.913682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1391aa-b6bf-4b7d-baca-c613cde06d3d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:15.923248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68411546-5cb4-437b-86bf-2ef03cd72e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:15.924317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68411546-5cb4-437b-86bf-2ef03cd72e27 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:15.924851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68411546-5cb4-437b-86bf-2ef03cd72e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:15.925290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68411546-5cb4-437b-86bf-2ef03cd72e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:15.926584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68411546-5cb4-437b-86bf-2ef03cd72e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:15.930377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68411546-5cb4-437b-86bf-2ef03cd72e27 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:15.944003 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1595/3180] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:25:15.948651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f48d35-fa96-4046-a443-8a60521dcd80 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:15.960829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f48d35-fa96-4046-a443-8a60521dcd80 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:15.968148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8c2f0-0b5c-4cd2-b40f-4fef59be26ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:15.969368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8c2f0-0b5c-4cd2-b40f-4fef59be26ea admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:15.969920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8c2f0-0b5c-4cd2-b40f-4fef59be26ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:15.970430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8c2f0-0b5c-4cd2-b40f-4fef59be26ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:15.972197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8c2f0-0b5c-4cd2-b40f-4fef59be26ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:15.975250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8c2f0-0b5c-4cd2-b40f-4fef59be26ea admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:15.994135 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1586/3181] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:25:15.997675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68411546-5cb4-437b-86bf-2ef03cd72e27 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:16.012167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68411546-5cb4-437b-86bf-2ef03cd72e27 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:16.024978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1866e7-2e57-40a9-9041-9949a4433619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:16.026241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1866e7-2e57-40a9-9041-9949a4433619 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:16.026530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1866e7-2e57-40a9-9041-9949a4433619 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:16.026807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1866e7-2e57-40a9-9041-9949a4433619 admin admin] PATH_INFO: `/v3/projects/5ad1097025fc4bbaae3cc4f8b96f10c7/users/90a07cb3d65646e4bab091a86657b8b6/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:16.071226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1866e7-2e57-40a9-9041-9949a4433619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad1097025fc4bbaae3cc4f8b96f10c7, user_id=90a07cb3d65646e4bab091a86657b8b6, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:16.077073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1866e7-2e57-40a9-9041-9949a4433619 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:16.202000 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1596/3182] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:25:15 2022] PUT /identity/v3/projects/5ad1097025fc4bbaae3cc4f8b96f10c7/users/90a07cb3d65646e4bab091a86657b8b6/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:16.208500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d5968-71c9-47e8-bd90-80f2fa432cda None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:16.208500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d5968-71c9-47e8-bd90-80f2fa432cda None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:16.208500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d5968-71c9-47e8-bd90-80f2fa432cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:16.244102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f51d5968-71c9-47e8-bd90-80f2fa432cda None None] MFA Rules not processed for user `90a07cb3d65646e4bab091a86657b8b6`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:16.244732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee66fa-83a9-4c94-a617-00fc078ed0ba None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:16.245232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee66fa-83a9-4c94-a617-00fc078ed0ba None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:16.245676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee66fa-83a9-4c94-a617-00fc078ed0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:16.245930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f51d5968-71c9-47e8-bd90-80f2fa432cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:16.268745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f5ee66fa-83a9-4c94-a617-00fc078ed0ba None None] MFA Rules not processed for user `4249f4ad303744e88e5f01d339a762b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:16.270365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f5ee66fa-83a9-4c94-a617-00fc078ed0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:16.339706 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1587/3183] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:25:16.342316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d5968-71c9-47e8-bd90-80f2fa432cda None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:16.365309 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1597/3184] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:16.534536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d5968-71c9-47e8-bd90-80f2fa432cda None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:16.553425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d99cd1-a56f-41e4-b329-eb0eb8697691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:16.554128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d99cd1-a56f-41e4-b329-eb0eb8697691 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:16.555000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d99cd1-a56f-41e4-b329-eb0eb8697691 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:16.555300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d99cd1-a56f-41e4-b329-eb0eb8697691 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:16.556041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d99cd1-a56f-41e4-b329-eb0eb8697691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:16.563102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d99cd1-a56f-41e4-b329-eb0eb8697691 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:16.704576 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1588/3185] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:25:16 2022] POST /identity/v3/projects => generated 385 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:25:16.710016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee66fa-83a9-4c94-a617-00fc078ed0ba None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:16.738197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee66fa-83a9-4c94-a617-00fc078ed0ba None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:16.816235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45085351-f351-4e9a-908b-8ab8c9f7b55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:16.816987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45085351-f351-4e9a-908b-8ab8c9f7b55f admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:16.817276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45085351-f351-4e9a-908b-8ab8c9f7b55f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:16.817558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45085351-f351-4e9a-908b-8ab8c9f7b55f admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:16.818321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45085351-f351-4e9a-908b-8ab8c9f7b55f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:16.820710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45085351-f351-4e9a-908b-8ab8c9f7b55f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:16.961446 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1598/3186] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:25:16 2022] POST /identity/v3/users => generated 299 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:25:16.962070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d99cd1-a56f-41e4-b329-eb0eb8697691 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:16.975234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d99cd1-a56f-41e4-b329-eb0eb8697691 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:16.988941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20deb3-a2c2-4502-bca8-93776747898e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:16.989747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20deb3-a2c2-4502-bca8-93776747898e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:16.990170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20deb3-a2c2-4502-bca8-93776747898e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:16.990917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20deb3-a2c2-4502-bca8-93776747898e admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:16.993707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20deb3-a2c2-4502-bca8-93776747898e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:16.995734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20deb3-a2c2-4502-bca8-93776747898e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:17.024272 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1589/3187] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:25:17.025704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45085351-f351-4e9a-908b-8ab8c9f7b55f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:17.038942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45085351-f351-4e9a-908b-8ab8c9f7b55f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:17.062547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963185f7-fd8e-44ca-bd91-65d773960d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:17.072310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963185f7-fd8e-44ca-bd91-65d773960d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:17.072310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963185f7-fd8e-44ca-bd91-65d773960d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:17.072310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963185f7-fd8e-44ca-bd91-65d773960d86 admin admin] PATH_INFO: `/v3/projects/c4c9350670df47f595b9439a0fb7bc3a/users/60d5f2dd831343868b36b4d67daef4c8/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:17.108261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963185f7-fd8e-44ca-bd91-65d773960d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c9350670df47f595b9439a0fb7bc3a, user_id=60d5f2dd831343868b36b4d67daef4c8, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:17.111228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963185f7-fd8e-44ca-bd91-65d773960d86 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:17.198194 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1599/3188] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:25:17 2022] PUT /identity/v3/projects/c4c9350670df47f595b9439a0fb7bc3a/users/60d5f2dd831343868b36b4d67daef4c8/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:17.203991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20deb3-a2c2-4502-bca8-93776747898e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:17.210825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963185f7-fd8e-44ca-bd91-65d773960d86 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:17.214568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-963185f7-fd8e-44ca-bd91-65d773960d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:17.223834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20deb3-a2c2-4502-bca8-93776747898e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:17.378547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963185f7-fd8e-44ca-bd91-65d773960d86 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:17.379089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa49add-98fb-4d44-af9a-639dafe2f0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:17.379809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa49add-98fb-4d44-af9a-639dafe2f0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:17.380078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa49add-98fb-4d44-af9a-639dafe2f0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:17.380362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa49add-98fb-4d44-af9a-639dafe2f0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:17.381134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa49add-98fb-4d44-af9a-639dafe2f0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:17.382801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa49add-98fb-4d44-af9a-639dafe2f0a7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:17.386574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c0b12-209e-4fe5-88cb-2334d65478c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:17.388213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c0b12-209e-4fe5-88cb-2334d65478c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:17.388783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c0b12-209e-4fe5-88cb-2334d65478c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:17.389508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c0b12-209e-4fe5-88cb-2334d65478c0 admin admin] PATH_INFO: `/v3/users/317b0225417142bcbe8751fd27cdf4ae` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:17.392058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c0b12-209e-4fe5-88cb-2334d65478c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=317b0225417142bcbe8751fd27cdf4ae)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:17.395649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c0b12-209e-4fe5-88cb-2334d65478c0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:17.403882 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1590/3189] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:25:17.411434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa49add-98fb-4d44-af9a-639dafe2f0a7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:17.428403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa49add-98fb-4d44-af9a-639dafe2f0a7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:17.435187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a07ee9-4457-4d37-8698-900fee4120d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:17.436191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a07ee9-4457-4d37-8698-900fee4120d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:17.436557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a07ee9-4457-4d37-8698-900fee4120d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:17.436986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a07ee9-4457-4d37-8698-900fee4120d5 admin admin] PATH_INFO: `/v3/projects/c4c9350670df47f595b9439a0fb7bc3a/users/60d5f2dd831343868b36b4d67daef4c8/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:17.439496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a07ee9-4457-4d37-8698-900fee4120d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c9350670df47f595b9439a0fb7bc3a, user_id=60d5f2dd831343868b36b4d67daef4c8, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:17.445229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a07ee9-4457-4d37-8698-900fee4120d5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:17.459803 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1591/3190] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:25:17 2022] PUT /identity/v3/projects/c4c9350670df47f595b9439a0fb7bc3a/users/60d5f2dd831343868b36b4d67daef4c8/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:17.469990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0465eb-832e-48de-acdf-a7f0e57b92fa None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:17.472177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0465eb-832e-48de-acdf-a7f0e57b92fa None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:17.472633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0465eb-832e-48de-acdf-a7f0e57b92fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:17.510119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9b0465eb-832e-48de-acdf-a7f0e57b92fa None None] MFA Rules not processed for user `60d5f2dd831343868b36b4d67daef4c8`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:17.511630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9b0465eb-832e-48de-acdf-a7f0e57b92fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:17.617052 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1592/3191] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:17.650682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0465eb-832e-48de-acdf-a7f0e57b92fa None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:17.659456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-505c0b12-209e-4fe5-88cb-2334d65478c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '317b0225417142bcbe8751fd27cdf4ae'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:17.659890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9b0465eb-832e-48de-acdf-a7f0e57b92fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:17.694619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-505c0b12-209e-4fe5-88cb-2334d65478c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '317b0225417142bcbe8751fd27cdf4ae'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:17.696750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-505c0b12-209e-4fe5-88cb-2334d65478c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '317b0225417142bcbe8751fd27cdf4ae'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:17.710902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-505c0b12-209e-4fe5-88cb-2334d65478c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '317b0225417142bcbe8751fd27cdf4ae'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:17.778957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0465eb-832e-48de-acdf-a7f0e57b92fa None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:17.793540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f0de4-8d00-4ee1-953b-f979c1fff642 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:17.794492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f0de4-8d00-4ee1-953b-f979c1fff642 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:17.794904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f0de4-8d00-4ee1-953b-f979c1fff642 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:17.795255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f0de4-8d00-4ee1-953b-f979c1fff642 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:17.804443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-505c0b12-209e-4fe5-88cb-2334d65478c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '317b0225417142bcbe8751fd27cdf4ae'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:17.817331 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1600/3192] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:25:17 2022] DELETE /identity/v3/users/317b0225417142bcbe8751fd27cdf4ae => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:17.818523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f0de4-8d00-4ee1-953b-f979c1fff642 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:17.819495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ea828-0b48-4f76-98cc-3778a316913c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:17.819882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ea828-0b48-4f76-98cc-3778a316913c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:17.820243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ea828-0b48-4f76-98cc-3778a316913c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:17.821915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f0de4-8d00-4ee1-953b-f979c1fff642 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:17.842842 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1593/3193] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:25:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:25:17.851881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e54ea828-0b48-4f76-98cc-3778a316913c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:17.853250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e54ea828-0b48-4f76-98cc-3778a316913c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:17.922854 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1601/3194] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:17.932781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f0de4-8d00-4ee1-953b-f979c1fff642 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:17.934474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ef3f0de4-8d00-4ee1-953b-f979c1fff642 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:17.991104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f0de4-8d00-4ee1-953b-f979c1fff642 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:18.038510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5c4ae-3cf9-44a0-9aed-35cf1e16710c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:18.039164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5c4ae-3cf9-44a0-9aed-35cf1e16710c service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:18.039449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5c4ae-3cf9-44a0-9aed-35cf1e16710c service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:18.039730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5c4ae-3cf9-44a0-9aed-35cf1e16710c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:18.049558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5c4ae-3cf9-44a0-9aed-35cf1e16710c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:18.050999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5c4ae-3cf9-44a0-9aed-35cf1e16710c service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:18.061132 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1594/3195] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:25:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:25:18.334032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ea828-0b48-4f76-98cc-3778a316913c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:18.335448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e54ea828-0b48-4f76-98cc-3778a316913c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:18.347791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ea828-0b48-4f76-98cc-3778a316913c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:18.364130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bf051-51f7-4d3d-97fd-70ba4792e907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:18.364130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bf051-51f7-4d3d-97fd-70ba4792e907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:18.364130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bf051-51f7-4d3d-97fd-70ba4792e907 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:18.364130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bf051-51f7-4d3d-97fd-70ba4792e907 admin admin] PATH_INFO: `/v3/projects/8bc20eb284a14780b832c3c567850937` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:18.365415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bf051-51f7-4d3d-97fd-70ba4792e907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bc20eb284a14780b832c3c567850937)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:18.365415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bf051-51f7-4d3d-97fd-70ba4792e907 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:18.500970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed1bf051-51f7-4d3d-97fd-70ba4792e907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bc20eb284a14780b832c3c567850937', 'request_id': 'req-ed1bf051-51f7-4d3d-97fd-70ba4792e907'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:18.507290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed1bf051-51f7-4d3d-97fd-70ba4792e907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bc20eb284a14780b832c3c567850937', 'request_id': 'req-ed1bf051-51f7-4d3d-97fd-70ba4792e907'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:18.582845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed1bf051-51f7-4d3d-97fd-70ba4792e907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bc20eb284a14780b832c3c567850937', 'request_id': 'req-ed1bf051-51f7-4d3d-97fd-70ba4792e907'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:18.594699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed1bf051-51f7-4d3d-97fd-70ba4792e907 admin admin] The token cache is being invalidate because project 8bc20eb284a14780b832c3c567850937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:25:18.594991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed1bf051-51f7-4d3d-97fd-70ba4792e907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:18.595623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed1bf051-51f7-4d3d-97fd-70ba4792e907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:18.597296 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1602/3196] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:25:18 2022] DELETE /identity/v3/projects/8bc20eb284a14780b832c3c567850937 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:18.601145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5c4ae-3cf9-44a0-9aed-35cf1e16710c service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:18.611303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5c4ae-3cf9-44a0-9aed-35cf1e16710c service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:18.705087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43242566-cdd9-4480-921d-acb6941ab9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:18.706051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43242566-cdd9-4480-921d-acb6941ab9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:18.706400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43242566-cdd9-4480-921d-acb6941ab9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:18.706748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43242566-cdd9-4480-921d-acb6941ab9ed admin admin] PATH_INFO: `/v3/users/b87592d223fb4513a820226bd0422212` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:18.708221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43242566-cdd9-4480-921d-acb6941ab9ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=b87592d223fb4513a820226bd0422212)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:18.710426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43242566-cdd9-4480-921d-acb6941ab9ed admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:18.961507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-43242566-cdd9-4480-921d-acb6941ab9ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b87592d223fb4513a820226bd0422212'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:18.974286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-43242566-cdd9-4480-921d-acb6941ab9ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b87592d223fb4513a820226bd0422212'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:18.974990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-43242566-cdd9-4480-921d-acb6941ab9ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b87592d223fb4513a820226bd0422212'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:18.982457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-43242566-cdd9-4480-921d-acb6941ab9ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b87592d223fb4513a820226bd0422212'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:19.137367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-43242566-cdd9-4480-921d-acb6941ab9ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b87592d223fb4513a820226bd0422212'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:19.143831 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1595/3197] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:25:18 2022] DELETE /identity/v3/users/b87592d223fb4513a820226bd0422212 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:19.343585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bf051-51f7-4d3d-97fd-70ba4792e907 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:19.345585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ed1bf051-51f7-4d3d-97fd-70ba4792e907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:19.358969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bf051-51f7-4d3d-97fd-70ba4792e907 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:19.417422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ce9cc-0cf3-428a-924d-3d02eec8f5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:19.418419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ce9cc-0cf3-428a-924d-3d02eec8f5eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:19.418764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ce9cc-0cf3-428a-924d-3d02eec8f5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:19.419114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ce9cc-0cf3-428a-924d-3d02eec8f5eb admin admin] PATH_INFO: `/v3/users/90a07cb3d65646e4bab091a86657b8b6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:19.422546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ce9cc-0cf3-428a-924d-3d02eec8f5eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a07cb3d65646e4bab091a86657b8b6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:19.424135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ce9cc-0cf3-428a-924d-3d02eec8f5eb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:19.425187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43242566-cdd9-4480-921d-acb6941ab9ed admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:19.426605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-43242566-cdd9-4480-921d-acb6941ab9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:19.439695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43242566-cdd9-4480-921d-acb6941ab9ed admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:19.445171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052a4d6-adc5-4bf4-9eac-afcfbfc6f1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:19.449847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052a4d6-adc5-4bf4-9eac-afcfbfc6f1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:19.449847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052a4d6-adc5-4bf4-9eac-afcfbfc6f1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:19.449847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052a4d6-adc5-4bf4-9eac-afcfbfc6f1e3 admin admin] PATH_INFO: `/v3/projects/fad8c5ef80c54e60953517fbaaeed299` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:19.449847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052a4d6-adc5-4bf4-9eac-afcfbfc6f1e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad8c5ef80c54e60953517fbaaeed299)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:19.450346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052a4d6-adc5-4bf4-9eac-afcfbfc6f1e3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:19.626500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-806ce9cc-0cf3-428a-924d-3d02eec8f5eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a07cb3d65646e4bab091a86657b8b6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:19.628326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0052a4d6-adc5-4bf4-9eac-afcfbfc6f1e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad8c5ef80c54e60953517fbaaeed299', 'request_id': 'req-0052a4d6-adc5-4bf4-9eac-afcfbfc6f1e3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:19.639343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-806ce9cc-0cf3-428a-924d-3d02eec8f5eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a07cb3d65646e4bab091a86657b8b6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:19.640053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-806ce9cc-0cf3-428a-924d-3d02eec8f5eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a07cb3d65646e4bab091a86657b8b6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:19.647813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-806ce9cc-0cf3-428a-924d-3d02eec8f5eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a07cb3d65646e4bab091a86657b8b6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:19.697688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0052a4d6-adc5-4bf4-9eac-afcfbfc6f1e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad8c5ef80c54e60953517fbaaeed299', 'request_id': 'req-0052a4d6-adc5-4bf4-9eac-afcfbfc6f1e3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:19.708387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0052a4d6-adc5-4bf4-9eac-afcfbfc6f1e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad8c5ef80c54e60953517fbaaeed299', 'request_id': 'req-0052a4d6-adc5-4bf4-9eac-afcfbfc6f1e3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:19.719236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0052a4d6-adc5-4bf4-9eac-afcfbfc6f1e3 admin admin] The token cache is being invalidate because project fad8c5ef80c54e60953517fbaaeed299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:25:19.720017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0052a4d6-adc5-4bf4-9eac-afcfbfc6f1e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:19.720751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0052a4d6-adc5-4bf4-9eac-afcfbfc6f1e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:19.722303 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1596/3198] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:25:19 2022] DELETE /identity/v3/projects/fad8c5ef80c54e60953517fbaaeed299 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:19.727018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a1bf6-bbb9-454d-8924-8f617eb5f1f6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:19.727329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a1bf6-bbb9-454d-8924-8f617eb5f1f6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:19.727626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a1bf6-bbb9-454d-8924-8f617eb5f1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:19.745103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f24a1bf6-bbb9-454d-8924-8f617eb5f1f6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:19.746877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f24a1bf6-bbb9-454d-8924-8f617eb5f1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:19.782991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-806ce9cc-0cf3-428a-924d-3d02eec8f5eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a07cb3d65646e4bab091a86657b8b6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:19.797470 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1603/3199] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:25:19 2022] DELETE /identity/v3/users/90a07cb3d65646e4bab091a86657b8b6 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:19.801930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e2e30-f845-415e-9117-1dfe75b1303d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:19.802230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e2e30-f845-415e-9117-1dfe75b1303d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:19.802515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e2e30-f845-415e-9117-1dfe75b1303d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:19.816770 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1597/3200] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:25:19.821276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6a739-1bb8-4d82-ad3f-f333dccc4bf9 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:19.821500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6a739-1bb8-4d82-ad3f-f333dccc4bf9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:19.821785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6a739-1bb8-4d82-ad3f-f333dccc4bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:19.825872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a69e2e30-f845-415e-9117-1dfe75b1303d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:19.827127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a69e2e30-f845-415e-9117-1dfe75b1303d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:19.842301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-29f6a739-1bb8-4d82-ad3f-f333dccc4bf9 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:19.843841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-29f6a739-1bb8-4d82-ad3f-f333dccc4bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:19.903133 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1604/3201] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:19.913687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e2e30-f845-415e-9117-1dfe75b1303d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:19.916091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a69e2e30-f845-415e-9117-1dfe75b1303d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:19.918917 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1598/3202] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:19.927861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6a739-1bb8-4d82-ad3f-f333dccc4bf9 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:19.943651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6a739-1bb8-4d82-ad3f-f333dccc4bf9 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:19.953099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbaaafb-54e4-4801-8671-20efb06b7cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:19.954284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbaaafb-54e4-4801-8671-20efb06b7cdc admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:19.954580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbaaafb-54e4-4801-8671-20efb06b7cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:19.954905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbaaafb-54e4-4801-8671-20efb06b7cdc admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:19.956179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbaaafb-54e4-4801-8671-20efb06b7cdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:25:19.956697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbaaafb-54e4-4801-8671-20efb06b7cdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:19.959082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbaaafb-54e4-4801-8671-20efb06b7cdc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:19.973433 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1599/3203] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:25:19.978648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbaaafb-54e4-4801-8671-20efb06b7cdc admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:19.994187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbaaafb-54e4-4801-8671-20efb06b7cdc admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:19.994341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e2e30-f845-415e-9117-1dfe75b1303d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:19.994501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64823af1-4b2f-40be-9169-fe6d67a6fd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:19.995160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64823af1-4b2f-40be-9169-fe6d67a6fd1b admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:19.995442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64823af1-4b2f-40be-9169-fe6d67a6fd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:19.995551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b7fd2-24e2-4ea6-9ced-914aa7e29e7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:19.995719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64823af1-4b2f-40be-9169-fe6d67a6fd1b admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:19.996740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b7fd2-24e2-4ea6-9ced-914aa7e29e7f service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:19.997000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64823af1-4b2f-40be-9169-fe6d67a6fd1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:19.997116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b7fd2-24e2-4ea6-9ced-914aa7e29e7f service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:19.997297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b7fd2-24e2-4ea6-9ced-914aa7e29e7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:20.004738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64823af1-4b2f-40be-9169-fe6d67a6fd1b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:20.007298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b7fd2-24e2-4ea6-9ced-914aa7e29e7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:20.009616 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b7fd2-24e2-4ea6-9ced-914aa7e29e7f service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:20.026729 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1605/3204] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:25:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:25:20.100050 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1600/3205] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:25:19 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:25:20.101681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b7fd2-24e2-4ea6-9ced-914aa7e29e7f service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:20.112823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b7fd2-24e2-4ea6-9ced-914aa7e29e7f service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:20.181652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd31f2-3fae-4c8d-955b-8764333698cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:20.182326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd31f2-3fae-4c8d-955b-8764333698cf admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:20.182621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd31f2-3fae-4c8d-955b-8764333698cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:20.182879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd31f2-3fae-4c8d-955b-8764333698cf admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:20.184251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd31f2-3fae-4c8d-955b-8764333698cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:20.186226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd31f2-3fae-4c8d-955b-8764333698cf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:20.316834 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1606/3206] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:25:20 2022] POST /identity/v3/users => generated 287 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:25:20.320960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64823af1-4b2f-40be-9169-fe6d67a6fd1b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:20.331673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64823af1-4b2f-40be-9169-fe6d67a6fd1b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:20.336338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027f5b0-758b-4824-b088-75ae59223009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:20.337036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027f5b0-758b-4824-b088-75ae59223009 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:20.337321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027f5b0-758b-4824-b088-75ae59223009 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:20.337600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027f5b0-758b-4824-b088-75ae59223009 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:20.338345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027f5b0-758b-4824-b088-75ae59223009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:20.341617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027f5b0-758b-4824-b088-75ae59223009 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:20.351743 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1601/3207] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:25:20.356975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd31f2-3fae-4c8d-955b-8764333698cf admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:20.367196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd31f2-3fae-4c8d-955b-8764333698cf admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:20.373124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee26d6-370a-4a10-a515-91d148a4f115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:20.374259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee26d6-370a-4a10-a515-91d148a4f115 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:20.374549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee26d6-370a-4a10-a515-91d148a4f115 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:20.374836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee26d6-370a-4a10-a515-91d148a4f115 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:20.377004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee26d6-370a-4a10-a515-91d148a4f115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:20.377412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee26d6-370a-4a10-a515-91d148a4f115 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:20.390147 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1607/3208] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:25:20.394415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027f5b0-758b-4824-b088-75ae59223009 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:20.406035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027f5b0-758b-4824-b088-75ae59223009 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:20.411102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f3b8b-498e-4093-b641-a9ad2c5c5957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:20.412032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f3b8b-498e-4093-b641-a9ad2c5c5957 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:20.412316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f3b8b-498e-4093-b641-a9ad2c5c5957 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:20.412606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f3b8b-498e-4093-b641-a9ad2c5c5957 admin admin] PATH_INFO: `/v3/projects/717af93565ff4289a969c82e2e51787a/users/eb7d948ae46f40fcae6685cedd105864/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:20.432776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f3b8b-498e-4093-b641-a9ad2c5c5957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=717af93565ff4289a969c82e2e51787a, user_id=eb7d948ae46f40fcae6685cedd105864, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:20.435470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f3b8b-498e-4093-b641-a9ad2c5c5957 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:20.515024 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1602/3209] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:25:20 2022] PUT /identity/v3/projects/717af93565ff4289a969c82e2e51787a/users/eb7d948ae46f40fcae6685cedd105864/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:25:20.526452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b9222-e7d9-4099-aa24-3eb22092db36 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:20.526749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b9222-e7d9-4099-aa24-3eb22092db36 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:20.527027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b9222-e7d9-4099-aa24-3eb22092db36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:20.559677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-612b9222-e7d9-4099-aa24-3eb22092db36 None None] MFA Rules not processed for user `eb7d948ae46f40fcae6685cedd105864`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:20.561274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-612b9222-e7d9-4099-aa24-3eb22092db36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:20.626663 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1608/3210] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:20.636802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f3b8b-498e-4093-b641-a9ad2c5c5957 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:20.638662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-493f3b8b-498e-4093-b641-a9ad2c5c5957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:20.648675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b9222-e7d9-4099-aa24-3eb22092db36 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:20.654999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-612b9222-e7d9-4099-aa24-3eb22092db36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:20.706120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f3b8b-498e-4093-b641-a9ad2c5c5957 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:20.710411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605726b3-e37a-4154-9f3d-f2eb7add3d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:20.711535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605726b3-e37a-4154-9f3d-f2eb7add3d76 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:20.711535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605726b3-e37a-4154-9f3d-f2eb7add3d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:20.711716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605726b3-e37a-4154-9f3d-f2eb7add3d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:20.723465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605726b3-e37a-4154-9f3d-f2eb7add3d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:20.726292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605726b3-e37a-4154-9f3d-f2eb7add3d76 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:20.751716 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1603/3211] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:25:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:25:20.785767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b9222-e7d9-4099-aa24-3eb22092db36 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:20.793030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6318be-bdaa-42cc-b47d-bc4bebc9fc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:20.793153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6318be-bdaa-42cc-b47d-bc4bebc9fc7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:20.793953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6318be-bdaa-42cc-b47d-bc4bebc9fc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:20.794311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6318be-bdaa-42cc-b47d-bc4bebc9fc7b admin admin] PATH_INFO: `/v3/projects/5ad1097025fc4bbaae3cc4f8b96f10c7` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:20.797700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6318be-bdaa-42cc-b47d-bc4bebc9fc7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ad1097025fc4bbaae3cc4f8b96f10c7)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:20.799801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6318be-bdaa-42cc-b47d-bc4bebc9fc7b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:20.941932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2e6318be-bdaa-42cc-b47d-bc4bebc9fc7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad1097025fc4bbaae3cc4f8b96f10c7', 'request_id': 'req-2e6318be-bdaa-42cc-b47d-bc4bebc9fc7b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:20.954937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2e6318be-bdaa-42cc-b47d-bc4bebc9fc7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad1097025fc4bbaae3cc4f8b96f10c7', 'request_id': 'req-2e6318be-bdaa-42cc-b47d-bc4bebc9fc7b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:21.103291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2e6318be-bdaa-42cc-b47d-bc4bebc9fc7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad1097025fc4bbaae3cc4f8b96f10c7', 'request_id': 'req-2e6318be-bdaa-42cc-b47d-bc4bebc9fc7b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:21.120900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2e6318be-bdaa-42cc-b47d-bc4bebc9fc7b admin admin] The token cache is being invalidate because project 5ad1097025fc4bbaae3cc4f8b96f10c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:25:21.121889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2e6318be-bdaa-42cc-b47d-bc4bebc9fc7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:21.123104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2e6318be-bdaa-42cc-b47d-bc4bebc9fc7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:21.126849 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1609/3212] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:25:20 2022] DELETE /identity/v3/projects/5ad1097025fc4bbaae3cc4f8b96f10c7 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:25:21.131025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605726b3-e37a-4154-9f3d-f2eb7add3d76 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:21.162499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605726b3-e37a-4154-9f3d-f2eb7add3d76 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:21.280330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29903080-e233-4346-a08f-dc9574f18563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:21.281659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29903080-e233-4346-a08f-dc9574f18563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:21.282187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29903080-e233-4346-a08f-dc9574f18563 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:21.282626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29903080-e233-4346-a08f-dc9574f18563 admin admin] PATH_INFO: `/v3/users/60d5f2dd831343868b36b4d67daef4c8` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:21.284329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29903080-e233-4346-a08f-dc9574f18563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d5f2dd831343868b36b4d67daef4c8)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:21.286686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29903080-e233-4346-a08f-dc9574f18563 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:21.503536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-29903080-e233-4346-a08f-dc9574f18563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d5f2dd831343868b36b4d67daef4c8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:21.527554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-29903080-e233-4346-a08f-dc9574f18563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d5f2dd831343868b36b4d67daef4c8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:21.528398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-29903080-e233-4346-a08f-dc9574f18563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d5f2dd831343868b36b4d67daef4c8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:21.538002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-29903080-e233-4346-a08f-dc9574f18563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d5f2dd831343868b36b4d67daef4c8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:21.603568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-29903080-e233-4346-a08f-dc9574f18563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d5f2dd831343868b36b4d67daef4c8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:21.612649 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1604/3213] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:25:21 2022] DELETE /identity/v3/users/60d5f2dd831343868b36b4d67daef4c8 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:21.681040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6318be-bdaa-42cc-b47d-bc4bebc9fc7b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:21.682551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2e6318be-bdaa-42cc-b47d-bc4bebc9fc7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:21.697863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6318be-bdaa-42cc-b47d-bc4bebc9fc7b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:21.769838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c4f02-27f0-48bc-8c39-967ed48b4ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:21.770814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c4f02-27f0-48bc-8c39-967ed48b4ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:21.771170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c4f02-27f0-48bc-8c39-967ed48b4ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:21.771596 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c4f02-27f0-48bc-8c39-967ed48b4ee5 admin admin] PATH_INFO: `/v3/users/eb7d948ae46f40fcae6685cedd105864` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:21.772957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c4f02-27f0-48bc-8c39-967ed48b4ee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb7d948ae46f40fcae6685cedd105864)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:21.775042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c4f02-27f0-48bc-8c39-967ed48b4ee5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:22.024974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e84c4f02-27f0-48bc-8c39-967ed48b4ee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb7d948ae46f40fcae6685cedd105864'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:22.037691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e84c4f02-27f0-48bc-8c39-967ed48b4ee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb7d948ae46f40fcae6685cedd105864'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:22.038404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e84c4f02-27f0-48bc-8c39-967ed48b4ee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb7d948ae46f40fcae6685cedd105864'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:22.045712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e84c4f02-27f0-48bc-8c39-967ed48b4ee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb7d948ae46f40fcae6685cedd105864'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:22.114689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e84c4f02-27f0-48bc-8c39-967ed48b4ee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb7d948ae46f40fcae6685cedd105864'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:22.121654 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1610/3214] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:25:21 2022] DELETE /identity/v3/users/eb7d948ae46f40fcae6685cedd105864 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:22.126741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676083c3-aa18-4f43-afb6-f2a1fe7222fb None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:22.127241 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676083c3-aa18-4f43-afb6-f2a1fe7222fb None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:22.127337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676083c3-aa18-4f43-afb6-f2a1fe7222fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:22.149387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-676083c3-aa18-4f43-afb6-f2a1fe7222fb None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:22.153397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-676083c3-aa18-4f43-afb6-f2a1fe7222fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:22.224419 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1605/3215] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:22.234178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c4f02-27f0-48bc-8c39-967ed48b4ee5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:22.235729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e84c4f02-27f0-48bc-8c39-967ed48b4ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:22.297455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c4f02-27f0-48bc-8c39-967ed48b4ee5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:22.301078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f14ad-e3ae-4fa5-aac0-9735e22851a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:22.301751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f14ad-e3ae-4fa5-aac0-9735e22851a5 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:22.302034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f14ad-e3ae-4fa5-aac0-9735e22851a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:22.302310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f14ad-e3ae-4fa5-aac0-9735e22851a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:22.312226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f14ad-e3ae-4fa5-aac0-9735e22851a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:22.313765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f14ad-e3ae-4fa5-aac0-9735e22851a5 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:22.325346 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1611/3216] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:25:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:25:22.921918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676083c3-aa18-4f43-afb6-f2a1fe7222fb None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:22.926020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-676083c3-aa18-4f43-afb6-f2a1fe7222fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:22.927076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f14ad-e3ae-4fa5-aac0-9735e22851a5 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:22.928796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0e5f14ad-e3ae-4fa5-aac0-9735e22851a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:22.940062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676083c3-aa18-4f43-afb6-f2a1fe7222fb None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:22.945427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20af553-61bc-4dd5-9e7d-b12020248037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:22.946039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f14ad-e3ae-4fa5-aac0-9735e22851a5 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:22.947408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20af553-61bc-4dd5-9e7d-b12020248037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:22.948408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20af553-61bc-4dd5-9e7d-b12020248037 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:22.948408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20af553-61bc-4dd5-9e7d-b12020248037 admin admin] PATH_INFO: `/v3/projects/717af93565ff4289a969c82e2e51787a` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:22.952685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20af553-61bc-4dd5-9e7d-b12020248037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=717af93565ff4289a969c82e2e51787a)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:22.952816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4192404-15aa-4385-a646-caadd8e292ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:22.952949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20af553-61bc-4dd5-9e7d-b12020248037 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:22.953302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4192404-15aa-4385-a646-caadd8e292ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:22.953589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4192404-15aa-4385-a646-caadd8e292ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:22.953867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4192404-15aa-4385-a646-caadd8e292ee admin admin] PATH_INFO: `/v3/projects/c4c9350670df47f595b9439a0fb7bc3a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:22.955236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4192404-15aa-4385-a646-caadd8e292ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4c9350670df47f595b9439a0fb7bc3a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:22.957210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4192404-15aa-4385-a646-caadd8e292ee admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:23.131816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b4192404-15aa-4385-a646-caadd8e292ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4c9350670df47f595b9439a0fb7bc3a', 'request_id': 'req-b4192404-15aa-4385-a646-caadd8e292ee'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:23.142907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b4192404-15aa-4385-a646-caadd8e292ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4c9350670df47f595b9439a0fb7bc3a', 'request_id': 'req-b4192404-15aa-4385-a646-caadd8e292ee'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:23.145105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f20af553-61bc-4dd5-9e7d-b12020248037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '717af93565ff4289a969c82e2e51787a', 'request_id': 'req-f20af553-61bc-4dd5-9e7d-b12020248037'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:23.277707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b4192404-15aa-4385-a646-caadd8e292ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4c9350670df47f595b9439a0fb7bc3a', 'request_id': 'req-b4192404-15aa-4385-a646-caadd8e292ee'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:23.290670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b4192404-15aa-4385-a646-caadd8e292ee admin admin] The token cache is being invalidate because project c4c9350670df47f595b9439a0fb7bc3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:25:23.291227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b4192404-15aa-4385-a646-caadd8e292ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:23.292143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b4192404-15aa-4385-a646-caadd8e292ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:23.295471 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1612/3217] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:25:22 2022] DELETE /identity/v3/projects/c4c9350670df47f595b9439a0fb7bc3a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:25:23.309190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cdbed-8d8c-4d60-9842-e05c2e5e03a4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:23.309190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cdbed-8d8c-4d60-9842-e05c2e5e03a4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:23.309190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cdbed-8d8c-4d60-9842-e05c2e5e03a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:23.325239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e14cdbed-8d8c-4d60-9842-e05c2e5e03a4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:23.326543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e14cdbed-8d8c-4d60-9842-e05c2e5e03a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:23.358414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f20af553-61bc-4dd5-9e7d-b12020248037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '717af93565ff4289a969c82e2e51787a', 'request_id': 'req-f20af553-61bc-4dd5-9e7d-b12020248037'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:23.366237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f20af553-61bc-4dd5-9e7d-b12020248037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '717af93565ff4289a969c82e2e51787a', 'request_id': 'req-f20af553-61bc-4dd5-9e7d-b12020248037'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:23.385095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f20af553-61bc-4dd5-9e7d-b12020248037 admin admin] The token cache is being invalidate because project 717af93565ff4289a969c82e2e51787a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:25:23.385661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f20af553-61bc-4dd5-9e7d-b12020248037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:23.386912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f20af553-61bc-4dd5-9e7d-b12020248037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:23.389724 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1606/3218] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:25:22 2022] DELETE /identity/v3/projects/717af93565ff4289a969c82e2e51787a => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:23.395714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b4553-7c54-4776-be66-591154df892c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:23.395714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b4553-7c54-4776-be66-591154df892c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:23.395714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b4553-7c54-4776-be66-591154df892c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:23.413768 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1613/3219] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:23.419085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-149b4553-7c54-4776-be66-591154df892c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:23.421906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93202abe-397f-4553-88ef-d2052400162c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:23.422176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93202abe-397f-4553-88ef-d2052400162c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:23.422457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93202abe-397f-4553-88ef-d2052400162c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:23.424072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-149b4553-7c54-4776-be66-591154df892c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:23.436067 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1607/3220] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:23.446453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30edd5-1aeb-41a2-a902-2f95047f0792 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:23.446453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30edd5-1aeb-41a2-a902-2f95047f0792 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:23.446453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30edd5-1aeb-41a2-a902-2f95047f0792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:23.461515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-93202abe-397f-4553-88ef-d2052400162c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:23.462888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-93202abe-397f-4553-88ef-d2052400162c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:23.472504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1e30edd5-1aeb-41a2-a902-2f95047f0792 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:23.474066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1e30edd5-1aeb-41a2-a902-2f95047f0792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:23.478997 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1614/3221] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:23.484548 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1608/3222] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:25:23.485643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93202abe-397f-4553-88ef-d2052400162c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:23.488217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30edd5-1aeb-41a2-a902-2f95047f0792 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:23.495982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93202abe-397f-4553-88ef-d2052400162c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:23.499699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30edd5-1aeb-41a2-a902-2f95047f0792 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:23.501950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7fa2a-9399-4292-b841-a918a16d2203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:23.503620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7fa2a-9399-4292-b841-a918a16d2203 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:23.503620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7fa2a-9399-4292-b841-a918a16d2203 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:23.503620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7fa2a-9399-4292-b841-a918a16d2203 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:23.504001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f7fa2a-9399-4292-b841-a918a16d2203 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:25:23.504462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f7fa2a-9399-4292-b841-a918a16d2203 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:23.505270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb121459-42c7-4f3e-beec-6eeba182bdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:23.505994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb121459-42c7-4f3e-beec-6eeba182bdc2 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:23.506313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f7fa2a-9399-4292-b841-a918a16d2203 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:23.506423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb121459-42c7-4f3e-beec-6eeba182bdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:23.506722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb121459-42c7-4f3e-beec-6eeba182bdc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:23.507521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb121459-42c7-4f3e-beec-6eeba182bdc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:25:23.507896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb121459-42c7-4f3e-beec-6eeba182bdc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:23.509584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb121459-42c7-4f3e-beec-6eeba182bdc2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:23.520043 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1615/3223] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:25:23.523530 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1609/3224] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:25:23.524471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7fa2a-9399-4292-b841-a918a16d2203 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:23.528421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb121459-42c7-4f3e-beec-6eeba182bdc2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:23.534888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7fa2a-9399-4292-b841-a918a16d2203 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:23.538099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb121459-42c7-4f3e-beec-6eeba182bdc2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:23.539612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956964b4-49fe-4382-9dae-f2af16163d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:23.540257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956964b4-49fe-4382-9dae-f2af16163d64 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:23.540540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956964b4-49fe-4382-9dae-f2af16163d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:23.540848 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956964b4-49fe-4382-9dae-f2af16163d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:23.541529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956964b4-49fe-4382-9dae-f2af16163d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:23.543552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894362a-1664-4ef3-82f7-700f707749c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:23.544136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956964b4-49fe-4382-9dae-f2af16163d64 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:23.544249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894362a-1664-4ef3-82f7-700f707749c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:23.544476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894362a-1664-4ef3-82f7-700f707749c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:23.544801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894362a-1664-4ef3-82f7-700f707749c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:23.545503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894362a-1664-4ef3-82f7-700f707749c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:23.547385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894362a-1664-4ef3-82f7-700f707749c4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:23.700621 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1616/3225] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:25:23 2022] POST /identity/v3/projects => generated 407 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:25:23.703593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956964b4-49fe-4382-9dae-f2af16163d64 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:23.736541 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1610/3226] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:25:23 2022] POST /identity/v3/projects => generated 361 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:25:23.745640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894362a-1664-4ef3-82f7-700f707749c4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:23.793842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956964b4-49fe-4382-9dae-f2af16163d64 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:23.872990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63815ca5-146a-43fc-b06d-8ef653235159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:23.874088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63815ca5-146a-43fc-b06d-8ef653235159 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:23.874609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63815ca5-146a-43fc-b06d-8ef653235159 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:23.874907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63815ca5-146a-43fc-b06d-8ef653235159 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:23.875611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63815ca5-146a-43fc-b06d-8ef653235159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:23.877621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63815ca5-146a-43fc-b06d-8ef653235159 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:23.898190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894362a-1664-4ef3-82f7-700f707749c4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:23.905350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46479b-fa71-494e-80bb-804bdb03036d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:23.906302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46479b-fa71-494e-80bb-804bdb03036d admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:23.907035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46479b-fa71-494e-80bb-804bdb03036d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:23.907515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46479b-fa71-494e-80bb-804bdb03036d admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:23.908563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46479b-fa71-494e-80bb-804bdb03036d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:23.911007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46479b-fa71-494e-80bb-804bdb03036d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:23.990249 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1617/3227] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:25:23 2022] POST /identity/v3/users => generated 304 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:25:23.993066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63815ca5-146a-43fc-b06d-8ef653235159 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:24.006228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63815ca5-146a-43fc-b06d-8ef653235159 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:24.010788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df48cc6-b80a-4a3f-a28e-3e3fb7639265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:24.012331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df48cc6-b80a-4a3f-a28e-3e3fb7639265 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:24.012666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df48cc6-b80a-4a3f-a28e-3e3fb7639265 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:24.013112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df48cc6-b80a-4a3f-a28e-3e3fb7639265 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:24.014114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df48cc6-b80a-4a3f-a28e-3e3fb7639265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:24.015740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df48cc6-b80a-4a3f-a28e-3e3fb7639265 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:24.026968 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1618/3228] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:25:24.031647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df48cc6-b80a-4a3f-a28e-3e3fb7639265 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:24.053501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df48cc6-b80a-4a3f-a28e-3e3fb7639265 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:24.057141 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a2db2-dde3-429c-baa8-85d805bb9a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:24.057841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a2db2-dde3-429c-baa8-85d805bb9a2b admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:24.058123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a2db2-dde3-429c-baa8-85d805bb9a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:24.058431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a2db2-dde3-429c-baa8-85d805bb9a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:24.059489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a2db2-dde3-429c-baa8-85d805bb9a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:24.061407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a2db2-dde3-429c-baa8-85d805bb9a2b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:24.062880 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1611/3229] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:25:23 2022] POST /identity/v3/users => generated 281 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:25:24.064573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46479b-fa71-494e-80bb-804bdb03036d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:24.076482 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1619/3230] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:25:24.076719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46479b-fa71-494e-80bb-804bdb03036d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:24.080239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a2db2-dde3-429c-baa8-85d805bb9a2b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:24.081916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3bc84-b409-4be6-a29f-354895a99c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:24.082547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3bc84-b409-4be6-a29f-354895a99c1d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:24.082981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3bc84-b409-4be6-a29f-354895a99c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:24.083272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3bc84-b409-4be6-a29f-354895a99c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:24.084011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3bc84-b409-4be6-a29f-354895a99c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:24.085672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3bc84-b409-4be6-a29f-354895a99c1d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:24.105061 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1612/3231] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:25:24.106076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3bc84-b409-4be6-a29f-354895a99c1d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:24.116212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a2db2-dde3-429c-baa8-85d805bb9a2b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:24.119806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3bc84-b409-4be6-a29f-354895a99c1d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:24.122441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ec337-4611-493b-860e-67cc5848453e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:24.123509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ec337-4611-493b-860e-67cc5848453e admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:24.124162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ec337-4611-493b-860e-67cc5848453e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:24.124519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ec337-4611-493b-860e-67cc5848453e admin admin] PATH_INFO: `/v3/projects/342aab6d1aa94d48b3cdd73778699fb3/users/eee060dbf36645db968bc0cbb3ba2529/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:24.125946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03c94d-43e8-455e-86c8-3a0baceafd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:24.126710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03c94d-43e8-455e-86c8-3a0baceafd61 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:24.127200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03c94d-43e8-455e-86c8-3a0baceafd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:24.127640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03c94d-43e8-455e-86c8-3a0baceafd61 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:24.128455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03c94d-43e8-455e-86c8-3a0baceafd61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:24.130266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03c94d-43e8-455e-86c8-3a0baceafd61 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:24.143111 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1613/3232] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:25:24.147736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03c94d-43e8-455e-86c8-3a0baceafd61 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:24.148383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ec337-4611-493b-860e-67cc5848453e admin admin] RBAC: Authorizing `identity:create_grant(project_id=342aab6d1aa94d48b3cdd73778699fb3, user_id=eee060dbf36645db968bc0cbb3ba2529, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:24.151059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ec337-4611-493b-860e-67cc5848453e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:24.159884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03c94d-43e8-455e-86c8-3a0baceafd61 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:24.164891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7b8de-08ca-412b-8175-4f067f649e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:24.166910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7b8de-08ca-412b-8175-4f067f649e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:24.166910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7b8de-08ca-412b-8175-4f067f649e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:24.166910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7b8de-08ca-412b-8175-4f067f649e1c admin admin] PATH_INFO: `/v3/projects/95b79dc0085c42dbbd93bedcf2d84079/users/028fdab3374e47248ce395b4257f9d17/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:24.182721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7b8de-08ca-412b-8175-4f067f649e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=95b79dc0085c42dbbd93bedcf2d84079, user_id=028fdab3374e47248ce395b4257f9d17, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:24.186182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7b8de-08ca-412b-8175-4f067f649e1c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:24.239425 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1620/3233] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:25:24 2022] PUT /identity/v3/projects/342aab6d1aa94d48b3cdd73778699fb3/users/eee060dbf36645db968bc0cbb3ba2529/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:24.250176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c73d-48c8-4653-897d-dd8bf15631cf None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:24.250535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c73d-48c8-4653-897d-dd8bf15631cf None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:24.250736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c73d-48c8-4653-897d-dd8bf15631cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:24.280247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0222c73d-48c8-4653-897d-dd8bf15631cf None None] MFA Rules not processed for user `eee060dbf36645db968bc0cbb3ba2529`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:24.281685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0222c73d-48c8-4653-897d-dd8bf15631cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:24.293808 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1614/3234] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:25:24 2022] PUT /identity/v3/projects/95b79dc0085c42dbbd93bedcf2d84079/users/028fdab3374e47248ce395b4257f9d17/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:25:24.305864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d7b40-1ddf-4c4c-aa06-b3187408e827 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:24.306290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d7b40-1ddf-4c4c-aa06-b3187408e827 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:24.306793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d7b40-1ddf-4c4c-aa06-b3187408e827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:24.343335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b00d7b40-1ddf-4c4c-aa06-b3187408e827 None None] MFA Rules not processed for user `028fdab3374e47248ce395b4257f9d17`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:24.344574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b00d7b40-1ddf-4c4c-aa06-b3187408e827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:24.361436 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1621/3235] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:24.365992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222c73d-48c8-4653-897d-dd8bf15631cf None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:24.422910 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1615/3236] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:25:24.430829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d7b40-1ddf-4c4c-aa06-b3187408e827 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:24.432497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b00d7b40-1ddf-4c4c-aa06-b3187408e827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:24.439074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222c73d-48c8-4653-897d-dd8bf15631cf None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:24.510132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63862696-71ad-44e1-9b5c-32cae25b22cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:24.510816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63862696-71ad-44e1-9b5c-32cae25b22cd admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:24.511108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63862696-71ad-44e1-9b5c-32cae25b22cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:24.511391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63862696-71ad-44e1-9b5c-32cae25b22cd admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:24.511895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d7b40-1ddf-4c4c-aa06-b3187408e827 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:24.512269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63862696-71ad-44e1-9b5c-32cae25b22cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:24.514854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63862696-71ad-44e1-9b5c-32cae25b22cd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:24.516464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6893b-647e-400f-bed4-166f8dac8ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:24.517153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6893b-647e-400f-bed4-166f8dac8ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:24.520709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6893b-647e-400f-bed4-166f8dac8ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:24.520709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6893b-647e-400f-bed4-166f8dac8ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:24.527076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6893b-647e-400f-bed4-166f8dac8ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:24.528514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6893b-647e-400f-bed4-166f8dac8ba8 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:24.538170 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1616/3237] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:25:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:25:24.624061 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1622/3238] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:25:24 2022] POST /identity/v3/projects => generated 409 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:25:24.628159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6893b-647e-400f-bed4-166f8dac8ba8 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:24.639158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6893b-647e-400f-bed4-166f8dac8ba8 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:24.702071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c18912-ee40-4717-9ec1-f46785701301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:24.702872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c18912-ee40-4717-9ec1-f46785701301 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:24.703224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c18912-ee40-4717-9ec1-f46785701301 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:24.703576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c18912-ee40-4717-9ec1-f46785701301 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:24.704291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c18912-ee40-4717-9ec1-f46785701301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:24.706472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c18912-ee40-4717-9ec1-f46785701301 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:24.799202 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1617/3239] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:25:24 2022] POST /identity/v3/users => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:25:24.800408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63862696-71ad-44e1-9b5c-32cae25b22cd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:24.812013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63862696-71ad-44e1-9b5c-32cae25b22cd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:24.817888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7395430-f9d9-4a3e-bed0-2928f770f52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:24.819087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7395430-f9d9-4a3e-bed0-2928f770f52d admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:24.819087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7395430-f9d9-4a3e-bed0-2928f770f52d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:24.819087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7395430-f9d9-4a3e-bed0-2928f770f52d admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:24.820063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7395430-f9d9-4a3e-bed0-2928f770f52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:24.821878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7395430-f9d9-4a3e-bed0-2928f770f52d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:24.838440 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1623/3240] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:25:24.843322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c18912-ee40-4717-9ec1-f46785701301 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:24.856005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c18912-ee40-4717-9ec1-f46785701301 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:24.862619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5214f7-6da2-430e-9981-1b1d54a63678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:24.863974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5214f7-6da2-430e-9981-1b1d54a63678 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:24.864423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5214f7-6da2-430e-9981-1b1d54a63678 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:24.864861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5214f7-6da2-430e-9981-1b1d54a63678 admin admin] PATH_INFO: `/v3/projects/647eb7afdf0544959f8081504173606c/users/7fb60fbfa0e04886b84d55f2253a2976/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:24.892226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5214f7-6da2-430e-9981-1b1d54a63678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=647eb7afdf0544959f8081504173606c, user_id=7fb60fbfa0e04886b84d55f2253a2976, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:24.895970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5214f7-6da2-430e-9981-1b1d54a63678 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:24.968264 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1618/3241] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:25:24 2022] PUT /identity/v3/projects/647eb7afdf0544959f8081504173606c/users/7fb60fbfa0e04886b84d55f2253a2976/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:24.972293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7395430-f9d9-4a3e-bed0-2928f770f52d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:25.003350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7395430-f9d9-4a3e-bed0-2928f770f52d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:25.099272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d96a95-f620-44de-a1ad-24b984c3589a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:25.099272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d96a95-f620-44de-a1ad-24b984c3589a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:25.099272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d96a95-f620-44de-a1ad-24b984c3589a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:25.099272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d96a95-f620-44de-a1ad-24b984c3589a admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:25.099762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d96a95-f620-44de-a1ad-24b984c3589a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:25.099939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d96a95-f620-44de-a1ad-24b984c3589a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:25.113691 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1624/3242] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:25:25.117918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5214f7-6da2-430e-9981-1b1d54a63678 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:25.128866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5214f7-6da2-430e-9981-1b1d54a63678 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:25.133828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56840052-2078-49bc-b4d6-5d5226b143ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:25.135215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56840052-2078-49bc-b4d6-5d5226b143ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:25.135215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56840052-2078-49bc-b4d6-5d5226b143ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:25.135412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56840052-2078-49bc-b4d6-5d5226b143ce admin admin] PATH_INFO: `/v3/projects/647eb7afdf0544959f8081504173606c/users/7fb60fbfa0e04886b84d55f2253a2976/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:25.137470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56840052-2078-49bc-b4d6-5d5226b143ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=647eb7afdf0544959f8081504173606c, user_id=7fb60fbfa0e04886b84d55f2253a2976, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:25.140109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56840052-2078-49bc-b4d6-5d5226b143ce admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:25.151042 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1619/3243] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:25:25 2022] PUT /identity/v3/projects/647eb7afdf0544959f8081504173606c/users/7fb60fbfa0e04886b84d55f2253a2976/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:25:25.166357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dbf81-603c-4db3-8d6d-9187d2fa2e5f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:25.166357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dbf81-603c-4db3-8d6d-9187d2fa2e5f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:25.166357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dbf81-603c-4db3-8d6d-9187d2fa2e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:25.191491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ac3dbf81-603c-4db3-8d6d-9187d2fa2e5f None None] MFA Rules not processed for user `7fb60fbfa0e04886b84d55f2253a2976`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:25.193275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ac3dbf81-603c-4db3-8d6d-9187d2fa2e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:25.288281 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1625/3244] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:25 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:25.289486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56840052-2078-49bc-b4d6-5d5226b143ce admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:25.389042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56840052-2078-49bc-b4d6-5d5226b143ce admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:25.394173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cd88e-511c-43fb-951f-4080959c49e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:25.395351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cd88e-511c-43fb-951f-4080959c49e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:25.395737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cd88e-511c-43fb-951f-4080959c49e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:25.396120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cd88e-511c-43fb-951f-4080959c49e1 admin admin] PATH_INFO: `/v3/users/eee060dbf36645db968bc0cbb3ba2529` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:25.397494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5cd88e-511c-43fb-951f-4080959c49e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eee060dbf36645db968bc0cbb3ba2529)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:25.399523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5cd88e-511c-43fb-951f-4080959c49e1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:25.620115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fb5cd88e-511c-43fb-951f-4080959c49e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eee060dbf36645db968bc0cbb3ba2529'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:25.634020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fb5cd88e-511c-43fb-951f-4080959c49e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eee060dbf36645db968bc0cbb3ba2529'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:25.635131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fb5cd88e-511c-43fb-951f-4080959c49e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eee060dbf36645db968bc0cbb3ba2529'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:25.650011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fb5cd88e-511c-43fb-951f-4080959c49e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eee060dbf36645db968bc0cbb3ba2529'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:25.705875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3dbf81-603c-4db3-8d6d-9187d2fa2e5f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:25.706877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ac3dbf81-603c-4db3-8d6d-9187d2fa2e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:25.726122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fb5cd88e-511c-43fb-951f-4080959c49e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eee060dbf36645db968bc0cbb3ba2529'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:25.741697 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1620/3245] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:25:25 2022] DELETE /identity/v3/users/eee060dbf36645db968bc0cbb3ba2529 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:25.743925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513e74b-3f43-4be3-b987-c99f24e49cb5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:25.744676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513e74b-3f43-4be3-b987-c99f24e49cb5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:25.745114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513e74b-3f43-4be3-b987-c99f24e49cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:25.768389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0513e74b-3f43-4be3-b987-c99f24e49cb5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:25.770217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0513e74b-3f43-4be3-b987-c99f24e49cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:25.798304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3dbf81-603c-4db3-8d6d-9187d2fa2e5f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:25.852823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31828fe6-85d2-4294-9930-d08183db8af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:25.853541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31828fe6-85d2-4294-9930-d08183db8af3 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:25.853831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31828fe6-85d2-4294-9930-d08183db8af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:25.854108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31828fe6-85d2-4294-9930-d08183db8af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:25.855645 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1621/3246] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:25.859233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-31828fe6-85d2-4294-9930-d08183db8af3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:25.868579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513e74b-3f43-4be3-b987-c99f24e49cb5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:25.871773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31828fe6-85d2-4294-9930-d08183db8af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:25.872173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0513e74b-3f43-4be3-b987-c99f24e49cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:25.873229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31828fe6-85d2-4294-9930-d08183db8af3 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:25.883086 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1626/3247] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:25:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:25:25.902766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513e74b-3f43-4be3-b987-c99f24e49cb5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:25.906911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75694869-e601-4cfb-81bb-a3f2516ce5d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:25.907825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75694869-e601-4cfb-81bb-a3f2516ce5d0 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:25.908186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75694869-e601-4cfb-81bb-a3f2516ce5d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:25.908619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75694869-e601-4cfb-81bb-a3f2516ce5d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:25.919963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75694869-e601-4cfb-81bb-a3f2516ce5d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:25.922366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75694869-e601-4cfb-81bb-a3f2516ce5d0 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:25.941843 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1622/3248] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:25:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:25:26.765700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31828fe6-85d2-4294-9930-d08183db8af3 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:26.765700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-31828fe6-85d2-4294-9930-d08183db8af3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:26.798301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31828fe6-85d2-4294-9930-d08183db8af3 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:26.813637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383728e-613f-4733-ab4d-22336e706a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:26.815712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383728e-613f-4733-ab4d-22336e706a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:26.816738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383728e-613f-4733-ab4d-22336e706a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:26.817090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383728e-613f-4733-ab4d-22336e706a0a admin admin] PATH_INFO: `/v3/projects/342aab6d1aa94d48b3cdd73778699fb3` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:26.820724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383728e-613f-4733-ab4d-22336e706a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=342aab6d1aa94d48b3cdd73778699fb3)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:26.825338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383728e-613f-4733-ab4d-22336e706a0a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:27.027133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2383728e-613f-4733-ab4d-22336e706a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '342aab6d1aa94d48b3cdd73778699fb3', 'request_id': 'req-2383728e-613f-4733-ab4d-22336e706a0a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:27.040879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2383728e-613f-4733-ab4d-22336e706a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '342aab6d1aa94d48b3cdd73778699fb3', 'request_id': 'req-2383728e-613f-4733-ab4d-22336e706a0a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:27.134157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2383728e-613f-4733-ab4d-22336e706a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '342aab6d1aa94d48b3cdd73778699fb3', 'request_id': 'req-2383728e-613f-4733-ab4d-22336e706a0a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:27.148542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2383728e-613f-4733-ab4d-22336e706a0a admin admin] The token cache is being invalidate because project 342aab6d1aa94d48b3cdd73778699fb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:25:27.148875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2383728e-613f-4733-ab4d-22336e706a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:27.150041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2383728e-613f-4733-ab4d-22336e706a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:27.153297 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1627/3249] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:25:26 2022] DELETE /identity/v3/projects/342aab6d1aa94d48b3cdd73778699fb3 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:27.159678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75694869-e601-4cfb-81bb-a3f2516ce5d0 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:27.177914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75694869-e601-4cfb-81bb-a3f2516ce5d0 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:27.258205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40c557-a5fa-4610-b2fd-b2956aeba455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:27.259020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40c557-a5fa-4610-b2fd-b2956aeba455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:27.259397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40c557-a5fa-4610-b2fd-b2956aeba455 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:27.259688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40c557-a5fa-4610-b2fd-b2956aeba455 admin admin] PATH_INFO: `/v3/users/7fb60fbfa0e04886b84d55f2253a2976` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:27.261060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40c557-a5fa-4610-b2fd-b2956aeba455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb60fbfa0e04886b84d55f2253a2976)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:27.263225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40c557-a5fa-4610-b2fd-b2956aeba455 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:27.466191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4b40c557-a5fa-4610-b2fd-b2956aeba455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb60fbfa0e04886b84d55f2253a2976'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:27.478792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4b40c557-a5fa-4610-b2fd-b2956aeba455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb60fbfa0e04886b84d55f2253a2976'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:27.480383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4b40c557-a5fa-4610-b2fd-b2956aeba455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb60fbfa0e04886b84d55f2253a2976'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:27.490030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4b40c557-a5fa-4610-b2fd-b2956aeba455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb60fbfa0e04886b84d55f2253a2976'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:27.560627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4b40c557-a5fa-4610-b2fd-b2956aeba455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb60fbfa0e04886b84d55f2253a2976'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:27.578407 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1623/3250] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:25:27 2022] DELETE /identity/v3/users/7fb60fbfa0e04886b84d55f2253a2976 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:28.224710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383728e-613f-4733-ab4d-22336e706a0a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:28.224710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2383728e-613f-4733-ab4d-22336e706a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:28.238979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383728e-613f-4733-ab4d-22336e706a0a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:28.306541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8831df7-4692-4f01-8671-e066028731bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:28.307442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8831df7-4692-4f01-8671-e066028731bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:28.307727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8831df7-4692-4f01-8671-e066028731bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:28.308004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8831df7-4692-4f01-8671-e066028731bf admin admin] PATH_INFO: `/v3/projects/647eb7afdf0544959f8081504173606c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:28.309229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8831df7-4692-4f01-8671-e066028731bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=647eb7afdf0544959f8081504173606c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:28.311149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8831df7-4692-4f01-8671-e066028731bf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:28.451375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b8831df7-4692-4f01-8671-e066028731bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '647eb7afdf0544959f8081504173606c', 'request_id': 'req-b8831df7-4692-4f01-8671-e066028731bf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:28.460478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b8831df7-4692-4f01-8671-e066028731bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '647eb7afdf0544959f8081504173606c', 'request_id': 'req-b8831df7-4692-4f01-8671-e066028731bf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:28.600309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b8831df7-4692-4f01-8671-e066028731bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '647eb7afdf0544959f8081504173606c', 'request_id': 'req-b8831df7-4692-4f01-8671-e066028731bf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:28.611797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b8831df7-4692-4f01-8671-e066028731bf admin admin] The token cache is being invalidate because project 647eb7afdf0544959f8081504173606c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:25:28.612309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b8831df7-4692-4f01-8671-e066028731bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:28.613040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b8831df7-4692-4f01-8671-e066028731bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:28.621415 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1628/3251] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:25:28 2022] DELETE /identity/v3/projects/647eb7afdf0544959f8081504173606c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:28.633235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ab406-1ca5-452c-bbb1-d7a121ba58f5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:28.633235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ab406-1ca5-452c-bbb1-d7a121ba58f5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:28.633235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ab406-1ca5-452c-bbb1-d7a121ba58f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:28.660883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-437ab406-1ca5-452c-bbb1-d7a121ba58f5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:28.662166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-437ab406-1ca5-452c-bbb1-d7a121ba58f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:28.738503 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1624/3252] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:28.749117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fe30e-373a-4f53-b177-651e3c165f9f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:28.749473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fe30e-373a-4f53-b177-651e3c165f9f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:28.749768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fe30e-373a-4f53-b177-651e3c165f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:28.774257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-005fe30e-373a-4f53-b177-651e3c165f9f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:28.775515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-005fe30e-373a-4f53-b177-651e3c165f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:28.790818 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1629/3253] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:28.795514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ab406-1ca5-452c-bbb1-d7a121ba58f5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:28.810085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ab406-1ca5-452c-bbb1-d7a121ba58f5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:28.812835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23304ea7-df18-40d2-b833-f42c0642c95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:28.813691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23304ea7-df18-40d2-b833-f42c0642c95f admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:28.813984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23304ea7-df18-40d2-b833-f42c0642c95f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:28.814280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23304ea7-df18-40d2-b833-f42c0642c95f admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:28.815017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23304ea7-df18-40d2-b833-f42c0642c95f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:25:28.815337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23304ea7-df18-40d2-b833-f42c0642c95f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:28.817013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23304ea7-df18-40d2-b833-f42c0642c95f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:28.832990 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1625/3254] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:25:28.837451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fe30e-373a-4f53-b177-651e3c165f9f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:28.847535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fe30e-373a-4f53-b177-651e3c165f9f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:28.852997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14756af5-9f46-4919-8e6e-58744af9ef17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:28.856030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14756af5-9f46-4919-8e6e-58744af9ef17 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:28.856030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14756af5-9f46-4919-8e6e-58744af9ef17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:28.856030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14756af5-9f46-4919-8e6e-58744af9ef17 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:28.856030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14756af5-9f46-4919-8e6e-58744af9ef17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:28.856950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14756af5-9f46-4919-8e6e-58744af9ef17 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:28.967874 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1630/3255] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:25:28 2022] POST /identity/v3/projects => generated 393 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:25:28.968791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23304ea7-df18-40d2-b833-f42c0642c95f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:28.981637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23304ea7-df18-40d2-b833-f42c0642c95f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:29.054233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926643a0-2cf6-4942-be7a-d4ea6e2b50b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:29.055192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926643a0-2cf6-4942-be7a-d4ea6e2b50b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:29.055542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926643a0-2cf6-4942-be7a-d4ea6e2b50b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:29.055925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926643a0-2cf6-4942-be7a-d4ea6e2b50b4 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:29.057019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926643a0-2cf6-4942-be7a-d4ea6e2b50b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:29.065225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926643a0-2cf6-4942-be7a-d4ea6e2b50b4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:29.205394 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1626/3256] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:25:28 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:25:29.206855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14756af5-9f46-4919-8e6e-58744af9ef17 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:29.219759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14756af5-9f46-4919-8e6e-58744af9ef17 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:29.224547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75c729-49c5-43dc-b084-cc0bad7d5da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:29.225446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75c729-49c5-43dc-b084-cc0bad7d5da5 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:29.226368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75c729-49c5-43dc-b084-cc0bad7d5da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:29.226850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75c729-49c5-43dc-b084-cc0bad7d5da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:29.227792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75c729-49c5-43dc-b084-cc0bad7d5da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:29.229750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75c729-49c5-43dc-b084-cc0bad7d5da5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:29.249772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926643a0-2cf6-4942-be7a-d4ea6e2b50b4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:29.257174 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1631/3257] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:25:29.267471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926643a0-2cf6-4942-be7a-d4ea6e2b50b4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:29.276324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e79f5-4082-4022-88dc-8add2e3f7780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:29.277080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e79f5-4082-4022-88dc-8add2e3f7780 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:29.277372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e79f5-4082-4022-88dc-8add2e3f7780 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:29.277651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e79f5-4082-4022-88dc-8add2e3f7780 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:29.278384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e79f5-4082-4022-88dc-8add2e3f7780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:29.281101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e79f5-4082-4022-88dc-8add2e3f7780 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:29.313947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75c729-49c5-43dc-b084-cc0bad7d5da5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:29.324430 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1627/3258] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:25:29.324948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75c729-49c5-43dc-b084-cc0bad7d5da5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:29.330611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e2e50-b8d8-457a-9d47-0dd62f0c1856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:29.331226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e2e50-b8d8-457a-9d47-0dd62f0c1856 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:29.331698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e2e50-b8d8-457a-9d47-0dd62f0c1856 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:29.332171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e2e50-b8d8-457a-9d47-0dd62f0c1856 admin admin] PATH_INFO: `/v3/projects/a071591c8b744124be2c1ccf30bf8602/users/aa89956fbc8e45e58021fae73812f473/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:29.348965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e2e50-b8d8-457a-9d47-0dd62f0c1856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a071591c8b744124be2c1ccf30bf8602, user_id=aa89956fbc8e45e58021fae73812f473, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:29.351989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e2e50-b8d8-457a-9d47-0dd62f0c1856 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:29.441944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cfc16-97e4-4ede-9c27-823ff2b37932 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:29.442463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cfc16-97e4-4ede-9c27-823ff2b37932 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:29.442949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cfc16-97e4-4ede-9c27-823ff2b37932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:29.444615 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1632/3259] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:25:29 2022] PUT /identity/v3/projects/a071591c8b744124be2c1ccf30bf8602/users/aa89956fbc8e45e58021fae73812f473/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:25:29.490314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-7a4cfc16-97e4-4ede-9c27-823ff2b37932 None None] MFA Rules not processed for user `aa89956fbc8e45e58021fae73812f473`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:29.492463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7a4cfc16-97e4-4ede-9c27-823ff2b37932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:29.641899 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1628/3260] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:29.652442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e2e50-b8d8-457a-9d47-0dd62f0c1856 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:29.735908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e2e50-b8d8-457a-9d47-0dd62f0c1856 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:29.740911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766457e-657f-4551-a410-9d5ebfd9c26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:29.741586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766457e-657f-4551-a410-9d5ebfd9c26a admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:29.741872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766457e-657f-4551-a410-9d5ebfd9c26a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:29.742155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766457e-657f-4551-a410-9d5ebfd9c26a admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:29.742989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766457e-657f-4551-a410-9d5ebfd9c26a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:29.745011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766457e-657f-4551-a410-9d5ebfd9c26a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:29.878391 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1633/3261] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:25:29 2022] POST /identity/v3/projects => generated 395 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:25:29.882468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cfc16-97e4-4ede-9c27-823ff2b37932 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:29.900087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cfc16-97e4-4ede-9c27-823ff2b37932 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:30.008783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e0cb3-fe9a-4ffe-a416-2af405c70ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:30.010434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e0cb3-fe9a-4ffe-a416-2af405c70ccc admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:30.012086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e0cb3-fe9a-4ffe-a416-2af405c70ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:30.012476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e0cb3-fe9a-4ffe-a416-2af405c70ccc admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:30.014370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e0cb3-fe9a-4ffe-a416-2af405c70ccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:30.017215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e0cb3-fe9a-4ffe-a416-2af405c70ccc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:30.150766 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1629/3262] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:25:29 2022] POST /identity/v3/users => generated 304 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:25:30.151617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766457e-657f-4551-a410-9d5ebfd9c26a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:30.170594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766457e-657f-4551-a410-9d5ebfd9c26a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:30.197428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210c140-2bf8-4865-918d-8f206580cd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:30.199365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210c140-2bf8-4865-918d-8f206580cd3e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:30.199365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210c140-2bf8-4865-918d-8f206580cd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:30.199365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210c140-2bf8-4865-918d-8f206580cd3e admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:30.200887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210c140-2bf8-4865-918d-8f206580cd3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:30.211826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210c140-2bf8-4865-918d-8f206580cd3e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:30.239339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e0cb3-fe9a-4ffe-a416-2af405c70ccc admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:30.242126 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1634/3263] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:25:30.257919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e0cb3-fe9a-4ffe-a416-2af405c70ccc admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:30.274172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564568f-0bd7-43b8-8a7c-b2f104dd17e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:30.275387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564568f-0bd7-43b8-8a7c-b2f104dd17e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:30.275914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564568f-0bd7-43b8-8a7c-b2f104dd17e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:30.276405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564568f-0bd7-43b8-8a7c-b2f104dd17e9 admin admin] PATH_INFO: `/v3/projects/00028c43b25d4e399eff5cd1744297d8/users/fc18613353ae4fe9bffa1223f347607f/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:30.316887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564568f-0bd7-43b8-8a7c-b2f104dd17e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00028c43b25d4e399eff5cd1744297d8, user_id=fc18613353ae4fe9bffa1223f347607f, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:30.322011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564568f-0bd7-43b8-8a7c-b2f104dd17e9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:30.405493 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1630/3264] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:25:30 2022] PUT /identity/v3/projects/00028c43b25d4e399eff5cd1744297d8/users/fc18613353ae4fe9bffa1223f347607f/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:25:30.406418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210c140-2bf8-4865-918d-8f206580cd3e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:30.425264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210c140-2bf8-4865-918d-8f206580cd3e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:30.539579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26459bd5-34f0-4fc0-acd6-f510df6cf333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:30.541921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26459bd5-34f0-4fc0-acd6-f510df6cf333 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:30.543490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26459bd5-34f0-4fc0-acd6-f510df6cf333 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:30.544071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26459bd5-34f0-4fc0-acd6-f510df6cf333 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:30.545779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26459bd5-34f0-4fc0-acd6-f510df6cf333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:30.549137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26459bd5-34f0-4fc0-acd6-f510df6cf333 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:30.577640 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1635/3265] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:25:30.578945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564568f-0bd7-43b8-8a7c-b2f104dd17e9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:30.597417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564568f-0bd7-43b8-8a7c-b2f104dd17e9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:30.604410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbc423-e65a-49ae-bde1-bcfd54ac389c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:30.605876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbc423-e65a-49ae-bde1-bcfd54ac389c admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:30.606230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbc423-e65a-49ae-bde1-bcfd54ac389c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:30.606429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbc423-e65a-49ae-bde1-bcfd54ac389c admin admin] PATH_INFO: `/v3/projects/00028c43b25d4e399eff5cd1744297d8/users/fc18613353ae4fe9bffa1223f347607f/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:30.617740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbc423-e65a-49ae-bde1-bcfd54ac389c admin admin] RBAC: Authorizing `identity:create_grant(project_id=00028c43b25d4e399eff5cd1744297d8, user_id=fc18613353ae4fe9bffa1223f347607f, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:30.620466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbc423-e65a-49ae-bde1-bcfd54ac389c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:30.642614 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1631/3266] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:25:30 2022] PUT /identity/v3/projects/00028c43b25d4e399eff5cd1744297d8/users/fc18613353ae4fe9bffa1223f347607f/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:30.654732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afee0c-0cac-442b-b5eb-980fce07a902 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:30.655048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afee0c-0cac-442b-b5eb-980fce07a902 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:30.661049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afee0c-0cac-442b-b5eb-980fce07a902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:30.730721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-64afee0c-0cac-442b-b5eb-980fce07a902 None None] MFA Rules not processed for user `fc18613353ae4fe9bffa1223f347607f`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:30.732854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-64afee0c-0cac-442b-b5eb-980fce07a902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:30.940060 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1636/3267] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:30.942170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15c4e3-29c1-4f01-9761-c29a0c131856 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:30.942647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15c4e3-29c1-4f01-9761-c29a0c131856 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:30.943110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15c4e3-29c1-4f01-9761-c29a0c131856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:30.974653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fa15c4e3-29c1-4f01-9761-c29a0c131856 None None] MFA Rules not processed for user `aa89956fbc8e45e58021fae73812f473`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:30.976071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fa15c4e3-29c1-4f01-9761-c29a0c131856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:31.131010 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1632/3268] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:31.288840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afee0c-0cac-442b-b5eb-980fce07a902 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:31.290317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-64afee0c-0cac-442b-b5eb-980fce07a902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:31.430569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afee0c-0cac-442b-b5eb-980fce07a902 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:31.437089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03279f8e-39a9-44c3-ab9b-1fec46a8ab63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:31.438281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03279f8e-39a9-44c3-ab9b-1fec46a8ab63 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:31.439394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03279f8e-39a9-44c3-ab9b-1fec46a8ab63 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:31.439920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03279f8e-39a9-44c3-ab9b-1fec46a8ab63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:31.451248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03279f8e-39a9-44c3-ab9b-1fec46a8ab63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:31.453483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03279f8e-39a9-44c3-ab9b-1fec46a8ab63 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:31.477556 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1637/3269] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:25:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:25:33.912656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d010d5-eac9-421c-b749-37f34f317bb6 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:33.913473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d010d5-eac9-421c-b749-37f34f317bb6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:33.913760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d010d5-eac9-421c-b749-37f34f317bb6 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:33.915172 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1633/3270] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:25:33.920446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e34905-e9cf-4731-92e5-16f11d033a12 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:33.920940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e34905-e9cf-4731-92e5-16f11d033a12 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:33.921053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e34905-e9cf-4731-92e5-16f11d033a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:33.943992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c6e34905-e9cf-4731-92e5-16f11d033a12 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:33.945401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c6e34905-e9cf-4731-92e5-16f11d033a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:34.020440 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1638/3271] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:25:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:25:34.047640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d010d5-eac9-421c-b749-37f34f317bb6 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:34.049517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a0d010d5-eac9-421c-b749-37f34f317bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:34.068593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d010d5-eac9-421c-b749-37f34f317bb6 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:34.075366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f47b9-c8d3-4e15-addd-d52f2d8bcc8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:34.076048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f47b9-c8d3-4e15-addd-d52f2d8bcc8b service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:34.076330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f47b9-c8d3-4e15-addd-d52f2d8bcc8b service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:34.076644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f47b9-c8d3-4e15-addd-d52f2d8bcc8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:34.085900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f47b9-c8d3-4e15-addd-d52f2d8bcc8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:34.088473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f47b9-c8d3-4e15-addd-d52f2d8bcc8b service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:34.111379 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1634/3272] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:25:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:25:34.482410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef27861-1adf-45ab-b0f3-8c33b4431ffa None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:34.490979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef27861-1adf-45ab-b0f3-8c33b4431ffa None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:34.490979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef27861-1adf-45ab-b0f3-8c33b4431ffa None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:34.490979 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1639/3273] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:25:34.491385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf576a8-c8a9-4523-92cc-f70ce0035860 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:34.491567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf576a8-c8a9-4523-92cc-f70ce0035860 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:34.492489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf576a8-c8a9-4523-92cc-f70ce0035860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:34.515225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-acf576a8-c8a9-4523-92cc-f70ce0035860 None None] MFA Rules not processed for user `e6036dd39fb74289a8cbdcd6a21f8662`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:34.516985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-acf576a8-c8a9-4523-92cc-f70ce0035860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:34.533398 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1635/3274] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:25:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:34.572014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef27861-1adf-45ab-b0f3-8c33b4431ffa None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:34.573959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bef27861-1adf-45ab-b0f3-8c33b4431ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:34.654092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef27861-1adf-45ab-b0f3-8c33b4431ffa None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:34.661011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889bce4-7cbd-423a-9a60-117262024688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:34.661722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889bce4-7cbd-423a-9a60-117262024688 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:34.663538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889bce4-7cbd-423a-9a60-117262024688 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:34.663909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889bce4-7cbd-423a-9a60-117262024688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:34.678240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889bce4-7cbd-423a-9a60-117262024688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:34.681388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889bce4-7cbd-423a-9a60-117262024688 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:34.697696 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1640/3275] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:25:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:25:43.948156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf576a8-c8a9-4523-92cc-f70ce0035860 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:43.952564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-acf576a8-c8a9-4523-92cc-f70ce0035860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:43.968433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf576a8-c8a9-4523-92cc-f70ce0035860 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:43.972698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40fa62-7512-4484-bafc-51f2e5023620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:43.973961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40fa62-7512-4484-bafc-51f2e5023620 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:43.974546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40fa62-7512-4484-bafc-51f2e5023620 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:43.974838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40fa62-7512-4484-bafc-51f2e5023620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:43.982178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0c40fa62-7512-4484-bafc-51f2e5023620 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:44.003096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40fa62-7512-4484-bafc-51f2e5023620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:44.004552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40fa62-7512-4484-bafc-51f2e5023620 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:44.028960 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1636/3276] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:25:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:25:44.511810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b83be-d201-429e-95ad-cea56f9c0122 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:44.512678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b83be-d201-429e-95ad-cea56f9c0122 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:44.513192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b83be-d201-429e-95ad-cea56f9c0122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:44.535236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-665b83be-d201-429e-95ad-cea56f9c0122 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:44.538888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-665b83be-d201-429e-95ad-cea56f9c0122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:44.633245 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1641/3277] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:25:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:44.670884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40fa62-7512-4484-bafc-51f2e5023620 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:44.672351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0c40fa62-7512-4484-bafc-51f2e5023620 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:44.759831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40fa62-7512-4484-bafc-51f2e5023620 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:44.772616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9f7b5-d650-4006-8212-10d4b55249a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:44.773723 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9f7b5-d650-4006-8212-10d4b55249a3 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:44.774291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9f7b5-d650-4006-8212-10d4b55249a3 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:44.774887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9f7b5-d650-4006-8212-10d4b55249a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:44.787695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9f7b5-d650-4006-8212-10d4b55249a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:44.790582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9f7b5-d650-4006-8212-10d4b55249a3 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:44.810339 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1637/3278] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:25:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:25:53.254851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b83be-d201-429e-95ad-cea56f9c0122 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:53.256863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-665b83be-d201-429e-95ad-cea56f9c0122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:53.429043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b83be-d201-429e-95ad-cea56f9c0122 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:53.444450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c12279-159d-4eed-953c-54652d4acb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:53.445434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c12279-159d-4eed-953c-54652d4acb3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:53.450044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c12279-159d-4eed-953c-54652d4acb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:53.450044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c12279-159d-4eed-953c-54652d4acb3e admin admin] PATH_INFO: `/v3/users/1ea3eddf81624b41a4410ea85e17eabe` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:53.450044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c12279-159d-4eed-953c-54652d4acb3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ea3eddf81624b41a4410ea85e17eabe)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:53.459492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c12279-159d-4eed-953c-54652d4acb3e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:53.696009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f3c12279-159d-4eed-953c-54652d4acb3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea3eddf81624b41a4410ea85e17eabe'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:53.711705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f3c12279-159d-4eed-953c-54652d4acb3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea3eddf81624b41a4410ea85e17eabe'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:53.712577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f3c12279-159d-4eed-953c-54652d4acb3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea3eddf81624b41a4410ea85e17eabe'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:53.728384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f3c12279-159d-4eed-953c-54652d4acb3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea3eddf81624b41a4410ea85e17eabe'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:53.812355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f3c12279-159d-4eed-953c-54652d4acb3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea3eddf81624b41a4410ea85e17eabe'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:53.823639 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1642/3279] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:25:53 2022] DELETE /identity/v3/users/1ea3eddf81624b41a4410ea85e17eabe => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:54.584089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9f7b5-d650-4006-8212-10d4b55249a3 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:54.597057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9f7b5-d650-4006-8212-10d4b55249a3 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:54.743321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab2584-612e-4e00-8506-da1806925cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:54.745977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab2584-612e-4e00-8506-da1806925cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:54.746363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab2584-612e-4e00-8506-da1806925cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:54.750571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab2584-612e-4e00-8506-da1806925cf8 admin admin] PATH_INFO: `/v3/projects/1b2130a8035040089eef66d1efbf65df` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:54.750571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab2584-612e-4e00-8506-da1806925cf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b2130a8035040089eef66d1efbf65df)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:54.752063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab2584-612e-4e00-8506-da1806925cf8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:54.908778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bdab2584-612e-4e00-8506-da1806925cf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b2130a8035040089eef66d1efbf65df', 'request_id': 'req-bdab2584-612e-4e00-8506-da1806925cf8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:54.983202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bdab2584-612e-4e00-8506-da1806925cf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b2130a8035040089eef66d1efbf65df', 'request_id': 'req-bdab2584-612e-4e00-8506-da1806925cf8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:54.993858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bdab2584-612e-4e00-8506-da1806925cf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b2130a8035040089eef66d1efbf65df', 'request_id': 'req-bdab2584-612e-4e00-8506-da1806925cf8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:55.009539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bdab2584-612e-4e00-8506-da1806925cf8 admin admin] The token cache is being invalidate because project 1b2130a8035040089eef66d1efbf65df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:25:55.010303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bdab2584-612e-4e00-8506-da1806925cf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:55.011902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bdab2584-612e-4e00-8506-da1806925cf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:55.014530 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1638/3280] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:25:54 2022] DELETE /identity/v3/projects/1b2130a8035040089eef66d1efbf65df => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:55.019037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c12279-159d-4eed-953c-54652d4acb3e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:55.021363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f3c12279-159d-4eed-953c-54652d4acb3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:55.042220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c12279-159d-4eed-953c-54652d4acb3e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:55.201200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c82ba-6d64-44a3-9e5d-50580fc57070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:55.201200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c82ba-6d64-44a3-9e5d-50580fc57070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:55.201200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c82ba-6d64-44a3-9e5d-50580fc57070 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:55.201200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c82ba-6d64-44a3-9e5d-50580fc57070 admin admin] PATH_INFO: `/v3/users/1da5ba60aea64ed0b8d9d23f19780c79` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:55.222737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c82ba-6d64-44a3-9e5d-50580fc57070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da5ba60aea64ed0b8d9d23f19780c79)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:55.231596 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c82ba-6d64-44a3-9e5d-50580fc57070 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:55.490838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e68c82ba-6d64-44a3-9e5d-50580fc57070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da5ba60aea64ed0b8d9d23f19780c79'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:55.538498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e68c82ba-6d64-44a3-9e5d-50580fc57070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da5ba60aea64ed0b8d9d23f19780c79'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:55.539254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e68c82ba-6d64-44a3-9e5d-50580fc57070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da5ba60aea64ed0b8d9d23f19780c79'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:55.547834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e68c82ba-6d64-44a3-9e5d-50580fc57070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da5ba60aea64ed0b8d9d23f19780c79'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:55.622507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e68c82ba-6d64-44a3-9e5d-50580fc57070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da5ba60aea64ed0b8d9d23f19780c79'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:55.632958 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1643/3281] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:25:55 2022] DELETE /identity/v3/users/1da5ba60aea64ed0b8d9d23f19780c79 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:56.436292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab2584-612e-4e00-8506-da1806925cf8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:56.439382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bdab2584-612e-4e00-8506-da1806925cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:56.481198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab2584-612e-4e00-8506-da1806925cf8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:56.728336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd787d53-490f-43da-bc38-6d6422eeedce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:56.732069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd787d53-490f-43da-bc38-6d6422eeedce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:56.736961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd787d53-490f-43da-bc38-6d6422eeedce admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:56.737645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd787d53-490f-43da-bc38-6d6422eeedce admin admin] PATH_INFO: `/v3/projects/11d4f336c09944c68796029ff93dcf1e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:56.740881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd787d53-490f-43da-bc38-6d6422eeedce admin admin] RBAC: Authorizing `identity:delete_project(project_id=11d4f336c09944c68796029ff93dcf1e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:56.745365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd787d53-490f-43da-bc38-6d6422eeedce admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:56.942249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bd787d53-490f-43da-bc38-6d6422eeedce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11d4f336c09944c68796029ff93dcf1e', 'request_id': 'req-bd787d53-490f-43da-bc38-6d6422eeedce'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:57.051747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bd787d53-490f-43da-bc38-6d6422eeedce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11d4f336c09944c68796029ff93dcf1e', 'request_id': 'req-bd787d53-490f-43da-bc38-6d6422eeedce'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:57.062708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bd787d53-490f-43da-bc38-6d6422eeedce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11d4f336c09944c68796029ff93dcf1e', 'request_id': 'req-bd787d53-490f-43da-bc38-6d6422eeedce'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:57.102417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bd787d53-490f-43da-bc38-6d6422eeedce admin admin] The token cache is being invalidate because project 11d4f336c09944c68796029ff93dcf1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:25:57.102417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bd787d53-490f-43da-bc38-6d6422eeedce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:57.106803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bd787d53-490f-43da-bc38-6d6422eeedce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:57.115287 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1639/3282] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:25:56 2022] DELETE /identity/v3/projects/11d4f336c09944c68796029ff93dcf1e => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:57.120452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9525371-5dea-4aea-ac78-320f231ad40f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:57.120996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9525371-5dea-4aea-ac78-320f231ad40f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:57.121106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9525371-5dea-4aea-ac78-320f231ad40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:57.163261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f9525371-5dea-4aea-ac78-320f231ad40f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:57.168467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f9525371-5dea-4aea-ac78-320f231ad40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:57.269415 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1644/3283] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:25:57.278932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33e56b-579d-4394-86e7-e3d53600d0c6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:57.279584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33e56b-579d-4394-86e7-e3d53600d0c6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:57.280047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33e56b-579d-4394-86e7-e3d53600d0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:57.315984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fd33e56b-579d-4394-86e7-e3d53600d0c6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:57.319703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fd33e56b-579d-4394-86e7-e3d53600d0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:57.340533 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1640/3284] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:25:57.341395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9525371-5dea-4aea-ac78-320f231ad40f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:57.358642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9525371-5dea-4aea-ac78-320f231ad40f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:57.373545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408f07c-97d8-4311-b4e0-19bc92594622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:57.375406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408f07c-97d8-4311-b4e0-19bc92594622 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:57.377113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408f07c-97d8-4311-b4e0-19bc92594622 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:57.377519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408f07c-97d8-4311-b4e0-19bc92594622 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:57.378952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408f07c-97d8-4311-b4e0-19bc92594622 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:25:57.379281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408f07c-97d8-4311-b4e0-19bc92594622 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:57.386725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408f07c-97d8-4311-b4e0-19bc92594622 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:57.416157 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1645/3285] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:25:57.421236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33e56b-579d-4394-86e7-e3d53600d0c6 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:57.431215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33e56b-579d-4394-86e7-e3d53600d0c6 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:57.446790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1cfaa-4415-43f6-adc9-843591f0ab88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:57.447476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1cfaa-4415-43f6-adc9-843591f0ab88 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:57.448498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1cfaa-4415-43f6-adc9-843591f0ab88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:57.449004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1cfaa-4415-43f6-adc9-843591f0ab88 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:57.449944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1cfaa-4415-43f6-adc9-843591f0ab88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:57.452085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1cfaa-4415-43f6-adc9-843591f0ab88 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:57.563323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408f07c-97d8-4311-b4e0-19bc92594622 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:57.570908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d408f07c-97d8-4311-b4e0-19bc92594622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:57.576686 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1641/3286] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:25:57 2022] POST /identity/v3/projects => generated 359 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:25:57.583507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1cfaa-4415-43f6-adc9-843591f0ab88 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:57.607885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408f07c-97d8-4311-b4e0-19bc92594622 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:57.733614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b987ed-bf08-47e4-9c81-09326a4aada9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:57.736925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b987ed-bf08-47e4-9c81-09326a4aada9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:57.737308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1cfaa-4415-43f6-adc9-843591f0ab88 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:57.737650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b987ed-bf08-47e4-9c81-09326a4aada9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:57.738098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b987ed-bf08-47e4-9c81-09326a4aada9 admin admin] PATH_INFO: `/v3/users/aa89956fbc8e45e58021fae73812f473` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:57.741385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b987ed-bf08-47e4-9c81-09326a4aada9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa89956fbc8e45e58021fae73812f473)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:57.745420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b987ed-bf08-47e4-9c81-09326a4aada9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:57.752397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f8091-8607-46ec-97d5-d40f9ee6ccf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:57.753697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f8091-8607-46ec-97d5-d40f9ee6ccf7 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:57.754205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f8091-8607-46ec-97d5-d40f9ee6ccf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:57.754766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f8091-8607-46ec-97d5-d40f9ee6ccf7 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:57.759708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f8091-8607-46ec-97d5-d40f9ee6ccf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:57.769797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f8091-8607-46ec-97d5-d40f9ee6ccf7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:57.981519 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1642/3287] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:25:57 2022] POST /identity/v3/users => generated 280 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:25:57.985807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f8091-8607-46ec-97d5-d40f9ee6ccf7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:58.034117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-43b987ed-bf08-47e4-9c81-09326a4aada9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa89956fbc8e45e58021fae73812f473'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:58.034672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f8091-8607-46ec-97d5-d40f9ee6ccf7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:58.052154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265e9e4-e965-4a3c-b3f7-0ed4b1d97294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:58.055886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265e9e4-e965-4a3c-b3f7-0ed4b1d97294 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:58.057681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265e9e4-e965-4a3c-b3f7-0ed4b1d97294 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:58.057681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265e9e4-e965-4a3c-b3f7-0ed4b1d97294 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:58.061908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265e9e4-e965-4a3c-b3f7-0ed4b1d97294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:58.066781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265e9e4-e965-4a3c-b3f7-0ed4b1d97294 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:58.075545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-43b987ed-bf08-47e4-9c81-09326a4aada9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa89956fbc8e45e58021fae73812f473'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:58.078260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-43b987ed-bf08-47e4-9c81-09326a4aada9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa89956fbc8e45e58021fae73812f473'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:58.098394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-43b987ed-bf08-47e4-9c81-09326a4aada9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa89956fbc8e45e58021fae73812f473'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:58.105467 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1643/3288] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:25:58.107749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265e9e4-e965-4a3c-b3f7-0ed4b1d97294 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:58.145298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265e9e4-e965-4a3c-b3f7-0ed4b1d97294 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:58.164663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c2db8-6444-4e5c-9e12-8dcfb8f49666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:58.168063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c2db8-6444-4e5c-9e12-8dcfb8f49666 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:58.183067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c2db8-6444-4e5c-9e12-8dcfb8f49666 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:58.186760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c2db8-6444-4e5c-9e12-8dcfb8f49666 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:58.186760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c2db8-6444-4e5c-9e12-8dcfb8f49666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:58.189431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c2db8-6444-4e5c-9e12-8dcfb8f49666 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:58.205580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-43b987ed-bf08-47e4-9c81-09326a4aada9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa89956fbc8e45e58021fae73812f473'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:58.214583 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1644/3290] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:25:58.214921 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1646/3290] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:25:57 2022] DELETE /identity/v3/users/aa89956fbc8e45e58021fae73812f473 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:58.218969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaa14a-12f8-42b1-b6b7-b5cdc4666304 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:58.220276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaa14a-12f8-42b1-b6b7-b5cdc4666304 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:58.220788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaa14a-12f8-42b1-b6b7-b5cdc4666304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:58.221760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c2db8-6444-4e5c-9e12-8dcfb8f49666 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:58.226486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-915c2db8-6444-4e5c-9e12-8dcfb8f49666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:58.310667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c2db8-6444-4e5c-9e12-8dcfb8f49666 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:58.326727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-edaaa14a-12f8-42b1-b6b7-b5cdc4666304 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:58.343302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-edaaa14a-12f8-42b1-b6b7-b5cdc4666304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:58.497616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa8465-553b-4717-aaae-3244497eb4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:58.498384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa8465-553b-4717-aaae-3244497eb4ea admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:58.498524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa8465-553b-4717-aaae-3244497eb4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:58.498701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa8465-553b-4717-aaae-3244497eb4ea admin admin] PATH_INFO: `/v3/projects/596a8fcbb2ce4a07a29bedbf32cd4dee/users/e835fbe05c1c429aaddf1a0f877445c7/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:58.504927 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1647/3291] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:25:58.521399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaaa14a-12f8-42b1-b6b7-b5cdc4666304 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:58.525142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-edaaa14a-12f8-42b1-b6b7-b5cdc4666304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:58.535166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa8465-553b-4717-aaae-3244497eb4ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=596a8fcbb2ce4a07a29bedbf32cd4dee, user_id=e835fbe05c1c429aaddf1a0f877445c7, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:58.547293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa8465-553b-4717-aaae-3244497eb4ea admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:58.619276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaaa14a-12f8-42b1-b6b7-b5cdc4666304 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:58.624354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d3b6e-d852-422d-9918-01ecd04afde8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:58.625267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d3b6e-d852-422d-9918-01ecd04afde8 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:58.625629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d3b6e-d852-422d-9918-01ecd04afde8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:58.625982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d3b6e-d852-422d-9918-01ecd04afde8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:58.640138 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1645/3292] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:25:58 2022] PUT /identity/v3/projects/596a8fcbb2ce4a07a29bedbf32cd4dee/users/e835fbe05c1c429aaddf1a0f877445c7/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:58.643815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d3b6e-d852-422d-9918-01ecd04afde8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:58.647893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d3b6e-d852-422d-9918-01ecd04afde8 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:58.651492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d128df2-182e-4b75-9c53-22c39bc25615 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:58.656030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d128df2-182e-4b75-9c53-22c39bc25615 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:58.656030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d128df2-182e-4b75-9c53-22c39bc25615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:58.676351 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1648/3293] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:25:58.705557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6d128df2-182e-4b75-9c53-22c39bc25615 None None] MFA Rules not processed for user `e835fbe05c1c429aaddf1a0f877445c7`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:25:58.708098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6d128df2-182e-4b75-9c53-22c39bc25615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:58.856959 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1646/3294] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:25:58 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:25:58.861910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d3b6e-d852-422d-9918-01ecd04afde8 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:58.876406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d3b6e-d852-422d-9918-01ecd04afde8 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:59.006953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65fd71-2cb6-4d99-bc26-031b7468e58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:59.007717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65fd71-2cb6-4d99-bc26-031b7468e58d admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:59.008095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65fd71-2cb6-4d99-bc26-031b7468e58d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:59.008392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65fd71-2cb6-4d99-bc26-031b7468e58d admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:59.009897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65fd71-2cb6-4d99-bc26-031b7468e58d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:59.012134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65fd71-2cb6-4d99-bc26-031b7468e58d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:59.139077 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1649/3295] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:25:58 2022] POST /identity/v3/projects => generated 359 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:25:59.140562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d128df2-182e-4b75-9c53-22c39bc25615 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:59.164920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d128df2-182e-4b75-9c53-22c39bc25615 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:59.286885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a59920-9ed3-4b98-89e6-0b922a22edb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:59.288090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a59920-9ed3-4b98-89e6-0b922a22edb7 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:59.288486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a59920-9ed3-4b98-89e6-0b922a22edb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:59.288895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a59920-9ed3-4b98-89e6-0b922a22edb7 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:59.290161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a59920-9ed3-4b98-89e6-0b922a22edb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:59.293862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a59920-9ed3-4b98-89e6-0b922a22edb7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:59.406601 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1647/3296] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:25:59 2022] POST /identity/v3/users => generated 286 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:25:59.408862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65fd71-2cb6-4d99-bc26-031b7468e58d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:59.438821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65fd71-2cb6-4d99-bc26-031b7468e58d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:59.451887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a59920-9ed3-4b98-89e6-0b922a22edb7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:59.453871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35ba9f-9dce-495f-8ee9-8bddb7bdd90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:59.456937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-43a59920-9ed3-4b98-89e6-0b922a22edb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:25:59.472116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35ba9f-9dce-495f-8ee9-8bddb7bdd90b admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:59.475493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35ba9f-9dce-495f-8ee9-8bddb7bdd90b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:59.475950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35ba9f-9dce-495f-8ee9-8bddb7bdd90b admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:59.481007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35ba9f-9dce-495f-8ee9-8bddb7bdd90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:59.482738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35ba9f-9dce-495f-8ee9-8bddb7bdd90b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:59.494717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a59920-9ed3-4b98-89e6-0b922a22edb7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:59.507231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd284243-8a7e-4232-8f22-31d29488ff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:59.508968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd284243-8a7e-4232-8f22-31d29488ff65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:59.509501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd284243-8a7e-4232-8f22-31d29488ff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:59.510028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd284243-8a7e-4232-8f22-31d29488ff65 admin admin] PATH_INFO: `/v3/projects/a071591c8b744124be2c1ccf30bf8602` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:59.513280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd284243-8a7e-4232-8f22-31d29488ff65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a071591c8b744124be2c1ccf30bf8602)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:59.529243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd284243-8a7e-4232-8f22-31d29488ff65 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:59.534629 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1650/3297] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:25:59.536137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35ba9f-9dce-495f-8ee9-8bddb7bdd90b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:59.582115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35ba9f-9dce-495f-8ee9-8bddb7bdd90b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:59.595585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ecc23-e86d-4db8-8288-2dca986a1611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:25:59.597279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ecc23-e86d-4db8-8288-2dca986a1611 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:25:59.600528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ecc23-e86d-4db8-8288-2dca986a1611 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:25:59.601012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ecc23-e86d-4db8-8288-2dca986a1611 admin admin] PATH_INFO: `/v3/projects/d3cc19b3fced44ec8a4bbceefe623f6d/users/9a80bed817f045d49cb5bfdda755e4ea/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:25:59.643592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ecc23-e86d-4db8-8288-2dca986a1611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3cc19b3fced44ec8a4bbceefe623f6d, user_id=9a80bed817f045d49cb5bfdda755e4ea, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:25:59.647290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ecc23-e86d-4db8-8288-2dca986a1611 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:25:59.773964 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1651/3298] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:25:59 2022] PUT /identity/v3/projects/d3cc19b3fced44ec8a4bbceefe623f6d/users/9a80bed817f045d49cb5bfdda755e4ea/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:59.777795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ecc23-e86d-4db8-8288-2dca986a1611 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:59.804257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fd284243-8a7e-4232-8f22-31d29488ff65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a071591c8b744124be2c1ccf30bf8602', 'request_id': 'req-fd284243-8a7e-4232-8f22-31d29488ff65'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:59.891986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fd284243-8a7e-4232-8f22-31d29488ff65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a071591c8b744124be2c1ccf30bf8602', 'request_id': 'req-fd284243-8a7e-4232-8f22-31d29488ff65'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:59.914072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fd284243-8a7e-4232-8f22-31d29488ff65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a071591c8b744124be2c1ccf30bf8602', 'request_id': 'req-fd284243-8a7e-4232-8f22-31d29488ff65'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:59.951285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fd284243-8a7e-4232-8f22-31d29488ff65 admin admin] The token cache is being invalidate because project a071591c8b744124be2c1ccf30bf8602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:25:59.951699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fd284243-8a7e-4232-8f22-31d29488ff65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:59.953050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fd284243-8a7e-4232-8f22-31d29488ff65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:25:59.956031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ecc23-e86d-4db8-8288-2dca986a1611 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:25:59.958099 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1648/3299] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:25:59 2022] DELETE /identity/v3/projects/a071591c8b744124be2c1ccf30bf8602 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:25:59.969312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd284243-8a7e-4232-8f22-31d29488ff65 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:25:59.976006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fd284243-8a7e-4232-8f22-31d29488ff65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:00.113298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b1e9c-6772-44fa-9dfd-214c02fb19c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:00.113991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b1e9c-6772-44fa-9dfd-214c02fb19c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:00.114278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b1e9c-6772-44fa-9dfd-214c02fb19c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:00.114557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b1e9c-6772-44fa-9dfd-214c02fb19c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:00.115347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b1e9c-6772-44fa-9dfd-214c02fb19c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:00.117812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b1e9c-6772-44fa-9dfd-214c02fb19c9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:00.132174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd284243-8a7e-4232-8f22-31d29488ff65 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:00.137360 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1652/3300] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:26:00.143553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b1e9c-6772-44fa-9dfd-214c02fb19c9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:00.152117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a2977-aca2-4fd1-bc9f-f7ea8b4de28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:00.154037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a2977-aca2-4fd1-bc9f-f7ea8b4de28e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:00.155287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a2977-aca2-4fd1-bc9f-f7ea8b4de28e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:00.160637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a2977-aca2-4fd1-bc9f-f7ea8b4de28e admin admin] PATH_INFO: `/v3/users/fc18613353ae4fe9bffa1223f347607f` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:00.170227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a2977-aca2-4fd1-bc9f-f7ea8b4de28e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc18613353ae4fe9bffa1223f347607f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:00.172153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a2977-aca2-4fd1-bc9f-f7ea8b4de28e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:00.177678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3c0b1e9c-6772-44fa-9dfd-214c02fb19c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:00.204735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b1e9c-6772-44fa-9dfd-214c02fb19c9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:00.236852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa7d22-0c55-40c5-a5bc-aef86f84170f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:00.238047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa7d22-0c55-40c5-a5bc-aef86f84170f admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:00.238322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa7d22-0c55-40c5-a5bc-aef86f84170f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:00.238694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa7d22-0c55-40c5-a5bc-aef86f84170f admin admin] PATH_INFO: `/v3/projects/d3cc19b3fced44ec8a4bbceefe623f6d/users/9a80bed817f045d49cb5bfdda755e4ea/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:00.250995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa7d22-0c55-40c5-a5bc-aef86f84170f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3cc19b3fced44ec8a4bbceefe623f6d, user_id=9a80bed817f045d49cb5bfdda755e4ea, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:00.254035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa7d22-0c55-40c5-a5bc-aef86f84170f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:00.284954 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1653/3301] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:26:00 2022] PUT /identity/v3/projects/d3cc19b3fced44ec8a4bbceefe623f6d/users/9a80bed817f045d49cb5bfdda755e4ea/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:26:00.296966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5004b2c-d836-4366-9aac-ce9175ee2003 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:00.297303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5004b2c-d836-4366-9aac-ce9175ee2003 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:00.297569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5004b2c-d836-4366-9aac-ce9175ee2003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:00.360252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d5004b2c-d836-4366-9aac-ce9175ee2003 None None] MFA Rules not processed for user `9a80bed817f045d49cb5bfdda755e4ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:00.361733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d5004b2c-d836-4366-9aac-ce9175ee2003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:00.508756 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1654/3302] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:00 2022] POST /identity/v3/auth/tokens => generated 3293 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:26:00.521002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5004b2c-d836-4366-9aac-ce9175ee2003 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:00.526253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d5004b2c-d836-4366-9aac-ce9175ee2003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:00.655562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5004b2c-d836-4366-9aac-ce9175ee2003 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:00.662773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b233970-9e0b-4819-8590-9d9eda6a8779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:00.663705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b233970-9e0b-4819-8590-9d9eda6a8779 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:00.664058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b233970-9e0b-4819-8590-9d9eda6a8779 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:00.664723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b233970-9e0b-4819-8590-9d9eda6a8779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:00.675509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b233970-9e0b-4819-8590-9d9eda6a8779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:00.677216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b233970-9e0b-4819-8590-9d9eda6a8779 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:00.693817 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1655/3303] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:26:00 2022] GET /identity/v3/auth/tokens => generated 3293 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:26:00.731511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-755a2977-aca2-4fd1-bc9f-f7ea8b4de28e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc18613353ae4fe9bffa1223f347607f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:00.746503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-755a2977-aca2-4fd1-bc9f-f7ea8b4de28e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc18613353ae4fe9bffa1223f347607f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:00.747513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-755a2977-aca2-4fd1-bc9f-f7ea8b4de28e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc18613353ae4fe9bffa1223f347607f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:00.755640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-755a2977-aca2-4fd1-bc9f-f7ea8b4de28e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc18613353ae4fe9bffa1223f347607f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:00.885719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-755a2977-aca2-4fd1-bc9f-f7ea8b4de28e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc18613353ae4fe9bffa1223f347607f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:00.899015 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1649/3304] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:25:59 2022] DELETE /identity/v3/users/fc18613353ae4fe9bffa1223f347607f => generated 0 bytes in 932 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:26:01.672953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b233970-9e0b-4819-8590-9d9eda6a8779 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:01.777157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b233970-9e0b-4819-8590-9d9eda6a8779 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:01.897441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b019b7-d6af-4fa9-ae2f-6c8cab7cfc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:01.898471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b019b7-d6af-4fa9-ae2f-6c8cab7cfc33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:01.898986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b019b7-d6af-4fa9-ae2f-6c8cab7cfc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:01.899542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b019b7-d6af-4fa9-ae2f-6c8cab7cfc33 admin admin] PATH_INFO: `/v3/users/e835fbe05c1c429aaddf1a0f877445c7` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:01.901649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b019b7-d6af-4fa9-ae2f-6c8cab7cfc33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e835fbe05c1c429aaddf1a0f877445c7)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:01.903898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b019b7-d6af-4fa9-ae2f-6c8cab7cfc33 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:02.063864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a2977-aca2-4fd1-bc9f-f7ea8b4de28e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:02.065460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-755a2977-aca2-4fd1-bc9f-f7ea8b4de28e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:02.081519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a2977-aca2-4fd1-bc9f-f7ea8b4de28e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:02.087777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e14161-a64a-4229-8c6e-628d063c9123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:02.089438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e14161-a64a-4229-8c6e-628d063c9123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:02.089830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e14161-a64a-4229-8c6e-628d063c9123 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:02.090229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e14161-a64a-4229-8c6e-628d063c9123 admin admin] PATH_INFO: `/v3/projects/00028c43b25d4e399eff5cd1744297d8` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:02.091802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e14161-a64a-4229-8c6e-628d063c9123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00028c43b25d4e399eff5cd1744297d8)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:02.094000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e14161-a64a-4229-8c6e-628d063c9123 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:02.168143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d5b019b7-d6af-4fa9-ae2f-6c8cab7cfc33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e835fbe05c1c429aaddf1a0f877445c7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:02.181414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d5b019b7-d6af-4fa9-ae2f-6c8cab7cfc33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e835fbe05c1c429aaddf1a0f877445c7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:02.182510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d5b019b7-d6af-4fa9-ae2f-6c8cab7cfc33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e835fbe05c1c429aaddf1a0f877445c7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:02.196468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d5b019b7-d6af-4fa9-ae2f-6c8cab7cfc33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e835fbe05c1c429aaddf1a0f877445c7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:02.247528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-02e14161-a64a-4229-8c6e-628d063c9123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00028c43b25d4e399eff5cd1744297d8', 'request_id': 'req-02e14161-a64a-4229-8c6e-628d063c9123'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:02.288626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d5b019b7-d6af-4fa9-ae2f-6c8cab7cfc33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e835fbe05c1c429aaddf1a0f877445c7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:02.300691 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1656/3305] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:26:01 2022] DELETE /identity/v3/users/e835fbe05c1c429aaddf1a0f877445c7 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:26:02.306222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb6381-9159-4a44-a04a-e82600aa9b9c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:02.306570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb6381-9159-4a44-a04a-e82600aa9b9c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:02.306975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb6381-9159-4a44-a04a-e82600aa9b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:02.326535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-16bb6381-9159-4a44-a04a-e82600aa9b9c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:02.327871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-16bb6381-9159-4a44-a04a-e82600aa9b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:02.377583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-02e14161-a64a-4229-8c6e-628d063c9123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00028c43b25d4e399eff5cd1744297d8', 'request_id': 'req-02e14161-a64a-4229-8c6e-628d063c9123'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:02.387291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-02e14161-a64a-4229-8c6e-628d063c9123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00028c43b25d4e399eff5cd1744297d8', 'request_id': 'req-02e14161-a64a-4229-8c6e-628d063c9123'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:02.397193 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1657/3306] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:02.397193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1536fcf-717e-44b5-a06c-de2832351374 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:02.397193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1536fcf-717e-44b5-a06c-de2832351374 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:02.397193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1536fcf-717e-44b5-a06c-de2832351374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:02.406460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-02e14161-a64a-4229-8c6e-628d063c9123 admin admin] The token cache is being invalidate because project 00028c43b25d4e399eff5cd1744297d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:26:02.407092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-02e14161-a64a-4229-8c6e-628d063c9123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:02.409068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-02e14161-a64a-4229-8c6e-628d063c9123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:02.410226 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1650/3307] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:26:02 2022] DELETE /identity/v3/projects/00028c43b25d4e399eff5cd1744297d8 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:26:02.411439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e14161-a64a-4229-8c6e-628d063c9123 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:02.413962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-02e14161-a64a-4229-8c6e-628d063c9123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:02.422791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f1536fcf-717e-44b5-a06c-de2832351374 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:02.424916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f1536fcf-717e-44b5-a06c-de2832351374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:02.498405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e14161-a64a-4229-8c6e-628d063c9123 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:02.506075 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1658/3308] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:26:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:02.507690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda2f8a-cf87-4e03-bcd8-3f89c3c7fe04 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:02.507985 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda2f8a-cf87-4e03-bcd8-3f89c3c7fe04 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:02.508272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda2f8a-cf87-4e03-bcd8-3f89c3c7fe04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:02.533549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ddda2f8a-cf87-4e03-bcd8-3f89c3c7fe04 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:02.535827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ddda2f8a-cf87-4e03-bcd8-3f89c3c7fe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:02.552658 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1659/3309] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:02.552658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda2f8a-cf87-4e03-bcd8-3f89c3c7fe04 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:02.555102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ddda2f8a-cf87-4e03-bcd8-3f89c3c7fe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:02.563274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3270041-1ec7-4a9a-ada4-a3f3d5f4f1a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:02.564339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3270041-1ec7-4a9a-ada4-a3f3d5f4f1a2 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:02.564992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3270041-1ec7-4a9a-ada4-a3f3d5f4f1a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:02.566006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3270041-1ec7-4a9a-ada4-a3f3d5f4f1a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:02.568556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f3270041-1ec7-4a9a-ada4-a3f3d5f4f1a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:02.599533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3270041-1ec7-4a9a-ada4-a3f3d5f4f1a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:02.601346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3270041-1ec7-4a9a-ada4-a3f3d5f4f1a2 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:02.613047 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1651/3310] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:26:02.614842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87470858-e3c0-4d1a-b295-e9a901133928 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:02.615339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87470858-e3c0-4d1a-b295-e9a901133928 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:02.615727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87470858-e3c0-4d1a-b295-e9a901133928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:02.636029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-87470858-e3c0-4d1a-b295-e9a901133928 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:02.637579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-87470858-e3c0-4d1a-b295-e9a901133928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:02.646645 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1652/3311] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:02.651299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87470858-e3c0-4d1a-b295-e9a901133928 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:02.654174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda2f8a-cf87-4e03-bcd8-3f89c3c7fe04 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:02.662291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775cbec-0e71-48a5-9cda-eabcebae1ab2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:02.662500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87470858-e3c0-4d1a-b295-e9a901133928 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:02.662847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775cbec-0e71-48a5-9cda-eabcebae1ab2 service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:02.663134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775cbec-0e71-48a5-9cda-eabcebae1ab2 service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:02.663415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775cbec-0e71-48a5-9cda-eabcebae1ab2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:02.667484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d2452-3537-4bed-9334-519828713895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:02.668149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d2452-3537-4bed-9334-519828713895 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:02.668433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d2452-3537-4bed-9334-519828713895 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:02.668759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d2452-3537-4bed-9334-519828713895 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:02.669493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d2452-3537-4bed-9334-519828713895 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:26:02.669804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d2452-3537-4bed-9334-519828713895 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:02.671458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d2452-3537-4bed-9334-519828713895 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:02.672692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775cbec-0e71-48a5-9cda-eabcebae1ab2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:02.674481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775cbec-0e71-48a5-9cda-eabcebae1ab2 service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:02.689423 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1653/3312] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:26:02.690367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d2452-3537-4bed-9334-519828713895 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:02.694010 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1660/3313] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:26:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:26:02.703037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d2452-3537-4bed-9334-519828713895 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:02.710070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68052755-64cb-434f-92d7-159eb9821bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:02.710746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68052755-64cb-434f-92d7-159eb9821bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:02.711094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68052755-64cb-434f-92d7-159eb9821bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:02.711382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68052755-64cb-434f-92d7-159eb9821bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:02.712269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68052755-64cb-434f-92d7-159eb9821bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:02.714406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68052755-64cb-434f-92d7-159eb9821bd4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:02.747335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775cbec-0e71-48a5-9cda-eabcebae1ab2 service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:02.749108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d775cbec-0e71-48a5-9cda-eabcebae1ab2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:02.769129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775cbec-0e71-48a5-9cda-eabcebae1ab2 service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:02.774343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a92cf-3adc-434d-afa9-2d832a8cd1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:02.775272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a92cf-3adc-434d-afa9-2d832a8cd1f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:02.775605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a92cf-3adc-434d-afa9-2d832a8cd1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:02.775889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a92cf-3adc-434d-afa9-2d832a8cd1f6 admin admin] PATH_INFO: `/v3/users/2856471176174dd7a2465a816eef3acc` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:02.777258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a92cf-3adc-434d-afa9-2d832a8cd1f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2856471176174dd7a2465a816eef3acc)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:02.779741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a92cf-3adc-434d-afa9-2d832a8cd1f6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:02.871648 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1654/3314] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:26:02 2022] POST /identity/v3/projects => generated 393 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:26:02.874661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68052755-64cb-434f-92d7-159eb9821bd4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:02.967583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68052755-64cb-434f-92d7-159eb9821bd4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:02.972826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffba044-5f4f-4ded-b15e-ecc4ac398f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:02.973513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffba044-5f4f-4ded-b15e-ecc4ac398f55 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:02.974428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffba044-5f4f-4ded-b15e-ecc4ac398f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:02.974719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffba044-5f4f-4ded-b15e-ecc4ac398f55 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:02.975430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffba044-5f4f-4ded-b15e-ecc4ac398f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:02.977933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffba044-5f4f-4ded-b15e-ecc4ac398f55 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:03.072467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-938a92cf-3adc-434d-afa9-2d832a8cd1f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2856471176174dd7a2465a816eef3acc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:03.105165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-938a92cf-3adc-434d-afa9-2d832a8cd1f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2856471176174dd7a2465a816eef3acc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:03.106800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-938a92cf-3adc-434d-afa9-2d832a8cd1f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2856471176174dd7a2465a816eef3acc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:03.128395 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1655/3315] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:26:02 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:26:03.132052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffba044-5f4f-4ded-b15e-ecc4ac398f55 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:03.132761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-938a92cf-3adc-434d-afa9-2d832a8cd1f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2856471176174dd7a2465a816eef3acc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:03.147076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffba044-5f4f-4ded-b15e-ecc4ac398f55 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:03.158315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a936525-5824-48db-8e8a-e2edf0d9e4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:03.159146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a936525-5824-48db-8e8a-e2edf0d9e4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:03.159440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a936525-5824-48db-8e8a-e2edf0d9e4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:03.159807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a936525-5824-48db-8e8a-e2edf0d9e4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:03.160561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a936525-5824-48db-8e8a-e2edf0d9e4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:03.169079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a936525-5824-48db-8e8a-e2edf0d9e4c4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:03.185072 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1656/3316] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:26:03.189459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a936525-5824-48db-8e8a-e2edf0d9e4c4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:03.202137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a936525-5824-48db-8e8a-e2edf0d9e4c4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:03.207187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf017223-8b6c-4f68-9e60-e457c8fb279e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:03.207953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf017223-8b6c-4f68-9e60-e457c8fb279e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:03.208315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf017223-8b6c-4f68-9e60-e457c8fb279e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:03.208726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf017223-8b6c-4f68-9e60-e457c8fb279e admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:03.209631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf017223-8b6c-4f68-9e60-e457c8fb279e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:03.211384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf017223-8b6c-4f68-9e60-e457c8fb279e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:03.217169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-938a92cf-3adc-434d-afa9-2d832a8cd1f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2856471176174dd7a2465a816eef3acc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:03.223581 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1661/3317] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:26:02 2022] DELETE /identity/v3/users/2856471176174dd7a2465a816eef3acc => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:26:03.234375 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1657/3318] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:26:03.238731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a92cf-3adc-434d-afa9-2d832a8cd1f6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:03.251394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-938a92cf-3adc-434d-afa9-2d832a8cd1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:03.298541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf017223-8b6c-4f68-9e60-e457c8fb279e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:03.300820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-cf017223-8b6c-4f68-9e60-e457c8fb279e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:03.327848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf017223-8b6c-4f68-9e60-e457c8fb279e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:03.368051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a92cf-3adc-434d-afa9-2d832a8cd1f6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:03.373614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339b84e-8e24-4017-b36c-1e7106c68b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:03.375016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339b84e-8e24-4017-b36c-1e7106c68b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:03.375490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339b84e-8e24-4017-b36c-1e7106c68b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:03.375887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339b84e-8e24-4017-b36c-1e7106c68b97 admin admin] PATH_INFO: `/v3/projects/e9bce7a6faeb4a9693c73a4fd0b12d9c/users/fbe5b02f3089419b9eeb2d52b673e1fd/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:03.402172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339b84e-8e24-4017-b36c-1e7106c68b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9bce7a6faeb4a9693c73a4fd0b12d9c, user_id=fbe5b02f3089419b9eeb2d52b673e1fd, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:03.405082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339b84e-8e24-4017-b36c-1e7106c68b97 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:03.423934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88d77a-f784-4812-83b7-a26a1a5c4e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:03.425017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88d77a-f784-4812-83b7-a26a1a5c4e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:03.425564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88d77a-f784-4812-83b7-a26a1a5c4e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:03.425718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88d77a-f784-4812-83b7-a26a1a5c4e74 admin admin] PATH_INFO: `/v3/projects/596a8fcbb2ce4a07a29bedbf32cd4dee` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:03.427895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88d77a-f784-4812-83b7-a26a1a5c4e74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=596a8fcbb2ce4a07a29bedbf32cd4dee)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:03.430177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88d77a-f784-4812-83b7-a26a1a5c4e74 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:03.463624 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1662/3319] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:26:03 2022] PUT /identity/v3/projects/e9bce7a6faeb4a9693c73a4fd0b12d9c/users/fbe5b02f3089419b9eeb2d52b673e1fd/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:26:03.474725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751ff78-f8db-44e2-9c4b-a46b5eecd38e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:03.475259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751ff78-f8db-44e2-9c4b-a46b5eecd38e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:03.475557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751ff78-f8db-44e2-9c4b-a46b5eecd38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:03.503163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b751ff78-f8db-44e2-9c4b-a46b5eecd38e None None] MFA Rules not processed for user `fbe5b02f3089419b9eeb2d52b673e1fd`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:03.504753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b751ff78-f8db-44e2-9c4b-a46b5eecd38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:03.591222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0c88d77a-f784-4812-83b7-a26a1a5c4e74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '596a8fcbb2ce4a07a29bedbf32cd4dee', 'request_id': 'req-0c88d77a-f784-4812-83b7-a26a1a5c4e74'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:03.608257 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1663/3320] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:26:03.609381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751ff78-f8db-44e2-9c4b-a46b5eecd38e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:03.611193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b751ff78-f8db-44e2-9c4b-a46b5eecd38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:03.685879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0c88d77a-f784-4812-83b7-a26a1a5c4e74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '596a8fcbb2ce4a07a29bedbf32cd4dee', 'request_id': 'req-0c88d77a-f784-4812-83b7-a26a1a5c4e74'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:03.695895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0c88d77a-f784-4812-83b7-a26a1a5c4e74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '596a8fcbb2ce4a07a29bedbf32cd4dee', 'request_id': 'req-0c88d77a-f784-4812-83b7-a26a1a5c4e74'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:03.709300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751ff78-f8db-44e2-9c4b-a46b5eecd38e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:03.711797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0c88d77a-f784-4812-83b7-a26a1a5c4e74 admin admin] The token cache is being invalidate because project 596a8fcbb2ce4a07a29bedbf32cd4dee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:26:03.712368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0c88d77a-f784-4812-83b7-a26a1a5c4e74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:03.713908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0c88d77a-f784-4812-83b7-a26a1a5c4e74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:03.716824 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1658/3321] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:26:03 2022] DELETE /identity/v3/projects/596a8fcbb2ce4a07a29bedbf32cd4dee => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:26:03.718202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88d77a-f784-4812-83b7-a26a1a5c4e74 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:03.721219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0c88d77a-f784-4812-83b7-a26a1a5c4e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:03.801683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa251f-3514-4b6e-a5c9-cb5b03c1326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:03.802572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa251f-3514-4b6e-a5c9-cb5b03c1326f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:03.802859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa251f-3514-4b6e-a5c9-cb5b03c1326f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:03.803137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa251f-3514-4b6e-a5c9-cb5b03c1326f admin admin] PATH_INFO: `/v3/projects/bb31dc76a4c24164becf90f8b970adc2` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:03.804383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa251f-3514-4b6e-a5c9-cb5b03c1326f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb31dc76a4c24164becf90f8b970adc2)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:03.806481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa251f-3514-4b6e-a5c9-cb5b03c1326f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:03.813092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88d77a-f784-4812-83b7-a26a1a5c4e74 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:03.821263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a79978-2f6a-4ae7-a4bf-5a9da0c52f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:03.822077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a79978-2f6a-4ae7-a4bf-5a9da0c52f48 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:03.822950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a79978-2f6a-4ae7-a4bf-5a9da0c52f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:03.823295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a79978-2f6a-4ae7-a4bf-5a9da0c52f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:03.824114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a79978-2f6a-4ae7-a4bf-5a9da0c52f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:03.826128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a79978-2f6a-4ae7-a4bf-5a9da0c52f48 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:03.942707 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1659/3322] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:26:03 2022] POST /identity/v3/projects => generated 393 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:26:03.942707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a79978-2f6a-4ae7-a4bf-5a9da0c52f48 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:03.942707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f5a79978-2f6a-4ae7-a4bf-5a9da0c52f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:03.953612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e1fa251f-3514-4b6e-a5c9-cb5b03c1326f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb31dc76a4c24164becf90f8b970adc2', 'request_id': 'req-e1fa251f-3514-4b6e-a5c9-cb5b03c1326f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:03.959890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e1fa251f-3514-4b6e-a5c9-cb5b03c1326f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb31dc76a4c24164becf90f8b970adc2', 'request_id': 'req-e1fa251f-3514-4b6e-a5c9-cb5b03c1326f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:04.015603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a79978-2f6a-4ae7-a4bf-5a9da0c52f48 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:04.021521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a4eac-3c30-4f4a-b9f8-b18203af386a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:04.022542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a4eac-3c30-4f4a-b9f8-b18203af386a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:04.022908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a4eac-3c30-4f4a-b9f8-b18203af386a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:04.023189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a4eac-3c30-4f4a-b9f8-b18203af386a admin admin] PATH_INFO: `/v3/users/9a80bed817f045d49cb5bfdda755e4ea` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:04.024547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a4eac-3c30-4f4a-b9f8-b18203af386a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a80bed817f045d49cb5bfdda755e4ea)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:04.026830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a4eac-3c30-4f4a-b9f8-b18203af386a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:04.082993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e1fa251f-3514-4b6e-a5c9-cb5b03c1326f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb31dc76a4c24164becf90f8b970adc2', 'request_id': 'req-e1fa251f-3514-4b6e-a5c9-cb5b03c1326f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:04.105534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e1fa251f-3514-4b6e-a5c9-cb5b03c1326f admin admin] The token cache is being invalidate because project bb31dc76a4c24164becf90f8b970adc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:26:04.105534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e1fa251f-3514-4b6e-a5c9-cb5b03c1326f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:04.105534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e1fa251f-3514-4b6e-a5c9-cb5b03c1326f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:04.115610 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1664/3323] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:26:03 2022] DELETE /identity/v3/projects/bb31dc76a4c24164becf90f8b970adc2 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:26:04.115610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa251f-3514-4b6e-a5c9-cb5b03c1326f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:04.115610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e1fa251f-3514-4b6e-a5c9-cb5b03c1326f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:04.187619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa251f-3514-4b6e-a5c9-cb5b03c1326f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:04.192518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8d464-4ec6-447c-a4a8-4e957220eeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:04.193222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8d464-4ec6-447c-a4a8-4e957220eeda admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:04.193506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8d464-4ec6-447c-a4a8-4e957220eeda admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:04.199389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8d464-4ec6-447c-a4a8-4e957220eeda admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:04.199389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8d464-4ec6-447c-a4a8-4e957220eeda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:04.199389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8d464-4ec6-447c-a4a8-4e957220eeda admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:04.282714 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1665/3324] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:26:04 2022] POST /identity/v3/users => generated 303 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:26:04.284117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10b35e-7965-495f-bda7-40c026b75081 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:04.284413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10b35e-7965-495f-bda7-40c026b75081 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:04.284727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10b35e-7965-495f-bda7-40c026b75081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:04.286805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9b1a4eac-3c30-4f4a-b9f8-b18203af386a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a80bed817f045d49cb5bfdda755e4ea'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:04.302130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9b1a4eac-3c30-4f4a-b9f8-b18203af386a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a80bed817f045d49cb5bfdda755e4ea'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:04.302967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9b1a4eac-3c30-4f4a-b9f8-b18203af386a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a80bed817f045d49cb5bfdda755e4ea'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:04.314411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5a10b35e-7965-495f-bda7-40c026b75081 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:04.314411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5a10b35e-7965-495f-bda7-40c026b75081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:04.314621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9b1a4eac-3c30-4f4a-b9f8-b18203af386a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a80bed817f045d49cb5bfdda755e4ea'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:04.316317 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1666/3325] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:04.317378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10b35e-7965-495f-bda7-40c026b75081 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:04.327296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10b35e-7965-495f-bda7-40c026b75081 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:04.332086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb565cae-528a-4d9f-ac13-7b953aa2ae6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:04.332902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb565cae-528a-4d9f-ac13-7b953aa2ae6e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:04.333191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb565cae-528a-4d9f-ac13-7b953aa2ae6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:04.340070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb565cae-528a-4d9f-ac13-7b953aa2ae6e admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:04.340070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb565cae-528a-4d9f-ac13-7b953aa2ae6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:04.340070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb565cae-528a-4d9f-ac13-7b953aa2ae6e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:04.355623 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1667/3326] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:26:04.356243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c5ecf-2df4-414d-8d22-adc107edb9ed None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:04.356719 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c5ecf-2df4-414d-8d22-adc107edb9ed None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:04.363163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c5ecf-2df4-414d-8d22-adc107edb9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:04.391669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-251c5ecf-2df4-414d-8d22-adc107edb9ed None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:04.393043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-251c5ecf-2df4-414d-8d22-adc107edb9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:04.402003 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1668/3327] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:04.406789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ebfc1-f4b2-4c0e-b010-a3973de91422 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:04.406789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ebfc1-f4b2-4c0e-b010-a3973de91422 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:04.406789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ebfc1-f4b2-4c0e-b010-a3973de91422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:04.423324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-437ebfc1-f4b2-4c0e-b010-a3973de91422 None None] MFA Rules not processed for user `e83fd687fcc74495a7ea73f0e001419b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:04.424721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-437ebfc1-f4b2-4c0e-b010-a3973de91422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:04.448881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9b1a4eac-3c30-4f4a-b9f8-b18203af386a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a80bed817f045d49cb5bfdda755e4ea'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:04.462560 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1660/3328] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:26:03 2022] DELETE /identity/v3/users/9a80bed817f045d49cb5bfdda755e4ea => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:26:04.464118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a4eac-3c30-4f4a-b9f8-b18203af386a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:04.467001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9b1a4eac-3c30-4f4a-b9f8-b18203af386a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:04.547661 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1669/3329] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:04.547661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ebfc1-f4b2-4c0e-b010-a3973de91422 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:04.547661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-437ebfc1-f4b2-4c0e-b010-a3973de91422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:04.555607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a4eac-3c30-4f4a-b9f8-b18203af386a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:04.562280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2769236-a9a7-4077-89e0-c2bdb81be299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:04.564919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2769236-a9a7-4077-89e0-c2bdb81be299 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:04.565647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2769236-a9a7-4077-89e0-c2bdb81be299 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:04.566031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2769236-a9a7-4077-89e0-c2bdb81be299 admin admin] PATH_INFO: `/v3/projects/ec7cfa22136249b982910864ad486f74/users/ae9a9efbf9a44d66b2384dd30ba43a5b/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:04.569156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ebfc1-f4b2-4c0e-b010-a3973de91422 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:04.576464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901ec52-4c9a-4273-b8fb-fc31fb93c77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:04.577269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901ec52-4c9a-4273-b8fb-fc31fb93c77d admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:04.577631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901ec52-4c9a-4273-b8fb-fc31fb93c77d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:04.578265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901ec52-4c9a-4273-b8fb-fc31fb93c77d admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:04.579344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901ec52-4c9a-4273-b8fb-fc31fb93c77d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:26:04.579922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901ec52-4c9a-4273-b8fb-fc31fb93c77d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:04.581844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901ec52-4c9a-4273-b8fb-fc31fb93c77d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:04.594432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2769236-a9a7-4077-89e0-c2bdb81be299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec7cfa22136249b982910864ad486f74, user_id=ae9a9efbf9a44d66b2384dd30ba43a5b, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:04.596920 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1670/3330] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:26:04.600389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2769236-a9a7-4077-89e0-c2bdb81be299 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:04.601678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901ec52-4c9a-4273-b8fb-fc31fb93c77d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:04.614052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901ec52-4c9a-4273-b8fb-fc31fb93c77d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:04.619821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ede416-1277-4650-81fb-97ca95033941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:04.620100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ede416-1277-4650-81fb-97ca95033941 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:04.620568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ede416-1277-4650-81fb-97ca95033941 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:04.623158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ede416-1277-4650-81fb-97ca95033941 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:04.623158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ede416-1277-4650-81fb-97ca95033941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:04.624976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ede416-1277-4650-81fb-97ca95033941 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:04.698549 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1661/3331] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:26:04 2022] PUT /identity/v3/projects/ec7cfa22136249b982910864ad486f74/users/ae9a9efbf9a44d66b2384dd30ba43a5b/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:26:04.702645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2769236-a9a7-4077-89e0-c2bdb81be299 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:04.758287 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1671/3332] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:26:04 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:26:04.762115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ede416-1277-4650-81fb-97ca95033941 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:04.780388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2769236-a9a7-4077-89e0-c2bdb81be299 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:04.848405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39871b9-db42-40c9-9082-1fcdf736ce4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:04.849295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39871b9-db42-40c9-9082-1fcdf736ce4e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:04.849598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39871b9-db42-40c9-9082-1fcdf736ce4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:04.849868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39871b9-db42-40c9-9082-1fcdf736ce4e admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:04.850713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39871b9-db42-40c9-9082-1fcdf736ce4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:04.852690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39871b9-db42-40c9-9082-1fcdf736ce4e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:04.852841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ede416-1277-4650-81fb-97ca95033941 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:04.859507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e67bd8-afe3-4fd9-b3e0-f84be201d274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:04.860411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e67bd8-afe3-4fd9-b3e0-f84be201d274 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:04.860726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e67bd8-afe3-4fd9-b3e0-f84be201d274 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:04.868799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e67bd8-afe3-4fd9-b3e0-f84be201d274 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:04.868799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e67bd8-afe3-4fd9-b3e0-f84be201d274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:04.868799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e67bd8-afe3-4fd9-b3e0-f84be201d274 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:04.876884 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1662/3333] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:26:04.877841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39871b9-db42-40c9-9082-1fcdf736ce4e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:04.889369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39871b9-db42-40c9-9082-1fcdf736ce4e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:04.896977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a6ac7-2239-4d55-a68b-61e26cde790c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:04.898265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a6ac7-2239-4d55-a68b-61e26cde790c admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:04.899508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a6ac7-2239-4d55-a68b-61e26cde790c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:04.899716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a6ac7-2239-4d55-a68b-61e26cde790c admin admin] PATH_INFO: `/v3/projects/ec7cfa22136249b982910864ad486f74/users/ae9a9efbf9a44d66b2384dd30ba43a5b/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:04.907792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a6ac7-2239-4d55-a68b-61e26cde790c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec7cfa22136249b982910864ad486f74, user_id=ae9a9efbf9a44d66b2384dd30ba43a5b, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:04.910579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a6ac7-2239-4d55-a68b-61e26cde790c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:04.925723 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1663/3334] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:26:04 2022] PUT /identity/v3/projects/ec7cfa22136249b982910864ad486f74/users/ae9a9efbf9a44d66b2384dd30ba43a5b/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:26:04.936099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cc34d-c91b-42b6-88d2-994c6fe55075 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:04.936402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cc34d-c91b-42b6-88d2-994c6fe55075 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:04.936739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cc34d-c91b-42b6-88d2-994c6fe55075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:04.967059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-891cc34d-c91b-42b6-88d2-994c6fe55075 None None] MFA Rules not processed for user `ae9a9efbf9a44d66b2384dd30ba43a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:04.969519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-891cc34d-c91b-42b6-88d2-994c6fe55075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:04.987801 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1672/3335] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:26:04 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:26:04.991863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e67bd8-afe3-4fd9-b3e0-f84be201d274 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:05.004728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e67bd8-afe3-4fd9-b3e0-f84be201d274 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:05.063219 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1664/3336] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:26:05.075227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5478992-0edd-4a0d-baed-f8c9e28655ba None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:05.075592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5478992-0edd-4a0d-baed-f8c9e28655ba None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:05.075877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5478992-0edd-4a0d-baed-f8c9e28655ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:05.091187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa1dc5-71ba-4e10-99ac-86fcb1e4f6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:05.091970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa1dc5-71ba-4e10-99ac-86fcb1e4f6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:05.092403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa1dc5-71ba-4e10-99ac-86fcb1e4f6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:05.092826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa1dc5-71ba-4e10-99ac-86fcb1e4f6c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:05.093654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa1dc5-71ba-4e10-99ac-86fcb1e4f6c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:05.095294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e5478992-0edd-4a0d-baed-f8c9e28655ba None None] MFA Rules not processed for user `fbe5b02f3089419b9eeb2d52b673e1fd`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:05.096035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa1dc5-71ba-4e10-99ac-86fcb1e4f6c7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:05.096523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e5478992-0edd-4a0d-baed-f8c9e28655ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:05.111018 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1673/3337] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:26:05.112200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa1dc5-71ba-4e10-99ac-86fcb1e4f6c7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:05.122834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa1dc5-71ba-4e10-99ac-86fcb1e4f6c7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:05.128208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a3773-acb5-42dd-bbca-5e6306994a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:05.130063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a3773-acb5-42dd-bbca-5e6306994a03 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:05.130063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a3773-acb5-42dd-bbca-5e6306994a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:05.130063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a3773-acb5-42dd-bbca-5e6306994a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:05.130636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a3773-acb5-42dd-bbca-5e6306994a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:05.132443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a3773-acb5-42dd-bbca-5e6306994a03 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:05.148231 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1674/3338] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:26:05.149250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a3773-acb5-42dd-bbca-5e6306994a03 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:05.153753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-281a3773-acb5-42dd-bbca-5e6306994a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:05.176305 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1665/3339] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:26:05.177235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5478992-0edd-4a0d-baed-f8c9e28655ba None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:05.187438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a3773-acb5-42dd-bbca-5e6306994a03 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:05.193422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc99378-48e0-4ba7-ab8b-7f0be6d7ba4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:05.194500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc99378-48e0-4ba7-ab8b-7f0be6d7ba4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:05.194800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc99378-48e0-4ba7-ab8b-7f0be6d7ba4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:05.195070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc99378-48e0-4ba7-ab8b-7f0be6d7ba4d admin admin] PATH_INFO: `/v3/projects/d3cc19b3fced44ec8a4bbceefe623f6d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:05.196293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc99378-48e0-4ba7-ab8b-7f0be6d7ba4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3cc19b3fced44ec8a4bbceefe623f6d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:05.199424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc99378-48e0-4ba7-ab8b-7f0be6d7ba4d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:05.199625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5478992-0edd-4a0d-baed-f8c9e28655ba None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:05.206287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e02a1e-b656-4f79-8b09-9be19c249a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:05.210118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e02a1e-b656-4f79-8b09-9be19c249a9c admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:05.210118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e02a1e-b656-4f79-8b09-9be19c249a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:05.210118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e02a1e-b656-4f79-8b09-9be19c249a9c admin admin] PATH_INFO: `/v3/projects/4f82450170e949c3b8bbfa5f5789e871/users/7314aa0ae67d468697a4160ee008991f/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:05.228330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e02a1e-b656-4f79-8b09-9be19c249a9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f82450170e949c3b8bbfa5f5789e871, user_id=7314aa0ae67d468697a4160ee008991f, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:05.231042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e02a1e-b656-4f79-8b09-9be19c249a9c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:05.392284 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1666/3340] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:26:05 2022] PUT /identity/v3/projects/4f82450170e949c3b8bbfa5f5789e871/users/7314aa0ae67d468697a4160ee008991f/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:26:05.393199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e02a1e-b656-4f79-8b09-9be19c249a9c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:05.394791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-03e02a1e-b656-4f79-8b09-9be19c249a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:05.402688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-efc99378-48e0-4ba7-ab8b-7f0be6d7ba4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3cc19b3fced44ec8a4bbceefe623f6d', 'request_id': 'req-efc99378-48e0-4ba7-ab8b-7f0be6d7ba4d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:05.409365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-efc99378-48e0-4ba7-ab8b-7f0be6d7ba4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3cc19b3fced44ec8a4bbceefe623f6d', 'request_id': 'req-efc99378-48e0-4ba7-ab8b-7f0be6d7ba4d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:05.468029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e02a1e-b656-4f79-8b09-9be19c249a9c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:05.536182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ce335-d355-4049-806b-0186582b9b45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:05.536875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ce335-d355-4049-806b-0186582b9b45 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:05.537161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ce335-d355-4049-806b-0186582b9b45 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:05.537440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ce335-d355-4049-806b-0186582b9b45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:05.539242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b07ce335-d355-4049-806b-0186582b9b45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:05.574763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-efc99378-48e0-4ba7-ab8b-7f0be6d7ba4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3cc19b3fced44ec8a4bbceefe623f6d', 'request_id': 'req-efc99378-48e0-4ba7-ab8b-7f0be6d7ba4d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:05.587456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-efc99378-48e0-4ba7-ab8b-7f0be6d7ba4d admin admin] The token cache is being invalidate because project d3cc19b3fced44ec8a4bbceefe623f6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:26:05.587785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-efc99378-48e0-4ba7-ab8b-7f0be6d7ba4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:05.588485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-efc99378-48e0-4ba7-ab8b-7f0be6d7ba4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:05.590062 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1675/3341] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:26:05 2022] DELETE /identity/v3/projects/d3cc19b3fced44ec8a4bbceefe623f6d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:26:05.591323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee821e9-a6a9-468d-b74e-c87747f35715 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:05.591618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee821e9-a6a9-468d-b74e-c87747f35715 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:05.591896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee821e9-a6a9-468d-b74e-c87747f35715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:05.596490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ce335-d355-4049-806b-0186582b9b45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:05.602949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ce335-d355-4049-806b-0186582b9b45 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:05.607467 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1667/3342] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:26:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:26:05.608960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac72b9-5626-4c33-9b36-54371a92f972 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:05.609252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac72b9-5626-4c33-9b36-54371a92f972 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:05.609535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac72b9-5626-4c33-9b36-54371a92f972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:05.629635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3cac72b9-5626-4c33-9b36-54371a92f972 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:05.630872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3cac72b9-5626-4c33-9b36-54371a92f972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:05.643664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-cee821e9-a6a9-468d-b74e-c87747f35715 None None] MFA Rules not processed for user `7314aa0ae67d468697a4160ee008991f`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:05.648948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cee821e9-a6a9-468d-b74e-c87747f35715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:05.743426 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1668/3343] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:05.746018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683e914-8240-4edf-81ed-5930834c0fa0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:05.746531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683e914-8240-4edf-81ed-5930834c0fa0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:05.747004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683e914-8240-4edf-81ed-5930834c0fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:05.770681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a683e914-8240-4edf-81ed-5930834c0fa0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:05.772240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a683e914-8240-4edf-81ed-5930834c0fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:05.780947 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1676/3344] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:05.786616 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1669/3345] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:05.792391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee821e9-a6a9-468d-b74e-c87747f35715 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:05.792683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683e914-8240-4edf-81ed-5930834c0fa0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:05.794087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a683e914-8240-4edf-81ed-5930834c0fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:05.807250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee821e9-a6a9-468d-b74e-c87747f35715 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:05.818761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef31d2-cdac-4371-898c-2cfa53ec8691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:05.819449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef31d2-cdac-4371-898c-2cfa53ec8691 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:05.819737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef31d2-cdac-4371-898c-2cfa53ec8691 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:05.820017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef31d2-cdac-4371-898c-2cfa53ec8691 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:05.821017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef31d2-cdac-4371-898c-2cfa53ec8691 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:26:05.821354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef31d2-cdac-4371-898c-2cfa53ec8691 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:05.825916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef31d2-cdac-4371-898c-2cfa53ec8691 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:05.845134 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1677/3346] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:26:05.846071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef31d2-cdac-4371-898c-2cfa53ec8691 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:05.857619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef31d2-cdac-4371-898c-2cfa53ec8691 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:05.871208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a7728-6321-4ce1-9e36-41e0d3f342df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:05.872309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a7728-6321-4ce1-9e36-41e0d3f342df admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:05.872630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a7728-6321-4ce1-9e36-41e0d3f342df admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:05.872908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a7728-6321-4ce1-9e36-41e0d3f342df admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:05.873620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a7728-6321-4ce1-9e36-41e0d3f342df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:05.875792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a7728-6321-4ce1-9e36-41e0d3f342df admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:05.917142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683e914-8240-4edf-81ed-5930834c0fa0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:05.921303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c33567-f0ad-4132-93ac-6ec52e64593d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:05.922276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c33567-f0ad-4132-93ac-6ec52e64593d service glance] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:05.922610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c33567-f0ad-4132-93ac-6ec52e64593d service glance] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:05.923622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c33567-f0ad-4132-93ac-6ec52e64593d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:05.938377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c33567-f0ad-4132-93ac-6ec52e64593d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:05.940503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c33567-f0ad-4132-93ac-6ec52e64593d service glance] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:05.956696 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1670/3347] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:26:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:26:06.013636 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1678/3348] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:26:05 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:26:06.017794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c33567-f0ad-4132-93ac-6ec52e64593d service glance] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:06.028623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c33567-f0ad-4132-93ac-6ec52e64593d service glance] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:06.127078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f9837-dceb-4085-8a9a-fe51c8a36a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:06.127887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f9837-dceb-4085-8a9a-fe51c8a36a12 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:06.128644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f9837-dceb-4085-8a9a-fe51c8a36a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:06.128644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f9837-dceb-4085-8a9a-fe51c8a36a12 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:06.129230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f9837-dceb-4085-8a9a-fe51c8a36a12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:06.131328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f9837-dceb-4085-8a9a-fe51c8a36a12 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:06.278494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a7728-6321-4ce1-9e36-41e0d3f342df admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:06.284331 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1671/3349] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:26:06 2022] POST /identity/v3/users => generated 292 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:26:06.291705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a7728-6321-4ce1-9e36-41e0d3f342df admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:06.303039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b4430-155c-4cdc-9b78-2c3902ade447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:06.304162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b4430-155c-4cdc-9b78-2c3902ade447 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:06.304465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b4430-155c-4cdc-9b78-2c3902ade447 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:06.304791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b4430-155c-4cdc-9b78-2c3902ade447 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:06.305533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b4430-155c-4cdc-9b78-2c3902ade447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:06.307179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b4430-155c-4cdc-9b78-2c3902ade447 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:06.323781 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1679/3350] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:26:06.327229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f9837-dceb-4085-8a9a-fe51c8a36a12 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:06.345371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f9837-dceb-4085-8a9a-fe51c8a36a12 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:06.351215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75fad6-e570-44fe-827a-e9c63c4d80fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:06.351913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75fad6-e570-44fe-827a-e9c63c4d80fb admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:06.352199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75fad6-e570-44fe-827a-e9c63c4d80fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:06.352478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75fad6-e570-44fe-827a-e9c63c4d80fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:06.353249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75fad6-e570-44fe-827a-e9c63c4d80fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:06.357535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75fad6-e570-44fe-827a-e9c63c4d80fb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:06.368684 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1672/3351] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:26:06.371123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b4430-155c-4cdc-9b78-2c3902ade447 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:06.387276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b4430-155c-4cdc-9b78-2c3902ade447 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:06.394422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbe30a-196b-4def-85c9-39d80b5345f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:06.400120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbe30a-196b-4def-85c9-39d80b5345f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:06.400120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbe30a-196b-4def-85c9-39d80b5345f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:06.400120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbe30a-196b-4def-85c9-39d80b5345f4 admin admin] PATH_INFO: `/v3/projects/40020fab911e41af89452a40ec1dd049/users/38b4da4596374618a827b286f73ad999/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:06.425080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbe30a-196b-4def-85c9-39d80b5345f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40020fab911e41af89452a40ec1dd049, user_id=38b4da4596374618a827b286f73ad999, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:06.427850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbe30a-196b-4def-85c9-39d80b5345f4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:06.563037 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1680/3352] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:26:06 2022] PUT /identity/v3/projects/40020fab911e41af89452a40ec1dd049/users/38b4da4596374618a827b286f73ad999/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:26:06.573957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9fe41-8bb2-4e41-b08e-07bd66de5045 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:06.574434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9fe41-8bb2-4e41-b08e-07bd66de5045 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:06.574557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9fe41-8bb2-4e41-b08e-07bd66de5045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:06.602348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4bf9fe41-8bb2-4e41-b08e-07bd66de5045 None None] MFA Rules not processed for user `38b4da4596374618a827b286f73ad999`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:06.603572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4bf9fe41-8bb2-4e41-b08e-07bd66de5045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:06.690595 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1673/3353] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:26:06.695220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbe30a-196b-4def-85c9-39d80b5345f4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:06.761082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbe30a-196b-4def-85c9-39d80b5345f4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:06.766033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeea06f-c6c2-4a1f-8090-c3e2079dc746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:06.766812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeea06f-c6c2-4a1f-8090-c3e2079dc746 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:06.767155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeea06f-c6c2-4a1f-8090-c3e2079dc746 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:06.767498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeea06f-c6c2-4a1f-8090-c3e2079dc746 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:06.768265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeea06f-c6c2-4a1f-8090-c3e2079dc746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:06.770280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeea06f-c6c2-4a1f-8090-c3e2079dc746 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:06.888618 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1681/3354] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:26:06 2022] POST /identity/v3/projects => generated 381 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:26:06.892938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9fe41-8bb2-4e41-b08e-07bd66de5045 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:06.906656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9fe41-8bb2-4e41-b08e-07bd66de5045 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:06.964634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b076bdf-42a4-49b8-bc72-17797e3fa1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:06.965372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b076bdf-42a4-49b8-bc72-17797e3fa1aa admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:06.965657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b076bdf-42a4-49b8-bc72-17797e3fa1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:06.965938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b076bdf-42a4-49b8-bc72-17797e3fa1aa admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:06.966639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b076bdf-42a4-49b8-bc72-17797e3fa1aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:06.968636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b076bdf-42a4-49b8-bc72-17797e3fa1aa admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:07.113998 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1674/3355] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:26:06 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:26:07.118013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeea06f-c6c2-4a1f-8090-c3e2079dc746 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:07.136686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeea06f-c6c2-4a1f-8090-c3e2079dc746 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:07.143757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dbc35-0a2c-4111-a34a-7ce4c4b4d5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:07.145937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dbc35-0a2c-4111-a34a-7ce4c4b4d5cc admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:07.146765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dbc35-0a2c-4111-a34a-7ce4c4b4d5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:07.147205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dbc35-0a2c-4111-a34a-7ce4c4b4d5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:07.148152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78dbc35-0a2c-4111-a34a-7ce4c4b4d5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:07.150205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78dbc35-0a2c-4111-a34a-7ce4c4b4d5cc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:07.165744 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1682/3356] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:26:07.169811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b076bdf-42a4-49b8-bc72-17797e3fa1aa admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:07.183940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b076bdf-42a4-49b8-bc72-17797e3fa1aa admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:07.190350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d306988-bac5-4ef3-9bd8-5d71761775a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:07.191365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d306988-bac5-4ef3-9bd8-5d71761775a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:07.191759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d306988-bac5-4ef3-9bd8-5d71761775a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:07.192161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d306988-bac5-4ef3-9bd8-5d71761775a5 admin admin] PATH_INFO: `/v3/projects/c58e55f2d96a41bbb23c78b83427bca4/users/da530920707d49139c498bd15e92ee25/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:07.210342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d306988-bac5-4ef3-9bd8-5d71761775a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58e55f2d96a41bbb23c78b83427bca4, user_id=da530920707d49139c498bd15e92ee25, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:07.213519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d306988-bac5-4ef3-9bd8-5d71761775a5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:07.299588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ac810-6361-4b2d-9569-c12eda2435a2 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:07.300060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ac810-6361-4b2d-9569-c12eda2435a2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:07.300379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ac810-6361-4b2d-9569-c12eda2435a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:07.320207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ee0ac810-6361-4b2d-9569-c12eda2435a2 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:07.323601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ee0ac810-6361-4b2d-9569-c12eda2435a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:07.343014 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1675/3357] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:26:07 2022] PUT /identity/v3/projects/c58e55f2d96a41bbb23c78b83427bca4/users/da530920707d49139c498bd15e92ee25/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:26:07.343927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d306988-bac5-4ef3-9bd8-5d71761775a5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:07.439198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d306988-bac5-4ef3-9bd8-5d71761775a5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:07.441578 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1683/3358] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:26:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:07.444813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78ad5b-9c1f-4d62-95d7-0bc82ce94520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:07.452284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78ad5b-9c1f-4d62-95d7-0bc82ce94520 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:07.452702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78ad5b-9c1f-4d62-95d7-0bc82ce94520 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:07.453062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78ad5b-9c1f-4d62-95d7-0bc82ce94520 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:07.455555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ac810-6361-4b2d-9569-c12eda2435a2 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:07.457354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78ad5b-9c1f-4d62-95d7-0bc82ce94520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:07.457584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ee0ac810-6361-4b2d-9569-c12eda2435a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:07.459526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78ad5b-9c1f-4d62-95d7-0bc82ce94520 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:07.479510 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1676/3359] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:26:07.489604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78ad5b-9c1f-4d62-95d7-0bc82ce94520 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:07.507378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78ad5b-9c1f-4d62-95d7-0bc82ce94520 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:07.524271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bb708-50b2-4be0-814c-b665da2bbd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:07.527888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bb708-50b2-4be0-814c-b665da2bbd92 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:07.528370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bb708-50b2-4be0-814c-b665da2bbd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:07.532821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bb708-50b2-4be0-814c-b665da2bbd92 admin admin] PATH_INFO: `/v3/projects/c58e55f2d96a41bbb23c78b83427bca4/users/da530920707d49139c498bd15e92ee25/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:07.532821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bb708-50b2-4be0-814c-b665da2bbd92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58e55f2d96a41bbb23c78b83427bca4, user_id=da530920707d49139c498bd15e92ee25, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:07.534692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bb708-50b2-4be0-814c-b665da2bbd92 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:07.551936 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1677/3360] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:26:07 2022] PUT /identity/v3/projects/c58e55f2d96a41bbb23c78b83427bca4/users/da530920707d49139c498bd15e92ee25/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:26:07.599840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ac810-6361-4b2d-9569-c12eda2435a2 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:07.621673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75369fef-2442-4827-81bb-bf28433348c6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:07.622505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75369fef-2442-4827-81bb-bf28433348c6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:07.623096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75369fef-2442-4827-81bb-bf28433348c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:07.673712 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-75369fef-2442-4827-81bb-bf28433348c6 None None] MFA Rules not processed for user `da530920707d49139c498bd15e92ee25`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:07.675051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-75369fef-2442-4827-81bb-bf28433348c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:07.703820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b783d-c3d1-4217-9bb4-59a791e0f7ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:07.705483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b783d-c3d1-4217-9bb4-59a791e0f7ab service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:07.705856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b783d-c3d1-4217-9bb4-59a791e0f7ab service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:07.706213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b783d-c3d1-4217-9bb4-59a791e0f7ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:07.793429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b783d-c3d1-4217-9bb4-59a791e0f7ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:07.797069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b783d-c3d1-4217-9bb4-59a791e0f7ab service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:07.802457 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1678/3361] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:07.811201 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1684/3362] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:26:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:26:07.822874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75369fef-2442-4827-81bb-bf28433348c6 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:07.824918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-75369fef-2442-4827-81bb-bf28433348c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:07.917976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75369fef-2442-4827-81bb-bf28433348c6 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:07.923931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e935a-ba5e-46b1-8fa4-2717e7808f62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:07.924545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e935a-ba5e-46b1-8fa4-2717e7808f62 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:07.924848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e935a-ba5e-46b1-8fa4-2717e7808f62 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:07.925133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e935a-ba5e-46b1-8fa4-2717e7808f62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:07.935243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e935a-ba5e-46b1-8fa4-2717e7808f62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:07.936909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e935a-ba5e-46b1-8fa4-2717e7808f62 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:07.947837 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1679/3363] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:26:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:26:07.963856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b20350-f8bc-44c4-8ed8-bc2ed8f09427 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:07.964694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b20350-f8bc-44c4-8ed8-bc2ed8f09427 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:07.965015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b20350-f8bc-44c4-8ed8-bc2ed8f09427 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:07.966905 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1685/3364] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:26:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:26:07.971261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e935a-ba5e-46b1-8fa4-2717e7808f62 service nova] Authenticating service token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:26:07.982716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e935a-ba5e-46b1-8fa4-2717e7808f62 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:07.992491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e935a-ba5e-46b1-8fa4-2717e7808f62 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:07.997257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc9b7f-1249-44bb-8660-565a0b9641ce tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da530920707d49139c498bd15e92ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58e55f2d96a41bbb23c78b83427bca4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:07.998127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc9b7f-1249-44bb-8660-565a0b9641ce tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:07.998409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc9b7f-1249-44bb-8660-565a0b9641ce tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:07.998683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc9b7f-1249-44bb-8660-565a0b9641ce tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] PATH_INFO: `/v3/projects/40020fab911e41af89452a40ec1dd049` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:08.000737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc9b7f-1249-44bb-8660-565a0b9641ce tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: Authorizing `identity:get_project(project_id=40020fab911e41af89452a40ec1dd049)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:08.003702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc9b7f-1249-44bb-8660-565a0b9641ce tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:08.005861 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1680/3365] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:26:07 2022] GET /identity/v3/projects/40020fab911e41af89452a40ec1dd049 => generated 383 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:26:08.052290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d0ff2-da8c-48b2-a4d9-4afb89e95f4e None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:08.052634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d0ff2-da8c-48b2-a4d9-4afb89e95f4e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:08.053084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d0ff2-da8c-48b2-a4d9-4afb89e95f4e None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:08.059883 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1686/3366] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:26:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:26:08.065154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc9b7f-1249-44bb-8660-565a0b9641ce tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] Authenticating service token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:26:08.066956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4dfc9b7f-1249-44bb-8660-565a0b9641ce tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:08.087655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc9b7f-1249-44bb-8660-565a0b9641ce tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:08.102207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc9b7f-1249-44bb-8660-565a0b9641ce tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:08.112524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927cb7c-89df-4c59-b75e-72ad9c48b954 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da530920707d49139c498bd15e92ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58e55f2d96a41bbb23c78b83427bca4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:08.113633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927cb7c-89df-4c59-b75e-72ad9c48b954 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:08.114229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927cb7c-89df-4c59-b75e-72ad9c48b954 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:08.118018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927cb7c-89df-4c59-b75e-72ad9c48b954 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] PATH_INFO: `/v3/projects/40020fab911e41af89452a40ec1dd049` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:08.119853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927cb7c-89df-4c59-b75e-72ad9c48b954 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: Authorizing `identity:get_project(project_id=40020fab911e41af89452a40ec1dd049)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:08.124737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927cb7c-89df-4c59-b75e-72ad9c48b954 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:08.126895 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1681/3367] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:26:08 2022] GET /identity/v3/projects/40020fab911e41af89452a40ec1dd049 => generated 383 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:26:08.379153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c20fb-63d4-4ef8-9025-ada24b6ae1ae None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:08.384415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c20fb-63d4-4ef8-9025-ada24b6ae1ae None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:08.384415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c20fb-63d4-4ef8-9025-ada24b6ae1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:08.418668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f93c20fb-63d4-4ef8-9025-ada24b6ae1ae None None] MFA Rules not processed for user `38b4da4596374618a827b286f73ad999`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:08.432992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f93c20fb-63d4-4ef8-9025-ada24b6ae1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:08.553112 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1687/3368] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:08.717524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927cb7c-89df-4c59-b75e-72ad9c48b954 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:08.730361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927cb7c-89df-4c59-b75e-72ad9c48b954 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:08.736306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678e881-d041-47d9-a368-a027378a592a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:08.737702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678e881-d041-47d9-a368-a027378a592a service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:08.737702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678e881-d041-47d9-a368-a027378a592a service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:08.737702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678e881-d041-47d9-a368-a027378a592a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:08.748067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678e881-d041-47d9-a368-a027378a592a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:08.750219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678e881-d041-47d9-a368-a027378a592a service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:08.761898 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1682/3369] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:26:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:26:09.635908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fcd13-4369-437e-aa21-34034c6e4bd8 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:09.636429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fcd13-4369-437e-aa21-34034c6e4bd8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:09.636881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fcd13-4369-437e-aa21-34034c6e4bd8 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:09.638216 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1688/3370] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:26:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:26:09.643464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678e881-d041-47d9-a368-a027378a592a service nova] Authenticating service token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:26:09.656224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678e881-d041-47d9-a368-a027378a592a service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:09.675701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678e881-d041-47d9-a368-a027378a592a service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:09.683931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1873b-80a2-46b1-84c2-5a12d8da96a4 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da530920707d49139c498bd15e92ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58e55f2d96a41bbb23c78b83427bca4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:09.684760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1873b-80a2-46b1-84c2-5a12d8da96a4 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:09.685045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1873b-80a2-46b1-84c2-5a12d8da96a4 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:09.685322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1873b-80a2-46b1-84c2-5a12d8da96a4 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] PATH_INFO: `/v3/projects/40020fab911e41af89452a40ec1dd049` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:09.686693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1873b-80a2-46b1-84c2-5a12d8da96a4 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: Authorizing `identity:get_project(project_id=40020fab911e41af89452a40ec1dd049)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:09.690093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1873b-80a2-46b1-84c2-5a12d8da96a4 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:09.696684 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1683/3371] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:26:09 2022] GET /identity/v3/projects/40020fab911e41af89452a40ec1dd049 => generated 383 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:26:09.950466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40d58e-c731-40c6-bbce-7de51ed7ff4b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:09.950980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40d58e-c731-40c6-bbce-7de51ed7ff4b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:09.951261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40d58e-c731-40c6-bbce-7de51ed7ff4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:09.954771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e630ca4-9919-4d3e-b757-19bccf1dc775 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:09.955315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e630ca4-9919-4d3e-b757-19bccf1dc775 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:09.955315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e630ca4-9919-4d3e-b757-19bccf1dc775 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:09.956781 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1684/3372] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:26:09.962907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e630ca4-9919-4d3e-b757-19bccf1dc775 None None] Authenticating service token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:26:09.974283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-bf40d58e-c731-40c6-bbce-7de51ed7ff4b None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:09.975485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bf40d58e-c731-40c6-bbce-7de51ed7ff4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:09.977906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e630ca4-9919-4d3e-b757-19bccf1dc775 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:09.983411 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1689/3373] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:26:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:09.990125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e630ca4-9919-4d3e-b757-19bccf1dc775 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:09.996298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c98552-08d8-40f4-807a-c9b607e14cf9 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da530920707d49139c498bd15e92ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58e55f2d96a41bbb23c78b83427bca4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:09.997506 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c98552-08d8-40f4-807a-c9b607e14cf9 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:09.997893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c98552-08d8-40f4-807a-c9b607e14cf9 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:09.998273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c98552-08d8-40f4-807a-c9b607e14cf9 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] PATH_INFO: `/v3/projects/40020fab911e41af89452a40ec1dd049` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:09.999468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40d58e-c731-40c6-bbce-7de51ed7ff4b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:09.999933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c98552-08d8-40f4-807a-c9b607e14cf9 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: Authorizing `identity:get_project(project_id=40020fab911e41af89452a40ec1dd049)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:10.002240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c98552-08d8-40f4-807a-c9b607e14cf9 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:10.005314 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1685/3374] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:26:09 2022] GET /identity/v3/projects/40020fab911e41af89452a40ec1dd049 => generated 383 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:26:10.016222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40d58e-c731-40c6-bbce-7de51ed7ff4b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:10.022126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230421d-e5f5-4932-96ad-8c2f76a76c90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:10.023151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230421d-e5f5-4932-96ad-8c2f76a76c90 service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:10.023810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230421d-e5f5-4932-96ad-8c2f76a76c90 service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:10.024269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230421d-e5f5-4932-96ad-8c2f76a76c90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:10.037875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230421d-e5f5-4932-96ad-8c2f76a76c90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:10.039476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230421d-e5f5-4932-96ad-8c2f76a76c90 service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:10.050111 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1690/3375] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:26:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:26:10.057926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630b19d-0350-4b4b-82e7-cf6ca3e3f66d None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:10.068630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630b19d-0350-4b4b-82e7-cf6ca3e3f66d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:10.068630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630b19d-0350-4b4b-82e7-cf6ca3e3f66d None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:10.068630 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1686/3376] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:26:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:26:10.069175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230421d-e5f5-4932-96ad-8c2f76a76c90 service swift] Authenticating service token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:26:10.080239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230421d-e5f5-4932-96ad-8c2f76a76c90 service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:10.090963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230421d-e5f5-4932-96ad-8c2f76a76c90 service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:10.096647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f9df9-5a8e-4d28-95cb-9db6f8b7e61e tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da530920707d49139c498bd15e92ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58e55f2d96a41bbb23c78b83427bca4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:10.099008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f9df9-5a8e-4d28-95cb-9db6f8b7e61e tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:10.099008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f9df9-5a8e-4d28-95cb-9db6f8b7e61e tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:10.099008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f9df9-5a8e-4d28-95cb-9db6f8b7e61e tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] PATH_INFO: `/v3/projects/40020fab911e41af89452a40ec1dd049` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:10.100087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f9df9-5a8e-4d28-95cb-9db6f8b7e61e tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: Authorizing `identity:get_project(project_id=40020fab911e41af89452a40ec1dd049)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:10.102344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f9df9-5a8e-4d28-95cb-9db6f8b7e61e tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:10.112704 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1691/3377] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:26:10 2022] GET /identity/v3/projects/40020fab911e41af89452a40ec1dd049 => generated 383 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:26:10.278307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f765fad-6c23-490f-a998-8e6caf74e25d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:10.278606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f765fad-6c23-490f-a998-8e6caf74e25d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:10.279481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f765fad-6c23-490f-a998-8e6caf74e25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:10.305832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3f765fad-6c23-490f-a998-8e6caf74e25d None None] MFA Rules not processed for user `38b4da4596374618a827b286f73ad999`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:10.308310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3f765fad-6c23-490f-a998-8e6caf74e25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:10.316893 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1687/3378] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:10.750063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee2662-ebaa-43f3-a8e2-7602a2350189 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:10.750646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee2662-ebaa-43f3-a8e2-7602a2350189 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:10.750839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee2662-ebaa-43f3-a8e2-7602a2350189 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:10.752792 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1692/3379] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:26:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 10:26:10.759963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f765fad-6c23-490f-a998-8e6caf74e25d None None] Authenticating service token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:26:10.773562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f765fad-6c23-490f-a998-8e6caf74e25d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:10.784979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f765fad-6c23-490f-a998-8e6caf74e25d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:10.790144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990338e3-193a-4bc4-9834-24d05a0b35b2 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da530920707d49139c498bd15e92ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58e55f2d96a41bbb23c78b83427bca4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:10.791910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990338e3-193a-4bc4-9834-24d05a0b35b2 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:10.792450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990338e3-193a-4bc4-9834-24d05a0b35b2 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:10.792866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990338e3-193a-4bc4-9834-24d05a0b35b2 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] PATH_INFO: `/v3/projects/40020fab911e41af89452a40ec1dd049` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:10.794401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990338e3-193a-4bc4-9834-24d05a0b35b2 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: Authorizing `identity:get_project(project_id=40020fab911e41af89452a40ec1dd049)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:10.796591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990338e3-193a-4bc4-9834-24d05a0b35b2 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:10.798575 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1688/3380] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:26:10 2022] GET /identity/v3/projects/40020fab911e41af89452a40ec1dd049 => generated 383 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:26:11.321016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333aba1e-e521-46c9-bccc-39360dba5b58 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:11.321507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333aba1e-e521-46c9-bccc-39360dba5b58 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:11.322494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333aba1e-e521-46c9-bccc-39360dba5b58 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:11.324237 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1693/3381] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:26:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:26:11.331360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990338e3-193a-4bc4-9834-24d05a0b35b2 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] Authenticating service token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:26:11.348038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990338e3-193a-4bc4-9834-24d05a0b35b2 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:11.359882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990338e3-193a-4bc4-9834-24d05a0b35b2 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:11.367522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c345a-d5b7-4ec5-9c34-8b07f677552c tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da530920707d49139c498bd15e92ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58e55f2d96a41bbb23c78b83427bca4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:11.369615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c345a-d5b7-4ec5-9c34-8b07f677552c tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:11.370065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c345a-d5b7-4ec5-9c34-8b07f677552c tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:11.370695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c345a-d5b7-4ec5-9c34-8b07f677552c tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] PATH_INFO: `/v3/projects/40020fab911e41af89452a40ec1dd049` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:11.372148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c345a-d5b7-4ec5-9c34-8b07f677552c tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: Authorizing `identity:get_project(project_id=40020fab911e41af89452a40ec1dd049)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:11.378476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c345a-d5b7-4ec5-9c34-8b07f677552c tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:11.386965 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1689/3382] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:26:11 2022] GET /identity/v3/projects/40020fab911e41af89452a40ec1dd049 => generated 383 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:26:11.468822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb8844-0155-423d-92b0-35329161c8d7 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:11.469342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb8844-0155-423d-92b0-35329161c8d7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:11.469784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb8844-0155-423d-92b0-35329161c8d7 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:11.472290 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1694/3383] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:26:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:26:11.478385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c345a-d5b7-4ec5-9c34-8b07f677552c tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] Authenticating service token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:26:11.493239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c345a-d5b7-4ec5-9c34-8b07f677552c tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:11.507177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c345a-d5b7-4ec5-9c34-8b07f677552c tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:11.514027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef93aa5-9ead-45cb-983b-5f5c21d305ee tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da530920707d49139c498bd15e92ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58e55f2d96a41bbb23c78b83427bca4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:11.515399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef93aa5-9ead-45cb-983b-5f5c21d305ee tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:11.515841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef93aa5-9ead-45cb-983b-5f5c21d305ee tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:11.516334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef93aa5-9ead-45cb-983b-5f5c21d305ee tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] PATH_INFO: `/v3/projects/40020fab911e41af89452a40ec1dd049` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:11.518357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef93aa5-9ead-45cb-983b-5f5c21d305ee tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: Authorizing `identity:get_project(project_id=40020fab911e41af89452a40ec1dd049)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:11.523567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef93aa5-9ead-45cb-983b-5f5c21d305ee tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:11.541057 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1690/3384] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:26:11 2022] GET /identity/v3/projects/40020fab911e41af89452a40ec1dd049 => generated 383 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:26:11.697786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1723999-2b29-4173-ac48-53df882da851 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:11.698387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1723999-2b29-4173-ac48-53df882da851 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:11.698785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1723999-2b29-4173-ac48-53df882da851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:11.740032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f1723999-2b29-4173-ac48-53df882da851 None None] MFA Rules not processed for user `38b4da4596374618a827b286f73ad999`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:11.742208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f1723999-2b29-4173-ac48-53df882da851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:11.752233 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1695/3385] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:12.193427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0f73e-57b1-4023-a933-04708c611570 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:12.194122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0f73e-57b1-4023-a933-04708c611570 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:12.198836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0f73e-57b1-4023-a933-04708c611570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:12.222474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a8d0f73e-57b1-4023-a933-04708c611570 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:12.223219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a8d0f73e-57b1-4023-a933-04708c611570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:12.240628 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1691/3386] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:26:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:12.247751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1723999-2b29-4173-ac48-53df882da851 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:12.283398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1723999-2b29-4173-ac48-53df882da851 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:12.292365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2a889-b126-4bbd-a7fd-382014d4300e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:12.293581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2a889-b126-4bbd-a7fd-382014d4300e service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:12.294010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2a889-b126-4bbd-a7fd-382014d4300e service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:12.294444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2a889-b126-4bbd-a7fd-382014d4300e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:12.315207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2a889-b126-4bbd-a7fd-382014d4300e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:12.316955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2a889-b126-4bbd-a7fd-382014d4300e service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:12.342667 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1696/3387] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:26:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:26:12.655251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcb2d5-702e-4b6b-be6f-542bf75d871a None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:12.655790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcb2d5-702e-4b6b-be6f-542bf75d871a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:12.655987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffcb2d5-702e-4b6b-be6f-542bf75d871a None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:12.657647 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1692/3388] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:26:12.663032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2a889-b126-4bbd-a7fd-382014d4300e service swift] Authenticating service token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:26:12.677481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2a889-b126-4bbd-a7fd-382014d4300e service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:12.690617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2a889-b126-4bbd-a7fd-382014d4300e service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:12.699442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989b7fb-1b27-4027-a19d-33fbd94e2d01 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da530920707d49139c498bd15e92ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c58e55f2d96a41bbb23c78b83427bca4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:12.700546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989b7fb-1b27-4027-a19d-33fbd94e2d01 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:12.701197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989b7fb-1b27-4027-a19d-33fbd94e2d01 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:12.701486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989b7fb-1b27-4027-a19d-33fbd94e2d01 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] PATH_INFO: `/v3/projects/40020fab911e41af89452a40ec1dd049` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:12.702858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989b7fb-1b27-4027-a19d-33fbd94e2d01 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: Authorizing `identity:get_project(project_id=40020fab911e41af89452a40ec1dd049)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:12.705023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989b7fb-1b27-4027-a19d-33fbd94e2d01 tempest-QuotasAdminNegativeTest-922591346 tempest-QuotasAdminNegativeTest-922591346-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:12.707222 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1697/3389] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:26:12 2022] GET /identity/v3/projects/40020fab911e41af89452a40ec1dd049 => generated 383 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:26:12.970667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcb2d5-702e-4b6b-be6f-542bf75d871a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:13.066495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464bcfb-ec81-430a-bef2-c0fa5f06f6a3 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:13.067033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464bcfb-ec81-430a-bef2-c0fa5f06f6a3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:13.067460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464bcfb-ec81-430a-bef2-c0fa5f06f6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:13.076570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffcb2d5-702e-4b6b-be6f-542bf75d871a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:13.083877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b3f0a-9d6a-4f9d-b6e2-31f541c7355e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:13.084992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b3f0a-9d6a-4f9d-b6e2-31f541c7355e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:13.085355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b3f0a-9d6a-4f9d-b6e2-31f541c7355e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:13.085694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b3f0a-9d6a-4f9d-b6e2-31f541c7355e admin admin] PATH_INFO: `/v3/users/38b4da4596374618a827b286f73ad999` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:13.087233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b3f0a-9d6a-4f9d-b6e2-31f541c7355e admin admin] RBAC: Authorizing `identity:delete_user(user_id=38b4da4596374618a827b286f73ad999)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:13.089604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b3f0a-9d6a-4f9d-b6e2-31f541c7355e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:13.101205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e464bcfb-ec81-430a-bef2-c0fa5f06f6a3 None None] MFA Rules not processed for user `7314aa0ae67d468697a4160ee008991f`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:13.105456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e464bcfb-ec81-430a-bef2-c0fa5f06f6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:13.190492 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1698/3390] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:26:13.294438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a32b3f0a-9d6a-4f9d-b6e2-31f541c7355e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38b4da4596374618a827b286f73ad999'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:13.320712 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a32b3f0a-9d6a-4f9d-b6e2-31f541c7355e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38b4da4596374618a827b286f73ad999'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:13.322385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a32b3f0a-9d6a-4f9d-b6e2-31f541c7355e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38b4da4596374618a827b286f73ad999'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:13.335747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a32b3f0a-9d6a-4f9d-b6e2-31f541c7355e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38b4da4596374618a827b286f73ad999'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:13.530849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a32b3f0a-9d6a-4f9d-b6e2-31f541c7355e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38b4da4596374618a827b286f73ad999'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:13.538562 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1693/3391] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:26:12 2022] DELETE /identity/v3/users/38b4da4596374618a827b286f73ad999 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:26:13.546034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b27c1-d83b-4f8e-942c-d6e9c33dc1dc None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:13.546590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b27c1-d83b-4f8e-942c-d6e9c33dc1dc None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:13.547037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b27c1-d83b-4f8e-942c-d6e9c33dc1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:13.592000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-672b27c1-d83b-4f8e-942c-d6e9c33dc1dc None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:13.596065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-672b27c1-d83b-4f8e-942c-d6e9c33dc1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:13.773480 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1699/3392] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:13.807128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b3f0a-9d6a-4f9d-b6e2-31f541c7355e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:13.810028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a32b3f0a-9d6a-4f9d-b6e2-31f541c7355e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:13.950711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b3f0a-9d6a-4f9d-b6e2-31f541c7355e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:13.956563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff10aa-bbb1-4cbc-9247-66f6e6aa6262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:13.957796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff10aa-bbb1-4cbc-9247-66f6e6aa6262 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:13.958454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff10aa-bbb1-4cbc-9247-66f6e6aa6262 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:13.958906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff10aa-bbb1-4cbc-9247-66f6e6aa6262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:13.973191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff10aa-bbb1-4cbc-9247-66f6e6aa6262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:13.975098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff10aa-bbb1-4cbc-9247-66f6e6aa6262 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:13.989680 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1694/3393] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:26:14.078774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ad6d6-40f7-43f7-8947-017162fe0c11 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:14.080043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ad6d6-40f7-43f7-8947-017162fe0c11 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:14.082874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ad6d6-40f7-43f7-8947-017162fe0c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:14.121455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9e9ad6d6-40f7-43f7-8947-017162fe0c11 None None] MFA Rules not processed for user `7314aa0ae67d468697a4160ee008991f`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:14.123084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9e9ad6d6-40f7-43f7-8947-017162fe0c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:14.289552 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1700/3394] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:15.643670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff10aa-bbb1-4cbc-9247-66f6e6aa6262 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:15.647867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-30ff10aa-bbb1-4cbc-9247-66f6e6aa6262 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:15.675312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff10aa-bbb1-4cbc-9247-66f6e6aa6262 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:15.682872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860e98e-3dd4-457e-be79-4b3dbb935f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:15.684565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860e98e-3dd4-457e-be79-4b3dbb935f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:15.685066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860e98e-3dd4-457e-be79-4b3dbb935f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:15.685530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860e98e-3dd4-457e-be79-4b3dbb935f38 admin admin] PATH_INFO: `/v3/projects/40020fab911e41af89452a40ec1dd049` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:15.687238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860e98e-3dd4-457e-be79-4b3dbb935f38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40020fab911e41af89452a40ec1dd049)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:15.689702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860e98e-3dd4-457e-be79-4b3dbb935f38 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:15.969169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5860e98e-3dd4-457e-be79-4b3dbb935f38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40020fab911e41af89452a40ec1dd049', 'request_id': 'req-5860e98e-3dd4-457e-be79-4b3dbb935f38'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:16.072401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5860e98e-3dd4-457e-be79-4b3dbb935f38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40020fab911e41af89452a40ec1dd049', 'request_id': 'req-5860e98e-3dd4-457e-be79-4b3dbb935f38'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:16.083903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5860e98e-3dd4-457e-be79-4b3dbb935f38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40020fab911e41af89452a40ec1dd049', 'request_id': 'req-5860e98e-3dd4-457e-be79-4b3dbb935f38'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:16.109932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5860e98e-3dd4-457e-be79-4b3dbb935f38 admin admin] The token cache is being invalidate because project 40020fab911e41af89452a40ec1dd049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:26:16.110295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5860e98e-3dd4-457e-be79-4b3dbb935f38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:16.110994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5860e98e-3dd4-457e-be79-4b3dbb935f38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:16.112782 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1695/3395] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:26:15 2022] DELETE /identity/v3/projects/40020fab911e41af89452a40ec1dd049 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:26:16.116770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ad6d6-40f7-43f7-8947-017162fe0c11 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:16.132172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ad6d6-40f7-43f7-8947-017162fe0c11 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:16.305891 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23654fc-00d9-466f-b106-df63ad66cc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:16.307734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23654fc-00d9-466f-b106-df63ad66cc0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:16.308205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23654fc-00d9-466f-b106-df63ad66cc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:16.308673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23654fc-00d9-466f-b106-df63ad66cc0b admin admin] PATH_INFO: `/v3/users/da530920707d49139c498bd15e92ee25` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:16.313006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23654fc-00d9-466f-b106-df63ad66cc0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=da530920707d49139c498bd15e92ee25)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:16.315253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23654fc-00d9-466f-b106-df63ad66cc0b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:16.585145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f23654fc-00d9-466f-b106-df63ad66cc0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da530920707d49139c498bd15e92ee25'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:16.613819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f23654fc-00d9-466f-b106-df63ad66cc0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da530920707d49139c498bd15e92ee25'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:16.625315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f23654fc-00d9-466f-b106-df63ad66cc0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da530920707d49139c498bd15e92ee25'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:16.637415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f23654fc-00d9-466f-b106-df63ad66cc0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da530920707d49139c498bd15e92ee25'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:16.708106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f23654fc-00d9-466f-b106-df63ad66cc0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da530920707d49139c498bd15e92ee25'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:16.722991 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1701/3396] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:26:16 2022] DELETE /identity/v3/users/da530920707d49139c498bd15e92ee25 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:26:18.153215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860e98e-3dd4-457e-be79-4b3dbb935f38 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:18.157588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5860e98e-3dd4-457e-be79-4b3dbb935f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:18.172448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860e98e-3dd4-457e-be79-4b3dbb935f38 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:18.241758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e99295-fb58-455e-b4ce-0b9d1356b04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:18.243852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e99295-fb58-455e-b4ce-0b9d1356b04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:18.244484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e99295-fb58-455e-b4ce-0b9d1356b04d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:18.244972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e99295-fb58-455e-b4ce-0b9d1356b04d admin admin] PATH_INFO: `/v3/projects/c58e55f2d96a41bbb23c78b83427bca4` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:18.247285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e99295-fb58-455e-b4ce-0b9d1356b04d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c58e55f2d96a41bbb23c78b83427bca4)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:18.250661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e99295-fb58-455e-b4ce-0b9d1356b04d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:18.479464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-03e99295-fb58-455e-b4ce-0b9d1356b04d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c58e55f2d96a41bbb23c78b83427bca4', 'request_id': 'req-03e99295-fb58-455e-b4ce-0b9d1356b04d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:18.580335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-03e99295-fb58-455e-b4ce-0b9d1356b04d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c58e55f2d96a41bbb23c78b83427bca4', 'request_id': 'req-03e99295-fb58-455e-b4ce-0b9d1356b04d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:18.590595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-03e99295-fb58-455e-b4ce-0b9d1356b04d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c58e55f2d96a41bbb23c78b83427bca4', 'request_id': 'req-03e99295-fb58-455e-b4ce-0b9d1356b04d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:18.632977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-03e99295-fb58-455e-b4ce-0b9d1356b04d admin admin] The token cache is being invalidate because project c58e55f2d96a41bbb23c78b83427bca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:26:18.633317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-03e99295-fb58-455e-b4ce-0b9d1356b04d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:18.636541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-03e99295-fb58-455e-b4ce-0b9d1356b04d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:18.646536 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1696/3397] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:26:18 2022] DELETE /identity/v3/projects/c58e55f2d96a41bbb23c78b83427bca4 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:26:18.659924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ca9d9-c1aa-48de-99a9-abee7bcc6b83 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:18.660480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ca9d9-c1aa-48de-99a9-abee7bcc6b83 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:18.660819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ca9d9-c1aa-48de-99a9-abee7bcc6b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:18.695819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7a7ca9d9-c1aa-48de-99a9-abee7bcc6b83 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:18.698768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7a7ca9d9-c1aa-48de-99a9-abee7bcc6b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:18.815493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ee167-7fd6-47a3-ab7b-5511b5074bdb None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:18.825055 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1702/3398] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:18.825340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ee167-7fd6-47a3-ab7b-5511b5074bdb None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:18.825340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ee167-7fd6-47a3-ab7b-5511b5074bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:18.878008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fb7ee167-7fd6-47a3-ab7b-5511b5074bdb None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:18.879732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fb7ee167-7fd6-47a3-ab7b-5511b5074bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:18.912385 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1697/3399] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:18.915527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ca9d9-c1aa-48de-99a9-abee7bcc6b83 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:18.927561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ca9d9-c1aa-48de-99a9-abee7bcc6b83 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:18.934472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35152afc-982e-40b3-b2b7-0f325aed0575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:18.935256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35152afc-982e-40b3-b2b7-0f325aed0575 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:18.935465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35152afc-982e-40b3-b2b7-0f325aed0575 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:18.935730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35152afc-982e-40b3-b2b7-0f325aed0575 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:18.936486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35152afc-982e-40b3-b2b7-0f325aed0575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:26:18.936890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35152afc-982e-40b3-b2b7-0f325aed0575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:18.939963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35152afc-982e-40b3-b2b7-0f325aed0575 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:18.957738 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1703/3400] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:26:18.962893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ee167-7fd6-47a3-ab7b-5511b5074bdb None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:18.980001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ee167-7fd6-47a3-ab7b-5511b5074bdb None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:18.987331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276d4d7-c9e2-4016-b75f-f56c0be2bbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:18.988027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276d4d7-c9e2-4016-b75f-f56c0be2bbb8 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:18.988317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276d4d7-c9e2-4016-b75f-f56c0be2bbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:18.988617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276d4d7-c9e2-4016-b75f-f56c0be2bbb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:18.989405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276d4d7-c9e2-4016-b75f-f56c0be2bbb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:18.991958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276d4d7-c9e2-4016-b75f-f56c0be2bbb8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:19.179732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35152afc-982e-40b3-b2b7-0f325aed0575 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:19.190763 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1698/3401] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:26:18 2022] POST /identity/v3/projects => generated 383 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:26:19.193262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35152afc-982e-40b3-b2b7-0f325aed0575 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:19.269200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92e358-82c5-4492-90e7-f81f33f1e240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:19.270466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92e358-82c5-4492-90e7-f81f33f1e240 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:19.270760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92e358-82c5-4492-90e7-f81f33f1e240 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:19.271138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92e358-82c5-4492-90e7-f81f33f1e240 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:19.271984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92e358-82c5-4492-90e7-f81f33f1e240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:19.274118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92e358-82c5-4492-90e7-f81f33f1e240 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:19.453398 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1704/3402] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:26:19 2022] POST /identity/v3/users => generated 292 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:26:19.458469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276d4d7-c9e2-4016-b75f-f56c0be2bbb8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:19.467573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276d4d7-c9e2-4016-b75f-f56c0be2bbb8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:19.482390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20111287-d9b3-4f71-b830-d6eac85e12e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:19.486978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20111287-d9b3-4f71-b830-d6eac85e12e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:19.486978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20111287-d9b3-4f71-b830-d6eac85e12e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:19.486978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20111287-d9b3-4f71-b830-d6eac85e12e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:19.486978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20111287-d9b3-4f71-b830-d6eac85e12e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:19.486978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20111287-d9b3-4f71-b830-d6eac85e12e5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:19.526894 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1699/3403] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:26:19.530103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92e358-82c5-4492-90e7-f81f33f1e240 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:19.548534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92e358-82c5-4492-90e7-f81f33f1e240 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:19.554432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9213859-de3e-47e1-ad2f-be42ccc40ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:19.555112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9213859-de3e-47e1-ad2f-be42ccc40ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:19.555399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9213859-de3e-47e1-ad2f-be42ccc40ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:19.555681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9213859-de3e-47e1-ad2f-be42ccc40ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:19.557003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9213859-de3e-47e1-ad2f-be42ccc40ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:19.558631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9213859-de3e-47e1-ad2f-be42ccc40ce0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:19.593216 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1705/3404] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:26:19.596021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20111287-d9b3-4f71-b830-d6eac85e12e5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:19.612247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20111287-d9b3-4f71-b830-d6eac85e12e5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:19.620154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752f363-a2f1-494e-a491-d9d87c6aaf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:19.621953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752f363-a2f1-494e-a491-d9d87c6aaf86 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:19.622344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752f363-a2f1-494e-a491-d9d87c6aaf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:19.622762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752f363-a2f1-494e-a491-d9d87c6aaf86 admin admin] PATH_INFO: `/v3/projects/50a567b2bd8247c9bc061502897d6e7e/users/3816b61af9864122a0b556581359f699/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:19.672312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752f363-a2f1-494e-a491-d9d87c6aaf86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a567b2bd8247c9bc061502897d6e7e, user_id=3816b61af9864122a0b556581359f699, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:19.697000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752f363-a2f1-494e-a491-d9d87c6aaf86 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:19.859284 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1700/3405] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:26:19 2022] PUT /identity/v3/projects/50a567b2bd8247c9bc061502897d6e7e/users/3816b61af9864122a0b556581359f699/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:26:19.869618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013a6e7-0e19-4960-9020-d0a930c366e2 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:19.875317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013a6e7-0e19-4960-9020-d0a930c366e2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:19.875317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013a6e7-0e19-4960-9020-d0a930c366e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:19.895913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9013a6e7-0e19-4960-9020-d0a930c366e2 None None] MFA Rules not processed for user `3816b61af9864122a0b556581359f699`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:19.897150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9013a6e7-0e19-4960-9020-d0a930c366e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:19.963115 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1706/3406] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:19.967498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752f363-a2f1-494e-a491-d9d87c6aaf86 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:20.036091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752f363-a2f1-494e-a491-d9d87c6aaf86 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:20.041362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1c634-1c9e-4b9f-b9ea-d6501e3dc1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:20.042308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1c634-1c9e-4b9f-b9ea-d6501e3dc1f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:20.042920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1c634-1c9e-4b9f-b9ea-d6501e3dc1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:20.043405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1c634-1c9e-4b9f-b9ea-d6501e3dc1f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:20.044360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1c634-1c9e-4b9f-b9ea-d6501e3dc1f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:20.046520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1c634-1c9e-4b9f-b9ea-d6501e3dc1f0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:20.167080 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1701/3407] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:26:19 2022] POST /identity/v3/projects => generated 381 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:26:20.168199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013a6e7-0e19-4960-9020-d0a930c366e2 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:20.178927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013a6e7-0e19-4960-9020-d0a930c366e2 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:20.237846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40d1ce-a01a-4eab-8d23-c7bab3ad315a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:20.238689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40d1ce-a01a-4eab-8d23-c7bab3ad315a admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:20.239066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40d1ce-a01a-4eab-8d23-c7bab3ad315a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:20.239420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40d1ce-a01a-4eab-8d23-c7bab3ad315a admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:20.240202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40d1ce-a01a-4eab-8d23-c7bab3ad315a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:20.242600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40d1ce-a01a-4eab-8d23-c7bab3ad315a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:20.344807 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1707/3408] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:26:20 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:26:20.347799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1c634-1c9e-4b9f-b9ea-d6501e3dc1f0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:20.358976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1c634-1c9e-4b9f-b9ea-d6501e3dc1f0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:20.365808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdd035-59fe-4691-b45e-bc61cb6b4574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:20.366940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdd035-59fe-4691-b45e-bc61cb6b4574 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:20.367560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdd035-59fe-4691-b45e-bc61cb6b4574 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:20.368035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdd035-59fe-4691-b45e-bc61cb6b4574 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:20.370010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdd035-59fe-4691-b45e-bc61cb6b4574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:20.371990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdd035-59fe-4691-b45e-bc61cb6b4574 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:20.385601 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1702/3409] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:26:20.389522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40d1ce-a01a-4eab-8d23-c7bab3ad315a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:20.400001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40d1ce-a01a-4eab-8d23-c7bab3ad315a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:20.430198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c840f-25e8-4ba6-ae2f-9f408210a6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:20.431848 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c840f-25e8-4ba6-ae2f-9f408210a6a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:20.432192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c840f-25e8-4ba6-ae2f-9f408210a6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:20.432678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c840f-25e8-4ba6-ae2f-9f408210a6a8 admin admin] PATH_INFO: `/v3/projects/f9a8b6ef10774a0597de62234e3b2680/users/ce997f812ef04dff853a3de6b0f45302/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:20.479883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c840f-25e8-4ba6-ae2f-9f408210a6a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a8b6ef10774a0597de62234e3b2680, user_id=ce997f812ef04dff853a3de6b0f45302, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:20.482734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c840f-25e8-4ba6-ae2f-9f408210a6a8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:20.572680 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1708/3410] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:26:20 2022] PUT /identity/v3/projects/f9a8b6ef10774a0597de62234e3b2680/users/ce997f812ef04dff853a3de6b0f45302/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:26:20.576765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdd035-59fe-4691-b45e-bc61cb6b4574 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:20.596529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdd035-59fe-4691-b45e-bc61cb6b4574 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:20.740415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c812af6-f288-4741-9b0a-424a7ac5309c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:20.741645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c812af6-f288-4741-9b0a-424a7ac5309c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:20.742098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c812af6-f288-4741-9b0a-424a7ac5309c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:20.742547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c812af6-f288-4741-9b0a-424a7ac5309c admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:20.743556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c812af6-f288-4741-9b0a-424a7ac5309c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:20.746393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c812af6-f288-4741-9b0a-424a7ac5309c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:20.765847 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1703/3411] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:26:20.767234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c840f-25e8-4ba6-ae2f-9f408210a6a8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:20.786942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c840f-25e8-4ba6-ae2f-9f408210a6a8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:20.801635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e7826-600f-4999-b486-89bff7ab328a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:20.803124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e7826-600f-4999-b486-89bff7ab328a admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:20.803451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e7826-600f-4999-b486-89bff7ab328a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:20.803732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e7826-600f-4999-b486-89bff7ab328a admin admin] PATH_INFO: `/v3/projects/f9a8b6ef10774a0597de62234e3b2680/users/ce997f812ef04dff853a3de6b0f45302/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:20.807361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e7826-600f-4999-b486-89bff7ab328a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a8b6ef10774a0597de62234e3b2680, user_id=ce997f812ef04dff853a3de6b0f45302, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:20.813270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e7826-600f-4999-b486-89bff7ab328a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:20.827913 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1709/3412] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:26:20 2022] PUT /identity/v3/projects/f9a8b6ef10774a0597de62234e3b2680/users/ce997f812ef04dff853a3de6b0f45302/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:26:20.840982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05470621-9d5d-4678-8985-dbd816df3740 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:20.841271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05470621-9d5d-4678-8985-dbd816df3740 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:20.841753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05470621-9d5d-4678-8985-dbd816df3740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:20.887086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-05470621-9d5d-4678-8985-dbd816df3740 None None] MFA Rules not processed for user `ce997f812ef04dff853a3de6b0f45302`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:20.897361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-05470621-9d5d-4678-8985-dbd816df3740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:21.012884 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1704/3413] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:21.018599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43dbf6-0ba4-41b3-91b4-158e4e9d25a2 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:21.019087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43dbf6-0ba4-41b3-91b4-158e4e9d25a2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:21.027045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43dbf6-0ba4-41b3-91b4-158e4e9d25a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:21.040248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2c43dbf6-0ba4-41b3-91b4-158e4e9d25a2 None None] MFA Rules not processed for user `3816b61af9864122a0b556581359f699`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:21.042409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2c43dbf6-0ba4-41b3-91b4-158e4e9d25a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:21.142319 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1710/3414] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:21.325460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05470621-9d5d-4678-8985-dbd816df3740 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:21.327350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-05470621-9d5d-4678-8985-dbd816df3740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:21.418195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05470621-9d5d-4678-8985-dbd816df3740 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:21.431849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da048d4-84b3-4e16-89ad-893cc51773a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:21.432742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da048d4-84b3-4e16-89ad-893cc51773a1 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:21.433098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da048d4-84b3-4e16-89ad-893cc51773a1 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:21.433485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da048d4-84b3-4e16-89ad-893cc51773a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:21.443676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da048d4-84b3-4e16-89ad-893cc51773a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:21.446087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da048d4-84b3-4e16-89ad-893cc51773a1 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:21.457501 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1705/3415] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:26:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:26:23.219610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19909409-af04-403f-9a0a-18006c273e2d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:23.220099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19909409-af04-403f-9a0a-18006c273e2d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:23.220831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19909409-af04-403f-9a0a-18006c273e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:23.244586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-19909409-af04-403f-9a0a-18006c273e2d None None] MFA Rules not processed for user `4249f4ad303744e88e5f01d339a762b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:23.246888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-19909409-af04-403f-9a0a-18006c273e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:23.343029 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1711/3416] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:24.978252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07544180-9027-4a5b-b88f-cc314ecf3fdc None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:24.979124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07544180-9027-4a5b-b88f-cc314ecf3fdc None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:24.979569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07544180-9027-4a5b-b88f-cc314ecf3fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:25.082454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-07544180-9027-4a5b-b88f-cc314ecf3fdc None None] MFA Rules not processed for user `1cf4f9c1eeb94bff96fa42d2f20d805f`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:25.085542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-07544180-9027-4a5b-b88f-cc314ecf3fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:25.232003 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1706/3417] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:28.710281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19909409-af04-403f-9a0a-18006c273e2d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:28.753618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19909409-af04-403f-9a0a-18006c273e2d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:28.781943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5159842-f204-40f4-ac27-fae79edcadc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:28.782625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5159842-f204-40f4-ac27-fae79edcadc0 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:28.783425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5159842-f204-40f4-ac27-fae79edcadc0 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:28.784047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5159842-f204-40f4-ac27-fae79edcadc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:28.793507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e5159842-f204-40f4-ac27-fae79edcadc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:28.896105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5159842-f204-40f4-ac27-fae79edcadc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:28.899110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5159842-f204-40f4-ac27-fae79edcadc0 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:28.927644 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1712/3418] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:26:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:26:28.947308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3fcc9-5c3e-40bf-8fef-7fe2ba33927f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:28.947796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3fcc9-5c3e-40bf-8fef-7fe2ba33927f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:28.947883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3fcc9-5c3e-40bf-8fef-7fe2ba33927f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:28.986308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-77c3fcc9-5c3e-40bf-8fef-7fe2ba33927f None None] MFA Rules not processed for user `fbe5b02f3089419b9eeb2d52b673e1fd`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:28.987546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-77c3fcc9-5c3e-40bf-8fef-7fe2ba33927f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:29.116245 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1707/3419] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:31.657016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fd721-1212-47d2-a296-af3e77a02b1e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:31.658043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fd721-1212-47d2-a296-af3e77a02b1e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:31.658488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fd721-1212-47d2-a296-af3e77a02b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:31.685420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-641fd721-1212-47d2-a296-af3e77a02b1e None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:31.688322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-641fd721-1212-47d2-a296-af3e77a02b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:31.792526 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1713/3420] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:26:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:31.842457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3fcc9-5c3e-40bf-8fef-7fe2ba33927f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:31.844960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-77c3fcc9-5c3e-40bf-8fef-7fe2ba33927f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:32.003700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3fcc9-5c3e-40bf-8fef-7fe2ba33927f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:32.017977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa850eb-4e13-4295-9a9c-eef62f1dc84a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:32.018708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa850eb-4e13-4295-9a9c-eef62f1dc84a service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:32.018964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa850eb-4e13-4295-9a9c-eef62f1dc84a service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:32.019251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa850eb-4e13-4295-9a9c-eef62f1dc84a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:32.033595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa850eb-4e13-4295-9a9c-eef62f1dc84a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:32.035870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa850eb-4e13-4295-9a9c-eef62f1dc84a service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:32.047631 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1708/3421] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:26:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:26:38.634931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fd721-1212-47d2-a296-af3e77a02b1e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:38.636980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-641fd721-1212-47d2-a296-af3e77a02b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:38.767782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fd721-1212-47d2-a296-af3e77a02b1e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:38.775739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e84ebc-9335-4e69-9ea7-ec2ee4862bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:38.786116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e84ebc-9335-4e69-9ea7-ec2ee4862bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:38.789020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e84ebc-9335-4e69-9ea7-ec2ee4862bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:38.792072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e84ebc-9335-4e69-9ea7-ec2ee4862bbc admin admin] PATH_INFO: `/v3/users/028fdab3374e47248ce395b4257f9d17` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:38.794245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e84ebc-9335-4e69-9ea7-ec2ee4862bbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=028fdab3374e47248ce395b4257f9d17)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:38.801013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e84ebc-9335-4e69-9ea7-ec2ee4862bbc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:39.122942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-55e84ebc-9335-4e69-9ea7-ec2ee4862bbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '028fdab3374e47248ce395b4257f9d17'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:39.152748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-55e84ebc-9335-4e69-9ea7-ec2ee4862bbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '028fdab3374e47248ce395b4257f9d17'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:39.154198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-55e84ebc-9335-4e69-9ea7-ec2ee4862bbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '028fdab3374e47248ce395b4257f9d17'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:39.173304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-55e84ebc-9335-4e69-9ea7-ec2ee4862bbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '028fdab3374e47248ce395b4257f9d17'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:39.250606 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-55e84ebc-9335-4e69-9ea7-ec2ee4862bbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '028fdab3374e47248ce395b4257f9d17'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:39.264452 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1714/3422] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:26:38 2022] DELETE /identity/v3/users/028fdab3374e47248ce395b4257f9d17 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:26:39.269177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6f200-1b49-4a02-9758-e61e7a4f7420 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:39.269644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6f200-1b49-4a02-9758-e61e7a4f7420 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:39.269925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6f200-1b49-4a02-9758-e61e7a4f7420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:39.296144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-dee6f200-1b49-4a02-9758-e61e7a4f7420 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:39.297607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dee6f200-1b49-4a02-9758-e61e7a4f7420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:39.419175 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1709/3423] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:39.453784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e84ebc-9335-4e69-9ea7-ec2ee4862bbc admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:39.455559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-55e84ebc-9335-4e69-9ea7-ec2ee4862bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:39.556130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e84ebc-9335-4e69-9ea7-ec2ee4862bbc admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:39.570423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf13952-756a-42e1-8b69-fa6316aab244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:39.570423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf13952-756a-42e1-8b69-fa6316aab244 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:39.570423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf13952-756a-42e1-8b69-fa6316aab244 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:39.570423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf13952-756a-42e1-8b69-fa6316aab244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:39.597879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf13952-756a-42e1-8b69-fa6316aab244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:39.603406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf13952-756a-42e1-8b69-fa6316aab244 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:39.624729 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1715/3424] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:26:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:26:40.118411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6f200-1b49-4a02-9758-e61e7a4f7420 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:40.119953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dee6f200-1b49-4a02-9758-e61e7a4f7420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:40.143674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6f200-1b49-4a02-9758-e61e7a4f7420 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:40.156390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df249ddf-e2c8-4d7d-a635-c59e634834b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:40.157377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df249ddf-e2c8-4d7d-a635-c59e634834b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:40.157740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df249ddf-e2c8-4d7d-a635-c59e634834b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:40.157979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df249ddf-e2c8-4d7d-a635-c59e634834b0 admin admin] PATH_INFO: `/v3/projects/95b79dc0085c42dbbd93bedcf2d84079` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:40.161225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df249ddf-e2c8-4d7d-a635-c59e634834b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95b79dc0085c42dbbd93bedcf2d84079)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:40.165465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df249ddf-e2c8-4d7d-a635-c59e634834b0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:40.354345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-df249ddf-e2c8-4d7d-a635-c59e634834b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95b79dc0085c42dbbd93bedcf2d84079', 'request_id': 'req-df249ddf-e2c8-4d7d-a635-c59e634834b0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:40.416030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-df249ddf-e2c8-4d7d-a635-c59e634834b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95b79dc0085c42dbbd93bedcf2d84079', 'request_id': 'req-df249ddf-e2c8-4d7d-a635-c59e634834b0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:40.423854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-df249ddf-e2c8-4d7d-a635-c59e634834b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95b79dc0085c42dbbd93bedcf2d84079', 'request_id': 'req-df249ddf-e2c8-4d7d-a635-c59e634834b0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:40.452425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-df249ddf-e2c8-4d7d-a635-c59e634834b0 admin admin] The token cache is being invalidate because project 95b79dc0085c42dbbd93bedcf2d84079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:26:40.452747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-df249ddf-e2c8-4d7d-a635-c59e634834b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:40.453434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-df249ddf-e2c8-4d7d-a635-c59e634834b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:26:40.457360 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1710/3425] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:26:40 2022] DELETE /identity/v3/projects/95b79dc0085c42dbbd93bedcf2d84079 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:26:40.463784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf390c-d925-4629-8315-f7d6c13713f8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:40.464277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf390c-d925-4629-8315-f7d6c13713f8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:40.464707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf390c-d925-4629-8315-f7d6c13713f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:40.518921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3baf390c-d925-4629-8315-f7d6c13713f8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:40.520380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3baf390c-d925-4629-8315-f7d6c13713f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:40.694176 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1716/3426] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:40.696138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20025c-bf9e-4e3b-94f6-607c457afbd5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:40.696594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20025c-bf9e-4e3b-94f6-607c457afbd5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:40.697395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20025c-bf9e-4e3b-94f6-607c457afbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:40.734778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9d20025c-bf9e-4e3b-94f6-607c457afbd5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:40.736118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9d20025c-bf9e-4e3b-94f6-607c457afbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:40.766143 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1711/3427] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:40.766980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf390c-d925-4629-8315-f7d6c13713f8 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:40.784189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf390c-d925-4629-8315-f7d6c13713f8 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:40.795470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddc4d8-79d4-4a90-af81-1825c77532ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:40.796377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddc4d8-79d4-4a90-af81-1825c77532ab admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:40.797138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddc4d8-79d4-4a90-af81-1825c77532ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:40.798914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddc4d8-79d4-4a90-af81-1825c77532ab admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:40.802411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaddc4d8-79d4-4a90-af81-1825c77532ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:26:40.802843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaddc4d8-79d4-4a90-af81-1825c77532ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:40.812070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaddc4d8-79d4-4a90-af81-1825c77532ab admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:40.846328 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1717/3428] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:26:40.851024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20025c-bf9e-4e3b-94f6-607c457afbd5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:40.868952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20025c-bf9e-4e3b-94f6-607c457afbd5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:40.879228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5c44e-899b-48cc-82b6-83546fbecbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:40.880168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5c44e-899b-48cc-82b6-83546fbecbb1 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:40.880656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5c44e-899b-48cc-82b6-83546fbecbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:40.882839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5c44e-899b-48cc-82b6-83546fbecbb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:40.883895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5c44e-899b-48cc-82b6-83546fbecbb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:40.887848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5c44e-899b-48cc-82b6-83546fbecbb1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:41.013274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddc4d8-79d4-4a90-af81-1825c77532ab admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:41.014033 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1712/3429] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:26:40 2022] POST /identity/v3/projects => generated 369 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:26:41.025567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddc4d8-79d4-4a90-af81-1825c77532ab admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:41.155895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ee30b-b173-4542-97eb-f91e9237acf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:41.157825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ee30b-b173-4542-97eb-f91e9237acf2 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:41.158648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ee30b-b173-4542-97eb-f91e9237acf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:41.158935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ee30b-b173-4542-97eb-f91e9237acf2 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:41.159980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ee30b-b173-4542-97eb-f91e9237acf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:41.162260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ee30b-b173-4542-97eb-f91e9237acf2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:41.267058 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1718/3430] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:26:41 2022] POST /identity/v3/users => generated 285 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:26:41.271044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5c44e-899b-48cc-82b6-83546fbecbb1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:41.288488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5c44e-899b-48cc-82b6-83546fbecbb1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:41.308384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4c9ec-ba70-468a-8a01-a5f225096750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:41.308811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4c9ec-ba70-468a-8a01-a5f225096750 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:41.309095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4c9ec-ba70-468a-8a01-a5f225096750 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:41.309374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4c9ec-ba70-468a-8a01-a5f225096750 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:41.310112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4c9ec-ba70-468a-8a01-a5f225096750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:41.325357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4c9ec-ba70-468a-8a01-a5f225096750 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:41.350295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ee30b-b173-4542-97eb-f91e9237acf2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:41.357053 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1713/3431] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:26:41.361283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ee30b-b173-4542-97eb-f91e9237acf2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:41.366683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cb89c-8f11-4b35-b6c5-4ed89979ac22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:41.368129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cb89c-8f11-4b35-b6c5-4ed89979ac22 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:41.368569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cb89c-8f11-4b35-b6c5-4ed89979ac22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:41.369034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cb89c-8f11-4b35-b6c5-4ed89979ac22 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:41.369940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cb89c-8f11-4b35-b6c5-4ed89979ac22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:41.371778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cb89c-8f11-4b35-b6c5-4ed89979ac22 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:41.385946 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1719/3432] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:26:41.390797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4c9ec-ba70-468a-8a01-a5f225096750 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:41.402474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4c9ec-ba70-468a-8a01-a5f225096750 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:41.407668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc6181-3e25-4aac-9001-0218216a9562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:41.408562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc6181-3e25-4aac-9001-0218216a9562 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:41.408882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc6181-3e25-4aac-9001-0218216a9562 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:41.409326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc6181-3e25-4aac-9001-0218216a9562 admin admin] PATH_INFO: `/v3/projects/ed36dcd8895a4ac5b50bc12ce5b17048/users/5c68b3ca4d28460086ac24784cc48134/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:41.428335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc6181-3e25-4aac-9001-0218216a9562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed36dcd8895a4ac5b50bc12ce5b17048, user_id=5c68b3ca4d28460086ac24784cc48134, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:41.441342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc6181-3e25-4aac-9001-0218216a9562 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:41.547267 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1714/3433] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:26:41 2022] PUT /identity/v3/projects/ed36dcd8895a4ac5b50bc12ce5b17048/users/5c68b3ca4d28460086ac24784cc48134/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:26:41.558481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47f3bd-99b2-4cf5-bb95-44f8193cd615 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:41.558948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47f3bd-99b2-4cf5-bb95-44f8193cd615 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:41.559050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47f3bd-99b2-4cf5-bb95-44f8193cd615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:41.607360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5c47f3bd-99b2-4cf5-bb95-44f8193cd615 None None] MFA Rules not processed for user `5c68b3ca4d28460086ac24784cc48134`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:41.608903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5c47f3bd-99b2-4cf5-bb95-44f8193cd615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:41.734624 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1720/3434] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:26:41.740977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc6181-3e25-4aac-9001-0218216a9562 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:41.742828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-44dc6181-3e25-4aac-9001-0218216a9562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:41.867979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47f3bd-99b2-4cf5-bb95-44f8193cd615 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:41.869750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5c47f3bd-99b2-4cf5-bb95-44f8193cd615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:41.884319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc6181-3e25-4aac-9001-0218216a9562 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:41.890640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5309e1-8be7-4dc1-94b4-d1d1d3e9d368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:41.891472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5309e1-8be7-4dc1-94b4-d1d1d3e9d368 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:41.891869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5309e1-8be7-4dc1-94b4-d1d1d3e9d368 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:41.892416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5309e1-8be7-4dc1-94b4-d1d1d3e9d368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:41.904372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5309e1-8be7-4dc1-94b4-d1d1d3e9d368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:41.906470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5309e1-8be7-4dc1-94b4-d1d1d3e9d368 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:41.920918 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1715/3435] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:26:41 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:26:42.017249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47f3bd-99b2-4cf5-bb95-44f8193cd615 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:42.023505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d432a-3ee9-416f-a449-e649e1989080 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:42.024200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d432a-3ee9-416f-a449-e649e1989080 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:42.024494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d432a-3ee9-416f-a449-e649e1989080 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:42.024804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d432a-3ee9-416f-a449-e649e1989080 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:42.026812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c94d432a-3ee9-416f-a449-e649e1989080 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:42.136840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d432a-3ee9-416f-a449-e649e1989080 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:42.139484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d432a-3ee9-416f-a449-e649e1989080 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:42.153095 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1721/3436] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:26:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:26:42.998039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e59d7-df06-49c1-a352-38f1bd95324d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:42.998635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e59d7-df06-49c1-a352-38f1bd95324d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:42.998635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e59d7-df06-49c1-a352-38f1bd95324d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:43.033194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-209e59d7-df06-49c1-a352-38f1bd95324d None None] MFA Rules not processed for user `3816b61af9864122a0b556581359f699`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:43.035724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-209e59d7-df06-49c1-a352-38f1bd95324d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:43.117436 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1716/3437] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:44.760548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efd0c2-dc0c-4988-b6e9-593cc475e8fd None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:44.762175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efd0c2-dc0c-4988-b6e9-593cc475e8fd None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:44.762703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efd0c2-dc0c-4988-b6e9-593cc475e8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:44.808880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e6efd0c2-dc0c-4988-b6e9-593cc475e8fd None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:44.810580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e6efd0c2-dc0c-4988-b6e9-593cc475e8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:44.948386 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1722/3438] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:26:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:44.961105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e59d7-df06-49c1-a352-38f1bd95324d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:44.962598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-209e59d7-df06-49c1-a352-38f1bd95324d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:45.125844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e59d7-df06-49c1-a352-38f1bd95324d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:45.132801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4f35a-d636-4680-86dd-2b86424db3a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:45.134561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4f35a-d636-4680-86dd-2b86424db3a7 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:45.135196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4f35a-d636-4680-86dd-2b86424db3a7 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:45.135641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4f35a-d636-4680-86dd-2b86424db3a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:45.146611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4f35a-d636-4680-86dd-2b86424db3a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:45.148236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4f35a-d636-4680-86dd-2b86424db3a7 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:45.187131 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1717/3439] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:26:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:26:46.261565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0708d1-d6ae-4d47-b53a-86a866979a41 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:46.262138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0708d1-d6ae-4d47-b53a-86a866979a41 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:46.262608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0708d1-d6ae-4d47-b53a-86a866979a41 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:46.264267 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1723/3440] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:26:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:26:46.274384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987f508-364b-46c3-883b-54bbfe4fd561 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:46.275325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987f508-364b-46c3-883b-54bbfe4fd561 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:46.275839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987f508-364b-46c3-883b-54bbfe4fd561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:46.320545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c987f508-364b-46c3-883b-54bbfe4fd561 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:46.322494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c987f508-364b-46c3-883b-54bbfe4fd561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:46.447541 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1718/3441] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:26:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:26:46.482192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0708d1-d6ae-4d47-b53a-86a866979a41 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:46.484912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fb0708d1-d6ae-4d47-b53a-86a866979a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:46.510746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0708d1-d6ae-4d47-b53a-86a866979a41 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:46.517582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fb7ee-1d85-416c-a212-dd81e389a63f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:46.518643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fb7ee-1d85-416c-a212-dd81e389a63f service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:46.519272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fb7ee-1d85-416c-a212-dd81e389a63f service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:46.519759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fb7ee-1d85-416c-a212-dd81e389a63f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:46.531493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67fb7ee-1d85-416c-a212-dd81e389a63f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:46.548308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67fb7ee-1d85-416c-a212-dd81e389a63f service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:46.561361 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1724/3442] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:26:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:26:51.168326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbf10d-56e1-4a58-88ab-c2d7064cc9de None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:51.168922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbf10d-56e1-4a58-88ab-c2d7064cc9de None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:51.169553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbf10d-56e1-4a58-88ab-c2d7064cc9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:51.209777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-11fbf10d-56e1-4a58-88ab-c2d7064cc9de None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:51.211581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-11fbf10d-56e1-4a58-88ab-c2d7064cc9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:51.226291 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1719/3443] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:26:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:26:51.268190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fb7ee-1d85-416c-a212-dd81e389a63f service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:26:51.280715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fb7ee-1d85-416c-a212-dd81e389a63f service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:26:51.286788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdce55-a1b4-418b-bfa1-e249600b6606 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:26:51.287279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdce55-a1b4-418b-bfa1-e249600b6606 service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:51.287579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdce55-a1b4-418b-bfa1-e249600b6606 service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:51.287858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdce55-a1b4-418b-bfa1-e249600b6606 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:51.297492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cdce55-a1b4-418b-bfa1-e249600b6606 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:26:51.299107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cdce55-a1b4-418b-bfa1-e249600b6606 service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:26:51.308274 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1725/3444] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:26:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:26:54.119131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cc1d6-3d22-401a-b4aa-cf6788d7f043 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:26:54.119962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cc1d6-3d22-401a-b4aa-cf6788d7f043 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:26:54.120253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cc1d6-3d22-401a-b4aa-cf6788d7f043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:26:54.173431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ce9cc1d6-3d22-401a-b4aa-cf6788d7f043 None None] MFA Rules not processed for user `e83fd687fcc74495a7ea73f0e001419b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:26:54.174957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ce9cc1d6-3d22-401a-b4aa-cf6788d7f043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:26:54.372401 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1720/3445] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:26:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:27:12.009684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ba773-79cf-413a-a752-e224fd275730 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:12.010686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ba773-79cf-413a-a752-e224fd275730 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:12.011334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ba773-79cf-413a-a752-e224fd275730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:12.031124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-fd1ba773-79cf-413a-a752-e224fd275730 None None] MFA Rules not processed for user `3816b61af9864122a0b556581359f699`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:12.032339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fd1ba773-79cf-413a-a752-e224fd275730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:12.040443 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1726/3446] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:27:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:27:12.501129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cc1d6-3d22-401a-b4aa-cf6788d7f043 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:12.503201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ce9cc1d6-3d22-401a-b4aa-cf6788d7f043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:12.607245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cc1d6-3d22-401a-b4aa-cf6788d7f043 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:12.612085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a55431-faf9-409a-a580-6f94a8edae11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:12.613036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a55431-faf9-409a-a580-6f94a8edae11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:12.613317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a55431-faf9-409a-a580-6f94a8edae11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:12.613788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a55431-faf9-409a-a580-6f94a8edae11 admin admin] PATH_INFO: `/v3/users/fbe5b02f3089419b9eeb2d52b673e1fd` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:12.615007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a55431-faf9-409a-a580-6f94a8edae11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbe5b02f3089419b9eeb2d52b673e1fd)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:12.616977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a55431-faf9-409a-a580-6f94a8edae11 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:12.709269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29d775-a0db-4b5e-965a-6e9384a6d64a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:12.709661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29d775-a0db-4b5e-965a-6e9384a6d64a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:12.710033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29d775-a0db-4b5e-965a-6e9384a6d64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:12.730964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ac29d775-a0db-4b5e-965a-6e9384a6d64a None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:12.743560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ac29d775-a0db-4b5e-965a-6e9384a6d64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:12.743560 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1727/3447] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:27:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:27:12.753406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29d775-a0db-4b5e-965a-6e9384a6d64a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:12.766231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29d775-a0db-4b5e-965a-6e9384a6d64a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:12.775290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c5454-4f6f-48e7-910f-70cfb9284e60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:12.775290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c5454-4f6f-48e7-910f-70cfb9284e60 service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:12.775290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c5454-4f6f-48e7-910f-70cfb9284e60 service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:12.775290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c5454-4f6f-48e7-910f-70cfb9284e60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:12.781963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c5454-4f6f-48e7-910f-70cfb9284e60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:12.783611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c5454-4f6f-48e7-910f-70cfb9284e60 service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:12.795182 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1728/3448] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:27:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 02 10:27:12.838836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e1a55431-faf9-409a-a580-6f94a8edae11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe5b02f3089419b9eeb2d52b673e1fd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:12.851761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e1a55431-faf9-409a-a580-6f94a8edae11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe5b02f3089419b9eeb2d52b673e1fd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:12.852515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e1a55431-faf9-409a-a580-6f94a8edae11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe5b02f3089419b9eeb2d52b673e1fd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:12.859359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e1a55431-faf9-409a-a580-6f94a8edae11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe5b02f3089419b9eeb2d52b673e1fd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:12.948461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e1a55431-faf9-409a-a580-6f94a8edae11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe5b02f3089419b9eeb2d52b673e1fd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:12.958135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdce2eb-e55e-4298-9601-c8d98b7982a5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:12.958978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdce2eb-e55e-4298-9601-c8d98b7982a5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:12.959423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdce2eb-e55e-4298-9601-c8d98b7982a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:12.961632 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1721/3449] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:27:12 2022] DELETE /identity/v3/users/fbe5b02f3089419b9eeb2d52b673e1fd => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:27:12.980772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-dcdce2eb-e55e-4298-9601-c8d98b7982a5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:12.982217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-dcdce2eb-e55e-4298-9601-c8d98b7982a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:13.107039 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1729/3450] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:27:13.117060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a55431-faf9-409a-a580-6f94a8edae11 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:13.119041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e1a55431-faf9-409a-a580-6f94a8edae11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:13.259302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a55431-faf9-409a-a580-6f94a8edae11 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:13.273343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd7c04-757c-4955-83a2-84a08dd2749e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:13.277209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd7c04-757c-4955-83a2-84a08dd2749e service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:13.277209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd7c04-757c-4955-83a2-84a08dd2749e service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:13.277209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd7c04-757c-4955-83a2-84a08dd2749e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:13.325339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd7c04-757c-4955-83a2-84a08dd2749e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:13.329696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd7c04-757c-4955-83a2-84a08dd2749e service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:13.348486 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1722/3451] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:27:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:27:13.924089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdce2eb-e55e-4298-9601-c8d98b7982a5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:13.926021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-dcdce2eb-e55e-4298-9601-c8d98b7982a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:13.954811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdce2eb-e55e-4298-9601-c8d98b7982a5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:13.961363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a1548-779d-474f-baca-0c80be73dcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:13.970868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a1548-779d-474f-baca-0c80be73dcad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:13.971515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a1548-779d-474f-baca-0c80be73dcad admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:13.985551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a1548-779d-474f-baca-0c80be73dcad admin admin] PATH_INFO: `/v3/projects/e9bce7a6faeb4a9693c73a4fd0b12d9c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:13.989642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a1548-779d-474f-baca-0c80be73dcad admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9bce7a6faeb4a9693c73a4fd0b12d9c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:13.991260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a1548-779d-474f-baca-0c80be73dcad admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:14.185402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-903a1548-779d-474f-baca-0c80be73dcad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9bce7a6faeb4a9693c73a4fd0b12d9c', 'request_id': 'req-903a1548-779d-474f-baca-0c80be73dcad'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:14.205846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-903a1548-779d-474f-baca-0c80be73dcad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9bce7a6faeb4a9693c73a4fd0b12d9c', 'request_id': 'req-903a1548-779d-474f-baca-0c80be73dcad'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:14.308164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-903a1548-779d-474f-baca-0c80be73dcad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9bce7a6faeb4a9693c73a4fd0b12d9c', 'request_id': 'req-903a1548-779d-474f-baca-0c80be73dcad'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:14.337786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-903a1548-779d-474f-baca-0c80be73dcad admin admin] The token cache is being invalidate because project e9bce7a6faeb4a9693c73a4fd0b12d9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:27:14.338460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-903a1548-779d-474f-baca-0c80be73dcad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:14.340820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-903a1548-779d-474f-baca-0c80be73dcad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:14.344738 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1730/3452] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:27:13 2022] DELETE /identity/v3/projects/e9bce7a6faeb4a9693c73a4fd0b12d9c => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:27:14.348676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd7c04-757c-4955-83a2-84a08dd2749e service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:14.360100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd7c04-757c-4955-83a2-84a08dd2749e service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:14.436679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db2b94-a6dd-4e9a-beb9-706666613a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:14.437858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db2b94-a6dd-4e9a-beb9-706666613a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:14.438341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db2b94-a6dd-4e9a-beb9-706666613a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:14.438782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db2b94-a6dd-4e9a-beb9-706666613a90 admin admin] PATH_INFO: `/v3/users/ae9a9efbf9a44d66b2384dd30ba43a5b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:14.440444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db2b94-a6dd-4e9a-beb9-706666613a90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae9a9efbf9a44d66b2384dd30ba43a5b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:14.442720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db2b94-a6dd-4e9a-beb9-706666613a90 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:14.690422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74db2b94-a6dd-4e9a-beb9-706666613a90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae9a9efbf9a44d66b2384dd30ba43a5b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:14.704260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74db2b94-a6dd-4e9a-beb9-706666613a90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae9a9efbf9a44d66b2384dd30ba43a5b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:14.708262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74db2b94-a6dd-4e9a-beb9-706666613a90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae9a9efbf9a44d66b2384dd30ba43a5b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:14.723099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74db2b94-a6dd-4e9a-beb9-706666613a90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae9a9efbf9a44d66b2384dd30ba43a5b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:14.845960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74db2b94-a6dd-4e9a-beb9-706666613a90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae9a9efbf9a44d66b2384dd30ba43a5b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:14.863849 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1723/3453] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:27:14 2022] DELETE /identity/v3/users/ae9a9efbf9a44d66b2384dd30ba43a5b => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:27:15.363034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a1548-779d-474f-baca-0c80be73dcad admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:15.364569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-903a1548-779d-474f-baca-0c80be73dcad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:15.389375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a1548-779d-474f-baca-0c80be73dcad admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:15.480982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f47fc0-0551-49bf-b692-58a3514daf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:15.482320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f47fc0-0551-49bf-b692-58a3514daf36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:15.482709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f47fc0-0551-49bf-b692-58a3514daf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:15.482994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f47fc0-0551-49bf-b692-58a3514daf36 admin admin] PATH_INFO: `/v3/projects/ec7cfa22136249b982910864ad486f74` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:15.484211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f47fc0-0551-49bf-b692-58a3514daf36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec7cfa22136249b982910864ad486f74)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:15.486212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f47fc0-0551-49bf-b692-58a3514daf36 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:15.644084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b7f47fc0-0551-49bf-b692-58a3514daf36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec7cfa22136249b982910864ad486f74', 'request_id': 'req-b7f47fc0-0551-49bf-b692-58a3514daf36'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:15.681136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b7f47fc0-0551-49bf-b692-58a3514daf36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec7cfa22136249b982910864ad486f74', 'request_id': 'req-b7f47fc0-0551-49bf-b692-58a3514daf36'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:15.817405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b7f47fc0-0551-49bf-b692-58a3514daf36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec7cfa22136249b982910864ad486f74', 'request_id': 'req-b7f47fc0-0551-49bf-b692-58a3514daf36'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:15.838579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b7f47fc0-0551-49bf-b692-58a3514daf36 admin admin] The token cache is being invalidate because project ec7cfa22136249b982910864ad486f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:27:15.839053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b7f47fc0-0551-49bf-b692-58a3514daf36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:15.840379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b7f47fc0-0551-49bf-b692-58a3514daf36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:15.846662 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1731/3454] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:27:15 2022] DELETE /identity/v3/projects/ec7cfa22136249b982910864ad486f74 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:27:15.849288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec9391-f5cd-4e98-a451-ffd2fffd4822 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:15.855980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec9391-f5cd-4e98-a451-ffd2fffd4822 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:15.859173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec9391-f5cd-4e98-a451-ffd2fffd4822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:15.949977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0cec9391-f5cd-4e98-a451-ffd2fffd4822 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:15.951222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0cec9391-f5cd-4e98-a451-ffd2fffd4822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:16.052677 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1724/3455] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:27:16.071557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4e00-3bdf-453a-92ce-672b416f3007 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:16.072045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4e00-3bdf-453a-92ce-672b416f3007 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:16.072430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4e00-3bdf-453a-92ce-672b416f3007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:16.128503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-cf3a4e00-3bdf-453a-92ce-672b416f3007 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:16.140038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cf3a4e00-3bdf-453a-92ce-672b416f3007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:16.164093 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1732/3456] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:27:16.170806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec9391-f5cd-4e98-a451-ffd2fffd4822 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:16.184092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec9391-f5cd-4e98-a451-ffd2fffd4822 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:16.199314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6a7ba-aa6f-470e-a289-3cbe001b255c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:16.200238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6a7ba-aa6f-470e-a289-3cbe001b255c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:16.200735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6a7ba-aa6f-470e-a289-3cbe001b255c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:16.201193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6a7ba-aa6f-470e-a289-3cbe001b255c admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:16.202305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6a7ba-aa6f-470e-a289-3cbe001b255c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:27:16.202840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6a7ba-aa6f-470e-a289-3cbe001b255c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:16.204782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6a7ba-aa6f-470e-a289-3cbe001b255c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:16.255037 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1725/3457] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:27:16.259669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a4e00-3bdf-453a-92ce-672b416f3007 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:16.275028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a4e00-3bdf-453a-92ce-672b416f3007 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:16.290299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dad1a0-33bb-4fc0-9839-7e8f571b0e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:16.296472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dad1a0-33bb-4fc0-9839-7e8f571b0e6e admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:16.296472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dad1a0-33bb-4fc0-9839-7e8f571b0e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:16.296472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dad1a0-33bb-4fc0-9839-7e8f571b0e6e admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:16.296472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dad1a0-33bb-4fc0-9839-7e8f571b0e6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:16.301119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dad1a0-33bb-4fc0-9839-7e8f571b0e6e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:16.458699 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1733/3458] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:27:16 2022] POST /identity/v3/projects => generated 401 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:27:16.463016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6a7ba-aa6f-470e-a289-3cbe001b255c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:16.486156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6a7ba-aa6f-470e-a289-3cbe001b255c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:16.592562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2d26c-9115-4de8-9609-69c9c6f43020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:16.593658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2d26c-9115-4de8-9609-69c9c6f43020 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:16.594062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2d26c-9115-4de8-9609-69c9c6f43020 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:16.595611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2d26c-9115-4de8-9609-69c9c6f43020 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:16.596509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2d26c-9115-4de8-9609-69c9c6f43020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:16.599687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2d26c-9115-4de8-9609-69c9c6f43020 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:16.755857 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1726/3459] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:27:16 2022] POST /identity/v3/users => generated 301 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:27:16.756753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dad1a0-33bb-4fc0-9839-7e8f571b0e6e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:16.782082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dad1a0-33bb-4fc0-9839-7e8f571b0e6e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:16.796716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca0df4-5ed3-441c-9bff-ecc7a96cbc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:16.798956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca0df4-5ed3-441c-9bff-ecc7a96cbc64 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:16.801635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca0df4-5ed3-441c-9bff-ecc7a96cbc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:16.802189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca0df4-5ed3-441c-9bff-ecc7a96cbc64 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:16.803522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca0df4-5ed3-441c-9bff-ecc7a96cbc64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:16.807316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca0df4-5ed3-441c-9bff-ecc7a96cbc64 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:16.833414 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1734/3460] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:27:16.839635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2d26c-9115-4de8-9609-69c9c6f43020 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:16.875630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2d26c-9115-4de8-9609-69c9c6f43020 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:16.885111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3562b1-e908-4489-a7b4-9fbbb8c7497e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:16.887814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3562b1-e908-4489-a7b4-9fbbb8c7497e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:16.888585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3562b1-e908-4489-a7b4-9fbbb8c7497e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:16.889290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3562b1-e908-4489-a7b4-9fbbb8c7497e admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:16.890230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3562b1-e908-4489-a7b4-9fbbb8c7497e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:16.892963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3562b1-e908-4489-a7b4-9fbbb8c7497e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:16.908012 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1727/3461] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:27:16.912699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca0df4-5ed3-441c-9bff-ecc7a96cbc64 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:16.925959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca0df4-5ed3-441c-9bff-ecc7a96cbc64 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:16.935666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38703875-2ba8-424a-a022-bb4d9c0e12eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:16.938354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38703875-2ba8-424a-a022-bb4d9c0e12eb admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:16.938354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38703875-2ba8-424a-a022-bb4d9c0e12eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:16.938354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38703875-2ba8-424a-a022-bb4d9c0e12eb admin admin] PATH_INFO: `/v3/projects/d645dcffcd6245bab866d580dbd32540/users/5f0c7b8acf7743fc8cd3aeae1a8dc26d/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:16.993546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38703875-2ba8-424a-a022-bb4d9c0e12eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d645dcffcd6245bab866d580dbd32540, user_id=5f0c7b8acf7743fc8cd3aeae1a8dc26d, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:16.997040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38703875-2ba8-424a-a022-bb4d9c0e12eb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:17.110732 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1735/3462] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:27:16 2022] PUT /identity/v3/projects/d645dcffcd6245bab866d580dbd32540/users/5f0c7b8acf7743fc8cd3aeae1a8dc26d/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:27:17.121856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca0a47-e575-432b-b905-30d407e8e6a0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:17.126819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca0a47-e575-432b-b905-30d407e8e6a0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:17.127108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca0a47-e575-432b-b905-30d407e8e6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:17.199305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-7aca0a47-e575-432b-b905-30d407e8e6a0 None None] MFA Rules not processed for user `5f0c7b8acf7743fc8cd3aeae1a8dc26d`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:17.200759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7aca0a47-e575-432b-b905-30d407e8e6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:17.353822 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1728/3463] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:27:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:27:17.358039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38703875-2ba8-424a-a022-bb4d9c0e12eb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:17.543534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38703875-2ba8-424a-a022-bb4d9c0e12eb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:17.559002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc35d3-186c-4c9f-a959-1feb107081fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:17.559691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc35d3-186c-4c9f-a959-1feb107081fb admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:17.559980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc35d3-186c-4c9f-a959-1feb107081fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:17.560255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc35d3-186c-4c9f-a959-1feb107081fb admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:17.561059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc35d3-186c-4c9f-a959-1feb107081fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:17.562981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc35d3-186c-4c9f-a959-1feb107081fb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:17.745660 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1736/3464] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:27:17 2022] POST /identity/v3/projects => generated 403 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:27:17.746809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca0a47-e575-432b-b905-30d407e8e6a0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:17.759924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca0a47-e575-432b-b905-30d407e8e6a0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:17.850817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1943f0e-facb-47c2-ba0f-343a3da614a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:17.850817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1943f0e-facb-47c2-ba0f-343a3da614a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:17.851200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1943f0e-facb-47c2-ba0f-343a3da614a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:17.851411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1943f0e-facb-47c2-ba0f-343a3da614a3 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:17.852168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1943f0e-facb-47c2-ba0f-343a3da614a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:17.854240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1943f0e-facb-47c2-ba0f-343a3da614a3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:18.171361 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1729/3465] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:27:17 2022] POST /identity/v3/users => generated 308 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:27:18.174902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc35d3-186c-4c9f-a959-1feb107081fb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:18.187573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc35d3-186c-4c9f-a959-1feb107081fb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:18.199152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61515cf-a944-4043-a952-3cb84407589c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:18.200140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61515cf-a944-4043-a952-3cb84407589c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:18.200704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61515cf-a944-4043-a952-3cb84407589c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:18.201249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61515cf-a944-4043-a952-3cb84407589c admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:18.202284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61515cf-a944-4043-a952-3cb84407589c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:18.205317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61515cf-a944-4043-a952-3cb84407589c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:18.225228 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1737/3466] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:27:18.226681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1943f0e-facb-47c2-ba0f-343a3da614a3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:18.244172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1943f0e-facb-47c2-ba0f-343a3da614a3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:18.251171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef078f1-8501-462b-b436-96a6b290c17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:18.252415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef078f1-8501-462b-b436-96a6b290c17b admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:18.252926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef078f1-8501-462b-b436-96a6b290c17b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:18.253424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef078f1-8501-462b-b436-96a6b290c17b admin admin] PATH_INFO: `/v3/projects/18c26bf503094be3b6a8ad439303ebc8/users/a2d604f15088491c9d3093105f43c1a4/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:18.284393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef078f1-8501-462b-b436-96a6b290c17b admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c26bf503094be3b6a8ad439303ebc8, user_id=a2d604f15088491c9d3093105f43c1a4, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:18.290897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef078f1-8501-462b-b436-96a6b290c17b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:18.631951 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1730/3467] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:27:18 2022] PUT /identity/v3/projects/18c26bf503094be3b6a8ad439303ebc8/users/a2d604f15088491c9d3093105f43c1a4/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:27:18.635763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61515cf-a944-4043-a952-3cb84407589c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:18.659438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61515cf-a944-4043-a952-3cb84407589c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:18.819501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c2a44-80d2-468d-85dc-da291a451dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:18.820265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c2a44-80d2-468d-85dc-da291a451dac admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:18.824542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c2a44-80d2-468d-85dc-da291a451dac admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:18.824542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c2a44-80d2-468d-85dc-da291a451dac admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:18.824542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c2a44-80d2-468d-85dc-da291a451dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:18.824542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c2a44-80d2-468d-85dc-da291a451dac admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:18.849931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef078f1-8501-462b-b436-96a6b290c17b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:18.861312 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1738/3468] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:27:18.864205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef078f1-8501-462b-b436-96a6b290c17b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:18.880650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc79aad-e23c-4a2b-886a-cf556971e96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:18.881873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc79aad-e23c-4a2b-886a-cf556971e96a admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:18.882420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc79aad-e23c-4a2b-886a-cf556971e96a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:18.882865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc79aad-e23c-4a2b-886a-cf556971e96a admin admin] PATH_INFO: `/v3/projects/18c26bf503094be3b6a8ad439303ebc8/users/a2d604f15088491c9d3093105f43c1a4/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:18.900071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc79aad-e23c-4a2b-886a-cf556971e96a admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c26bf503094be3b6a8ad439303ebc8, user_id=a2d604f15088491c9d3093105f43c1a4, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:18.910013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc79aad-e23c-4a2b-886a-cf556971e96a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:18.958898 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1731/3469] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:27:18 2022] PUT /identity/v3/projects/18c26bf503094be3b6a8ad439303ebc8/users/a2d604f15088491c9d3093105f43c1a4/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:27:19.023029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bb46c-264d-4188-892b-cdaafd8b7658 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:19.023493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bb46c-264d-4188-892b-cdaafd8b7658 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:19.023881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bb46c-264d-4188-892b-cdaafd8b7658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:19.118461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-965bb46c-264d-4188-892b-cdaafd8b7658 None None] MFA Rules not processed for user `a2d604f15088491c9d3093105f43c1a4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:19.119680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-965bb46c-264d-4188-892b-cdaafd8b7658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:19.310677 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1739/3470] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:27:19 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 02 10:27:19.318444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc79aad-e23c-4a2b-886a-cf556971e96a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:19.322244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dbc79aad-e23c-4a2b-886a-cf556971e96a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:19.542730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc79aad-e23c-4a2b-886a-cf556971e96a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:19.564106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b4b59-6598-4af0-947e-c3c511d39c24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:19.566190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b4b59-6598-4af0-947e-c3c511d39c24 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:19.566785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b4b59-6598-4af0-947e-c3c511d39c24 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:19.567283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b4b59-6598-4af0-947e-c3c511d39c24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:19.585247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b4b59-6598-4af0-947e-c3c511d39c24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:19.588918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b4b59-6598-4af0-947e-c3c511d39c24 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:19.635431 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1732/3471] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:27:19 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:27:20.190115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bb46c-264d-4188-892b-cdaafd8b7658 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:20.213176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bb46c-264d-4188-892b-cdaafd8b7658 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:20.232913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703e2fe-ae55-45fd-b984-51086eb32600 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:20.234694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703e2fe-ae55-45fd-b984-51086eb32600 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:20.235240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703e2fe-ae55-45fd-b984-51086eb32600 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:20.236072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703e2fe-ae55-45fd-b984-51086eb32600 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:20.239450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b703e2fe-ae55-45fd-b984-51086eb32600 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:20.406840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703e2fe-ae55-45fd-b984-51086eb32600 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:20.409424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703e2fe-ae55-45fd-b984-51086eb32600 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:20.477952 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1740/3472] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:27:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:27:22.693530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b4b59-6598-4af0-947e-c3c511d39c24 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:22.718504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b4b59-6598-4af0-947e-c3c511d39c24 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:22.760651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606e221-4239-444a-9872-115246cf7e9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:22.762736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606e221-4239-444a-9872-115246cf7e9d service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:22.764435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606e221-4239-444a-9872-115246cf7e9d service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:22.764966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606e221-4239-444a-9872-115246cf7e9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:22.932798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606e221-4239-444a-9872-115246cf7e9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:22.932798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606e221-4239-444a-9872-115246cf7e9d service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:22.954858 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1733/3473] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:27:22 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:27:22.982224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703e2fe-ae55-45fd-b984-51086eb32600 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:23.135777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703e2fe-ae55-45fd-b984-51086eb32600 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:23.147579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb80a9-9df1-45b5-991b-f750fc2a5404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:23.149809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb80a9-9df1-45b5-991b-f750fc2a5404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:23.150107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb80a9-9df1-45b5-991b-f750fc2a5404 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:23.150393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb80a9-9df1-45b5-991b-f750fc2a5404 admin admin] PATH_INFO: `/v3/users/5f0c7b8acf7743fc8cd3aeae1a8dc26d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:23.153996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb80a9-9df1-45b5-991b-f750fc2a5404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f0c7b8acf7743fc8cd3aeae1a8dc26d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:23.158948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb80a9-9df1-45b5-991b-f750fc2a5404 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:23.531171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dccb80a9-9df1-45b5-991b-f750fc2a5404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f0c7b8acf7743fc8cd3aeae1a8dc26d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:23.550590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dccb80a9-9df1-45b5-991b-f750fc2a5404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f0c7b8acf7743fc8cd3aeae1a8dc26d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:23.551344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dccb80a9-9df1-45b5-991b-f750fc2a5404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f0c7b8acf7743fc8cd3aeae1a8dc26d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:23.568030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dccb80a9-9df1-45b5-991b-f750fc2a5404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f0c7b8acf7743fc8cd3aeae1a8dc26d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:23.647345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dccb80a9-9df1-45b5-991b-f750fc2a5404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f0c7b8acf7743fc8cd3aeae1a8dc26d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:23.659236 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1741/3474] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:27:22 2022] DELETE /identity/v3/users/5f0c7b8acf7743fc8cd3aeae1a8dc26d => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:27:23.660809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e7c7b-4be7-487d-a99d-3fbd214518ab None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:23.661594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e7c7b-4be7-487d-a99d-3fbd214518ab None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:23.661594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e7c7b-4be7-487d-a99d-3fbd214518ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:23.693823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4d6e7c7b-4be7-487d-a99d-3fbd214518ab None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:23.701256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4d6e7c7b-4be7-487d-a99d-3fbd214518ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:23.883343 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1734/3475] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:27:23.998222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb80a9-9df1-45b5-991b-f750fc2a5404 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:24.004292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-dccb80a9-9df1-45b5-991b-f750fc2a5404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:24.137937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb80a9-9df1-45b5-991b-f750fc2a5404 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:24.150147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec328f-87be-4b97-bd7f-7c25c172522b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:24.151127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec328f-87be-4b97-bd7f-7c25c172522b service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:24.151675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec328f-87be-4b97-bd7f-7c25c172522b service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:24.152060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec328f-87be-4b97-bd7f-7c25c172522b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:24.167885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec328f-87be-4b97-bd7f-7c25c172522b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:24.169840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec328f-87be-4b97-bd7f-7c25c172522b service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:24.181064 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1742/3476] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:27:25.334846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e7c7b-4be7-487d-a99d-3fbd214518ab None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:25.339013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4d6e7c7b-4be7-487d-a99d-3fbd214518ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:25.470409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e7c7b-4be7-487d-a99d-3fbd214518ab None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:25.488306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42268c60-4969-44a0-919d-885ab0dd5c5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:25.489149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42268c60-4969-44a0-919d-885ab0dd5c5a service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:25.489554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42268c60-4969-44a0-919d-885ab0dd5c5a service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:25.489839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42268c60-4969-44a0-919d-885ab0dd5c5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:25.497973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-42268c60-4969-44a0-919d-885ab0dd5c5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:25.513726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42268c60-4969-44a0-919d-885ab0dd5c5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:25.515323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42268c60-4969-44a0-919d-885ab0dd5c5a service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:25.540124 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1735/3477] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:27:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:27:25.642274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec328f-87be-4b97-bd7f-7c25c172522b service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:25.643896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6bec328f-87be-4b97-bd7f-7c25c172522b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:25.663804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec328f-87be-4b97-bd7f-7c25c172522b service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:25.684260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6852f23-c659-4329-b93d-37bf82fb91d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:25.685081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6852f23-c659-4329-b93d-37bf82fb91d3 service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:25.685367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6852f23-c659-4329-b93d-37bf82fb91d3 service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:25.685646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6852f23-c659-4329-b93d-37bf82fb91d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:25.688104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f6852f23-c659-4329-b93d-37bf82fb91d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:25.701784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6852f23-c659-4329-b93d-37bf82fb91d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:25.703566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6852f23-c659-4329-b93d-37bf82fb91d3 service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:25.720660 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1743/3478] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:27:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:27:25.863818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42268c60-4969-44a0-919d-885ab0dd5c5a service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:25.865480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-42268c60-4969-44a0-919d-885ab0dd5c5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:25.889110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42268c60-4969-44a0-919d-885ab0dd5c5a service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:25.901966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cc2ef-8107-471e-8d42-bcae39e6998f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:25.904555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cc2ef-8107-471e-8d42-bcae39e6998f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:25.905410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cc2ef-8107-471e-8d42-bcae39e6998f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:25.919319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cc2ef-8107-471e-8d42-bcae39e6998f admin admin] PATH_INFO: `/v3/projects/d645dcffcd6245bab866d580dbd32540` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:25.923870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212cc2ef-8107-471e-8d42-bcae39e6998f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d645dcffcd6245bab866d580dbd32540)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:25.934409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212cc2ef-8107-471e-8d42-bcae39e6998f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:26.200081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-212cc2ef-8107-471e-8d42-bcae39e6998f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd645dcffcd6245bab866d580dbd32540', 'request_id': 'req-212cc2ef-8107-471e-8d42-bcae39e6998f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:26.294507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-212cc2ef-8107-471e-8d42-bcae39e6998f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd645dcffcd6245bab866d580dbd32540', 'request_id': 'req-212cc2ef-8107-471e-8d42-bcae39e6998f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:26.310821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-212cc2ef-8107-471e-8d42-bcae39e6998f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd645dcffcd6245bab866d580dbd32540', 'request_id': 'req-212cc2ef-8107-471e-8d42-bcae39e6998f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:26.332895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-212cc2ef-8107-471e-8d42-bcae39e6998f admin admin] The token cache is being invalidate because project d645dcffcd6245bab866d580dbd32540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:27:26.339242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-212cc2ef-8107-471e-8d42-bcae39e6998f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:26.339242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-212cc2ef-8107-471e-8d42-bcae39e6998f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:26.342801 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1736/3479] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:27:25 2022] DELETE /identity/v3/projects/d645dcffcd6245bab866d580dbd32540 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:27:26.346662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6852f23-c659-4329-b93d-37bf82fb91d3 service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:26.365767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6852f23-c659-4329-b93d-37bf82fb91d3 service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:26.561486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3a6cf-3aa2-4f9f-8084-be94c0fb0d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:26.574440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3a6cf-3aa2-4f9f-8084-be94c0fb0d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:26.574779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3a6cf-3aa2-4f9f-8084-be94c0fb0d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:26.579947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3a6cf-3aa2-4f9f-8084-be94c0fb0d29 admin admin] PATH_INFO: `/v3/users/a2d604f15088491c9d3093105f43c1a4` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:26.584808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac3a6cf-3aa2-4f9f-8084-be94c0fb0d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d604f15088491c9d3093105f43c1a4)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:26.590920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac3a6cf-3aa2-4f9f-8084-be94c0fb0d29 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:26.937921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1ac3a6cf-3aa2-4f9f-8084-be94c0fb0d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d604f15088491c9d3093105f43c1a4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:26.975767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1ac3a6cf-3aa2-4f9f-8084-be94c0fb0d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d604f15088491c9d3093105f43c1a4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:26.978262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1ac3a6cf-3aa2-4f9f-8084-be94c0fb0d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d604f15088491c9d3093105f43c1a4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:26.990280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1ac3a6cf-3aa2-4f9f-8084-be94c0fb0d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d604f15088491c9d3093105f43c1a4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:27.122339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1ac3a6cf-3aa2-4f9f-8084-be94c0fb0d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d604f15088491c9d3093105f43c1a4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:27.141612 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1744/3480] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:27:26 2022] DELETE /identity/v3/users/a2d604f15088491c9d3093105f43c1a4 => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:27:29.510441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cc2ef-8107-471e-8d42-bcae39e6998f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:29.513138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-212cc2ef-8107-471e-8d42-bcae39e6998f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:29.534220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cc2ef-8107-471e-8d42-bcae39e6998f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:29.715585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905ba1c-7a46-4edf-a5fb-b068cdde0f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:29.716933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905ba1c-7a46-4edf-a5fb-b068cdde0f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:29.717508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905ba1c-7a46-4edf-a5fb-b068cdde0f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:29.718006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905ba1c-7a46-4edf-a5fb-b068cdde0f25 admin admin] PATH_INFO: `/v3/projects/18c26bf503094be3b6a8ad439303ebc8` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:29.721099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905ba1c-7a46-4edf-a5fb-b068cdde0f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c26bf503094be3b6a8ad439303ebc8)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:29.728095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905ba1c-7a46-4edf-a5fb-b068cdde0f25 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:29.928733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8905ba1c-7a46-4edf-a5fb-b068cdde0f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c26bf503094be3b6a8ad439303ebc8', 'request_id': 'req-8905ba1c-7a46-4edf-a5fb-b068cdde0f25'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:30.070770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8905ba1c-7a46-4edf-a5fb-b068cdde0f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c26bf503094be3b6a8ad439303ebc8', 'request_id': 'req-8905ba1c-7a46-4edf-a5fb-b068cdde0f25'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:30.080979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8905ba1c-7a46-4edf-a5fb-b068cdde0f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c26bf503094be3b6a8ad439303ebc8', 'request_id': 'req-8905ba1c-7a46-4edf-a5fb-b068cdde0f25'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:30.105680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8905ba1c-7a46-4edf-a5fb-b068cdde0f25 admin admin] The token cache is being invalidate because project 18c26bf503094be3b6a8ad439303ebc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:27:30.106375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8905ba1c-7a46-4edf-a5fb-b068cdde0f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:30.108883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8905ba1c-7a46-4edf-a5fb-b068cdde0f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:30.111371 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1737/3481] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:27:29 2022] DELETE /identity/v3/projects/18c26bf503094be3b6a8ad439303ebc8 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:27:30.116262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e59edc-1d92-4593-99a5-78dc08ffe89b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:30.117908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e59edc-1d92-4593-99a5-78dc08ffe89b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:30.118395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e59edc-1d92-4593-99a5-78dc08ffe89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:30.199281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e4e59edc-1d92-4593-99a5-78dc08ffe89b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:30.203497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e4e59edc-1d92-4593-99a5-78dc08ffe89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:30.369441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dae15b-fc44-48be-95b2-04a7e2179421 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:30.369886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dae15b-fc44-48be-95b2-04a7e2179421 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:30.370268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dae15b-fc44-48be-95b2-04a7e2179421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:30.380042 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1745/3482] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:27:30.416880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-35dae15b-fc44-48be-95b2-04a7e2179421 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:30.435756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-35dae15b-fc44-48be-95b2-04a7e2179421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:30.467418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e59edc-1d92-4593-99a5-78dc08ffe89b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:30.474037 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1738/3483] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:27:30.477836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e59edc-1d92-4593-99a5-78dc08ffe89b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:30.502247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c4b24-fabd-4633-8a04-5153ac9c9335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:30.503131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c4b24-fabd-4633-8a04-5153ac9c9335 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:30.503737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c4b24-fabd-4633-8a04-5153ac9c9335 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:30.504220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c4b24-fabd-4633-8a04-5153ac9c9335 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:30.505366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c4b24-fabd-4633-8a04-5153ac9c9335 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:27:30.505903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c4b24-fabd-4633-8a04-5153ac9c9335 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:30.508291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c4b24-fabd-4633-8a04-5153ac9c9335 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:30.540113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dae15b-fc44-48be-95b2-04a7e2179421 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:30.546303 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1746/3484] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:27:30.565792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dae15b-fc44-48be-95b2-04a7e2179421 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:30.585158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ace1b-9fcc-4e35-9e39-18145d7299e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:30.586707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ace1b-9fcc-4e35-9e39-18145d7299e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:30.587191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ace1b-9fcc-4e35-9e39-18145d7299e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:30.587642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ace1b-9fcc-4e35-9e39-18145d7299e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:30.589280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ace1b-9fcc-4e35-9e39-18145d7299e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:30.596657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ace1b-9fcc-4e35-9e39-18145d7299e7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:30.850944 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1739/3485] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:27:30 2022] POST /identity/v3/projects => generated 379 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:27:30.852493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c4b24-fabd-4633-8a04-5153ac9c9335 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:30.872104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c4b24-fabd-4633-8a04-5153ac9c9335 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:31.027321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e572607-ca05-4a7f-86cd-7434411787c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:31.028127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e572607-ca05-4a7f-86cd-7434411787c0 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:31.028420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e572607-ca05-4a7f-86cd-7434411787c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:31.028743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e572607-ca05-4a7f-86cd-7434411787c0 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:31.029449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e572607-ca05-4a7f-86cd-7434411787c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:31.033487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e572607-ca05-4a7f-86cd-7434411787c0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:31.153276 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1747/3486] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:27:30 2022] POST /identity/v3/users => generated 290 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:27:31.157755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ace1b-9fcc-4e35-9e39-18145d7299e7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:31.169645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ace1b-9fcc-4e35-9e39-18145d7299e7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:31.178113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c14f56-a342-46c3-b81f-aa2d2bd66f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:31.179056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c14f56-a342-46c3-b81f-aa2d2bd66f20 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:31.180091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c14f56-a342-46c3-b81f-aa2d2bd66f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:31.180567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c14f56-a342-46c3-b81f-aa2d2bd66f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:31.181542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c14f56-a342-46c3-b81f-aa2d2bd66f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:31.190152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c14f56-a342-46c3-b81f-aa2d2bd66f20 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:31.255341 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1740/3487] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:27:31.259748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e572607-ca05-4a7f-86cd-7434411787c0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:31.274505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e572607-ca05-4a7f-86cd-7434411787c0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:31.290219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f3c9d-322a-4f39-a747-096ab3088392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:31.291361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f3c9d-322a-4f39-a747-096ab3088392 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:31.292006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f3c9d-322a-4f39-a747-096ab3088392 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:31.292589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f3c9d-322a-4f39-a747-096ab3088392 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:31.296792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f3c9d-322a-4f39-a747-096ab3088392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:31.300428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f3c9d-322a-4f39-a747-096ab3088392 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:31.340315 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1748/3488] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:27:31.341072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c14f56-a342-46c3-b81f-aa2d2bd66f20 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:31.365762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c14f56-a342-46c3-b81f-aa2d2bd66f20 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:31.380067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ee0d4-ce5e-4895-92e8-c718b90ae3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:31.389261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ee0d4-ce5e-4895-92e8-c718b90ae3e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:31.389875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ee0d4-ce5e-4895-92e8-c718b90ae3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:31.390365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ee0d4-ce5e-4895-92e8-c718b90ae3e0 admin admin] PATH_INFO: `/v3/projects/8702d33df6a549ff93260cef833fd585/users/1b6e3ed627284cba9dfdf5b07c1df360/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:31.416624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ee0d4-ce5e-4895-92e8-c718b90ae3e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8702d33df6a549ff93260cef833fd585, user_id=1b6e3ed627284cba9dfdf5b07c1df360, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:31.419857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ee0d4-ce5e-4895-92e8-c718b90ae3e0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:31.554018 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1741/3489] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:27:31 2022] PUT /identity/v3/projects/8702d33df6a549ff93260cef833fd585/users/1b6e3ed627284cba9dfdf5b07c1df360/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:27:31.566465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be8a2b-9f2c-43b1-899a-d3c9f398075d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:31.566985 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be8a2b-9f2c-43b1-899a-d3c9f398075d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:31.567590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be8a2b-9f2c-43b1-899a-d3c9f398075d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:31.654059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d6be8a2b-9f2c-43b1-899a-d3c9f398075d None None] MFA Rules not processed for user `1b6e3ed627284cba9dfdf5b07c1df360`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:31.655797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d6be8a2b-9f2c-43b1-899a-d3c9f398075d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:31.853067 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1749/3490] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:27:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:27:31.872910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ee0d4-ce5e-4895-92e8-c718b90ae3e0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:31.875065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b23ee0d4-ce5e-4895-92e8-c718b90ae3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:32.060808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ee0d4-ce5e-4895-92e8-c718b90ae3e0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:32.075775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f735f-23e6-44dc-bdd3-fc3be076fc38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:32.076937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f735f-23e6-44dc-bdd3-fc3be076fc38 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:32.077837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f735f-23e6-44dc-bdd3-fc3be076fc38 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:32.078249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f735f-23e6-44dc-bdd3-fc3be076fc38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:32.114127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f735f-23e6-44dc-bdd3-fc3be076fc38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:32.120785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f735f-23e6-44dc-bdd3-fc3be076fc38 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:32.137645 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1742/3491] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:27:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:27:32.661855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f15e2-6f67-4455-a507-f9bdad66dc8c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:32.662763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f15e2-6f67-4455-a507-f9bdad66dc8c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:32.663225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f15e2-6f67-4455-a507-f9bdad66dc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:32.697202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-350f15e2-6f67-4455-a507-f9bdad66dc8c None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:32.703401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-350f15e2-6f67-4455-a507-f9bdad66dc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:32.829193 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1750/3492] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:27:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:27:32.842170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f735f-23e6-44dc-bdd3-fc3be076fc38 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:32.852139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fb1f735f-23e6-44dc-bdd3-fc3be076fc38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:32.947061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f735f-23e6-44dc-bdd3-fc3be076fc38 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:32.953795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fb3e4-4561-4a17-996a-dd86159c25f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:32.954695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fb3e4-4561-4a17-996a-dd86159c25f9 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:32.955175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fb3e4-4561-4a17-996a-dd86159c25f9 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:32.955629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fb3e4-4561-4a17-996a-dd86159c25f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:32.966626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fb3e4-4561-4a17-996a-dd86159c25f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:32.968526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fb3e4-4561-4a17-996a-dd86159c25f9 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:32.978405 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1743/3493] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:27:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:27:33.290332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f15e2-6f67-4455-a507-f9bdad66dc8c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:33.293001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-350f15e2-6f67-4455-a507-f9bdad66dc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:33.469805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f15e2-6f67-4455-a507-f9bdad66dc8c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:33.475769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bf52c-b5cf-4be8-9762-9d987e466b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:33.476917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bf52c-b5cf-4be8-9762-9d987e466b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:33.477575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bf52c-b5cf-4be8-9762-9d987e466b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:33.478129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bf52c-b5cf-4be8-9762-9d987e466b64 admin admin] PATH_INFO: `/v3/users/e83fd687fcc74495a7ea73f0e001419b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:33.479632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4bf52c-b5cf-4be8-9762-9d987e466b64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e83fd687fcc74495a7ea73f0e001419b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:33.481921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4bf52c-b5cf-4be8-9762-9d987e466b64 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:33.561339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093d173-2ac1-4bab-90f8-c085c6357984 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:33.562019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093d173-2ac1-4bab-90f8-c085c6357984 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:33.562596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093d173-2ac1-4bab-90f8-c085c6357984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:33.611247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0093d173-2ac1-4bab-90f8-c085c6357984 None None] MFA Rules not processed for user `1b6e3ed627284cba9dfdf5b07c1df360`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:33.615225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0093d173-2ac1-4bab-90f8-c085c6357984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:33.639371 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1744/3494] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:27:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:27:33.809975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3b4bf52c-b5cf-4be8-9762-9d987e466b64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e83fd687fcc74495a7ea73f0e001419b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:33.842812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3b4bf52c-b5cf-4be8-9762-9d987e466b64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e83fd687fcc74495a7ea73f0e001419b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:33.843795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3b4bf52c-b5cf-4be8-9762-9d987e466b64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e83fd687fcc74495a7ea73f0e001419b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:33.863594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3b4bf52c-b5cf-4be8-9762-9d987e466b64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e83fd687fcc74495a7ea73f0e001419b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:33.946530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3b4bf52c-b5cf-4be8-9762-9d987e466b64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e83fd687fcc74495a7ea73f0e001419b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:33.955265 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1751/3495] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:27:33 2022] DELETE /identity/v3/users/e83fd687fcc74495a7ea73f0e001419b => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:27:34.259061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f9d2e-b6b4-4166-acf9-f87148f64172 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:34.259623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f9d2e-b6b4-4166-acf9-f87148f64172 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:34.259623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f9d2e-b6b4-4166-acf9-f87148f64172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:34.326501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-667f9d2e-b6b4-4166-acf9-f87148f64172 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:34.328091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-667f9d2e-b6b4-4166-acf9-f87148f64172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:34.431280 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1745/3496] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:27:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:27:34.450823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bf52c-b5cf-4be8-9762-9d987e466b64 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:34.453221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3b4bf52c-b5cf-4be8-9762-9d987e466b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:34.608977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bf52c-b5cf-4be8-9762-9d987e466b64 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:34.615400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa9799-e5a6-408e-aae2-f4b628cebe43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:34.616100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa9799-e5a6-408e-aae2-f4b628cebe43 service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:34.616392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa9799-e5a6-408e-aae2-f4b628cebe43 service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:34.616953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa9799-e5a6-408e-aae2-f4b628cebe43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:34.627616 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa9799-e5a6-408e-aae2-f4b628cebe43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:34.629783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa9799-e5a6-408e-aae2-f4b628cebe43 service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:34.679956 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1752/3497] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:27:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:27:35.137958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f9d2e-b6b4-4166-acf9-f87148f64172 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:35.139781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-667f9d2e-b6b4-4166-acf9-f87148f64172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:35.225484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f9d2e-b6b4-4166-acf9-f87148f64172 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:35.230596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f94b6-a689-4805-9ee9-dab71cdd500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:35.231813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f94b6-a689-4805-9ee9-dab71cdd500f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:35.232284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f94b6-a689-4805-9ee9-dab71cdd500f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:35.232765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f94b6-a689-4805-9ee9-dab71cdd500f admin admin] PATH_INFO: `/v3/projects/a1ea8413418742c49c7aadca80d951ed` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:35.234197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f94b6-a689-4805-9ee9-dab71cdd500f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1ea8413418742c49c7aadca80d951ed)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:35.236297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f94b6-a689-4805-9ee9-dab71cdd500f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:35.276042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa9799-e5a6-408e-aae2-f4b628cebe43 service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:35.277709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c8aa9799-e5a6-408e-aae2-f4b628cebe43 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:35.292172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa9799-e5a6-408e-aae2-f4b628cebe43 service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:35.297185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df453cd3-6b76-46bc-9bf5-cc136ace5323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:35.298060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df453cd3-6b76-46bc-9bf5-cc136ace5323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:35.298625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df453cd3-6b76-46bc-9bf5-cc136ace5323 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:35.299082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df453cd3-6b76-46bc-9bf5-cc136ace5323 admin admin] PATH_INFO: `/v3/users/1b6e3ed627284cba9dfdf5b07c1df360` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:35.300483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df453cd3-6b76-46bc-9bf5-cc136ace5323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b6e3ed627284cba9dfdf5b07c1df360)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:35.302499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df453cd3-6b76-46bc-9bf5-cc136ace5323 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:35.510824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f46f94b6-a689-4805-9ee9-dab71cdd500f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1ea8413418742c49c7aadca80d951ed', 'request_id': 'req-f46f94b6-a689-4805-9ee9-dab71cdd500f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:35.516586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-df453cd3-6b76-46bc-9bf5-cc136ace5323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b6e3ed627284cba9dfdf5b07c1df360'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:35.527919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-df453cd3-6b76-46bc-9bf5-cc136ace5323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b6e3ed627284cba9dfdf5b07c1df360'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:35.528762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-df453cd3-6b76-46bc-9bf5-cc136ace5323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b6e3ed627284cba9dfdf5b07c1df360'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:35.536262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-df453cd3-6b76-46bc-9bf5-cc136ace5323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b6e3ed627284cba9dfdf5b07c1df360'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:35.594321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f46f94b6-a689-4805-9ee9-dab71cdd500f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1ea8413418742c49c7aadca80d951ed', 'request_id': 'req-f46f94b6-a689-4805-9ee9-dab71cdd500f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:35.603491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f46f94b6-a689-4805-9ee9-dab71cdd500f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1ea8413418742c49c7aadca80d951ed', 'request_id': 'req-f46f94b6-a689-4805-9ee9-dab71cdd500f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:35.615067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f46f94b6-a689-4805-9ee9-dab71cdd500f admin admin] The token cache is being invalidate because project a1ea8413418742c49c7aadca80d951ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:27:35.615358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f46f94b6-a689-4805-9ee9-dab71cdd500f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:35.616203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f46f94b6-a689-4805-9ee9-dab71cdd500f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:35.618758 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1746/3498] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:27:35 2022] DELETE /identity/v3/projects/a1ea8413418742c49c7aadca80d951ed => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:27:35.629053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd97d9-2ce3-4bb0-b858-0396ef7fe59c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:35.629340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd97d9-2ce3-4bb0-b858-0396ef7fe59c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:35.629868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd97d9-2ce3-4bb0-b858-0396ef7fe59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:35.656957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0bdd97d9-2ce3-4bb0-b858-0396ef7fe59c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:35.659548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0bdd97d9-2ce3-4bb0-b858-0396ef7fe59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:35.682842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-df453cd3-6b76-46bc-9bf5-cc136ace5323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b6e3ed627284cba9dfdf5b07c1df360'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:35.706285 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1753/3499] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:27:35 2022] DELETE /identity/v3/users/1b6e3ed627284cba9dfdf5b07c1df360 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:27:35.710096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5a782-e80c-42f3-a52c-01509a676b1d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:35.710409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5a782-e80c-42f3-a52c-01509a676b1d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:35.710785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5a782-e80c-42f3-a52c-01509a676b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:35.742464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6da5a782-e80c-42f3-a52c-01509a676b1d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:35.743726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6da5a782-e80c-42f3-a52c-01509a676b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:35.787477 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1747/3500] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:27:35.795813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6e21a-b6c2-480e-98c2-428a019e1586 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:35.796578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6e21a-b6c2-480e-98c2-428a019e1586 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:35.798124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6e21a-b6c2-480e-98c2-428a019e1586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:35.824715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-99e6e21a-b6c2-480e-98c2-428a019e1586 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:35.824715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-99e6e21a-b6c2-480e-98c2-428a019e1586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:35.860044 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1754/3501] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:27:35.867999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5a782-e80c-42f3-a52c-01509a676b1d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:35.869807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6da5a782-e80c-42f3-a52c-01509a676b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:35.912318 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1748/3502] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:27:35.917873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6e21a-b6c2-480e-98c2-428a019e1586 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:35.933473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6e21a-b6c2-480e-98c2-428a019e1586 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:35.939284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a60c0a-0f57-430c-abef-639d551434a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:35.943127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a60c0a-0f57-430c-abef-639d551434a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:35.943127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a60c0a-0f57-430c-abef-639d551434a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:35.943127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a60c0a-0f57-430c-abef-639d551434a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:35.943524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a60c0a-0f57-430c-abef-639d551434a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:27:35.943731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a60c0a-0f57-430c-abef-639d551434a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:35.946012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5a782-e80c-42f3-a52c-01509a676b1d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:35.946158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a60c0a-0f57-430c-abef-639d551434a7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:35.951099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7066d-44fe-45b9-8089-aef927bb7030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:35.951834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7066d-44fe-45b9-8089-aef927bb7030 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:35.952174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7066d-44fe-45b9-8089-aef927bb7030 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:35.952358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7066d-44fe-45b9-8089-aef927bb7030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:35.963266 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1749/3503] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:27:35.966101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7066d-44fe-45b9-8089-aef927bb7030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:35.967855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a60c0a-0f57-430c-abef-639d551434a7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:35.970931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7066d-44fe-45b9-8089-aef927bb7030 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:35.983171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a60c0a-0f57-430c-abef-639d551434a7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:35.986475 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1755/3504] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:27:35.991210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a1cae-05bb-4190-be90-a860764bda1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:35.992549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a1cae-05bb-4190-be90-a860764bda1e admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:35.992933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a1cae-05bb-4190-be90-a860764bda1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:35.993224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a1cae-05bb-4190-be90-a860764bda1e admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:35.994294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a1cae-05bb-4190-be90-a860764bda1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:35.996870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a1cae-05bb-4190-be90-a860764bda1e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:36.114734 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1750/3505] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:27:35 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:27:36.119992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7066d-44fe-45b9-8089-aef927bb7030 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:36.138789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7066d-44fe-45b9-8089-aef927bb7030 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:36.221412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51539ac9-3806-40f3-bc8b-6f61133a8af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:36.222213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51539ac9-3806-40f3-bc8b-6f61133a8af4 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:36.222616 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51539ac9-3806-40f3-bc8b-6f61133a8af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:36.222959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51539ac9-3806-40f3-bc8b-6f61133a8af4 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:36.223723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51539ac9-3806-40f3-bc8b-6f61133a8af4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:36.225842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51539ac9-3806-40f3-bc8b-6f61133a8af4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:36.421193 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1756/3506] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:27:36 2022] POST /identity/v3/users => generated 293 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:27:36.425221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a1cae-05bb-4190-be90-a860764bda1e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:36.439207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a1cae-05bb-4190-be90-a860764bda1e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:36.449280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b4d61-c82c-489c-9fe3-33cd7550c575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:36.450845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b4d61-c82c-489c-9fe3-33cd7550c575 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:36.451384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b4d61-c82c-489c-9fe3-33cd7550c575 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:36.451859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b4d61-c82c-489c-9fe3-33cd7550c575 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:36.452869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b4d61-c82c-489c-9fe3-33cd7550c575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:36.454677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b4d61-c82c-489c-9fe3-33cd7550c575 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:36.469876 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1751/3507] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:27:36.473874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51539ac9-3806-40f3-bc8b-6f61133a8af4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:36.498600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51539ac9-3806-40f3-bc8b-6f61133a8af4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:36.510336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026dec9c-f66d-4e72-bbfe-2099dd939745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:36.511026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dec9c-f66d-4e72-bbfe-2099dd939745 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:36.511311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dec9c-f66d-4e72-bbfe-2099dd939745 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:36.511590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dec9c-f66d-4e72-bbfe-2099dd939745 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:36.512795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026dec9c-f66d-4e72-bbfe-2099dd939745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:36.514804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026dec9c-f66d-4e72-bbfe-2099dd939745 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:36.533924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b4d61-c82c-489c-9fe3-33cd7550c575 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:36.536810 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1757/3508] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:27:36.554851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b4d61-c82c-489c-9fe3-33cd7550c575 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:36.560149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e7ad4-bd9d-4540-b7a8-2d7b1dc0bd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:36.563799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e7ad4-bd9d-4540-b7a8-2d7b1dc0bd20 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:36.580385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e7ad4-bd9d-4540-b7a8-2d7b1dc0bd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:36.582550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e7ad4-bd9d-4540-b7a8-2d7b1dc0bd20 admin admin] PATH_INFO: `/v3/projects/1d5fba18b19446e8ac75b3792e386fc4/users/04ac3f0b81f3409f8ca246f490a2055e/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:36.625482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e7ad4-bd9d-4540-b7a8-2d7b1dc0bd20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5fba18b19446e8ac75b3792e386fc4, user_id=04ac3f0b81f3409f8ca246f490a2055e, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:36.635869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e7ad4-bd9d-4540-b7a8-2d7b1dc0bd20 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:36.731822 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1752/3509] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:27:36 2022] PUT /identity/v3/projects/1d5fba18b19446e8ac75b3792e386fc4/users/04ac3f0b81f3409f8ca246f490a2055e/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:27:36.733744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76beed1-881b-42cf-afa5-b532f6441db6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:36.734039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76beed1-881b-42cf-afa5-b532f6441db6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:36.734320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76beed1-881b-42cf-afa5-b532f6441db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:36.754828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f76beed1-881b-42cf-afa5-b532f6441db6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:36.756210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f76beed1-881b-42cf-afa5-b532f6441db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:36.880048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e7ad4-bd9d-4540-b7a8-2d7b1dc0bd20 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:36.882374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a17e7ad4-bd9d-4540-b7a8-2d7b1dc0bd20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:37.013309 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1758/3510] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:27:37.040966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76beed1-881b-42cf-afa5-b532f6441db6 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:37.045747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f76beed1-881b-42cf-afa5-b532f6441db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:37.080990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e7ad4-bd9d-4540-b7a8-2d7b1dc0bd20 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:37.086829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a5edc-1190-4aad-9613-e0a0d2d4c6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:37.088792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a5edc-1190-4aad-9613-e0a0d2d4c6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:37.092969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a5edc-1190-4aad-9613-e0a0d2d4c6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:37.092969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a5edc-1190-4aad-9613-e0a0d2d4c6aa admin admin] PATH_INFO: `/v3/projects/8702d33df6a549ff93260cef833fd585` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:37.102479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a5edc-1190-4aad-9613-e0a0d2d4c6aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8702d33df6a549ff93260cef833fd585)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:37.105475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a5edc-1190-4aad-9613-e0a0d2d4c6aa admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:37.197128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76beed1-881b-42cf-afa5-b532f6441db6 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:37.207050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a5e16-c0b1-43bc-a7bb-41133d9e4749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:37.207729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a5e16-c0b1-43bc-a7bb-41133d9e4749 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:37.208545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a5e16-c0b1-43bc-a7bb-41133d9e4749 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:37.209146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a5e16-c0b1-43bc-a7bb-41133d9e4749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:37.223845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a5e16-c0b1-43bc-a7bb-41133d9e4749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:37.225490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a5e16-c0b1-43bc-a7bb-41133d9e4749 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:37.261137 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1759/3511] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:27:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:27:37.328763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-053a5edc-1190-4aad-9613-e0a0d2d4c6aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8702d33df6a549ff93260cef833fd585', 'request_id': 'req-053a5edc-1190-4aad-9613-e0a0d2d4c6aa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:37.442017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-053a5edc-1190-4aad-9613-e0a0d2d4c6aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8702d33df6a549ff93260cef833fd585', 'request_id': 'req-053a5edc-1190-4aad-9613-e0a0d2d4c6aa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:37.450038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-053a5edc-1190-4aad-9613-e0a0d2d4c6aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8702d33df6a549ff93260cef833fd585', 'request_id': 'req-053a5edc-1190-4aad-9613-e0a0d2d4c6aa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:37.467041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-053a5edc-1190-4aad-9613-e0a0d2d4c6aa admin admin] The token cache is being invalidate because project 8702d33df6a549ff93260cef833fd585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:27:37.467573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-053a5edc-1190-4aad-9613-e0a0d2d4c6aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:37.468947 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-053a5edc-1190-4aad-9613-e0a0d2d4c6aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:27:37.471261 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1753/3512] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:27:36 2022] DELETE /identity/v3/projects/8702d33df6a549ff93260cef833fd585 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:27:37.476174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada87783-63fb-47dc-945a-7d19e06cc756 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:37.479894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada87783-63fb-47dc-945a-7d19e06cc756 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:37.479894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada87783-63fb-47dc-945a-7d19e06cc756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:37.506740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ada87783-63fb-47dc-945a-7d19e06cc756 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:37.508019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ada87783-63fb-47dc-945a-7d19e06cc756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:37.642335 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1760/3513] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:27:37.643384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6415e3-87a1-4be5-8560-54639f8ff52a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:37.643837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6415e3-87a1-4be5-8560-54639f8ff52a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:37.644000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6415e3-87a1-4be5-8560-54639f8ff52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:37.687129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3a6415e3-87a1-4be5-8560-54639f8ff52a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:37.688100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3a6415e3-87a1-4be5-8560-54639f8ff52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:37.714666 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1754/3514] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:27:37.719519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada87783-63fb-47dc-945a-7d19e06cc756 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:37.732545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada87783-63fb-47dc-945a-7d19e06cc756 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:37.739548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57e890-03f7-46db-af6c-2c7f4f757f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:37.741042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57e890-03f7-46db-af6c-2c7f4f757f4f admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:37.744958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57e890-03f7-46db-af6c-2c7f4f757f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:37.744958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57e890-03f7-46db-af6c-2c7f4f757f4f admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:37.744958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57e890-03f7-46db-af6c-2c7f4f757f4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:27:37.744958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57e890-03f7-46db-af6c-2c7f4f757f4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:37.745621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57e890-03f7-46db-af6c-2c7f4f757f4f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:37.768830 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1761/3515] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:27:37.768998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6415e3-87a1-4be5-8560-54639f8ff52a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:37.782050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6415e3-87a1-4be5-8560-54639f8ff52a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:37.793597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f74a44-f246-4c0b-9421-9bbf941b838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:37.796516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f74a44-f246-4c0b-9421-9bbf941b838c admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:37.796848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f74a44-f246-4c0b-9421-9bbf941b838c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:37.797142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f74a44-f246-4c0b-9421-9bbf941b838c admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:37.797871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f74a44-f246-4c0b-9421-9bbf941b838c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:37.805123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f74a44-f246-4c0b-9421-9bbf941b838c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:37.927736 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1755/3516] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:27:37 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:27:37.929805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57e890-03f7-46db-af6c-2c7f4f757f4f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:37.949042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57e890-03f7-46db-af6c-2c7f4f757f4f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:38.105384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c0727-4bc3-49fc-ba55-9675e1f3d6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:38.106089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c0727-4bc3-49fc-ba55-9675e1f3d6f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:38.106377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c0727-4bc3-49fc-ba55-9675e1f3d6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:38.106674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c0727-4bc3-49fc-ba55-9675e1f3d6f2 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:38.107363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c0727-4bc3-49fc-ba55-9675e1f3d6f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:38.111264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c0727-4bc3-49fc-ba55-9675e1f3d6f2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:38.233349 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1762/3517] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:27:37 2022] POST /identity/v3/users => generated 288 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:27:38.236960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f74a44-f246-4c0b-9421-9bbf941b838c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:38.266063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f74a44-f246-4c0b-9421-9bbf941b838c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:38.278646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dd78f-5f56-4ec7-a10e-0c15a2b30f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:38.279672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dd78f-5f56-4ec7-a10e-0c15a2b30f33 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:38.280474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dd78f-5f56-4ec7-a10e-0c15a2b30f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:38.281554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dd78f-5f56-4ec7-a10e-0c15a2b30f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:38.282773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095dd78f-5f56-4ec7-a10e-0c15a2b30f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:38.289349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095dd78f-5f56-4ec7-a10e-0c15a2b30f33 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:38.324852 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1756/3518] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:27:38.327963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c0727-4bc3-49fc-ba55-9675e1f3d6f2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:38.340324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c0727-4bc3-49fc-ba55-9675e1f3d6f2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:38.361547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa745e-74a1-4363-977c-5f518d824722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:38.371710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa745e-74a1-4363-977c-5f518d824722 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:38.373272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa745e-74a1-4363-977c-5f518d824722 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:38.373761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa745e-74a1-4363-977c-5f518d824722 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:38.375157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa745e-74a1-4363-977c-5f518d824722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:38.379447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa745e-74a1-4363-977c-5f518d824722 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:38.431814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dd78f-5f56-4ec7-a10e-0c15a2b30f33 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:38.432037 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1763/3519] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:27:38.486893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dd78f-5f56-4ec7-a10e-0c15a2b30f33 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:38.511591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc27a2-69f5-46cf-8c25-c875b72dfcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:38.518303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc27a2-69f5-46cf-8c25-c875b72dfcf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:38.518735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc27a2-69f5-46cf-8c25-c875b72dfcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:38.524343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc27a2-69f5-46cf-8c25-c875b72dfcf1 admin admin] PATH_INFO: `/v3/projects/4b3cbda8aaf0451ea40060916319a0c2/users/bf9fc52ad7754d9d9667e90b0e65f9db/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:38.592898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc27a2-69f5-46cf-8c25-c875b72dfcf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b3cbda8aaf0451ea40060916319a0c2, user_id=bf9fc52ad7754d9d9667e90b0e65f9db, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:38.602477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc27a2-69f5-46cf-8c25-c875b72dfcf1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:38.726987 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1757/3520] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:27:38 2022] PUT /identity/v3/projects/4b3cbda8aaf0451ea40060916319a0c2/users/bf9fc52ad7754d9d9667e90b0e65f9db/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:27:38.732503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfb967-36e0-4683-98ed-d190aaad8a79 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:38.733260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfb967-36e0-4683-98ed-d190aaad8a79 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:38.733260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfb967-36e0-4683-98ed-d190aaad8a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:38.795273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-08dfb967-36e0-4683-98ed-d190aaad8a79 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:38.796518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-08dfb967-36e0-4683-98ed-d190aaad8a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:38.910638 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1764/3521] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:27:38.924133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc27a2-69f5-46cf-8c25-c875b72dfcf1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:38.930327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c3cc27a2-69f5-46cf-8c25-c875b72dfcf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:39.008056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc27a2-69f5-46cf-8c25-c875b72dfcf1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:39.012578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c839a-7429-4aa8-961a-5942cb54d30b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:39.014231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c839a-7429-4aa8-961a-5942cb54d30b service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:39.014526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c839a-7429-4aa8-961a-5942cb54d30b service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:39.015815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c839a-7429-4aa8-961a-5942cb54d30b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:39.030105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c839a-7429-4aa8-961a-5942cb54d30b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:39.032513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c839a-7429-4aa8-961a-5942cb54d30b service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:39.052178 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1758/3522] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:27:44.089345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe6fcb-dbd0-4abe-8863-c21e98f6da83 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:44.089897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe6fcb-dbd0-4abe-8863-c21e98f6da83 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:44.090084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe6fcb-dbd0-4abe-8863-c21e98f6da83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:44.156534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-30fe6fcb-dbd0-4abe-8863-c21e98f6da83 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:44.158568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-30fe6fcb-dbd0-4abe-8863-c21e98f6da83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:44.299568 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1765/3523] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:27:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:27:44.317931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c839a-7429-4aa8-961a-5942cb54d30b service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:44.320462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-858c839a-7429-4aa8-961a-5942cb54d30b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:44.554186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c839a-7429-4aa8-961a-5942cb54d30b service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:44.567637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7154be6-9785-4c21-b8a5-a4211352df96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:44.568030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7154be6-9785-4c21-b8a5-a4211352df96 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:44.568125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7154be6-9785-4c21-b8a5-a4211352df96 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:44.568374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7154be6-9785-4c21-b8a5-a4211352df96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:44.587799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7154be6-9785-4c21-b8a5-a4211352df96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:44.595214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7154be6-9785-4c21-b8a5-a4211352df96 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:44.611363 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1759/3524] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:27:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:27:44.999790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46f3ac-cdf0-4bc4-bc2a-ff091db9d3b1 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:45.000295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46f3ac-cdf0-4bc4-bc2a-ff091db9d3b1 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:45.000778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46f3ac-cdf0-4bc4-bc2a-ff091db9d3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:45.053203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-cc46f3ac-cdf0-4bc4-bc2a-ff091db9d3b1 None None] MFA Rules not processed for user `3816b61af9864122a0b556581359f699`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:45.055363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cc46f3ac-cdf0-4bc4-bc2a-ff091db9d3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:45.227256 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1766/3525] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:27:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:27:49.011997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73482c98-a391-4416-baa5-d7c42ced2a16 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:49.013129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73482c98-a391-4416-baa5-d7c42ced2a16 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:49.013668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73482c98-a391-4416-baa5-d7c42ced2a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:49.037800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-73482c98-a391-4416-baa5-d7c42ced2a16 None None] MFA Rules not processed for user `4249f4ad303744e88e5f01d339a762b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:49.040131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-73482c98-a391-4416-baa5-d7c42ced2a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:49.171362 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1760/3526] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:27:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:27:55.293352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b5009-7976-4bd7-a436-f900afd035ba None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:55.294399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b5009-7976-4bd7-a436-f900afd035ba None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:55.294926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b5009-7976-4bd7-a436-f900afd035ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:55.345313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3a3b5009-7976-4bd7-a436-f900afd035ba None None] MFA Rules not processed for user `04ac3f0b81f3409f8ca246f490a2055e`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:27:55.347502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3a3b5009-7976-4bd7-a436-f900afd035ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:55.445850 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1767/3527] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:27:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:27:56.135889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73482c98-a391-4416-baa5-d7c42ced2a16 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:27:56.137628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-73482c98-a391-4416-baa5-d7c42ced2a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:27:56.450218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73482c98-a391-4416-baa5-d7c42ced2a16 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:27:56.469473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d791ae-3975-4a83-96a0-169e338b1be0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:27:56.471127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d791ae-3975-4a83-96a0-169e338b1be0 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:27:56.473066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d791ae-3975-4a83-96a0-169e338b1be0 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:27:56.473549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d791ae-3975-4a83-96a0-169e338b1be0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:27:56.511412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d791ae-3975-4a83-96a0-169e338b1be0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:27:56.513522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d791ae-3975-4a83-96a0-169e338b1be0 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:27:56.560509 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1761/3528] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:27:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:28:01.677267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b9a31-9b42-4d88-bd1d-9ed216238606 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:01.678915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b9a31-9b42-4d88-bd1d-9ed216238606 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:01.679268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b9a31-9b42-4d88-bd1d-9ed216238606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:01.743344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a68b9a31-9b42-4d88-bd1d-9ed216238606 None None] MFA Rules not processed for user `bf9fc52ad7754d9d9667e90b0e65f9db`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:01.744879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a68b9a31-9b42-4d88-bd1d-9ed216238606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:01.974178 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1768/3529] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:28:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:28:01.986181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d791ae-3975-4a83-96a0-169e338b1be0 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:01.988650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-63d791ae-3975-4a83-96a0-169e338b1be0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:02.035549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d791ae-3975-4a83-96a0-169e338b1be0 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:02.047064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85681a6d-6319-49c0-aa7d-a42836197001 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:02.048134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85681a6d-6319-49c0-aa7d-a42836197001 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:02.048842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85681a6d-6319-49c0-aa7d-a42836197001 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:02.049358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85681a6d-6319-49c0-aa7d-a42836197001 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:02.075780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85681a6d-6319-49c0-aa7d-a42836197001 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:02.078761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85681a6d-6319-49c0-aa7d-a42836197001 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:02.107286 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1762/3530] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:28:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:28:05.486214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b705ffc-866e-48a1-9910-b2f1b936c2d9 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:05.487138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b705ffc-866e-48a1-9910-b2f1b936c2d9 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:05.487589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b705ffc-866e-48a1-9910-b2f1b936c2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:05.541870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0b705ffc-866e-48a1-9910-b2f1b936c2d9 None None] MFA Rules not processed for user `1cf4f9c1eeb94bff96fa42d2f20d805f`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:05.547604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0b705ffc-866e-48a1-9910-b2f1b936c2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:05.674117 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1769/3531] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:28:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:28:05.910236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28cbda-1ef5-470b-aee8-7f9123c5e134 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:05.910726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28cbda-1ef5-470b-aee8-7f9123c5e134 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:05.910934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28cbda-1ef5-470b-aee8-7f9123c5e134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:05.954999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2d28cbda-1ef5-470b-aee8-7f9123c5e134 None None] MFA Rules not processed for user `04ac3f0b81f3409f8ca246f490a2055e`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:05.956517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2d28cbda-1ef5-470b-aee8-7f9123c5e134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:05.972091 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1763/3532] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:28:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:28:13.238795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000cfb6-2607-449f-b550-1f1fb83d3057 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:13.238795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000cfb6-2607-449f-b550-1f1fb83d3057 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:13.238795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000cfb6-2607-449f-b550-1f1fb83d3057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:13.261287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7000cfb6-2607-449f-b550-1f1fb83d3057 None None] MFA Rules not processed for user `3816b61af9864122a0b556581359f699`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:13.262528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7000cfb6-2607-449f-b550-1f1fb83d3057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:13.274804 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1770/3533] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:28:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:28:16.304762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28cbda-1ef5-470b-aee8-7f9123c5e134 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:16.307106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2d28cbda-1ef5-470b-aee8-7f9123c5e134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:16.327713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28cbda-1ef5-470b-aee8-7f9123c5e134 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:16.334124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ecdf4-01a5-42e2-a0f1-87e0c3236e7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:16.335441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ecdf4-01a5-42e2-a0f1-87e0c3236e7d service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:16.335971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ecdf4-01a5-42e2-a0f1-87e0c3236e7d service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:16.336566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ecdf4-01a5-42e2-a0f1-87e0c3236e7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:16.339496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-026ecdf4-01a5-42e2-a0f1-87e0c3236e7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:16.359569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ecdf4-01a5-42e2-a0f1-87e0c3236e7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:16.359569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ecdf4-01a5-42e2-a0f1-87e0c3236e7d service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:16.378401 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1764/3534] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:28:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:28:16.587951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64633de-4806-4c1c-bee1-2301d54b5de5 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:16.588497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64633de-4806-4c1c-bee1-2301d54b5de5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:16.588497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64633de-4806-4c1c-bee1-2301d54b5de5 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:16.596092 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1771/3535] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:28:16.618741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f1b40-74fa-4fae-933b-f7cc8aee760f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:16.619046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f1b40-74fa-4fae-933b-f7cc8aee760f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:16.619567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f1b40-74fa-4fae-933b-f7cc8aee760f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:16.680093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b71f1b40-74fa-4fae-933b-f7cc8aee760f None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:16.682745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b71f1b40-74fa-4fae-933b-f7cc8aee760f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:16.796289 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1765/3536] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:28:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:28:16.820531 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64633de-4806-4c1c-bee1-2301d54b5de5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:16.822427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f64633de-4806-4c1c-bee1-2301d54b5de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:16.841307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64633de-4806-4c1c-bee1-2301d54b5de5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:16.848258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a2395-7b81-49a4-90ec-733df7ad2586 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:16.850309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a2395-7b81-49a4-90ec-733df7ad2586 service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:16.851095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a2395-7b81-49a4-90ec-733df7ad2586 service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:16.851383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a2395-7b81-49a4-90ec-733df7ad2586 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:16.862437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a2395-7b81-49a4-90ec-733df7ad2586 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:16.871131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a2395-7b81-49a4-90ec-733df7ad2586 service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:16.880464 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1772/3537] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:28:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:28:19.647738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9a93f-0ea0-4cb3-94e5-f949aab32dc2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:19.648264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9a93f-0ea0-4cb3-94e5-f949aab32dc2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:19.648374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9a93f-0ea0-4cb3-94e5-f949aab32dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:19.666191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1eb9a93f-0ea0-4cb3-94e5-f949aab32dc2 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:19.670821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1eb9a93f-0ea0-4cb3-94e5-f949aab32dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:19.676312 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1766/3538] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:28:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:28:19.695987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a2395-7b81-49a4-90ec-733df7ad2586 service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:19.707407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a2395-7b81-49a4-90ec-733df7ad2586 service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:19.712751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5faaa0-348e-4a4c-8868-4422940337dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:19.713516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5faaa0-348e-4a4c-8868-4422940337dc service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:19.713803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5faaa0-348e-4a4c-8868-4422940337dc service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:19.714081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5faaa0-348e-4a4c-8868-4422940337dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:19.722799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5faaa0-348e-4a4c-8868-4422940337dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:19.724868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5faaa0-348e-4a4c-8868-4422940337dc service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:19.734343 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1773/3539] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:28:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:28:21.257971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036bb7e-fcad-40e9-8bde-36734eaffdf8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:21.258814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036bb7e-fcad-40e9-8bde-36734eaffdf8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:21.259262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036bb7e-fcad-40e9-8bde-36734eaffdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:21.291577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9036bb7e-fcad-40e9-8bde-36734eaffdf8 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:21.292919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9036bb7e-fcad-40e9-8bde-36734eaffdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:21.346169 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1767/3540] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:28:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:28:21.361968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5faaa0-348e-4a4c-8868-4422940337dc service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:21.384051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5faaa0-348e-4a4c-8868-4422940337dc service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:21.392069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbe1ec-da4a-4b0b-be0c-5df7075be1fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:21.393082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbe1ec-da4a-4b0b-be0c-5df7075be1fd service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:21.393535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbe1ec-da4a-4b0b-be0c-5df7075be1fd service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:21.393995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbe1ec-da4a-4b0b-be0c-5df7075be1fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:21.404767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbe1ec-da4a-4b0b-be0c-5df7075be1fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:21.406788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbe1ec-da4a-4b0b-be0c-5df7075be1fd service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:21.436089 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1774/3541] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:28:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:28:22.585257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edb8f3-8890-4af5-b87e-cf970a66f583 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:22.585767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edb8f3-8890-4af5-b87e-cf970a66f583 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:22.585864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edb8f3-8890-4af5-b87e-cf970a66f583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:22.616237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-95edb8f3-8890-4af5-b87e-cf970a66f583 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:22.617874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-95edb8f3-8890-4af5-b87e-cf970a66f583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:22.627469 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1768/3542] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:28:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:28:22.640513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbe1ec-da4a-4b0b-be0c-5df7075be1fd service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:22.652304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbe1ec-da4a-4b0b-be0c-5df7075be1fd service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:22.658096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06590327-88bc-4353-8c26-3521321639df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:22.658833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06590327-88bc-4353-8c26-3521321639df service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:22.660941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06590327-88bc-4353-8c26-3521321639df service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:22.662570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06590327-88bc-4353-8c26-3521321639df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:22.673402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06590327-88bc-4353-8c26-3521321639df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:22.675531 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06590327-88bc-4353-8c26-3521321639df service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:22.693617 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1775/3543] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:28:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:28:27.586848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edb8f3-8890-4af5-b87e-cf970a66f583 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:27.604044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edb8f3-8890-4af5-b87e-cf970a66f583 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:27.617464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6969f-995f-42fa-9f82-7986ffcc0faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:27.618748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6969f-995f-42fa-9f82-7986ffcc0faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:27.619267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6969f-995f-42fa-9f82-7986ffcc0faa admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:27.620052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6969f-995f-42fa-9f82-7986ffcc0faa admin admin] PATH_INFO: `/v3/users/bf9fc52ad7754d9d9667e90b0e65f9db` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:27.621854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6969f-995f-42fa-9f82-7986ffcc0faa admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf9fc52ad7754d9d9667e90b0e65f9db)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:27.627221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6969f-995f-42fa-9f82-7986ffcc0faa admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:27.926116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-96f6969f-995f-42fa-9f82-7986ffcc0faa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf9fc52ad7754d9d9667e90b0e65f9db'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:27.939541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-96f6969f-995f-42fa-9f82-7986ffcc0faa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf9fc52ad7754d9d9667e90b0e65f9db'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:27.940338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-96f6969f-995f-42fa-9f82-7986ffcc0faa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf9fc52ad7754d9d9667e90b0e65f9db'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:27.948261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-96f6969f-995f-42fa-9f82-7986ffcc0faa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf9fc52ad7754d9d9667e90b0e65f9db'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:28.122172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-96f6969f-995f-42fa-9f82-7986ffcc0faa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf9fc52ad7754d9d9667e90b0e65f9db'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:28.131719 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1769/3544] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:28:27 2022] DELETE /identity/v3/users/bf9fc52ad7754d9d9667e90b0e65f9db => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:28:28.746992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06590327-88bc-4353-8c26-3521321639df service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:28.780354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06590327-88bc-4353-8c26-3521321639df service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:28.906803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a338b3-16e2-40bc-aa2b-750d88f3ea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:28.908200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a338b3-16e2-40bc-aa2b-750d88f3ea4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:28.908864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a338b3-16e2-40bc-aa2b-750d88f3ea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:28.909344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a338b3-16e2-40bc-aa2b-750d88f3ea4b admin admin] PATH_INFO: `/v3/projects/4b3cbda8aaf0451ea40060916319a0c2` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:28.910928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a338b3-16e2-40bc-aa2b-750d88f3ea4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b3cbda8aaf0451ea40060916319a0c2)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:28.916352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a338b3-16e2-40bc-aa2b-750d88f3ea4b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:29.169611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-12a338b3-16e2-40bc-aa2b-750d88f3ea4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b3cbda8aaf0451ea40060916319a0c2', 'request_id': 'req-12a338b3-16e2-40bc-aa2b-750d88f3ea4b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:29.178820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-12a338b3-16e2-40bc-aa2b-750d88f3ea4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b3cbda8aaf0451ea40060916319a0c2', 'request_id': 'req-12a338b3-16e2-40bc-aa2b-750d88f3ea4b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:29.305001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-12a338b3-16e2-40bc-aa2b-750d88f3ea4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b3cbda8aaf0451ea40060916319a0c2', 'request_id': 'req-12a338b3-16e2-40bc-aa2b-750d88f3ea4b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:29.327136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-12a338b3-16e2-40bc-aa2b-750d88f3ea4b admin admin] The token cache is being invalidate because project 4b3cbda8aaf0451ea40060916319a0c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:28:29.327441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-12a338b3-16e2-40bc-aa2b-750d88f3ea4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:29.328181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-12a338b3-16e2-40bc-aa2b-750d88f3ea4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:29.330647 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1776/3545] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:28:28 2022] DELETE /identity/v3/projects/4b3cbda8aaf0451ea40060916319a0c2 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:28:29.337549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f649d-7013-4c58-bfd6-08f685c29a3b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:29.338120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f649d-7013-4c58-bfd6-08f685c29a3b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:29.338120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f649d-7013-4c58-bfd6-08f685c29a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:29.358725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e30f649d-7013-4c58-bfd6-08f685c29a3b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:29.360803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e30f649d-7013-4c58-bfd6-08f685c29a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:29.430682 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1770/3546] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:28:29.442421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e634036-fc68-4309-b243-f084c1e43441 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:29.442714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e634036-fc68-4309-b243-f084c1e43441 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:29.443490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e634036-fc68-4309-b243-f084c1e43441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:29.466077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0e634036-fc68-4309-b243-f084c1e43441 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:29.467529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0e634036-fc68-4309-b243-f084c1e43441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:29.487161 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1777/3547] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:28:29.490815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f649d-7013-4c58-bfd6-08f685c29a3b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:29.503134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f649d-7013-4c58-bfd6-08f685c29a3b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:29.518683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fe498-91e8-48b3-a586-de25ef566c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:29.518683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fe498-91e8-48b3-a586-de25ef566c5e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:29.518683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fe498-91e8-48b3-a586-de25ef566c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:29.518683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fe498-91e8-48b3-a586-de25ef566c5e admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:29.519287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fe498-91e8-48b3-a586-de25ef566c5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:28:29.519287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fe498-91e8-48b3-a586-de25ef566c5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:29.519287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fe498-91e8-48b3-a586-de25ef566c5e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:29.542774 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1771/3548] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:28:29.547130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e634036-fc68-4309-b243-f084c1e43441 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:29.560944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e634036-fc68-4309-b243-f084c1e43441 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:29.577262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39640099-393b-41f9-949d-0e46eb4cfbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:29.578259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39640099-393b-41f9-949d-0e46eb4cfbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:29.578728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39640099-393b-41f9-949d-0e46eb4cfbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:29.579342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39640099-393b-41f9-949d-0e46eb4cfbf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:29.580229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39640099-393b-41f9-949d-0e46eb4cfbf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:29.582417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39640099-393b-41f9-949d-0e46eb4cfbf3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:29.729731 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1778/3549] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:28:29 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:28:29.733916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fe498-91e8-48b3-a586-de25ef566c5e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:29.744819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fe498-91e8-48b3-a586-de25ef566c5e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:29.922818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa78d2-aa35-4547-86bb-0230d879496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:29.926935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa78d2-aa35-4547-86bb-0230d879496f admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:29.926935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa78d2-aa35-4547-86bb-0230d879496f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:29.927287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa78d2-aa35-4547-86bb-0230d879496f admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:29.927893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa78d2-aa35-4547-86bb-0230d879496f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:29.933237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa78d2-aa35-4547-86bb-0230d879496f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:30.053782 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1772/3550] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:28:29 2022] POST /identity/v3/users => generated 293 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:28:30.058259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39640099-393b-41f9-949d-0e46eb4cfbf3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:30.078007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39640099-393b-41f9-949d-0e46eb4cfbf3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:30.089129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b25bb-1614-4d45-a7f8-581ba7cc36f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:30.089816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b25bb-1614-4d45-a7f8-581ba7cc36f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:30.091888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b25bb-1614-4d45-a7f8-581ba7cc36f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:30.093272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b25bb-1614-4d45-a7f8-581ba7cc36f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:30.097940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b25bb-1614-4d45-a7f8-581ba7cc36f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:30.100450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b25bb-1614-4d45-a7f8-581ba7cc36f2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:30.139667 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1779/3551] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:28:30.142261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa78d2-aa35-4547-86bb-0230d879496f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:30.155579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa78d2-aa35-4547-86bb-0230d879496f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:30.169429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b84d5f-518a-4880-88e2-7bb0689b1e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:30.170161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b84d5f-518a-4880-88e2-7bb0689b1e5f admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:30.170412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b84d5f-518a-4880-88e2-7bb0689b1e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:30.170689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b84d5f-518a-4880-88e2-7bb0689b1e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:30.171436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b84d5f-518a-4880-88e2-7bb0689b1e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:30.173094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b84d5f-518a-4880-88e2-7bb0689b1e5f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:30.195718 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1773/3552] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:28:30.200077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b25bb-1614-4d45-a7f8-581ba7cc36f2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:30.220843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b25bb-1614-4d45-a7f8-581ba7cc36f2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:30.229390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cdc48-288f-4b88-b243-422e23ff6462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:30.230290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cdc48-288f-4b88-b243-422e23ff6462 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:30.230589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cdc48-288f-4b88-b243-422e23ff6462 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:30.230870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cdc48-288f-4b88-b243-422e23ff6462 admin admin] PATH_INFO: `/v3/projects/b9f28177488d47b8959c08125f6bd94d/users/23b1b2dd6190491393cdec41b865e427/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:30.267452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cdc48-288f-4b88-b243-422e23ff6462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f28177488d47b8959c08125f6bd94d, user_id=23b1b2dd6190491393cdec41b865e427, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:30.270544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cdc48-288f-4b88-b243-422e23ff6462 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:30.391126 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1780/3553] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:28:30 2022] PUT /identity/v3/projects/b9f28177488d47b8959c08125f6bd94d/users/23b1b2dd6190491393cdec41b865e427/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:28:30.396341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ecfc6-59a0-4310-860c-2301e8c1a224 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:30.397298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ecfc6-59a0-4310-860c-2301e8c1a224 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:30.397783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ecfc6-59a0-4310-860c-2301e8c1a224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:30.430610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-089ecfc6-59a0-4310-860c-2301e8c1a224 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:30.433352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-089ecfc6-59a0-4310-860c-2301e8c1a224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:30.541457 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1774/3554] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:28:30.551637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cdc48-288f-4b88-b243-422e23ff6462 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:30.555856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-653cdc48-288f-4b88-b243-422e23ff6462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:30.621483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cdc48-288f-4b88-b243-422e23ff6462 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:30.628106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d6e28-881e-425e-a97e-05645ed750ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:30.629886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d6e28-881e-425e-a97e-05645ed750ff service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:30.630987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d6e28-881e-425e-a97e-05645ed750ff service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:30.631510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d6e28-881e-425e-a97e-05645ed750ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:30.647039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d6e28-881e-425e-a97e-05645ed750ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:30.648848 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d6e28-881e-425e-a97e-05645ed750ff service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:30.661813 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1781/3555] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:28:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:28:37.557794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70a6ce-dcbb-4704-8138-28b3fecd34e1 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:37.558360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70a6ce-dcbb-4704-8138-28b3fecd34e1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:37.558689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70a6ce-dcbb-4704-8138-28b3fecd34e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:37.583485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ef70a6ce-dcbb-4704-8138-28b3fecd34e1 None None] MFA Rules not processed for user `3816b61af9864122a0b556581359f699`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:37.583485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ef70a6ce-dcbb-4704-8138-28b3fecd34e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:37.649505 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1775/3556] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:28:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:28:38.420497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c32ea-56b3-4c7d-9ea6-b4cc35563bc4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:38.421027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c32ea-56b3-4c7d-9ea6-b4cc35563bc4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:38.421287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c32ea-56b3-4c7d-9ea6-b4cc35563bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:38.440519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2c3c32ea-56b3-4c7d-9ea6-b4cc35563bc4 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:38.441747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2c3c32ea-56b3-4c7d-9ea6-b4cc35563bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:38.540523 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1782/3557] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:28:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:28:38.559681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70a6ce-dcbb-4704-8138-28b3fecd34e1 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:38.561149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ef70a6ce-dcbb-4704-8138-28b3fecd34e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:38.642057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70a6ce-dcbb-4704-8138-28b3fecd34e1 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:38.651998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a898eb-624f-4556-8c30-9240f6d4844c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:38.653327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a898eb-624f-4556-8c30-9240f6d4844c service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:38.653788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a898eb-624f-4556-8c30-9240f6d4844c service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:38.654442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a898eb-624f-4556-8c30-9240f6d4844c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:38.673201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a898eb-624f-4556-8c30-9240f6d4844c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:38.675586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a898eb-624f-4556-8c30-9240f6d4844c service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:38.687655 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1776/3558] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:28:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:28:39.414853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eb8c7-38f6-4148-a32c-b4d9ee9edd6b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:39.414853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eb8c7-38f6-4148-a32c-b4d9ee9edd6b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:39.415114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eb8c7-38f6-4148-a32c-b4d9ee9edd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:39.453606 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-615eb8c7-38f6-4148-a32c-b4d9ee9edd6b None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:39.456790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-615eb8c7-38f6-4148-a32c-b4d9ee9edd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:39.497787 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1783/3559] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:28:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:28:39.503236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a898eb-624f-4556-8c30-9240f6d4844c service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:39.511934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a898eb-624f-4556-8c30-9240f6d4844c service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:39.518802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43356c88-df60-43b4-b5bf-2a877da7cac8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:39.520108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43356c88-df60-43b4-b5bf-2a877da7cac8 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:39.520801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43356c88-df60-43b4-b5bf-2a877da7cac8 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:39.521363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43356c88-df60-43b4-b5bf-2a877da7cac8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:39.534821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43356c88-df60-43b4-b5bf-2a877da7cac8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:39.542879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43356c88-df60-43b4-b5bf-2a877da7cac8 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:39.556510 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1777/3560] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:28:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:28:40.144661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda6f32-75b2-47e0-aff9-254a0bd07cce None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:40.144936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda6f32-75b2-47e0-aff9-254a0bd07cce None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:40.145740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda6f32-75b2-47e0-aff9-254a0bd07cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:40.164466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8dda6f32-75b2-47e0-aff9-254a0bd07cce None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:40.165729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8dda6f32-75b2-47e0-aff9-254a0bd07cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:40.174356 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1784/3561] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:28:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:28:40.189443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43356c88-df60-43b4-b5bf-2a877da7cac8 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:40.210353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43356c88-df60-43b4-b5bf-2a877da7cac8 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:40.218813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0f030-85e6-46f2-8129-bf6f56642c70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:40.220578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0f030-85e6-46f2-8129-bf6f56642c70 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:40.220932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0f030-85e6-46f2-8129-bf6f56642c70 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:40.221289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0f030-85e6-46f2-8129-bf6f56642c70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:40.234598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0f030-85e6-46f2-8129-bf6f56642c70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:40.236352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0f030-85e6-46f2-8129-bf6f56642c70 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:40.249869 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1778/3562] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:28:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:28:40.803533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda6f32-75b2-47e0-aff9-254a0bd07cce None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:40.805118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8dda6f32-75b2-47e0-aff9-254a0bd07cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:40.824482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda6f32-75b2-47e0-aff9-254a0bd07cce None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:40.830511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ab1ef-fffd-4651-a9c3-f0cd7f23ecc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:40.832228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ab1ef-fffd-4651-a9c3-f0cd7f23ecc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:40.832847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ab1ef-fffd-4651-a9c3-f0cd7f23ecc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:40.833295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ab1ef-fffd-4651-a9c3-f0cd7f23ecc7 admin admin] PATH_INFO: `/v3/users/7314aa0ae67d468697a4160ee008991f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:40.838284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ab1ef-fffd-4651-a9c3-f0cd7f23ecc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7314aa0ae67d468697a4160ee008991f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:40.840879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ab1ef-fffd-4651-a9c3-f0cd7f23ecc7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:41.091816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5a6ab1ef-fffd-4651-a9c3-f0cd7f23ecc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7314aa0ae67d468697a4160ee008991f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:41.118928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5a6ab1ef-fffd-4651-a9c3-f0cd7f23ecc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7314aa0ae67d468697a4160ee008991f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:41.120317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5a6ab1ef-fffd-4651-a9c3-f0cd7f23ecc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7314aa0ae67d468697a4160ee008991f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:41.133677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5a6ab1ef-fffd-4651-a9c3-f0cd7f23ecc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7314aa0ae67d468697a4160ee008991f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:41.213950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5a6ab1ef-fffd-4651-a9c3-f0cd7f23ecc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7314aa0ae67d468697a4160ee008991f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:41.229888 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1785/3563] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:28:40 2022] DELETE /identity/v3/users/7314aa0ae67d468697a4160ee008991f => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:28:41.234310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a521e-5705-4cb3-be25-873dc57e9f36 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:41.234834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a521e-5705-4cb3-be25-873dc57e9f36 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:41.234942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a521e-5705-4cb3-be25-873dc57e9f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:41.269330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d14a521e-5705-4cb3-be25-873dc57e9f36 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:41.270956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d14a521e-5705-4cb3-be25-873dc57e9f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:41.396096 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1779/3564] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:28:41.411786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ab1ef-fffd-4651-a9c3-f0cd7f23ecc7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:41.413174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5a6ab1ef-fffd-4651-a9c3-f0cd7f23ecc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:41.597076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ab1ef-fffd-4651-a9c3-f0cd7f23ecc7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:41.602486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0e513-eff6-4f11-8b53-2918bbe6d5c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:41.603263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0e513-eff6-4f11-8b53-2918bbe6d5c2 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:41.605556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0e513-eff6-4f11-8b53-2918bbe6d5c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:41.605938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0e513-eff6-4f11-8b53-2918bbe6d5c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:41.673268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0e513-eff6-4f11-8b53-2918bbe6d5c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:41.674885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0e513-eff6-4f11-8b53-2918bbe6d5c2 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:41.700979 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1786/3565] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:28:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:28:42.082374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c215db-c438-49c3-b05c-621002f6b261 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:42.084617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c215db-c438-49c3-b05c-621002f6b261 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:42.085100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c215db-c438-49c3-b05c-621002f6b261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:42.136193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c0c215db-c438-49c3-b05c-621002f6b261 None None] MFA Rules not processed for user `23b1b2dd6190491393cdec41b865e427`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:42.137803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c0c215db-c438-49c3-b05c-621002f6b261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:42.262217 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1780/3566] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:28:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:28:42.274540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0e513-eff6-4f11-8b53-2918bbe6d5c2 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:42.276365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2ea0e513-eff6-4f11-8b53-2918bbe6d5c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:42.284867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c215db-c438-49c3-b05c-621002f6b261 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:42.288046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c0c215db-c438-49c3-b05c-621002f6b261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:42.304370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c215db-c438-49c3-b05c-621002f6b261 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:42.309926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a825c5e-b153-4c08-8932-883c866d85a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:42.311462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a825c5e-b153-4c08-8932-883c866d85a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:42.312013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a825c5e-b153-4c08-8932-883c866d85a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:42.312473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a825c5e-b153-4c08-8932-883c866d85a6 admin admin] PATH_INFO: `/v3/projects/4f82450170e949c3b8bbfa5f5789e871` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:42.315558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a825c5e-b153-4c08-8932-883c866d85a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f82450170e949c3b8bbfa5f5789e871)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:42.318124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a825c5e-b153-4c08-8932-883c866d85a6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:42.385494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0e513-eff6-4f11-8b53-2918bbe6d5c2 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:42.393048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdda300-61d5-417a-8f1c-68cc62fda4d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:42.393732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdda300-61d5-417a-8f1c-68cc62fda4d7 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:42.394164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdda300-61d5-417a-8f1c-68cc62fda4d7 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:42.394639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdda300-61d5-417a-8f1c-68cc62fda4d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:42.404030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdda300-61d5-417a-8f1c-68cc62fda4d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:42.405918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdda300-61d5-417a-8f1c-68cc62fda4d7 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:42.419449 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1787/3567] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:28:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:28:42.527519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a825c5e-b153-4c08-8932-883c866d85a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f82450170e949c3b8bbfa5f5789e871', 'request_id': 'req-5a825c5e-b153-4c08-8932-883c866d85a6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:42.609868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a825c5e-b153-4c08-8932-883c866d85a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f82450170e949c3b8bbfa5f5789e871', 'request_id': 'req-5a825c5e-b153-4c08-8932-883c866d85a6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:42.617069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a825c5e-b153-4c08-8932-883c866d85a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f82450170e949c3b8bbfa5f5789e871', 'request_id': 'req-5a825c5e-b153-4c08-8932-883c866d85a6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:42.632931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a825c5e-b153-4c08-8932-883c866d85a6 admin admin] The token cache is being invalidate because project 4f82450170e949c3b8bbfa5f5789e871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:28:42.633534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a825c5e-b153-4c08-8932-883c866d85a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:42.635844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a825c5e-b153-4c08-8932-883c866d85a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:42.640817 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1781/3568] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:28:42 2022] DELETE /identity/v3/projects/4f82450170e949c3b8bbfa5f5789e871 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:28:42.647013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8dba3-e1a2-4527-ad38-7701b3dd8af7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:42.647666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8dba3-e1a2-4527-ad38-7701b3dd8af7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:42.647809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8dba3-e1a2-4527-ad38-7701b3dd8af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:42.673614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d3a8dba3-e1a2-4527-ad38-7701b3dd8af7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:42.675952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d3a8dba3-e1a2-4527-ad38-7701b3dd8af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:42.762891 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1788/3569] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:28:42.770944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa927f91-5cf8-48f6-bae5-003990e105ee None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:42.772321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa927f91-5cf8-48f6-bae5-003990e105ee None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:42.773516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa927f91-5cf8-48f6-bae5-003990e105ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:42.802999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fa927f91-5cf8-48f6-bae5-003990e105ee None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:42.804256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fa927f91-5cf8-48f6-bae5-003990e105ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:42.815635 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1782/3570] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:28:42.820312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8dba3-e1a2-4527-ad38-7701b3dd8af7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:42.832396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8dba3-e1a2-4527-ad38-7701b3dd8af7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:42.838704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05877901-3da8-4253-9f2e-10104f1029bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:42.840930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05877901-3da8-4253-9f2e-10104f1029bb admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:42.841178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05877901-3da8-4253-9f2e-10104f1029bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:42.841531 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05877901-3da8-4253-9f2e-10104f1029bb admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:42.842300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05877901-3da8-4253-9f2e-10104f1029bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:28:42.842622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05877901-3da8-4253-9f2e-10104f1029bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:42.844337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05877901-3da8-4253-9f2e-10104f1029bb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:42.872336 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1789/3571] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:28:42.889889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa927f91-5cf8-48f6-bae5-003990e105ee None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:42.900487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa927f91-5cf8-48f6-bae5-003990e105ee None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:42.908671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6cbb7-bed5-42a0-9158-9748f819c80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:42.909637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6cbb7-bed5-42a0-9158-9748f819c80f admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:42.910183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6cbb7-bed5-42a0-9158-9748f819c80f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:42.910620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6cbb7-bed5-42a0-9158-9748f819c80f admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:42.911497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6cbb7-bed5-42a0-9158-9748f819c80f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:42.913664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6cbb7-bed5-42a0-9158-9748f819c80f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:43.048975 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1783/3572] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:28:42 2022] POST /identity/v3/projects => generated 405 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:28:43.053648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05877901-3da8-4253-9f2e-10104f1029bb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:43.069265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05877901-3da8-4253-9f2e-10104f1029bb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:43.152929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d2efc-f279-4d08-8a5e-da2207871bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:43.155251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d2efc-f279-4d08-8a5e-da2207871bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:43.155251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d2efc-f279-4d08-8a5e-da2207871bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:43.155251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d2efc-f279-4d08-8a5e-da2207871bd0 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:43.155251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d2efc-f279-4d08-8a5e-da2207871bd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:43.157309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d2efc-f279-4d08-8a5e-da2207871bd0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:43.294631 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1790/3573] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:28:43 2022] POST /identity/v3/users => generated 303 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:28:43.295290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6cbb7-bed5-42a0-9158-9748f819c80f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:43.308266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6cbb7-bed5-42a0-9158-9748f819c80f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:43.351242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863671a-35af-4505-86db-289e58da352c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:43.351939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863671a-35af-4505-86db-289e58da352c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:43.352228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863671a-35af-4505-86db-289e58da352c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:43.352510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863671a-35af-4505-86db-289e58da352c admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:43.353383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863671a-35af-4505-86db-289e58da352c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:43.359427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863671a-35af-4505-86db-289e58da352c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:43.397905 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1784/3574] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:28:43.402097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d2efc-f279-4d08-8a5e-da2207871bd0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:43.416213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d2efc-f279-4d08-8a5e-da2207871bd0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:43.425716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b835b-cd44-486b-94ba-4fc2440caaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:43.428055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b835b-cd44-486b-94ba-4fc2440caaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:43.428843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b835b-cd44-486b-94ba-4fc2440caaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:43.429213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b835b-cd44-486b-94ba-4fc2440caaf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:43.430073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b835b-cd44-486b-94ba-4fc2440caaf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:43.433135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b835b-cd44-486b-94ba-4fc2440caaf2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:43.467972 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1791/3575] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:28:43.470354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863671a-35af-4505-86db-289e58da352c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:43.482996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863671a-35af-4505-86db-289e58da352c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:43.488501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fd58e-612f-4ccb-aedf-f3be82df4fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:43.490151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fd58e-612f-4ccb-aedf-f3be82df4fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:43.490430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fd58e-612f-4ccb-aedf-f3be82df4fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:43.490753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fd58e-612f-4ccb-aedf-f3be82df4fc5 admin admin] PATH_INFO: `/v3/projects/0b653373f3454629b2b4384e1897ab4d/users/439f2dbfb91247c783506fc82b0bc6d5/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:43.520402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fd58e-612f-4ccb-aedf-f3be82df4fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b653373f3454629b2b4384e1897ab4d, user_id=439f2dbfb91247c783506fc82b0bc6d5, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:43.523822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fd58e-612f-4ccb-aedf-f3be82df4fc5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:43.656526 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1785/3576] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:28:43 2022] PUT /identity/v3/projects/0b653373f3454629b2b4384e1897ab4d/users/439f2dbfb91247c783506fc82b0bc6d5/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:28:43.657318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673855e-d25b-42a8-962d-33117d65c9b1 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:43.657674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673855e-d25b-42a8-962d-33117d65c9b1 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:43.657962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673855e-d25b-42a8-962d-33117d65c9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:43.689140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b673855e-d25b-42a8-962d-33117d65c9b1 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:43.695887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b673855e-d25b-42a8-962d-33117d65c9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:43.767665 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1792/3577] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:28:43.778935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fd58e-612f-4ccb-aedf-f3be82df4fc5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:43.781025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ca9fd58e-612f-4ccb-aedf-f3be82df4fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:43.866292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fd58e-612f-4ccb-aedf-f3be82df4fc5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:43.870040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f82c8-9f93-4444-bb44-fca4d52a0018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:43.870694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f82c8-9f93-4444-bb44-fca4d52a0018 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:43.870975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f82c8-9f93-4444-bb44-fca4d52a0018 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:43.871256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f82c8-9f93-4444-bb44-fca4d52a0018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:43.881907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f82c8-9f93-4444-bb44-fca4d52a0018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:43.883393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f82c8-9f93-4444-bb44-fca4d52a0018 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:43.894656 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1786/3578] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:28:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:28:47.427486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a6eb8-6f39-4dd4-a4c9-db4fc3ae7d20 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:47.429569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a6eb8-6f39-4dd4-a4c9-db4fc3ae7d20 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:47.430110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a6eb8-6f39-4dd4-a4c9-db4fc3ae7d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:47.475035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-949a6eb8-6f39-4dd4-a4c9-db4fc3ae7d20 None None] MFA Rules not processed for user `439f2dbfb91247c783506fc82b0bc6d5`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:47.478420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-949a6eb8-6f39-4dd4-a4c9-db4fc3ae7d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:47.573633 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1793/3579] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:28:47 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:28:47.582175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f82c8-9f93-4444-bb44-fca4d52a0018 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:47.584137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e60f82c8-9f93-4444-bb44-fca4d52a0018 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:47.770671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f82c8-9f93-4444-bb44-fca4d52a0018 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:47.777848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e0785-8fe9-4b20-8763-5a5e26521ce1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:47.781571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e0785-8fe9-4b20-8763-5a5e26521ce1 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:47.781571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e0785-8fe9-4b20-8763-5a5e26521ce1 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:47.781571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e0785-8fe9-4b20-8763-5a5e26521ce1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:47.789850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e0785-8fe9-4b20-8763-5a5e26521ce1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:47.792237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e0785-8fe9-4b20-8763-5a5e26521ce1 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:47.805117 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1787/3580] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:28:47 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:28:53.496466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a6eb8-6f39-4dd4-a4c9-db4fc3ae7d20 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:53.498042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-949a6eb8-6f39-4dd4-a4c9-db4fc3ae7d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:53.517417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a6eb8-6f39-4dd4-a4c9-db4fc3ae7d20 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:53.520100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf3be4-ea1b-4fe1-8b31-e48cb73212a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:53.521000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf3be4-ea1b-4fe1-8b31-e48cb73212a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:53.521287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf3be4-ea1b-4fe1-8b31-e48cb73212a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:53.521580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf3be4-ea1b-4fe1-8b31-e48cb73212a6 admin admin] PATH_INFO: `/v3/users/5c68b3ca4d28460086ac24784cc48134` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:53.522754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf3be4-ea1b-4fe1-8b31-e48cb73212a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c68b3ca4d28460086ac24784cc48134)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:53.524820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf3be4-ea1b-4fe1-8b31-e48cb73212a6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:53.770469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-68bf3be4-ea1b-4fe1-8b31-e48cb73212a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c68b3ca4d28460086ac24784cc48134'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:53.797948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-68bf3be4-ea1b-4fe1-8b31-e48cb73212a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c68b3ca4d28460086ac24784cc48134'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:53.798858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-68bf3be4-ea1b-4fe1-8b31-e48cb73212a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c68b3ca4d28460086ac24784cc48134'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:53.807631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-68bf3be4-ea1b-4fe1-8b31-e48cb73212a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c68b3ca4d28460086ac24784cc48134'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:53.910713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-68bf3be4-ea1b-4fe1-8b31-e48cb73212a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c68b3ca4d28460086ac24784cc48134'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:53.918416 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1794/3581] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:28:53 2022] DELETE /identity/v3/users/5c68b3ca4d28460086ac24784cc48134 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:28:53.923531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894a429-c87a-47d3-ab42-d8deae46f3f4 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:53.924042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894a429-c87a-47d3-ab42-d8deae46f3f4 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:53.924149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894a429-c87a-47d3-ab42-d8deae46f3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:53.948627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d894a429-c87a-47d3-ab42-d8deae46f3f4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:53.949859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d894a429-c87a-47d3-ab42-d8deae46f3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:54.033102 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1788/3582] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:28:54.048267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf3be4-ea1b-4fe1-8b31-e48cb73212a6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:54.050002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-68bf3be4-ea1b-4fe1-8b31-e48cb73212a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:54.145147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf3be4-ea1b-4fe1-8b31-e48cb73212a6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:54.149769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5cbba-3451-4b7a-af76-ddfda93e79e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:54.152590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5cbba-3451-4b7a-af76-ddfda93e79e4 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:54.152590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5cbba-3451-4b7a-af76-ddfda93e79e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:54.152590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5cbba-3451-4b7a-af76-ddfda93e79e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:54.162531 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5cbba-3451-4b7a-af76-ddfda93e79e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:54.163990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5cbba-3451-4b7a-af76-ddfda93e79e4 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:54.174307 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1795/3583] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:28:54.552419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894a429-c87a-47d3-ab42-d8deae46f3f4 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:54.554307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d894a429-c87a-47d3-ab42-d8deae46f3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:54.568479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894a429-c87a-47d3-ab42-d8deae46f3f4 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:54.574410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc838c4-847e-402d-8c30-fb2a01d83e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:54.577581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc838c4-847e-402d-8c30-fb2a01d83e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:54.577581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc838c4-847e-402d-8c30-fb2a01d83e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:54.577581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc838c4-847e-402d-8c30-fb2a01d83e05 admin admin] PATH_INFO: `/v3/projects/ed36dcd8895a4ac5b50bc12ce5b17048` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:54.578977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc838c4-847e-402d-8c30-fb2a01d83e05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed36dcd8895a4ac5b50bc12ce5b17048)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:54.581929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc838c4-847e-402d-8c30-fb2a01d83e05 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:54.722745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5bc838c4-847e-402d-8c30-fb2a01d83e05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed36dcd8895a4ac5b50bc12ce5b17048', 'request_id': 'req-5bc838c4-847e-402d-8c30-fb2a01d83e05'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:54.805517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5bc838c4-847e-402d-8c30-fb2a01d83e05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed36dcd8895a4ac5b50bc12ce5b17048', 'request_id': 'req-5bc838c4-847e-402d-8c30-fb2a01d83e05'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:54.812420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5bc838c4-847e-402d-8c30-fb2a01d83e05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed36dcd8895a4ac5b50bc12ce5b17048', 'request_id': 'req-5bc838c4-847e-402d-8c30-fb2a01d83e05'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:54.824963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5bc838c4-847e-402d-8c30-fb2a01d83e05 admin admin] The token cache is being invalidate because project ed36dcd8895a4ac5b50bc12ce5b17048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:28:54.825973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5bc838c4-847e-402d-8c30-fb2a01d83e05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:54.826871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5bc838c4-847e-402d-8c30-fb2a01d83e05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:54.828702 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1789/3584] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:28:54 2022] DELETE /identity/v3/projects/ed36dcd8895a4ac5b50bc12ce5b17048 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:28:54.833790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bdf3c-9d44-4695-b42f-21e210f86c9f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:54.834309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bdf3c-9d44-4695-b42f-21e210f86c9f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:54.834442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bdf3c-9d44-4695-b42f-21e210f86c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:54.855522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-957bdf3c-9d44-4695-b42f-21e210f86c9f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:54.855522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-957bdf3c-9d44-4695-b42f-21e210f86c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:54.923566 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1796/3585] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:28:54.931859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117af25-f882-40e7-9552-d9e105480db5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:54.933179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117af25-f882-40e7-9552-d9e105480db5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:54.934268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117af25-f882-40e7-9552-d9e105480db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:54.955591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9117af25-f882-40e7-9552-d9e105480db5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:54.957068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9117af25-f882-40e7-9552-d9e105480db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:54.965837 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1790/3586] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:28:54.969783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bdf3c-9d44-4695-b42f-21e210f86c9f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:54.989934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bdf3c-9d44-4695-b42f-21e210f86c9f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:55.003401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be5f46-a1a1-48b2-ab44-3a82b36dd32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:55.005293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be5f46-a1a1-48b2-ab44-3a82b36dd32d admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:55.005597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be5f46-a1a1-48b2-ab44-3a82b36dd32d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:55.005916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be5f46-a1a1-48b2-ab44-3a82b36dd32d admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:55.006739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be5f46-a1a1-48b2-ab44-3a82b36dd32d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:28:55.007066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be5f46-a1a1-48b2-ab44-3a82b36dd32d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:55.012429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be5f46-a1a1-48b2-ab44-3a82b36dd32d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:55.033346 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1797/3587] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:28:55.037808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117af25-f882-40e7-9552-d9e105480db5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:55.051689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117af25-f882-40e7-9552-d9e105480db5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:55.057701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac887e7-0e70-49e5-b5b2-d07b5389c949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:55.058649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac887e7-0e70-49e5-b5b2-d07b5389c949 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:55.058931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac887e7-0e70-49e5-b5b2-d07b5389c949 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:55.059375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac887e7-0e70-49e5-b5b2-d07b5389c949 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:55.060229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac887e7-0e70-49e5-b5b2-d07b5389c949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:55.063350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac887e7-0e70-49e5-b5b2-d07b5389c949 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:55.147366 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1791/3588] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:28:55 2022] POST /identity/v3/projects => generated 359 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:28:55.151765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be5f46-a1a1-48b2-ab44-3a82b36dd32d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:55.163316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be5f46-a1a1-48b2-ab44-3a82b36dd32d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:55.241809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa950d-b441-4528-b59f-5ceadbfe20aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:55.242853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa950d-b441-4528-b59f-5ceadbfe20aa admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:55.243372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa950d-b441-4528-b59f-5ceadbfe20aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:55.243663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa950d-b441-4528-b59f-5ceadbfe20aa admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:55.244417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa950d-b441-4528-b59f-5ceadbfe20aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:55.246447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa950d-b441-4528-b59f-5ceadbfe20aa admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:55.407882 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1798/3589] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:28:55 2022] POST /identity/v3/users => generated 280 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:28:55.412574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac887e7-0e70-49e5-b5b2-d07b5389c949 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:55.426665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac887e7-0e70-49e5-b5b2-d07b5389c949 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:55.432135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65a037-9509-4f64-a6f1-2030ddc5debc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:55.433080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65a037-9509-4f64-a6f1-2030ddc5debc admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:55.433364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65a037-9509-4f64-a6f1-2030ddc5debc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:55.433816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65a037-9509-4f64-a6f1-2030ddc5debc admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:55.434631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65a037-9509-4f64-a6f1-2030ddc5debc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:55.436274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65a037-9509-4f64-a6f1-2030ddc5debc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:55.448699 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1792/3590] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:28:55.452329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa950d-b441-4528-b59f-5ceadbfe20aa admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:55.462542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa950d-b441-4528-b59f-5ceadbfe20aa admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:55.467460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62640bd4-971a-491a-b3ff-1eca04259fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:55.468165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62640bd4-971a-491a-b3ff-1eca04259fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:55.468452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62640bd4-971a-491a-b3ff-1eca04259fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:55.468777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62640bd4-971a-491a-b3ff-1eca04259fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:55.469523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62640bd4-971a-491a-b3ff-1eca04259fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:55.471121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62640bd4-971a-491a-b3ff-1eca04259fa8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:55.481938 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1799/3591] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:28:55.486148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65a037-9509-4f64-a6f1-2030ddc5debc admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:55.497882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65a037-9509-4f64-a6f1-2030ddc5debc admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:55.503664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075435bd-feed-4f30-b420-61e50f07698a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:55.504898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075435bd-feed-4f30-b420-61e50f07698a admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:55.505177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075435bd-feed-4f30-b420-61e50f07698a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:55.505627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075435bd-feed-4f30-b420-61e50f07698a admin admin] PATH_INFO: `/v3/projects/e65507ade2ab4a2e9fb5dd982a278324/users/42a74a50cf644fe9a2ced2d319ff3e7b/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:55.527274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075435bd-feed-4f30-b420-61e50f07698a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65507ade2ab4a2e9fb5dd982a278324, user_id=42a74a50cf644fe9a2ced2d319ff3e7b, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:55.531047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075435bd-feed-4f30-b420-61e50f07698a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:55.619754 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1793/3592] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:28:55 2022] PUT /identity/v3/projects/e65507ade2ab4a2e9fb5dd982a278324/users/42a74a50cf644fe9a2ced2d319ff3e7b/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:28:55.700449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f3324-23f7-49df-ac0b-4ffee46ca4de None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:55.700777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f3324-23f7-49df-ac0b-4ffee46ca4de None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:55.701059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f3324-23f7-49df-ac0b-4ffee46ca4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:55.735175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-1c9f3324-23f7-49df-ac0b-4ffee46ca4de None None] MFA Rules not processed for user `42a74a50cf644fe9a2ced2d319ff3e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:55.736657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1c9f3324-23f7-49df-ac0b-4ffee46ca4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:55.822331 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1800/3593] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:28:55 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:28:55.833916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075435bd-feed-4f30-b420-61e50f07698a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:55.835729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-075435bd-feed-4f30-b420-61e50f07698a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:55.910781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075435bd-feed-4f30-b420-61e50f07698a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:55.910781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1e1ac-3ec6-4fc2-8a7e-c28215f81e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:55.910781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1e1ac-3ec6-4fc2-8a7e-c28215f81e5d service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:55.910781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1e1ac-3ec6-4fc2-8a7e-c28215f81e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:55.911239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1e1ac-3ec6-4fc2-8a7e-c28215f81e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:55.920920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1e1ac-3ec6-4fc2-8a7e-c28215f81e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:55.922436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1e1ac-3ec6-4fc2-8a7e-c28215f81e5d service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:55.932535 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1794/3594] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:28:55 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:28:57.295093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f3324-23f7-49df-ac0b-4ffee46ca4de None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:57.297218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1c9f3324-23f7-49df-ac0b-4ffee46ca4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:57.374854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f3324-23f7-49df-ac0b-4ffee46ca4de None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:57.380501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb814a4a-af9a-4cc5-b69f-a847adda1030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:57.381665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb814a4a-af9a-4cc5-b69f-a847adda1030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:57.381946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb814a4a-af9a-4cc5-b69f-a847adda1030 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:57.382220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb814a4a-af9a-4cc5-b69f-a847adda1030 admin admin] PATH_INFO: `/v3/users/439f2dbfb91247c783506fc82b0bc6d5` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:57.383412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb814a4a-af9a-4cc5-b69f-a847adda1030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=439f2dbfb91247c783506fc82b0bc6d5)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:57.385448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb814a4a-af9a-4cc5-b69f-a847adda1030 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:57.630574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fb814a4a-af9a-4cc5-b69f-a847adda1030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '439f2dbfb91247c783506fc82b0bc6d5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:57.643503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fb814a4a-af9a-4cc5-b69f-a847adda1030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '439f2dbfb91247c783506fc82b0bc6d5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:57.644307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fb814a4a-af9a-4cc5-b69f-a847adda1030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '439f2dbfb91247c783506fc82b0bc6d5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:57.651818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fb814a4a-af9a-4cc5-b69f-a847adda1030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '439f2dbfb91247c783506fc82b0bc6d5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:57.744135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fb814a4a-af9a-4cc5-b69f-a847adda1030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '439f2dbfb91247c783506fc82b0bc6d5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:57.752114 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1801/3595] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:28:57 2022] DELETE /identity/v3/users/439f2dbfb91247c783506fc82b0bc6d5 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:28:58.419452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1e1ac-3ec6-4fc2-8a7e-c28215f81e5d service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:58.432167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1e1ac-3ec6-4fc2-8a7e-c28215f81e5d service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:58.520127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5764cf6-ffc3-472b-8196-97684f574fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:58.521987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5764cf6-ffc3-472b-8196-97684f574fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:58.522508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5764cf6-ffc3-472b-8196-97684f574fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:58.523012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5764cf6-ffc3-472b-8196-97684f574fc1 admin admin] PATH_INFO: `/v3/projects/0b653373f3454629b2b4384e1897ab4d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:58.524375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5764cf6-ffc3-472b-8196-97684f574fc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b653373f3454629b2b4384e1897ab4d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:58.526511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5764cf6-ffc3-472b-8196-97684f574fc1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:58.644202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c5764cf6-ffc3-472b-8196-97684f574fc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b653373f3454629b2b4384e1897ab4d', 'request_id': 'req-c5764cf6-ffc3-472b-8196-97684f574fc1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:58.742680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c5764cf6-ffc3-472b-8196-97684f574fc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b653373f3454629b2b4384e1897ab4d', 'request_id': 'req-c5764cf6-ffc3-472b-8196-97684f574fc1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:58.753234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c5764cf6-ffc3-472b-8196-97684f574fc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b653373f3454629b2b4384e1897ab4d', 'request_id': 'req-c5764cf6-ffc3-472b-8196-97684f574fc1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:58.768858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c5764cf6-ffc3-472b-8196-97684f574fc1 admin admin] The token cache is being invalidate because project 0b653373f3454629b2b4384e1897ab4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:28:58.769272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c5764cf6-ffc3-472b-8196-97684f574fc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:58.770734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c5764cf6-ffc3-472b-8196-97684f574fc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:28:58.773106 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1795/3596] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:28:58 2022] DELETE /identity/v3/projects/0b653373f3454629b2b4384e1897ab4d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:28:58.778167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcaae52-e6e1-4e0a-a827-4cb4a357f5df None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:58.778744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcaae52-e6e1-4e0a-a827-4cb4a357f5df None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:58.778744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcaae52-e6e1-4e0a-a827-4cb4a357f5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:58.804053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-efcaae52-e6e1-4e0a-a827-4cb4a357f5df None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:58.805844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-efcaae52-e6e1-4e0a-a827-4cb4a357f5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:58.895629 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1802/3597] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:28:58.904697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd1a36-3dc3-4564-be0e-e4c923eb7606 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:58.905232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd1a36-3dc3-4564-be0e-e4c923eb7606 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:58.905825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd1a36-3dc3-4564-be0e-e4c923eb7606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:58.933593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-60fd1a36-3dc3-4564-be0e-e4c923eb7606 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:58.935339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-60fd1a36-3dc3-4564-be0e-e4c923eb7606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:58.946661 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1796/3598] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:28:58.951516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcaae52-e6e1-4e0a-a827-4cb4a357f5df None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:58.969650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcaae52-e6e1-4e0a-a827-4cb4a357f5df None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:58.975092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295f8d7-48b2-4a3f-83dd-9dcc39b64a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:58.977103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295f8d7-48b2-4a3f-83dd-9dcc39b64a22 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:58.977591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295f8d7-48b2-4a3f-83dd-9dcc39b64a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:58.978048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295f8d7-48b2-4a3f-83dd-9dcc39b64a22 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:58.979977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295f8d7-48b2-4a3f-83dd-9dcc39b64a22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:28:58.980585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295f8d7-48b2-4a3f-83dd-9dcc39b64a22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:58.984549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295f8d7-48b2-4a3f-83dd-9dcc39b64a22 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:59.001215 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1803/3599] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:28:59.005991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd1a36-3dc3-4564-be0e-e4c923eb7606 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:59.018589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd1a36-3dc3-4564-be0e-e4c923eb7606 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:59.025895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca75b5f-f4c7-4bb2-b017-2ecc6783ba19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:59.026730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca75b5f-f4c7-4bb2-b017-2ecc6783ba19 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:59.027125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca75b5f-f4c7-4bb2-b017-2ecc6783ba19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:59.027665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca75b5f-f4c7-4bb2-b017-2ecc6783ba19 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:59.028637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca75b5f-f4c7-4bb2-b017-2ecc6783ba19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:59.031204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca75b5f-f4c7-4bb2-b017-2ecc6783ba19 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:59.165390 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1797/3600] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:28:59 2022] POST /identity/v3/projects => generated 393 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:28:59.171598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295f8d7-48b2-4a3f-83dd-9dcc39b64a22 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:59.201753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295f8d7-48b2-4a3f-83dd-9dcc39b64a22 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:59.346843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b56d2f-9236-414a-a8df-9e27beead5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:59.350959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b56d2f-9236-414a-a8df-9e27beead5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:59.350959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b56d2f-9236-414a-a8df-9e27beead5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:59.350959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b56d2f-9236-414a-a8df-9e27beead5e8 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:59.350959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b56d2f-9236-414a-a8df-9e27beead5e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:59.352044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b56d2f-9236-414a-a8df-9e27beead5e8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:59.485843 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1804/3601] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:28:59 2022] POST /identity/v3/users => generated 297 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:28:59.486786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca75b5f-f4c7-4bb2-b017-2ecc6783ba19 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:59.506818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca75b5f-f4c7-4bb2-b017-2ecc6783ba19 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:59.507692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb6743-d05b-4496-8c53-411825f9d166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:59.508565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb6743-d05b-4496-8c53-411825f9d166 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:59.509868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb6743-d05b-4496-8c53-411825f9d166 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:59.510159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb6743-d05b-4496-8c53-411825f9d166 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:59.510934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb6743-d05b-4496-8c53-411825f9d166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:59.512582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb6743-d05b-4496-8c53-411825f9d166 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:59.533578 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1798/3602] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:28:59.534190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b56d2f-9236-414a-a8df-9e27beead5e8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:59.554635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b56d2f-9236-414a-a8df-9e27beead5e8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:59.565641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62494985-83dd-49ac-bc67-24253c91140f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:59.567390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62494985-83dd-49ac-bc67-24253c91140f admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:59.568677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62494985-83dd-49ac-bc67-24253c91140f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:59.570210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62494985-83dd-49ac-bc67-24253c91140f admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:59.571566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62494985-83dd-49ac-bc67-24253c91140f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:59.576406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62494985-83dd-49ac-bc67-24253c91140f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:59.605901 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1805/3603] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:28:59.611701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb6743-d05b-4496-8c53-411825f9d166 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:28:59.638084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb6743-d05b-4496-8c53-411825f9d166 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:28:59.651030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2090661-0dda-4af8-bd2e-ad6acb83cc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:28:59.651030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2090661-0dda-4af8-bd2e-ad6acb83cc03 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:59.651524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2090661-0dda-4af8-bd2e-ad6acb83cc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:59.651524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2090661-0dda-4af8-bd2e-ad6acb83cc03 admin admin] PATH_INFO: `/v3/projects/cfe06f14a5fd4dcf8012131cb8f9881b/users/8f257f118da5434fb67af3decc324dd7/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:59.680940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2090661-0dda-4af8-bd2e-ad6acb83cc03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe06f14a5fd4dcf8012131cb8f9881b, user_id=8f257f118da5434fb67af3decc324dd7, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:28:59.684036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2090661-0dda-4af8-bd2e-ad6acb83cc03 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:28:59.787261 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1799/3604] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:28:59 2022] PUT /identity/v3/projects/cfe06f14a5fd4dcf8012131cb8f9881b/users/8f257f118da5434fb67af3decc324dd7/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:28:59.797671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48abd8-5bb3-4f37-b767-c8017bfe1537 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:59.798221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48abd8-5bb3-4f37-b767-c8017bfe1537 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:59.798528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48abd8-5bb3-4f37-b767-c8017bfe1537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:59.852595 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6e48abd8-5bb3-4f37-b767-c8017bfe1537 None None] MFA Rules not processed for user `8f257f118da5434fb67af3decc324dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:59.854796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6e48abd8-5bb3-4f37-b767-c8017bfe1537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:59.945280 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1806/3605] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:28:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:28:59.955818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6ab9b-4dce-4d22-9aaf-be6c874169f4 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:28:59.956103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6ab9b-4dce-4d22-9aaf-be6c874169f4 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:28:59.956373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6ab9b-4dce-4d22-9aaf-be6c874169f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:28:59.981098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-56c6ab9b-4dce-4d22-9aaf-be6c874169f4 None None] MFA Rules not processed for user `8f257f118da5434fb67af3decc324dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:28:59.982501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-56c6ab9b-4dce-4d22-9aaf-be6c874169f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:28:59.992670 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1800/3606] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:28:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:00.005789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48abd8-5bb3-4f37-b767-c8017bfe1537 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:00.007252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6e48abd8-5bb3-4f37-b767-c8017bfe1537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:00.137482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48abd8-5bb3-4f37-b767-c8017bfe1537 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:00.145582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb48f9-ddcc-48d7-ab5a-6b0d137bcea7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:00.147612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb48f9-ddcc-48d7-ab5a-6b0d137bcea7 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:00.148018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb48f9-ddcc-48d7-ab5a-6b0d137bcea7 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:00.148364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb48f9-ddcc-48d7-ab5a-6b0d137bcea7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:00.161786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb48f9-ddcc-48d7-ab5a-6b0d137bcea7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:00.164656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb48f9-ddcc-48d7-ab5a-6b0d137bcea7 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:00.178204 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1807/3607] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:00.206444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14f9c9-8573-4ca1-b426-700a69a553fc None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:00.206920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14f9c9-8573-4ca1-b426-700a69a553fc None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:00.207309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14f9c9-8573-4ca1-b426-700a69a553fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:00.232382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6b14f9c9-8573-4ca1-b426-700a69a553fc None None] MFA Rules not processed for user `8f257f118da5434fb67af3decc324dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:00.236469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6b14f9c9-8573-4ca1-b426-700a69a553fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:00.248316 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1801/3608] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:00.275294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b836b-8b57-405a-b275-d08f73655b29 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:00.275590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b836b-8b57-405a-b275-d08f73655b29 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:00.275874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b836b-8b57-405a-b275-d08f73655b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:00.298321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-771b836b-8b57-405a-b275-d08f73655b29 None None] MFA Rules not processed for user `8f257f118da5434fb67af3decc324dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:00.301568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-771b836b-8b57-405a-b275-d08f73655b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:00.318476 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1808/3609] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:00.339450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4445988-5326-41e8-9f01-616c926d5290 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:00.339754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4445988-5326-41e8-9f01-616c926d5290 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:00.340354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4445988-5326-41e8-9f01-616c926d5290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:00.367686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e4445988-5326-41e8-9f01-616c926d5290 None None] MFA Rules not processed for user `8f257f118da5434fb67af3decc324dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:00.369590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e4445988-5326-41e8-9f01-616c926d5290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:00.383820 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1802/3610] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:00.409073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f93eb-9d62-4451-bd72-859396754b3b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:00.409707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f93eb-9d62-4451-bd72-859396754b3b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:00.410447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f93eb-9d62-4451-bd72-859396754b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:00.430213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-713f93eb-9d62-4451-bd72-859396754b3b None None] MFA Rules not processed for user `8f257f118da5434fb67af3decc324dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:00.431917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-713f93eb-9d62-4451-bd72-859396754b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:00.447934 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1809/3611] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:00.461708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4445988-5326-41e8-9f01-616c926d5290 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:00.545679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4445988-5326-41e8-9f01-616c926d5290 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:00.551657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e887e2-49f1-4945-abd5-c9c5d3e765a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:00.552946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e887e2-49f1-4945-abd5-c9c5d3e765a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:00.553393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e887e2-49f1-4945-abd5-c9c5d3e765a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:00.553880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e887e2-49f1-4945-abd5-c9c5d3e765a4 admin admin] PATH_INFO: `/v3/users/8f257f118da5434fb67af3decc324dd7` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:00.555352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e887e2-49f1-4945-abd5-c9c5d3e765a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f257f118da5434fb67af3decc324dd7)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:00.557656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e887e2-49f1-4945-abd5-c9c5d3e765a4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:00.748483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a0e887e2-49f1-4945-abd5-c9c5d3e765a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f257f118da5434fb67af3decc324dd7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:00.775229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a0e887e2-49f1-4945-abd5-c9c5d3e765a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f257f118da5434fb67af3decc324dd7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:00.776876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a0e887e2-49f1-4945-abd5-c9c5d3e765a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f257f118da5434fb67af3decc324dd7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:00.786624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a0e887e2-49f1-4945-abd5-c9c5d3e765a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f257f118da5434fb67af3decc324dd7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:00.878407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a0e887e2-49f1-4945-abd5-c9c5d3e765a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f257f118da5434fb67af3decc324dd7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:00.890369 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1803/3612] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:29:00 2022] DELETE /identity/v3/users/8f257f118da5434fb67af3decc324dd7 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:00.893586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053ef33-1f0a-40be-a8a6-27a9e6a26c73 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:00.894068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053ef33-1f0a-40be-a8a6-27a9e6a26c73 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:00.894160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053ef33-1f0a-40be-a8a6-27a9e6a26c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:00.919096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d053ef33-1f0a-40be-a8a6-27a9e6a26c73 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:00.919096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d053ef33-1f0a-40be-a8a6-27a9e6a26c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:00.995795 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1810/3613] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:01.055470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e887e2-49f1-4945-abd5-c9c5d3e765a4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:01.058250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a0e887e2-49f1-4945-abd5-c9c5d3e765a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:01.204938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e887e2-49f1-4945-abd5-c9c5d3e765a4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:01.217652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2685ed-bbc2-44bb-b496-08df76eba98c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:01.218752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2685ed-bbc2-44bb-b496-08df76eba98c service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:01.219383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2685ed-bbc2-44bb-b496-08df76eba98c service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:01.219857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2685ed-bbc2-44bb-b496-08df76eba98c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:01.238760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2685ed-bbc2-44bb-b496-08df76eba98c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:01.241461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2685ed-bbc2-44bb-b496-08df76eba98c service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:01.256815 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1804/3614] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:02.196343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053ef33-1f0a-40be-a8a6-27a9e6a26c73 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:02.199754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d053ef33-1f0a-40be-a8a6-27a9e6a26c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:02.235317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053ef33-1f0a-40be-a8a6-27a9e6a26c73 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:02.275409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535fba8-130a-4260-a026-e237aa8002ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:02.275409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535fba8-130a-4260-a026-e237aa8002ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:02.275657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535fba8-130a-4260-a026-e237aa8002ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:02.275766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535fba8-130a-4260-a026-e237aa8002ee admin admin] PATH_INFO: `/v3/projects/cfe06f14a5fd4dcf8012131cb8f9881b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:02.279872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535fba8-130a-4260-a026-e237aa8002ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfe06f14a5fd4dcf8012131cb8f9881b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:02.282714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535fba8-130a-4260-a026-e237aa8002ee admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:02.458657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7535fba8-130a-4260-a026-e237aa8002ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfe06f14a5fd4dcf8012131cb8f9881b', 'request_id': 'req-7535fba8-130a-4260-a026-e237aa8002ee'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:02.469296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7535fba8-130a-4260-a026-e237aa8002ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfe06f14a5fd4dcf8012131cb8f9881b', 'request_id': 'req-7535fba8-130a-4260-a026-e237aa8002ee'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:02.540215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7535fba8-130a-4260-a026-e237aa8002ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfe06f14a5fd4dcf8012131cb8f9881b', 'request_id': 'req-7535fba8-130a-4260-a026-e237aa8002ee'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:02.572206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7535fba8-130a-4260-a026-e237aa8002ee admin admin] The token cache is being invalidate because project cfe06f14a5fd4dcf8012131cb8f9881b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:29:02.579196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7535fba8-130a-4260-a026-e237aa8002ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:02.579999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7535fba8-130a-4260-a026-e237aa8002ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:02.590146 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1811/3615] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:29:02 2022] DELETE /identity/v3/projects/cfe06f14a5fd4dcf8012131cb8f9881b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:02.591119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b365eaf-2946-4ff1-9d32-ced2e75aed23 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:02.591610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b365eaf-2946-4ff1-9d32-ced2e75aed23 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:02.591869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b365eaf-2946-4ff1-9d32-ced2e75aed23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:02.635632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-7b365eaf-2946-4ff1-9d32-ced2e75aed23 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:02.649342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7b365eaf-2946-4ff1-9d32-ced2e75aed23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:02.755793 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1805/3616] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:29:02.763401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3584da-a368-42bf-b112-f40b037faec0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:02.764489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3584da-a368-42bf-b112-f40b037faec0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:02.764489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3584da-a368-42bf-b112-f40b037faec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:02.805833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-da3584da-a368-42bf-b112-f40b037faec0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:02.807416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-da3584da-a368-42bf-b112-f40b037faec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:02.841652 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1812/3617] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:02.842212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b365eaf-2946-4ff1-9d32-ced2e75aed23 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:02.874939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b365eaf-2946-4ff1-9d32-ced2e75aed23 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:02.884860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efe814-fd75-42b3-bcb1-6b7be7ab167e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:02.886946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efe814-fd75-42b3-bcb1-6b7be7ab167e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:02.887489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efe814-fd75-42b3-bcb1-6b7be7ab167e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:02.888124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efe814-fd75-42b3-bcb1-6b7be7ab167e admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:02.893523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efe814-fd75-42b3-bcb1-6b7be7ab167e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:29:02.894219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efe814-fd75-42b3-bcb1-6b7be7ab167e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:02.924467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efe814-fd75-42b3-bcb1-6b7be7ab167e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:02.960192 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1806/3618] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:29:02.965585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3584da-a368-42bf-b112-f40b037faec0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:02.993402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3584da-a368-42bf-b112-f40b037faec0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:03.013842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d5161-0cb4-43fe-8265-b40b59fd3273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:03.014966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d5161-0cb4-43fe-8265-b40b59fd3273 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:03.015699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d5161-0cb4-43fe-8265-b40b59fd3273 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:03.016750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d5161-0cb4-43fe-8265-b40b59fd3273 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:03.017758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d5161-0cb4-43fe-8265-b40b59fd3273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:03.020864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d5161-0cb4-43fe-8265-b40b59fd3273 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:03.158695 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1813/3619] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:29:02 2022] POST /identity/v3/projects => generated 397 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:29:03.165070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efe814-fd75-42b3-bcb1-6b7be7ab167e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:03.179598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efe814-fd75-42b3-bcb1-6b7be7ab167e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:03.337096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a55ef-1def-4a86-8c43-d78b99e40d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:03.337424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a55ef-1def-4a86-8c43-d78b99e40d82 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:03.337713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a55ef-1def-4a86-8c43-d78b99e40d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:03.337989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a55ef-1def-4a86-8c43-d78b99e40d82 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:03.338696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a55ef-1def-4a86-8c43-d78b99e40d82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:03.340660 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a55ef-1def-4a86-8c43-d78b99e40d82 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:03.453819 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1807/3620] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:29:03 2022] POST /identity/v3/users => generated 299 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:29:03.460102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d5161-0cb4-43fe-8265-b40b59fd3273 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:03.493770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d5161-0cb4-43fe-8265-b40b59fd3273 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:03.516496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c73f1b-6361-4578-9c01-8b302bf05be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:03.517701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c73f1b-6361-4578-9c01-8b302bf05be8 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:03.518236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c73f1b-6361-4578-9c01-8b302bf05be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:03.518809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c73f1b-6361-4578-9c01-8b302bf05be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:03.522504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c73f1b-6361-4578-9c01-8b302bf05be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:03.524521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c73f1b-6361-4578-9c01-8b302bf05be8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:03.551502 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1814/3621] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:29:03.558121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a55ef-1def-4a86-8c43-d78b99e40d82 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:03.573062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a55ef-1def-4a86-8c43-d78b99e40d82 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:03.578922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f1885-999c-4829-90be-0949d7d5b03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:03.579331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f1885-999c-4829-90be-0949d7d5b03f admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:03.579705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f1885-999c-4829-90be-0949d7d5b03f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:03.579908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f1885-999c-4829-90be-0949d7d5b03f admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:03.580770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f1885-999c-4829-90be-0949d7d5b03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:03.582971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f1885-999c-4829-90be-0949d7d5b03f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:03.615255 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1808/3622] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:29:03.616569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c73f1b-6361-4578-9c01-8b302bf05be8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:03.637657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c73f1b-6361-4578-9c01-8b302bf05be8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:03.649714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff56f94-0057-44b6-81c9-d7ba1b637c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:03.650710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff56f94-0057-44b6-81c9-d7ba1b637c5d admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:03.651065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff56f94-0057-44b6-81c9-d7ba1b637c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:03.651460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff56f94-0057-44b6-81c9-d7ba1b637c5d admin admin] PATH_INFO: `/v3/projects/b2b72e8c93b64fbab043bc10a6c8d60b/users/516be147aabf4c07a63f33b4350812e7/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:03.672029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff56f94-0057-44b6-81c9-d7ba1b637c5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b72e8c93b64fbab043bc10a6c8d60b, user_id=516be147aabf4c07a63f33b4350812e7, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:03.675315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff56f94-0057-44b6-81c9-d7ba1b637c5d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:03.779719 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1815/3623] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:29:03 2022] PUT /identity/v3/projects/b2b72e8c93b64fbab043bc10a6c8d60b/users/516be147aabf4c07a63f33b4350812e7/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:29:03.784922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778423d-9b84-473b-9d33-b48900ba72b4 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:03.790957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778423d-9b84-473b-9d33-b48900ba72b4 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:03.791488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778423d-9b84-473b-9d33-b48900ba72b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:03.822271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e778423d-9b84-473b-9d33-b48900ba72b4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:03.826816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e778423d-9b84-473b-9d33-b48900ba72b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:03.958536 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1809/3624] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:04.003062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff56f94-0057-44b6-81c9-d7ba1b637c5d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:04.005749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-eff56f94-0057-44b6-81c9-d7ba1b637c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:04.130567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff56f94-0057-44b6-81c9-d7ba1b637c5d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:04.151813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78241def-ae70-4818-9179-184b476ed5a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:04.152688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78241def-ae70-4818-9179-184b476ed5a9 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:04.153031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78241def-ae70-4818-9179-184b476ed5a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:04.153367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78241def-ae70-4818-9179-184b476ed5a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:04.171292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78241def-ae70-4818-9179-184b476ed5a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:04.173136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78241def-ae70-4818-9179-184b476ed5a9 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:04.216202 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1816/3625] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:06.271796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778423d-9b84-473b-9d33-b48900ba72b4 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:06.274795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e778423d-9b84-473b-9d33-b48900ba72b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:06.292823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778423d-9b84-473b-9d33-b48900ba72b4 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:06.319059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c394ca-2ce8-43f1-94ea-ad56f30f86fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:06.320363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c394ca-2ce8-43f1-94ea-ad56f30f86fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:06.326378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c394ca-2ce8-43f1-94ea-ad56f30f86fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:06.326378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c394ca-2ce8-43f1-94ea-ad56f30f86fd admin admin] PATH_INFO: `/v3/users/23b1b2dd6190491393cdec41b865e427` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:06.336323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c394ca-2ce8-43f1-94ea-ad56f30f86fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b1b2dd6190491393cdec41b865e427)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:06.343922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c394ca-2ce8-43f1-94ea-ad56f30f86fd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:06.657943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e4c394ca-2ce8-43f1-94ea-ad56f30f86fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b1b2dd6190491393cdec41b865e427'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:06.687501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e4c394ca-2ce8-43f1-94ea-ad56f30f86fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b1b2dd6190491393cdec41b865e427'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:06.688515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e4c394ca-2ce8-43f1-94ea-ad56f30f86fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b1b2dd6190491393cdec41b865e427'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:06.711526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e4c394ca-2ce8-43f1-94ea-ad56f30f86fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b1b2dd6190491393cdec41b865e427'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:06.776293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0a7e7-fb3f-4996-9797-916c2da9e6a2 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:06.777294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0a7e7-fb3f-4996-9797-916c2da9e6a2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:06.777761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0a7e7-fb3f-4996-9797-916c2da9e6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:06.801168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e4c394ca-2ce8-43f1-94ea-ad56f30f86fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b1b2dd6190491393cdec41b865e427'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:06.809626 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1810/3626] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:29:06 2022] DELETE /identity/v3/users/23b1b2dd6190491393cdec41b865e427 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:06.826725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-cfc0a7e7-fb3f-4996-9797-916c2da9e6a2 None None] MFA Rules not processed for user `516be147aabf4c07a63f33b4350812e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:06.828835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cfc0a7e7-fb3f-4996-9797-916c2da9e6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:06.937207 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1817/3627] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:06.950530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4df97-b1b0-45c0-a428-330bb70509a7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:06.950822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4df97-b1b0-45c0-a428-330bb70509a7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:06.951931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4df97-b1b0-45c0-a428-330bb70509a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:06.977004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d4e4df97-b1b0-45c0-a428-330bb70509a7 None None] MFA Rules not processed for user `516be147aabf4c07a63f33b4350812e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:06.979347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d4e4df97-b1b0-45c0-a428-330bb70509a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:06.992142 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1811/3628] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:07.003230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0a7e7-fb3f-4996-9797-916c2da9e6a2 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:07.005605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cfc0a7e7-fb3f-4996-9797-916c2da9e6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:07.136236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0a7e7-fb3f-4996-9797-916c2da9e6a2 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:07.142795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976e929-8713-4cab-9362-cd82a1ce6d7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:07.143568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976e929-8713-4cab-9362-cd82a1ce6d7e service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:07.143716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976e929-8713-4cab-9362-cd82a1ce6d7e service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:07.143986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976e929-8713-4cab-9362-cd82a1ce6d7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:07.157527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976e929-8713-4cab-9362-cd82a1ce6d7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:07.159729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976e929-8713-4cab-9362-cd82a1ce6d7e service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:07.171213 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1818/3629] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:07.182841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4df97-b1b0-45c0-a428-330bb70509a7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:07.184333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d4e4df97-b1b0-45c0-a428-330bb70509a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:07.291105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4df97-b1b0-45c0-a428-330bb70509a7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:07.298016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73fb6d-6e30-451f-9153-c6cd74e78d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:07.299429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73fb6d-6e30-451f-9153-c6cd74e78d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:07.300001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73fb6d-6e30-451f-9153-c6cd74e78d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:07.300530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73fb6d-6e30-451f-9153-c6cd74e78d75 admin admin] PATH_INFO: `/v3/projects/b9f28177488d47b8959c08125f6bd94d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:07.302118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73fb6d-6e30-451f-9153-c6cd74e78d75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f28177488d47b8959c08125f6bd94d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:07.313655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73fb6d-6e30-451f-9153-c6cd74e78d75 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:07.476409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f73fb6d-6e30-451f-9153-c6cd74e78d75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f28177488d47b8959c08125f6bd94d', 'request_id': 'req-2f73fb6d-6e30-451f-9153-c6cd74e78d75'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:07.549827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f73fb6d-6e30-451f-9153-c6cd74e78d75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f28177488d47b8959c08125f6bd94d', 'request_id': 'req-2f73fb6d-6e30-451f-9153-c6cd74e78d75'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:07.558469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f73fb6d-6e30-451f-9153-c6cd74e78d75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f28177488d47b8959c08125f6bd94d', 'request_id': 'req-2f73fb6d-6e30-451f-9153-c6cd74e78d75'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:07.573522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f73fb6d-6e30-451f-9153-c6cd74e78d75 admin admin] The token cache is being invalidate because project b9f28177488d47b8959c08125f6bd94d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:29:07.574375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f73fb6d-6e30-451f-9153-c6cd74e78d75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:07.575895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f73fb6d-6e30-451f-9153-c6cd74e78d75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:07.579870 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1812/3630] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:29:07 2022] DELETE /identity/v3/projects/b9f28177488d47b8959c08125f6bd94d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:07.584643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f7758-0d7d-4703-ac4a-e12f8142dbc7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:07.584958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f7758-0d7d-4703-ac4a-e12f8142dbc7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:07.585212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f7758-0d7d-4703-ac4a-e12f8142dbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:07.605341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e59f7758-0d7d-4703-ac4a-e12f8142dbc7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:07.606925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e59f7758-0d7d-4703-ac4a-e12f8142dbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:07.706745 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1819/3631] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:07.707415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f7d6b-db75-4b0a-ae9f-5c91c487e81a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:07.707818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f7d6b-db75-4b0a-ae9f-5c91c487e81a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:07.708226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f7d6b-db75-4b0a-ae9f-5c91c487e81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:07.728072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8d7f7d6b-db75-4b0a-ae9f-5c91c487e81a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:07.729683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8d7f7d6b-db75-4b0a-ae9f-5c91c487e81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:07.739607 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1813/3632] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:07.743535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f7758-0d7d-4703-ac4a-e12f8142dbc7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:07.756053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f7758-0d7d-4703-ac4a-e12f8142dbc7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:07.764222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5322f-8112-47ea-9d5e-d46469b3c843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:07.770987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5322f-8112-47ea-9d5e-d46469b3c843 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:07.770987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5322f-8112-47ea-9d5e-d46469b3c843 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:07.770987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5322f-8112-47ea-9d5e-d46469b3c843 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:07.770987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5322f-8112-47ea-9d5e-d46469b3c843 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:29:07.770987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5322f-8112-47ea-9d5e-d46469b3c843 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:07.770987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5322f-8112-47ea-9d5e-d46469b3c843 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:07.782409 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1820/3633] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:29:07.787160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f7d6b-db75-4b0a-ae9f-5c91c487e81a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:07.797242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f7d6b-db75-4b0a-ae9f-5c91c487e81a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:07.803666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76405c2d-1237-49d3-8d1e-f3e30902adab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:07.804336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76405c2d-1237-49d3-8d1e-f3e30902adab admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:07.804639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76405c2d-1237-49d3-8d1e-f3e30902adab admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:07.805024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76405c2d-1237-49d3-8d1e-f3e30902adab admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:07.812191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76405c2d-1237-49d3-8d1e-f3e30902adab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:07.814350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76405c2d-1237-49d3-8d1e-f3e30902adab admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:07.940393 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1814/3634] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:29:07 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:29:07.941521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5322f-8112-47ea-9d5e-d46469b3c843 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:07.952214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5322f-8112-47ea-9d5e-d46469b3c843 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:08.015003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b4312-a747-4c8e-a0c9-b6c8e37a1e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:08.016071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b4312-a747-4c8e-a0c9-b6c8e37a1e2b admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:08.016515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b4312-a747-4c8e-a0c9-b6c8e37a1e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:08.021509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b4312-a747-4c8e-a0c9-b6c8e37a1e2b admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:08.021509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b4312-a747-4c8e-a0c9-b6c8e37a1e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:08.021509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b4312-a747-4c8e-a0c9-b6c8e37a1e2b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:08.122445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76405c2d-1237-49d3-8d1e-f3e30902adab admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:08.125098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-76405c2d-1237-49d3-8d1e-f3e30902adab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:08.140125 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1821/3635] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:29:07 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:29:08.145030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b4312-a747-4c8e-a0c9-b6c8e37a1e2b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:08.169371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b4312-a747-4c8e-a0c9-b6c8e37a1e2b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:08.175953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1583fc1-de1c-47c6-9ad3-203d31c2d785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:08.177284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1583fc1-de1c-47c6-9ad3-203d31c2d785 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:08.177739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1583fc1-de1c-47c6-9ad3-203d31c2d785 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:08.178213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1583fc1-de1c-47c6-9ad3-203d31c2d785 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:08.179222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1583fc1-de1c-47c6-9ad3-203d31c2d785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:08.181305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1583fc1-de1c-47c6-9ad3-203d31c2d785 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:08.194932 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1822/3636] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:29:08.201300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1583fc1-de1c-47c6-9ad3-203d31c2d785 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:08.212697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1583fc1-de1c-47c6-9ad3-203d31c2d785 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:08.218623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2f547-586a-47c4-9fdf-bc7c8b0d0726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:08.219824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2f547-586a-47c4-9fdf-bc7c8b0d0726 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:08.220309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2f547-586a-47c4-9fdf-bc7c8b0d0726 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:08.220956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2f547-586a-47c4-9fdf-bc7c8b0d0726 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:08.221839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2f547-586a-47c4-9fdf-bc7c8b0d0726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:08.225761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2f547-586a-47c4-9fdf-bc7c8b0d0726 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:08.226579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76405c2d-1237-49d3-8d1e-f3e30902adab admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:08.234127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c79ef-eb2c-4e70-a4d6-fcc2f9075a89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:08.234873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c79ef-eb2c-4e70-a4d6-fcc2f9075a89 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:08.236760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c79ef-eb2c-4e70-a4d6-fcc2f9075a89 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:08.237566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c79ef-eb2c-4e70-a4d6-fcc2f9075a89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:08.241360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6c1c79ef-eb2c-4e70-a4d6-fcc2f9075a89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:08.251158 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1823/3637] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:29:08.252249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2f547-586a-47c4-9fdf-bc7c8b0d0726 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:08.263258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2f547-586a-47c4-9fdf-bc7c8b0d0726 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:08.268347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd6f5f-4713-48bd-a94d-6f1cde4067a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:08.276950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd6f5f-4713-48bd-a94d-6f1cde4067a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:08.276950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd6f5f-4713-48bd-a94d-6f1cde4067a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:08.276950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd6f5f-4713-48bd-a94d-6f1cde4067a7 admin admin] PATH_INFO: `/v3/projects/e83bbd60f3124021903ffa865f75541f/users/7e393a50c4bf4f95bedf2c67d1ff95a6/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:08.293491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd6f5f-4713-48bd-a94d-6f1cde4067a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e83bbd60f3124021903ffa865f75541f, user_id=7e393a50c4bf4f95bedf2c67d1ff95a6, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:08.296448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd6f5f-4713-48bd-a94d-6f1cde4067a7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:08.336160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c79ef-eb2c-4e70-a4d6-fcc2f9075a89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:08.337856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c79ef-eb2c-4e70-a4d6-fcc2f9075a89 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:08.348465 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1815/3638] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:08.399505 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1824/3639] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:29:08 2022] PUT /identity/v3/projects/e83bbd60f3124021903ffa865f75541f/users/7e393a50c4bf4f95bedf2c67d1ff95a6/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:08.400386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480ac87-dcc5-4c75-be2e-611abbe01ac7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:08.400708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480ac87-dcc5-4c75-be2e-611abbe01ac7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:08.400990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480ac87-dcc5-4c75-be2e-611abbe01ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:08.432263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9480ac87-dcc5-4c75-be2e-611abbe01ac7 None None] MFA Rules not processed for user `7e393a50c4bf4f95bedf2c67d1ff95a6`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:08.433744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9480ac87-dcc5-4c75-be2e-611abbe01ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:08.525481 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1816/3640] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:29:08.537168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd6f5f-4713-48bd-a94d-6f1cde4067a7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:08.637619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd6f5f-4713-48bd-a94d-6f1cde4067a7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:08.643880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482e702-c971-42a8-9e50-f227cd9591ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:08.645231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482e702-c971-42a8-9e50-f227cd9591ab service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:08.646222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482e702-c971-42a8-9e50-f227cd9591ab service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:08.646222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482e702-c971-42a8-9e50-f227cd9591ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:08.656227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482e702-c971-42a8-9e50-f227cd9591ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:08.658832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482e702-c971-42a8-9e50-f227cd9591ab service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:08.675360 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1825/3641] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:08.952870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480ac87-dcc5-4c75-be2e-611abbe01ac7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:09.077345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480ac87-dcc5-4c75-be2e-611abbe01ac7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:09.084179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63448754-a42a-4896-979c-837e75af3f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:09.085537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63448754-a42a-4896-979c-837e75af3f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:09.086494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63448754-a42a-4896-979c-837e75af3f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:09.086791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63448754-a42a-4896-979c-837e75af3f1a admin admin] PATH_INFO: `/v3/users/7e393a50c4bf4f95bedf2c67d1ff95a6` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:09.088078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63448754-a42a-4896-979c-837e75af3f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e393a50c4bf4f95bedf2c67d1ff95a6)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:09.090169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63448754-a42a-4896-979c-837e75af3f1a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:09.372013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-63448754-a42a-4896-979c-837e75af3f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e393a50c4bf4f95bedf2c67d1ff95a6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:09.387304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-63448754-a42a-4896-979c-837e75af3f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e393a50c4bf4f95bedf2c67d1ff95a6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:09.388325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-63448754-a42a-4896-979c-837e75af3f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e393a50c4bf4f95bedf2c67d1ff95a6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:09.402312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-63448754-a42a-4896-979c-837e75af3f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e393a50c4bf4f95bedf2c67d1ff95a6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:09.480352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-63448754-a42a-4896-979c-837e75af3f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e393a50c4bf4f95bedf2c67d1ff95a6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:09.495494 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1817/3642] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:29:08 2022] DELETE /identity/v3/users/7e393a50c4bf4f95bedf2c67d1ff95a6 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:09.500281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc3ce7-efe0-4394-a092-16b4174e8aab None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:09.501185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc3ce7-efe0-4394-a092-16b4174e8aab None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:09.501747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc3ce7-efe0-4394-a092-16b4174e8aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:09.527772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-41cc3ce7-efe0-4394-a092-16b4174e8aab None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:09.529361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-41cc3ce7-efe0-4394-a092-16b4174e8aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:09.682328 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1826/3643] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:09.692381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63448754-a42a-4896-979c-837e75af3f1a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:09.693855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-63448754-a42a-4896-979c-837e75af3f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:09.758021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63448754-a42a-4896-979c-837e75af3f1a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:09.761738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee75704-981d-47b3-8051-8e3e09cd2a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:09.762390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee75704-981d-47b3-8051-8e3e09cd2a4b service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:09.762679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee75704-981d-47b3-8051-8e3e09cd2a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:09.763881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee75704-981d-47b3-8051-8e3e09cd2a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:09.775885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee75704-981d-47b3-8051-8e3e09cd2a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:09.779077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee75704-981d-47b3-8051-8e3e09cd2a4b service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:09.790023 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1818/3644] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:10.281996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc3ce7-efe0-4394-a092-16b4174e8aab None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:10.284585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-41cc3ce7-efe0-4394-a092-16b4174e8aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:10.325971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc3ce7-efe0-4394-a092-16b4174e8aab None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:10.344496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137f709-4206-476f-b85d-6e33bb3e4476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:10.345668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137f709-4206-476f-b85d-6e33bb3e4476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:10.346308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137f709-4206-476f-b85d-6e33bb3e4476 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:10.347070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137f709-4206-476f-b85d-6e33bb3e4476 admin admin] PATH_INFO: `/v3/projects/e83bbd60f3124021903ffa865f75541f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:10.349472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137f709-4206-476f-b85d-6e33bb3e4476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e83bbd60f3124021903ffa865f75541f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:10.355738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137f709-4206-476f-b85d-6e33bb3e4476 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:10.551311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f137f709-4206-476f-b85d-6e33bb3e4476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e83bbd60f3124021903ffa865f75541f', 'request_id': 'req-f137f709-4206-476f-b85d-6e33bb3e4476'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:10.560508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f137f709-4206-476f-b85d-6e33bb3e4476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e83bbd60f3124021903ffa865f75541f', 'request_id': 'req-f137f709-4206-476f-b85d-6e33bb3e4476'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:10.646217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f137f709-4206-476f-b85d-6e33bb3e4476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e83bbd60f3124021903ffa865f75541f', 'request_id': 'req-f137f709-4206-476f-b85d-6e33bb3e4476'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:10.660465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f137f709-4206-476f-b85d-6e33bb3e4476 admin admin] The token cache is being invalidate because project e83bbd60f3124021903ffa865f75541f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:29:10.660798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f137f709-4206-476f-b85d-6e33bb3e4476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:10.661660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f137f709-4206-476f-b85d-6e33bb3e4476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:10.663728 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1827/3645] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:29:10 2022] DELETE /identity/v3/projects/e83bbd60f3124021903ffa865f75541f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:10.668982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b45e0-6b57-4f35-b73c-b67b46c66e3f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:10.669488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b45e0-6b57-4f35-b73c-b67b46c66e3f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:10.669609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b45e0-6b57-4f35-b73c-b67b46c66e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:10.697410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-272b45e0-6b57-4f35-b73c-b67b46c66e3f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:10.698872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-272b45e0-6b57-4f35-b73c-b67b46c66e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:10.821780 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1819/3646] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:10.830283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd02f6d-e244-4ea1-8205-813cb9c92787 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:10.830575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd02f6d-e244-4ea1-8205-813cb9c92787 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:10.830854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd02f6d-e244-4ea1-8205-813cb9c92787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:10.887948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2dd02f6d-e244-4ea1-8205-813cb9c92787 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:10.889858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2dd02f6d-e244-4ea1-8205-813cb9c92787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:10.906144 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1828/3647] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:10.911596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b45e0-6b57-4f35-b73c-b67b46c66e3f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:10.923844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd02f6d-e244-4ea1-8205-813cb9c92787 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:10.930568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2dd02f6d-e244-4ea1-8205-813cb9c92787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:10.934797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b45e0-6b57-4f35-b73c-b67b46c66e3f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:10.946123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad92fe-b1ae-4c25-8992-1915c2ff905f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:10.955284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad92fe-b1ae-4c25-8992-1915c2ff905f admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:10.955284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad92fe-b1ae-4c25-8992-1915c2ff905f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:10.955284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad92fe-b1ae-4c25-8992-1915c2ff905f admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:10.955284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad92fe-b1ae-4c25-8992-1915c2ff905f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:29:10.955284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad92fe-b1ae-4c25-8992-1915c2ff905f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:10.955284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad92fe-b1ae-4c25-8992-1915c2ff905f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:10.974313 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1820/3648] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:29:10.978307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad92fe-b1ae-4c25-8992-1915c2ff905f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:10.993268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad92fe-b1ae-4c25-8992-1915c2ff905f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:10.998521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44b079-f0de-455d-a306-64f5ced3b55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:10.999190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44b079-f0de-455d-a306-64f5ced3b55c admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:10.999965 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44b079-f0de-455d-a306-64f5ced3b55c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:11.000248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44b079-f0de-455d-a306-64f5ced3b55c admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:11.001256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44b079-f0de-455d-a306-64f5ced3b55c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:11.003519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44b079-f0de-455d-a306-64f5ced3b55c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:11.059419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd02f6d-e244-4ea1-8205-813cb9c92787 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:11.066730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247414e9-5d6c-4b36-91f6-3792d03233d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:11.072442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247414e9-5d6c-4b36-91f6-3792d03233d7 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:11.072442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247414e9-5d6c-4b36-91f6-3792d03233d7 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:11.072442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247414e9-5d6c-4b36-91f6-3792d03233d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:11.072442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-247414e9-5d6c-4b36-91f6-3792d03233d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:11.146951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247414e9-5d6c-4b36-91f6-3792d03233d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:11.149414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247414e9-5d6c-4b36-91f6-3792d03233d7 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:11.157498 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1821/3649] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:29:10 2022] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:29:11.160118 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1829/3650] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:11.169356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44b079-f0de-455d-a306-64f5ced3b55c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:11.245186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44b079-f0de-455d-a306-64f5ced3b55c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:11.250718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932561df-f9b3-4e51-a78a-e13cd81e6122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:11.251405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932561df-f9b3-4e51-a78a-e13cd81e6122 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:11.251694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932561df-f9b3-4e51-a78a-e13cd81e6122 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:11.252242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932561df-f9b3-4e51-a78a-e13cd81e6122 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:11.252993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932561df-f9b3-4e51-a78a-e13cd81e6122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:11.254922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932561df-f9b3-4e51-a78a-e13cd81e6122 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:11.384639 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1822/3651] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:29:11 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:29:11.389504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247414e9-5d6c-4b36-91f6-3792d03233d7 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:11.400754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247414e9-5d6c-4b36-91f6-3792d03233d7 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:11.416382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22148c4e-1978-43ac-a037-a96899943fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:11.416965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22148c4e-1978-43ac-a037-a96899943fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:11.418474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22148c4e-1978-43ac-a037-a96899943fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:11.418474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22148c4e-1978-43ac-a037-a96899943fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:11.418474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22148c4e-1978-43ac-a037-a96899943fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:11.422269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22148c4e-1978-43ac-a037-a96899943fe7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:11.437818 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1830/3652] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:29:11.442891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932561df-f9b3-4e51-a78a-e13cd81e6122 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:11.459095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932561df-f9b3-4e51-a78a-e13cd81e6122 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:11.466098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b635170-bfac-46f1-b7b7-66e4506a6d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:11.467166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b635170-bfac-46f1-b7b7-66e4506a6d03 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:11.467671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b635170-bfac-46f1-b7b7-66e4506a6d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:11.468110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b635170-bfac-46f1-b7b7-66e4506a6d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:11.469147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b635170-bfac-46f1-b7b7-66e4506a6d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:11.475457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b635170-bfac-46f1-b7b7-66e4506a6d03 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:11.489165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22148c4e-1978-43ac-a037-a96899943fe7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:11.496964 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1823/3653] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:29:11.503163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22148c4e-1978-43ac-a037-a96899943fe7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:11.509150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afef30-a38f-4226-ae0e-759e53059031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:11.510203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afef30-a38f-4226-ae0e-759e53059031 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:11.510471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afef30-a38f-4226-ae0e-759e53059031 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:11.510897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afef30-a38f-4226-ae0e-759e53059031 admin admin] PATH_INFO: `/v3/projects/a863a560c8d34a34b2ad695ab50551a5/users/cf07eac8778147f69220d5da8f645a25/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:11.532208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afef30-a38f-4226-ae0e-759e53059031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a863a560c8d34a34b2ad695ab50551a5, user_id=cf07eac8778147f69220d5da8f645a25, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:11.537318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afef30-a38f-4226-ae0e-759e53059031 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:11.595978 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1831/3654] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:29:11 2022] PUT /identity/v3/projects/a863a560c8d34a34b2ad695ab50551a5/users/cf07eac8778147f69220d5da8f645a25/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:11.608471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a438013-44ce-4300-b7d6-1f40224dec9e None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:11.608821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a438013-44ce-4300-b7d6-1f40224dec9e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:11.609102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a438013-44ce-4300-b7d6-1f40224dec9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:11.645512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1a438013-44ce-4300-b7d6-1f40224dec9e None None] MFA Rules not processed for user `cf07eac8778147f69220d5da8f645a25`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:11.646786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1a438013-44ce-4300-b7d6-1f40224dec9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:11.713589 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1824/3655] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:29:11.725382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afef30-a38f-4226-ae0e-759e53059031 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:11.802407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afef30-a38f-4226-ae0e-759e53059031 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:11.808591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9b519-be93-4929-90e7-0b6aa051c91e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:11.809288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9b519-be93-4929-90e7-0b6aa051c91e service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:11.809573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9b519-be93-4929-90e7-0b6aa051c91e service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:11.809861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9b519-be93-4929-90e7-0b6aa051c91e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:11.818988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9b519-be93-4929-90e7-0b6aa051c91e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:11.820712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9b519-be93-4929-90e7-0b6aa051c91e service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:11.834058 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1832/3656] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:11.886731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a438013-44ce-4300-b7d6-1f40224dec9e None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:11.967002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a438013-44ce-4300-b7d6-1f40224dec9e None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:11.972146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c89a0-ddac-453e-8053-1f8f2de01668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:11.973064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c89a0-ddac-453e-8053-1f8f2de01668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:11.973344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c89a0-ddac-453e-8053-1f8f2de01668 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:11.974028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c89a0-ddac-453e-8053-1f8f2de01668 admin admin] PATH_INFO: `/v3/users/cf07eac8778147f69220d5da8f645a25` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:11.974884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c89a0-ddac-453e-8053-1f8f2de01668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf07eac8778147f69220d5da8f645a25)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:11.977121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c89a0-ddac-453e-8053-1f8f2de01668 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:12.209370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-809c89a0-ddac-453e-8053-1f8f2de01668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf07eac8778147f69220d5da8f645a25'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:12.223025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-809c89a0-ddac-453e-8053-1f8f2de01668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf07eac8778147f69220d5da8f645a25'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:12.224704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-809c89a0-ddac-453e-8053-1f8f2de01668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf07eac8778147f69220d5da8f645a25'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:12.234744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-809c89a0-ddac-453e-8053-1f8f2de01668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf07eac8778147f69220d5da8f645a25'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:12.321453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-809c89a0-ddac-453e-8053-1f8f2de01668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf07eac8778147f69220d5da8f645a25'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:12.328446 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1825/3657] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:29:11 2022] DELETE /identity/v3/users/cf07eac8778147f69220d5da8f645a25 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:12.332908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cc2fb-8ab2-48db-8e81-e3a16e00b191 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:12.333200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cc2fb-8ab2-48db-8e81-e3a16e00b191 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:12.333475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cc2fb-8ab2-48db-8e81-e3a16e00b191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:12.353314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c69cc2fb-8ab2-48db-8e81-e3a16e00b191 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:12.354979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c69cc2fb-8ab2-48db-8e81-e3a16e00b191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:12.458744 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1833/3658] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:29:12.472419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c89a0-ddac-453e-8053-1f8f2de01668 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:12.474486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-809c89a0-ddac-453e-8053-1f8f2de01668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:12.556288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c89a0-ddac-453e-8053-1f8f2de01668 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:12.566586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ededae-b361-4a2d-bba4-9ce3efd1a86d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:12.567265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ededae-b361-4a2d-bba4-9ce3efd1a86d service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:12.567551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ededae-b361-4a2d-bba4-9ce3efd1a86d service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:12.567840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ededae-b361-4a2d-bba4-9ce3efd1a86d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:12.590911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ededae-b361-4a2d-bba4-9ce3efd1a86d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:12.597447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ededae-b361-4a2d-bba4-9ce3efd1a86d service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:12.622638 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1826/3659] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:13.412191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cc2fb-8ab2-48db-8e81-e3a16e00b191 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:13.413906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c69cc2fb-8ab2-48db-8e81-e3a16e00b191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:13.433229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cc2fb-8ab2-48db-8e81-e3a16e00b191 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:13.445511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6098fb-cf10-4def-91fb-e5ee4431f7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:13.447408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6098fb-cf10-4def-91fb-e5ee4431f7a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:13.448316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6098fb-cf10-4def-91fb-e5ee4431f7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:13.448950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6098fb-cf10-4def-91fb-e5ee4431f7a5 admin admin] PATH_INFO: `/v3/projects/a863a560c8d34a34b2ad695ab50551a5` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:13.457832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6098fb-cf10-4def-91fb-e5ee4431f7a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a863a560c8d34a34b2ad695ab50551a5)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:13.470165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6098fb-cf10-4def-91fb-e5ee4431f7a5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:13.691730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cf6098fb-cf10-4def-91fb-e5ee4431f7a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a863a560c8d34a34b2ad695ab50551a5', 'request_id': 'req-cf6098fb-cf10-4def-91fb-e5ee4431f7a5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:13.699589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cf6098fb-cf10-4def-91fb-e5ee4431f7a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a863a560c8d34a34b2ad695ab50551a5', 'request_id': 'req-cf6098fb-cf10-4def-91fb-e5ee4431f7a5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:13.801608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cf6098fb-cf10-4def-91fb-e5ee4431f7a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a863a560c8d34a34b2ad695ab50551a5', 'request_id': 'req-cf6098fb-cf10-4def-91fb-e5ee4431f7a5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:13.814051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cf6098fb-cf10-4def-91fb-e5ee4431f7a5 admin admin] The token cache is being invalidate because project a863a560c8d34a34b2ad695ab50551a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:29:13.816462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cf6098fb-cf10-4def-91fb-e5ee4431f7a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:13.816462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cf6098fb-cf10-4def-91fb-e5ee4431f7a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:13.817447 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1834/3660] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:29:13 2022] DELETE /identity/v3/projects/a863a560c8d34a34b2ad695ab50551a5 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:13.822974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ec750-23bf-4333-ad29-4d48fdfb9a97 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:13.823921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ec750-23bf-4333-ad29-4d48fdfb9a97 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:13.824216 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ec750-23bf-4333-ad29-4d48fdfb9a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:13.845998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-5f5ec750-23bf-4333-ad29-4d48fdfb9a97 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:13.847847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5f5ec750-23bf-4333-ad29-4d48fdfb9a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:13.932659 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1827/3661] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:13.941433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed4ec0-61e9-4122-b945-49008469af19 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:13.941798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed4ec0-61e9-4122-b945-49008469af19 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:13.942076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed4ec0-61e9-4122-b945-49008469af19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:13.975063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2bed4ec0-61e9-4122-b945-49008469af19 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:13.976449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2bed4ec0-61e9-4122-b945-49008469af19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:13.984809 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1835/3662] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:29:13.988884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ec750-23bf-4333-ad29-4d48fdfb9a97 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:14.009342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ec750-23bf-4333-ad29-4d48fdfb9a97 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:14.014192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7cc00-ec9b-4028-b197-2cdf92e446ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:14.014888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7cc00-ec9b-4028-b197-2cdf92e446ff admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:14.015175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7cc00-ec9b-4028-b197-2cdf92e446ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:14.015460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7cc00-ec9b-4028-b197-2cdf92e446ff admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:14.016243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7cc00-ec9b-4028-b197-2cdf92e446ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:29:14.016499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7cc00-ec9b-4028-b197-2cdf92e446ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:14.018306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7cc00-ec9b-4028-b197-2cdf92e446ff admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:14.032633 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1828/3663] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:29:14.035498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed4ec0-61e9-4122-b945-49008469af19 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:14.045008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed4ec0-61e9-4122-b945-49008469af19 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:14.050976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f5e0a-3072-4968-94e1-e4a4bd994244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:14.051834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f5e0a-3072-4968-94e1-e4a4bd994244 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:14.052292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f5e0a-3072-4968-94e1-e4a4bd994244 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:14.052791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f5e0a-3072-4968-94e1-e4a4bd994244 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:14.053486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f5e0a-3072-4968-94e1-e4a4bd994244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:14.055580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f5e0a-3072-4968-94e1-e4a4bd994244 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:14.167742 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1836/3664] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:29:14 2022] POST /identity/v3/projects => generated 393 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:29:14.171734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7cc00-ec9b-4028-b197-2cdf92e446ff admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:14.182289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7cc00-ec9b-4028-b197-2cdf92e446ff admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:14.238690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7a55c-30de-4759-83f8-8958da410d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:14.239408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7a55c-30de-4759-83f8-8958da410d77 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:14.239689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7a55c-30de-4759-83f8-8958da410d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:14.239989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7a55c-30de-4759-83f8-8958da410d77 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:14.240698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7a55c-30de-4759-83f8-8958da410d77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:14.242625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7a55c-30de-4759-83f8-8958da410d77 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:14.353006 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1829/3665] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:29:14 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:29:14.354250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f5e0a-3072-4968-94e1-e4a4bd994244 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:14.365294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f5e0a-3072-4968-94e1-e4a4bd994244 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:14.369986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2003ba8-f5a1-4836-8ad8-c76c2fe79c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:14.370648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2003ba8-f5a1-4836-8ad8-c76c2fe79c31 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:14.370938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2003ba8-f5a1-4836-8ad8-c76c2fe79c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:14.371218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2003ba8-f5a1-4836-8ad8-c76c2fe79c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:14.372150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2003ba8-f5a1-4836-8ad8-c76c2fe79c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:14.373877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2003ba8-f5a1-4836-8ad8-c76c2fe79c31 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:14.388934 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1837/3666] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:29:14.390138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7a55c-30de-4759-83f8-8958da410d77 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:14.401372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7a55c-30de-4759-83f8-8958da410d77 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:14.406361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611da4c-d1c8-452b-a3bb-4a66758c7ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:14.410390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611da4c-d1c8-452b-a3bb-4a66758c7ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:14.410390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611da4c-d1c8-452b-a3bb-4a66758c7ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:14.410390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611da4c-d1c8-452b-a3bb-4a66758c7ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:14.410390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611da4c-d1c8-452b-a3bb-4a66758c7ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:14.410390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611da4c-d1c8-452b-a3bb-4a66758c7ac0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:14.425732 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1830/3667] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:29:14.427039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2003ba8-f5a1-4836-8ad8-c76c2fe79c31 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:14.438944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2003ba8-f5a1-4836-8ad8-c76c2fe79c31 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:14.457700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd3afd-ef6d-4fff-848a-e38d6f08ccb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:14.464003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd3afd-ef6d-4fff-848a-e38d6f08ccb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:14.464003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd3afd-ef6d-4fff-848a-e38d6f08ccb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:14.464003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd3afd-ef6d-4fff-848a-e38d6f08ccb9 admin admin] PATH_INFO: `/v3/projects/5452ea1c6c824946993a5b1934d1ed39/users/54205863dcb34b76a5bac11904084caf/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:14.517346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd3afd-ef6d-4fff-848a-e38d6f08ccb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5452ea1c6c824946993a5b1934d1ed39, user_id=54205863dcb34b76a5bac11904084caf, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:14.520562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd3afd-ef6d-4fff-848a-e38d6f08ccb9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:14.661618 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1838/3668] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:29:14 2022] PUT /identity/v3/projects/5452ea1c6c824946993a5b1934d1ed39/users/54205863dcb34b76a5bac11904084caf/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:14.672705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82955cbc-5b2d-4d7a-972b-69c1f4f2b2ca None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:14.673149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82955cbc-5b2d-4d7a-972b-69c1f4f2b2ca None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:14.673541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82955cbc-5b2d-4d7a-972b-69c1f4f2b2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:14.722581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-82955cbc-5b2d-4d7a-972b-69c1f4f2b2ca None None] MFA Rules not processed for user `54205863dcb34b76a5bac11904084caf`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:14.734183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-82955cbc-5b2d-4d7a-972b-69c1f4f2b2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:14.849599 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1831/3669] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:14.986469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd3afd-ef6d-4fff-848a-e38d6f08ccb9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:14.989147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-14cd3afd-ef6d-4fff-848a-e38d6f08ccb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:15.066424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd3afd-ef6d-4fff-848a-e38d6f08ccb9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:15.072827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4009c5d-6c60-4c3b-b00d-5b2a670c1452 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:15.073670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4009c5d-6c60-4c3b-b00d-5b2a670c1452 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:15.073961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4009c5d-6c60-4c3b-b00d-5b2a670c1452 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:15.074365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4009c5d-6c60-4c3b-b00d-5b2a670c1452 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:15.083135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4009c5d-6c60-4c3b-b00d-5b2a670c1452 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:15.084884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4009c5d-6c60-4c3b-b00d-5b2a670c1452 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:15.099534 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1839/3670] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:15.150262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f020283-35dd-4d03-8e15-4a49ebba6d70 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:15.150560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f020283-35dd-4d03-8e15-4a49ebba6d70 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:15.150848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f020283-35dd-4d03-8e15-4a49ebba6d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:15.182292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8f020283-35dd-4d03-8e15-4a49ebba6d70 None None] MFA Rules not processed for user `54205863dcb34b76a5bac11904084caf`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:15.183542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8f020283-35dd-4d03-8e15-4a49ebba6d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:15.208001 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1832/3671] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:29:15.722846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4009c5d-6c60-4c3b-b00d-5b2a670c1452 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:15.804298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4009c5d-6c60-4c3b-b00d-5b2a670c1452 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:15.809438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6b31f-d644-4e05-9c88-2dab1200fce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:15.810379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6b31f-d644-4e05-9c88-2dab1200fce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:15.810689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6b31f-d644-4e05-9c88-2dab1200fce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:15.811048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6b31f-d644-4e05-9c88-2dab1200fce4 admin admin] PATH_INFO: `/v3/users/54205863dcb34b76a5bac11904084caf` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:15.812846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6b31f-d644-4e05-9c88-2dab1200fce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54205863dcb34b76a5bac11904084caf)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:15.815341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6b31f-d644-4e05-9c88-2dab1200fce4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:16.066693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-82a6b31f-d644-4e05-9c88-2dab1200fce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54205863dcb34b76a5bac11904084caf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:16.089805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-82a6b31f-d644-4e05-9c88-2dab1200fce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54205863dcb34b76a5bac11904084caf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:16.090569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-82a6b31f-d644-4e05-9c88-2dab1200fce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54205863dcb34b76a5bac11904084caf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:16.105089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-82a6b31f-d644-4e05-9c88-2dab1200fce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54205863dcb34b76a5bac11904084caf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:16.174124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-82a6b31f-d644-4e05-9c88-2dab1200fce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54205863dcb34b76a5bac11904084caf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:16.199083 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1840/3672] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:29:15 2022] DELETE /identity/v3/users/54205863dcb34b76a5bac11904084caf => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:16.200148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29378a-5da8-46e1-a5cc-2b6dcaea7264 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:16.200685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29378a-5da8-46e1-a5cc-2b6dcaea7264 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:16.200810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29378a-5da8-46e1-a5cc-2b6dcaea7264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:16.226960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-5c29378a-5da8-46e1-a5cc-2b6dcaea7264 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:16.234504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5c29378a-5da8-46e1-a5cc-2b6dcaea7264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:16.327806 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1833/3673] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:16.379128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6b31f-d644-4e05-9c88-2dab1200fce4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:16.382902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-82a6b31f-d644-4e05-9c88-2dab1200fce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:16.513817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6b31f-d644-4e05-9c88-2dab1200fce4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:16.521881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d35ad-d4aa-4f51-aace-f45b8ce22475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:16.522746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d35ad-d4aa-4f51-aace-f45b8ce22475 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:16.523090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d35ad-d4aa-4f51-aace-f45b8ce22475 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:16.527378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d35ad-d4aa-4f51-aace-f45b8ce22475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:16.547087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d35ad-d4aa-4f51-aace-f45b8ce22475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:16.552083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d35ad-d4aa-4f51-aace-f45b8ce22475 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:16.575946 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1841/3674] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:18.741529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29378a-5da8-46e1-a5cc-2b6dcaea7264 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:18.743736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5c29378a-5da8-46e1-a5cc-2b6dcaea7264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:18.758334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29378a-5da8-46e1-a5cc-2b6dcaea7264 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:18.763983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf8dbb-c1c2-4052-8a38-34d2a9385c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:18.764847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf8dbb-c1c2-4052-8a38-34d2a9385c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:18.765134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf8dbb-c1c2-4052-8a38-34d2a9385c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:18.765416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf8dbb-c1c2-4052-8a38-34d2a9385c62 admin admin] PATH_INFO: `/v3/projects/5452ea1c6c824946993a5b1934d1ed39` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:18.766665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf8dbb-c1c2-4052-8a38-34d2a9385c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5452ea1c6c824946993a5b1934d1ed39)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:18.769345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf8dbb-c1c2-4052-8a38-34d2a9385c62 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:18.981085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-eabf8dbb-c1c2-4052-8a38-34d2a9385c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5452ea1c6c824946993a5b1934d1ed39', 'request_id': 'req-eabf8dbb-c1c2-4052-8a38-34d2a9385c62'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:19.080127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-eabf8dbb-c1c2-4052-8a38-34d2a9385c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5452ea1c6c824946993a5b1934d1ed39', 'request_id': 'req-eabf8dbb-c1c2-4052-8a38-34d2a9385c62'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:19.090398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-eabf8dbb-c1c2-4052-8a38-34d2a9385c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5452ea1c6c824946993a5b1934d1ed39', 'request_id': 'req-eabf8dbb-c1c2-4052-8a38-34d2a9385c62'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:19.127643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-eabf8dbb-c1c2-4052-8a38-34d2a9385c62 admin admin] The token cache is being invalidate because project 5452ea1c6c824946993a5b1934d1ed39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:29:19.130263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-eabf8dbb-c1c2-4052-8a38-34d2a9385c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:19.130263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-eabf8dbb-c1c2-4052-8a38-34d2a9385c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:19.135718 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1834/3675] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:29:18 2022] DELETE /identity/v3/projects/5452ea1c6c824946993a5b1934d1ed39 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:19.137340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bac455-2383-4d1d-922a-6b4ae168950a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:19.137823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bac455-2383-4d1d-922a-6b4ae168950a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:19.138039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bac455-2383-4d1d-922a-6b4ae168950a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:19.164845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-68bac455-2383-4d1d-922a-6b4ae168950a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:19.166464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-68bac455-2383-4d1d-922a-6b4ae168950a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:19.306211 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1842/3676] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:19.315840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74022b1e-f7bd-4aaf-bcdc-bcc831d31849 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:19.316287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74022b1e-f7bd-4aaf-bcdc-bcc831d31849 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:19.316737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74022b1e-f7bd-4aaf-bcdc-bcc831d31849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:19.381862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-74022b1e-f7bd-4aaf-bcdc-bcc831d31849 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:19.386953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-74022b1e-f7bd-4aaf-bcdc-bcc831d31849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:19.407000 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1835/3677] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:19.410474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bac455-2383-4d1d-922a-6b4ae168950a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:19.422662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bac455-2383-4d1d-922a-6b4ae168950a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:19.439031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e7c20-0851-4dc8-8049-411d4471ba1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:19.439550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e7c20-0851-4dc8-8049-411d4471ba1d admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:19.439850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e7c20-0851-4dc8-8049-411d4471ba1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:19.440131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e7c20-0851-4dc8-8049-411d4471ba1d admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:19.442225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e7c20-0851-4dc8-8049-411d4471ba1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:29:19.443720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e7c20-0851-4dc8-8049-411d4471ba1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:19.448791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e7c20-0851-4dc8-8049-411d4471ba1d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:19.479949 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1843/3678] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:29:19.481450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74022b1e-f7bd-4aaf-bcdc-bcc831d31849 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:19.497508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74022b1e-f7bd-4aaf-bcdc-bcc831d31849 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:19.504920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01d7ae-e0e5-4894-a34e-bc4a77fee65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:19.505802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01d7ae-e0e5-4894-a34e-bc4a77fee65f admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:19.506170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01d7ae-e0e5-4894-a34e-bc4a77fee65f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:19.506353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01d7ae-e0e5-4894-a34e-bc4a77fee65f admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:19.507727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01d7ae-e0e5-4894-a34e-bc4a77fee65f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:19.511327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01d7ae-e0e5-4894-a34e-bc4a77fee65f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:19.634301 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1836/3679] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:29:19 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:29:19.644831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e7c20-0851-4dc8-8049-411d4471ba1d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:19.650055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e7c20-0851-4dc8-8049-411d4471ba1d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:19.721026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d47f9b-b52e-4b26-923e-2db22b60a957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:19.724295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d47f9b-b52e-4b26-923e-2db22b60a957 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:19.724295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d47f9b-b52e-4b26-923e-2db22b60a957 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:19.724295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d47f9b-b52e-4b26-923e-2db22b60a957 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:19.724295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d47f9b-b52e-4b26-923e-2db22b60a957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:19.725281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d47f9b-b52e-4b26-923e-2db22b60a957 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:19.822445 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1844/3680] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:29:19 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:29:19.823935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01d7ae-e0e5-4894-a34e-bc4a77fee65f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:19.843059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01d7ae-e0e5-4894-a34e-bc4a77fee65f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:19.854295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28d85e-d475-45b0-b88f-94d51c4e38e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:19.855290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28d85e-d475-45b0-b88f-94d51c4e38e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:19.855744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28d85e-d475-45b0-b88f-94d51c4e38e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:19.857281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28d85e-d475-45b0-b88f-94d51c4e38e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:19.858241 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28d85e-d475-45b0-b88f-94d51c4e38e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:19.860363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28d85e-d475-45b0-b88f-94d51c4e38e6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:19.889646 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1837/3681] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:29:19.895667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d47f9b-b52e-4b26-923e-2db22b60a957 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:19.915746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d47f9b-b52e-4b26-923e-2db22b60a957 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:19.934543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f44b86-e130-4273-a09a-ef58e15f83d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:19.935658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f44b86-e130-4273-a09a-ef58e15f83d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:19.940945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f44b86-e130-4273-a09a-ef58e15f83d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:19.941550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f44b86-e130-4273-a09a-ef58e15f83d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:19.942598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f44b86-e130-4273-a09a-ef58e15f83d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:19.947558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f44b86-e130-4273-a09a-ef58e15f83d7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:19.979353 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1845/3682] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:29:19.984146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28d85e-d475-45b0-b88f-94d51c4e38e6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:20.000013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28d85e-d475-45b0-b88f-94d51c4e38e6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:20.014861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfaeeaa-862c-42ff-bccb-b74cabb8c47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:20.016286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaeeaa-862c-42ff-bccb-b74cabb8c47a admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:20.016953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaeeaa-862c-42ff-bccb-b74cabb8c47a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:20.017399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaeeaa-862c-42ff-bccb-b74cabb8c47a admin admin] PATH_INFO: `/v3/projects/6c7bd47feb9549daaf4d186085f8d171/users/e3d3dea2740e4e46ae98265dcade1291/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:20.056539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfaeeaa-862c-42ff-bccb-b74cabb8c47a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7bd47feb9549daaf4d186085f8d171, user_id=e3d3dea2740e4e46ae98265dcade1291, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:20.059383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfaeeaa-862c-42ff-bccb-b74cabb8c47a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:20.156030 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1838/3683] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:29:19 2022] PUT /identity/v3/projects/6c7bd47feb9549daaf4d186085f8d171/users/e3d3dea2740e4e46ae98265dcade1291/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:29:20.162583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497650fd-4694-4cf8-bb83-e8b1242b25e8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:20.163111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497650fd-4694-4cf8-bb83-e8b1242b25e8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:20.163111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497650fd-4694-4cf8-bb83-e8b1242b25e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:20.191178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-497650fd-4694-4cf8-bb83-e8b1242b25e8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:20.200042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-497650fd-4694-4cf8-bb83-e8b1242b25e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:20.363414 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1846/3684] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:20.454825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfaeeaa-862c-42ff-bccb-b74cabb8c47a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:20.457117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5dfaeeaa-862c-42ff-bccb-b74cabb8c47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:20.533416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfaeeaa-862c-42ff-bccb-b74cabb8c47a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:20.550915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e4a3a-bc06-4ca0-ba85-9e6b7c849747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:20.551593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e4a3a-bc06-4ca0-ba85-9e6b7c849747 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:20.551874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e4a3a-bc06-4ca0-ba85-9e6b7c849747 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:20.552231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e4a3a-bc06-4ca0-ba85-9e6b7c849747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:20.577238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e4a3a-bc06-4ca0-ba85-9e6b7c849747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:20.578732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e4a3a-bc06-4ca0-ba85-9e6b7c849747 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:20.606299 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1839/3685] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:22.686626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c79139-1958-47fc-9f80-d3be4998baeb None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:22.687611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c79139-1958-47fc-9f80-d3be4998baeb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:22.688340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c79139-1958-47fc-9f80-d3be4998baeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:22.740060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f7c79139-1958-47fc-9f80-d3be4998baeb None None] MFA Rules not processed for user `e3d3dea2740e4e46ae98265dcade1291`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:22.741699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f7c79139-1958-47fc-9f80-d3be4998baeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:22.877648 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1847/3686] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:22.880478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3de008-ab48-4c83-a24b-525e128e4cb0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:22.881104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3de008-ab48-4c83-a24b-525e128e4cb0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:22.881490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3de008-ab48-4c83-a24b-525e128e4cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:22.934178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-df3de008-ab48-4c83-a24b-525e128e4cb0 None None] MFA Rules not processed for user `e3d3dea2740e4e46ae98265dcade1291`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:22.937071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-df3de008-ab48-4c83-a24b-525e128e4cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:22.958829 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1840/3687] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:23.179807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c79139-1958-47fc-9f80-d3be4998baeb None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:23.181364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f7c79139-1958-47fc-9f80-d3be4998baeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:23.281610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c79139-1958-47fc-9f80-d3be4998baeb None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:23.287560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1f82f-60a3-4d33-9fd0-5e12d2fd053a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:23.288337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1f82f-60a3-4d33-9fd0-5e12d2fd053a service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:23.289170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1f82f-60a3-4d33-9fd0-5e12d2fd053a service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:23.289170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1f82f-60a3-4d33-9fd0-5e12d2fd053a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:23.298867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1f82f-60a3-4d33-9fd0-5e12d2fd053a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:23.301575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1f82f-60a3-4d33-9fd0-5e12d2fd053a service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:23.311956 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1848/3688] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:28.717231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7db94e-fb8c-447b-80d6-549492968c94 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:28.717231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7db94e-fb8c-447b-80d6-549492968c94 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:28.717231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7db94e-fb8c-447b-80d6-549492968c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:28.734989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1b7db94e-fb8c-447b-80d6-549492968c94 None None] MFA Rules not processed for user `516be147aabf4c07a63f33b4350812e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:28.739892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1b7db94e-fb8c-447b-80d6-549492968c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:28.820515 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1841/3689] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:28.888855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb0995-e6ad-48b9-8d7f-c6738e50a0b6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:28.889743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb0995-e6ad-48b9-8d7f-c6738e50a0b6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:28.890169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb0995-e6ad-48b9-8d7f-c6738e50a0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:28.914880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-89bb0995-e6ad-48b9-8d7f-c6738e50a0b6 None None] MFA Rules not processed for user `516be147aabf4c07a63f33b4350812e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:28.916243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-89bb0995-e6ad-48b9-8d7f-c6738e50a0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:28.929017 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1849/3690] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:29:28.954418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c20a1-4cdd-4133-8588-3c25e2f67629 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:28.955140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c20a1-4cdd-4133-8588-3c25e2f67629 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:28.955608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c20a1-4cdd-4133-8588-3c25e2f67629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:28.995844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e53c20a1-4cdd-4133-8588-3c25e2f67629 None None] MFA Rules not processed for user `516be147aabf4c07a63f33b4350812e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:28.997121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e53c20a1-4cdd-4133-8588-3c25e2f67629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:29.014702 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1842/3691] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:29.037613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66cf73-35c6-436b-870c-2b0954b7f730 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:29.038116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66cf73-35c6-436b-870c-2b0954b7f730 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:29.039142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66cf73-35c6-436b-870c-2b0954b7f730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:29.083586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-be66cf73-35c6-436b-870c-2b0954b7f730 None None] MFA Rules not processed for user `516be147aabf4c07a63f33b4350812e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:29.084876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-be66cf73-35c6-436b-870c-2b0954b7f730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:29.111293 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1850/3692] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:29.233583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab0214-64aa-490c-9476-aca0172f75d7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:29.233893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab0214-64aa-490c-9476-aca0172f75d7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:29.234175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab0214-64aa-490c-9476-aca0172f75d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:29.273459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-49ab0214-64aa-490c-9476-aca0172f75d7 None None] MFA Rules not processed for user `516be147aabf4c07a63f33b4350812e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:29.275045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-49ab0214-64aa-490c-9476-aca0172f75d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:29.297268 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1843/3693] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:31.152716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66cf73-35c6-436b-870c-2b0954b7f730 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:31.155209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-be66cf73-35c6-436b-870c-2b0954b7f730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:31.186921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66cf73-35c6-436b-870c-2b0954b7f730 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:31.195679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a20e5-6916-46bc-b131-d48430ad7002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:31.198906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a20e5-6916-46bc-b131-d48430ad7002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:31.199385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a20e5-6916-46bc-b131-d48430ad7002 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:31.200512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a20e5-6916-46bc-b131-d48430ad7002 admin admin] PATH_INFO: `/v3/users/4249f4ad303744e88e5f01d339a762b7` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:31.203051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a20e5-6916-46bc-b131-d48430ad7002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4249f4ad303744e88e5f01d339a762b7)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:31.208432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a20e5-6916-46bc-b131-d48430ad7002 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:31.495878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f49a20e5-6916-46bc-b131-d48430ad7002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4249f4ad303744e88e5f01d339a762b7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:31.529600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f49a20e5-6916-46bc-b131-d48430ad7002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4249f4ad303744e88e5f01d339a762b7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:31.537216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f49a20e5-6916-46bc-b131-d48430ad7002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4249f4ad303744e88e5f01d339a762b7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:31.551514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f49a20e5-6916-46bc-b131-d48430ad7002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4249f4ad303744e88e5f01d339a762b7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:31.618666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f49a20e5-6916-46bc-b131-d48430ad7002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4249f4ad303744e88e5f01d339a762b7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:31.638796 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1851/3694] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:29:31 2022] DELETE /identity/v3/users/4249f4ad303744e88e5f01d339a762b7 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:31.643748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ee4f0-1a54-4374-b694-9aa5872de8e1 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:31.644297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ee4f0-1a54-4374-b694-9aa5872de8e1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:31.644792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ee4f0-1a54-4374-b694-9aa5872de8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:31.667815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4d7ee4f0-1a54-4374-b694-9aa5872de8e1 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:31.669291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4d7ee4f0-1a54-4374-b694-9aa5872de8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:31.772556 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1844/3695] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:31.784316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a20e5-6916-46bc-b131-d48430ad7002 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:31.786630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f49a20e5-6916-46bc-b131-d48430ad7002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:31.912424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a20e5-6916-46bc-b131-d48430ad7002 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:31.916670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8dde9-00c8-4c66-ad56-41fe23a6846b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:31.917489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8dde9-00c8-4c66-ad56-41fe23a6846b service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:31.917921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8dde9-00c8-4c66-ad56-41fe23a6846b service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:31.918346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8dde9-00c8-4c66-ad56-41fe23a6846b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:31.929465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8dde9-00c8-4c66-ad56-41fe23a6846b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:31.931081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8dde9-00c8-4c66-ad56-41fe23a6846b service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:31.943212 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1852/3696] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:33.213453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ee4f0-1a54-4374-b694-9aa5872de8e1 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:33.215711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4d7ee4f0-1a54-4374-b694-9aa5872de8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:33.229926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ee4f0-1a54-4374-b694-9aa5872de8e1 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:33.234914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f637501-2e64-42c4-9aad-dc7a69c21783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:33.235835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f637501-2e64-42c4-9aad-dc7a69c21783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:33.236125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f637501-2e64-42c4-9aad-dc7a69c21783 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:33.236409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f637501-2e64-42c4-9aad-dc7a69c21783 admin admin] PATH_INFO: `/v3/projects/8f3a87b199b24854bb1e0699f7402e8d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:33.237934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f637501-2e64-42c4-9aad-dc7a69c21783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3a87b199b24854bb1e0699f7402e8d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:33.239856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f637501-2e64-42c4-9aad-dc7a69c21783 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:33.423346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0f637501-2e64-42c4-9aad-dc7a69c21783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3a87b199b24854bb1e0699f7402e8d', 'request_id': 'req-0f637501-2e64-42c4-9aad-dc7a69c21783'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:33.510415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0f637501-2e64-42c4-9aad-dc7a69c21783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3a87b199b24854bb1e0699f7402e8d', 'request_id': 'req-0f637501-2e64-42c4-9aad-dc7a69c21783'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:33.526978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0f637501-2e64-42c4-9aad-dc7a69c21783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3a87b199b24854bb1e0699f7402e8d', 'request_id': 'req-0f637501-2e64-42c4-9aad-dc7a69c21783'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:33.551330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0f637501-2e64-42c4-9aad-dc7a69c21783 admin admin] The token cache is being invalidate because project 8f3a87b199b24854bb1e0699f7402e8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:29:33.551934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0f637501-2e64-42c4-9aad-dc7a69c21783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:33.553502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0f637501-2e64-42c4-9aad-dc7a69c21783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:33.556099 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1845/3697] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:29:33 2022] DELETE /identity/v3/projects/8f3a87b199b24854bb1e0699f7402e8d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:33.560171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8dde9-00c8-4c66-ad56-41fe23a6846b service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:33.575564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8dde9-00c8-4c66-ad56-41fe23a6846b service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:33.686293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe48020-f2e5-4914-bb72-5f696bfb4c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:33.687418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe48020-f2e5-4914-bb72-5f696bfb4c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:33.687813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe48020-f2e5-4914-bb72-5f696bfb4c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:33.688370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe48020-f2e5-4914-bb72-5f696bfb4c8e admin admin] PATH_INFO: `/v3/users/8301d074b6c845d2a5a6c03bef6b6b94` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:33.691144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe48020-f2e5-4914-bb72-5f696bfb4c8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8301d074b6c845d2a5a6c03bef6b6b94)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:33.703857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe48020-f2e5-4914-bb72-5f696bfb4c8e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:34.056475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ffe48020-f2e5-4914-bb72-5f696bfb4c8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8301d074b6c845d2a5a6c03bef6b6b94'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:34.095101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ffe48020-f2e5-4914-bb72-5f696bfb4c8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8301d074b6c845d2a5a6c03bef6b6b94'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:34.095901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ffe48020-f2e5-4914-bb72-5f696bfb4c8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8301d074b6c845d2a5a6c03bef6b6b94'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:34.104750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ffe48020-f2e5-4914-bb72-5f696bfb4c8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8301d074b6c845d2a5a6c03bef6b6b94'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:34.198502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f637501-2e64-42c4-9aad-dc7a69c21783 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:34.203905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0f637501-2e64-42c4-9aad-dc7a69c21783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:34.204023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ffe48020-f2e5-4914-bb72-5f696bfb4c8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8301d074b6c845d2a5a6c03bef6b6b94'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:34.214551 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1853/3698] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:29:33 2022] DELETE /identity/v3/users/8301d074b6c845d2a5a6c03bef6b6b94 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:29:34.218035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f637501-2e64-42c4-9aad-dc7a69c21783 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:34.330852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54112f2-1215-4aff-881f-e576e28d3c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:34.354890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54112f2-1215-4aff-881f-e576e28d3c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:34.356379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54112f2-1215-4aff-881f-e576e28d3c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:34.356910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54112f2-1215-4aff-881f-e576e28d3c52 admin admin] PATH_INFO: `/v3/users/04ac3f0b81f3409f8ca246f490a2055e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:34.370597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54112f2-1215-4aff-881f-e576e28d3c52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04ac3f0b81f3409f8ca246f490a2055e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:34.382616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54112f2-1215-4aff-881f-e576e28d3c52 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:34.645356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b54112f2-1215-4aff-881f-e576e28d3c52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04ac3f0b81f3409f8ca246f490a2055e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:34.660501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b54112f2-1215-4aff-881f-e576e28d3c52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04ac3f0b81f3409f8ca246f490a2055e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:34.661574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b54112f2-1215-4aff-881f-e576e28d3c52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04ac3f0b81f3409f8ca246f490a2055e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:34.666696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe48020-f2e5-4914-bb72-5f696bfb4c8e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:34.669080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ffe48020-f2e5-4914-bb72-5f696bfb4c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:34.671082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b54112f2-1215-4aff-881f-e576e28d3c52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04ac3f0b81f3409f8ca246f490a2055e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:34.685201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe48020-f2e5-4914-bb72-5f696bfb4c8e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:34.692054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ad038-016c-4dd8-8893-4a019db367c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:34.692978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ad038-016c-4dd8-8893-4a019db367c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:34.693449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ad038-016c-4dd8-8893-4a019db367c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:34.693734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ad038-016c-4dd8-8893-4a019db367c9 admin admin] PATH_INFO: `/v3/projects/ec017741bbc04f0783dbb90c49061b1f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:34.695076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ad038-016c-4dd8-8893-4a019db367c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec017741bbc04f0783dbb90c49061b1f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:34.713233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ad038-016c-4dd8-8893-4a019db367c9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:34.811571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b54112f2-1215-4aff-881f-e576e28d3c52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04ac3f0b81f3409f8ca246f490a2055e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:34.819033 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1846/3699] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:29:34 2022] DELETE /identity/v3/users/04ac3f0b81f3409f8ca246f490a2055e => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:29:34.853224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-367ad038-016c-4dd8-8893-4a019db367c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec017741bbc04f0783dbb90c49061b1f', 'request_id': 'req-367ad038-016c-4dd8-8893-4a019db367c9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:34.860283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-367ad038-016c-4dd8-8893-4a019db367c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec017741bbc04f0783dbb90c49061b1f', 'request_id': 'req-367ad038-016c-4dd8-8893-4a019db367c9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:34.943438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-367ad038-016c-4dd8-8893-4a019db367c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec017741bbc04f0783dbb90c49061b1f', 'request_id': 'req-367ad038-016c-4dd8-8893-4a019db367c9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:34.955012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-367ad038-016c-4dd8-8893-4a019db367c9 admin admin] The token cache is being invalidate because project ec017741bbc04f0783dbb90c49061b1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:29:34.955322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-367ad038-016c-4dd8-8893-4a019db367c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:34.955964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-367ad038-016c-4dd8-8893-4a019db367c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:34.957546 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1854/3700] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:29:34 2022] DELETE /identity/v3/projects/ec017741bbc04f0783dbb90c49061b1f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:29:34.962506 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3a33f-98a8-410c-95c5-51412aa0a6b2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:34.962795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3a33f-98a8-410c-95c5-51412aa0a6b2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:34.963072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3a33f-98a8-410c-95c5-51412aa0a6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:34.982981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-67f3a33f-98a8-410c-95c5-51412aa0a6b2 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:34.984430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-67f3a33f-98a8-410c-95c5-51412aa0a6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:35.075391 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1847/3701] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:29:35.076569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415df29-c9bf-4316-8c40-927a1bef4f82 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:35.076905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415df29-c9bf-4316-8c40-927a1bef4f82 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:35.077185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415df29-c9bf-4316-8c40-927a1bef4f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:35.092031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3a33f-98a8-410c-95c5-51412aa0a6b2 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:35.093733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-67f3a33f-98a8-410c-95c5-51412aa0a6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:35.108419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3a33f-98a8-410c-95c5-51412aa0a6b2 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:35.114385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61decec2-de1f-44e2-948c-84bf6efdb2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:35.115662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61decec2-de1f-44e2-948c-84bf6efdb2e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:35.116054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61decec2-de1f-44e2-948c-84bf6efdb2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:35.116557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61decec2-de1f-44e2-948c-84bf6efdb2e2 admin admin] PATH_INFO: `/v3/users/3816b61af9864122a0b556581359f699` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:35.117013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9415df29-c9bf-4316-8c40-927a1bef4f82 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:35.118099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61decec2-de1f-44e2-948c-84bf6efdb2e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3816b61af9864122a0b556581359f699)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:35.118212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9415df29-c9bf-4316-8c40-927a1bef4f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:35.120493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61decec2-de1f-44e2-948c-84bf6efdb2e2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:35.136108 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1855/3702] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:29:35.142789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415df29-c9bf-4316-8c40-927a1bef4f82 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:35.160740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415df29-c9bf-4316-8c40-927a1bef4f82 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:35.166806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38385be8-9262-4374-acdf-bd73a9828f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:35.168527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38385be8-9262-4374-acdf-bd73a9828f03 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:35.168527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38385be8-9262-4374-acdf-bd73a9828f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:35.168527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38385be8-9262-4374-acdf-bd73a9828f03 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:35.168882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38385be8-9262-4374-acdf-bd73a9828f03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:29:35.169192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38385be8-9262-4374-acdf-bd73a9828f03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:35.170841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38385be8-9262-4374-acdf-bd73a9828f03 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:35.184301 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1856/3703] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:29:35.190184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38385be8-9262-4374-acdf-bd73a9828f03 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:35.204711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38385be8-9262-4374-acdf-bd73a9828f03 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:35.211185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5287c67-62ae-487b-9df0-5cb269b805de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:35.211850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5287c67-62ae-487b-9df0-5cb269b805de admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:35.212130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5287c67-62ae-487b-9df0-5cb269b805de admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:35.212407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5287c67-62ae-487b-9df0-5cb269b805de admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:35.213137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5287c67-62ae-487b-9df0-5cb269b805de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:35.215027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5287c67-62ae-487b-9df0-5cb269b805de admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:35.352781 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1857/3704] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:29:35 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:29:35.352781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5287c67-62ae-487b-9df0-5cb269b805de admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:35.354924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c5287c67-62ae-487b-9df0-5cb269b805de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:35.410745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-61decec2-de1f-44e2-948c-84bf6efdb2e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3816b61af9864122a0b556581359f699'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:35.428058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-61decec2-de1f-44e2-948c-84bf6efdb2e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3816b61af9864122a0b556581359f699'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:35.429410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-61decec2-de1f-44e2-948c-84bf6efdb2e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3816b61af9864122a0b556581359f699'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:35.441564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-61decec2-de1f-44e2-948c-84bf6efdb2e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3816b61af9864122a0b556581359f699'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:35.467920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5287c67-62ae-487b-9df0-5cb269b805de admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:35.490209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325929a9-e5cd-49f0-81d4-3e4dc4ffed0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:35.490209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325929a9-e5cd-49f0-81d4-3e4dc4ffed0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:35.490209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325929a9-e5cd-49f0-81d4-3e4dc4ffed0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:35.490209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325929a9-e5cd-49f0-81d4-3e4dc4ffed0c admin admin] PATH_INFO: `/v3/projects/1d5fba18b19446e8ac75b3792e386fc4` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:35.490452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325929a9-e5cd-49f0-81d4-3e4dc4ffed0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d5fba18b19446e8ac75b3792e386fc4)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:35.490452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325929a9-e5cd-49f0-81d4-3e4dc4ffed0c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:35.508835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-61decec2-de1f-44e2-948c-84bf6efdb2e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3816b61af9864122a0b556581359f699'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:35.518900 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1848/3705] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:29:35 2022] DELETE /identity/v3/users/3816b61af9864122a0b556581359f699 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:35.520114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61decec2-de1f-44e2-948c-84bf6efdb2e2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:35.524686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-61decec2-de1f-44e2-948c-84bf6efdb2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:35.603704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61decec2-de1f-44e2-948c-84bf6efdb2e2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:35.609667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e4278-b297-42e5-b5bd-4512c9235a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:35.610891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e4278-b297-42e5-b5bd-4512c9235a47 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:35.611271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e4278-b297-42e5-b5bd-4512c9235a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:35.611653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e4278-b297-42e5-b5bd-4512c9235a47 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:35.612420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e4278-b297-42e5-b5bd-4512c9235a47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:35.614796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e4278-b297-42e5-b5bd-4512c9235a47 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:35.653487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-325929a9-e5cd-49f0-81d4-3e4dc4ffed0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d5fba18b19446e8ac75b3792e386fc4', 'request_id': 'req-325929a9-e5cd-49f0-81d4-3e4dc4ffed0c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:35.671244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-325929a9-e5cd-49f0-81d4-3e4dc4ffed0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d5fba18b19446e8ac75b3792e386fc4', 'request_id': 'req-325929a9-e5cd-49f0-81d4-3e4dc4ffed0c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:35.715776 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1849/3706] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:29:35 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:29:35.717184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc9f9d-0ba7-4ac4-ba27-78afaac3af16 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:35.717469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc9f9d-0ba7-4ac4-ba27-78afaac3af16 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:35.718346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc9f9d-0ba7-4ac4-ba27-78afaac3af16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:35.738124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e5fc9f9d-0ba7-4ac4-ba27-78afaac3af16 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:35.739353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e5fc9f9d-0ba7-4ac4-ba27-78afaac3af16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:35.806449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-325929a9-e5cd-49f0-81d4-3e4dc4ffed0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d5fba18b19446e8ac75b3792e386fc4', 'request_id': 'req-325929a9-e5cd-49f0-81d4-3e4dc4ffed0c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:35.817164 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1850/3707] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:35.818092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc9f9d-0ba7-4ac4-ba27-78afaac3af16 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:35.834591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc9f9d-0ba7-4ac4-ba27-78afaac3af16 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:35.836122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-325929a9-e5cd-49f0-81d4-3e4dc4ffed0c admin admin] The token cache is being invalidate because project 1d5fba18b19446e8ac75b3792e386fc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:29:35.836549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-325929a9-e5cd-49f0-81d4-3e4dc4ffed0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:35.837482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-325929a9-e5cd-49f0-81d4-3e4dc4ffed0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:35.843906 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1858/3708] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:29:35 2022] DELETE /identity/v3/projects/1d5fba18b19446e8ac75b3792e386fc4 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:35.844030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29988093-9cc7-458d-88f7-9a61b6780c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:35.844030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29988093-9cc7-458d-88f7-9a61b6780c99 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:35.844030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29988093-9cc7-458d-88f7-9a61b6780c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:35.844030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29988093-9cc7-458d-88f7-9a61b6780c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:35.844312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29988093-9cc7-458d-88f7-9a61b6780c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:35.844399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325929a9-e5cd-49f0-81d4-3e4dc4ffed0c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:35.844486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29988093-9cc7-458d-88f7-9a61b6780c99 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:35.845510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-325929a9-e5cd-49f0-81d4-3e4dc4ffed0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:35.855202 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1851/3709] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:29:35.856620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67ba57-cb46-4dad-937e-4493f9a554b8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:35.862306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67ba57-cb46-4dad-937e-4493f9a554b8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:35.862306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67ba57-cb46-4dad-937e-4493f9a554b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:35.876119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1d67ba57-cb46-4dad-937e-4493f9a554b8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:35.877926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1d67ba57-cb46-4dad-937e-4493f9a554b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:35.888986 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1852/3710] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:35.889960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67ba57-cb46-4dad-937e-4493f9a554b8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:35.891768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1d67ba57-cb46-4dad-937e-4493f9a554b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:35.904541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67ba57-cb46-4dad-937e-4493f9a554b8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:35.909765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285632e-0a2e-456b-a261-48b534aa4765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:35.910477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285632e-0a2e-456b-a261-48b534aa4765 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:35.910806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285632e-0a2e-456b-a261-48b534aa4765 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:35.911030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285632e-0a2e-456b-a261-48b534aa4765 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:35.911773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285632e-0a2e-456b-a261-48b534aa4765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:35.913526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285632e-0a2e-456b-a261-48b534aa4765 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:35.922188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325929a9-e5cd-49f0-81d4-3e4dc4ffed0c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:35.923807 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1853/3711] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:29:35.925364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c66dd0-5e3b-4259-b560-0647f47dd73f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:35.925650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c66dd0-5e3b-4259-b560-0647f47dd73f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:35.926343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c66dd0-5e3b-4259-b560-0647f47dd73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:35.931341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f30b8-7520-403f-8b58-6aee014f597d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:35.932231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f30b8-7520-403f-8b58-6aee014f597d service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:35.932693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f30b8-7520-403f-8b58-6aee014f597d service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:35.933190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f30b8-7520-403f-8b58-6aee014f597d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:35.935521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cd1f30b8-7520-403f-8b58-6aee014f597d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:35.947615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a2c66dd0-5e3b-4259-b560-0647f47dd73f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:35.948952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f30b8-7520-403f-8b58-6aee014f597d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:35.949061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a2c66dd0-5e3b-4259-b560-0647f47dd73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:35.950588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f30b8-7520-403f-8b58-6aee014f597d service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:35.961212 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1854/3712] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:35.961212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c66dd0-5e3b-4259-b560-0647f47dd73f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:35.969420 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1859/3713] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:35.971239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f30b8-7520-403f-8b58-6aee014f597d service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:35.983291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c66dd0-5e3b-4259-b560-0647f47dd73f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:35.984513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f30b8-7520-403f-8b58-6aee014f597d service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:35.992344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4ddb2-bfb0-46e1-8f3c-5a74a4b1a39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:35.993414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4ddb2-bfb0-46e1-8f3c-5a74a4b1a39c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:35.994066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4ddb2-bfb0-46e1-8f3c-5a74a4b1a39c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:35.994565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4ddb2-bfb0-46e1-8f3c-5a74a4b1a39c admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:35.996232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4ddb2-bfb0-46e1-8f3c-5a74a4b1a39c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:29:35.996839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4ddb2-bfb0-46e1-8f3c-5a74a4b1a39c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:35.997068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255033f-5cca-42fd-b42f-1bedfa34c5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:35.998330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255033f-5cca-42fd-b42f-1bedfa34c5f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:36.002698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255033f-5cca-42fd-b42f-1bedfa34c5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:36.002698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255033f-5cca-42fd-b42f-1bedfa34c5f5 admin admin] PATH_INFO: `/v3/projects/0fd407e19119471bbbf24c91d9e1fdb8/users/68fbd43b80904411b61d9c1e5b8fa843/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:36.002862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4ddb2-bfb0-46e1-8f3c-5a74a4b1a39c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:36.023068 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1860/3714] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:29:36.027209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4ddb2-bfb0-46e1-8f3c-5a74a4b1a39c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:36.029317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255033f-5cca-42fd-b42f-1bedfa34c5f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd407e19119471bbbf24c91d9e1fdb8, user_id=68fbd43b80904411b61d9c1e5b8fa843, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:36.032053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255033f-5cca-42fd-b42f-1bedfa34c5f5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:36.044798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4ddb2-bfb0-46e1-8f3c-5a74a4b1a39c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:36.055501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcda0c7-e00b-4369-b55d-d171b9c91463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:36.056382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcda0c7-e00b-4369-b55d-d171b9c91463 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:36.056725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcda0c7-e00b-4369-b55d-d171b9c91463 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:36.057263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcda0c7-e00b-4369-b55d-d171b9c91463 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:36.058030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcda0c7-e00b-4369-b55d-d171b9c91463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:36.068010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcda0c7-e00b-4369-b55d-d171b9c91463 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:36.121112 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1855/3715] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:29:35 2022] PUT /identity/v3/projects/0fd407e19119471bbbf24c91d9e1fdb8/users/68fbd43b80904411b61d9c1e5b8fa843/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:36.132156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e50a6-39a3-48c0-922d-ffc6748bfebb None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:36.133286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e50a6-39a3-48c0-922d-ffc6748bfebb None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:36.133286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e50a6-39a3-48c0-922d-ffc6748bfebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:36.170503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4d8e50a6-39a3-48c0-922d-ffc6748bfebb None None] MFA Rules not processed for user `68fbd43b80904411b61d9c1e5b8fa843`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:36.171745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4d8e50a6-39a3-48c0-922d-ffc6748bfebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:36.246393 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1856/3716] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:36.248228 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1861/3717] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:29:36 2022] POST /identity/v3/projects => generated 379 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:29:36.253292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e50a6-39a3-48c0-922d-ffc6748bfebb None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:36.253548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcda0c7-e00b-4369-b55d-d171b9c91463 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:36.317041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcda0c7-e00b-4369-b55d-d171b9c91463 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:36.320526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e50a6-39a3-48c0-922d-ffc6748bfebb None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:36.322384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9579ab2-14af-4b34-aea8-31c6e1b9ac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:36.323078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9579ab2-14af-4b34-aea8-31c6e1b9ac03 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:36.323342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9579ab2-14af-4b34-aea8-31c6e1b9ac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:36.323627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9579ab2-14af-4b34-aea8-31c6e1b9ac03 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:36.324313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9579ab2-14af-4b34-aea8-31c6e1b9ac03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:36.325969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f465f-f7a9-4cda-9db4-459f8d2ba0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:36.326309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9579ab2-14af-4b34-aea8-31c6e1b9ac03 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:36.327004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f465f-f7a9-4cda-9db4-459f8d2ba0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:36.327688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f465f-f7a9-4cda-9db4-459f8d2ba0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:36.328116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f465f-f7a9-4cda-9db4-459f8d2ba0f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:36.328990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f465f-f7a9-4cda-9db4-459f8d2ba0f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:36.331157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f465f-f7a9-4cda-9db4-459f8d2ba0f2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:36.451971 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1862/3718] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:29:36 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:29:36.453067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9579ab2-14af-4b34-aea8-31c6e1b9ac03 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:36.454666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b9579ab2-14af-4b34-aea8-31c6e1b9ac03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:36.467505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9579ab2-14af-4b34-aea8-31c6e1b9ac03 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:36.473104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37912eca-1d44-4823-88c9-d4db5f10f46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:36.474075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37912eca-1d44-4823-88c9-d4db5f10f46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:36.474418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37912eca-1d44-4823-88c9-d4db5f10f46a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:36.474731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37912eca-1d44-4823-88c9-d4db5f10f46a admin admin] PATH_INFO: `/v3/projects/50a567b2bd8247c9bc061502897d6e7e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:36.476004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37912eca-1d44-4823-88c9-d4db5f10f46a admin admin] RBAC: Authorizing `identity:delete_project(project_id=50a567b2bd8247c9bc061502897d6e7e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:36.477184 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1857/3719] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:29:36 2022] POST /identity/v3/projects => generated 375 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:29:36.478600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37912eca-1d44-4823-88c9-d4db5f10f46a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:36.481278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f465f-f7a9-4cda-9db4-459f8d2ba0f2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:36.541688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f465f-f7a9-4cda-9db4-459f8d2ba0f2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:36.547406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dfe59-cc06-4112-a4d7-dd4f9fdf2bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:36.548089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dfe59-cc06-4112-a4d7-dd4f9fdf2bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:36.548380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dfe59-cc06-4112-a4d7-dd4f9fdf2bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:36.548703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dfe59-cc06-4112-a4d7-dd4f9fdf2bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:36.550060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868dfe59-cc06-4112-a4d7-dd4f9fdf2bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:36.551754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868dfe59-cc06-4112-a4d7-dd4f9fdf2bc2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:36.561779 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1858/3720] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:29:36.562736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dfe59-cc06-4112-a4d7-dd4f9fdf2bc2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:36.572246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dfe59-cc06-4112-a4d7-dd4f9fdf2bc2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:36.577155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafc95a-f885-426f-a974-7a31e10f672e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:36.577837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc95a-f885-426f-a974-7a31e10f672e admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:36.578125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc95a-f885-426f-a974-7a31e10f672e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:36.578431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc95a-f885-426f-a974-7a31e10f672e admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:36.579149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafc95a-f885-426f-a974-7a31e10f672e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:36.581246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafc95a-f885-426f-a974-7a31e10f672e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:36.616948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-37912eca-1d44-4823-88c9-d4db5f10f46a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50a567b2bd8247c9bc061502897d6e7e', 'request_id': 'req-37912eca-1d44-4823-88c9-d4db5f10f46a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:36.630978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-37912eca-1d44-4823-88c9-d4db5f10f46a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50a567b2bd8247c9bc061502897d6e7e', 'request_id': 'req-37912eca-1d44-4823-88c9-d4db5f10f46a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:36.688861 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1859/3721] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:29:36 2022] POST /identity/v3/users => generated 294 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:29:36.691248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafc95a-f885-426f-a974-7a31e10f672e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:36.741072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafc95a-f885-426f-a974-7a31e10f672e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:36.748717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-37912eca-1d44-4823-88c9-d4db5f10f46a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50a567b2bd8247c9bc061502897d6e7e', 'request_id': 'req-37912eca-1d44-4823-88c9-d4db5f10f46a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:36.764476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-37912eca-1d44-4823-88c9-d4db5f10f46a admin admin] The token cache is being invalidate because project 50a567b2bd8247c9bc061502897d6e7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:29:36.765478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-37912eca-1d44-4823-88c9-d4db5f10f46a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:36.768429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-37912eca-1d44-4823-88c9-d4db5f10f46a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:36.774017 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1863/3722] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:29:36 2022] DELETE /identity/v3/projects/50a567b2bd8247c9bc061502897d6e7e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:36.774879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37912eca-1d44-4823-88c9-d4db5f10f46a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:36.782667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-37912eca-1d44-4823-88c9-d4db5f10f46a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:36.867919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b37e17-03fe-437c-b9b9-2de5676484fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:36.868640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b37e17-03fe-437c-b9b9-2de5676484fc admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:36.869238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b37e17-03fe-437c-b9b9-2de5676484fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:36.869526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b37e17-03fe-437c-b9b9-2de5676484fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:36.872138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b37e17-03fe-437c-b9b9-2de5676484fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:36.874265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b37e17-03fe-437c-b9b9-2de5676484fc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:36.890226 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1860/3723] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:29:36.891100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b37e17-03fe-437c-b9b9-2de5676484fc admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:36.895178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-15b37e17-03fe-437c-b9b9-2de5676484fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:36.903861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37912eca-1d44-4823-88c9-d4db5f10f46a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:36.909349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b37e17-03fe-437c-b9b9-2de5676484fc admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:36.909492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774cbd9-d2da-493e-8ea6-35fc8f9ca0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:36.910167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774cbd9-d2da-493e-8ea6-35fc8f9ca0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:36.910541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774cbd9-d2da-493e-8ea6-35fc8f9ca0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:36.910782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774cbd9-d2da-493e-8ea6-35fc8f9ca0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:36.911470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774cbd9-d2da-493e-8ea6-35fc8f9ca0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:36.915300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774cbd9-d2da-493e-8ea6-35fc8f9ca0e3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:36.917342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ef928-ff80-455c-a4fb-e6b2be819ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:36.918594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ef928-ff80-455c-a4fb-e6b2be819ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:36.918594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ef928-ff80-455c-a4fb-e6b2be819ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:36.918877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ef928-ff80-455c-a4fb-e6b2be819ce2 admin admin] PATH_INFO: `/v3/users/ce997f812ef04dff853a3de6b0f45302` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:36.920349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ef928-ff80-455c-a4fb-e6b2be819ce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce997f812ef04dff853a3de6b0f45302)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:36.922294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ef928-ff80-455c-a4fb-e6b2be819ce2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:36.923409 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1864/3724] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:29:36.924234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774cbd9-d2da-493e-8ea6-35fc8f9ca0e3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:36.926071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2774cbd9-d2da-493e-8ea6-35fc8f9ca0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:36.939638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774cbd9-d2da-493e-8ea6-35fc8f9ca0e3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:36.945112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a519dce-dcb7-483c-9d98-69d336a1e3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:36.946030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a519dce-dcb7-483c-9d98-69d336a1e3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:36.946319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a519dce-dcb7-483c-9d98-69d336a1e3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:36.946640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a519dce-dcb7-483c-9d98-69d336a1e3f7 admin admin] PATH_INFO: `/v3/projects/7b88222d9c35413dabb63e3807c81700/users/8983f7b383b644f5ae9ac927fbe54cf2/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:36.962864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a519dce-dcb7-483c-9d98-69d336a1e3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b88222d9c35413dabb63e3807c81700, user_id=8983f7b383b644f5ae9ac927fbe54cf2, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:36.965678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a519dce-dcb7-483c-9d98-69d336a1e3f7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:37.084771 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1865/3725] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:29:36 2022] PUT /identity/v3/projects/7b88222d9c35413dabb63e3807c81700/users/8983f7b383b644f5ae9ac927fbe54cf2/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:37.085982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a519dce-dcb7-483c-9d98-69d336a1e3f7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:37.169947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a519dce-dcb7-483c-9d98-69d336a1e3f7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:37.175689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603db54c-af5e-4a85-aada-1ad3bbfa29b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:37.176973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603db54c-af5e-4a85-aada-1ad3bbfa29b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:37.178151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603db54c-af5e-4a85-aada-1ad3bbfa29b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:37.178612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603db54c-af5e-4a85-aada-1ad3bbfa29b2 admin admin] PATH_INFO: `/v3/projects/7e092933a52146129c95f8cf20759acc/users/7f967a3d7e00453a9c4a2e7b645b645e/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:37.186819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f02ef928-ff80-455c-a4fb-e6b2be819ce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce997f812ef04dff853a3de6b0f45302'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:37.195900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603db54c-af5e-4a85-aada-1ad3bbfa29b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e092933a52146129c95f8cf20759acc, user_id=7f967a3d7e00453a9c4a2e7b645b645e, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:37.198972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603db54c-af5e-4a85-aada-1ad3bbfa29b2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:37.199898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f02ef928-ff80-455c-a4fb-e6b2be819ce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce997f812ef04dff853a3de6b0f45302'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:37.200713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f02ef928-ff80-455c-a4fb-e6b2be819ce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce997f812ef04dff853a3de6b0f45302'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:37.208761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f02ef928-ff80-455c-a4fb-e6b2be819ce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce997f812ef04dff853a3de6b0f45302'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:37.286265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f02ef928-ff80-455c-a4fb-e6b2be819ce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce997f812ef04dff853a3de6b0f45302'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:37.292661 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1866/3726] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:29:37 2022] PUT /identity/v3/projects/7e092933a52146129c95f8cf20759acc/users/7f967a3d7e00453a9c4a2e7b645b645e/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:37.296755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42ce05-8c43-40f1-aaa2-fd09d2d97ed5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:37.297047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42ce05-8c43-40f1-aaa2-fd09d2d97ed5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:37.297325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42ce05-8c43-40f1-aaa2-fd09d2d97ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:37.304098 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1861/3727] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:29:36 2022] DELETE /identity/v3/users/ce997f812ef04dff853a3de6b0f45302 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:37.305073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ef928-ff80-455c-a4fb-e6b2be819ce2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:37.306470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f02ef928-ff80-455c-a4fb-e6b2be819ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:37.322256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-dc42ce05-8c43-40f1-aaa2-fd09d2d97ed5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:37.322705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-dc42ce05-8c43-40f1-aaa2-fd09d2d97ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:37.406930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ef928-ff80-455c-a4fb-e6b2be819ce2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:37.412238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e4c06-f534-4c35-98b6-526cf763dbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:37.412895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e4c06-f534-4c35-98b6-526cf763dbaf admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:37.413187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e4c06-f534-4c35-98b6-526cf763dbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:37.413470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e4c06-f534-4c35-98b6-526cf763dbaf admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:37.414205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e4c06-f534-4c35-98b6-526cf763dbaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:37.416076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e4c06-f534-4c35-98b6-526cf763dbaf admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:37.419336 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1867/3728] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:37.430031 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1862/3729] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:29:37.430203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42ce05-8c43-40f1-aaa2-fd09d2d97ed5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:37.430203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-dc42ce05-8c43-40f1-aaa2-fd09d2d97ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:37.430994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e4c06-f534-4c35-98b6-526cf763dbaf admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:37.442954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e4c06-f534-4c35-98b6-526cf763dbaf admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:37.448749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df876f3-7ffc-449f-b9c5-c845401df283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:37.450097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df876f3-7ffc-449f-b9c5-c845401df283 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:37.450941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df876f3-7ffc-449f-b9c5-c845401df283 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:37.451192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df876f3-7ffc-449f-b9c5-c845401df283 admin admin] PATH_INFO: `/v3/projects/7e092933a52146129c95f8cf20759acc/users/7f967a3d7e00453a9c4a2e7b645b645e/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:37.453347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df876f3-7ffc-449f-b9c5-c845401df283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e092933a52146129c95f8cf20759acc, user_id=7f967a3d7e00453a9c4a2e7b645b645e, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:37.457060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df876f3-7ffc-449f-b9c5-c845401df283 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:37.468199 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1863/3730] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:29:37 2022] PUT /identity/v3/projects/7e092933a52146129c95f8cf20759acc/users/7f967a3d7e00453a9c4a2e7b645b645e/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:29:37.480990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee95ca3-31cf-4065-a5de-7b1331849074 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:37.481595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee95ca3-31cf-4065-a5de-7b1331849074 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:37.481595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee95ca3-31cf-4065-a5de-7b1331849074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:37.515526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-eee95ca3-31cf-4065-a5de-7b1331849074 None None] MFA Rules not processed for user `7f967a3d7e00453a9c4a2e7b645b645e`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:37.516908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42ce05-8c43-40f1-aaa2-fd09d2d97ed5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:37.517019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-eee95ca3-31cf-4065-a5de-7b1331849074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:37.575323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7bbef5-555a-4219-addb-73fbdf88be7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:37.576006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bbef5-555a-4219-addb-73fbdf88be7a service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:37.576275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bbef5-555a-4219-addb-73fbdf88be7a service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:37.576531 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7bbef5-555a-4219-addb-73fbdf88be7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:37.596903 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1864/3731] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:29:37.598299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee95ca3-31cf-4065-a5de-7b1331849074 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:37.600007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-eee95ca3-31cf-4065-a5de-7b1331849074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:37.657359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7bbef5-555a-4219-addb-73fbdf88be7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:37.659758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7bbef5-555a-4219-addb-73fbdf88be7a service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:37.675720 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1868/3732] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:29:37.677533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acac6c-30b3-4eec-9040-a0b31f5acb2a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:37.678135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acac6c-30b3-4eec-9040-a0b31f5acb2a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:37.678588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acac6c-30b3-4eec-9040-a0b31f5acb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:37.716095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-22acac6c-30b3-4eec-9040-a0b31f5acb2a None None] MFA Rules not processed for user `68fbd43b80904411b61d9c1e5b8fa843`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:37.717456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-22acac6c-30b3-4eec-9040-a0b31f5acb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:37.749220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee95ca3-31cf-4065-a5de-7b1331849074 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:37.755414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cbbff-89cb-470e-9917-984a4da04672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:37.756312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cbbff-89cb-470e-9917-984a4da04672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:37.756621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cbbff-89cb-470e-9917-984a4da04672 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:37.756906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cbbff-89cb-470e-9917-984a4da04672 admin admin] PATH_INFO: `/v3/users/516be147aabf4c07a63f33b4350812e7` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:37.758120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cbbff-89cb-470e-9917-984a4da04672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=516be147aabf4c07a63f33b4350812e7)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:37.760049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cbbff-89cb-470e-9917-984a4da04672 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:37.782581 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1869/3733] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:37.783683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acac6c-30b3-4eec-9040-a0b31f5acb2a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:37.786114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-22acac6c-30b3-4eec-9040-a0b31f5acb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:37.844726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acac6c-30b3-4eec-9040-a0b31f5acb2a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:37.849425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a92343-866a-4e7f-a530-263bec6a4008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:37.850310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a92343-866a-4e7f-a530-263bec6a4008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:37.850598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a92343-866a-4e7f-a530-263bec6a4008 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:37.850881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a92343-866a-4e7f-a530-263bec6a4008 admin admin] PATH_INFO: `/v3/projects/f9a8b6ef10774a0597de62234e3b2680` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:37.852119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a92343-866a-4e7f-a530-263bec6a4008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9a8b6ef10774a0597de62234e3b2680)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:37.854552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a92343-866a-4e7f-a530-263bec6a4008 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:38.006081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d8a92343-866a-4e7f-a530-263bec6a4008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9a8b6ef10774a0597de62234e3b2680', 'request_id': 'req-d8a92343-866a-4e7f-a530-263bec6a4008'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:38.012094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d8a92343-866a-4e7f-a530-263bec6a4008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9a8b6ef10774a0597de62234e3b2680', 'request_id': 'req-d8a92343-866a-4e7f-a530-263bec6a4008'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:38.112582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d8a92343-866a-4e7f-a530-263bec6a4008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9a8b6ef10774a0597de62234e3b2680', 'request_id': 'req-d8a92343-866a-4e7f-a530-263bec6a4008'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:38.128380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d8a92343-866a-4e7f-a530-263bec6a4008 admin admin] The token cache is being invalidate because project f9a8b6ef10774a0597de62234e3b2680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:29:38.128834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d8a92343-866a-4e7f-a530-263bec6a4008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:38.129614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d8a92343-866a-4e7f-a530-263bec6a4008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:38.133237 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1870/3734] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:29:37 2022] DELETE /identity/v3/projects/f9a8b6ef10774a0597de62234e3b2680 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:38.137954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a92343-866a-4e7f-a530-263bec6a4008 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:38.139477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d8a92343-866a-4e7f-a530-263bec6a4008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:38.238013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a92343-866a-4e7f-a530-263bec6a4008 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:38.244227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16207a7d-bd48-469a-a39a-cd9c0ab4a44d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:38.245055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16207a7d-bd48-469a-a39a-cd9c0ab4a44d service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:38.245418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16207a7d-bd48-469a-a39a-cd9c0ab4a44d service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:38.245772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16207a7d-bd48-469a-a39a-cd9c0ab4a44d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:38.250097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-16207a7d-bd48-469a-a39a-cd9c0ab4a44d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:38.309524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-367cbbff-89cb-470e-9917-984a4da04672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '516be147aabf4c07a63f33b4350812e7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:38.338092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-367cbbff-89cb-470e-9917-984a4da04672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '516be147aabf4c07a63f33b4350812e7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:38.349542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-367cbbff-89cb-470e-9917-984a4da04672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '516be147aabf4c07a63f33b4350812e7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:38.360996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-367cbbff-89cb-470e-9917-984a4da04672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '516be147aabf4c07a63f33b4350812e7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:38.385972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16207a7d-bd48-469a-a39a-cd9c0ab4a44d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:38.387864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16207a7d-bd48-469a-a39a-cd9c0ab4a44d service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:38.404633 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1871/3735] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:38.404633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d196d4-b928-497a-a511-e56ff04002d1 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:38.404633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d196d4-b928-497a-a511-e56ff04002d1 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:38.404633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d196d4-b928-497a-a511-e56ff04002d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:38.428655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-367cbbff-89cb-470e-9917-984a4da04672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '516be147aabf4c07a63f33b4350812e7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:38.437561 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1865/3736] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:29:37 2022] DELETE /identity/v3/users/516be147aabf4c07a63f33b4350812e7 => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:38.494714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-09d196d4-b928-497a-a511-e56ff04002d1 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:38.499993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-09d196d4-b928-497a-a511-e56ff04002d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:38.593124 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1872/3737] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:38.601431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a004b1-2522-4bc5-9d9e-b517e5424c35 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:38.602434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a004b1-2522-4bc5-9d9e-b517e5424c35 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:38.602936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a004b1-2522-4bc5-9d9e-b517e5424c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:38.628524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-55a004b1-2522-4bc5-9d9e-b517e5424c35 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:38.632753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-55a004b1-2522-4bc5-9d9e-b517e5424c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:38.649278 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1866/3738] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:38.653520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d196d4-b928-497a-a511-e56ff04002d1 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:38.669984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d196d4-b928-497a-a511-e56ff04002d1 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:38.677393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a68ebc-553f-45ef-a5a8-ead7a8740f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:38.678047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a68ebc-553f-45ef-a5a8-ead7a8740f0e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:38.678444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a68ebc-553f-45ef-a5a8-ead7a8740f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:38.678929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a68ebc-553f-45ef-a5a8-ead7a8740f0e admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:38.680724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a68ebc-553f-45ef-a5a8-ead7a8740f0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:29:38.681305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a68ebc-553f-45ef-a5a8-ead7a8740f0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:38.683116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a68ebc-553f-45ef-a5a8-ead7a8740f0e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:38.700179 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1873/3739] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:29:38.716250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a004b1-2522-4bc5-9d9e-b517e5424c35 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:38.737580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a004b1-2522-4bc5-9d9e-b517e5424c35 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:38.747114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed5d6b-386a-4917-b03f-bfd10988f5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:38.749086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed5d6b-386a-4917-b03f-bfd10988f5ee admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:38.749482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed5d6b-386a-4917-b03f-bfd10988f5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:38.750094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed5d6b-386a-4917-b03f-bfd10988f5ee admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:38.750944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed5d6b-386a-4917-b03f-bfd10988f5ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:38.754074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed5d6b-386a-4917-b03f-bfd10988f5ee admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:38.864665 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1867/3740] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:29:38 2022] POST /identity/v3/projects => generated 403 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:29:38.868486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a68ebc-553f-45ef-a5a8-ead7a8740f0e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:38.886603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a68ebc-553f-45ef-a5a8-ead7a8740f0e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:39.005145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819bed0-2814-424f-8bf0-6ec5ad6142a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:39.006075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819bed0-2814-424f-8bf0-6ec5ad6142a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:39.007307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819bed0-2814-424f-8bf0-6ec5ad6142a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:39.007745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819bed0-2814-424f-8bf0-6ec5ad6142a5 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:39.008640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819bed0-2814-424f-8bf0-6ec5ad6142a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:39.010785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819bed0-2814-424f-8bf0-6ec5ad6142a5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:39.128280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed5d6b-386a-4917-b03f-bfd10988f5ee admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:39.130733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-08ed5d6b-386a-4917-b03f-bfd10988f5ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:39.147505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed5d6b-386a-4917-b03f-bfd10988f5ee admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:39.154705 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1874/3741] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:29:38 2022] POST /identity/v3/users => generated 302 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:29:39.158892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819bed0-2814-424f-8bf0-6ec5ad6142a5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:39.161434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324571f2-d7ac-44de-b59a-2384eb6ce1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:39.162807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324571f2-d7ac-44de-b59a-2384eb6ce1f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:39.162807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324571f2-d7ac-44de-b59a-2384eb6ce1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:39.165156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324571f2-d7ac-44de-b59a-2384eb6ce1f9 admin admin] PATH_INFO: `/v3/projects/b2b72e8c93b64fbab043bc10a6c8d60b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:39.170387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324571f2-d7ac-44de-b59a-2384eb6ce1f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b72e8c93b64fbab043bc10a6c8d60b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:39.177418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324571f2-d7ac-44de-b59a-2384eb6ce1f9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:39.194590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819bed0-2814-424f-8bf0-6ec5ad6142a5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:39.200307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0473a4-4de7-428b-9b0d-e687b78564ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:39.201360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0473a4-4de7-428b-9b0d-e687b78564ee admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:39.201682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0473a4-4de7-428b-9b0d-e687b78564ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:39.201962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0473a4-4de7-428b-9b0d-e687b78564ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:39.202741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0473a4-4de7-428b-9b0d-e687b78564ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:39.204360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0473a4-4de7-428b-9b0d-e687b78564ee admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:39.217884 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1875/3742] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:29:39.223071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0473a4-4de7-428b-9b0d-e687b78564ee admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:39.237912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0473a4-4de7-428b-9b0d-e687b78564ee admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:39.263199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e7ace-f507-48bc-84d1-ad4cfd677b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:39.264222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e7ace-f507-48bc-84d1-ad4cfd677b3c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:39.264751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e7ace-f507-48bc-84d1-ad4cfd677b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:39.269626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e7ace-f507-48bc-84d1-ad4cfd677b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:39.270697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e7ace-f507-48bc-84d1-ad4cfd677b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:39.273599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e7ace-f507-48bc-84d1-ad4cfd677b3c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:39.308271 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1876/3743] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:29:39.310101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589db65-2daa-4c18-88b7-31bd1aeb21c0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:39.313587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589db65-2daa-4c18-88b7-31bd1aeb21c0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:39.314101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589db65-2daa-4c18-88b7-31bd1aeb21c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:39.334979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-324571f2-d7ac-44de-b59a-2384eb6ce1f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b72e8c93b64fbab043bc10a6c8d60b', 'request_id': 'req-324571f2-d7ac-44de-b59a-2384eb6ce1f9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:39.362941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5589db65-2daa-4c18-88b7-31bd1aeb21c0 None None] MFA Rules not processed for user `68fbd43b80904411b61d9c1e5b8fa843`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:39.365655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5589db65-2daa-4c18-88b7-31bd1aeb21c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:39.413017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-324571f2-d7ac-44de-b59a-2384eb6ce1f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b72e8c93b64fbab043bc10a6c8d60b', 'request_id': 'req-324571f2-d7ac-44de-b59a-2384eb6ce1f9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:39.426380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-324571f2-d7ac-44de-b59a-2384eb6ce1f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b72e8c93b64fbab043bc10a6c8d60b', 'request_id': 'req-324571f2-d7ac-44de-b59a-2384eb6ce1f9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:39.459811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-324571f2-d7ac-44de-b59a-2384eb6ce1f9 admin admin] The token cache is being invalidate because project b2b72e8c93b64fbab043bc10a6c8d60b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:29:39.460137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-324571f2-d7ac-44de-b59a-2384eb6ce1f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:39.461874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-324571f2-d7ac-44de-b59a-2384eb6ce1f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:29:39.470507 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1868/3744] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:29:39 2022] DELETE /identity/v3/projects/b2b72e8c93b64fbab043bc10a6c8d60b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:39.472113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324571f2-d7ac-44de-b59a-2384eb6ce1f9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:39.479690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-324571f2-d7ac-44de-b59a-2384eb6ce1f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:39.555271 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1877/3745] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:39.557393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f809663-92aa-4bd0-90ee-1a68471c9d7f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:39.559542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f809663-92aa-4bd0-90ee-1a68471c9d7f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:39.562802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f809663-92aa-4bd0-90ee-1a68471c9d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:39.667823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-1f809663-92aa-4bd0-90ee-1a68471c9d7f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:39.669463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1f809663-92aa-4bd0-90ee-1a68471c9d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:39.737115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324571f2-d7ac-44de-b59a-2384eb6ce1f9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:39.746232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad45872-3e89-4b46-b7cc-9014f4d22818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:39.747308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad45872-3e89-4b46-b7cc-9014f4d22818 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:39.747453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad45872-3e89-4b46-b7cc-9014f4d22818 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:39.747719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad45872-3e89-4b46-b7cc-9014f4d22818 admin admin] PATH_INFO: `/v3/projects/2235fe46aff549b1b700357f9455a129/users/7acc933705b14e54b3a04625a1d3c8fa/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:39.791254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad45872-3e89-4b46-b7cc-9014f4d22818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2235fe46aff549b1b700357f9455a129, user_id=7acc933705b14e54b3a04625a1d3c8fa, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:39.795665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad45872-3e89-4b46-b7cc-9014f4d22818 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:39.797490 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1878/3746] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:39.808269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3863dd-7327-499d-b46d-9953d6ba18d8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:39.811870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3863dd-7327-499d-b46d-9953d6ba18d8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:39.813875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3863dd-7327-499d-b46d-9953d6ba18d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:39.852589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8f3863dd-7327-499d-b46d-9953d6ba18d8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:39.854088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8f3863dd-7327-499d-b46d-9953d6ba18d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:39.866194 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1879/3747] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:39.869916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3863dd-7327-499d-b46d-9953d6ba18d8 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:39.882714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3863dd-7327-499d-b46d-9953d6ba18d8 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:39.915204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cabc9e-4b6f-4010-ae3a-e9731210bb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:39.916182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cabc9e-4b6f-4010-ae3a-e9731210bb30 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:39.916577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cabc9e-4b6f-4010-ae3a-e9731210bb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:39.916987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cabc9e-4b6f-4010-ae3a-e9731210bb30 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:39.917887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cabc9e-4b6f-4010-ae3a-e9731210bb30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:29:39.918794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cabc9e-4b6f-4010-ae3a-e9731210bb30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:39.921267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cabc9e-4b6f-4010-ae3a-e9731210bb30 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:39.938944 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1880/3748] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:29:39.939144 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1869/3749] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:29:39 2022] PUT /identity/v3/projects/2235fe46aff549b1b700357f9455a129/users/7acc933705b14e54b3a04625a1d3c8fa/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:39.940766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cabc9e-4b6f-4010-ae3a-e9731210bb30 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:39.942002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ca67f-68b9-469d-9e90-9cb6cecbd5e1 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:39.942290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ca67f-68b9-469d-9e90-9cb6cecbd5e1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:39.942581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ca67f-68b9-469d-9e90-9cb6cecbd5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:39.956867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cabc9e-4b6f-4010-ae3a-e9731210bb30 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:39.990646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-cf5ca67f-68b9-469d-9e90-9cb6cecbd5e1 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:39.991909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-cf5ca67f-68b9-469d-9e90-9cb6cecbd5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:40.097992 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1870/3750] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:40.101603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28b1ec-a538-4ccb-95c5-6d42b7c9cf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:40.102293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28b1ec-a538-4ccb-95c5-6d42b7c9cf7b admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:40.102584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28b1ec-a538-4ccb-95c5-6d42b7c9cf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:40.102962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28b1ec-a538-4ccb-95c5-6d42b7c9cf7b admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:40.103818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28b1ec-a538-4ccb-95c5-6d42b7c9cf7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:40.105898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28b1ec-a538-4ccb-95c5-6d42b7c9cf7b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:40.144819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ca67f-68b9-469d-9e90-9cb6cecbd5e1 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:40.150096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-cf5ca67f-68b9-469d-9e90-9cb6cecbd5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:40.203185 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1881/3751] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:29:39 2022] POST /identity/v3/projects => generated 379 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:29:40.206257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28b1ec-a538-4ccb-95c5-6d42b7c9cf7b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:40.324304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ca67f-68b9-469d-9e90-9cb6cecbd5e1 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:40.372472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28b1ec-a538-4ccb-95c5-6d42b7c9cf7b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:40.379448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89537aff-89b7-43bf-a68e-bc7437e6d685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:40.380487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89537aff-89b7-43bf-a68e-bc7437e6d685 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:40.381047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89537aff-89b7-43bf-a68e-bc7437e6d685 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:40.381546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89537aff-89b7-43bf-a68e-bc7437e6d685 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:40.382448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89537aff-89b7-43bf-a68e-bc7437e6d685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:40.384807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89537aff-89b7-43bf-a68e-bc7437e6d685 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:40.449123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b433479-f508-4e16-acb8-f12471c90a40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:40.449788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b433479-f508-4e16-acb8-f12471c90a40 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:40.450499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b433479-f508-4e16-acb8-f12471c90a40 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:40.450499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b433479-f508-4e16-acb8-f12471c90a40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:40.462789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b433479-f508-4e16-acb8-f12471c90a40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:40.464321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b433479-f508-4e16-acb8-f12471c90a40 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:40.495023 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1871/3752] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:40.568299 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1882/3753] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:29:40 2022] POST /identity/v3/users => generated 290 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:29:40.572225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b433479-f508-4e16-acb8-f12471c90a40 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:40.583999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b433479-f508-4e16-acb8-f12471c90a40 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:40.602121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c26aa7-da71-40f7-864b-dc67251e6e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:40.602805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c26aa7-da71-40f7-864b-dc67251e6e30 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:40.603081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c26aa7-da71-40f7-864b-dc67251e6e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:40.603352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c26aa7-da71-40f7-864b-dc67251e6e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:40.604229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c26aa7-da71-40f7-864b-dc67251e6e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:40.605730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c26aa7-da71-40f7-864b-dc67251e6e30 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:40.626171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89537aff-89b7-43bf-a68e-bc7437e6d685 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:40.626548 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1872/3754] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:29:40.638036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89537aff-89b7-43bf-a68e-bc7437e6d685 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:40.643786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c58a3-0b16-49c0-bbe3-66dee1daa69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:40.655979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c58a3-0b16-49c0-bbe3-66dee1daa69e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:40.655979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c58a3-0b16-49c0-bbe3-66dee1daa69e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:40.655979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c58a3-0b16-49c0-bbe3-66dee1daa69e admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:40.655979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c58a3-0b16-49c0-bbe3-66dee1daa69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:40.655979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c58a3-0b16-49c0-bbe3-66dee1daa69e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:40.670443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c26aa7-da71-40f7-864b-dc67251e6e30 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:40.670931 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1883/3755] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:29:40.690627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c26aa7-da71-40f7-864b-dc67251e6e30 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:40.703327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66557ad4-4eee-4e9c-857a-62f55bf1a8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:40.704529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66557ad4-4eee-4e9c-857a-62f55bf1a8a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:40.704854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66557ad4-4eee-4e9c-857a-62f55bf1a8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:40.705168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66557ad4-4eee-4e9c-857a-62f55bf1a8a5 admin admin] PATH_INFO: `/v3/projects/49eb61123f624832aa949f49de778c90/users/75902673ba414cd895898e64cd3060bc/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:40.726670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66557ad4-4eee-4e9c-857a-62f55bf1a8a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49eb61123f624832aa949f49de778c90, user_id=75902673ba414cd895898e64cd3060bc, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:40.730774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66557ad4-4eee-4e9c-857a-62f55bf1a8a5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:40.841178 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1873/3756] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:29:40 2022] PUT /identity/v3/projects/49eb61123f624832aa949f49de778c90/users/75902673ba414cd895898e64cd3060bc/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:29:40.846306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c0729-8a19-4d2f-bc9c-5482e1edeb8c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:40.846836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c0729-8a19-4d2f-bc9c-5482e1edeb8c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:40.847311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c0729-8a19-4d2f-bc9c-5482e1edeb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:40.880219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ac1c0729-8a19-4d2f-bc9c-5482e1edeb8c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:40.884693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ac1c0729-8a19-4d2f-bc9c-5482e1edeb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:41.006073 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1884/3757] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:41.043061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66557ad4-4eee-4e9c-857a-62f55bf1a8a5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:41.233573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66557ad4-4eee-4e9c-857a-62f55bf1a8a5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:41.240537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d26069-7064-445d-b992-d81316aec991 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:41.241509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d26069-7064-445d-b992-d81316aec991 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:41.241898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d26069-7064-445d-b992-d81316aec991 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:41.242304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d26069-7064-445d-b992-d81316aec991 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:41.256186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d26069-7064-445d-b992-d81316aec991 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:41.257865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d26069-7064-445d-b992-d81316aec991 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:41.277368 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1874/3758] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:45.344145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28d7cd-d618-4b8a-a12d-520db039a175 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:45.344957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28d7cd-d618-4b8a-a12d-520db039a175 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:45.346560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28d7cd-d618-4b8a-a12d-520db039a175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:45.422745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5d28d7cd-d618-4b8a-a12d-520db039a175 None None] MFA Rules not processed for user `75902673ba414cd895898e64cd3060bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:45.426133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5d28d7cd-d618-4b8a-a12d-520db039a175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:45.569693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddf430-8d44-4daa-b004-391587920b48 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:45.570171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddf430-8d44-4daa-b004-391587920b48 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:45.570246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddf430-8d44-4daa-b004-391587920b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:45.571161 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1885/3759] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:45.607589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6fddf430-8d44-4daa-b004-391587920b48 None None] MFA Rules not processed for user `75902673ba414cd895898e64cd3060bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:45.610451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6fddf430-8d44-4daa-b004-391587920b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:45.636819 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1875/3760] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:29:45.649574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28d7cd-d618-4b8a-a12d-520db039a175 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:45.651400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5d28d7cd-d618-4b8a-a12d-520db039a175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:45.875562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28d7cd-d618-4b8a-a12d-520db039a175 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:45.889696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b61a4-88cd-42ab-8219-b9308782cc1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:45.890629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b61a4-88cd-42ab-8219-b9308782cc1f service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:45.891088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b61a4-88cd-42ab-8219-b9308782cc1f service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:45.891509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b61a4-88cd-42ab-8219-b9308782cc1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:45.917672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b61a4-88cd-42ab-8219-b9308782cc1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:45.919344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b61a4-88cd-42ab-8219-b9308782cc1f service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:45.949071 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1886/3761] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:46.045270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddf430-8d44-4daa-b004-391587920b48 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:46.048799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6fddf430-8d44-4daa-b004-391587920b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:46.219297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddf430-8d44-4daa-b004-391587920b48 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:46.225381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867f910-8d8f-4304-83f3-5beb1c918c18 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:46.226541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867f910-8d8f-4304-83f3-5beb1c918c18 service glance] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:46.227189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867f910-8d8f-4304-83f3-5beb1c918c18 service glance] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:46.233093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867f910-8d8f-4304-83f3-5beb1c918c18 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:46.233093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6867f910-8d8f-4304-83f3-5beb1c918c18 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:46.251393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867f910-8d8f-4304-83f3-5beb1c918c18 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:46.254017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867f910-8d8f-4304-83f3-5beb1c918c18 service glance] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:46.284381 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1876/3762] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:46.749099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b61a4-88cd-42ab-8219-b9308782cc1f service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:46.756717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-387b61a4-88cd-42ab-8219-b9308782cc1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:46.793607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b61a4-88cd-42ab-8219-b9308782cc1f service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:46.801773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97be62-1456-4ef0-81ac-979166d8c333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:46.802688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97be62-1456-4ef0-81ac-979166d8c333 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:46.804563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97be62-1456-4ef0-81ac-979166d8c333 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:46.805691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97be62-1456-4ef0-81ac-979166d8c333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:46.808326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2c97be62-1456-4ef0-81ac-979166d8c333 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:46.889601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97be62-1456-4ef0-81ac-979166d8c333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:46.893551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97be62-1456-4ef0-81ac-979166d8c333 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:46.914437 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1887/3763] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:48.436172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a07020-0f99-4c97-b323-5e6c3eb83e4a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:48.437022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a07020-0f99-4c97-b323-5e6c3eb83e4a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:48.437468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a07020-0f99-4c97-b323-5e6c3eb83e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:48.465846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a6a07020-0f99-4c97-b323-5e6c3eb83e4a None None] MFA Rules not processed for user `e3d3dea2740e4e46ae98265dcade1291`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:48.467812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a6a07020-0f99-4c97-b323-5e6c3eb83e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:48.566129 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1877/3764] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:29:50.851323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97be62-1456-4ef0-81ac-979166d8c333 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:50.853479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2c97be62-1456-4ef0-81ac-979166d8c333 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:50.987081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97be62-1456-4ef0-81ac-979166d8c333 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:50.993429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb52aa-bd28-411e-8342-2e5c1fa9276f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:50.994166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb52aa-bd28-411e-8342-2e5c1fa9276f service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:50.994565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb52aa-bd28-411e-8342-2e5c1fa9276f service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:50.994847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb52aa-bd28-411e-8342-2e5c1fa9276f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:50.996728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7edb52aa-bd28-411e-8342-2e5c1fa9276f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:51.010297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb52aa-bd28-411e-8342-2e5c1fa9276f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:51.011994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb52aa-bd28-411e-8342-2e5c1fa9276f service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:51.036491 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1888/3765] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:51.545012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372659a-185c-4b67-8022-22f6a88c6b40 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:51.545481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372659a-185c-4b67-8022-22f6a88c6b40 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:51.545932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372659a-185c-4b67-8022-22f6a88c6b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:51.582521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8372659a-185c-4b67-8022-22f6a88c6b40 None None] MFA Rules not processed for user `8983f7b383b644f5ae9ac927fbe54cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:51.584081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8372659a-185c-4b67-8022-22f6a88c6b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:51.711021 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1878/3766] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:51.722973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb52aa-bd28-411e-8342-2e5c1fa9276f service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:51.752771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb52aa-bd28-411e-8342-2e5c1fa9276f service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:51.771442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5da8e-184b-4bef-a82c-988824ba11d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:51.772643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5da8e-184b-4bef-a82c-988824ba11d6 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:51.776007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5da8e-184b-4bef-a82c-988824ba11d6 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:51.776327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5da8e-184b-4bef-a82c-988824ba11d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:51.798087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5da8e-184b-4bef-a82c-988824ba11d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:51.802766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5da8e-184b-4bef-a82c-988824ba11d6 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:51.822660 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1889/3767] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:29:55.772724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372659a-185c-4b67-8022-22f6a88c6b40 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:55.794813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372659a-185c-4b67-8022-22f6a88c6b40 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:55.827991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad6c2e-9f22-47f7-a6ff-5e037aceafab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:55.827991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad6c2e-9f22-47f7-a6ff-5e037aceafab service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:55.827991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad6c2e-9f22-47f7-a6ff-5e037aceafab service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:55.827991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad6c2e-9f22-47f7-a6ff-5e037aceafab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:55.836412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-67ad6c2e-9f22-47f7-a6ff-5e037aceafab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:55.865933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad6c2e-9f22-47f7-a6ff-5e037aceafab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:55.868295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad6c2e-9f22-47f7-a6ff-5e037aceafab service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:55.887554 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1879/3768] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:57.810579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3b0a7-9611-43c2-ac31-c4949ef9add5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:57.813178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3b0a7-9611-43c2-ac31-c4949ef9add5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:57.813788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3b0a7-9611-43c2-ac31-c4949ef9add5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:57.888664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-01e3b0a7-9611-43c2-ac31-c4949ef9add5 None None] MFA Rules not processed for user `7acc933705b14e54b3a04625a1d3c8fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:29:57.894746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-01e3b0a7-9611-43c2-ac31-c4949ef9add5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:58.029504 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1890/3769] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:29:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:29:58.330743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad6c2e-9f22-47f7-a6ff-5e037aceafab service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:58.332219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-67ad6c2e-9f22-47f7-a6ff-5e037aceafab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:58.359940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad6c2e-9f22-47f7-a6ff-5e037aceafab service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:58.367759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82f432-81fa-4ec2-aed9-8db026749b08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:58.369222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82f432-81fa-4ec2-aed9-8db026749b08 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:58.370850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82f432-81fa-4ec2-aed9-8db026749b08 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:58.371495 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82f432-81fa-4ec2-aed9-8db026749b08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:58.403464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82f432-81fa-4ec2-aed9-8db026749b08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:58.406220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82f432-81fa-4ec2-aed9-8db026749b08 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:58.422656 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1880/3770] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:58 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:58.538737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3b0a7-9611-43c2-ac31-c4949ef9add5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:58.589745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3b0a7-9611-43c2-ac31-c4949ef9add5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:58.599057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbda567-7f2c-4718-adb3-6ed91b1d298f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:58.600110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbda567-7f2c-4718-adb3-6ed91b1d298f service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:58.600644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbda567-7f2c-4718-adb3-6ed91b1d298f service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:58.602329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbda567-7f2c-4718-adb3-6ed91b1d298f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:58.607280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5cbda567-7f2c-4718-adb3-6ed91b1d298f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:29:58.628439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbda567-7f2c-4718-adb3-6ed91b1d298f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:29:58.630509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbda567-7f2c-4718-adb3-6ed91b1d298f service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:29:58.659316 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1891/3771] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:29:59.968405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82f432-81fa-4ec2-aed9-8db026749b08 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:29:59.979888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82f432-81fa-4ec2-aed9-8db026749b08 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:29:59.986552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbda265-c3ab-4fa7-9b4c-4d11845b83ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:29:59.987853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbda265-c3ab-4fa7-9b4c-4d11845b83ca service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:29:59.988380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbda265-c3ab-4fa7-9b4c-4d11845b83ca service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:29:59.989067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbda265-c3ab-4fa7-9b4c-4d11845b83ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:29:59.991878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4bbda265-c3ab-4fa7-9b4c-4d11845b83ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:00.009475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbda265-c3ab-4fa7-9b4c-4d11845b83ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:00.018525 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbda265-c3ab-4fa7-9b4c-4d11845b83ca service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:00.030770 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1881/3772] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:29:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:30:00.483228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff9855-81fe-4a5c-8ff4-8c91f6f842cc None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:00.485409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff9855-81fe-4a5c-8ff4-8c91f6f842cc None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:00.491530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff9855-81fe-4a5c-8ff4-8c91f6f842cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:00.518774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c1ff9855-81fe-4a5c-8ff4-8c91f6f842cc None None] MFA Rules not processed for user `8983f7b383b644f5ae9ac927fbe54cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:00.520623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c1ff9855-81fe-4a5c-8ff4-8c91f6f842cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:00.546732 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1892/3773] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:03.778843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a33c3-4a70-4dfb-afe5-e964b8865059 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:03.779376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a33c3-4a70-4dfb-afe5-e964b8865059 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:03.779468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a33c3-4a70-4dfb-afe5-e964b8865059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:03.804518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-594a33c3-4a70-4dfb-afe5-e964b8865059 None None] MFA Rules not processed for user `68fbd43b80904411b61d9c1e5b8fa843`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:03.805943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-594a33c3-4a70-4dfb-afe5-e964b8865059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:03.927554 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1882/3774] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:04.435757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff9855-81fe-4a5c-8ff4-8c91f6f842cc None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:04.450766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff9855-81fe-4a5c-8ff4-8c91f6f842cc None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:04.455590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad547f2-e76f-4e8d-9de5-1679871acd9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:04.456939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad547f2-e76f-4e8d-9de5-1679871acd9d service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:04.457716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad547f2-e76f-4e8d-9de5-1679871acd9d service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:04.458206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad547f2-e76f-4e8d-9de5-1679871acd9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:04.460871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cad547f2-e76f-4e8d-9de5-1679871acd9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:04.477360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad547f2-e76f-4e8d-9de5-1679871acd9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:04.479126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad547f2-e76f-4e8d-9de5-1679871acd9d service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:04.491389 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1893/3775] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:30:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:30:07.195734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a33c3-4a70-4dfb-afe5-e964b8865059 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:07.233292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a33c3-4a70-4dfb-afe5-e964b8865059 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:07.235067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62c427-62c1-44af-8717-c2846bba5ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:07.236725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62c427-62c1-44af-8717-c2846bba5ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:07.237149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62c427-62c1-44af-8717-c2846bba5ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:07.237606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62c427-62c1-44af-8717-c2846bba5ff7 admin admin] PATH_INFO: `/v3/users/7acc933705b14e54b3a04625a1d3c8fa` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:07.239707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62c427-62c1-44af-8717-c2846bba5ff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7acc933705b14e54b3a04625a1d3c8fa)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:07.241797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62c427-62c1-44af-8717-c2846bba5ff7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:07.576582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bd62c427-62c1-44af-8717-c2846bba5ff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7acc933705b14e54b3a04625a1d3c8fa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:07.607610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bd62c427-62c1-44af-8717-c2846bba5ff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7acc933705b14e54b3a04625a1d3c8fa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:07.613525 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bd62c427-62c1-44af-8717-c2846bba5ff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7acc933705b14e54b3a04625a1d3c8fa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:07.626774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bd62c427-62c1-44af-8717-c2846bba5ff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7acc933705b14e54b3a04625a1d3c8fa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:07.697631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bd62c427-62c1-44af-8717-c2846bba5ff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7acc933705b14e54b3a04625a1d3c8fa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:07.720340 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1883/3776] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:30:07 2022] DELETE /identity/v3/users/7acc933705b14e54b3a04625a1d3c8fa => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:08.707429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad547f2-e76f-4e8d-9de5-1679871acd9d service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:08.718901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad547f2-e76f-4e8d-9de5-1679871acd9d service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:08.830926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fac72-f56e-49c0-a4f0-0d41580deac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:08.832356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fac72-f56e-49c0-a4f0-0d41580deac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:08.834014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fac72-f56e-49c0-a4f0-0d41580deac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:08.834533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fac72-f56e-49c0-a4f0-0d41580deac1 admin admin] PATH_INFO: `/v3/projects/2235fe46aff549b1b700357f9455a129` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:08.840277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fac72-f56e-49c0-a4f0-0d41580deac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2235fe46aff549b1b700357f9455a129)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:08.842571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fac72-f56e-49c0-a4f0-0d41580deac1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:09.070280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-363fac72-f56e-49c0-a4f0-0d41580deac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2235fe46aff549b1b700357f9455a129', 'request_id': 'req-363fac72-f56e-49c0-a4f0-0d41580deac1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:09.077495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-363fac72-f56e-49c0-a4f0-0d41580deac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2235fe46aff549b1b700357f9455a129', 'request_id': 'req-363fac72-f56e-49c0-a4f0-0d41580deac1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:09.170627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-363fac72-f56e-49c0-a4f0-0d41580deac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2235fe46aff549b1b700357f9455a129', 'request_id': 'req-363fac72-f56e-49c0-a4f0-0d41580deac1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:09.221376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-363fac72-f56e-49c0-a4f0-0d41580deac1 admin admin] The token cache is being invalidate because project 2235fe46aff549b1b700357f9455a129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:09.222519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-363fac72-f56e-49c0-a4f0-0d41580deac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:09.223620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-363fac72-f56e-49c0-a4f0-0d41580deac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:09.231064 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1894/3777] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:08 2022] DELETE /identity/v3/projects/2235fe46aff549b1b700357f9455a129 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:09.243056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d81a1-826c-4fda-8237-e5c105f4dd5b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:09.243589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d81a1-826c-4fda-8237-e5c105f4dd5b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:09.243589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d81a1-826c-4fda-8237-e5c105f4dd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:09.273090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-116d81a1-826c-4fda-8237-e5c105f4dd5b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:09.276313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-116d81a1-826c-4fda-8237-e5c105f4dd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:09.366685 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1884/3778] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:09.374652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de631f8-a5f9-49c8-8364-2a3d907e7f34 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:09.375285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de631f8-a5f9-49c8-8364-2a3d907e7f34 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:09.375520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de631f8-a5f9-49c8-8364-2a3d907e7f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:09.414299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9de631f8-a5f9-49c8-8364-2a3d907e7f34 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:09.415540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9de631f8-a5f9-49c8-8364-2a3d907e7f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:09.461905 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1895/3779] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:09.466406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d81a1-826c-4fda-8237-e5c105f4dd5b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:09.495072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d81a1-826c-4fda-8237-e5c105f4dd5b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:09.521816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1b10b-6223-4c40-b4be-1e5e0b92b757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:09.522697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1b10b-6223-4c40-b4be-1e5e0b92b757 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:09.522992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1b10b-6223-4c40-b4be-1e5e0b92b757 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:09.525176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1b10b-6223-4c40-b4be-1e5e0b92b757 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:09.525176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1b10b-6223-4c40-b4be-1e5e0b92b757 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:30:09.525176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1b10b-6223-4c40-b4be-1e5e0b92b757 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:09.534306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1b10b-6223-4c40-b4be-1e5e0b92b757 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:09.611643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de631f8-a5f9-49c8-8364-2a3d907e7f34 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:09.612086 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1885/3780] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:30:09.635165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de631f8-a5f9-49c8-8364-2a3d907e7f34 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:09.653330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447205f1-e40a-45ed-9c94-5635376e4998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:09.654237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447205f1-e40a-45ed-9c94-5635376e4998 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:09.654599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447205f1-e40a-45ed-9c94-5635376e4998 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:09.654944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447205f1-e40a-45ed-9c94-5635376e4998 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:09.655855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447205f1-e40a-45ed-9c94-5635376e4998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:09.662382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447205f1-e40a-45ed-9c94-5635376e4998 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:09.872784 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1896/3781] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:30:09 2022] POST /identity/v3/projects => generated 393 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:09.874549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1b10b-6223-4c40-b4be-1e5e0b92b757 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:09.892539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1b10b-6223-4c40-b4be-1e5e0b92b757 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:10.073003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87ccb2-916b-49b3-b014-818b184a4672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:10.074125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87ccb2-916b-49b3-b014-818b184a4672 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:10.074627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87ccb2-916b-49b3-b014-818b184a4672 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:10.075119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87ccb2-916b-49b3-b014-818b184a4672 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:10.076034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87ccb2-916b-49b3-b014-818b184a4672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:10.083311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87ccb2-916b-49b3-b014-818b184a4672 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:10.183482 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1886/3782] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:30:09 2022] POST /identity/v3/users => generated 297 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:10.189339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447205f1-e40a-45ed-9c94-5635376e4998 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:10.212213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447205f1-e40a-45ed-9c94-5635376e4998 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:10.227711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00f955-6db9-4814-9835-b325fdaa61c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:10.228410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f955-6db9-4814-9835-b325fdaa61c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:10.228739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f955-6db9-4814-9835-b325fdaa61c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:10.229019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f955-6db9-4814-9835-b325fdaa61c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:10.229920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00f955-6db9-4814-9835-b325fdaa61c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:10.233147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00f955-6db9-4814-9835-b325fdaa61c0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:10.262462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87ccb2-916b-49b3-b014-818b184a4672 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:10.265206 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1897/3783] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:30:10.287958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87ccb2-916b-49b3-b014-818b184a4672 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:10.318861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4f4e8-db6f-463c-9a77-b0786f83015a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:10.319559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4f4e8-db6f-463c-9a77-b0786f83015a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:10.319854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4f4e8-db6f-463c-9a77-b0786f83015a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:10.320140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4f4e8-db6f-463c-9a77-b0786f83015a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:10.325098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4f4e8-db6f-463c-9a77-b0786f83015a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:10.326758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4f4e8-db6f-463c-9a77-b0786f83015a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:10.378737 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1887/3784] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:30:10.382788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00f955-6db9-4814-9835-b325fdaa61c0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:10.426647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00f955-6db9-4814-9835-b325fdaa61c0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:10.460106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32b470-f4ab-4565-9d2e-a7d185310ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:10.461028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32b470-f4ab-4565-9d2e-a7d185310ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:10.463582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32b470-f4ab-4565-9d2e-a7d185310ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:10.463914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32b470-f4ab-4565-9d2e-a7d185310ec0 admin admin] PATH_INFO: `/v3/projects/20cfd3821fea4d2ebe2bb54a499c6af4/users/71eaa25c89f5458aa73190ec11ac2745/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:10.504883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32b470-f4ab-4565-9d2e-a7d185310ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20cfd3821fea4d2ebe2bb54a499c6af4, user_id=71eaa25c89f5458aa73190ec11ac2745, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:10.508271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32b470-f4ab-4565-9d2e-a7d185310ec0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:10.612504 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1898/3785] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:30:10 2022] PUT /identity/v3/projects/20cfd3821fea4d2ebe2bb54a499c6af4/users/71eaa25c89f5458aa73190ec11ac2745/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:10.613488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734e808-e0eb-4c93-881d-88bb03a90db3 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:10.613787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734e808-e0eb-4c93-881d-88bb03a90db3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:10.614715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734e808-e0eb-4c93-881d-88bb03a90db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:10.676922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3734e808-e0eb-4c93-881d-88bb03a90db3 None None] MFA Rules not processed for user `71eaa25c89f5458aa73190ec11ac2745`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:10.678185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3734e808-e0eb-4c93-881d-88bb03a90db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:10.780909 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1888/3786] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:30:10.795744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32b470-f4ab-4565-9d2e-a7d185310ec0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:10.799565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7e32b470-f4ab-4565-9d2e-a7d185310ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:10.914095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32b470-f4ab-4565-9d2e-a7d185310ec0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:10.921362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f15f6-0af0-44ee-a8e9-0c960badc0a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:10.922313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f15f6-0af0-44ee-a8e9-0c960badc0a4 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:10.923290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f15f6-0af0-44ee-a8e9-0c960badc0a4 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:10.924519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f15f6-0af0-44ee-a8e9-0c960badc0a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:10.934064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f15f6-0af0-44ee-a8e9-0c960badc0a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:10.936074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f15f6-0af0-44ee-a8e9-0c960badc0a4 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:10.962968 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1899/3787] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:30:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:30:11.230165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734e808-e0eb-4c93-881d-88bb03a90db3 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:11.312116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734e808-e0eb-4c93-881d-88bb03a90db3 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:11.318683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460b753-2bad-47a7-bed7-93cc016bafde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:11.319803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460b753-2bad-47a7-bed7-93cc016bafde admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:11.320271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460b753-2bad-47a7-bed7-93cc016bafde admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:11.320804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460b753-2bad-47a7-bed7-93cc016bafde admin admin] PATH_INFO: `/v3/users/71eaa25c89f5458aa73190ec11ac2745` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:11.324123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460b753-2bad-47a7-bed7-93cc016bafde admin admin] RBAC: Authorizing `identity:delete_user(user_id=71eaa25c89f5458aa73190ec11ac2745)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:11.329885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460b753-2bad-47a7-bed7-93cc016bafde admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:11.579780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2460b753-2bad-47a7-bed7-93cc016bafde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71eaa25c89f5458aa73190ec11ac2745'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:11.597579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2460b753-2bad-47a7-bed7-93cc016bafde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71eaa25c89f5458aa73190ec11ac2745'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:11.597579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2460b753-2bad-47a7-bed7-93cc016bafde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71eaa25c89f5458aa73190ec11ac2745'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:11.608121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2460b753-2bad-47a7-bed7-93cc016bafde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71eaa25c89f5458aa73190ec11ac2745'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:11.698389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2460b753-2bad-47a7-bed7-93cc016bafde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71eaa25c89f5458aa73190ec11ac2745'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:11.703371 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1889/3788] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:30:11 2022] DELETE /identity/v3/users/71eaa25c89f5458aa73190ec11ac2745 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:11.711002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec5f0f-a980-4172-ad7d-edb8d73cdda5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:11.712501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec5f0f-a980-4172-ad7d-edb8d73cdda5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:11.712887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec5f0f-a980-4172-ad7d-edb8d73cdda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:11.765027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-53ec5f0f-a980-4172-ad7d-edb8d73cdda5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:11.768977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-53ec5f0f-a980-4172-ad7d-edb8d73cdda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:11.949759 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1900/3789] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:11.996949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460b753-2bad-47a7-bed7-93cc016bafde admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:11.998699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2460b753-2bad-47a7-bed7-93cc016bafde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:12.156060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460b753-2bad-47a7-bed7-93cc016bafde admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:12.181614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b7719-a3c3-47a0-b8f3-247ec5416296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:12.184380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b7719-a3c3-47a0-b8f3-247ec5416296 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:12.185556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b7719-a3c3-47a0-b8f3-247ec5416296 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:12.186829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b7719-a3c3-47a0-b8f3-247ec5416296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:12.217414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b7719-a3c3-47a0-b8f3-247ec5416296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:12.227285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b7719-a3c3-47a0-b8f3-247ec5416296 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:12.272773 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1890/3790] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:30:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:30:13.285545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec5f0f-a980-4172-ad7d-edb8d73cdda5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:13.308060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-53ec5f0f-a980-4172-ad7d-edb8d73cdda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:13.543209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec5f0f-a980-4172-ad7d-edb8d73cdda5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:13.558610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2d60c-2502-48de-a1a5-6430fb156423 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:13.560401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2d60c-2502-48de-a1a5-6430fb156423 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:13.561550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2d60c-2502-48de-a1a5-6430fb156423 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:13.562091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2d60c-2502-48de-a1a5-6430fb156423 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:13.590709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-90f2d60c-2502-48de-a1a5-6430fb156423 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:13.636974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2d60c-2502-48de-a1a5-6430fb156423 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:13.638903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2d60c-2502-48de-a1a5-6430fb156423 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:13.672270 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1901/3791] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:30:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:30:14.979344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b7719-a3c3-47a0-b8f3-247ec5416296 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:14.981494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f13b7719-a3c3-47a0-b8f3-247ec5416296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:14.995360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b7719-a3c3-47a0-b8f3-247ec5416296 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:15.002473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2d60c-2502-48de-a1a5-6430fb156423 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:15.002989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50402503-8ba8-45f8-87dc-08eb7c203b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:15.003724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50402503-8ba8-45f8-87dc-08eb7c203b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:15.004008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50402503-8ba8-45f8-87dc-08eb7c203b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:15.004285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50402503-8ba8-45f8-87dc-08eb7c203b34 admin admin] PATH_INFO: `/v3/projects/20cfd3821fea4d2ebe2bb54a499c6af4` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:15.005263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-90f2d60c-2502-48de-a1a5-6430fb156423 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:15.005492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50402503-8ba8-45f8-87dc-08eb7c203b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20cfd3821fea4d2ebe2bb54a499c6af4)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:15.007491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50402503-8ba8-45f8-87dc-08eb7c203b34 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:15.038194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2d60c-2502-48de-a1a5-6430fb156423 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:15.057170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98c021-8155-4f49-8348-3372dfe0e99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:15.058067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98c021-8155-4f49-8348-3372dfe0e99b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:15.058354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98c021-8155-4f49-8348-3372dfe0e99b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:15.058634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98c021-8155-4f49-8348-3372dfe0e99b admin admin] PATH_INFO: `/v3/users/1cf4f9c1eeb94bff96fa42d2f20d805f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:15.062980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98c021-8155-4f49-8348-3372dfe0e99b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cf4f9c1eeb94bff96fa42d2f20d805f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:15.068739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98c021-8155-4f49-8348-3372dfe0e99b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:15.131005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-50402503-8ba8-45f8-87dc-08eb7c203b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20cfd3821fea4d2ebe2bb54a499c6af4', 'request_id': 'req-50402503-8ba8-45f8-87dc-08eb7c203b34'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:15.210302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-50402503-8ba8-45f8-87dc-08eb7c203b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20cfd3821fea4d2ebe2bb54a499c6af4', 'request_id': 'req-50402503-8ba8-45f8-87dc-08eb7c203b34'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:15.217475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-50402503-8ba8-45f8-87dc-08eb7c203b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20cfd3821fea4d2ebe2bb54a499c6af4', 'request_id': 'req-50402503-8ba8-45f8-87dc-08eb7c203b34'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:15.236328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-50402503-8ba8-45f8-87dc-08eb7c203b34 admin admin] The token cache is being invalidate because project 20cfd3821fea4d2ebe2bb54a499c6af4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:15.236896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-50402503-8ba8-45f8-87dc-08eb7c203b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:15.237563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-50402503-8ba8-45f8-87dc-08eb7c203b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:15.239751 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1891/3792] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:14 2022] DELETE /identity/v3/projects/20cfd3821fea4d2ebe2bb54a499c6af4 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:15.244980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ad98c021-8155-4f49-8348-3372dfe0e99b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cf4f9c1eeb94bff96fa42d2f20d805f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:15.245141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a428200-2421-4e74-a627-3061a370f840 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:15.245924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a428200-2421-4e74-a627-3061a370f840 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:15.245924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a428200-2421-4e74-a627-3061a370f840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:15.261108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ad98c021-8155-4f49-8348-3372dfe0e99b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cf4f9c1eeb94bff96fa42d2f20d805f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:15.262815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ad98c021-8155-4f49-8348-3372dfe0e99b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cf4f9c1eeb94bff96fa42d2f20d805f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:15.266975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-7a428200-2421-4e74-a627-3061a370f840 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:15.268266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7a428200-2421-4e74-a627-3061a370f840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:15.272573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ad98c021-8155-4f49-8348-3372dfe0e99b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cf4f9c1eeb94bff96fa42d2f20d805f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:15.342650 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1892/3793] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:15.345126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1042470-6e02-426e-96f5-5d026d67b3b7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:15.345332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ad98c021-8155-4f49-8348-3372dfe0e99b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cf4f9c1eeb94bff96fa42d2f20d805f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:15.345795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1042470-6e02-426e-96f5-5d026d67b3b7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:15.346231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1042470-6e02-426e-96f5-5d026d67b3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:15.360464 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1902/3794] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:30:15 2022] DELETE /identity/v3/users/1cf4f9c1eeb94bff96fa42d2f20d805f => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:15.367681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c1042470-6e02-426e-96f5-5d026d67b3b7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:15.369307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c1042470-6e02-426e-96f5-5d026d67b3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:15.446414 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1893/3795] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:15.456467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98c021-8155-4f49-8348-3372dfe0e99b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:15.468267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98c021-8155-4f49-8348-3372dfe0e99b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:15.478992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1854b-6172-4fa1-825c-adea8eb166f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:15.481601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1854b-6172-4fa1-825c-adea8eb166f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:15.481601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1854b-6172-4fa1-825c-adea8eb166f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:15.481601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1854b-6172-4fa1-825c-adea8eb166f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:15.481601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1854b-6172-4fa1-825c-adea8eb166f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:30:15.482049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1854b-6172-4fa1-825c-adea8eb166f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:15.484066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1854b-6172-4fa1-825c-adea8eb166f8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:15.510121 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1903/3796] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:30:15.514702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1042470-6e02-426e-96f5-5d026d67b3b7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:15.530091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1042470-6e02-426e-96f5-5d026d67b3b7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:15.545879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53ff9f-bdbd-4484-8da6-6eb80668a8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:15.547053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53ff9f-bdbd-4484-8da6-6eb80668a8c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:15.548269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53ff9f-bdbd-4484-8da6-6eb80668a8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:15.548557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53ff9f-bdbd-4484-8da6-6eb80668a8c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:15.550866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53ff9f-bdbd-4484-8da6-6eb80668a8c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:15.553088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53ff9f-bdbd-4484-8da6-6eb80668a8c5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:15.714665 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1894/3797] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:30:15 2022] POST /identity/v3/projects => generated 399 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:15.718860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1854b-6172-4fa1-825c-adea8eb166f8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:15.728684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1854b-6172-4fa1-825c-adea8eb166f8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:15.774533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53ff9f-bdbd-4484-8da6-6eb80668a8c5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:15.776415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5d53ff9f-bdbd-4484-8da6-6eb80668a8c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:15.798877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970afdb4-9ee5-487e-bec6-8407d66d1b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:15.798877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970afdb4-9ee5-487e-bec6-8407d66d1b00 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:15.798877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970afdb4-9ee5-487e-bec6-8407d66d1b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:15.798877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970afdb4-9ee5-487e-bec6-8407d66d1b00 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:15.799165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970afdb4-9ee5-487e-bec6-8407d66d1b00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:15.800977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970afdb4-9ee5-487e-bec6-8407d66d1b00 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:15.871985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53ff9f-bdbd-4484-8da6-6eb80668a8c5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:15.878673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b10f2f-c657-424d-8a75-fb931c2725b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:15.879652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b10f2f-c657-424d-8a75-fb931c2725b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:15.884470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b10f2f-c657-424d-8a75-fb931c2725b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:15.884470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b10f2f-c657-424d-8a75-fb931c2725b9 admin admin] PATH_INFO: `/v3/projects/e3c5102fde294e5fb3dbf22336934db9` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:15.884470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b10f2f-c657-424d-8a75-fb931c2725b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3c5102fde294e5fb3dbf22336934db9)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:15.884470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b10f2f-c657-424d-8a75-fb931c2725b9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:15.963984 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1904/3798] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:30:15 2022] POST /identity/v3/users => generated 300 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:15.964928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970afdb4-9ee5-487e-bec6-8407d66d1b00 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:15.975864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970afdb4-9ee5-487e-bec6-8407d66d1b00 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:15.990360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8825ab-a4a2-4568-b86a-de665266fe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:15.999690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8825ab-a4a2-4568-b86a-de665266fe17 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:15.999690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8825ab-a4a2-4568-b86a-de665266fe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:15.999690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8825ab-a4a2-4568-b86a-de665266fe17 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:15.999690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8825ab-a4a2-4568-b86a-de665266fe17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:15.999690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8825ab-a4a2-4568-b86a-de665266fe17 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:16.013388 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1905/3799] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:30:16.017385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8825ab-a4a2-4568-b86a-de665266fe17 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:16.019347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69b10f2f-c657-424d-8a75-fb931c2725b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3c5102fde294e5fb3dbf22336934db9', 'request_id': 'req-69b10f2f-c657-424d-8a75-fb931c2725b9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:16.035375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8825ab-a4a2-4568-b86a-de665266fe17 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:16.107952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69b10f2f-c657-424d-8a75-fb931c2725b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3c5102fde294e5fb3dbf22336934db9', 'request_id': 'req-69b10f2f-c657-424d-8a75-fb931c2725b9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:16.116394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69b10f2f-c657-424d-8a75-fb931c2725b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3c5102fde294e5fb3dbf22336934db9', 'request_id': 'req-69b10f2f-c657-424d-8a75-fb931c2725b9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:16.130236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec9cc7-6d85-46e0-8042-fa344a6cb0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:16.131037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec9cc7-6d85-46e0-8042-fa344a6cb0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:16.131322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec9cc7-6d85-46e0-8042-fa344a6cb0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:16.131787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec9cc7-6d85-46e0-8042-fa344a6cb0a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:16.132522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69b10f2f-c657-424d-8a75-fb931c2725b9 admin admin] The token cache is being invalidate because project e3c5102fde294e5fb3dbf22336934db9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:16.132906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec9cc7-6d85-46e0-8042-fa344a6cb0a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:16.133034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69b10f2f-c657-424d-8a75-fb931c2725b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:16.133945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69b10f2f-c657-424d-8a75-fb931c2725b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:16.135268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec9cc7-6d85-46e0-8042-fa344a6cb0a4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:16.136053 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1895/3800] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:15 2022] DELETE /identity/v3/projects/e3c5102fde294e5fb3dbf22336934db9 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:30:16.147667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6d72f-9670-4651-bdae-82baf23bbef0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:16.147960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6d72f-9670-4651-bdae-82baf23bbef0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:16.148369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6d72f-9670-4651-bdae-82baf23bbef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:16.155317 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1906/3801] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:30:16.159610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec9cc7-6d85-46e0-8042-fa344a6cb0a4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:16.161603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f5ec9cc7-6d85-46e0-8042-fa344a6cb0a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:16.173416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-45e6d72f-9670-4651-bdae-82baf23bbef0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:16.174670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-45e6d72f-9670-4651-bdae-82baf23bbef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:16.177922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec9cc7-6d85-46e0-8042-fa344a6cb0a4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:16.184057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef860132-553d-42c3-974d-e8d121c3f97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:16.185372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef860132-553d-42c3-974d-e8d121c3f97b admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:16.185559 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1896/3802] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:30:16.186158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef860132-553d-42c3-974d-e8d121c3f97b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:16.186524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef860132-553d-42c3-974d-e8d121c3f97b admin admin] PATH_INFO: `/v3/projects/01271c76e9e3490089d30e74ae05144e/users/04881f915cde4c29b57c9173ab754cbf/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:16.196073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d71a1c-f77b-4cc8-b6ed-af2b532bb8c6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:16.196365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d71a1c-f77b-4cc8-b6ed-af2b532bb8c6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:16.196679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d71a1c-f77b-4cc8-b6ed-af2b532bb8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:16.204857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef860132-553d-42c3-974d-e8d121c3f97b admin admin] RBAC: Authorizing `identity:create_grant(project_id=01271c76e9e3490089d30e74ae05144e, user_id=04881f915cde4c29b57c9173ab754cbf, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:16.207836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef860132-553d-42c3-974d-e8d121c3f97b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:16.227776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f7d71a1c-f77b-4cc8-b6ed-af2b532bb8c6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:16.229051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f7d71a1c-f77b-4cc8-b6ed-af2b532bb8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:16.237802 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1897/3803] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:30:16.242018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d71a1c-f77b-4cc8-b6ed-af2b532bb8c6 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:16.251676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d71a1c-f77b-4cc8-b6ed-af2b532bb8c6 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:16.256545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa79a55-a3ac-4080-b6c8-6ae0ea949ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:16.257339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa79a55-a3ac-4080-b6c8-6ae0ea949ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:16.257702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa79a55-a3ac-4080-b6c8-6ae0ea949ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:16.258105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa79a55-a3ac-4080-b6c8-6ae0ea949ee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:16.258897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa79a55-a3ac-4080-b6c8-6ae0ea949ee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:30:16.259282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa79a55-a3ac-4080-b6c8-6ae0ea949ee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:16.261039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa79a55-a3ac-4080-b6c8-6ae0ea949ee9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:16.272531 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1898/3804] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:30:16.276739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa79a55-a3ac-4080-b6c8-6ae0ea949ee9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:16.279890 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1907/3805] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:30:16 2022] PUT /identity/v3/projects/01271c76e9e3490089d30e74ae05144e/users/04881f915cde4c29b57c9173ab754cbf/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:30:16.287621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa79a55-a3ac-4080-b6c8-6ae0ea949ee9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:16.295699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a125484-92d5-4eb2-9113-2eb2a597655e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:16.296228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a125484-92d5-4eb2-9113-2eb2a597655e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:16.296586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a125484-92d5-4eb2-9113-2eb2a597655e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:16.318371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3a125484-92d5-4eb2-9113-2eb2a597655e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:16.319874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3a125484-92d5-4eb2-9113-2eb2a597655e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:16.350226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a4e9d-f001-44f2-8ff5-9b5d6efe9305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:16.350996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a4e9d-f001-44f2-8ff5-9b5d6efe9305 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:16.351360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a4e9d-f001-44f2-8ff5-9b5d6efe9305 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:16.351713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a4e9d-f001-44f2-8ff5-9b5d6efe9305 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:16.352489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a4e9d-f001-44f2-8ff5-9b5d6efe9305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:16.354687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a4e9d-f001-44f2-8ff5-9b5d6efe9305 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:16.388066 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1908/3806] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:30:16.397577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a125484-92d5-4eb2-9113-2eb2a597655e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:16.398955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3a125484-92d5-4eb2-9113-2eb2a597655e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:16.457637 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1899/3807] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:30:16 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:30:16.458529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a4e9d-f001-44f2-8ff5-9b5d6efe9305 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:16.468809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a125484-92d5-4eb2-9113-2eb2a597655e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:16.535586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a4e9d-f001-44f2-8ff5-9b5d6efe9305 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:16.539865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5667fc9-c761-4d48-9394-3d5e6d53af37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:16.540749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5667fc9-c761-4d48-9394-3d5e6d53af37 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:16.541207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5667fc9-c761-4d48-9394-3d5e6d53af37 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:16.541639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5667fc9-c761-4d48-9394-3d5e6d53af37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:16.543147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b859d74-a0de-41b9-91fd-953502b91445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:16.543827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b859d74-a0de-41b9-91fd-953502b91445 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:16.544103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b859d74-a0de-41b9-91fd-953502b91445 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:16.544380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b859d74-a0de-41b9-91fd-953502b91445 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:16.545104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b859d74-a0de-41b9-91fd-953502b91445 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:16.547013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b859d74-a0de-41b9-91fd-953502b91445 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:16.553570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5667fc9-c761-4d48-9394-3d5e6d53af37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:16.555512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5667fc9-c761-4d48-9394-3d5e6d53af37 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:16.570221 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1909/3808] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:30:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:30:16.648099 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1900/3809] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:30:16 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:16.649276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5667fc9-c761-4d48-9394-3d5e6d53af37 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:16.659470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5667fc9-c761-4d48-9394-3d5e6d53af37 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:16.665138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717af469-576f-40e3-9d60-f924c637a500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:16.665821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717af469-576f-40e3-9d60-f924c637a500 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:16.666107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717af469-576f-40e3-9d60-f924c637a500 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:16.666385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717af469-576f-40e3-9d60-f924c637a500 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:16.667158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717af469-576f-40e3-9d60-f924c637a500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:16.668856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717af469-576f-40e3-9d60-f924c637a500 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:16.680519 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1910/3810] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:30:16.685013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b859d74-a0de-41b9-91fd-953502b91445 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:16.698232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b859d74-a0de-41b9-91fd-953502b91445 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:16.706400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632878f-808b-44d9-86a7-ae44d2d518ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:16.707515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632878f-808b-44d9-86a7-ae44d2d518ce admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:16.707515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632878f-808b-44d9-86a7-ae44d2d518ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:16.707944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632878f-808b-44d9-86a7-ae44d2d518ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:16.708947 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632878f-808b-44d9-86a7-ae44d2d518ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:16.710806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632878f-808b-44d9-86a7-ae44d2d518ce admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:16.728272 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1901/3811] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:30:16.729664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717af469-576f-40e3-9d60-f924c637a500 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:16.743099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717af469-576f-40e3-9d60-f924c637a500 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:16.748754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9d5cb-9187-4d96-9cc7-79340cca5d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:16.749663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9d5cb-9187-4d96-9cc7-79340cca5d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:16.750198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9d5cb-9187-4d96-9cc7-79340cca5d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:16.750929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9d5cb-9187-4d96-9cc7-79340cca5d7f admin admin] PATH_INFO: `/v3/projects/135596a6d4af4bedaf5991984bdcc445/users/90f47dd110f54a14b39d610acbb98afa/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:16.771075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9d5cb-9187-4d96-9cc7-79340cca5d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=135596a6d4af4bedaf5991984bdcc445, user_id=90f47dd110f54a14b39d610acbb98afa, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:16.774048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9d5cb-9187-4d96-9cc7-79340cca5d7f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:16.907375 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1911/3812] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:30:16 2022] PUT /identity/v3/projects/135596a6d4af4bedaf5991984bdcc445/users/90f47dd110f54a14b39d610acbb98afa/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:16.919169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01999e-a601-47b9-a127-2acb206fa2dc None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:16.919472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01999e-a601-47b9-a127-2acb206fa2dc None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:16.919855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01999e-a601-47b9-a127-2acb206fa2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:16.950022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ca01999e-a601-47b9-a127-2acb206fa2dc None None] MFA Rules not processed for user `90f47dd110f54a14b39d610acbb98afa`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:16.951610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ca01999e-a601-47b9-a127-2acb206fa2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:17.029903 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1902/3813] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:17.035624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9d5cb-9187-4d96-9cc7-79340cca5d7f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:17.105382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9d5cb-9187-4d96-9cc7-79340cca5d7f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:17.110638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211bac2-964a-4419-a8ad-049111b01872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:17.111681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211bac2-964a-4419-a8ad-049111b01872 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:17.112571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211bac2-964a-4419-a8ad-049111b01872 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:17.118187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211bac2-964a-4419-a8ad-049111b01872 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:17.118187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211bac2-964a-4419-a8ad-049111b01872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:17.118187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211bac2-964a-4419-a8ad-049111b01872 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:17.236292 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1912/3814] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:30:17 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:30:17.240815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01999e-a601-47b9-a127-2acb206fa2dc None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:17.267327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01999e-a601-47b9-a127-2acb206fa2dc None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:17.377772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81c098-9c3e-4167-8873-2171a994013a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:17.378657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81c098-9c3e-4167-8873-2171a994013a admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:17.379265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81c098-9c3e-4167-8873-2171a994013a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:17.379626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81c098-9c3e-4167-8873-2171a994013a admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:17.380400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81c098-9c3e-4167-8873-2171a994013a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:17.383266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81c098-9c3e-4167-8873-2171a994013a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:17.462131 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1903/3815] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:30:17 2022] POST /identity/v3/users => generated 295 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:17.466139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211bac2-964a-4419-a8ad-049111b01872 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:17.477223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211bac2-964a-4419-a8ad-049111b01872 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:17.482732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690421c-378c-4911-9ca9-026eb82687f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:17.483539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690421c-378c-4911-9ca9-026eb82687f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:17.489073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690421c-378c-4911-9ca9-026eb82687f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:17.489073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690421c-378c-4911-9ca9-026eb82687f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:17.489073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690421c-378c-4911-9ca9-026eb82687f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:17.489073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690421c-378c-4911-9ca9-026eb82687f9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:17.501356 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1913/3816] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:30:17.505824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81c098-9c3e-4167-8873-2171a994013a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:17.523948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81c098-9c3e-4167-8873-2171a994013a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:17.530142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706eeef1-1c97-47ee-8d85-c761b48aa26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:17.531383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706eeef1-1c97-47ee-8d85-c761b48aa26a admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:17.531938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706eeef1-1c97-47ee-8d85-c761b48aa26a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:17.532518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706eeef1-1c97-47ee-8d85-c761b48aa26a admin admin] PATH_INFO: `/v3/projects/afd3f74241604780afda57f2e038ed71/users/2a27b81ebb1146efaba51e6135c4b5e1/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:17.551361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706eeef1-1c97-47ee-8d85-c761b48aa26a admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd3f74241604780afda57f2e038ed71, user_id=2a27b81ebb1146efaba51e6135c4b5e1, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:17.555485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706eeef1-1c97-47ee-8d85-c761b48aa26a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:17.626147 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1904/3817] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:30:17 2022] PUT /identity/v3/projects/afd3f74241604780afda57f2e038ed71/users/2a27b81ebb1146efaba51e6135c4b5e1/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:17.631259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690421c-378c-4911-9ca9-026eb82687f9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:17.640555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690421c-378c-4911-9ca9-026eb82687f9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:17.721676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65b910-ee01-4f06-8d8d-0a53755894a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:17.724092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65b910-ee01-4f06-8d8d-0a53755894a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:17.724454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65b910-ee01-4f06-8d8d-0a53755894a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:17.724868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65b910-ee01-4f06-8d8d-0a53755894a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:17.725764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65b910-ee01-4f06-8d8d-0a53755894a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:17.727520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65b910-ee01-4f06-8d8d-0a53755894a6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:17.747003 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1914/3818] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:30:17.751275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706eeef1-1c97-47ee-8d85-c761b48aa26a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:17.764577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706eeef1-1c97-47ee-8d85-c761b48aa26a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:17.771448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f3e39-92d8-431a-b9d1-0687354c199c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:17.772279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f3e39-92d8-431a-b9d1-0687354c199c admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:17.772697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f3e39-92d8-431a-b9d1-0687354c199c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:17.773135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f3e39-92d8-431a-b9d1-0687354c199c admin admin] PATH_INFO: `/v3/projects/afd3f74241604780afda57f2e038ed71/users/2a27b81ebb1146efaba51e6135c4b5e1/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:17.775637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f3e39-92d8-431a-b9d1-0687354c199c admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd3f74241604780afda57f2e038ed71, user_id=2a27b81ebb1146efaba51e6135c4b5e1, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:17.778537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f3e39-92d8-431a-b9d1-0687354c199c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:17.792908 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1905/3819] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:30:17 2022] PUT /identity/v3/projects/afd3f74241604780afda57f2e038ed71/users/2a27b81ebb1146efaba51e6135c4b5e1/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:17.801866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d3455-1589-49b6-b363-47330039f697 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:17.802158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d3455-1589-49b6-b363-47330039f697 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:17.802439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d3455-1589-49b6-b363-47330039f697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:17.829611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d23d3455-1589-49b6-b363-47330039f697 None None] MFA Rules not processed for user `2a27b81ebb1146efaba51e6135c4b5e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:17.830837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d23d3455-1589-49b6-b363-47330039f697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:17.929229 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1915/3820] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:17.929600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f3e39-92d8-431a-b9d1-0687354c199c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:17.944638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f3e39-92d8-431a-b9d1-0687354c199c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:17.965128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa38bc3-b8ca-4e42-b03b-d0350c5748a8 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a27b81ebb1146efaba51e6135c4b5e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd3f74241604780afda57f2e038ed71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:17.966065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa38bc3-b8ca-4e42-b03b-d0350c5748a8 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:17.966364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa38bc3-b8ca-4e42-b03b-d0350c5748a8 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:17.966657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa38bc3-b8ca-4e42-b03b-d0350c5748a8 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:17.970305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa38bc3-b8ca-4e42-b03b-d0350c5748a8 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:17.975248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa38bc3-b8ca-4e42-b03b-d0350c5748a8 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:18.121388 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1906/3821] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:30:17 2022] POST /identity/v3/projects => generated 333 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:30:18.125695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d3455-1589-49b6-b363-47330039f697 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:18.134845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d3455-1589-49b6-b363-47330039f697 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:18.213757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd739b23-b7c3-4b4b-ba62-256193a165a6 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a27b81ebb1146efaba51e6135c4b5e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd3f74241604780afda57f2e038ed71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:18.214621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd739b23-b7c3-4b4b-ba62-256193a165a6 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:18.215052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd739b23-b7c3-4b4b-ba62-256193a165a6 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:18.215432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd739b23-b7c3-4b4b-ba62-256193a165a6 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:18.216346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd739b23-b7c3-4b4b-ba62-256193a165a6 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:18.218571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd739b23-b7c3-4b4b-ba62-256193a165a6 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:18.222961 ncdv-master-1 devstack@keystone.service[91119]: WARNING keystone.server.flask.common [None req-bd739b23-b7c3-4b4b-ba62-256193a165a6 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 02 10:30:18.388236 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1916/3822] 10.222.0.16 () {60 vars in 1151 bytes} [Mon May 2 10:30:18 2022] POST /identity/v3/projects => generated 332 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:18.389564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa38bc3-b8ca-4e42-b03b-d0350c5748a8 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:18.405579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa38bc3-b8ca-4e42-b03b-d0350c5748a8 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:18.537185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aceab88-09b2-4861-98f7-7b5c71beb487 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a27b81ebb1146efaba51e6135c4b5e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd3f74241604780afda57f2e038ed71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:18.538199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceab88-09b2-4861-98f7-7b5c71beb487 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:18.538711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceab88-09b2-4861-98f7-7b5c71beb487 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:18.539193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aceab88-09b2-4861-98f7-7b5c71beb487 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:18.540150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aceab88-09b2-4861-98f7-7b5c71beb487 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:18.542409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aceab88-09b2-4861-98f7-7b5c71beb487 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:18.648818 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1907/3823] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:30:18 2022] POST /identity/v3/projects => generated 357 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:18.653328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd739b23-b7c3-4b4b-ba62-256193a165a6 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:18.667172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd739b23-b7c3-4b4b-ba62-256193a165a6 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:18.741691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b71db-3a80-4587-b879-f2dddd519137 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a27b81ebb1146efaba51e6135c4b5e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd3f74241604780afda57f2e038ed71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:18.742397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b71db-3a80-4587-b879-f2dddd519137 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:18.742757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b71db-3a80-4587-b879-f2dddd519137 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:18.743131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b71db-3a80-4587-b879-f2dddd519137 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:18.743944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b71db-3a80-4587-b879-f2dddd519137 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:18.745370 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-cd6b71db-3a80-4587-b879-f2dddd519137 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:30:18.745370 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:30:18.745370 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:30:18.749627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b71db-3a80-4587-b879-f2dddd519137 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:18.782449 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1917/3824] 10.222.0.16 () {58 vars in 1130 bytes} [Mon May 2 10:30:18 2022] GET /identity/v3/projects => generated 7203 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:30:18.787446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aceab88-09b2-4861-98f7-7b5c71beb487 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:18.798993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aceab88-09b2-4861-98f7-7b5c71beb487 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:18.803906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b829813-83f9-46cf-a5cd-367aee40670f tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a27b81ebb1146efaba51e6135c4b5e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd3f74241604780afda57f2e038ed71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:18.810263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b829813-83f9-46cf-a5cd-367aee40670f tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:18.810263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b829813-83f9-46cf-a5cd-367aee40670f tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:18.810263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b829813-83f9-46cf-a5cd-367aee40670f tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:18.810263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b829813-83f9-46cf-a5cd-367aee40670f tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:30:18.810263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b829813-83f9-46cf-a5cd-367aee40670f tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:18.810786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b829813-83f9-46cf-a5cd-367aee40670f tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:18.864525 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1908/3825] 10.222.0.16 () {58 vars in 1157 bytes} [Mon May 2 10:30:18 2022] GET /identity/v3/projects?enabled=False => generated 444 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:30:18.866018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b71db-3a80-4587-b879-f2dddd519137 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:18.877180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b71db-3a80-4587-b879-f2dddd519137 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:18.883634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f803d-966e-4d0b-a494-ffce656c90cf tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a27b81ebb1146efaba51e6135c4b5e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd3f74241604780afda57f2e038ed71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:18.884343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f803d-966e-4d0b-a494-ffce656c90cf tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:18.884674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f803d-966e-4d0b-a494-ffce656c90cf tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:18.884957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f803d-966e-4d0b-a494-ffce656c90cf tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:18.886180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f803d-966e-4d0b-a494-ffce656c90cf tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: Adding query filter params (parent_id=a49e1c7ce1c44916a3fc264b7283cb51) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:30:18.886180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f803d-966e-4d0b-a494-ffce656c90cf tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:18.887969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f803d-966e-4d0b-a494-ffce656c90cf tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:18.910633 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1918/3826] 10.222.0.16 () {58 vars in 1215 bytes} [Mon May 2 10:30:18 2022] GET /identity/v3/projects?parent_id=a49e1c7ce1c44916a3fc264b7283cb51 => generated 497 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:30:18.915371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b829813-83f9-46cf-a5cd-367aee40670f tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:18.931639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b829813-83f9-46cf-a5cd-367aee40670f tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:18.940150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa92d8f-3e0d-4fc2-8c4a-4c4dc99cc67c tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a27b81ebb1146efaba51e6135c4b5e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd3f74241604780afda57f2e038ed71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:18.941639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa92d8f-3e0d-4fc2-8c4a-4c4dc99cc67c tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:18.941639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa92d8f-3e0d-4fc2-8c4a-4c4dc99cc67c tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:18.941887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa92d8f-3e0d-4fc2-8c4a-4c4dc99cc67c tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] PATH_INFO: `/v3/projects/82503dde0530486db973e9ac15eeaf86` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:18.943242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa92d8f-3e0d-4fc2-8c4a-4c4dc99cc67c tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: Authorizing `identity:delete_project(project_id=82503dde0530486db973e9ac15eeaf86)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:18.945603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa92d8f-3e0d-4fc2-8c4a-4c4dc99cc67c tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:18.993962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e465120-ecb4-42e3-9a7a-61219f1b0154 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:18.994187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e465120-ecb4-42e3-9a7a-61219f1b0154 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:18.994470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e465120-ecb4-42e3-9a7a-61219f1b0154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:19.056084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7e465120-ecb4-42e3-9a7a-61219f1b0154 None None] MFA Rules not processed for user `04881f915cde4c29b57c9173ab754cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:19.058441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7e465120-ecb4-42e3-9a7a-61219f1b0154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:19.147328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4fa92d8f-3e0d-4fc2-8c4a-4c4dc99cc67c tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82503dde0530486db973e9ac15eeaf86', 'request_id': 'req-4fa92d8f-3e0d-4fc2-8c4a-4c4dc99cc67c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:19.184888 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1919/3827] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:30:19.188346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e86721-65a5-44b9-aa10-086b72f2d00a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:19.188907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e86721-65a5-44b9-aa10-086b72f2d00a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:19.189390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e86721-65a5-44b9-aa10-086b72f2d00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:19.220152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-45e86721-65a5-44b9-aa10-086b72f2d00a None None] MFA Rules not processed for user `04881f915cde4c29b57c9173ab754cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:19.221836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-45e86721-65a5-44b9-aa10-086b72f2d00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:19.234115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4fa92d8f-3e0d-4fc2-8c4a-4c4dc99cc67c tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82503dde0530486db973e9ac15eeaf86', 'request_id': 'req-4fa92d8f-3e0d-4fc2-8c4a-4c4dc99cc67c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:19.249667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4fa92d8f-3e0d-4fc2-8c4a-4c4dc99cc67c tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82503dde0530486db973e9ac15eeaf86', 'request_id': 'req-4fa92d8f-3e0d-4fc2-8c4a-4c4dc99cc67c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:19.263862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4fa92d8f-3e0d-4fc2-8c4a-4c4dc99cc67c tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] The token cache is being invalidate because project 82503dde0530486db973e9ac15eeaf86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:19.265285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4fa92d8f-3e0d-4fc2-8c4a-4c4dc99cc67c tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:19.266138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4fa92d8f-3e0d-4fc2-8c4a-4c4dc99cc67c tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:19.271854 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1909/3828] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:18 2022] DELETE /identity/v3/projects/82503dde0530486db973e9ac15eeaf86 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:19.273649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa92d8f-3e0d-4fc2-8c4a-4c4dc99cc67c tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:19.275395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4fa92d8f-3e0d-4fc2-8c4a-4c4dc99cc67c tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:19.363173 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1920/3829] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:19.370063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e86721-65a5-44b9-aa10-086b72f2d00a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:19.373363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-45e86721-65a5-44b9-aa10-086b72f2d00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:19.406032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa92d8f-3e0d-4fc2-8c4a-4c4dc99cc67c tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:19.413260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a1791-f6dc-431d-aed3-edc464871fa5 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a27b81ebb1146efaba51e6135c4b5e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd3f74241604780afda57f2e038ed71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:19.414750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a1791-f6dc-431d-aed3-edc464871fa5 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:19.415116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a1791-f6dc-431d-aed3-edc464871fa5 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:19.415502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a1791-f6dc-431d-aed3-edc464871fa5 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] PATH_INFO: `/v3/projects/a49e1c7ce1c44916a3fc264b7283cb51` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:19.417462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a1791-f6dc-431d-aed3-edc464871fa5 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a49e1c7ce1c44916a3fc264b7283cb51)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:19.419740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a1791-f6dc-431d-aed3-edc464871fa5 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:19.492438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e86721-65a5-44b9-aa10-086b72f2d00a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:19.498201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317fa32-fc93-485e-ae5d-0f3a4c604f71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:19.498858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317fa32-fc93-485e-ae5d-0f3a4c604f71 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:19.499144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317fa32-fc93-485e-ae5d-0f3a4c604f71 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:19.499424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317fa32-fc93-485e-ae5d-0f3a4c604f71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:19.501917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0317fa32-fc93-485e-ae5d-0f3a4c604f71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:19.515648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317fa32-fc93-485e-ae5d-0f3a4c604f71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:19.517992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317fa32-fc93-485e-ae5d-0f3a4c604f71 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:19.527903 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1921/3830] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:30:19 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:30:19.567510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ae4a1791-f6dc-431d-aed3-edc464871fa5 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a49e1c7ce1c44916a3fc264b7283cb51', 'request_id': 'req-ae4a1791-f6dc-431d-aed3-edc464871fa5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:19.646914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ae4a1791-f6dc-431d-aed3-edc464871fa5 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a49e1c7ce1c44916a3fc264b7283cb51', 'request_id': 'req-ae4a1791-f6dc-431d-aed3-edc464871fa5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:19.662663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ae4a1791-f6dc-431d-aed3-edc464871fa5 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a49e1c7ce1c44916a3fc264b7283cb51', 'request_id': 'req-ae4a1791-f6dc-431d-aed3-edc464871fa5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:19.676844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ae4a1791-f6dc-431d-aed3-edc464871fa5 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] The token cache is being invalidate because project a49e1c7ce1c44916a3fc264b7283cb51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:19.677214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ae4a1791-f6dc-431d-aed3-edc464871fa5 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:19.678897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ae4a1791-f6dc-431d-aed3-edc464871fa5 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:19.685824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317fa32-fc93-485e-ae5d-0f3a4c604f71 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:19.687815 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1910/3831] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:19 2022] DELETE /identity/v3/projects/a49e1c7ce1c44916a3fc264b7283cb51 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:19.701544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317fa32-fc93-485e-ae5d-0f3a4c604f71 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:19.815695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8f729-dd96-4e5a-ac8f-7aa7dafddf4a tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a27b81ebb1146efaba51e6135c4b5e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd3f74241604780afda57f2e038ed71', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:19.816589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8f729-dd96-4e5a-ac8f-7aa7dafddf4a tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:19.817182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8f729-dd96-4e5a-ac8f-7aa7dafddf4a tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:19.817712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8f729-dd96-4e5a-ac8f-7aa7dafddf4a tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] PATH_INFO: `/v3/projects/543988f55bd8491baff6126536603417` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:19.821013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8f729-dd96-4e5a-ac8f-7aa7dafddf4a tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: Authorizing `identity:delete_project(project_id=543988f55bd8491baff6126536603417)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:19.824230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8f729-dd96-4e5a-ac8f-7aa7dafddf4a tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:19.983998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0cd8f729-dd96-4e5a-ac8f-7aa7dafddf4a tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '543988f55bd8491baff6126536603417', 'request_id': 'req-0cd8f729-dd96-4e5a-ac8f-7aa7dafddf4a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:19.993001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0cd8f729-dd96-4e5a-ac8f-7aa7dafddf4a tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '543988f55bd8491baff6126536603417', 'request_id': 'req-0cd8f729-dd96-4e5a-ac8f-7aa7dafddf4a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:20.085138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0cd8f729-dd96-4e5a-ac8f-7aa7dafddf4a tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '543988f55bd8491baff6126536603417', 'request_id': 'req-0cd8f729-dd96-4e5a-ac8f-7aa7dafddf4a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:20.119587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0cd8f729-dd96-4e5a-ac8f-7aa7dafddf4a tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] The token cache is being invalidate because project 543988f55bd8491baff6126536603417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:20.120065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0cd8f729-dd96-4e5a-ac8f-7aa7dafddf4a tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:20.122845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0cd8f729-dd96-4e5a-ac8f-7aa7dafddf4a tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:20.132243 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1922/3832] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:19 2022] DELETE /identity/v3/projects/543988f55bd8491baff6126536603417 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:20.136666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a1791-f6dc-431d-aed3-edc464871fa5 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:20.138727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ae4a1791-f6dc-431d-aed3-edc464871fa5 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:20.224260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a1791-f6dc-431d-aed3-edc464871fa5 tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:20.300810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3598b-d3d3-44bb-acfc-ab78fed4db9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:20.303548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3598b-d3d3-44bb-acfc-ab78fed4db9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:20.303548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3598b-d3d3-44bb-acfc-ab78fed4db9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:20.303548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3598b-d3d3-44bb-acfc-ab78fed4db9e admin admin] PATH_INFO: `/v3/users/90f47dd110f54a14b39d610acbb98afa` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:20.303742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3598b-d3d3-44bb-acfc-ab78fed4db9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=90f47dd110f54a14b39d610acbb98afa)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:20.305707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3598b-d3d3-44bb-acfc-ab78fed4db9e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:20.595736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3ab3598b-d3d3-44bb-acfc-ab78fed4db9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90f47dd110f54a14b39d610acbb98afa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:20.649090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3ab3598b-d3d3-44bb-acfc-ab78fed4db9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90f47dd110f54a14b39d610acbb98afa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:20.649926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3ab3598b-d3d3-44bb-acfc-ab78fed4db9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90f47dd110f54a14b39d610acbb98afa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:20.652148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8f729-dd96-4e5a-ac8f-7aa7dafddf4a tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:20.653626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0cd8f729-dd96-4e5a-ac8f-7aa7dafddf4a tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:20.675794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8f729-dd96-4e5a-ac8f-7aa7dafddf4a tempest-ListProjectsTestJSON-1908010252 tempest-ListProjectsTestJSON-1908010252-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:20.681572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26add948-9f31-4d9c-ab8f-8b699ddc4584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:20.682525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26add948-9f31-4d9c-ab8f-8b699ddc4584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:20.682811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26add948-9f31-4d9c-ab8f-8b699ddc4584 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:20.683092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26add948-9f31-4d9c-ab8f-8b699ddc4584 admin admin] PATH_INFO: `/v3/users/75902673ba414cd895898e64cd3060bc` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:20.684389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26add948-9f31-4d9c-ab8f-8b699ddc4584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75902673ba414cd895898e64cd3060bc)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:20.686558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26add948-9f31-4d9c-ab8f-8b699ddc4584 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:20.699592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3ab3598b-d3d3-44bb-acfc-ab78fed4db9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90f47dd110f54a14b39d610acbb98afa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:20.828131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3ab3598b-d3d3-44bb-acfc-ab78fed4db9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90f47dd110f54a14b39d610acbb98afa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:20.834934 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1911/3833] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:30:20 2022] DELETE /identity/v3/users/90f47dd110f54a14b39d610acbb98afa => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:20.839020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3598b-d3d3-44bb-acfc-ab78fed4db9e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:20.840611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3ab3598b-d3d3-44bb-acfc-ab78fed4db9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:20.938099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3598b-d3d3-44bb-acfc-ab78fed4db9e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:20.944479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ba0cd-1350-4de0-abed-50fc499dcc55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:20.945007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ba0cd-1350-4de0-abed-50fc499dcc55 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:20.945341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ba0cd-1350-4de0-abed-50fc499dcc55 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:20.945572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ba0cd-1350-4de0-abed-50fc499dcc55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:20.947623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-097ba0cd-1350-4de0-abed-50fc499dcc55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:20.969711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ba0cd-1350-4de0-abed-50fc499dcc55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:20.969711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ba0cd-1350-4de0-abed-50fc499dcc55 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:20.978454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-26add948-9f31-4d9c-ab8f-8b699ddc4584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75902673ba414cd895898e64cd3060bc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:20.996681 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1912/3834] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:30:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:30:21.001089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d114d-78c9-4f1b-86d4-33cfc7c30109 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:21.001381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d114d-78c9-4f1b-86d4-33cfc7c30109 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:21.001668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d114d-78c9-4f1b-86d4-33cfc7c30109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:21.003007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-26add948-9f31-4d9c-ab8f-8b699ddc4584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75902673ba414cd895898e64cd3060bc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:21.005719 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-26add948-9f31-4d9c-ab8f-8b699ddc4584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75902673ba414cd895898e64cd3060bc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:21.018178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-26add948-9f31-4d9c-ab8f-8b699ddc4584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75902673ba414cd895898e64cd3060bc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:21.021395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-568d114d-78c9-4f1b-86d4-33cfc7c30109 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:21.022698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-568d114d-78c9-4f1b-86d4-33cfc7c30109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:21.108649 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1913/3835] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:21.109714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d114d-78c9-4f1b-86d4-33cfc7c30109 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:21.111242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-568d114d-78c9-4f1b-86d4-33cfc7c30109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:21.124260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-26add948-9f31-4d9c-ab8f-8b699ddc4584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75902673ba414cd895898e64cd3060bc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:21.144011 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1923/3836] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:30:20 2022] DELETE /identity/v3/users/75902673ba414cd895898e64cd3060bc => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:21.190201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d114d-78c9-4f1b-86d4-33cfc7c30109 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:21.291803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295acca3-828b-4adc-ade9-66d73b719541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:21.292586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295acca3-828b-4adc-ade9-66d73b719541 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:21.294794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295acca3-828b-4adc-ade9-66d73b719541 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:21.294794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295acca3-828b-4adc-ade9-66d73b719541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:21.296560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-295acca3-828b-4adc-ade9-66d73b719541 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:21.401949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295acca3-828b-4adc-ade9-66d73b719541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:21.403572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295acca3-828b-4adc-ade9-66d73b719541 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:21.414614 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1914/3837] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:30:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:30:21.613066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26add948-9f31-4d9c-ab8f-8b699ddc4584 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:21.615156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-26add948-9f31-4d9c-ab8f-8b699ddc4584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:21.656963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26add948-9f31-4d9c-ab8f-8b699ddc4584 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:21.673902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08370f99-ab6d-4e5d-aba6-4cb9b075a9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:21.676528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08370f99-ab6d-4e5d-aba6-4cb9b075a9db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:21.676997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08370f99-ab6d-4e5d-aba6-4cb9b075a9db admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:21.677420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08370f99-ab6d-4e5d-aba6-4cb9b075a9db admin admin] PATH_INFO: `/v3/projects/49eb61123f624832aa949f49de778c90` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:21.678949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08370f99-ab6d-4e5d-aba6-4cb9b075a9db admin admin] RBAC: Authorizing `identity:delete_project(project_id=49eb61123f624832aa949f49de778c90)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:21.681122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08370f99-ab6d-4e5d-aba6-4cb9b075a9db admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:21.930398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-08370f99-ab6d-4e5d-aba6-4cb9b075a9db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49eb61123f624832aa949f49de778c90', 'request_id': 'req-08370f99-ab6d-4e5d-aba6-4cb9b075a9db'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:21.936782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-08370f99-ab6d-4e5d-aba6-4cb9b075a9db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49eb61123f624832aa949f49de778c90', 'request_id': 'req-08370f99-ab6d-4e5d-aba6-4cb9b075a9db'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:22.021675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-08370f99-ab6d-4e5d-aba6-4cb9b075a9db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49eb61123f624832aa949f49de778c90', 'request_id': 'req-08370f99-ab6d-4e5d-aba6-4cb9b075a9db'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:22.033109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-08370f99-ab6d-4e5d-aba6-4cb9b075a9db admin admin] The token cache is being invalidate because project 49eb61123f624832aa949f49de778c90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:22.033450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-08370f99-ab6d-4e5d-aba6-4cb9b075a9db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:22.034480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-08370f99-ab6d-4e5d-aba6-4cb9b075a9db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:22.036896 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1924/3838] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:21 2022] DELETE /identity/v3/projects/49eb61123f624832aa949f49de778c90 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:22.043327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ea661-6564-42ba-87c9-8efa0889972c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:22.043969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ea661-6564-42ba-87c9-8efa0889972c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:22.044739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ea661-6564-42ba-87c9-8efa0889972c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:22.054949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08370f99-ab6d-4e5d-aba6-4cb9b075a9db admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:22.061715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-08370f99-ab6d-4e5d-aba6-4cb9b075a9db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:22.104181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4b1ea661-6564-42ba-87c9-8efa0889972c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:22.104181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4b1ea661-6564-42ba-87c9-8efa0889972c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:22.160992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08370f99-ab6d-4e5d-aba6-4cb9b075a9db admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:22.170601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f46c5-ff06-485c-9c64-9eaae4820516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:22.174287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f46c5-ff06-485c-9c64-9eaae4820516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:22.181157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f46c5-ff06-485c-9c64-9eaae4820516 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:22.181748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f46c5-ff06-485c-9c64-9eaae4820516 admin admin] PATH_INFO: `/v3/projects/135596a6d4af4bedaf5991984bdcc445` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:22.183502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f46c5-ff06-485c-9c64-9eaae4820516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=135596a6d4af4bedaf5991984bdcc445)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:22.185708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f46c5-ff06-485c-9c64-9eaae4820516 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:22.213502 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1915/3839] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:22.222606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062d4dc-4931-4b21-95a5-6bc382884567 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:22.223116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062d4dc-4931-4b21-95a5-6bc382884567 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:22.223541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062d4dc-4931-4b21-95a5-6bc382884567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:22.246778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9062d4dc-4931-4b21-95a5-6bc382884567 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:22.248229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9062d4dc-4931-4b21-95a5-6bc382884567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:22.261241 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1916/3840] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:22.262494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062d4dc-4931-4b21-95a5-6bc382884567 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:22.271739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062d4dc-4931-4b21-95a5-6bc382884567 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:22.276762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec73a6-0d17-4314-8b37-02c165bdf9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:22.277464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec73a6-0d17-4314-8b37-02c165bdf9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:22.277791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec73a6-0d17-4314-8b37-02c165bdf9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:22.278036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec73a6-0d17-4314-8b37-02c165bdf9d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:22.278778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec73a6-0d17-4314-8b37-02c165bdf9d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:30:22.279090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec73a6-0d17-4314-8b37-02c165bdf9d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:22.280789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec73a6-0d17-4314-8b37-02c165bdf9d5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:22.300639 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1917/3841] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:30:22.304335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec73a6-0d17-4314-8b37-02c165bdf9d5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:22.318516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec73a6-0d17-4314-8b37-02c165bdf9d5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:22.323684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e7d8e-1d2b-41b4-8f2e-e91cee2d14e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:22.324344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e7d8e-1d2b-41b4-8f2e-e91cee2d14e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:22.324658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e7d8e-1d2b-41b4-8f2e-e91cee2d14e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:22.324948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e7d8e-1d2b-41b4-8f2e-e91cee2d14e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:22.325804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e7d8e-1d2b-41b4-8f2e-e91cee2d14e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:22.327885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e7d8e-1d2b-41b4-8f2e-e91cee2d14e6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:22.345954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-529f46c5-ff06-485c-9c64-9eaae4820516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '135596a6d4af4bedaf5991984bdcc445', 'request_id': 'req-529f46c5-ff06-485c-9c64-9eaae4820516'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:22.352516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-529f46c5-ff06-485c-9c64-9eaae4820516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '135596a6d4af4bedaf5991984bdcc445', 'request_id': 'req-529f46c5-ff06-485c-9c64-9eaae4820516'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:22.425190 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1918/3842] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:30:22 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:30:22.425190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e7d8e-1d2b-41b4-8f2e-e91cee2d14e6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:22.445413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-529f46c5-ff06-485c-9c64-9eaae4820516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '135596a6d4af4bedaf5991984bdcc445', 'request_id': 'req-529f46c5-ff06-485c-9c64-9eaae4820516'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:22.459565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-529f46c5-ff06-485c-9c64-9eaae4820516 admin admin] The token cache is being invalidate because project 135596a6d4af4bedaf5991984bdcc445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:22.459990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-529f46c5-ff06-485c-9c64-9eaae4820516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:22.460941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-529f46c5-ff06-485c-9c64-9eaae4820516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:22.466028 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1925/3843] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:22 2022] DELETE /identity/v3/projects/135596a6d4af4bedaf5991984bdcc445 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:22.466982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f46c5-ff06-485c-9c64-9eaae4820516 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:22.468542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-529f46c5-ff06-485c-9c64-9eaae4820516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:22.499162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e7d8e-1d2b-41b4-8f2e-e91cee2d14e6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:22.507149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5da90-4734-4493-98ce-7e257ce94c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:22.508054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5da90-4734-4493-98ce-7e257ce94c3d admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:22.508535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5da90-4734-4493-98ce-7e257ce94c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:22.509323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5da90-4734-4493-98ce-7e257ce94c3d admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:22.510386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5da90-4734-4493-98ce-7e257ce94c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:22.512921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5da90-4734-4493-98ce-7e257ce94c3d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:22.552894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f46c5-ff06-485c-9c64-9eaae4820516 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:22.558903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f29dc-e198-46ee-9a9e-629e2fa8e5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:22.560173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f29dc-e198-46ee-9a9e-629e2fa8e5ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:22.560461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f29dc-e198-46ee-9a9e-629e2fa8e5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:22.560834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f29dc-e198-46ee-9a9e-629e2fa8e5ed admin admin] PATH_INFO: `/v3/users/2a27b81ebb1146efaba51e6135c4b5e1` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:22.562173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f29dc-e198-46ee-9a9e-629e2fa8e5ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a27b81ebb1146efaba51e6135c4b5e1)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:22.564184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f29dc-e198-46ee-9a9e-629e2fa8e5ed admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:22.598638 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1919/3844] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:30:22 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:30:22.599793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5da90-4734-4493-98ce-7e257ce94c3d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:22.602410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-90f5da90-4734-4493-98ce-7e257ce94c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:22.619423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5da90-4734-4493-98ce-7e257ce94c3d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:22.625360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a8803-f630-4c21-975a-78141a5ce471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:22.626031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a8803-f630-4c21-975a-78141a5ce471 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:22.626341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a8803-f630-4c21-975a-78141a5ce471 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:22.626621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a8803-f630-4c21-975a-78141a5ce471 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:22.627556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a8803-f630-4c21-975a-78141a5ce471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:22.629035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a8803-f630-4c21-975a-78141a5ce471 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:22.643502 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1920/3845] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:30:22.647561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a8803-f630-4c21-975a-78141a5ce471 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:22.658518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a8803-f630-4c21-975a-78141a5ce471 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:22.663668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7aaa6b-2e66-41e5-b441-b8735b34642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:22.664980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7aaa6b-2e66-41e5-b441-b8735b34642f admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:22.664980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7aaa6b-2e66-41e5-b441-b8735b34642f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:22.665234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7aaa6b-2e66-41e5-b441-b8735b34642f admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:22.668731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7aaa6b-2e66-41e5-b441-b8735b34642f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:22.668731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7aaa6b-2e66-41e5-b441-b8735b34642f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:22.678803 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1921/3846] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:30:22.682824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7aaa6b-2e66-41e5-b441-b8735b34642f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:22.693480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7aaa6b-2e66-41e5-b441-b8735b34642f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:22.698487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc91827-20be-405f-aa8f-c55e0e6adb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:22.699373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc91827-20be-405f-aa8f-c55e0e6adb4d admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:22.699651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc91827-20be-405f-aa8f-c55e0e6adb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:22.700058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc91827-20be-405f-aa8f-c55e0e6adb4d admin admin] PATH_INFO: `/v3/projects/f15feefc56df4978830002509782cad7/users/23a6af7e588542a58e5793b8ea1bb9ed/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:22.716849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc91827-20be-405f-aa8f-c55e0e6adb4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f15feefc56df4978830002509782cad7, user_id=23a6af7e588542a58e5793b8ea1bb9ed, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:22.720526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc91827-20be-405f-aa8f-c55e0e6adb4d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:22.772839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c99f29dc-e198-46ee-9a9e-629e2fa8e5ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a27b81ebb1146efaba51e6135c4b5e1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:22.794016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c99f29dc-e198-46ee-9a9e-629e2fa8e5ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a27b81ebb1146efaba51e6135c4b5e1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:22.794961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c99f29dc-e198-46ee-9a9e-629e2fa8e5ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a27b81ebb1146efaba51e6135c4b5e1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:22.803755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c99f29dc-e198-46ee-9a9e-629e2fa8e5ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a27b81ebb1146efaba51e6135c4b5e1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:22.813625 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1922/3847] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:30:22 2022] PUT /identity/v3/projects/f15feefc56df4978830002509782cad7/users/23a6af7e588542a58e5793b8ea1bb9ed/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:30:22.823587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd8e99-9574-4684-aed0-849372428d8d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:22.823898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd8e99-9574-4684-aed0-849372428d8d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:22.824829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd8e99-9574-4684-aed0-849372428d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:22.879227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-32cd8e99-9574-4684-aed0-849372428d8d None None] MFA Rules not processed for user `23a6af7e588542a58e5793b8ea1bb9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:22.880701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-32cd8e99-9574-4684-aed0-849372428d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:22.919486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c99f29dc-e198-46ee-9a9e-629e2fa8e5ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a27b81ebb1146efaba51e6135c4b5e1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:22.932727 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1926/3848] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:30:22 2022] DELETE /identity/v3/users/2a27b81ebb1146efaba51e6135c4b5e1 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:22.987897 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1923/3849] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:30:22.999501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0032d8-ba37-4719-b339-7173a772a31b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:23.000041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0032d8-ba37-4719-b339-7173a772a31b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:23.000882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0032d8-ba37-4719-b339-7173a772a31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:23.022214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9d0032d8-ba37-4719-b339-7173a772a31b None None] MFA Rules not processed for user `23a6af7e588542a58e5793b8ea1bb9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:23.023663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9d0032d8-ba37-4719-b339-7173a772a31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:23.118999 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1927/3850] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:23.131977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd8e99-9574-4684-aed0-849372428d8d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:23.133944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-32cd8e99-9574-4684-aed0-849372428d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:23.252479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd8e99-9574-4684-aed0-849372428d8d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:23.371307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c21b7-2ba7-4369-8e9c-eae0c8675c06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:23.372743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c21b7-2ba7-4369-8e9c-eae0c8675c06 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:23.373214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c21b7-2ba7-4369-8e9c-eae0c8675c06 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:23.373647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c21b7-2ba7-4369-8e9c-eae0c8675c06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:23.390607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c21b7-2ba7-4369-8e9c-eae0c8675c06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:23.393822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c21b7-2ba7-4369-8e9c-eae0c8675c06 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:23.407405 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1924/3851] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:30:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:30:23.661358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0032d8-ba37-4719-b339-7173a772a31b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:23.663015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9d0032d8-ba37-4719-b339-7173a772a31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:23.772833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0032d8-ba37-4719-b339-7173a772a31b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:23.779917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfecc00-16c1-40be-805d-da4d9d8ce321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:23.781075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfecc00-16c1-40be-805d-da4d9d8ce321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:23.781893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfecc00-16c1-40be-805d-da4d9d8ce321 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:23.782239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfecc00-16c1-40be-805d-da4d9d8ce321 admin admin] PATH_INFO: `/v3/projects/afd3f74241604780afda57f2e038ed71` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:23.791941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfecc00-16c1-40be-805d-da4d9d8ce321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afd3f74241604780afda57f2e038ed71)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:23.801298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfecc00-16c1-40be-805d-da4d9d8ce321 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:23.988073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0cfecc00-16c1-40be-805d-da4d9d8ce321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afd3f74241604780afda57f2e038ed71', 'request_id': 'req-0cfecc00-16c1-40be-805d-da4d9d8ce321'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:24.005199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0cfecc00-16c1-40be-805d-da4d9d8ce321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afd3f74241604780afda57f2e038ed71', 'request_id': 'req-0cfecc00-16c1-40be-805d-da4d9d8ce321'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:24.107519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0cfecc00-16c1-40be-805d-da4d9d8ce321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afd3f74241604780afda57f2e038ed71', 'request_id': 'req-0cfecc00-16c1-40be-805d-da4d9d8ce321'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:24.122046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0cfecc00-16c1-40be-805d-da4d9d8ce321 admin admin] The token cache is being invalidate because project afd3f74241604780afda57f2e038ed71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:24.123168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0cfecc00-16c1-40be-805d-da4d9d8ce321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:24.125764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0cfecc00-16c1-40be-805d-da4d9d8ce321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:24.129948 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1928/3852] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:23 2022] DELETE /identity/v3/projects/afd3f74241604780afda57f2e038ed71 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:24.134512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e574dc0-5490-4c52-9e15-31bb10399f8e None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:24.134806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e574dc0-5490-4c52-9e15-31bb10399f8e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:24.135087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e574dc0-5490-4c52-9e15-31bb10399f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:24.171228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9e574dc0-5490-4c52-9e15-31bb10399f8e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:24.173011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9e574dc0-5490-4c52-9e15-31bb10399f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:24.255928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c183b5-c461-43a9-be0b-9a379c266e68 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:24.256329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c183b5-c461-43a9-be0b-9a379c266e68 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:24.256508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c183b5-c461-43a9-be0b-9a379c266e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:24.290137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-74c183b5-c461-43a9-be0b-9a379c266e68 None None] MFA Rules not processed for user `e3d3dea2740e4e46ae98265dcade1291`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:24.292822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-74c183b5-c461-43a9-be0b-9a379c266e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:24.295660 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1925/3853] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:24.297359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5267775-13a9-477e-8578-90c7d1f9654d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:24.297756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5267775-13a9-477e-8578-90c7d1f9654d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:24.298144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5267775-13a9-477e-8578-90c7d1f9654d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:24.341943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b5267775-13a9-477e-8578-90c7d1f9654d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:24.343435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b5267775-13a9-477e-8578-90c7d1f9654d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:24.360811 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1926/3854] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:24.362274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5267775-13a9-477e-8578-90c7d1f9654d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:24.374346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5267775-13a9-477e-8578-90c7d1f9654d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:24.382649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecb459-3639-4eb5-b0b1-189c850324af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:24.384120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecb459-3639-4eb5-b0b1-189c850324af admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:24.384704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecb459-3639-4eb5-b0b1-189c850324af admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:24.385739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecb459-3639-4eb5-b0b1-189c850324af admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:24.387336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecb459-3639-4eb5-b0b1-189c850324af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:30:24.387867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecb459-3639-4eb5-b0b1-189c850324af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:24.390267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecb459-3639-4eb5-b0b1-189c850324af admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:24.411957 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1927/3855] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:30:24.413155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecb459-3639-4eb5-b0b1-189c850324af admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:24.425469 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1929/3856] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:24.426469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecb459-3639-4eb5-b0b1-189c850324af admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:24.432125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872dc0c-d1ea-480d-9cf1-11e95f5a0973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:24.433201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872dc0c-d1ea-480d-9cf1-11e95f5a0973 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:24.433651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872dc0c-d1ea-480d-9cf1-11e95f5a0973 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:24.435538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872dc0c-d1ea-480d-9cf1-11e95f5a0973 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:24.436646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872dc0c-d1ea-480d-9cf1-11e95f5a0973 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:24.439496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872dc0c-d1ea-480d-9cf1-11e95f5a0973 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:24.546686 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1928/3857] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:30:24 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:24.552276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c183b5-c461-43a9-be0b-9a379c266e68 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:24.571255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c183b5-c461-43a9-be0b-9a379c266e68 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:24.678626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16225329-e5a2-4aa6-9cef-11b63e009d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:24.680322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16225329-e5a2-4aa6-9cef-11b63e009d42 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:24.680857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16225329-e5a2-4aa6-9cef-11b63e009d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:24.681291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16225329-e5a2-4aa6-9cef-11b63e009d42 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:24.683919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16225329-e5a2-4aa6-9cef-11b63e009d42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:24.688249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16225329-e5a2-4aa6-9cef-11b63e009d42 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:24.827892 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1930/3858] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:30:24 2022] POST /identity/v3/users => generated 284 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:24.832300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872dc0c-d1ea-480d-9cf1-11e95f5a0973 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:24.846255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872dc0c-d1ea-480d-9cf1-11e95f5a0973 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:24.868156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d6eeb-cfbc-4231-8520-dd85428c0bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:24.869879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d6eeb-cfbc-4231-8520-dd85428c0bcf admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:24.875738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d6eeb-cfbc-4231-8520-dd85428c0bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:24.875738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d6eeb-cfbc-4231-8520-dd85428c0bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:24.875738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d6eeb-cfbc-4231-8520-dd85428c0bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:24.875738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d6eeb-cfbc-4231-8520-dd85428c0bcf admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:24.908530 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1929/3859] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:30:24.910751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16225329-e5a2-4aa6-9cef-11b63e009d42 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:24.927779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16225329-e5a2-4aa6-9cef-11b63e009d42 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:24.946574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648524a-aefa-42fd-a584-b95e6cf19d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:24.947496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648524a-aefa-42fd-a584-b95e6cf19d7b admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:24.947852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648524a-aefa-42fd-a584-b95e6cf19d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:24.948344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648524a-aefa-42fd-a584-b95e6cf19d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:24.949307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648524a-aefa-42fd-a584-b95e6cf19d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:24.951389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648524a-aefa-42fd-a584-b95e6cf19d7b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:24.967551 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1931/3860] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:30:24.969320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d6eeb-cfbc-4231-8520-dd85428c0bcf admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:24.990307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d6eeb-cfbc-4231-8520-dd85428c0bcf admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:24.998565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975632e-d25e-4af8-a9f2-39bc69f46609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:24.999491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975632e-d25e-4af8-a9f2-39bc69f46609 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:24.999764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975632e-d25e-4af8-a9f2-39bc69f46609 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:25.000903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975632e-d25e-4af8-a9f2-39bc69f46609 admin admin] PATH_INFO: `/v3/projects/1418a8e8bf1c48d48f0a61054123edd4/users/b84aafff22c9412992d2cd4f4e49f74b/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:25.040742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975632e-d25e-4af8-a9f2-39bc69f46609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1418a8e8bf1c48d48f0a61054123edd4, user_id=b84aafff22c9412992d2cd4f4e49f74b, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:25.045636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975632e-d25e-4af8-a9f2-39bc69f46609 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:25.182600 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1930/3861] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:30:24 2022] PUT /identity/v3/projects/1418a8e8bf1c48d48f0a61054123edd4/users/b84aafff22c9412992d2cd4f4e49f74b/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:30:25.193818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c77cce-7338-48d1-b827-47ecab9d6fae None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:25.198558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c77cce-7338-48d1-b827-47ecab9d6fae None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:25.198558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c77cce-7338-48d1-b827-47ecab9d6fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:25.240226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-76c77cce-7338-48d1-b827-47ecab9d6fae None None] MFA Rules not processed for user `b84aafff22c9412992d2cd4f4e49f74b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:25.241503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-76c77cce-7338-48d1-b827-47ecab9d6fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:25.322850 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1932/3862] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:25.327088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975632e-d25e-4af8-a9f2-39bc69f46609 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:25.412443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975632e-d25e-4af8-a9f2-39bc69f46609 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:25.418597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4749c-bbf3-49dd-86ef-92f5acf6df1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:25.419524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4749c-bbf3-49dd-86ef-92f5acf6df1b admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:25.420160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4749c-bbf3-49dd-86ef-92f5acf6df1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:25.420584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4749c-bbf3-49dd-86ef-92f5acf6df1b admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:25.422509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4749c-bbf3-49dd-86ef-92f5acf6df1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:25.430044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4749c-bbf3-49dd-86ef-92f5acf6df1b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:25.630865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c77cce-7338-48d1-b827-47ecab9d6fae None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:25.631360 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1931/3863] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:30:25 2022] POST /identity/v3/projects => generated 369 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:30:25.654381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c77cce-7338-48d1-b827-47ecab9d6fae None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:25.726158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f882f-579d-4a69-952a-d16f206232c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:25.729438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f882f-579d-4a69-952a-d16f206232c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:25.729950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f882f-579d-4a69-952a-d16f206232c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:25.730382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f882f-579d-4a69-952a-d16f206232c6 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:25.731388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f882f-579d-4a69-952a-d16f206232c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:25.734890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f882f-579d-4a69-952a-d16f206232c6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:25.830958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4749c-bbf3-49dd-86ef-92f5acf6df1b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:25.833153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3ff4749c-bbf3-49dd-86ef-92f5acf6df1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:25.841250 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1933/3864] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:30:25 2022] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:25.846785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f882f-579d-4a69-952a-d16f206232c6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:25.860652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f882f-579d-4a69-952a-d16f206232c6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:25.868845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1256f2-bf84-483d-9916-0c5e226e938e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:25.869882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1256f2-bf84-483d-9916-0c5e226e938e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:25.870354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1256f2-bf84-483d-9916-0c5e226e938e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:25.870890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1256f2-bf84-483d-9916-0c5e226e938e admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:25.872515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1256f2-bf84-483d-9916-0c5e226e938e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:25.877174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1256f2-bf84-483d-9916-0c5e226e938e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:25.901725 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1934/3865] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:30:25.905970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1256f2-bf84-483d-9916-0c5e226e938e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:25.931778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1256f2-bf84-483d-9916-0c5e226e938e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:25.942429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f8a37-f1fa-48b1-86ab-de34627a60c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:25.944949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f8a37-f1fa-48b1-86ab-de34627a60c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:25.945219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f8a37-f1fa-48b1-86ab-de34627a60c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:25.945513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f8a37-f1fa-48b1-86ab-de34627a60c8 admin admin] PATH_INFO: `/v3/projects/15abf4fd579641f781f04dc75f12bd83/users/67c30f61490c46aab1dba9fd5bc49e48/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:25.985879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4749c-bbf3-49dd-86ef-92f5acf6df1b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:25.988359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f8a37-f1fa-48b1-86ab-de34627a60c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15abf4fd579641f781f04dc75f12bd83, user_id=67c30f61490c46aab1dba9fd5bc49e48, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:25.992954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f8a37-f1fa-48b1-86ab-de34627a60c8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:26.002734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b1d11-1ddc-47ee-9752-5c3c7286e718 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:26.003318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b1d11-1ddc-47ee-9752-5c3c7286e718 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:26.007850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b1d11-1ddc-47ee-9752-5c3c7286e718 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:26.007850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b1d11-1ddc-47ee-9752-5c3c7286e718 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:26.007850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9a5b1d11-1ddc-47ee-9752-5c3c7286e718 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:26.089183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b1d11-1ddc-47ee-9752-5c3c7286e718 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:26.090587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b1d11-1ddc-47ee-9752-5c3c7286e718 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:26.109554 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1932/3866] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:30:25 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:30:26.118490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b1d11-1ddc-47ee-9752-5c3c7286e718 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:26.119139 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1935/3867] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:30:25 2022] PUT /identity/v3/projects/15abf4fd579641f781f04dc75f12bd83/users/67c30f61490c46aab1dba9fd5bc49e48/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:26.119139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc2612-2613-4791-b1f2-530fd036bba8 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:26.119139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc2612-2613-4791-b1f2-530fd036bba8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:26.119139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc2612-2613-4791-b1f2-530fd036bba8 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:26.119139 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1936/3868] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:30:26.119139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc2612-2613-4791-b1f2-530fd036bba8 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:26.119603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9a5b1d11-1ddc-47ee-9752-5c3c7286e718 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:26.203966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc2612-2613-4791-b1f2-530fd036bba8 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:26.222608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc00c1-d877-44fb-b2b3-586e0a90803f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:26.223755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc00c1-d877-44fb-b2b3-586e0a90803f admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:26.223755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc00c1-d877-44fb-b2b3-586e0a90803f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:26.224678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc00c1-d877-44fb-b2b3-586e0a90803f admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:26.226239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc00c1-d877-44fb-b2b3-586e0a90803f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:26.228794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc00c1-d877-44fb-b2b3-586e0a90803f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:26.239263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b1d11-1ddc-47ee-9752-5c3c7286e718 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:26.245652 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1937/3869] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:30:26.245652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74ef7b-586c-4077-abf7-746e8116ca8b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:26.245652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74ef7b-586c-4077-abf7-746e8116ca8b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:26.245652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74ef7b-586c-4077-abf7-746e8116ca8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:26.309375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9d74ef7b-586c-4077-abf7-746e8116ca8b None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:26.310826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9d74ef7b-586c-4077-abf7-746e8116ca8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:26.364274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d27e9-644b-442f-9b02-5d138de56d3b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:26.365253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d27e9-644b-442f-9b02-5d138de56d3b service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:26.365727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d27e9-644b-442f-9b02-5d138de56d3b service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:26.366162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d27e9-644b-442f-9b02-5d138de56d3b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:26.388132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a51d27e9-644b-442f-9b02-5d138de56d3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:26.398568 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1938/3870] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:30:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:26.400489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74ef7b-586c-4077-abf7-746e8116ca8b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:26.417371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d27e9-644b-442f-9b02-5d138de56d3b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:26.419662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d27e9-644b-442f-9b02-5d138de56d3b service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:26.421852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74ef7b-586c-4077-abf7-746e8116ca8b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:26.428136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1b03a-39bf-4a00-8682-33feea65027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:26.429449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1b03a-39bf-4a00-8682-33feea65027b admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:26.429734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1b03a-39bf-4a00-8682-33feea65027b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:26.430004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1b03a-39bf-4a00-8682-33feea65027b admin admin] PATH_INFO: `/v3/projects/15abf4fd579641f781f04dc75f12bd83/users/67c30f61490c46aab1dba9fd5bc49e48/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:26.432440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1b03a-39bf-4a00-8682-33feea65027b admin admin] RBAC: Authorizing `identity:create_grant(project_id=15abf4fd579641f781f04dc75f12bd83, user_id=67c30f61490c46aab1dba9fd5bc49e48, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:26.435242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1b03a-39bf-4a00-8682-33feea65027b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:26.442841 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1933/3871] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:30:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:30:26.444240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d27e9-644b-442f-9b02-5d138de56d3b service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:26.449236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a51d27e9-644b-442f-9b02-5d138de56d3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:26.462288 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1939/3872] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:30:26 2022] PUT /identity/v3/projects/15abf4fd579641f781f04dc75f12bd83/users/67c30f61490c46aab1dba9fd5bc49e48/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:26.464311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d291b33-e089-40e0-99c6-52bb5954e419 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:26.464640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d291b33-e089-40e0-99c6-52bb5954e419 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:26.464913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d291b33-e089-40e0-99c6-52bb5954e419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:26.485969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d27e9-644b-442f-9b02-5d138de56d3b service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:26.507434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2d291b33-e089-40e0-99c6-52bb5954e419 None None] MFA Rules not processed for user `67c30f61490c46aab1dba9fd5bc49e48`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:26.508589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2d291b33-e089-40e0-99c6-52bb5954e419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:26.602208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df738e63-34eb-4855-a642-7ef69f4660de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:26.602962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df738e63-34eb-4855-a642-7ef69f4660de service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:26.603251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df738e63-34eb-4855-a642-7ef69f4660de service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:26.603534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df738e63-34eb-4855-a642-7ef69f4660de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:26.604165 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1940/3873] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:26 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:26.609022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d291b33-e089-40e0-99c6-52bb5954e419 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:26.645603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d291b33-e089-40e0-99c6-52bb5954e419 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:26.649787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df738e63-34eb-4855-a642-7ef69f4660de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:26.651400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df738e63-34eb-4855-a642-7ef69f4660de service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:26.657304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782358c-10dd-4af4-8acf-b2948d090657 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:26.657993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782358c-10dd-4af4-8acf-b2948d090657 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:26.658284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782358c-10dd-4af4-8acf-b2948d090657 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:26.658566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782358c-10dd-4af4-8acf-b2948d090657 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:26.659261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782358c-10dd-4af4-8acf-b2948d090657 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:26.664471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782358c-10dd-4af4-8acf-b2948d090657 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:26.688904 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1934/3874] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:30:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:30:26.757959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf058b7-ab9a-4558-8df8-70636f1d59e4 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:26.758264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf058b7-ab9a-4558-8df8-70636f1d59e4 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:26.758541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf058b7-ab9a-4558-8df8-70636f1d59e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:26.791089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-5bf058b7-ab9a-4558-8df8-70636f1d59e4 None None] MFA Rules not processed for user `e3d3dea2740e4e46ae98265dcade1291`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:26.793636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5bf058b7-ab9a-4558-8df8-70636f1d59e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:26.800442 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1941/3875] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:30:26 2022] POST /identity/v3/projects => generated 359 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:26.804998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782358c-10dd-4af4-8acf-b2948d090657 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:26.890418 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1935/3876] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:30:26.957856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782358c-10dd-4af4-8acf-b2948d090657 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:26.965593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea340e-d305-4dd6-971c-e455518d4526 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:26.966358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea340e-d305-4dd6-971c-e455518d4526 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:26.966650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea340e-d305-4dd6-971c-e455518d4526 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:26.966932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea340e-d305-4dd6-971c-e455518d4526 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:26.967898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea340e-d305-4dd6-971c-e455518d4526 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:26.970065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea340e-d305-4dd6-971c-e455518d4526 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:27.089499 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1942/3877] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:30:26 2022] POST /identity/v3/users => generated 407 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:27.094161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf058b7-ab9a-4558-8df8-70636f1d59e4 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:27.117787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf058b7-ab9a-4558-8df8-70636f1d59e4 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:27.137361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ac6f5-7fc8-4418-812b-94544b4efb7f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:27.138874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ac6f5-7fc8-4418-812b-94544b4efb7f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:27.138998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ac6f5-7fc8-4418-812b-94544b4efb7f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:27.139315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ac6f5-7fc8-4418-812b-94544b4efb7f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/users/48e218c04b6b41e9895153feb43d056a` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:27.170403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ac6f5-7fc8-4418-812b-94544b4efb7f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:get_user(user_id=48e218c04b6b41e9895153feb43d056a)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:27.173349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ac6f5-7fc8-4418-812b-94544b4efb7f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:27.176117 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1936/3878] 10.222.0.16 () {58 vars in 1220 bytes} [Mon May 2 10:30:27 2022] GET /identity/v3/users/48e218c04b6b41e9895153feb43d056a => generated 407 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:30:27.180445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea340e-d305-4dd6-971c-e455518d4526 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:27.193591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea340e-d305-4dd6-971c-e455518d4526 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:27.199204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9977503-2bc5-487d-bc03-1112bc9610b1 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:27.201705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9977503-2bc5-487d-bc03-1112bc9610b1 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:27.202101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9977503-2bc5-487d-bc03-1112bc9610b1 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:27.202485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9977503-2bc5-487d-bc03-1112bc9610b1 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/users/48e218c04b6b41e9895153feb43d056a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:27.204097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9977503-2bc5-487d-bc03-1112bc9610b1 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:delete_user(user_id=48e218c04b6b41e9895153feb43d056a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:27.207400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9977503-2bc5-487d-bc03-1112bc9610b1 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:27.341933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e9977503-2bc5-487d-bc03-1112bc9610b1 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e218c04b6b41e9895153feb43d056a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:27.356149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e9977503-2bc5-487d-bc03-1112bc9610b1 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e218c04b6b41e9895153feb43d056a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:27.357229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e9977503-2bc5-487d-bc03-1112bc9610b1 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e218c04b6b41e9895153feb43d056a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:27.367363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e9977503-2bc5-487d-bc03-1112bc9610b1 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e218c04b6b41e9895153feb43d056a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:27.443471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e9977503-2bc5-487d-bc03-1112bc9610b1 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e218c04b6b41e9895153feb43d056a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:27.450180 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1943/3879] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:30:27 2022] DELETE /identity/v3/users/48e218c04b6b41e9895153feb43d056a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:30:27.454269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ac6f5-7fc8-4418-812b-94544b4efb7f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:27.456239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-638ac6f5-7fc8-4418-812b-94544b4efb7f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:27.470067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ac6f5-7fc8-4418-812b-94544b4efb7f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:27.537900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a39372-583d-42e6-ac7a-ae5c323fe5a5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:27.539114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a39372-583d-42e6-ac7a-ae5c323fe5a5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:27.539114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a39372-583d-42e6-ac7a-ae5c323fe5a5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:27.539357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a39372-583d-42e6-ac7a-ae5c323fe5a5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/fc954c76a979470cbfac972a317c6b5d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:27.540994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a39372-583d-42e6-ac7a-ae5c323fe5a5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fc954c76a979470cbfac972a317c6b5d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:27.542564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a39372-583d-42e6-ac7a-ae5c323fe5a5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:27.705441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c1a39372-583d-42e6-ac7a-ae5c323fe5a5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc954c76a979470cbfac972a317c6b5d', 'request_id': 'req-c1a39372-583d-42e6-ac7a-ae5c323fe5a5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:27.778186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c1a39372-583d-42e6-ac7a-ae5c323fe5a5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc954c76a979470cbfac972a317c6b5d', 'request_id': 'req-c1a39372-583d-42e6-ac7a-ae5c323fe5a5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:27.787024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c1a39372-583d-42e6-ac7a-ae5c323fe5a5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc954c76a979470cbfac972a317c6b5d', 'request_id': 'req-c1a39372-583d-42e6-ac7a-ae5c323fe5a5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:27.801531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c1a39372-583d-42e6-ac7a-ae5c323fe5a5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] The token cache is being invalidate because project fc954c76a979470cbfac972a317c6b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:27.801850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c1a39372-583d-42e6-ac7a-ae5c323fe5a5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:27.803013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c1a39372-583d-42e6-ac7a-ae5c323fe5a5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:27.810454 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1937/3880] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:27 2022] DELETE /identity/v3/projects/fc954c76a979470cbfac972a317c6b5d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:27.810648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9977503-2bc5-487d-bc03-1112bc9610b1 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:27.820881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9977503-2bc5-487d-bc03-1112bc9610b1 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:27.885567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d7e79-d73b-4f56-a00e-56b3d14ea05c tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:27.886242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d7e79-d73b-4f56-a00e-56b3d14ea05c tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:27.886526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d7e79-d73b-4f56-a00e-56b3d14ea05c tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:27.886800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d7e79-d73b-4f56-a00e-56b3d14ea05c tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:27.887507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d7e79-d73b-4f56-a00e-56b3d14ea05c tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:27.889789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d7e79-d73b-4f56-a00e-56b3d14ea05c tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:27.987061 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1944/3881] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:30:27 2022] POST /identity/v3/projects => generated 349 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:27.987683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a39372-583d-42e6-ac7a-ae5c323fe5a5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:27.988883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c1a39372-583d-42e6-ac7a-ae5c323fe5a5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:28.002955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a39372-583d-42e6-ac7a-ae5c323fe5a5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:28.066812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d6261-7331-453e-ab59-16cd2c32b087 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:28.067481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d6261-7331-453e-ab59-16cd2c32b087 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:28.067771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d6261-7331-453e-ab59-16cd2c32b087 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:28.068054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d6261-7331-453e-ab59-16cd2c32b087 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:28.068865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d6261-7331-453e-ab59-16cd2c32b087 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:30:28.069180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d6261-7331-453e-ab59-16cd2c32b087 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:28.071047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d6261-7331-453e-ab59-16cd2c32b087 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:28.092645 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1938/3882] 10.222.0.16 () {58 vars in 1159 bytes} [Mon May 2 10:30:27 2022] GET /identity/v3/projects?is_domain=True => generated 1021 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:30:28.097431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d7e79-d73b-4f56-a00e-56b3d14ea05c tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:28.128654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d7e79-d73b-4f56-a00e-56b3d14ea05c tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:28.134584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346c26f-f69f-42a8-b1d5-e6313f5a04d8 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:28.141313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346c26f-f69f-42a8-b1d5-e6313f5a04d8 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:28.141614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346c26f-f69f-42a8-b1d5-e6313f5a04d8 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:28.141986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346c26f-f69f-42a8-b1d5-e6313f5a04d8 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:28.142632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346c26f-f69f-42a8-b1d5-e6313f5a04d8 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:28.144277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346c26f-f69f-42a8-b1d5-e6313f5a04d8 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:28.172349 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1945/3883] 10.222.0.16 () {58 vars in 1127 bytes} [Mon May 2 10:30:28 2022] GET /identity/v3/domains => generated 830 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:30:28.174104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d6261-7331-453e-ab59-16cd2c32b087 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:28.189658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d6261-7331-453e-ab59-16cd2c32b087 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:28.194898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538359d-1c11-4b35-97ea-3ea0c8abf5bc tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:28.195878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538359d-1c11-4b35-97ea-3ea0c8abf5bc tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:28.196176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538359d-1c11-4b35-97ea-3ea0c8abf5bc tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:28.196459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538359d-1c11-4b35-97ea-3ea0c8abf5bc tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/c2e7505715a34fe1858f4bf013700b77` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:28.197849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538359d-1c11-4b35-97ea-3ea0c8abf5bc tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:update_project(project_id=c2e7505715a34fe1858f4bf013700b77)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:28.199474 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-f538359d-1c11-4b35-97ea-3ea0c8abf5bc tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:30:28.199474 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:30:28.199474 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:30:28.199964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538359d-1c11-4b35-97ea-3ea0c8abf5bc tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:28.214887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f538359d-1c11-4b35-97ea-3ea0c8abf5bc tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c2e7505715a34fe1858f4bf013700b77'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:28.214887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f538359d-1c11-4b35-97ea-3ea0c8abf5bc tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c2e7505715a34fe1858f4bf013700b77'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:28.302930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f538359d-1c11-4b35-97ea-3ea0c8abf5bc tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c2e7505715a34fe1858f4bf013700b77'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:28.303639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f538359d-1c11-4b35-97ea-3ea0c8abf5bc tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c2e7505715a34fe1858f4bf013700b77'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:28.308232 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1939/3884] 10.222.0.16 () {60 vars in 1251 bytes} [Mon May 2 10:30:28 2022] PATCH /identity/v3/projects/c2e7505715a34fe1858f4bf013700b77 => generated 363 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:30:28.312827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346c26f-f69f-42a8-b1d5-e6313f5a04d8 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:28.315212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e346c26f-f69f-42a8-b1d5-e6313f5a04d8 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:28.331701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346c26f-f69f-42a8-b1d5-e6313f5a04d8 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:28.415096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2de480-2c29-4f92-bca0-2d819d902151 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:28.416642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2de480-2c29-4f92-bca0-2d819d902151 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:28.416943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2de480-2c29-4f92-bca0-2d819d902151 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:28.417405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2de480-2c29-4f92-bca0-2d819d902151 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/c2e7505715a34fe1858f4bf013700b77` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:28.433692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2de480-2c29-4f92-bca0-2d819d902151 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c2e7505715a34fe1858f4bf013700b77)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:28.436697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2de480-2c29-4f92-bca0-2d819d902151 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:28.470269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cb2de480-2c29-4f92-bca0-2d819d902151 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c2e7505715a34fe1858f4bf013700b77'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:28.493694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cb2de480-2c29-4f92-bca0-2d819d902151 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c2e7505715a34fe1858f4bf013700b77'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:28.631964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cb2de480-2c29-4f92-bca0-2d819d902151 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2e7505715a34fe1858f4bf013700b77', 'request_id': 'req-cb2de480-2c29-4f92-bca0-2d819d902151'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:28.639534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cb2de480-2c29-4f92-bca0-2d819d902151 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2e7505715a34fe1858f4bf013700b77', 'request_id': 'req-cb2de480-2c29-4f92-bca0-2d819d902151'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:28.753918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cb2de480-2c29-4f92-bca0-2d819d902151 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2e7505715a34fe1858f4bf013700b77', 'request_id': 'req-cb2de480-2c29-4f92-bca0-2d819d902151'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:28.773738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cb2de480-2c29-4f92-bca0-2d819d902151 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] The token cache is being invalidate because project c2e7505715a34fe1858f4bf013700b77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:28.775352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cb2de480-2c29-4f92-bca0-2d819d902151 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:28.776107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cb2de480-2c29-4f92-bca0-2d819d902151 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:28.812326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cb2de480-2c29-4f92-bca0-2d819d902151 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c2e7505715a34fe1858f4bf013700b77', 'request_id': 'req-cb2de480-2c29-4f92-bca0-2d819d902151'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:28.826237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cb2de480-2c29-4f92-bca0-2d819d902151 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c2e7505715a34fe1858f4bf013700b77', 'request_id': 'req-cb2de480-2c29-4f92-bca0-2d819d902151'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:28.827007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cb2de480-2c29-4f92-bca0-2d819d902151 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c2e7505715a34fe1858f4bf013700b77', 'request_id': 'req-cb2de480-2c29-4f92-bca0-2d819d902151'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:28.835715 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1946/3885] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:28 2022] DELETE /identity/v3/projects/c2e7505715a34fe1858f4bf013700b77 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:30:28.843933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538359d-1c11-4b35-97ea-3ea0c8abf5bc tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:28.854606 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2de480-2c29-4f92-bca0-2d819d902151 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:28.861776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cb2de480-2c29-4f92-bca0-2d819d902151 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:28.866973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538359d-1c11-4b35-97ea-3ea0c8abf5bc tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:28.998883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2de480-2c29-4f92-bca0-2d819d902151 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:29.003838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb176032-cba6-45b0-b131-0cceb4028acc tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:29.004527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb176032-cba6-45b0-b131-0cceb4028acc tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:29.004839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb176032-cba6-45b0-b131-0cceb4028acc tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:29.005121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb176032-cba6-45b0-b131-0cceb4028acc tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:29.007510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb176032-cba6-45b0-b131-0cceb4028acc tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:29.010850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb176032-cba6-45b0-b131-0cceb4028acc tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:29.015085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37799113-e26e-4a77-8436-cecdfa943ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:29.017127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37799113-e26e-4a77-8436-cecdfa943ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:29.017599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37799113-e26e-4a77-8436-cecdfa943ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:29.018060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37799113-e26e-4a77-8436-cecdfa943ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:29.020250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-37799113-e26e-4a77-8436-cecdfa943ba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:29.038718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37799113-e26e-4a77-8436-cecdfa943ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:29.040684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37799113-e26e-4a77-8436-cecdfa943ba2 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:29.070959 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1947/3886] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:30:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:30:29.169346 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1940/3887] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:30:28 2022] POST /identity/v3/projects => generated 358 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:29.171609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37799113-e26e-4a77-8436-cecdfa943ba2 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:29.175541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-37799113-e26e-4a77-8436-cecdfa943ba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:29.199459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37799113-e26e-4a77-8436-cecdfa943ba2 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:29.276985 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa5415-abd3-49fb-9dc9-0b108c3cb7e5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:29.277894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa5415-abd3-49fb-9dc9-0b108c3cb7e5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:29.278185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa5415-abd3-49fb-9dc9-0b108c3cb7e5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:29.278756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa5415-abd3-49fb-9dc9-0b108c3cb7e5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/5141b4a4a86d4169bcc85468ac8db154` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:29.280194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa5415-abd3-49fb-9dc9-0b108c3cb7e5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:get_project(project_id=5141b4a4a86d4169bcc85468ac8db154)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:29.283263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa5415-abd3-49fb-9dc9-0b108c3cb7e5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:29.288189 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1948/3888] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:30:29 2022] GET /identity/v3/projects/5141b4a4a86d4169bcc85468ac8db154 => generated 358 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:30:29.289947 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb176032-cba6-45b0-b131-0cceb4028acc tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:29.309090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb176032-cba6-45b0-b131-0cceb4028acc tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:29.319433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde4337-5d60-43ca-aeef-47a9f4ffa74b tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:29.321402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde4337-5d60-43ca-aeef-47a9f4ffa74b tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:29.321816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde4337-5d60-43ca-aeef-47a9f4ffa74b tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:29.322234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde4337-5d60-43ca-aeef-47a9f4ffa74b tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/5141b4a4a86d4169bcc85468ac8db154` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:29.323868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde4337-5d60-43ca-aeef-47a9f4ffa74b tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5141b4a4a86d4169bcc85468ac8db154)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:29.327177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde4337-5d60-43ca-aeef-47a9f4ffa74b tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:29.541657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4fde4337-5d60-43ca-aeef-47a9f4ffa74b tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5141b4a4a86d4169bcc85468ac8db154', 'request_id': 'req-4fde4337-5d60-43ca-aeef-47a9f4ffa74b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:29.623140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4fde4337-5d60-43ca-aeef-47a9f4ffa74b tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5141b4a4a86d4169bcc85468ac8db154', 'request_id': 'req-4fde4337-5d60-43ca-aeef-47a9f4ffa74b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:29.634293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4fde4337-5d60-43ca-aeef-47a9f4ffa74b tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5141b4a4a86d4169bcc85468ac8db154', 'request_id': 'req-4fde4337-5d60-43ca-aeef-47a9f4ffa74b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:29.668749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4fde4337-5d60-43ca-aeef-47a9f4ffa74b tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] The token cache is being invalidate because project 5141b4a4a86d4169bcc85468ac8db154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:29.669187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4fde4337-5d60-43ca-aeef-47a9f4ffa74b tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:29.671182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4fde4337-5d60-43ca-aeef-47a9f4ffa74b tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:29.677956 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1941/3889] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:29 2022] DELETE /identity/v3/projects/5141b4a4a86d4169bcc85468ac8db154 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:29.685090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa5415-abd3-49fb-9dc9-0b108c3cb7e5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:29.690854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-83aa5415-abd3-49fb-9dc9-0b108c3cb7e5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:29.738027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa5415-abd3-49fb-9dc9-0b108c3cb7e5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:29.877408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e68254-cc48-46e5-86ff-493dc936a72f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:29.878509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e68254-cc48-46e5-86ff-493dc936a72f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:29.879897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e68254-cc48-46e5-86ff-493dc936a72f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:29.880509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e68254-cc48-46e5-86ff-493dc936a72f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:29.881786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e68254-cc48-46e5-86ff-493dc936a72f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:29.885337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e68254-cc48-46e5-86ff-493dc936a72f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:30.053559 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1949/3890] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:30:29 2022] POST /identity/v3/projects => generated 361 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:30.058229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde4337-5d60-43ca-aeef-47a9f4ffa74b tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:30.083186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde4337-5d60-43ca-aeef-47a9f4ffa74b tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:30.267040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825a4a0-4594-402d-9820-b5fa2f33e5b9 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:30.275119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825a4a0-4594-402d-9820-b5fa2f33e5b9 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:30.275119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825a4a0-4594-402d-9820-b5fa2f33e5b9 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:30.275119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825a4a0-4594-402d-9820-b5fa2f33e5b9 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/e1bb6be1061943399dff2f4e374629d0` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:30.275791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825a4a0-4594-402d-9820-b5fa2f33e5b9 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:get_project(project_id=e1bb6be1061943399dff2f4e374629d0)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:30.278108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825a4a0-4594-402d-9820-b5fa2f33e5b9 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:30.283314 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1942/3891] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:30:30 2022] GET /identity/v3/projects/e1bb6be1061943399dff2f4e374629d0 => generated 361 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:30:30.284744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e68254-cc48-46e5-86ff-493dc936a72f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:30.309952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e68254-cc48-46e5-86ff-493dc936a72f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:30.315434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dab6d9-69f3-45cb-9e5a-0d9604aeedc5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:30.315742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dab6d9-69f3-45cb-9e5a-0d9604aeedc5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:30.316025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dab6d9-69f3-45cb-9e5a-0d9604aeedc5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:30.316312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dab6d9-69f3-45cb-9e5a-0d9604aeedc5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/e1bb6be1061943399dff2f4e374629d0` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:30.318217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dab6d9-69f3-45cb-9e5a-0d9604aeedc5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e1bb6be1061943399dff2f4e374629d0)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:30.325241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dab6d9-69f3-45cb-9e5a-0d9604aeedc5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:30.695827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-79dab6d9-69f3-45cb-9e5a-0d9604aeedc5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1bb6be1061943399dff2f4e374629d0', 'request_id': 'req-79dab6d9-69f3-45cb-9e5a-0d9604aeedc5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:30.721165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-79dab6d9-69f3-45cb-9e5a-0d9604aeedc5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1bb6be1061943399dff2f4e374629d0', 'request_id': 'req-79dab6d9-69f3-45cb-9e5a-0d9604aeedc5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:30.849894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-79dab6d9-69f3-45cb-9e5a-0d9604aeedc5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1bb6be1061943399dff2f4e374629d0', 'request_id': 'req-79dab6d9-69f3-45cb-9e5a-0d9604aeedc5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:30.866682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-79dab6d9-69f3-45cb-9e5a-0d9604aeedc5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] The token cache is being invalidate because project e1bb6be1061943399dff2f4e374629d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:30.869953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-79dab6d9-69f3-45cb-9e5a-0d9604aeedc5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:30.876971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-79dab6d9-69f3-45cb-9e5a-0d9604aeedc5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:30.877745 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1950/3892] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:30 2022] DELETE /identity/v3/projects/e1bb6be1061943399dff2f4e374629d0 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:30.882442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825a4a0-4594-402d-9820-b5fa2f33e5b9 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:30.886528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a825a4a0-4594-402d-9820-b5fa2f33e5b9 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:30.918232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825a4a0-4594-402d-9820-b5fa2f33e5b9 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:31.142122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aed841-28d9-4bcc-be55-5a0234bb4b77 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:31.144844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aed841-28d9-4bcc-be55-5a0234bb4b77 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:31.146349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aed841-28d9-4bcc-be55-5a0234bb4b77 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:31.146869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aed841-28d9-4bcc-be55-5a0234bb4b77 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:31.153504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aed841-28d9-4bcc-be55-5a0234bb4b77 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:31.161790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aed841-28d9-4bcc-be55-5a0234bb4b77 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:31.351557 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1943/3893] 10.222.0.16 () {60 vars in 1151 bytes} [Mon May 2 10:30:30 2022] POST /identity/v3/projects => generated 347 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:31.355643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dab6d9-69f3-45cb-9e5a-0d9604aeedc5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:31.386703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dab6d9-69f3-45cb-9e5a-0d9604aeedc5 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:31.536489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f4c50-5acb-4a56-8b66-e7db2e048638 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:31.537462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f4c50-5acb-4a56-8b66-e7db2e048638 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:31.537925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f4c50-5acb-4a56-8b66-e7db2e048638 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:31.538777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f4c50-5acb-4a56-8b66-e7db2e048638 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/126eebca677b42a5a043dd0d4dc00c15` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:31.540201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f4c50-5acb-4a56-8b66-e7db2e048638 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:get_project(project_id=126eebca677b42a5a043dd0d4dc00c15)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:31.542903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f4c50-5acb-4a56-8b66-e7db2e048638 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:31.548759 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1951/3894] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:30:31 2022] GET /identity/v3/projects/126eebca677b42a5a043dd0d4dc00c15 => generated 347 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:30:31.551502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aed841-28d9-4bcc-be55-5a0234bb4b77 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:31.576374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aed841-28d9-4bcc-be55-5a0234bb4b77 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:31.589567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4eb18-09fd-49f3-a6b9-19926064616d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:31.590364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4eb18-09fd-49f3-a6b9-19926064616d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:31.593171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4eb18-09fd-49f3-a6b9-19926064616d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:31.593498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4eb18-09fd-49f3-a6b9-19926064616d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/126eebca677b42a5a043dd0d4dc00c15` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:31.598310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4eb18-09fd-49f3-a6b9-19926064616d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:delete_project(project_id=126eebca677b42a5a043dd0d4dc00c15)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:31.604861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4eb18-09fd-49f3-a6b9-19926064616d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:31.794373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69c4eb18-09fd-49f3-a6b9-19926064616d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '126eebca677b42a5a043dd0d4dc00c15', 'request_id': 'req-69c4eb18-09fd-49f3-a6b9-19926064616d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:31.924962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69c4eb18-09fd-49f3-a6b9-19926064616d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '126eebca677b42a5a043dd0d4dc00c15', 'request_id': 'req-69c4eb18-09fd-49f3-a6b9-19926064616d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:31.941839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69c4eb18-09fd-49f3-a6b9-19926064616d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '126eebca677b42a5a043dd0d4dc00c15', 'request_id': 'req-69c4eb18-09fd-49f3-a6b9-19926064616d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:31.963413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69c4eb18-09fd-49f3-a6b9-19926064616d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] The token cache is being invalidate because project 126eebca677b42a5a043dd0d4dc00c15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:31.963723 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69c4eb18-09fd-49f3-a6b9-19926064616d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:31.965167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69c4eb18-09fd-49f3-a6b9-19926064616d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:31.967082 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1944/3895] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:31 2022] DELETE /identity/v3/projects/126eebca677b42a5a043dd0d4dc00c15 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:31.972708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f4c50-5acb-4a56-8b66-e7db2e048638 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:31.975118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d83f4c50-5acb-4a56-8b66-e7db2e048638 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:32.000340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f4c50-5acb-4a56-8b66-e7db2e048638 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:32.175978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d0c64-5777-4dc9-b002-f07763a67cbe tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:32.178603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d0c64-5777-4dc9-b002-f07763a67cbe tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:32.178877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d0c64-5777-4dc9-b002-f07763a67cbe tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:32.180174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d0c64-5777-4dc9-b002-f07763a67cbe tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:32.182806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d0c64-5777-4dc9-b002-f07763a67cbe tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:32.192462 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-426d0c64-5777-4dc9-b002-f07763a67cbe tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:30:32.192462 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:30:32.192462 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:30:32.193836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d0c64-5777-4dc9-b002-f07763a67cbe tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:32.288756 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1952/3896] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:30:31 2022] POST /identity/v3/domains => generated 275 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:32.292834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4eb18-09fd-49f3-a6b9-19926064616d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:32.333339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4eb18-09fd-49f3-a6b9-19926064616d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:32.542771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08148728-a098-4009-92ef-6f92a9dfe94b tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:32.545859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08148728-a098-4009-92ef-6f92a9dfe94b tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:32.546386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08148728-a098-4009-92ef-6f92a9dfe94b tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:32.547586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08148728-a098-4009-92ef-6f92a9dfe94b tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:32.549819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08148728-a098-4009-92ef-6f92a9dfe94b tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:32.562359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08148728-a098-4009-92ef-6f92a9dfe94b tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:32.733959 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1945/3897] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:30:32 2022] POST /identity/v3/projects => generated 404 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:32.738416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d0c64-5777-4dc9-b002-f07763a67cbe tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:32.761584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d0c64-5777-4dc9-b002-f07763a67cbe tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:32.993554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5b44b-1601-43ef-adab-e2bb23d40f59 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:32.994456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5b44b-1601-43ef-adab-e2bb23d40f59 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:32.994747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5b44b-1601-43ef-adab-e2bb23d40f59 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:32.995028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5b44b-1601-43ef-adab-e2bb23d40f59 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/f6c4571afd9b47359ed872331701b009` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:32.998545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5b44b-1601-43ef-adab-e2bb23d40f59 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:get_project(project_id=f6c4571afd9b47359ed872331701b009)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:33.004467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5b44b-1601-43ef-adab-e2bb23d40f59 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:33.015185 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1953/3898] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:30:32 2022] GET /identity/v3/projects/f6c4571afd9b47359ed872331701b009 => generated 404 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:30:33.018884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08148728-a098-4009-92ef-6f92a9dfe94b tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:33.041878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08148728-a098-4009-92ef-6f92a9dfe94b tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:33.058391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cba08-a9c9-4f81-b9dd-a1274f72fc9d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:33.059300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cba08-a9c9-4f81-b9dd-a1274f72fc9d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:33.072171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cba08-a9c9-4f81-b9dd-a1274f72fc9d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:33.072171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cba08-a9c9-4f81-b9dd-a1274f72fc9d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/f6c4571afd9b47359ed872331701b009` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:33.076363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241cba08-a9c9-4f81-b9dd-a1274f72fc9d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f6c4571afd9b47359ed872331701b009)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:33.077216 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241cba08-a9c9-4f81-b9dd-a1274f72fc9d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:33.340930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-241cba08-a9c9-4f81-b9dd-a1274f72fc9d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6c4571afd9b47359ed872331701b009', 'request_id': 'req-241cba08-a9c9-4f81-b9dd-a1274f72fc9d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:33.486400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-241cba08-a9c9-4f81-b9dd-a1274f72fc9d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6c4571afd9b47359ed872331701b009', 'request_id': 'req-241cba08-a9c9-4f81-b9dd-a1274f72fc9d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:33.497306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-241cba08-a9c9-4f81-b9dd-a1274f72fc9d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6c4571afd9b47359ed872331701b009', 'request_id': 'req-241cba08-a9c9-4f81-b9dd-a1274f72fc9d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:33.541146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-241cba08-a9c9-4f81-b9dd-a1274f72fc9d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] The token cache is being invalidate because project f6c4571afd9b47359ed872331701b009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:33.541772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-241cba08-a9c9-4f81-b9dd-a1274f72fc9d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:33.545987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-241cba08-a9c9-4f81-b9dd-a1274f72fc9d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:33.552982 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1946/3899] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:33 2022] DELETE /identity/v3/projects/f6c4571afd9b47359ed872331701b009 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:33.563208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5b44b-1601-43ef-adab-e2bb23d40f59 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:33.563208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f8c5b44b-1601-43ef-adab-e2bb23d40f59 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:33.621276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5b44b-1601-43ef-adab-e2bb23d40f59 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:33.781976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c0bb8-1139-4cb5-b10e-96cc200859ad tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:33.785311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c0bb8-1139-4cb5-b10e-96cc200859ad tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:33.785311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c0bb8-1139-4cb5-b10e-96cc200859ad tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:33.785311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c0bb8-1139-4cb5-b10e-96cc200859ad tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/domains/08c3fbde1f8942c2a871b62cf940089e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:33.787913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c0bb8-1139-4cb5-b10e-96cc200859ad tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=08c3fbde1f8942c2a871b62cf940089e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:33.790126 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-4c0c0bb8-1139-4cb5-b10e-96cc200859ad tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:30:33.790126 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:30:33.790126 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:30:33.796981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c0bb8-1139-4cb5-b10e-96cc200859ad tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:33.862045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4c0c0bb8-1139-4cb5-b10e-96cc200859ad tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '08c3fbde1f8942c2a871b62cf940089e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:33.863148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4c0c0bb8-1139-4cb5-b10e-96cc200859ad tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '08c3fbde1f8942c2a871b62cf940089e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:33.966990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4c0c0bb8-1139-4cb5-b10e-96cc200859ad tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '08c3fbde1f8942c2a871b62cf940089e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:33.966990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4c0c0bb8-1139-4cb5-b10e-96cc200859ad tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '08c3fbde1f8942c2a871b62cf940089e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:33.971896 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1954/3900] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:30:33 2022] PATCH /identity/v3/domains/08c3fbde1f8942c2a871b62cf940089e => generated 276 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:30:33.974319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cba08-a9c9-4f81-b9dd-a1274f72fc9d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:33.995570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cba08-a9c9-4f81-b9dd-a1274f72fc9d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:34.165178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b75da0-76b7-4034-9b4e-0b59a081e522 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:34.168313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b75da0-76b7-4034-9b4e-0b59a081e522 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:34.168424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b75da0-76b7-4034-9b4e-0b59a081e522 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:34.168808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b75da0-76b7-4034-9b4e-0b59a081e522 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/domains/08c3fbde1f8942c2a871b62cf940089e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:34.190029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b75da0-76b7-4034-9b4e-0b59a081e522 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=08c3fbde1f8942c2a871b62cf940089e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:34.191906 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-69b75da0-76b7-4034-9b4e-0b59a081e522 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:30:34.191906 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:30:34.191906 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:30:34.193376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b75da0-76b7-4034-9b4e-0b59a081e522 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:34.237295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69b75da0-76b7-4034-9b4e-0b59a081e522 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '08c3fbde1f8942c2a871b62cf940089e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:34.251138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69b75da0-76b7-4034-9b4e-0b59a081e522 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '08c3fbde1f8942c2a871b62cf940089e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:34.483037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69b75da0-76b7-4034-9b4e-0b59a081e522 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08c3fbde1f8942c2a871b62cf940089e', 'request_id': 'req-69b75da0-76b7-4034-9b4e-0b59a081e522'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:34.575375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69b75da0-76b7-4034-9b4e-0b59a081e522 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08c3fbde1f8942c2a871b62cf940089e', 'request_id': 'req-69b75da0-76b7-4034-9b4e-0b59a081e522'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:34.595790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69b75da0-76b7-4034-9b4e-0b59a081e522 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08c3fbde1f8942c2a871b62cf940089e', 'request_id': 'req-69b75da0-76b7-4034-9b4e-0b59a081e522'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:34.626244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69b75da0-76b7-4034-9b4e-0b59a081e522 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] The token cache is being invalidate because project 08c3fbde1f8942c2a871b62cf940089e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:34.627661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69b75da0-76b7-4034-9b4e-0b59a081e522 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:34.630823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69b75da0-76b7-4034-9b4e-0b59a081e522 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:34.677284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69b75da0-76b7-4034-9b4e-0b59a081e522 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '08c3fbde1f8942c2a871b62cf940089e', 'request_id': 'req-69b75da0-76b7-4034-9b4e-0b59a081e522'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:34.679719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69b75da0-76b7-4034-9b4e-0b59a081e522 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '08c3fbde1f8942c2a871b62cf940089e', 'request_id': 'req-69b75da0-76b7-4034-9b4e-0b59a081e522'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:34.689851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69b75da0-76b7-4034-9b4e-0b59a081e522 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '08c3fbde1f8942c2a871b62cf940089e', 'request_id': 'req-69b75da0-76b7-4034-9b4e-0b59a081e522'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:34.704550 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1947/3901] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:30:33 2022] DELETE /identity/v3/domains/08c3fbde1f8942c2a871b62cf940089e => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:34.711400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c0bb8-1139-4cb5-b10e-96cc200859ad tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:34.713173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4c0c0bb8-1139-4cb5-b10e-96cc200859ad tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:34.736389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c0bb8-1139-4cb5-b10e-96cc200859ad tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:34.888348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3aa615-06b9-489b-bd66-b0955be35749 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:34.903510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3aa615-06b9-489b-bd66-b0955be35749 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:34.904343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3aa615-06b9-489b-bd66-b0955be35749 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:34.904892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3aa615-06b9-489b-bd66-b0955be35749 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:34.906454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3aa615-06b9-489b-bd66-b0955be35749 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:34.908406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3aa615-06b9-489b-bd66-b0955be35749 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:34.998005 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1955/3902] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:30:34 2022] POST /identity/v3/domains => generated 276 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:34.998998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b75da0-76b7-4034-9b4e-0b59a081e522 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:35.001566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-69b75da0-76b7-4034-9b4e-0b59a081e522 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:35.071320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b75da0-76b7-4034-9b4e-0b59a081e522 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:35.259617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33ebaf-0c18-4c6b-a952-317a54de233d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:35.260043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33ebaf-0c18-4c6b-a952-317a54de233d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:35.264218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33ebaf-0c18-4c6b-a952-317a54de233d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:35.264218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33ebaf-0c18-4c6b-a952-317a54de233d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:35.264970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33ebaf-0c18-4c6b-a952-317a54de233d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:35.278369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33ebaf-0c18-4c6b-a952-317a54de233d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:35.434872 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1948/3903] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:30:34 2022] POST /identity/v3/projects => generated 408 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:35.443234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3aa615-06b9-489b-bd66-b0955be35749 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:35.460656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3aa615-06b9-489b-bd66-b0955be35749 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:35.622652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5209b-109a-41fc-a280-ad6f76bb07b2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:35.626199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5209b-109a-41fc-a280-ad6f76bb07b2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:35.626199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5209b-109a-41fc-a280-ad6f76bb07b2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:35.626199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5209b-109a-41fc-a280-ad6f76bb07b2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:35.626199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5209b-109a-41fc-a280-ad6f76bb07b2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:35.638558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5209b-109a-41fc-a280-ad6f76bb07b2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:35.845136 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1956/3904] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:30:35 2022] POST /identity/v3/projects => generated 403 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:35.850113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33ebaf-0c18-4c6b-a952-317a54de233d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:35.865303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33ebaf-0c18-4c6b-a952-317a54de233d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:36.066845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f3678-aa4d-4b21-a9d4-83aca42693c2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:36.068794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f3678-aa4d-4b21-a9d4-83aca42693c2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:36.069086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f3678-aa4d-4b21-a9d4-83aca42693c2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:36.069367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f3678-aa4d-4b21-a9d4-83aca42693c2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/f5bc376e114346b7a99b9a974b9bda21` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:36.071011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f3678-aa4d-4b21-a9d4-83aca42693c2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f5bc376e114346b7a99b9a974b9bda21)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:36.077247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f3678-aa4d-4b21-a9d4-83aca42693c2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:36.332102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c34f3678-aa4d-4b21-a9d4-83aca42693c2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5bc376e114346b7a99b9a974b9bda21', 'request_id': 'req-c34f3678-aa4d-4b21-a9d4-83aca42693c2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:36.467579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c34f3678-aa4d-4b21-a9d4-83aca42693c2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5bc376e114346b7a99b9a974b9bda21', 'request_id': 'req-c34f3678-aa4d-4b21-a9d4-83aca42693c2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:36.483359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c34f3678-aa4d-4b21-a9d4-83aca42693c2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5bc376e114346b7a99b9a974b9bda21', 'request_id': 'req-c34f3678-aa4d-4b21-a9d4-83aca42693c2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:36.523502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c34f3678-aa4d-4b21-a9d4-83aca42693c2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] The token cache is being invalidate because project f5bc376e114346b7a99b9a974b9bda21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:36.525675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c34f3678-aa4d-4b21-a9d4-83aca42693c2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:36.533452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c34f3678-aa4d-4b21-a9d4-83aca42693c2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:36.540795 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1949/3905] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:35 2022] DELETE /identity/v3/projects/f5bc376e114346b7a99b9a974b9bda21 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:36.544960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5209b-109a-41fc-a280-ad6f76bb07b2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:36.546900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f6e5209b-109a-41fc-a280-ad6f76bb07b2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:36.578572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5209b-109a-41fc-a280-ad6f76bb07b2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:36.748705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79796889-dc9d-4d42-ae49-ca910de1dbce tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:36.750449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79796889-dc9d-4d42-ae49-ca910de1dbce tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:36.750743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79796889-dc9d-4d42-ae49-ca910de1dbce tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:36.751025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79796889-dc9d-4d42-ae49-ca910de1dbce tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/09acd44d634d4f99b9dd603cf9f31f67` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:36.758352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79796889-dc9d-4d42-ae49-ca910de1dbce tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:delete_project(project_id=09acd44d634d4f99b9dd603cf9f31f67)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:36.765913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79796889-dc9d-4d42-ae49-ca910de1dbce tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:36.982308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-79796889-dc9d-4d42-ae49-ca910de1dbce tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09acd44d634d4f99b9dd603cf9f31f67', 'request_id': 'req-79796889-dc9d-4d42-ae49-ca910de1dbce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:36.997219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-79796889-dc9d-4d42-ae49-ca910de1dbce tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09acd44d634d4f99b9dd603cf9f31f67', 'request_id': 'req-79796889-dc9d-4d42-ae49-ca910de1dbce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:37.078860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-79796889-dc9d-4d42-ae49-ca910de1dbce tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09acd44d634d4f99b9dd603cf9f31f67', 'request_id': 'req-79796889-dc9d-4d42-ae49-ca910de1dbce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:37.093999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-79796889-dc9d-4d42-ae49-ca910de1dbce tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] The token cache is being invalidate because project 09acd44d634d4f99b9dd603cf9f31f67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:37.094477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-79796889-dc9d-4d42-ae49-ca910de1dbce tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:37.095504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-79796889-dc9d-4d42-ae49-ca910de1dbce tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:37.102216 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f3678-aa4d-4b21-a9d4-83aca42693c2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:37.119176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f3678-aa4d-4b21-a9d4-83aca42693c2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:37.127557 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1957/3906] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:36 2022] DELETE /identity/v3/projects/09acd44d634d4f99b9dd603cf9f31f67 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:37.322559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981b839-76e8-4af4-9ef2-300f4cc4ba15 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:37.326654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981b839-76e8-4af4-9ef2-300f4cc4ba15 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:37.333626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981b839-76e8-4af4-9ef2-300f4cc4ba15 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:37.333626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981b839-76e8-4af4-9ef2-300f4cc4ba15 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/domains/829c7bb7dbec42ceb4a849f74a23499b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:37.333626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981b839-76e8-4af4-9ef2-300f4cc4ba15 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=829c7bb7dbec42ceb4a849f74a23499b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:37.338944 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-7981b839-76e8-4af4-9ef2-300f4cc4ba15 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:30:37.338944 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:30:37.338944 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:30:37.339877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981b839-76e8-4af4-9ef2-300f4cc4ba15 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:37.391132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7981b839-76e8-4af4-9ef2-300f4cc4ba15 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '829c7bb7dbec42ceb4a849f74a23499b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:37.401182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7981b839-76e8-4af4-9ef2-300f4cc4ba15 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '829c7bb7dbec42ceb4a849f74a23499b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:37.504341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7981b839-76e8-4af4-9ef2-300f4cc4ba15 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '829c7bb7dbec42ceb4a849f74a23499b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:37.507236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7981b839-76e8-4af4-9ef2-300f4cc4ba15 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '829c7bb7dbec42ceb4a849f74a23499b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:37.511812 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1950/3907] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:30:37 2022] PATCH /identity/v3/domains/829c7bb7dbec42ceb4a849f74a23499b => generated 277 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:30:37.517294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79796889-dc9d-4d42-ae49-ca910de1dbce tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:37.520592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-79796889-dc9d-4d42-ae49-ca910de1dbce tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:37.601831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79796889-dc9d-4d42-ae49-ca910de1dbce tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:37.921151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a772e-994c-4dca-9395-accb8a7bf9da tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:37.931022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a772e-994c-4dca-9395-accb8a7bf9da tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:37.933851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a772e-994c-4dca-9395-accb8a7bf9da tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:37.934783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a772e-994c-4dca-9395-accb8a7bf9da tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/domains/829c7bb7dbec42ceb4a849f74a23499b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:37.973159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a772e-994c-4dca-9395-accb8a7bf9da tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=829c7bb7dbec42ceb4a849f74a23499b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:37.981776 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-149a772e-994c-4dca-9395-accb8a7bf9da tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:30:37.981776 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:30:37.981776 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:30:37.985304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a772e-994c-4dca-9395-accb8a7bf9da tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:38.053736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-149a772e-994c-4dca-9395-accb8a7bf9da tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '829c7bb7dbec42ceb4a849f74a23499b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:38.096447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-149a772e-994c-4dca-9395-accb8a7bf9da tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '829c7bb7dbec42ceb4a849f74a23499b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:38.267613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-149a772e-994c-4dca-9395-accb8a7bf9da tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '829c7bb7dbec42ceb4a849f74a23499b', 'request_id': 'req-149a772e-994c-4dca-9395-accb8a7bf9da'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:38.282734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-149a772e-994c-4dca-9395-accb8a7bf9da tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '829c7bb7dbec42ceb4a849f74a23499b', 'request_id': 'req-149a772e-994c-4dca-9395-accb8a7bf9da'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:38.380361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-149a772e-994c-4dca-9395-accb8a7bf9da tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '829c7bb7dbec42ceb4a849f74a23499b', 'request_id': 'req-149a772e-994c-4dca-9395-accb8a7bf9da'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:38.410757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-149a772e-994c-4dca-9395-accb8a7bf9da tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] The token cache is being invalidate because project 829c7bb7dbec42ceb4a849f74a23499b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:38.412483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-149a772e-994c-4dca-9395-accb8a7bf9da tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:38.416217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-149a772e-994c-4dca-9395-accb8a7bf9da tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:38.445322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-149a772e-994c-4dca-9395-accb8a7bf9da tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '829c7bb7dbec42ceb4a849f74a23499b', 'request_id': 'req-149a772e-994c-4dca-9395-accb8a7bf9da'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:38.455150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-149a772e-994c-4dca-9395-accb8a7bf9da tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '829c7bb7dbec42ceb4a849f74a23499b', 'request_id': 'req-149a772e-994c-4dca-9395-accb8a7bf9da'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:38.459802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-149a772e-994c-4dca-9395-accb8a7bf9da tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '829c7bb7dbec42ceb4a849f74a23499b', 'request_id': 'req-149a772e-994c-4dca-9395-accb8a7bf9da'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:38.475117 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1958/3908] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:30:37 2022] DELETE /identity/v3/domains/829c7bb7dbec42ceb4a849f74a23499b => generated 0 bytes in 959 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:38.479942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981b839-76e8-4af4-9ef2-300f4cc4ba15 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:38.486188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7981b839-76e8-4af4-9ef2-300f4cc4ba15 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:38.537861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981b839-76e8-4af4-9ef2-300f4cc4ba15 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:38.658240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01dbe7c-3fb6-4d8c-8848-04962d35c532 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:38.659356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01dbe7c-3fb6-4d8c-8848-04962d35c532 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:38.659724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01dbe7c-3fb6-4d8c-8848-04962d35c532 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:38.660084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01dbe7c-3fb6-4d8c-8848-04962d35c532 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:38.662367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01dbe7c-3fb6-4d8c-8848-04962d35c532 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:38.669959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01dbe7c-3fb6-4d8c-8848-04962d35c532 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:38.802990 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1951/3909] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:30:38 2022] POST /identity/v3/projects => generated 376 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:38.804355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a772e-994c-4dca-9395-accb8a7bf9da tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:38.810105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-149a772e-994c-4dca-9395-accb8a7bf9da tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:38.851103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a772e-994c-4dca-9395-accb8a7bf9da tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:38.928238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1eebc9-8415-4fa7-a75d-943d6b5d9906 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:38.928238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eebc9-8415-4fa7-a75d-943d6b5d9906 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:38.928238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eebc9-8415-4fa7-a75d-943d6b5d9906 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:38.928632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eebc9-8415-4fa7-a75d-943d6b5d9906 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/6339f726d6ef4c6cab66b31c8cb20bb6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:38.930148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1eebc9-8415-4fa7-a75d-943d6b5d9906 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:get_project(project_id=6339f726d6ef4c6cab66b31c8cb20bb6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:38.932767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1eebc9-8415-4fa7-a75d-943d6b5d9906 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:38.939982 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1959/3910] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:30:38 2022] GET /identity/v3/projects/6339f726d6ef4c6cab66b31c8cb20bb6 => generated 376 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:30:38.941155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01dbe7c-3fb6-4d8c-8848-04962d35c532 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:38.959581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01dbe7c-3fb6-4d8c-8848-04962d35c532 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:38.968594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982dfe9-2d4d-434d-b640-f0b62481ceb3 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:38.969539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982dfe9-2d4d-434d-b640-f0b62481ceb3 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:38.970008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982dfe9-2d4d-434d-b640-f0b62481ceb3 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:38.970458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982dfe9-2d4d-434d-b640-f0b62481ceb3 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:38.971377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982dfe9-2d4d-434d-b640-f0b62481ceb3 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:38.976041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982dfe9-2d4d-434d-b640-f0b62481ceb3 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:39.017603 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1952/3911] 10.222.0.16 () {58 vars in 1130 bytes} [Mon May 2 10:30:38 2022] GET /identity/v3/projects => generated 6555 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:30:39.020816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1eebc9-8415-4fa7-a75d-943d6b5d9906 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:39.038129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1eebc9-8415-4fa7-a75d-943d6b5d9906 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:39.043320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b8d0d-6459-4651-bae3-d1d593e5e732 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:39.044176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b8d0d-6459-4651-bae3-d1d593e5e732 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:39.044462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b8d0d-6459-4651-bae3-d1d593e5e732 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:39.044788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b8d0d-6459-4651-bae3-d1d593e5e732 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/6339f726d6ef4c6cab66b31c8cb20bb6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:39.046162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b8d0d-6459-4651-bae3-d1d593e5e732 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6339f726d6ef4c6cab66b31c8cb20bb6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:39.048947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b8d0d-6459-4651-bae3-d1d593e5e732 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:39.211681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2c7b8d0d-6459-4651-bae3-d1d593e5e732 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6339f726d6ef4c6cab66b31c8cb20bb6', 'request_id': 'req-2c7b8d0d-6459-4651-bae3-d1d593e5e732'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:39.223613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2c7b8d0d-6459-4651-bae3-d1d593e5e732 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6339f726d6ef4c6cab66b31c8cb20bb6', 'request_id': 'req-2c7b8d0d-6459-4651-bae3-d1d593e5e732'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:39.280902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982dfe9-2d4d-434d-b640-f0b62481ceb3 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:39.285200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4982dfe9-2d4d-434d-b640-f0b62481ceb3 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:39.291114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2c7b8d0d-6459-4651-bae3-d1d593e5e732 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6339f726d6ef4c6cab66b31c8cb20bb6', 'request_id': 'req-2c7b8d0d-6459-4651-bae3-d1d593e5e732'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:39.320865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2c7b8d0d-6459-4651-bae3-d1d593e5e732 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] The token cache is being invalidate because project 6339f726d6ef4c6cab66b31c8cb20bb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:39.321100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2c7b8d0d-6459-4651-bae3-d1d593e5e732 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:39.322030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2c7b8d0d-6459-4651-bae3-d1d593e5e732 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:39.331983 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1960/3912] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:39 2022] DELETE /identity/v3/projects/6339f726d6ef4c6cab66b31c8cb20bb6 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:39.335158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b8d0d-6459-4651-bae3-d1d593e5e732 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:39.338789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2c7b8d0d-6459-4651-bae3-d1d593e5e732 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:39.459097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b8d0d-6459-4651-bae3-d1d593e5e732 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:39.473900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982dfe9-2d4d-434d-b640-f0b62481ceb3 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:39.478048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06201c2-6471-4313-a938-b5f071828256 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:39.479289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06201c2-6471-4313-a938-b5f071828256 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:39.479289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06201c2-6471-4313-a938-b5f071828256 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:39.479289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06201c2-6471-4313-a938-b5f071828256 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:39.480140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06201c2-6471-4313-a938-b5f071828256 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:39.486302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06201c2-6471-4313-a938-b5f071828256 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:39.581505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1241dd-070c-41e3-8907-40e018fde164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:39.582182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1241dd-070c-41e3-8907-40e018fde164 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:39.582588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1241dd-070c-41e3-8907-40e018fde164 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:39.583272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1241dd-070c-41e3-8907-40e018fde164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:39.587213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-cd1241dd-070c-41e3-8907-40e018fde164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:39.647057 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1961/3913] 10.222.0.16 () {60 vars in 1151 bytes} [Mon May 2 10:30:39 2022] POST /identity/v3/projects => generated 347 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:39.666948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06201c2-6471-4313-a938-b5f071828256 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:39.717166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1241dd-070c-41e3-8907-40e018fde164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:39.719511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1241dd-070c-41e3-8907-40e018fde164 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:39.758639 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1953/3914] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:30:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:30:39.853502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06201c2-6471-4313-a938-b5f071828256 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:39.873620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba1554-bf5c-4e5c-97e5-6476ee89212d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:39.874684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba1554-bf5c-4e5c-97e5-6476ee89212d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:39.875302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba1554-bf5c-4e5c-97e5-6476ee89212d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:39.876745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba1554-bf5c-4e5c-97e5-6476ee89212d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/01035805aa7f4490852f2cb974713840` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:39.877533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba1554-bf5c-4e5c-97e5-6476ee89212d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:update_project(project_id=01035805aa7f4490852f2cb974713840)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:39.878985 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-cbba1554-bf5c-4e5c-97e5-6476ee89212d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:30:39.878985 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:30:39.878985 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:30:39.886038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba1554-bf5c-4e5c-97e5-6476ee89212d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:40.074816 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1962/3915] 10.222.0.16 () {60 vars in 1251 bytes} [Mon May 2 10:30:39 2022] PATCH /identity/v3/projects/01035805aa7f4490852f2cb974713840 => generated 356 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:30:40.081628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1241dd-070c-41e3-8907-40e018fde164 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:40.108774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1241dd-070c-41e3-8907-40e018fde164 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:40.126441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98253d-2e59-4a19-b803-cc0a46d16a34 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:40.127635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98253d-2e59-4a19-b803-cc0a46d16a34 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:40.128369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98253d-2e59-4a19-b803-cc0a46d16a34 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:40.128876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98253d-2e59-4a19-b803-cc0a46d16a34 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/01035805aa7f4490852f2cb974713840` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:40.160069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98253d-2e59-4a19-b803-cc0a46d16a34 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:get_project(project_id=01035805aa7f4490852f2cb974713840)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:40.164629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98253d-2e59-4a19-b803-cc0a46d16a34 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:40.174687 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1954/3916] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:30:40 2022] GET /identity/v3/projects/01035805aa7f4490852f2cb974713840 => generated 343 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:30:40.175722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba1554-bf5c-4e5c-97e5-6476ee89212d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:40.200910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba1554-bf5c-4e5c-97e5-6476ee89212d tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:40.234829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9904b-38f4-4ebf-bac2-a3bb7f51e1f2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:40.239245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9904b-38f4-4ebf-bac2-a3bb7f51e1f2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:40.239811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9904b-38f4-4ebf-bac2-a3bb7f51e1f2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:40.240345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9904b-38f4-4ebf-bac2-a3bb7f51e1f2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/01035805aa7f4490852f2cb974713840` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:40.242408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9904b-38f4-4ebf-bac2-a3bb7f51e1f2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:delete_project(project_id=01035805aa7f4490852f2cb974713840)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:40.246509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9904b-38f4-4ebf-bac2-a3bb7f51e1f2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:40.506014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-78d9904b-38f4-4ebf-bac2-a3bb7f51e1f2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01035805aa7f4490852f2cb974713840', 'request_id': 'req-78d9904b-38f4-4ebf-bac2-a3bb7f51e1f2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:40.527136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-78d9904b-38f4-4ebf-bac2-a3bb7f51e1f2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01035805aa7f4490852f2cb974713840', 'request_id': 'req-78d9904b-38f4-4ebf-bac2-a3bb7f51e1f2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:40.639248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-78d9904b-38f4-4ebf-bac2-a3bb7f51e1f2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01035805aa7f4490852f2cb974713840', 'request_id': 'req-78d9904b-38f4-4ebf-bac2-a3bb7f51e1f2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:40.663714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-78d9904b-38f4-4ebf-bac2-a3bb7f51e1f2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] The token cache is being invalidate because project 01035805aa7f4490852f2cb974713840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:40.664280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-78d9904b-38f4-4ebf-bac2-a3bb7f51e1f2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:40.665826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-78d9904b-38f4-4ebf-bac2-a3bb7f51e1f2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:40.667786 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1963/3917] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:40 2022] DELETE /identity/v3/projects/01035805aa7f4490852f2cb974713840 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:40.673505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98253d-2e59-4a19-b803-cc0a46d16a34 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:40.677473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4c98253d-2e59-4a19-b803-cc0a46d16a34 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:40.713199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98253d-2e59-4a19-b803-cc0a46d16a34 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:40.843149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4006fc6-6f64-48f3-922c-65aee5c36252 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:40.843149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4006fc6-6f64-48f3-922c-65aee5c36252 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:40.843149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4006fc6-6f64-48f3-922c-65aee5c36252 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:40.843408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4006fc6-6f64-48f3-922c-65aee5c36252 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:40.843408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4006fc6-6f64-48f3-922c-65aee5c36252 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:40.846337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4006fc6-6f64-48f3-922c-65aee5c36252 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:40.976663 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1955/3918] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:30:40 2022] POST /identity/v3/projects => generated 359 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:40.981033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9904b-38f4-4ebf-bac2-a3bb7f51e1f2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:41.007530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9904b-38f4-4ebf-bac2-a3bb7f51e1f2 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:41.110748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c49f64-9559-415b-a40e-7ade8d96d11f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:41.132303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c49f64-9559-415b-a40e-7ade8d96d11f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:41.132956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c49f64-9559-415b-a40e-7ade8d96d11f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:41.133462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c49f64-9559-415b-a40e-7ade8d96d11f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/04799e7374664e36841bd33f7ed0bf84` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:41.135849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c49f64-9559-415b-a40e-7ade8d96d11f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:update_project(project_id=04799e7374664e36841bd33f7ed0bf84)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:41.141053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c49f64-9559-415b-a40e-7ade8d96d11f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:41.335674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4006fc6-6f64-48f3-922c-65aee5c36252 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:41.336727 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1964/3919] 10.222.0.16 () {60 vars in 1251 bytes} [Mon May 2 10:30:40 2022] PATCH /identity/v3/projects/04799e7374664e36841bd33f7ed0bf84 => generated 371 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:30:41.365949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4006fc6-6f64-48f3-922c-65aee5c36252 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:41.377373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9792ef3-3170-4872-995a-55ca84f0cf20 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:41.378271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9792ef3-3170-4872-995a-55ca84f0cf20 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:41.378558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9792ef3-3170-4872-995a-55ca84f0cf20 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:41.378837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9792ef3-3170-4872-995a-55ca84f0cf20 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/04799e7374664e36841bd33f7ed0bf84` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:41.405563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9792ef3-3170-4872-995a-55ca84f0cf20 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:get_project(project_id=04799e7374664e36841bd33f7ed0bf84)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:41.411158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9792ef3-3170-4872-995a-55ca84f0cf20 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:41.417611 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1956/3920] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:30:41 2022] GET /identity/v3/projects/04799e7374664e36841bd33f7ed0bf84 => generated 358 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:30:41.421697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c49f64-9559-415b-a40e-7ade8d96d11f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:41.439144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c49f64-9559-415b-a40e-7ade8d96d11f tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:41.450857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb3c3e-c5e5-46c8-9114-a5efdabea80e tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:41.451768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb3c3e-c5e5-46c8-9114-a5efdabea80e tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:41.452194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb3c3e-c5e5-46c8-9114-a5efdabea80e tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:41.456710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb3c3e-c5e5-46c8-9114-a5efdabea80e tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/04799e7374664e36841bd33f7ed0bf84` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:41.460322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb3c3e-c5e5-46c8-9114-a5efdabea80e tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:delete_project(project_id=04799e7374664e36841bd33f7ed0bf84)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:41.463399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb3c3e-c5e5-46c8-9114-a5efdabea80e tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:41.637110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53cb3c3e-c5e5-46c8-9114-a5efdabea80e tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04799e7374664e36841bd33f7ed0bf84', 'request_id': 'req-53cb3c3e-c5e5-46c8-9114-a5efdabea80e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:41.647157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53cb3c3e-c5e5-46c8-9114-a5efdabea80e tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04799e7374664e36841bd33f7ed0bf84', 'request_id': 'req-53cb3c3e-c5e5-46c8-9114-a5efdabea80e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:41.794025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53cb3c3e-c5e5-46c8-9114-a5efdabea80e tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04799e7374664e36841bd33f7ed0bf84', 'request_id': 'req-53cb3c3e-c5e5-46c8-9114-a5efdabea80e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:41.842944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53cb3c3e-c5e5-46c8-9114-a5efdabea80e tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] The token cache is being invalidate because project 04799e7374664e36841bd33f7ed0bf84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:41.843869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53cb3c3e-c5e5-46c8-9114-a5efdabea80e tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:41.847245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53cb3c3e-c5e5-46c8-9114-a5efdabea80e tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:41.856729 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1965/3921] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:41 2022] DELETE /identity/v3/projects/04799e7374664e36841bd33f7ed0bf84 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:41.861527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9792ef3-3170-4872-995a-55ca84f0cf20 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:41.864291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e9792ef3-3170-4872-995a-55ca84f0cf20 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:41.896364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9792ef3-3170-4872-995a-55ca84f0cf20 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:42.009192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24001cdc-1c82-481a-9ff5-acf55278985c tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:42.010102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24001cdc-1c82-481a-9ff5-acf55278985c tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:42.011159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24001cdc-1c82-481a-9ff5-acf55278985c tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:42.011509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24001cdc-1c82-481a-9ff5-acf55278985c tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:42.012285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24001cdc-1c82-481a-9ff5-acf55278985c tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:42.017407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24001cdc-1c82-481a-9ff5-acf55278985c tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:42.170907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb3c3e-c5e5-46c8-9114-a5efdabea80e tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:42.173759 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1957/3922] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:30:41 2022] POST /identity/v3/projects => generated 354 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:42.194893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb3c3e-c5e5-46c8-9114-a5efdabea80e tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:42.413012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4d8ee-395c-4897-8f32-fffbeb7b7776 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:42.422766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4d8ee-395c-4897-8f32-fffbeb7b7776 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:42.423336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4d8ee-395c-4897-8f32-fffbeb7b7776 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:42.423981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4d8ee-395c-4897-8f32-fffbeb7b7776 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/d8224593d68d440b899e649032d4b8b8` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:42.425986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4d8ee-395c-4897-8f32-fffbeb7b7776 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:update_project(project_id=d8224593d68d440b899e649032d4b8b8)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:42.444326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4d8ee-395c-4897-8f32-fffbeb7b7776 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:42.711451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24001cdc-1c82-481a-9ff5-acf55278985c tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:42.712772 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1966/3923] 10.222.0.16 () {60 vars in 1251 bytes} [Mon May 2 10:30:42 2022] PATCH /identity/v3/projects/d8224593d68d440b899e649032d4b8b8 => generated 368 bytes in 537 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:30:42.739662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24001cdc-1c82-481a-9ff5-acf55278985c tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:42.745169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a9a44-dca9-4b13-a738-f5daaf6d5e74 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:42.746551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a9a44-dca9-4b13-a738-f5daaf6d5e74 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:42.747048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a9a44-dca9-4b13-a738-f5daaf6d5e74 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:42.747343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a9a44-dca9-4b13-a738-f5daaf6d5e74 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/d8224593d68d440b899e649032d4b8b8` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:42.767108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a9a44-dca9-4b13-a738-f5daaf6d5e74 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:get_project(project_id=d8224593d68d440b899e649032d4b8b8)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:42.770308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a9a44-dca9-4b13-a738-f5daaf6d5e74 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:42.777223 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1958/3924] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:30:42 2022] GET /identity/v3/projects/d8224593d68d440b899e649032d4b8b8 => generated 355 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:30:42.782797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4d8ee-395c-4897-8f32-fffbeb7b7776 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:42.798728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4d8ee-395c-4897-8f32-fffbeb7b7776 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:42.807471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72bfed-dc5a-402a-b788-4be4bfd38919 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:42.808940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72bfed-dc5a-402a-b788-4be4bfd38919 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:42.810827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72bfed-dc5a-402a-b788-4be4bfd38919 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:42.810827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72bfed-dc5a-402a-b788-4be4bfd38919 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/projects/d8224593d68d440b899e649032d4b8b8` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:42.811386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72bfed-dc5a-402a-b788-4be4bfd38919 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d8224593d68d440b899e649032d4b8b8)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:42.815925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72bfed-dc5a-402a-b788-4be4bfd38919 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:43.013059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5f72bfed-dc5a-402a-b788-4be4bfd38919 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8224593d68d440b899e649032d4b8b8', 'request_id': 'req-5f72bfed-dc5a-402a-b788-4be4bfd38919'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:43.036431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5f72bfed-dc5a-402a-b788-4be4bfd38919 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8224593d68d440b899e649032d4b8b8', 'request_id': 'req-5f72bfed-dc5a-402a-b788-4be4bfd38919'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:43.115417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5f72bfed-dc5a-402a-b788-4be4bfd38919 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8224593d68d440b899e649032d4b8b8', 'request_id': 'req-5f72bfed-dc5a-402a-b788-4be4bfd38919'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:43.150078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5f72bfed-dc5a-402a-b788-4be4bfd38919 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] The token cache is being invalidate because project d8224593d68d440b899e649032d4b8b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:43.150551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5f72bfed-dc5a-402a-b788-4be4bfd38919 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:43.151334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5f72bfed-dc5a-402a-b788-4be4bfd38919 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:43.153218 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1967/3925] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:42 2022] DELETE /identity/v3/projects/d8224593d68d440b899e649032d4b8b8 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:43.159069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a9a44-dca9-4b13-a738-f5daaf6d5e74 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:43.164372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d43a9a44-dca9-4b13-a738-f5daaf6d5e74 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:43.186099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a9a44-dca9-4b13-a738-f5daaf6d5e74 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:43.343704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb93a4-16ec-49dc-9533-f865d2066813 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:43.344898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb93a4-16ec-49dc-9533-f865d2066813 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:43.345328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb93a4-16ec-49dc-9533-f865d2066813 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:43.345932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb93a4-16ec-49dc-9533-f865d2066813 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/domains/829c7bb7dbec42ceb4a849f74a23499b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:43.367148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb93a4-16ec-49dc-9533-f865d2066813 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:30:43.385668 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-c3fb93a4-16ec-49dc-9533-f865d2066813 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Could not find domain: 829c7bb7dbec42ceb4a849f74a23499b.: keystone.exception.DomainNotFound: Could not find domain: 829c7bb7dbec42ceb4a849f74a23499b. May 02 10:30:43.385668 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:30:43.385668 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 02 10:30:43.385668 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 02 10:30:43.385668 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:30:43.385668 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:30:43.385668 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:30:43.385668 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:30:43.385668 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 829c7bb7dbec42ceb4a849f74a23499b. May 02 10:30:43.385668 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:30:43.385668 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:30:43.385668 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:30:43.385668 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:30:43.385668 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:30:43.385668 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:30:43.385668 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:30:43.386710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:30:43.386710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:30:43.386710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:30:43.386710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:30:43.386710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:30:43.386710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:30:43.386710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:30:43.386710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 02 10:30:43.386710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 02 10:30:43.386710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:30:43.386710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:30:43.386710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:30:43.386710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:30:43.386710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:30:43.386710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:30:43.386710 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:30:43.387573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:30:43.387573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:30:43.387573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:30:43.387573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:30:43.387573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:30:43.387573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:30:43.387573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:30:43.387573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:30:43.387573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:30:43.387573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:30:43.387573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:30:43.387573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:30:43.387573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:30:43.387573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 02 10:30:43.387573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:30:43.387573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 829c7bb7dbec42ceb4a849f74a23499b. May 02 10:30:43.387573 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:30:43.391883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72bfed-dc5a-402a-b788-4be4bfd38919 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:43.392318 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1959/3926] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:30:43 2022] PATCH /identity/v3/domains/829c7bb7dbec42ceb4a849f74a23499b => generated 112 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:30:43.404310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72bfed-dc5a-402a-b788-4be4bfd38919 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:43.409507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb34b64-b23c-4f2a-908f-8cc1278f1718 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c30f61490c46aab1dba9fd5bc49e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15abf4fd579641f781f04dc75f12bd83', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:43.410385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb34b64-b23c-4f2a-908f-8cc1278f1718 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:43.410674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb34b64-b23c-4f2a-908f-8cc1278f1718 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:43.410959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb34b64-b23c-4f2a-908f-8cc1278f1718 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] PATH_INFO: `/v3/domains/08c3fbde1f8942c2a871b62cf940089e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:43.421566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb34b64-b23c-4f2a-908f-8cc1278f1718 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:30:43.432242 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-9eb34b64-b23c-4f2a-908f-8cc1278f1718 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Could not find domain: 08c3fbde1f8942c2a871b62cf940089e.: keystone.exception.DomainNotFound: Could not find domain: 08c3fbde1f8942c2a871b62cf940089e. May 02 10:30:43.432242 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:30:43.432242 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 02 10:30:43.432242 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 02 10:30:43.432242 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:30:43.432242 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:30:43.432242 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:30:43.432242 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:30:43.432242 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 08c3fbde1f8942c2a871b62cf940089e. May 02 10:30:43.432242 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:30:43.432242 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:30:43.432242 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:30:43.432242 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:30:43.432242 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:30:43.432242 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:30:43.432242 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:30:43.433246 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:30:43.433246 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:30:43.433246 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:30:43.433246 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:30:43.433246 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:30:43.433246 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:30:43.433246 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:30:43.433246 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 02 10:30:43.433246 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 02 10:30:43.433246 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:30:43.433246 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:30:43.433246 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:30:43.433246 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:30:43.433246 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:30:43.433246 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:30:43.433246 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:30:43.434070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:30:43.434070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:30:43.434070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:30:43.434070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:30:43.434070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:30:43.434070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:30:43.434070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:30:43.434070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:30:43.434070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:30:43.434070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:30:43.434070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:30:43.434070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:30:43.434070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:30:43.434070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 02 10:30:43.434070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:30:43.434070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 08c3fbde1f8942c2a871b62cf940089e. May 02 10:30:43.434070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:30:43.438641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb93a4-16ec-49dc-9533-f865d2066813 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:43.439567 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1968/3927] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:30:43 2022] PATCH /identity/v3/domains/08c3fbde1f8942c2a871b62cf940089e => generated 112 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 02 10:30:43.440515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c3fb93a4-16ec-49dc-9533-f865d2066813 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:43.550921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb93a4-16ec-49dc-9533-f865d2066813 tempest-ProjectsTestJSON-1776158555 tempest-ProjectsTestJSON-1776158555-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:43.564984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16032abe-1c26-4f41-bb0f-2ddff506ec77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:43.565903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16032abe-1c26-4f41-bb0f-2ddff506ec77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:43.566185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16032abe-1c26-4f41-bb0f-2ddff506ec77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:43.566468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16032abe-1c26-4f41-bb0f-2ddff506ec77 admin admin] PATH_INFO: `/v3/users/b84aafff22c9412992d2cd4f4e49f74b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:43.567784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16032abe-1c26-4f41-bb0f-2ddff506ec77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b84aafff22c9412992d2cd4f4e49f74b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:43.572041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16032abe-1c26-4f41-bb0f-2ddff506ec77 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:43.757903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-16032abe-1c26-4f41-bb0f-2ddff506ec77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b84aafff22c9412992d2cd4f4e49f74b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:43.771329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-16032abe-1c26-4f41-bb0f-2ddff506ec77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b84aafff22c9412992d2cd4f4e49f74b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:43.772179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-16032abe-1c26-4f41-bb0f-2ddff506ec77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b84aafff22c9412992d2cd4f4e49f74b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:43.781151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-16032abe-1c26-4f41-bb0f-2ddff506ec77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b84aafff22c9412992d2cd4f4e49f74b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:43.873334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-16032abe-1c26-4f41-bb0f-2ddff506ec77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b84aafff22c9412992d2cd4f4e49f74b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:43.886257 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1960/3928] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:30:43 2022] DELETE /identity/v3/users/b84aafff22c9412992d2cd4f4e49f74b => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:43.889831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74713b-4c8f-4cb1-9de2-f0f94ed08ce7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:43.893124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74713b-4c8f-4cb1-9de2-f0f94ed08ce7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:43.893704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74713b-4c8f-4cb1-9de2-f0f94ed08ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:43.959562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7d74713b-4c8f-4cb1-9de2-f0f94ed08ce7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:43.962063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7d74713b-4c8f-4cb1-9de2-f0f94ed08ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:44.091869 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1969/3929] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:44.111009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16032abe-1c26-4f41-bb0f-2ddff506ec77 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:44.114935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-16032abe-1c26-4f41-bb0f-2ddff506ec77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:44.278432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16032abe-1c26-4f41-bb0f-2ddff506ec77 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:44.286311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2511a-24d0-427d-9948-c8e5fc4cdb68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:44.287965 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2511a-24d0-427d-9948-c8e5fc4cdb68 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:44.288259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2511a-24d0-427d-9948-c8e5fc4cdb68 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:44.291649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2511a-24d0-427d-9948-c8e5fc4cdb68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:44.311685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2511a-24d0-427d-9948-c8e5fc4cdb68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:44.314594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2511a-24d0-427d-9948-c8e5fc4cdb68 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:44.361421 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1961/3930] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:30:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:30:45.603500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74713b-4c8f-4cb1-9de2-f0f94ed08ce7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:45.605350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7d74713b-4c8f-4cb1-9de2-f0f94ed08ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:45.626880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74713b-4c8f-4cb1-9de2-f0f94ed08ce7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:45.634434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262fd9e-64c3-43a5-b9a8-c36efc91da1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:45.636453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262fd9e-64c3-43a5-b9a8-c36efc91da1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:45.637480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262fd9e-64c3-43a5-b9a8-c36efc91da1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:45.637964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262fd9e-64c3-43a5-b9a8-c36efc91da1b admin admin] PATH_INFO: `/v3/projects/1418a8e8bf1c48d48f0a61054123edd4` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:45.640829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262fd9e-64c3-43a5-b9a8-c36efc91da1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1418a8e8bf1c48d48f0a61054123edd4)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:45.645065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262fd9e-64c3-43a5-b9a8-c36efc91da1b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:45.799834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8262fd9e-64c3-43a5-b9a8-c36efc91da1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1418a8e8bf1c48d48f0a61054123edd4', 'request_id': 'req-8262fd9e-64c3-43a5-b9a8-c36efc91da1b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:45.818203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8262fd9e-64c3-43a5-b9a8-c36efc91da1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1418a8e8bf1c48d48f0a61054123edd4', 'request_id': 'req-8262fd9e-64c3-43a5-b9a8-c36efc91da1b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:45.901883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8262fd9e-64c3-43a5-b9a8-c36efc91da1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1418a8e8bf1c48d48f0a61054123edd4', 'request_id': 'req-8262fd9e-64c3-43a5-b9a8-c36efc91da1b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:45.918166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8262fd9e-64c3-43a5-b9a8-c36efc91da1b admin admin] The token cache is being invalidate because project 1418a8e8bf1c48d48f0a61054123edd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:45.918466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8262fd9e-64c3-43a5-b9a8-c36efc91da1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:45.921639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8262fd9e-64c3-43a5-b9a8-c36efc91da1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:45.924011 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1970/3931] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:45 2022] DELETE /identity/v3/projects/1418a8e8bf1c48d48f0a61054123edd4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:45.928103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2511a-24d0-427d-9948-c8e5fc4cdb68 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:45.946300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2511a-24d0-427d-9948-c8e5fc4cdb68 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:46.052164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2724264-65f8-4ed5-917e-32ea06dda5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:46.053628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2724264-65f8-4ed5-917e-32ea06dda5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:46.054267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2724264-65f8-4ed5-917e-32ea06dda5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:46.054963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2724264-65f8-4ed5-917e-32ea06dda5ac admin admin] PATH_INFO: `/v3/users/67c30f61490c46aab1dba9fd5bc49e48` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:46.056834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2724264-65f8-4ed5-917e-32ea06dda5ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=67c30f61490c46aab1dba9fd5bc49e48)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:46.060420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2724264-65f8-4ed5-917e-32ea06dda5ac admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:46.294888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b2724264-65f8-4ed5-917e-32ea06dda5ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67c30f61490c46aab1dba9fd5bc49e48'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:46.321675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b2724264-65f8-4ed5-917e-32ea06dda5ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67c30f61490c46aab1dba9fd5bc49e48'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:46.322440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b2724264-65f8-4ed5-917e-32ea06dda5ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67c30f61490c46aab1dba9fd5bc49e48'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:46.337156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b2724264-65f8-4ed5-917e-32ea06dda5ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67c30f61490c46aab1dba9fd5bc49e48'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:46.404455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b2724264-65f8-4ed5-917e-32ea06dda5ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67c30f61490c46aab1dba9fd5bc49e48'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:46.427259 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1962/3932] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:30:45 2022] DELETE /identity/v3/users/67c30f61490c46aab1dba9fd5bc49e48 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:47.766342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262fd9e-64c3-43a5-b9a8-c36efc91da1b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:47.768779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8262fd9e-64c3-43a5-b9a8-c36efc91da1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:47.804981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262fd9e-64c3-43a5-b9a8-c36efc91da1b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:47.964956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53173338-5a63-4b8b-809f-f6976666724c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:47.966061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53173338-5a63-4b8b-809f-f6976666724c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:47.967901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53173338-5a63-4b8b-809f-f6976666724c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:47.968350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53173338-5a63-4b8b-809f-f6976666724c admin admin] PATH_INFO: `/v3/projects/15abf4fd579641f781f04dc75f12bd83` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:47.974693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53173338-5a63-4b8b-809f-f6976666724c admin admin] RBAC: Authorizing `identity:delete_project(project_id=15abf4fd579641f781f04dc75f12bd83)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:47.979319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53173338-5a63-4b8b-809f-f6976666724c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:48.158730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53173338-5a63-4b8b-809f-f6976666724c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15abf4fd579641f781f04dc75f12bd83', 'request_id': 'req-53173338-5a63-4b8b-809f-f6976666724c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:48.165777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53173338-5a63-4b8b-809f-f6976666724c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15abf4fd579641f781f04dc75f12bd83', 'request_id': 'req-53173338-5a63-4b8b-809f-f6976666724c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:48.273428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53173338-5a63-4b8b-809f-f6976666724c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15abf4fd579641f781f04dc75f12bd83', 'request_id': 'req-53173338-5a63-4b8b-809f-f6976666724c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:48.308717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53173338-5a63-4b8b-809f-f6976666724c admin admin] The token cache is being invalidate because project 15abf4fd579641f781f04dc75f12bd83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:48.312527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53173338-5a63-4b8b-809f-f6976666724c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:48.313359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53173338-5a63-4b8b-809f-f6976666724c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:48.321178 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1971/3933] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:47 2022] DELETE /identity/v3/projects/15abf4fd579641f781f04dc75f12bd83 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:48.322907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d716d15-035c-41fe-ab06-1be9d81c4e1b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:48.323363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d716d15-035c-41fe-ab06-1be9d81c4e1b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:48.323483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d716d15-035c-41fe-ab06-1be9d81c4e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:48.349807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-7d716d15-035c-41fe-ab06-1be9d81c4e1b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:48.352153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7d716d15-035c-41fe-ab06-1be9d81c4e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:48.434624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53173338-5a63-4b8b-809f-f6976666724c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:48.437130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-53173338-5a63-4b8b-809f-f6976666724c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:48.455603 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1963/3934] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:30:48.470664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcfaf5-3d0c-486c-80ea-4c0ff8114e7b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:48.471315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcfaf5-3d0c-486c-80ea-4c0ff8114e7b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:48.484456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcfaf5-3d0c-486c-80ea-4c0ff8114e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:48.490868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53173338-5a63-4b8b-809f-f6976666724c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:48.497694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f5f5d-08f6-48a1-bcfb-30664987c8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:48.498737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f5f5d-08f6-48a1-bcfb-30664987c8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:48.499131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f5f5d-08f6-48a1-bcfb-30664987c8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:48.499542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f5f5d-08f6-48a1-bcfb-30664987c8c3 admin admin] PATH_INFO: `/v3/users/26be0fc413e94efa9d98b869a834e69f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:48.504872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f5f5d-08f6-48a1-bcfb-30664987c8c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26be0fc413e94efa9d98b869a834e69f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:48.507586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f5f5d-08f6-48a1-bcfb-30664987c8c3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:48.522183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4ffcfaf5-3d0c-486c-80ea-4c0ff8114e7b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:48.528996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4ffcfaf5-3d0c-486c-80ea-4c0ff8114e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:48.541888 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1964/3935] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:48.549318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcfaf5-3d0c-486c-80ea-4c0ff8114e7b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:48.560992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcfaf5-3d0c-486c-80ea-4c0ff8114e7b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:48.566263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb565b7c-fbe5-4d19-a481-fdc2d5f94527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:48.567154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb565b7c-fbe5-4d19-a481-fdc2d5f94527 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:48.567598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb565b7c-fbe5-4d19-a481-fdc2d5f94527 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:48.568028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb565b7c-fbe5-4d19-a481-fdc2d5f94527 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:48.569091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb565b7c-fbe5-4d19-a481-fdc2d5f94527 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:30:48.569557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb565b7c-fbe5-4d19-a481-fdc2d5f94527 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:48.571342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb565b7c-fbe5-4d19-a481-fdc2d5f94527 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:48.590786 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1965/3936] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:30:48.597742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb565b7c-fbe5-4d19-a481-fdc2d5f94527 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:48.618951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb565b7c-fbe5-4d19-a481-fdc2d5f94527 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:48.637230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506e470-026d-4ce0-a4ef-94a29bdf2614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:48.638313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506e470-026d-4ce0-a4ef-94a29bdf2614 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:48.639152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506e470-026d-4ce0-a4ef-94a29bdf2614 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:48.639611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506e470-026d-4ce0-a4ef-94a29bdf2614 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:48.640487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506e470-026d-4ce0-a4ef-94a29bdf2614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:48.643047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506e470-026d-4ce0-a4ef-94a29bdf2614 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:48.722855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-957f5f5d-08f6-48a1-bcfb-30664987c8c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26be0fc413e94efa9d98b869a834e69f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:48.740930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-957f5f5d-08f6-48a1-bcfb-30664987c8c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26be0fc413e94efa9d98b869a834e69f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:48.741941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-957f5f5d-08f6-48a1-bcfb-30664987c8c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26be0fc413e94efa9d98b869a834e69f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:48.749287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-957f5f5d-08f6-48a1-bcfb-30664987c8c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26be0fc413e94efa9d98b869a834e69f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:48.770802 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1966/3937] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:30:48 2022] POST /identity/v3/projects => generated 391 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:48.772070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506e470-026d-4ce0-a4ef-94a29bdf2614 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:48.838183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-957f5f5d-08f6-48a1-bcfb-30664987c8c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26be0fc413e94efa9d98b869a834e69f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:48.850416 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1972/3938] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:30:48 2022] DELETE /identity/v3/users/26be0fc413e94efa9d98b869a834e69f => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:48.853624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506e470-026d-4ce0-a4ef-94a29bdf2614 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:48.926120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc620c-dfed-4fce-8ad5-a2fa04a810e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:48.927555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc620c-dfed-4fce-8ad5-a2fa04a810e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:48.928055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc620c-dfed-4fce-8ad5-a2fa04a810e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:48.928492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc620c-dfed-4fce-8ad5-a2fa04a810e8 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:48.929389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc620c-dfed-4fce-8ad5-a2fa04a810e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:48.931762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc620c-dfed-4fce-8ad5-a2fa04a810e8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:49.070438 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1967/3939] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:30:48 2022] POST /identity/v3/users => generated 296 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:49.074526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f5f5d-08f6-48a1-bcfb-30664987c8c3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:49.076828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-957f5f5d-08f6-48a1-bcfb-30664987c8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:49.094542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc620c-dfed-4fce-8ad5-a2fa04a810e8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:49.099137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-34fc620c-dfed-4fce-8ad5-a2fa04a810e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:49.115288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f5f5d-08f6-48a1-bcfb-30664987c8c3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:49.153991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41cb3d-fdf3-4f16-9e7e-8c208f875a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:49.161031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41cb3d-fdf3-4f16-9e7e-8c208f875a8a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:49.161412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41cb3d-fdf3-4f16-9e7e-8c208f875a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:49.161712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41cb3d-fdf3-4f16-9e7e-8c208f875a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:49.162496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41cb3d-fdf3-4f16-9e7e-8c208f875a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:49.164163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41cb3d-fdf3-4f16-9e7e-8c208f875a8a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:49.170202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc620c-dfed-4fce-8ad5-a2fa04a810e8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:49.185770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909d697-83f2-4397-bcd3-3334e593d3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:49.187859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909d697-83f2-4397-bcd3-3334e593d3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:49.188957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909d697-83f2-4397-bcd3-3334e593d3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:49.189848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909d697-83f2-4397-bcd3-3334e593d3cf admin admin] PATH_INFO: `/v3/projects/794ae6913d5546dbadfb32cb27b15d3c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:49.193867 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1973/3940] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:30:49.195771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41cb3d-fdf3-4f16-9e7e-8c208f875a8a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:49.198553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909d697-83f2-4397-bcd3-3334e593d3cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=794ae6913d5546dbadfb32cb27b15d3c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:49.206090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909d697-83f2-4397-bcd3-3334e593d3cf admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:49.223620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41cb3d-fdf3-4f16-9e7e-8c208f875a8a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:49.228586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1daae0-1d06-4d5d-965a-5ca9eb159e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:49.229384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1daae0-1d06-4d5d-965a-5ca9eb159e29 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:49.229678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1daae0-1d06-4d5d-965a-5ca9eb159e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:49.229960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1daae0-1d06-4d5d-965a-5ca9eb159e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:49.230690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1daae0-1d06-4d5d-965a-5ca9eb159e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:49.232348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1daae0-1d06-4d5d-965a-5ca9eb159e29 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:49.246222 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1974/3941] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:30:49.250908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1daae0-1d06-4d5d-965a-5ca9eb159e29 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:49.265136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1daae0-1d06-4d5d-965a-5ca9eb159e29 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:49.274751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e130720-3862-439b-9cf5-5b17110b7224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:49.276291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e130720-3862-439b-9cf5-5b17110b7224 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:49.276838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e130720-3862-439b-9cf5-5b17110b7224 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:49.277311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e130720-3862-439b-9cf5-5b17110b7224 admin admin] PATH_INFO: `/v3/projects/6e496d74a5964ea8a155774c2e63a881/users/b42253ceb4ef49bfa4e81d36c136215c/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:49.298940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e130720-3862-439b-9cf5-5b17110b7224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e496d74a5964ea8a155774c2e63a881, user_id=b42253ceb4ef49bfa4e81d36c136215c, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:49.303022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e130720-3862-439b-9cf5-5b17110b7224 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:49.377906 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1975/3942] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:30:49 2022] PUT /identity/v3/projects/6e496d74a5964ea8a155774c2e63a881/users/b42253ceb4ef49bfa4e81d36c136215c/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:30:49.389443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82da4f-5367-40d4-b5d7-9f4efd27184d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:49.390315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82da4f-5367-40d4-b5d7-9f4efd27184d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:49.398941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82da4f-5367-40d4-b5d7-9f4efd27184d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:49.399083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3909d697-83f2-4397-bcd3-3334e593d3cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '794ae6913d5546dbadfb32cb27b15d3c', 'request_id': 'req-3909d697-83f2-4397-bcd3-3334e593d3cf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:49.427787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9e82da4f-5367-40d4-b5d7-9f4efd27184d None None] MFA Rules not processed for user `b42253ceb4ef49bfa4e81d36c136215c`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:49.429004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9e82da4f-5367-40d4-b5d7-9f4efd27184d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:49.450710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3909d697-83f2-4397-bcd3-3334e593d3cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '794ae6913d5546dbadfb32cb27b15d3c', 'request_id': 'req-3909d697-83f2-4397-bcd3-3334e593d3cf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:49.480447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3909d697-83f2-4397-bcd3-3334e593d3cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '794ae6913d5546dbadfb32cb27b15d3c', 'request_id': 'req-3909d697-83f2-4397-bcd3-3334e593d3cf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:49.494463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3909d697-83f2-4397-bcd3-3334e593d3cf admin admin] The token cache is being invalidate because project 794ae6913d5546dbadfb32cb27b15d3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:49.494883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3909d697-83f2-4397-bcd3-3334e593d3cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:49.495701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3909d697-83f2-4397-bcd3-3334e593d3cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:49.499058 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1968/3943] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:49 2022] DELETE /identity/v3/projects/794ae6913d5546dbadfb32cb27b15d3c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:49.505115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29504051-402c-4f4a-8699-ec5c3ac24ead None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:49.505682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29504051-402c-4f4a-8699-ec5c3ac24ead None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:49.506174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29504051-402c-4f4a-8699-ec5c3ac24ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:49.524020 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1976/3944] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:49.531368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-29504051-402c-4f4a-8699-ec5c3ac24ead None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:49.531528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82da4f-5367-40d4-b5d7-9f4efd27184d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:49.533051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-29504051-402c-4f4a-8699-ec5c3ac24ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:49.547119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82da4f-5367-40d4-b5d7-9f4efd27184d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:49.551384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052fb5a-2037-4762-8367-bd682f489cf4 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b42253ceb4ef49bfa4e81d36c136215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e496d74a5964ea8a155774c2e63a881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:49.552271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052fb5a-2037-4762-8367-bd682f489cf4 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:49.552742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052fb5a-2037-4762-8367-bd682f489cf4 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:49.553023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052fb5a-2037-4762-8367-bd682f489cf4 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] PATH_INFO: `/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:49.554013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052fb5a-2037-4762-8367-bd682f489cf4 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorizing `identity:create_application_credential(user_id=b42253ceb4ef49bfa4e81d36c136215c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:49.555175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052fb5a-2037-4762-8367-bd682f489cf4 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:49.652285 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1969/3945] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:49.654060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22603363-b08f-4558-9d64-3a81db3f416c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:49.654428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22603363-b08f-4558-9d64-3a81db3f416c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:49.654785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22603363-b08f-4558-9d64-3a81db3f416c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:49.675107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-22603363-b08f-4558-9d64-3a81db3f416c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:49.676739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-22603363-b08f-4558-9d64-3a81db3f416c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:49.687350 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1970/3946] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:49.692235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22603363-b08f-4558-9d64-3a81db3f416c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:49.702715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22603363-b08f-4558-9d64-3a81db3f416c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:49.724134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c80a0a-77e1-4385-865b-0cc0d0348b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:49.724892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c80a0a-77e1-4385-865b-0cc0d0348b9d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:49.725181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c80a0a-77e1-4385-865b-0cc0d0348b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:49.725461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c80a0a-77e1-4385-865b-0cc0d0348b9d admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:49.726213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c80a0a-77e1-4385-865b-0cc0d0348b9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:30:49.726528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c80a0a-77e1-4385-865b-0cc0d0348b9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:49.728151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c80a0a-77e1-4385-865b-0cc0d0348b9d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:49.743643 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1977/3947] 10.222.0.16 () {60 vars in 1313 bytes} [Mon May 2 10:30:49 2022] POST /identity/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials => generated 789 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:49.747424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052fb5a-2037-4762-8367-bd682f489cf4 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:49.751190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7052fb5a-2037-4762-8367-bd682f489cf4 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:49.758688 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1971/3948] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:30:49.763510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c80a0a-77e1-4385-865b-0cc0d0348b9d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:49.772264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052fb5a-2037-4762-8367-bd682f489cf4 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:49.781026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c80a0a-77e1-4385-865b-0cc0d0348b9d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:49.783393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563a761-aae3-4868-90df-8c6da09399f1 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b42253ceb4ef49bfa4e81d36c136215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e496d74a5964ea8a155774c2e63a881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:49.784363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563a761-aae3-4868-90df-8c6da09399f1 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:49.784685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563a761-aae3-4868-90df-8c6da09399f1 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:49.784960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563a761-aae3-4868-90df-8c6da09399f1 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] PATH_INFO: `/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials/95972417ff21490cb15ac9a743e66fa4` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:49.789898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8c2b6-1bd8-4042-8806-a082eb7b2b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:49.791517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8c2b6-1bd8-4042-8806-a082eb7b2b24 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:49.791961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8c2b6-1bd8-4042-8806-a082eb7b2b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:49.792742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8c2b6-1bd8-4042-8806-a082eb7b2b24 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:49.794155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8c2b6-1bd8-4042-8806-a082eb7b2b24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:49.797094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8c2b6-1bd8-4042-8806-a082eb7b2b24 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:49.817324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563a761-aae3-4868-90df-8c6da09399f1 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorizing `identity:get_application_credential(user_id=b42253ceb4ef49bfa4e81d36c136215c, application_credential_id=95972417ff21490cb15ac9a743e66fa4)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:49.818984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563a761-aae3-4868-90df-8c6da09399f1 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:49.824687 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1978/3949] 10.222.0.16 () {58 vars in 1391 bytes} [Mon May 2 10:30:49 2022] GET /identity/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials/95972417ff21490cb15ac9a743e66fa4 => generated 689 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:30:49.826648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d74753-8d4e-47f6-95b4-a4cebdd3cff4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:49.826648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d74753-8d4e-47f6-95b4-a4cebdd3cff4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:49.826648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d74753-8d4e-47f6-95b4-a4cebdd3cff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:49.856813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-29d74753-8d4e-47f6-95b4-a4cebdd3cff4 None None] MFA Rules not processed for user `b42253ceb4ef49bfa4e81d36c136215c`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:49.858088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-29d74753-8d4e-47f6-95b4-a4cebdd3cff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:49.890462 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1972/3950] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:30:49 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:49.894930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8c2b6-1bd8-4042-8806-a082eb7b2b24 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:49.998165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8c2b6-1bd8-4042-8806-a082eb7b2b24 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:50.005204 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1979/3951] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:49 2022] POST /identity/v3/auth/tokens => generated 3415 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) May 02 10:30:50.010056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d74753-8d4e-47f6-95b4-a4cebdd3cff4 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:50.015066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975c57e-1b01-4a5d-882b-bb7d82aa63cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:50.016079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975c57e-1b01-4a5d-882b-bb7d82aa63cb admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:50.016454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975c57e-1b01-4a5d-882b-bb7d82aa63cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:50.016778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975c57e-1b01-4a5d-882b-bb7d82aa63cb admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:50.017487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975c57e-1b01-4a5d-882b-bb7d82aa63cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:50.019429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975c57e-1b01-4a5d-882b-bb7d82aa63cb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:50.091427 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1973/3952] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:30:49 2022] POST /identity/v3/users => generated 283 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:50.096499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d74753-8d4e-47f6-95b4-a4cebdd3cff4 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:50.111969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf9a07-cea6-4ae7-b7f9-3ad86a85a829 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b42253ceb4ef49bfa4e81d36c136215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e496d74a5964ea8a155774c2e63a881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:50.113109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf9a07-cea6-4ae7-b7f9-3ad86a85a829 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:50.113248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975c57e-1b01-4a5d-882b-bb7d82aa63cb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:50.113532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf9a07-cea6-4ae7-b7f9-3ad86a85a829 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:50.113880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf9a07-cea6-4ae7-b7f9-3ad86a85a829 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] PATH_INFO: `/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials/95972417ff21490cb15ac9a743e66fa4` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:50.116318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf9a07-cea6-4ae7-b7f9-3ad86a85a829 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b42253ceb4ef49bfa4e81d36c136215c, application_credential_id=95972417ff21490cb15ac9a743e66fa4)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:50.127255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf9a07-cea6-4ae7-b7f9-3ad86a85a829 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:50.131048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975c57e-1b01-4a5d-882b-bb7d82aa63cb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:50.137442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891e59e-e4d8-49bd-9a48-54d259bb6294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:50.138685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891e59e-e4d8-49bd-9a48-54d259bb6294 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:50.139051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891e59e-e4d8-49bd-9a48-54d259bb6294 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:50.139448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891e59e-e4d8-49bd-9a48-54d259bb6294 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:50.141694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891e59e-e4d8-49bd-9a48-54d259bb6294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:50.143320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891e59e-e4d8-49bd-9a48-54d259bb6294 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:50.160492 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1974/3953] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:30:50.165365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891e59e-e4d8-49bd-9a48-54d259bb6294 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:50.181464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891e59e-e4d8-49bd-9a48-54d259bb6294 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:50.187936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8fee6-d757-430f-acaa-dcf186ddaeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:50.188765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8fee6-d757-430f-acaa-dcf186ddaeeb admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:50.189119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8fee6-d757-430f-acaa-dcf186ddaeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:50.189488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8fee6-d757-430f-acaa-dcf186ddaeeb admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:50.190317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8fee6-d757-430f-acaa-dcf186ddaeeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:50.192984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8fee6-d757-430f-acaa-dcf186ddaeeb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:50.199675 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1980/3954] 10.222.0.16 () {58 vars in 1394 bytes} [Mon May 2 10:30:50 2022] DELETE /identity/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials/95972417ff21490cb15ac9a743e66fa4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:30:50.208166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf9a07-cea6-4ae7-b7f9-3ad86a85a829 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:50.216937 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1975/3955] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:30:50.222097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8fee6-d757-430f-acaa-dcf186ddaeeb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:50.225950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf9a07-cea6-4ae7-b7f9-3ad86a85a829 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:50.239621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8fee6-d757-430f-acaa-dcf186ddaeeb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:50.240529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bff8fa-585a-4af4-a698-36f636afd541 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b42253ceb4ef49bfa4e81d36c136215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e496d74a5964ea8a155774c2e63a881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:50.241761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bff8fa-585a-4af4-a698-36f636afd541 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:50.242204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bff8fa-585a-4af4-a698-36f636afd541 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:50.242635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bff8fa-585a-4af4-a698-36f636afd541 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] PATH_INFO: `/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:50.245802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b661e0-10f9-4c26-a843-5d4426bf6c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:50.246691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bff8fa-585a-4af4-a698-36f636afd541 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorizing `identity:create_application_credential(user_id=b42253ceb4ef49bfa4e81d36c136215c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:50.246881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b661e0-10f9-4c26-a843-5d4426bf6c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:50.247237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b661e0-10f9-4c26-a843-5d4426bf6c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:50.247795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b661e0-10f9-4c26-a843-5d4426bf6c7f admin admin] PATH_INFO: `/v3/projects/938d7f7fb79f43809d28533c00fa1b06/users/4368e1c27d6941b09dacd4591bcbecbb/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:50.247912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bff8fa-585a-4af4-a698-36f636afd541 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:50.271985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b661e0-10f9-4c26-a843-5d4426bf6c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=938d7f7fb79f43809d28533c00fa1b06, user_id=4368e1c27d6941b09dacd4591bcbecbb, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:50.278268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b661e0-10f9-4c26-a843-5d4426bf6c7f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:50.368512 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1976/3956] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:30:50 2022] PUT /identity/v3/projects/938d7f7fb79f43809d28533c00fa1b06/users/4368e1c27d6941b09dacd4591bcbecbb/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:50.370147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b115a-d02f-4b4a-bf29-711388b1215a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:50.370438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b115a-d02f-4b4a-bf29-711388b1215a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:50.370721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b115a-d02f-4b4a-bf29-711388b1215a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:50.414415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-906b115a-d02f-4b4a-bf29-711388b1215a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:50.417986 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1981/3957] 10.222.0.16 () {60 vars in 1314 bytes} [Mon May 2 10:30:50 2022] POST /identity/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials => generated 921 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:30:50.418959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-906b115a-d02f-4b4a-bf29-711388b1215a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:50.422969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bff8fa-585a-4af4-a698-36f636afd541 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:50.439355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bff8fa-585a-4af4-a698-36f636afd541 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:50.558071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dcede-2852-4fe2-8678-40fd3fef9096 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b42253ceb4ef49bfa4e81d36c136215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e496d74a5964ea8a155774c2e63a881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:50.562228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dcede-2852-4fe2-8678-40fd3fef9096 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:50.562228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dcede-2852-4fe2-8678-40fd3fef9096 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:50.562228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dcede-2852-4fe2-8678-40fd3fef9096 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] PATH_INFO: `/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials/256f451dab6c40ef9793b64509966504` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:50.587800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dcede-2852-4fe2-8678-40fd3fef9096 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b42253ceb4ef49bfa4e81d36c136215c, application_credential_id=256f451dab6c40ef9793b64509966504)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:50.589366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dcede-2852-4fe2-8678-40fd3fef9096 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:50.590270 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1977/3958] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:30:50.684792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b115a-d02f-4b4a-bf29-711388b1215a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:50.684792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-906b115a-d02f-4b4a-bf29-711388b1215a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:50.707296 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1982/3959] 10.222.0.16 () {58 vars in 1394 bytes} [Mon May 2 10:30:50 2022] DELETE /identity/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials/256f451dab6c40ef9793b64509966504 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:50.718163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dcede-2852-4fe2-8678-40fd3fef9096 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:50.731511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dcede-2852-4fe2-8678-40fd3fef9096 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:50.740310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f9987-d12f-4006-9b8a-bc34b88d014c tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b42253ceb4ef49bfa4e81d36c136215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e496d74a5964ea8a155774c2e63a881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:50.741589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f9987-d12f-4006-9b8a-bc34b88d014c tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:50.742099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f9987-d12f-4006-9b8a-bc34b88d014c tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:50.742623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f9987-d12f-4006-9b8a-bc34b88d014c tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] PATH_INFO: `/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:50.743729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f9987-d12f-4006-9b8a-bc34b88d014c tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorizing `identity:create_application_credential(user_id=b42253ceb4ef49bfa4e81d36c136215c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:50.745167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f9987-d12f-4006-9b8a-bc34b88d014c tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:50.788176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b115a-d02f-4b4a-bf29-711388b1215a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:50.804370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800cf15-bf55-40f8-ac5a-0eb70a160242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:50.804566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800cf15-bf55-40f8-ac5a-0eb70a160242 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:50.805052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800cf15-bf55-40f8-ac5a-0eb70a160242 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:50.805328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800cf15-bf55-40f8-ac5a-0eb70a160242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:50.834867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800cf15-bf55-40f8-ac5a-0eb70a160242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:50.837101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800cf15-bf55-40f8-ac5a-0eb70a160242 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:50.852086 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1978/3960] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:30:50.968716 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1983/3961] 10.222.0.16 () {60 vars in 1314 bytes} [Mon May 2 10:30:50 2022] POST /identity/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials => generated 812 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:50.972823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800cf15-bf55-40f8-ac5a-0eb70a160242 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:51.002430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800cf15-bf55-40f8-ac5a-0eb70a160242 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:51.017028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ea638-9dd3-4280-bb09-6c05307642e1 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b42253ceb4ef49bfa4e81d36c136215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e496d74a5964ea8a155774c2e63a881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:51.018332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ea638-9dd3-4280-bb09-6c05307642e1 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:51.018803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ea638-9dd3-4280-bb09-6c05307642e1 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:51.019564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ea638-9dd3-4280-bb09-6c05307642e1 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] PATH_INFO: `/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials/1ce5055ac79a4a4a90f2ed08f78a967c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:51.041150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ea638-9dd3-4280-bb09-6c05307642e1 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b42253ceb4ef49bfa4e81d36c136215c, application_credential_id=1ce5055ac79a4a4a90f2ed08f78a967c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:51.044732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ea638-9dd3-4280-bb09-6c05307642e1 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:51.139315 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1979/3962] 10.222.0.16 () {58 vars in 1394 bytes} [Mon May 2 10:30:50 2022] DELETE /identity/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials/1ce5055ac79a4a4a90f2ed08f78a967c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:30:51.144906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f9987-d12f-4006-9b8a-bc34b88d014c tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:51.160215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f9987-d12f-4006-9b8a-bc34b88d014c tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:51.182336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4e987-068d-41b7-ae29-71657efa69db tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b42253ceb4ef49bfa4e81d36c136215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e496d74a5964ea8a155774c2e63a881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:51.185239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4e987-068d-41b7-ae29-71657efa69db tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:51.192407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4e987-068d-41b7-ae29-71657efa69db tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:51.200126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4e987-068d-41b7-ae29-71657efa69db tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] PATH_INFO: `/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:51.214855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4e987-068d-41b7-ae29-71657efa69db tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorizing `identity:create_application_credential(user_id=b42253ceb4ef49bfa4e81d36c136215c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:51.224316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4e987-068d-41b7-ae29-71657efa69db tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:51.474938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ea638-9dd3-4280-bb09-6c05307642e1 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:51.480737 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1984/3963] 10.222.0.16 () {60 vars in 1313 bytes} [Mon May 2 10:30:51 2022] POST /identity/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials => generated 787 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:51.489489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ea638-9dd3-4280-bb09-6c05307642e1 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:51.505562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecfdc9-3fb1-4853-8300-c35ee463a21e tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b42253ceb4ef49bfa4e81d36c136215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e496d74a5964ea8a155774c2e63a881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:51.506737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecfdc9-3fb1-4853-8300-c35ee463a21e tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:51.507905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecfdc9-3fb1-4853-8300-c35ee463a21e tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:51.510732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecfdc9-3fb1-4853-8300-c35ee463a21e tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] PATH_INFO: `/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:51.510732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecfdc9-3fb1-4853-8300-c35ee463a21e tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorizing `identity:create_application_credential(user_id=b42253ceb4ef49bfa4e81d36c136215c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:51.510732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecfdc9-3fb1-4853-8300-c35ee463a21e tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:51.701082 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1980/3964] 10.222.0.16 () {60 vars in 1313 bytes} [Mon May 2 10:30:51 2022] POST /identity/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials => generated 788 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:51.706187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4e987-068d-41b7-ae29-71657efa69db tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:51.733965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4e987-068d-41b7-ae29-71657efa69db tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:51.753269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d7e79-7571-4c19-b3d7-e16d4daa31e5 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b42253ceb4ef49bfa4e81d36c136215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e496d74a5964ea8a155774c2e63a881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:51.755810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d7e79-7571-4c19-b3d7-e16d4daa31e5 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:51.755810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d7e79-7571-4c19-b3d7-e16d4daa31e5 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:51.755810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d7e79-7571-4c19-b3d7-e16d4daa31e5 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] PATH_INFO: `/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:51.755810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d7e79-7571-4c19-b3d7-e16d4daa31e5 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorizing `identity:list_application_credentials(user_id=b42253ceb4ef49bfa4e81d36c136215c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:51.758579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d7e79-7571-4c19-b3d7-e16d4daa31e5 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:51.795326 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1985/3965] 10.222.0.16 () {58 vars in 1292 bytes} [Mon May 2 10:30:51 2022] GET /identity/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials => generated 1499 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:30:51.796800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecfdc9-3fb1-4853-8300-c35ee463a21e tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:51.813499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecfdc9-3fb1-4853-8300-c35ee463a21e tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:51.826715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b40f1-246e-4255-af44-1c8b951517c6 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b42253ceb4ef49bfa4e81d36c136215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e496d74a5964ea8a155774c2e63a881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:51.827928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b40f1-246e-4255-af44-1c8b951517c6 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:51.828228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b40f1-246e-4255-af44-1c8b951517c6 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:51.828515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b40f1-246e-4255-af44-1c8b951517c6 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] PATH_INFO: `/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials/a03c16d1821f40ccb3c4b0ed31bc3048` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:51.850282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b40f1-246e-4255-af44-1c8b951517c6 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b42253ceb4ef49bfa4e81d36c136215c, application_credential_id=a03c16d1821f40ccb3c4b0ed31bc3048)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:51.852999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b40f1-246e-4255-af44-1c8b951517c6 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:52.024275 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1981/3966] 10.222.0.16 () {58 vars in 1394 bytes} [Mon May 2 10:30:51 2022] DELETE /identity/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials/a03c16d1821f40ccb3c4b0ed31bc3048 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:30:52.034085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d7e79-7571-4c19-b3d7-e16d4daa31e5 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:52.048021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d7e79-7571-4c19-b3d7-e16d4daa31e5 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:52.056214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfdea8-f9cb-4b0f-a41d-1a637d263964 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b42253ceb4ef49bfa4e81d36c136215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e496d74a5964ea8a155774c2e63a881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:52.057401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfdea8-f9cb-4b0f-a41d-1a637d263964 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:52.057805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfdea8-f9cb-4b0f-a41d-1a637d263964 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:52.058148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfdea8-f9cb-4b0f-a41d-1a637d263964 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] PATH_INFO: `/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials/2d713936730b42d198e3dff820195e82` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:52.074862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdfdea8-f9cb-4b0f-a41d-1a637d263964 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b42253ceb4ef49bfa4e81d36c136215c, application_credential_id=2d713936730b42d198e3dff820195e82)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:52.076951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdfdea8-f9cb-4b0f-a41d-1a637d263964 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:52.223516 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1986/3967] 10.222.0.16 () {58 vars in 1394 bytes} [Mon May 2 10:30:52 2022] DELETE /identity/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials/2d713936730b42d198e3dff820195e82 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:52.228404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b40f1-246e-4255-af44-1c8b951517c6 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:52.238852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b40f1-246e-4255-af44-1c8b951517c6 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:52.254416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378af93-efa2-4485-b1f0-bb9eef7493ba tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b42253ceb4ef49bfa4e81d36c136215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e496d74a5964ea8a155774c2e63a881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:52.255322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378af93-efa2-4485-b1f0-bb9eef7493ba tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:52.255615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378af93-efa2-4485-b1f0-bb9eef7493ba tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:52.255956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378af93-efa2-4485-b1f0-bb9eef7493ba tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] PATH_INFO: `/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:52.256656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378af93-efa2-4485-b1f0-bb9eef7493ba tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorizing `identity:create_application_credential(user_id=b42253ceb4ef49bfa4e81d36c136215c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:52.257827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378af93-efa2-4485-b1f0-bb9eef7493ba tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:52.516763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfdea8-f9cb-4b0f-a41d-1a637d263964 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:52.527531 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1982/3968] 10.222.0.16 () {60 vars in 1313 bytes} [Mon May 2 10:30:52 2022] POST /identity/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials => generated 788 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:52.534129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfdea8-f9cb-4b0f-a41d-1a637d263964 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:52.557845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295796da-7ad3-4d22-9148-70e3182b4f45 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b42253ceb4ef49bfa4e81d36c136215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e496d74a5964ea8a155774c2e63a881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:52.559529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295796da-7ad3-4d22-9148-70e3182b4f45 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:52.561145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295796da-7ad3-4d22-9148-70e3182b4f45 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:52.561551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295796da-7ad3-4d22-9148-70e3182b4f45 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] PATH_INFO: `/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:52.564038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295796da-7ad3-4d22-9148-70e3182b4f45 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorizing `identity:create_application_credential(user_id=b42253ceb4ef49bfa4e81d36c136215c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:52.568222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295796da-7ad3-4d22-9148-70e3182b4f45 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:52.728153 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1987/3969] 10.222.0.16 () {60 vars in 1313 bytes} [Mon May 2 10:30:52 2022] POST /identity/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials => generated 788 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:52.733001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378af93-efa2-4485-b1f0-bb9eef7493ba tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:52.751878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378af93-efa2-4485-b1f0-bb9eef7493ba tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:52.794484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5504626-69c9-4d36-950e-f4a6f2c5c854 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b42253ceb4ef49bfa4e81d36c136215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e496d74a5964ea8a155774c2e63a881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:52.799334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5504626-69c9-4d36-950e-f4a6f2c5c854 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:52.799634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5504626-69c9-4d36-950e-f4a6f2c5c854 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:52.799920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5504626-69c9-4d36-950e-f4a6f2c5c854 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] PATH_INFO: `/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:52.804243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5504626-69c9-4d36-950e-f4a6f2c5c854 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Adding query filter params (name=tempest-application_credential-530096631) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:30:52.804847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5504626-69c9-4d36-950e-f4a6f2c5c854 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorizing `identity:list_application_credentials(user_id=b42253ceb4ef49bfa4e81d36c136215c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:52.806665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5504626-69c9-4d36-950e-f4a6f2c5c854 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:52.833682 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1983/3970] 10.222.0.16 () {58 vars in 1383 bytes} [Mon May 2 10:30:52 2022] GET /identity/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials?name=tempest-application_credential-530096631 => generated 885 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:30:52.846873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295796da-7ad3-4d22-9148-70e3182b4f45 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:52.856976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295796da-7ad3-4d22-9148-70e3182b4f45 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:52.862349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20a7b2-3d60-4035-8614-22852d261df6 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b42253ceb4ef49bfa4e81d36c136215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e496d74a5964ea8a155774c2e63a881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:52.864324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20a7b2-3d60-4035-8614-22852d261df6 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:52.864842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20a7b2-3d60-4035-8614-22852d261df6 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:52.871657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20a7b2-3d60-4035-8614-22852d261df6 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] PATH_INFO: `/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials/3058e7075a4a4d82828c25e49519ee0b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:52.875884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20a7b2-3d60-4035-8614-22852d261df6 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b42253ceb4ef49bfa4e81d36c136215c, application_credential_id=3058e7075a4a4d82828c25e49519ee0b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:52.877699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20a7b2-3d60-4035-8614-22852d261df6 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:52.979237 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1988/3971] 10.222.0.16 () {58 vars in 1394 bytes} [Mon May 2 10:30:52 2022] DELETE /identity/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials/3058e7075a4a4d82828c25e49519ee0b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:52.983587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5504626-69c9-4d36-950e-f4a6f2c5c854 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:52.992996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5504626-69c9-4d36-950e-f4a6f2c5c854 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:52.997090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae12437-441b-4939-a8ab-42a8216858a8 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b42253ceb4ef49bfa4e81d36c136215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e496d74a5964ea8a155774c2e63a881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:53.005336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae12437-441b-4939-a8ab-42a8216858a8 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:53.008934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae12437-441b-4939-a8ab-42a8216858a8 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:53.009340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae12437-441b-4939-a8ab-42a8216858a8 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] PATH_INFO: `/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials/ac21aaddc78245219eeace4ceee94d3e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:53.022066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae12437-441b-4939-a8ab-42a8216858a8 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b42253ceb4ef49bfa4e81d36c136215c, application_credential_id=ac21aaddc78245219eeace4ceee94d3e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:53.024122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae12437-441b-4939-a8ab-42a8216858a8 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:53.165127 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1984/3972] 10.222.0.16 () {58 vars in 1394 bytes} [Mon May 2 10:30:52 2022] DELETE /identity/v3/users/b42253ceb4ef49bfa4e81d36c136215c/application_credentials/ac21aaddc78245219eeace4ceee94d3e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:53.170027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20a7b2-3d60-4035-8614-22852d261df6 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:53.173203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ed20a7b2-3d60-4035-8614-22852d261df6 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:53.196573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20a7b2-3d60-4035-8614-22852d261df6 tempest-ApplicationCredentialsV3Test-847027944 tempest-ApplicationCredentialsV3Test-847027944-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:53.205414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69026317-5cec-425a-9ce3-b5091e37afed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:53.207981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69026317-5cec-425a-9ce3-b5091e37afed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:53.207981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69026317-5cec-425a-9ce3-b5091e37afed admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:53.207981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69026317-5cec-425a-9ce3-b5091e37afed admin admin] PATH_INFO: `/v3/users/b42253ceb4ef49bfa4e81d36c136215c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:53.214076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69026317-5cec-425a-9ce3-b5091e37afed admin admin] RBAC: Authorizing `identity:delete_user(user_id=b42253ceb4ef49bfa4e81d36c136215c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:53.216747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69026317-5cec-425a-9ce3-b5091e37afed admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:53.478715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-69026317-5cec-425a-9ce3-b5091e37afed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b42253ceb4ef49bfa4e81d36c136215c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:53.604384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-69026317-5cec-425a-9ce3-b5091e37afed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b42253ceb4ef49bfa4e81d36c136215c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:53.605054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-69026317-5cec-425a-9ce3-b5091e37afed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b42253ceb4ef49bfa4e81d36c136215c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:53.618888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-69026317-5cec-425a-9ce3-b5091e37afed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b42253ceb4ef49bfa4e81d36c136215c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:53.706933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-69026317-5cec-425a-9ce3-b5091e37afed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b42253ceb4ef49bfa4e81d36c136215c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:53.720299 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1989/3973] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:30:53 2022] DELETE /identity/v3/users/b42253ceb4ef49bfa4e81d36c136215c => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:53.720507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591909a2-e897-4db1-852f-126214bf6283 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:53.722412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591909a2-e897-4db1-852f-126214bf6283 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:53.722986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591909a2-e897-4db1-852f-126214bf6283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:53.768124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-591909a2-e897-4db1-852f-126214bf6283 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:53.769845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-591909a2-e897-4db1-852f-126214bf6283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:53.878650 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1985/3974] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:53.892140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69026317-5cec-425a-9ce3-b5091e37afed admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:53.893811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-69026317-5cec-425a-9ce3-b5091e37afed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:54.001258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69026317-5cec-425a-9ce3-b5091e37afed admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:54.012452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b594a4-a52c-4b76-869f-bf14ebead95f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:54.013444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b594a4-a52c-4b76-869f-bf14ebead95f service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:54.014546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b594a4-a52c-4b76-869f-bf14ebead95f service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:54.015050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b594a4-a52c-4b76-869f-bf14ebead95f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:54.035570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b594a4-a52c-4b76-869f-bf14ebead95f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:54.037799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b594a4-a52c-4b76-869f-bf14ebead95f service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:54.071670 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1990/3975] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:30:55.957240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591909a2-e897-4db1-852f-126214bf6283 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:55.958782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-591909a2-e897-4db1-852f-126214bf6283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:55.981556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591909a2-e897-4db1-852f-126214bf6283 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:55.990013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582d15c-311b-4777-8856-910a69b8a7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:55.996976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582d15c-311b-4777-8856-910a69b8a7fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:55.997426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582d15c-311b-4777-8856-910a69b8a7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:55.997817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582d15c-311b-4777-8856-910a69b8a7fc admin admin] PATH_INFO: `/v3/projects/6e496d74a5964ea8a155774c2e63a881` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:55.999798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582d15c-311b-4777-8856-910a69b8a7fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e496d74a5964ea8a155774c2e63a881)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:56.002111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582d15c-311b-4777-8856-910a69b8a7fc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:56.147229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9582d15c-311b-4777-8856-910a69b8a7fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e496d74a5964ea8a155774c2e63a881', 'request_id': 'req-9582d15c-311b-4777-8856-910a69b8a7fc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:56.215889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9582d15c-311b-4777-8856-910a69b8a7fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e496d74a5964ea8a155774c2e63a881', 'request_id': 'req-9582d15c-311b-4777-8856-910a69b8a7fc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:56.229379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9582d15c-311b-4777-8856-910a69b8a7fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e496d74a5964ea8a155774c2e63a881', 'request_id': 'req-9582d15c-311b-4777-8856-910a69b8a7fc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:56.245456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9582d15c-311b-4777-8856-910a69b8a7fc admin admin] The token cache is being invalidate because project 6e496d74a5964ea8a155774c2e63a881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:30:56.245917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9582d15c-311b-4777-8856-910a69b8a7fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:56.246801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9582d15c-311b-4777-8856-910a69b8a7fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:56.251425 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1986/3976] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:30:55 2022] DELETE /identity/v3/projects/6e496d74a5964ea8a155774c2e63a881 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:56.256288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67a0f7-fe16-4ff7-bb25-70dc2d86545b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:56.256773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67a0f7-fe16-4ff7-bb25-70dc2d86545b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:56.256906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67a0f7-fe16-4ff7-bb25-70dc2d86545b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:56.295074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4d67a0f7-fe16-4ff7-bb25-70dc2d86545b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:56.298834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4d67a0f7-fe16-4ff7-bb25-70dc2d86545b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:56.495673 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1991/3977] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:56.503081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4915f3-afa5-4e2a-9da4-eb45e253caae None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:56.503635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4915f3-afa5-4e2a-9da4-eb45e253caae None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:56.504060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4915f3-afa5-4e2a-9da4-eb45e253caae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:56.545989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6a4915f3-afa5-4e2a-9da4-eb45e253caae None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:56.547703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6a4915f3-afa5-4e2a-9da4-eb45e253caae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:56.569137 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1987/3978] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:56.573313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67a0f7-fe16-4ff7-bb25-70dc2d86545b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:56.586720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67a0f7-fe16-4ff7-bb25-70dc2d86545b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:56.591997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafcd8b-d5e6-45dd-aaf5-f2c116904ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:56.592995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafcd8b-d5e6-45dd-aaf5-f2c116904ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:56.593529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafcd8b-d5e6-45dd-aaf5-f2c116904ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:56.594012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafcd8b-d5e6-45dd-aaf5-f2c116904ad1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:56.594959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafcd8b-d5e6-45dd-aaf5-f2c116904ad1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:30:56.595538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafcd8b-d5e6-45dd-aaf5-f2c116904ad1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:56.600561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafcd8b-d5e6-45dd-aaf5-f2c116904ad1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:56.614264 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1992/3979] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:30:56.618547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4915f3-afa5-4e2a-9da4-eb45e253caae None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:56.632780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4915f3-afa5-4e2a-9da4-eb45e253caae None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:56.647191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85967bc-1f05-47e8-8a2b-998617d9b091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:56.648288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85967bc-1f05-47e8-8a2b-998617d9b091 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:56.648809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85967bc-1f05-47e8-8a2b-998617d9b091 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:56.649289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85967bc-1f05-47e8-8a2b-998617d9b091 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:56.650235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85967bc-1f05-47e8-8a2b-998617d9b091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:56.652439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85967bc-1f05-47e8-8a2b-998617d9b091 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:56.790769 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1988/3980] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:30:56 2022] POST /identity/v3/projects => generated 381 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:56.795262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafcd8b-d5e6-45dd-aaf5-f2c116904ad1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:56.807316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafcd8b-d5e6-45dd-aaf5-f2c116904ad1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:56.918806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950398a-f106-40b2-999c-284179f96452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:56.919815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950398a-f106-40b2-999c-284179f96452 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:56.920466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950398a-f106-40b2-999c-284179f96452 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:56.924554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950398a-f106-40b2-999c-284179f96452 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:56.924554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950398a-f106-40b2-999c-284179f96452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:56.925639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950398a-f106-40b2-999c-284179f96452 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:57.034668 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1993/3981] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:30:56 2022] POST /identity/v3/users => generated 291 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:30:57.038951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85967bc-1f05-47e8-8a2b-998617d9b091 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:57.051125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85967bc-1f05-47e8-8a2b-998617d9b091 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:57.063409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7965898-b2c8-42eb-849c-cb36036c1e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:57.064250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7965898-b2c8-42eb-849c-cb36036c1e35 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:57.064691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7965898-b2c8-42eb-849c-cb36036c1e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:57.065085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7965898-b2c8-42eb-849c-cb36036c1e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:57.068038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7965898-b2c8-42eb-849c-cb36036c1e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:57.069428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7965898-b2c8-42eb-849c-cb36036c1e35 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:57.124174 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1989/3982] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:30:57.128739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950398a-f106-40b2-999c-284179f96452 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:57.148189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950398a-f106-40b2-999c-284179f96452 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:57.153104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdb767-d294-465f-99eb-8b91f6927ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:57.154003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdb767-d294-465f-99eb-8b91f6927ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:57.154440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdb767-d294-465f-99eb-8b91f6927ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:57.155440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdb767-d294-465f-99eb-8b91f6927ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:57.156390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdb767-d294-465f-99eb-8b91f6927ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:57.158949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdb767-d294-465f-99eb-8b91f6927ce9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:57.174956 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1994/3983] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:30:57.179097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7965898-b2c8-42eb-849c-cb36036c1e35 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:57.191211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7965898-b2c8-42eb-849c-cb36036c1e35 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:57.197813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fa206-f825-40ac-afe0-ace5166c3a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:57.199040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fa206-f825-40ac-afe0-ace5166c3a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:57.199479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fa206-f825-40ac-afe0-ace5166c3a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:57.199920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fa206-f825-40ac-afe0-ace5166c3a19 admin admin] PATH_INFO: `/v3/projects/b5649ae2f6674f4cb4154c508918c72a/users/7716a029ed5746719d6983005378891a/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:57.225122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fa206-f825-40ac-afe0-ace5166c3a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5649ae2f6674f4cb4154c508918c72a, user_id=7716a029ed5746719d6983005378891a, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:57.228873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fa206-f825-40ac-afe0-ace5166c3a19 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:57.324588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe18df-5d19-4975-900d-0607b9efe3c3 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:57.325400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe18df-5d19-4975-900d-0607b9efe3c3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:57.325877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe18df-5d19-4975-900d-0607b9efe3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:57.340434 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1990/3984] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:30:57 2022] PUT /identity/v3/projects/b5649ae2f6674f4cb4154c508918c72a/users/7716a029ed5746719d6983005378891a/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:57.374436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c5fe18df-5d19-4975-900d-0607b9efe3c3 None None] MFA Rules not processed for user `7716a029ed5746719d6983005378891a`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:57.376624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c5fe18df-5d19-4975-900d-0607b9efe3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:57.485098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fa206-f825-40ac-afe0-ace5166c3a19 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:57.487855 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1995/3985] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:57.610030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fa206-f825-40ac-afe0-ace5166c3a19 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:57.616917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587471d1-5a68-4907-b608-3a7af62487b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:57.617609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587471d1-5a68-4907-b608-3a7af62487b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:57.617897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587471d1-5a68-4907-b608-3a7af62487b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:57.618174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587471d1-5a68-4907-b608-3a7af62487b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:57.618971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587471d1-5a68-4907-b608-3a7af62487b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:57.622290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587471d1-5a68-4907-b608-3a7af62487b2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:57.726336 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1991/3986] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:30:57 2022] POST /identity/v3/projects => generated 379 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:57.731339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe18df-5d19-4975-900d-0607b9efe3c3 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:57.743407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe18df-5d19-4975-900d-0607b9efe3c3 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:57.851329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd364b3e-9c39-4e17-851a-b79aba9ea212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:57.852116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd364b3e-9c39-4e17-851a-b79aba9ea212 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:57.852502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd364b3e-9c39-4e17-851a-b79aba9ea212 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:57.852812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd364b3e-9c39-4e17-851a-b79aba9ea212 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:57.853626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd364b3e-9c39-4e17-851a-b79aba9ea212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:57.877582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd364b3e-9c39-4e17-851a-b79aba9ea212 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:58.005822 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1996/3987] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:30:57 2022] POST /identity/v3/users => generated 290 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:30:58.009890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587471d1-5a68-4907-b608-3a7af62487b2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:58.026462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587471d1-5a68-4907-b608-3a7af62487b2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:58.036547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d312e8-7800-42a3-863d-eb71299d5342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:58.037975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d312e8-7800-42a3-863d-eb71299d5342 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:58.038424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d312e8-7800-42a3-863d-eb71299d5342 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:58.038858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d312e8-7800-42a3-863d-eb71299d5342 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:58.039775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d312e8-7800-42a3-863d-eb71299d5342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:58.042023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d312e8-7800-42a3-863d-eb71299d5342 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:58.058533 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1992/3988] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:30:58.060774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd364b3e-9c39-4e17-851a-b79aba9ea212 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:58.073686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd364b3e-9c39-4e17-851a-b79aba9ea212 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:58.080272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcb25f-aafc-4f17-a592-72424bcdc39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:58.081345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcb25f-aafc-4f17-a592-72424bcdc39c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:58.083342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcb25f-aafc-4f17-a592-72424bcdc39c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:58.084202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcb25f-aafc-4f17-a592-72424bcdc39c admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:58.085216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcb25f-aafc-4f17-a592-72424bcdc39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:58.087106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcb25f-aafc-4f17-a592-72424bcdc39c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:58.106797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d312e8-7800-42a3-863d-eb71299d5342 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:58.120209 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1997/3989] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:30:58.122112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d312e8-7800-42a3-863d-eb71299d5342 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:58.129151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977120bd-e183-4790-92a6-303562efda88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:58.131033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977120bd-e183-4790-92a6-303562efda88 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:58.131512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977120bd-e183-4790-92a6-303562efda88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:58.131936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977120bd-e183-4790-92a6-303562efda88 admin admin] PATH_INFO: `/v3/projects/07fe21ffc02746708a97e66e47c56a56/users/004001d2e4b1469c800235fd290a4982/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:58.153277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977120bd-e183-4790-92a6-303562efda88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07fe21ffc02746708a97e66e47c56a56, user_id=004001d2e4b1469c800235fd290a4982, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:58.158082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977120bd-e183-4790-92a6-303562efda88 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:58.264393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f5853-7fde-4228-a7e2-ba5537181fd2 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:58.264717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f5853-7fde-4228-a7e2-ba5537181fd2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:58.265003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f5853-7fde-4228-a7e2-ba5537181fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:58.270955 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1993/3990] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:30:58 2022] PUT /identity/v3/projects/07fe21ffc02746708a97e66e47c56a56/users/004001d2e4b1469c800235fd290a4982/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:30:58.296207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b56f5853-7fde-4228-a7e2-ba5537181fd2 None None] MFA Rules not processed for user `004001d2e4b1469c800235fd290a4982`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:58.297672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b56f5853-7fde-4228-a7e2-ba5537181fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:58.376780 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1998/3991] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:58.382136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977120bd-e183-4790-92a6-303562efda88 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:58.459516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977120bd-e183-4790-92a6-303562efda88 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:58.470436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcfd08-7d14-45c0-ae23-1bdd537b151a tempest-IdentityV3ProjectsTest-1118497556 tempest-IdentityV3ProjectsTest-1118497556-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7716a029ed5746719d6983005378891a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5649ae2f6674f4cb4154c508918c72a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:58.472440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcfd08-7d14-45c0-ae23-1bdd537b151a tempest-IdentityV3ProjectsTest-1118497556 tempest-IdentityV3ProjectsTest-1118497556-project] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:58.472785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcfd08-7d14-45c0-ae23-1bdd537b151a tempest-IdentityV3ProjectsTest-1118497556 tempest-IdentityV3ProjectsTest-1118497556-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:58.473401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcfd08-7d14-45c0-ae23-1bdd537b151a tempest-IdentityV3ProjectsTest-1118497556 tempest-IdentityV3ProjectsTest-1118497556-project] PATH_INFO: `/v3/users/7716a029ed5746719d6983005378891a/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:58.475634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcfd08-7d14-45c0-ae23-1bdd537b151a tempest-IdentityV3ProjectsTest-1118497556 tempest-IdentityV3ProjectsTest-1118497556-project] RBAC: Authorizing `identity:list_user_projects(user_id=7716a029ed5746719d6983005378891a)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:58.481521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcfd08-7d14-45c0-ae23-1bdd537b151a tempest-IdentityV3ProjectsTest-1118497556 tempest-IdentityV3ProjectsTest-1118497556-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:58.548206 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1994/3992] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 2 10:30:58 2022] GET /identity/v3/users/7716a029ed5746719d6983005378891a/projects => generated 517 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:30:58.552852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2ccee-a592-4f6e-bcef-8196f0383007 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:58.553419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2ccee-a592-4f6e-bcef-8196f0383007 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:58.553848 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2ccee-a592-4f6e-bcef-8196f0383007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:58.589521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b0f2ccee-a592-4f6e-bcef-8196f0383007 None None] MFA Rules not processed for user `7716a029ed5746719d6983005378891a`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:58.591059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b0f2ccee-a592-4f6e-bcef-8196f0383007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:58.600188 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 1999/3993] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:30:58.604956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb9fe7-ca19-44bd-866c-ce4dff543796 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:58.605306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb9fe7-ca19-44bd-866c-ce4dff543796 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:58.605597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb9fe7-ca19-44bd-866c-ce4dff543796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:58.630262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2fbb9fe7-ca19-44bd-866c-ce4dff543796 None None] MFA Rules not processed for user `7716a029ed5746719d6983005378891a`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:58.633414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2fbb9fe7-ca19-44bd-866c-ce4dff543796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:58.725929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.models.token_model [None req-2fbb9fe7-ca19-44bd-866c-ce4dff543796 None None] User 7716a029ed5746719d6983005378891a has no access to project 07fe21ffc02746708a97e66e47c56a56 {{(pid=91118) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} May 02 10:30:58.731442 ncdv-master-1 devstack@keystone.service[91118]: WARNING keystone.server.flask.application [None req-2fbb9fe7-ca19-44bd-866c-ce4dff543796 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. May 02 10:30:58.738552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2ccee-a592-4f6e-bcef-8196f0383007 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:58.738791 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1995/3994] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:58 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 135 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) May 02 10:30:58.911872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8da44-d1f9-4349-abe9-6c3dce625c21 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:58.912685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8da44-d1f9-4349-abe9-6c3dce625c21 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:58.912979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8da44-d1f9-4349-abe9-6c3dce625c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:58.977020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2ccee-a592-4f6e-bcef-8196f0383007 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:58.989558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6ea8da44-d1f9-4349-abe9-6c3dce625c21 None None] MFA Rules not processed for user `e3d3dea2740e4e46ae98265dcade1291`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:58.990485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6ea8da44-d1f9-4349-abe9-6c3dce625c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:58.991630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44f9eb-4d48-46d2-9df2-8021ee20dbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:58.992554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44f9eb-4d48-46d2-9df2-8021ee20dbf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:58.994126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44f9eb-4d48-46d2-9df2-8021ee20dbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:58.994511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44f9eb-4d48-46d2-9df2-8021ee20dbf0 admin admin] PATH_INFO: `/v3/users/7716a029ed5746719d6983005378891a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:58.996938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44f9eb-4d48-46d2-9df2-8021ee20dbf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7716a029ed5746719d6983005378891a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:59.002917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44f9eb-4d48-46d2-9df2-8021ee20dbf0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:59.111669 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1996/3995] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:59.252903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6f44f9eb-4d48-46d2-9df2-8021ee20dbf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7716a029ed5746719d6983005378891a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:59.279304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6f44f9eb-4d48-46d2-9df2-8021ee20dbf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7716a029ed5746719d6983005378891a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:59.280594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6f44f9eb-4d48-46d2-9df2-8021ee20dbf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7716a029ed5746719d6983005378891a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:59.292448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6f44f9eb-4d48-46d2-9df2-8021ee20dbf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7716a029ed5746719d6983005378891a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:59.422883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6f44f9eb-4d48-46d2-9df2-8021ee20dbf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7716a029ed5746719d6983005378891a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:30:59.434238 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2000/3996] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:30:58 2022] DELETE /identity/v3/users/7716a029ed5746719d6983005378891a => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:30:59.439140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435bd35-5b73-4deb-830e-cfc9842e7019 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:59.439483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435bd35-5b73-4deb-830e-cfc9842e7019 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:59.439725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435bd35-5b73-4deb-830e-cfc9842e7019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:59.461782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c435bd35-5b73-4deb-830e-cfc9842e7019 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:30:59.464410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c435bd35-5b73-4deb-830e-cfc9842e7019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:59.604159 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1997/3997] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:30:59.631785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44f9eb-4d48-46d2-9df2-8021ee20dbf0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:59.633322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6f44f9eb-4d48-46d2-9df2-8021ee20dbf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:59.740831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44f9eb-4d48-46d2-9df2-8021ee20dbf0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:59.745149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8984f-3d2b-4c1d-8d54-bed911c20be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:59.746168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8984f-3d2b-4c1d-8d54-bed911c20be4 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:59.746632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8984f-3d2b-4c1d-8d54-bed911c20be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:59.747281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8984f-3d2b-4c1d-8d54-bed911c20be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:59.763172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8984f-3d2b-4c1d-8d54-bed911c20be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:59.764805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8984f-3d2b-4c1d-8d54-bed911c20be4 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:30:59.776926 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2001/3998] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:30:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:30:59.909252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435bd35-5b73-4deb-830e-cfc9842e7019 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:30:59.911062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c435bd35-5b73-4deb-830e-cfc9842e7019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:59.932795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435bd35-5b73-4deb-830e-cfc9842e7019 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:30:59.951319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53734098-1787-4bff-90b4-d9426fd5ff35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:30:59.952046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53734098-1787-4bff-90b4-d9426fd5ff35 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:30:59.952336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53734098-1787-4bff-90b4-d9426fd5ff35 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:30:59.952642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53734098-1787-4bff-90b4-d9426fd5ff35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:30:59.959204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-53734098-1787-4bff-90b4-d9426fd5ff35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:30:59.989325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53734098-1787-4bff-90b4-d9426fd5ff35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:30:59.991828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53734098-1787-4bff-90b4-d9426fd5ff35 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:00.011051 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1998/3999] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:30:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:31:01.609800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8984f-3d2b-4c1d-8d54-bed911c20be4 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:01.612780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6ec8984f-3d2b-4c1d-8d54-bed911c20be4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:01.630073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8984f-3d2b-4c1d-8d54-bed911c20be4 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:01.648213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae773c-2d1a-44b5-90b0-c5d09c1cdf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:01.649336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae773c-2d1a-44b5-90b0-c5d09c1cdf78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:01.650269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae773c-2d1a-44b5-90b0-c5d09c1cdf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:01.652075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae773c-2d1a-44b5-90b0-c5d09c1cdf78 admin admin] PATH_INFO: `/v3/projects/b5649ae2f6674f4cb4154c508918c72a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:01.653656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae773c-2d1a-44b5-90b0-c5d09c1cdf78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5649ae2f6674f4cb4154c508918c72a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:01.660935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae773c-2d1a-44b5-90b0-c5d09c1cdf78 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:01.876103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bcae773c-2d1a-44b5-90b0-c5d09c1cdf78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5649ae2f6674f4cb4154c508918c72a', 'request_id': 'req-bcae773c-2d1a-44b5-90b0-c5d09c1cdf78'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:01.890460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bcae773c-2d1a-44b5-90b0-c5d09c1cdf78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5649ae2f6674f4cb4154c508918c72a', 'request_id': 'req-bcae773c-2d1a-44b5-90b0-c5d09c1cdf78'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:02.066599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bcae773c-2d1a-44b5-90b0-c5d09c1cdf78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5649ae2f6674f4cb4154c508918c72a', 'request_id': 'req-bcae773c-2d1a-44b5-90b0-c5d09c1cdf78'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:02.088940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bcae773c-2d1a-44b5-90b0-c5d09c1cdf78 admin admin] The token cache is being invalidate because project b5649ae2f6674f4cb4154c508918c72a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:31:02.090127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bcae773c-2d1a-44b5-90b0-c5d09c1cdf78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:02.099580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bcae773c-2d1a-44b5-90b0-c5d09c1cdf78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:02.104918 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2002/4000] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:31:01 2022] DELETE /identity/v3/projects/b5649ae2f6674f4cb4154c508918c72a => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:02.106123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53734098-1787-4bff-90b4-d9426fd5ff35 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:02.164488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53734098-1787-4bff-90b4-d9426fd5ff35 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:02.250628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9182517-759d-4881-b683-7540f5737f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:02.251600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9182517-759d-4881-b683-7540f5737f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:02.251972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9182517-759d-4881-b683-7540f5737f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:02.252329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9182517-759d-4881-b683-7540f5737f9f admin admin] PATH_INFO: `/v3/users/004001d2e4b1469c800235fd290a4982` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:02.253695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9182517-759d-4881-b683-7540f5737f9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=004001d2e4b1469c800235fd290a4982)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:02.256027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9182517-759d-4881-b683-7540f5737f9f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:02.862044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d9182517-759d-4881-b683-7540f5737f9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '004001d2e4b1469c800235fd290a4982'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:02.893936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d9182517-759d-4881-b683-7540f5737f9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '004001d2e4b1469c800235fd290a4982'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:02.893936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d9182517-759d-4881-b683-7540f5737f9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '004001d2e4b1469c800235fd290a4982'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:02.909598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d9182517-759d-4881-b683-7540f5737f9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '004001d2e4b1469c800235fd290a4982'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:03.005787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d9182517-759d-4881-b683-7540f5737f9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '004001d2e4b1469c800235fd290a4982'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:03.011297 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 1999/4001] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:31:02 2022] DELETE /identity/v3/users/004001d2e4b1469c800235fd290a4982 => generated 0 bytes in 906 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:04.409920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12df41-0cee-40e8-8d5f-b810529130fa None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:04.410906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12df41-0cee-40e8-8d5f-b810529130fa None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:04.411202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12df41-0cee-40e8-8d5f-b810529130fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:04.455526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4a12df41-0cee-40e8-8d5f-b810529130fa None None] MFA Rules not processed for user `4368e1c27d6941b09dacd4591bcbecbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:04.456789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4a12df41-0cee-40e8-8d5f-b810529130fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:04.547066 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2003/4002] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:04.557781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9182517-759d-4881-b683-7540f5737f9f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:04.559312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d9182517-759d-4881-b683-7540f5737f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:04.574861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12df41-0cee-40e8-8d5f-b810529130fa None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:04.578469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4a12df41-0cee-40e8-8d5f-b810529130fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:04.676368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12df41-0cee-40e8-8d5f-b810529130fa None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:04.681124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9182517-759d-4881-b683-7540f5737f9f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:04.682126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c471c-9650-4895-8a27-7e70a52bbdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:04.683110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c471c-9650-4895-8a27-7e70a52bbdf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:04.683404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c471c-9650-4895-8a27-7e70a52bbdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:04.683682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c471c-9650-4895-8a27-7e70a52bbdf1 admin admin] PATH_INFO: `/v3/projects/07fe21ffc02746708a97e66e47c56a56` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:04.685200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c471c-9650-4895-8a27-7e70a52bbdf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07fe21ffc02746708a97e66e47c56a56)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:04.690496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c471c-9650-4895-8a27-7e70a52bbdf1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:04.696402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15989f5a-be53-4c04-a4db-81cc8220a550 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:04.697140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15989f5a-be53-4c04-a4db-81cc8220a550 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:04.697427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15989f5a-be53-4c04-a4db-81cc8220a550 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:04.697702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15989f5a-be53-4c04-a4db-81cc8220a550 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:04.709405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15989f5a-be53-4c04-a4db-81cc8220a550 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:04.711193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15989f5a-be53-4c04-a4db-81cc8220a550 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:04.722324 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2000/4003] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:04 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:31:04.846421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e90c471c-9650-4895-8a27-7e70a52bbdf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07fe21ffc02746708a97e66e47c56a56', 'request_id': 'req-e90c471c-9650-4895-8a27-7e70a52bbdf1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:04.856074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e90c471c-9650-4895-8a27-7e70a52bbdf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07fe21ffc02746708a97e66e47c56a56', 'request_id': 'req-e90c471c-9650-4895-8a27-7e70a52bbdf1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:04.924008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e90c471c-9650-4895-8a27-7e70a52bbdf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07fe21ffc02746708a97e66e47c56a56', 'request_id': 'req-e90c471c-9650-4895-8a27-7e70a52bbdf1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:04.940218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e90c471c-9650-4895-8a27-7e70a52bbdf1 admin admin] The token cache is being invalidate because project 07fe21ffc02746708a97e66e47c56a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:31:04.940751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e90c471c-9650-4895-8a27-7e70a52bbdf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:04.941429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e90c471c-9650-4895-8a27-7e70a52bbdf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:04.943671 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2004/4004] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:31:04 2022] DELETE /identity/v3/projects/07fe21ffc02746708a97e66e47c56a56 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:31:04.950512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fb39c-95a9-4cfe-b88f-1e287d7b0cac None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:04.950921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fb39c-95a9-4cfe-b88f-1e287d7b0cac None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:04.951936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fb39c-95a9-4cfe-b88f-1e287d7b0cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:04.984771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f70fb39c-95a9-4cfe-b88f-1e287d7b0cac None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:04.986357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f70fb39c-95a9-4cfe-b88f-1e287d7b0cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:05.094241 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2001/4005] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:31:05.101915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790aa50-6a94-4ba7-b384-19ded58bc3ea None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:05.106843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790aa50-6a94-4ba7-b384-19ded58bc3ea None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:05.106843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790aa50-6a94-4ba7-b384-19ded58bc3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:05.153663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a790aa50-6a94-4ba7-b384-19ded58bc3ea None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:05.155276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a790aa50-6a94-4ba7-b384-19ded58bc3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:05.170339 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2005/4006] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:05.171403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fb39c-95a9-4cfe-b88f-1e287d7b0cac None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:05.186944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fb39c-95a9-4cfe-b88f-1e287d7b0cac None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:05.199208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03f0b1-485c-41c6-acd5-9dfd7643bee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:05.199208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03f0b1-485c-41c6-acd5-9dfd7643bee7 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:05.199208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03f0b1-485c-41c6-acd5-9dfd7643bee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:05.199208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03f0b1-485c-41c6-acd5-9dfd7643bee7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:05.199815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03f0b1-485c-41c6-acd5-9dfd7643bee7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:31:05.199815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03f0b1-485c-41c6-acd5-9dfd7643bee7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:05.199815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03f0b1-485c-41c6-acd5-9dfd7643bee7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:05.252238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790aa50-6a94-4ba7-b384-19ded58bc3ea None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:05.254202 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2002/4007] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:31:05.268217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790aa50-6a94-4ba7-b384-19ded58bc3ea None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:05.284628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe2b5a-7a6f-42f0-8c95-2e0884aca8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:05.285793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe2b5a-7a6f-42f0-8c95-2e0884aca8ba admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:05.286091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe2b5a-7a6f-42f0-8c95-2e0884aca8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:05.286375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe2b5a-7a6f-42f0-8c95-2e0884aca8ba admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:05.287083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe2b5a-7a6f-42f0-8c95-2e0884aca8ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:05.289091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe2b5a-7a6f-42f0-8c95-2e0884aca8ba admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:05.408284 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2006/4008] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:31:05 2022] POST /identity/v3/projects => generated 397 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:31:05.412447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03f0b1-485c-41c6-acd5-9dfd7643bee7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:05.429663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03f0b1-485c-41c6-acd5-9dfd7643bee7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:05.523420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb32ea-3ba1-4daf-89e3-01016b4bae04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:05.524193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb32ea-3ba1-4daf-89e3-01016b4bae04 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:05.524850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb32ea-3ba1-4daf-89e3-01016b4bae04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:05.525335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb32ea-3ba1-4daf-89e3-01016b4bae04 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:05.526263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb32ea-3ba1-4daf-89e3-01016b4bae04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:05.528850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb32ea-3ba1-4daf-89e3-01016b4bae04 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:05.632932 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2003/4009] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:31:05 2022] POST /identity/v3/users => generated 305 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:31:05.637002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe2b5a-7a6f-42f0-8c95-2e0884aca8ba admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:05.647408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe2b5a-7a6f-42f0-8c95-2e0884aca8ba admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:05.652242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a17e8c-711a-4de3-9da2-009edc7b00c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:05.652948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a17e8c-711a-4de3-9da2-009edc7b00c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:05.653239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a17e8c-711a-4de3-9da2-009edc7b00c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:05.653547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a17e8c-711a-4de3-9da2-009edc7b00c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:05.654339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a17e8c-711a-4de3-9da2-009edc7b00c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:05.656475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a17e8c-711a-4de3-9da2-009edc7b00c1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:05.667899 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2007/4010] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:31:05.673715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb32ea-3ba1-4daf-89e3-01016b4bae04 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:05.689802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb32ea-3ba1-4daf-89e3-01016b4bae04 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:05.690641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6526da-23c7-46a4-9f95-92a7dfeab977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:05.691766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6526da-23c7-46a4-9f95-92a7dfeab977 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:05.691898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6526da-23c7-46a4-9f95-92a7dfeab977 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:05.692114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6526da-23c7-46a4-9f95-92a7dfeab977 admin admin] PATH_INFO: `/v3/projects/9c162e19bf5d4b2caafed87a26788564/users/760b7d04c6654d6bbd1027b6b4acc1c9/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:05.709724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6526da-23c7-46a4-9f95-92a7dfeab977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c162e19bf5d4b2caafed87a26788564, user_id=760b7d04c6654d6bbd1027b6b4acc1c9, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:05.712720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6526da-23c7-46a4-9f95-92a7dfeab977 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:05.836992 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2004/4011] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:31:05 2022] PUT /identity/v3/projects/9c162e19bf5d4b2caafed87a26788564/users/760b7d04c6654d6bbd1027b6b4acc1c9/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:05.840752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a17e8c-711a-4de3-9da2-009edc7b00c1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:05.856622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a17e8c-711a-4de3-9da2-009edc7b00c1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:05.920900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838c8ea-6494-4010-8425-02ab7898fc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:05.922035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838c8ea-6494-4010-8425-02ab7898fc7e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:05.922310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838c8ea-6494-4010-8425-02ab7898fc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:05.922761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838c8ea-6494-4010-8425-02ab7898fc7e admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:05.923919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838c8ea-6494-4010-8425-02ab7898fc7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:05.925857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838c8ea-6494-4010-8425-02ab7898fc7e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:05.938155 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2008/4012] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:31:05.942113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6526da-23c7-46a4-9f95-92a7dfeab977 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:05.957213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6526da-23c7-46a4-9f95-92a7dfeab977 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:05.964393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dda1e-adb2-4050-b2c5-32f0115ff04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:05.965479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dda1e-adb2-4050-b2c5-32f0115ff04c admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:05.965769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dda1e-adb2-4050-b2c5-32f0115ff04c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:05.966053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dda1e-adb2-4050-b2c5-32f0115ff04c admin admin] PATH_INFO: `/v3/projects/9c162e19bf5d4b2caafed87a26788564/users/760b7d04c6654d6bbd1027b6b4acc1c9/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:05.968856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dda1e-adb2-4050-b2c5-32f0115ff04c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c162e19bf5d4b2caafed87a26788564, user_id=760b7d04c6654d6bbd1027b6b4acc1c9, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:05.974370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dda1e-adb2-4050-b2c5-32f0115ff04c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:05.983988 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2005/4013] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:31:05 2022] PUT /identity/v3/projects/9c162e19bf5d4b2caafed87a26788564/users/760b7d04c6654d6bbd1027b6b4acc1c9/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:05.997236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9541915-faee-4c50-8e0e-94cd8a40ea19 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:05.997236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9541915-faee-4c50-8e0e-94cd8a40ea19 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:05.997475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9541915-faee-4c50-8e0e-94cd8a40ea19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:06.028714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b9541915-faee-4c50-8e0e-94cd8a40ea19 None None] MFA Rules not processed for user `760b7d04c6654d6bbd1027b6b4acc1c9`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:06.031019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b9541915-faee-4c50-8e0e-94cd8a40ea19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:06.151772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dda1e-adb2-4050-b2c5-32f0115ff04c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:06.155147 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2009/4014] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:06.314443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dda1e-adb2-4050-b2c5-32f0115ff04c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:06.324652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b0ebb-1eda-4ad8-aad6-4917d981074d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:06.325350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b0ebb-1eda-4ad8-aad6-4917d981074d admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:06.325634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b0ebb-1eda-4ad8-aad6-4917d981074d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:06.325915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b0ebb-1eda-4ad8-aad6-4917d981074d admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:06.329887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b0ebb-1eda-4ad8-aad6-4917d981074d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:06.335160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b0ebb-1eda-4ad8-aad6-4917d981074d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:06.445510 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2006/4015] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:31:06 2022] POST /identity/v3/projects => generated 395 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:31:06.449430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9541915-faee-4c50-8e0e-94cd8a40ea19 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:06.466866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9541915-faee-4c50-8e0e-94cd8a40ea19 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:06.627752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919b2d9-da19-4d09-a2de-22766b912446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:06.628509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919b2d9-da19-4d09-a2de-22766b912446 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:06.629442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919b2d9-da19-4d09-a2de-22766b912446 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:06.629798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919b2d9-da19-4d09-a2de-22766b912446 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:06.632432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919b2d9-da19-4d09-a2de-22766b912446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:06.634810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919b2d9-da19-4d09-a2de-22766b912446 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:06.734902 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2010/4016] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:31:06 2022] POST /identity/v3/users => generated 298 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:31:06.738506 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b0ebb-1eda-4ad8-aad6-4917d981074d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:06.761227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b0ebb-1eda-4ad8-aad6-4917d981074d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:06.780828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4327ea-4c65-4ebc-a270-4ba73d742a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:06.784210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4327ea-4c65-4ebc-a270-4ba73d742a56 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:06.784210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4327ea-4c65-4ebc-a270-4ba73d742a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:06.784210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4327ea-4c65-4ebc-a270-4ba73d742a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:06.784210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4327ea-4c65-4ebc-a270-4ba73d742a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:06.784706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4327ea-4c65-4ebc-a270-4ba73d742a56 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:06.817832 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2007/4017] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:31:06.821959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919b2d9-da19-4d09-a2de-22766b912446 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:06.839379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919b2d9-da19-4d09-a2de-22766b912446 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:06.856942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627c923-8384-4baa-91f6-da44fd092ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:06.858149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627c923-8384-4baa-91f6-da44fd092ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:06.858433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627c923-8384-4baa-91f6-da44fd092ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:06.858710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627c923-8384-4baa-91f6-da44fd092ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:06.859448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627c923-8384-4baa-91f6-da44fd092ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:06.861103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627c923-8384-4baa-91f6-da44fd092ab7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:06.911363 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2011/4018] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:31:06.916237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4327ea-4c65-4ebc-a270-4ba73d742a56 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:06.941929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4327ea-4c65-4ebc-a270-4ba73d742a56 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:06.957722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a548633-b7aa-43e9-85ba-ec4dc82e7c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:06.958655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a548633-b7aa-43e9-85ba-ec4dc82e7c95 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:06.958939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a548633-b7aa-43e9-85ba-ec4dc82e7c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:06.959220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a548633-b7aa-43e9-85ba-ec4dc82e7c95 admin admin] PATH_INFO: `/v3/projects/9ef72d25906b4895aea1c99bb66c9962/users/df4ccb5e2ec44037ba47fc52f050966d/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:06.995348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a548633-b7aa-43e9-85ba-ec4dc82e7c95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ef72d25906b4895aea1c99bb66c9962, user_id=df4ccb5e2ec44037ba47fc52f050966d, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:07.017627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a548633-b7aa-43e9-85ba-ec4dc82e7c95 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:07.152904 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2008/4019] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:31:06 2022] PUT /identity/v3/projects/9ef72d25906b4895aea1c99bb66c9962/users/df4ccb5e2ec44037ba47fc52f050966d/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:07.242162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a16b8-8f16-422b-9f1a-7b740b00c728 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:07.242480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a16b8-8f16-422b-9f1a-7b740b00c728 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:07.242732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a16b8-8f16-422b-9f1a-7b740b00c728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:07.325154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b51a16b8-8f16-422b-9f1a-7b740b00c728 None None] MFA Rules not processed for user `df4ccb5e2ec44037ba47fc52f050966d`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:07.343667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b51a16b8-8f16-422b-9f1a-7b740b00c728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:07.519167 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2012/4020] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:07.530261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a548633-b7aa-43e9-85ba-ec4dc82e7c95 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:07.532349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2a548633-b7aa-43e9-85ba-ec4dc82e7c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:07.706307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a548633-b7aa-43e9-85ba-ec4dc82e7c95 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:07.711891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea10b7-279a-4317-90b8-01726b984b4b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:07.712697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea10b7-279a-4317-90b8-01726b984b4b service glance] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:07.712881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea10b7-279a-4317-90b8-01726b984b4b service glance] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:07.713135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea10b7-279a-4317-90b8-01726b984b4b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:07.850184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea10b7-279a-4317-90b8-01726b984b4b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:07.851661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea10b7-279a-4317-90b8-01726b984b4b service glance] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:07.892990 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2009/4021] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:31:08.370139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1827d-5f41-4524-adc5-eb9d14aacb3f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:08.370628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1827d-5f41-4524-adc5-eb9d14aacb3f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:08.370989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1827d-5f41-4524-adc5-eb9d14aacb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:08.459269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-1cb1827d-5f41-4524-adc5-eb9d14aacb3f None None] MFA Rules not processed for user `04881f915cde4c29b57c9173ab754cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:08.461942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1cb1827d-5f41-4524-adc5-eb9d14aacb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:08.642549 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2013/4022] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:09.028740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea10b7-279a-4317-90b8-01726b984b4b service glance] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:09.144254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea10b7-279a-4317-90b8-01726b984b4b service glance] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:09.157688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa69eac-cd38-435c-a3e8-e8977e28cb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:09.159515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa69eac-cd38-435c-a3e8-e8977e28cb5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:09.163992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa69eac-cd38-435c-a3e8-e8977e28cb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:09.163992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa69eac-cd38-435c-a3e8-e8977e28cb5b admin admin] PATH_INFO: `/v3/users/760b7d04c6654d6bbd1027b6b4acc1c9` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:09.163992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa69eac-cd38-435c-a3e8-e8977e28cb5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=760b7d04c6654d6bbd1027b6b4acc1c9)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:09.165872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa69eac-cd38-435c-a3e8-e8977e28cb5b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:09.347872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1aa69eac-cd38-435c-a3e8-e8977e28cb5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '760b7d04c6654d6bbd1027b6b4acc1c9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:09.362724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1aa69eac-cd38-435c-a3e8-e8977e28cb5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '760b7d04c6654d6bbd1027b6b4acc1c9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:09.363557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1aa69eac-cd38-435c-a3e8-e8977e28cb5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '760b7d04c6654d6bbd1027b6b4acc1c9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:09.371206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1aa69eac-cd38-435c-a3e8-e8977e28cb5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '760b7d04c6654d6bbd1027b6b4acc1c9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:09.432398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1aa69eac-cd38-435c-a3e8-e8977e28cb5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '760b7d04c6654d6bbd1027b6b4acc1c9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:09.443973 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2010/4023] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:31:09 2022] DELETE /identity/v3/users/760b7d04c6654d6bbd1027b6b4acc1c9 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:09.448453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d2e45-078d-4fab-a6ed-314c3c2f1652 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:09.449059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d2e45-078d-4fab-a6ed-314c3c2f1652 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:09.449059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d2e45-078d-4fab-a6ed-314c3c2f1652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:09.477075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c48d2e45-078d-4fab-a6ed-314c3c2f1652 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:09.479114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c48d2e45-078d-4fab-a6ed-314c3c2f1652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:09.551960 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2014/4024] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:09.575571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa69eac-cd38-435c-a3e8-e8977e28cb5b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:09.577144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1aa69eac-cd38-435c-a3e8-e8977e28cb5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:09.644307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa69eac-cd38-435c-a3e8-e8977e28cb5b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:09.648503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c763e-3c5f-42d8-b751-aa212f240ca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:09.649435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c763e-3c5f-42d8-b751-aa212f240ca3 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:09.649727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c763e-3c5f-42d8-b751-aa212f240ca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:09.650056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c763e-3c5f-42d8-b751-aa212f240ca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:09.664120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c763e-3c5f-42d8-b751-aa212f240ca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:09.666275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c763e-3c5f-42d8-b751-aa212f240ca3 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:09.687332 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2011/4025] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:31:11.179327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d2e45-078d-4fab-a6ed-314c3c2f1652 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:11.180987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c48d2e45-078d-4fab-a6ed-314c3c2f1652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:11.197403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d2e45-078d-4fab-a6ed-314c3c2f1652 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:11.205965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef391589-9344-4086-9e21-b495a54688d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:11.207332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef391589-9344-4086-9e21-b495a54688d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:11.207870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef391589-9344-4086-9e21-b495a54688d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:11.208361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef391589-9344-4086-9e21-b495a54688d6 admin admin] PATH_INFO: `/v3/projects/9c162e19bf5d4b2caafed87a26788564` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:11.210132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef391589-9344-4086-9e21-b495a54688d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c162e19bf5d4b2caafed87a26788564)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:11.212916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef391589-9344-4086-9e21-b495a54688d6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:11.367787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ef391589-9344-4086-9e21-b495a54688d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c162e19bf5d4b2caafed87a26788564', 'request_id': 'req-ef391589-9344-4086-9e21-b495a54688d6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:11.374791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ef391589-9344-4086-9e21-b495a54688d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c162e19bf5d4b2caafed87a26788564', 'request_id': 'req-ef391589-9344-4086-9e21-b495a54688d6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:11.560887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ef391589-9344-4086-9e21-b495a54688d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c162e19bf5d4b2caafed87a26788564', 'request_id': 'req-ef391589-9344-4086-9e21-b495a54688d6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:11.573206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ef391589-9344-4086-9e21-b495a54688d6 admin admin] The token cache is being invalidate because project 9c162e19bf5d4b2caafed87a26788564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:31:11.573724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ef391589-9344-4086-9e21-b495a54688d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:11.574753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ef391589-9344-4086-9e21-b495a54688d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:11.577223 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2015/4026] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:31:11 2022] DELETE /identity/v3/projects/9c162e19bf5d4b2caafed87a26788564 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:11.581555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c763e-3c5f-42d8-b751-aa212f240ca3 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:11.593346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c763e-3c5f-42d8-b751-aa212f240ca3 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:11.680693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19951cac-2f32-4c1b-806c-a60943779b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:11.682832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19951cac-2f32-4c1b-806c-a60943779b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:11.683521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19951cac-2f32-4c1b-806c-a60943779b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:11.684028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19951cac-2f32-4c1b-806c-a60943779b98 admin admin] PATH_INFO: `/v3/users/df4ccb5e2ec44037ba47fc52f050966d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:11.686626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19951cac-2f32-4c1b-806c-a60943779b98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df4ccb5e2ec44037ba47fc52f050966d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:11.689822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19951cac-2f32-4c1b-806c-a60943779b98 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:11.732021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6338d8-4db6-4231-ad5d-11df77302add None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:11.732384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6338d8-4db6-4231-ad5d-11df77302add None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:11.732673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6338d8-4db6-4231-ad5d-11df77302add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:11.753123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2f6338d8-4db6-4231-ad5d-11df77302add None None] MFA Rules not processed for user `4368e1c27d6941b09dacd4591bcbecbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:11.754971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2f6338d8-4db6-4231-ad5d-11df77302add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:11.844128 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2016/4027] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:11.897692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-19951cac-2f32-4c1b-806c-a60943779b98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df4ccb5e2ec44037ba47fc52f050966d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:11.918601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-19951cac-2f32-4c1b-806c-a60943779b98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df4ccb5e2ec44037ba47fc52f050966d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:11.919822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-19951cac-2f32-4c1b-806c-a60943779b98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df4ccb5e2ec44037ba47fc52f050966d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:11.928515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-19951cac-2f32-4c1b-806c-a60943779b98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df4ccb5e2ec44037ba47fc52f050966d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:12.026392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-19951cac-2f32-4c1b-806c-a60943779b98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df4ccb5e2ec44037ba47fc52f050966d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:12.038739 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2012/4028] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:31:11 2022] DELETE /identity/v3/users/df4ccb5e2ec44037ba47fc52f050966d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:12.855893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6338d8-4db6-4231-ad5d-11df77302add None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:12.857537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2f6338d8-4db6-4231-ad5d-11df77302add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:12.893197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6338d8-4db6-4231-ad5d-11df77302add None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:12.956407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ffd3f-78fb-448a-bc53-68e9d38dc418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:12.956945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ffd3f-78fb-448a-bc53-68e9d38dc418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:12.957326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ffd3f-78fb-448a-bc53-68e9d38dc418 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:12.957728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ffd3f-78fb-448a-bc53-68e9d38dc418 admin admin] PATH_INFO: `/v3/projects/9ef72d25906b4895aea1c99bb66c9962` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:12.959205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ffd3f-78fb-448a-bc53-68e9d38dc418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ef72d25906b4895aea1c99bb66c9962)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:12.961955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ffd3f-78fb-448a-bc53-68e9d38dc418 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:13.097372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5a3ffd3f-78fb-448a-bc53-68e9d38dc418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ef72d25906b4895aea1c99bb66c9962', 'request_id': 'req-5a3ffd3f-78fb-448a-bc53-68e9d38dc418'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:13.119359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5a3ffd3f-78fb-448a-bc53-68e9d38dc418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ef72d25906b4895aea1c99bb66c9962', 'request_id': 'req-5a3ffd3f-78fb-448a-bc53-68e9d38dc418'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:13.197936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5a3ffd3f-78fb-448a-bc53-68e9d38dc418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ef72d25906b4895aea1c99bb66c9962', 'request_id': 'req-5a3ffd3f-78fb-448a-bc53-68e9d38dc418'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:13.214248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5a3ffd3f-78fb-448a-bc53-68e9d38dc418 admin admin] The token cache is being invalidate because project 9ef72d25906b4895aea1c99bb66c9962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:31:13.214841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5a3ffd3f-78fb-448a-bc53-68e9d38dc418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:13.216192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5a3ffd3f-78fb-448a-bc53-68e9d38dc418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:13.218149 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2017/4029] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:31:12 2022] DELETE /identity/v3/projects/9ef72d25906b4895aea1c99bb66c9962 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:13.223535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148ce8a-cf1e-4730-abbc-f1f79fb27e8a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:13.224036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148ce8a-cf1e-4730-abbc-f1f79fb27e8a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:13.224137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148ce8a-cf1e-4730-abbc-f1f79fb27e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:13.277526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2148ce8a-cf1e-4730-abbc-f1f79fb27e8a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:13.278752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2148ce8a-cf1e-4730-abbc-f1f79fb27e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:13.434658 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2013/4030] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:13.437233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36975ee-053f-4211-aa33-131d70844771 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:13.437769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36975ee-053f-4211-aa33-131d70844771 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:13.438256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36975ee-053f-4211-aa33-131d70844771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:13.465857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d36975ee-053f-4211-aa33-131d70844771 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:13.467134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d36975ee-053f-4211-aa33-131d70844771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:13.483462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148ce8a-cf1e-4730-abbc-f1f79fb27e8a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:13.483739 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2018/4031] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:13.503059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148ce8a-cf1e-4730-abbc-f1f79fb27e8a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:13.520294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdfe11-4cda-4f77-bd31-9cd19b8348da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:13.521020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdfe11-4cda-4f77-bd31-9cd19b8348da admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:13.521310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdfe11-4cda-4f77-bd31-9cd19b8348da admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:13.521614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdfe11-4cda-4f77-bd31-9cd19b8348da admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:13.522791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdfe11-4cda-4f77-bd31-9cd19b8348da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:31:13.523841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdfe11-4cda-4f77-bd31-9cd19b8348da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:13.525694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdfe11-4cda-4f77-bd31-9cd19b8348da admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:13.550122 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2014/4032] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:31:13.554876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36975ee-053f-4211-aa33-131d70844771 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:13.573668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36975ee-053f-4211-aa33-131d70844771 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:13.586806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf3679-c42a-45d3-8cc1-00620bd679bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:13.587941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf3679-c42a-45d3-8cc1-00620bd679bf admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:13.588781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf3679-c42a-45d3-8cc1-00620bd679bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:13.589601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf3679-c42a-45d3-8cc1-00620bd679bf admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:13.592007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf3679-c42a-45d3-8cc1-00620bd679bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:13.594211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf3679-c42a-45d3-8cc1-00620bd679bf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:13.678085 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2019/4033] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:31:13 2022] POST /identity/v3/projects => generated 393 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:31:13.679464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdfe11-4cda-4f77-bd31-9cd19b8348da admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:13.694415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdfe11-4cda-4f77-bd31-9cd19b8348da admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:13.850316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6907a3-3134-46fe-8974-14029c4754e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:13.851026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6907a3-3134-46fe-8974-14029c4754e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:13.851303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6907a3-3134-46fe-8974-14029c4754e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:13.851635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6907a3-3134-46fe-8974-14029c4754e7 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:13.852341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6907a3-3134-46fe-8974-14029c4754e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:13.858373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6907a3-3134-46fe-8974-14029c4754e7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:14.042612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf3679-c42a-45d3-8cc1-00620bd679bf admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:14.043576 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2015/4034] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:31:13 2022] POST /identity/v3/users => generated 303 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:31:14.058433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf3679-c42a-45d3-8cc1-00620bd679bf admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:14.088981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec5ca1-5061-437e-b9ee-070d35d1aa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:14.089684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec5ca1-5061-437e-b9ee-070d35d1aa7a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:14.089975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec5ca1-5061-437e-b9ee-070d35d1aa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:14.090260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec5ca1-5061-437e-b9ee-070d35d1aa7a admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:14.090993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec5ca1-5061-437e-b9ee-070d35d1aa7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:14.093180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec5ca1-5061-437e-b9ee-070d35d1aa7a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:14.132481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6907a3-3134-46fe-8974-14029c4754e7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:14.139948 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2020/4035] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:31:14.152543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6907a3-3134-46fe-8974-14029c4754e7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:14.166285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00157517-cbaa-4e69-9605-0974f27908f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:14.171250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00157517-cbaa-4e69-9605-0974f27908f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:14.171691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00157517-cbaa-4e69-9605-0974f27908f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:14.171987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00157517-cbaa-4e69-9605-0974f27908f0 admin admin] PATH_INFO: `/v3/projects/a72330f3656143c79833786e554e4d3c/users/c9557e06818d47f2a6f01f3a2507433b/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:14.210240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00157517-cbaa-4e69-9605-0974f27908f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a72330f3656143c79833786e554e4d3c, user_id=c9557e06818d47f2a6f01f3a2507433b, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:14.214193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00157517-cbaa-4e69-9605-0974f27908f0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:14.372821 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2016/4036] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:31:14 2022] PUT /identity/v3/projects/a72330f3656143c79833786e554e4d3c/users/c9557e06818d47f2a6f01f3a2507433b/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:14.377964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec5ca1-5061-437e-b9ee-070d35d1aa7a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:14.404792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec5ca1-5061-437e-b9ee-070d35d1aa7a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:14.520865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00157517-cbaa-4e69-9605-0974f27908f0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:14.523030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-00157517-cbaa-4e69-9605-0974f27908f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:14.566270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da4b11-061d-4d5d-9df0-0514159310ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:14.567421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da4b11-061d-4d5d-9df0-0514159310ea admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:14.567711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da4b11-061d-4d5d-9df0-0514159310ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:14.569122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da4b11-061d-4d5d-9df0-0514159310ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:14.569895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da4b11-061d-4d5d-9df0-0514159310ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:14.574453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da4b11-061d-4d5d-9df0-0514159310ea admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:14.592454 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2021/4037] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:31:14.596924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da4b11-061d-4d5d-9df0-0514159310ea admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:14.610145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da4b11-061d-4d5d-9df0-0514159310ea admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:14.618733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff29201-59ec-481b-b944-b27e548b2c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:14.621339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff29201-59ec-481b-b944-b27e548b2c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:14.621339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff29201-59ec-481b-b944-b27e548b2c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:14.621339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff29201-59ec-481b-b944-b27e548b2c25 admin admin] PATH_INFO: `/v3/projects/a72330f3656143c79833786e554e4d3c/users/c9557e06818d47f2a6f01f3a2507433b/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:14.623626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff29201-59ec-481b-b944-b27e548b2c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a72330f3656143c79833786e554e4d3c, user_id=c9557e06818d47f2a6f01f3a2507433b, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:14.627690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff29201-59ec-481b-b944-b27e548b2c25 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:14.647008 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2022/4038] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:31:14 2022] PUT /identity/v3/projects/a72330f3656143c79833786e554e4d3c/users/c9557e06818d47f2a6f01f3a2507433b/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:31:14.647341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00157517-cbaa-4e69-9605-0974f27908f0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:14.658386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7530a9f-dedb-4ee1-83f7-86d850a6e6f4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:14.658910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7530a9f-dedb-4ee1-83f7-86d850a6e6f4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:14.660023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7530a9f-dedb-4ee1-83f7-86d850a6e6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:14.701684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a7530a9f-dedb-4ee1-83f7-86d850a6e6f4 None None] MFA Rules not processed for user `c9557e06818d47f2a6f01f3a2507433b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:14.703455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a7530a9f-dedb-4ee1-83f7-86d850a6e6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:14.741193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d247cd5-d305-4440-ad48-e15ead47a4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:14.742301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d247cd5-d305-4440-ad48-e15ead47a4d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:14.743433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d247cd5-d305-4440-ad48-e15ead47a4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:14.743865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d247cd5-d305-4440-ad48-e15ead47a4d3 admin admin] PATH_INFO: `/v3/users/23a6af7e588542a58e5793b8ea1bb9ed` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:14.745888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d247cd5-d305-4440-ad48-e15ead47a4d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a6af7e588542a58e5793b8ea1bb9ed)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:14.748170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d247cd5-d305-4440-ad48-e15ead47a4d3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:14.814068 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2023/4039] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:31:14.815036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7530a9f-dedb-4ee1-83f7-86d850a6e6f4 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:14.829199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7530a9f-dedb-4ee1-83f7-86d850a6e6f4 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:14.834962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b34d54-d392-4aea-905d-b2120ba515eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:14.835909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b34d54-d392-4aea-905d-b2120ba515eb admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:14.836229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b34d54-d392-4aea-905d-b2120ba515eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:14.836993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b34d54-d392-4aea-905d-b2120ba515eb admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:14.837436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b34d54-d392-4aea-905d-b2120ba515eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:14.839642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b34d54-d392-4aea-905d-b2120ba515eb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:14.969571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2d247cd5-d305-4440-ad48-e15ead47a4d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a6af7e588542a58e5793b8ea1bb9ed'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:14.976009 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2024/4040] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:31:14 2022] POST /identity/v3/projects => generated 393 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:31:14.980049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b34d54-d392-4aea-905d-b2120ba515eb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:14.998147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2d247cd5-d305-4440-ad48-e15ead47a4d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a6af7e588542a58e5793b8ea1bb9ed'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:14.999748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2d247cd5-d305-4440-ad48-e15ead47a4d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a6af7e588542a58e5793b8ea1bb9ed'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:15.010903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2d247cd5-d305-4440-ad48-e15ead47a4d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a6af7e588542a58e5793b8ea1bb9ed'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:15.090013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b34d54-d392-4aea-905d-b2120ba515eb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:15.121061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90b4f4-878d-4249-9d26-23fbef6c3780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:15.121944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90b4f4-878d-4249-9d26-23fbef6c3780 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:15.122233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90b4f4-878d-4249-9d26-23fbef6c3780 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:15.122515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90b4f4-878d-4249-9d26-23fbef6c3780 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:15.123869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90b4f4-878d-4249-9d26-23fbef6c3780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:15.134980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90b4f4-878d-4249-9d26-23fbef6c3780 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:15.153171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2d247cd5-d305-4440-ad48-e15ead47a4d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a6af7e588542a58e5793b8ea1bb9ed'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:15.162641 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2017/4041] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:31:14 2022] DELETE /identity/v3/users/23a6af7e588542a58e5793b8ea1bb9ed => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:31:15.167042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481645d-a30e-4219-b68e-2644fec89cdb None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:15.167404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481645d-a30e-4219-b68e-2644fec89cdb None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:15.167755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481645d-a30e-4219-b68e-2644fec89cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:15.192928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6481645d-a30e-4219-b68e-2644fec89cdb None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:15.195078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6481645d-a30e-4219-b68e-2644fec89cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:15.277741 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2025/4042] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:31:14 2022] POST /identity/v3/users => generated 297 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:31:15.281763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90b4f4-878d-4249-9d26-23fbef6c3780 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:15.284288 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2018/4043] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:15.285259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ae90b4f4-878d-4249-9d26-23fbef6c3780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:15.302064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481645d-a30e-4219-b68e-2644fec89cdb None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:15.303575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6481645d-a30e-4219-b68e-2644fec89cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:15.317893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90b4f4-878d-4249-9d26-23fbef6c3780 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:15.337890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cc95e-fec4-4950-bc4d-46e170676c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:15.339171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cc95e-fec4-4950-bc4d-46e170676c4a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:15.341382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cc95e-fec4-4950-bc4d-46e170676c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:15.343344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cc95e-fec4-4950-bc4d-46e170676c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:15.345953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cc95e-fec4-4950-bc4d-46e170676c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:15.353651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cc95e-fec4-4950-bc4d-46e170676c4a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:15.384100 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2026/4044] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:31:15.385536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cc95e-fec4-4950-bc4d-46e170676c4a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:15.399511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cc95e-fec4-4950-bc4d-46e170676c4a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:15.406878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b23f8d-d28f-4dac-85c1-6fa949843f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:15.407669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b23f8d-d28f-4dac-85c1-6fa949843f44 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:15.407973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b23f8d-d28f-4dac-85c1-6fa949843f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:15.408259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b23f8d-d28f-4dac-85c1-6fa949843f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:15.409062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b23f8d-d28f-4dac-85c1-6fa949843f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:15.410704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b23f8d-d28f-4dac-85c1-6fa949843f44 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:15.425658 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2027/4045] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:31:15.429457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b23f8d-d28f-4dac-85c1-6fa949843f44 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:15.429703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481645d-a30e-4219-b68e-2644fec89cdb None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:15.441964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad521471-3636-4bf2-bd6e-33e7eafc39c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:15.443162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad521471-3636-4bf2-bd6e-33e7eafc39c1 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:15.443323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b23f8d-d28f-4dac-85c1-6fa949843f44 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:15.443750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad521471-3636-4bf2-bd6e-33e7eafc39c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:15.444197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad521471-3636-4bf2-bd6e-33e7eafc39c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:15.448978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987c38b-0921-409a-9b9f-7e98cfbe96af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:15.450124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987c38b-0921-409a-9b9f-7e98cfbe96af admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:15.450411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987c38b-0921-409a-9b9f-7e98cfbe96af admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:15.450694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987c38b-0921-409a-9b9f-7e98cfbe96af admin admin] PATH_INFO: `/v3/projects/e94e1e17eed441568c79557545628916/users/4f9e70f565d14f20befdb7ddf43afb4a/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:15.470609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987c38b-0921-409a-9b9f-7e98cfbe96af admin admin] RBAC: Authorizing `identity:create_grant(project_id=e94e1e17eed441568c79557545628916, user_id=4f9e70f565d14f20befdb7ddf43afb4a, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:15.474217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad521471-3636-4bf2-bd6e-33e7eafc39c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:15.479725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad521471-3636-4bf2-bd6e-33e7eafc39c1 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:15.486341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987c38b-0921-409a-9b9f-7e98cfbe96af admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:15.510109 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2019/4046] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:31:15.582983 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2028/4047] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:31:15 2022] PUT /identity/v3/projects/e94e1e17eed441568c79557545628916/users/4f9e70f565d14f20befdb7ddf43afb4a/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:15.599344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e404ade-b189-4a43-bbf3-c44b290a6777 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:15.599714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e404ade-b189-4a43-bbf3-c44b290a6777 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:15.599915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e404ade-b189-4a43-bbf3-c44b290a6777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:15.633044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8e404ade-b189-4a43-bbf3-c44b290a6777 None None] MFA Rules not processed for user `4f9e70f565d14f20befdb7ddf43afb4a`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:15.634335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8e404ade-b189-4a43-bbf3-c44b290a6777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:15.733217 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2020/4048] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:15.744999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987c38b-0921-409a-9b9f-7e98cfbe96af admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:15.744999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6987c38b-0921-409a-9b9f-7e98cfbe96af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:15.836578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987c38b-0921-409a-9b9f-7e98cfbe96af admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:15.845753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38870f-87cd-4589-b609-4f86d8cf4477 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:15.846425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38870f-87cd-4589-b609-4f86d8cf4477 service glance] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:15.846713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38870f-87cd-4589-b609-4f86d8cf4477 service glance] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:15.848362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38870f-87cd-4589-b609-4f86d8cf4477 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:15.872798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ef38870f-87cd-4589-b609-4f86d8cf4477 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:16.000404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38870f-87cd-4589-b609-4f86d8cf4477 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:16.002390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38870f-87cd-4589-b609-4f86d8cf4477 service glance] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:16.029851 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2029/4049] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:31:16.758620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e404ade-b189-4a43-bbf3-c44b290a6777 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:16.770639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8e404ade-b189-4a43-bbf3-c44b290a6777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:16.847568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e404ade-b189-4a43-bbf3-c44b290a6777 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:16.854905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589a9b0-f40b-4e66-ab6f-8df4b0461ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:16.856673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589a9b0-f40b-4e66-ab6f-8df4b0461ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:16.857649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589a9b0-f40b-4e66-ab6f-8df4b0461ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:16.857943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589a9b0-f40b-4e66-ab6f-8df4b0461ad0 admin admin] PATH_INFO: `/v3/projects/f15feefc56df4978830002509782cad7` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:16.860915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589a9b0-f40b-4e66-ab6f-8df4b0461ad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f15feefc56df4978830002509782cad7)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:16.864213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589a9b0-f40b-4e66-ab6f-8df4b0461ad0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:17.023655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5589a9b0-f40b-4e66-ab6f-8df4b0461ad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f15feefc56df4978830002509782cad7', 'request_id': 'req-5589a9b0-f40b-4e66-ab6f-8df4b0461ad0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:17.147209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5589a9b0-f40b-4e66-ab6f-8df4b0461ad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f15feefc56df4978830002509782cad7', 'request_id': 'req-5589a9b0-f40b-4e66-ab6f-8df4b0461ad0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:17.155527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5589a9b0-f40b-4e66-ab6f-8df4b0461ad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f15feefc56df4978830002509782cad7', 'request_id': 'req-5589a9b0-f40b-4e66-ab6f-8df4b0461ad0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:17.167376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5589a9b0-f40b-4e66-ab6f-8df4b0461ad0 admin admin] The token cache is being invalidate because project f15feefc56df4978830002509782cad7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:31:17.167801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5589a9b0-f40b-4e66-ab6f-8df4b0461ad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:17.168620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5589a9b0-f40b-4e66-ab6f-8df4b0461ad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:17.171116 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2021/4050] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:31:16 2022] DELETE /identity/v3/projects/f15feefc56df4978830002509782cad7 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:17.176266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3af7cb-e5af-4631-b1ed-5e8d3d567a2c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:17.179337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3af7cb-e5af-4631-b1ed-5e8d3d567a2c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:17.179337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3af7cb-e5af-4631-b1ed-5e8d3d567a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:17.197344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-af3af7cb-e5af-4631-b1ed-5e8d3d567a2c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:17.198983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-af3af7cb-e5af-4631-b1ed-5e8d3d567a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:17.305334 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2030/4051] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:17.313891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08401e-c65f-427c-840f-b4db0af117b5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:17.314139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08401e-c65f-427c-840f-b4db0af117b5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:17.314402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08401e-c65f-427c-840f-b4db0af117b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:17.361199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0c08401e-c65f-427c-840f-b4db0af117b5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:17.363471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0c08401e-c65f-427c-840f-b4db0af117b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:17.383121 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2022/4052] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:17.387141 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3af7cb-e5af-4631-b1ed-5e8d3d567a2c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:17.403248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3af7cb-e5af-4631-b1ed-5e8d3d567a2c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:17.415980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb131b-4bda-4d66-992c-fb96fad42699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:17.418864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb131b-4bda-4d66-992c-fb96fad42699 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:17.419177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb131b-4bda-4d66-992c-fb96fad42699 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:17.419556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb131b-4bda-4d66-992c-fb96fad42699 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:17.421685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb131b-4bda-4d66-992c-fb96fad42699 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:31:17.422060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb131b-4bda-4d66-992c-fb96fad42699 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:17.430889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb131b-4bda-4d66-992c-fb96fad42699 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:17.449114 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2031/4053] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:31:17.458126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08401e-c65f-427c-840f-b4db0af117b5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:17.508086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08401e-c65f-427c-840f-b4db0af117b5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:17.519162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b23998-3632-43eb-a8ca-e75a38216f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:17.519831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b23998-3632-43eb-a8ca-e75a38216f5c admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:17.520118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b23998-3632-43eb-a8ca-e75a38216f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:17.520533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b23998-3632-43eb-a8ca-e75a38216f5c admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:17.521275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b23998-3632-43eb-a8ca-e75a38216f5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:17.526449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b23998-3632-43eb-a8ca-e75a38216f5c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:17.661479 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2023/4054] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:31:17 2022] POST /identity/v3/projects => generated 381 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:31:17.665755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb131b-4bda-4d66-992c-fb96fad42699 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:17.678260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb131b-4bda-4d66-992c-fb96fad42699 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:17.785124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40061f80-e540-4efc-8580-ca91b60a48a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:17.787687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40061f80-e540-4efc-8580-ca91b60a48a8 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:17.789688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40061f80-e540-4efc-8580-ca91b60a48a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:17.790087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40061f80-e540-4efc-8580-ca91b60a48a8 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:17.792801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40061f80-e540-4efc-8580-ca91b60a48a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:17.795295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40061f80-e540-4efc-8580-ca91b60a48a8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:17.898897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b23998-3632-43eb-a8ca-e75a38216f5c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:17.902542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-52b23998-3632-43eb-a8ca-e75a38216f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:17.907867 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2032/4055] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:31:17 2022] POST /identity/v3/users => generated 291 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:31:17.909234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40061f80-e540-4efc-8580-ca91b60a48a8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:17.925789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b23998-3632-43eb-a8ca-e75a38216f5c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:17.928084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40061f80-e540-4efc-8580-ca91b60a48a8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:17.932518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d58fa-6b4b-4444-8689-32e6447fce94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:17.933842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d58fa-6b4b-4444-8689-32e6447fce94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:17.934326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d58fa-6b4b-4444-8689-32e6447fce94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:17.934734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f8101-26b9-45d1-ae7c-987eb27c512a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:17.934951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d58fa-6b4b-4444-8689-32e6447fce94 admin admin] PATH_INFO: `/v3/users/c9557e06818d47f2a6f01f3a2507433b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:17.936343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f8101-26b9-45d1-ae7c-987eb27c512a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:17.936815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f8101-26b9-45d1-ae7c-987eb27c512a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:17.937191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f8101-26b9-45d1-ae7c-987eb27c512a admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:17.937397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d58fa-6b4b-4444-8689-32e6447fce94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9557e06818d47f2a6f01f3a2507433b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:17.938132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f8101-26b9-45d1-ae7c-987eb27c512a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:17.939962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d58fa-6b4b-4444-8689-32e6447fce94 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:17.940186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f8101-26b9-45d1-ae7c-987eb27c512a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:17.958012 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2033/4056] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:31:17.966649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f8101-26b9-45d1-ae7c-987eb27c512a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:17.980886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f8101-26b9-45d1-ae7c-987eb27c512a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:17.987194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b866116-93c9-41bd-b79f-136fdc011681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:17.987978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b866116-93c9-41bd-b79f-136fdc011681 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:17.988323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b866116-93c9-41bd-b79f-136fdc011681 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:17.988724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b866116-93c9-41bd-b79f-136fdc011681 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:17.989485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b866116-93c9-41bd-b79f-136fdc011681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:17.992911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b866116-93c9-41bd-b79f-136fdc011681 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:18.007080 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2034/4057] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:31:18.009226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b866116-93c9-41bd-b79f-136fdc011681 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:18.043533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b866116-93c9-41bd-b79f-136fdc011681 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:18.056546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05526b9-2e43-40f4-a8bb-bd77c11d88e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:18.058758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05526b9-2e43-40f4-a8bb-bd77c11d88e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:18.059350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05526b9-2e43-40f4-a8bb-bd77c11d88e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:18.059828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05526b9-2e43-40f4-a8bb-bd77c11d88e8 admin admin] PATH_INFO: `/v3/projects/cde37b6fb7fb45aa9279111ef4d5ceed/users/bb79a0a1ee5a429c9df27db4f671f0b4/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:18.090472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05526b9-2e43-40f4-a8bb-bd77c11d88e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde37b6fb7fb45aa9279111ef4d5ceed, user_id=bb79a0a1ee5a429c9df27db4f671f0b4, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:18.093565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05526b9-2e43-40f4-a8bb-bd77c11d88e8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:18.150395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c78d58fa-6b4b-4444-8689-32e6447fce94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9557e06818d47f2a6f01f3a2507433b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:18.170880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c78d58fa-6b4b-4444-8689-32e6447fce94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9557e06818d47f2a6f01f3a2507433b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:18.173187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c78d58fa-6b4b-4444-8689-32e6447fce94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9557e06818d47f2a6f01f3a2507433b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:18.176963 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2035/4058] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:31:18 2022] PUT /identity/v3/projects/cde37b6fb7fb45aa9279111ef4d5ceed/users/bb79a0a1ee5a429c9df27db4f671f0b4/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:18.182963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9487c0-a547-4b55-af39-cae2692595fd None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:18.183313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c78d58fa-6b4b-4444-8689-32e6447fce94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9557e06818d47f2a6f01f3a2507433b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:18.183600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9487c0-a547-4b55-af39-cae2692595fd None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:18.184026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9487c0-a547-4b55-af39-cae2692595fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:18.206281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3f9487c0-a547-4b55-af39-cae2692595fd None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:18.208423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3f9487c0-a547-4b55-af39-cae2692595fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:18.282953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c78d58fa-6b4b-4444-8689-32e6447fce94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9557e06818d47f2a6f01f3a2507433b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:18.283673 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2036/4059] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:18.296449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9487c0-a547-4b55-af39-cae2692595fd None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:18.302463 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2024/4060] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:31:17 2022] DELETE /identity/v3/users/c9557e06818d47f2a6f01f3a2507433b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:31:18.302855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3f9487c0-a547-4b55-af39-cae2692595fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:18.305129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31a593-0c86-4285-9f2c-1e6b3ec3c1d2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:18.307281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31a593-0c86-4285-9f2c-1e6b3ec3c1d2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:18.307281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31a593-0c86-4285-9f2c-1e6b3ec3c1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:18.330857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0b31a593-0c86-4285-9f2c-1e6b3ec3c1d2 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:18.332333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0b31a593-0c86-4285-9f2c-1e6b3ec3c1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:18.367479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9487c0-a547-4b55-af39-cae2692595fd None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:18.402275 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2025/4061] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:18.413313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31a593-0c86-4285-9f2c-1e6b3ec3c1d2 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:18.415018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0b31a593-0c86-4285-9f2c-1e6b3ec3c1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:18.428224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5999033-10c9-49e4-a1cc-5f7ac9475ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:18.429253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5999033-10c9-49e4-a1cc-5f7ac9475ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:18.429945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5999033-10c9-49e4-a1cc-5f7ac9475ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:18.430235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5999033-10c9-49e4-a1cc-5f7ac9475ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:18.432328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f5999033-10c9-49e4-a1cc-5f7ac9475ac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:18.446358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5999033-10c9-49e4-a1cc-5f7ac9475ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:18.447856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5999033-10c9-49e4-a1cc-5f7ac9475ac0 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:18.459686 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2037/4062] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:31:18.477506 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31a593-0c86-4285-9f2c-1e6b3ec3c1d2 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:18.481467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42b3a4-850a-47c3-aeda-3f14f82fa33d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:18.483129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42b3a4-850a-47c3-aeda-3f14f82fa33d service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:18.483129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42b3a4-850a-47c3-aeda-3f14f82fa33d service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:18.483680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42b3a4-850a-47c3-aeda-3f14f82fa33d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:18.493828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42b3a4-850a-47c3-aeda-3f14f82fa33d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:18.495391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42b3a4-850a-47c3-aeda-3f14f82fa33d service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:18.506414 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2026/4063] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:31:19.461250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5999033-10c9-49e4-a1cc-5f7ac9475ac0 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:19.462869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f5999033-10c9-49e4-a1cc-5f7ac9475ac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:19.488214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5999033-10c9-49e4-a1cc-5f7ac9475ac0 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:19.500317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be1723-24c5-42ae-af8c-0acb7716b386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:19.503237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be1723-24c5-42ae-af8c-0acb7716b386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:19.503546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be1723-24c5-42ae-af8c-0acb7716b386 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:19.504168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be1723-24c5-42ae-af8c-0acb7716b386 admin admin] PATH_INFO: `/v3/projects/a72330f3656143c79833786e554e4d3c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:19.509570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be1723-24c5-42ae-af8c-0acb7716b386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a72330f3656143c79833786e554e4d3c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:19.511733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be1723-24c5-42ae-af8c-0acb7716b386 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:19.682627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-26be1723-24c5-42ae-af8c-0acb7716b386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a72330f3656143c79833786e554e4d3c', 'request_id': 'req-26be1723-24c5-42ae-af8c-0acb7716b386'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:19.697314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-26be1723-24c5-42ae-af8c-0acb7716b386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a72330f3656143c79833786e554e4d3c', 'request_id': 'req-26be1723-24c5-42ae-af8c-0acb7716b386'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:19.758680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-26be1723-24c5-42ae-af8c-0acb7716b386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a72330f3656143c79833786e554e4d3c', 'request_id': 'req-26be1723-24c5-42ae-af8c-0acb7716b386'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:19.802533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-26be1723-24c5-42ae-af8c-0acb7716b386 admin admin] The token cache is being invalidate because project a72330f3656143c79833786e554e4d3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:31:19.802798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-26be1723-24c5-42ae-af8c-0acb7716b386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:19.807210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-26be1723-24c5-42ae-af8c-0acb7716b386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:19.814877 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2038/4064] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:31:19 2022] DELETE /identity/v3/projects/a72330f3656143c79833786e554e4d3c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:19.816235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42b3a4-850a-47c3-aeda-3f14f82fa33d service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:19.829818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42b3a4-850a-47c3-aeda-3f14f82fa33d service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:19.950014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd60f5-a839-4473-a1a1-2185d80f043b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:19.951349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd60f5-a839-4473-a1a1-2185d80f043b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:19.951881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd60f5-a839-4473-a1a1-2185d80f043b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:19.952260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd60f5-a839-4473-a1a1-2185d80f043b admin admin] PATH_INFO: `/v3/users/4f9e70f565d14f20befdb7ddf43afb4a` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:19.954217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd60f5-a839-4473-a1a1-2185d80f043b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f9e70f565d14f20befdb7ddf43afb4a)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:19.962781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd60f5-a839-4473-a1a1-2185d80f043b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:20.224282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75dd60f5-a839-4473-a1a1-2185d80f043b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f9e70f565d14f20befdb7ddf43afb4a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:20.252820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75dd60f5-a839-4473-a1a1-2185d80f043b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f9e70f565d14f20befdb7ddf43afb4a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:20.253574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75dd60f5-a839-4473-a1a1-2185d80f043b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f9e70f565d14f20befdb7ddf43afb4a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:20.262014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75dd60f5-a839-4473-a1a1-2185d80f043b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f9e70f565d14f20befdb7ddf43afb4a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:20.369027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75dd60f5-a839-4473-a1a1-2185d80f043b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f9e70f565d14f20befdb7ddf43afb4a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:20.379421 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2027/4065] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:31:19 2022] DELETE /identity/v3/users/4f9e70f565d14f20befdb7ddf43afb4a => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:21.378860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d409be-4b00-4f4f-b1d1-a73e69bc6c5b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:21.381446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d409be-4b00-4f4f-b1d1-a73e69bc6c5b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:21.381446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d409be-4b00-4f4f-b1d1-a73e69bc6c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:21.431921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d1d409be-4b00-4f4f-b1d1-a73e69bc6c5b None None] MFA Rules not processed for user `bb79a0a1ee5a429c9df27db4f671f0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:21.433277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d1d409be-4b00-4f4f-b1d1-a73e69bc6c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:21.448290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd60f5-a839-4473-a1a1-2185d80f043b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:21.450450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-75dd60f5-a839-4473-a1a1-2185d80f043b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:21.547254 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2039/4066] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:21.643659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000dd23-e03d-4964-a1ee-739ba9b67260 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:21.643949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000dd23-e03d-4964-a1ee-739ba9b67260 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:21.644406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000dd23-e03d-4964-a1ee-739ba9b67260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:21.672722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd60f5-a839-4473-a1a1-2185d80f043b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:21.678425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e000dd23-e03d-4964-a1ee-739ba9b67260 None None] MFA Rules not processed for user `bb79a0a1ee5a429c9df27db4f671f0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:21.679895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e000dd23-e03d-4964-a1ee-739ba9b67260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:21.683127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d5660-6384-4d4b-9ecb-d76f298dfb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:21.684440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d5660-6384-4d4b-9ecb-d76f298dfb47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:21.684875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d5660-6384-4d4b-9ecb-d76f298dfb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:21.685289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d5660-6384-4d4b-9ecb-d76f298dfb47 admin admin] PATH_INFO: `/v3/projects/e94e1e17eed441568c79557545628916` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:21.686940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d5660-6384-4d4b-9ecb-d76f298dfb47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e94e1e17eed441568c79557545628916)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:21.692728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d5660-6384-4d4b-9ecb-d76f298dfb47 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:21.693320 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2040/4067] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:31:21.837613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5d5d5660-6384-4d4b-9ecb-d76f298dfb47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e94e1e17eed441568c79557545628916', 'request_id': 'req-5d5d5660-6384-4d4b-9ecb-d76f298dfb47'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:21.923348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5d5d5660-6384-4d4b-9ecb-d76f298dfb47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e94e1e17eed441568c79557545628916', 'request_id': 'req-5d5d5660-6384-4d4b-9ecb-d76f298dfb47'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:21.931326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5d5d5660-6384-4d4b-9ecb-d76f298dfb47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e94e1e17eed441568c79557545628916', 'request_id': 'req-5d5d5660-6384-4d4b-9ecb-d76f298dfb47'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:21.978100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000dd23-e03d-4964-a1ee-739ba9b67260 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:21.979860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e000dd23-e03d-4964-a1ee-739ba9b67260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:21.990133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5d5d5660-6384-4d4b-9ecb-d76f298dfb47 admin admin] The token cache is being invalidate because project e94e1e17eed441568c79557545628916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:31:21.990133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5d5d5660-6384-4d4b-9ecb-d76f298dfb47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:21.991853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5d5d5660-6384-4d4b-9ecb-d76f298dfb47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:21.993897 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2028/4068] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:31:21 2022] DELETE /identity/v3/projects/e94e1e17eed441568c79557545628916 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:31:21.998583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454a1e7-96a3-4eb7-9338-1afe36b8fcda None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:21.998864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454a1e7-96a3-4eb7-9338-1afe36b8fcda None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:21.999149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454a1e7-96a3-4eb7-9338-1afe36b8fcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:22.038865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f454a1e7-96a3-4eb7-9338-1afe36b8fcda None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:22.040422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f454a1e7-96a3-4eb7-9338-1afe36b8fcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:22.116465 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2029/4069] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:31:22.118583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000dd23-e03d-4964-a1ee-739ba9b67260 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:22.123855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e6420-61df-49cf-820a-1ad2672170a5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:22.124234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e6420-61df-49cf-820a-1ad2672170a5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:22.126410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e6420-61df-49cf-820a-1ad2672170a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:22.166342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3c3e6420-61df-49cf-820a-1ad2672170a5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:22.170077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3c3e6420-61df-49cf-820a-1ad2672170a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:22.190905 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2030/4070] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:22.195122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e6420-61df-49cf-820a-1ad2672170a5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:22.209444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e6420-61df-49cf-820a-1ad2672170a5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:22.223403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fd312-f8a0-4113-90ac-99ace7a6e460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:22.224773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fd312-f8a0-4113-90ac-99ace7a6e460 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:22.226895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fd312-f8a0-4113-90ac-99ace7a6e460 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:22.227613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fd312-f8a0-4113-90ac-99ace7a6e460 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:22.229161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297fd312-f8a0-4113-90ac-99ace7a6e460 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:31:22.229686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297fd312-f8a0-4113-90ac-99ace7a6e460 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:22.232318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297fd312-f8a0-4113-90ac-99ace7a6e460 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:22.244937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22088e44-b928-4397-ac50-00a214e3ff2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:22.245652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22088e44-b928-4397-ac50-00a214e3ff2c service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:22.245937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22088e44-b928-4397-ac50-00a214e3ff2c service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:22.246214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22088e44-b928-4397-ac50-00a214e3ff2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:22.253491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-22088e44-b928-4397-ac50-00a214e3ff2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:22.273787 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2031/4071] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:31:22.279878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fd312-f8a0-4113-90ac-99ace7a6e460 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:22.305351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fd312-f8a0-4113-90ac-99ace7a6e460 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:22.321777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8125a-85cc-421d-950d-c82e3fac9358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:22.322805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8125a-85cc-421d-950d-c82e3fac9358 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:22.323761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8125a-85cc-421d-950d-c82e3fac9358 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:22.323761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8125a-85cc-421d-950d-c82e3fac9358 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:22.324360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8125a-85cc-421d-950d-c82e3fac9358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:22.327793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8125a-85cc-421d-950d-c82e3fac9358 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:22.419599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22088e44-b928-4397-ac50-00a214e3ff2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:22.424357 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2032/4072] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:31:22 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:31:22.424508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22088e44-b928-4397-ac50-00a214e3ff2c service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:22.426808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8125a-85cc-421d-950d-c82e3fac9358 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:22.447885 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2041/4073] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:31:22.580270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8125a-85cc-421d-950d-c82e3fac9358 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:22.586693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362aaf9-931d-4aed-a970-5bdeadecce00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:22.587951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362aaf9-931d-4aed-a970-5bdeadecce00 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:22.588460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362aaf9-931d-4aed-a970-5bdeadecce00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:22.591265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362aaf9-931d-4aed-a970-5bdeadecce00 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:22.593278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362aaf9-931d-4aed-a970-5bdeadecce00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:22.596779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362aaf9-931d-4aed-a970-5bdeadecce00 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:22.695055 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2033/4074] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:31:22 2022] POST /identity/v3/users => generated 287 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:31:22.699383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22088e44-b928-4397-ac50-00a214e3ff2c service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:22.727120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22088e44-b928-4397-ac50-00a214e3ff2c service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:22.737105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc958614-388e-43e6-9496-94133c086868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:22.738002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc958614-388e-43e6-9496-94133c086868 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:22.751708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc958614-388e-43e6-9496-94133c086868 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:22.752076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc958614-388e-43e6-9496-94133c086868 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:22.755297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc958614-388e-43e6-9496-94133c086868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:22.757199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc958614-388e-43e6-9496-94133c086868 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:22.769702 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2042/4075] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:31:22.773327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362aaf9-931d-4aed-a970-5bdeadecce00 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:22.791083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362aaf9-931d-4aed-a970-5bdeadecce00 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:22.798791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8fffc5-2158-47de-a42d-0fee319cb1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:22.807100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fffc5-2158-47de-a42d-0fee319cb1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:22.807401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fffc5-2158-47de-a42d-0fee319cb1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:22.808318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8fffc5-2158-47de-a42d-0fee319cb1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:22.811126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8fffc5-2158-47de-a42d-0fee319cb1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:22.812796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8fffc5-2158-47de-a42d-0fee319cb1d8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:22.831841 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2034/4076] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:31:22.833020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc958614-388e-43e6-9496-94133c086868 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:22.849707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc958614-388e-43e6-9496-94133c086868 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:22.861915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b6c7d-10f9-428a-8f03-74556119cf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:22.863278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b6c7d-10f9-428a-8f03-74556119cf21 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:22.863573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b6c7d-10f9-428a-8f03-74556119cf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:22.863861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b6c7d-10f9-428a-8f03-74556119cf21 admin admin] PATH_INFO: `/v3/projects/410b1252fa254c2185ca4f753b9a2d3c/users/c83faa413a814d9d8439cf50d197852c/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:22.918151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b6c7d-10f9-428a-8f03-74556119cf21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=410b1252fa254c2185ca4f753b9a2d3c, user_id=c83faa413a814d9d8439cf50d197852c, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:22.926916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b6c7d-10f9-428a-8f03-74556119cf21 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:23.023766 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2043/4077] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:31:22 2022] PUT /identity/v3/projects/410b1252fa254c2185ca4f753b9a2d3c/users/c83faa413a814d9d8439cf50d197852c/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:23.036499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82c505-9be9-4116-8190-320c6a8e69ca None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:23.036824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82c505-9be9-4116-8190-320c6a8e69ca None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:23.037110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82c505-9be9-4116-8190-320c6a8e69ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:23.103300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1c82c505-9be9-4116-8190-320c6a8e69ca None None] MFA Rules not processed for user `c83faa413a814d9d8439cf50d197852c`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:23.104551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1c82c505-9be9-4116-8190-320c6a8e69ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:23.198912 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2035/4078] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:23.213297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b6c7d-10f9-428a-8f03-74556119cf21 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:23.215157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-619b6c7d-10f9-428a-8f03-74556119cf21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:23.291879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b6c7d-10f9-428a-8f03-74556119cf21 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:23.297053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571523f-d146-44bb-8ccf-fdd94ee602df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:23.298094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571523f-d146-44bb-8ccf-fdd94ee602df service glance] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:23.298430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571523f-d146-44bb-8ccf-fdd94ee602df service glance] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:23.298813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571523f-d146-44bb-8ccf-fdd94ee602df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:23.309867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571523f-d146-44bb-8ccf-fdd94ee602df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:23.311335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571523f-d146-44bb-8ccf-fdd94ee602df service glance] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:23.322202 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2044/4079] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:31:23.433259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82c505-9be9-4116-8190-320c6a8e69ca None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:23.509250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82c505-9be9-4116-8190-320c6a8e69ca None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:23.524194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea28ea5-bdbd-455b-a006-f1111cc380c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:23.525147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea28ea5-bdbd-455b-a006-f1111cc380c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:23.525437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea28ea5-bdbd-455b-a006-f1111cc380c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:23.525720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea28ea5-bdbd-455b-a006-f1111cc380c2 admin admin] PATH_INFO: `/v3/users/c83faa413a814d9d8439cf50d197852c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:23.526984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea28ea5-bdbd-455b-a006-f1111cc380c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c83faa413a814d9d8439cf50d197852c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:23.529779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea28ea5-bdbd-455b-a006-f1111cc380c2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:23.737995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fea28ea5-bdbd-455b-a006-f1111cc380c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c83faa413a814d9d8439cf50d197852c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:23.759586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fea28ea5-bdbd-455b-a006-f1111cc380c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c83faa413a814d9d8439cf50d197852c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:23.760574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fea28ea5-bdbd-455b-a006-f1111cc380c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c83faa413a814d9d8439cf50d197852c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:23.772107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fea28ea5-bdbd-455b-a006-f1111cc380c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c83faa413a814d9d8439cf50d197852c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:23.901421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fea28ea5-bdbd-455b-a006-f1111cc380c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c83faa413a814d9d8439cf50d197852c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:23.924153 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2036/4080] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:31:23 2022] DELETE /identity/v3/users/c83faa413a814d9d8439cf50d197852c => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:23.924390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccde21-552a-4fe0-b02f-0a371c525d63 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:23.924906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccde21-552a-4fe0-b02f-0a371c525d63 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:23.924982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccde21-552a-4fe0-b02f-0a371c525d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:23.944699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f0ccde21-552a-4fe0-b02f-0a371c525d63 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:23.947918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f0ccde21-552a-4fe0-b02f-0a371c525d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:24.065483 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2045/4081] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:24.087455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea28ea5-bdbd-455b-a006-f1111cc380c2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:24.089000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fea28ea5-bdbd-455b-a006-f1111cc380c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:24.194199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea28ea5-bdbd-455b-a006-f1111cc380c2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:24.204282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37e438-d722-4e55-bab4-73187feee4b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:24.205312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37e438-d722-4e55-bab4-73187feee4b4 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:24.205746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37e438-d722-4e55-bab4-73187feee4b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:24.206194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37e438-d722-4e55-bab4-73187feee4b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:24.216286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37e438-d722-4e55-bab4-73187feee4b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:24.217963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37e438-d722-4e55-bab4-73187feee4b4 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:24.232920 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2037/4082] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:31:25.721266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccde21-552a-4fe0-b02f-0a371c525d63 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:25.723375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f0ccde21-552a-4fe0-b02f-0a371c525d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:25.738622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccde21-552a-4fe0-b02f-0a371c525d63 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:25.744914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34826abf-0576-4361-95fc-efa4403e428b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:25.746051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34826abf-0576-4361-95fc-efa4403e428b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:25.746506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34826abf-0576-4361-95fc-efa4403e428b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:25.746939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34826abf-0576-4361-95fc-efa4403e428b admin admin] PATH_INFO: `/v3/projects/410b1252fa254c2185ca4f753b9a2d3c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:25.748230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34826abf-0576-4361-95fc-efa4403e428b admin admin] RBAC: Authorizing `identity:delete_project(project_id=410b1252fa254c2185ca4f753b9a2d3c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:25.750621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34826abf-0576-4361-95fc-efa4403e428b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:25.895099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-34826abf-0576-4361-95fc-efa4403e428b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '410b1252fa254c2185ca4f753b9a2d3c', 'request_id': 'req-34826abf-0576-4361-95fc-efa4403e428b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:25.915098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-34826abf-0576-4361-95fc-efa4403e428b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '410b1252fa254c2185ca4f753b9a2d3c', 'request_id': 'req-34826abf-0576-4361-95fc-efa4403e428b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:26.008768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-34826abf-0576-4361-95fc-efa4403e428b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '410b1252fa254c2185ca4f753b9a2d3c', 'request_id': 'req-34826abf-0576-4361-95fc-efa4403e428b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:26.032338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-34826abf-0576-4361-95fc-efa4403e428b admin admin] The token cache is being invalidate because project 410b1252fa254c2185ca4f753b9a2d3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:31:26.032732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-34826abf-0576-4361-95fc-efa4403e428b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:26.035116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-34826abf-0576-4361-95fc-efa4403e428b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:26.041332 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2046/4083] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:31:25 2022] DELETE /identity/v3/projects/410b1252fa254c2185ca4f753b9a2d3c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:26.045271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64b8a1-b942-439a-9932-800a88a09107 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:26.046235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64b8a1-b942-439a-9932-800a88a09107 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:26.046728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64b8a1-b942-439a-9932-800a88a09107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:26.076414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9c64b8a1-b942-439a-9932-800a88a09107 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:26.077974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9c64b8a1-b942-439a-9932-800a88a09107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:26.184268 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2038/4084] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:26.190221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9473b-995c-4cb2-ad37-7f09174a4cb0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:26.190587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9473b-995c-4cb2-ad37-7f09174a4cb0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:26.190876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9473b-995c-4cb2-ad37-7f09174a4cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:26.212253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-83a9473b-995c-4cb2-ad37-7f09174a4cb0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:26.213742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-83a9473b-995c-4cb2-ad37-7f09174a4cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:26.225802 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2047/4085] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:26.227038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64b8a1-b942-439a-9932-800a88a09107 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:26.236881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64b8a1-b942-439a-9932-800a88a09107 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:26.241547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab200af-d149-451c-a883-6d45a3a79630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:26.242299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab200af-d149-451c-a883-6d45a3a79630 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:26.242655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab200af-d149-451c-a883-6d45a3a79630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:26.243006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab200af-d149-451c-a883-6d45a3a79630 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:26.243810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab200af-d149-451c-a883-6d45a3a79630 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:31:26.244194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab200af-d149-451c-a883-6d45a3a79630 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:26.245894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab200af-d149-451c-a883-6d45a3a79630 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:26.276022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9473b-995c-4cb2-ad37-7f09174a4cb0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:26.296110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9473b-995c-4cb2-ad37-7f09174a4cb0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:26.296420 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2039/4086] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:31:26.302530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bb776-1a42-4bb9-8f45-71848337b426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:26.303516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bb776-1a42-4bb9-8f45-71848337b426 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:26.303974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bb776-1a42-4bb9-8f45-71848337b426 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:26.304427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bb776-1a42-4bb9-8f45-71848337b426 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:26.305356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4bb776-1a42-4bb9-8f45-71848337b426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:26.307598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4bb776-1a42-4bb9-8f45-71848337b426 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:26.434180 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2048/4087] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:31:26 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:31:26.439366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab200af-d149-451c-a883-6d45a3a79630 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:26.453289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab200af-d149-451c-a883-6d45a3a79630 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:26.573657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bca262-1749-47fc-a178-fd48c8bc49d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:26.573657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bca262-1749-47fc-a178-fd48c8bc49d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:26.573657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bca262-1749-47fc-a178-fd48c8bc49d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:26.573908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bca262-1749-47fc-a178-fd48c8bc49d9 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:26.590679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bca262-1749-47fc-a178-fd48c8bc49d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:26.592771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bca262-1749-47fc-a178-fd48c8bc49d9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:26.721484 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2040/4088] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:31:26 2022] POST /identity/v3/users => generated 291 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:31:26.721808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bb776-1a42-4bb9-8f45-71848337b426 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:26.737924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bb776-1a42-4bb9-8f45-71848337b426 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:26.749345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62954f25-380c-4daf-8232-04e169224e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:26.751891 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62954f25-380c-4daf-8232-04e169224e1f admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:26.752396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62954f25-380c-4daf-8232-04e169224e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:26.753012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62954f25-380c-4daf-8232-04e169224e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:26.754238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62954f25-380c-4daf-8232-04e169224e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:26.757601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62954f25-380c-4daf-8232-04e169224e1f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:26.777568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bca262-1749-47fc-a178-fd48c8bc49d9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:26.777725 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2049/4089] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:31:26.793925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bca262-1749-47fc-a178-fd48c8bc49d9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:26.811056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee7216-b300-4aae-8ba4-667ac8043b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:26.811922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee7216-b300-4aae-8ba4-667ac8043b51 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:26.812257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee7216-b300-4aae-8ba4-667ac8043b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:26.812531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee7216-b300-4aae-8ba4-667ac8043b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:26.813729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee7216-b300-4aae-8ba4-667ac8043b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:26.824899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee7216-b300-4aae-8ba4-667ac8043b51 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:26.843000 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2041/4090] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:31:26.848009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62954f25-380c-4daf-8232-04e169224e1f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:26.863187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62954f25-380c-4daf-8232-04e169224e1f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:26.877880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f8d13-d9fe-4f81-b4e3-91523f6811d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:26.879739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f8d13-d9fe-4f81-b4e3-91523f6811d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:26.880244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f8d13-d9fe-4f81-b4e3-91523f6811d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:26.880991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f8d13-d9fe-4f81-b4e3-91523f6811d3 admin admin] PATH_INFO: `/v3/projects/308850d6707b4afd80762934ddee6a87/users/f6418e83dfa5483da73c7745920936bf/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:26.901409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f8d13-d9fe-4f81-b4e3-91523f6811d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=308850d6707b4afd80762934ddee6a87, user_id=f6418e83dfa5483da73c7745920936bf, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:26.913037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f8d13-d9fe-4f81-b4e3-91523f6811d3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:27.067956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fe59f-e10e-4654-991e-f0510c1438e5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:27.068486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fe59f-e10e-4654-991e-f0510c1438e5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:27.068593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fe59f-e10e-4654-991e-f0510c1438e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:27.074512 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2050/4091] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:31:26 2022] PUT /identity/v3/projects/308850d6707b4afd80762934ddee6a87/users/f6418e83dfa5483da73c7745920936bf/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:27.147881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-962fe59f-e10e-4654-991e-f0510c1438e5 None None] MFA Rules not processed for user `f6418e83dfa5483da73c7745920936bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:27.149156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-962fe59f-e10e-4654-991e-f0510c1438e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:27.299573 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2042/4092] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:27.336361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f8d13-d9fe-4f81-b4e3-91523f6811d3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:27.338652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-196f8d13-d9fe-4f81-b4e3-91523f6811d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:27.465118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f8d13-d9fe-4f81-b4e3-91523f6811d3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:27.477607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3c3d0-4c01-4b5e-b49a-a7b80ea61b5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:27.478352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3c3d0-4c01-4b5e-b49a-a7b80ea61b5d service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:27.478646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3c3d0-4c01-4b5e-b49a-a7b80ea61b5d service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:27.478926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3c3d0-4c01-4b5e-b49a-a7b80ea61b5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:27.497562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3c3d0-4c01-4b5e-b49a-a7b80ea61b5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:27.499577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3c3d0-4c01-4b5e-b49a-a7b80ea61b5d service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:27.515497 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2051/4093] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:31:27.565807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fe59f-e10e-4654-991e-f0510c1438e5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:27.567347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-962fe59f-e10e-4654-991e-f0510c1438e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:27.721652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fe59f-e10e-4654-991e-f0510c1438e5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:27.739685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca76ed1-52cb-4ee8-89d4-28129e485c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:27.740793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca76ed1-52cb-4ee8-89d4-28129e485c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:27.740925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca76ed1-52cb-4ee8-89d4-28129e485c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:27.741190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca76ed1-52cb-4ee8-89d4-28129e485c98 admin admin] PATH_INFO: `/v3/users/8983f7b383b644f5ae9ac927fbe54cf2` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:27.742479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca76ed1-52cb-4ee8-89d4-28129e485c98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8983f7b383b644f5ae9ac927fbe54cf2)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:27.744453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca76ed1-52cb-4ee8-89d4-28129e485c98 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:28.093571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4ca76ed1-52cb-4ee8-89d4-28129e485c98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8983f7b383b644f5ae9ac927fbe54cf2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:28.116226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4ca76ed1-52cb-4ee8-89d4-28129e485c98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8983f7b383b644f5ae9ac927fbe54cf2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:28.117839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4ca76ed1-52cb-4ee8-89d4-28129e485c98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8983f7b383b644f5ae9ac927fbe54cf2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:28.131711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4ca76ed1-52cb-4ee8-89d4-28129e485c98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8983f7b383b644f5ae9ac927fbe54cf2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:28.223120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4ca76ed1-52cb-4ee8-89d4-28129e485c98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8983f7b383b644f5ae9ac927fbe54cf2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:28.232839 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2043/4094] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:31:27 2022] DELETE /identity/v3/users/8983f7b383b644f5ae9ac927fbe54cf2 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:28.583370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3c3d0-4c01-4b5e-b49a-a7b80ea61b5d service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:28.603965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3c3d0-4c01-4b5e-b49a-a7b80ea61b5d service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:28.704941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5edf3-ecc2-4e40-b8d4-6ae5b5075b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:28.705831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5edf3-ecc2-4e40-b8d4-6ae5b5075b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:28.706322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5edf3-ecc2-4e40-b8d4-6ae5b5075b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:28.706818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5edf3-ecc2-4e40-b8d4-6ae5b5075b9f admin admin] PATH_INFO: `/v3/projects/7b88222d9c35413dabb63e3807c81700` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:28.708081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5edf3-ecc2-4e40-b8d4-6ae5b5075b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b88222d9c35413dabb63e3807c81700)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:28.710124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5edf3-ecc2-4e40-b8d4-6ae5b5075b9f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:28.874386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30c5edf3-ecc2-4e40-b8d4-6ae5b5075b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b88222d9c35413dabb63e3807c81700', 'request_id': 'req-30c5edf3-ecc2-4e40-b8d4-6ae5b5075b9f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:28.889394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30c5edf3-ecc2-4e40-b8d4-6ae5b5075b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b88222d9c35413dabb63e3807c81700', 'request_id': 'req-30c5edf3-ecc2-4e40-b8d4-6ae5b5075b9f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:29.020065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30c5edf3-ecc2-4e40-b8d4-6ae5b5075b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b88222d9c35413dabb63e3807c81700', 'request_id': 'req-30c5edf3-ecc2-4e40-b8d4-6ae5b5075b9f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:29.038359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30c5edf3-ecc2-4e40-b8d4-6ae5b5075b9f admin admin] The token cache is being invalidate because project 7b88222d9c35413dabb63e3807c81700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:31:29.038727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30c5edf3-ecc2-4e40-b8d4-6ae5b5075b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:29.040113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30c5edf3-ecc2-4e40-b8d4-6ae5b5075b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:29.046245 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2052/4095] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:31:28 2022] DELETE /identity/v3/projects/7b88222d9c35413dabb63e3807c81700 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:31:29.051468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967f6d1-9726-44ba-a2a4-76113c29423a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:29.051772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967f6d1-9726-44ba-a2a4-76113c29423a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:29.052053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967f6d1-9726-44ba-a2a4-76113c29423a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:29.085897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-5967f6d1-9726-44ba-a2a4-76113c29423a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:29.087374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5967f6d1-9726-44ba-a2a4-76113c29423a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:29.175083 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2044/4096] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:29.186223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b79dbe-26ab-4583-adcb-c249531ccfea None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:29.186641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b79dbe-26ab-4583-adcb-c249531ccfea None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:29.186999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b79dbe-26ab-4583-adcb-c249531ccfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:29.208281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-90b79dbe-26ab-4583-adcb-c249531ccfea None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:29.209715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-90b79dbe-26ab-4583-adcb-c249531ccfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:29.220649 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2053/4097] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:29.227733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967f6d1-9726-44ba-a2a4-76113c29423a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:29.240293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967f6d1-9726-44ba-a2a4-76113c29423a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:29.245465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f622cda-df4e-42f6-bea2-e677877d546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:29.246603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f622cda-df4e-42f6-bea2-e677877d546e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:29.247111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f622cda-df4e-42f6-bea2-e677877d546e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:29.248016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f622cda-df4e-42f6-bea2-e677877d546e admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:29.248986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f622cda-df4e-42f6-bea2-e677877d546e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:31:29.249374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f622cda-df4e-42f6-bea2-e677877d546e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:29.251303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f622cda-df4e-42f6-bea2-e677877d546e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:29.270052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b79dbe-26ab-4583-adcb-c249531ccfea None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:29.270742 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2045/4098] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:31:29.291488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b79dbe-26ab-4583-adcb-c249531ccfea None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:29.297489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae968b88-d9d7-4816-be9b-cacb475ffa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:29.298291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae968b88-d9d7-4816-be9b-cacb475ffa00 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:29.298649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae968b88-d9d7-4816-be9b-cacb475ffa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:29.299366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae968b88-d9d7-4816-be9b-cacb475ffa00 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:29.300147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae968b88-d9d7-4816-be9b-cacb475ffa00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:29.302247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae968b88-d9d7-4816-be9b-cacb475ffa00 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:29.410927 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2054/4099] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:31:29 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:31:29.415357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f622cda-df4e-42f6-bea2-e677877d546e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:29.428276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f622cda-df4e-42f6-bea2-e677877d546e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:29.500951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f658c17-725a-4496-8cec-79555a376bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:29.501974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f658c17-725a-4496-8cec-79555a376bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:29.502473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f658c17-725a-4496-8cec-79555a376bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:29.502936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f658c17-725a-4496-8cec-79555a376bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:29.503914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f658c17-725a-4496-8cec-79555a376bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:29.506717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f658c17-725a-4496-8cec-79555a376bc8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:29.573931 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2046/4100] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:31:29 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:31:29.576363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae968b88-d9d7-4816-be9b-cacb475ffa00 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:29.596633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae968b88-d9d7-4816-be9b-cacb475ffa00 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:29.601938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc23b6-8c37-4ca0-94a3-74973c632c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:29.602808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc23b6-8c37-4ca0-94a3-74973c632c67 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:29.603244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc23b6-8c37-4ca0-94a3-74973c632c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:29.606995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc23b6-8c37-4ca0-94a3-74973c632c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:29.606995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc23b6-8c37-4ca0-94a3-74973c632c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:29.606995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc23b6-8c37-4ca0-94a3-74973c632c67 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:29.623101 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2055/4101] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:31:29.627591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f658c17-725a-4496-8cec-79555a376bc8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:29.640313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f658c17-725a-4496-8cec-79555a376bc8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:29.651832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8756e7-750e-4bb2-bbbb-c41d810025bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:29.654327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8756e7-750e-4bb2-bbbb-c41d810025bd admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:29.654842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8756e7-750e-4bb2-bbbb-c41d810025bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:29.655683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8756e7-750e-4bb2-bbbb-c41d810025bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:29.656700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8756e7-750e-4bb2-bbbb-c41d810025bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:29.658750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8756e7-750e-4bb2-bbbb-c41d810025bd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:29.673114 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2047/4102] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:31:29.677136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc23b6-8c37-4ca0-94a3-74973c632c67 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:29.692531 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc23b6-8c37-4ca0-94a3-74973c632c67 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:29.699086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e63d4-8ec3-4a24-902f-8175a1fc7c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:29.701030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e63d4-8ec3-4a24-902f-8175a1fc7c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:29.702028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e63d4-8ec3-4a24-902f-8175a1fc7c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:29.702482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e63d4-8ec3-4a24-902f-8175a1fc7c4c admin admin] PATH_INFO: `/v3/projects/620e47e300b7498a87384c30546dcb18/users/ac7a59b2974d49b0ac50e3885c6a3ef9/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:29.746885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e63d4-8ec3-4a24-902f-8175a1fc7c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=620e47e300b7498a87384c30546dcb18, user_id=ac7a59b2974d49b0ac50e3885c6a3ef9, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:29.752432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e63d4-8ec3-4a24-902f-8175a1fc7c4c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:29.851744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3f0b9-f1ce-4f1b-8b99-31b47850c121 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:29.851913 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2056/4103] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:31:29 2022] PUT /identity/v3/projects/620e47e300b7498a87384c30546dcb18/users/ac7a59b2974d49b0ac50e3885c6a3ef9/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:29.852048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3f0b9-f1ce-4f1b-8b99-31b47850c121 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:29.852329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3f0b9-f1ce-4f1b-8b99-31b47850c121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:29.892754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-11d3f0b9-f1ce-4f1b-8b99-31b47850c121 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:29.894031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-11d3f0b9-f1ce-4f1b-8b99-31b47850c121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:30.017660 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2048/4104] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:31:30.090163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e63d4-8ec3-4a24-902f-8175a1fc7c4c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:30.093254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a16e63d4-8ec3-4a24-902f-8175a1fc7c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:30.174192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e63d4-8ec3-4a24-902f-8175a1fc7c4c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:30.179957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a36f5b-06f1-413d-ae3c-7eb3bd8c555e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:30.181059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a36f5b-06f1-413d-ae3c-7eb3bd8c555e service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:30.181581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a36f5b-06f1-413d-ae3c-7eb3bd8c555e service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:30.182081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a36f5b-06f1-413d-ae3c-7eb3bd8c555e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:30.213163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a36f5b-06f1-413d-ae3c-7eb3bd8c555e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:30.213163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a36f5b-06f1-413d-ae3c-7eb3bd8c555e service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:30.238380 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2057/4105] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:31:35.553919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3f0b9-f1ce-4f1b-8b99-31b47850c121 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:35.555978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-11d3f0b9-f1ce-4f1b-8b99-31b47850c121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:35.569809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3f0b9-f1ce-4f1b-8b99-31b47850c121 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:35.574949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514f5f5-3a50-4959-bdfa-5e70340bbe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:35.575809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514f5f5-3a50-4959-bdfa-5e70340bbe8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:35.576100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514f5f5-3a50-4959-bdfa-5e70340bbe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:35.576388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514f5f5-3a50-4959-bdfa-5e70340bbe8e admin admin] PATH_INFO: `/v3/users/42a74a50cf644fe9a2ced2d319ff3e7b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:35.580011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514f5f5-3a50-4959-bdfa-5e70340bbe8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=42a74a50cf644fe9a2ced2d319ff3e7b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:35.581690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514f5f5-3a50-4959-bdfa-5e70340bbe8e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:35.814445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f514f5f5-3a50-4959-bdfa-5e70340bbe8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42a74a50cf644fe9a2ced2d319ff3e7b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:35.855553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f514f5f5-3a50-4959-bdfa-5e70340bbe8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42a74a50cf644fe9a2ced2d319ff3e7b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:35.857119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f514f5f5-3a50-4959-bdfa-5e70340bbe8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42a74a50cf644fe9a2ced2d319ff3e7b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:35.882277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f514f5f5-3a50-4959-bdfa-5e70340bbe8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42a74a50cf644fe9a2ced2d319ff3e7b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:35.954541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f514f5f5-3a50-4959-bdfa-5e70340bbe8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42a74a50cf644fe9a2ced2d319ff3e7b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:35.972562 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2049/4106] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:31:35 2022] DELETE /identity/v3/users/42a74a50cf644fe9a2ced2d319ff3e7b => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:35.975441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfb39e-d761-4945-b13b-5920f1327955 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:35.975441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfb39e-d761-4945-b13b-5920f1327955 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:35.975441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfb39e-d761-4945-b13b-5920f1327955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:36.034250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0acfb39e-d761-4945-b13b-5920f1327955 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:36.036590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0acfb39e-d761-4945-b13b-5920f1327955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:36.148887 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2058/4107] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:36.162702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514f5f5-3a50-4959-bdfa-5e70340bbe8e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:36.164270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f514f5f5-3a50-4959-bdfa-5e70340bbe8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:36.248340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514f5f5-3a50-4959-bdfa-5e70340bbe8e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:36.276426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fdece-b7bb-43c0-b83c-562d1b27a02d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:36.291327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fdece-b7bb-43c0-b83c-562d1b27a02d service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:36.291811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fdece-b7bb-43c0-b83c-562d1b27a02d service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:36.292110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fdece-b7bb-43c0-b83c-562d1b27a02d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:36.336048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887fdece-b7bb-43c0-b83c-562d1b27a02d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:36.337829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887fdece-b7bb-43c0-b83c-562d1b27a02d service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:36.377648 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2050/4108] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:31:36.859942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfb39e-d761-4945-b13b-5920f1327955 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:36.863357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0acfb39e-d761-4945-b13b-5920f1327955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:36.891479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfb39e-d761-4945-b13b-5920f1327955 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:36.900836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a31d3f-e2a5-4541-9907-23385ad17d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:36.908686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a31d3f-e2a5-4541-9907-23385ad17d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:36.908686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a31d3f-e2a5-4541-9907-23385ad17d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:36.908686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a31d3f-e2a5-4541-9907-23385ad17d8d admin admin] PATH_INFO: `/v3/projects/e65507ade2ab4a2e9fb5dd982a278324` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:36.909653 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a31d3f-e2a5-4541-9907-23385ad17d8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e65507ade2ab4a2e9fb5dd982a278324)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:36.911400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a31d3f-e2a5-4541-9907-23385ad17d8d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:37.075197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-96a31d3f-e2a5-4541-9907-23385ad17d8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e65507ade2ab4a2e9fb5dd982a278324', 'request_id': 'req-96a31d3f-e2a5-4541-9907-23385ad17d8d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:37.082970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-96a31d3f-e2a5-4541-9907-23385ad17d8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e65507ade2ab4a2e9fb5dd982a278324', 'request_id': 'req-96a31d3f-e2a5-4541-9907-23385ad17d8d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:37.146135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-96a31d3f-e2a5-4541-9907-23385ad17d8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e65507ade2ab4a2e9fb5dd982a278324', 'request_id': 'req-96a31d3f-e2a5-4541-9907-23385ad17d8d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:37.162691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-96a31d3f-e2a5-4541-9907-23385ad17d8d admin admin] The token cache is being invalidate because project e65507ade2ab4a2e9fb5dd982a278324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:31:37.162981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-96a31d3f-e2a5-4541-9907-23385ad17d8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:37.163832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-96a31d3f-e2a5-4541-9907-23385ad17d8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:37.170521 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2059/4109] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:31:36 2022] DELETE /identity/v3/projects/e65507ade2ab4a2e9fb5dd982a278324 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:37.172146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602e9a3-2571-4d48-be9a-161688d20d8f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:37.172671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602e9a3-2571-4d48-be9a-161688d20d8f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:37.173084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602e9a3-2571-4d48-be9a-161688d20d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:37.199371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8602e9a3-2571-4d48-be9a-161688d20d8f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:37.201064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8602e9a3-2571-4d48-be9a-161688d20d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:37.297348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551da6f6-d39f-4461-b162-bff88cf011b2 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:37.297641 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2051/4110] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:37.297822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551da6f6-d39f-4461-b162-bff88cf011b2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:37.298113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551da6f6-d39f-4461-b162-bff88cf011b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:37.369683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-551da6f6-d39f-4461-b162-bff88cf011b2 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:37.371151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-551da6f6-d39f-4461-b162-bff88cf011b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:37.393897 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2060/4111] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:37.394207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602e9a3-2571-4d48-be9a-161688d20d8f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:37.406805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602e9a3-2571-4d48-be9a-161688d20d8f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:37.421921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac2c8e-b7ba-428c-ae9a-25f0a94ac559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:37.422529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac2c8e-b7ba-428c-ae9a-25f0a94ac559 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:37.422819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac2c8e-b7ba-428c-ae9a-25f0a94ac559 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:37.423298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac2c8e-b7ba-428c-ae9a-25f0a94ac559 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:37.424052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac2c8e-b7ba-428c-ae9a-25f0a94ac559 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:31:37.424369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac2c8e-b7ba-428c-ae9a-25f0a94ac559 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:37.426052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac2c8e-b7ba-428c-ae9a-25f0a94ac559 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:37.442573 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2052/4112] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:31:37.443529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551da6f6-d39f-4461-b162-bff88cf011b2 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:37.462972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551da6f6-d39f-4461-b162-bff88cf011b2 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:37.468826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1a3f0-87e8-4e84-b8f5-02d3d78b8713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:37.469763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1a3f0-87e8-4e84-b8f5-02d3d78b8713 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:37.470335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1a3f0-87e8-4e84-b8f5-02d3d78b8713 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:37.472444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1a3f0-87e8-4e84-b8f5-02d3d78b8713 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:37.473372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1a3f0-87e8-4e84-b8f5-02d3d78b8713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:37.475873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1a3f0-87e8-4e84-b8f5-02d3d78b8713 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:37.583777 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2061/4113] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:31:37 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:31:37.588115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac2c8e-b7ba-428c-ae9a-25f0a94ac559 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:37.611390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac2c8e-b7ba-428c-ae9a-25f0a94ac559 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:37.730339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc107d71-7159-411f-9108-f93babd2cfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:37.731843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc107d71-7159-411f-9108-f93babd2cfb7 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:37.732152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc107d71-7159-411f-9108-f93babd2cfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:37.733153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc107d71-7159-411f-9108-f93babd2cfb7 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:37.734735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc107d71-7159-411f-9108-f93babd2cfb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:37.737968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc107d71-7159-411f-9108-f93babd2cfb7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:37.910995 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2053/4114] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:31:37 2022] POST /identity/v3/users => generated 288 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:31:37.912299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1a3f0-87e8-4e84-b8f5-02d3d78b8713 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:37.926139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1a3f0-87e8-4e84-b8f5-02d3d78b8713 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:37.941033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9cb2b-91e6-42d5-a8c3-374f8472dede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:37.941033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9cb2b-91e6-42d5-a8c3-374f8472dede admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:37.941033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9cb2b-91e6-42d5-a8c3-374f8472dede admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:37.941033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9cb2b-91e6-42d5-a8c3-374f8472dede admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:37.941468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9cb2b-91e6-42d5-a8c3-374f8472dede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:37.942834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9cb2b-91e6-42d5-a8c3-374f8472dede admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:37.962476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc107d71-7159-411f-9108-f93babd2cfb7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:37.969325 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2062/4115] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:31:37.975946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc107d71-7159-411f-9108-f93babd2cfb7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:37.979350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2441b-5bcb-4f37-86ca-36e4d3b10c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:37.980313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2441b-5bcb-4f37-86ca-36e4d3b10c75 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:37.980886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2441b-5bcb-4f37-86ca-36e4d3b10c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:37.981798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2441b-5bcb-4f37-86ca-36e4d3b10c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:37.982916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2441b-5bcb-4f37-86ca-36e4d3b10c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:38.003842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2441b-5bcb-4f37-86ca-36e4d3b10c75 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:38.024273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9cb2b-91e6-42d5-a8c3-374f8472dede admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:38.037161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9cb2b-91e6-42d5-a8c3-374f8472dede admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:38.037672 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2054/4116] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:31:38.047735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f25284-9015-42e0-acdc-373239bad743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:38.049650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f25284-9015-42e0-acdc-373239bad743 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:38.049947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f25284-9015-42e0-acdc-373239bad743 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:38.050238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f25284-9015-42e0-acdc-373239bad743 admin admin] PATH_INFO: `/v3/projects/dc22ae6537554345819055e1eae07375/users/36188007ad34426a9feb94464dcc7aac/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:38.090318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f25284-9015-42e0-acdc-373239bad743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc22ae6537554345819055e1eae07375, user_id=36188007ad34426a9feb94464dcc7aac, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:38.096862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f25284-9015-42e0-acdc-373239bad743 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:38.212909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecb08b-aad2-4c84-b43f-0d3a570530ee None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:38.213372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecb08b-aad2-4c84-b43f-0d3a570530ee None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:38.213372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecb08b-aad2-4c84-b43f-0d3a570530ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:38.214568 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2063/4117] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:31:38 2022] PUT /identity/v3/projects/dc22ae6537554345819055e1eae07375/users/36188007ad34426a9feb94464dcc7aac/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:38.275842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-71ecb08b-aad2-4c84-b43f-0d3a570530ee None None] MFA Rules not processed for user `36188007ad34426a9feb94464dcc7aac`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:38.277343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-71ecb08b-aad2-4c84-b43f-0d3a570530ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:38.404830 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2055/4118] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:38.472093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f25284-9015-42e0-acdc-373239bad743 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:38.474129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f3f25284-9015-42e0-acdc-373239bad743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:38.619604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f25284-9015-42e0-acdc-373239bad743 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:38.626639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef39a4-f1cc-4a5c-b285-0814b2bbe35b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:38.627344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef39a4-f1cc-4a5c-b285-0814b2bbe35b service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:38.627691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef39a4-f1cc-4a5c-b285-0814b2bbe35b service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:38.627974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef39a4-f1cc-4a5c-b285-0814b2bbe35b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:38.638351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef39a4-f1cc-4a5c-b285-0814b2bbe35b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:38.640239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef39a4-f1cc-4a5c-b285-0814b2bbe35b service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:38.657881 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2064/4119] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:31:38.849637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecb08b-aad2-4c84-b43f-0d3a570530ee None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:38.953891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecb08b-aad2-4c84-b43f-0d3a570530ee None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:38.959971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db639c5c-3f8e-47d7-816b-d5f3661c94f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:38.961196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db639c5c-3f8e-47d7-816b-d5f3661c94f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:38.961841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db639c5c-3f8e-47d7-816b-d5f3661c94f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:38.962548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db639c5c-3f8e-47d7-816b-d5f3661c94f3 admin admin] PATH_INFO: `/v3/users/36188007ad34426a9feb94464dcc7aac` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:38.964404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db639c5c-3f8e-47d7-816b-d5f3661c94f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36188007ad34426a9feb94464dcc7aac)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:38.967873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db639c5c-3f8e-47d7-816b-d5f3661c94f3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:39.154697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-db639c5c-3f8e-47d7-816b-d5f3661c94f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36188007ad34426a9feb94464dcc7aac'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:39.170216 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-db639c5c-3f8e-47d7-816b-d5f3661c94f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36188007ad34426a9feb94464dcc7aac'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:39.170998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-db639c5c-3f8e-47d7-816b-d5f3661c94f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36188007ad34426a9feb94464dcc7aac'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:39.182840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-db639c5c-3f8e-47d7-816b-d5f3661c94f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36188007ad34426a9feb94464dcc7aac'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:39.260146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-db639c5c-3f8e-47d7-816b-d5f3661c94f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36188007ad34426a9feb94464dcc7aac'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:39.271904 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2056/4120] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:31:38 2022] DELETE /identity/v3/users/36188007ad34426a9feb94464dcc7aac => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:39.276800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a68f6-ff9c-4889-8af0-6f4716244ed1 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:39.277253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a68f6-ff9c-4889-8af0-6f4716244ed1 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:39.277513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a68f6-ff9c-4889-8af0-6f4716244ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:39.307289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-494a68f6-ff9c-4889-8af0-6f4716244ed1 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:39.308813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-494a68f6-ff9c-4889-8af0-6f4716244ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:39.344207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4048ac-2a26-4212-a4ff-90642987890f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:39.344566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4048ac-2a26-4212-a4ff-90642987890f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:39.344983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4048ac-2a26-4212-a4ff-90642987890f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:39.393097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0b4048ac-2a26-4212-a4ff-90642987890f None None] MFA Rules not processed for user `04881f915cde4c29b57c9173ab754cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:39.397926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0b4048ac-2a26-4212-a4ff-90642987890f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:39.401843 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2065/4121] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:39.409096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a68f6-ff9c-4889-8af0-6f4716244ed1 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:39.412419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-494a68f6-ff9c-4889-8af0-6f4716244ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:39.500959 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2057/4122] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:31:39.524462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a68f6-ff9c-4889-8af0-6f4716244ed1 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:39.533001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285dc17d-b04e-4112-bf2e-252b8b97edbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:39.534211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dc17d-b04e-4112-bf2e-252b8b97edbf service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:39.534655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dc17d-b04e-4112-bf2e-252b8b97edbf service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:39.535138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dc17d-b04e-4112-bf2e-252b8b97edbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:39.556290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285dc17d-b04e-4112-bf2e-252b8b97edbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:39.558152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285dc17d-b04e-4112-bf2e-252b8b97edbf service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:39.571264 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2066/4123] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:31:40.910857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4048ac-2a26-4212-a4ff-90642987890f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:40.923884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0b4048ac-2a26-4212-a4ff-90642987890f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:40.977909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4048ac-2a26-4212-a4ff-90642987890f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:41.001572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa72dee-a377-4f45-841f-ad3ebcc97dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:41.004035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa72dee-a377-4f45-841f-ad3ebcc97dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:41.006189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa72dee-a377-4f45-841f-ad3ebcc97dab admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:41.008749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa72dee-a377-4f45-841f-ad3ebcc97dab admin admin] PATH_INFO: `/v3/projects/dc22ae6537554345819055e1eae07375` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:41.011884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa72dee-a377-4f45-841f-ad3ebcc97dab admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc22ae6537554345819055e1eae07375)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:41.018248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa72dee-a377-4f45-841f-ad3ebcc97dab admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:41.365875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-aaa72dee-a377-4f45-841f-ad3ebcc97dab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc22ae6537554345819055e1eae07375', 'request_id': 'req-aaa72dee-a377-4f45-841f-ad3ebcc97dab'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:41.455234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-aaa72dee-a377-4f45-841f-ad3ebcc97dab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc22ae6537554345819055e1eae07375', 'request_id': 'req-aaa72dee-a377-4f45-841f-ad3ebcc97dab'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:41.471058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-aaa72dee-a377-4f45-841f-ad3ebcc97dab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc22ae6537554345819055e1eae07375', 'request_id': 'req-aaa72dee-a377-4f45-841f-ad3ebcc97dab'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:41.497885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-aaa72dee-a377-4f45-841f-ad3ebcc97dab admin admin] The token cache is being invalidate because project dc22ae6537554345819055e1eae07375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:31:41.498446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-aaa72dee-a377-4f45-841f-ad3ebcc97dab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:41.499326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-aaa72dee-a377-4f45-841f-ad3ebcc97dab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:41.514426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984b653-769f-4de1-8472-a6424a89e12d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:41.522376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984b653-769f-4de1-8472-a6424a89e12d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:41.523340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984b653-769f-4de1-8472-a6424a89e12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:41.526091 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2058/4124] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:31:40 2022] DELETE /identity/v3/projects/dc22ae6537554345819055e1eae07375 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:41.552693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e984b653-769f-4de1-8472-a6424a89e12d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:41.557289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e984b653-769f-4de1-8472-a6424a89e12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:41.720385 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2067/4125] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:41.730249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815df311-110f-433a-a1e2-d379745b70f7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:41.732079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815df311-110f-433a-a1e2-d379745b70f7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:41.732524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815df311-110f-433a-a1e2-d379745b70f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:41.762596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-815df311-110f-433a-a1e2-d379745b70f7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:41.764366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-815df311-110f-433a-a1e2-d379745b70f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:41.774903 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2059/4126] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:41.779732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984b653-769f-4de1-8472-a6424a89e12d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:41.803165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984b653-769f-4de1-8472-a6424a89e12d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:41.815204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87c482-b0c8-4711-9a49-957f27eb0fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:41.815905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87c482-b0c8-4711-9a49-957f27eb0fcb admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:41.816189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87c482-b0c8-4711-9a49-957f27eb0fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:41.816470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87c482-b0c8-4711-9a49-957f27eb0fcb admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:41.817268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87c482-b0c8-4711-9a49-957f27eb0fcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:31:41.817584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87c482-b0c8-4711-9a49-957f27eb0fcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:41.819211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87c482-b0c8-4711-9a49-957f27eb0fcb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:41.871035 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2068/4127] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:31:41.873015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815df311-110f-433a-a1e2-d379745b70f7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:41.928979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815df311-110f-433a-a1e2-d379745b70f7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:41.975822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba224f15-b5f7-477e-bf9a-78a44479122c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:41.979844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba224f15-b5f7-477e-bf9a-78a44479122c admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:41.980142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba224f15-b5f7-477e-bf9a-78a44479122c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:41.980434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba224f15-b5f7-477e-bf9a-78a44479122c admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:41.981831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba224f15-b5f7-477e-bf9a-78a44479122c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:41.983710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba224f15-b5f7-477e-bf9a-78a44479122c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:42.130533 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2060/4128] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:31:41 2022] POST /identity/v3/projects => generated 403 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:31:42.134075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87c482-b0c8-4711-9a49-957f27eb0fcb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:42.150713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87c482-b0c8-4711-9a49-957f27eb0fcb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:42.315314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679d112-ed4b-4af7-8632-05053859b056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:42.316060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679d112-ed4b-4af7-8632-05053859b056 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:42.316486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679d112-ed4b-4af7-8632-05053859b056 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:42.316829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679d112-ed4b-4af7-8632-05053859b056 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:42.317692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679d112-ed4b-4af7-8632-05053859b056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:42.321430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679d112-ed4b-4af7-8632-05053859b056 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:42.423620 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2069/4129] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:31:42 2022] POST /identity/v3/users => generated 302 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:31:42.424443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba224f15-b5f7-477e-bf9a-78a44479122c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:42.459200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba224f15-b5f7-477e-bf9a-78a44479122c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:42.487893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2e0e9-3c3f-4f53-9805-1a96dc2709ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:42.500908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2e0e9-3c3f-4f53-9805-1a96dc2709ee admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:42.501617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2e0e9-3c3f-4f53-9805-1a96dc2709ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:42.502806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2e0e9-3c3f-4f53-9805-1a96dc2709ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:42.506584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2e0e9-3c3f-4f53-9805-1a96dc2709ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:42.525316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2e0e9-3c3f-4f53-9805-1a96dc2709ee admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:42.545838 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2061/4130] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:31:42.555056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679d112-ed4b-4af7-8632-05053859b056 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:42.582674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679d112-ed4b-4af7-8632-05053859b056 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:42.600920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18a207-8e9e-4fa1-b7ed-b77139190753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:42.601875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18a207-8e9e-4fa1-b7ed-b77139190753 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:42.602347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18a207-8e9e-4fa1-b7ed-b77139190753 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:42.602794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18a207-8e9e-4fa1-b7ed-b77139190753 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:42.603707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18a207-8e9e-4fa1-b7ed-b77139190753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:42.605587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18a207-8e9e-4fa1-b7ed-b77139190753 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:42.649265 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2070/4131] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:31:42.653815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2e0e9-3c3f-4f53-9805-1a96dc2709ee admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:42.668425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2e0e9-3c3f-4f53-9805-1a96dc2709ee admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:42.682434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cdc010-82b2-4931-a9da-42e7183871f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:42.683640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cdc010-82b2-4931-a9da-42e7183871f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:42.684628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cdc010-82b2-4931-a9da-42e7183871f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:42.692248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cdc010-82b2-4931-a9da-42e7183871f5 admin admin] PATH_INFO: `/v3/projects/37dec51d2b074d888b2527fc09e44db2/users/321fd5c30e1a4b7baad26cf3cae16f63/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:42.721076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cdc010-82b2-4931-a9da-42e7183871f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37dec51d2b074d888b2527fc09e44db2, user_id=321fd5c30e1a4b7baad26cf3cae16f63, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:42.723946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cdc010-82b2-4931-a9da-42e7183871f5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:42.781791 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2062/4132] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:31:42 2022] PUT /identity/v3/projects/37dec51d2b074d888b2527fc09e44db2/users/321fd5c30e1a4b7baad26cf3cae16f63/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:31:42.800421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2dcaf-bb56-4fce-b89b-505258c527af None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:42.804458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2dcaf-bb56-4fce-b89b-505258c527af None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:42.804458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2dcaf-bb56-4fce-b89b-505258c527af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:42.872162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-47f2dcaf-bb56-4fce-b89b-505258c527af None None] MFA Rules not processed for user `321fd5c30e1a4b7baad26cf3cae16f63`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:42.873559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-47f2dcaf-bb56-4fce-b89b-505258c527af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:42.980578 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2071/4133] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:42.985717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cdc010-82b2-4931-a9da-42e7183871f5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:43.083992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cdc010-82b2-4931-a9da-42e7183871f5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:43.108851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f9ca3-bbb9-4252-9a4e-67507cc0b9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:43.108851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f9ca3-bbb9-4252-9a4e-67507cc0b9b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:43.108851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f9ca3-bbb9-4252-9a4e-67507cc0b9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:43.108851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f9ca3-bbb9-4252-9a4e-67507cc0b9b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:43.109200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f9ca3-bbb9-4252-9a4e-67507cc0b9b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:43.111476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f9ca3-bbb9-4252-9a4e-67507cc0b9b3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:43.227012 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2063/4134] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:31:42 2022] POST /identity/v3/projects => generated 403 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:31:43.231504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2dcaf-bb56-4fce-b89b-505258c527af None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:43.255387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2dcaf-bb56-4fce-b89b-505258c527af None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:43.438254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe876ad0-859d-450c-b9fe-732db4d7e30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:43.439156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe876ad0-859d-450c-b9fe-732db4d7e30f admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:43.439537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe876ad0-859d-450c-b9fe-732db4d7e30f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:43.439918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe876ad0-859d-450c-b9fe-732db4d7e30f admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:43.440894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe876ad0-859d-450c-b9fe-732db4d7e30f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:43.442985 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe876ad0-859d-450c-b9fe-732db4d7e30f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:43.564725 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2072/4135] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:31:43 2022] POST /identity/v3/users => generated 308 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:31:43.567867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f9ca3-bbb9-4252-9a4e-67507cc0b9b3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:43.616453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f9ca3-bbb9-4252-9a4e-67507cc0b9b3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:43.668478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb480cf0-a169-487e-a886-d3affd18fb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:43.672270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb480cf0-a169-487e-a886-d3affd18fb33 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:43.679139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb480cf0-a169-487e-a886-d3affd18fb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:43.679139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb480cf0-a169-487e-a886-d3affd18fb33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:43.680301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb480cf0-a169-487e-a886-d3affd18fb33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:43.682280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb480cf0-a169-487e-a886-d3affd18fb33 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:43.745346 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2064/4136] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:31:43.748886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe876ad0-859d-450c-b9fe-732db4d7e30f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:43.767128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe876ad0-859d-450c-b9fe-732db4d7e30f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:43.789414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c52825-cb98-4829-babe-7477508fe3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:43.790373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c52825-cb98-4829-babe-7477508fe3d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:43.790670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c52825-cb98-4829-babe-7477508fe3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:43.791136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c52825-cb98-4829-babe-7477508fe3d0 admin admin] PATH_INFO: `/v3/projects/67626ea56eac428290179e4b62ca0eab/users/2cf460cf31af4f8c9cc81ca37ff81956/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:43.841757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c52825-cb98-4829-babe-7477508fe3d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67626ea56eac428290179e4b62ca0eab, user_id=2cf460cf31af4f8c9cc81ca37ff81956, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:43.850023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c52825-cb98-4829-babe-7477508fe3d0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:43.953785 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2073/4137] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:31:43 2022] PUT /identity/v3/projects/67626ea56eac428290179e4b62ca0eab/users/2cf460cf31af4f8c9cc81ca37ff81956/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:43.958551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb480cf0-a169-487e-a886-d3affd18fb33 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:43.970596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb480cf0-a169-487e-a886-d3affd18fb33 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:44.068521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33eaf7-2b63-41cf-95ba-8fbf665fc0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:44.072330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33eaf7-2b63-41cf-95ba-8fbf665fc0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:44.072330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33eaf7-2b63-41cf-95ba-8fbf665fc0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:44.072330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33eaf7-2b63-41cf-95ba-8fbf665fc0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:44.072330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33eaf7-2b63-41cf-95ba-8fbf665fc0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:44.074113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33eaf7-2b63-41cf-95ba-8fbf665fc0c3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:44.101051 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2065/4138] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:31:44.102438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c52825-cb98-4829-babe-7477508fe3d0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:44.117807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c52825-cb98-4829-babe-7477508fe3d0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:44.124663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06ba9d-baba-46fa-ae53-69e20df6204b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:44.127478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06ba9d-baba-46fa-ae53-69e20df6204b admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:44.127478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06ba9d-baba-46fa-ae53-69e20df6204b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:44.127478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06ba9d-baba-46fa-ae53-69e20df6204b admin admin] PATH_INFO: `/v3/projects/67626ea56eac428290179e4b62ca0eab/users/2cf460cf31af4f8c9cc81ca37ff81956/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:44.130516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06ba9d-baba-46fa-ae53-69e20df6204b admin admin] RBAC: Authorizing `identity:create_grant(project_id=67626ea56eac428290179e4b62ca0eab, user_id=2cf460cf31af4f8c9cc81ca37ff81956, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:44.134255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06ba9d-baba-46fa-ae53-69e20df6204b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:44.159038 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2074/4139] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:31:44 2022] PUT /identity/v3/projects/67626ea56eac428290179e4b62ca0eab/users/2cf460cf31af4f8c9cc81ca37ff81956/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:31:44.178565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cc33d-41b6-4d0b-b750-fcb45d386e21 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:44.179331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cc33d-41b6-4d0b-b750-fcb45d386e21 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:44.179825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cc33d-41b6-4d0b-b750-fcb45d386e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:44.210217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b76cc33d-41b6-4d0b-b750-fcb45d386e21 None None] MFA Rules not processed for user `2cf460cf31af4f8c9cc81ca37ff81956`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:44.212508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b76cc33d-41b6-4d0b-b750-fcb45d386e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:44.234143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b28474-6ad8-4aa6-8823-2c7bd727d630 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:44.234425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b28474-6ad8-4aa6-8823-2c7bd727d630 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:44.236490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b28474-6ad8-4aa6-8823-2c7bd727d630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:44.281933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-24b28474-6ad8-4aa6-8823-2c7bd727d630 None None] MFA Rules not processed for user `ac7a59b2974d49b0ac50e3885c6a3ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:44.286176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-24b28474-6ad8-4aa6-8823-2c7bd727d630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:44.320683 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2066/4140] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:44 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:44.333629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cc33d-41b6-4d0b-b750-fcb45d386e21 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:44.336049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b76cc33d-41b6-4d0b-b750-fcb45d386e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:44.396756 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2075/4141] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:44.405135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b28474-6ad8-4aa6-8823-2c7bd727d630 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:44.406826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-24b28474-6ad8-4aa6-8823-2c7bd727d630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:44.407334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cc33d-41b6-4d0b-b750-fcb45d386e21 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:44.412123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff0c8f-83b3-4e41-b454-f1fc1fcdf660 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:44.413095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff0c8f-83b3-4e41-b454-f1fc1fcdf660 service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:44.414129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff0c8f-83b3-4e41-b454-f1fc1fcdf660 service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:44.414550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff0c8f-83b3-4e41-b454-f1fc1fcdf660 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:44.427427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff0c8f-83b3-4e41-b454-f1fc1fcdf660 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:44.430036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff0c8f-83b3-4e41-b454-f1fc1fcdf660 service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:44.444297 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2067/4142] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:44 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:31:44.491690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b28474-6ad8-4aa6-8823-2c7bd727d630 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:44.497367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ec975-802a-4445-ada9-ffff9e2e4d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:44.498068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ec975-802a-4445-ada9-ffff9e2e4d66 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:44.498417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ec975-802a-4445-ada9-ffff9e2e4d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:44.498706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ec975-802a-4445-ada9-ffff9e2e4d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:44.509021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ec975-802a-4445-ada9-ffff9e2e4d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:44.517044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ec975-802a-4445-ada9-ffff9e2e4d66 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:44.522835 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2076/4143] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:31:44.603485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff0c8f-83b3-4e41-b454-f1fc1fcdf660 service cinder] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:44.684973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff0c8f-83b3-4e41-b454-f1fc1fcdf660 service cinder] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:44.691577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c831ec-9586-40df-9edd-3f47b1c384a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:44.693274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c831ec-9586-40df-9edd-3f47b1c384a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:44.694291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c831ec-9586-40df-9edd-3f47b1c384a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:44.695043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c831ec-9586-40df-9edd-3f47b1c384a9 admin admin] PATH_INFO: `/v3/users/321fd5c30e1a4b7baad26cf3cae16f63` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:44.696352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c831ec-9586-40df-9edd-3f47b1c384a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=321fd5c30e1a4b7baad26cf3cae16f63)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:44.699156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c831ec-9586-40df-9edd-3f47b1c384a9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:44.873927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f7c831ec-9586-40df-9edd-3f47b1c384a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '321fd5c30e1a4b7baad26cf3cae16f63'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:44.911754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f7c831ec-9586-40df-9edd-3f47b1c384a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '321fd5c30e1a4b7baad26cf3cae16f63'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:44.915463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f7c831ec-9586-40df-9edd-3f47b1c384a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '321fd5c30e1a4b7baad26cf3cae16f63'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:44.948843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f7c831ec-9586-40df-9edd-3f47b1c384a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '321fd5c30e1a4b7baad26cf3cae16f63'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:45.014927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f7c831ec-9586-40df-9edd-3f47b1c384a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '321fd5c30e1a4b7baad26cf3cae16f63'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:45.024840 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2068/4144] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:31:44 2022] DELETE /identity/v3/users/321fd5c30e1a4b7baad26cf3cae16f63 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:45.034302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a16a1a-23c6-401b-8b7d-869000ccf7de None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:45.034769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a16a1a-23c6-401b-8b7d-869000ccf7de None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:45.034948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a16a1a-23c6-401b-8b7d-869000ccf7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:45.089823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-81a16a1a-23c6-401b-8b7d-869000ccf7de None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:45.091642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-81a16a1a-23c6-401b-8b7d-869000ccf7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:45.208702 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2077/4145] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:45.254441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c831ec-9586-40df-9edd-3f47b1c384a9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:45.256797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f7c831ec-9586-40df-9edd-3f47b1c384a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:45.353007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c831ec-9586-40df-9edd-3f47b1c384a9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:45.358570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534244d-4b35-4edf-b892-d5c6cd3e15e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:45.359757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534244d-4b35-4edf-b892-d5c6cd3e15e9 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:45.360182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534244d-4b35-4edf-b892-d5c6cd3e15e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:45.360783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534244d-4b35-4edf-b892-d5c6cd3e15e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:45.373611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534244d-4b35-4edf-b892-d5c6cd3e15e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:45.375641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534244d-4b35-4edf-b892-d5c6cd3e15e9 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:45.394871 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2069/4146] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:31:46.253742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd60fc-ded2-4897-bd0b-97a125502be4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:46.254299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd60fc-ded2-4897-bd0b-97a125502be4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:46.254299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd60fc-ded2-4897-bd0b-97a125502be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:46.282895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-aedd60fc-ded2-4897-bd0b-97a125502be4 None None] MFA Rules not processed for user `bb79a0a1ee5a429c9df27db4f671f0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:46.284402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-aedd60fc-ded2-4897-bd0b-97a125502be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:46.392275 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2078/4147] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:47.134813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534244d-4b35-4edf-b892-d5c6cd3e15e9 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:47.140557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0534244d-4b35-4edf-b892-d5c6cd3e15e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:47.169935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534244d-4b35-4edf-b892-d5c6cd3e15e9 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:47.182550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a44f1-65c8-4c5f-b551-f2c61bcdf332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:47.183459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a44f1-65c8-4c5f-b551-f2c61bcdf332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:47.186213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a44f1-65c8-4c5f-b551-f2c61bcdf332 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:47.186724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a44f1-65c8-4c5f-b551-f2c61bcdf332 admin admin] PATH_INFO: `/v3/projects/37dec51d2b074d888b2527fc09e44db2` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:47.191195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a44f1-65c8-4c5f-b551-f2c61bcdf332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37dec51d2b074d888b2527fc09e44db2)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:47.197488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a44f1-65c8-4c5f-b551-f2c61bcdf332 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:47.373105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8e7a44f1-65c8-4c5f-b551-f2c61bcdf332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37dec51d2b074d888b2527fc09e44db2', 'request_id': 'req-8e7a44f1-65c8-4c5f-b551-f2c61bcdf332'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:47.478311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8e7a44f1-65c8-4c5f-b551-f2c61bcdf332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37dec51d2b074d888b2527fc09e44db2', 'request_id': 'req-8e7a44f1-65c8-4c5f-b551-f2c61bcdf332'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:47.494792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8e7a44f1-65c8-4c5f-b551-f2c61bcdf332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37dec51d2b074d888b2527fc09e44db2', 'request_id': 'req-8e7a44f1-65c8-4c5f-b551-f2c61bcdf332'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:47.505216 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8e7a44f1-65c8-4c5f-b551-f2c61bcdf332 admin admin] The token cache is being invalidate because project 37dec51d2b074d888b2527fc09e44db2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:31:47.508525 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8e7a44f1-65c8-4c5f-b551-f2c61bcdf332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:47.510158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8e7a44f1-65c8-4c5f-b551-f2c61bcdf332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:47.514510 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2070/4148] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:31:47 2022] DELETE /identity/v3/projects/37dec51d2b074d888b2527fc09e44db2 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:47.518173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd60fc-ded2-4897-bd0b-97a125502be4 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:47.535144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd60fc-ded2-4897-bd0b-97a125502be4 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:47.682064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c70003-e9ab-443a-90bf-7bbf65dee065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:47.683002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c70003-e9ab-443a-90bf-7bbf65dee065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:47.683294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c70003-e9ab-443a-90bf-7bbf65dee065 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:47.684249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c70003-e9ab-443a-90bf-7bbf65dee065 admin admin] PATH_INFO: `/v3/users/2cf460cf31af4f8c9cc81ca37ff81956` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:47.685758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c70003-e9ab-443a-90bf-7bbf65dee065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf460cf31af4f8c9cc81ca37ff81956)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:47.688327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c70003-e9ab-443a-90bf-7bbf65dee065 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:47.927587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-36c70003-e9ab-443a-90bf-7bbf65dee065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf460cf31af4f8c9cc81ca37ff81956'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:47.952046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-36c70003-e9ab-443a-90bf-7bbf65dee065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf460cf31af4f8c9cc81ca37ff81956'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:47.952873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-36c70003-e9ab-443a-90bf-7bbf65dee065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf460cf31af4f8c9cc81ca37ff81956'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:47.962126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-36c70003-e9ab-443a-90bf-7bbf65dee065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf460cf31af4f8c9cc81ca37ff81956'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:48.049458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-36c70003-e9ab-443a-90bf-7bbf65dee065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf460cf31af4f8c9cc81ca37ff81956'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:48.061916 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2079/4149] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:31:47 2022] DELETE /identity/v3/users/2cf460cf31af4f8c9cc81ca37ff81956 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:48.499498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a44f1-65c8-4c5f-b551-f2c61bcdf332 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:48.503132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8e7a44f1-65c8-4c5f-b551-f2c61bcdf332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:48.545939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a44f1-65c8-4c5f-b551-f2c61bcdf332 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:48.713275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a508fd9-8c4f-4d6b-a849-156d75f68eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:48.719073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a508fd9-8c4f-4d6b-a849-156d75f68eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:48.720023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a508fd9-8c4f-4d6b-a849-156d75f68eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:48.727692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a508fd9-8c4f-4d6b-a849-156d75f68eb6 admin admin] PATH_INFO: `/v3/users/68fbd43b80904411b61d9c1e5b8fa843` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:48.733404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a508fd9-8c4f-4d6b-a849-156d75f68eb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68fbd43b80904411b61d9c1e5b8fa843)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:48.741889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a508fd9-8c4f-4d6b-a849-156d75f68eb6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:49.056368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2a508fd9-8c4f-4d6b-a849-156d75f68eb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68fbd43b80904411b61d9c1e5b8fa843'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:49.089352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2a508fd9-8c4f-4d6b-a849-156d75f68eb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68fbd43b80904411b61d9c1e5b8fa843'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:49.092679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2a508fd9-8c4f-4d6b-a849-156d75f68eb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68fbd43b80904411b61d9c1e5b8fa843'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:49.125501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2a508fd9-8c4f-4d6b-a849-156d75f68eb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68fbd43b80904411b61d9c1e5b8fa843'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:49.260830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2a508fd9-8c4f-4d6b-a849-156d75f68eb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68fbd43b80904411b61d9c1e5b8fa843'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:49.271693 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2071/4150] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:31:48 2022] DELETE /identity/v3/users/68fbd43b80904411b61d9c1e5b8fa843 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:49.274126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6de5c-fd07-4d54-9a36-889e183f76de None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:49.274901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6de5c-fd07-4d54-9a36-889e183f76de None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:49.275196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6de5c-fd07-4d54-9a36-889e183f76de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:49.310014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-60a6de5c-fd07-4d54-9a36-889e183f76de None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:49.312648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-60a6de5c-fd07-4d54-9a36-889e183f76de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:49.460353 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2080/4151] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:49.474050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a508fd9-8c4f-4d6b-a849-156d75f68eb6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:49.475999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2a508fd9-8c4f-4d6b-a849-156d75f68eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:49.514852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6de5c-fd07-4d54-9a36-889e183f76de None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:49.514852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-60a6de5c-fd07-4d54-9a36-889e183f76de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:49.528582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6de5c-fd07-4d54-9a36-889e183f76de None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:49.540681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90013932-344b-4674-a84a-5c27333ca27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:49.543740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90013932-344b-4674-a84a-5c27333ca27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:49.543740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90013932-344b-4674-a84a-5c27333ca27b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:49.543740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90013932-344b-4674-a84a-5c27333ca27b admin admin] PATH_INFO: `/v3/projects/67626ea56eac428290179e4b62ca0eab` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:49.545300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90013932-344b-4674-a84a-5c27333ca27b admin admin] RBAC: Authorizing `identity:delete_project(project_id=67626ea56eac428290179e4b62ca0eab)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:49.548330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90013932-344b-4674-a84a-5c27333ca27b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:49.601712 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a508fd9-8c4f-4d6b-a849-156d75f68eb6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:49.606524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeeb458-7fc6-4f3a-ab0f-83adcb7de827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:49.607339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeb458-7fc6-4f3a-ab0f-83adcb7de827 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:49.607634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeb458-7fc6-4f3a-ab0f-83adcb7de827 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:49.607916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeb458-7fc6-4f3a-ab0f-83adcb7de827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:49.618017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeeb458-7fc6-4f3a-ab0f-83adcb7de827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:49.624937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeeb458-7fc6-4f3a-ab0f-83adcb7de827 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:49.665744 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2072/4152] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:31:49.674550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb6ca6-5ab9-4ba4-b1e5-5ba378a35381 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:49.674550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb6ca6-5ab9-4ba4-b1e5-5ba378a35381 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:49.674550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb6ca6-5ab9-4ba4-b1e5-5ba378a35381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:49.708576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-90013932-344b-4674-a84a-5c27333ca27b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67626ea56eac428290179e4b62ca0eab', 'request_id': 'req-90013932-344b-4674-a84a-5c27333ca27b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:49.724284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-90013932-344b-4674-a84a-5c27333ca27b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67626ea56eac428290179e4b62ca0eab', 'request_id': 'req-90013932-344b-4674-a84a-5c27333ca27b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:49.727857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-48cb6ca6-5ab9-4ba4-b1e5-5ba378a35381 None None] MFA Rules not processed for user `ac7a59b2974d49b0ac50e3885c6a3ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:49.730215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-48cb6ca6-5ab9-4ba4-b1e5-5ba378a35381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:49.826985 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-90013932-344b-4674-a84a-5c27333ca27b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67626ea56eac428290179e4b62ca0eab', 'request_id': 'req-90013932-344b-4674-a84a-5c27333ca27b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:49.844078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-90013932-344b-4674-a84a-5c27333ca27b admin admin] The token cache is being invalidate because project 67626ea56eac428290179e4b62ca0eab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:31:49.844273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-90013932-344b-4674-a84a-5c27333ca27b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:49.853790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-90013932-344b-4674-a84a-5c27333ca27b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:49.863482 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2081/4153] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:31:49 2022] DELETE /identity/v3/projects/67626ea56eac428290179e4b62ca0eab => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:31:49.874948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48eb8ba-b51c-4c6a-9461-f2d867e2c91a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:49.877972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48eb8ba-b51c-4c6a-9461-f2d867e2c91a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:49.878316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48eb8ba-b51c-4c6a-9461-f2d867e2c91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:49.884060 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2073/4154] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:49.935581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c48eb8ba-b51c-4c6a-9461-f2d867e2c91a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:49.936905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c48eb8ba-b51c-4c6a-9461-f2d867e2c91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:50.112958 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2082/4155] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:50.122166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab60c2-bf51-40e8-972f-6415ce251ca8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:50.122759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab60c2-bf51-40e8-972f-6415ce251ca8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:50.123218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab60c2-bf51-40e8-972f-6415ce251ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:50.157273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-54ab60c2-bf51-40e8-972f-6415ce251ca8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:50.158784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-54ab60c2-bf51-40e8-972f-6415ce251ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:50.169922 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2074/4156] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:50.174369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48eb8ba-b51c-4c6a-9461-f2d867e2c91a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:50.209643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48eb8ba-b51c-4c6a-9461-f2d867e2c91a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:50.232033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e582294-4678-4c39-b114-2bd7579ea765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:50.242693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e582294-4678-4c39-b114-2bd7579ea765 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:50.242693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e582294-4678-4c39-b114-2bd7579ea765 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:50.242693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e582294-4678-4c39-b114-2bd7579ea765 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:50.242693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e582294-4678-4c39-b114-2bd7579ea765 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:31:50.242693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e582294-4678-4c39-b114-2bd7579ea765 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:50.258850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e582294-4678-4c39-b114-2bd7579ea765 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:50.285027 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2083/4157] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:31:50.289964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab60c2-bf51-40e8-972f-6415ce251ca8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:50.304031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab60c2-bf51-40e8-972f-6415ce251ca8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:50.312546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db727f-8830-4b21-b924-f208bf451de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:50.313639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db727f-8830-4b21-b924-f208bf451de8 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:50.314109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db727f-8830-4b21-b924-f208bf451de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:50.314597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db727f-8830-4b21-b924-f208bf451de8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:50.315825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db727f-8830-4b21-b924-f208bf451de8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:50.318667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db727f-8830-4b21-b924-f208bf451de8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:50.338481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e582294-4678-4c39-b114-2bd7579ea765 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:50.342516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0e582294-4678-4c39-b114-2bd7579ea765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:50.383013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e582294-4678-4c39-b114-2bd7579ea765 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:50.395491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e03985-199f-4fb8-b993-eb46e5b212d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:50.396773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e03985-199f-4fb8-b993-eb46e5b212d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:50.397301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e03985-199f-4fb8-b993-eb46e5b212d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:50.397792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e03985-199f-4fb8-b993-eb46e5b212d2 admin admin] PATH_INFO: `/v3/projects/0fd407e19119471bbbf24c91d9e1fdb8` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:50.399814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e03985-199f-4fb8-b993-eb46e5b212d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd407e19119471bbbf24c91d9e1fdb8)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:50.403152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e03985-199f-4fb8-b993-eb46e5b212d2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:50.482720 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2075/4158] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:31:50 2022] POST /identity/v3/projects => generated 387 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:31:50.486765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db727f-8830-4b21-b924-f208bf451de8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:50.570302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f6e03985-199f-4fb8-b993-eb46e5b212d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd407e19119471bbbf24c91d9e1fdb8', 'request_id': 'req-f6e03985-199f-4fb8-b993-eb46e5b212d2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:50.591068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f6e03985-199f-4fb8-b993-eb46e5b212d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd407e19119471bbbf24c91d9e1fdb8', 'request_id': 'req-f6e03985-199f-4fb8-b993-eb46e5b212d2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:50.677010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f6e03985-199f-4fb8-b993-eb46e5b212d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd407e19119471bbbf24c91d9e1fdb8', 'request_id': 'req-f6e03985-199f-4fb8-b993-eb46e5b212d2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:50.700708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f6e03985-199f-4fb8-b993-eb46e5b212d2 admin admin] The token cache is being invalidate because project 0fd407e19119471bbbf24c91d9e1fdb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:31:50.702843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f6e03985-199f-4fb8-b993-eb46e5b212d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:50.704623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f6e03985-199f-4fb8-b993-eb46e5b212d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:50.710933 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2084/4159] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:31:50 2022] DELETE /identity/v3/projects/0fd407e19119471bbbf24c91d9e1fdb8 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:50.715702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e03985-199f-4fb8-b993-eb46e5b212d2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:50.719558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f6e03985-199f-4fb8-b993-eb46e5b212d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:50.759756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db727f-8830-4b21-b924-f208bf451de8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:50.906829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e03985-199f-4fb8-b993-eb46e5b212d2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:50.913875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c380c8-2839-4186-8601-cebeba2c1d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:50.915971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c380c8-2839-4186-8601-cebeba2c1d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:50.916368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c380c8-2839-4186-8601-cebeba2c1d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:50.916689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c380c8-2839-4186-8601-cebeba2c1d44 admin admin] PATH_INFO: `/v3/users/7f967a3d7e00453a9c4a2e7b645b645e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:50.918022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c380c8-2839-4186-8601-cebeba2c1d44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f967a3d7e00453a9c4a2e7b645b645e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:50.921014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c380c8-2839-4186-8601-cebeba2c1d44 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:50.963807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f59a3-5eb0-4279-8e4c-f9a5fefc3827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:50.964515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f59a3-5eb0-4279-8e4c-f9a5fefc3827 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:50.965369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f59a3-5eb0-4279-8e4c-f9a5fefc3827 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:50.965669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f59a3-5eb0-4279-8e4c-f9a5fefc3827 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:50.970021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f59a3-5eb0-4279-8e4c-f9a5fefc3827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:50.970021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f59a3-5eb0-4279-8e4c-f9a5fefc3827 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:51.105211 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2076/4160] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:31:50 2022] POST /identity/v3/users => generated 294 bytes in 619 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:31:51.109381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f59a3-5eb0-4279-8e4c-f9a5fefc3827 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:51.114962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-456f59a3-5eb0-4279-8e4c-f9a5fefc3827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:51.154721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f59a3-5eb0-4279-8e4c-f9a5fefc3827 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:51.186626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1f0f8-fa8c-495e-aa9f-04a382b8662a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:51.187319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1f0f8-fa8c-495e-aa9f-04a382b8662a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:51.187603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1f0f8-fa8c-495e-aa9f-04a382b8662a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:51.187880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1f0f8-fa8c-495e-aa9f-04a382b8662a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:51.188681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1f0f8-fa8c-495e-aa9f-04a382b8662a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:51.203698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1f0f8-fa8c-495e-aa9f-04a382b8662a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:51.209160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-89c380c8-2839-4186-8601-cebeba2c1d44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f967a3d7e00453a9c4a2e7b645b645e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:51.259881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-89c380c8-2839-4186-8601-cebeba2c1d44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f967a3d7e00453a9c4a2e7b645b645e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:51.263018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-89c380c8-2839-4186-8601-cebeba2c1d44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f967a3d7e00453a9c4a2e7b645b645e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:51.267923 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2077/4161] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:31:51.270447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1f0f8-fa8c-495e-aa9f-04a382b8662a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:51.291268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-89c380c8-2839-4186-8601-cebeba2c1d44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f967a3d7e00453a9c4a2e7b645b645e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:51.300656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1f0f8-fa8c-495e-aa9f-04a382b8662a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:51.313559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88614e8d-37dd-4db0-a7a3-026ea2f023a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:51.314359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88614e8d-37dd-4db0-a7a3-026ea2f023a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:51.314656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88614e8d-37dd-4db0-a7a3-026ea2f023a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:51.314940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88614e8d-37dd-4db0-a7a3-026ea2f023a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:51.315849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88614e8d-37dd-4db0-a7a3-026ea2f023a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:51.317681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88614e8d-37dd-4db0-a7a3-026ea2f023a6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:51.332653 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2078/4162] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:31:51.335962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88614e8d-37dd-4db0-a7a3-026ea2f023a6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:51.352286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88614e8d-37dd-4db0-a7a3-026ea2f023a6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:51.357548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd5968-e605-455c-a169-9ed0bca32384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:51.358857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd5968-e605-455c-a169-9ed0bca32384 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:51.359296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd5968-e605-455c-a169-9ed0bca32384 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:51.359756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd5968-e605-455c-a169-9ed0bca32384 admin admin] PATH_INFO: `/v3/projects/f69244c8551140e3b1a806ef5e7188a4/users/1879ab1a5ab0414fb7ae472629ed995c/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:51.377560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd5968-e605-455c-a169-9ed0bca32384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f69244c8551140e3b1a806ef5e7188a4, user_id=1879ab1a5ab0414fb7ae472629ed995c, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:51.380749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd5968-e605-455c-a169-9ed0bca32384 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:51.402339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-89c380c8-2839-4186-8601-cebeba2c1d44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f967a3d7e00453a9c4a2e7b645b645e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:51.414894 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2085/4163] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:31:50 2022] DELETE /identity/v3/users/7f967a3d7e00453a9c4a2e7b645b645e => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:51.497224 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2079/4164] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:31:51 2022] PUT /identity/v3/projects/f69244c8551140e3b1a806ef5e7188a4/users/1879ab1a5ab0414fb7ae472629ed995c/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:51.506399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f18f25-7f13-4e50-a5d2-768a7d3f3a6a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:51.506926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f18f25-7f13-4e50-a5d2-768a7d3f3a6a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:51.507393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f18f25-7f13-4e50-a5d2-768a7d3f3a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:51.588290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c0f18f25-7f13-4e50-a5d2-768a7d3f3a6a None None] MFA Rules not processed for user `1879ab1a5ab0414fb7ae472629ed995c`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:51.590818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c0f18f25-7f13-4e50-a5d2-768a7d3f3a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:51.773931 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2086/4165] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:51.778770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd5968-e605-455c-a169-9ed0bca32384 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:51.781343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a6fd5968-e605-455c-a169-9ed0bca32384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:51.924070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd5968-e605-455c-a169-9ed0bca32384 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:51.928905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff577f94-e8d5-4d0f-9993-d52f7e65275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:51.929698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff577f94-e8d5-4d0f-9993-d52f7e65275a admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:51.929851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff577f94-e8d5-4d0f-9993-d52f7e65275a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:51.930123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff577f94-e8d5-4d0f-9993-d52f7e65275a admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:51.931655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff577f94-e8d5-4d0f-9993-d52f7e65275a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:51.935150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff577f94-e8d5-4d0f-9993-d52f7e65275a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:52.052880 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2080/4166] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:31:51 2022] POST /identity/v3/projects => generated 387 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:31:52.058104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f18f25-7f13-4e50-a5d2-768a7d3f3a6a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:52.076214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f18f25-7f13-4e50-a5d2-768a7d3f3a6a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:52.231518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03f999-4e91-493f-b077-74601d257a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:52.232204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03f999-4e91-493f-b077-74601d257a60 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:52.232482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03f999-4e91-493f-b077-74601d257a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:52.232851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03f999-4e91-493f-b077-74601d257a60 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:52.233685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03f999-4e91-493f-b077-74601d257a60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:52.235632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03f999-4e91-493f-b077-74601d257a60 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:52.285618 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff577f94-e8d5-4d0f-9993-d52f7e65275a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:52.288402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ff577f94-e8d5-4d0f-9993-d52f7e65275a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:52.314441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff577f94-e8d5-4d0f-9993-d52f7e65275a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:52.319862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c8659-98b2-47e0-804e-1187ace76ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:52.321639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c8659-98b2-47e0-804e-1187ace76ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:52.321983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c8659-98b2-47e0-804e-1187ace76ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:52.322299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c8659-98b2-47e0-804e-1187ace76ccf admin admin] PATH_INFO: `/v3/projects/7e092933a52146129c95f8cf20759acc` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:52.323884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c8659-98b2-47e0-804e-1187ace76ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e092933a52146129c95f8cf20759acc)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:52.326471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c8659-98b2-47e0-804e-1187ace76ccf admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:52.339010 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2087/4167] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:31:52 2022] POST /identity/v3/users => generated 300 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:31:52.341558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03f999-4e91-493f-b077-74601d257a60 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:52.359850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03f999-4e91-493f-b077-74601d257a60 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:52.374703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00794137-e91c-409a-8ed2-ffa88d82fd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:52.375682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00794137-e91c-409a-8ed2-ffa88d82fd41 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:52.375949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00794137-e91c-409a-8ed2-ffa88d82fd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:52.376409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00794137-e91c-409a-8ed2-ffa88d82fd41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:52.377345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00794137-e91c-409a-8ed2-ffa88d82fd41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:52.391261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00794137-e91c-409a-8ed2-ffa88d82fd41 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:52.402925 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2088/4168] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:31:52.407371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00794137-e91c-409a-8ed2-ffa88d82fd41 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:52.432063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00794137-e91c-409a-8ed2-ffa88d82fd41 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:52.448412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac0e09-52e9-46f2-b0f3-9df2a160f22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:52.449964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac0e09-52e9-46f2-b0f3-9df2a160f22d admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:52.450259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac0e09-52e9-46f2-b0f3-9df2a160f22d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:52.450542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac0e09-52e9-46f2-b0f3-9df2a160f22d admin admin] PATH_INFO: `/v3/projects/66697da5eeeb4bbd8bb3d6265c4290e5/users/44b9196fdd1f458499c36496de6235ab/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:52.486940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac0e09-52e9-46f2-b0f3-9df2a160f22d admin admin] RBAC: Authorizing `identity:create_grant(project_id=66697da5eeeb4bbd8bb3d6265c4290e5, user_id=44b9196fdd1f458499c36496de6235ab, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:52.489706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac0e09-52e9-46f2-b0f3-9df2a160f22d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:52.522612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d47c8659-98b2-47e0-804e-1187ace76ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e092933a52146129c95f8cf20759acc', 'request_id': 'req-d47c8659-98b2-47e0-804e-1187ace76ccf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:52.567420 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2089/4169] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:31:52 2022] PUT /identity/v3/projects/66697da5eeeb4bbd8bb3d6265c4290e5/users/44b9196fdd1f458499c36496de6235ab/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:52.571424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac0e09-52e9-46f2-b0f3-9df2a160f22d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:52.608740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d47c8659-98b2-47e0-804e-1187ace76ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e092933a52146129c95f8cf20759acc', 'request_id': 'req-d47c8659-98b2-47e0-804e-1187ace76ccf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:52.620105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d47c8659-98b2-47e0-804e-1187ace76ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e092933a52146129c95f8cf20759acc', 'request_id': 'req-d47c8659-98b2-47e0-804e-1187ace76ccf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:52.650282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d47c8659-98b2-47e0-804e-1187ace76ccf admin admin] The token cache is being invalidate because project 7e092933a52146129c95f8cf20759acc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:31:52.650501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d47c8659-98b2-47e0-804e-1187ace76ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:52.651374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d47c8659-98b2-47e0-804e-1187ace76ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:52.653423 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2081/4170] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:31:52 2022] DELETE /identity/v3/projects/7e092933a52146129c95f8cf20759acc => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:31:52.662654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0c669-bc26-42cf-81a1-bcf5e7c405c3 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:52.663935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0c669-bc26-42cf-81a1-bcf5e7c405c3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:52.664989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0c669-bc26-42cf-81a1-bcf5e7c405c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:52.689354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac0e09-52e9-46f2-b0f3-9df2a160f22d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:52.691137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ede0c669-bc26-42cf-81a1-bcf5e7c405c3 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:52.693742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ede0c669-bc26-42cf-81a1-bcf5e7c405c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:52.695128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9e2b0-25e9-4555-9d46-50086df19ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:52.695812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9e2b0-25e9-4555-9d46-50086df19ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:52.696093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9e2b0-25e9-4555-9d46-50086df19ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:52.696370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9e2b0-25e9-4555-9d46-50086df19ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:52.697273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9e2b0-25e9-4555-9d46-50086df19ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:52.698837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9e2b0-25e9-4555-9d46-50086df19ff1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:52.703667 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2082/4171] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:52.712096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c13272-bc32-43ad-b8f8-4bc90838d6ca None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:52.713662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c13272-bc32-43ad-b8f8-4bc90838d6ca None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:52.713662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c13272-bc32-43ad-b8f8-4bc90838d6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:52.739314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a7c13272-bc32-43ad-b8f8-4bc90838d6ca None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:52.740904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a7c13272-bc32-43ad-b8f8-4bc90838d6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:52.747709 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2090/4172] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:31:52.752102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9e2b0-25e9-4555-9d46-50086df19ff1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:52.752203 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2083/4173] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:52.757473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9da9e2b0-25e9-4555-9d46-50086df19ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:52.778344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c13272-bc32-43ad-b8f8-4bc90838d6ca None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:52.800112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9e2b0-25e9-4555-9d46-50086df19ff1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:52.806248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c13272-bc32-43ad-b8f8-4bc90838d6ca None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:52.815603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ce7b2-243c-481e-92aa-997f62eef638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:52.816469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ce7b2-243c-481e-92aa-997f62eef638 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:52.816786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ce7b2-243c-481e-92aa-997f62eef638 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:52.817065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ce7b2-243c-481e-92aa-997f62eef638 admin admin] PATH_INFO: `/v3/projects/66697da5eeeb4bbd8bb3d6265c4290e5/users/44b9196fdd1f458499c36496de6235ab/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:52.818654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e6dea-a298-4583-9969-b36ba650e6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:52.819475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e6dea-a298-4583-9969-b36ba650e6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:52.819763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e6dea-a298-4583-9969-b36ba650e6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:52.821944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e6dea-a298-4583-9969-b36ba650e6c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:52.822709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e6dea-a298-4583-9969-b36ba650e6c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:31:52.823022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e6dea-a298-4583-9969-b36ba650e6c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:52.830318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ce7b2-243c-481e-92aa-997f62eef638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66697da5eeeb4bbd8bb3d6265c4290e5, user_id=44b9196fdd1f458499c36496de6235ab, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:52.831903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e6dea-a298-4583-9969-b36ba650e6c9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:52.837523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ce7b2-243c-481e-92aa-997f62eef638 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:52.862766 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2084/4175] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:31:52.868493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e6dea-a298-4583-9969-b36ba650e6c9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:52.873096 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2091/4175] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:31:52 2022] PUT /identity/v3/projects/66697da5eeeb4bbd8bb3d6265c4290e5/users/44b9196fdd1f458499c36496de6235ab/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:52.880345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866cffa-a717-44aa-a00b-be29be0407ce None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:52.881165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866cffa-a717-44aa-a00b-be29be0407ce None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:52.881770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866cffa-a717-44aa-a00b-be29be0407ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:52.908255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e6dea-a298-4583-9969-b36ba650e6c9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:52.925083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2866cffa-a717-44aa-a00b-be29be0407ce None None] MFA Rules not processed for user `44b9196fdd1f458499c36496de6235ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:52.926741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2866cffa-a717-44aa-a00b-be29be0407ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:52.992141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e1cfa-2972-4443-897e-5f356a0aac5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:52.995247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e1cfa-2972-4443-897e-5f356a0aac5e admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:52.996700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e1cfa-2972-4443-897e-5f356a0aac5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:52.997157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e1cfa-2972-4443-897e-5f356a0aac5e admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:52.998095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e1cfa-2972-4443-897e-5f356a0aac5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:53.001023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e1cfa-2972-4443-897e-5f356a0aac5e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:53.053368 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2092/4176] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:53.065043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866cffa-a717-44aa-a00b-be29be0407ce None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:53.067830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2866cffa-a717-44aa-a00b-be29be0407ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:53.172889 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2085/4177] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:31:52 2022] POST /identity/v3/projects => generated 393 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:31:53.172889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e1cfa-2972-4443-897e-5f356a0aac5e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:53.218129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866cffa-a717-44aa-a00b-be29be0407ce None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:53.347148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e1cfa-2972-4443-897e-5f356a0aac5e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:53.353275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ac5b8-91cf-422f-9aea-c90bf3cdf290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:53.363092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ac5b8-91cf-422f-9aea-c90bf3cdf290 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:53.363378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ac5b8-91cf-422f-9aea-c90bf3cdf290 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:53.363859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ac5b8-91cf-422f-9aea-c90bf3cdf290 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:53.364775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ac5b8-91cf-422f-9aea-c90bf3cdf290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:53.372815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ac5b8-91cf-422f-9aea-c90bf3cdf290 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:53.381190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccfe4c-9baa-4022-824c-9a38c18758b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:53.382097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccfe4c-9baa-4022-824c-9a38c18758b9 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:53.382609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccfe4c-9baa-4022-824c-9a38c18758b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:53.383311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccfe4c-9baa-4022-824c-9a38c18758b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:53.541345 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2086/4178] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:31:53 2022] POST /identity/v3/users => generated 297 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:31:53.546372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ac5b8-91cf-422f-9aea-c90bf3cdf290 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:53.548573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcccfe4c-9baa-4022-824c-9a38c18758b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:53.552335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcccfe4c-9baa-4022-824c-9a38c18758b9 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:53.580193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ac5b8-91cf-422f-9aea-c90bf3cdf290 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:53.585390 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2093/4179] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:31:53.601859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36265722-439b-41fd-81ae-f388a1a7d745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:53.602571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36265722-439b-41fd-81ae-f388a1a7d745 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:53.602859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36265722-439b-41fd-81ae-f388a1a7d745 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:53.603140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36265722-439b-41fd-81ae-f388a1a7d745 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:53.607103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36265722-439b-41fd-81ae-f388a1a7d745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:53.617936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36265722-439b-41fd-81ae-f388a1a7d745 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:53.640248 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2087/4180] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:31:53.645506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccfe4c-9baa-4022-824c-9a38c18758b9 service cinder] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:53.672989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccfe4c-9baa-4022-824c-9a38c18758b9 service cinder] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:53.735046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055183d-4612-475a-9090-dbea649e5fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:53.736697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055183d-4612-475a-9090-dbea649e5fde admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:53.737179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055183d-4612-475a-9090-dbea649e5fde admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:53.737630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055183d-4612-475a-9090-dbea649e5fde admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:53.740745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055183d-4612-475a-9090-dbea649e5fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:53.744393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055183d-4612-475a-9090-dbea649e5fde admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:53.776703 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2094/4181] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:31:53.781446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36265722-439b-41fd-81ae-f388a1a7d745 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:53.797555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36265722-439b-41fd-81ae-f388a1a7d745 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:53.821834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead840b-b382-4147-b826-8c7453553ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:53.829287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead840b-b382-4147-b826-8c7453553ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:53.829287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead840b-b382-4147-b826-8c7453553ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:53.829287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead840b-b382-4147-b826-8c7453553ef3 admin admin] PATH_INFO: `/v3/projects/dc2147283df5438e9aa225c999591a41/users/e74385e7702b4a27b512f1c73fe4c83d/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:53.830681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055183d-4612-475a-9090-dbea649e5fde admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:53.850107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055183d-4612-475a-9090-dbea649e5fde admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:53.870425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c336d07-88ad-43c7-8bd9-940da8b8ba9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:53.872577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c336d07-88ad-43c7-8bd9-940da8b8ba9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:53.876868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c336d07-88ad-43c7-8bd9-940da8b8ba9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:53.882344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c336d07-88ad-43c7-8bd9-940da8b8ba9b admin admin] PATH_INFO: `/v3/users/1879ab1a5ab0414fb7ae472629ed995c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:53.882741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead840b-b382-4147-b826-8c7453553ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2147283df5438e9aa225c999591a41, user_id=e74385e7702b4a27b512f1c73fe4c83d, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:53.882828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c336d07-88ad-43c7-8bd9-940da8b8ba9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1879ab1a5ab0414fb7ae472629ed995c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:53.884806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c336d07-88ad-43c7-8bd9-940da8b8ba9b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:53.887927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead840b-b382-4147-b826-8c7453553ef3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:53.991887 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2088/4182] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:31:53 2022] PUT /identity/v3/projects/dc2147283df5438e9aa225c999591a41/users/e74385e7702b4a27b512f1c73fe4c83d/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:54.005165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1b5ab-037a-4d00-a99a-a50c7e84f456 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:54.005715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1b5ab-037a-4d00-a99a-a50c7e84f456 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:54.007258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1b5ab-037a-4d00-a99a-a50c7e84f456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:54.048949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-19e1b5ab-037a-4d00-a99a-a50c7e84f456 None None] MFA Rules not processed for user `e74385e7702b4a27b512f1c73fe4c83d`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:54.052108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-19e1b5ab-037a-4d00-a99a-a50c7e84f456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:54.132714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6c336d07-88ad-43c7-8bd9-940da8b8ba9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1879ab1a5ab0414fb7ae472629ed995c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:54.148906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6c336d07-88ad-43c7-8bd9-940da8b8ba9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1879ab1a5ab0414fb7ae472629ed995c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:54.149634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6c336d07-88ad-43c7-8bd9-940da8b8ba9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1879ab1a5ab0414fb7ae472629ed995c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:54.159945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6c336d07-88ad-43c7-8bd9-940da8b8ba9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1879ab1a5ab0414fb7ae472629ed995c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:54.162376 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2089/4183] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:54.166483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1b5ab-037a-4d00-a99a-a50c7e84f456 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:54.219179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6c336d07-88ad-43c7-8bd9-940da8b8ba9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1879ab1a5ab0414fb7ae472629ed995c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:54.226261 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2095/4184] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:31:53 2022] DELETE /identity/v3/users/1879ab1a5ab0414fb7ae472629ed995c => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:54.231799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f99c73-aa60-4537-a2f8-7795dc5b3c95 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:54.232097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f99c73-aa60-4537-a2f8-7795dc5b3c95 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:54.232381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f99c73-aa60-4537-a2f8-7795dc5b3c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:54.252021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a6f99c73-aa60-4537-a2f8-7795dc5b3c95 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:54.253471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a6f99c73-aa60-4537-a2f8-7795dc5b3c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:54.260246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1b5ab-037a-4d00-a99a-a50c7e84f456 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:54.348532 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2096/4185] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:54.352398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc65851-9696-4c6a-9b41-eaff4073e74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:54.353351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc65851-9696-4c6a-9b41-eaff4073e74b admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:54.353798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc65851-9696-4c6a-9b41-eaff4073e74b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:54.354160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc65851-9696-4c6a-9b41-eaff4073e74b admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:54.354952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc65851-9696-4c6a-9b41-eaff4073e74b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:54.360485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc65851-9696-4c6a-9b41-eaff4073e74b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:54.361605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f99c73-aa60-4537-a2f8-7795dc5b3c95 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:54.363980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a6f99c73-aa60-4537-a2f8-7795dc5b3c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:54.446121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f99c73-aa60-4537-a2f8-7795dc5b3c95 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:54.450640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427739d-df9a-4b11-a2a6-4f20982ed274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:54.451519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427739d-df9a-4b11-a2a6-4f20982ed274 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:54.451962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427739d-df9a-4b11-a2a6-4f20982ed274 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:54.452409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427739d-df9a-4b11-a2a6-4f20982ed274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:54.464588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427739d-df9a-4b11-a2a6-4f20982ed274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:54.466965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427739d-df9a-4b11-a2a6-4f20982ed274 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:54.476949 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2090/4186] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:31:54 2022] POST /identity/v3/projects => generated 393 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:31:54.478644 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2097/4187] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:31:54.481693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc65851-9696-4c6a-9b41-eaff4073e74b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:54.484125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-cfc65851-9696-4c6a-9b41-eaff4073e74b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:54.584082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc65851-9696-4c6a-9b41-eaff4073e74b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:54.595098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d08bb9-18f4-40cd-9bd0-3c413b161ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:54.596201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d08bb9-18f4-40cd-9bd0-3c413b161ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:54.596824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d08bb9-18f4-40cd-9bd0-3c413b161ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:54.597725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d08bb9-18f4-40cd-9bd0-3c413b161ac5 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:54.599044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d08bb9-18f4-40cd-9bd0-3c413b161ac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:54.601595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d08bb9-18f4-40cd-9bd0-3c413b161ac5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:54.700719 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2091/4188] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:31:54 2022] POST /identity/v3/users => generated 303 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:31:54.705061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427739d-df9a-4b11-a2a6-4f20982ed274 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:54.720494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427739d-df9a-4b11-a2a6-4f20982ed274 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:54.725143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3420c-8591-45f0-8895-7e2997295c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:54.725966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3420c-8591-45f0-8895-7e2997295c13 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:54.736569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3420c-8591-45f0-8895-7e2997295c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:54.737953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3420c-8591-45f0-8895-7e2997295c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:54.738763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3420c-8591-45f0-8895-7e2997295c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:54.756530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3420c-8591-45f0-8895-7e2997295c13 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:54.787358 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2098/4189] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:31:54.789574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d08bb9-18f4-40cd-9bd0-3c413b161ac5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:54.808143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3420c-8591-45f0-8895-7e2997295c13 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:54.810804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-11b3420c-8591-45f0-8895-7e2997295c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:54.823238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d08bb9-18f4-40cd-9bd0-3c413b161ac5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:54.837644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3420c-8591-45f0-8895-7e2997295c13 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:54.839719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d6242-27cf-475e-b3e9-892dbb0045ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:54.843670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d6242-27cf-475e-b3e9-892dbb0045ba admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:54.843670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d6242-27cf-475e-b3e9-892dbb0045ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:54.843670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d6242-27cf-475e-b3e9-892dbb0045ba admin admin] PATH_INFO: `/v3/projects/2c2f4545d2c249f2bbbd4ec4b7a6e1fa/users/b224608201c14252a11c25b997f9a8d3/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:54.852404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7eff9-8085-4e27-86fb-859871790b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:54.853495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7eff9-8085-4e27-86fb-859871790b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:54.856927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7eff9-8085-4e27-86fb-859871790b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:54.857315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7eff9-8085-4e27-86fb-859871790b37 admin admin] PATH_INFO: `/v3/users/f6418e83dfa5483da73c7745920936bf` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:54.859261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7eff9-8085-4e27-86fb-859871790b37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6418e83dfa5483da73c7745920936bf)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:54.864015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d6242-27cf-475e-b3e9-892dbb0045ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c2f4545d2c249f2bbbd4ec4b7a6e1fa, user_id=b224608201c14252a11c25b997f9a8d3, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:54.864771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7eff9-8085-4e27-86fb-859871790b37 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:54.867162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d6242-27cf-475e-b3e9-892dbb0045ba admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:54.960733 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2092/4190] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:31:54 2022] PUT /identity/v3/projects/2c2f4545d2c249f2bbbd4ec4b7a6e1fa/users/b224608201c14252a11c25b997f9a8d3/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:54.961846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d6242-27cf-475e-b3e9-892dbb0045ba admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:55.053732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d6242-27cf-475e-b3e9-892dbb0045ba admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:55.061410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d20f5-54c9-4aee-a36b-df6ef2dd7ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:55.063278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d20f5-54c9-4aee-a36b-df6ef2dd7ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:55.064164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d20f5-54c9-4aee-a36b-df6ef2dd7ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:55.064453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d20f5-54c9-4aee-a36b-df6ef2dd7ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:55.065400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d20f5-54c9-4aee-a36b-df6ef2dd7ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:55.068316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d20f5-54c9-4aee-a36b-df6ef2dd7ea1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:55.086972 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2093/4191] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:31:55.091014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d8e7eff9-8085-4e27-86fb-859871790b37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6418e83dfa5483da73c7745920936bf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:55.093018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d20f5-54c9-4aee-a36b-df6ef2dd7ea1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:55.104229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d8e7eff9-8085-4e27-86fb-859871790b37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6418e83dfa5483da73c7745920936bf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:55.105109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d8e7eff9-8085-4e27-86fb-859871790b37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6418e83dfa5483da73c7745920936bf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:55.113599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d8e7eff9-8085-4e27-86fb-859871790b37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6418e83dfa5483da73c7745920936bf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:55.121305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d20f5-54c9-4aee-a36b-df6ef2dd7ea1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:55.140645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f218e2-d9ef-4d04-80db-b99565d67345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:55.141574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f218e2-d9ef-4d04-80db-b99565d67345 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:55.141912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f218e2-d9ef-4d04-80db-b99565d67345 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:55.142200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f218e2-d9ef-4d04-80db-b99565d67345 admin admin] PATH_INFO: `/v3/projects/2c2f4545d2c249f2bbbd4ec4b7a6e1fa/users/b224608201c14252a11c25b997f9a8d3/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:55.145379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f218e2-d9ef-4d04-80db-b99565d67345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c2f4545d2c249f2bbbd4ec4b7a6e1fa, user_id=b224608201c14252a11c25b997f9a8d3, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:55.148930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f218e2-d9ef-4d04-80db-b99565d67345 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:55.160776 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2094/4192] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:31:55 2022] PUT /identity/v3/projects/2c2f4545d2c249f2bbbd4ec4b7a6e1fa/users/b224608201c14252a11c25b997f9a8d3/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:55.171915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc574f2-65e3-411b-9513-5b36d7f0d38a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:55.172208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc574f2-65e3-411b-9513-5b36d7f0d38a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:55.172516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc574f2-65e3-411b-9513-5b36d7f0d38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:55.242845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-5fc574f2-65e3-411b-9513-5b36d7f0d38a None None] MFA Rules not processed for user `b224608201c14252a11c25b997f9a8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:55.244115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5fc574f2-65e3-411b-9513-5b36d7f0d38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:55.254190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d8e7eff9-8085-4e27-86fb-859871790b37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6418e83dfa5483da73c7745920936bf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:55.268399 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2099/4193] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:31:54 2022] DELETE /identity/v3/users/f6418e83dfa5483da73c7745920936bf => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:55.272983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b09b6-6cf1-46f2-819d-3160bce69ef6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:55.273274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b09b6-6cf1-46f2-819d-3160bce69ef6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:55.273606 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b09b6-6cf1-46f2-819d-3160bce69ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:55.367652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ba1b09b6-6cf1-46f2-819d-3160bce69ef6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:55.372748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ba1b09b6-6cf1-46f2-819d-3160bce69ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:55.431030 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2095/4194] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:55.452633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc574f2-65e3-411b-9513-5b36d7f0d38a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:55.454557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5fc574f2-65e3-411b-9513-5b36d7f0d38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:55.544982 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2100/4195] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:55.545951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b09b6-6cf1-46f2-819d-3160bce69ef6 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:55.555950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ba1b09b6-6cf1-46f2-819d-3160bce69ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:55.595738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc574f2-65e3-411b-9513-5b36d7f0d38a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:55.601271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6eeb14-953b-4374-b4ef-98a731845ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:55.602130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6eeb14-953b-4374-b4ef-98a731845ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:55.602415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6eeb14-953b-4374-b4ef-98a731845ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:55.602913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6eeb14-953b-4374-b4ef-98a731845ec3 admin admin] PATH_INFO: `/v3/projects/f69244c8551140e3b1a806ef5e7188a4` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:55.612690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6eeb14-953b-4374-b4ef-98a731845ec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f69244c8551140e3b1a806ef5e7188a4)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:55.621067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6eeb14-953b-4374-b4ef-98a731845ec3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:55.709427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b09b6-6cf1-46f2-819d-3160bce69ef6 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:55.715855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd05fe-0dd7-4354-9851-73236472de1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:55.716754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd05fe-0dd7-4354-9851-73236472de1b service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:55.717192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd05fe-0dd7-4354-9851-73236472de1b service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:55.717481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd05fe-0dd7-4354-9851-73236472de1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:55.788040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1c6eeb14-953b-4374-b4ef-98a731845ec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f69244c8551140e3b1a806ef5e7188a4', 'request_id': 'req-1c6eeb14-953b-4374-b4ef-98a731845ec3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:55.826256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd05fe-0dd7-4354-9851-73236472de1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:55.828301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd05fe-0dd7-4354-9851-73236472de1b service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:55.842188 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2101/4196] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:31:55.843258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd05fe-0dd7-4354-9851-73236472de1b service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:55.847942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-19dd05fe-0dd7-4354-9851-73236472de1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:55.924219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1c6eeb14-953b-4374-b4ef-98a731845ec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f69244c8551140e3b1a806ef5e7188a4', 'request_id': 'req-1c6eeb14-953b-4374-b4ef-98a731845ec3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:55.967983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1c6eeb14-953b-4374-b4ef-98a731845ec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f69244c8551140e3b1a806ef5e7188a4', 'request_id': 'req-1c6eeb14-953b-4374-b4ef-98a731845ec3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:55.990746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd05fe-0dd7-4354-9851-73236472de1b service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:56.040302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1c6eeb14-953b-4374-b4ef-98a731845ec3 admin admin] The token cache is being invalidate because project f69244c8551140e3b1a806ef5e7188a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:31:56.040635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1c6eeb14-953b-4374-b4ef-98a731845ec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:56.049146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1c6eeb14-953b-4374-b4ef-98a731845ec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:56.064658 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2096/4197] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:31:55 2022] DELETE /identity/v3/projects/f69244c8551140e3b1a806ef5e7188a4 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:31:56.064658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6eeb14-953b-4374-b4ef-98a731845ec3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:56.073864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1c6eeb14-953b-4374-b4ef-98a731845ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:56.086757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2073f8-01ab-440c-ba22-c8d99dbc9aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:56.121063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2073f8-01ab-440c-ba22-c8d99dbc9aef service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:56.121781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2073f8-01ab-440c-ba22-c8d99dbc9aef service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:56.123266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2073f8-01ab-440c-ba22-c8d99dbc9aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:56.126730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ab2073f8-01ab-440c-ba22-c8d99dbc9aef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:56.178878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6eeb14-953b-4374-b4ef-98a731845ec3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:56.187479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f5e89-6924-4852-98cf-981e27a333ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:56.188292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f5e89-6924-4852-98cf-981e27a333ad service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:56.188585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f5e89-6924-4852-98cf-981e27a333ad service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:56.188893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f5e89-6924-4852-98cf-981e27a333ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:56.191170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1d7f5e89-6924-4852-98cf-981e27a333ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:56.280690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2073f8-01ab-440c-ba22-c8d99dbc9aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:56.286687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2073f8-01ab-440c-ba22-c8d99dbc9aef service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:56.312033 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2102/4198] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:31:56.313333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2073f8-01ab-440c-ba22-c8d99dbc9aef service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:56.314834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ab2073f8-01ab-440c-ba22-c8d99dbc9aef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:56.331028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2073f8-01ab-440c-ba22-c8d99dbc9aef service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:56.338681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f5e89-6924-4852-98cf-981e27a333ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:56.340243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbda54-bf1e-4fcb-847f-3dbbaa3f6695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:56.341410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f5e89-6924-4852-98cf-981e27a333ad service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:56.342148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbda54-bf1e-4fcb-847f-3dbbaa3f6695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:56.342584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbda54-bf1e-4fcb-847f-3dbbaa3f6695 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:56.342932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbda54-bf1e-4fcb-847f-3dbbaa3f6695 admin admin] PATH_INFO: `/v3/users/44b9196fdd1f458499c36496de6235ab` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:56.344912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebbda54-bf1e-4fcb-847f-3dbbaa3f6695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44b9196fdd1f458499c36496de6235ab)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:56.348065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebbda54-bf1e-4fcb-847f-3dbbaa3f6695 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:56.377949 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2097/4199] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:31:56.383097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e53dd4-cae8-4000-8979-ac1995960e57 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:56.383097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e53dd4-cae8-4000-8979-ac1995960e57 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:56.383097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e53dd4-cae8-4000-8979-ac1995960e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:56.466755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-38e53dd4-cae8-4000-8979-ac1995960e57 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:56.468089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-38e53dd4-cae8-4000-8979-ac1995960e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:56.559233 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2098/4200] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:31:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:56.559427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cebbda54-bf1e-4fcb-847f-3dbbaa3f6695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44b9196fdd1f458499c36496de6235ab'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:56.566086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e53dd4-cae8-4000-8979-ac1995960e57 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:56.571168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-38e53dd4-cae8-4000-8979-ac1995960e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:56.591218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cebbda54-bf1e-4fcb-847f-3dbbaa3f6695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44b9196fdd1f458499c36496de6235ab'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:56.592027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cebbda54-bf1e-4fcb-847f-3dbbaa3f6695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44b9196fdd1f458499c36496de6235ab'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:56.599968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e53dd4-cae8-4000-8979-ac1995960e57 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:56.607011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f87f4b-1106-4b2f-ab51-e7506fd7a596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:56.608042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f87f4b-1106-4b2f-ab51-e7506fd7a596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:56.609036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f87f4b-1106-4b2f-ab51-e7506fd7a596 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:56.609036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f87f4b-1106-4b2f-ab51-e7506fd7a596 admin admin] PATH_INFO: `/v3/users/e74385e7702b4a27b512f1c73fe4c83d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:56.612273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f87f4b-1106-4b2f-ab51-e7506fd7a596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e74385e7702b4a27b512f1c73fe4c83d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:56.614446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f87f4b-1106-4b2f-ab51-e7506fd7a596 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:56.620632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cebbda54-bf1e-4fcb-847f-3dbbaa3f6695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44b9196fdd1f458499c36496de6235ab'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:56.695116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cebbda54-bf1e-4fcb-847f-3dbbaa3f6695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44b9196fdd1f458499c36496de6235ab'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:56.707573 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2103/4201] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:31:56 2022] DELETE /identity/v3/users/44b9196fdd1f458499c36496de6235ab => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:56.725142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbda54-bf1e-4fcb-847f-3dbbaa3f6695 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:56.726952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cebbda54-bf1e-4fcb-847f-3dbbaa3f6695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:56.827841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-52f87f4b-1106-4b2f-ab51-e7506fd7a596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e74385e7702b4a27b512f1c73fe4c83d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:56.844873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-52f87f4b-1106-4b2f-ab51-e7506fd7a596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e74385e7702b4a27b512f1c73fe4c83d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:56.854902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-52f87f4b-1106-4b2f-ab51-e7506fd7a596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e74385e7702b4a27b512f1c73fe4c83d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:56.856540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-52f87f4b-1106-4b2f-ab51-e7506fd7a596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e74385e7702b4a27b512f1c73fe4c83d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:56.893844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbda54-bf1e-4fcb-847f-3dbbaa3f6695 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:56.901010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3e1ea-3bae-4084-b4f7-00f1b9982655 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:56.901685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3e1ea-3bae-4084-b4f7-00f1b9982655 service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:56.901971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3e1ea-3bae-4084-b4f7-00f1b9982655 service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:56.902776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3e1ea-3bae-4084-b4f7-00f1b9982655 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:56.905518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-51e3e1ea-3bae-4084-b4f7-00f1b9982655 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:56.951502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-52f87f4b-1106-4b2f-ab51-e7506fd7a596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e74385e7702b4a27b512f1c73fe4c83d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:56.962412 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2099/4202] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:31:56 2022] DELETE /identity/v3/users/e74385e7702b4a27b512f1c73fe4c83d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:56.970801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0171ee-8ba2-4e56-b18e-9002d2108e61 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:56.974939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0171ee-8ba2-4e56-b18e-9002d2108e61 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:56.975247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0171ee-8ba2-4e56-b18e-9002d2108e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:57.005041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fc0171ee-8ba2-4e56-b18e-9002d2108e61 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:57.007462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fc0171ee-8ba2-4e56-b18e-9002d2108e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:57.087901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3e1ea-3bae-4084-b4f7-00f1b9982655 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:57.090596 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3e1ea-3bae-4084-b4f7-00f1b9982655 service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:57.106559 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2104/4203] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:31:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 02 10:31:57.147182 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2100/4204] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:31:57.162043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3e1ea-3bae-4084-b4f7-00f1b9982655 service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:57.166875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-51e3e1ea-3bae-4084-b4f7-00f1b9982655 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:57.171850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0171ee-8ba2-4e56-b18e-9002d2108e61 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:57.173516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fc0171ee-8ba2-4e56-b18e-9002d2108e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:57.205754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0171ee-8ba2-4e56-b18e-9002d2108e61 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:57.211718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731442f1-a933-4433-9ab2-549c42b15565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:57.213062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731442f1-a933-4433-9ab2-549c42b15565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:57.213517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731442f1-a933-4433-9ab2-549c42b15565 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:57.213953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731442f1-a933-4433-9ab2-549c42b15565 admin admin] PATH_INFO: `/v3/projects/308850d6707b4afd80762934ddee6a87` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:57.216542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731442f1-a933-4433-9ab2-549c42b15565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=308850d6707b4afd80762934ddee6a87)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:57.219082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731442f1-a933-4433-9ab2-549c42b15565 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:57.278339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3e1ea-3bae-4084-b4f7-00f1b9982655 service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:57.388106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-731442f1-a933-4433-9ab2-549c42b15565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '308850d6707b4afd80762934ddee6a87', 'request_id': 'req-731442f1-a933-4433-9ab2-549c42b15565'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:57.398975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edec89-4753-460b-b5df-7719f5f5e8de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:57.399652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edec89-4753-460b-b5df-7719f5f5e8de service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:57.399938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edec89-4753-460b-b5df-7719f5f5e8de service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:57.400277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edec89-4753-460b-b5df-7719f5f5e8de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:57.425209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6edec89-4753-460b-b5df-7719f5f5e8de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:57.429090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6edec89-4753-460b-b5df-7719f5f5e8de service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:57.455739 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2105/4205] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:31:57.465997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-731442f1-a933-4433-9ab2-549c42b15565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '308850d6707b4afd80762934ddee6a87', 'request_id': 'req-731442f1-a933-4433-9ab2-549c42b15565'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:57.474208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-731442f1-a933-4433-9ab2-549c42b15565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '308850d6707b4afd80762934ddee6a87', 'request_id': 'req-731442f1-a933-4433-9ab2-549c42b15565'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:57.494813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-731442f1-a933-4433-9ab2-549c42b15565 admin admin] The token cache is being invalidate because project 308850d6707b4afd80762934ddee6a87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:31:57.495359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-731442f1-a933-4433-9ab2-549c42b15565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:57.496959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-731442f1-a933-4433-9ab2-549c42b15565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:57.499835 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2101/4206] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:31:57 2022] DELETE /identity/v3/projects/308850d6707b4afd80762934ddee6a87 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:57.507528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177af8ba-6553-4789-bb98-a362949451ef None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:57.508063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177af8ba-6553-4789-bb98-a362949451ef None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:57.508518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177af8ba-6553-4789-bb98-a362949451ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:57.545983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-177af8ba-6553-4789-bb98-a362949451ef None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:57.547556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-177af8ba-6553-4789-bb98-a362949451ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:57.725306 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2106/4207] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:57.733458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a8733-ab15-49a1-bea9-e2846a9e480b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:57.733766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a8733-ab15-49a1-bea9-e2846a9e480b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:57.734040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a8733-ab15-49a1-bea9-e2846a9e480b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:57.775602 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0b6a8733-ab15-49a1-bea9-e2846a9e480b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:57.775602 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0b6a8733-ab15-49a1-bea9-e2846a9e480b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:57.799944 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2102/4208] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:57.800932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177af8ba-6553-4789-bb98-a362949451ef None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:57.817792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177af8ba-6553-4789-bb98-a362949451ef None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:57.829678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3eb2bb-c02e-488a-a205-05e4f2eacbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:57.830664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3eb2bb-c02e-488a-a205-05e4f2eacbc1 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:57.831230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3eb2bb-c02e-488a-a205-05e4f2eacbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:57.831809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3eb2bb-c02e-488a-a205-05e4f2eacbc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:57.833046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3eb2bb-c02e-488a-a205-05e4f2eacbc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:31:57.833519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3eb2bb-c02e-488a-a205-05e4f2eacbc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:57.835652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3eb2bb-c02e-488a-a205-05e4f2eacbc1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:57.852463 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2107/4209] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:31:57.857373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a8733-ab15-49a1-bea9-e2846a9e480b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:57.877109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a8733-ab15-49a1-bea9-e2846a9e480b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:57.885596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0df24c-93cb-4257-85b6-26d4e5c25551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:57.886390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0df24c-93cb-4257-85b6-26d4e5c25551 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:57.887721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0df24c-93cb-4257-85b6-26d4e5c25551 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:57.888045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0df24c-93cb-4257-85b6-26d4e5c25551 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:57.888862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0df24c-93cb-4257-85b6-26d4e5c25551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:57.892544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0df24c-93cb-4257-85b6-26d4e5c25551 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:57.949542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3eb2bb-c02e-488a-a205-05e4f2eacbc1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:57.952551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6e3eb2bb-c02e-488a-a205-05e4f2eacbc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:57.968169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3eb2bb-c02e-488a-a205-05e4f2eacbc1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:57.974055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48768472-d07e-44cf-8b90-5e1a1ea01ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:57.975101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48768472-d07e-44cf-8b90-5e1a1ea01ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:57.975494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48768472-d07e-44cf-8b90-5e1a1ea01ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:57.977137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48768472-d07e-44cf-8b90-5e1a1ea01ceb admin admin] PATH_INFO: `/v3/projects/66697da5eeeb4bbd8bb3d6265c4290e5` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:57.979344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48768472-d07e-44cf-8b90-5e1a1ea01ceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=66697da5eeeb4bbd8bb3d6265c4290e5)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:57.982123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48768472-d07e-44cf-8b90-5e1a1ea01ceb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:58.036748 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2103/4210] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:31:57 2022] POST /identity/v3/projects => generated 365 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:31:58.038582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0df24c-93cb-4257-85b6-26d4e5c25551 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:58.142860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0df24c-93cb-4257-85b6-26d4e5c25551 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:58.148697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2dea9-7803-45ba-96df-8bd52b203f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:58.149706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2dea9-7803-45ba-96df-8bd52b203f1f admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:58.150062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2dea9-7803-45ba-96df-8bd52b203f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:58.150408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2dea9-7803-45ba-96df-8bd52b203f1f admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:58.151434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2dea9-7803-45ba-96df-8bd52b203f1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:58.153975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2dea9-7803-45ba-96df-8bd52b203f1f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:58.192960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-48768472-d07e-44cf-8b90-5e1a1ea01ceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66697da5eeeb4bbd8bb3d6265c4290e5', 'request_id': 'req-48768472-d07e-44cf-8b90-5e1a1ea01ceb'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:58.203202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-48768472-d07e-44cf-8b90-5e1a1ea01ceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66697da5eeeb4bbd8bb3d6265c4290e5', 'request_id': 'req-48768472-d07e-44cf-8b90-5e1a1ea01ceb'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:58.276652 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2104/4211] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:31:58 2022] POST /identity/v3/users => generated 283 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:31:58.278966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-48768472-d07e-44cf-8b90-5e1a1ea01ceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66697da5eeeb4bbd8bb3d6265c4290e5', 'request_id': 'req-48768472-d07e-44cf-8b90-5e1a1ea01ceb'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:58.279263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2dea9-7803-45ba-96df-8bd52b203f1f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:58.298709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-48768472-d07e-44cf-8b90-5e1a1ea01ceb admin admin] The token cache is being invalidate because project 66697da5eeeb4bbd8bb3d6265c4290e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:31:58.299378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-48768472-d07e-44cf-8b90-5e1a1ea01ceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:58.300348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-48768472-d07e-44cf-8b90-5e1a1ea01ceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:58.302852 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2108/4212] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:31:57 2022] DELETE /identity/v3/projects/66697da5eeeb4bbd8bb3d6265c4290e5 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:31:58.303863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2dea9-7803-45ba-96df-8bd52b203f1f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:58.311680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cf42f-c5c2-4518-9a0f-08526d417c67 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:58.312319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cf42f-c5c2-4518-9a0f-08526d417c67 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:58.313143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cf42f-c5c2-4518-9a0f-08526d417c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:58.340071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a20cf42f-c5c2-4518-9a0f-08526d417c67 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:58.341750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a20cf42f-c5c2-4518-9a0f-08526d417c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:58.466064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c31aa-64e1-4d85-b239-79ca1164f64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:58.466756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c31aa-64e1-4d85-b239-79ca1164f64d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:58.467445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c31aa-64e1-4d85-b239-79ca1164f64d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:58.467931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c31aa-64e1-4d85-b239-79ca1164f64d admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:58.469102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c31aa-64e1-4d85-b239-79ca1164f64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:58.471049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c31aa-64e1-4d85-b239-79ca1164f64d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:58.492148 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2105/4213] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:31:58.499875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c31aa-64e1-4d85-b239-79ca1164f64d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:58.512676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6e1c31aa-64e1-4d85-b239-79ca1164f64d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:58.535339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c31aa-64e1-4d85-b239-79ca1164f64d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:58.549066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9b1aa-7266-4de7-a6ab-b25371fc66f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:58.549445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9b1aa-7266-4de7-a6ab-b25371fc66f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:58.549735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9b1aa-7266-4de7-a6ab-b25371fc66f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:58.550020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9b1aa-7266-4de7-a6ab-b25371fc66f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:58.550754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9b1aa-7266-4de7-a6ab-b25371fc66f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:58.551986 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2109/4214] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:58.552354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9b1aa-7266-4de7-a6ab-b25371fc66f5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:58.561015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5c6e6-ccff-4088-8c68-6b681e85d4a3 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:58.561476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5c6e6-ccff-4088-8c68-6b681e85d4a3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:58.561862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5c6e6-ccff-4088-8c68-6b681e85d4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:58.621338 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2106/4215] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:31:58.621338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9b1aa-7266-4de7-a6ab-b25371fc66f5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:58.621338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9b1aa-7266-4de7-a6ab-b25371fc66f5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:58.621916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c5a5c6e6-ccff-4088-8c68-6b681e85d4a3 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:58.621916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c5a5c6e6-ccff-4088-8c68-6b681e85d4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:58.629337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273abc53-314f-4f5f-872a-d020d12e511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:58.630367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273abc53-314f-4f5f-872a-d020d12e511d admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:58.630778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273abc53-314f-4f5f-872a-d020d12e511d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:58.631258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273abc53-314f-4f5f-872a-d020d12e511d admin admin] PATH_INFO: `/v3/projects/d9fd0aad469e47db8ff8bc7852954449/users/b02c5c3cdea84636a1852be787ef4b31/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:58.647559 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2110/4216] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:58.651939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5c6e6-ccff-4088-8c68-6b681e85d4a3 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:58.672894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5c6e6-ccff-4088-8c68-6b681e85d4a3 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:58.676512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273abc53-314f-4f5f-872a-d020d12e511d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9fd0aad469e47db8ff8bc7852954449, user_id=b02c5c3cdea84636a1852be787ef4b31, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:58.679371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273abc53-314f-4f5f-872a-d020d12e511d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:58.693048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be61f8-8922-45cd-8fc5-5cbbc4e85a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:58.713043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be61f8-8922-45cd-8fc5-5cbbc4e85a00 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:58.713043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be61f8-8922-45cd-8fc5-5cbbc4e85a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:58.713043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be61f8-8922-45cd-8fc5-5cbbc4e85a00 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:58.713043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be61f8-8922-45cd-8fc5-5cbbc4e85a00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:31:58.713043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be61f8-8922-45cd-8fc5-5cbbc4e85a00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:58.713043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be61f8-8922-45cd-8fc5-5cbbc4e85a00 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:58.723125 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2111/4217] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:31:58.727971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be61f8-8922-45cd-8fc5-5cbbc4e85a00 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:58.747955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be61f8-8922-45cd-8fc5-5cbbc4e85a00 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:58.756324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df5305-e5a2-4310-afcd-8d2e41d7f27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:58.757889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df5305-e5a2-4310-afcd-8d2e41d7f27c admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:58.758413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df5305-e5a2-4310-afcd-8d2e41d7f27c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:58.759521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df5305-e5a2-4310-afcd-8d2e41d7f27c admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:58.760569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df5305-e5a2-4310-afcd-8d2e41d7f27c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:58.763295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df5305-e5a2-4310-afcd-8d2e41d7f27c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:59.115111 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2107/4218] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:31:58 2022] PUT /identity/v3/projects/d9fd0aad469e47db8ff8bc7852954449/users/b02c5c3cdea84636a1852be787ef4b31/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:31:59.116709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47c516-74e0-4a39-86fd-bc2e5a02ea83 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:59.117005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47c516-74e0-4a39-86fd-bc2e5a02ea83 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:59.117285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47c516-74e0-4a39-86fd-bc2e5a02ea83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:59.148653 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2112/4219] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:31:58 2022] POST /identity/v3/projects => generated 393 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:31:59.152282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df5305-e5a2-4310-afcd-8d2e41d7f27c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:59.179389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ba47c516-74e0-4a39-86fd-bc2e5a02ea83 None None] MFA Rules not processed for user `b02c5c3cdea84636a1852be787ef4b31`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:31:59.183928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ba47c516-74e0-4a39-86fd-bc2e5a02ea83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:59.280028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df5305-e5a2-4310-afcd-8d2e41d7f27c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:59.289889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa467ea-d729-495c-80be-d3de71c56ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:59.290581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa467ea-d729-495c-80be-d3de71c56ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:59.290866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa467ea-d729-495c-80be-d3de71c56ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:59.291148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa467ea-d729-495c-80be-d3de71c56ba2 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:59.291845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa467ea-d729-495c-80be-d3de71c56ba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:59.298552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa467ea-d729-495c-80be-d3de71c56ba2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:59.326862 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2108/4220] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:31:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:31:59.330715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47c516-74e0-4a39-86fd-bc2e5a02ea83 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:59.332822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ba47c516-74e0-4a39-86fd-bc2e5a02ea83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:59.356918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47c516-74e0-4a39-86fd-bc2e5a02ea83 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:59.371709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922513d1-ac5b-4ac9-a589-6054aa314421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:59.371709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922513d1-ac5b-4ac9-a589-6054aa314421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:59.371709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922513d1-ac5b-4ac9-a589-6054aa314421 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:59.371709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922513d1-ac5b-4ac9-a589-6054aa314421 admin admin] PATH_INFO: `/v3/projects/dc2147283df5438e9aa225c999591a41` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:59.372074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922513d1-ac5b-4ac9-a589-6054aa314421 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc2147283df5438e9aa225c999591a41)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:59.372074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922513d1-ac5b-4ac9-a589-6054aa314421 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:31:59.489012 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2113/4221] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:31:59 2022] POST /identity/v3/users => generated 297 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:31:59.493573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa467ea-d729-495c-80be-d3de71c56ba2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:59.500723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-faa467ea-d729-495c-80be-d3de71c56ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:59.576503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-922513d1-ac5b-4ac9-a589-6054aa314421 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc2147283df5438e9aa225c999591a41', 'request_id': 'req-922513d1-ac5b-4ac9-a589-6054aa314421'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:59.657178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa467ea-d729-495c-80be-d3de71c56ba2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:59.697470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-922513d1-ac5b-4ac9-a589-6054aa314421 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc2147283df5438e9aa225c999591a41', 'request_id': 'req-922513d1-ac5b-4ac9-a589-6054aa314421'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:59.743634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-922513d1-ac5b-4ac9-a589-6054aa314421 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc2147283df5438e9aa225c999591a41', 'request_id': 'req-922513d1-ac5b-4ac9-a589-6054aa314421'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:59.794581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-922513d1-ac5b-4ac9-a589-6054aa314421 admin admin] The token cache is being invalidate because project dc2147283df5438e9aa225c999591a41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:31:59.794581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-922513d1-ac5b-4ac9-a589-6054aa314421 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:59.796242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-922513d1-ac5b-4ac9-a589-6054aa314421 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:31:59.804058 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2109/4222] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:31:59 2022] DELETE /identity/v3/projects/dc2147283df5438e9aa225c999591a41 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:31:59.809626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922513d1-ac5b-4ac9-a589-6054aa314421 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:31:59.814485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-922513d1-ac5b-4ac9-a589-6054aa314421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:59.875853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35516a-526c-4ecc-b62a-e480c8492c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:59.878620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35516a-526c-4ecc-b62a-e480c8492c93 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:59.878963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35516a-526c-4ecc-b62a-e480c8492c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:59.879275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35516a-526c-4ecc-b62a-e480c8492c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:59.887108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fa35516a-526c-4ecc-b62a-e480c8492c93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:31:59.960784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922513d1-ac5b-4ac9-a589-6054aa314421 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:31:59.977403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1943f-4473-407b-b989-3c4b553634a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:31:59.978100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1943f-4473-407b-b989-3c4b553634a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:31:59.978395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1943f-4473-407b-b989-3c4b553634a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:31:59.978761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1943f-4473-407b-b989-3c4b553634a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:31:59.979513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1943f-4473-407b-b989-3c4b553634a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:31:59.981905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1943f-4473-407b-b989-3c4b553634a0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:00.018125 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2110/4223] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:00.019559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1943f-4473-407b-b989-3c4b553634a0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:00.037173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b9b1943f-4473-407b-b989-3c4b553634a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:00.056732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1943f-4473-407b-b989-3c4b553634a0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:00.065035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477c6da-99f8-4f78-bc9e-9816a4b025b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:00.066686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477c6da-99f8-4f78-bc9e-9816a4b025b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:00.067122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35516a-526c-4ecc-b62a-e480c8492c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:00.067833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477c6da-99f8-4f78-bc9e-9816a4b025b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:00.068342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477c6da-99f8-4f78-bc9e-9816a4b025b3 admin admin] PATH_INFO: `/v3/users/b224608201c14252a11c25b997f9a8d3` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:00.068592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35516a-526c-4ecc-b62a-e480c8492c93 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:00.070353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477c6da-99f8-4f78-bc9e-9816a4b025b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b224608201c14252a11c25b997f9a8d3)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:00.072934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477c6da-99f8-4f78-bc9e-9816a4b025b3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:00.091938 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2114/4224] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:31:59 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:32:00.092814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35516a-526c-4ecc-b62a-e480c8492c93 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:00.120142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35516a-526c-4ecc-b62a-e480c8492c93 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:00.149767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0758f0-fe1a-43aa-889a-cb5f494f30ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:00.150521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0758f0-fe1a-43aa-889a-cb5f494f30ae admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:00.150807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0758f0-fe1a-43aa-889a-cb5f494f30ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:00.151084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0758f0-fe1a-43aa-889a-cb5f494f30ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:00.151815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0758f0-fe1a-43aa-889a-cb5f494f30ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:00.154033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0758f0-fe1a-43aa-889a-cb5f494f30ae admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:00.186467 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2115/4225] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:00.190697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0758f0-fe1a-43aa-889a-cb5f494f30ae admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:00.229804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0758f0-fe1a-43aa-889a-cb5f494f30ae admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:00.241584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fbc91-bca3-4f5b-897a-c9de0502bd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:00.242709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fbc91-bca3-4f5b-897a-c9de0502bd8c admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:00.243155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fbc91-bca3-4f5b-897a-c9de0502bd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:00.243601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fbc91-bca3-4f5b-897a-c9de0502bd8c admin admin] PATH_INFO: `/v3/projects/ba2732a151c04314a5fcd1c95faaba90/users/e3f69b380ae641f1ac4879502e8b4cb5/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:00.282349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7477c6da-99f8-4f78-bc9e-9816a4b025b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b224608201c14252a11c25b997f9a8d3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:00.284654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fbc91-bca3-4f5b-897a-c9de0502bd8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba2732a151c04314a5fcd1c95faaba90, user_id=e3f69b380ae641f1ac4879502e8b4cb5, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:00.289554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fbc91-bca3-4f5b-897a-c9de0502bd8c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:00.321769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7477c6da-99f8-4f78-bc9e-9816a4b025b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b224608201c14252a11c25b997f9a8d3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:00.323427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7477c6da-99f8-4f78-bc9e-9816a4b025b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b224608201c14252a11c25b997f9a8d3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:00.349957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7477c6da-99f8-4f78-bc9e-9816a4b025b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b224608201c14252a11c25b997f9a8d3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:00.374221 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2116/4226] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:32:00 2022] PUT /identity/v3/projects/ba2732a151c04314a5fcd1c95faaba90/users/e3f69b380ae641f1ac4879502e8b4cb5/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:00.385183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f1eaa-ed30-4615-b559-c1069cc4a328 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:00.385838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f1eaa-ed30-4615-b559-c1069cc4a328 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:00.386856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f1eaa-ed30-4615-b559-c1069cc4a328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:00.442610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7477c6da-99f8-4f78-bc9e-9816a4b025b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b224608201c14252a11c25b997f9a8d3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:00.451099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ed8f1eaa-ed30-4615-b559-c1069cc4a328 None None] MFA Rules not processed for user `e3f69b380ae641f1ac4879502e8b4cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:00.456085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ed8f1eaa-ed30-4615-b559-c1069cc4a328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:00.456991 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2111/4227] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:32:00 2022] DELETE /identity/v3/users/b224608201c14252a11c25b997f9a8d3 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:00.584397 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2117/4228] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:00.585353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477c6da-99f8-4f78-bc9e-9816a4b025b3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:00.589278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7477c6da-99f8-4f78-bc9e-9816a4b025b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:00.751091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477c6da-99f8-4f78-bc9e-9816a4b025b3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:00.766558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cf0ba-81ad-4097-975b-1e27f4055d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:00.767538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cf0ba-81ad-4097-975b-1e27f4055d3a admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:00.769349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cf0ba-81ad-4097-975b-1e27f4055d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:00.769349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cf0ba-81ad-4097-975b-1e27f4055d3a admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:00.770312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31cf0ba-81ad-4097-975b-1e27f4055d3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:00.773891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31cf0ba-81ad-4097-975b-1e27f4055d3a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:00.913202 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2112/4229] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:32:00 2022] POST /identity/v3/projects => generated 393 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:32:00.914648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f1eaa-ed30-4615-b559-c1069cc4a328 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:00.937589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f1eaa-ed30-4615-b559-c1069cc4a328 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:01.054088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d90c7-d8a3-409e-abaa-0a2f646c9f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:01.054776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d90c7-d8a3-409e-abaa-0a2f646c9f7f admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:01.055439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d90c7-d8a3-409e-abaa-0a2f646c9f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:01.055439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d90c7-d8a3-409e-abaa-0a2f646c9f7f admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:01.056004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d90c7-d8a3-409e-abaa-0a2f646c9f7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:01.058020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d90c7-d8a3-409e-abaa-0a2f646c9f7f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:01.177756 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2118/4230] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:32:00 2022] POST /identity/v3/users => generated 303 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:32:01.179101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cf0ba-81ad-4097-975b-1e27f4055d3a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:01.195776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cf0ba-81ad-4097-975b-1e27f4055d3a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:01.208542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cdcfc-3354-4ad5-a85e-311984a9e9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:01.209441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cdcfc-3354-4ad5-a85e-311984a9e9ff admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:01.209794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cdcfc-3354-4ad5-a85e-311984a9e9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:01.210183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cdcfc-3354-4ad5-a85e-311984a9e9ff admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:01.211029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65cdcfc-3354-4ad5-a85e-311984a9e9ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:01.220106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65cdcfc-3354-4ad5-a85e-311984a9e9ff admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:01.239724 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2113/4231] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:01.244032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d90c7-d8a3-409e-abaa-0a2f646c9f7f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:01.258656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d90c7-d8a3-409e-abaa-0a2f646c9f7f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:01.275861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27811fb3-b991-408f-bd3a-72ce3c36fd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:01.277823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27811fb3-b991-408f-bd3a-72ce3c36fd44 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:01.278207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27811fb3-b991-408f-bd3a-72ce3c36fd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:01.279969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27811fb3-b991-408f-bd3a-72ce3c36fd44 admin admin] PATH_INFO: `/v3/projects/a70bccc545cd4718aee92bd4d806ee37/users/d57c7897c0894818ab83ee1048a1abcf/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:01.314281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27811fb3-b991-408f-bd3a-72ce3c36fd44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a70bccc545cd4718aee92bd4d806ee37, user_id=d57c7897c0894818ab83ee1048a1abcf, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:01.317923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27811fb3-b991-408f-bd3a-72ce3c36fd44 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:01.412326 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2119/4232] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:32:01 2022] PUT /identity/v3/projects/a70bccc545cd4718aee92bd4d806ee37/users/d57c7897c0894818ab83ee1048a1abcf/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:01.413528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cdcfc-3354-4ad5-a85e-311984a9e9ff admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:01.432386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cdcfc-3354-4ad5-a85e-311984a9e9ff admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:01.567897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a1ace-d873-48f6-bd2a-c54f8e947087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:01.567897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a1ace-d873-48f6-bd2a-c54f8e947087 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:01.567897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a1ace-d873-48f6-bd2a-c54f8e947087 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:01.567897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a1ace-d873-48f6-bd2a-c54f8e947087 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:01.569014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a1ace-d873-48f6-bd2a-c54f8e947087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:01.575394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a1ace-d873-48f6-bd2a-c54f8e947087 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:01.597690 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2114/4233] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:32:01.599524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27811fb3-b991-408f-bd3a-72ce3c36fd44 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:01.628320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27811fb3-b991-408f-bd3a-72ce3c36fd44 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:01.642344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe005ae-44d5-4692-a05c-c5683579c43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:01.643534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe005ae-44d5-4692-a05c-c5683579c43a admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:01.643984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe005ae-44d5-4692-a05c-c5683579c43a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:01.644439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe005ae-44d5-4692-a05c-c5683579c43a admin admin] PATH_INFO: `/v3/projects/a70bccc545cd4718aee92bd4d806ee37/users/d57c7897c0894818ab83ee1048a1abcf/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:01.646786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe005ae-44d5-4692-a05c-c5683579c43a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a70bccc545cd4718aee92bd4d806ee37, user_id=d57c7897c0894818ab83ee1048a1abcf, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:01.650342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe005ae-44d5-4692-a05c-c5683579c43a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:01.676935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5c2a0-2212-4173-9428-3d1693747229 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:01.677230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5c2a0-2212-4173-9428-3d1693747229 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:01.677578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5c2a0-2212-4173-9428-3d1693747229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:01.685779 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2120/4234] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:32:01 2022] PUT /identity/v3/projects/a70bccc545cd4718aee92bd4d806ee37/users/d57c7897c0894818ab83ee1048a1abcf/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:01.745053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-00b5c2a0-2212-4173-9428-3d1693747229 None None] MFA Rules not processed for user `d57c7897c0894818ab83ee1048a1abcf`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:01.747802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-00b5c2a0-2212-4173-9428-3d1693747229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:01.982868 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2115/4235] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:32:01.994824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe005ae-44d5-4692-a05c-c5683579c43a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:01.996989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2fe005ae-44d5-4692-a05c-c5683579c43a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:02.040909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5c2a0-2212-4173-9428-3d1693747229 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:02.043896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-00b5c2a0-2212-4173-9428-3d1693747229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:02.124501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe005ae-44d5-4692-a05c-c5683579c43a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:02.131200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2be17-ece1-4012-99e9-0610d08d28e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:02.132177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2be17-ece1-4012-99e9-0610d08d28e3 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:02.132685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2be17-ece1-4012-99e9-0610d08d28e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:02.133195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2be17-ece1-4012-99e9-0610d08d28e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:02.146383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2be17-ece1-4012-99e9-0610d08d28e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:02.148493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2be17-ece1-4012-99e9-0610d08d28e3 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:02.187046 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2121/4236] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:32:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:32:02.208188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5c2a0-2212-4173-9428-3d1693747229 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:02.225029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f0706-66b6-4a60-a642-5d907aa2f204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:02.225947 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f0706-66b6-4a60-a642-5d907aa2f204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:02.226233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f0706-66b6-4a60-a642-5d907aa2f204 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:02.226516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f0706-66b6-4a60-a642-5d907aa2f204 admin admin] PATH_INFO: `/v3/projects/2c2f4545d2c249f2bbbd4ec4b7a6e1fa` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:02.235335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f0706-66b6-4a60-a642-5d907aa2f204 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c2f4545d2c249f2bbbd4ec4b7a6e1fa)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:02.237646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f0706-66b6-4a60-a642-5d907aa2f204 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:02.318412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2be17-ece1-4012-99e9-0610d08d28e3 service cinder] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:02.321154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c5a2be17-ece1-4012-99e9-0610d08d28e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:02.341224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2be17-ece1-4012-99e9-0610d08d28e3 service cinder] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:02.356116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54634ee3-097b-4694-b3b7-8472e7967ce7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:02.356810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54634ee3-097b-4694-b3b7-8472e7967ce7 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:02.357096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54634ee3-097b-4694-b3b7-8472e7967ce7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:02.357567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54634ee3-097b-4694-b3b7-8472e7967ce7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:02.441329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e02f0706-66b6-4a60-a642-5d907aa2f204 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c2f4545d2c249f2bbbd4ec4b7a6e1fa', 'request_id': 'req-e02f0706-66b6-4a60-a642-5d907aa2f204'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:02.475121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54634ee3-097b-4694-b3b7-8472e7967ce7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:02.476734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54634ee3-097b-4694-b3b7-8472e7967ce7 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:02.487759 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2122/4237] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:32:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:32:02.531891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e02f0706-66b6-4a60-a642-5d907aa2f204 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c2f4545d2c249f2bbbd4ec4b7a6e1fa', 'request_id': 'req-e02f0706-66b6-4a60-a642-5d907aa2f204'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:02.546917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e02f0706-66b6-4a60-a642-5d907aa2f204 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c2f4545d2c249f2bbbd4ec4b7a6e1fa', 'request_id': 'req-e02f0706-66b6-4a60-a642-5d907aa2f204'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:02.586399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e02f0706-66b6-4a60-a642-5d907aa2f204 admin admin] The token cache is being invalidate because project 2c2f4545d2c249f2bbbd4ec4b7a6e1fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:32:02.587169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e02f0706-66b6-4a60-a642-5d907aa2f204 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:02.590446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e02f0706-66b6-4a60-a642-5d907aa2f204 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:02.593429 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2116/4238] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:32:02 2022] DELETE /identity/v3/projects/2c2f4545d2c249f2bbbd4ec4b7a6e1fa => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:32:02.602524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbeefd-c450-44d0-a0b9-3ea0451cc745 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:02.602808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbeefd-c450-44d0-a0b9-3ea0451cc745 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:02.603285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbeefd-c450-44d0-a0b9-3ea0451cc745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:02.662194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3cfbeefd-c450-44d0-a0b9-3ea0451cc745 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:02.663888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3cfbeefd-c450-44d0-a0b9-3ea0451cc745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:02.800825 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2123/4239] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:02.810218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b8f9a-83a1-4358-8f94-c521fe6138a6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:02.810444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b8f9a-83a1-4358-8f94-c521fe6138a6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:02.810723 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b8f9a-83a1-4358-8f94-c521fe6138a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:02.847072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8a3b8f9a-83a1-4358-8f94-c521fe6138a6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:02.848638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8a3b8f9a-83a1-4358-8f94-c521fe6138a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:02.857898 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2117/4240] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:02.862465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbeefd-c450-44d0-a0b9-3ea0451cc745 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:02.877574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbeefd-c450-44d0-a0b9-3ea0451cc745 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:02.883402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ffd56-99c7-4fc4-8c1b-aa4082f7aa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:02.884206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ffd56-99c7-4fc4-8c1b-aa4082f7aa37 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:02.884558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ffd56-99c7-4fc4-8c1b-aa4082f7aa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:02.885385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ffd56-99c7-4fc4-8c1b-aa4082f7aa37 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:02.885588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ffd56-99c7-4fc4-8c1b-aa4082f7aa37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:32:02.885896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ffd56-99c7-4fc4-8c1b-aa4082f7aa37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:02.888089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ffd56-99c7-4fc4-8c1b-aa4082f7aa37 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:02.904049 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2124/4241] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:32:02.905256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b8f9a-83a1-4358-8f94-c521fe6138a6 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:02.920106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b8f9a-83a1-4358-8f94-c521fe6138a6 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:02.930598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a9b22-af5d-429c-b658-417180df0b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:02.930834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a9b22-af5d-429c-b658-417180df0b82 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:02.931093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a9b22-af5d-429c-b658-417180df0b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:02.931369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a9b22-af5d-429c-b658-417180df0b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:02.932154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a9b22-af5d-429c-b658-417180df0b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:02.938879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a9b22-af5d-429c-b658-417180df0b82 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:03.033282 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2118/4242] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:32:02 2022] POST /identity/v3/projects => generated 411 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:32:03.037600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ffd56-99c7-4fc4-8c1b-aa4082f7aa37 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:03.051667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ffd56-99c7-4fc4-8c1b-aa4082f7aa37 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:03.313636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bac81-ab7b-4fc1-8b04-d8b09cc06beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:03.315925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bac81-ab7b-4fc1-8b04-d8b09cc06beb admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:03.318005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bac81-ab7b-4fc1-8b04-d8b09cc06beb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:03.318579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bac81-ab7b-4fc1-8b04-d8b09cc06beb admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:03.319681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bac81-ab7b-4fc1-8b04-d8b09cc06beb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:03.322789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bac81-ab7b-4fc1-8b04-d8b09cc06beb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:03.691975 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2125/4243] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:32:03 2022] POST /identity/v3/users => generated 306 bytes in 655 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:32:03.692474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a9b22-af5d-429c-b658-417180df0b82 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:03.704240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a9b22-af5d-429c-b658-417180df0b82 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:03.715798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c7503-bdc6-4808-b59d-77941244a2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:03.716698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c7503-bdc6-4808-b59d-77941244a2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:03.717188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c7503-bdc6-4808-b59d-77941244a2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:03.717681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c7503-bdc6-4808-b59d-77941244a2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:03.718627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c7503-bdc6-4808-b59d-77941244a2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:03.720700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c7503-bdc6-4808-b59d-77941244a2d5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:03.897730 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2119/4244] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:03.898478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bac81-ab7b-4fc1-8b04-d8b09cc06beb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:03.919072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bac81-ab7b-4fc1-8b04-d8b09cc06beb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:03.924496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682f0c8-04d9-4144-ba43-1cecd911dbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:03.927448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682f0c8-04d9-4144-ba43-1cecd911dbed admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:03.927448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682f0c8-04d9-4144-ba43-1cecd911dbed admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:03.927448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682f0c8-04d9-4144-ba43-1cecd911dbed admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:03.927448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682f0c8-04d9-4144-ba43-1cecd911dbed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:03.928747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682f0c8-04d9-4144-ba43-1cecd911dbed admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:03.958626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c7503-bdc6-4808-b59d-77941244a2d5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:03.970983 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2126/4245] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:03.982609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c7503-bdc6-4808-b59d-77941244a2d5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:03.989697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae4dc9-46b2-4bd6-93ed-6c0f6f3d50e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:03.991015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae4dc9-46b2-4bd6-93ed-6c0f6f3d50e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:03.991401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae4dc9-46b2-4bd6-93ed-6c0f6f3d50e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:03.991774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae4dc9-46b2-4bd6-93ed-6c0f6f3d50e9 admin admin] PATH_INFO: `/v3/projects/b1b64eac9be54bb888efb39bf8bb93ba/users/46400570e35841af88803dc0d527afbe/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:04.041635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae4dc9-46b2-4bd6-93ed-6c0f6f3d50e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1b64eac9be54bb888efb39bf8bb93ba, user_id=46400570e35841af88803dc0d527afbe, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:04.046110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae4dc9-46b2-4bd6-93ed-6c0f6f3d50e9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:04.170007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131c294-03ca-4855-86f0-0c3ea9b308cd None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:04.170959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131c294-03ca-4855-86f0-0c3ea9b308cd None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:04.171483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131c294-03ca-4855-86f0-0c3ea9b308cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:04.173067 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2120/4246] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:32:03 2022] PUT /identity/v3/projects/b1b64eac9be54bb888efb39bf8bb93ba/users/46400570e35841af88803dc0d527afbe/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:32:04.194575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f131c294-03ca-4855-86f0-0c3ea9b308cd None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:04.196428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f131c294-03ca-4855-86f0-0c3ea9b308cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:04.325003 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2127/4247] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:04.332979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae4dc9-46b2-4bd6-93ed-6c0f6f3d50e9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:04.335388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-68ae4dc9-46b2-4bd6-93ed-6c0f6f3d50e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:04.484140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae4dc9-46b2-4bd6-93ed-6c0f6f3d50e9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:04.496933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc686a45-d452-4ead-ae10-a30ec877721a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:04.497611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc686a45-d452-4ead-ae10-a30ec877721a service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:04.498097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc686a45-d452-4ead-ae10-a30ec877721a service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:04.502948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc686a45-d452-4ead-ae10-a30ec877721a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:04.521413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc686a45-d452-4ead-ae10-a30ec877721a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:04.523149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc686a45-d452-4ead-ae10-a30ec877721a service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:04.551165 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2121/4248] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:32:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:32:11.678436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131c294-03ca-4855-86f0-0c3ea9b308cd None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:11.680110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f131c294-03ca-4855-86f0-0c3ea9b308cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:11.693273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131c294-03ca-4855-86f0-0c3ea9b308cd None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:11.705314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2780714-26cb-4b53-8f6e-618eabfd1ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:11.706468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2780714-26cb-4b53-8f6e-618eabfd1ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:11.706815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2780714-26cb-4b53-8f6e-618eabfd1ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:11.707178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2780714-26cb-4b53-8f6e-618eabfd1ffa admin admin] PATH_INFO: `/v3/users/04881f915cde4c29b57c9173ab754cbf` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:11.713124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2780714-26cb-4b53-8f6e-618eabfd1ffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=04881f915cde4c29b57c9173ab754cbf)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:11.715574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2780714-26cb-4b53-8f6e-618eabfd1ffa admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:11.971107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b2780714-26cb-4b53-8f6e-618eabfd1ffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04881f915cde4c29b57c9173ab754cbf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:12.057900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b2780714-26cb-4b53-8f6e-618eabfd1ffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04881f915cde4c29b57c9173ab754cbf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:12.060182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b2780714-26cb-4b53-8f6e-618eabfd1ffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04881f915cde4c29b57c9173ab754cbf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:12.092495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b2780714-26cb-4b53-8f6e-618eabfd1ffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04881f915cde4c29b57c9173ab754cbf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:12.180319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b2780714-26cb-4b53-8f6e-618eabfd1ffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04881f915cde4c29b57c9173ab754cbf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:12.180319 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2128/4249] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:32:11 2022] DELETE /identity/v3/users/04881f915cde4c29b57c9173ab754cbf => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:13.522540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc686a45-d452-4ead-ae10-a30ec877721a service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:13.523992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bc686a45-d452-4ead-ae10-a30ec877721a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:13.547258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc686a45-d452-4ead-ae10-a30ec877721a service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:13.715083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f7d9a-6155-4539-83cc-27d7bbee348b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:13.716498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f7d9a-6155-4539-83cc-27d7bbee348b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:13.716900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f7d9a-6155-4539-83cc-27d7bbee348b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:13.717272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f7d9a-6155-4539-83cc-27d7bbee348b admin admin] PATH_INFO: `/v3/users/e3f69b380ae641f1ac4879502e8b4cb5` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:13.723066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f7d9a-6155-4539-83cc-27d7bbee348b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3f69b380ae641f1ac4879502e8b4cb5)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:13.728131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f7d9a-6155-4539-83cc-27d7bbee348b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:13.950282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43efc5-8743-48ae-b0b8-9f5316bf496c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:13.950860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43efc5-8743-48ae-b0b8-9f5316bf496c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:13.950860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43efc5-8743-48ae-b0b8-9f5316bf496c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:14.001579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7e43efc5-8743-48ae-b0b8-9f5316bf496c None None] MFA Rules not processed for user `bb79a0a1ee5a429c9df27db4f671f0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:14.005769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7e43efc5-8743-48ae-b0b8-9f5316bf496c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:14.006285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ec4f7d9a-6155-4539-83cc-27d7bbee348b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3f69b380ae641f1ac4879502e8b4cb5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:14.036657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ec4f7d9a-6155-4539-83cc-27d7bbee348b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3f69b380ae641f1ac4879502e8b4cb5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:14.037328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ec4f7d9a-6155-4539-83cc-27d7bbee348b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3f69b380ae641f1ac4879502e8b4cb5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:14.054007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ec4f7d9a-6155-4539-83cc-27d7bbee348b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3f69b380ae641f1ac4879502e8b4cb5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:14.127662 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2129/4250] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:32:14.132978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43efc5-8743-48ae-b0b8-9f5316bf496c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:14.136935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7e43efc5-8743-48ae-b0b8-9f5316bf496c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:14.156251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ec4f7d9a-6155-4539-83cc-27d7bbee348b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3f69b380ae641f1ac4879502e8b4cb5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:14.164091 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2122/4251] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:32:13 2022] DELETE /identity/v3/users/e3f69b380ae641f1ac4879502e8b4cb5 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:14.170083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341503ea-14a1-472b-b253-ae75bbb1f8b6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:14.170370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341503ea-14a1-472b-b253-ae75bbb1f8b6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:14.170645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341503ea-14a1-472b-b253-ae75bbb1f8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:14.197440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43efc5-8743-48ae-b0b8-9f5316bf496c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:14.228561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-341503ea-14a1-472b-b253-ae75bbb1f8b6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:14.230199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-341503ea-14a1-472b-b253-ae75bbb1f8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:14.386886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361218e-b262-40f5-87c6-9a3daf2948d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:14.390510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361218e-b262-40f5-87c6-9a3daf2948d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:14.390808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361218e-b262-40f5-87c6-9a3daf2948d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:14.391099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361218e-b262-40f5-87c6-9a3daf2948d5 admin admin] PATH_INFO: `/v3/projects/01271c76e9e3490089d30e74ae05144e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:14.397854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361218e-b262-40f5-87c6-9a3daf2948d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01271c76e9e3490089d30e74ae05144e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:14.405948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361218e-b262-40f5-87c6-9a3daf2948d5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:14.430502 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2123/4252] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:32:14.482064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341503ea-14a1-472b-b253-ae75bbb1f8b6 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:14.483501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-341503ea-14a1-472b-b253-ae75bbb1f8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:14.585700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341503ea-14a1-472b-b253-ae75bbb1f8b6 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:14.593514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d361218e-b262-40f5-87c6-9a3daf2948d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01271c76e9e3490089d30e74ae05144e', 'request_id': 'req-d361218e-b262-40f5-87c6-9a3daf2948d5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:14.608207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d361218e-b262-40f5-87c6-9a3daf2948d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01271c76e9e3490089d30e74ae05144e', 'request_id': 'req-d361218e-b262-40f5-87c6-9a3daf2948d5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:14.676363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c19cc-44e6-4b50-84b9-29f4717cc4b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:14.677546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c19cc-44e6-4b50-84b9-29f4717cc4b0 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:14.678687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c19cc-44e6-4b50-84b9-29f4717cc4b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:14.679134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c19cc-44e6-4b50-84b9-29f4717cc4b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:14.688291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d361218e-b262-40f5-87c6-9a3daf2948d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01271c76e9e3490089d30e74ae05144e', 'request_id': 'req-d361218e-b262-40f5-87c6-9a3daf2948d5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:14.707220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d361218e-b262-40f5-87c6-9a3daf2948d5 admin admin] The token cache is being invalidate because project 01271c76e9e3490089d30e74ae05144e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:32:14.707917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d361218e-b262-40f5-87c6-9a3daf2948d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:14.709869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d361218e-b262-40f5-87c6-9a3daf2948d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:14.713350 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2130/4253] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:32:14 2022] DELETE /identity/v3/projects/01271c76e9e3490089d30e74ae05144e => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:14.718903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d51a5b-ff15-4a8e-93d6-0ccf24edad4e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:14.721292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d51a5b-ff15-4a8e-93d6-0ccf24edad4e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:14.722025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d51a5b-ff15-4a8e-93d6-0ccf24edad4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:14.764916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c19cc-44e6-4b50-84b9-29f4717cc4b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:14.766617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c19cc-44e6-4b50-84b9-29f4717cc4b0 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:14.779704 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2124/4254] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:32:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:32:14.788267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-75d51a5b-ff15-4a8e-93d6-0ccf24edad4e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:14.789782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-75d51a5b-ff15-4a8e-93d6-0ccf24edad4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:14.837107 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2131/4255] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:14.839931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d41da4-f5e7-4521-aaa1-569d6b3c9ee6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:14.840372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d41da4-f5e7-4521-aaa1-569d6b3c9ee6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:14.840674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d41da4-f5e7-4521-aaa1-569d6b3c9ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:14.888018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-43d41da4-f5e7-4521-aaa1-569d6b3c9ee6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:14.888018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-43d41da4-f5e7-4521-aaa1-569d6b3c9ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:14.906046 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2125/4256] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:14.907169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d51a5b-ff15-4a8e-93d6-0ccf24edad4e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:14.918372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d51a5b-ff15-4a8e-93d6-0ccf24edad4e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:14.930556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c905ae-ef22-4a59-8a5d-eb8efcb66f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:14.931235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c905ae-ef22-4a59-8a5d-eb8efcb66f18 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:14.931674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c905ae-ef22-4a59-8a5d-eb8efcb66f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:14.931955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c905ae-ef22-4a59-8a5d-eb8efcb66f18 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:14.932769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c905ae-ef22-4a59-8a5d-eb8efcb66f18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:32:14.933077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c905ae-ef22-4a59-8a5d-eb8efcb66f18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:14.935287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c905ae-ef22-4a59-8a5d-eb8efcb66f18 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:14.950431 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2132/4257] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:32:14.954399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d41da4-f5e7-4521-aaa1-569d6b3c9ee6 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:14.969314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d41da4-f5e7-4521-aaa1-569d6b3c9ee6 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:14.975141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725904a-d862-4e2d-a741-c38ee97b8ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:14.975835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725904a-d862-4e2d-a741-c38ee97b8ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:14.976241 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725904a-d862-4e2d-a741-c38ee97b8ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:14.976592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725904a-d862-4e2d-a741-c38ee97b8ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:14.977450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725904a-d862-4e2d-a741-c38ee97b8ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:14.980203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725904a-d862-4e2d-a741-c38ee97b8ea9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:15.115469 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2126/4258] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:32:14 2022] POST /identity/v3/projects => generated 391 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:32:15.120655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c905ae-ef22-4a59-8a5d-eb8efcb66f18 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:15.136656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c905ae-ef22-4a59-8a5d-eb8efcb66f18 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:15.211776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b32f0-5632-4860-89ca-caa521e369eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:15.212483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b32f0-5632-4860-89ca-caa521e369eb admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:15.212808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b32f0-5632-4860-89ca-caa521e369eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:15.213093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b32f0-5632-4860-89ca-caa521e369eb admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:15.214344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b32f0-5632-4860-89ca-caa521e369eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:15.216318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b32f0-5632-4860-89ca-caa521e369eb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:15.392509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725904a-d862-4e2d-a741-c38ee97b8ea9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:15.392640 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2133/4259] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:32:15 2022] POST /identity/v3/users => generated 296 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:32:15.404028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725904a-d862-4e2d-a741-c38ee97b8ea9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:15.422108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a53c3f-570e-4809-b277-e3dd4f63d98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:15.422108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a53c3f-570e-4809-b277-e3dd4f63d98c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:15.422108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a53c3f-570e-4809-b277-e3dd4f63d98c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:15.422108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a53c3f-570e-4809-b277-e3dd4f63d98c admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:15.422427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a53c3f-570e-4809-b277-e3dd4f63d98c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:15.425408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a53c3f-570e-4809-b277-e3dd4f63d98c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:15.471605 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2127/4260] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:15.475739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b32f0-5632-4860-89ca-caa521e369eb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:15.492570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b32f0-5632-4860-89ca-caa521e369eb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:15.543078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a07a6-17b8-44e1-914b-11f86abdcefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:15.545214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a07a6-17b8-44e1-914b-11f86abdcefb admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:15.545522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a07a6-17b8-44e1-914b-11f86abdcefb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:15.545809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a07a6-17b8-44e1-914b-11f86abdcefb admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:15.553229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a07a6-17b8-44e1-914b-11f86abdcefb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:15.558774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a07a6-17b8-44e1-914b-11f86abdcefb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:15.604670 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2134/4261] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:15.608181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a53c3f-570e-4809-b277-e3dd4f63d98c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:15.631980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a53c3f-570e-4809-b277-e3dd4f63d98c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:15.660009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4943c-2df0-4836-9a98-1040eccceaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:15.660986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4943c-2df0-4836-9a98-1040eccceaee admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:15.661271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4943c-2df0-4836-9a98-1040eccceaee admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:15.661547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4943c-2df0-4836-9a98-1040eccceaee admin admin] PATH_INFO: `/v3/projects/82bde93c359b4e4cb13a9ebcfa317377/users/d1f8df29b43a461d9c79b42858701437/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:15.716522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4943c-2df0-4836-9a98-1040eccceaee admin admin] RBAC: Authorizing `identity:create_grant(project_id=82bde93c359b4e4cb13a9ebcfa317377, user_id=d1f8df29b43a461d9c79b42858701437, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:15.719275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4943c-2df0-4836-9a98-1040eccceaee admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:15.826354 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2128/4262] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:32:15 2022] PUT /identity/v3/projects/82bde93c359b4e4cb13a9ebcfa317377/users/d1f8df29b43a461d9c79b42858701437/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:15.828205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbd0fe-3345-40c6-987d-33c41eb30538 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:15.829002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbd0fe-3345-40c6-987d-33c41eb30538 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:15.829428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbd0fe-3345-40c6-987d-33c41eb30538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:15.853132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4ccbd0fe-3345-40c6-987d-33c41eb30538 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:15.855391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4ccbd0fe-3345-40c6-987d-33c41eb30538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:16.021645 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2135/4263] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:16.054964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4943c-2df0-4836-9a98-1040eccceaee admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:16.056820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-69c4943c-2df0-4836-9a98-1040eccceaee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:16.205794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbd0fe-3345-40c6-987d-33c41eb30538 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:16.208742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4ccbd0fe-3345-40c6-987d-33c41eb30538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:16.217537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4943c-2df0-4836-9a98-1040eccceaee admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:16.226038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256694bc-f08c-4d5f-a34d-92dcbb5ea78c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:16.227024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256694bc-f08c-4d5f-a34d-92dcbb5ea78c service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:16.227312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256694bc-f08c-4d5f-a34d-92dcbb5ea78c service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:16.227669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256694bc-f08c-4d5f-a34d-92dcbb5ea78c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:16.232307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbd0fe-3345-40c6-987d-33c41eb30538 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:16.242938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fba1f0-5a80-432a-84a0-9f7fafb92adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:16.243812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fba1f0-5a80-432a-84a0-9f7fafb92adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:16.245392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fba1f0-5a80-432a-84a0-9f7fafb92adc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:16.246151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fba1f0-5a80-432a-84a0-9f7fafb92adc admin admin] PATH_INFO: `/v3/projects/ba2732a151c04314a5fcd1c95faaba90` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:16.247761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256694bc-f08c-4d5f-a34d-92dcbb5ea78c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:16.248620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fba1f0-5a80-432a-84a0-9f7fafb92adc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba2732a151c04314a5fcd1c95faaba90)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:16.250507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256694bc-f08c-4d5f-a34d-92dcbb5ea78c service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:16.252681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fba1f0-5a80-432a-84a0-9f7fafb92adc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:16.274431 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2129/4264] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:32:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:32:16.477853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-94fba1f0-5a80-432a-84a0-9f7fafb92adc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba2732a151c04314a5fcd1c95faaba90', 'request_id': 'req-94fba1f0-5a80-432a-84a0-9f7fafb92adc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:16.488632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-94fba1f0-5a80-432a-84a0-9f7fafb92adc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba2732a151c04314a5fcd1c95faaba90', 'request_id': 'req-94fba1f0-5a80-432a-84a0-9f7fafb92adc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:16.575399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-94fba1f0-5a80-432a-84a0-9f7fafb92adc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba2732a151c04314a5fcd1c95faaba90', 'request_id': 'req-94fba1f0-5a80-432a-84a0-9f7fafb92adc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:16.604198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-94fba1f0-5a80-432a-84a0-9f7fafb92adc admin admin] The token cache is being invalidate because project ba2732a151c04314a5fcd1c95faaba90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:32:16.604198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-94fba1f0-5a80-432a-84a0-9f7fafb92adc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:16.604198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-94fba1f0-5a80-432a-84a0-9f7fafb92adc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:16.607650 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2136/4265] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:32:16 2022] DELETE /identity/v3/projects/ba2732a151c04314a5fcd1c95faaba90 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:32:16.612263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256694bc-f08c-4d5f-a34d-92dcbb5ea78c service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:16.634781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256694bc-f08c-4d5f-a34d-92dcbb5ea78c service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:16.764035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f3ce1-2056-43c0-aec7-211bb904205e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:16.783945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f3ce1-2056-43c0-aec7-211bb904205e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:16.784301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f3ce1-2056-43c0-aec7-211bb904205e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:16.791258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f3ce1-2056-43c0-aec7-211bb904205e admin admin] PATH_INFO: `/v3/users/d57c7897c0894818ab83ee1048a1abcf` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:16.795469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f3ce1-2056-43c0-aec7-211bb904205e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d57c7897c0894818ab83ee1048a1abcf)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:16.809130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f3ce1-2056-43c0-aec7-211bb904205e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:17.067728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a30f3ce1-2056-43c0-aec7-211bb904205e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd57c7897c0894818ab83ee1048a1abcf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:17.093724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a30f3ce1-2056-43c0-aec7-211bb904205e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd57c7897c0894818ab83ee1048a1abcf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:17.095274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a30f3ce1-2056-43c0-aec7-211bb904205e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd57c7897c0894818ab83ee1048a1abcf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:17.106532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a30f3ce1-2056-43c0-aec7-211bb904205e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd57c7897c0894818ab83ee1048a1abcf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:17.201037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a30f3ce1-2056-43c0-aec7-211bb904205e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd57c7897c0894818ab83ee1048a1abcf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:17.213286 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2130/4266] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:32:16 2022] DELETE /identity/v3/users/d57c7897c0894818ab83ee1048a1abcf => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:18.973604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9a43a-c9a0-4b88-a530-2cb951c6956f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:18.974164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9a43a-c9a0-4b88-a530-2cb951c6956f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:18.974164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9a43a-c9a0-4b88-a530-2cb951c6956f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:19.005040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4af9a43a-c9a0-4b88-a530-2cb951c6956f None None] MFA Rules not processed for user `bb79a0a1ee5a429c9df27db4f671f0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:19.008456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4af9a43a-c9a0-4b88-a530-2cb951c6956f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:19.248106 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2137/4267] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:20.698097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f3ce1-2056-43c0-aec7-211bb904205e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:20.699769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a30f3ce1-2056-43c0-aec7-211bb904205e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:20.808630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f3ce1-2056-43c0-aec7-211bb904205e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:20.814905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741f972-2532-4194-a006-a3701b25cd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:20.817649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741f972-2532-4194-a006-a3701b25cd34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:20.817649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741f972-2532-4194-a006-a3701b25cd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:20.817649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741f972-2532-4194-a006-a3701b25cd34 admin admin] PATH_INFO: `/v3/projects/a70bccc545cd4718aee92bd4d806ee37` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:20.818559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741f972-2532-4194-a006-a3701b25cd34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a70bccc545cd4718aee92bd4d806ee37)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:20.821050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741f972-2532-4194-a006-a3701b25cd34 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:20.964563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d741f972-2532-4194-a006-a3701b25cd34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a70bccc545cd4718aee92bd4d806ee37', 'request_id': 'req-d741f972-2532-4194-a006-a3701b25cd34'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:21.025946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d741f972-2532-4194-a006-a3701b25cd34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a70bccc545cd4718aee92bd4d806ee37', 'request_id': 'req-d741f972-2532-4194-a006-a3701b25cd34'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:21.035251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d741f972-2532-4194-a006-a3701b25cd34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a70bccc545cd4718aee92bd4d806ee37', 'request_id': 'req-d741f972-2532-4194-a006-a3701b25cd34'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:21.062421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d741f972-2532-4194-a006-a3701b25cd34 admin admin] The token cache is being invalidate because project a70bccc545cd4718aee92bd4d806ee37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:32:21.062731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d741f972-2532-4194-a006-a3701b25cd34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:21.066022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d741f972-2532-4194-a006-a3701b25cd34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:21.067032 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2131/4268] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:32:20 2022] DELETE /identity/v3/projects/a70bccc545cd4718aee92bd4d806ee37 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:21.072236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de62b9e-d7a1-472f-a167-fe4c908cef66 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:21.072672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de62b9e-d7a1-472f-a167-fe4c908cef66 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:21.073505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de62b9e-d7a1-472f-a167-fe4c908cef66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:21.110491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0de62b9e-d7a1-472f-a167-fe4c908cef66 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:21.111737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0de62b9e-d7a1-472f-a167-fe4c908cef66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:21.257820 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2138/4269] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:21.265051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeda42-b20f-4d87-bf94-808b01890e9b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:21.265909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeda42-b20f-4d87-bf94-808b01890e9b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:21.266592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeda42-b20f-4d87-bf94-808b01890e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:21.302079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-85aeda42-b20f-4d87-bf94-808b01890e9b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:21.305188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-85aeda42-b20f-4d87-bf94-808b01890e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:21.331956 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2132/4270] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:21.332215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de62b9e-d7a1-472f-a167-fe4c908cef66 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:21.350644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de62b9e-d7a1-472f-a167-fe4c908cef66 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:21.372297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199df610-6b78-41eb-b1f5-63c38523fc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:21.373151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df610-6b78-41eb-b1f5-63c38523fc2b admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:21.387729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df610-6b78-41eb-b1f5-63c38523fc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:21.387729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df610-6b78-41eb-b1f5-63c38523fc2b admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:21.387729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199df610-6b78-41eb-b1f5-63c38523fc2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:32:21.387729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199df610-6b78-41eb-b1f5-63c38523fc2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:21.387729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199df610-6b78-41eb-b1f5-63c38523fc2b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:21.456922 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2139/4271] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:32:21.460135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aeda42-b20f-4d87-bf94-808b01890e9b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:21.484570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aeda42-b20f-4d87-bf94-808b01890e9b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:21.491310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f1444-2d9e-4f27-9129-9c2b94fbba97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:21.494691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f1444-2d9e-4f27-9129-9c2b94fbba97 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:21.496169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f1444-2d9e-4f27-9129-9c2b94fbba97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:21.497003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f1444-2d9e-4f27-9129-9c2b94fbba97 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:21.497985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f1444-2d9e-4f27-9129-9c2b94fbba97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:21.509194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f1444-2d9e-4f27-9129-9c2b94fbba97 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:21.649209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fde9e4-a534-42c2-82a2-d5920d5d6110 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:21.652317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fde9e4-a534-42c2-82a2-d5920d5d6110 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:21.652317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fde9e4-a534-42c2-82a2-d5920d5d6110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:21.700664 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2133/4272] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:32:21 2022] POST /identity/v3/projects => generated 377 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:32:21.702743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ea2de-e175-41d8-bbee-701fbcbe94fe None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:21.704739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ea2de-e175-41d8-bbee-701fbcbe94fe None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:21.704739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ea2de-e175-41d8-bbee-701fbcbe94fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:21.720702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e9fde9e4-a534-42c2-82a2-d5920d5d6110 None None] MFA Rules not processed for user `d1f8df29b43a461d9c79b42858701437`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:21.722089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e9fde9e4-a534-42c2-82a2-d5920d5d6110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:21.793454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ea6ea2de-e175-41d8-bbee-701fbcbe94fe None None] MFA Rules not processed for user `46400570e35841af88803dc0d527afbe`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:21.794866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ea6ea2de-e175-41d8-bbee-701fbcbe94fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:21.811245 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2140/4273] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:21.811483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fde9e4-a534-42c2-82a2-d5920d5d6110 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:22.000880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fde9e4-a534-42c2-82a2-d5920d5d6110 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:22.001570 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2134/4274] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:21 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:22.003017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a128574-37e6-4c70-bcef-ba3dda141290 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:22.003311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a128574-37e6-4c70-bcef-ba3dda141290 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:22.003595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a128574-37e6-4c70-bcef-ba3dda141290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:22.019439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31d00c-7b10-4ddb-9ac4-e3cfb6b9cd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:22.020143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31d00c-7b10-4ddb-9ac4-e3cfb6b9cd44 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:22.022645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31d00c-7b10-4ddb-9ac4-e3cfb6b9cd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:22.023017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31d00c-7b10-4ddb-9ac4-e3cfb6b9cd44 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:22.023752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31d00c-7b10-4ddb-9ac4-e3cfb6b9cd44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:22.027224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31d00c-7b10-4ddb-9ac4-e3cfb6b9cd44 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:22.044963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0a128574-37e6-4c70-bcef-ba3dda141290 None None] MFA Rules not processed for user `d1f8df29b43a461d9c79b42858701437`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:22.049640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0a128574-37e6-4c70-bcef-ba3dda141290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:22.074515 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2135/4275] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:22.077514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328e575-b9af-4990-a52d-b27dbafdef68 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:22.078884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328e575-b9af-4990-a52d-b27dbafdef68 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:22.079406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328e575-b9af-4990-a52d-b27dbafdef68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:22.102266 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2141/4276] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:32:21 2022] POST /identity/v3/users => generated 289 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:32:22.106459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31d00c-7b10-4ddb-9ac4-e3cfb6b9cd44 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:22.110305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0a31d00c-7b10-4ddb-9ac4-e3cfb6b9cd44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:22.128498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6328e575-b9af-4990-a52d-b27dbafdef68 None None] MFA Rules not processed for user `46400570e35841af88803dc0d527afbe`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:22.130661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6328e575-b9af-4990-a52d-b27dbafdef68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:22.149959 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2136/4277] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:22 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:22.151520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328e575-b9af-4990-a52d-b27dbafdef68 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:22.190363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328e575-b9af-4990-a52d-b27dbafdef68 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:22.210407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9cace-7046-45c0-86f6-0f738ab4c34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:22.211266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9cace-7046-45c0-86f6-0f738ab4c34a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:22.211718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9cace-7046-45c0-86f6-0f738ab4c34a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:22.212098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9cace-7046-45c0-86f6-0f738ab4c34a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:22.214158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9cace-7046-45c0-86f6-0f738ab4c34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:22.217864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9cace-7046-45c0-86f6-0f738ab4c34a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:22.250859 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2137/4278] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:22.252106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9cace-7046-45c0-86f6-0f738ab4c34a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:22.278892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9cace-7046-45c0-86f6-0f738ab4c34a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:22.298626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0f4ee-29be-409e-b996-e47cdd1adcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:22.299328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0f4ee-29be-409e-b996-e47cdd1adcd1 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:22.299646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0f4ee-29be-409e-b996-e47cdd1adcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:22.300437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0f4ee-29be-409e-b996-e47cdd1adcd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:22.301222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0f4ee-29be-409e-b996-e47cdd1adcd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:22.302984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0f4ee-29be-409e-b996-e47cdd1adcd1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:22.333091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31d00c-7b10-4ddb-9ac4-e3cfb6b9cd44 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:22.341007 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2138/4279] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:22.342012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0f4ee-29be-409e-b996-e47cdd1adcd1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:22.349294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792365b-9f85-45d3-a644-99e9a69ff003 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:22.352737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792365b-9f85-45d3-a644-99e9a69ff003 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:22.352737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792365b-9f85-45d3-a644-99e9a69ff003 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:22.352737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792365b-9f85-45d3-a644-99e9a69ff003 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:22.368616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0f4ee-29be-409e-b996-e47cdd1adcd1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:22.401767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309707d-7f4f-42ad-bef3-d176e5edf338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:22.402694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309707d-7f4f-42ad-bef3-d176e5edf338 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:22.402978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309707d-7f4f-42ad-bef3-d176e5edf338 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:22.403256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309707d-7f4f-42ad-bef3-d176e5edf338 admin admin] PATH_INFO: `/v3/projects/f80150bd642142428d02edc12b8f5f01/users/ca9888965cf94163bd0c9cdb5cc4a363/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:22.409013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792365b-9f85-45d3-a644-99e9a69ff003 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:22.410825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792365b-9f85-45d3-a644-99e9a69ff003 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:22.452291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309707d-7f4f-42ad-bef3-d176e5edf338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f80150bd642142428d02edc12b8f5f01, user_id=ca9888965cf94163bd0c9cdb5cc4a363, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:22.456520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309707d-7f4f-42ad-bef3-d176e5edf338 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:22.464941 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2142/4280] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:32:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:32:22.558621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9750fa1-4e97-4156-bbc0-a1a9825640e4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:22.558918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9750fa1-4e97-4156-bbc0-a1a9825640e4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:22.559207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9750fa1-4e97-4156-bbc0-a1a9825640e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:22.560790 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2139/4281] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:32:22 2022] PUT /identity/v3/projects/f80150bd642142428d02edc12b8f5f01/users/ca9888965cf94163bd0c9cdb5cc4a363/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:22.639438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f9750fa1-4e97-4156-bbc0-a1a9825640e4 None None] MFA Rules not processed for user `ca9888965cf94163bd0c9cdb5cc4a363`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:22.641434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f9750fa1-4e97-4156-bbc0-a1a9825640e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:22.769741 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2143/4282] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:22.775313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309707d-7f4f-42ad-bef3-d176e5edf338 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:22.922379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309707d-7f4f-42ad-bef3-d176e5edf338 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:22.935570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c92245-a290-432f-9fbe-e9b98f940e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:22.936264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c92245-a290-432f-9fbe-e9b98f940e9b admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:22.936552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c92245-a290-432f-9fbe-e9b98f940e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:22.939796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c92245-a290-432f-9fbe-e9b98f940e9b admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:22.940552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c92245-a290-432f-9fbe-e9b98f940e9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:22.947583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c92245-a290-432f-9fbe-e9b98f940e9b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:23.049138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9750fa1-4e97-4156-bbc0-a1a9825640e4 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:23.051334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f9750fa1-4e97-4156-bbc0-a1a9825640e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:23.138072 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2140/4283] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:32:22 2022] POST /identity/v3/projects => generated 379 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:32:23.142134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c92245-a290-432f-9fbe-e9b98f940e9b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:23.270718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c92245-a290-432f-9fbe-e9b98f940e9b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:23.284418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e07a87-193a-4256-9d8e-6a8042d99b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:23.285342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e07a87-193a-4256-9d8e-6a8042d99b9f admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:23.285748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e07a87-193a-4256-9d8e-6a8042d99b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:23.286140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e07a87-193a-4256-9d8e-6a8042d99b9f admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:23.287023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e07a87-193a-4256-9d8e-6a8042d99b9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:23.290834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e07a87-193a-4256-9d8e-6a8042d99b9f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:23.321191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9750fa1-4e97-4156-bbc0-a1a9825640e4 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:23.399160 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2141/4284] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:32:23 2022] POST /identity/v3/users => generated 290 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:32:23.403627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e07a87-193a-4256-9d8e-6a8042d99b9f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:23.429678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e07a87-193a-4256-9d8e-6a8042d99b9f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:23.439343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493e09b-589d-4a59-b864-119ede21b8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:23.441218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493e09b-589d-4a59-b864-119ede21b8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:23.441753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493e09b-589d-4a59-b864-119ede21b8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:23.442264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493e09b-589d-4a59-b864-119ede21b8c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:23.445581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493e09b-589d-4a59-b864-119ede21b8c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:23.447714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493e09b-589d-4a59-b864-119ede21b8c9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:23.477732 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2142/4285] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:23.483532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493e09b-589d-4a59-b864-119ede21b8c9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:23.508654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493e09b-589d-4a59-b864-119ede21b8c9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:23.511215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51479b-9d11-4c35-97ef-daa879210f6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:23.511892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51479b-9d11-4c35-97ef-daa879210f6a service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:23.512177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51479b-9d11-4c35-97ef-daa879210f6a service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:23.512453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51479b-9d11-4c35-97ef-daa879210f6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:23.522771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cb421-d49d-4c31-a056-63aa9324cb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:23.525021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cb421-d49d-4c31-a056-63aa9324cb8e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:23.525496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cb421-d49d-4c31-a056-63aa9324cb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:23.530438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cb421-d49d-4c31-a056-63aa9324cb8e admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:23.535235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cb421-d49d-4c31-a056-63aa9324cb8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:23.535235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cb421-d49d-4c31-a056-63aa9324cb8e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:23.559814 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2143/4286] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:23.563964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cb421-d49d-4c31-a056-63aa9324cb8e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:23.586559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cb421-d49d-4c31-a056-63aa9324cb8e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:23.597975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4169b5-8bed-40d4-a1c6-c77cd8efd5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:23.599189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4169b5-8bed-40d4-a1c6-c77cd8efd5d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:23.600580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4169b5-8bed-40d4-a1c6-c77cd8efd5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:23.601032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4169b5-8bed-40d4-a1c6-c77cd8efd5d9 admin admin] PATH_INFO: `/v3/projects/b22a071dc0cb41e6ad969c33911df1f0/users/bf2e1464ad31428ea4b5977f12f764f9/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:23.634832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4169b5-8bed-40d4-a1c6-c77cd8efd5d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b22a071dc0cb41e6ad969c33911df1f0, user_id=bf2e1464ad31428ea4b5977f12f764f9, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:23.642312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4169b5-8bed-40d4-a1c6-c77cd8efd5d9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:23.664456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51479b-9d11-4c35-97ef-daa879210f6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:23.664456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51479b-9d11-4c35-97ef-daa879210f6a service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:23.687249 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2144/4287] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:32:23 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:32:23.702581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcaf566-18fe-4053-b10e-ede8f7c8a55b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:23.702869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcaf566-18fe-4053-b10e-ede8f7c8a55b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:23.703153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcaf566-18fe-4053-b10e-ede8f7c8a55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:23.734388 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2144/4288] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:32:23 2022] PUT /identity/v3/projects/b22a071dc0cb41e6ad969c33911df1f0/users/bf2e1464ad31428ea4b5977f12f764f9/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:32:23.749929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731e96-698d-46b6-a005-f7637ac781ca None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:23.750485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731e96-698d-46b6-a005-f7637ac781ca None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:23.750916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da731e96-698d-46b6-a005-f7637ac781ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:23.765209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2dcaf566-18fe-4053-b10e-ede8f7c8a55b None None] MFA Rules not processed for user `bb79a0a1ee5a429c9df27db4f671f0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:23.766440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2dcaf566-18fe-4053-b10e-ede8f7c8a55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:23.805996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-da731e96-698d-46b6-a005-f7637ac781ca None None] MFA Rules not processed for user `bf2e1464ad31428ea4b5977f12f764f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:23.806441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-da731e96-698d-46b6-a005-f7637ac781ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:23.851883 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2145/4289] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:23.918363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcaf566-18fe-4053-b10e-ede8f7c8a55b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:23.920416 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2145/4290] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:24.074335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcaf566-18fe-4053-b10e-ede8f7c8a55b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:24.086082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b136e97-08b8-45fe-94df-752cdb8c2c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:24.086775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b136e97-08b8-45fe-94df-752cdb8c2c8e admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:24.087058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b136e97-08b8-45fe-94df-752cdb8c2c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:24.087333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b136e97-08b8-45fe-94df-752cdb8c2c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:24.088029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b136e97-08b8-45fe-94df-752cdb8c2c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:24.097257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b136e97-08b8-45fe-94df-752cdb8c2c8e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:24.231795 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2146/4291] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:32:23 2022] POST /identity/v3/projects => generated 379 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:32:24.233843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da731e96-698d-46b6-a005-f7637ac781ca None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:24.261116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da731e96-698d-46b6-a005-f7637ac781ca None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:24.411122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c6684-d28e-41c4-8ba5-ebcf126fa89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:24.411917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c6684-d28e-41c4-8ba5-ebcf126fa89b admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:24.412197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c6684-d28e-41c4-8ba5-ebcf126fa89b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:24.412472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c6684-d28e-41c4-8ba5-ebcf126fa89b admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:24.413257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c6684-d28e-41c4-8ba5-ebcf126fa89b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:24.415219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c6684-d28e-41c4-8ba5-ebcf126fa89b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:24.553844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b136e97-08b8-45fe-94df-752cdb8c2c8e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:24.559167 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2146/4292] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:32:24 2022] POST /identity/v3/users => generated 296 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:32:24.582931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b136e97-08b8-45fe-94df-752cdb8c2c8e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:24.601419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698a076-722e-499c-b5d2-279e887961dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:24.602436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698a076-722e-499c-b5d2-279e887961dd admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:24.602909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698a076-722e-499c-b5d2-279e887961dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:24.603377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698a076-722e-499c-b5d2-279e887961dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:24.607481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698a076-722e-499c-b5d2-279e887961dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:24.613048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698a076-722e-499c-b5d2-279e887961dd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:24.643593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c6684-d28e-41c4-8ba5-ebcf126fa89b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:24.643882 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2147/4293] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:24.658033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c6684-d28e-41c4-8ba5-ebcf126fa89b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:24.673319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496bdf7-cec7-4642-b880-135d56eb8271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:24.675321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496bdf7-cec7-4642-b880-135d56eb8271 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:24.680707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496bdf7-cec7-4642-b880-135d56eb8271 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:24.681426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496bdf7-cec7-4642-b880-135d56eb8271 admin admin] PATH_INFO: `/v3/projects/82f5f109b6d14ba9b81003b66a5df961/users/7752420014684b558e92d7acb9793389/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:24.723865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496bdf7-cec7-4642-b880-135d56eb8271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82f5f109b6d14ba9b81003b66a5df961, user_id=7752420014684b558e92d7acb9793389, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:24.732407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496bdf7-cec7-4642-b880-135d56eb8271 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:24.796181 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2147/4294] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:32:24 2022] PUT /identity/v3/projects/82f5f109b6d14ba9b81003b66a5df961/users/7752420014684b558e92d7acb9793389/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:32:24.800466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698a076-722e-499c-b5d2-279e887961dd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:24.817036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698a076-722e-499c-b5d2-279e887961dd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:24.981262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5596010-a354-4eb9-b07d-51438a044e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:24.983416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5596010-a354-4eb9-b07d-51438a044e71 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:24.983792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5596010-a354-4eb9-b07d-51438a044e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:24.984152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5596010-a354-4eb9-b07d-51438a044e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:24.986288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5596010-a354-4eb9-b07d-51438a044e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:24.988018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5596010-a354-4eb9-b07d-51438a044e71 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:25.017094 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2148/4295] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:25.020449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496bdf7-cec7-4642-b880-135d56eb8271 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:25.047404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496bdf7-cec7-4642-b880-135d56eb8271 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:25.065620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f6db2-a4c6-4211-89a7-ae3af55fc2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:25.067271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f6db2-a4c6-4211-89a7-ae3af55fc2cb admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:25.067673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f6db2-a4c6-4211-89a7-ae3af55fc2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:25.068152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f6db2-a4c6-4211-89a7-ae3af55fc2cb admin admin] PATH_INFO: `/v3/projects/82f5f109b6d14ba9b81003b66a5df961/users/7752420014684b558e92d7acb9793389/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:25.071053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f6db2-a4c6-4211-89a7-ae3af55fc2cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=82f5f109b6d14ba9b81003b66a5df961, user_id=7752420014684b558e92d7acb9793389, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:25.076726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f6db2-a4c6-4211-89a7-ae3af55fc2cb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:25.093360 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2148/4296] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:32:25 2022] PUT /identity/v3/projects/82f5f109b6d14ba9b81003b66a5df961/users/7752420014684b558e92d7acb9793389/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:25.104903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57558092-ecc2-4273-8100-b56a28e42b21 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:25.104903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57558092-ecc2-4273-8100-b56a28e42b21 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:25.106360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57558092-ecc2-4273-8100-b56a28e42b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:25.185526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-57558092-ecc2-4273-8100-b56a28e42b21 None None] MFA Rules not processed for user `7752420014684b558e92d7acb9793389`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:25.188211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-57558092-ecc2-4273-8100-b56a28e42b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:25.372374 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2149/4297] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:25.388317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f6db2-a4c6-4211-89a7-ae3af55fc2cb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:25.391063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d94f6db2-a4c6-4211-89a7-ae3af55fc2cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:25.446731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57558092-ecc2-4273-8100-b56a28e42b21 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:25.448882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-57558092-ecc2-4273-8100-b56a28e42b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:25.608838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f6db2-a4c6-4211-89a7-ae3af55fc2cb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:25.618195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8646d9-4365-47ff-8534-087642bc46a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:25.618913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8646d9-4365-47ff-8534-087642bc46a1 service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:25.619200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8646d9-4365-47ff-8534-087642bc46a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:25.620368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8646d9-4365-47ff-8534-087642bc46a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:25.680934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8646d9-4365-47ff-8534-087642bc46a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:25.686790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8646d9-4365-47ff-8534-087642bc46a1 service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:25.711425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57558092-ecc2-4273-8100-b56a28e42b21 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:25.730551 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2149/4298] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:32:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:32:25.733621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df57e0-7210-4e16-a5c0-2703eb11d211 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:25.735509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df57e0-7210-4e16-a5c0-2703eb11d211 service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:25.735795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df57e0-7210-4e16-a5c0-2703eb11d211 service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:25.736093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df57e0-7210-4e16-a5c0-2703eb11d211 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:25.743874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a7df57e0-7210-4e16-a5c0-2703eb11d211 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:25.789269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df57e0-7210-4e16-a5c0-2703eb11d211 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:25.798249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df57e0-7210-4e16-a5c0-2703eb11d211 service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:25.844870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8646d9-4365-47ff-8534-087642bc46a1 service cinder] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:25.846326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bf8646d9-4365-47ff-8534-087642bc46a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:25.847465 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2150/4299] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:32:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:32:25.865744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8646d9-4365-47ff-8534-087642bc46a1 service cinder] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:25.876299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531037f-6638-486c-98b7-6bffb544b6f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:25.877302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531037f-6638-486c-98b7-6bffb544b6f4 service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:25.877763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531037f-6638-486c-98b7-6bffb544b6f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:25.880264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531037f-6638-486c-98b7-6bffb544b6f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:26.017573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531037f-6638-486c-98b7-6bffb544b6f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:26.019036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531037f-6638-486c-98b7-6bffb544b6f4 service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:26.037896 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2150/4300] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:32:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:32:26.719640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086bd26-3473-4d71-a456-5ffd866cd818 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:26.720581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086bd26-3473-4d71-a456-5ffd866cd818 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:26.721072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086bd26-3473-4d71-a456-5ffd866cd818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:26.764977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d086bd26-3473-4d71-a456-5ffd866cd818 None None] MFA Rules not processed for user `bb79a0a1ee5a429c9df27db4f671f0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:26.766393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d086bd26-3473-4d71-a456-5ffd866cd818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:26.820504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531037f-6638-486c-98b7-6bffb544b6f4 service cinder] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:26.847577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531037f-6638-486c-98b7-6bffb544b6f4 service cinder] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:26.862135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf946e63-6b8e-4548-b60a-dbf5777194de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:26.863066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf946e63-6b8e-4548-b60a-dbf5777194de service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:26.863505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf946e63-6b8e-4548-b60a-dbf5777194de service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:26.864432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf946e63-6b8e-4548-b60a-dbf5777194de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:26.871350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bf946e63-6b8e-4548-b60a-dbf5777194de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:26.905375 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2151/4301] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:26.910615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf946e63-6b8e-4548-b60a-dbf5777194de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:26.912301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf946e63-6b8e-4548-b60a-dbf5777194de service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:26.961467 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2151/4302] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:32:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:32:27.414137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3b477-4fa8-40b3-9c53-94797553077c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:27.415506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3b477-4fa8-40b3-9c53-94797553077c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:27.416042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3b477-4fa8-40b3-9c53-94797553077c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:27.446150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6de3b477-4fa8-40b3-9c53-94797553077c None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:27.446150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6de3b477-4fa8-40b3-9c53-94797553077c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:27.580939 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2152/4303] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:32:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:27.601106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf946e63-6b8e-4548-b60a-dbf5777194de service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:27.602673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bf946e63-6b8e-4548-b60a-dbf5777194de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:27.765504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf946e63-6b8e-4548-b60a-dbf5777194de service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:27.774903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c5aad-28ef-42be-976f-599f8d3e7043 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:27.776166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c5aad-28ef-42be-976f-599f8d3e7043 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:27.776580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c5aad-28ef-42be-976f-599f8d3e7043 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:27.777010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c5aad-28ef-42be-976f-599f8d3e7043 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:27.796347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c5aad-28ef-42be-976f-599f8d3e7043 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:27.798052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c5aad-28ef-42be-976f-599f8d3e7043 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:27.814923 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2152/4304] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:32:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:32:28.028913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e6c37-32de-4149-a04c-5e4dace6ae54 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:28.029403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e6c37-32de-4149-a04c-5e4dace6ae54 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:28.029498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e6c37-32de-4149-a04c-5e4dace6ae54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:28.048325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-526e6c37-32de-4149-a04c-5e4dace6ae54 None None] MFA Rules not processed for user `bb79a0a1ee5a429c9df27db4f671f0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:28.049590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-526e6c37-32de-4149-a04c-5e4dace6ae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:28.056853 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2153/4305] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:29.622333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c0ca7-9f07-4cf8-9659-6e7c995ed761 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:29.622914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c0ca7-9f07-4cf8-9659-6e7c995ed761 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:29.623105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c0ca7-9f07-4cf8-9659-6e7c995ed761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:29.664901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c01c0ca7-9f07-4cf8-9659-6e7c995ed761 None None] MFA Rules not processed for user `bb79a0a1ee5a429c9df27db4f671f0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:29.674689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c01c0ca7-9f07-4cf8-9659-6e7c995ed761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:29.681290 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2153/4306] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:30.990683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e6359-aecc-423f-86a5-b63fa46f3c22 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:30.991256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e6359-aecc-423f-86a5-b63fa46f3c22 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:30.991256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e6359-aecc-423f-86a5-b63fa46f3c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:31.013047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-640e6359-aecc-423f-86a5-b63fa46f3c22 None None] MFA Rules not processed for user `bb79a0a1ee5a429c9df27db4f671f0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:31.014537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-640e6359-aecc-423f-86a5-b63fa46f3c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:31.025624 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2154/4307] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:32.256626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4de9a-d97b-4e17-a87d-199765b8482a None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:32.257716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4de9a-d97b-4e17-a87d-199765b8482a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:32.257716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4de9a-d97b-4e17-a87d-199765b8482a None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:32.259154 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2154/4308] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:32:32.273298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd140a-4cdc-45ca-9b23-6e7636000bc5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:32.273881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd140a-4cdc-45ca-9b23-6e7636000bc5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:32.274165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd140a-4cdc-45ca-9b23-6e7636000bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:32.307714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d1bd140a-4cdc-45ca-9b23-6e7636000bc5 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:32.309679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d1bd140a-4cdc-45ca-9b23-6e7636000bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:32.322309 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2155/4309] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:32:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:32.351154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4de9a-d97b-4e17-a87d-199765b8482a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:32.353214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-54e4de9a-d97b-4e17-a87d-199765b8482a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:32.380282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4de9a-d97b-4e17-a87d-199765b8482a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:32.387443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54ea6c-cee7-4c69-b2a3-e0e8e4310b08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:32.388478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54ea6c-cee7-4c69-b2a3-e0e8e4310b08 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:32.388960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54ea6c-cee7-4c69-b2a3-e0e8e4310b08 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:32.389415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54ea6c-cee7-4c69-b2a3-e0e8e4310b08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:32.403099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54ea6c-cee7-4c69-b2a3-e0e8e4310b08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:32.406821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54ea6c-cee7-4c69-b2a3-e0e8e4310b08 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:32.434853 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2155/4310] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:32:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:32:33.344754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15229c-b4ac-4364-a13b-23a45f1124d4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:33.345331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15229c-b4ac-4364-a13b-23a45f1124d4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:33.345331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15229c-b4ac-4364-a13b-23a45f1124d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:33.374717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-fe15229c-b4ac-4364-a13b-23a45f1124d4 None None] MFA Rules not processed for user `bb79a0a1ee5a429c9df27db4f671f0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:33.376194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fe15229c-b4ac-4364-a13b-23a45f1124d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:33.395856 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2156/4311] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:33.501855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0c3f5-918f-4530-bf73-a47242f8aee5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:33.502428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0c3f5-918f-4530-bf73-a47242f8aee5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:33.502428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0c3f5-918f-4530-bf73-a47242f8aee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:33.574285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-53f0c3f5-918f-4530-bf73-a47242f8aee5 None None] MFA Rules not processed for user `e3d3dea2740e4e46ae98265dcade1291`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:33.574285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-53f0c3f5-918f-4530-bf73-a47242f8aee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:33.681371 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2156/4312] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:35.000801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24782c-9116-43ad-b4f9-125923e8eaf4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:35.001626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24782c-9116-43ad-b4f9-125923e8eaf4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:35.002059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24782c-9116-43ad-b4f9-125923e8eaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:35.057542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9f24782c-9116-43ad-b4f9-125923e8eaf4 None None] MFA Rules not processed for user `bb79a0a1ee5a429c9df27db4f671f0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:35.062513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9f24782c-9116-43ad-b4f9-125923e8eaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:35.096703 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2157/4313] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:35.332766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0c3f5-918f-4530-bf73-a47242f8aee5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:35.464655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0c3f5-918f-4530-bf73-a47242f8aee5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:35.478372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab28fb5-ec8b-4379-a6f4-70820ca01cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:35.481823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab28fb5-ec8b-4379-a6f4-70820ca01cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:35.481823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab28fb5-ec8b-4379-a6f4-70820ca01cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:35.481823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab28fb5-ec8b-4379-a6f4-70820ca01cfc admin admin] PATH_INFO: `/v3/users/ca9888965cf94163bd0c9cdb5cc4a363` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:35.483285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab28fb5-ec8b-4379-a6f4-70820ca01cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca9888965cf94163bd0c9cdb5cc4a363)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:35.485739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab28fb5-ec8b-4379-a6f4-70820ca01cfc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:35.839368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1ab28fb5-ec8b-4379-a6f4-70820ca01cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca9888965cf94163bd0c9cdb5cc4a363'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:35.862250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1ab28fb5-ec8b-4379-a6f4-70820ca01cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca9888965cf94163bd0c9cdb5cc4a363'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:35.863450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1ab28fb5-ec8b-4379-a6f4-70820ca01cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca9888965cf94163bd0c9cdb5cc4a363'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:35.872992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1ab28fb5-ec8b-4379-a6f4-70820ca01cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca9888965cf94163bd0c9cdb5cc4a363'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:35.972859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1ab28fb5-ec8b-4379-a6f4-70820ca01cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca9888965cf94163bd0c9cdb5cc4a363'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:35.990153 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2157/4314] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:32:35 2022] DELETE /identity/v3/users/ca9888965cf94163bd0c9cdb5cc4a363 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:35.994408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd063bce-d617-452a-b349-401782e5da9c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:35.994699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd063bce-d617-452a-b349-401782e5da9c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:35.999660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd063bce-d617-452a-b349-401782e5da9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:36.047461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-dd063bce-d617-452a-b349-401782e5da9c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:36.049856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-dd063bce-d617-452a-b349-401782e5da9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:36.187570 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2158/4315] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:36.254570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab28fb5-ec8b-4379-a6f4-70820ca01cfc admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:36.256866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1ab28fb5-ec8b-4379-a6f4-70820ca01cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:36.391813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab28fb5-ec8b-4379-a6f4-70820ca01cfc admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:36.405772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1249d6-830f-4f19-a29e-440eacac9619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:36.406745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1249d6-830f-4f19-a29e-440eacac9619 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:36.407034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1249d6-830f-4f19-a29e-440eacac9619 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:36.407365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1249d6-830f-4f19-a29e-440eacac9619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:36.433280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1249d6-830f-4f19-a29e-440eacac9619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:36.440982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1249d6-830f-4f19-a29e-440eacac9619 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:36.465607 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2158/4316] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:32:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:32:37.105887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb5dfc-924e-4f1b-9253-38627c27321f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:37.108102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb5dfc-924e-4f1b-9253-38627c27321f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:37.108102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb5dfc-924e-4f1b-9253-38627c27321f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:37.133059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f7bb5dfc-924e-4f1b-9253-38627c27321f None None] MFA Rules not processed for user `bb79a0a1ee5a429c9df27db4f671f0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:37.136910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f7bb5dfc-924e-4f1b-9253-38627c27321f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:37.217607 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2159/4317] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:37.638237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1249d6-830f-4f19-a29e-440eacac9619 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:37.639794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ac1249d6-830f-4f19-a29e-440eacac9619 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:37.658301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1249d6-830f-4f19-a29e-440eacac9619 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:37.666774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41a003-7e7e-4b69-bd1c-29f012545d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:37.669074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41a003-7e7e-4b69-bd1c-29f012545d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:37.669543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41a003-7e7e-4b69-bd1c-29f012545d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:37.669830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41a003-7e7e-4b69-bd1c-29f012545d13 admin admin] PATH_INFO: `/v3/users/4368e1c27d6941b09dacd4591bcbecbb` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:37.671733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41a003-7e7e-4b69-bd1c-29f012545d13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4368e1c27d6941b09dacd4591bcbecbb)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:37.674542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41a003-7e7e-4b69-bd1c-29f012545d13 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:37.942615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f41a003-7e7e-4b69-bd1c-29f012545d13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4368e1c27d6941b09dacd4591bcbecbb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:37.959835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f41a003-7e7e-4b69-bd1c-29f012545d13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4368e1c27d6941b09dacd4591bcbecbb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:37.960974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f41a003-7e7e-4b69-bd1c-29f012545d13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4368e1c27d6941b09dacd4591bcbecbb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:37.973702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f41a003-7e7e-4b69-bd1c-29f012545d13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4368e1c27d6941b09dacd4591bcbecbb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:38.089919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f41a003-7e7e-4b69-bd1c-29f012545d13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4368e1c27d6941b09dacd4591bcbecbb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:38.108210 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2159/4318] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:32:37 2022] DELETE /identity/v3/users/4368e1c27d6941b09dacd4591bcbecbb => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:38.142589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb5dfc-924e-4f1b-9253-38627c27321f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:38.144080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f7bb5dfc-924e-4f1b-9253-38627c27321f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:38.165076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb5dfc-924e-4f1b-9253-38627c27321f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:38.272124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3eddcf-b5f1-4c86-aca2-2b03fcd21c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:38.273091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3eddcf-b5f1-4c86-aca2-2b03fcd21c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:38.273328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3eddcf-b5f1-4c86-aca2-2b03fcd21c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:38.273760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3eddcf-b5f1-4c86-aca2-2b03fcd21c60 admin admin] PATH_INFO: `/v3/projects/f80150bd642142428d02edc12b8f5f01` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:38.277255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3eddcf-b5f1-4c86-aca2-2b03fcd21c60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f80150bd642142428d02edc12b8f5f01)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:38.279213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3eddcf-b5f1-4c86-aca2-2b03fcd21c60 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:38.439339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ac3eddcf-b5f1-4c86-aca2-2b03fcd21c60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f80150bd642142428d02edc12b8f5f01', 'request_id': 'req-ac3eddcf-b5f1-4c86-aca2-2b03fcd21c60'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:38.447876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ac3eddcf-b5f1-4c86-aca2-2b03fcd21c60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f80150bd642142428d02edc12b8f5f01', 'request_id': 'req-ac3eddcf-b5f1-4c86-aca2-2b03fcd21c60'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:38.556152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ac3eddcf-b5f1-4c86-aca2-2b03fcd21c60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f80150bd642142428d02edc12b8f5f01', 'request_id': 'req-ac3eddcf-b5f1-4c86-aca2-2b03fcd21c60'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:38.583841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ac3eddcf-b5f1-4c86-aca2-2b03fcd21c60 admin admin] The token cache is being invalidate because project f80150bd642142428d02edc12b8f5f01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:32:38.584144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ac3eddcf-b5f1-4c86-aca2-2b03fcd21c60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:38.584951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ac3eddcf-b5f1-4c86-aca2-2b03fcd21c60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:38.586665 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2160/4319] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:32:38 2022] DELETE /identity/v3/projects/f80150bd642142428d02edc12b8f5f01 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:32:38.591374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41a003-7e7e-4b69-bd1c-29f012545d13 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:38.593867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2f41a003-7e7e-4b69-bd1c-29f012545d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:38.609482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41a003-7e7e-4b69-bd1c-29f012545d13 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:38.610568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3eddcf-b5f1-4c86-aca2-2b03fcd21c60 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:38.612503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ac3eddcf-b5f1-4c86-aca2-2b03fcd21c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:38.700006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aedd3f-34a7-4e4c-966d-30d274fac06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:38.701065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aedd3f-34a7-4e4c-966d-30d274fac06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:38.701350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aedd3f-34a7-4e4c-966d-30d274fac06e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:38.701787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aedd3f-34a7-4e4c-966d-30d274fac06e admin admin] PATH_INFO: `/v3/users/bf2e1464ad31428ea4b5977f12f764f9` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:38.703653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aedd3f-34a7-4e4c-966d-30d274fac06e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf2e1464ad31428ea4b5977f12f764f9)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:38.706065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aedd3f-34a7-4e4c-966d-30d274fac06e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:38.754499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3eddcf-b5f1-4c86-aca2-2b03fcd21c60 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:38.777138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f13885-0385-4623-84fe-0958bf9af041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:38.778136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f13885-0385-4623-84fe-0958bf9af041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:38.778498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f13885-0385-4623-84fe-0958bf9af041 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:38.778902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f13885-0385-4623-84fe-0958bf9af041 admin admin] PATH_INFO: `/v3/projects/938d7f7fb79f43809d28533c00fa1b06` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:38.784329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f13885-0385-4623-84fe-0958bf9af041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=938d7f7fb79f43809d28533c00fa1b06)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:38.803066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f13885-0385-4623-84fe-0958bf9af041 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:38.927185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-64aedd3f-34a7-4e4c-966d-30d274fac06e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf2e1464ad31428ea4b5977f12f764f9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:38.950045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-64aedd3f-34a7-4e4c-966d-30d274fac06e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf2e1464ad31428ea4b5977f12f764f9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:38.953357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-64aedd3f-34a7-4e4c-966d-30d274fac06e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf2e1464ad31428ea4b5977f12f764f9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:38.970992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-64aedd3f-34a7-4e4c-966d-30d274fac06e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf2e1464ad31428ea4b5977f12f764f9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:38.974889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e3f13885-0385-4623-84fe-0958bf9af041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '938d7f7fb79f43809d28533c00fa1b06', 'request_id': 'req-e3f13885-0385-4623-84fe-0958bf9af041'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:38.993682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e3f13885-0385-4623-84fe-0958bf9af041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '938d7f7fb79f43809d28533c00fa1b06', 'request_id': 'req-e3f13885-0385-4623-84fe-0958bf9af041'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:39.071624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-64aedd3f-34a7-4e4c-966d-30d274fac06e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf2e1464ad31428ea4b5977f12f764f9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:39.086462 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2160/4320] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:32:38 2022] DELETE /identity/v3/users/bf2e1464ad31428ea4b5977f12f764f9 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:39.135461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e3f13885-0385-4623-84fe-0958bf9af041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '938d7f7fb79f43809d28533c00fa1b06', 'request_id': 'req-e3f13885-0385-4623-84fe-0958bf9af041'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:39.155065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e3f13885-0385-4623-84fe-0958bf9af041 admin admin] The token cache is being invalidate because project 938d7f7fb79f43809d28533c00fa1b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:32:39.156356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e3f13885-0385-4623-84fe-0958bf9af041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:39.157672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e3f13885-0385-4623-84fe-0958bf9af041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:39.170017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf42011-bbbf-4898-8484-36d4fc8e970b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:39.172461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf42011-bbbf-4898-8484-36d4fc8e970b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:39.173411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf42011-bbbf-4898-8484-36d4fc8e970b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:39.184076 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2161/4321] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:32:38 2022] DELETE /identity/v3/projects/938d7f7fb79f43809d28533c00fa1b06 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:32:39.203429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3bf42011-bbbf-4898-8484-36d4fc8e970b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:39.204926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3bf42011-bbbf-4898-8484-36d4fc8e970b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:39.378879 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2161/4322] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:39.382623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a9cb9-5288-44f8-bbae-d12037ad5bc1 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:39.382925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a9cb9-5288-44f8-bbae-d12037ad5bc1 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:39.383214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a9cb9-5288-44f8-bbae-d12037ad5bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:39.452889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f40a9cb9-5288-44f8-bbae-d12037ad5bc1 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:39.454384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f40a9cb9-5288-44f8-bbae-d12037ad5bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:39.469268 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2162/4323] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:39.473396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf42011-bbbf-4898-8484-36d4fc8e970b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:39.486973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf42011-bbbf-4898-8484-36d4fc8e970b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:39.493251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7b7f3-0d4c-4fb7-b357-7d2e7bc52fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:39.494039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7b7f3-0d4c-4fb7-b357-7d2e7bc52fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:39.494377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7b7f3-0d4c-4fb7-b357-7d2e7bc52fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:39.494668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7b7f3-0d4c-4fb7-b357-7d2e7bc52fd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:39.495428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7b7f3-0d4c-4fb7-b357-7d2e7bc52fd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:32:39.495739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7b7f3-0d4c-4fb7-b357-7d2e7bc52fd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:39.497472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7b7f3-0d4c-4fb7-b357-7d2e7bc52fd7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:39.513413 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2162/4324] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:32:39.519112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a9cb9-5288-44f8-bbae-d12037ad5bc1 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:39.531112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a9cb9-5288-44f8-bbae-d12037ad5bc1 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:39.543553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c863039-66e7-4738-82dd-20d2da527f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:39.544831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c863039-66e7-4738-82dd-20d2da527f7c admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:39.545356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c863039-66e7-4738-82dd-20d2da527f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:39.545842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c863039-66e7-4738-82dd-20d2da527f7c admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:39.546780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c863039-66e7-4738-82dd-20d2da527f7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:39.549280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c863039-66e7-4738-82dd-20d2da527f7c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:39.641696 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2163/4325] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:32:39 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:32:39.641871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7b7f3-0d4c-4fb7-b357-7d2e7bc52fd7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:39.665536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7b7f3-0d4c-4fb7-b357-7d2e7bc52fd7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:39.744850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c863039-66e7-4738-82dd-20d2da527f7c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:39.747968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1c06f-005d-4bda-ba48-644128d898c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:39.750735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3c863039-66e7-4738-82dd-20d2da527f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:39.750858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1c06f-005d-4bda-ba48-644128d898c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:39.750858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1c06f-005d-4bda-ba48-644128d898c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:39.750858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1c06f-005d-4bda-ba48-644128d898c2 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:39.751423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1c06f-005d-4bda-ba48-644128d898c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:39.754187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1c06f-005d-4bda-ba48-644128d898c2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:39.776670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c863039-66e7-4738-82dd-20d2da527f7c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:39.785527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8694c-d6de-4285-a73e-d2f8c47c6b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:39.786699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8694c-d6de-4285-a73e-d2f8c47c6b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:39.787181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8694c-d6de-4285-a73e-d2f8c47c6b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:39.787607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8694c-d6de-4285-a73e-d2f8c47c6b43 admin admin] PATH_INFO: `/v3/projects/b22a071dc0cb41e6ad969c33911df1f0` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:39.789109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8694c-d6de-4285-a73e-d2f8c47c6b43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b22a071dc0cb41e6ad969c33911df1f0)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:39.792216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8694c-d6de-4285-a73e-d2f8c47c6b43 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:39.859955 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2163/4326] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:32:39 2022] POST /identity/v3/users => generated 288 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:32:39.861244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1c06f-005d-4bda-ba48-644128d898c2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:39.874747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1c06f-005d-4bda-ba48-644128d898c2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:39.883994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53b995-9ba9-4c0b-a7bc-fb3478d05fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:39.885535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53b995-9ba9-4c0b-a7bc-fb3478d05fac admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:39.886014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53b995-9ba9-4c0b-a7bc-fb3478d05fac admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:39.887144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53b995-9ba9-4c0b-a7bc-fb3478d05fac admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:39.888064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53b995-9ba9-4c0b-a7bc-fb3478d05fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:39.898190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53b995-9ba9-4c0b-a7bc-fb3478d05fac admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:39.911086 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2164/4327] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:39.912062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53b995-9ba9-4c0b-a7bc-fb3478d05fac admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:39.940649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53b995-9ba9-4c0b-a7bc-fb3478d05fac admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:39.973024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-48c8694c-d6de-4285-a73e-d2f8c47c6b43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b22a071dc0cb41e6ad969c33911df1f0', 'request_id': 'req-48c8694c-d6de-4285-a73e-d2f8c47c6b43'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:40.004021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-48c8694c-d6de-4285-a73e-d2f8c47c6b43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b22a071dc0cb41e6ad969c33911df1f0', 'request_id': 'req-48c8694c-d6de-4285-a73e-d2f8c47c6b43'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:40.034002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959cf29-772d-48bb-84b8-98617450b308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:40.034844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959cf29-772d-48bb-84b8-98617450b308 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:40.035141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959cf29-772d-48bb-84b8-98617450b308 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:40.035426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959cf29-772d-48bb-84b8-98617450b308 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:40.036791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959cf29-772d-48bb-84b8-98617450b308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:40.038410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959cf29-772d-48bb-84b8-98617450b308 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:40.055585 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2165/4328] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:40.059487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959cf29-772d-48bb-84b8-98617450b308 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:40.083373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959cf29-772d-48bb-84b8-98617450b308 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:40.089659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b47300-714e-4dba-b3d6-309d0cb44100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:40.090870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b47300-714e-4dba-b3d6-309d0cb44100 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:40.091323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b47300-714e-4dba-b3d6-309d0cb44100 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:40.092134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b47300-714e-4dba-b3d6-309d0cb44100 admin admin] PATH_INFO: `/v3/projects/4159f5ce4fb544c2bae494d5bcd6f3e0/users/c337647f0fa340949df8761bceb1bafc/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:40.098657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-48c8694c-d6de-4285-a73e-d2f8c47c6b43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b22a071dc0cb41e6ad969c33911df1f0', 'request_id': 'req-48c8694c-d6de-4285-a73e-d2f8c47c6b43'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:40.125858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-48c8694c-d6de-4285-a73e-d2f8c47c6b43 admin admin] The token cache is being invalidate because project b22a071dc0cb41e6ad969c33911df1f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:32:40.126239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-48c8694c-d6de-4285-a73e-d2f8c47c6b43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:40.128172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-48c8694c-d6de-4285-a73e-d2f8c47c6b43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:40.129017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b47300-714e-4dba-b3d6-309d0cb44100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4159f5ce4fb544c2bae494d5bcd6f3e0, user_id=c337647f0fa340949df8761bceb1bafc, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:40.129953 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2164/4329] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:32:39 2022] DELETE /identity/v3/projects/b22a071dc0cb41e6ad969c33911df1f0 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:40.133978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8694c-d6de-4285-a73e-d2f8c47c6b43 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:40.136109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-48c8694c-d6de-4285-a73e-d2f8c47c6b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:40.141756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b47300-714e-4dba-b3d6-309d0cb44100 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:40.160849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8694c-d6de-4285-a73e-d2f8c47c6b43 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:40.173799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a48a8-0896-412c-8cad-9570823893e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:40.174784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a48a8-0896-412c-8cad-9570823893e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:40.177302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a48a8-0896-412c-8cad-9570823893e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:40.180757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a48a8-0896-412c-8cad-9570823893e9 admin admin] PATH_INFO: `/v3/users/7752420014684b558e92d7acb9793389` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:40.180757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a48a8-0896-412c-8cad-9570823893e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7752420014684b558e92d7acb9793389)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:40.184446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a48a8-0896-412c-8cad-9570823893e9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:40.203520 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2166/4330] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:32:40 2022] PUT /identity/v3/projects/4159f5ce4fb544c2bae494d5bcd6f3e0/users/c337647f0fa340949df8761bceb1bafc/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:32:40.209137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15875eca-91ae-4cb7-afec-1d7286cc9f22 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:40.209505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15875eca-91ae-4cb7-afec-1d7286cc9f22 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:40.211756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15875eca-91ae-4cb7-afec-1d7286cc9f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:40.248303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-15875eca-91ae-4cb7-afec-1d7286cc9f22 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:40.250624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-15875eca-91ae-4cb7-afec-1d7286cc9f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:40.345287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-be4a48a8-0896-412c-8cad-9570823893e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7752420014684b558e92d7acb9793389'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:40.395270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-be4a48a8-0896-412c-8cad-9570823893e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7752420014684b558e92d7acb9793389'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:40.398601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-be4a48a8-0896-412c-8cad-9570823893e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7752420014684b558e92d7acb9793389'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:40.415512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-be4a48a8-0896-412c-8cad-9570823893e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7752420014684b558e92d7acb9793389'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:40.438277 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2167/4331] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:32:40.460017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15875eca-91ae-4cb7-afec-1d7286cc9f22 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:40.461595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-15875eca-91ae-4cb7-afec-1d7286cc9f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:40.488480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-be4a48a8-0896-412c-8cad-9570823893e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7752420014684b558e92d7acb9793389'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:40.495442 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2165/4332] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:32:40 2022] DELETE /identity/v3/users/7752420014684b558e92d7acb9793389 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:40.548620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15875eca-91ae-4cb7-afec-1d7286cc9f22 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:40.639973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f7b94-cfff-4b45-b5df-697ab2b2c221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:40.641013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f7b94-cfff-4b45-b5df-697ab2b2c221 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:40.641458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f7b94-cfff-4b45-b5df-697ab2b2c221 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:40.642016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f7b94-cfff-4b45-b5df-697ab2b2c221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:40.644840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-079f7b94-cfff-4b45-b5df-697ab2b2c221 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:40.733533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f7b94-cfff-4b45-b5df-697ab2b2c221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:40.736594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f7b94-cfff-4b45-b5df-697ab2b2c221 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:40.761917 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2168/4333] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:32:42.202944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a48a8-0896-412c-8cad-9570823893e9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:42.204501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-be4a48a8-0896-412c-8cad-9570823893e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:42.224336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a48a8-0896-412c-8cad-9570823893e9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:42.231003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77af86-9973-464b-b562-ea335c1ba993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:42.232187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77af86-9973-464b-b562-ea335c1ba993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:42.232672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77af86-9973-464b-b562-ea335c1ba993 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:42.233193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77af86-9973-464b-b562-ea335c1ba993 admin admin] PATH_INFO: `/v3/projects/82f5f109b6d14ba9b81003b66a5df961` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:42.234481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77af86-9973-464b-b562-ea335c1ba993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82f5f109b6d14ba9b81003b66a5df961)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:42.237267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77af86-9973-464b-b562-ea335c1ba993 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:42.394079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5c77af86-9973-464b-b562-ea335c1ba993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82f5f109b6d14ba9b81003b66a5df961', 'request_id': 'req-5c77af86-9973-464b-b562-ea335c1ba993'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:42.401992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5c77af86-9973-464b-b562-ea335c1ba993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82f5f109b6d14ba9b81003b66a5df961', 'request_id': 'req-5c77af86-9973-464b-b562-ea335c1ba993'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:42.487051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5c77af86-9973-464b-b562-ea335c1ba993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82f5f109b6d14ba9b81003b66a5df961', 'request_id': 'req-5c77af86-9973-464b-b562-ea335c1ba993'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:42.501317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5c77af86-9973-464b-b562-ea335c1ba993 admin admin] The token cache is being invalidate because project 82f5f109b6d14ba9b81003b66a5df961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:32:42.501610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5c77af86-9973-464b-b562-ea335c1ba993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:42.502915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5c77af86-9973-464b-b562-ea335c1ba993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:42.504534 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2166/4334] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:32:42 2022] DELETE /identity/v3/projects/82f5f109b6d14ba9b81003b66a5df961 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:42.511226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd95c90-34bf-4b8d-bd3c-25f57dfab324 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:42.512092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd95c90-34bf-4b8d-bd3c-25f57dfab324 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:42.512384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd95c90-34bf-4b8d-bd3c-25f57dfab324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:42.532337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ccd95c90-34bf-4b8d-bd3c-25f57dfab324 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:42.533878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ccd95c90-34bf-4b8d-bd3c-25f57dfab324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:42.602381 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2169/4335] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:42.612041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b953717-05e1-4940-a21f-af3e894790d4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:42.612683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b953717-05e1-4940-a21f-af3e894790d4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:42.613071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b953717-05e1-4940-a21f-af3e894790d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:42.635680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6b953717-05e1-4940-a21f-af3e894790d4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:42.637305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6b953717-05e1-4940-a21f-af3e894790d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:42.645899 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2167/4336] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:42.650153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd95c90-34bf-4b8d-bd3c-25f57dfab324 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:42.661282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd95c90-34bf-4b8d-bd3c-25f57dfab324 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:42.670258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f78f37-474d-4f05-861e-fda28b09d2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:42.670977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f78f37-474d-4f05-861e-fda28b09d2ad admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:42.671246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f78f37-474d-4f05-861e-fda28b09d2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:42.671713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f78f37-474d-4f05-861e-fda28b09d2ad admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:42.672466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f78f37-474d-4f05-861e-fda28b09d2ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:32:42.672868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f78f37-474d-4f05-861e-fda28b09d2ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:42.674527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f78f37-474d-4f05-861e-fda28b09d2ad admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:42.699667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b953717-05e1-4940-a21f-af3e894790d4 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:42.700037 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2170/4337] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:32:42.709196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b953717-05e1-4940-a21f-af3e894790d4 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:42.714059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80344624-bcad-48ec-87db-1e34933b3df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:42.714724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80344624-bcad-48ec-87db-1e34933b3df4 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:42.715015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80344624-bcad-48ec-87db-1e34933b3df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:42.715298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80344624-bcad-48ec-87db-1e34933b3df4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:42.715992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80344624-bcad-48ec-87db-1e34933b3df4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:42.718007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80344624-bcad-48ec-87db-1e34933b3df4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:42.821382 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2168/4338] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:32:42 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:32:42.826307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f78f37-474d-4f05-861e-fda28b09d2ad admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:42.840741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f78f37-474d-4f05-861e-fda28b09d2ad admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:42.906625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286c9f6-1279-4797-b26b-bd9dc3107be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:42.907551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286c9f6-1279-4797-b26b-bd9dc3107be9 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:42.908042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286c9f6-1279-4797-b26b-bd9dc3107be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:42.908417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286c9f6-1279-4797-b26b-bd9dc3107be9 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:42.909234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286c9f6-1279-4797-b26b-bd9dc3107be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:42.916276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286c9f6-1279-4797-b26b-bd9dc3107be9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:43.023712 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2171/4339] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:32:42 2022] POST /identity/v3/users => generated 294 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:32:43.026198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80344624-bcad-48ec-87db-1e34933b3df4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:43.037795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80344624-bcad-48ec-87db-1e34933b3df4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:43.043986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f33910-aab2-4c25-9263-ae98f4cdf4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:43.050850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f33910-aab2-4c25-9263-ae98f4cdf4cb admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:43.050850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f33910-aab2-4c25-9263-ae98f4cdf4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:43.050850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f33910-aab2-4c25-9263-ae98f4cdf4cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:43.050850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f33910-aab2-4c25-9263-ae98f4cdf4cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:43.050850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f33910-aab2-4c25-9263-ae98f4cdf4cb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:43.081314 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2169/4340] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:43.091799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286c9f6-1279-4797-b26b-bd9dc3107be9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:43.106269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286c9f6-1279-4797-b26b-bd9dc3107be9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:43.118252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adb69e-fead-4230-8990-16af9b7f970c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:43.120411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adb69e-fead-4230-8990-16af9b7f970c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:43.122037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adb69e-fead-4230-8990-16af9b7f970c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:43.124973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adb69e-fead-4230-8990-16af9b7f970c admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:43.124973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adb69e-fead-4230-8990-16af9b7f970c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:43.124973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adb69e-fead-4230-8990-16af9b7f970c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:43.135769 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2172/4341] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:43.139986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f33910-aab2-4c25-9263-ae98f4cdf4cb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:43.155050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f33910-aab2-4c25-9263-ae98f4cdf4cb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:43.166677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cab70-ad96-4dcf-b0d2-05f9be010336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:43.167885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cab70-ad96-4dcf-b0d2-05f9be010336 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:43.168175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cab70-ad96-4dcf-b0d2-05f9be010336 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:43.168457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cab70-ad96-4dcf-b0d2-05f9be010336 admin admin] PATH_INFO: `/v3/projects/a6273d621b8140ec8e28bf44bdcf3106/users/d2f9d3466ff14a3fa5942cb9488b125d/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:43.187472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cab70-ad96-4dcf-b0d2-05f9be010336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6273d621b8140ec8e28bf44bdcf3106, user_id=d2f9d3466ff14a3fa5942cb9488b125d, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:43.190214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cab70-ad96-4dcf-b0d2-05f9be010336 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:43.283247 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2170/4342] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:32:43 2022] PUT /identity/v3/projects/a6273d621b8140ec8e28bf44bdcf3106/users/d2f9d3466ff14a3fa5942cb9488b125d/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:43.295556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea29d5-7636-45b7-af65-c506f859b725 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:43.295853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea29d5-7636-45b7-af65-c506f859b725 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:43.296139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea29d5-7636-45b7-af65-c506f859b725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:43.355562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0fea29d5-7636-45b7-af65-c506f859b725 None None] MFA Rules not processed for user `d2f9d3466ff14a3fa5942cb9488b125d`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:43.356975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0fea29d5-7636-45b7-af65-c506f859b725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:43.446256 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2173/4343] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:43.450320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cab70-ad96-4dcf-b0d2-05f9be010336 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:43.547282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cab70-ad96-4dcf-b0d2-05f9be010336 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:43.564811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cfbc84-5465-47e6-8a45-c8bc2d581180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:43.566134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfbc84-5465-47e6-8a45-c8bc2d581180 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:43.566763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfbc84-5465-47e6-8a45-c8bc2d581180 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:43.567293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfbc84-5465-47e6-8a45-c8bc2d581180 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:43.568864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cfbc84-5465-47e6-8a45-c8bc2d581180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:43.571088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cfbc84-5465-47e6-8a45-c8bc2d581180 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:43.661358 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2171/4344] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:32:43 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:32:43.661749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea29d5-7636-45b7-af65-c506f859b725 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:43.679322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea29d5-7636-45b7-af65-c506f859b725 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:43.761313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd95cbc-8f99-48ac-a67e-9c96dcf13b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:43.762471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd95cbc-8f99-48ac-a67e-9c96dcf13b00 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:43.762757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd95cbc-8f99-48ac-a67e-9c96dcf13b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:43.763117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd95cbc-8f99-48ac-a67e-9c96dcf13b00 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:43.763829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd95cbc-8f99-48ac-a67e-9c96dcf13b00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:43.766202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd95cbc-8f99-48ac-a67e-9c96dcf13b00 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:43.865137 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2174/4345] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:32:43 2022] POST /identity/v3/users => generated 299 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:32:43.869188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cfbc84-5465-47e6-8a45-c8bc2d581180 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:43.880796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cfbc84-5465-47e6-8a45-c8bc2d581180 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:43.889070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa44f11-3ba6-4227-bef2-b8a1c846699b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:43.891135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa44f11-3ba6-4227-bef2-b8a1c846699b admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:43.891135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa44f11-3ba6-4227-bef2-b8a1c846699b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:43.891135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa44f11-3ba6-4227-bef2-b8a1c846699b admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:43.892439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa44f11-3ba6-4227-bef2-b8a1c846699b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:43.894495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa44f11-3ba6-4227-bef2-b8a1c846699b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:43.911954 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2172/4346] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:43.915863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd95cbc-8f99-48ac-a67e-9c96dcf13b00 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:43.930242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd95cbc-8f99-48ac-a67e-9c96dcf13b00 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:43.940054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f2abc-4bf7-4b12-a86a-418a20768a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:43.941672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f2abc-4bf7-4b12-a86a-418a20768a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:43.941972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f2abc-4bf7-4b12-a86a-418a20768a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:43.942315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f2abc-4bf7-4b12-a86a-418a20768a7d admin admin] PATH_INFO: `/v3/projects/4731696638e240a18d53e9dbaf405bde/users/e1161d74d8674c5e9512af565a948a1f/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:43.959657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f2abc-4bf7-4b12-a86a-418a20768a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4731696638e240a18d53e9dbaf405bde, user_id=e1161d74d8674c5e9512af565a948a1f, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:43.968172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f2abc-4bf7-4b12-a86a-418a20768a7d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:44.038443 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2175/4347] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:32:43 2022] PUT /identity/v3/projects/4731696638e240a18d53e9dbaf405bde/users/e1161d74d8674c5e9512af565a948a1f/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:44.043370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa44f11-3ba6-4227-bef2-b8a1c846699b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:44.067815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa44f11-3ba6-4227-bef2-b8a1c846699b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:44.217301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd40a81-01e8-4743-b6ae-fadfdd15e8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:44.218279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd40a81-01e8-4743-b6ae-fadfdd15e8cf admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:44.219274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd40a81-01e8-4743-b6ae-fadfdd15e8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:44.220699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd40a81-01e8-4743-b6ae-fadfdd15e8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:44.224064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd40a81-01e8-4743-b6ae-fadfdd15e8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:44.228268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd40a81-01e8-4743-b6ae-fadfdd15e8cf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:44.270708 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2173/4348] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:44.272619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f2abc-4bf7-4b12-a86a-418a20768a7d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:44.293591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f2abc-4bf7-4b12-a86a-418a20768a7d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:44.298587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89163e-c9ef-458f-8d84-a6776056f3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:44.299494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89163e-c9ef-458f-8d84-a6776056f3b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:44.299779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89163e-c9ef-458f-8d84-a6776056f3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:44.300059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89163e-c9ef-458f-8d84-a6776056f3b3 admin admin] PATH_INFO: `/v3/projects/4731696638e240a18d53e9dbaf405bde/users/e1161d74d8674c5e9512af565a948a1f/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:44.306934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89163e-c9ef-458f-8d84-a6776056f3b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4731696638e240a18d53e9dbaf405bde, user_id=e1161d74d8674c5e9512af565a948a1f, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:44.309803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89163e-c9ef-458f-8d84-a6776056f3b3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:44.323672 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2176/4349] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:32:44 2022] PUT /identity/v3/projects/4731696638e240a18d53e9dbaf405bde/users/e1161d74d8674c5e9512af565a948a1f/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:44.334134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a914163-645a-45dd-94bc-579e9692fc74 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:44.334714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a914163-645a-45dd-94bc-579e9692fc74 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:44.334714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a914163-645a-45dd-94bc-579e9692fc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:44.386730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5a914163-645a-45dd-94bc-579e9692fc74 None None] MFA Rules not processed for user `e1161d74d8674c5e9512af565a948a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:44.389497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5a914163-645a-45dd-94bc-579e9692fc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:44.495975 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2174/4350] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:44.509640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89163e-c9ef-458f-8d84-a6776056f3b3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:44.511439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-db89163e-c9ef-458f-8d84-a6776056f3b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:44.619276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89163e-c9ef-458f-8d84-a6776056f3b3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:44.623813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa59f69-67f1-45ba-b147-4e87e91911bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:44.624760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa59f69-67f1-45ba-b147-4e87e91911bd service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:44.628065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa59f69-67f1-45ba-b147-4e87e91911bd service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:44.628065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa59f69-67f1-45ba-b147-4e87e91911bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:44.663703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa59f69-67f1-45ba-b147-4e87e91911bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:44.663703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa59f69-67f1-45ba-b147-4e87e91911bd service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:44.688352 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2177/4351] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:32:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:32:45.203541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deafedf-1c72-44e0-934a-08f9209c48e8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:45.210793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deafedf-1c72-44e0-934a-08f9209c48e8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:45.210793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deafedf-1c72-44e0-934a-08f9209c48e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:45.251301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4deafedf-1c72-44e0-934a-08f9209c48e8 None None] MFA Rules not processed for user `bb79a0a1ee5a429c9df27db4f671f0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:45.257114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4deafedf-1c72-44e0-934a-08f9209c48e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:45.379214 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2175/4352] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:46.222024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa59f69-67f1-45ba-b147-4e87e91911bd service cinder] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:46.318391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa59f69-67f1-45ba-b147-4e87e91911bd service cinder] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:46.323759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d39f18-69b2-4905-bce8-dce01b27cc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:46.324955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d39f18-69b2-4905-bce8-dce01b27cc7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:46.325481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d39f18-69b2-4905-bce8-dce01b27cc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:46.325997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d39f18-69b2-4905-bce8-dce01b27cc7e admin admin] PATH_INFO: `/v3/users/d2f9d3466ff14a3fa5942cb9488b125d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:46.327793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d39f18-69b2-4905-bce8-dce01b27cc7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2f9d3466ff14a3fa5942cb9488b125d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:46.330286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d39f18-69b2-4905-bce8-dce01b27cc7e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:46.522189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75d39f18-69b2-4905-bce8-dce01b27cc7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2f9d3466ff14a3fa5942cb9488b125d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:46.547344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75d39f18-69b2-4905-bce8-dce01b27cc7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2f9d3466ff14a3fa5942cb9488b125d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:46.548100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75d39f18-69b2-4905-bce8-dce01b27cc7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2f9d3466ff14a3fa5942cb9488b125d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:46.557904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75d39f18-69b2-4905-bce8-dce01b27cc7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2f9d3466ff14a3fa5942cb9488b125d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:46.639159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75d39f18-69b2-4905-bce8-dce01b27cc7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2f9d3466ff14a3fa5942cb9488b125d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:46.651614 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2178/4353] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:32:46 2022] DELETE /identity/v3/users/d2f9d3466ff14a3fa5942cb9488b125d => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:32:46.656435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4fa59-49e9-4211-991f-5e3568cb4e7c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:46.657056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4fa59-49e9-4211-991f-5e3568cb4e7c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:46.657056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4fa59-49e9-4211-991f-5e3568cb4e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:46.680587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ccf4fa59-49e9-4211-991f-5e3568cb4e7c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:46.681910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ccf4fa59-49e9-4211-991f-5e3568cb4e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:46.773703 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2176/4354] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:46.805775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d39f18-69b2-4905-bce8-dce01b27cc7e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:46.809638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-75d39f18-69b2-4905-bce8-dce01b27cc7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:46.915333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d39f18-69b2-4905-bce8-dce01b27cc7e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:46.920138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ff8dd-a5aa-4c69-8268-998b368059b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:46.921384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ff8dd-a5aa-4c69-8268-998b368059b4 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:46.921831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ff8dd-a5aa-4c69-8268-998b368059b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:46.924168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ff8dd-a5aa-4c69-8268-998b368059b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:46.937277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ff8dd-a5aa-4c69-8268-998b368059b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:46.939205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ff8dd-a5aa-4c69-8268-998b368059b4 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:46.967348 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2179/4355] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:32:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:32:48.498649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e3578-1152-42c0-85da-ba4231f622a5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:48.498649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e3578-1152-42c0-85da-ba4231f622a5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:48.498649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e3578-1152-42c0-85da-ba4231f622a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:48.520049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9a3e3578-1152-42c0-85da-ba4231f622a5 None None] MFA Rules not processed for user `bb79a0a1ee5a429c9df27db4f671f0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:48.521835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9a3e3578-1152-42c0-85da-ba4231f622a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:48.604623 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2177/4356] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:48.621305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ff8dd-a5aa-4c69-8268-998b368059b4 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:48.622782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-368ff8dd-a5aa-4c69-8268-998b368059b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:48.648549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ff8dd-a5aa-4c69-8268-998b368059b4 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:48.659316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1366dac-0e48-4e24-9a64-b33561cef78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:48.665540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1366dac-0e48-4e24-9a64-b33561cef78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:48.665540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1366dac-0e48-4e24-9a64-b33561cef78e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:48.665540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1366dac-0e48-4e24-9a64-b33561cef78e admin admin] PATH_INFO: `/v3/projects/a6273d621b8140ec8e28bf44bdcf3106` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:48.665540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1366dac-0e48-4e24-9a64-b33561cef78e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6273d621b8140ec8e28bf44bdcf3106)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:48.666766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1366dac-0e48-4e24-9a64-b33561cef78e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:48.846962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c1366dac-0e48-4e24-9a64-b33561cef78e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6273d621b8140ec8e28bf44bdcf3106', 'request_id': 'req-c1366dac-0e48-4e24-9a64-b33561cef78e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:48.946408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c1366dac-0e48-4e24-9a64-b33561cef78e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6273d621b8140ec8e28bf44bdcf3106', 'request_id': 'req-c1366dac-0e48-4e24-9a64-b33561cef78e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:48.956925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c1366dac-0e48-4e24-9a64-b33561cef78e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6273d621b8140ec8e28bf44bdcf3106', 'request_id': 'req-c1366dac-0e48-4e24-9a64-b33561cef78e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:48.970187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c1366dac-0e48-4e24-9a64-b33561cef78e admin admin] The token cache is being invalidate because project a6273d621b8140ec8e28bf44bdcf3106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:32:48.970830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c1366dac-0e48-4e24-9a64-b33561cef78e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:48.971894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c1366dac-0e48-4e24-9a64-b33561cef78e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:48.974168 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2180/4357] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:32:48 2022] DELETE /identity/v3/projects/a6273d621b8140ec8e28bf44bdcf3106 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:48.983391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e3578-1152-42c0-85da-ba4231f622a5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:48.994331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e3578-1152-42c0-85da-ba4231f622a5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:49.098763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f091e2-aa32-4a06-a9c8-1cec52839b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:49.099761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f091e2-aa32-4a06-a9c8-1cec52839b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:49.100123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f091e2-aa32-4a06-a9c8-1cec52839b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:49.100415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f091e2-aa32-4a06-a9c8-1cec52839b97 admin admin] PATH_INFO: `/v3/users/e1161d74d8674c5e9512af565a948a1f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:49.106175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f091e2-aa32-4a06-a9c8-1cec52839b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1161d74d8674c5e9512af565a948a1f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:49.108242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f091e2-aa32-4a06-a9c8-1cec52839b97 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:49.286394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e3f091e2-aa32-4a06-a9c8-1cec52839b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1161d74d8674c5e9512af565a948a1f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:49.308489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e3f091e2-aa32-4a06-a9c8-1cec52839b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1161d74d8674c5e9512af565a948a1f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:49.309202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e3f091e2-aa32-4a06-a9c8-1cec52839b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1161d74d8674c5e9512af565a948a1f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:49.326460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e3f091e2-aa32-4a06-a9c8-1cec52839b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1161d74d8674c5e9512af565a948a1f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:49.402056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e3f091e2-aa32-4a06-a9c8-1cec52839b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1161d74d8674c5e9512af565a948a1f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:49.416682 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2178/4358] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:32:48 2022] DELETE /identity/v3/users/e1161d74d8674c5e9512af565a948a1f => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:50.742610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1366dac-0e48-4e24-9a64-b33561cef78e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:50.746725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c1366dac-0e48-4e24-9a64-b33561cef78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:50.766941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1366dac-0e48-4e24-9a64-b33561cef78e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:50.965688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a890574-b8ad-490b-bb1c-82946878d191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:50.967040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a890574-b8ad-490b-bb1c-82946878d191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:50.967570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a890574-b8ad-490b-bb1c-82946878d191 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:50.968532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a890574-b8ad-490b-bb1c-82946878d191 admin admin] PATH_INFO: `/v3/projects/4731696638e240a18d53e9dbaf405bde` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:50.970498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a890574-b8ad-490b-bb1c-82946878d191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4731696638e240a18d53e9dbaf405bde)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:50.975322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a890574-b8ad-490b-bb1c-82946878d191 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:51.161818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3a890574-b8ad-490b-bb1c-82946878d191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4731696638e240a18d53e9dbaf405bde', 'request_id': 'req-3a890574-b8ad-490b-bb1c-82946878d191'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:51.259090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3a890574-b8ad-490b-bb1c-82946878d191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4731696638e240a18d53e9dbaf405bde', 'request_id': 'req-3a890574-b8ad-490b-bb1c-82946878d191'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:51.265812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f091e2-aa32-4a06-a9c8-1cec52839b97 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:51.267511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e3f091e2-aa32-4a06-a9c8-1cec52839b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:51.287071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3a890574-b8ad-490b-bb1c-82946878d191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4731696638e240a18d53e9dbaf405bde', 'request_id': 'req-3a890574-b8ad-490b-bb1c-82946878d191'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:51.299269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f091e2-aa32-4a06-a9c8-1cec52839b97 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:51.313079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3a890574-b8ad-490b-bb1c-82946878d191 admin admin] The token cache is being invalidate because project 4731696638e240a18d53e9dbaf405bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:32:51.313502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3a890574-b8ad-490b-bb1c-82946878d191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:51.314855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3a890574-b8ad-490b-bb1c-82946878d191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:51.317890 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2181/4359] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:32:50 2022] DELETE /identity/v3/projects/4731696638e240a18d53e9dbaf405bde => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:51.325109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4653339-0f12-42e9-a936-e643f2195c5c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:51.325382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4653339-0f12-42e9-a936-e643f2195c5c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:51.325944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4653339-0f12-42e9-a936-e643f2195c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:51.419023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b4653339-0f12-42e9-a936-e643f2195c5c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:51.420270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b4653339-0f12-42e9-a936-e643f2195c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:51.506188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c72b64-6764-4912-826e-c738791741a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:51.514519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c72b64-6764-4912-826e-c738791741a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:51.515808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c72b64-6764-4912-826e-c738791741a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:51.516270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c72b64-6764-4912-826e-c738791741a0 admin admin] PATH_INFO: `/v3/users/d1f8df29b43a461d9c79b42858701437` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:51.517934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c72b64-6764-4912-826e-c738791741a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1f8df29b43a461d9c79b42858701437)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:51.520121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c72b64-6764-4912-826e-c738791741a0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:51.596329 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2182/4360] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:51.608020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac3dab-d213-4fbe-a268-9c9c8599c545 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:51.608565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac3dab-d213-4fbe-a268-9c9c8599c545 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:51.609147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac3dab-d213-4fbe-a268-9c9c8599c545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:51.651491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-87ac3dab-d213-4fbe-a268-9c9c8599c545 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:51.654626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-87ac3dab-d213-4fbe-a268-9c9c8599c545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:51.683285 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2183/4361] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:51.689205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac3dab-d213-4fbe-a268-9c9c8599c545 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:51.714079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac3dab-d213-4fbe-a268-9c9c8599c545 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:51.723237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3c72b64-6764-4912-826e-c738791741a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1f8df29b43a461d9c79b42858701437'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:51.742838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df6d36-f1f1-4841-8bf1-b06ccf78edf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:51.743601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df6d36-f1f1-4841-8bf1-b06ccf78edf3 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:51.743859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df6d36-f1f1-4841-8bf1-b06ccf78edf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:51.744139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df6d36-f1f1-4841-8bf1-b06ccf78edf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:51.744914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df6d36-f1f1-4841-8bf1-b06ccf78edf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:32:51.745411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df6d36-f1f1-4841-8bf1-b06ccf78edf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:51.747248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df6d36-f1f1-4841-8bf1-b06ccf78edf3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:51.755408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3c72b64-6764-4912-826e-c738791741a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1f8df29b43a461d9c79b42858701437'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:51.757607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3c72b64-6764-4912-826e-c738791741a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1f8df29b43a461d9c79b42858701437'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:51.775570 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2184/4362] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:32:51.782946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df6d36-f1f1-4841-8bf1-b06ccf78edf3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:51.783096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3c72b64-6764-4912-826e-c738791741a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1f8df29b43a461d9c79b42858701437'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:51.803556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df6d36-f1f1-4841-8bf1-b06ccf78edf3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:51.819447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb25b14-5a24-42ce-8391-b672b1137434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:51.820068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb25b14-5a24-42ce-8391-b672b1137434 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:51.820355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb25b14-5a24-42ce-8391-b672b1137434 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:51.820655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb25b14-5a24-42ce-8391-b672b1137434 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:51.828924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb25b14-5a24-42ce-8391-b672b1137434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:51.831478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb25b14-5a24-42ce-8391-b672b1137434 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:51.875974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3c72b64-6764-4912-826e-c738791741a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1f8df29b43a461d9c79b42858701437'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:51.894643 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2179/4363] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:32:51 2022] DELETE /identity/v3/users/d1f8df29b43a461d9c79b42858701437 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:51.984871 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2185/4364] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:32:51 2022] POST /identity/v3/projects => generated 377 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:32:51.989363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c72b64-6764-4912-826e-c738791741a0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:51.991978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d3c72b64-6764-4912-826e-c738791741a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:52.242532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c72b64-6764-4912-826e-c738791741a0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:52.293657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd0b31-3554-45fc-bdce-d02f70eef313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:52.295166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd0b31-3554-45fc-bdce-d02f70eef313 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:52.295699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd0b31-3554-45fc-bdce-d02f70eef313 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:52.296453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd0b31-3554-45fc-bdce-d02f70eef313 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:52.297440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd0b31-3554-45fc-bdce-d02f70eef313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:52.299772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd0b31-3554-45fc-bdce-d02f70eef313 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:52.405541 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2180/4365] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:32:51 2022] POST /identity/v3/users => generated 289 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:32:52.408163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb25b14-5a24-42ce-8391-b672b1137434 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:52.451142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb25b14-5a24-42ce-8391-b672b1137434 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:52.458446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb3a08-353f-4b02-a14f-3a925d801be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:52.459391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb3a08-353f-4b02-a14f-3a925d801be6 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:52.459987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb3a08-353f-4b02-a14f-3a925d801be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:52.460441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb3a08-353f-4b02-a14f-3a925d801be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:52.462820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb3a08-353f-4b02-a14f-3a925d801be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:52.467167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb3a08-353f-4b02-a14f-3a925d801be6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:52.488227 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2186/4366] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:52.492986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd0b31-3554-45fc-bdce-d02f70eef313 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:52.507985 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd0b31-3554-45fc-bdce-d02f70eef313 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:52.515381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2659bf5-9e43-4655-ad38-2a328a9ba2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:52.516324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2659bf5-9e43-4655-ad38-2a328a9ba2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:52.516875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2659bf5-9e43-4655-ad38-2a328a9ba2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:52.517362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2659bf5-9e43-4655-ad38-2a328a9ba2e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:52.518346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2659bf5-9e43-4655-ad38-2a328a9ba2e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:52.520168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2659bf5-9e43-4655-ad38-2a328a9ba2e8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:52.533569 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2181/4367] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:52.537508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb3a08-353f-4b02-a14f-3a925d801be6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:52.556235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb3a08-353f-4b02-a14f-3a925d801be6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:52.563740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19196a-4166-49eb-ae12-d60c30e431c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:52.565256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19196a-4166-49eb-ae12-d60c30e431c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:52.565769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19196a-4166-49eb-ae12-d60c30e431c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:52.566263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19196a-4166-49eb-ae12-d60c30e431c2 admin admin] PATH_INFO: `/v3/projects/470a6d88d5b94bf69e729aa9ccb9be12/users/94002d1dd28b44aea254de29b78d44e7/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:52.593564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19196a-4166-49eb-ae12-d60c30e431c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=470a6d88d5b94bf69e729aa9ccb9be12, user_id=94002d1dd28b44aea254de29b78d44e7, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:52.596495 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19196a-4166-49eb-ae12-d60c30e431c2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:52.688840 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2187/4368] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:32:52 2022] PUT /identity/v3/projects/470a6d88d5b94bf69e729aa9ccb9be12/users/94002d1dd28b44aea254de29b78d44e7/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:52.699867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380e51d-adfe-438e-b73f-b3662109ed72 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:52.700112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380e51d-adfe-438e-b73f-b3662109ed72 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:52.700398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380e51d-adfe-438e-b73f-b3662109ed72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:52.748670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0380e51d-adfe-438e-b73f-b3662109ed72 None None] MFA Rules not processed for user `94002d1dd28b44aea254de29b78d44e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:52.749854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0380e51d-adfe-438e-b73f-b3662109ed72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:52.826623 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2182/4369] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:52.840009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19196a-4166-49eb-ae12-d60c30e431c2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:52.842143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7f19196a-4166-49eb-ae12-d60c30e431c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:52.904837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380e51d-adfe-438e-b73f-b3662109ed72 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:52.906750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0380e51d-adfe-438e-b73f-b3662109ed72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:52.950070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19196a-4166-49eb-ae12-d60c30e431c2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:52.963032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e7b8c-bebb-4cb9-b559-e29ffd984063 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:52.963032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e7b8c-bebb-4cb9-b559-e29ffd984063 service glance] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:52.963865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e7b8c-bebb-4cb9-b559-e29ffd984063 service glance] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:52.964525 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e7b8c-bebb-4cb9-b559-e29ffd984063 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:52.992165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e7b8c-bebb-4cb9-b559-e29ffd984063 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:52.994358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e7b8c-bebb-4cb9-b559-e29ffd984063 service glance] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:53.025051 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2188/4370] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:32:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:32:53.057964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380e51d-adfe-438e-b73f-b3662109ed72 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:53.072817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75681b7b-108f-4040-a2ac-1cb5368c0aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:53.072817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75681b7b-108f-4040-a2ac-1cb5368c0aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:53.072817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75681b7b-108f-4040-a2ac-1cb5368c0aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:53.072817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75681b7b-108f-4040-a2ac-1cb5368c0aa9 admin admin] PATH_INFO: `/v3/projects/82bde93c359b4e4cb13a9ebcfa317377` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:53.074599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75681b7b-108f-4040-a2ac-1cb5368c0aa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82bde93c359b4e4cb13a9ebcfa317377)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:53.078273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75681b7b-108f-4040-a2ac-1cb5368c0aa9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:53.260441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-75681b7b-108f-4040-a2ac-1cb5368c0aa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82bde93c359b4e4cb13a9ebcfa317377', 'request_id': 'req-75681b7b-108f-4040-a2ac-1cb5368c0aa9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:53.302298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-75681b7b-108f-4040-a2ac-1cb5368c0aa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82bde93c359b4e4cb13a9ebcfa317377', 'request_id': 'req-75681b7b-108f-4040-a2ac-1cb5368c0aa9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:53.384665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-75681b7b-108f-4040-a2ac-1cb5368c0aa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82bde93c359b4e4cb13a9ebcfa317377', 'request_id': 'req-75681b7b-108f-4040-a2ac-1cb5368c0aa9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:53.401831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-75681b7b-108f-4040-a2ac-1cb5368c0aa9 admin admin] The token cache is being invalidate because project 82bde93c359b4e4cb13a9ebcfa317377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:32:53.402749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-75681b7b-108f-4040-a2ac-1cb5368c0aa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:53.409434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-75681b7b-108f-4040-a2ac-1cb5368c0aa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:32:53.421784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7194f-4650-4814-89b5-d2e66a4581a0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:53.421784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7194f-4650-4814-89b5-d2e66a4581a0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:53.421784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7194f-4650-4814-89b5-d2e66a4581a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:53.422049 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2183/4371] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:32:52 2022] DELETE /identity/v3/projects/82bde93c359b4e4cb13a9ebcfa317377 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:32:53.455532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-48f7194f-4650-4814-89b5-d2e66a4581a0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:53.458225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-48f7194f-4650-4814-89b5-d2e66a4581a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:53.619951 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2189/4372] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:53.621650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a773c-66b3-4f80-8d3a-566d22d51fe0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:53.622104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a773c-66b3-4f80-8d3a-566d22d51fe0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:53.622492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a773c-66b3-4f80-8d3a-566d22d51fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:53.649331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-406a773c-66b3-4f80-8d3a-566d22d51fe0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:53.652194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-406a773c-66b3-4f80-8d3a-566d22d51fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:53.673032 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2184/4373] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:32:53.677181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7194f-4650-4814-89b5-d2e66a4581a0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:53.689631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7194f-4650-4814-89b5-d2e66a4581a0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:53.695161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66f818-c51f-4d0f-b61c-b3026b4bf894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:53.696120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66f818-c51f-4d0f-b61c-b3026b4bf894 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:53.696617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66f818-c51f-4d0f-b61c-b3026b4bf894 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:53.697027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66f818-c51f-4d0f-b61c-b3026b4bf894 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:53.697869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66f818-c51f-4d0f-b61c-b3026b4bf894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:32:53.698283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66f818-c51f-4d0f-b61c-b3026b4bf894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:53.700238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66f818-c51f-4d0f-b61c-b3026b4bf894 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:53.717826 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2190/4374] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:32:53.722377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a773c-66b3-4f80-8d3a-566d22d51fe0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:53.735768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a773c-66b3-4f80-8d3a-566d22d51fe0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:53.753514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f6789-2506-40d0-aa40-7cd456aaa1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:53.754637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f6789-2506-40d0-aa40-7cd456aaa1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:53.755396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f6789-2506-40d0-aa40-7cd456aaa1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:53.755886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f6789-2506-40d0-aa40-7cd456aaa1e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:53.756837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f6789-2506-40d0-aa40-7cd456aaa1e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:53.759142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f6789-2506-40d0-aa40-7cd456aaa1e6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:53.873040 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2185/4375] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:32:53 2022] POST /identity/v3/projects => generated 389 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:32:53.877740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66f818-c51f-4d0f-b61c-b3026b4bf894 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:53.893336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66f818-c51f-4d0f-b61c-b3026b4bf894 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:53.979974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339bf44-98e5-4013-b104-7097a07d9e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:53.981298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339bf44-98e5-4013-b104-7097a07d9e44 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:53.981639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339bf44-98e5-4013-b104-7097a07d9e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:53.981929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339bf44-98e5-4013-b104-7097a07d9e44 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:53.983505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339bf44-98e5-4013-b104-7097a07d9e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:53.986769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339bf44-98e5-4013-b104-7097a07d9e44 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:54.110070 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2191/4376] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:32:53 2022] POST /identity/v3/users => generated 295 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:32:54.113632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f6789-2506-40d0-aa40-7cd456aaa1e6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:54.125623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f6789-2506-40d0-aa40-7cd456aaa1e6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:54.134800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc21c37-fb31-42ed-b0ab-f59f17ff41cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:54.136816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc21c37-fb31-42ed-b0ab-f59f17ff41cb admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:54.136816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc21c37-fb31-42ed-b0ab-f59f17ff41cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:54.137263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc21c37-fb31-42ed-b0ab-f59f17ff41cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:54.138447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc21c37-fb31-42ed-b0ab-f59f17ff41cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:54.140928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc21c37-fb31-42ed-b0ab-f59f17ff41cb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:54.157671 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2186/4377] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:54.160671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339bf44-98e5-4013-b104-7097a07d9e44 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:54.177417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339bf44-98e5-4013-b104-7097a07d9e44 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:54.191474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd36d53-0ba8-41ba-8aca-5d7e3fc81cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:54.192335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd36d53-0ba8-41ba-8aca-5d7e3fc81cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:54.192768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd36d53-0ba8-41ba-8aca-5d7e3fc81cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:54.193147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd36d53-0ba8-41ba-8aca-5d7e3fc81cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:54.202328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd36d53-0ba8-41ba-8aca-5d7e3fc81cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:54.219095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd36d53-0ba8-41ba-8aca-5d7e3fc81cd9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:54.240506 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2192/4378] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:54.249522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc21c37-fb31-42ed-b0ab-f59f17ff41cb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:54.270892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc21c37-fb31-42ed-b0ab-f59f17ff41cb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:54.291253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427fe2a-3e80-471b-91bd-816b321a6234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:54.292518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427fe2a-3e80-471b-91bd-816b321a6234 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:54.292988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427fe2a-3e80-471b-91bd-816b321a6234 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:54.293444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427fe2a-3e80-471b-91bd-816b321a6234 admin admin] PATH_INFO: `/v3/projects/b548e2f0a4f24658b983a91d88eaa32b/users/d11e625d18bd4a5ebeb43464a5c4093c/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:54.339699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427fe2a-3e80-471b-91bd-816b321a6234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b548e2f0a4f24658b983a91d88eaa32b, user_id=d11e625d18bd4a5ebeb43464a5c4093c, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:54.345539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427fe2a-3e80-471b-91bd-816b321a6234 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:54.473985 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2187/4379] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:32:54 2022] PUT /identity/v3/projects/b548e2f0a4f24658b983a91d88eaa32b/users/d11e625d18bd4a5ebeb43464a5c4093c/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:54.480903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdd2c9-a5f8-4640-a08d-0a3967cce079 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:54.481466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdd2c9-a5f8-4640-a08d-0a3967cce079 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:54.481928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdd2c9-a5f8-4640-a08d-0a3967cce079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:54.538945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-13fdd2c9-a5f8-4640-a08d-0a3967cce079 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:54.546440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-13fdd2c9-a5f8-4640-a08d-0a3967cce079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:54.719945 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2193/4380] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:54.772854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427fe2a-3e80-471b-91bd-816b321a6234 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:54.775154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6427fe2a-3e80-471b-91bd-816b321a6234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:54.915690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427fe2a-3e80-471b-91bd-816b321a6234 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:54.927820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57754e-4b7b-4145-8ebd-0dd96d1b9d3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:54.932640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57754e-4b7b-4145-8ebd-0dd96d1b9d3d service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:54.932640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57754e-4b7b-4145-8ebd-0dd96d1b9d3d service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:54.932640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57754e-4b7b-4145-8ebd-0dd96d1b9d3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:54.955685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57754e-4b7b-4145-8ebd-0dd96d1b9d3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:54.957998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57754e-4b7b-4145-8ebd-0dd96d1b9d3d service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:54.981336 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2188/4381] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:32:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:32:55.209736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25d284-e82b-4c70-a86e-b3742165c68c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:55.209736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25d284-e82b-4c70-a86e-b3742165c68c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:55.209736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25d284-e82b-4c70-a86e-b3742165c68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:55.269168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-be25d284-e82b-4c70-a86e-b3742165c68c None None] MFA Rules not processed for user `c337647f0fa340949df8761bceb1bafc`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:55.270441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-be25d284-e82b-4c70-a86e-b3742165c68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:55.449145 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2194/4382] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:55.454020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57754e-4b7b-4145-8ebd-0dd96d1b9d3d service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:55.456122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3d57754e-4b7b-4145-8ebd-0dd96d1b9d3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:55.490832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57754e-4b7b-4145-8ebd-0dd96d1b9d3d service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:55.497961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec0300-3992-42b0-977a-1041db1c8276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:55.498904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec0300-3992-42b0-977a-1041db1c8276 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:55.499752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec0300-3992-42b0-977a-1041db1c8276 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:55.500516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec0300-3992-42b0-977a-1041db1c8276 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:55.501424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec0300-3992-42b0-977a-1041db1c8276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:55.503535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec0300-3992-42b0-977a-1041db1c8276 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:55.611419 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2189/4383] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:32:55 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:32:55.616591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25d284-e82b-4c70-a86e-b3742165c68c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:55.639488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25d284-e82b-4c70-a86e-b3742165c68c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:55.800997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cafa8-c971-4999-bd38-45c51fc52c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:55.801767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cafa8-c971-4999-bd38-45c51fc52c83 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:55.802171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cafa8-c971-4999-bd38-45c51fc52c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:55.802381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cafa8-c971-4999-bd38-45c51fc52c83 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:55.803101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849cafa8-c971-4999-bd38-45c51fc52c83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:55.807453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849cafa8-c971-4999-bd38-45c51fc52c83 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:55.886939 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2195/4384] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:32:55 2022] POST /identity/v3/users => generated 296 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:32:55.888331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec0300-3992-42b0-977a-1041db1c8276 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:55.907689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec0300-3992-42b0-977a-1041db1c8276 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:55.921008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b34ea-5299-48ed-a78f-4dba9e40955a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:55.924110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b34ea-5299-48ed-a78f-4dba9e40955a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:55.924110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b34ea-5299-48ed-a78f-4dba9e40955a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:55.924110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b34ea-5299-48ed-a78f-4dba9e40955a admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:55.924110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b34ea-5299-48ed-a78f-4dba9e40955a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:55.930003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b34ea-5299-48ed-a78f-4dba9e40955a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:55.960272 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2190/4385] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:55.963389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cafa8-c971-4999-bd38-45c51fc52c83 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:55.982232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cafa8-c971-4999-bd38-45c51fc52c83 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:56.006653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8350943-292c-48a9-bd11-c00a54ce859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:56.007588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350943-292c-48a9-bd11-c00a54ce859a admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:56.007878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350943-292c-48a9-bd11-c00a54ce859a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:56.008168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350943-292c-48a9-bd11-c00a54ce859a admin admin] PATH_INFO: `/v3/projects/b5527890307e49edad96eaf0fa0051c2/users/b6a971cadf2444c0bc39e4edfb1887f3/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:56.082125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8350943-292c-48a9-bd11-c00a54ce859a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5527890307e49edad96eaf0fa0051c2, user_id=b6a971cadf2444c0bc39e4edfb1887f3, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:56.082125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8350943-292c-48a9-bd11-c00a54ce859a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:56.261403 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2196/4386] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:32:55 2022] PUT /identity/v3/projects/b5527890307e49edad96eaf0fa0051c2/users/b6a971cadf2444c0bc39e4edfb1887f3/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:56.265546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b34ea-5299-48ed-a78f-4dba9e40955a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:56.281446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b34ea-5299-48ed-a78f-4dba9e40955a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:56.428946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625ee4b-780d-4cde-925a-dd98ecac1a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:56.429803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625ee4b-780d-4cde-925a-dd98ecac1a17 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:56.430422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625ee4b-780d-4cde-925a-dd98ecac1a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:56.432702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625ee4b-780d-4cde-925a-dd98ecac1a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:56.433578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625ee4b-780d-4cde-925a-dd98ecac1a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:56.438164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625ee4b-780d-4cde-925a-dd98ecac1a17 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:56.472535 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2191/4387] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:32:56.474312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8350943-292c-48a9-bd11-c00a54ce859a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:56.500804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8350943-292c-48a9-bd11-c00a54ce859a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:56.518841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfd7b9-1c80-47b7-9c45-ac4a8a6e53ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:56.520168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfd7b9-1c80-47b7-9c45-ac4a8a6e53ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:56.521281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfd7b9-1c80-47b7-9c45-ac4a8a6e53ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:56.521785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfd7b9-1c80-47b7-9c45-ac4a8a6e53ce admin admin] PATH_INFO: `/v3/projects/b5527890307e49edad96eaf0fa0051c2/users/b6a971cadf2444c0bc39e4edfb1887f3/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:56.542284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfd7b9-1c80-47b7-9c45-ac4a8a6e53ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5527890307e49edad96eaf0fa0051c2, user_id=b6a971cadf2444c0bc39e4edfb1887f3, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:56.549081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfd7b9-1c80-47b7-9c45-ac4a8a6e53ce admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:56.565480 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2197/4388] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:32:56 2022] PUT /identity/v3/projects/b5527890307e49edad96eaf0fa0051c2/users/b6a971cadf2444c0bc39e4edfb1887f3/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:32:58.724765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cc62a-13bf-4a4c-b0db-841fd8af15f5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:58.725770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cc62a-13bf-4a4c-b0db-841fd8af15f5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:58.726123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cc62a-13bf-4a4c-b0db-841fd8af15f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:58.762030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8c0cc62a-13bf-4a4c-b0db-841fd8af15f5 None None] MFA Rules not processed for user `d11e625d18bd4a5ebeb43464a5c4093c`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:58.763388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8c0cc62a-13bf-4a4c-b0db-841fd8af15f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:58.842966 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2192/4389] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:58.854023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad082253-6aec-4fc9-b798-52b76d97df19 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:58.854533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad082253-6aec-4fc9-b798-52b76d97df19 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:58.854778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad082253-6aec-4fc9-b798-52b76d97df19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:58.880553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ad082253-6aec-4fc9-b798-52b76d97df19 None None] MFA Rules not processed for user `d11e625d18bd4a5ebeb43464a5c4093c`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:32:58.882779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ad082253-6aec-4fc9-b798-52b76d97df19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:58.895314 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2198/4390] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:32:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:32:59.236624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cc62a-13bf-4a4c-b0db-841fd8af15f5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:32:59.238552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8c0cc62a-13bf-4a4c-b0db-841fd8af15f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:32:59.433971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cc62a-13bf-4a4c-b0db-841fd8af15f5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:32:59.447695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19768ad-5b8c-4d19-aed5-1d652c20e6ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:32:59.454656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19768ad-5b8c-4d19-aed5-1d652c20e6ca service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:32:59.454656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19768ad-5b8c-4d19-aed5-1d652c20e6ca service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:32:59.454656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19768ad-5b8c-4d19-aed5-1d652c20e6ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:32:59.484759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19768ad-5b8c-4d19-aed5-1d652c20e6ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:32:59.484759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19768ad-5b8c-4d19-aed5-1d652c20e6ca service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:32:59.502338 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2193/4391] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:32:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:33:01.601608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3afa8-1b89-4495-92e5-793e3f9d1229 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:01.603972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3afa8-1b89-4495-92e5-793e3f9d1229 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:01.604519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3afa8-1b89-4495-92e5-793e3f9d1229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:01.643063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-09a3afa8-1b89-4495-92e5-793e3f9d1229 None None] MFA Rules not processed for user `ac7a59b2974d49b0ac50e3885c6a3ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:33:01.645492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-09a3afa8-1b89-4495-92e5-793e3f9d1229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:01.775661 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2199/4392] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:33:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:33:07.088431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19768ad-5b8c-4d19-aed5-1d652c20e6ca service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:07.090008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c19768ad-5b8c-4d19-aed5-1d652c20e6ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:07.203382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19768ad-5b8c-4d19-aed5-1d652c20e6ca service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:07.210453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1f5e0-a3b2-4740-82d1-418d4b6f13da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:07.212296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1f5e0-a3b2-4740-82d1-418d4b6f13da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:07.212775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1f5e0-a3b2-4740-82d1-418d4b6f13da admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:07.213271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1f5e0-a3b2-4740-82d1-418d4b6f13da admin admin] PATH_INFO: `/v3/users/94002d1dd28b44aea254de29b78d44e7` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:07.215181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1f5e0-a3b2-4740-82d1-418d4b6f13da admin admin] RBAC: Authorizing `identity:delete_user(user_id=94002d1dd28b44aea254de29b78d44e7)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:07.217643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1f5e0-a3b2-4740-82d1-418d4b6f13da admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:07.387784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-40a1f5e0-a3b2-4740-82d1-418d4b6f13da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94002d1dd28b44aea254de29b78d44e7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:07.419410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-40a1f5e0-a3b2-4740-82d1-418d4b6f13da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94002d1dd28b44aea254de29b78d44e7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:07.420449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-40a1f5e0-a3b2-4740-82d1-418d4b6f13da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94002d1dd28b44aea254de29b78d44e7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:07.428560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-40a1f5e0-a3b2-4740-82d1-418d4b6f13da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94002d1dd28b44aea254de29b78d44e7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:07.503723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-40a1f5e0-a3b2-4740-82d1-418d4b6f13da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94002d1dd28b44aea254de29b78d44e7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:07.510735 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2194/4393] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:33:07 2022] DELETE /identity/v3/users/94002d1dd28b44aea254de29b78d44e7 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:33:07.516081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e83943-f311-42b7-8579-d01c6d6362bc None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:07.517198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e83943-f311-42b7-8579-d01c6d6362bc None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:07.517610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e83943-f311-42b7-8579-d01c6d6362bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:07.541386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f6e83943-f311-42b7-8579-d01c6d6362bc None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:33:07.541797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f6e83943-f311-42b7-8579-d01c6d6362bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:07.608290 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2200/4394] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:33:07.657912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1f5e0-a3b2-4740-82d1-418d4b6f13da admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:07.661234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-40a1f5e0-a3b2-4740-82d1-418d4b6f13da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:07.793774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1f5e0-a3b2-4740-82d1-418d4b6f13da admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:07.799137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce513a5d-f7f1-4ef5-b09a-c19932546ea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:07.800062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce513a5d-f7f1-4ef5-b09a-c19932546ea8 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:07.800479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce513a5d-f7f1-4ef5-b09a-c19932546ea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:07.800867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce513a5d-f7f1-4ef5-b09a-c19932546ea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:07.820150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce513a5d-f7f1-4ef5-b09a-c19932546ea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:07.823732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce513a5d-f7f1-4ef5-b09a-c19932546ea8 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:07.848396 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2195/4395] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:33:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:33:10.654817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e83943-f311-42b7-8579-d01c6d6362bc None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:10.656397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f6e83943-f311-42b7-8579-d01c6d6362bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:10.674449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e83943-f311-42b7-8579-d01c6d6362bc None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:10.679857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb2446-e0e4-416b-a465-cb4bd18847a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:10.681801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb2446-e0e4-416b-a465-cb4bd18847a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:10.682328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb2446-e0e4-416b-a465-cb4bd18847a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:10.682812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb2446-e0e4-416b-a465-cb4bd18847a4 admin admin] PATH_INFO: `/v3/projects/470a6d88d5b94bf69e729aa9ccb9be12` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:10.685016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb2446-e0e4-416b-a465-cb4bd18847a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=470a6d88d5b94bf69e729aa9ccb9be12)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:10.687175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb2446-e0e4-416b-a465-cb4bd18847a4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:10.867993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f2cb2446-e0e4-416b-a465-cb4bd18847a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '470a6d88d5b94bf69e729aa9ccb9be12', 'request_id': 'req-f2cb2446-e0e4-416b-a465-cb4bd18847a4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:10.973299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f2cb2446-e0e4-416b-a465-cb4bd18847a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '470a6d88d5b94bf69e729aa9ccb9be12', 'request_id': 'req-f2cb2446-e0e4-416b-a465-cb4bd18847a4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:10.980972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f2cb2446-e0e4-416b-a465-cb4bd18847a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '470a6d88d5b94bf69e729aa9ccb9be12', 'request_id': 'req-f2cb2446-e0e4-416b-a465-cb4bd18847a4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:11.006463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f2cb2446-e0e4-416b-a465-cb4bd18847a4 admin admin] The token cache is being invalidate because project 470a6d88d5b94bf69e729aa9ccb9be12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:33:11.007026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f2cb2446-e0e4-416b-a465-cb4bd18847a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:11.008056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f2cb2446-e0e4-416b-a465-cb4bd18847a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:11.011883 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2201/4396] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:33:10 2022] DELETE /identity/v3/projects/470a6d88d5b94bf69e729aa9ccb9be12 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:33:11.016670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49486c-b68a-45d4-88e6-8c18ae04b802 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:11.017229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49486c-b68a-45d4-88e6-8c18ae04b802 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:11.017229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49486c-b68a-45d4-88e6-8c18ae04b802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:11.049013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ed49486c-b68a-45d4-88e6-8c18ae04b802 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:33:11.050282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ed49486c-b68a-45d4-88e6-8c18ae04b802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:11.163193 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2196/4397] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:33:11.170863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080705d5-006b-4bfb-a078-f4ca5d3695fb None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:11.171142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080705d5-006b-4bfb-a078-f4ca5d3695fb None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:11.171435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080705d5-006b-4bfb-a078-f4ca5d3695fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:11.204937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-080705d5-006b-4bfb-a078-f4ca5d3695fb None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:33:11.206580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-080705d5-006b-4bfb-a078-f4ca5d3695fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:11.221220 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2202/4398] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:33:11.227164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49486c-b68a-45d4-88e6-8c18ae04b802 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:11.238661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49486c-b68a-45d4-88e6-8c18ae04b802 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:11.245754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90270d3-e2f2-43c9-b9fd-3f55210c0177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:11.246684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90270d3-e2f2-43c9-b9fd-3f55210c0177 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:11.247183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90270d3-e2f2-43c9-b9fd-3f55210c0177 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:11.247917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90270d3-e2f2-43c9-b9fd-3f55210c0177 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:11.248951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90270d3-e2f2-43c9-b9fd-3f55210c0177 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:33:11.251350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90270d3-e2f2-43c9-b9fd-3f55210c0177 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:11.253514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90270d3-e2f2-43c9-b9fd-3f55210c0177 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:11.268312 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2197/4399] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:33:11.272623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080705d5-006b-4bfb-a078-f4ca5d3695fb None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:11.283428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080705d5-006b-4bfb-a078-f4ca5d3695fb None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:11.289219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd7e44-7f4d-4bf2-a4b0-82072e112ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:11.290806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd7e44-7f4d-4bf2-a4b0-82072e112ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:11.291428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd7e44-7f4d-4bf2-a4b0-82072e112ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:11.291859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd7e44-7f4d-4bf2-a4b0-82072e112ce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:11.292922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd7e44-7f4d-4bf2-a4b0-82072e112ce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:11.295185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd7e44-7f4d-4bf2-a4b0-82072e112ce1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:11.405674 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2203/4400] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:33:11 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:33:11.409599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90270d3-e2f2-43c9-b9fd-3f55210c0177 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:11.421120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90270d3-e2f2-43c9-b9fd-3f55210c0177 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:11.501817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae82da-0ec1-408e-8961-91034801a145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:11.502536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae82da-0ec1-408e-8961-91034801a145 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:11.502820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae82da-0ec1-408e-8961-91034801a145 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:11.503104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae82da-0ec1-408e-8961-91034801a145 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:11.503807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae82da-0ec1-408e-8961-91034801a145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:11.505858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae82da-0ec1-408e-8961-91034801a145 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:11.596647 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2198/4401] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:33:11 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:33:11.600019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd7e44-7f4d-4bf2-a4b0-82072e112ce1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:11.612969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd7e44-7f4d-4bf2-a4b0-82072e112ce1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:11.618911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df46040-66d0-49b9-8bfc-227ba4e17d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:11.619743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df46040-66d0-49b9-8bfc-227ba4e17d33 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:11.620032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df46040-66d0-49b9-8bfc-227ba4e17d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:11.620315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df46040-66d0-49b9-8bfc-227ba4e17d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:11.621093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df46040-66d0-49b9-8bfc-227ba4e17d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:11.622890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df46040-66d0-49b9-8bfc-227ba4e17d33 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:11.635321 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2204/4402] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:33:11.639088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae82da-0ec1-408e-8961-91034801a145 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:11.649922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae82da-0ec1-408e-8961-91034801a145 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:11.658363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ac43d-758f-4271-91e5-4bce349c38be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:11.659049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ac43d-758f-4271-91e5-4bce349c38be admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:11.659339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ac43d-758f-4271-91e5-4bce349c38be admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:11.662615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ac43d-758f-4271-91e5-4bce349c38be admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:11.666216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ac43d-758f-4271-91e5-4bce349c38be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:11.666216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ac43d-758f-4271-91e5-4bce349c38be admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:11.683294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df46040-66d0-49b9-8bfc-227ba4e17d33 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:11.688776 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2199/4403] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:33:11.695155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df46040-66d0-49b9-8bfc-227ba4e17d33 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:11.700999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f5644-5c67-4e49-8e49-998c7035c8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:11.701905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f5644-5c67-4e49-8e49-998c7035c8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:11.702200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f5644-5c67-4e49-8e49-998c7035c8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:11.702624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f5644-5c67-4e49-8e49-998c7035c8b5 admin admin] PATH_INFO: `/v3/projects/67cc0a5d5e6a452e9991ef89d74248a0/users/087b08c5319d401d85619b5b615923aa/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:11.722579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f5644-5c67-4e49-8e49-998c7035c8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67cc0a5d5e6a452e9991ef89d74248a0, user_id=087b08c5319d401d85619b5b615923aa, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:11.730040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f5644-5c67-4e49-8e49-998c7035c8b5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:11.791754 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2205/4404] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:33:11 2022] PUT /identity/v3/projects/67cc0a5d5e6a452e9991ef89d74248a0/users/087b08c5319d401d85619b5b615923aa/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:33:11.802171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937b8ff-870a-43f0-8c05-10141d4583df None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:11.802590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937b8ff-870a-43f0-8c05-10141d4583df None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:11.802946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937b8ff-870a-43f0-8c05-10141d4583df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:11.840924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4937b8ff-870a-43f0-8c05-10141d4583df None None] MFA Rules not processed for user `087b08c5319d401d85619b5b615923aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:33:11.842174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4937b8ff-870a-43f0-8c05-10141d4583df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:11.909858 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2200/4405] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:33:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:33:11.922312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f5644-5c67-4e49-8e49-998c7035c8b5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:11.924363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1c1f5644-5c67-4e49-8e49-998c7035c8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:11.994280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f5644-5c67-4e49-8e49-998c7035c8b5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:12.011896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a2b79-cb32-4ee8-b8c1-5692fa5350df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:12.013530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a2b79-cb32-4ee8-b8c1-5692fa5350df service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:12.013530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a2b79-cb32-4ee8-b8c1-5692fa5350df service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:12.013530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a2b79-cb32-4ee8-b8c1-5692fa5350df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:12.036463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a2b79-cb32-4ee8-b8c1-5692fa5350df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:12.038440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a2b79-cb32-4ee8-b8c1-5692fa5350df service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:12.052934 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2206/4406] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:33:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:33:14.612854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a9d5a-5f38-423d-b126-4f086bb4746a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:14.612854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a9d5a-5f38-423d-b126-4f086bb4746a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:14.612854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a9d5a-5f38-423d-b126-4f086bb4746a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:14.651857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0e7a9d5a-5f38-423d-b126-4f086bb4746a None None] MFA Rules not processed for user `bb79a0a1ee5a429c9df27db4f671f0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:33:14.654164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0e7a9d5a-5f38-423d-b126-4f086bb4746a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:14.740342 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2201/4407] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:33:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:33:17.909592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabb8e9-216d-45e1-80be-4e5aade96ca4 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:17.914835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabb8e9-216d-45e1-80be-4e5aade96ca4 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:17.914835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabb8e9-216d-45e1-80be-4e5aade96ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:17.960523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fdabb8e9-216d-45e1-80be-4e5aade96ca4 None None] MFA Rules not processed for user `b6a971cadf2444c0bc39e4edfb1887f3`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:33:17.963349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fdabb8e9-216d-45e1-80be-4e5aade96ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:18.089141 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2207/4408] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:33:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:33:18.118289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a9d5a-5f38-423d-b126-4f086bb4746a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:18.119887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0e7a9d5a-5f38-423d-b126-4f086bb4746a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:18.151405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a9d5a-5f38-423d-b126-4f086bb4746a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:18.163875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54622d2e-0bdc-4223-9c93-e1e995a6288d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:18.169374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54622d2e-0bdc-4223-9c93-e1e995a6288d service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:18.169704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54622d2e-0bdc-4223-9c93-e1e995a6288d service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:18.170275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54622d2e-0bdc-4223-9c93-e1e995a6288d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:18.172295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-54622d2e-0bdc-4223-9c93-e1e995a6288d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:18.289156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54622d2e-0bdc-4223-9c93-e1e995a6288d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:18.293162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54622d2e-0bdc-4223-9c93-e1e995a6288d service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:18.321243 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2202/4409] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:33:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:33:27.393628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4f1f3-793e-4b14-9f22-b1a745fd37a7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:27.394500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4f1f3-793e-4b14-9f22-b1a745fd37a7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:27.394944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4f1f3-793e-4b14-9f22-b1a745fd37a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:27.418769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1ad4f1f3-793e-4b14-9f22-b1a745fd37a7 None None] MFA Rules not processed for user `e3d3dea2740e4e46ae98265dcade1291`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:33:27.420733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1ad4f1f3-793e-4b14-9f22-b1a745fd37a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:27.506686 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2208/4410] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:33:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:33:28.067302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54622d2e-0bdc-4223-9c93-e1e995a6288d service cinder] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:28.069190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-54622d2e-0bdc-4223-9c93-e1e995a6288d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:28.154362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54622d2e-0bdc-4223-9c93-e1e995a6288d service cinder] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:28.159482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99711c-f4ab-41e0-8b90-ee493b24f112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:28.160506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99711c-f4ab-41e0-8b90-ee493b24f112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:28.160921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99711c-f4ab-41e0-8b90-ee493b24f112 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:28.161304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99711c-f4ab-41e0-8b90-ee493b24f112 admin admin] PATH_INFO: `/v3/users/46400570e35841af88803dc0d527afbe` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:28.162655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99711c-f4ab-41e0-8b90-ee493b24f112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46400570e35841af88803dc0d527afbe)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:28.166206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99711c-f4ab-41e0-8b90-ee493b24f112 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:28.371312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4d99711c-f4ab-41e0-8b90-ee493b24f112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46400570e35841af88803dc0d527afbe'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:28.394410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4d99711c-f4ab-41e0-8b90-ee493b24f112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46400570e35841af88803dc0d527afbe'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:28.395269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4d99711c-f4ab-41e0-8b90-ee493b24f112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46400570e35841af88803dc0d527afbe'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:28.424488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4d99711c-f4ab-41e0-8b90-ee493b24f112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46400570e35841af88803dc0d527afbe'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:28.548912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4d99711c-f4ab-41e0-8b90-ee493b24f112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46400570e35841af88803dc0d527afbe'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:28.560213 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2203/4411] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:33:28 2022] DELETE /identity/v3/users/46400570e35841af88803dc0d527afbe => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:33:29.095156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4f1f3-793e-4b14-9f22-b1a745fd37a7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:29.108005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4f1f3-793e-4b14-9f22-b1a745fd37a7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:29.174309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e7bb3-aa9c-479b-bc0e-e21c8cb424d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:29.175942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e7bb3-aa9c-479b-bc0e-e21c8cb424d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:29.176286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e7bb3-aa9c-479b-bc0e-e21c8cb424d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:29.176736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e7bb3-aa9c-479b-bc0e-e21c8cb424d9 admin admin] PATH_INFO: `/v3/projects/b1b64eac9be54bb888efb39bf8bb93ba` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:29.178037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e7bb3-aa9c-479b-bc0e-e21c8cb424d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1b64eac9be54bb888efb39bf8bb93ba)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:29.180545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e7bb3-aa9c-479b-bc0e-e21c8cb424d9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:29.331140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e88e7bb3-aa9c-479b-bc0e-e21c8cb424d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1b64eac9be54bb888efb39bf8bb93ba', 'request_id': 'req-e88e7bb3-aa9c-479b-bc0e-e21c8cb424d9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:29.408769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e88e7bb3-aa9c-479b-bc0e-e21c8cb424d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1b64eac9be54bb888efb39bf8bb93ba', 'request_id': 'req-e88e7bb3-aa9c-479b-bc0e-e21c8cb424d9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:29.417377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e88e7bb3-aa9c-479b-bc0e-e21c8cb424d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1b64eac9be54bb888efb39bf8bb93ba', 'request_id': 'req-e88e7bb3-aa9c-479b-bc0e-e21c8cb424d9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:29.427869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e88e7bb3-aa9c-479b-bc0e-e21c8cb424d9 admin admin] The token cache is being invalidate because project b1b64eac9be54bb888efb39bf8bb93ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:33:29.428711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e88e7bb3-aa9c-479b-bc0e-e21c8cb424d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:29.430038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e88e7bb3-aa9c-479b-bc0e-e21c8cb424d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:29.431607 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2209/4412] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:33:29 2022] DELETE /identity/v3/projects/b1b64eac9be54bb888efb39bf8bb93ba => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:33:29.437134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda65aa2-06d6-494d-82bd-ea9d5c317cbd None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:29.437675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda65aa2-06d6-494d-82bd-ea9d5c317cbd None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:29.437776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda65aa2-06d6-494d-82bd-ea9d5c317cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:29.456200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-cda65aa2-06d6-494d-82bd-ea9d5c317cbd None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:33:29.457466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cda65aa2-06d6-494d-82bd-ea9d5c317cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:29.520289 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2204/4413] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:33:29.528720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a5441-1a4c-4e57-87bf-cb00d81b02f5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:29.528944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a5441-1a4c-4e57-87bf-cb00d81b02f5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:29.529226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a5441-1a4c-4e57-87bf-cb00d81b02f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:29.550056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-986a5441-1a4c-4e57-87bf-cb00d81b02f5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:33:29.551269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-986a5441-1a4c-4e57-87bf-cb00d81b02f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:29.560169 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2210/4414] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:33:29.564543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda65aa2-06d6-494d-82bd-ea9d5c317cbd None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:29.576220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda65aa2-06d6-494d-82bd-ea9d5c317cbd None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:29.581394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f38b2-e171-4d36-84bf-025d1060e1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:29.582180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f38b2-e171-4d36-84bf-025d1060e1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:29.582473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f38b2-e171-4d36-84bf-025d1060e1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:29.582833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f38b2-e171-4d36-84bf-025d1060e1f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:29.583710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f38b2-e171-4d36-84bf-025d1060e1f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:33:29.584090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f38b2-e171-4d36-84bf-025d1060e1f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:29.585933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f38b2-e171-4d36-84bf-025d1060e1f6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:29.598958 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2205/4415] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:33:29.604784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a5441-1a4c-4e57-87bf-cb00d81b02f5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:29.644124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a5441-1a4c-4e57-87bf-cb00d81b02f5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:29.652211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377263c-eb10-4634-b5fa-e06af5346909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:29.653147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377263c-eb10-4634-b5fa-e06af5346909 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:29.653681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377263c-eb10-4634-b5fa-e06af5346909 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:29.653956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377263c-eb10-4634-b5fa-e06af5346909 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:29.654875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377263c-eb10-4634-b5fa-e06af5346909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:29.657175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377263c-eb10-4634-b5fa-e06af5346909 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:29.757816 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2211/4416] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:33:29 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:33:29.761888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f38b2-e171-4d36-84bf-025d1060e1f6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:29.786533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f38b2-e171-4d36-84bf-025d1060e1f6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:29.864158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44814bda-7884-4150-826f-a06acfe8a130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:29.864981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44814bda-7884-4150-826f-a06acfe8a130 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:29.866411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44814bda-7884-4150-826f-a06acfe8a130 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:29.869003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44814bda-7884-4150-826f-a06acfe8a130 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:29.870084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44814bda-7884-4150-826f-a06acfe8a130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:29.872770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44814bda-7884-4150-826f-a06acfe8a130 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:29.994967 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2206/4417] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:33:29 2022] POST /identity/v3/users => generated 292 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:33:29.996244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377263c-eb10-4634-b5fa-e06af5346909 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:30.012053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377263c-eb10-4634-b5fa-e06af5346909 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:30.021082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680cc8d-c216-46d2-aeea-379a553b4ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:30.021082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680cc8d-c216-46d2-aeea-379a553b4ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:30.021082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680cc8d-c216-46d2-aeea-379a553b4ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:30.021082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680cc8d-c216-46d2-aeea-379a553b4ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:30.021758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680cc8d-c216-46d2-aeea-379a553b4ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:30.024485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680cc8d-c216-46d2-aeea-379a553b4ae4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:30.043304 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2212/4418] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:33:30.047299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44814bda-7884-4150-826f-a06acfe8a130 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:30.059763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44814bda-7884-4150-826f-a06acfe8a130 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:30.065298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef3172-4eab-4eb3-9d44-43ed89a222c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:30.066745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef3172-4eab-4eb3-9d44-43ed89a222c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:30.066745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef3172-4eab-4eb3-9d44-43ed89a222c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:30.066745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef3172-4eab-4eb3-9d44-43ed89a222c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:30.067323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef3172-4eab-4eb3-9d44-43ed89a222c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:30.069562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef3172-4eab-4eb3-9d44-43ed89a222c1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:30.097209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680cc8d-c216-46d2-aeea-379a553b4ae4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:30.097556 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2207/4419] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:33:30.101409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680cc8d-c216-46d2-aeea-379a553b4ae4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:30.115105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0396d8a-8e11-42fa-942e-8534dd311eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:30.118554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0396d8a-8e11-42fa-942e-8534dd311eca admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:30.118554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0396d8a-8e11-42fa-942e-8534dd311eca admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:30.118554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0396d8a-8e11-42fa-942e-8534dd311eca admin admin] PATH_INFO: `/v3/projects/acccc99fe3574a59b1b416e67ea040dd/users/68aa28ca960047049d2eab9f3de4543e/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:30.160816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0396d8a-8e11-42fa-942e-8534dd311eca admin admin] RBAC: Authorizing `identity:create_grant(project_id=acccc99fe3574a59b1b416e67ea040dd, user_id=68aa28ca960047049d2eab9f3de4543e, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:30.170043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0396d8a-8e11-42fa-942e-8534dd311eca admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:30.272722 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2213/4420] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:33:30 2022] PUT /identity/v3/projects/acccc99fe3574a59b1b416e67ea040dd/users/68aa28ca960047049d2eab9f3de4543e/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:33:30.289430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4bd0f-bb4f-4542-b824-e63e49e0d038 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:30.289430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4bd0f-bb4f-4542-b824-e63e49e0d038 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:30.289430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4bd0f-bb4f-4542-b824-e63e49e0d038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:30.346113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-99f4bd0f-bb4f-4542-b824-e63e49e0d038 None None] MFA Rules not processed for user `68aa28ca960047049d2eab9f3de4543e`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:33:30.347533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-99f4bd0f-bb4f-4542-b824-e63e49e0d038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:30.474268 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2208/4421] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:33:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:33:30.490808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2d6d3-44a5-4522-a61a-b3b8365a5de8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:30.491279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2d6d3-44a5-4522-a61a-b3b8365a5de8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:30.492083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2d6d3-44a5-4522-a61a-b3b8365a5de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:30.528354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-49d2d6d3-44a5-4522-a61a-b3b8365a5de8 None None] MFA Rules not processed for user `68aa28ca960047049d2eab9f3de4543e`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:33:30.529897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-49d2d6d3-44a5-4522-a61a-b3b8365a5de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:30.544788 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2214/4422] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:33:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:33:30.557110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4bd0f-bb4f-4542-b824-e63e49e0d038 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:30.558825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-99f4bd0f-bb4f-4542-b824-e63e49e0d038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:30.697927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4bd0f-bb4f-4542-b824-e63e49e0d038 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:30.704438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bee381-1117-42cd-b5e4-94993280df0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:30.705502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bee381-1117-42cd-b5e4-94993280df0c service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:30.705950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bee381-1117-42cd-b5e4-94993280df0c service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:30.706410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bee381-1117-42cd-b5e4-94993280df0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:30.717019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bee381-1117-42cd-b5e4-94993280df0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:30.718965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bee381-1117-42cd-b5e4-94993280df0c service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:30.729697 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2209/4423] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:33:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:33:31.153573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2d6d3-44a5-4522-a61a-b3b8365a5de8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:31.155138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-49d2d6d3-44a5-4522-a61a-b3b8365a5de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:31.293724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2d6d3-44a5-4522-a61a-b3b8365a5de8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:31.300866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171bada-4679-42de-adb5-11b241ea7d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:31.302254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171bada-4679-42de-adb5-11b241ea7d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:31.302761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171bada-4679-42de-adb5-11b241ea7d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:31.303280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171bada-4679-42de-adb5-11b241ea7d37 admin admin] PATH_INFO: `/v3/users/087b08c5319d401d85619b5b615923aa` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:31.307260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171bada-4679-42de-adb5-11b241ea7d37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=087b08c5319d401d85619b5b615923aa)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:31.311344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171bada-4679-42de-adb5-11b241ea7d37 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:31.514247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9720cbb-3adf-4212-be44-6efbadd81764 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:31.515083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9720cbb-3adf-4212-be44-6efbadd81764 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:31.515542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9720cbb-3adf-4212-be44-6efbadd81764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:31.540563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b9720cbb-3adf-4212-be44-6efbadd81764 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:33:31.545418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b9720cbb-3adf-4212-be44-6efbadd81764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:31.568165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6171bada-4679-42de-adb5-11b241ea7d37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '087b08c5319d401d85619b5b615923aa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:31.582531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6171bada-4679-42de-adb5-11b241ea7d37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '087b08c5319d401d85619b5b615923aa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:31.583263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6171bada-4679-42de-adb5-11b241ea7d37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '087b08c5319d401d85619b5b615923aa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:31.591634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6171bada-4679-42de-adb5-11b241ea7d37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '087b08c5319d401d85619b5b615923aa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:31.654738 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2210/4424] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:33:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:33:31.732030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6171bada-4679-42de-adb5-11b241ea7d37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '087b08c5319d401d85619b5b615923aa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:31.739768 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2215/4425] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:33:31 2022] DELETE /identity/v3/users/087b08c5319d401d85619b5b615923aa => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:33:31.745811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734c7b9-7c3f-499e-a0ff-298769b7acb5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:31.745811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734c7b9-7c3f-499e-a0ff-298769b7acb5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:31.746112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734c7b9-7c3f-499e-a0ff-298769b7acb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:31.767487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e734c7b9-7c3f-499e-a0ff-298769b7acb5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:33:31.769242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e734c7b9-7c3f-499e-a0ff-298769b7acb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:31.857215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171bada-4679-42de-adb5-11b241ea7d37 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:31.859330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6171bada-4679-42de-adb5-11b241ea7d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:31.860910 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2211/4426] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:33:31.907728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734c7b9-7c3f-499e-a0ff-298769b7acb5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:31.914965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e734c7b9-7c3f-499e-a0ff-298769b7acb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:32.033275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734c7b9-7c3f-499e-a0ff-298769b7acb5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:32.038906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547ab53-cc30-4af2-82f1-d8045a0c139e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:32.039990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547ab53-cc30-4af2-82f1-d8045a0c139e service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:32.040533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547ab53-cc30-4af2-82f1-d8045a0c139e service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:32.041056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547ab53-cc30-4af2-82f1-d8045a0c139e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:32.053618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547ab53-cc30-4af2-82f1-d8045a0c139e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:32.056135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547ab53-cc30-4af2-82f1-d8045a0c139e service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:32.071634 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2212/4427] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:33:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:33:32.076273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171bada-4679-42de-adb5-11b241ea7d37 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:32.092264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c13a4-fe53-4e83-a9a0-353575cdac31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:32.095388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c13a4-fe53-4e83-a9a0-353575cdac31 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:32.095388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c13a4-fe53-4e83-a9a0-353575cdac31 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:32.095388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c13a4-fe53-4e83-a9a0-353575cdac31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:32.098047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-387c13a4-fe53-4e83-a9a0-353575cdac31 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:32.199666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c13a4-fe53-4e83-a9a0-353575cdac31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:32.201431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c13a4-fe53-4e83-a9a0-353575cdac31 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:32.212685 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2216/4428] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:33:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:33:35.031034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547ab53-cc30-4af2-82f1-d8045a0c139e service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:35.037768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f547ab53-cc30-4af2-82f1-d8045a0c139e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:35.076748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547ab53-cc30-4af2-82f1-d8045a0c139e service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:35.105367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195502e-3d6c-45c8-8ab5-426bbd00981f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:35.106466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195502e-3d6c-45c8-8ab5-426bbd00981f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:35.106925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195502e-3d6c-45c8-8ab5-426bbd00981f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:35.107411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195502e-3d6c-45c8-8ab5-426bbd00981f admin admin] PATH_INFO: `/v3/projects/67cc0a5d5e6a452e9991ef89d74248a0` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:35.111420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195502e-3d6c-45c8-8ab5-426bbd00981f admin admin] RBAC: Authorizing `identity:delete_project(project_id=67cc0a5d5e6a452e9991ef89d74248a0)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:35.113641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195502e-3d6c-45c8-8ab5-426bbd00981f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:35.314545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6195502e-3d6c-45c8-8ab5-426bbd00981f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67cc0a5d5e6a452e9991ef89d74248a0', 'request_id': 'req-6195502e-3d6c-45c8-8ab5-426bbd00981f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:35.325965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6195502e-3d6c-45c8-8ab5-426bbd00981f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67cc0a5d5e6a452e9991ef89d74248a0', 'request_id': 'req-6195502e-3d6c-45c8-8ab5-426bbd00981f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:35.394331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6195502e-3d6c-45c8-8ab5-426bbd00981f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67cc0a5d5e6a452e9991ef89d74248a0', 'request_id': 'req-6195502e-3d6c-45c8-8ab5-426bbd00981f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:35.414873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6195502e-3d6c-45c8-8ab5-426bbd00981f admin admin] The token cache is being invalidate because project 67cc0a5d5e6a452e9991ef89d74248a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:33:35.415149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6195502e-3d6c-45c8-8ab5-426bbd00981f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:35.424081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6195502e-3d6c-45c8-8ab5-426bbd00981f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:35.434312 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2213/4429] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:33:35 2022] DELETE /identity/v3/projects/67cc0a5d5e6a452e9991ef89d74248a0 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:33:35.436255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682dc69-bff0-4433-a830-28c49e8b8d2b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:35.437976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682dc69-bff0-4433-a830-28c49e8b8d2b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:35.438439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682dc69-bff0-4433-a830-28c49e8b8d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:35.479070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e682dc69-bff0-4433-a830-28c49e8b8d2b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:33:35.483836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e682dc69-bff0-4433-a830-28c49e8b8d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:35.648945 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2217/4430] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:33:35.657135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21756c-5b86-49ff-953f-ccd113c71357 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:35.657442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21756c-5b86-49ff-953f-ccd113c71357 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:35.658011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21756c-5b86-49ff-953f-ccd113c71357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:35.711651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5e21756c-5b86-49ff-953f-ccd113c71357 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:33:35.719958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5e21756c-5b86-49ff-953f-ccd113c71357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:35.749683 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2214/4431] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:33:35.750915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682dc69-bff0-4433-a830-28c49e8b8d2b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:35.769360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682dc69-bff0-4433-a830-28c49e8b8d2b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:35.782206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e7dfa-a200-4313-9026-5a6af790b055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:35.783134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e7dfa-a200-4313-9026-5a6af790b055 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:35.783643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e7dfa-a200-4313-9026-5a6af790b055 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:35.784138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e7dfa-a200-4313-9026-5a6af790b055 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:35.785275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e7dfa-a200-4313-9026-5a6af790b055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:33:35.785822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e7dfa-a200-4313-9026-5a6af790b055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:35.789340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e7dfa-a200-4313-9026-5a6af790b055 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:35.818957 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2218/4432] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:33:35.823505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21756c-5b86-49ff-953f-ccd113c71357 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:35.836069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21756c-5b86-49ff-953f-ccd113c71357 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:35.842208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b4cf2-b340-4932-8f75-4edffa53b8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:35.843286 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b4cf2-b340-4932-8f75-4edffa53b8c7 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:35.843726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b4cf2-b340-4932-8f75-4edffa53b8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:35.844314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b4cf2-b340-4932-8f75-4edffa53b8c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:35.845680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b4cf2-b340-4932-8f75-4edffa53b8c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:35.847954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b4cf2-b340-4932-8f75-4edffa53b8c7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:35.983943 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2215/4433] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:33:35 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:33:35.985413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e7dfa-a200-4313-9026-5a6af790b055 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:36.003026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e7dfa-a200-4313-9026-5a6af790b055 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:36.152840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15382242-8115-48e7-9fcf-e16c947d4954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:36.154064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15382242-8115-48e7-9fcf-e16c947d4954 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:36.154064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15382242-8115-48e7-9fcf-e16c947d4954 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:36.154402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15382242-8115-48e7-9fcf-e16c947d4954 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:36.155114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15382242-8115-48e7-9fcf-e16c947d4954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:36.158206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15382242-8115-48e7-9fcf-e16c947d4954 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:36.258464 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2219/4434] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:33:35 2022] POST /identity/v3/users => generated 289 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:33:36.262686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b4cf2-b340-4932-8f75-4edffa53b8c7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:36.287325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b4cf2-b340-4932-8f75-4edffa53b8c7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:36.294615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e297df-3123-4bba-b8f9-8c2aeff4ca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:36.297777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e297df-3123-4bba-b8f9-8c2aeff4ca66 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:36.298226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e297df-3123-4bba-b8f9-8c2aeff4ca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:36.302164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e297df-3123-4bba-b8f9-8c2aeff4ca66 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:36.302164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e297df-3123-4bba-b8f9-8c2aeff4ca66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:36.302164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e297df-3123-4bba-b8f9-8c2aeff4ca66 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:36.327677 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2216/4435] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:33:36.336062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15382242-8115-48e7-9fcf-e16c947d4954 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:36.359260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15382242-8115-48e7-9fcf-e16c947d4954 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:36.369097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad5d83-2f1f-44fb-a6f4-e313234a42d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:36.369936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad5d83-2f1f-44fb-a6f4-e313234a42d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:36.375197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad5d83-2f1f-44fb-a6f4-e313234a42d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:36.376332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad5d83-2f1f-44fb-a6f4-e313234a42d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:36.377960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad5d83-2f1f-44fb-a6f4-e313234a42d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:36.384227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad5d83-2f1f-44fb-a6f4-e313234a42d7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:36.421450 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2220/4436] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:33:36.422686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e297df-3123-4bba-b8f9-8c2aeff4ca66 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:36.437463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e297df-3123-4bba-b8f9-8c2aeff4ca66 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:36.457196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb56034-f5e0-4f44-a44c-6ea3785fe60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:36.458714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb56034-f5e0-4f44-a44c-6ea3785fe60b admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:36.459209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb56034-f5e0-4f44-a44c-6ea3785fe60b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:36.459694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb56034-f5e0-4f44-a44c-6ea3785fe60b admin admin] PATH_INFO: `/v3/projects/44303f0df72a46058e13a869110175a6/users/6efa82b4e40e4ac7a4acef8a549147f4/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:36.502687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb56034-f5e0-4f44-a44c-6ea3785fe60b admin admin] RBAC: Authorizing `identity:create_grant(project_id=44303f0df72a46058e13a869110175a6, user_id=6efa82b4e40e4ac7a4acef8a549147f4, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:36.503083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb56034-f5e0-4f44-a44c-6ea3785fe60b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:36.569290 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2217/4437] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:33:36 2022] PUT /identity/v3/projects/44303f0df72a46058e13a869110175a6/users/6efa82b4e40e4ac7a4acef8a549147f4/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:33:36.581088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb199b-a9c3-4b61-be63-9bf64a9bb4f9 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:36.581709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb199b-a9c3-4b61-be63-9bf64a9bb4f9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:36.581709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb199b-a9c3-4b61-be63-9bf64a9bb4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:36.641593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-21fb199b-a9c3-4b61-be63-9bf64a9bb4f9 None None] MFA Rules not processed for user `6efa82b4e40e4ac7a4acef8a549147f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:33:36.643116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-21fb199b-a9c3-4b61-be63-9bf64a9bb4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:36.838607 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2221/4438] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:33:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:33:36.849419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb56034-f5e0-4f44-a44c-6ea3785fe60b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:36.851730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9fb56034-f5e0-4f44-a44c-6ea3785fe60b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:36.995039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb56034-f5e0-4f44-a44c-6ea3785fe60b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:37.017105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e834f9c-0a40-425b-8866-9ca86b2455e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:37.044592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e834f9c-0a40-425b-8866-9ca86b2455e7 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:37.044809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e834f9c-0a40-425b-8866-9ca86b2455e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:37.045100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e834f9c-0a40-425b-8866-9ca86b2455e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:37.057029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e834f9c-0a40-425b-8866-9ca86b2455e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:37.059131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e834f9c-0a40-425b-8866-9ca86b2455e7 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:37.082257 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2218/4439] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:33:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:33:50.793279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb199b-a9c3-4b61-be63-9bf64a9bb4f9 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:50.799424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-21fb199b-a9c3-4b61-be63-9bf64a9bb4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:50.924432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb199b-a9c3-4b61-be63-9bf64a9bb4f9 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:50.930509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32aaf0-7a73-4113-a552-558ec627cec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:50.935476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32aaf0-7a73-4113-a552-558ec627cec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:50.935476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32aaf0-7a73-4113-a552-558ec627cec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:50.935476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32aaf0-7a73-4113-a552-558ec627cec6 admin admin] PATH_INFO: `/v3/users/d11e625d18bd4a5ebeb43464a5c4093c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:50.935476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32aaf0-7a73-4113-a552-558ec627cec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d11e625d18bd4a5ebeb43464a5c4093c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:50.937198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32aaf0-7a73-4113-a552-558ec627cec6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:51.218795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0f32aaf0-7a73-4113-a552-558ec627cec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd11e625d18bd4a5ebeb43464a5c4093c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:51.260400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0f32aaf0-7a73-4113-a552-558ec627cec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd11e625d18bd4a5ebeb43464a5c4093c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:51.263897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0f32aaf0-7a73-4113-a552-558ec627cec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd11e625d18bd4a5ebeb43464a5c4093c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:51.285364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0f32aaf0-7a73-4113-a552-558ec627cec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd11e625d18bd4a5ebeb43464a5c4093c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:51.389313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0f32aaf0-7a73-4113-a552-558ec627cec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd11e625d18bd4a5ebeb43464a5c4093c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:51.399660 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2222/4440] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:33:50 2022] DELETE /identity/v3/users/d11e625d18bd4a5ebeb43464a5c4093c => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:33:52.324207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e834f9c-0a40-425b-8866-9ca86b2455e7 service cinder] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:52.338591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e834f9c-0a40-425b-8866-9ca86b2455e7 service cinder] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:52.460463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236a3a4-bed7-495d-82b5-b4b5a229a311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:52.461541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236a3a4-bed7-495d-82b5-b4b5a229a311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:52.464567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236a3a4-bed7-495d-82b5-b4b5a229a311 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:52.464935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236a3a4-bed7-495d-82b5-b4b5a229a311 admin admin] PATH_INFO: `/v3/projects/b548e2f0a4f24658b983a91d88eaa32b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:52.469450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236a3a4-bed7-495d-82b5-b4b5a229a311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b548e2f0a4f24658b983a91d88eaa32b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:52.471565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236a3a4-bed7-495d-82b5-b4b5a229a311 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:52.695514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e236a3a4-bed7-495d-82b5-b4b5a229a311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b548e2f0a4f24658b983a91d88eaa32b', 'request_id': 'req-e236a3a4-bed7-495d-82b5-b4b5a229a311'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:52.715214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e236a3a4-bed7-495d-82b5-b4b5a229a311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b548e2f0a4f24658b983a91d88eaa32b', 'request_id': 'req-e236a3a4-bed7-495d-82b5-b4b5a229a311'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:52.835032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e236a3a4-bed7-495d-82b5-b4b5a229a311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b548e2f0a4f24658b983a91d88eaa32b', 'request_id': 'req-e236a3a4-bed7-495d-82b5-b4b5a229a311'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:52.856315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e236a3a4-bed7-495d-82b5-b4b5a229a311 admin admin] The token cache is being invalidate because project b548e2f0a4f24658b983a91d88eaa32b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:33:52.857031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e236a3a4-bed7-495d-82b5-b4b5a229a311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:52.858225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e236a3a4-bed7-495d-82b5-b4b5a229a311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:52.860114 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2219/4441] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:33:52 2022] DELETE /identity/v3/projects/b548e2f0a4f24658b983a91d88eaa32b => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:33:52.866422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fcc62-2e6e-46b7-88e7-b782fc0ef3c8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:52.867684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fcc62-2e6e-46b7-88e7-b782fc0ef3c8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:52.867684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fcc62-2e6e-46b7-88e7-b782fc0ef3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:52.926163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-865fcc62-2e6e-46b7-88e7-b782fc0ef3c8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:33:52.931081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-865fcc62-2e6e-46b7-88e7-b782fc0ef3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:53.082771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936715d-bff5-4749-b8bd-9eb97d4005cb None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:53.084154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936715d-bff5-4749-b8bd-9eb97d4005cb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:53.084723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936715d-bff5-4749-b8bd-9eb97d4005cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:53.105469 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2223/4442] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:33:53.139545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e936715d-bff5-4749-b8bd-9eb97d4005cb None None] MFA Rules not processed for user `c337647f0fa340949df8761bceb1bafc`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:33:53.141385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e936715d-bff5-4749-b8bd-9eb97d4005cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:53.184520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e14294-d4ce-4d36-85c3-93f92eb5c2f2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:53.184993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e14294-d4ce-4d36-85c3-93f92eb5c2f2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:53.185416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e14294-d4ce-4d36-85c3-93f92eb5c2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:53.219439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-63e14294-d4ce-4d36-85c3-93f92eb5c2f2 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:33:53.228045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-63e14294-d4ce-4d36-85c3-93f92eb5c2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:53.249135 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2224/4443] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:33:53.252616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e14294-d4ce-4d36-85c3-93f92eb5c2f2 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:53.275941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e14294-d4ce-4d36-85c3-93f92eb5c2f2 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:53.289291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7115f8-006a-4c1d-8bca-ec0fc23e8191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:53.289291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7115f8-006a-4c1d-8bca-ec0fc23e8191 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:53.289291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7115f8-006a-4c1d-8bca-ec0fc23e8191 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:53.290239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7115f8-006a-4c1d-8bca-ec0fc23e8191 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:53.292510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7115f8-006a-4c1d-8bca-ec0fc23e8191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:33:53.292961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7115f8-006a-4c1d-8bca-ec0fc23e8191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:53.294695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7115f8-006a-4c1d-8bca-ec0fc23e8191 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:53.306348 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2220/4444] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:33:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:33:53.315970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903fcc4-8fb2-45e8-beca-900349d380e7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:53.316265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903fcc4-8fb2-45e8-beca-900349d380e7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:53.316550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903fcc4-8fb2-45e8-beca-900349d380e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:53.321812 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2225/4445] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:33:53.328359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7115f8-006a-4c1d-8bca-ec0fc23e8191 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:53.343951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7115f8-006a-4c1d-8bca-ec0fc23e8191 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:53.351619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ed8ad-092e-4d6c-9c80-a1a572f23264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:53.352450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ed8ad-092e-4d6c-9c80-a1a572f23264 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:53.353039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ed8ad-092e-4d6c-9c80-a1a572f23264 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:53.353436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ed8ad-092e-4d6c-9c80-a1a572f23264 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:53.354252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ed8ad-092e-4d6c-9c80-a1a572f23264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:53.357989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ed8ad-092e-4d6c-9c80-a1a572f23264 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:53.373540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d903fcc4-8fb2-45e8-beca-900349d380e7 None None] MFA Rules not processed for user `c337647f0fa340949df8761bceb1bafc`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:33:53.377193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d903fcc4-8fb2-45e8-beca-900349d380e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:53.412344 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2221/4446] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:33:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:33:53.802174 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2226/4447] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:33:53 2022] POST /identity/v3/projects => generated 389 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:33:53.809288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903fcc4-8fb2-45e8-beca-900349d380e7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:53.821517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903fcc4-8fb2-45e8-beca-900349d380e7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:53.899215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7adbf-5602-4e85-9beb-4832b28eb1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:53.900017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7adbf-5602-4e85-9beb-4832b28eb1ea admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:53.900405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7adbf-5602-4e85-9beb-4832b28eb1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:53.900842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7adbf-5602-4e85-9beb-4832b28eb1ea admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:53.902358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a7adbf-5602-4e85-9beb-4832b28eb1ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:53.905245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a7adbf-5602-4e85-9beb-4832b28eb1ea admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:53.971079 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2222/4448] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:33:53 2022] POST /identity/v3/users => generated 295 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:33:53.977654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ed8ad-092e-4d6c-9c80-a1a572f23264 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:54.001340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ed8ad-092e-4d6c-9c80-a1a572f23264 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:54.017767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab9216-5774-4d32-bc7a-dd68f61e70c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:54.018365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab9216-5774-4d32-bc7a-dd68f61e70c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:54.018912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab9216-5774-4d32-bc7a-dd68f61e70c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:54.019191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab9216-5774-4d32-bc7a-dd68f61e70c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:54.019924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab9216-5774-4d32-bc7a-dd68f61e70c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:54.025116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab9216-5774-4d32-bc7a-dd68f61e70c9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:54.055591 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2227/4449] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:33:54.056851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7adbf-5602-4e85-9beb-4832b28eb1ea admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:54.073093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7adbf-5602-4e85-9beb-4832b28eb1ea admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:54.092473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679507b-18c3-4339-b6ee-7cbd22a6a9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:54.093298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679507b-18c3-4339-b6ee-7cbd22a6a9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:54.096564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679507b-18c3-4339-b6ee-7cbd22a6a9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:54.097090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679507b-18c3-4339-b6ee-7cbd22a6a9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:54.101190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679507b-18c3-4339-b6ee-7cbd22a6a9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:54.106898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679507b-18c3-4339-b6ee-7cbd22a6a9e9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:54.138859 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2223/4450] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:33:54.143307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab9216-5774-4d32-bc7a-dd68f61e70c9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:54.159999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab9216-5774-4d32-bc7a-dd68f61e70c9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:54.176041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb6c76-2264-41e7-969e-0ed6318d6d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:54.177255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb6c76-2264-41e7-969e-0ed6318d6d20 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:54.177694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb6c76-2264-41e7-969e-0ed6318d6d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:54.178745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb6c76-2264-41e7-969e-0ed6318d6d20 admin admin] PATH_INFO: `/v3/projects/849913c996ea4611a4317bb4d0136031/users/aa1943e65db34e1da273b41c8a3d2faf/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:54.196294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb6c76-2264-41e7-969e-0ed6318d6d20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=849913c996ea4611a4317bb4d0136031, user_id=aa1943e65db34e1da273b41c8a3d2faf, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:54.210955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb6c76-2264-41e7-969e-0ed6318d6d20 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:54.311016 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2228/4451] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:33:54 2022] PUT /identity/v3/projects/849913c996ea4611a4317bb4d0136031/users/aa1943e65db34e1da273b41c8a3d2faf/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:33:54.318044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6142e-d8e5-436e-8a9d-7abcd299d735 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:54.318346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6142e-d8e5-436e-8a9d-7abcd299d735 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:54.318705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6142e-d8e5-436e-8a9d-7abcd299d735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:54.381827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7ad6142e-d8e5-436e-8a9d-7abcd299d735 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:33:54.383150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7ad6142e-d8e5-436e-8a9d-7abcd299d735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:54.545474 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2224/4452] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:33:54.560362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb6c76-2264-41e7-969e-0ed6318d6d20 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:54.562659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6fbb6c76-2264-41e7-969e-0ed6318d6d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:54.686976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb6c76-2264-41e7-969e-0ed6318d6d20 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:54.691002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820c3d5-4b23-4417-a540-10599fb39509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:54.691938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820c3d5-4b23-4417-a540-10599fb39509 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:54.692445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820c3d5-4b23-4417-a540-10599fb39509 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:54.699867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820c3d5-4b23-4417-a540-10599fb39509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:54.710220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820c3d5-4b23-4417-a540-10599fb39509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:54.712107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820c3d5-4b23-4417-a540-10599fb39509 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:54.724264 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2229/4453] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:33:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:33:58.310363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6142e-d8e5-436e-8a9d-7abcd299d735 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:58.332639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6142e-d8e5-436e-8a9d-7abcd299d735 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:58.360490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1903040-e697-4c5d-9a63-3cd256b584b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:58.361226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1903040-e697-4c5d-9a63-3cd256b584b2 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:58.361495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1903040-e697-4c5d-9a63-3cd256b584b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:58.361779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1903040-e697-4c5d-9a63-3cd256b584b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:58.367530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f1903040-e697-4c5d-9a63-3cd256b584b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:58.539173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1903040-e697-4c5d-9a63-3cd256b584b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:58.541716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1903040-e697-4c5d-9a63-3cd256b584b2 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:58.565869 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2225/4454] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:33:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:33:58.961555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820c3d5-4b23-4417-a540-10599fb39509 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:58.963339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2820c3d5-4b23-4417-a540-10599fb39509 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:58.977864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820c3d5-4b23-4417-a540-10599fb39509 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:58.987773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08756909-24e7-4a5e-a101-6c0e73eaea2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:58.989011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08756909-24e7-4a5e-a101-6c0e73eaea2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:58.993453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08756909-24e7-4a5e-a101-6c0e73eaea2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:58.993997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08756909-24e7-4a5e-a101-6c0e73eaea2c admin admin] PATH_INFO: `/v3/users/6efa82b4e40e4ac7a4acef8a549147f4` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:58.995455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08756909-24e7-4a5e-a101-6c0e73eaea2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6efa82b4e40e4ac7a4acef8a549147f4)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:58.997467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08756909-24e7-4a5e-a101-6c0e73eaea2c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:59.204119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-08756909-24e7-4a5e-a101-6c0e73eaea2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6efa82b4e40e4ac7a4acef8a549147f4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:59.236957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-08756909-24e7-4a5e-a101-6c0e73eaea2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6efa82b4e40e4ac7a4acef8a549147f4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:59.236957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-08756909-24e7-4a5e-a101-6c0e73eaea2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6efa82b4e40e4ac7a4acef8a549147f4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:59.243808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-08756909-24e7-4a5e-a101-6c0e73eaea2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6efa82b4e40e4ac7a4acef8a549147f4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:59.365642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-08756909-24e7-4a5e-a101-6c0e73eaea2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6efa82b4e40e4ac7a4acef8a549147f4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:33:59.381822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8656d1-6668-42f4-a5cc-311a0f013387 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:59.383090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8656d1-6668-42f4-a5cc-311a0f013387 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:59.384198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8656d1-6668-42f4-a5cc-311a0f013387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:59.395108 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2230/4455] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:33:58 2022] DELETE /identity/v3/users/6efa82b4e40e4ac7a4acef8a549147f4 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:33:59.411229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2e8656d1-6668-42f4-a5cc-311a0f013387 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:33:59.413169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2e8656d1-6668-42f4-a5cc-311a0f013387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:59.519428 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2226/4456] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:33:59.549927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08756909-24e7-4a5e-a101-6c0e73eaea2c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:33:59.551774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-08756909-24e7-4a5e-a101-6c0e73eaea2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:33:59.666640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08756909-24e7-4a5e-a101-6c0e73eaea2c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:33:59.670420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c1eef-7958-47b7-a212-09b5c53e4134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:33:59.671117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c1eef-7958-47b7-a212-09b5c53e4134 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:33:59.671402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c1eef-7958-47b7-a212-09b5c53e4134 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:33:59.671690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c1eef-7958-47b7-a212-09b5c53e4134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:33:59.685424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c1eef-7958-47b7-a212-09b5c53e4134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:33:59.686886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c1eef-7958-47b7-a212-09b5c53e4134 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:33:59.698158 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2231/4457] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:33:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:34:01.527776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8656d1-6668-42f4-a5cc-311a0f013387 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:01.529477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2e8656d1-6668-42f4-a5cc-311a0f013387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:01.556497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8656d1-6668-42f4-a5cc-311a0f013387 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:01.578581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e70ff5-4b45-48e7-8c97-d479adc12a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:01.582257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e70ff5-4b45-48e7-8c97-d479adc12a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:01.584007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e70ff5-4b45-48e7-8c97-d479adc12a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:01.585047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e70ff5-4b45-48e7-8c97-d479adc12a82 admin admin] PATH_INFO: `/v3/projects/44303f0df72a46058e13a869110175a6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:01.589721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e70ff5-4b45-48e7-8c97-d479adc12a82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44303f0df72a46058e13a869110175a6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:01.601461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e70ff5-4b45-48e7-8c97-d479adc12a82 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:01.696786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b0e70ff5-4b45-48e7-8c97-d479adc12a82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44303f0df72a46058e13a869110175a6', 'request_id': 'req-b0e70ff5-4b45-48e7-8c97-d479adc12a82'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:01.710863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b0e70ff5-4b45-48e7-8c97-d479adc12a82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44303f0df72a46058e13a869110175a6', 'request_id': 'req-b0e70ff5-4b45-48e7-8c97-d479adc12a82'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:01.788480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b0e70ff5-4b45-48e7-8c97-d479adc12a82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44303f0df72a46058e13a869110175a6', 'request_id': 'req-b0e70ff5-4b45-48e7-8c97-d479adc12a82'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:01.808870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b0e70ff5-4b45-48e7-8c97-d479adc12a82 admin admin] The token cache is being invalidate because project 44303f0df72a46058e13a869110175a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:34:01.809297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b0e70ff5-4b45-48e7-8c97-d479adc12a82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:01.819360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b0e70ff5-4b45-48e7-8c97-d479adc12a82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:01.831841 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2227/4458] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:34:01 2022] DELETE /identity/v3/projects/44303f0df72a46058e13a869110175a6 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:34:01.833908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f22f1-0919-4924-8b97-91dc53e92269 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:01.835402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f22f1-0919-4924-8b97-91dc53e92269 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:01.835859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f22f1-0919-4924-8b97-91dc53e92269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:01.907246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-706f22f1-0919-4924-8b97-91dc53e92269 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:01.908799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-706f22f1-0919-4924-8b97-91dc53e92269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:02.160736 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2232/4459] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:02.166517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f0c0a-34fd-43c0-9446-7e12540dd79e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:02.167178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f0c0a-34fd-43c0-9446-7e12540dd79e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:02.167481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f0c0a-34fd-43c0-9446-7e12540dd79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:02.233222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4c6f0c0a-34fd-43c0-9446-7e12540dd79e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:02.241459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4c6f0c0a-34fd-43c0-9446-7e12540dd79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:02.301653 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2228/4460] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:02.303395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f22f1-0919-4924-8b97-91dc53e92269 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:02.324140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f22f1-0919-4924-8b97-91dc53e92269 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:02.341775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a17a8c-ab9e-4edd-9a74-232a8bcb3a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:02.347726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a17a8c-ab9e-4edd-9a74-232a8bcb3a93 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:02.348496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a17a8c-ab9e-4edd-9a74-232a8bcb3a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:02.349047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a17a8c-ab9e-4edd-9a74-232a8bcb3a93 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:02.354969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a17a8c-ab9e-4edd-9a74-232a8bcb3a93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:34:02.358743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a17a8c-ab9e-4edd-9a74-232a8bcb3a93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:02.363378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a17a8c-ab9e-4edd-9a74-232a8bcb3a93 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:02.406196 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2233/4461] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:34:02.411255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f0c0a-34fd-43c0-9446-7e12540dd79e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:02.422419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f0c0a-34fd-43c0-9446-7e12540dd79e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:02.443388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397c04a-d2a0-49d2-b556-02dcce0f47d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:02.444086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397c04a-d2a0-49d2-b556-02dcce0f47d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:02.444375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397c04a-d2a0-49d2-b556-02dcce0f47d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:02.444691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397c04a-d2a0-49d2-b556-02dcce0f47d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:02.445411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397c04a-d2a0-49d2-b556-02dcce0f47d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:02.447917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397c04a-d2a0-49d2-b556-02dcce0f47d5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:02.636138 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2229/4462] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:34:02 2022] POST /identity/v3/projects => generated 375 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:34:02.640809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a17a8c-ab9e-4edd-9a74-232a8bcb3a93 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:02.653091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a17a8c-ab9e-4edd-9a74-232a8bcb3a93 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:02.791902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54ee52-60da-4b98-bc0f-b22f3f36811b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:02.793302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54ee52-60da-4b98-bc0f-b22f3f36811b admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:02.793815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54ee52-60da-4b98-bc0f-b22f3f36811b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:02.795308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54ee52-60da-4b98-bc0f-b22f3f36811b admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:02.796444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54ee52-60da-4b98-bc0f-b22f3f36811b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:02.798986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54ee52-60da-4b98-bc0f-b22f3f36811b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:02.900296 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2234/4463] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:34:02 2022] POST /identity/v3/users => generated 288 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:34:02.904573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397c04a-d2a0-49d2-b556-02dcce0f47d5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:02.935248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397c04a-d2a0-49d2-b556-02dcce0f47d5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:02.945959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439bb67-3022-445c-a34b-a419761a4f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:02.976472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439bb67-3022-445c-a34b-a419761a4f76 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:02.977033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439bb67-3022-445c-a34b-a419761a4f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:02.977978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439bb67-3022-445c-a34b-a419761a4f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:02.979264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439bb67-3022-445c-a34b-a419761a4f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:02.991133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439bb67-3022-445c-a34b-a419761a4f76 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:03.031936 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2230/4464] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:34:03.043094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54ee52-60da-4b98-bc0f-b22f3f36811b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:03.054041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54ee52-60da-4b98-bc0f-b22f3f36811b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:03.069535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95ccf5-7379-432f-b30a-491a1d8b86cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:03.070235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95ccf5-7379-432f-b30a-491a1d8b86cf admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:03.073971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95ccf5-7379-432f-b30a-491a1d8b86cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:03.074556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95ccf5-7379-432f-b30a-491a1d8b86cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:03.076741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95ccf5-7379-432f-b30a-491a1d8b86cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:03.079806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95ccf5-7379-432f-b30a-491a1d8b86cf admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:03.125590 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2235/4465] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:34:03.129085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439bb67-3022-445c-a34b-a419761a4f76 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:03.147485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439bb67-3022-445c-a34b-a419761a4f76 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:03.173421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a88ce-fcfc-4fff-a078-ca61ba98f3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:03.174418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a88ce-fcfc-4fff-a078-ca61ba98f3a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:03.174714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a88ce-fcfc-4fff-a078-ca61ba98f3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:03.175005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a88ce-fcfc-4fff-a078-ca61ba98f3a0 admin admin] PATH_INFO: `/v3/projects/58aa2745261044759f71e557f5c3808f/users/7d95ecff0c864990a2fce75a398874e4/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:03.243461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a88ce-fcfc-4fff-a078-ca61ba98f3a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58aa2745261044759f71e557f5c3808f, user_id=7d95ecff0c864990a2fce75a398874e4, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:03.243572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a88ce-fcfc-4fff-a078-ca61ba98f3a0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:03.332226 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2231/4466] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:34:03 2022] PUT /identity/v3/projects/58aa2745261044759f71e557f5c3808f/users/7d95ecff0c864990a2fce75a398874e4/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:34:03.347220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ebf88-4b9a-43f2-adbf-1c45ddc1151a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:03.347534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ebf88-4b9a-43f2-adbf-1c45ddc1151a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:03.347868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ebf88-4b9a-43f2-adbf-1c45ddc1151a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:03.387807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-cc4ebf88-4b9a-43f2-adbf-1c45ddc1151a None None] MFA Rules not processed for user `7d95ecff0c864990a2fce75a398874e4`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:03.389247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-cc4ebf88-4b9a-43f2-adbf-1c45ddc1151a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:03.541462 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2236/4467] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:34:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:03.549679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a88ce-fcfc-4fff-a078-ca61ba98f3a0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:03.553222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-058a88ce-fcfc-4fff-a078-ca61ba98f3a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:03.656718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a88ce-fcfc-4fff-a078-ca61ba98f3a0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:03.668510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad78a9-5cf0-42ba-b56a-aa6a5424246f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:03.668510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad78a9-5cf0-42ba-b56a-aa6a5424246f service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:03.673317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad78a9-5cf0-42ba-b56a-aa6a5424246f service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:03.673624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad78a9-5cf0-42ba-b56a-aa6a5424246f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:03.699039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad78a9-5cf0-42ba-b56a-aa6a5424246f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:03.700533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad78a9-5cf0-42ba-b56a-aa6a5424246f service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:03.728501 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2232/4468] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:34:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:34:04.454172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ebf88-4b9a-43f2-adbf-1c45ddc1151a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:04.455864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-cc4ebf88-4b9a-43f2-adbf-1c45ddc1151a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:04.649978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ebf88-4b9a-43f2-adbf-1c45ddc1151a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:04.657957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afc397-71c8-42b7-b5c6-fc6a01ca40d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:04.659249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afc397-71c8-42b7-b5c6-fc6a01ca40d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:04.659760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afc397-71c8-42b7-b5c6-fc6a01ca40d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:04.660315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afc397-71c8-42b7-b5c6-fc6a01ca40d6 admin admin] PATH_INFO: `/v3/users/ac7a59b2974d49b0ac50e3885c6a3ef9` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:04.667594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afc397-71c8-42b7-b5c6-fc6a01ca40d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac7a59b2974d49b0ac50e3885c6a3ef9)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:04.670912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afc397-71c8-42b7-b5c6-fc6a01ca40d6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:04.933683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e8afc397-71c8-42b7-b5c6-fc6a01ca40d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac7a59b2974d49b0ac50e3885c6a3ef9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:04.962325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e8afc397-71c8-42b7-b5c6-fc6a01ca40d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac7a59b2974d49b0ac50e3885c6a3ef9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:04.963455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e8afc397-71c8-42b7-b5c6-fc6a01ca40d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac7a59b2974d49b0ac50e3885c6a3ef9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:04.995201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e8afc397-71c8-42b7-b5c6-fc6a01ca40d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac7a59b2974d49b0ac50e3885c6a3ef9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:05.063734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e8afc397-71c8-42b7-b5c6-fc6a01ca40d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac7a59b2974d49b0ac50e3885c6a3ef9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:05.075387 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2237/4469] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:34:04 2022] DELETE /identity/v3/users/ac7a59b2974d49b0ac50e3885c6a3ef9 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:34:06.024074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad78a9-5cf0-42ba-b56a-aa6a5424246f service cinder] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:06.025100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9fad78a9-5cf0-42ba-b56a-aa6a5424246f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:06.167601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad78a9-5cf0-42ba-b56a-aa6a5424246f service cinder] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:06.305670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d25e3-3af0-439e-a6b5-6d3314bedbde service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:06.312171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d25e3-3af0-439e-a6b5-6d3314bedbde service glance] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:06.312171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d25e3-3af0-439e-a6b5-6d3314bedbde service glance] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:06.312171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d25e3-3af0-439e-a6b5-6d3314bedbde service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:06.312171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-569d25e3-3af0-439e-a6b5-6d3314bedbde service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:06.507087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d25e3-3af0-439e-a6b5-6d3314bedbde service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:06.508575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d25e3-3af0-439e-a6b5-6d3314bedbde service glance] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:06.536304 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2233/4470] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:34:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:34:06.784037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afc397-71c8-42b7-b5c6-fc6a01ca40d6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:06.786049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e8afc397-71c8-42b7-b5c6-fc6a01ca40d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:06.960787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d25e3-3af0-439e-a6b5-6d3314bedbde service glance] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:06.963093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-569d25e3-3af0-439e-a6b5-6d3314bedbde service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:07.021766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afc397-71c8-42b7-b5c6-fc6a01ca40d6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:07.027891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515dbfc-8bad-47ff-92bb-4b9ef8526bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:07.029063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515dbfc-8bad-47ff-92bb-4b9ef8526bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:07.029509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515dbfc-8bad-47ff-92bb-4b9ef8526bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:07.029930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515dbfc-8bad-47ff-92bb-4b9ef8526bf5 admin admin] PATH_INFO: `/v3/projects/620e47e300b7498a87384c30546dcb18` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:07.031322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515dbfc-8bad-47ff-92bb-4b9ef8526bf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=620e47e300b7498a87384c30546dcb18)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:07.033682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515dbfc-8bad-47ff-92bb-4b9ef8526bf5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:07.150635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d25e3-3af0-439e-a6b5-6d3314bedbde service glance] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:07.173389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0c932-f11c-462a-8bc9-98bee6818333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:07.174620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0c932-f11c-462a-8bc9-98bee6818333 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:07.175067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0c932-f11c-462a-8bc9-98bee6818333 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:07.175636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0c932-f11c-462a-8bc9-98bee6818333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:07.178175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-41b0c932-f11c-462a-8bc9-98bee6818333 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:07.202647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5515dbfc-8bad-47ff-92bb-4b9ef8526bf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '620e47e300b7498a87384c30546dcb18', 'request_id': 'req-5515dbfc-8bad-47ff-92bb-4b9ef8526bf5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:07.214317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0c932-f11c-462a-8bc9-98bee6818333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:07.218525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0c932-f11c-462a-8bc9-98bee6818333 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:07.262697 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2234/4471] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:34:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:34:07.265954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50aa045-8f8c-4a2a-8cb0-7d41dc52209c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:07.269755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50aa045-8f8c-4a2a-8cb0-7d41dc52209c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:07.272667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50aa045-8f8c-4a2a-8cb0-7d41dc52209c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:07.297991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5515dbfc-8bad-47ff-92bb-4b9ef8526bf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '620e47e300b7498a87384c30546dcb18', 'request_id': 'req-5515dbfc-8bad-47ff-92bb-4b9ef8526bf5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:07.306495 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5515dbfc-8bad-47ff-92bb-4b9ef8526bf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '620e47e300b7498a87384c30546dcb18', 'request_id': 'req-5515dbfc-8bad-47ff-92bb-4b9ef8526bf5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:07.338412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5515dbfc-8bad-47ff-92bb-4b9ef8526bf5 admin admin] The token cache is being invalidate because project 620e47e300b7498a87384c30546dcb18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:34:07.338708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5515dbfc-8bad-47ff-92bb-4b9ef8526bf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:07.339780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b50aa045-8f8c-4a2a-8cb0-7d41dc52209c None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:07.341069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b50aa045-8f8c-4a2a-8cb0-7d41dc52209c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:07.348940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5515dbfc-8bad-47ff-92bb-4b9ef8526bf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:07.352795 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2238/4472] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:34:06 2022] DELETE /identity/v3/projects/620e47e300b7498a87384c30546dcb18 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:34:07.363874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ad3a6-6b61-4bc3-a46b-7eef69eedc8d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:07.364425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ad3a6-6b61-4bc3-a46b-7eef69eedc8d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:07.371098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ad3a6-6b61-4bc3-a46b-7eef69eedc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:07.409721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-707ad3a6-6b61-4bc3-a46b-7eef69eedc8d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:07.411127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-707ad3a6-6b61-4bc3-a46b-7eef69eedc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:07.539375 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2235/4473] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:34:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:07.562128 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2239/4474] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:34:07.563736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a6d93-232f-4c5c-b752-d6345b5668ba None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:07.564036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a6d93-232f-4c5c-b752-d6345b5668ba None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:07.564308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a6d93-232f-4c5c-b752-d6345b5668ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:07.572797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ad3a6-6b61-4bc3-a46b-7eef69eedc8d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:07.575809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-707ad3a6-6b61-4bc3-a46b-7eef69eedc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:07.596473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-bf3a6d93-232f-4c5c-b752-d6345b5668ba None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:07.599310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bf3a6d93-232f-4c5c-b752-d6345b5668ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:07.638020 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2236/4475] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:07.641810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a6d93-232f-4c5c-b752-d6345b5668ba None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:07.672542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a6d93-232f-4c5c-b752-d6345b5668ba None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:07.686922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910bd5e-1e4f-46f3-a213-e82aed3ba3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:07.688311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910bd5e-1e4f-46f3-a213-e82aed3ba3dd admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:07.688629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910bd5e-1e4f-46f3-a213-e82aed3ba3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:07.688893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910bd5e-1e4f-46f3-a213-e82aed3ba3dd admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:07.693531 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910bd5e-1e4f-46f3-a213-e82aed3ba3dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:34:07.696013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910bd5e-1e4f-46f3-a213-e82aed3ba3dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:07.704644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910bd5e-1e4f-46f3-a213-e82aed3ba3dd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:07.751796 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2237/4476] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:34:07.754642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ad3a6-6b61-4bc3-a46b-7eef69eedc8d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:07.755235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910bd5e-1e4f-46f3-a213-e82aed3ba3dd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:07.767920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd810f-e6af-4b5e-bba0-5fb5ae56804e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:07.768626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd810f-e6af-4b5e-bba0-5fb5ae56804e service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:07.769010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd810f-e6af-4b5e-bba0-5fb5ae56804e service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:07.769189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd810f-e6af-4b5e-bba0-5fb5ae56804e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:07.787348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd810f-e6af-4b5e-bba0-5fb5ae56804e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:07.788999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd810f-e6af-4b5e-bba0-5fb5ae56804e service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:07.802153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910bd5e-1e4f-46f3-a213-e82aed3ba3dd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:07.824152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd701e41-d93e-41ef-8898-4d5aafb5ff2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:07.824865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd701e41-d93e-41ef-8898-4d5aafb5ff2c admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:07.826700 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2240/4477] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:34:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:34:07.826837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd701e41-d93e-41ef-8898-4d5aafb5ff2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:07.827001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd701e41-d93e-41ef-8898-4d5aafb5ff2c admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:07.829040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd701e41-d93e-41ef-8898-4d5aafb5ff2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:07.845913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd701e41-d93e-41ef-8898-4d5aafb5ff2c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:07.981217 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2238/4478] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:34:07 2022] POST /identity/v3/projects => generated 389 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:34:07.986987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd810f-e6af-4b5e-bba0-5fb5ae56804e service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:08.015564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd810f-e6af-4b5e-bba0-5fb5ae56804e service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:08.325233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7429e4e-a8cf-496d-9e74-3eb3c4c94408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:08.326201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7429e4e-a8cf-496d-9e74-3eb3c4c94408 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:08.326644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7429e4e-a8cf-496d-9e74-3eb3c4c94408 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:08.327077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7429e4e-a8cf-496d-9e74-3eb3c4c94408 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:08.328478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7429e4e-a8cf-496d-9e74-3eb3c4c94408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:08.334910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7429e4e-a8cf-496d-9e74-3eb3c4c94408 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:08.455727 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2241/4479] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:34:07 2022] POST /identity/v3/users => generated 295 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:34:08.456342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd701e41-d93e-41ef-8898-4d5aafb5ff2c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:08.474099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd701e41-d93e-41ef-8898-4d5aafb5ff2c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:08.489221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0d3ae-a7f1-4d8a-843c-9620b73a05eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:08.489996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0d3ae-a7f1-4d8a-843c-9620b73a05eb admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:08.490798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0d3ae-a7f1-4d8a-843c-9620b73a05eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:08.491075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0d3ae-a7f1-4d8a-843c-9620b73a05eb admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:08.491810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0d3ae-a7f1-4d8a-843c-9620b73a05eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:08.501331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0d3ae-a7f1-4d8a-843c-9620b73a05eb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:08.536425 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2239/4480] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:34:08.538253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7429e4e-a8cf-496d-9e74-3eb3c4c94408 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:08.564834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7429e4e-a8cf-496d-9e74-3eb3c4c94408 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:08.578473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e386796-db1b-45d4-a63d-fef3fd7e6b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:08.583359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e386796-db1b-45d4-a63d-fef3fd7e6b6b admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:08.583359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e386796-db1b-45d4-a63d-fef3fd7e6b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:08.583359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e386796-db1b-45d4-a63d-fef3fd7e6b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:08.583359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e386796-db1b-45d4-a63d-fef3fd7e6b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:08.586812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e386796-db1b-45d4-a63d-fef3fd7e6b6b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:08.616726 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2242/4481] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:34:08.618949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0d3ae-a7f1-4d8a-843c-9620b73a05eb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:08.630833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0d3ae-a7f1-4d8a-843c-9620b73a05eb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:08.636219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e76580-6bb9-42a3-b85a-dc9cee24a50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:08.637359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e76580-6bb9-42a3-b85a-dc9cee24a50f admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:08.638172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e76580-6bb9-42a3-b85a-dc9cee24a50f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:08.638462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e76580-6bb9-42a3-b85a-dc9cee24a50f admin admin] PATH_INFO: `/v3/projects/00e2e106852b47f7a8e76aab24c5e883/users/11570d45e8de428fa751c85b80b673e4/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:08.658954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e76580-6bb9-42a3-b85a-dc9cee24a50f admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e2e106852b47f7a8e76aab24c5e883, user_id=11570d45e8de428fa751c85b80b673e4, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:08.667305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e76580-6bb9-42a3-b85a-dc9cee24a50f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:08.787702 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2240/4482] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:34:08 2022] PUT /identity/v3/projects/00e2e106852b47f7a8e76aab24c5e883/users/11570d45e8de428fa751c85b80b673e4/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:34:08.791490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f645751-30b7-4b50-87b7-78eefa4d4489 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:08.792504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f645751-30b7-4b50-87b7-78eefa4d4489 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:08.796286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f645751-30b7-4b50-87b7-78eefa4d4489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:08.824394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-5f645751-30b7-4b50-87b7-78eefa4d4489 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:08.826159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5f645751-30b7-4b50-87b7-78eefa4d4489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:08.921106 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2243/4483] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:09.074125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e76580-6bb9-42a3-b85a-dc9cee24a50f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:09.076098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-62e76580-6bb9-42a3-b85a-dc9cee24a50f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:09.118041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f645751-30b7-4b50-87b7-78eefa4d4489 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:09.120479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5f645751-30b7-4b50-87b7-78eefa4d4489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:09.251589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e76580-6bb9-42a3-b85a-dc9cee24a50f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:09.262034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b58f5d-d816-40ee-bce2-ded614a19af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:09.263016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b58f5d-d816-40ee-bce2-ded614a19af8 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:09.263449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b58f5d-d816-40ee-bce2-ded614a19af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:09.263898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b58f5d-d816-40ee-bce2-ded614a19af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:09.274305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-64b58f5d-d816-40ee-bce2-ded614a19af8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:09.285033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f645751-30b7-4b50-87b7-78eefa4d4489 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:09.295718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fb992-cff5-4328-a16b-a9624fcd5b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:09.297701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fb992-cff5-4328-a16b-a9624fcd5b0e service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:09.299189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fb992-cff5-4328-a16b-a9624fcd5b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:09.299980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fb992-cff5-4328-a16b-a9624fcd5b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:09.342990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fb992-cff5-4328-a16b-a9624fcd5b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:09.344530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fb992-cff5-4328-a16b-a9624fcd5b0e service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:09.359666 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2244/4484] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:34:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:34:09.441855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b58f5d-d816-40ee-bce2-ded614a19af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:09.443852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b58f5d-d816-40ee-bce2-ded614a19af8 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:09.462653 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2241/4485] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:34:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:34:14.803796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fb992-cff5-4328-a16b-a9624fcd5b0e service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:14.805445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-956fb992-cff5-4328-a16b-a9624fcd5b0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:14.853433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fb992-cff5-4328-a16b-a9624fcd5b0e service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:14.866340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a92726-3d32-43ed-9369-34e13d39ed58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:14.867566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a92726-3d32-43ed-9369-34e13d39ed58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:14.868036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a92726-3d32-43ed-9369-34e13d39ed58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:14.868482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a92726-3d32-43ed-9369-34e13d39ed58 admin admin] PATH_INFO: `/v3/users/7d95ecff0c864990a2fce75a398874e4` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:14.872289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a92726-3d32-43ed-9369-34e13d39ed58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d95ecff0c864990a2fce75a398874e4)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:14.879435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a92726-3d32-43ed-9369-34e13d39ed58 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:15.197062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-71a92726-3d32-43ed-9369-34e13d39ed58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d95ecff0c864990a2fce75a398874e4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:15.231509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-71a92726-3d32-43ed-9369-34e13d39ed58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d95ecff0c864990a2fce75a398874e4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:15.231509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-71a92726-3d32-43ed-9369-34e13d39ed58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d95ecff0c864990a2fce75a398874e4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:15.242094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-71a92726-3d32-43ed-9369-34e13d39ed58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d95ecff0c864990a2fce75a398874e4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:15.308828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-71a92726-3d32-43ed-9369-34e13d39ed58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d95ecff0c864990a2fce75a398874e4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:15.329207 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2245/4486] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:34:14 2022] DELETE /identity/v3/users/7d95ecff0c864990a2fce75a398874e4 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:34:15.333629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d843620-3087-4215-a21f-7c863fd913f0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:15.334199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d843620-3087-4215-a21f-7c863fd913f0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:15.334199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d843620-3087-4215-a21f-7c863fd913f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:15.393950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7d843620-3087-4215-a21f-7c863fd913f0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:15.395193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7d843620-3087-4215-a21f-7c863fd913f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:15.550104 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2242/4487] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:15.629267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a92726-3d32-43ed-9369-34e13d39ed58 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:15.630869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-71a92726-3d32-43ed-9369-34e13d39ed58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:15.651779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d843620-3087-4215-a21f-7c863fd913f0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:15.654494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7d843620-3087-4215-a21f-7c863fd913f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:15.676729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d843620-3087-4215-a21f-7c863fd913f0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:15.687389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e7d45-5105-4c89-8602-7a20e9532f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:15.688646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e7d45-5105-4c89-8602-7a20e9532f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:15.689394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e7d45-5105-4c89-8602-7a20e9532f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:15.690469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e7d45-5105-4c89-8602-7a20e9532f13 admin admin] PATH_INFO: `/v3/users/e3d3dea2740e4e46ae98265dcade1291` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:15.696273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e7d45-5105-4c89-8602-7a20e9532f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d3dea2740e4e46ae98265dcade1291)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:15.698605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e7d45-5105-4c89-8602-7a20e9532f13 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:15.787808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a92726-3d32-43ed-9369-34e13d39ed58 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:15.798563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b6736-dd2b-4575-abb0-9a873dfe3f46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:15.799735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b6736-dd2b-4575-abb0-9a873dfe3f46 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:15.800042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b6736-dd2b-4575-abb0-9a873dfe3f46 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:15.803030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b6736-dd2b-4575-abb0-9a873dfe3f46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:15.827573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b6736-dd2b-4575-abb0-9a873dfe3f46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:15.829084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b6736-dd2b-4575-abb0-9a873dfe3f46 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:15.856757 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2246/4488] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:34:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:34:15.962721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-069e7d45-5105-4c89-8602-7a20e9532f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d3dea2740e4e46ae98265dcade1291'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:15.996419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-069e7d45-5105-4c89-8602-7a20e9532f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d3dea2740e4e46ae98265dcade1291'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:15.998140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-069e7d45-5105-4c89-8602-7a20e9532f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d3dea2740e4e46ae98265dcade1291'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:16.011827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-069e7d45-5105-4c89-8602-7a20e9532f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d3dea2740e4e46ae98265dcade1291'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:16.097907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-069e7d45-5105-4c89-8602-7a20e9532f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d3dea2740e4e46ae98265dcade1291'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:16.116443 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2243/4489] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:34:15 2022] DELETE /identity/v3/users/e3d3dea2740e4e46ae98265dcade1291 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:34:16.409584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387eb41-0109-4099-9e76-ed769ff61ed2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:16.409912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387eb41-0109-4099-9e76-ed769ff61ed2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:16.410204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387eb41-0109-4099-9e76-ed769ff61ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:16.472544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2387eb41-0109-4099-9e76-ed769ff61ed2 None None] MFA Rules not processed for user `aa1943e65db34e1da273b41c8a3d2faf`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:16.478080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2387eb41-0109-4099-9e76-ed769ff61ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:16.628949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18102af-3216-4185-9831-1744d4676cfb None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:16.629557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18102af-3216-4185-9831-1744d4676cfb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:16.629557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18102af-3216-4185-9831-1744d4676cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:16.632318 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2247/4490] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:34:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:16.653370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d18102af-3216-4185-9831-1744d4676cfb None None] MFA Rules not processed for user `aa1943e65db34e1da273b41c8a3d2faf`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:16.654885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d18102af-3216-4185-9831-1744d4676cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:16.665029 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2244/4491] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:34:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:16.676424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387eb41-0109-4099-9e76-ed769ff61ed2 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:16.686418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2387eb41-0109-4099-9e76-ed769ff61ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:16.902159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387eb41-0109-4099-9e76-ed769ff61ed2 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:16.914682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd7bbf-7175-4c2f-afc6-7d797b496fa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:16.915359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd7bbf-7175-4c2f-afc6-7d797b496fa5 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:16.915643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd7bbf-7175-4c2f-afc6-7d797b496fa5 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:16.915921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd7bbf-7175-4c2f-afc6-7d797b496fa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:16.934980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd7bbf-7175-4c2f-afc6-7d797b496fa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:16.938662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd7bbf-7175-4c2f-afc6-7d797b496fa5 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:16.966622 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2248/4492] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:34:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:34:17.595102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18102af-3216-4185-9831-1744d4676cfb None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:17.596972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d18102af-3216-4185-9831-1744d4676cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:17.833234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18102af-3216-4185-9831-1744d4676cfb None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:17.842950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970febc-6fec-4da3-a981-bb3c3d6ba0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:17.845017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970febc-6fec-4da3-a981-bb3c3d6ba0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:17.845523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970febc-6fec-4da3-a981-bb3c3d6ba0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:17.846003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970febc-6fec-4da3-a981-bb3c3d6ba0ce admin admin] PATH_INFO: `/v3/projects/6c7bd47feb9549daaf4d186085f8d171` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:17.848141 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970febc-6fec-4da3-a981-bb3c3d6ba0ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c7bd47feb9549daaf4d186085f8d171)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:17.850830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970febc-6fec-4da3-a981-bb3c3d6ba0ce admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:18.098828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd7bbf-7175-4c2f-afc6-7d797b496fa5 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:18.098828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6bbd7bbf-7175-4c2f-afc6-7d797b496fa5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:18.118113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd7bbf-7175-4c2f-afc6-7d797b496fa5 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:18.126716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f970febc-6fec-4da3-a981-bb3c3d6ba0ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c7bd47feb9549daaf4d186085f8d171', 'request_id': 'req-f970febc-6fec-4da3-a981-bb3c3d6ba0ce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:18.134699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f970febc-6fec-4da3-a981-bb3c3d6ba0ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c7bd47feb9549daaf4d186085f8d171', 'request_id': 'req-f970febc-6fec-4da3-a981-bb3c3d6ba0ce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:18.216470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecca94f-2107-452a-8247-a3adc18ccd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:18.218537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecca94f-2107-452a-8247-a3adc18ccd56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:18.219075 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecca94f-2107-452a-8247-a3adc18ccd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:18.219576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecca94f-2107-452a-8247-a3adc18ccd56 admin admin] PATH_INFO: `/v3/projects/58aa2745261044759f71e557f5c3808f` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:18.221120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecca94f-2107-452a-8247-a3adc18ccd56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58aa2745261044759f71e557f5c3808f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:18.223564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecca94f-2107-452a-8247-a3adc18ccd56 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:18.316754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f970febc-6fec-4da3-a981-bb3c3d6ba0ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c7bd47feb9549daaf4d186085f8d171', 'request_id': 'req-f970febc-6fec-4da3-a981-bb3c3d6ba0ce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:18.347436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f970febc-6fec-4da3-a981-bb3c3d6ba0ce admin admin] The token cache is being invalidate because project 6c7bd47feb9549daaf4d186085f8d171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:34:18.347798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f970febc-6fec-4da3-a981-bb3c3d6ba0ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:18.348880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f970febc-6fec-4da3-a981-bb3c3d6ba0ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:18.353639 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2245/4493] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:34:17 2022] DELETE /identity/v3/projects/6c7bd47feb9549daaf4d186085f8d171 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:34:18.366884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2ddc0-27ae-4dc1-83a0-b92b1bdaa597 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:18.367184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2ddc0-27ae-4dc1-83a0-b92b1bdaa597 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:18.384100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2ddc0-27ae-4dc1-83a0-b92b1bdaa597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:18.384224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6ecca94f-2107-452a-8247-a3adc18ccd56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58aa2745261044759f71e557f5c3808f', 'request_id': 'req-6ecca94f-2107-452a-8247-a3adc18ccd56'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:18.400791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-82e2ddc0-27ae-4dc1-83a0-b92b1bdaa597 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:18.409239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-82e2ddc0-27ae-4dc1-83a0-b92b1bdaa597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:18.517456 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2246/4494] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:34:18.525172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7992665-ef09-48dd-aca8-7119653f1f7b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:18.526287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7992665-ef09-48dd-aca8-7119653f1f7b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:18.526682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7992665-ef09-48dd-aca8-7119653f1f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:18.549682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f7992665-ef09-48dd-aca8-7119653f1f7b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:18.551066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f7992665-ef09-48dd-aca8-7119653f1f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:18.563646 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2247/4495] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:34:18.569319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7992665-ef09-48dd-aca8-7119653f1f7b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:18.580249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7992665-ef09-48dd-aca8-7119653f1f7b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:18.586593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1ab46-b998-4d63-a9c5-39a3efa0fd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:18.587429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1ab46-b998-4d63-a9c5-39a3efa0fd77 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:18.587812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1ab46-b998-4d63-a9c5-39a3efa0fd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:18.588188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1ab46-b998-4d63-a9c5-39a3efa0fd77 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:18.589075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1ab46-b998-4d63-a9c5-39a3efa0fd77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:34:18.589483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1ab46-b998-4d63-a9c5-39a3efa0fd77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:18.591364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1ab46-b998-4d63-a9c5-39a3efa0fd77 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:18.611855 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2248/4496] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:34:18.613927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1ab46-b998-4d63-a9c5-39a3efa0fd77 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:18.641135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1ab46-b998-4d63-a9c5-39a3efa0fd77 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:18.641375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c50d41-19fa-44f4-b108-f071ab73810e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:18.641944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c50d41-19fa-44f4-b108-f071ab73810e admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:18.642239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c50d41-19fa-44f4-b108-f071ab73810e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:18.642517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c50d41-19fa-44f4-b108-f071ab73810e admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:18.644076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c50d41-19fa-44f4-b108-f071ab73810e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:18.646545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c50d41-19fa-44f4-b108-f071ab73810e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:18.666656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6ecca94f-2107-452a-8247-a3adc18ccd56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58aa2745261044759f71e557f5c3808f', 'request_id': 'req-6ecca94f-2107-452a-8247-a3adc18ccd56'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:18.675566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6ecca94f-2107-452a-8247-a3adc18ccd56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58aa2745261044759f71e557f5c3808f', 'request_id': 'req-6ecca94f-2107-452a-8247-a3adc18ccd56'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:18.699100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6ecca94f-2107-452a-8247-a3adc18ccd56 admin admin] The token cache is being invalidate because project 58aa2745261044759f71e557f5c3808f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:34:18.704245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6ecca94f-2107-452a-8247-a3adc18ccd56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:18.704245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6ecca94f-2107-452a-8247-a3adc18ccd56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:34:18.704245 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2249/4497] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:34:18 2022] DELETE /identity/v3/projects/58aa2745261044759f71e557f5c3808f => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:34:18.708076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1bb4a-c5ca-463d-80cb-562acc551808 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:18.708400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1bb4a-c5ca-463d-80cb-562acc551808 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:18.708787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1bb4a-c5ca-463d-80cb-562acc551808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:18.734013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1db1bb4a-c5ca-463d-80cb-562acc551808 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:18.735343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1db1bb4a-c5ca-463d-80cb-562acc551808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:18.755691 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2250/4498] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:18.757431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e87f-f536-4c97-84c0-2870f87c56e3 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:18.757731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e87f-f536-4c97-84c0-2870f87c56e3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:18.758015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e87f-f536-4c97-84c0-2870f87c56e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:18.772824 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2249/4499] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:34:18 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:34:18.777999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c50d41-19fa-44f4-b108-f071ab73810e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:18.779954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-28c50d41-19fa-44f4-b108-f071ab73810e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:18.845460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0764e87f-f536-4c97-84c0-2870f87c56e3 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:18.850356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0764e87f-f536-4c97-84c0-2870f87c56e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:18.977967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c50d41-19fa-44f4-b108-f071ab73810e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:18.987980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddeffc-e248-466e-8843-198ccf76c6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:18.989338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddeffc-e248-466e-8843-198ccf76c6c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:18.990665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddeffc-e248-466e-8843-198ccf76c6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:18.991258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddeffc-e248-466e-8843-198ccf76c6c5 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:18.992492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddeffc-e248-466e-8843-198ccf76c6c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:18.995183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddeffc-e248-466e-8843-198ccf76c6c5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:19.079241 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2251/4500] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:19.085264 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2250/4501] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:34:18 2022] POST /identity/v3/users => generated 294 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:34:19.085264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddeffc-e248-466e-8843-198ccf76c6c5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:19.086132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecd56f-002b-4f67-a1b4-0f2b82435a3b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:19.086430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecd56f-002b-4f67-a1b4-0f2b82435a3b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:19.086713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecd56f-002b-4f67-a1b4-0f2b82435a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:19.126001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c2ecd56f-002b-4f67-a1b4-0f2b82435a3b None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:19.127052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddeffc-e248-466e-8843-198ccf76c6c5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:19.134135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c2ecd56f-002b-4f67-a1b4-0f2b82435a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:19.140556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23ec46-d0fb-41ae-8deb-3ab06de4eb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:19.141757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23ec46-d0fb-41ae-8deb-3ab06de4eb13 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:19.142138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23ec46-d0fb-41ae-8deb-3ab06de4eb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:19.143021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23ec46-d0fb-41ae-8deb-3ab06de4eb13 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:19.145403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23ec46-d0fb-41ae-8deb-3ab06de4eb13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:19.149297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23ec46-d0fb-41ae-8deb-3ab06de4eb13 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:19.180266 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2251/4502] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:34:19.181416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23ec46-d0fb-41ae-8deb-3ab06de4eb13 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:19.202655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23ec46-d0fb-41ae-8deb-3ab06de4eb13 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:19.215280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb57d9-638e-41ca-bfd2-339984373dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:19.216676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb57d9-638e-41ca-bfd2-339984373dcb admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:19.219671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb57d9-638e-41ca-bfd2-339984373dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:19.220102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb57d9-638e-41ca-bfd2-339984373dcb admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:19.221853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb57d9-638e-41ca-bfd2-339984373dcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:34:19.222965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb57d9-638e-41ca-bfd2-339984373dcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:19.228152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb57d9-638e-41ca-bfd2-339984373dcb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:19.259354 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2252/4503] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:34:19.264517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb57d9-638e-41ca-bfd2-339984373dcb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:19.289642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb57d9-638e-41ca-bfd2-339984373dcb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:19.302155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213237e3-34db-4eb6-9e1f-fad3c5d9b609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:19.308355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213237e3-34db-4eb6-9e1f-fad3c5d9b609 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:19.308355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213237e3-34db-4eb6-9e1f-fad3c5d9b609 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:19.308355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213237e3-34db-4eb6-9e1f-fad3c5d9b609 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:19.308849 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2252/4504] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:34:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:19.308957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213237e3-34db-4eb6-9e1f-fad3c5d9b609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:19.309062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecd56f-002b-4f67-a1b4-0f2b82435a3b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:19.311461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213237e3-34db-4eb6-9e1f-fad3c5d9b609 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:19.342534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecd56f-002b-4f67-a1b4-0f2b82435a3b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:19.346445 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2253/4505] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:34:19.347681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213237e3-34db-4eb6-9e1f-fad3c5d9b609 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:19.353750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-213237e3-34db-4eb6-9e1f-fad3c5d9b609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:19.367050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519975b-d555-40cf-95e0-de215f942fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:19.367738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519975b-d555-40cf-95e0-de215f942fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:19.368024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519975b-d555-40cf-95e0-de215f942fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:19.368311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519975b-d555-40cf-95e0-de215f942fd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:19.369051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519975b-d555-40cf-95e0-de215f942fd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:19.370980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519975b-d555-40cf-95e0-de215f942fd5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:19.434175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213237e3-34db-4eb6-9e1f-fad3c5d9b609 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:19.440757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da275f03-4105-4a24-9946-284a0f3970bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:19.445866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da275f03-4105-4a24-9946-284a0f3970bf service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:19.445866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da275f03-4105-4a24-9946-284a0f3970bf service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:19.445866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da275f03-4105-4a24-9946-284a0f3970bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:19.452550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da275f03-4105-4a24-9946-284a0f3970bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:19.455513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da275f03-4105-4a24-9946-284a0f3970bf service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:19.465423 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2254/4506] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:34:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:34:19.466465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da275f03-4105-4a24-9946-284a0f3970bf service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:19.482998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da275f03-4105-4a24-9946-284a0f3970bf service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:19.486325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb942d2-f5b3-49ec-8296-c12556361948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:19.487319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb942d2-f5b3-49ec-8296-c12556361948 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:19.487681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb942d2-f5b3-49ec-8296-c12556361948 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:19.488074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb942d2-f5b3-49ec-8296-c12556361948 admin admin] PATH_INFO: `/v3/projects/bdf9033cbc6148288d1ec5f86ff7a5a2/users/bdc1def7eba349a783953bcbde5214f4/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:19.510774 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2253/4507] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:34:19 2022] POST /identity/v3/projects => generated 373 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:34:19.526808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519975b-d555-40cf-95e0-de215f942fd5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:19.541383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb942d2-f5b3-49ec-8296-c12556361948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf9033cbc6148288d1ec5f86ff7a5a2, user_id=bdc1def7eba349a783953bcbde5214f4, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:19.559113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb942d2-f5b3-49ec-8296-c12556361948 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:19.657927 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2255/4508] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:34:19 2022] PUT /identity/v3/projects/bdf9033cbc6148288d1ec5f86ff7a5a2/users/bdc1def7eba349a783953bcbde5214f4/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:34:19.660438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3491218-6194-4fbb-bd37-5cee8044d9b5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:19.661050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3491218-6194-4fbb-bd37-5cee8044d9b5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:19.662082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3491218-6194-4fbb-bd37-5cee8044d9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:19.699801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f3491218-6194-4fbb-bd37-5cee8044d9b5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:19.702356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f3491218-6194-4fbb-bd37-5cee8044d9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:19.735916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519975b-d555-40cf-95e0-de215f942fd5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:19.804244 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2256/4509] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:19.863278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3491218-6194-4fbb-bd37-5cee8044d9b5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:19.866624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f3491218-6194-4fbb-bd37-5cee8044d9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:19.997461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c93ca3-1721-435c-8090-f247f9d6928d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:19.998162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c93ca3-1721-435c-8090-f247f9d6928d admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:19.998476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c93ca3-1721-435c-8090-f247f9d6928d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:19.998760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c93ca3-1721-435c-8090-f247f9d6928d admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:19.999466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c93ca3-1721-435c-8090-f247f9d6928d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:20.002954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c93ca3-1721-435c-8090-f247f9d6928d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:20.161805 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2254/4510] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:34:19 2022] POST /identity/v3/users => generated 287 bytes in 646 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:34:20.165408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c93ca3-1721-435c-8090-f247f9d6928d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:20.177567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3491218-6194-4fbb-bd37-5cee8044d9b5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:20.188246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c93ca3-1721-435c-8090-f247f9d6928d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:20.193721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bd306-3daa-4906-9ae6-865910b260a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:20.193721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bd306-3daa-4906-9ae6-865910b260a7 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:20.195319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fa9b7-bbef-4e68-919c-e26c7b7db874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:20.197164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bd306-3daa-4906-9ae6-865910b260a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:20.197709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fa9b7-bbef-4e68-919c-e26c7b7db874 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:20.198257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fa9b7-bbef-4e68-919c-e26c7b7db874 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:20.198768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fa9b7-bbef-4e68-919c-e26c7b7db874 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:20.199434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bd306-3daa-4906-9ae6-865910b260a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:20.201227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fa9b7-bbef-4e68-919c-e26c7b7db874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:20.207673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fa9b7-bbef-4e68-919c-e26c7b7db874 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:20.229082 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2255/4511] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:34:20.233293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fa9b7-bbef-4e68-919c-e26c7b7db874 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:20.237949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bd306-3daa-4906-9ae6-865910b260a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:20.239491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bd306-3daa-4906-9ae6-865910b260a7 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:20.247149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fa9b7-bbef-4e68-919c-e26c7b7db874 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:20.253692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a64acc-298d-454c-86ce-bfe83129c300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:20.254790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a64acc-298d-454c-86ce-bfe83129c300 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:20.255598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a64acc-298d-454c-86ce-bfe83129c300 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:20.256221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a64acc-298d-454c-86ce-bfe83129c300 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:20.257345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a64acc-298d-454c-86ce-bfe83129c300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:20.259431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a64acc-298d-454c-86ce-bfe83129c300 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:20.274688 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2257/4512] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:34:20.277319 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2256/4513] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:34:20.279206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bd306-3daa-4906-9ae6-865910b260a7 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:20.302436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bd306-3daa-4906-9ae6-865910b260a7 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:20.315400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2255b3-e812-4a94-a03f-702abe639e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:20.316074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2255b3-e812-4a94-a03f-702abe639e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:20.316371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2255b3-e812-4a94-a03f-702abe639e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:20.316712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2255b3-e812-4a94-a03f-702abe639e08 admin admin] PATH_INFO: `/v3/projects/56a059bb653d412f81c66dfd5c50806c/users/f70906b656804455a60b4be9f825869d/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:20.355090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2255b3-e812-4a94-a03f-702abe639e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56a059bb653d412f81c66dfd5c50806c, user_id=f70906b656804455a60b4be9f825869d, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:20.387369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2255b3-e812-4a94-a03f-702abe639e08 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:20.459621 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2258/4514] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:34:20 2022] PUT /identity/v3/projects/56a059bb653d412f81c66dfd5c50806c/users/f70906b656804455a60b4be9f825869d/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:34:20.470088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb73205-1a1a-41c7-95de-8fcd427c4d8c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:20.470897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb73205-1a1a-41c7-95de-8fcd427c4d8c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:20.471390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb73205-1a1a-41c7-95de-8fcd427c4d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:20.564211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6cb73205-1a1a-41c7-95de-8fcd427c4d8c None None] MFA Rules not processed for user `f70906b656804455a60b4be9f825869d`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:20.570403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6cb73205-1a1a-41c7-95de-8fcd427c4d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:20.882217 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2257/4515] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:34:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:20.897495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2255b3-e812-4a94-a03f-702abe639e08 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:20.899391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ec2255b3-e812-4a94-a03f-702abe639e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:21.023060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2255b3-e812-4a94-a03f-702abe639e08 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:21.038552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ee084-e319-45a1-a6c0-a922e0b22a48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:21.039229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ee084-e319-45a1-a6c0-a922e0b22a48 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:21.039620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ee084-e319-45a1-a6c0-a922e0b22a48 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:21.039910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ee084-e319-45a1-a6c0-a922e0b22a48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:21.058972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ee084-e319-45a1-a6c0-a922e0b22a48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:21.060635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ee084-e319-45a1-a6c0-a922e0b22a48 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:21.112882 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2259/4516] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:34:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:34:24.891197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f4077-15fe-499d-97bd-072178cacb55 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:24.891831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f4077-15fe-499d-97bd-072178cacb55 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:24.891831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f4077-15fe-499d-97bd-072178cacb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:24.941519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-765f4077-15fe-499d-97bd-072178cacb55 None None] MFA Rules not processed for user `f70906b656804455a60b4be9f825869d`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:24.943362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-765f4077-15fe-499d-97bd-072178cacb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:24.988299 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2258/4517] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:34:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:26.103877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde7fcb-bd3c-46b8-8331-9e4678a73637 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:26.104475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde7fcb-bd3c-46b8-8331-9e4678a73637 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:26.104958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde7fcb-bd3c-46b8-8331-9e4678a73637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:26.193580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-fcde7fcb-bd3c-46b8-8331-9e4678a73637 None None] MFA Rules not processed for user `aa1943e65db34e1da273b41c8a3d2faf`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:26.201068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fcde7fcb-bd3c-46b8-8331-9e4678a73637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:26.420367 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2260/4518] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:34:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:30.328045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d898307-422d-4099-9926-8466c322095f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:30.330134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d898307-422d-4099-9926-8466c322095f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:30.330590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d898307-422d-4099-9926-8466c322095f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:30.405239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2d898307-422d-4099-9926-8466c322095f None None] MFA Rules not processed for user `bdc1def7eba349a783953bcbde5214f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:30.411236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2d898307-422d-4099-9926-8466c322095f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:30.632952 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2259/4519] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:34:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:30.644371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb92257-8e26-46e9-b9d4-0f11df7a36c8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:30.645444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb92257-8e26-46e9-b9d4-0f11df7a36c8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:30.645928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb92257-8e26-46e9-b9d4-0f11df7a36c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:30.691208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0eb92257-8e26-46e9-b9d4-0f11df7a36c8 None None] MFA Rules not processed for user `bdc1def7eba349a783953bcbde5214f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:30.693877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0eb92257-8e26-46e9-b9d4-0f11df7a36c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:30.714108 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2261/4520] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:34:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:30.723082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4827d6-c8ab-46e7-a5fb-255dee956484 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:30.723684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4827d6-c8ab-46e7-a5fb-255dee956484 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:30.724168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4827d6-c8ab-46e7-a5fb-255dee956484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:30.775510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9a4827d6-c8ab-46e7-a5fb-255dee956484 None None] MFA Rules not processed for user `bdc1def7eba349a783953bcbde5214f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:30.778400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9a4827d6-c8ab-46e7-a5fb-255dee956484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:30.806175 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2260/4521] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:34:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:38.588486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb92257-8e26-46e9-b9d4-0f11df7a36c8 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:38.591514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0eb92257-8e26-46e9-b9d4-0f11df7a36c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:38.764462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb92257-8e26-46e9-b9d4-0f11df7a36c8 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:38.774979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf858377-ed8f-4716-836e-59e8a5af3c1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:38.776049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf858377-ed8f-4716-836e-59e8a5af3c1a service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:38.776818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf858377-ed8f-4716-836e-59e8a5af3c1a service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:38.777355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf858377-ed8f-4716-836e-59e8a5af3c1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:38.792687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf858377-ed8f-4716-836e-59e8a5af3c1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:38.796578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf858377-ed8f-4716-836e-59e8a5af3c1a service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:38.810617 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2262/4522] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:34:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:34:41.796834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988885e-d550-46c5-9cf1-b93a3267ed52 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:41.797269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988885e-d550-46c5-9cf1-b93a3267ed52 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:41.797269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988885e-d550-46c5-9cf1-b93a3267ed52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:41.846629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3988885e-d550-46c5-9cf1-b93a3267ed52 None None] MFA Rules not processed for user `bdc1def7eba349a783953bcbde5214f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:41.849690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3988885e-d550-46c5-9cf1-b93a3267ed52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:41.881246 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2261/4523] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:34:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:44.579116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e6e7f-768e-4d15-aaf2-5c1ff940fb9e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:44.580372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e6e7f-768e-4d15-aaf2-5c1ff940fb9e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:44.580932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e6e7f-768e-4d15-aaf2-5c1ff940fb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:44.610203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6b6e6e7f-768e-4d15-aaf2-5c1ff940fb9e None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:44.611641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6b6e6e7f-768e-4d15-aaf2-5c1ff940fb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:44.720294 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2263/4524] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:34:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:44.738674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988885e-d550-46c5-9cf1-b93a3267ed52 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:44.853188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111141c-6b77-44c8-b7bd-8c8a530ff226 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:44.853688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111141c-6b77-44c8-b7bd-8c8a530ff226 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:44.854127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111141c-6b77-44c8-b7bd-8c8a530ff226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:44.919971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988885e-d550-46c5-9cf1-b93a3267ed52 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:44.935713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37ad23-5904-4305-8b78-ef17c4318e72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:44.944939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37ad23-5904-4305-8b78-ef17c4318e72 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:44.950029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37ad23-5904-4305-8b78-ef17c4318e72 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:44.950619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37ad23-5904-4305-8b78-ef17c4318e72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:44.962214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c111141c-6b77-44c8-b7bd-8c8a530ff226 None None] MFA Rules not processed for user `11570d45e8de428fa751c85b80b673e4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:44.965228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c111141c-6b77-44c8-b7bd-8c8a530ff226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:44.968379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37ad23-5904-4305-8b78-ef17c4318e72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:44.970108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37ad23-5904-4305-8b78-ef17c4318e72 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:44.986599 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2262/4525] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:34:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:34:45.148284 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2264/4526] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:34:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:45.148685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37ad23-5904-4305-8b78-ef17c4318e72 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:45.150081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3f37ad23-5904-4305-8b78-ef17c4318e72 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:45.342078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37ad23-5904-4305-8b78-ef17c4318e72 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:45.362874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e8777-dfa9-482e-9bda-ef4268a6506e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:45.362874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e8777-dfa9-482e-9bda-ef4268a6506e admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:45.362874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e8777-dfa9-482e-9bda-ef4268a6506e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:45.362874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e8777-dfa9-482e-9bda-ef4268a6506e admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:45.363368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e8777-dfa9-482e-9bda-ef4268a6506e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:45.363903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e8777-dfa9-482e-9bda-ef4268a6506e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:45.976712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111141c-6b77-44c8-b7bd-8c8a530ff226 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:45.985890 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2263/4527] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:34:45 2022] POST /identity/v3/projects => generated 387 bytes in 838 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:34:45.990042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111141c-6b77-44c8-b7bd-8c8a530ff226 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:46.107645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a33a3e-124a-4189-bdf6-d964f2957ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:46.110973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a33a3e-124a-4189-bdf6-d964f2957ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:46.111338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a33a3e-124a-4189-bdf6-d964f2957ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:46.111631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a33a3e-124a-4189-bdf6-d964f2957ab8 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:46.112381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a33a3e-124a-4189-bdf6-d964f2957ab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:46.124193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a33a3e-124a-4189-bdf6-d964f2957ab8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:46.124708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dd3a4-68f6-44d6-96d2-024d1810a3e0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:46.125190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dd3a4-68f6-44d6-96d2-024d1810a3e0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:46.125915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dd3a4-68f6-44d6-96d2-024d1810a3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:46.169662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-981dd3a4-68f6-44d6-96d2-024d1810a3e0 None None] MFA Rules not processed for user `bdc1def7eba349a783953bcbde5214f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:46.176674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-981dd3a4-68f6-44d6-96d2-024d1810a3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:46.223601 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2265/4528] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:34:45 2022] POST /identity/v3/users => generated 300 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:34:46.225257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a33a3e-124a-4189-bdf6-d964f2957ab8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:46.279234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a33a3e-124a-4189-bdf6-d964f2957ab8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:46.301681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e2625-4142-4963-b342-a047b10da954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:46.305590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e2625-4142-4963-b342-a047b10da954 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:46.306158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e2625-4142-4963-b342-a047b10da954 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:46.308000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e2625-4142-4963-b342-a047b10da954 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:46.314379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e2625-4142-4963-b342-a047b10da954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:46.329601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e2625-4142-4963-b342-a047b10da954 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:46.359328 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2266/4529] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:34:46.360505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e2625-4142-4963-b342-a047b10da954 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:46.373916 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2264/4530] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:34:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:46.375208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981dd3a4-68f6-44d6-96d2-024d1810a3e0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:46.395943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981dd3a4-68f6-44d6-96d2-024d1810a3e0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:46.402934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66accb-f9bb-4c77-86ff-6db1900046c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:46.405836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66accb-f9bb-4c77-86ff-6db1900046c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:46.406288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66accb-f9bb-4c77-86ff-6db1900046c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:46.421337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66accb-f9bb-4c77-86ff-6db1900046c3 admin admin] PATH_INFO: `/v3/projects/839c485fea7940d1aad426fd7fc19dfc/users/f409d644bbd64f22b01cdd3ecb71ace1/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:46.539817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e2625-4142-4963-b342-a047b10da954 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:46.543033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66accb-f9bb-4c77-86ff-6db1900046c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=839c485fea7940d1aad426fd7fc19dfc, user_id=f409d644bbd64f22b01cdd3ecb71ace1, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:46.548418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fc974-5a71-41b5-b2d1-bc0278faf934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:46.549200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fc974-5a71-41b5-b2d1-bc0278faf934 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:46.549487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fc974-5a71-41b5-b2d1-bc0278faf934 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:46.549765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fc974-5a71-41b5-b2d1-bc0278faf934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:46.551988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-383fc974-5a71-41b5-b2d1-bc0278faf934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:46.555414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66accb-f9bb-4c77-86ff-6db1900046c3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:46.647779 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2265/4531] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:34:46 2022] PUT /identity/v3/projects/839c485fea7940d1aad426fd7fc19dfc/users/f409d644bbd64f22b01cdd3ecb71ace1/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:34:46.661004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66accb-f9bb-4c77-86ff-6db1900046c3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:46.783618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fc974-5a71-41b5-b2d1-bc0278faf934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:46.786321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fc974-5a71-41b5-b2d1-bc0278faf934 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:46.842241 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2267/4532] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:34:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:34:46.860706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66accb-f9bb-4c77-86ff-6db1900046c3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:46.877092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4e667-e470-4aa3-b370-262444b61bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:46.877790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4e667-e470-4aa3-b370-262444b61bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:46.878081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4e667-e470-4aa3-b370-262444b61bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:46.878361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4e667-e470-4aa3-b370-262444b61bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:46.885469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4e667-e470-4aa3-b370-262444b61bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:46.887135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4e667-e470-4aa3-b370-262444b61bd2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:46.902645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fc974-5a71-41b5-b2d1-bc0278faf934 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:46.904098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-383fc974-5a71-41b5-b2d1-bc0278faf934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:46.924462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fc974-5a71-41b5-b2d1-bc0278faf934 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:46.927424 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2266/4533] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:34:46.935608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4e667-e470-4aa3-b370-262444b61bd2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:46.968558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4e667-e470-4aa3-b370-262444b61bd2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:46.992197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f545bd3-2a71-4426-a5f7-77ba7d28e02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:46.995052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f545bd3-2a71-4426-a5f7-77ba7d28e02e admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:46.997025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f545bd3-2a71-4426-a5f7-77ba7d28e02e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:46.997547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f545bd3-2a71-4426-a5f7-77ba7d28e02e admin admin] PATH_INFO: `/v3/projects/839c485fea7940d1aad426fd7fc19dfc/users/f409d644bbd64f22b01cdd3ecb71ace1/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:47.008496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f545bd3-2a71-4426-a5f7-77ba7d28e02e admin admin] RBAC: Authorizing `identity:create_grant(project_id=839c485fea7940d1aad426fd7fc19dfc, user_id=f409d644bbd64f22b01cdd3ecb71ace1, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:47.011369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f545bd3-2a71-4426-a5f7-77ba7d28e02e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:47.058302 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2267/4534] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:34:46 2022] PUT /identity/v3/projects/839c485fea7940d1aad426fd7fc19dfc/users/f409d644bbd64f22b01cdd3ecb71ace1/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:34:47.085303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3fcb0-9fd2-4f76-865b-5c322f2ab126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:47.107586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3fcb0-9fd2-4f76-865b-5c322f2ab126 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:47.107989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3fcb0-9fd2-4f76-865b-5c322f2ab126 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:47.108191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3fcb0-9fd2-4f76-865b-5c322f2ab126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:47.115450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f6c3fcb0-9fd2-4f76-865b-5c322f2ab126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:47.245876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3fcb0-9fd2-4f76-865b-5c322f2ab126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:47.247427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3fcb0-9fd2-4f76-865b-5c322f2ab126 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:47.265736 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2268/4535] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:34:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:34:49.907560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f545bd3-2a71-4426-a5f7-77ba7d28e02e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:49.910353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8f545bd3-2a71-4426-a5f7-77ba7d28e02e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:50.114912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f545bd3-2a71-4426-a5f7-77ba7d28e02e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:50.133517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28b948-7954-4d2f-b126-ce4974050398 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:50.138309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28b948-7954-4d2f-b126-ce4974050398 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:50.138906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28b948-7954-4d2f-b126-ce4974050398 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:50.139358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28b948-7954-4d2f-b126-ce4974050398 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:50.146205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-af28b948-7954-4d2f-b126-ce4974050398 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:50.170129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28b948-7954-4d2f-b126-ce4974050398 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:50.177590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28b948-7954-4d2f-b126-ce4974050398 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:50.204522 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2268/4536] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:34:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:34:53.920153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4ccab-1fc3-4633-87f0-692199fa4689 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:53.921965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4ccab-1fc3-4633-87f0-692199fa4689 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:53.921965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4ccab-1fc3-4633-87f0-692199fa4689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:53.973940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-aaa4ccab-1fc3-4633-87f0-692199fa4689 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:53.975249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-aaa4ccab-1fc3-4633-87f0-692199fa4689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:54.123474 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2269/4537] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:34:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:54.141166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28b948-7954-4d2f-b126-ce4974050398 service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:54.259676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28b948-7954-4d2f-b126-ce4974050398 service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:54.268563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2e18a-4f5b-463d-a4c5-a866a61c2d68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:54.269891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2e18a-4f5b-463d-a4c5-a866a61c2d68 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:54.270397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2e18a-4f5b-463d-a4c5-a866a61c2d68 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:54.270879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2e18a-4f5b-463d-a4c5-a866a61c2d68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:54.293758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2e18a-4f5b-463d-a4c5-a866a61c2d68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:54.295708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2e18a-4f5b-463d-a4c5-a866a61c2d68 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:54.316783 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2269/4538] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:34:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:34:55.118679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4ccab-1fc3-4633-87f0-692199fa4689 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:55.232667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4ccab-1fc3-4633-87f0-692199fa4689 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:55.239163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c547cf8-3f8a-4258-bde7-dc8f57386a85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:55.239841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c547cf8-3f8a-4258-bde7-dc8f57386a85 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:55.240127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c547cf8-3f8a-4258-bde7-dc8f57386a85 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:55.240409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c547cf8-3f8a-4258-bde7-dc8f57386a85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:55.245142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5c547cf8-3f8a-4258-bde7-dc8f57386a85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:55.273422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c547cf8-3f8a-4258-bde7-dc8f57386a85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:55.274881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c547cf8-3f8a-4258-bde7-dc8f57386a85 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:55.296260 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2270/4539] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:34:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:34:55.529089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71dfcb9-2a87-4c38-a86c-37a6923556dd None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:55.530117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71dfcb9-2a87-4c38-a86c-37a6923556dd None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:55.530576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71dfcb9-2a87-4c38-a86c-37a6923556dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:55.561613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e71dfcb9-2a87-4c38-a86c-37a6923556dd None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:34:55.565912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e71dfcb9-2a87-4c38-a86c-37a6923556dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:55.577595 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2270/4540] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:34:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:34:55.594479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c547cf8-3f8a-4258-bde7-dc8f57386a85 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:55.624778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c547cf8-3f8a-4258-bde7-dc8f57386a85 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:55.643486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725d42f-de7b-4ab1-8e43-e23366937108 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:55.644630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725d42f-de7b-4ab1-8e43-e23366937108 service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:55.645271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725d42f-de7b-4ab1-8e43-e23366937108 service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:55.645816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725d42f-de7b-4ab1-8e43-e23366937108 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:55.666838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725d42f-de7b-4ab1-8e43-e23366937108 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:55.671926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725d42f-de7b-4ab1-8e43-e23366937108 service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:55.699034 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2271/4541] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:34:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:34:58.597498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71dfcb9-2a87-4c38-a86c-37a6923556dd None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:58.599200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e71dfcb9-2a87-4c38-a86c-37a6923556dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:58.788356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71dfcb9-2a87-4c38-a86c-37a6923556dd None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:58.801710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ef39e-babe-412d-8cfa-5dc32ab6ccbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:58.807522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ef39e-babe-412d-8cfa-5dc32ab6ccbd service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:58.807522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ef39e-babe-412d-8cfa-5dc32ab6ccbd service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:58.807522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ef39e-babe-412d-8cfa-5dc32ab6ccbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:58.809866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-946ef39e-babe-412d-8cfa-5dc32ab6ccbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:58.850238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ef39e-babe-412d-8cfa-5dc32ab6ccbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:58.852509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ef39e-babe-412d-8cfa-5dc32ab6ccbd service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:58.905990 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2271/4542] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:34:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:34:59.015735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725d42f-de7b-4ab1-8e43-e23366937108 service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:34:59.038535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725d42f-de7b-4ab1-8e43-e23366937108 service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:34:59.058599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135829d-183c-46d8-ba32-c41ee581ff86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:34:59.059279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135829d-183c-46d8-ba32-c41ee581ff86 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:34:59.059566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135829d-183c-46d8-ba32-c41ee581ff86 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:34:59.059847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135829d-183c-46d8-ba32-c41ee581ff86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:34:59.080928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1135829d-183c-46d8-ba32-c41ee581ff86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:34:59.123266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135829d-183c-46d8-ba32-c41ee581ff86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:34:59.130057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135829d-183c-46d8-ba32-c41ee581ff86 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:34:59.163200 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2272/4543] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:34:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:35:11.407295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ee0f8-7763-49f2-aa87-7f93be02b60f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:11.407811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ee0f8-7763-49f2-aa87-7f93be02b60f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:11.407924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ee0f8-7763-49f2-aa87-7f93be02b60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:11.473097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-552ee0f8-7763-49f2-aa87-7f93be02b60f None None] MFA Rules not processed for user `f409d644bbd64f22b01cdd3ecb71ace1`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:11.477173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-552ee0f8-7763-49f2-aa87-7f93be02b60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:11.643894 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2272/4544] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:11.668311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135829d-183c-46d8-ba32-c41ee581ff86 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:11.841196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135829d-183c-46d8-ba32-c41ee581ff86 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:11.845877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434deb7c-4da3-4d43-aa8c-4e1527b3ddd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:11.847425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434deb7c-4da3-4d43-aa8c-4e1527b3ddd9 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:11.847706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434deb7c-4da3-4d43-aa8c-4e1527b3ddd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:11.848102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434deb7c-4da3-4d43-aa8c-4e1527b3ddd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:12.031119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434deb7c-4da3-4d43-aa8c-4e1527b3ddd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:12.032789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434deb7c-4da3-4d43-aa8c-4e1527b3ddd9 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:12.060085 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2273/4545] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:35:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:35:23.704046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16ab52-e559-4728-9d01-62e541f02ffa None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:23.704545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16ab52-e559-4728-9d01-62e541f02ffa None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:23.705520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16ab52-e559-4728-9d01-62e541f02ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:23.727694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-db16ab52-e559-4728-9d01-62e541f02ffa None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:23.729125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-db16ab52-e559-4728-9d01-62e541f02ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:23.741806 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2273/4546] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:35:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:23.760784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434deb7c-4da3-4d43-aa8c-4e1527b3ddd9 service cinder] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:23.774072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434deb7c-4da3-4d43-aa8c-4e1527b3ddd9 service cinder] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:23.781233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d65e6-3877-4527-b2dc-3727b4100136 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:23.781921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d65e6-3877-4527-b2dc-3727b4100136 service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:23.782362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d65e6-3877-4527-b2dc-3727b4100136 service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:23.784914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d65e6-3877-4527-b2dc-3727b4100136 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:23.791590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d65e6-3877-4527-b2dc-3727b4100136 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:23.793259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d65e6-3877-4527-b2dc-3727b4100136 service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:23.814170 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2274/4547] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:35:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:35:26.178567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16ab52-e559-4728-9d01-62e541f02ffa None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:26.194823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16ab52-e559-4728-9d01-62e541f02ffa None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:26.202844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a1f0b-cc60-4970-889f-5b8fe01fa644 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:26.204747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a1f0b-cc60-4970-889f-5b8fe01fa644 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:26.205147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a1f0b-cc60-4970-889f-5b8fe01fa644 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:26.205587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a1f0b-cc60-4970-889f-5b8fe01fa644 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:26.209785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6c1a1f0b-cc60-4970-889f-5b8fe01fa644 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:26.224795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a1f0b-cc60-4970-889f-5b8fe01fa644 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:26.226830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a1f0b-cc60-4970-889f-5b8fe01fa644 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:26.244301 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2274/4548] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:35:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:35:27.393233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d65e6-3877-4527-b2dc-3727b4100136 service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:27.394822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-aa5d65e6-3877-4527-b2dc-3727b4100136 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:27.520880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d65e6-3877-4527-b2dc-3727b4100136 service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:27.535551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a87ff-a475-4a41-9b6b-7e3e77ba7cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:27.540287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a87ff-a475-4a41-9b6b-7e3e77ba7cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:27.540287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a87ff-a475-4a41-9b6b-7e3e77ba7cac admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:27.540287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a87ff-a475-4a41-9b6b-7e3e77ba7cac admin admin] PATH_INFO: `/v3/users/b02c5c3cdea84636a1852be787ef4b31` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:27.540287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a87ff-a475-4a41-9b6b-7e3e77ba7cac admin admin] RBAC: Authorizing `identity:delete_user(user_id=b02c5c3cdea84636a1852be787ef4b31)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:27.541003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a87ff-a475-4a41-9b6b-7e3e77ba7cac admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:27.808973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5d5a87ff-a475-4a41-9b6b-7e3e77ba7cac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b02c5c3cdea84636a1852be787ef4b31'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:27.822687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5d5a87ff-a475-4a41-9b6b-7e3e77ba7cac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b02c5c3cdea84636a1852be787ef4b31'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:27.823658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5d5a87ff-a475-4a41-9b6b-7e3e77ba7cac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b02c5c3cdea84636a1852be787ef4b31'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:27.836815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5d5a87ff-a475-4a41-9b6b-7e3e77ba7cac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b02c5c3cdea84636a1852be787ef4b31'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:27.912304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5d5a87ff-a475-4a41-9b6b-7e3e77ba7cac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b02c5c3cdea84636a1852be787ef4b31'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:27.919030 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2275/4549] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:35:27 2022] DELETE /identity/v3/users/b02c5c3cdea84636a1852be787ef4b31 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:35:27.923817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dcfe2-7f92-4f56-8dc5-231816af9642 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:27.924474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dcfe2-7f92-4f56-8dc5-231816af9642 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:27.924474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dcfe2-7f92-4f56-8dc5-231816af9642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:27.943702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c83dcfe2-7f92-4f56-8dc5-231816af9642 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:27.944921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c83dcfe2-7f92-4f56-8dc5-231816af9642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:28.016291 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2275/4550] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:28.039419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a87ff-a475-4a41-9b6b-7e3e77ba7cac admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:28.042020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5d5a87ff-a475-4a41-9b6b-7e3e77ba7cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:28.115029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a87ff-a475-4a41-9b6b-7e3e77ba7cac admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:28.120714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242404c-1804-4b9c-a081-2b1ae7646122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:28.126143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242404c-1804-4b9c-a081-2b1ae7646122 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:28.126143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242404c-1804-4b9c-a081-2b1ae7646122 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:28.126143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242404c-1804-4b9c-a081-2b1ae7646122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:28.134514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242404c-1804-4b9c-a081-2b1ae7646122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:28.136080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242404c-1804-4b9c-a081-2b1ae7646122 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:28.146873 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2276/4551] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:35:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:35:28.456482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dcfe2-7f92-4f56-8dc5-231816af9642 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:28.458179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c83dcfe2-7f92-4f56-8dc5-231816af9642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:28.472682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dcfe2-7f92-4f56-8dc5-231816af9642 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:28.480371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119bdf0-d096-434e-9435-164e16d76d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:28.485333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119bdf0-d096-434e-9435-164e16d76d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:28.485333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119bdf0-d096-434e-9435-164e16d76d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:28.485333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119bdf0-d096-434e-9435-164e16d76d5d admin admin] PATH_INFO: `/v3/projects/d9fd0aad469e47db8ff8bc7852954449` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:28.485333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119bdf0-d096-434e-9435-164e16d76d5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9fd0aad469e47db8ff8bc7852954449)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:28.493631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119bdf0-d096-434e-9435-164e16d76d5d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:28.699997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1119bdf0-d096-434e-9435-164e16d76d5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9fd0aad469e47db8ff8bc7852954449', 'request_id': 'req-1119bdf0-d096-434e-9435-164e16d76d5d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:28.832109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1119bdf0-d096-434e-9435-164e16d76d5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9fd0aad469e47db8ff8bc7852954449', 'request_id': 'req-1119bdf0-d096-434e-9435-164e16d76d5d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:28.841120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1119bdf0-d096-434e-9435-164e16d76d5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9fd0aad469e47db8ff8bc7852954449', 'request_id': 'req-1119bdf0-d096-434e-9435-164e16d76d5d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:28.859566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1119bdf0-d096-434e-9435-164e16d76d5d admin admin] The token cache is being invalidate because project d9fd0aad469e47db8ff8bc7852954449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:35:28.860237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1119bdf0-d096-434e-9435-164e16d76d5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:28.862135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1119bdf0-d096-434e-9435-164e16d76d5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:28.865902 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2276/4552] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:35:28 2022] DELETE /identity/v3/projects/d9fd0aad469e47db8ff8bc7852954449 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:35:28.880011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b581a81-a9fe-497f-a137-d7449b34e2f7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:28.880535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b581a81-a9fe-497f-a137-d7449b34e2f7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:28.880681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b581a81-a9fe-497f-a137-d7449b34e2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:28.909935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0b581a81-a9fe-497f-a137-d7449b34e2f7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:28.911593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0b581a81-a9fe-497f-a137-d7449b34e2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:28.990564 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2277/4553] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:28.998812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d5bc3-ff72-4e81-84bc-e3f62cd9f9a0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:28.999895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d5bc3-ff72-4e81-84bc-e3f62cd9f9a0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:29.000178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d5bc3-ff72-4e81-84bc-e3f62cd9f9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:29.027292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-650d5bc3-ff72-4e81-84bc-e3f62cd9f9a0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:29.028819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-650d5bc3-ff72-4e81-84bc-e3f62cd9f9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:29.038242 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2277/4554] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:29.042495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b581a81-a9fe-497f-a137-d7449b34e2f7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:29.057589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b581a81-a9fe-497f-a137-d7449b34e2f7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:29.063162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edecf26-18ad-4de8-9b54-6c7c2a44a765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:29.063838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edecf26-18ad-4de8-9b54-6c7c2a44a765 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:29.064842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edecf26-18ad-4de8-9b54-6c7c2a44a765 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:29.065288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edecf26-18ad-4de8-9b54-6c7c2a44a765 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:29.068670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edecf26-18ad-4de8-9b54-6c7c2a44a765 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:35:29.068670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edecf26-18ad-4de8-9b54-6c7c2a44a765 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:29.068670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edecf26-18ad-4de8-9b54-6c7c2a44a765 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:29.081265 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2278/4555] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:35:29.085326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d5bc3-ff72-4e81-84bc-e3f62cd9f9a0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:29.097674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d5bc3-ff72-4e81-84bc-e3f62cd9f9a0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:29.104812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e0ee6-7906-403c-8cb9-fe9f27c9efd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:29.106399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e0ee6-7906-403c-8cb9-fe9f27c9efd0 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:29.106856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e0ee6-7906-403c-8cb9-fe9f27c9efd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:29.107292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e0ee6-7906-403c-8cb9-fe9f27c9efd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:29.108405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e0ee6-7906-403c-8cb9-fe9f27c9efd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:29.115900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e0ee6-7906-403c-8cb9-fe9f27c9efd0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:29.274755 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2278/4556] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:35:29 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:35:29.285796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edecf26-18ad-4de8-9b54-6c7c2a44a765 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:29.296818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edecf26-18ad-4de8-9b54-6c7c2a44a765 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:29.363969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bcedc-a76c-4301-85e3-384584e5fbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:29.364668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bcedc-a76c-4301-85e3-384584e5fbb6 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:29.364957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bcedc-a76c-4301-85e3-384584e5fbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:29.365235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bcedc-a76c-4301-85e3-384584e5fbb6 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:29.365932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bcedc-a76c-4301-85e3-384584e5fbb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:29.367848 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bcedc-a76c-4301-85e3-384584e5fbb6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:29.539973 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2279/4557] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:35:29 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:35:29.540929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e0ee6-7906-403c-8cb9-fe9f27c9efd0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:29.555240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e0ee6-7906-403c-8cb9-fe9f27c9efd0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:29.573287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf788d-1af1-4fda-b04a-544d7f169e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:29.573287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf788d-1af1-4fda-b04a-544d7f169e79 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:29.573287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf788d-1af1-4fda-b04a-544d7f169e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:29.573287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf788d-1af1-4fda-b04a-544d7f169e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:29.573811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf788d-1af1-4fda-b04a-544d7f169e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:29.573811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf788d-1af1-4fda-b04a-544d7f169e79 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:29.585706 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2279/4558] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:35:29.590111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bcedc-a76c-4301-85e3-384584e5fbb6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:29.601082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bcedc-a76c-4301-85e3-384584e5fbb6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:29.607928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c838ddb-dcfb-4398-a0fc-d93dc79ebc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:29.608835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c838ddb-dcfb-4398-a0fc-d93dc79ebc1c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:29.609293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c838ddb-dcfb-4398-a0fc-d93dc79ebc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:29.609721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c838ddb-dcfb-4398-a0fc-d93dc79ebc1c admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:29.610626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c838ddb-dcfb-4398-a0fc-d93dc79ebc1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:29.613187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c838ddb-dcfb-4398-a0fc-d93dc79ebc1c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:29.626718 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2280/4559] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:35:29.631577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf788d-1af1-4fda-b04a-544d7f169e79 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:29.643991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf788d-1af1-4fda-b04a-544d7f169e79 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:29.649503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe620e8-ce5e-4728-9fd0-0bd0644fefdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:29.650583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe620e8-ce5e-4728-9fd0-0bd0644fefdb admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:29.651359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe620e8-ce5e-4728-9fd0-0bd0644fefdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:29.651829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe620e8-ce5e-4728-9fd0-0bd0644fefdb admin admin] PATH_INFO: `/v3/projects/aeb0ed00df5f4427af0b79cd832e4399/users/319a0e8f3f79476d8ac2ae0cbe43aec4/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:29.668518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe620e8-ce5e-4728-9fd0-0bd0644fefdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeb0ed00df5f4427af0b79cd832e4399, user_id=319a0e8f3f79476d8ac2ae0cbe43aec4, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:29.671937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe620e8-ce5e-4728-9fd0-0bd0644fefdb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:29.896517 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2280/4560] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:35:29 2022] PUT /identity/v3/projects/aeb0ed00df5f4427af0b79cd832e4399/users/319a0e8f3f79476d8ac2ae0cbe43aec4/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:35:29.913796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff21f46-c4bf-4f9e-b046-9d33868e3e8a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:29.914656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff21f46-c4bf-4f9e-b046-9d33868e3e8a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:29.915223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff21f46-c4bf-4f9e-b046-9d33868e3e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:29.993073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6ff21f46-c4bf-4f9e-b046-9d33868e3e8a None None] MFA Rules not processed for user `319a0e8f3f79476d8ac2ae0cbe43aec4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:29.995250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6ff21f46-c4bf-4f9e-b046-9d33868e3e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:30.105553 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2281/4561] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:30.119529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe620e8-ce5e-4728-9fd0-0bd0644fefdb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:30.121533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0fe620e8-ce5e-4728-9fd0-0bd0644fefdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:30.225456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe620e8-ce5e-4728-9fd0-0bd0644fefdb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:30.231324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0323c2c-3e94-4706-8bcd-30437c316c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:30.232271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0323c2c-3e94-4706-8bcd-30437c316c83 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:30.232813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0323c2c-3e94-4706-8bcd-30437c316c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:30.233279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0323c2c-3e94-4706-8bcd-30437c316c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:30.244023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0323c2c-3e94-4706-8bcd-30437c316c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:30.245826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0323c2c-3e94-4706-8bcd-30437c316c83 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:30.257313 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2281/4562] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:35:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:35:30.360615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff21f46-c4bf-4f9e-b046-9d33868e3e8a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:30.363390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6ff21f46-c4bf-4f9e-b046-9d33868e3e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:30.472546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff21f46-c4bf-4f9e-b046-9d33868e3e8a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:30.479602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c0fa0-1229-4475-bc3f-a35bf3303fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:30.482173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c0fa0-1229-4475-bc3f-a35bf3303fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:30.486673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c0fa0-1229-4475-bc3f-a35bf3303fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:30.486673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c0fa0-1229-4475-bc3f-a35bf3303fd4 admin admin] PATH_INFO: `/v3/users/68aa28ca960047049d2eab9f3de4543e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:30.486673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c0fa0-1229-4475-bc3f-a35bf3303fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68aa28ca960047049d2eab9f3de4543e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:30.487603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c0fa0-1229-4475-bc3f-a35bf3303fd4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:30.756332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-554c0fa0-1229-4475-bc3f-a35bf3303fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68aa28ca960047049d2eab9f3de4543e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:30.779829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-554c0fa0-1229-4475-bc3f-a35bf3303fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68aa28ca960047049d2eab9f3de4543e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:30.782629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-554c0fa0-1229-4475-bc3f-a35bf3303fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68aa28ca960047049d2eab9f3de4543e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:30.799016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-554c0fa0-1229-4475-bc3f-a35bf3303fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68aa28ca960047049d2eab9f3de4543e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:30.923925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-554c0fa0-1229-4475-bc3f-a35bf3303fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68aa28ca960047049d2eab9f3de4543e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:30.936447 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2282/4563] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:35:30 2022] DELETE /identity/v3/users/68aa28ca960047049d2eab9f3de4543e => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:35:30.941468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64cec3-aa66-461e-996c-996c890daf7e None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:30.942268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64cec3-aa66-461e-996c-996c890daf7e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:30.942773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64cec3-aa66-461e-996c-996c890daf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:30.971422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fc64cec3-aa66-461e-996c-996c890daf7e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:30.973414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fc64cec3-aa66-461e-996c-996c890daf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:31.062202 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2282/4564] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:31.070288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c0fa0-1229-4475-bc3f-a35bf3303fd4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:31.072136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-554c0fa0-1229-4475-bc3f-a35bf3303fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:31.147616 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c0fa0-1229-4475-bc3f-a35bf3303fd4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:31.151306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939cf2d-5109-4a48-aa6c-c1d1f6425b2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:31.152014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939cf2d-5109-4a48-aa6c-c1d1f6425b2c service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:31.152306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939cf2d-5109-4a48-aa6c-c1d1f6425b2c service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:31.152587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939cf2d-5109-4a48-aa6c-c1d1f6425b2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:31.162854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939cf2d-5109-4a48-aa6c-c1d1f6425b2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:31.164357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939cf2d-5109-4a48-aa6c-c1d1f6425b2c service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:31.205973 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2283/4565] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:35:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:35:31.682392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc64cec3-aa66-461e-996c-996c890daf7e None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:31.685334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fc64cec3-aa66-461e-996c-996c890daf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:31.719377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc64cec3-aa66-461e-996c-996c890daf7e None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:31.727863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a186187-0f89-4bb6-ac0f-06462e50fc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:31.729853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a186187-0f89-4bb6-ac0f-06462e50fc00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:31.730538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a186187-0f89-4bb6-ac0f-06462e50fc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:31.731127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a186187-0f89-4bb6-ac0f-06462e50fc00 admin admin] PATH_INFO: `/v3/projects/acccc99fe3574a59b1b416e67ea040dd` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:31.733273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a186187-0f89-4bb6-ac0f-06462e50fc00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acccc99fe3574a59b1b416e67ea040dd)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:31.735920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a186187-0f89-4bb6-ac0f-06462e50fc00 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:31.836952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8a186187-0f89-4bb6-ac0f-06462e50fc00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acccc99fe3574a59b1b416e67ea040dd', 'request_id': 'req-8a186187-0f89-4bb6-ac0f-06462e50fc00'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:32.432362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8a186187-0f89-4bb6-ac0f-06462e50fc00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acccc99fe3574a59b1b416e67ea040dd', 'request_id': 'req-8a186187-0f89-4bb6-ac0f-06462e50fc00'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:32.439530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8a186187-0f89-4bb6-ac0f-06462e50fc00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acccc99fe3574a59b1b416e67ea040dd', 'request_id': 'req-8a186187-0f89-4bb6-ac0f-06462e50fc00'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:32.451771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8a186187-0f89-4bb6-ac0f-06462e50fc00 admin admin] The token cache is being invalidate because project acccc99fe3574a59b1b416e67ea040dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:35:32.452067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8a186187-0f89-4bb6-ac0f-06462e50fc00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:32.452840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8a186187-0f89-4bb6-ac0f-06462e50fc00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:32.458558 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2283/4566] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:35:31 2022] DELETE /identity/v3/projects/acccc99fe3574a59b1b416e67ea040dd => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:35:32.460205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe68ae3-8d87-427d-8f0b-cc42ecb4fb1b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:32.460744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe68ae3-8d87-427d-8f0b-cc42ecb4fb1b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:32.461038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe68ae3-8d87-427d-8f0b-cc42ecb4fb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:32.479867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-dfe68ae3-8d87-427d-8f0b-cc42ecb4fb1b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:32.481122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-dfe68ae3-8d87-427d-8f0b-cc42ecb4fb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:32.557670 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2284/4567] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:35:32.566895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1f196-8172-486a-8ada-ac597f7f852c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:32.567286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1f196-8172-486a-8ada-ac597f7f852c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:32.567791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1f196-8172-486a-8ada-ac597f7f852c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:32.592348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-cdb1f196-8172-486a-8ada-ac597f7f852c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:32.594056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-cdb1f196-8172-486a-8ada-ac597f7f852c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:32.620307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe68ae3-8d87-427d-8f0b-cc42ecb4fb1b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:32.623516 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2284/4568] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:35:32.653312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe68ae3-8d87-427d-8f0b-cc42ecb4fb1b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:32.667914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615efef0-b8b6-4ca8-9078-3c79a9c99ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:32.669084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615efef0-b8b6-4ca8-9078-3c79a9c99ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:32.681839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615efef0-b8b6-4ca8-9078-3c79a9c99ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:32.683461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615efef0-b8b6-4ca8-9078-3c79a9c99ba8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:32.684484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615efef0-b8b6-4ca8-9078-3c79a9c99ba8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:35:32.688015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615efef0-b8b6-4ca8-9078-3c79a9c99ba8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:32.688342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615efef0-b8b6-4ca8-9078-3c79a9c99ba8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:32.725813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1f196-8172-486a-8ada-ac597f7f852c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:32.733278 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2285/4569] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:35:32.741385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1f196-8172-486a-8ada-ac597f7f852c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:32.755776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d591c-425d-406c-a585-92af79392b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:32.756808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d591c-425d-406c-a585-92af79392b87 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:32.757339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d591c-425d-406c-a585-92af79392b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:32.757852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d591c-425d-406c-a585-92af79392b87 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:32.758958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d591c-425d-406c-a585-92af79392b87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:32.764959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d591c-425d-406c-a585-92af79392b87 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:32.878997 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2285/4570] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:35:32 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:35:32.883300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615efef0-b8b6-4ca8-9078-3c79a9c99ba8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:32.904456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615efef0-b8b6-4ca8-9078-3c79a9c99ba8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:33.107601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978a26e-11e2-464d-817b-5ae3727ae734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:33.108297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978a26e-11e2-464d-817b-5ae3727ae734 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:33.108583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978a26e-11e2-464d-817b-5ae3727ae734 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:33.112781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978a26e-11e2-464d-817b-5ae3727ae734 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:33.117054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978a26e-11e2-464d-817b-5ae3727ae734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:33.117651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978a26e-11e2-464d-817b-5ae3727ae734 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:33.301463 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2286/4571] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:35:32 2022] POST /identity/v3/users => generated 291 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:35:33.309002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d591c-425d-406c-a585-92af79392b87 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:33.319769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d591c-425d-406c-a585-92af79392b87 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:33.327685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4c121-d707-464a-9909-a51999990460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:33.328684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4c121-d707-464a-9909-a51999990460 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:33.329163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4c121-d707-464a-9909-a51999990460 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:33.329620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4c121-d707-464a-9909-a51999990460 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:33.330720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4c121-d707-464a-9909-a51999990460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:33.332653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4c121-d707-464a-9909-a51999990460 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:33.345729 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2286/4572] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:35:33.353272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978a26e-11e2-464d-817b-5ae3727ae734 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:33.377002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978a26e-11e2-464d-817b-5ae3727ae734 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:33.400910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2547e-4758-4a56-8d64-86f9c3da7611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:33.400910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2547e-4758-4a56-8d64-86f9c3da7611 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:33.400910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2547e-4758-4a56-8d64-86f9c3da7611 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:33.400910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2547e-4758-4a56-8d64-86f9c3da7611 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:33.401425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2547e-4758-4a56-8d64-86f9c3da7611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:33.403690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2547e-4758-4a56-8d64-86f9c3da7611 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:33.436854 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2287/4573] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:35:33.440890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4c121-d707-464a-9909-a51999990460 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:33.465444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4c121-d707-464a-9909-a51999990460 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:33.477374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f27a91-d218-4416-bc7d-454587033565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:33.480366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f27a91-d218-4416-bc7d-454587033565 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:33.480366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f27a91-d218-4416-bc7d-454587033565 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:33.480754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f27a91-d218-4416-bc7d-454587033565 admin admin] PATH_INFO: `/v3/projects/553b9c7e4f82450f827b71deadd7474c/users/2db7a6aedbab4785a793449ecf998dd7/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:33.503409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f27a91-d218-4416-bc7d-454587033565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=553b9c7e4f82450f827b71deadd7474c, user_id=2db7a6aedbab4785a793449ecf998dd7, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:33.506511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f27a91-d218-4416-bc7d-454587033565 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:33.662678 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2287/4574] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:35:33 2022] PUT /identity/v3/projects/553b9c7e4f82450f827b71deadd7474c/users/2db7a6aedbab4785a793449ecf998dd7/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:35:33.667670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbd168-57ba-47f3-9a4a-b2f606a62610 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:33.668149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbd168-57ba-47f3-9a4a-b2f606a62610 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:33.668760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbd168-57ba-47f3-9a4a-b2f606a62610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:33.731309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-82fbd168-57ba-47f3-9a4a-b2f606a62610 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:33.732704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-82fbd168-57ba-47f3-9a4a-b2f606a62610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:33.889297 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2288/4575] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:33.930630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f27a91-d218-4416-bc7d-454587033565 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:33.940954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-46f27a91-d218-4416-bc7d-454587033565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:34.092011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f27a91-d218-4416-bc7d-454587033565 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:34.119259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d55ab-7fea-4275-a429-8897e48f8ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:34.120464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d55ab-7fea-4275-a429-8897e48f8ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:34.121074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d55ab-7fea-4275-a429-8897e48f8ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:34.123254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d55ab-7fea-4275-a429-8897e48f8ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:34.149464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d55ab-7fea-4275-a429-8897e48f8ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:34.154043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d55ab-7fea-4275-a429-8897e48f8ca0 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:34.181504 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2288/4576] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:35:36.184551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92c71f-9d7c-4a59-8860-e1146387ad6e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:36.185489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92c71f-9d7c-4a59-8860-e1146387ad6e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:36.185940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92c71f-9d7c-4a59-8860-e1146387ad6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:36.225322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8d92c71f-9d7c-4a59-8860-e1146387ad6e None None] MFA Rules not processed for user `2db7a6aedbab4785a793449ecf998dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:36.227683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8d92c71f-9d7c-4a59-8860-e1146387ad6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:36.317925 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2289/4577] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:36.328258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d55ab-7fea-4275-a429-8897e48f8ca0 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:36.331196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2d1d55ab-7fea-4275-a429-8897e48f8ca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:36.413881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d55ab-7fea-4275-a429-8897e48f8ca0 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:36.419855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068e3cd-51bc-41ae-bbb9-4ba66b948953 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:36.420638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068e3cd-51bc-41ae-bbb9-4ba66b948953 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:36.421174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068e3cd-51bc-41ae-bbb9-4ba66b948953 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:36.421663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068e3cd-51bc-41ae-bbb9-4ba66b948953 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:36.434036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068e3cd-51bc-41ae-bbb9-4ba66b948953 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:36.436524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068e3cd-51bc-41ae-bbb9-4ba66b948953 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:36.458237 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2289/4578] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:35:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:35:37.499161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666b555-5fea-4ed3-bf27-4f2ca299d9a4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:37.499718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666b555-5fea-4ed3-bf27-4f2ca299d9a4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:37.499718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666b555-5fea-4ed3-bf27-4f2ca299d9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:37.538133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6666b555-5fea-4ed3-bf27-4f2ca299d9a4 None None] MFA Rules not processed for user `2db7a6aedbab4785a793449ecf998dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:37.539362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6666b555-5fea-4ed3-bf27-4f2ca299d9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:37.556397 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2290/4579] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:37.643975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca591821-788a-4306-9676-13b50725d1f9 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:37.644489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca591821-788a-4306-9676-13b50725d1f9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:37.644636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca591821-788a-4306-9676-13b50725d1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:37.675580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ca591821-788a-4306-9676-13b50725d1f9 None None] MFA Rules not processed for user `11570d45e8de428fa751c85b80b673e4`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:37.677287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ca591821-788a-4306-9676-13b50725d1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:37.762149 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2290/4580] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:37.771875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991d27b-3e41-4315-bd06-1c15bfc2e2a0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:37.772285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991d27b-3e41-4315-bd06-1c15bfc2e2a0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:37.772844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991d27b-3e41-4315-bd06-1c15bfc2e2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:37.791258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5991d27b-3e41-4315-bd06-1c15bfc2e2a0 None None] MFA Rules not processed for user `11570d45e8de428fa751c85b80b673e4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:37.793508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5991d27b-3e41-4315-bd06-1c15bfc2e2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:37.801177 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2291/4581] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:38.426630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca591821-788a-4306-9676-13b50725d1f9 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:38.437624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ca591821-788a-4306-9676-13b50725d1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:38.446876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca591821-788a-4306-9676-13b50725d1f9 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:38.450660 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84469a2b-a752-440c-87a8-efc771b828a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:38.453206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84469a2b-a752-440c-87a8-efc771b828a0 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:38.453206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84469a2b-a752-440c-87a8-efc771b828a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:38.453206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84469a2b-a752-440c-87a8-efc771b828a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:38.453864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-84469a2b-a752-440c-87a8-efc771b828a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:38.464922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84469a2b-a752-440c-87a8-efc771b828a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:38.466372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84469a2b-a752-440c-87a8-efc771b828a0 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:38.479451 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2291/4582] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:35:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:35:46.107552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991d27b-3e41-4315-bd06-1c15bfc2e2a0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:46.111859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5991d27b-3e41-4315-bd06-1c15bfc2e2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:46.127291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991d27b-3e41-4315-bd06-1c15bfc2e2a0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:46.145239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ea36a-a4ce-4fd5-8c62-820be7909e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:46.147102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ea36a-a4ce-4fd5-8c62-820be7909e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:46.147525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ea36a-a4ce-4fd5-8c62-820be7909e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:46.147980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ea36a-a4ce-4fd5-8c62-820be7909e83 admin admin] PATH_INFO: `/v3/users/319a0e8f3f79476d8ac2ae0cbe43aec4` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:46.149520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ea36a-a4ce-4fd5-8c62-820be7909e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=319a0e8f3f79476d8ac2ae0cbe43aec4)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:46.151970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ea36a-a4ce-4fd5-8c62-820be7909e83 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:46.371674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0c7ea36a-a4ce-4fd5-8c62-820be7909e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '319a0e8f3f79476d8ac2ae0cbe43aec4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:46.395714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0c7ea36a-a4ce-4fd5-8c62-820be7909e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '319a0e8f3f79476d8ac2ae0cbe43aec4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:46.397346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0c7ea36a-a4ce-4fd5-8c62-820be7909e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '319a0e8f3f79476d8ac2ae0cbe43aec4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:46.407186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0c7ea36a-a4ce-4fd5-8c62-820be7909e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '319a0e8f3f79476d8ac2ae0cbe43aec4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:46.477725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0c7ea36a-a4ce-4fd5-8c62-820be7909e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '319a0e8f3f79476d8ac2ae0cbe43aec4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:46.488284 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2292/4583] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:35:46 2022] DELETE /identity/v3/users/319a0e8f3f79476d8ac2ae0cbe43aec4 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:35:46.492231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b67927-45a1-470f-b560-2fd0fdedc973 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:46.492818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b67927-45a1-470f-b560-2fd0fdedc973 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:46.492818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b67927-45a1-470f-b560-2fd0fdedc973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:46.518308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b2b67927-45a1-470f-b560-2fd0fdedc973 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:46.521544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b2b67927-45a1-470f-b560-2fd0fdedc973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:46.621123 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2292/4584] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:46.653228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ea36a-a4ce-4fd5-8c62-820be7909e83 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:46.655333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0c7ea36a-a4ce-4fd5-8c62-820be7909e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:46.735630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ea36a-a4ce-4fd5-8c62-820be7909e83 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:46.744535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52c8cf-f289-44ea-af63-a0963eae39a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:46.745342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52c8cf-f289-44ea-af63-a0963eae39a5 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:46.745730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52c8cf-f289-44ea-af63-a0963eae39a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:46.746111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52c8cf-f289-44ea-af63-a0963eae39a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:46.758301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52c8cf-f289-44ea-af63-a0963eae39a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:46.759920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52c8cf-f289-44ea-af63-a0963eae39a5 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:46.771660 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2293/4585] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:35:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:35:47.221994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b67927-45a1-470f-b560-2fd0fdedc973 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:47.223454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b2b67927-45a1-470f-b560-2fd0fdedc973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:47.236670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b67927-45a1-470f-b560-2fd0fdedc973 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:47.255437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f7c14-0fac-499d-9885-3c4ab571ef55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:47.257377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f7c14-0fac-499d-9885-3c4ab571ef55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:47.257377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f7c14-0fac-499d-9885-3c4ab571ef55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:47.257377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f7c14-0fac-499d-9885-3c4ab571ef55 admin admin] PATH_INFO: `/v3/projects/aeb0ed00df5f4427af0b79cd832e4399` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:47.262598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f7c14-0fac-499d-9885-3c4ab571ef55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeb0ed00df5f4427af0b79cd832e4399)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:47.265182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f7c14-0fac-499d-9885-3c4ab571ef55 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:47.457156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b44f7c14-0fac-499d-9885-3c4ab571ef55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeb0ed00df5f4427af0b79cd832e4399', 'request_id': 'req-b44f7c14-0fac-499d-9885-3c4ab571ef55'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:47.540343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b44f7c14-0fac-499d-9885-3c4ab571ef55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeb0ed00df5f4427af0b79cd832e4399', 'request_id': 'req-b44f7c14-0fac-499d-9885-3c4ab571ef55'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:47.549653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b44f7c14-0fac-499d-9885-3c4ab571ef55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeb0ed00df5f4427af0b79cd832e4399', 'request_id': 'req-b44f7c14-0fac-499d-9885-3c4ab571ef55'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:47.585391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b44f7c14-0fac-499d-9885-3c4ab571ef55 admin admin] The token cache is being invalidate because project aeb0ed00df5f4427af0b79cd832e4399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:35:47.597091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b44f7c14-0fac-499d-9885-3c4ab571ef55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:47.598124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b44f7c14-0fac-499d-9885-3c4ab571ef55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:47.600336 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2293/4586] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:35:47 2022] DELETE /identity/v3/projects/aeb0ed00df5f4427af0b79cd832e4399 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:35:47.605815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dee94-36d5-4cff-af9d-ecc37124d9e8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:47.608690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dee94-36d5-4cff-af9d-ecc37124d9e8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:47.609197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dee94-36d5-4cff-af9d-ecc37124d9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:47.644947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-771dee94-36d5-4cff-af9d-ecc37124d9e8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:47.644947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-771dee94-36d5-4cff-af9d-ecc37124d9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:47.787622 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2294/4587] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:35:47.795836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118b063-5db6-4e96-bd0d-d1550b031b42 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:47.796252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118b063-5db6-4e96-bd0d-d1550b031b42 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:47.797410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118b063-5db6-4e96-bd0d-d1550b031b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:47.828173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9118b063-5db6-4e96-bd0d-d1550b031b42 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:47.830415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9118b063-5db6-4e96-bd0d-d1550b031b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:47.839723 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2294/4588] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:47.844180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771dee94-36d5-4cff-af9d-ecc37124d9e8 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:47.859357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771dee94-36d5-4cff-af9d-ecc37124d9e8 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:47.876796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c7eb5-8127-43a4-ae5c-bc02f429c9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:47.881905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c7eb5-8127-43a4-ae5c-bc02f429c9ec admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:47.881905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c7eb5-8127-43a4-ae5c-bc02f429c9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:47.881905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c7eb5-8127-43a4-ae5c-bc02f429c9ec admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:47.881905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c7eb5-8127-43a4-ae5c-bc02f429c9ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:35:47.881905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c7eb5-8127-43a4-ae5c-bc02f429c9ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:47.884624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c7eb5-8127-43a4-ae5c-bc02f429c9ec admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:47.915069 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2295/4589] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:35:47.921928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118b063-5db6-4e96-bd0d-d1550b031b42 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:47.941330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118b063-5db6-4e96-bd0d-d1550b031b42 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:47.952208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c87fb0-5d1c-444e-a6d4-993a47058d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:47.953662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c87fb0-5d1c-444e-a6d4-993a47058d58 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:47.954013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c87fb0-5d1c-444e-a6d4-993a47058d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:47.954250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c87fb0-5d1c-444e-a6d4-993a47058d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:47.956404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c87fb0-5d1c-444e-a6d4-993a47058d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:47.964272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c87fb0-5d1c-444e-a6d4-993a47058d58 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:48.127811 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2295/4590] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:35:47 2022] POST /identity/v3/projects => generated 375 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:35:48.129465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c7eb5-8127-43a4-ae5c-bc02f429c9ec admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:48.147223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c7eb5-8127-43a4-ae5c-bc02f429c9ec admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:48.238084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bbd25-31ed-4360-84bf-d7bd57acf355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:48.239284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bbd25-31ed-4360-84bf-d7bd57acf355 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:48.239851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bbd25-31ed-4360-84bf-d7bd57acf355 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:48.240292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bbd25-31ed-4360-84bf-d7bd57acf355 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:48.241653 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bbd25-31ed-4360-84bf-d7bd57acf355 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:48.243996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bbd25-31ed-4360-84bf-d7bd57acf355 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:48.354375 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2296/4591] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:35:48 2022] POST /identity/v3/users => generated 288 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:35:48.358707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c87fb0-5d1c-444e-a6d4-993a47058d58 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:48.381927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c87fb0-5d1c-444e-a6d4-993a47058d58 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:48.388910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633b96c-6d0c-452b-9f9d-841b3855c72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:48.388910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633b96c-6d0c-452b-9f9d-841b3855c72c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:48.388910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633b96c-6d0c-452b-9f9d-841b3855c72c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:48.388910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633b96c-6d0c-452b-9f9d-841b3855c72c admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:48.389430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633b96c-6d0c-452b-9f9d-841b3855c72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:48.391318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633b96c-6d0c-452b-9f9d-841b3855c72c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:48.407578 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2296/4592] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:35:48.411859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bbd25-31ed-4360-84bf-d7bd57acf355 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:48.424023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bbd25-31ed-4360-84bf-d7bd57acf355 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:48.430036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c348409-dcd1-464d-93d6-3cf0159ad3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:48.430953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c348409-dcd1-464d-93d6-3cf0159ad3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:48.431396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c348409-dcd1-464d-93d6-3cf0159ad3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:48.431847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c348409-dcd1-464d-93d6-3cf0159ad3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:48.432940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c348409-dcd1-464d-93d6-3cf0159ad3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:48.434760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c348409-dcd1-464d-93d6-3cf0159ad3c2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:48.448298 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2297/4593] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:35:48.452529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633b96c-6d0c-452b-9f9d-841b3855c72c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:48.467215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633b96c-6d0c-452b-9f9d-841b3855c72c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:48.473289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c0f68-c03b-460a-9f1b-72a5bbaff8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:48.474863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c0f68-c03b-460a-9f1b-72a5bbaff8cd admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:48.474863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c0f68-c03b-460a-9f1b-72a5bbaff8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:48.475462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c0f68-c03b-460a-9f1b-72a5bbaff8cd admin admin] PATH_INFO: `/v3/projects/77db3c06e6914376ab9983d9cd0b5f5e/users/e6dccfddca9741ec8fad984224a80ee1/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:48.496289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c0f68-c03b-460a-9f1b-72a5bbaff8cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=77db3c06e6914376ab9983d9cd0b5f5e, user_id=e6dccfddca9741ec8fad984224a80ee1, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:48.500871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c0f68-c03b-460a-9f1b-72a5bbaff8cd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:48.587139 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2297/4594] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:35:48 2022] PUT /identity/v3/projects/77db3c06e6914376ab9983d9cd0b5f5e/users/e6dccfddca9741ec8fad984224a80ee1/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:35:48.598677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae845d-c9f9-4379-ad07-a8a4caec79b6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:48.599028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae845d-c9f9-4379-ad07-a8a4caec79b6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:48.599259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae845d-c9f9-4379-ad07-a8a4caec79b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:48.638928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-32ae845d-c9f9-4379-ad07-a8a4caec79b6 None None] MFA Rules not processed for user `e6dccfddca9741ec8fad984224a80ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:48.641910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-32ae845d-c9f9-4379-ad07-a8a4caec79b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:48.743024 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2298/4595] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:48.744457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c0f68-c03b-460a-9f1b-72a5bbaff8cd admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:48.747015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e61c0f68-c03b-460a-9f1b-72a5bbaff8cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:48.833742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c0f68-c03b-460a-9f1b-72a5bbaff8cd admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:48.840873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faff963-4149-4bb7-9f91-208a2c07e6a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:48.842057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faff963-4149-4bb7-9f91-208a2c07e6a8 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:48.842599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faff963-4149-4bb7-9f91-208a2c07e6a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:48.843046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faff963-4149-4bb7-9f91-208a2c07e6a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:48.858939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faff963-4149-4bb7-9f91-208a2c07e6a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:48.870728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faff963-4149-4bb7-9f91-208a2c07e6a8 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:48.885296 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2298/4596] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:35:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:35:49.092941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae845d-c9f9-4379-ad07-a8a4caec79b6 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:49.098418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-32ae845d-c9f9-4379-ad07-a8a4caec79b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:49.214413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae845d-c9f9-4379-ad07-a8a4caec79b6 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:49.222095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b6b7f-d650-4a43-b022-bea33874399e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:49.222693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b6b7f-d650-4a43-b022-bea33874399e service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:49.222973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b6b7f-d650-4a43-b022-bea33874399e service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:49.223247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b6b7f-d650-4a43-b022-bea33874399e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:49.226108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-983b6b7f-d650-4a43-b022-bea33874399e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:49.241487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b6b7f-d650-4a43-b022-bea33874399e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:49.243121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b6b7f-d650-4a43-b022-bea33874399e service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:49.257779 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2299/4597] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:35:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:35:50.365679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faff963-4149-4bb7-9f91-208a2c07e6a8 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:50.545422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faff963-4149-4bb7-9f91-208a2c07e6a8 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:50.558674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac611b9-57b8-4626-ac14-d01abfee66e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:50.561784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac611b9-57b8-4626-ac14-d01abfee66e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:50.561784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac611b9-57b8-4626-ac14-d01abfee66e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:50.561784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac611b9-57b8-4626-ac14-d01abfee66e1 admin admin] PATH_INFO: `/v3/users/e6dccfddca9741ec8fad984224a80ee1` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:50.564789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac611b9-57b8-4626-ac14-d01abfee66e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6dccfddca9741ec8fad984224a80ee1)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:50.571236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac611b9-57b8-4626-ac14-d01abfee66e1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:50.773340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-eac611b9-57b8-4626-ac14-d01abfee66e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6dccfddca9741ec8fad984224a80ee1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:50.785584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-eac611b9-57b8-4626-ac14-d01abfee66e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6dccfddca9741ec8fad984224a80ee1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:50.797102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-eac611b9-57b8-4626-ac14-d01abfee66e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6dccfddca9741ec8fad984224a80ee1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:50.809451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-eac611b9-57b8-4626-ac14-d01abfee66e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6dccfddca9741ec8fad984224a80ee1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:50.945916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-eac611b9-57b8-4626-ac14-d01abfee66e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6dccfddca9741ec8fad984224a80ee1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:50.954340 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2299/4598] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:35:50 2022] DELETE /identity/v3/users/e6dccfddca9741ec8fad984224a80ee1 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:35:50.958932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0f2cf-e709-41f5-9109-a07f647d5265 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:50.959448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0f2cf-e709-41f5-9109-a07f647d5265 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:50.959569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0f2cf-e709-41f5-9109-a07f647d5265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:51.005138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-acf0f2cf-e709-41f5-9109-a07f647d5265 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:51.006390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-acf0f2cf-e709-41f5-9109-a07f647d5265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:51.087549 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2300/4599] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:51.101644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac611b9-57b8-4626-ac14-d01abfee66e1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:51.103571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-eac611b9-57b8-4626-ac14-d01abfee66e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:51.180410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac611b9-57b8-4626-ac14-d01abfee66e1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:51.184348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e88e54-0ed9-4aee-9376-3b0646d67ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:51.185433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e88e54-0ed9-4aee-9376-3b0646d67ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:51.185433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e88e54-0ed9-4aee-9376-3b0646d67ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:51.185665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e88e54-0ed9-4aee-9376-3b0646d67ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:51.198859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e88e54-0ed9-4aee-9376-3b0646d67ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:51.200998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e88e54-0ed9-4aee-9376-3b0646d67ab1 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:51.228810 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2300/4600] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:35:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:35:52.263787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0f2cf-e709-41f5-9109-a07f647d5265 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:52.269445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-acf0f2cf-e709-41f5-9109-a07f647d5265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:52.280358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0f2cf-e709-41f5-9109-a07f647d5265 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:52.285676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497dd0bb-7107-4d51-9766-d9efae10a89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:52.286538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dd0bb-7107-4d51-9766-d9efae10a89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:52.286817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dd0bb-7107-4d51-9766-d9efae10a89c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:52.287328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dd0bb-7107-4d51-9766-d9efae10a89c admin admin] PATH_INFO: `/v3/projects/77db3c06e6914376ab9983d9cd0b5f5e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:52.288622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497dd0bb-7107-4d51-9766-d9efae10a89c admin admin] RBAC: Authorizing `identity:delete_project(project_id=77db3c06e6914376ab9983d9cd0b5f5e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:52.290704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497dd0bb-7107-4d51-9766-d9efae10a89c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:52.406343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-497dd0bb-7107-4d51-9766-d9efae10a89c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77db3c06e6914376ab9983d9cd0b5f5e', 'request_id': 'req-497dd0bb-7107-4d51-9766-d9efae10a89c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:52.414936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-497dd0bb-7107-4d51-9766-d9efae10a89c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77db3c06e6914376ab9983d9cd0b5f5e', 'request_id': 'req-497dd0bb-7107-4d51-9766-d9efae10a89c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:52.529832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-497dd0bb-7107-4d51-9766-d9efae10a89c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77db3c06e6914376ab9983d9cd0b5f5e', 'request_id': 'req-497dd0bb-7107-4d51-9766-d9efae10a89c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:52.549449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-497dd0bb-7107-4d51-9766-d9efae10a89c admin admin] The token cache is being invalidate because project 77db3c06e6914376ab9983d9cd0b5f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:35:52.550200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-497dd0bb-7107-4d51-9766-d9efae10a89c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:52.551312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-497dd0bb-7107-4d51-9766-d9efae10a89c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:52.554123 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2301/4601] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:35:52 2022] DELETE /identity/v3/projects/77db3c06e6914376ab9983d9cd0b5f5e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:35:52.560659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cad3ca-32d3-402d-95b2-306fd6932115 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:52.561622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cad3ca-32d3-402d-95b2-306fd6932115 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:52.562078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cad3ca-32d3-402d-95b2-306fd6932115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:52.589468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e5cad3ca-32d3-402d-95b2-306fd6932115 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:52.590713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e5cad3ca-32d3-402d-95b2-306fd6932115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:52.676574 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2301/4602] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:52.685700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a356a40-c5a0-4255-a414-b01185b5f539 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:52.686486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a356a40-c5a0-4255-a414-b01185b5f539 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:52.686817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a356a40-c5a0-4255-a414-b01185b5f539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:52.734524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5a356a40-c5a0-4255-a414-b01185b5f539 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:52.740654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5a356a40-c5a0-4255-a414-b01185b5f539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:52.761615 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2302/4603] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:52.776221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cad3ca-32d3-402d-95b2-306fd6932115 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:52.795025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cad3ca-32d3-402d-95b2-306fd6932115 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:52.815151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226684f3-88e3-4b9f-a1b5-d8abd0e4aed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:52.817612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226684f3-88e3-4b9f-a1b5-d8abd0e4aed2 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:52.818135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226684f3-88e3-4b9f-a1b5-d8abd0e4aed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:52.818601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226684f3-88e3-4b9f-a1b5-d8abd0e4aed2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:52.819570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226684f3-88e3-4b9f-a1b5-d8abd0e4aed2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:35:52.820064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226684f3-88e3-4b9f-a1b5-d8abd0e4aed2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:52.832990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226684f3-88e3-4b9f-a1b5-d8abd0e4aed2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:52.856222 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2302/4604] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:35:52.857678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a356a40-c5a0-4255-a414-b01185b5f539 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:52.879470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a356a40-c5a0-4255-a414-b01185b5f539 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:52.885038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb5504-6b9f-4cb4-8400-37e47728c698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:52.885889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb5504-6b9f-4cb4-8400-37e47728c698 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:52.887925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb5504-6b9f-4cb4-8400-37e47728c698 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:52.887925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb5504-6b9f-4cb4-8400-37e47728c698 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:52.887925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb5504-6b9f-4cb4-8400-37e47728c698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:52.890609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb5504-6b9f-4cb4-8400-37e47728c698 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:53.063681 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2303/4605] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:35:52 2022] POST /identity/v3/projects => generated 371 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:35:53.065267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226684f3-88e3-4b9f-a1b5-d8abd0e4aed2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:53.076970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226684f3-88e3-4b9f-a1b5-d8abd0e4aed2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:53.146332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328ce4b-4c38-4c2a-9a5f-6d36337526e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:53.147366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328ce4b-4c38-4c2a-9a5f-6d36337526e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:53.147792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328ce4b-4c38-4c2a-9a5f-6d36337526e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:53.148084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328ce4b-4c38-4c2a-9a5f-6d36337526e2 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:53.149058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328ce4b-4c38-4c2a-9a5f-6d36337526e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:53.151358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328ce4b-4c38-4c2a-9a5f-6d36337526e2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:53.289575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb5504-6b9f-4cb4-8400-37e47728c698 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:53.301955 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2303/4606] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:35:53 2022] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:35:53.308458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb5504-6b9f-4cb4-8400-37e47728c698 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:53.314951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24ac20-12a6-48a2-8860-2c4550c7334c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:53.315960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24ac20-12a6-48a2-8860-2c4550c7334c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:53.325207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24ac20-12a6-48a2-8860-2c4550c7334c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:53.325207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24ac20-12a6-48a2-8860-2c4550c7334c admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:53.325207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24ac20-12a6-48a2-8860-2c4550c7334c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:53.325207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24ac20-12a6-48a2-8860-2c4550c7334c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:53.347091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328ce4b-4c38-4c2a-9a5f-6d36337526e2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:53.354573 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2304/4607] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:35:53.359267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328ce4b-4c38-4c2a-9a5f-6d36337526e2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:53.366272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd270c-963c-4286-acac-3f26b50ab468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:53.367215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd270c-963c-4286-acac-3f26b50ab468 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:53.368161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd270c-963c-4286-acac-3f26b50ab468 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:53.368161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd270c-963c-4286-acac-3f26b50ab468 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:53.371651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd270c-963c-4286-acac-3f26b50ab468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:53.371872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd270c-963c-4286-acac-3f26b50ab468 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:53.384388 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2304/4608] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:35:53.388904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24ac20-12a6-48a2-8860-2c4550c7334c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:53.399203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24ac20-12a6-48a2-8860-2c4550c7334c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:53.405236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3064a06-43d8-46e8-ae11-96fe1275a489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:53.406150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3064a06-43d8-46e8-ae11-96fe1275a489 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:53.406430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3064a06-43d8-46e8-ae11-96fe1275a489 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:53.406707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3064a06-43d8-46e8-ae11-96fe1275a489 admin admin] PATH_INFO: `/v3/projects/87874128eb924ef6a0b82b664573ded3/users/dc8ebaeb63264c6bb66dd47ad65a5624/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:53.437514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3064a06-43d8-46e8-ae11-96fe1275a489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87874128eb924ef6a0b82b664573ded3, user_id=dc8ebaeb63264c6bb66dd47ad65a5624, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:53.441416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3064a06-43d8-46e8-ae11-96fe1275a489 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:53.552061 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2305/4609] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:35:53 2022] PUT /identity/v3/projects/87874128eb924ef6a0b82b664573ded3/users/dc8ebaeb63264c6bb66dd47ad65a5624/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:35:53.561594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488575f-ea79-44e3-a2ee-0297e716787c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:53.562483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488575f-ea79-44e3-a2ee-0297e716787c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:53.562924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488575f-ea79-44e3-a2ee-0297e716787c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:53.594662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8488575f-ea79-44e3-a2ee-0297e716787c None None] MFA Rules not processed for user `dc8ebaeb63264c6bb66dd47ad65a5624`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:53.597995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8488575f-ea79-44e3-a2ee-0297e716787c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:53.693549 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2305/4610] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:53.702054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3064a06-43d8-46e8-ae11-96fe1275a489 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:53.861070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3064a06-43d8-46e8-ae11-96fe1275a489 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:53.870234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13099b-db07-478e-a1e2-424dfb3111bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:53.871100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13099b-db07-478e-a1e2-424dfb3111bc admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:53.875257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13099b-db07-478e-a1e2-424dfb3111bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:53.875257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13099b-db07-478e-a1e2-424dfb3111bc admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:53.875257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13099b-db07-478e-a1e2-424dfb3111bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:53.875257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13099b-db07-478e-a1e2-424dfb3111bc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:54.034006 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2306/4611] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:35:53 2022] POST /identity/v3/projects => generated 371 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:35:54.037745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488575f-ea79-44e3-a2ee-0297e716787c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:54.049933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488575f-ea79-44e3-a2ee-0297e716787c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:54.068844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13099b-db07-478e-a1e2-424dfb3111bc admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:54.068844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9b13099b-db07-478e-a1e2-424dfb3111bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:54.175693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63a7fc-a3dc-4c11-bc60-32e799e73736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:54.176423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63a7fc-a3dc-4c11-bc60-32e799e73736 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:54.176745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63a7fc-a3dc-4c11-bc60-32e799e73736 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:54.177026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63a7fc-a3dc-4c11-bc60-32e799e73736 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:54.177891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63a7fc-a3dc-4c11-bc60-32e799e73736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:54.179986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63a7fc-a3dc-4c11-bc60-32e799e73736 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:54.260523 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2306/4612] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:35:54 2022] POST /identity/v3/users => generated 292 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:35:54.262469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63a7fc-a3dc-4c11-bc60-32e799e73736 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:54.271159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13099b-db07-478e-a1e2-424dfb3111bc admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:54.290139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63a7fc-a3dc-4c11-bc60-32e799e73736 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:54.291169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79f690-2d17-429b-ab51-34af720c2c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:54.292851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79f690-2d17-429b-ab51-34af720c2c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:54.293423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79f690-2d17-429b-ab51-34af720c2c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:54.293940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79f690-2d17-429b-ab51-34af720c2c4d admin admin] PATH_INFO: `/v3/users/bb79a0a1ee5a429c9df27db4f671f0b4` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:54.300509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79f690-2d17-429b-ab51-34af720c2c4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb79a0a1ee5a429c9df27db4f671f0b4)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:54.301863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718ed9b-5c79-4f87-b621-03349af3483e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:54.302558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718ed9b-5c79-4f87-b621-03349af3483e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:54.302848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718ed9b-5c79-4f87-b621-03349af3483e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:54.303133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718ed9b-5c79-4f87-b621-03349af3483e admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:54.303892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718ed9b-5c79-4f87-b621-03349af3483e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:54.305554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718ed9b-5c79-4f87-b621-03349af3483e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:54.306289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79f690-2d17-429b-ab51-34af720c2c4d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:54.335349 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2307/4613] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:35:54.336566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718ed9b-5c79-4f87-b621-03349af3483e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:54.351744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718ed9b-5c79-4f87-b621-03349af3483e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:54.359776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87862965-d68e-4f03-87fd-a43e186bf742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:54.360792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87862965-d68e-4f03-87fd-a43e186bf742 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:54.361084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87862965-d68e-4f03-87fd-a43e186bf742 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:54.361420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87862965-d68e-4f03-87fd-a43e186bf742 admin admin] PATH_INFO: `/v3/projects/33a105f3376d48818781ffd7b18b8adb/users/c40b61aef3c740838ab1adc0f58a6ffd/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:54.396346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87862965-d68e-4f03-87fd-a43e186bf742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a105f3376d48818781ffd7b18b8adb, user_id=c40b61aef3c740838ab1adc0f58a6ffd, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:54.399396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87862965-d68e-4f03-87fd-a43e186bf742 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:54.540277 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2308/4614] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:35:54 2022] PUT /identity/v3/projects/33a105f3376d48818781ffd7b18b8adb/users/c40b61aef3c740838ab1adc0f58a6ffd/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:35:54.545643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87862965-d68e-4f03-87fd-a43e186bf742 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:54.612311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cc79f690-2d17-429b-ab51-34af720c2c4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb79a0a1ee5a429c9df27db4f671f0b4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:54.637791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cc79f690-2d17-429b-ab51-34af720c2c4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb79a0a1ee5a429c9df27db4f671f0b4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:54.638580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cc79f690-2d17-429b-ab51-34af720c2c4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb79a0a1ee5a429c9df27db4f671f0b4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:54.655604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cc79f690-2d17-429b-ab51-34af720c2c4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb79a0a1ee5a429c9df27db4f671f0b4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:54.671942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87862965-d68e-4f03-87fd-a43e186bf742 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:54.683220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e632e5e-48f3-4c8f-ab64-b89790d952bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:54.684553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e632e5e-48f3-4c8f-ab64-b89790d952bb admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:54.685419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e632e5e-48f3-4c8f-ab64-b89790d952bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:54.685884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e632e5e-48f3-4c8f-ab64-b89790d952bb admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:54.686917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e632e5e-48f3-4c8f-ab64-b89790d952bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:54.690209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e632e5e-48f3-4c8f-ab64-b89790d952bb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:54.702874 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2309/4615] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:35:54.706714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e632e5e-48f3-4c8f-ab64-b89790d952bb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:54.717597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e632e5e-48f3-4c8f-ab64-b89790d952bb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:54.727135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef0d08-0833-4177-9368-908094ea19e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:54.727135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef0d08-0833-4177-9368-908094ea19e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:54.727135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef0d08-0833-4177-9368-908094ea19e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:54.727135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef0d08-0833-4177-9368-908094ea19e2 admin admin] PATH_INFO: `/v3/projects/33a105f3376d48818781ffd7b18b8adb/users/c40b61aef3c740838ab1adc0f58a6ffd/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:54.727556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef0d08-0833-4177-9368-908094ea19e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a105f3376d48818781ffd7b18b8adb, user_id=c40b61aef3c740838ab1adc0f58a6ffd, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:54.730093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef0d08-0833-4177-9368-908094ea19e2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:54.741492 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2310/4616] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:35:54 2022] PUT /identity/v3/projects/33a105f3376d48818781ffd7b18b8adb/users/c40b61aef3c740838ab1adc0f58a6ffd/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:35:54.757152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b1d2c-3cb5-47ef-a6e4-f9898f7bf180 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:54.757152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b1d2c-3cb5-47ef-a6e4-f9898f7bf180 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:54.757152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b1d2c-3cb5-47ef-a6e4-f9898f7bf180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:54.791164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cc79f690-2d17-429b-ab51-34af720c2c4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb79a0a1ee5a429c9df27db4f671f0b4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:54.797060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a56b1d2c-3cb5-47ef-a6e4-f9898f7bf180 None None] MFA Rules not processed for user `c40b61aef3c740838ab1adc0f58a6ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:54.798942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a56b1d2c-3cb5-47ef-a6e4-f9898f7bf180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:54.801381 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2307/4617] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:35:54 2022] DELETE /identity/v3/users/bb79a0a1ee5a429c9df27db4f671f0b4 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:35:54.898863 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2311/4618] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:54 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:54.911200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79f690-2d17-429b-ab51-34af720c2c4d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:54.912669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cc79f690-2d17-429b-ab51-34af720c2c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:55.108219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79f690-2d17-429b-ab51-34af720c2c4d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:55.115024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dff0eb-ec23-44d9-af0a-5c57d2f14d94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:55.115845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dff0eb-ec23-44d9-af0a-5c57d2f14d94 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:55.116139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dff0eb-ec23-44d9-af0a-5c57d2f14d94 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:55.116420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dff0eb-ec23-44d9-af0a-5c57d2f14d94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:55.140986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dff0eb-ec23-44d9-af0a-5c57d2f14d94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:55.143071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dff0eb-ec23-44d9-af0a-5c57d2f14d94 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:55.171737 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2308/4619] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:35:54 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:35:55.289594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b1d2c-3cb5-47ef-a6e4-f9898f7bf180 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:55.291429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a56b1d2c-3cb5-47ef-a6e4-f9898f7bf180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:55.501065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b1d2c-3cb5-47ef-a6e4-f9898f7bf180 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:55.508321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7a76a-42b1-45d1-aab4-3294810328aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:55.509511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7a76a-42b1-45d1-aab4-3294810328aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:55.509651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7a76a-42b1-45d1-aab4-3294810328aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:55.509838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7a76a-42b1-45d1-aab4-3294810328aa admin admin] PATH_INFO: `/v3/projects/cde37b6fb7fb45aa9279111ef4d5ceed` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:55.512352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7a76a-42b1-45d1-aab4-3294810328aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=cde37b6fb7fb45aa9279111ef4d5ceed)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:55.514541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7a76a-42b1-45d1-aab4-3294810328aa admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:55.674016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-cea7a76a-42b1-45d1-aab4-3294810328aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cde37b6fb7fb45aa9279111ef4d5ceed', 'request_id': 'req-cea7a76a-42b1-45d1-aab4-3294810328aa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:55.728514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-cea7a76a-42b1-45d1-aab4-3294810328aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cde37b6fb7fb45aa9279111ef4d5ceed', 'request_id': 'req-cea7a76a-42b1-45d1-aab4-3294810328aa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:55.742713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-cea7a76a-42b1-45d1-aab4-3294810328aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cde37b6fb7fb45aa9279111ef4d5ceed', 'request_id': 'req-cea7a76a-42b1-45d1-aab4-3294810328aa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:55.764811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-cea7a76a-42b1-45d1-aab4-3294810328aa admin admin] The token cache is being invalidate because project cde37b6fb7fb45aa9279111ef4d5ceed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:35:55.766357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-cea7a76a-42b1-45d1-aab4-3294810328aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:55.767780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-cea7a76a-42b1-45d1-aab4-3294810328aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:55.771633 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2312/4620] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:35:55 2022] DELETE /identity/v3/projects/cde37b6fb7fb45aa9279111ef4d5ceed => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:35:55.776440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38e449-db9c-4cf4-b5ba-881a0595d856 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:55.776931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38e449-db9c-4cf4-b5ba-881a0595d856 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:55.777042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38e449-db9c-4cf4-b5ba-881a0595d856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:55.812257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0b38e449-db9c-4cf4-b5ba-881a0595d856 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:55.815759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0b38e449-db9c-4cf4-b5ba-881a0595d856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:55.914015 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2309/4621] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:55.915377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70ee75-158a-4ff4-a1d8-377be4d087b2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:55.915674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70ee75-158a-4ff4-a1d8-377be4d087b2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:55.915958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70ee75-158a-4ff4-a1d8-377be4d087b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:55.951056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-be70ee75-158a-4ff4-a1d8-377be4d087b2 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:55.952332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-be70ee75-158a-4ff4-a1d8-377be4d087b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:55.978784 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2313/4622] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:35:55.983351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38e449-db9c-4cf4-b5ba-881a0595d856 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:55.994684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38e449-db9c-4cf4-b5ba-881a0595d856 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:56.000406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d972e61-c9db-4a67-9181-7a38ef496f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:56.002110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d972e61-c9db-4a67-9181-7a38ef496f90 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:56.002498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d972e61-c9db-4a67-9181-7a38ef496f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:56.002849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d972e61-c9db-4a67-9181-7a38ef496f90 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:56.003695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d972e61-c9db-4a67-9181-7a38ef496f90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:35:56.004053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d972e61-c9db-4a67-9181-7a38ef496f90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:56.005977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d972e61-c9db-4a67-9181-7a38ef496f90 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:56.022008 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2310/4623] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:35:56.028053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70ee75-158a-4ff4-a1d8-377be4d087b2 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:56.038070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70ee75-158a-4ff4-a1d8-377be4d087b2 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:56.058028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff21f7-61c2-4092-8578-98b830ba00c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:56.058936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff21f7-61c2-4092-8578-98b830ba00c0 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:56.059693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff21f7-61c2-4092-8578-98b830ba00c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:56.060031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff21f7-61c2-4092-8578-98b830ba00c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:56.060840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff21f7-61c2-4092-8578-98b830ba00c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:56.064509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff21f7-61c2-4092-8578-98b830ba00c0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:56.163156 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2314/4624] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:35:56 2022] POST /identity/v3/projects => generated 359 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:35:56.170894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d972e61-c9db-4a67-9181-7a38ef496f90 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:56.182858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d972e61-c9db-4a67-9181-7a38ef496f90 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:56.314780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5698872-d0fc-4b4e-b89e-a7f70639462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:56.316005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5698872-d0fc-4b4e-b89e-a7f70639462f admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:56.316256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5698872-d0fc-4b4e-b89e-a7f70639462f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:56.316811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5698872-d0fc-4b4e-b89e-a7f70639462f admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:56.317534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5698872-d0fc-4b4e-b89e-a7f70639462f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:56.321109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5698872-d0fc-4b4e-b89e-a7f70639462f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:56.434449 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2311/4625] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:35:56 2022] POST /identity/v3/users => generated 280 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:35:56.439455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff21f7-61c2-4092-8578-98b830ba00c0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:56.456174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff21f7-61c2-4092-8578-98b830ba00c0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:56.463480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacb338-219a-42dc-883a-99c6c0847910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:56.464186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacb338-219a-42dc-883a-99c6c0847910 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:56.464472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacb338-219a-42dc-883a-99c6c0847910 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:56.464950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacb338-219a-42dc-883a-99c6c0847910 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:56.465563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eacb338-219a-42dc-883a-99c6c0847910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:56.467439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eacb338-219a-42dc-883a-99c6c0847910 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:56.494287 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2315/4626] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:35:56.495909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5698872-d0fc-4b4e-b89e-a7f70639462f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:56.507585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5698872-d0fc-4b4e-b89e-a7f70639462f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:56.520386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacb338-219a-42dc-883a-99c6c0847910 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:56.521762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0eacb338-219a-42dc-883a-99c6c0847910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:56.534862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6e51a-f24d-4006-9ef0-60ed3f5c6728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:56.535679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6e51a-f24d-4006-9ef0-60ed3f5c6728 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:56.535974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6e51a-f24d-4006-9ef0-60ed3f5c6728 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:56.536264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6e51a-f24d-4006-9ef0-60ed3f5c6728 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:56.537033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6e51a-f24d-4006-9ef0-60ed3f5c6728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:56.542070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6e51a-f24d-4006-9ef0-60ed3f5c6728 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:56.559848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacb338-219a-42dc-883a-99c6c0847910 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:56.575679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614d542-1978-4110-a212-669124d634bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:56.575679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614d542-1978-4110-a212-669124d634bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:56.575679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614d542-1978-4110-a212-669124d634bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:56.575679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614d542-1978-4110-a212-669124d634bc admin admin] PATH_INFO: `/v3/users/dc8ebaeb63264c6bb66dd47ad65a5624` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:56.576147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614d542-1978-4110-a212-669124d634bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc8ebaeb63264c6bb66dd47ad65a5624)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:56.576147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614d542-1978-4110-a212-669124d634bc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:56.577928 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2312/4627] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:35:56.578999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6e51a-f24d-4006-9ef0-60ed3f5c6728 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:56.592496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6e51a-f24d-4006-9ef0-60ed3f5c6728 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:56.598588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2755d4-03ed-4272-ad31-b81128faecc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:56.599569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2755d4-03ed-4272-ad31-b81128faecc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:56.599862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2755d4-03ed-4272-ad31-b81128faecc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:56.600142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2755d4-03ed-4272-ad31-b81128faecc9 admin admin] PATH_INFO: `/v3/projects/2c99f0e29f35413fb396a4ba0c712113/users/8c66787dc22444039733ddcb2bbe4a36/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:56.620097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2755d4-03ed-4272-ad31-b81128faecc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c99f0e29f35413fb396a4ba0c712113, user_id=8c66787dc22444039733ddcb2bbe4a36, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:56.623113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2755d4-03ed-4272-ad31-b81128faecc9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:56.706703 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2313/4628] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:35:56 2022] PUT /identity/v3/projects/2c99f0e29f35413fb396a4ba0c712113/users/8c66787dc22444039733ddcb2bbe4a36/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:35:56.717284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787b4be-89bb-43ed-97bc-f8722ca0b6ca None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:56.718378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787b4be-89bb-43ed-97bc-f8722ca0b6ca None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:56.718736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787b4be-89bb-43ed-97bc-f8722ca0b6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:56.762143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b787b4be-89bb-43ed-97bc-f8722ca0b6ca None None] MFA Rules not processed for user `8c66787dc22444039733ddcb2bbe4a36`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:56.763591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b787b4be-89bb-43ed-97bc-f8722ca0b6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:56.804216 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4614d542-1978-4110-a212-669124d634bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc8ebaeb63264c6bb66dd47ad65a5624'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:56.831507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4614d542-1978-4110-a212-669124d634bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc8ebaeb63264c6bb66dd47ad65a5624'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:56.834146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4614d542-1978-4110-a212-669124d634bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc8ebaeb63264c6bb66dd47ad65a5624'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:56.851764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4614d542-1978-4110-a212-669124d634bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc8ebaeb63264c6bb66dd47ad65a5624'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:56.892786 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2314/4629] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:56 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:56.950651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787b4be-89bb-43ed-97bc-f8722ca0b6ca None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:56.962871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4614d542-1978-4110-a212-669124d634bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc8ebaeb63264c6bb66dd47ad65a5624'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:56.978114 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2316/4630] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:35:56 2022] DELETE /identity/v3/users/dc8ebaeb63264c6bb66dd47ad65a5624 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:35:56.989555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d86a0-cde6-43b6-bdc5-8e74c785f8e0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:56.989555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d86a0-cde6-43b6-bdc5-8e74c785f8e0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:56.991141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d86a0-cde6-43b6-bdc5-8e74c785f8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:57.033038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2d9d86a0-cde6-43b6-bdc5-8e74c785f8e0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:57.037647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2d9d86a0-cde6-43b6-bdc5-8e74c785f8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:57.102534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787b4be-89bb-43ed-97bc-f8722ca0b6ca None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:57.168146 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2317/4631] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:57.205538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337e703-03dc-40c5-a91d-6d5dc7ce5b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:57.206507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337e703-03dc-40c5-a91d-6d5dc7ce5b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:57.206871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337e703-03dc-40c5-a91d-6d5dc7ce5b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:57.207161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337e703-03dc-40c5-a91d-6d5dc7ce5b2e admin admin] PATH_INFO: `/v3/users/8c66787dc22444039733ddcb2bbe4a36` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:57.208742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337e703-03dc-40c5-a91d-6d5dc7ce5b2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c66787dc22444039733ddcb2bbe4a36)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:57.211285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337e703-03dc-40c5-a91d-6d5dc7ce5b2e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:57.244013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d86a0-cde6-43b6-bdc5-8e74c785f8e0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:57.253044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2d9d86a0-cde6-43b6-bdc5-8e74c785f8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:57.369340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d86a0-cde6-43b6-bdc5-8e74c785f8e0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:57.374955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97693adf-9ad5-413a-a108-dc2fabc239d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:57.376137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97693adf-9ad5-413a-a108-dc2fabc239d4 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:57.376787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97693adf-9ad5-413a-a108-dc2fabc239d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:57.377433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97693adf-9ad5-413a-a108-dc2fabc239d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:57.395068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97693adf-9ad5-413a-a108-dc2fabc239d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:57.397310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97693adf-9ad5-413a-a108-dc2fabc239d4 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:57.412453 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2318/4632] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:35:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:35:57.481948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a337e703-03dc-40c5-a91d-6d5dc7ce5b2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c66787dc22444039733ddcb2bbe4a36'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:57.505605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a337e703-03dc-40c5-a91d-6d5dc7ce5b2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c66787dc22444039733ddcb2bbe4a36'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:57.506364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a337e703-03dc-40c5-a91d-6d5dc7ce5b2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c66787dc22444039733ddcb2bbe4a36'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:57.513988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a337e703-03dc-40c5-a91d-6d5dc7ce5b2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c66787dc22444039733ddcb2bbe4a36'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:57.597475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a337e703-03dc-40c5-a91d-6d5dc7ce5b2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c66787dc22444039733ddcb2bbe4a36'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:57.608824 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2315/4633] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:35:56 2022] DELETE /identity/v3/users/8c66787dc22444039733ddcb2bbe4a36 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:35:57.610435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5684b2f-636e-41d5-acaa-100dd7119da0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:57.610943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5684b2f-636e-41d5-acaa-100dd7119da0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:57.611285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5684b2f-636e-41d5-acaa-100dd7119da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:57.632731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e5684b2f-636e-41d5-acaa-100dd7119da0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:57.634030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e5684b2f-636e-41d5-acaa-100dd7119da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:57.736110 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2319/4634] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:35:57.766247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337e703-03dc-40c5-a91d-6d5dc7ce5b2e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:57.769748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a337e703-03dc-40c5-a91d-6d5dc7ce5b2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:57.936360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337e703-03dc-40c5-a91d-6d5dc7ce5b2e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:57.942238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d7b5f-5d1e-4cdc-9225-120d27d32f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:57.942965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d7b5f-5d1e-4cdc-9225-120d27d32f27 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:57.943316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d7b5f-5d1e-4cdc-9225-120d27d32f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:57.943606 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d7b5f-5d1e-4cdc-9225-120d27d32f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:57.957281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d7b5f-5d1e-4cdc-9225-120d27d32f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:57.968849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d7b5f-5d1e-4cdc-9225-120d27d32f27 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:57.983531 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2316/4635] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:35:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:35:58.487177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5684b2f-636e-41d5-acaa-100dd7119da0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:58.488646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e5684b2f-636e-41d5-acaa-100dd7119da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:58.503610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5684b2f-636e-41d5-acaa-100dd7119da0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:58.509509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb6bda-ab4b-443e-ac74-e9ce09f1eeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:58.510697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb6bda-ab4b-443e-ac74-e9ce09f1eeda admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:58.511048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb6bda-ab4b-443e-ac74-e9ce09f1eeda admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:58.511544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb6bda-ab4b-443e-ac74-e9ce09f1eeda admin admin] PATH_INFO: `/v3/projects/87874128eb924ef6a0b82b664573ded3` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:58.513019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb6bda-ab4b-443e-ac74-e9ce09f1eeda admin admin] RBAC: Authorizing `identity:delete_project(project_id=87874128eb924ef6a0b82b664573ded3)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:58.515272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb6bda-ab4b-443e-ac74-e9ce09f1eeda admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:58.649632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-34bb6bda-ab4b-443e-ac74-e9ce09f1eeda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87874128eb924ef6a0b82b664573ded3', 'request_id': 'req-34bb6bda-ab4b-443e-ac74-e9ce09f1eeda'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:58.717365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-34bb6bda-ab4b-443e-ac74-e9ce09f1eeda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87874128eb924ef6a0b82b664573ded3', 'request_id': 'req-34bb6bda-ab4b-443e-ac74-e9ce09f1eeda'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:58.725719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-34bb6bda-ab4b-443e-ac74-e9ce09f1eeda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87874128eb924ef6a0b82b664573ded3', 'request_id': 'req-34bb6bda-ab4b-443e-ac74-e9ce09f1eeda'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:58.738938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-34bb6bda-ab4b-443e-ac74-e9ce09f1eeda admin admin] The token cache is being invalidate because project 87874128eb924ef6a0b82b664573ded3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:35:58.739232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-34bb6bda-ab4b-443e-ac74-e9ce09f1eeda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:58.743087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-34bb6bda-ab4b-443e-ac74-e9ce09f1eeda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:58.743087 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2320/4636] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:35:58 2022] DELETE /identity/v3/projects/87874128eb924ef6a0b82b664573ded3 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:35:58.745934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d7b5f-5d1e-4cdc-9225-120d27d32f27 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:58.756844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d7b5f-5d1e-4cdc-9225-120d27d32f27 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:58.837705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849772b-266a-4b78-9e5a-19060dc57ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:58.838909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849772b-266a-4b78-9e5a-19060dc57ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:58.839506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849772b-266a-4b78-9e5a-19060dc57ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:58.839950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849772b-266a-4b78-9e5a-19060dc57ed7 admin admin] PATH_INFO: `/v3/users/c40b61aef3c740838ab1adc0f58a6ffd` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:58.841878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849772b-266a-4b78-9e5a-19060dc57ed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c40b61aef3c740838ab1adc0f58a6ffd)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:58.845629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849772b-266a-4b78-9e5a-19060dc57ed7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:59.126929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5849772b-266a-4b78-9e5a-19060dc57ed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c40b61aef3c740838ab1adc0f58a6ffd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:59.161908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5849772b-266a-4b78-9e5a-19060dc57ed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c40b61aef3c740838ab1adc0f58a6ffd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:59.167647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5849772b-266a-4b78-9e5a-19060dc57ed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c40b61aef3c740838ab1adc0f58a6ffd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:59.178985 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5849772b-266a-4b78-9e5a-19060dc57ed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c40b61aef3c740838ab1adc0f58a6ffd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:59.248359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb6bda-ab4b-443e-ac74-e9ce09f1eeda admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:59.251764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-34bb6bda-ab4b-443e-ac74-e9ce09f1eeda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:59.271797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5849772b-266a-4b78-9e5a-19060dc57ed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c40b61aef3c740838ab1adc0f58a6ffd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:59.275327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb6bda-ab4b-443e-ac74-e9ce09f1eeda admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:59.279510 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2317/4637] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:35:58 2022] DELETE /identity/v3/users/c40b61aef3c740838ab1adc0f58a6ffd => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:35:59.283055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce2007-416e-4ef3-bb84-62ac2521ef6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:59.284475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce2007-416e-4ef3-bb84-62ac2521ef6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:59.284903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce2007-416e-4ef3-bb84-62ac2521ef6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:59.285283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce2007-416e-4ef3-bb84-62ac2521ef6b admin admin] PATH_INFO: `/v3/projects/2c99f0e29f35413fb396a4ba0c712113` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:59.286977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce2007-416e-4ef3-bb84-62ac2521ef6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c99f0e29f35413fb396a4ba0c712113)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:59.289090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce2007-416e-4ef3-bb84-62ac2521ef6b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:59.412060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-39ce2007-416e-4ef3-bb84-62ac2521ef6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c99f0e29f35413fb396a4ba0c712113', 'request_id': 'req-39ce2007-416e-4ef3-bb84-62ac2521ef6b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:59.466005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-39ce2007-416e-4ef3-bb84-62ac2521ef6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c99f0e29f35413fb396a4ba0c712113', 'request_id': 'req-39ce2007-416e-4ef3-bb84-62ac2521ef6b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:59.476001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-39ce2007-416e-4ef3-bb84-62ac2521ef6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c99f0e29f35413fb396a4ba0c712113', 'request_id': 'req-39ce2007-416e-4ef3-bb84-62ac2521ef6b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:59.489830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-39ce2007-416e-4ef3-bb84-62ac2521ef6b admin admin] The token cache is being invalidate because project 2c99f0e29f35413fb396a4ba0c712113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:35:59.490702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-39ce2007-416e-4ef3-bb84-62ac2521ef6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:59.490992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-39ce2007-416e-4ef3-bb84-62ac2521ef6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:35:59.496141 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2321/4638] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:35:59 2022] DELETE /identity/v3/projects/2c99f0e29f35413fb396a4ba0c712113 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:35:59.501793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d043a-3e8d-4573-85ae-36e29446935b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:59.502462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d043a-3e8d-4573-85ae-36e29446935b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:59.502759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d043a-3e8d-4573-85ae-36e29446935b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:59.533469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-cb1d043a-3e8d-4573-85ae-36e29446935b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:59.534858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cb1d043a-3e8d-4573-85ae-36e29446935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:59.642287 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2318/4639] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:35:59.645552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c619a34-64a7-422c-b449-c486e032dc5f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:59.645954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c619a34-64a7-422c-b449-c486e032dc5f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:59.646677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c619a34-64a7-422c-b449-c486e032dc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:59.678682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9c619a34-64a7-422c-b449-c486e032dc5f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:35:59.680223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9c619a34-64a7-422c-b449-c486e032dc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:35:59.691873 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2322/4640] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:35:59.696495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d043a-3e8d-4573-85ae-36e29446935b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:59.709508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d043a-3e8d-4573-85ae-36e29446935b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:59.714753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1857c6-17d4-48b1-9254-0f2f3271fe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:59.715695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1857c6-17d4-48b1-9254-0f2f3271fe3a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:59.715986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1857c6-17d4-48b1-9254-0f2f3271fe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:59.716305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1857c6-17d4-48b1-9254-0f2f3271fe3a admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:59.717092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1857c6-17d4-48b1-9254-0f2f3271fe3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:35:59.717408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1857c6-17d4-48b1-9254-0f2f3271fe3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:59.719047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1857c6-17d4-48b1-9254-0f2f3271fe3a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:59.744671 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2319/4641] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:35:59.747488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c619a34-64a7-422c-b449-c486e032dc5f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:59.771650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c619a34-64a7-422c-b449-c486e032dc5f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:59.779679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad28a2c-5f66-4e51-827c-c7beb1cee7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:59.780905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad28a2c-5f66-4e51-827c-c7beb1cee7dc admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:59.781558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad28a2c-5f66-4e51-827c-c7beb1cee7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:59.783383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad28a2c-5f66-4e51-827c-c7beb1cee7dc admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:59.785798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad28a2c-5f66-4e51-827c-c7beb1cee7dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:59.789418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad28a2c-5f66-4e51-827c-c7beb1cee7dc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:35:59.880053 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2323/4642] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:35:59 2022] POST /identity/v3/projects => generated 389 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:35:59.884387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1857c6-17d4-48b1-9254-0f2f3271fe3a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:35:59.903979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1857c6-17d4-48b1-9254-0f2f3271fe3a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:35:59.981690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e243f7f-9c59-42d0-8d63-f24c36452e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:35:59.982478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e243f7f-9c59-42d0-8d63-f24c36452e3c admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:35:59.982828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e243f7f-9c59-42d0-8d63-f24c36452e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:35:59.985580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e243f7f-9c59-42d0-8d63-f24c36452e3c admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:35:59.989068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e243f7f-9c59-42d0-8d63-f24c36452e3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:35:59.994744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e243f7f-9c59-42d0-8d63-f24c36452e3c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:00.134419 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2320/4643] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:35:59 2022] POST /identity/v3/users => generated 295 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:36:00.138512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad28a2c-5f66-4e51-827c-c7beb1cee7dc admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:00.149178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad28a2c-5f66-4e51-827c-c7beb1cee7dc admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:00.154534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c124568-2b45-4993-82e3-36a0feec7fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:00.154534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c124568-2b45-4993-82e3-36a0feec7fcd admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:00.154764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c124568-2b45-4993-82e3-36a0feec7fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:00.154983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c124568-2b45-4993-82e3-36a0feec7fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:00.155750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c124568-2b45-4993-82e3-36a0feec7fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:00.157418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c124568-2b45-4993-82e3-36a0feec7fcd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:00.167822 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2324/4644] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:00.171859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e243f7f-9c59-42d0-8d63-f24c36452e3c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:00.182941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e243f7f-9c59-42d0-8d63-f24c36452e3c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:00.189843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6ee92-a0b7-4afd-af8c-826df1ab5bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:00.190766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6ee92-a0b7-4afd-af8c-826df1ab5bff admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:00.191059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6ee92-a0b7-4afd-af8c-826df1ab5bff admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:00.191337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6ee92-a0b7-4afd-af8c-826df1ab5bff admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:00.192079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6ee92-a0b7-4afd-af8c-826df1ab5bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:00.195829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6ee92-a0b7-4afd-af8c-826df1ab5bff admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:00.197359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c124568-2b45-4993-82e3-36a0feec7fcd admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:00.199343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0c124568-2b45-4993-82e3-36a0feec7fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:00.208168 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2321/4645] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:00.212357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6ee92-a0b7-4afd-af8c-826df1ab5bff admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:00.222310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c124568-2b45-4993-82e3-36a0feec7fcd admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:00.226197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6ee92-a0b7-4afd-af8c-826df1ab5bff admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:00.229751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e84e06-a827-4b22-9ffd-a2fa51c49759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:00.230538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e84e06-a827-4b22-9ffd-a2fa51c49759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:00.231129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e84e06-a827-4b22-9ffd-a2fa51c49759 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:00.231219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e84e06-a827-4b22-9ffd-a2fa51c49759 admin admin] PATH_INFO: `/v3/projects/33a105f3376d48818781ffd7b18b8adb` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:00.233095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e84e06-a827-4b22-9ffd-a2fa51c49759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33a105f3376d48818781ffd7b18b8adb)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:00.235860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e84e06-a827-4b22-9ffd-a2fa51c49759 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:00.270761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f27fe3-6eb3-43e6-b3a1-beb348d0d111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:00.271683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f27fe3-6eb3-43e6-b3a1-beb348d0d111 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:00.272000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f27fe3-6eb3-43e6-b3a1-beb348d0d111 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:00.272417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f27fe3-6eb3-43e6-b3a1-beb348d0d111 admin admin] PATH_INFO: `/v3/projects/b68e88ba1a694bb2b6371213cb70c32c/users/e8ab562c65674682ae625a4f85a0223a/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:00.333936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f27fe3-6eb3-43e6-b3a1-beb348d0d111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b68e88ba1a694bb2b6371213cb70c32c, user_id=e8ab562c65674682ae625a4f85a0223a, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:00.336545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f27fe3-6eb3-43e6-b3a1-beb348d0d111 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:00.466927 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2322/4646] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:00 2022] PUT /identity/v3/projects/b68e88ba1a694bb2b6371213cb70c32c/users/e8ab562c65674682ae625a4f85a0223a/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:00.470698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe959b0-18c5-4b0b-9eda-13a355dcf4d1 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:00.475369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe959b0-18c5-4b0b-9eda-13a355dcf4d1 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:00.475369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe959b0-18c5-4b0b-9eda-13a355dcf4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:00.505392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b8e84e06-a827-4b22-9ffd-a2fa51c49759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33a105f3376d48818781ffd7b18b8adb', 'request_id': 'req-b8e84e06-a827-4b22-9ffd-a2fa51c49759'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:00.550233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ebe959b0-18c5-4b0b-9eda-13a355dcf4d1 None None] MFA Rules not processed for user `e8ab562c65674682ae625a4f85a0223a`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:00.551703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ebe959b0-18c5-4b0b-9eda-13a355dcf4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:00.609060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b8e84e06-a827-4b22-9ffd-a2fa51c49759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33a105f3376d48818781ffd7b18b8adb', 'request_id': 'req-b8e84e06-a827-4b22-9ffd-a2fa51c49759'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:00.618142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b8e84e06-a827-4b22-9ffd-a2fa51c49759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33a105f3376d48818781ffd7b18b8adb', 'request_id': 'req-b8e84e06-a827-4b22-9ffd-a2fa51c49759'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:00.646100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b8e84e06-a827-4b22-9ffd-a2fa51c49759 admin admin] The token cache is being invalidate because project 33a105f3376d48818781ffd7b18b8adb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:00.646383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b8e84e06-a827-4b22-9ffd-a2fa51c49759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:00.647532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b8e84e06-a827-4b22-9ffd-a2fa51c49759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:00.650077 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2325/4647] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:36:00 2022] DELETE /identity/v3/projects/33a105f3376d48818781ffd7b18b8adb => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:00.655012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e035a-74b8-49f0-b3f9-69c499f09431 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:00.655522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e035a-74b8-49f0-b3f9-69c499f09431 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:00.655982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e035a-74b8-49f0-b3f9-69c499f09431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:00.678755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-7c6e035a-74b8-49f0-b3f9-69c499f09431 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:00.681107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7c6e035a-74b8-49f0-b3f9-69c499f09431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:00.710281 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2323/4648] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:00.712384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe959b0-18c5-4b0b-9eda-13a355dcf4d1 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:00.714412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ebe959b0-18c5-4b0b-9eda-13a355dcf4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:00.772644 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2326/4649] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:00.783394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc06e9-2447-4f70-9cf5-8920b6822337 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:00.784272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc06e9-2447-4f70-9cf5-8920b6822337 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:00.785073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc06e9-2447-4f70-9cf5-8920b6822337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:00.815543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f3cc06e9-2447-4f70-9cf5-8920b6822337 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:00.817448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f3cc06e9-2447-4f70-9cf5-8920b6822337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:00.827702 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2327/4650] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:36:00.831452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc06e9-2447-4f70-9cf5-8920b6822337 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:00.831607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe959b0-18c5-4b0b-9eda-13a355dcf4d1 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:00.842581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc06e9-2447-4f70-9cf5-8920b6822337 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:00.848968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bef1a-8989-416f-9d0d-8daf596d8140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:00.849864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bef1a-8989-416f-9d0d-8daf596d8140 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:00.850149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bef1a-8989-416f-9d0d-8daf596d8140 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:00.850427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bef1a-8989-416f-9d0d-8daf596d8140 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:00.851193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bef1a-8989-416f-9d0d-8daf596d8140 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:36:00.851505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bef1a-8989-416f-9d0d-8daf596d8140 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:00.853124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bef1a-8989-416f-9d0d-8daf596d8140 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:00.867950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba429b2-1862-4a32-9c25-fff81c18c5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:00.867950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba429b2-1862-4a32-9c25-fff81c18c5ac admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:00.867950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba429b2-1862-4a32-9c25-fff81c18c5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:00.867950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba429b2-1862-4a32-9c25-fff81c18c5ac admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:00.871252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba429b2-1862-4a32-9c25-fff81c18c5ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:00.871252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba429b2-1862-4a32-9c25-fff81c18c5ac admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:00.877883 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2328/4651] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:00.883660 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bef1a-8989-416f-9d0d-8daf596d8140 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:00.900180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bef1a-8989-416f-9d0d-8daf596d8140 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:00.904888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9dbf9a-db00-4d9b-9168-be9350411ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:00.905560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9dbf9a-db00-4d9b-9168-be9350411ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:00.905850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9dbf9a-db00-4d9b-9168-be9350411ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:00.906173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9dbf9a-db00-4d9b-9168-be9350411ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:00.906884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9dbf9a-db00-4d9b-9168-be9350411ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:00.909422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9dbf9a-db00-4d9b-9168-be9350411ca7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:00.982691 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2324/4652] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:36:00 2022] POST /identity/v3/projects => generated 391 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:00.987783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba429b2-1862-4a32-9c25-fff81c18c5ac admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:01.013246 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2329/4653] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:36:00 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:01.018969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9dbf9a-db00-4d9b-9168-be9350411ca7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:01.176434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9dbf9a-db00-4d9b-9168-be9350411ca7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:01.189176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba429b2-1862-4a32-9c25-fff81c18c5ac admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:01.197685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa3f2f-0a66-464e-8b31-2c57b532a7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:01.198424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa3f2f-0a66-464e-8b31-2c57b532a7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:01.198811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa3f2f-0a66-464e-8b31-2c57b532a7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:01.213195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ae629-df48-43d7-a4eb-7fff89fc7d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:01.218260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ae629-df48-43d7-a4eb-7fff89fc7d43 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:01.218442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa3f2f-0a66-464e-8b31-2c57b532a7d6 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:01.218625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ae629-df48-43d7-a4eb-7fff89fc7d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:01.218625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ae629-df48-43d7-a4eb-7fff89fc7d43 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:01.218625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ae629-df48-43d7-a4eb-7fff89fc7d43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:01.219049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa3f2f-0a66-464e-8b31-2c57b532a7d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:01.219197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ae629-df48-43d7-a4eb-7fff89fc7d43 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:01.219580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa3f2f-0a66-464e-8b31-2c57b532a7d6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:01.333862 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2330/4654] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:36:01 2022] POST /identity/v3/users => generated 293 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:36:01.337892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ae629-df48-43d7-a4eb-7fff89fc7d43 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:01.351490 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2325/4655] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:36:00 2022] POST /identity/v3/users => generated 302 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:36:01.354688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ae629-df48-43d7-a4eb-7fff89fc7d43 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:01.364906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6af59-4e4b-4f87-877f-fb819e09fd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:01.365693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6af59-4e4b-4f87-877f-fb819e09fd45 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:01.366329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6af59-4e4b-4f87-877f-fb819e09fd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:01.368106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6af59-4e4b-4f87-877f-fb819e09fd45 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:01.368922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6af59-4e4b-4f87-877f-fb819e09fd45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:01.373500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa3f2f-0a66-464e-8b31-2c57b532a7d6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:01.376509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6af59-4e4b-4f87-877f-fb819e09fd45 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:01.401967 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2331/4656] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:01.403171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6af59-4e4b-4f87-877f-fb819e09fd45 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:01.422360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa3f2f-0a66-464e-8b31-2c57b532a7d6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:01.439825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6af59-4e4b-4f87-877f-fb819e09fd45 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:01.450442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbd6e6-52b0-4280-8eb7-2b5e9aea862f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:01.452389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e55803-c5c4-4a98-9db6-645ca45e0e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:01.453275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e55803-c5c4-4a98-9db6-645ca45e0e23 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:01.453675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbd6e6-52b0-4280-8eb7-2b5e9aea862f admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:01.453889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e55803-c5c4-4a98-9db6-645ca45e0e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:01.454859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e55803-c5c4-4a98-9db6-645ca45e0e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:01.455856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e55803-c5c4-4a98-9db6-645ca45e0e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:01.456316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbd6e6-52b0-4280-8eb7-2b5e9aea862f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:01.457144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbd6e6-52b0-4280-8eb7-2b5e9aea862f admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:01.458367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e55803-c5c4-4a98-9db6-645ca45e0e23 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:01.462022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbd6e6-52b0-4280-8eb7-2b5e9aea862f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:01.467737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbd6e6-52b0-4280-8eb7-2b5e9aea862f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:01.471945 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2332/4657] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:01.478658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e55803-c5c4-4a98-9db6-645ca45e0e23 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:01.495536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e55803-c5c4-4a98-9db6-645ca45e0e23 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:01.503521 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2326/4658] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:01.519736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbd6e6-52b0-4280-8eb7-2b5e9aea862f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:01.521554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07056f00-e18e-4627-9597-eebb466241df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:01.522479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07056f00-e18e-4627-9597-eebb466241df admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:01.522766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07056f00-e18e-4627-9597-eebb466241df admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:01.523048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07056f00-e18e-4627-9597-eebb466241df admin admin] PATH_INFO: `/v3/projects/cdb85581362c41929cd74827f6654a89/users/061ef885372742f0a9be8d967060ffe7/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:01.546440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbd6e6-52b0-4280-8eb7-2b5e9aea862f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:01.546654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07056f00-e18e-4627-9597-eebb466241df admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb85581362c41929cd74827f6654a89, user_id=061ef885372742f0a9be8d967060ffe7, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:01.546753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3164843-c04b-4835-a81e-221069036db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:01.546753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3164843-c04b-4835-a81e-221069036db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:01.546753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3164843-c04b-4835-a81e-221069036db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:01.546753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3164843-c04b-4835-a81e-221069036db8 admin admin] PATH_INFO: `/v3/projects/d93bb6e9ee764c54b113d5e04cf5163c/users/2cadde14f4d34220a25d2c351845a09b/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:01.548117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07056f00-e18e-4627-9597-eebb466241df admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:01.565424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3164843-c04b-4835-a81e-221069036db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93bb6e9ee764c54b113d5e04cf5163c, user_id=2cadde14f4d34220a25d2c351845a09b, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:01.568414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3164843-c04b-4835-a81e-221069036db8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:01.649421 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2333/4659] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:01 2022] PUT /identity/v3/projects/cdb85581362c41929cd74827f6654a89/users/061ef885372742f0a9be8d967060ffe7/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:01.652301 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2327/4660] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:01 2022] PUT /identity/v3/projects/d93bb6e9ee764c54b113d5e04cf5163c/users/2cadde14f4d34220a25d2c351845a09b/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:01.656198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07056f00-e18e-4627-9597-eebb466241df admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:01.662466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9661f-992c-41e5-87bb-beb83d22d95a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:01.663278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9661f-992c-41e5-87bb-beb83d22d95a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:01.664282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9661f-992c-41e5-87bb-beb83d22d95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:01.697772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-25f9661f-992c-41e5-87bb-beb83d22d95a None None] MFA Rules not processed for user `061ef885372742f0a9be8d967060ffe7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:01.699286 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-25f9661f-992c-41e5-87bb-beb83d22d95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:01.810054 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2328/4661] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:36:01.812042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07056f00-e18e-4627-9597-eebb466241df admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:01.814991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9661f-992c-41e5-87bb-beb83d22d95a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:01.830124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba2d8a-6121-4669-b5ed-99a11e83ec9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:01.831052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9661f-992c-41e5-87bb-beb83d22d95a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:01.832289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba2d8a-6121-4669-b5ed-99a11e83ec9c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:01.833396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba2d8a-6121-4669-b5ed-99a11e83ec9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:01.834038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba2d8a-6121-4669-b5ed-99a11e83ec9c admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:01.836589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cf927-7eb0-491b-a9c2-11fdf3fabae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:01.836993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba2d8a-6121-4669-b5ed-99a11e83ec9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:01.837282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cf927-7eb0-491b-a9c2-11fdf3fabae1 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:01.837615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cf927-7eb0-491b-a9c2-11fdf3fabae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:01.837894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cf927-7eb0-491b-a9c2-11fdf3fabae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:01.838633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cf927-7eb0-491b-a9c2-11fdf3fabae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:01.840699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cf927-7eb0-491b-a9c2-11fdf3fabae1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:01.854669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba2d8a-6121-4669-b5ed-99a11e83ec9c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:01.917176 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2334/4662] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:01.919047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba2d8a-6121-4669-b5ed-99a11e83ec9c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:01.947329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba2d8a-6121-4669-b5ed-99a11e83ec9c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:01.953680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e9ad5-187f-4208-a968-b9bac1487171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:01.961778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e9ad5-187f-4208-a968-b9bac1487171 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:01.962208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e9ad5-187f-4208-a968-b9bac1487171 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:01.962373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e9ad5-187f-4208-a968-b9bac1487171 admin admin] PATH_INFO: `/v3/projects/d93bb6e9ee764c54b113d5e04cf5163c/users/2cadde14f4d34220a25d2c351845a09b/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:01.964719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e9ad5-187f-4208-a968-b9bac1487171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93bb6e9ee764c54b113d5e04cf5163c, user_id=2cadde14f4d34220a25d2c351845a09b, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:01.968360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e9ad5-187f-4208-a968-b9bac1487171 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:01.983053 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2335/4663] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:01 2022] PUT /identity/v3/projects/d93bb6e9ee764c54b113d5e04cf5163c/users/2cadde14f4d34220a25d2c351845a09b/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:02.003096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c9577-90ae-4553-9fb8-fba5610df03a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:02.003396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c9577-90ae-4553-9fb8-fba5610df03a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:02.003686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c9577-90ae-4553-9fb8-fba5610df03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:02.022029 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2329/4664] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:36:01 2022] POST /identity/v3/projects => generated 387 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:02.028145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cf927-7eb0-491b-a9c2-11fdf3fabae1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:02.137574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cf927-7eb0-491b-a9c2-11fdf3fabae1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:02.144521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c08a7c-279d-4a6b-a040-a6d24f94c5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:02.145737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c08a7c-279d-4a6b-a040-a6d24f94c5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:02.151240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c08a7c-279d-4a6b-a040-a6d24f94c5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:02.151240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c08a7c-279d-4a6b-a040-a6d24f94c5b7 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:02.151240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c08a7c-279d-4a6b-a040-a6d24f94c5b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:02.151240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c08a7c-279d-4a6b-a040-a6d24f94c5b7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:02.154202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2d1c9577-90ae-4553-9fb8-fba5610df03a None None] MFA Rules not processed for user `2cadde14f4d34220a25d2c351845a09b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:02.156205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2d1c9577-90ae-4553-9fb8-fba5610df03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:02.273556 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2330/4665] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:36:02 2022] POST /identity/v3/users => generated 294 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:02.274933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c08a7c-279d-4a6b-a040-a6d24f94c5b7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:02.300432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c08a7c-279d-4a6b-a040-a6d24f94c5b7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:02.310379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d3732-fa40-4ac5-9922-4c58c8ead567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:02.311577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d3732-fa40-4ac5-9922-4c58c8ead567 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:02.312066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d3732-fa40-4ac5-9922-4c58c8ead567 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:02.312537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d3732-fa40-4ac5-9922-4c58c8ead567 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:02.313638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d3732-fa40-4ac5-9922-4c58c8ead567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:02.316175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d3732-fa40-4ac5-9922-4c58c8ead567 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:02.331151 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2331/4666] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:02.335511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d3732-fa40-4ac5-9922-4c58c8ead567 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:02.349045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d3732-fa40-4ac5-9922-4c58c8ead567 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:02.357780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736b365-e1eb-46b7-8aa2-413961fce37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:02.358148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736b365-e1eb-46b7-8aa2-413961fce37d admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:02.358440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736b365-e1eb-46b7-8aa2-413961fce37d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:02.358724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736b365-e1eb-46b7-8aa2-413961fce37d admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:02.359455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736b365-e1eb-46b7-8aa2-413961fce37d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:02.363053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736b365-e1eb-46b7-8aa2-413961fce37d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:02.376980 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2332/4667] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:36:02.380788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736b365-e1eb-46b7-8aa2-413961fce37d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:02.386625 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2336/4668] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:02.393106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c9577-90ae-4553-9fb8-fba5610df03a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:02.396332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736b365-e1eb-46b7-8aa2-413961fce37d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:02.404549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f864a-3a16-4758-a9f9-d23e62a359a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:02.406233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f864a-3a16-4758-a9f9-d23e62a359a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:02.411443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f864a-3a16-4758-a9f9-d23e62a359a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:02.411443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f864a-3a16-4758-a9f9-d23e62a359a8 admin admin] PATH_INFO: `/v3/projects/e5cb9a319501442caf0ca5d095688bdb/users/1dd1170a5a804fdfab265f86213ff665/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:02.416881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c9577-90ae-4553-9fb8-fba5610df03a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:02.425438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f066e-addc-42c4-990c-f0bfaecd19e2 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:02.426214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f066e-addc-42c4-990c-f0bfaecd19e2 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:02.426817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f066e-addc-42c4-990c-f0bfaecd19e2 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:02.427184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f066e-addc-42c4-990c-f0bfaecd19e2 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:02.428168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f066e-addc-42c4-990c-f0bfaecd19e2 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:02.429109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f864a-3a16-4758-a9f9-d23e62a359a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5cb9a319501442caf0ca5d095688bdb, user_id=1dd1170a5a804fdfab265f86213ff665, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:02.429287 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-321f066e-addc-42c4-990c-f0bfaecd19e2 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:02.429287 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:02.429287 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:02.432800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f864a-3a16-4758-a9f9-d23e62a359a8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:02.433826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f066e-addc-42c4-990c-f0bfaecd19e2 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:02.554351 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2333/4669] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:02 2022] PUT /identity/v3/projects/e5cb9a319501442caf0ca5d095688bdb/users/1dd1170a5a804fdfab265f86213ff665/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:02.566702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf8581-6b58-476f-b7eb-208c168d5c3b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:02.566702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf8581-6b58-476f-b7eb-208c168d5c3b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:02.566702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf8581-6b58-476f-b7eb-208c168d5c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:02.570907 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2337/4670] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:36:02 2022] POST /identity/v3/domains => generated 276 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:02.575418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f066e-addc-42c4-990c-f0bfaecd19e2 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:02.620078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-cdbf8581-6b58-476f-b7eb-208c168d5c3b None None] MFA Rules not processed for user `1dd1170a5a804fdfab265f86213ff665`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:02.621555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cdbf8581-6b58-476f-b7eb-208c168d5c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:02.668039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f066e-addc-42c4-990c-f0bfaecd19e2 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:02.673577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37331a-be4e-4311-abaf-69372e3a1e78 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:02.674442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37331a-be4e-4311-abaf-69372e3a1e78 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:02.674755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37331a-be4e-4311-abaf-69372e3a1e78 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:02.675003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37331a-be4e-4311-abaf-69372e3a1e78 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/2e9a2e7320614584ad329da260900062/config` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:02.675961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37331a-be4e-4311-abaf-69372e3a1e78 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=2e9a2e7320614584ad329da260900062)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:02.677023 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-5d37331a-be4e-4311-abaf-69372e3a1e78 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:02.677023 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:02.677023 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:02.677928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37331a-be4e-4311-abaf-69372e3a1e78 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:02.717857 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2334/4671] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:02.723530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf8581-6b58-476f-b7eb-208c168d5c3b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:02.803911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf8581-6b58-476f-b7eb-208c168d5c3b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:02.810574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd806f-6fa4-4560-a99d-54569f087ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:02.811406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd806f-6fa4-4560-a99d-54569f087ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:02.811696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd806f-6fa4-4560-a99d-54569f087ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:02.812772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd806f-6fa4-4560-a99d-54569f087ee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:02.813557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd806f-6fa4-4560-a99d-54569f087ee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:02.815635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd806f-6fa4-4560-a99d-54569f087ee7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:02.820030 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2338/4672] 10.222.0.16 () {60 vars in 1268 bytes} [Mon May 2 10:36:02 2022] PUT /identity/v3/domains/2e9a2e7320614584ad329da260900062/config => generated 138 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:02.822000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37331a-be4e-4311-abaf-69372e3a1e78 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:02.835055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37331a-be4e-4311-abaf-69372e3a1e78 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:02.840108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f2c16-0748-430e-8b12-8faf76f7e6e6 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:02.841450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f2c16-0748-430e-8b12-8faf76f7e6e6 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:02.842550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f2c16-0748-430e-8b12-8faf76f7e6e6 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:02.843243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f2c16-0748-430e-8b12-8faf76f7e6e6 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/2e9a2e7320614584ad329da260900062/config/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:02.846809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f2c16-0748-430e-8b12-8faf76f7e6e6 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2e9a2e7320614584ad329da260900062, group=identity)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:02.847849 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-e02f2c16-0748-430e-8b12-8faf76f7e6e6 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:02.847849 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:02.847849 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:02.848869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f2c16-0748-430e-8b12-8faf76f7e6e6 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:02.855613 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2339/4673] 10.222.0.16 () {58 vars in 1274 bytes} [Mon May 2 10:36:02 2022] GET /identity/v3/domains/2e9a2e7320614584ad329da260900062/config/identity => generated 45 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:02.859942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f2c16-0748-430e-8b12-8faf76f7e6e6 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:02.872584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f2c16-0748-430e-8b12-8faf76f7e6e6 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:02.879435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58b8ae-6284-4f8d-9f31-129ce3d23587 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:02.879435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58b8ae-6284-4f8d-9f31-129ce3d23587 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:02.879435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58b8ae-6284-4f8d-9f31-129ce3d23587 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:02.879833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58b8ae-6284-4f8d-9f31-129ce3d23587 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/2e9a2e7320614584ad329da260900062/config/identity/driver` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:02.881010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58b8ae-6284-4f8d-9f31-129ce3d23587 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2e9a2e7320614584ad329da260900062, group=identity, option=driver)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:02.883115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58b8ae-6284-4f8d-9f31-129ce3d23587 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:02.890479 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2340/4674] 10.222.0.16 () {58 vars in 1295 bytes} [Mon May 2 10:36:02 2022] GET /identity/v3/domains/2e9a2e7320614584ad329da260900062/config/identity/driver => generated 31 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:02.894878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58b8ae-6284-4f8d-9f31-129ce3d23587 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:02.904816 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2335/4675] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:36:02 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:36:02.906178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd806f-6fa4-4560-a99d-54569f087ee7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:02.912567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58b8ae-6284-4f8d-9f31-129ce3d23587 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:03.005779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd806f-6fa4-4560-a99d-54569f087ee7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:03.008200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc75c1-014a-4cf8-9e07-b5badac6bce3 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:03.009180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc75c1-014a-4cf8-9e07-b5badac6bce3 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:03.009521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc75c1-014a-4cf8-9e07-b5badac6bce3 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:03.010095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc75c1-014a-4cf8-9e07-b5badac6bce3 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/2e9a2e7320614584ad329da260900062/config/ldap` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:03.011721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc75c1-014a-4cf8-9e07-b5badac6bce3 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2e9a2e7320614584ad329da260900062, group=ldap)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:03.012968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c84e68-324f-4653-b38c-8189dd85562c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:03.013825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c84e68-324f-4653-b38c-8189dd85562c admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:03.014306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c84e68-324f-4653-b38c-8189dd85562c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:03.014793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c84e68-324f-4653-b38c-8189dd85562c admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:03.014919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc75c1-014a-4cf8-9e07-b5badac6bce3 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:03.017211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c84e68-324f-4653-b38c-8189dd85562c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:03.020824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c84e68-324f-4653-b38c-8189dd85562c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:03.021956 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2341/4676] 10.222.0.16 () {58 vars in 1262 bytes} [Mon May 2 10:36:02 2022] GET /identity/v3/domains/2e9a2e7320614584ad329da260900062/config/ldap => generated 106 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:03.029124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc75c1-014a-4cf8-9e07-b5badac6bce3 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:03.039608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc75c1-014a-4cf8-9e07-b5badac6bce3 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:03.044478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e373b-b6dd-42f4-ba26-654a367271a5 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:03.045381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e373b-b6dd-42f4-ba26-654a367271a5 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:03.045670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e373b-b6dd-42f4-ba26-654a367271a5 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:03.045957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e373b-b6dd-42f4-ba26-654a367271a5 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/2e9a2e7320614584ad329da260900062/config/ldap/url` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:03.047208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e373b-b6dd-42f4-ba26-654a367271a5 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2e9a2e7320614584ad329da260900062, group=ldap, option=url)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:03.048951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e373b-b6dd-42f4-ba26-654a367271a5 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:03.057039 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2342/4677] 10.222.0.16 () {58 vars in 1274 bytes} [Mon May 2 10:36:03 2022] GET /identity/v3/domains/2e9a2e7320614584ad329da260900062/config/ldap/url => generated 46 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:03.058129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e373b-b6dd-42f4-ba26-654a367271a5 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:03.069479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e373b-b6dd-42f4-ba26-654a367271a5 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:03.075307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfac76-0132-42ad-9316-a7d58741a780 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:03.076312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfac76-0132-42ad-9316-a7d58741a780 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:03.076697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfac76-0132-42ad-9316-a7d58741a780 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:03.077130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfac76-0132-42ad-9316-a7d58741a780 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/2e9a2e7320614584ad329da260900062/config/ldap/user_tree_dn` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:03.078401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfac76-0132-42ad-9316-a7d58741a780 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=2e9a2e7320614584ad329da260900062, group=ldap, option=user_tree_dn)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:03.080681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfac76-0132-42ad-9316-a7d58741a780 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:03.086295 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2343/4678] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 2 10:36:03 2022] GET /identity/v3/domains/2e9a2e7320614584ad329da260900062/config/ldap/user_tree_dn => generated 63 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:03.107832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfac76-0132-42ad-9316-a7d58741a780 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:03.116623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfac76-0132-42ad-9316-a7d58741a780 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:03.122102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f5898-d3f9-4a43-9de1-c8990719c234 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:03.123039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f5898-d3f9-4a43-9de1-c8990719c234 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:03.123334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f5898-d3f9-4a43-9de1-c8990719c234 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:03.129204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f5898-d3f9-4a43-9de1-c8990719c234 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/2e9a2e7320614584ad329da260900062/config` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:03.129204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f5898-d3f9-4a43-9de1-c8990719c234 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=2e9a2e7320614584ad329da260900062)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:03.129204 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-3c8f5898-d3f9-4a43-9de1-c8990719c234 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:03.129204 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:03.129204 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:03.129204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f5898-d3f9-4a43-9de1-c8990719c234 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:03.294430 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2336/4679] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:36:02 2022] POST /identity/v3/users => generated 299 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:03.301657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c84e68-324f-4653-b38c-8189dd85562c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:03.316452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c84e68-324f-4653-b38c-8189dd85562c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:03.330378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d54e41-cf03-4207-bdc6-fcc49e90e3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:03.332225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d54e41-cf03-4207-bdc6-fcc49e90e3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:03.332826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d54e41-cf03-4207-bdc6-fcc49e90e3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:03.333336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d54e41-cf03-4207-bdc6-fcc49e90e3e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:03.334307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d54e41-cf03-4207-bdc6-fcc49e90e3e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:03.336868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d54e41-cf03-4207-bdc6-fcc49e90e3e1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:03.361449 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2337/4680] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:03.363818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d54e41-cf03-4207-bdc6-fcc49e90e3e1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:03.378041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d54e41-cf03-4207-bdc6-fcc49e90e3e1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:03.385788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f945292-3d1e-4b64-b3a2-36c6784013a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:03.386652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f945292-3d1e-4b64-b3a2-36c6784013a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:03.387093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f945292-3d1e-4b64-b3a2-36c6784013a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:03.387652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f945292-3d1e-4b64-b3a2-36c6784013a1 admin admin] PATH_INFO: `/v3/projects/a5189e16dd1c44e5875900f2e5110652/users/9651df8a727e4ab09b344717cd82cc92/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:03.407884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f945292-3d1e-4b64-b3a2-36c6784013a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5189e16dd1c44e5875900f2e5110652, user_id=9651df8a727e4ab09b344717cd82cc92, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:03.409935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f945292-3d1e-4b64-b3a2-36c6784013a1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:03.426563 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2344/4681] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 2 10:36:03 2022] DELETE /identity/v3/domains/2e9a2e7320614584ad329da260900062/config => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:03.430841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f5898-d3f9-4a43-9de1-c8990719c234 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:03.443002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f5898-d3f9-4a43-9de1-c8990719c234 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:03.448124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66550aaa-6b36-46bc-bda8-d88210ed5705 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:03.449000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66550aaa-6b36-46bc-bda8-d88210ed5705 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:03.449305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66550aaa-6b36-46bc-bda8-d88210ed5705 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:03.449643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66550aaa-6b36-46bc-bda8-d88210ed5705 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/2e9a2e7320614584ad329da260900062` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:03.451247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66550aaa-6b36-46bc-bda8-d88210ed5705 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2e9a2e7320614584ad329da260900062)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:03.452999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66550aaa-6b36-46bc-bda8-d88210ed5705 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:03.474061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-66550aaa-6b36-46bc-bda8-d88210ed5705 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2e9a2e7320614584ad329da260900062'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:03.474887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-66550aaa-6b36-46bc-bda8-d88210ed5705 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2e9a2e7320614584ad329da260900062'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:03.494244 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2338/4682] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:03 2022] PUT /identity/v3/projects/a5189e16dd1c44e5875900f2e5110652/users/9651df8a727e4ab09b344717cd82cc92/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:03.498211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f945292-3d1e-4b64-b3a2-36c6784013a1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:03.499866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2f945292-3d1e-4b64-b3a2-36c6784013a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:03.553783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-66550aaa-6b36-46bc-bda8-d88210ed5705 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2e9a2e7320614584ad329da260900062'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:03.558920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-66550aaa-6b36-46bc-bda8-d88210ed5705 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2e9a2e7320614584ad329da260900062'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:03.562474 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2345/4683] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:36:03 2022] PATCH /identity/v3/domains/2e9a2e7320614584ad329da260900062 => generated 277 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:36:03.573972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66550aaa-6b36-46bc-bda8-d88210ed5705 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:03.575462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-66550aaa-6b36-46bc-bda8-d88210ed5705 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:03.707116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66550aaa-6b36-46bc-bda8-d88210ed5705 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:03.709757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f945292-3d1e-4b64-b3a2-36c6784013a1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:03.720215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371af47-249f-4563-9798-6a19f8b8921e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:03.721331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371af47-249f-4563-9798-6a19f8b8921e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:03.726193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371af47-249f-4563-9798-6a19f8b8921e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:03.726193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371af47-249f-4563-9798-6a19f8b8921e admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:03.726193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371af47-249f-4563-9798-6a19f8b8921e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:03.740032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371af47-249f-4563-9798-6a19f8b8921e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:03.767603 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2339/4684] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:03.777938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371af47-249f-4563-9798-6a19f8b8921e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:03.788544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8371af47-249f-4563-9798-6a19f8b8921e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:03.845454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371af47-249f-4563-9798-6a19f8b8921e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:03.879271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f52ddf-0b16-437d-a9a3-0dd508378a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:03.881178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f52ddf-0b16-437d-a9a3-0dd508378a56 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:03.881178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f52ddf-0b16-437d-a9a3-0dd508378a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:03.882792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f52ddf-0b16-437d-a9a3-0dd508378a56 admin admin] PATH_INFO: `/v3/projects/a5189e16dd1c44e5875900f2e5110652/users/9651df8a727e4ab09b344717cd82cc92/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:03.889019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f52ddf-0b16-437d-a9a3-0dd508378a56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5189e16dd1c44e5875900f2e5110652, user_id=9651df8a727e4ab09b344717cd82cc92, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:03.899929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f52ddf-0b16-437d-a9a3-0dd508378a56 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:03.948895 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2340/4685] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:03 2022] PUT /identity/v3/projects/a5189e16dd1c44e5875900f2e5110652/users/9651df8a727e4ab09b344717cd82cc92/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:03.949275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7386588-b0ea-46d9-af93-d0450f6084bd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:03.949275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7386588-b0ea-46d9-af93-d0450f6084bd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:03.949275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7386588-b0ea-46d9-af93-d0450f6084bd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:03.949600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7386588-b0ea-46d9-af93-d0450f6084bd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/2e9a2e7320614584ad329da260900062` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:03.951597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181ef72-a529-4f72-a9a0-0459edf278f9 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:03.951886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181ef72-a529-4f72-a9a0-0459edf278f9 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:03.952163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181ef72-a529-4f72-a9a0-0459edf278f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:03.972957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7386588-b0ea-46d9-af93-d0450f6084bd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2e9a2e7320614584ad329da260900062)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:03.977224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7386588-b0ea-46d9-af93-d0450f6084bd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:04.006078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c7386588-b0ea-46d9-af93-d0450f6084bd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2e9a2e7320614584ad329da260900062'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:04.012560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0181ef72-a529-4f72-a9a0-0459edf278f9 None None] MFA Rules not processed for user `9651df8a727e4ab09b344717cd82cc92`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:04.014238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0181ef72-a529-4f72-a9a0-0459edf278f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:04.017346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c7386588-b0ea-46d9-af93-d0450f6084bd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2e9a2e7320614584ad329da260900062'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:04.122342 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2341/4686] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:36:04.132871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181ef72-a529-4f72-a9a0-0459edf278f9 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:04.132871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0181ef72-a529-4f72-a9a0-0459edf278f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:04.184332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c7386588-b0ea-46d9-af93-d0450f6084bd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e9a2e7320614584ad329da260900062', 'request_id': 'req-c7386588-b0ea-46d9-af93-d0450f6084bd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:04.211662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181ef72-a529-4f72-a9a0-0459edf278f9 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:04.244592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c7386588-b0ea-46d9-af93-d0450f6084bd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e9a2e7320614584ad329da260900062', 'request_id': 'req-c7386588-b0ea-46d9-af93-d0450f6084bd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:04.252716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c7386588-b0ea-46d9-af93-d0450f6084bd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e9a2e7320614584ad329da260900062', 'request_id': 'req-c7386588-b0ea-46d9-af93-d0450f6084bd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:04.286134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c7386588-b0ea-46d9-af93-d0450f6084bd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] The token cache is being invalidate because project 2e9a2e7320614584ad329da260900062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:04.286446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c7386588-b0ea-46d9-af93-d0450f6084bd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:04.290965 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c7386588-b0ea-46d9-af93-d0450f6084bd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:04.310720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c7386588-b0ea-46d9-af93-d0450f6084bd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2e9a2e7320614584ad329da260900062', 'request_id': 'req-c7386588-b0ea-46d9-af93-d0450f6084bd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:04.311611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c7386588-b0ea-46d9-af93-d0450f6084bd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2e9a2e7320614584ad329da260900062', 'request_id': 'req-c7386588-b0ea-46d9-af93-d0450f6084bd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:04.313757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74b824-9417-42af-937a-aa3788429585 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:04.314420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74b824-9417-42af-937a-aa3788429585 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:04.314702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74b824-9417-42af-937a-aa3788429585 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:04.314976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74b824-9417-42af-937a-aa3788429585 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:04.317799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c7386588-b0ea-46d9-af93-d0450f6084bd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2e9a2e7320614584ad329da260900062', 'request_id': 'req-c7386588-b0ea-46d9-af93-d0450f6084bd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:04.317948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5a74b824-9417-42af-937a-aa3788429585 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:04.342831 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2346/4687] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:36:03 2022] DELETE /identity/v3/domains/2e9a2e7320614584ad329da260900062 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:04.350149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7386588-b0ea-46d9-af93-d0450f6084bd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:04.351565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c7386588-b0ea-46d9-af93-d0450f6084bd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:04.409987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74b824-9417-42af-937a-aa3788429585 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:04.411609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74b824-9417-42af-937a-aa3788429585 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:04.431516 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2342/4688] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:36:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:36:04.483346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7386588-b0ea-46d9-af93-d0450f6084bd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:04.492173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a88c69-db01-4c26-98db-0f3933282aa0 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:04.496344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a88c69-db01-4c26-98db-0f3933282aa0 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:04.496875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a88c69-db01-4c26-98db-0f3933282aa0 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:04.506756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a88c69-db01-4c26-98db-0f3933282aa0 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:04.507646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a88c69-db01-4c26-98db-0f3933282aa0 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:04.510388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a88c69-db01-4c26-98db-0f3933282aa0 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:04.650627 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2347/4689] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:36:04 2022] POST /identity/v3/domains => generated 277 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:04.654689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74b824-9417-42af-937a-aa3788429585 service cinder] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:04.665453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74b824-9417-42af-937a-aa3788429585 service cinder] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:04.728782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1847ca-e52c-49f8-9d1f-eec2141bc6e4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:04.729626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1847ca-e52c-49f8-9d1f-eec2141bc6e4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:04.729921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1847ca-e52c-49f8-9d1f-eec2141bc6e4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:04.730265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1847ca-e52c-49f8-9d1f-eec2141bc6e4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/f09fcb0b96d54ac9ad773e78a6e478fd/config` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:04.731043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1847ca-e52c-49f8-9d1f-eec2141bc6e4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=f09fcb0b96d54ac9ad773e78a6e478fd)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:04.732122 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-af1847ca-e52c-49f8-9d1f-eec2141bc6e4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:04.732122 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:04.732122 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:04.733391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1847ca-e52c-49f8-9d1f-eec2141bc6e4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:04.788226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac68b67-c86a-4dee-91e8-cf69cc2ac828 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:04.788586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac68b67-c86a-4dee-91e8-cf69cc2ac828 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:04.788962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac68b67-c86a-4dee-91e8-cf69cc2ac828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:04.821807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2ac68b67-c86a-4dee-91e8-cf69cc2ac828 None None] MFA Rules not processed for user `2db7a6aedbab4785a793449ecf998dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:04.823246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2ac68b67-c86a-4dee-91e8-cf69cc2ac828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:04.887708 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2343/4690] 10.222.0.16 () {60 vars in 1268 bytes} [Mon May 2 10:36:04 2022] PUT /identity/v3/domains/f09fcb0b96d54ac9ad773e78a6e478fd/config => generated 138 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:04.889276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1847ca-e52c-49f8-9d1f-eec2141bc6e4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:04.898224 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2348/4691] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:36:04.913794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1847ca-e52c-49f8-9d1f-eec2141bc6e4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:04.930561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff726206-fc0b-4172-916c-9ba1bc942d6c tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:04.930561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff726206-fc0b-4172-916c-9ba1bc942d6c tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:04.930561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff726206-fc0b-4172-916c-9ba1bc942d6c tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:04.930884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff726206-fc0b-4172-916c-9ba1bc942d6c tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/f09fcb0b96d54ac9ad773e78a6e478fd/config` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:04.930884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff726206-fc0b-4172-916c-9ba1bc942d6c tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=f09fcb0b96d54ac9ad773e78a6e478fd)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:04.930884 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-ff726206-fc0b-4172-916c-9ba1bc942d6c tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:04.930884 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:04.930884 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:04.931329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff726206-fc0b-4172-916c-9ba1bc942d6c tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:05.047550 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2344/4692] 10.222.0.16 () {60 vars in 1270 bytes} [Mon May 2 10:36:04 2022] PATCH /identity/v3/domains/f09fcb0b96d54ac9ad773e78a6e478fd/config => generated 141 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:36:05.052254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac68b67-c86a-4dee-91e8-cf69cc2ac828 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:05.062917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac68b67-c86a-4dee-91e8-cf69cc2ac828 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:05.068135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e468a67-a3a8-47e1-ab77-9dd7676b7d41 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:05.069000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e468a67-a3a8-47e1-ab77-9dd7676b7d41 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:05.069286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e468a67-a3a8-47e1-ab77-9dd7676b7d41 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:05.069628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e468a67-a3a8-47e1-ab77-9dd7676b7d41 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/f09fcb0b96d54ac9ad773e78a6e478fd/config` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:05.070848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e468a67-a3a8-47e1-ab77-9dd7676b7d41 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f09fcb0b96d54ac9ad773e78a6e478fd)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:05.072445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e468a67-a3a8-47e1-ab77-9dd7676b7d41 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:05.077486 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2349/4693] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 2 10:36:05 2022] GET /identity/v3/domains/f09fcb0b96d54ac9ad773e78a6e478fd/config => generated 141 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:05.082203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff726206-fc0b-4172-916c-9ba1bc942d6c tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:05.093629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff726206-fc0b-4172-916c-9ba1bc942d6c tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:05.106620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1cd08-85fc-4a37-92b6-a282e6781a08 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:05.108394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1cd08-85fc-4a37-92b6-a282e6781a08 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:05.108394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1cd08-85fc-4a37-92b6-a282e6781a08 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:05.108394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1cd08-85fc-4a37-92b6-a282e6781a08 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/f09fcb0b96d54ac9ad773e78a6e478fd/config` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:05.109469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1cd08-85fc-4a37-92b6-a282e6781a08 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=f09fcb0b96d54ac9ad773e78a6e478fd)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:05.111749 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-19a1cd08-85fc-4a37-92b6-a282e6781a08 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:05.111749 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:05.111749 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:05.113064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1cd08-85fc-4a37-92b6-a282e6781a08 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:05.232679 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2345/4694] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 2 10:36:05 2022] DELETE /identity/v3/domains/f09fcb0b96d54ac9ad773e78a6e478fd/config => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:05.237171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e468a67-a3a8-47e1-ab77-9dd7676b7d41 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:05.248371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e468a67-a3a8-47e1-ab77-9dd7676b7d41 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:05.254876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7358d9-a3dd-442a-8430-dab1f74a6dc2 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:05.258916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7358d9-a3dd-442a-8430-dab1f74a6dc2 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:05.259466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7358d9-a3dd-442a-8430-dab1f74a6dc2 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:05.259780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7358d9-a3dd-442a-8430-dab1f74a6dc2 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/f09fcb0b96d54ac9ad773e78a6e478fd/config` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:05.263054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7358d9-a3dd-442a-8430-dab1f74a6dc2 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f09fcb0b96d54ac9ad773e78a6e478fd)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:05.270267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7358d9-a3dd-442a-8430-dab1f74a6dc2 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:05.294110 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-4d7358d9-a3dd-442a-8430-dab1f74a6dc2 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Could not find any options in domain configuration for domain f09fcb0b96d54ac9ad773e78a6e478fd.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain f09fcb0b96d54ac9ad773e78a6e478fd. May 02 10:36:05.294110 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:05.294110 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:36:05.294110 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:36:05.294110 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:36:05.294110 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:36:05.294110 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:36:05.294110 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:36:05.294110 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:36:05.294110 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:36:05.294110 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:36:05.294110 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:36:05.294110 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get May 02 10:36:05.295168 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) May 02 10:36:05.295168 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config May 02 10:36:05.295168 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( May 02 10:36:05.295168 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:36:05.295168 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:36:05.295168 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config May 02 10:36:05.295168 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( May 02 10:36:05.295168 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain f09fcb0b96d54ac9ad773e78a6e478fd. May 02 10:36:05.295168 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:05.295168 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2350/4695] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 2 10:36:05 2022] GET /identity/v3/domains/f09fcb0b96d54ac9ad773e78a6e478fd/config => generated 151 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:36:05.299781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1cd08-85fc-4a37-92b6-a282e6781a08 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:05.312013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1cd08-85fc-4a37-92b6-a282e6781a08 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:05.313500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7358d9-a3dd-442a-8430-dab1f74a6dc2 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:05.315852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4d7358d9-a3dd-442a-8430-dab1f74a6dc2 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:05.317522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0c299-8c4c-43ec-b879-262115dabb5d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:05.318473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0c299-8c4c-43ec-b879-262115dabb5d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:05.318819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0c299-8c4c-43ec-b879-262115dabb5d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:05.319235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0c299-8c4c-43ec-b879-262115dabb5d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/f09fcb0b96d54ac9ad773e78a6e478fd/config` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:05.319871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0c299-8c4c-43ec-b879-262115dabb5d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=f09fcb0b96d54ac9ad773e78a6e478fd)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:05.322656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0c299-8c4c-43ec-b879-262115dabb5d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:05.330409 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2346/4696] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 2 10:36:05 2022] DELETE /identity/v3/domains/f09fcb0b96d54ac9ad773e78a6e478fd/config => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:05.334687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0c299-8c4c-43ec-b879-262115dabb5d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:05.345244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0c299-8c4c-43ec-b879-262115dabb5d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:05.350480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67adbe3a-3f16-4159-b2af-a8675f3949e5 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:05.351892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adbe3a-3f16-4159-b2af-a8675f3949e5 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:05.352314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adbe3a-3f16-4159-b2af-a8675f3949e5 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:05.352647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adbe3a-3f16-4159-b2af-a8675f3949e5 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/f09fcb0b96d54ac9ad773e78a6e478fd` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:05.354690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67adbe3a-3f16-4159-b2af-a8675f3949e5 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f09fcb0b96d54ac9ad773e78a6e478fd)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:05.356408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67adbe3a-3f16-4159-b2af-a8675f3949e5 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:05.385955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-67adbe3a-3f16-4159-b2af-a8675f3949e5 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f09fcb0b96d54ac9ad773e78a6e478fd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:05.386486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7358d9-a3dd-442a-8430-dab1f74a6dc2 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:05.388131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-67adbe3a-3f16-4159-b2af-a8675f3949e5 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f09fcb0b96d54ac9ad773e78a6e478fd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:05.390347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce469d-17a4-4a35-81b3-a8e7e2ab5ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:05.395155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce469d-17a4-4a35-81b3-a8e7e2ab5ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:05.395155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce469d-17a4-4a35-81b3-a8e7e2ab5ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:05.395155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce469d-17a4-4a35-81b3-a8e7e2ab5ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:05.395155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-84ce469d-17a4-4a35-81b3-a8e7e2ab5ec0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:05.406409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce469d-17a4-4a35-81b3-a8e7e2ab5ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:05.408644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce469d-17a4-4a35-81b3-a8e7e2ab5ec0 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:05.423738 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2351/4697] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:36:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:36:05.491571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-67adbe3a-3f16-4159-b2af-a8675f3949e5 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f09fcb0b96d54ac9ad773e78a6e478fd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:05.492970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-67adbe3a-3f16-4159-b2af-a8675f3949e5 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f09fcb0b96d54ac9ad773e78a6e478fd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:05.501071 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2347/4698] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:36:05 2022] PATCH /identity/v3/domains/f09fcb0b96d54ac9ad773e78a6e478fd => generated 278 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:05.502300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce469d-17a4-4a35-81b3-a8e7e2ab5ec0 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:05.503754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-84ce469d-17a4-4a35-81b3-a8e7e2ab5ec0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:05.518695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce469d-17a4-4a35-81b3-a8e7e2ab5ec0 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:05.626562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8ca8e-02f5-4913-80b5-ccc28857d620 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:05.627647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8ca8e-02f5-4913-80b5-ccc28857d620 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:05.628066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8ca8e-02f5-4913-80b5-ccc28857d620 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:05.628449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8ca8e-02f5-4913-80b5-ccc28857d620 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/f09fcb0b96d54ac9ad773e78a6e478fd` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:05.666697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8ca8e-02f5-4913-80b5-ccc28857d620 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f09fcb0b96d54ac9ad773e78a6e478fd)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:05.668331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8ca8e-02f5-4913-80b5-ccc28857d620 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:05.698411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e0f8ca8e-02f5-4913-80b5-ccc28857d620 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f09fcb0b96d54ac9ad773e78a6e478fd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:05.702859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e0f8ca8e-02f5-4913-80b5-ccc28857d620 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f09fcb0b96d54ac9ad773e78a6e478fd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:05.790284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67adbe3a-3f16-4159-b2af-a8675f3949e5 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:05.792010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-67adbe3a-3f16-4159-b2af-a8675f3949e5 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:05.837787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e0f8ca8e-02f5-4913-80b5-ccc28857d620 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f09fcb0b96d54ac9ad773e78a6e478fd', 'request_id': 'req-e0f8ca8e-02f5-4913-80b5-ccc28857d620'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:05.884212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67adbe3a-3f16-4159-b2af-a8675f3949e5 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:05.943123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45d64c-8774-4cd3-9963-a199a117b8f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:05.943782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45d64c-8774-4cd3-9963-a199a117b8f0 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:05.944063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45d64c-8774-4cd3-9963-a199a117b8f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:05.944338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45d64c-8774-4cd3-9963-a199a117b8f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:05.946133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5b45d64c-8774-4cd3-9963-a199a117b8f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:05.957183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e0f8ca8e-02f5-4913-80b5-ccc28857d620 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f09fcb0b96d54ac9ad773e78a6e478fd', 'request_id': 'req-e0f8ca8e-02f5-4913-80b5-ccc28857d620'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:05.964227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e0f8ca8e-02f5-4913-80b5-ccc28857d620 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f09fcb0b96d54ac9ad773e78a6e478fd', 'request_id': 'req-e0f8ca8e-02f5-4913-80b5-ccc28857d620'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:05.978571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e0f8ca8e-02f5-4913-80b5-ccc28857d620 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] The token cache is being invalidate because project f09fcb0b96d54ac9ad773e78a6e478fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:05.978791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e0f8ca8e-02f5-4913-80b5-ccc28857d620 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:05.979504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e0f8ca8e-02f5-4913-80b5-ccc28857d620 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:05.990057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e0f8ca8e-02f5-4913-80b5-ccc28857d620 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f09fcb0b96d54ac9ad773e78a6e478fd', 'request_id': 'req-e0f8ca8e-02f5-4913-80b5-ccc28857d620'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:05.991755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e0f8ca8e-02f5-4913-80b5-ccc28857d620 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f09fcb0b96d54ac9ad773e78a6e478fd', 'request_id': 'req-e0f8ca8e-02f5-4913-80b5-ccc28857d620'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:05.995409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e0f8ca8e-02f5-4913-80b5-ccc28857d620 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f09fcb0b96d54ac9ad773e78a6e478fd', 'request_id': 'req-e0f8ca8e-02f5-4913-80b5-ccc28857d620'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:06.003762 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2352/4699] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:36:05 2022] DELETE /identity/v3/domains/f09fcb0b96d54ac9ad773e78a6e478fd => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:06.018140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8ca8e-02f5-4913-80b5-ccc28857d620 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:06.026487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45d64c-8774-4cd3-9963-a199a117b8f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:06.027965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45d64c-8774-4cd3-9963-a199a117b8f0 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:06.030980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e0f8ca8e-02f5-4913-80b5-ccc28857d620 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:06.038748 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2348/4700] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:36:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:36:06.221287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8ca8e-02f5-4913-80b5-ccc28857d620 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:06.236237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6c046-0ace-49e7-8015-1ea64f60d32a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:06.236237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6c046-0ace-49e7-8015-1ea64f60d32a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:06.236237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6c046-0ace-49e7-8015-1ea64f60d32a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:06.236808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6c046-0ace-49e7-8015-1ea64f60d32a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:06.236808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6c046-0ace-49e7-8015-1ea64f60d32a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:06.242068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6c046-0ace-49e7-8015-1ea64f60d32a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:06.314309 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2353/4701] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:36:06 2022] POST /identity/v3/domains => generated 274 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:06.318431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45d64c-8774-4cd3-9963-a199a117b8f0 service cinder] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:06.320186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5b45d64c-8774-4cd3-9963-a199a117b8f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:06.348369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45d64c-8774-4cd3-9963-a199a117b8f0 service cinder] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:06.484252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526c23c-0e7d-44a9-bc31-a6b501010816 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:06.486440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526c23c-0e7d-44a9-bc31-a6b501010816 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:06.487059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526c23c-0e7d-44a9-bc31-a6b501010816 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:06.487809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526c23c-0e7d-44a9-bc31-a6b501010816 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/c6454418125f45e9a9e5e5315e1cb9b2/config` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:06.488637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526c23c-0e7d-44a9-bc31-a6b501010816 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=c6454418125f45e9a9e5e5315e1cb9b2)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:06.492626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526c23c-0e7d-44a9-bc31-a6b501010816 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:06.611129 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2349/4702] 10.222.0.16 () {60 vars in 1268 bytes} [Mon May 2 10:36:06 2022] PUT /identity/v3/domains/c6454418125f45e9a9e5e5315e1cb9b2/config => generated 138 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:06.614105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6c046-0ace-49e7-8015-1ea64f60d32a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:06.660940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6c046-0ace-49e7-8015-1ea64f60d32a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:06.670855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d0a8e-2cbf-46b6-bc44-0336373a355b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:06.671864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d0a8e-2cbf-46b6-bc44-0336373a355b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:06.672156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d0a8e-2cbf-46b6-bc44-0336373a355b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:06.673107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d0a8e-2cbf-46b6-bc44-0336373a355b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/c6454418125f45e9a9e5e5315e1cb9b2/config/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:06.674222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d0a8e-2cbf-46b6-bc44-0336373a355b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=c6454418125f45e9a9e5e5315e1cb9b2, group=identity)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:06.675350 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-bc9d0a8e-2cbf-46b6-bc44-0336373a355b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:06.675350 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:06.675350 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:06.676441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d0a8e-2cbf-46b6-bc44-0336373a355b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:06.812043 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2354/4703] 10.222.0.16 () {60 vars in 1296 bytes} [Mon May 2 10:36:06 2022] PATCH /identity/v3/domains/c6454418125f45e9a9e5e5315e1cb9b2/config/identity => generated 176 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:36:06.813185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526c23c-0e7d-44a9-bc31-a6b501010816 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:06.828732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526c23c-0e7d-44a9-bc31-a6b501010816 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:06.836201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb9aba-af71-4dcc-befb-c6cfc0f14e76 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:06.845100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb9aba-af71-4dcc-befb-c6cfc0f14e76 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:06.848782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb9aba-af71-4dcc-befb-c6cfc0f14e76 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:06.859047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb9aba-af71-4dcc-befb-c6cfc0f14e76 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/c6454418125f45e9a9e5e5315e1cb9b2/config/identity/driver` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:06.859047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb9aba-af71-4dcc-befb-c6cfc0f14e76 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=c6454418125f45e9a9e5e5315e1cb9b2, group=identity, option=driver)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:06.859047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb9aba-af71-4dcc-befb-c6cfc0f14e76 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:07.087544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d0a8e-2cbf-46b6-bc44-0336373a355b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:07.093422 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2350/4704] 10.222.0.16 () {60 vars in 1317 bytes} [Mon May 2 10:36:06 2022] PATCH /identity/v3/domains/c6454418125f45e9a9e5e5315e1cb9b2/config/identity/driver => generated 176 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:36:07.101178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d0a8e-2cbf-46b6-bc44-0336373a355b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:07.111541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d1569-0f39-4609-b979-080cf7477a1f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:07.113032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d1569-0f39-4609-b979-080cf7477a1f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:07.113032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d1569-0f39-4609-b979-080cf7477a1f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:07.115301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d1569-0f39-4609-b979-080cf7477a1f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/c6454418125f45e9a9e5e5315e1cb9b2/config/identity/driver` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:07.116799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d1569-0f39-4609-b979-080cf7477a1f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=c6454418125f45e9a9e5e5315e1cb9b2, group=identity, option=driver)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:07.122232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d1569-0f39-4609-b979-080cf7477a1f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:07.209302 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2355/4705] 10.222.0.16 () {58 vars in 1298 bytes} [Mon May 2 10:36:07 2022] DELETE /identity/v3/domains/c6454418125f45e9a9e5e5315e1cb9b2/config/identity/driver => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:07.213895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb9aba-af71-4dcc-befb-c6cfc0f14e76 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:07.238024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb9aba-af71-4dcc-befb-c6cfc0f14e76 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:07.247895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab6136-f55a-4333-aaff-0e2ccdf17775 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:07.249615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab6136-f55a-4333-aaff-0e2ccdf17775 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:07.257741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab6136-f55a-4333-aaff-0e2ccdf17775 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:07.258182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab6136-f55a-4333-aaff-0e2ccdf17775 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/c6454418125f45e9a9e5e5315e1cb9b2/config/identity/driver` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:07.263448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab6136-f55a-4333-aaff-0e2ccdf17775 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=c6454418125f45e9a9e5e5315e1cb9b2, group=identity, option=driver)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:07.264589 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-deab6136-f55a-4333-aaff-0e2ccdf17775 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:07.264589 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:07.264589 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:07.265481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab6136-f55a-4333-aaff-0e2ccdf17775 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:07.300582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-deab6136-f55a-4333-aaff-0e2ccdf17775 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Could not find option driver in group identity in domain configuration for domain c6454418125f45e9a9e5e5315e1cb9b2.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain c6454418125f45e9a9e5e5315e1cb9b2. May 02 10:36:07.300582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:07.300582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:36:07.300582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:36:07.300582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:36:07.300582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:36:07.300582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:36:07.300582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:36:07.300582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:36:07.300582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:36:07.300582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:36:07.300582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:36:07.300582 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get May 02 10:36:07.301616 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) May 02 10:36:07.301616 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config May 02 10:36:07.301616 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( May 02 10:36:07.301616 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:36:07.301616 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:36:07.301616 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config May 02 10:36:07.301616 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( May 02 10:36:07.301616 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain c6454418125f45e9a9e5e5315e1cb9b2. May 02 10:36:07.301616 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:07.306575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d1569-0f39-4609-b979-080cf7477a1f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:07.309362 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2351/4706] 10.222.0.16 () {58 vars in 1295 bytes} [Mon May 2 10:36:07 2022] GET /identity/v3/domains/c6454418125f45e9a9e5e5315e1cb9b2/config/identity/driver => generated 171 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:36:07.319877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d1569-0f39-4609-b979-080cf7477a1f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:07.335784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f58354-f112-4d9d-a49a-73147ae4f195 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:07.340677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f58354-f112-4d9d-a49a-73147ae4f195 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:07.340677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f58354-f112-4d9d-a49a-73147ae4f195 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:07.340677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f58354-f112-4d9d-a49a-73147ae4f195 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/c6454418125f45e9a9e5e5315e1cb9b2/config/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:07.340677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f58354-f112-4d9d-a49a-73147ae4f195 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=c6454418125f45e9a9e5e5315e1cb9b2, group=identity)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:07.341291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f58354-f112-4d9d-a49a-73147ae4f195 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:07.417655 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2356/4707] 10.222.0.16 () {58 vars in 1277 bytes} [Mon May 2 10:36:07 2022] DELETE /identity/v3/domains/c6454418125f45e9a9e5e5315e1cb9b2/config/identity => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:07.423688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab6136-f55a-4333-aaff-0e2ccdf17775 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:07.439132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab6136-f55a-4333-aaff-0e2ccdf17775 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:07.445954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bd7cb-2a12-47d8-b5ba-42a60ca243a3 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:07.446933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bd7cb-2a12-47d8-b5ba-42a60ca243a3 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:07.447228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bd7cb-2a12-47d8-b5ba-42a60ca243a3 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:07.447516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bd7cb-2a12-47d8-b5ba-42a60ca243a3 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/c6454418125f45e9a9e5e5315e1cb9b2/config/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:07.449122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bd7cb-2a12-47d8-b5ba-42a60ca243a3 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=c6454418125f45e9a9e5e5315e1cb9b2, group=identity)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:07.450794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bd7cb-2a12-47d8-b5ba-42a60ca243a3 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:07.493808 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-7b3bd7cb-2a12-47d8-b5ba-42a60ca243a3 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Could not find group identity in domain configuration for domain c6454418125f45e9a9e5e5315e1cb9b2.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain c6454418125f45e9a9e5e5315e1cb9b2. May 02 10:36:07.493808 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:07.493808 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:36:07.493808 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:36:07.493808 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:36:07.493808 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:36:07.493808 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:36:07.493808 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:36:07.493808 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:36:07.493808 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:36:07.493808 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:36:07.493808 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:36:07.493808 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get May 02 10:36:07.494840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) May 02 10:36:07.494840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config May 02 10:36:07.494840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( May 02 10:36:07.494840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:36:07.494840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:36:07.494840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config May 02 10:36:07.494840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( May 02 10:36:07.494840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain c6454418125f45e9a9e5e5315e1cb9b2. May 02 10:36:07.494840 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:07.506466 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2352/4708] 10.222.0.16 () {58 vars in 1274 bytes} [Mon May 2 10:36:07 2022] GET /identity/v3/domains/c6454418125f45e9a9e5e5315e1cb9b2/config/identity => generated 154 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:36:07.507417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f58354-f112-4d9d-a49a-73147ae4f195 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:07.526139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f58354-f112-4d9d-a49a-73147ae4f195 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:07.550629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c93dec-62d5-43d6-b266-1bd475418a80 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:07.550629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c93dec-62d5-43d6-b266-1bd475418a80 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:07.550629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c93dec-62d5-43d6-b266-1bd475418a80 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:07.550893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c93dec-62d5-43d6-b266-1bd475418a80 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/c6454418125f45e9a9e5e5315e1cb9b2/config` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:07.550893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c93dec-62d5-43d6-b266-1bd475418a80 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=c6454418125f45e9a9e5e5315e1cb9b2)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:07.550893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c93dec-62d5-43d6-b266-1bd475418a80 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:07.665855 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2357/4709] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 2 10:36:07 2022] DELETE /identity/v3/domains/c6454418125f45e9a9e5e5315e1cb9b2/config => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:07.679223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bd7cb-2a12-47d8-b5ba-42a60ca243a3 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:07.700161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bd7cb-2a12-47d8-b5ba-42a60ca243a3 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:07.711819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf382a7-6ecf-42bb-ad0b-b6f547875616 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:07.712864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf382a7-6ecf-42bb-ad0b-b6f547875616 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:07.713153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf382a7-6ecf-42bb-ad0b-b6f547875616 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:07.713435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf382a7-6ecf-42bb-ad0b-b6f547875616 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/c6454418125f45e9a9e5e5315e1cb9b2` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:07.716081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf382a7-6ecf-42bb-ad0b-b6f547875616 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c6454418125f45e9a9e5e5315e1cb9b2)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:07.720085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf382a7-6ecf-42bb-ad0b-b6f547875616 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:07.814881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-acf382a7-6ecf-42bb-ad0b-b6f547875616 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c6454418125f45e9a9e5e5315e1cb9b2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:07.817028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-acf382a7-6ecf-42bb-ad0b-b6f547875616 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c6454418125f45e9a9e5e5315e1cb9b2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:08.017072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-acf382a7-6ecf-42bb-ad0b-b6f547875616 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c6454418125f45e9a9e5e5315e1cb9b2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:08.017722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-acf382a7-6ecf-42bb-ad0b-b6f547875616 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c6454418125f45e9a9e5e5315e1cb9b2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:08.021687 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2353/4710] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:36:07 2022] PATCH /identity/v3/domains/c6454418125f45e9a9e5e5315e1cb9b2 => generated 275 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:08.025577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c93dec-62d5-43d6-b266-1bd475418a80 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:08.029436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-88c93dec-62d5-43d6-b266-1bd475418a80 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:08.046174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c93dec-62d5-43d6-b266-1bd475418a80 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:08.134100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a7559-4abc-4114-b80e-c4f2e4bc6491 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:08.134984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a7559-4abc-4114-b80e-c4f2e4bc6491 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:08.135278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a7559-4abc-4114-b80e-c4f2e4bc6491 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:08.135557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a7559-4abc-4114-b80e-c4f2e4bc6491 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/c6454418125f45e9a9e5e5315e1cb9b2` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:08.160901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a7559-4abc-4114-b80e-c4f2e4bc6491 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c6454418125f45e9a9e5e5315e1cb9b2)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:08.163002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a7559-4abc-4114-b80e-c4f2e4bc6491 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:08.194729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-301a7559-4abc-4114-b80e-c4f2e4bc6491 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c6454418125f45e9a9e5e5315e1cb9b2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:08.198346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-301a7559-4abc-4114-b80e-c4f2e4bc6491 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c6454418125f45e9a9e5e5315e1cb9b2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:08.262278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf382a7-6ecf-42bb-ad0b-b6f547875616 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:08.264393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-acf382a7-6ecf-42bb-ad0b-b6f547875616 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:08.329847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-301a7559-4abc-4114-b80e-c4f2e4bc6491 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6454418125f45e9a9e5e5315e1cb9b2', 'request_id': 'req-301a7559-4abc-4114-b80e-c4f2e4bc6491'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:08.346697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf382a7-6ecf-42bb-ad0b-b6f547875616 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:08.414209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-301a7559-4abc-4114-b80e-c4f2e4bc6491 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6454418125f45e9a9e5e5315e1cb9b2', 'request_id': 'req-301a7559-4abc-4114-b80e-c4f2e4bc6491'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:08.417788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67cc5d9-5ff0-4961-94a7-e0935e3d83e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:08.418804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67cc5d9-5ff0-4961-94a7-e0935e3d83e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:08.419186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67cc5d9-5ff0-4961-94a7-e0935e3d83e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:08.419826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67cc5d9-5ff0-4961-94a7-e0935e3d83e2 admin admin] PATH_INFO: `/v3/users/bdc1def7eba349a783953bcbde5214f4` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:08.420858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67cc5d9-5ff0-4961-94a7-e0935e3d83e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdc1def7eba349a783953bcbde5214f4)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:08.422840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67cc5d9-5ff0-4961-94a7-e0935e3d83e2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:08.429319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-301a7559-4abc-4114-b80e-c4f2e4bc6491 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6454418125f45e9a9e5e5315e1cb9b2', 'request_id': 'req-301a7559-4abc-4114-b80e-c4f2e4bc6491'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:08.442832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-301a7559-4abc-4114-b80e-c4f2e4bc6491 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] The token cache is being invalidate because project c6454418125f45e9a9e5e5315e1cb9b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:08.443225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-301a7559-4abc-4114-b80e-c4f2e4bc6491 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:08.444350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-301a7559-4abc-4114-b80e-c4f2e4bc6491 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:08.451912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-301a7559-4abc-4114-b80e-c4f2e4bc6491 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c6454418125f45e9a9e5e5315e1cb9b2', 'request_id': 'req-301a7559-4abc-4114-b80e-c4f2e4bc6491'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:08.456289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-301a7559-4abc-4114-b80e-c4f2e4bc6491 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c6454418125f45e9a9e5e5315e1cb9b2', 'request_id': 'req-301a7559-4abc-4114-b80e-c4f2e4bc6491'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:08.456671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-301a7559-4abc-4114-b80e-c4f2e4bc6491 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c6454418125f45e9a9e5e5315e1cb9b2', 'request_id': 'req-301a7559-4abc-4114-b80e-c4f2e4bc6491'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:08.462960 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2358/4711] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:36:08 2022] DELETE /identity/v3/domains/c6454418125f45e9a9e5e5315e1cb9b2 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:08.468290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a7559-4abc-4114-b80e-c4f2e4bc6491 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:08.469858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-301a7559-4abc-4114-b80e-c4f2e4bc6491 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:08.537463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a7559-4abc-4114-b80e-c4f2e4bc6491 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:08.542595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc71cc2-286d-4d50-99f9-7c586eb21127 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:08.543236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc71cc2-286d-4d50-99f9-7c586eb21127 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:08.543527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc71cc2-286d-4d50-99f9-7c586eb21127 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:08.543827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc71cc2-286d-4d50-99f9-7c586eb21127 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:08.544477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc71cc2-286d-4d50-99f9-7c586eb21127 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:08.545528 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-1dc71cc2-286d-4d50-99f9-7c586eb21127 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:08.545528 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:08.545528 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:08.546457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc71cc2-286d-4d50-99f9-7c586eb21127 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:08.550937 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2359/4712] 10.222.0.16 () {58 vars in 1172 bytes} [Mon May 2 10:36:08 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:36:08.554965 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc71cc2-286d-4d50-99f9-7c586eb21127 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:08.565931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc71cc2-286d-4d50-99f9-7c586eb21127 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:08.570715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5f871-5372-4672-971f-31711c1404a8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:08.571582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5f871-5372-4672-971f-31711c1404a8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:08.571863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5f871-5372-4672-971f-31711c1404a8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:08.572173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5f871-5372-4672-971f-31711c1404a8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:08.572829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5f871-5372-4672-971f-31711c1404a8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:08.574443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5f871-5372-4672-971f-31711c1404a8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:08.575687 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2360/4713] 10.222.0.16 () {58 vars in 1199 bytes} [Mon May 2 10:36:08 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:08.580430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5f871-5372-4672-971f-31711c1404a8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:08.592487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5f871-5372-4672-971f-31711c1404a8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:08.598120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd54fd-0859-492f-8c63-234291e85376 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:08.598893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd54fd-0859-492f-8c63-234291e85376 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:08.599206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd54fd-0859-492f-8c63-234291e85376 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:08.599492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd54fd-0859-492f-8c63-234291e85376 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:08.600172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd54fd-0859-492f-8c63-234291e85376 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:08.601918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd54fd-0859-492f-8c63-234291e85376 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:08.603307 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2361/4714] 10.222.0.16 () {58 vars in 1220 bytes} [Mon May 2 10:36:08 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:08.607297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd54fd-0859-492f-8c63-234291e85376 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:08.617262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd54fd-0859-492f-8c63-234291e85376 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:08.622080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839a11b-2eae-4667-982f-ddc0415ac21e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:08.622840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839a11b-2eae-4667-982f-ddc0415ac21e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:08.623126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839a11b-2eae-4667-982f-ddc0415ac21e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:08.623406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839a11b-2eae-4667-982f-ddc0415ac21e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:08.624092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839a11b-2eae-4667-982f-ddc0415ac21e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:08.626465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839a11b-2eae-4667-982f-ddc0415ac21e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:08.627628 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2362/4715] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:36:08 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:08.631345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839a11b-2eae-4667-982f-ddc0415ac21e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:08.641231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839a11b-2eae-4667-982f-ddc0415ac21e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:08.646768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccff389-1aa6-46ed-b586-e1f6ccb62ff9 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:08.647539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccff389-1aa6-46ed-b586-e1f6ccb62ff9 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:08.647835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccff389-1aa6-46ed-b586-e1f6ccb62ff9 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:08.648121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccff389-1aa6-46ed-b586-e1f6ccb62ff9 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:08.648876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccff389-1aa6-46ed-b586-e1f6ccb62ff9 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:08.650593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccff389-1aa6-46ed-b586-e1f6ccb62ff9 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:08.653368 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2363/4716] 10.222.0.16 () {58 vars in 1187 bytes} [Mon May 2 10:36:08 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:08.656359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccff389-1aa6-46ed-b586-e1f6ccb62ff9 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:08.667353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccff389-1aa6-46ed-b586-e1f6ccb62ff9 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:08.672944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e67cc5d9-5ff0-4961-94a7-e0935e3d83e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdc1def7eba349a783953bcbde5214f4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:08.673488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e2275-0c58-4582-b469-89eb236618d4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:08.673886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e2275-0c58-4582-b469-89eb236618d4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:08.674215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e2275-0c58-4582-b469-89eb236618d4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:08.674454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e2275-0c58-4582-b469-89eb236618d4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:08.675098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e2275-0c58-4582-b469-89eb236618d4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:08.676902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e2275-0c58-4582-b469-89eb236618d4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:08.679328 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2364/4717] 10.222.0.16 () {58 vars in 1199 bytes} [Mon May 2 10:36:08 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:08.683409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e2275-0c58-4582-b469-89eb236618d4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:08.694607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e67cc5d9-5ff0-4961-94a7-e0935e3d83e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdc1def7eba349a783953bcbde5214f4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:08.695358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e67cc5d9-5ff0-4961-94a7-e0935e3d83e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdc1def7eba349a783953bcbde5214f4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:08.699200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e2275-0c58-4582-b469-89eb236618d4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:08.701643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fd5d0-897d-44b0-a3b1-ea7ad7e0c478 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:08.702567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fd5d0-897d-44b0-a3b1-ea7ad7e0c478 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:08.702973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fd5d0-897d-44b0-a3b1-ea7ad7e0c478 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:08.703261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fd5d0-897d-44b0-a3b1-ea7ad7e0c478 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:08.704117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fd5d0-897d-44b0-a3b1-ea7ad7e0c478 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:08.704854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e67cc5d9-5ff0-4961-94a7-e0935e3d83e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdc1def7eba349a783953bcbde5214f4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:08.706247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fd5d0-897d-44b0-a3b1-ea7ad7e0c478 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:08.710862 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2365/4718] 10.222.0.16 () {58 vars in 1202 bytes} [Mon May 2 10:36:08 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:08.711634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fd5d0-897d-44b0-a3b1-ea7ad7e0c478 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:08.722160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fd5d0-897d-44b0-a3b1-ea7ad7e0c478 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:08.733144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c3325-2b8d-4f40-8683-73b6151bd1aa tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:08.734533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c3325-2b8d-4f40-8683-73b6151bd1aa tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:08.735528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c3325-2b8d-4f40-8683-73b6151bd1aa tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:08.736841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c3325-2b8d-4f40-8683-73b6151bd1aa tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:08.737805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c3325-2b8d-4f40-8683-73b6151bd1aa tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:08.740143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c3325-2b8d-4f40-8683-73b6151bd1aa tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:08.742689 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2366/4719] 10.222.0.16 () {58 vars in 1208 bytes} [Mon May 2 10:36:08 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:08.746113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c3325-2b8d-4f40-8683-73b6151bd1aa tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:08.761014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c3325-2b8d-4f40-8683-73b6151bd1aa tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:08.770155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b552c16-0e3b-462f-9d93-46ee18487383 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:08.772557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b552c16-0e3b-462f-9d93-46ee18487383 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:08.772557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b552c16-0e3b-462f-9d93-46ee18487383 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:08.772557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b552c16-0e3b-462f-9d93-46ee18487383 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:08.772557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b552c16-0e3b-462f-9d93-46ee18487383 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:08.774553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b552c16-0e3b-462f-9d93-46ee18487383 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:08.775883 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2367/4720] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:08 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:08.780097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b552c16-0e3b-462f-9d93-46ee18487383 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:08.792320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e67cc5d9-5ff0-4961-94a7-e0935e3d83e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdc1def7eba349a783953bcbde5214f4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:08.796043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b552c16-0e3b-462f-9d93-46ee18487383 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:08.802602 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2354/4721] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:08 2022] DELETE /identity/v3/users/bdc1def7eba349a783953bcbde5214f4 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:08.806850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f98a61-5802-427f-9cdc-08229ba3c965 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:08.807653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f98a61-5802-427f-9cdc-08229ba3c965 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:08.807944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f98a61-5802-427f-9cdc-08229ba3c965 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:08.808228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f98a61-5802-427f-9cdc-08229ba3c965 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:08.808942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f98a61-5802-427f-9cdc-08229ba3c965 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:08.810557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f98a61-5802-427f-9cdc-08229ba3c965 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:08.812099 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2368/4722] 10.222.0.16 () {58 vars in 1217 bytes} [Mon May 2 10:36:08 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:08.831229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67cc5d9-5ff0-4961-94a7-e0935e3d83e2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:08.831229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e67cc5d9-5ff0-4961-94a7-e0935e3d83e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:08.909785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67cc5d9-5ff0-4961-94a7-e0935e3d83e2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:08.916802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c029bb8-350f-4104-a71d-69fd1e08e4fe tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:08.917790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c029bb8-350f-4104-a71d-69fd1e08e4fe tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:08.918104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c029bb8-350f-4104-a71d-69fd1e08e4fe tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:08.918508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c029bb8-350f-4104-a71d-69fd1e08e4fe tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:08.919256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c029bb8-350f-4104-a71d-69fd1e08e4fe tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:08.921240 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-5c029bb8-350f-4104-a71d-69fd1e08e4fe tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:08.921240 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:08.921240 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:08.922403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c029bb8-350f-4104-a71d-69fd1e08e4fe tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:08.925137 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2355/4723] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 2 10:36:08 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:08.929928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f98a61-5802-427f-9cdc-08229ba3c965 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:08.945117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f98a61-5802-427f-9cdc-08229ba3c965 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:08.956722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948e346-e879-4483-88ec-aac4f2059a5e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:08.962069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948e346-e879-4483-88ec-aac4f2059a5e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:08.962451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948e346-e879-4483-88ec-aac4f2059a5e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:08.962811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948e346-e879-4483-88ec-aac4f2059a5e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:08.963742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948e346-e879-4483-88ec-aac4f2059a5e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:08.965633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948e346-e879-4483-88ec-aac4f2059a5e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:08.974022 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2369/4724] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:08 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:08.976725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c029bb8-350f-4104-a71d-69fd1e08e4fe tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:08.992308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c029bb8-350f-4104-a71d-69fd1e08e4fe tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.002225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25451ccb-d755-41c0-8be2-4fd1ac8f705d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.003085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25451ccb-d755-41c0-8be2-4fd1ac8f705d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.003371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25451ccb-d755-41c0-8be2-4fd1ac8f705d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.003655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25451ccb-d755-41c0-8be2-4fd1ac8f705d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.005805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25451ccb-d755-41c0-8be2-4fd1ac8f705d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.008472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25451ccb-d755-41c0-8be2-4fd1ac8f705d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.015066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948e346-e879-4483-88ec-aac4f2059a5e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.024388 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2356/4725] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 2 10:36:08 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:09.030108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948e346-e879-4483-88ec-aac4f2059a5e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.035844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a2983-79a8-47dd-b4ff-d180bf422cc4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.036725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a2983-79a8-47dd-b4ff-d180bf422cc4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.037004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a2983-79a8-47dd-b4ff-d180bf422cc4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.037321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a2983-79a8-47dd-b4ff-d180bf422cc4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.040363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a2983-79a8-47dd-b4ff-d180bf422cc4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.040363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a2983-79a8-47dd-b4ff-d180bf422cc4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.043589 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2370/4726] 10.222.0.16 () {58 vars in 1226 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:09.045445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25451ccb-d755-41c0-8be2-4fd1ac8f705d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.070399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25451ccb-d755-41c0-8be2-4fd1ac8f705d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.077004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca93dc-4dd0-418d-bef6-e21eb89d360f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.081728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca93dc-4dd0-418d-bef6-e21eb89d360f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.082086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca93dc-4dd0-418d-bef6-e21eb89d360f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.082565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca93dc-4dd0-418d-bef6-e21eb89d360f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.083361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca93dc-4dd0-418d-bef6-e21eb89d360f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.085352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca93dc-4dd0-418d-bef6-e21eb89d360f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.088038 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2357/4727] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:09.093697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a2983-79a8-47dd-b4ff-d180bf422cc4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.105602 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a2983-79a8-47dd-b4ff-d180bf422cc4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.118893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68052d4f-fda7-4a7e-bd30-89a21a4f4302 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.119825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68052d4f-fda7-4a7e-bd30-89a21a4f4302 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.120181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68052d4f-fda7-4a7e-bd30-89a21a4f4302 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.120535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68052d4f-fda7-4a7e-bd30-89a21a4f4302 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.121514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68052d4f-fda7-4a7e-bd30-89a21a4f4302 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.124103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68052d4f-fda7-4a7e-bd30-89a21a4f4302 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.129453 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2371/4728] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:09.129924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca93dc-4dd0-418d-bef6-e21eb89d360f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.141069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca93dc-4dd0-418d-bef6-e21eb89d360f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.145902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f488ac1-68ae-4f6f-8243-9e836546f183 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.146705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f488ac1-68ae-4f6f-8243-9e836546f183 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.146991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f488ac1-68ae-4f6f-8243-9e836546f183 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.147455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f488ac1-68ae-4f6f-8243-9e836546f183 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.148159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f488ac1-68ae-4f6f-8243-9e836546f183 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.149948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f488ac1-68ae-4f6f-8243-9e836546f183 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.160922 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2358/4729] 10.222.0.16 () {58 vars in 1241 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:09.164105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68052d4f-fda7-4a7e-bd30-89a21a4f4302 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.165963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f488ac1-68ae-4f6f-8243-9e836546f183 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.168194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-68052d4f-fda7-4a7e-bd30-89a21a4f4302 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:09.180349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f488ac1-68ae-4f6f-8243-9e836546f183 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.185207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7457c-3f1e-4429-bc9b-eeacc803ec25 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.186013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7457c-3f1e-4429-bc9b-eeacc803ec25 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.186303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7457c-3f1e-4429-bc9b-eeacc803ec25 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.187199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7457c-3f1e-4429-bc9b-eeacc803ec25 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.191175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7457c-3f1e-4429-bc9b-eeacc803ec25 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.191175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7457c-3f1e-4429-bc9b-eeacc803ec25 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.191175 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2359/4730] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:09.200657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7457c-3f1e-4429-bc9b-eeacc803ec25 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.216420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7457c-3f1e-4429-bc9b-eeacc803ec25 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.223116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc69e1-0e05-41c2-9a16-2c22e5102e8b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.224036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc69e1-0e05-41c2-9a16-2c22e5102e8b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.224513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc69e1-0e05-41c2-9a16-2c22e5102e8b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.224997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc69e1-0e05-41c2-9a16-2c22e5102e8b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.225737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc69e1-0e05-41c2-9a16-2c22e5102e8b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.228631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc69e1-0e05-41c2-9a16-2c22e5102e8b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.232216 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2360/4731] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:09.243187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc69e1-0e05-41c2-9a16-2c22e5102e8b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.255307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc69e1-0e05-41c2-9a16-2c22e5102e8b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.267215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2f138-a63a-43ad-be18-75b4314fc6ca tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.268044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2f138-a63a-43ad-be18-75b4314fc6ca tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.268330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2f138-a63a-43ad-be18-75b4314fc6ca tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.268632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2f138-a63a-43ad-be18-75b4314fc6ca tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.269311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2f138-a63a-43ad-be18-75b4314fc6ca tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.272919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2f138-a63a-43ad-be18-75b4314fc6ca tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.279023 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2361/4732] 10.222.0.16 () {58 vars in 1268 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:09.283020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2f138-a63a-43ad-be18-75b4314fc6ca tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.303164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2f138-a63a-43ad-be18-75b4314fc6ca tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.324858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff706b57-34a0-41b7-a930-2625b86336cf tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.324858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff706b57-34a0-41b7-a930-2625b86336cf tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.324858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff706b57-34a0-41b7-a930-2625b86336cf tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.325190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff706b57-34a0-41b7-a930-2625b86336cf tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.325190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff706b57-34a0-41b7-a930-2625b86336cf tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.325190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff706b57-34a0-41b7-a930-2625b86336cf tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.325190 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2362/4733] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:09.327762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff706b57-34a0-41b7-a930-2625b86336cf tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.349496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68052d4f-fda7-4a7e-bd30-89a21a4f4302 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.350526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff706b57-34a0-41b7-a930-2625b86336cf tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.358351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a1ee7-c29a-4d97-9707-6be58ed68597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.359835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a29569-ea21-49ae-9afd-a0c45e757ccd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.361278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a29569-ea21-49ae-9afd-a0c45e757ccd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.361621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a29569-ea21-49ae-9afd-a0c45e757ccd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.361840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a29569-ea21-49ae-9afd-a0c45e757ccd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.362501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a29569-ea21-49ae-9afd-a0c45e757ccd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.364114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a29569-ea21-49ae-9afd-a0c45e757ccd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.364820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a1ee7-c29a-4d97-9707-6be58ed68597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.366508 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2363/4734] 10.222.0.16 () {58 vars in 1256 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:09.366777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a1ee7-c29a-4d97-9707-6be58ed68597 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.366777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a1ee7-c29a-4d97-9707-6be58ed68597 admin admin] PATH_INFO: `/v3/projects/bdf9033cbc6148288d1ec5f86ff7a5a2` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.369683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a1ee7-c29a-4d97-9707-6be58ed68597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf9033cbc6148288d1ec5f86ff7a5a2)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.370666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a29569-ea21-49ae-9afd-a0c45e757ccd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.372125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a1ee7-c29a-4d97-9707-6be58ed68597 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.387582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a29569-ea21-49ae-9afd-a0c45e757ccd tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.393769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42aacda-48d3-4479-8ae7-0f510522bb09 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.394577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42aacda-48d3-4479-8ae7-0f510522bb09 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.394868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42aacda-48d3-4479-8ae7-0f510522bb09 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.395157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42aacda-48d3-4479-8ae7-0f510522bb09 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.396639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42aacda-48d3-4479-8ae7-0f510522bb09 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.398343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42aacda-48d3-4479-8ae7-0f510522bb09 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.400809 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2364/4735] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:09.407520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42aacda-48d3-4479-8ae7-0f510522bb09 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.417083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42aacda-48d3-4479-8ae7-0f510522bb09 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.421689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e5675-3b76-4db2-9292-b7b264d1439e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.423096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e5675-3b76-4db2-9292-b7b264d1439e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.423425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e5675-3b76-4db2-9292-b7b264d1439e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.423775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e5675-3b76-4db2-9292-b7b264d1439e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.424430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e5675-3b76-4db2-9292-b7b264d1439e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.426055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e5675-3b76-4db2-9292-b7b264d1439e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.427273 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2365/4736] 10.222.0.16 () {58 vars in 1241 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:09.431168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e5675-3b76-4db2-9292-b7b264d1439e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.441270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e5675-3b76-4db2-9292-b7b264d1439e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.445890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad9299-bf7f-49c6-8889-0b0ce0565f7f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.447269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad9299-bf7f-49c6-8889-0b0ce0565f7f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.447427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad9299-bf7f-49c6-8889-0b0ce0565f7f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.447656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad9299-bf7f-49c6-8889-0b0ce0565f7f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.448363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad9299-bf7f-49c6-8889-0b0ce0565f7f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.450046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad9299-bf7f-49c6-8889-0b0ce0565f7f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.451324 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2366/4737] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:09.460113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad9299-bf7f-49c6-8889-0b0ce0565f7f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.471412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad9299-bf7f-49c6-8889-0b0ce0565f7f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.481520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674c810-0d3d-4d56-a39e-8f4ceeb8b266 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.485822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674c810-0d3d-4d56-a39e-8f4ceeb8b266 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.485822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674c810-0d3d-4d56-a39e-8f4ceeb8b266 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.485822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674c810-0d3d-4d56-a39e-8f4ceeb8b266 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.485822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674c810-0d3d-4d56-a39e-8f4ceeb8b266 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.486226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674c810-0d3d-4d56-a39e-8f4ceeb8b266 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.487452 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2367/4738] 10.222.0.16 () {58 vars in 1253 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:09.491354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674c810-0d3d-4d56-a39e-8f4ceeb8b266 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.503080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674c810-0d3d-4d56-a39e-8f4ceeb8b266 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.508722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e86de-3eec-4790-9290-26518234df5d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.509703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e86de-3eec-4790-9290-26518234df5d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.509996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e86de-3eec-4790-9290-26518234df5d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.510444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e86de-3eec-4790-9290-26518234df5d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.511137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e86de-3eec-4790-9290-26518234df5d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.513171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e86de-3eec-4790-9290-26518234df5d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.517227 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2368/4739] 10.222.0.16 () {58 vars in 1289 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:09.521157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e86de-3eec-4790-9290-26518234df5d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.533525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e86de-3eec-4790-9290-26518234df5d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.543438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5b7a1ee7-c29a-4d97-9707-6be58ed68597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf9033cbc6148288d1ec5f86ff7a5a2', 'request_id': 'req-5b7a1ee7-c29a-4d97-9707-6be58ed68597'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:09.600541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f5c2d-6669-49fe-be11-a50c99e1c2c8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.601441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f5c2d-6669-49fe-be11-a50c99e1c2c8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.602238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f5c2d-6669-49fe-be11-a50c99e1c2c8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.602696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f5c2d-6669-49fe-be11-a50c99e1c2c8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.603857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f5c2d-6669-49fe-be11-a50c99e1c2c8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.611072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f5c2d-6669-49fe-be11-a50c99e1c2c8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.621566 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2369/4740] 10.222.0.16 () {58 vars in 1256 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:09.626563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f5c2d-6669-49fe-be11-a50c99e1c2c8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.642600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f5c2d-6669-49fe-be11-a50c99e1c2c8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.652267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85635ad7-26f6-474e-b1ed-0371a52b86e1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.654177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85635ad7-26f6-474e-b1ed-0371a52b86e1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.654573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85635ad7-26f6-474e-b1ed-0371a52b86e1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.654963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85635ad7-26f6-474e-b1ed-0371a52b86e1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.655795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85635ad7-26f6-474e-b1ed-0371a52b86e1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.658439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85635ad7-26f6-474e-b1ed-0371a52b86e1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.659918 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2370/4741] 10.222.0.16 () {58 vars in 1265 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:09.663963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85635ad7-26f6-474e-b1ed-0371a52b86e1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.671188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5b7a1ee7-c29a-4d97-9707-6be58ed68597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf9033cbc6148288d1ec5f86ff7a5a2', 'request_id': 'req-5b7a1ee7-c29a-4d97-9707-6be58ed68597'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:09.678748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5b7a1ee7-c29a-4d97-9707-6be58ed68597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf9033cbc6148288d1ec5f86ff7a5a2', 'request_id': 'req-5b7a1ee7-c29a-4d97-9707-6be58ed68597'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:09.679390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85635ad7-26f6-474e-b1ed-0371a52b86e1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.685969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd12d8b-27b6-4217-833b-bc18fabb27db tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.687514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd12d8b-27b6-4217-833b-bc18fabb27db tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.688002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd12d8b-27b6-4217-833b-bc18fabb27db tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.688363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd12d8b-27b6-4217-833b-bc18fabb27db tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.690049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd12d8b-27b6-4217-833b-bc18fabb27db tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.692376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd12d8b-27b6-4217-833b-bc18fabb27db tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.696747 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2371/4742] 10.222.0.16 () {58 vars in 1307 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:09.698916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd12d8b-27b6-4217-833b-bc18fabb27db tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.700523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5b7a1ee7-c29a-4d97-9707-6be58ed68597 admin admin] The token cache is being invalidate because project bdf9033cbc6148288d1ec5f86ff7a5a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:09.701042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5b7a1ee7-c29a-4d97-9707-6be58ed68597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:09.701882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5b7a1ee7-c29a-4d97-9707-6be58ed68597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:09.715787 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2372/4743] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:36:09 2022] DELETE /identity/v3/projects/bdf9033cbc6148288d1ec5f86ff7a5a2 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:09.722041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9cd12d8b-27b6-4217-833b-bc18fabb27db tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:09.722361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306e8f4-4af7-4202-9b89-5aa45b872d39 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.722807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306e8f4-4af7-4202-9b89-5aa45b872d39 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.723293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306e8f4-4af7-4202-9b89-5aa45b872d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.751434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8306e8f4-4af7-4202-9b89-5aa45b872d39 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:09.753910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8306e8f4-4af7-4202-9b89-5aa45b872d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:09.761993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd12d8b-27b6-4217-833b-bc18fabb27db tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.771423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0ff52-bd91-4348-8c64-1b4642d4e8d4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.772262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0ff52-bd91-4348-8c64-1b4642d4e8d4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.772750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0ff52-bd91-4348-8c64-1b4642d4e8d4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.773047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0ff52-bd91-4348-8c64-1b4642d4e8d4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.773723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0ff52-bd91-4348-8c64-1b4642d4e8d4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.776440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0ff52-bd91-4348-8c64-1b4642d4e8d4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.779453 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2372/4744] 10.222.0.16 () {58 vars in 1289 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:09.785467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0ff52-bd91-4348-8c64-1b4642d4e8d4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.820704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0ff52-bd91-4348-8c64-1b4642d4e8d4 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.851719 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22074a-b5ae-4c74-8cb2-802256f98d3a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.851719 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22074a-b5ae-4c74-8cb2-802256f98d3a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.851719 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22074a-b5ae-4c74-8cb2-802256f98d3a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.852027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22074a-b5ae-4c74-8cb2-802256f98d3a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.852027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22074a-b5ae-4c74-8cb2-802256f98d3a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.853621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22074a-b5ae-4c74-8cb2-802256f98d3a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.855000 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2373/4745] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:09.858774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22074a-b5ae-4c74-8cb2-802256f98d3a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.870405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22074a-b5ae-4c74-8cb2-802256f98d3a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.876773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787f7f6-8dc0-40d2-a228-aa19587c845c tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.878122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787f7f6-8dc0-40d2-a228-aa19587c845c tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.878415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787f7f6-8dc0-40d2-a228-aa19587c845c tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.878699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787f7f6-8dc0-40d2-a228-aa19587c845c tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.879361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787f7f6-8dc0-40d2-a228-aa19587c845c tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.881268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787f7f6-8dc0-40d2-a228-aa19587c845c tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.886385 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2374/4746] 10.222.0.16 () {58 vars in 1226 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:09.892008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787f7f6-8dc0-40d2-a228-aa19587c845c tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.905771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787f7f6-8dc0-40d2-a228-aa19587c845c tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.908409 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2373/4747] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:09.915483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa96bca-7436-44df-a9d9-d2849ce3d327 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.916940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa96bca-7436-44df-a9d9-d2849ce3d327 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.917050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407b4fe-5a1d-44f6-b211-ffb68bcd2f25 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.917165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa96bca-7436-44df-a9d9-d2849ce3d327 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.917274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407b4fe-5a1d-44f6-b211-ffb68bcd2f25 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.917274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407b4fe-5a1d-44f6-b211-ffb68bcd2f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.917454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa96bca-7436-44df-a9d9-d2849ce3d327 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.918253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa96bca-7436-44df-a9d9-d2849ce3d327 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.920331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa96bca-7436-44df-a9d9-d2849ce3d327 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.924660 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2375/4748] 10.222.0.16 () {58 vars in 1241 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:09.926671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa96bca-7436-44df-a9d9-d2849ce3d327 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.938669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa96bca-7436-44df-a9d9-d2849ce3d327 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.942318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3407b4fe-5a1d-44f6-b211-ffb68bcd2f25 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:09.943583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3407b4fe-5a1d-44f6-b211-ffb68bcd2f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:09.944119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a7d08-d715-403d-87dc-5f71fd26fbf9 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.945193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a7d08-d715-403d-87dc-5f71fd26fbf9 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.945598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a7d08-d715-403d-87dc-5f71fd26fbf9 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.945979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a7d08-d715-403d-87dc-5f71fd26fbf9 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.946751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a7d08-d715-403d-87dc-5f71fd26fbf9 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.948480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a7d08-d715-403d-87dc-5f71fd26fbf9 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.953006 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2374/4749] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:09.954352 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2376/4750] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:09.954998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407b4fe-5a1d-44f6-b211-ffb68bcd2f25 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.957837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a7d08-d715-403d-87dc-5f71fd26fbf9 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.968459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407b4fe-5a1d-44f6-b211-ffb68bcd2f25 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.968988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a7d08-d715-403d-87dc-5f71fd26fbf9 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.975103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0672103-5497-4848-ad84-04e119ef54a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.975422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3c547-d8d3-4fd8-aaea-a48f498420df tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:09.976086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0672103-5497-4848-ad84-04e119ef54a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.976217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3c547-d8d3-4fd8-aaea-a48f498420df tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:09.976487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0672103-5497-4848-ad84-04e119ef54a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.976647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3c547-d8d3-4fd8-aaea-a48f498420df tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:09.976841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3c547-d8d3-4fd8-aaea-a48f498420df tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.976954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0672103-5497-4848-ad84-04e119ef54a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:09.977683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead3c547-d8d3-4fd8-aaea-a48f498420df tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.977851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0672103-5497-4848-ad84-04e119ef54a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:36:09.978214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0672103-5497-4848-ad84-04e119ef54a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:09.979683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead3c547-d8d3-4fd8-aaea-a48f498420df tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.980061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0672103-5497-4848-ad84-04e119ef54a6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:09.980913 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2375/4751] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:09.985147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3c547-d8d3-4fd8-aaea-a48f498420df tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:09.997616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3c547-d8d3-4fd8-aaea-a48f498420df tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:09.998397 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2377/4752] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:10.003556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0672103-5497-4848-ad84-04e119ef54a6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.018990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960408c0-d1e3-4b66-9b4c-82a05c5f5cd8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.019823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960408c0-d1e3-4b66-9b4c-82a05c5f5cd8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.020120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960408c0-d1e3-4b66-9b4c-82a05c5f5cd8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.020415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960408c0-d1e3-4b66-9b4c-82a05c5f5cd8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.021148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960408c0-d1e3-4b66-9b4c-82a05c5f5cd8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.022820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960408c0-d1e3-4b66-9b4c-82a05c5f5cd8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:10.027785 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2376/4753] 10.222.0.16 () {58 vars in 1253 bytes} [Mon May 2 10:36:09 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:10.028668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0672103-5497-4848-ad84-04e119ef54a6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.029175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960408c0-d1e3-4b66-9b4c-82a05c5f5cd8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.034481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1f2bb-ec57-4e55-95e7-6aa21e1e567c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.035184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1f2bb-ec57-4e55-95e7-6aa21e1e567c admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.035531 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1f2bb-ec57-4e55-95e7-6aa21e1e567c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.035732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1f2bb-ec57-4e55-95e7-6aa21e1e567c admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.037112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1f2bb-ec57-4e55-95e7-6aa21e1e567c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.040098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1f2bb-ec57-4e55-95e7-6aa21e1e567c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:10.040748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960408c0-d1e3-4b66-9b4c-82a05c5f5cd8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.045809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c6b22-d2f1-451d-b5fd-787e9224617a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.046643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c6b22-d2f1-451d-b5fd-787e9224617a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.046956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c6b22-d2f1-451d-b5fd-787e9224617a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.047208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c6b22-d2f1-451d-b5fd-787e9224617a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.047920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c6b22-d2f1-451d-b5fd-787e9224617a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.049694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c6b22-d2f1-451d-b5fd-787e9224617a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:10.051052 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2377/4754] 10.222.0.16 () {58 vars in 1256 bytes} [Mon May 2 10:36:10 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:10.055338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c6b22-d2f1-451d-b5fd-787e9224617a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.065719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c6b22-d2f1-451d-b5fd-787e9224617a tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.070677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197adbd-8d3b-4c0e-8307-b739c5280b56 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.071498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197adbd-8d3b-4c0e-8307-b739c5280b56 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.071794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197adbd-8d3b-4c0e-8307-b739c5280b56 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.072080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197adbd-8d3b-4c0e-8307-b739c5280b56 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.072849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197adbd-8d3b-4c0e-8307-b739c5280b56 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.074539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197adbd-8d3b-4c0e-8307-b739c5280b56 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:10.075770 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2378/4755] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 2 10:36:10 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:10.080308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197adbd-8d3b-4c0e-8307-b739c5280b56 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.090860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197adbd-8d3b-4c0e-8307-b739c5280b56 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.096667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db289f5-69c2-414e-a1ce-b3b61e0ec71e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.097469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db289f5-69c2-414e-a1ce-b3b61e0ec71e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.097759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db289f5-69c2-414e-a1ce-b3b61e0ec71e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.098040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db289f5-69c2-414e-a1ce-b3b61e0ec71e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.098714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db289f5-69c2-414e-a1ce-b3b61e0ec71e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.100319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db289f5-69c2-414e-a1ce-b3b61e0ec71e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:10.104967 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2379/4756] 10.222.0.16 () {58 vars in 1256 bytes} [Mon May 2 10:36:10 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:10.106088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db289f5-69c2-414e-a1ce-b3b61e0ec71e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.117381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db289f5-69c2-414e-a1ce-b3b61e0ec71e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.119353 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2378/4757] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:36:10 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:36:10.123566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1f2bb-ec57-4e55-95e7-6aa21e1e567c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.180896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e32b5-cafb-467e-be0f-2b0feb4e0c67 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.182084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e32b5-cafb-467e-be0f-2b0feb4e0c67 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.182338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e32b5-cafb-467e-be0f-2b0feb4e0c67 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.182937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e32b5-cafb-467e-be0f-2b0feb4e0c67 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.183666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e32b5-cafb-467e-be0f-2b0feb4e0c67 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.185338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e32b5-cafb-467e-be0f-2b0feb4e0c67 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:10.186534 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2380/4758] 10.222.0.16 () {58 vars in 1292 bytes} [Mon May 2 10:36:10 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:10.191222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e32b5-cafb-467e-be0f-2b0feb4e0c67 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.194771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1f2bb-ec57-4e55-95e7-6aa21e1e567c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.199638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d526d-bd8c-4709-bc09-9e4cd98c1a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.200318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d526d-bd8c-4709-bc09-9e4cd98c1a21 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.200709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d526d-bd8c-4709-bc09-9e4cd98c1a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.204475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d526d-bd8c-4709-bc09-9e4cd98c1a21 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.204622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e32b5-cafb-467e-be0f-2b0feb4e0c67 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.204723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d526d-bd8c-4709-bc09-9e4cd98c1a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.204723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d526d-bd8c-4709-bc09-9e4cd98c1a21 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:10.208757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acd635-fb1d-4cfd-bf54-28b2376cae32 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.209634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acd635-fb1d-4cfd-bf54-28b2376cae32 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.209993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acd635-fb1d-4cfd-bf54-28b2376cae32 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.210349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acd635-fb1d-4cfd-bf54-28b2376cae32 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.211102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63acd635-fb1d-4cfd-bf54-28b2376cae32 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.212873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63acd635-fb1d-4cfd-bf54-28b2376cae32 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:10.214585 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2381/4759] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:36:10 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:10.218518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acd635-fb1d-4cfd-bf54-28b2376cae32 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.230222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acd635-fb1d-4cfd-bf54-28b2376cae32 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.235979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cff6ae-d7a1-49bd-bc92-b0a118584528 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.236846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cff6ae-d7a1-49bd-bc92-b0a118584528 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.237141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cff6ae-d7a1-49bd-bc92-b0a118584528 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.237426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cff6ae-d7a1-49bd-bc92-b0a118584528 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.238226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cff6ae-d7a1-49bd-bc92-b0a118584528 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.239865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cff6ae-d7a1-49bd-bc92-b0a118584528 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:10.241105 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2382/4760] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:36:10 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:10.245134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cff6ae-d7a1-49bd-bc92-b0a118584528 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.256318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cff6ae-d7a1-49bd-bc92-b0a118584528 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.261251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eaac5f-6845-4386-897e-a4f65c0bfb0e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.262041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaac5f-6845-4386-897e-a4f65c0bfb0e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.262330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaac5f-6845-4386-897e-a4f65c0bfb0e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.262640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaac5f-6845-4386-897e-a4f65c0bfb0e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.263313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eaac5f-6845-4386-897e-a4f65c0bfb0e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.265163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eaac5f-6845-4386-897e-a4f65c0bfb0e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:10.266901 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2383/4761] 10.222.0.16 () {58 vars in 1211 bytes} [Mon May 2 10:36:10 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:10.271451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eaac5f-6845-4386-897e-a4f65c0bfb0e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.281613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eaac5f-6845-4386-897e-a4f65c0bfb0e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.286321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50233d5d-7403-4c07-8d96-5bfe79df836f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.287099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50233d5d-7403-4c07-8d96-5bfe79df836f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.287387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50233d5d-7403-4c07-8d96-5bfe79df836f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.287665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50233d5d-7403-4c07-8d96-5bfe79df836f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.288364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50233d5d-7403-4c07-8d96-5bfe79df836f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.290002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50233d5d-7403-4c07-8d96-5bfe79df836f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:10.291169 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2384/4762] 10.222.0.16 () {58 vars in 1226 bytes} [Mon May 2 10:36:10 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:10.295005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50233d5d-7403-4c07-8d96-5bfe79df836f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.306983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50233d5d-7403-4c07-8d96-5bfe79df836f tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.315574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c31e0-9b8a-4ace-b75f-4efdc4edf721 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.316134 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2379/4763] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:36:10 2022] POST /identity/v3/users => generated 291 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:36:10.316429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c31e0-9b8a-4ace-b75f-4efdc4edf721 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.316761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c31e0-9b8a-4ace-b75f-4efdc4edf721 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.317050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c31e0-9b8a-4ace-b75f-4efdc4edf721 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.317516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d526d-bd8c-4709-bc09-9e4cd98c1a21 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.317713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c31e0-9b8a-4ace-b75f-4efdc4edf721 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.319315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c31e0-9b8a-4ace-b75f-4efdc4edf721 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:10.320667 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2385/4764] 10.222.0.16 () {58 vars in 1214 bytes} [Mon May 2 10:36:10 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:10.331528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c31e0-9b8a-4ace-b75f-4efdc4edf721 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.334942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d526d-bd8c-4709-bc09-9e4cd98c1a21 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.340965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15c645-8afd-494f-8f27-8eecda543f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.342088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15c645-8afd-494f-8f27-8eecda543f77 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.342088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15c645-8afd-494f-8f27-8eecda543f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.342386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15c645-8afd-494f-8f27-8eecda543f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.343079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15c645-8afd-494f-8f27-8eecda543f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.345961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15c645-8afd-494f-8f27-8eecda543f77 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:10.368222 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2380/4765] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:10.368222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15c645-8afd-494f-8f27-8eecda543f77 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.368424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c31e0-9b8a-4ace-b75f-4efdc4edf721 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.373839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4e355-a209-49e8-9cfc-0c320af65584 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.374827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4e355-a209-49e8-9cfc-0c320af65584 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.375113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4e355-a209-49e8-9cfc-0c320af65584 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.375397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4e355-a209-49e8-9cfc-0c320af65584 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.376787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4e355-a209-49e8-9cfc-0c320af65584 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.378334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15c645-8afd-494f-8f27-8eecda543f77 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.378565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4e355-a209-49e8-9cfc-0c320af65584 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:10.380112 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2386/4766] 10.222.0.16 () {58 vars in 1217 bytes} [Mon May 2 10:36:10 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:10.383273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606c618-ea3f-4157-8a51-449229f57c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.383727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4e355-a209-49e8-9cfc-0c320af65584 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.383945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606c618-ea3f-4157-8a51-449229f57c1f admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.384237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606c618-ea3f-4157-8a51-449229f57c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.388763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606c618-ea3f-4157-8a51-449229f57c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.388763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606c618-ea3f-4157-8a51-449229f57c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.388763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606c618-ea3f-4157-8a51-449229f57c1f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:10.396744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4e355-a209-49e8-9cfc-0c320af65584 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.400370 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2381/4767] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:36:10.402242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e99d81-93a2-4e90-95d5-545ad3b0d67b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.403220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e99d81-93a2-4e90-95d5-545ad3b0d67b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.403514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e99d81-93a2-4e90-95d5-545ad3b0d67b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.403796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e99d81-93a2-4e90-95d5-545ad3b0d67b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.404459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e99d81-93a2-4e90-95d5-545ad3b0d67b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.404997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606c618-ea3f-4157-8a51-449229f57c1f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.407869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e99d81-93a2-4e90-95d5-545ad3b0d67b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:10.409197 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2387/4768] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:36:10 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:10.414037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e99d81-93a2-4e90-95d5-545ad3b0d67b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.419773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606c618-ea3f-4157-8a51-449229f57c1f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.424863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e99d81-93a2-4e90-95d5-545ad3b0d67b tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.425874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca9642-35b5-4174-93d7-2d364ea0bb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.427175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca9642-35b5-4174-93d7-2d364ea0bb12 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.427764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca9642-35b5-4174-93d7-2d364ea0bb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.428218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca9642-35b5-4174-93d7-2d364ea0bb12 admin admin] PATH_INFO: `/v3/projects/f5afcabc10d742cd84c60d17f855e5e8/users/f2140817178b44e99d837e98eff69629/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.430210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ce68b-26ba-4d9f-ba28-98b7eff8a3d1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.431204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ce68b-26ba-4d9f-ba28-98b7eff8a3d1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.431577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ce68b-26ba-4d9f-ba28-98b7eff8a3d1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.431957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ce68b-26ba-4d9f-ba28-98b7eff8a3d1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.432772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ce68b-26ba-4d9f-ba28-98b7eff8a3d1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.434461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ce68b-26ba-4d9f-ba28-98b7eff8a3d1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:10.439232 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2388/4769] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 2 10:36:10 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:10.440762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ce68b-26ba-4d9f-ba28-98b7eff8a3d1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.454819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ce68b-26ba-4d9f-ba28-98b7eff8a3d1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.460900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3894f28-282d-4e42-a12b-7cb0db5baa16 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.462060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3894f28-282d-4e42-a12b-7cb0db5baa16 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.462427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3894f28-282d-4e42-a12b-7cb0db5baa16 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.462810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3894f28-282d-4e42-a12b-7cb0db5baa16 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.463610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3894f28-282d-4e42-a12b-7cb0db5baa16 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.465529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3894f28-282d-4e42-a12b-7cb0db5baa16 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:10.483795 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2389/4770] 10.222.0.16 () {58 vars in 1259 bytes} [Mon May 2 10:36:10 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:10.490397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca9642-35b5-4174-93d7-2d364ea0bb12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5afcabc10d742cd84c60d17f855e5e8, user_id=f2140817178b44e99d837e98eff69629, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.493112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca9642-35b5-4174-93d7-2d364ea0bb12 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:10.493263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3894f28-282d-4e42-a12b-7cb0db5baa16 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.527075 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3894f28-282d-4e42-a12b-7cb0db5baa16 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.540065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7675149-fb45-4897-b6ad-286ae2b36177 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.541096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7675149-fb45-4897-b6ad-286ae2b36177 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.541469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7675149-fb45-4897-b6ad-286ae2b36177 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.541832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7675149-fb45-4897-b6ad-286ae2b36177 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.542981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7675149-fb45-4897-b6ad-286ae2b36177 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.544258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7675149-fb45-4897-b6ad-286ae2b36177 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:10.549859 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2390/4771] 10.222.0.16 () {58 vars in 1262 bytes} [Mon May 2 10:36:10 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:10.551038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7675149-fb45-4897-b6ad-286ae2b36177 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.574253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7675149-fb45-4897-b6ad-286ae2b36177 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.597393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f25bb-4433-4726-bb46-b58383d54db8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.597799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f25bb-4433-4726-bb46-b58383d54db8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.599030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f25bb-4433-4726-bb46-b58383d54db8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.599245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f25bb-4433-4726-bb46-b58383d54db8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.601915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f25bb-4433-4726-bb46-b58383d54db8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.603555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f25bb-4433-4726-bb46-b58383d54db8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:10.607683 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2391/4772] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:36:10 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:10.608849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f25bb-4433-4726-bb46-b58383d54db8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.614795 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2382/4773] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:10 2022] PUT /identity/v3/projects/f5afcabc10d742cd84c60d17f855e5e8/users/f2140817178b44e99d837e98eff69629/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:10.627555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f25bb-4433-4726-bb46-b58383d54db8 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.627765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f7e20-2296-4c97-b007-e19c4dc0f3e0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.628690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f7e20-2296-4c97-b007-e19c4dc0f3e0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.629314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f7e20-2296-4c97-b007-e19c4dc0f3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.657206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d17f7e20-2296-4c97-b007-e19c4dc0f3e0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:10.658718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d17f7e20-2296-4c97-b007-e19c4dc0f3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:10.729604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56271679-ccb2-46b9-ac7c-f271a7aa503e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.730420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56271679-ccb2-46b9-ac7c-f271a7aa503e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.730714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56271679-ccb2-46b9-ac7c-f271a7aa503e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.731002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56271679-ccb2-46b9-ac7c-f271a7aa503e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.731859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56271679-ccb2-46b9-ac7c-f271a7aa503e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.745183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56271679-ccb2-46b9-ac7c-f271a7aa503e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:10.746999 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2392/4774] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:36:10 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 02 10:36:10.751679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56271679-ccb2-46b9-ac7c-f271a7aa503e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.779806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56271679-ccb2-46b9-ac7c-f271a7aa503e tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.786514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94b0c9-135c-4dc8-af89-e1ac8138c22d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.787780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94b0c9-135c-4dc8-af89-e1ac8138c22d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.788265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94b0c9-135c-4dc8-af89-e1ac8138c22d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.788490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94b0c9-135c-4dc8-af89-e1ac8138c22d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.789258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94b0c9-135c-4dc8-af89-e1ac8138c22d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.791341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94b0c9-135c-4dc8-af89-e1ac8138c22d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:10.792809 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2393/4775] 10.222.0.16 () {58 vars in 1277 bytes} [Mon May 2 10:36:10 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:36:10.800270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94b0c9-135c-4dc8-af89-e1ac8138c22d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.812634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94b0c9-135c-4dc8-af89-e1ac8138c22d tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.820290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098fb74-70a3-4687-902d-ba672e7d0bc1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.821881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098fb74-70a3-4687-902d-ba672e7d0bc1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.822491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098fb74-70a3-4687-902d-ba672e7d0bc1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.822844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098fb74-70a3-4687-902d-ba672e7d0bc1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/c6454418125f45e9a9e5e5315e1cb9b2` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.832083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098fb74-70a3-4687-902d-ba672e7d0bc1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:36:10.833637 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2383/4776] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:10.843283 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-0098fb74-70a3-4687-902d-ba672e7d0bc1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Could not find domain: c6454418125f45e9a9e5e5315e1cb9b2.: keystone.exception.DomainNotFound: Could not find domain: c6454418125f45e9a9e5e5315e1cb9b2. May 02 10:36:10.843283 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:10.843283 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 02 10:36:10.843283 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 02 10:36:10.843283 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:36:10.843283 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:36:10.843283 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:36:10.843283 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:36:10.843283 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c6454418125f45e9a9e5e5315e1cb9b2. May 02 10:36:10.843283 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:10.843283 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:36:10.843283 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:10.843283 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:10.843283 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:36:10.843283 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:36:10.844582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:36:10.844582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:36:10.844582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:36:10.844582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:36:10.844582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:36:10.844582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:36:10.844582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:36:10.844582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:36:10.844582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 02 10:36:10.844582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 02 10:36:10.844582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:36:10.844582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:36:10.844582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:36:10.844582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:36:10.844582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:36:10.844582 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:36:10.845811 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:36:10.845811 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:36:10.845811 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:36:10.845811 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:36:10.845811 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:36:10.845811 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:36:10.845811 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:36:10.845811 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:36:10.845811 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:36:10.845811 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:36:10.845811 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:36:10.845811 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:36:10.845811 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:36:10.845811 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:36:10.845811 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 02 10:36:10.845811 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:36:10.845811 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c6454418125f45e9a9e5e5315e1cb9b2. May 02 10:36:10.847105 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:10.847624 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2394/4777] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:36:10 2022] PATCH /identity/v3/domains/c6454418125f45e9a9e5e5315e1cb9b2 => generated 112 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:36:10.848219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f7e20-2296-4c97-b007-e19c4dc0f3e0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.848463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098fb74-70a3-4687-902d-ba672e7d0bc1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.853933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d17f7e20-2296-4c97-b007-e19c4dc0f3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:10.863372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098fb74-70a3-4687-902d-ba672e7d0bc1 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.879798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a42cd-a337-499c-9b17-7fab723fc561 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.879798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a42cd-a337-499c-9b17-7fab723fc561 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.879798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a42cd-a337-499c-9b17-7fab723fc561 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.880111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a42cd-a337-499c-9b17-7fab723fc561 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/f09fcb0b96d54ac9ad773e78a6e478fd` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.903242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a42cd-a337-499c-9b17-7fab723fc561 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:36:10.917213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-6b3a42cd-a337-499c-9b17-7fab723fc561 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Could not find domain: f09fcb0b96d54ac9ad773e78a6e478fd.: keystone.exception.DomainNotFound: Could not find domain: f09fcb0b96d54ac9ad773e78a6e478fd. May 02 10:36:10.917213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:10.917213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 02 10:36:10.917213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 02 10:36:10.917213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:36:10.917213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:36:10.917213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:36:10.917213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:36:10.917213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f09fcb0b96d54ac9ad773e78a6e478fd. May 02 10:36:10.917213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:10.917213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:36:10.917213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:10.917213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:10.917213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:36:10.917213 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:36:10.918494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:36:10.918494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:36:10.918494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:36:10.918494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:36:10.918494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:36:10.918494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:36:10.918494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:36:10.918494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:36:10.918494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 02 10:36:10.918494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 02 10:36:10.918494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:36:10.918494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:36:10.918494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:36:10.918494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:36:10.918494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:36:10.918494 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:36:10.919701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:36:10.919701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:36:10.919701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:36:10.919701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:36:10.919701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:36:10.919701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:36:10.919701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:36:10.919701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:36:10.919701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:36:10.919701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:36:10.919701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:36:10.919701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:36:10.919701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:36:10.919701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:36:10.919701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 02 10:36:10.919701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:36:10.919701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f09fcb0b96d54ac9ad773e78a6e478fd. May 02 10:36:10.921103 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:10.921103 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2395/4778] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:36:10 2022] PATCH /identity/v3/domains/f09fcb0b96d54ac9ad773e78a6e478fd => generated 112 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:36:10.923662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a42cd-a337-499c-9b17-7fab723fc561 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.935218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a42cd-a337-499c-9b17-7fab723fc561 tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.941289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc906ff0-0ef8-45df-b218-29222e7711ae tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cadde14f4d34220a25d2c351845a09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd93bb6e9ee764c54b113d5e04cf5163c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.942441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc906ff0-0ef8-45df-b218-29222e7711ae tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.942843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc906ff0-0ef8-45df-b218-29222e7711ae tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.943247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc906ff0-0ef8-45df-b218-29222e7711ae tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] PATH_INFO: `/v3/domains/2e9a2e7320614584ad329da260900062` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.956848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc906ff0-0ef8-45df-b218-29222e7711ae tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:36:10.971173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f7e20-2296-4c97-b007-e19c4dc0f3e0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:10.973337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-fc906ff0-0ef8-45df-b218-29222e7711ae tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Could not find domain: 2e9a2e7320614584ad329da260900062.: keystone.exception.DomainNotFound: Could not find domain: 2e9a2e7320614584ad329da260900062. May 02 10:36:10.973337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:10.973337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 02 10:36:10.973337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 02 10:36:10.973337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:36:10.973337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:36:10.973337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:36:10.973337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:36:10.973337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2e9a2e7320614584ad329da260900062. May 02 10:36:10.973337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:10.973337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:36:10.973337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:10.973337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:10.973337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:36:10.973337 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:36:10.974722 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:36:10.974722 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:36:10.974722 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:36:10.974722 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:36:10.974722 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:36:10.974722 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:36:10.974722 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:36:10.974722 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:36:10.974722 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 02 10:36:10.974722 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 02 10:36:10.974722 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:36:10.974722 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:36:10.974722 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:36:10.974722 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:36:10.974722 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:36:10.974722 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:36:10.975866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:36:10.975866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:36:10.975866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:36:10.975866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:36:10.975866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:36:10.975866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:36:10.975866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:36:10.975866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:36:10.975866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:36:10.975866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:36:10.975866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:36:10.975866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:36:10.975866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:36:10.975866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:36:10.975866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 02 10:36:10.975866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:36:10.975866 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 2e9a2e7320614584ad329da260900062. May 02 10:36:10.977106 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:10.977106 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2396/4779] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:36:10 2022] PATCH /identity/v3/domains/2e9a2e7320614584ad329da260900062 => generated 112 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:36:10.979922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc906ff0-0ef8-45df-b218-29222e7711ae tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:10.981176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6997b5-edfd-4970-98bb-cf774fd3d6a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:10.981853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6997b5-edfd-4970-98bb-cf774fd3d6a9 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:10.982317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6997b5-edfd-4970-98bb-cf774fd3d6a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:10.982455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6997b5-edfd-4970-98bb-cf774fd3d6a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:10.982815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fc906ff0-0ef8-45df-b218-29222e7711ae tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:10.993601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6997b5-edfd-4970-98bb-cf774fd3d6a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:10.995447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6997b5-edfd-4970-98bb-cf774fd3d6a9 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:11.006309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc906ff0-0ef8-45df-b218-29222e7711ae tempest-DomainConfigurationTestJSON-2117096742 tempest-DomainConfigurationTestJSON-2117096742-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:11.008096 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2384/4780] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:36:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:36:11.014936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58e9cd-39fb-427c-9271-fc0309d7824b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:11.016065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58e9cd-39fb-427c-9271-fc0309d7824b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:11.017296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58e9cd-39fb-427c-9271-fc0309d7824b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:11.017296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58e9cd-39fb-427c-9271-fc0309d7824b admin admin] PATH_INFO: `/v3/users/e8ab562c65674682ae625a4f85a0223a` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:11.019416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58e9cd-39fb-427c-9271-fc0309d7824b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8ab562c65674682ae625a4f85a0223a)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:11.022572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58e9cd-39fb-427c-9271-fc0309d7824b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:11.229667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2e58e9cd-39fb-427c-9271-fc0309d7824b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8ab562c65674682ae625a4f85a0223a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:11.242279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2e58e9cd-39fb-427c-9271-fc0309d7824b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8ab562c65674682ae625a4f85a0223a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:11.243041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2e58e9cd-39fb-427c-9271-fc0309d7824b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8ab562c65674682ae625a4f85a0223a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:11.249762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2e58e9cd-39fb-427c-9271-fc0309d7824b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8ab562c65674682ae625a4f85a0223a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:11.328060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2e58e9cd-39fb-427c-9271-fc0309d7824b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8ab562c65674682ae625a4f85a0223a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:11.337931 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2397/4781] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:10 2022] DELETE /identity/v3/users/e8ab562c65674682ae625a4f85a0223a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:11.342833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2caa8-1551-4046-9649-fbd3fda11240 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:11.343127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2caa8-1551-4046-9649-fbd3fda11240 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:11.343699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2caa8-1551-4046-9649-fbd3fda11240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:11.376994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e9f2caa8-1551-4046-9649-fbd3fda11240 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:11.380052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e9f2caa8-1551-4046-9649-fbd3fda11240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:11.494212 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2385/4782] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:11.503391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58e9cd-39fb-427c-9271-fc0309d7824b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:11.505172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2e58e9cd-39fb-427c-9271-fc0309d7824b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:11.581415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58e9cd-39fb-427c-9271-fc0309d7824b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:11.585568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c38ccb-84c7-43e4-8c87-f85ca0d3f362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:11.586332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c38ccb-84c7-43e4-8c87-f85ca0d3f362 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:11.586689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c38ccb-84c7-43e4-8c87-f85ca0d3f362 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:11.587165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c38ccb-84c7-43e4-8c87-f85ca0d3f362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:11.599155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c38ccb-84c7-43e4-8c87-f85ca0d3f362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:11.600866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c38ccb-84c7-43e4-8c87-f85ca0d3f362 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:11.617484 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2398/4783] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:36:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:36:12.220263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2caa8-1551-4046-9649-fbd3fda11240 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:12.223604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e9f2caa8-1551-4046-9649-fbd3fda11240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:12.243411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2caa8-1551-4046-9649-fbd3fda11240 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:12.252026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536e112-5edb-4137-8377-a03d668464d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:12.253124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536e112-5edb-4137-8377-a03d668464d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:12.253568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536e112-5edb-4137-8377-a03d668464d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:12.254303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536e112-5edb-4137-8377-a03d668464d5 admin admin] PATH_INFO: `/v3/projects/b68e88ba1a694bb2b6371213cb70c32c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:12.255870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536e112-5edb-4137-8377-a03d668464d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b68e88ba1a694bb2b6371213cb70c32c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:12.259010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536e112-5edb-4137-8377-a03d668464d5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:12.383981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f536e112-5edb-4137-8377-a03d668464d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b68e88ba1a694bb2b6371213cb70c32c', 'request_id': 'req-f536e112-5edb-4137-8377-a03d668464d5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:12.390326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f536e112-5edb-4137-8377-a03d668464d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b68e88ba1a694bb2b6371213cb70c32c', 'request_id': 'req-f536e112-5edb-4137-8377-a03d668464d5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:12.473172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f536e112-5edb-4137-8377-a03d668464d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b68e88ba1a694bb2b6371213cb70c32c', 'request_id': 'req-f536e112-5edb-4137-8377-a03d668464d5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:12.489922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f536e112-5edb-4137-8377-a03d668464d5 admin admin] The token cache is being invalidate because project b68e88ba1a694bb2b6371213cb70c32c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:12.490545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f536e112-5edb-4137-8377-a03d668464d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:12.491602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f536e112-5edb-4137-8377-a03d668464d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:12.493356 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2386/4784] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:36:12 2022] DELETE /identity/v3/projects/b68e88ba1a694bb2b6371213cb70c32c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:12.497300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c38ccb-84c7-43e4-8c87-f85ca0d3f362 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:12.509845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c38ccb-84c7-43e4-8c87-f85ca0d3f362 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:12.599926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfd5f3-d721-41fc-ba6f-ba610fb0d452 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:12.601168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfd5f3-d721-41fc-ba6f-ba610fb0d452 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:12.601684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfd5f3-d721-41fc-ba6f-ba610fb0d452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:12.638271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-19bfd5f3-d721-41fc-ba6f-ba610fb0d452 None None] MFA Rules not processed for user `f2140817178b44e99d837e98eff69629`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:12.658397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-19bfd5f3-d721-41fc-ba6f-ba610fb0d452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:12.669550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5c7af-4416-4193-b140-0cf775d09c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:12.670429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5c7af-4416-4193-b140-0cf775d09c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:12.670929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5c7af-4416-4193-b140-0cf775d09c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:12.671452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5c7af-4416-4193-b140-0cf775d09c32 admin admin] PATH_INFO: `/v3/users/2cadde14f4d34220a25d2c351845a09b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:12.674543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5c7af-4416-4193-b140-0cf775d09c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cadde14f4d34220a25d2c351845a09b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:12.676861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5c7af-4416-4193-b140-0cf775d09c32 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:12.752066 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2387/4785] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:12.762199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d68b77-8f18-47bb-a374-d1f6f5dfe1a4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:12.762483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d68b77-8f18-47bb-a374-d1f6f5dfe1a4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:12.762761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d68b77-8f18-47bb-a374-d1f6f5dfe1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:12.787213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f3d68b77-8f18-47bb-a374-d1f6f5dfe1a4 None None] MFA Rules not processed for user `f2140817178b44e99d837e98eff69629`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:12.788450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f3d68b77-8f18-47bb-a374-d1f6f5dfe1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:12.803779 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2388/4786] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:12.814749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d68b77-8f18-47bb-a374-d1f6f5dfe1a4 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:12.816171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f3d68b77-8f18-47bb-a374-d1f6f5dfe1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:12.904871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d68b77-8f18-47bb-a374-d1f6f5dfe1a4 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:12.911126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371000e7-0ec1-4de1-9019-f8800d6d1222 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:12.911780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371000e7-0ec1-4de1-9019-f8800d6d1222 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:12.912063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371000e7-0ec1-4de1-9019-f8800d6d1222 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:12.912341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371000e7-0ec1-4de1-9019-f8800d6d1222 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:12.921564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371000e7-0ec1-4de1-9019-f8800d6d1222 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:12.923946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371000e7-0ec1-4de1-9019-f8800d6d1222 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:12.933687 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2389/4787] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:36:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:36:12.990683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-71f5c7af-4416-4193-b140-0cf775d09c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cadde14f4d34220a25d2c351845a09b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:13.007804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-71f5c7af-4416-4193-b140-0cf775d09c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cadde14f4d34220a25d2c351845a09b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:13.008526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-71f5c7af-4416-4193-b140-0cf775d09c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cadde14f4d34220a25d2c351845a09b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:13.016916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-71f5c7af-4416-4193-b140-0cf775d09c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cadde14f4d34220a25d2c351845a09b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:13.122397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-71f5c7af-4416-4193-b140-0cf775d09c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cadde14f4d34220a25d2c351845a09b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:13.131567 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2399/4788] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:12 2022] DELETE /identity/v3/users/2cadde14f4d34220a25d2c351845a09b => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:13.535932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371000e7-0ec1-4de1-9019-f8800d6d1222 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:13.538314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-371000e7-0ec1-4de1-9019-f8800d6d1222 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:13.579522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371000e7-0ec1-4de1-9019-f8800d6d1222 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:13.650871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76597268-5dbf-4cc8-9e90-20f2a530c6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:13.651779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76597268-5dbf-4cc8-9e90-20f2a530c6ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:13.652151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76597268-5dbf-4cc8-9e90-20f2a530c6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:13.652334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76597268-5dbf-4cc8-9e90-20f2a530c6ab admin admin] PATH_INFO: `/v3/projects/d93bb6e9ee764c54b113d5e04cf5163c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:13.653668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76597268-5dbf-4cc8-9e90-20f2a530c6ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d93bb6e9ee764c54b113d5e04cf5163c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:13.655738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76597268-5dbf-4cc8-9e90-20f2a530c6ab admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:13.762395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-76597268-5dbf-4cc8-9e90-20f2a530c6ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd93bb6e9ee764c54b113d5e04cf5163c', 'request_id': 'req-76597268-5dbf-4cc8-9e90-20f2a530c6ab'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:13.769396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-76597268-5dbf-4cc8-9e90-20f2a530c6ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd93bb6e9ee764c54b113d5e04cf5163c', 'request_id': 'req-76597268-5dbf-4cc8-9e90-20f2a530c6ab'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:13.851111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-76597268-5dbf-4cc8-9e90-20f2a530c6ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd93bb6e9ee764c54b113d5e04cf5163c', 'request_id': 'req-76597268-5dbf-4cc8-9e90-20f2a530c6ab'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:13.869299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-76597268-5dbf-4cc8-9e90-20f2a530c6ab admin admin] The token cache is being invalidate because project d93bb6e9ee764c54b113d5e04cf5163c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:13.869527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-76597268-5dbf-4cc8-9e90-20f2a530c6ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:13.870259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-76597268-5dbf-4cc8-9e90-20f2a530c6ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:13.872354 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2390/4789] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:36:13 2022] DELETE /identity/v3/projects/d93bb6e9ee764c54b113d5e04cf5163c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:13.881164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8b76f-4b3f-4397-8a6e-c0ad7946b644 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:13.881701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8b76f-4b3f-4397-8a6e-c0ad7946b644 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:13.885610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8b76f-4b3f-4397-8a6e-c0ad7946b644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:13.907502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-70c8b76f-4b3f-4397-8a6e-c0ad7946b644 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:13.909583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-70c8b76f-4b3f-4397-8a6e-c0ad7946b644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:14.011603 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2400/4790] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:14.020349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adb3b8-d4fb-4e1d-82d4-fb22e247262f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:14.020912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adb3b8-d4fb-4e1d-82d4-fb22e247262f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:14.021316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adb3b8-d4fb-4e1d-82d4-fb22e247262f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:14.042235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-49adb3b8-d4fb-4e1d-82d4-fb22e247262f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:14.043619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-49adb3b8-d4fb-4e1d-82d4-fb22e247262f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:14.055386 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2391/4791] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:14.057033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8b76f-4b3f-4397-8a6e-c0ad7946b644 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:14.068885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8b76f-4b3f-4397-8a6e-c0ad7946b644 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:14.074183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149ebf7-b48d-4ed5-9680-949986261be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:14.075559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149ebf7-b48d-4ed5-9680-949986261be4 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:14.075879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149ebf7-b48d-4ed5-9680-949986261be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:14.076186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149ebf7-b48d-4ed5-9680-949986261be4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:14.076950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149ebf7-b48d-4ed5-9680-949986261be4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:36:14.077423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149ebf7-b48d-4ed5-9680-949986261be4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:14.079810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149ebf7-b48d-4ed5-9680-949986261be4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:14.093644 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2401/4792] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:36:14.101675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49adb3b8-d4fb-4e1d-82d4-fb22e247262f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:14.113601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49adb3b8-d4fb-4e1d-82d4-fb22e247262f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:14.122121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1bb72-a0a7-4b26-86ae-f7b40640042c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:14.123522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1bb72-a0a7-4b26-86ae-f7b40640042c admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:14.123977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1bb72-a0a7-4b26-86ae-f7b40640042c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:14.124957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1bb72-a0a7-4b26-86ae-f7b40640042c admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:14.126386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1bb72-a0a7-4b26-86ae-f7b40640042c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:14.129284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1bb72-a0a7-4b26-86ae-f7b40640042c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:14.265434 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2392/4793] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:36:14 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:14.270348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149ebf7-b48d-4ed5-9680-949986261be4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:14.282562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149ebf7-b48d-4ed5-9680-949986261be4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:14.363390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6271626-6c7e-4423-8ae2-275ede2654e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:14.363390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6271626-6c7e-4423-8ae2-275ede2654e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:14.363390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6271626-6c7e-4423-8ae2-275ede2654e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:14.363390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6271626-6c7e-4423-8ae2-275ede2654e2 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:14.363775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6271626-6c7e-4423-8ae2-275ede2654e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:14.365589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6271626-6c7e-4423-8ae2-275ede2654e2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:14.463606 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2402/4794] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:36:14 2022] POST /identity/v3/users => generated 291 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:14.466127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1bb72-a0a7-4b26-86ae-f7b40640042c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:14.475756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1bb72-a0a7-4b26-86ae-f7b40640042c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:14.480373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f783c5-3b9e-4e29-ae67-0bc3a945b205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:14.481102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f783c5-3b9e-4e29-ae67-0bc3a945b205 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:14.481383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f783c5-3b9e-4e29-ae67-0bc3a945b205 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:14.481655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f783c5-3b9e-4e29-ae67-0bc3a945b205 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:14.482404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f783c5-3b9e-4e29-ae67-0bc3a945b205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:14.483988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f783c5-3b9e-4e29-ae67-0bc3a945b205 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:14.497792 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2393/4795] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:36:14.499077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6271626-6c7e-4423-8ae2-275ede2654e2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:14.509754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6271626-6c7e-4423-8ae2-275ede2654e2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:14.514416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cc550-7303-4f80-8d37-f3e3e696dbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:14.515075 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cc550-7303-4f80-8d37-f3e3e696dbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:14.515361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cc550-7303-4f80-8d37-f3e3e696dbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:14.515643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cc550-7303-4f80-8d37-f3e3e696dbf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:14.516393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cc550-7303-4f80-8d37-f3e3e696dbf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:14.518017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cc550-7303-4f80-8d37-f3e3e696dbf2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:14.527592 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2403/4796] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:14.531784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f783c5-3b9e-4e29-ae67-0bc3a945b205 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:14.541783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f783c5-3b9e-4e29-ae67-0bc3a945b205 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:14.546451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ee7b9-18dc-42ef-8946-e51d53567434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:14.547824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ee7b9-18dc-42ef-8946-e51d53567434 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:14.548105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ee7b9-18dc-42ef-8946-e51d53567434 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:14.548379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ee7b9-18dc-42ef-8946-e51d53567434 admin admin] PATH_INFO: `/v3/projects/3e9d1ad482844af6b7fbfa65d7990d91/users/72175c67d99b4fb0becacfc57ce439f7/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:14.562701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ee7b9-18dc-42ef-8946-e51d53567434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9d1ad482844af6b7fbfa65d7990d91, user_id=72175c67d99b4fb0becacfc57ce439f7, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:14.565956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ee7b9-18dc-42ef-8946-e51d53567434 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:14.682889 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2394/4797] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:14 2022] PUT /identity/v3/projects/3e9d1ad482844af6b7fbfa65d7990d91/users/72175c67d99b4fb0becacfc57ce439f7/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:14.692942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a8b58-4b92-4f2f-894f-614475fe9d13 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:14.693241 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a8b58-4b92-4f2f-894f-614475fe9d13 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:14.693523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a8b58-4b92-4f2f-894f-614475fe9d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:14.719889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f42a8b58-4b92-4f2f-894f-614475fe9d13 None None] MFA Rules not processed for user `72175c67d99b4fb0becacfc57ce439f7`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:14.721120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f42a8b58-4b92-4f2f-894f-614475fe9d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:14.794333 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2404/4798] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:14.799566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ee7b9-18dc-42ef-8946-e51d53567434 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:14.867831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ee7b9-18dc-42ef-8946-e51d53567434 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:14.873831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505e322-1e17-4424-a9ab-14ce7857579c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:14.874545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505e322-1e17-4424-a9ab-14ce7857579c admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:14.874828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505e322-1e17-4424-a9ab-14ce7857579c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:14.876693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505e322-1e17-4424-a9ab-14ce7857579c admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:14.877831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505e322-1e17-4424-a9ab-14ce7857579c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:14.879995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505e322-1e17-4424-a9ab-14ce7857579c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:14.968935 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2395/4799] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:36:14 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:14.973540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a8b58-4b92-4f2f-894f-614475fe9d13 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:14.991966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a8b58-4b92-4f2f-894f-614475fe9d13 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:15.073421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720d629-1302-4eaf-a547-6f0f542fc5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:15.074117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720d629-1302-4eaf-a547-6f0f542fc5cb admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:15.074404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720d629-1302-4eaf-a547-6f0f542fc5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:15.074681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720d629-1302-4eaf-a547-6f0f542fc5cb admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:15.075391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720d629-1302-4eaf-a547-6f0f542fc5cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:15.077385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720d629-1302-4eaf-a547-6f0f542fc5cb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:15.164475 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2405/4800] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:36:14 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:15.171673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505e322-1e17-4424-a9ab-14ce7857579c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:15.184254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505e322-1e17-4424-a9ab-14ce7857579c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:15.189829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdf25c-01dd-483d-8abb-48f612ca729d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:15.190559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdf25c-01dd-483d-8abb-48f612ca729d admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:15.190854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdf25c-01dd-483d-8abb-48f612ca729d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:15.191137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdf25c-01dd-483d-8abb-48f612ca729d admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:15.191900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bdf25c-01dd-483d-8abb-48f612ca729d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:15.194210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bdf25c-01dd-483d-8abb-48f612ca729d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:15.206803 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2396/4801] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:15.210954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720d629-1302-4eaf-a547-6f0f542fc5cb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:15.225699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720d629-1302-4eaf-a547-6f0f542fc5cb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:15.230848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7f023-cb94-49a8-a2a9-29739cba7e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:15.231781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7f023-cb94-49a8-a2a9-29739cba7e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:15.232067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7f023-cb94-49a8-a2a9-29739cba7e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:15.232344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7f023-cb94-49a8-a2a9-29739cba7e19 admin admin] PATH_INFO: `/v3/projects/2eddcd2d662e41378bfbb0843fcd520e/users/0f539effa5c546f89783d3c4d3b8e0f3/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:15.259310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7f023-cb94-49a8-a2a9-29739cba7e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eddcd2d662e41378bfbb0843fcd520e, user_id=0f539effa5c546f89783d3c4d3b8e0f3, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:15.262038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7f023-cb94-49a8-a2a9-29739cba7e19 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:15.352702 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2406/4802] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:15 2022] PUT /identity/v3/projects/2eddcd2d662e41378bfbb0843fcd520e/users/0f539effa5c546f89783d3c4d3b8e0f3/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:15.357145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdf25c-01dd-483d-8abb-48f612ca729d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:15.371432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdf25c-01dd-483d-8abb-48f612ca729d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:15.451529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97266542-4ba5-4919-bb31-45e70b3156f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:15.453056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97266542-4ba5-4919-bb31-45e70b3156f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:15.454301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97266542-4ba5-4919-bb31-45e70b3156f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:15.464584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97266542-4ba5-4919-bb31-45e70b3156f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:15.464584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97266542-4ba5-4919-bb31-45e70b3156f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:15.464584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97266542-4ba5-4919-bb31-45e70b3156f5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:15.471294 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2397/4803] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:15.475904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7f023-cb94-49a8-a2a9-29739cba7e19 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:15.490356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7f023-cb94-49a8-a2a9-29739cba7e19 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:15.508357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61194e76-62fe-4f6a-bd42-ccd389a45c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:15.509611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61194e76-62fe-4f6a-bd42-ccd389a45c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:15.509958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61194e76-62fe-4f6a-bd42-ccd389a45c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:15.511594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61194e76-62fe-4f6a-bd42-ccd389a45c71 admin admin] PATH_INFO: `/v3/projects/2eddcd2d662e41378bfbb0843fcd520e/users/0f539effa5c546f89783d3c4d3b8e0f3/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:15.515536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61194e76-62fe-4f6a-bd42-ccd389a45c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eddcd2d662e41378bfbb0843fcd520e, user_id=0f539effa5c546f89783d3c4d3b8e0f3, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:15.523793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61194e76-62fe-4f6a-bd42-ccd389a45c71 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:15.579307 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2407/4804] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:15 2022] PUT /identity/v3/projects/2eddcd2d662e41378bfbb0843fcd520e/users/0f539effa5c546f89783d3c4d3b8e0f3/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:15.591004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba26dc-85ec-43e3-9411-563389adb52f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:15.591523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba26dc-85ec-43e3-9411-563389adb52f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:15.591766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba26dc-85ec-43e3-9411-563389adb52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:15.621627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-54ba26dc-85ec-43e3-9411-563389adb52f None None] MFA Rules not processed for user `0f539effa5c546f89783d3c4d3b8e0f3`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:15.622899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-54ba26dc-85ec-43e3-9411-563389adb52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:15.695053 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2398/4805] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:15.700064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61194e76-62fe-4f6a-bd42-ccd389a45c71 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:15.711344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61194e76-62fe-4f6a-bd42-ccd389a45c71 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:15.716544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e1138-58a7-4568-bffe-01a19c1156d2 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f539effa5c546f89783d3c4d3b8e0f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eddcd2d662e41378bfbb0843fcd520e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:15.716544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e1138-58a7-4568-bffe-01a19c1156d2 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:15.717438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e1138-58a7-4568-bffe-01a19c1156d2 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:15.717438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e1138-58a7-4568-bffe-01a19c1156d2 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:15.717897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e1138-58a7-4568-bffe-01a19c1156d2 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:15.719522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e1138-58a7-4568-bffe-01a19c1156d2 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:15.741416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-4e6e1138-58a7-4568-bffe-01a19c1156d2 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invalid input for field 'name': '' is too short May 02 10:36:15.741416 ncdv-master-1 devstack@keystone.service[91118]: Failed validating 'minLength' in schema['properties']['name']: May 02 10:36:15.741416 ncdv-master-1 devstack@keystone.service[91118]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 02 10:36:15.741416 ncdv-master-1 devstack@keystone.service[91118]: On instance['name']: May 02 10:36:15.741416 ncdv-master-1 devstack@keystone.service[91118]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short May 02 10:36:15.741416 ncdv-master-1 devstack@keystone.service[91118]: Failed validating 'minLength' in schema['properties']['name']: May 02 10:36:15.741416 ncdv-master-1 devstack@keystone.service[91118]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 02 10:36:15.741416 ncdv-master-1 devstack@keystone.service[91118]: On instance['name']: May 02 10:36:15.741416 ncdv-master-1 devstack@keystone.service[91118]: '' May 02 10:36:15.741416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:15.741416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 02 10:36:15.741416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 02 10:36:15.741416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 02 10:36:15.741416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise error May 02 10:36:15.741416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short May 02 10:36:15.741416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:15.741416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: May 02 10:36:15.741416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 02 10:36:15.741416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:15.741416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application On instance['name']: May 02 10:36:15.741416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application '' May 02 10:36:15.741416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:15.741416 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:36:15.743346 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:15.743346 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:15.743346 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:36:15.743346 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:36:15.743346 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:36:15.743346 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:36:15.743346 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:36:15.743346 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:36:15.743346 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:36:15.743346 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:36:15.743346 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:36:15.743346 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:36:15.743346 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post May 02 10:36:15.743346 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) May 02 10:36:15.743346 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 02 10:36:15.743346 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 02 10:36:15.743346 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 02 10:36:15.744431 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 02 10:36:15.744431 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short May 02 10:36:15.744431 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:15.744431 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: May 02 10:36:15.744431 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 02 10:36:15.744431 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:15.744431 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application On instance['name']: May 02 10:36:15.744431 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application '' May 02 10:36:15.744431 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:15.744431 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2408/4806] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:36:15 2022] POST /identity/v3/domains => generated 283 bytes in 43 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 02 10:36:15.748149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba26dc-85ec-43e3-9411-563389adb52f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:15.758760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba26dc-85ec-43e3-9411-563389adb52f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:15.763500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a836b-da0b-450a-bdb6-86e91ecfb692 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f539effa5c546f89783d3c4d3b8e0f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eddcd2d662e41378bfbb0843fcd520e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:15.764240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a836b-da0b-450a-bdb6-86e91ecfb692 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:15.764553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a836b-da0b-450a-bdb6-86e91ecfb692 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:15.764882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a836b-da0b-450a-bdb6-86e91ecfb692 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:15.765629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a836b-da0b-450a-bdb6-86e91ecfb692 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:15.767964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a836b-da0b-450a-bdb6-86e91ecfb692 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:15.776292 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-c16a836b-da0b-450a-bdb6-86e91ecfb692 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 02 10:36:15.776292 ncdv-master-1 devstack@keystone.service[91119]: Failed validating 'maxLength' in schema['properties']['name']: May 02 10:36:15.776292 ncdv-master-1 devstack@keystone.service[91119]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 02 10:36:15.776292 ncdv-master-1 devstack@keystone.service[91119]: On instance['name']: May 02 10:36:15.776292 ncdv-master-1 devstack@keystone.service[91119]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 02 10:36:15.776292 ncdv-master-1 devstack@keystone.service[91119]: Failed validating 'maxLength' in schema['properties']['name']: May 02 10:36:15.776292 ncdv-master-1 devstack@keystone.service[91119]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 02 10:36:15.776292 ncdv-master-1 devstack@keystone.service[91119]: On instance['name']: May 02 10:36:15.776292 ncdv-master-1 devstack@keystone.service[91119]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 02 10:36:15.776292 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:15.776292 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 02 10:36:15.776292 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 02 10:36:15.776292 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 02 10:36:15.776292 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise error May 02 10:36:15.776292 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 02 10:36:15.776292 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:15.776292 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: May 02 10:36:15.776292 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 02 10:36:15.776292 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:15.777798 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application On instance['name']: May 02 10:36:15.777798 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 02 10:36:15.777798 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:15.777798 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:36:15.777798 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:15.777798 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:15.777798 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:36:15.777798 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:36:15.777798 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:36:15.777798 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:36:15.777798 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:36:15.777798 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:36:15.777798 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:36:15.777798 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:36:15.777798 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:36:15.777798 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:36:15.777798 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post May 02 10:36:15.777798 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) May 02 10:36:15.779419 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 02 10:36:15.779419 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 02 10:36:15.779419 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 02 10:36:15.779419 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 02 10:36:15.779419 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 02 10:36:15.779419 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:15.779419 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: May 02 10:36:15.779419 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 02 10:36:15.779419 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:15.779419 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application On instance['name']: May 02 10:36:15.779419 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 02 10:36:15.779419 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:15.779419 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2399/4807] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:36:15 2022] POST /identity/v3/domains => generated 412 bytes in 30 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 02 10:36:15.782662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e1138-58a7-4568-bffe-01a19c1156d2 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:15.795022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e1138-58a7-4568-bffe-01a19c1156d2 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:15.800756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bf984-d900-4a76-9cce-53d4ae4c967a tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f539effa5c546f89783d3c4d3b8e0f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eddcd2d662e41378bfbb0843fcd520e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:15.801299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bf984-d900-4a76-9cce-53d4ae4c967a tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:15.801595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bf984-d900-4a76-9cce-53d4ae4c967a tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:15.801877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bf984-d900-4a76-9cce-53d4ae4c967a tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:15.803801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bf984-d900-4a76-9cce-53d4ae4c967a tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:15.805477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bf984-d900-4a76-9cce-53d4ae4c967a tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:15.912299 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2409/4808] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:36:15 2022] POST /identity/v3/domains => generated 277 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:15.916346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a836b-da0b-450a-bdb6-86e91ecfb692 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:15.944172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a836b-da0b-450a-bdb6-86e91ecfb692 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:16.020195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d2a24-2627-4e5b-835e-363eeed3b67c tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f539effa5c546f89783d3c4d3b8e0f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eddcd2d662e41378bfbb0843fcd520e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:16.021119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d2a24-2627-4e5b-835e-363eeed3b67c tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:16.031394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d2a24-2627-4e5b-835e-363eeed3b67c tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:16.034079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d2a24-2627-4e5b-835e-363eeed3b67c tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] PATH_INFO: `/v3/domains/de4fc9f8b8b54e1ab45adf30698ce526` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:16.051587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d2a24-2627-4e5b-835e-363eeed3b67c tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=de4fc9f8b8b54e1ab45adf30698ce526)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:16.053535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d2a24-2627-4e5b-835e-363eeed3b67c tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:16.080844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-101d2a24-2627-4e5b-835e-363eeed3b67c tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. May 02 10:36:16.080844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:16.080844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:36:16.080844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:36:16.080844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:36:16.080844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:36:16.080844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:36:16.080844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:36:16.080844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:36:16.080844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:36:16.080844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:36:16.080844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:36:16.080844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete May 02 10:36:16.080844 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( May 02 10:36:16.082185 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:36:16.082185 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:36:16.082185 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain May 02 10:36:16.082185 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) May 02 10:36:16.082185 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain May 02 10:36:16.082185 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( May 02 10:36:16.082185 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. May 02 10:36:16.082185 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:16.082958 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2400/4809] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:36:15 2022] DELETE /identity/v3/domains/de4fc9f8b8b54e1ab45adf30698ce526 => generated 120 bytes in 166 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) May 02 10:36:16.086172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bf984-d900-4a76-9cce-53d4ae4c967a tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:16.105893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bf984-d900-4a76-9cce-53d4ae4c967a tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:16.112694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d848a6-09b3-4f2d-ba29-11862114ee66 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f539effa5c546f89783d3c4d3b8e0f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eddcd2d662e41378bfbb0843fcd520e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:16.114296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d848a6-09b3-4f2d-ba29-11862114ee66 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:16.114828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d848a6-09b3-4f2d-ba29-11862114ee66 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:16.115221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d848a6-09b3-4f2d-ba29-11862114ee66 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] PATH_INFO: `/v3/domains/de4fc9f8b8b54e1ab45adf30698ce526` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:16.116581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d848a6-09b3-4f2d-ba29-11862114ee66 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=de4fc9f8b8b54e1ab45adf30698ce526)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:16.118656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d848a6-09b3-4f2d-ba29-11862114ee66 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:16.143995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d6d848a6-09b3-4f2d-ba29-11862114ee66 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'de4fc9f8b8b54e1ab45adf30698ce526'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:16.145100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d6d848a6-09b3-4f2d-ba29-11862114ee66 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'de4fc9f8b8b54e1ab45adf30698ce526'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:16.238632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d6d848a6-09b3-4f2d-ba29-11862114ee66 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'de4fc9f8b8b54e1ab45adf30698ce526'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:16.239293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d6d848a6-09b3-4f2d-ba29-11862114ee66 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'de4fc9f8b8b54e1ab45adf30698ce526'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:16.242008 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2410/4810] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:36:16 2022] PATCH /identity/v3/domains/de4fc9f8b8b54e1ab45adf30698ce526 => generated 278 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:16.246210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d2a24-2627-4e5b-835e-363eeed3b67c tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:16.247909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-101d2a24-2627-4e5b-835e-363eeed3b67c tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:16.262605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d2a24-2627-4e5b-835e-363eeed3b67c tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:16.326872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a65e1b-dbe5-4522-9330-75a25314d00d tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f539effa5c546f89783d3c4d3b8e0f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eddcd2d662e41378bfbb0843fcd520e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:16.327735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a65e1b-dbe5-4522-9330-75a25314d00d tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:16.328023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a65e1b-dbe5-4522-9330-75a25314d00d tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:16.328298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a65e1b-dbe5-4522-9330-75a25314d00d tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] PATH_INFO: `/v3/domains/de4fc9f8b8b54e1ab45adf30698ce526` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:16.338903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a65e1b-dbe5-4522-9330-75a25314d00d tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=de4fc9f8b8b54e1ab45adf30698ce526)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:16.341680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a65e1b-dbe5-4522-9330-75a25314d00d tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:16.368977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3a65e1b-dbe5-4522-9330-75a25314d00d tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'de4fc9f8b8b54e1ab45adf30698ce526'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:16.379750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3a65e1b-dbe5-4522-9330-75a25314d00d tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'de4fc9f8b8b54e1ab45adf30698ce526'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:16.501754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3a65e1b-dbe5-4522-9330-75a25314d00d tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de4fc9f8b8b54e1ab45adf30698ce526', 'request_id': 'req-d3a65e1b-dbe5-4522-9330-75a25314d00d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:16.512875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3a65e1b-dbe5-4522-9330-75a25314d00d tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de4fc9f8b8b54e1ab45adf30698ce526', 'request_id': 'req-d3a65e1b-dbe5-4522-9330-75a25314d00d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:16.594714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3a65e1b-dbe5-4522-9330-75a25314d00d tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de4fc9f8b8b54e1ab45adf30698ce526', 'request_id': 'req-d3a65e1b-dbe5-4522-9330-75a25314d00d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:16.613886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3a65e1b-dbe5-4522-9330-75a25314d00d tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] The token cache is being invalidate because project de4fc9f8b8b54e1ab45adf30698ce526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:16.614048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3a65e1b-dbe5-4522-9330-75a25314d00d tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:16.616526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3a65e1b-dbe5-4522-9330-75a25314d00d tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:16.626047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3a65e1b-dbe5-4522-9330-75a25314d00d tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'de4fc9f8b8b54e1ab45adf30698ce526', 'request_id': 'req-d3a65e1b-dbe5-4522-9330-75a25314d00d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:16.630267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3a65e1b-dbe5-4522-9330-75a25314d00d tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'de4fc9f8b8b54e1ab45adf30698ce526', 'request_id': 'req-d3a65e1b-dbe5-4522-9330-75a25314d00d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:16.631301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3a65e1b-dbe5-4522-9330-75a25314d00d tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'de4fc9f8b8b54e1ab45adf30698ce526', 'request_id': 'req-d3a65e1b-dbe5-4522-9330-75a25314d00d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:16.643826 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2401/4811] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:36:16 2022] DELETE /identity/v3/domains/de4fc9f8b8b54e1ab45adf30698ce526 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:16.645144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d848a6-09b3-4f2d-ba29-11862114ee66 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:16.657631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d848a6-09b3-4f2d-ba29-11862114ee66 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:16.738395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e58b5c-686a-490d-9395-a38e6cc0ca43 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f539effa5c546f89783d3c4d3b8e0f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eddcd2d662e41378bfbb0843fcd520e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:16.739614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e58b5c-686a-490d-9395-a38e6cc0ca43 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:16.740167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e58b5c-686a-490d-9395-a38e6cc0ca43 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:16.740516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e58b5c-686a-490d-9395-a38e6cc0ca43 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] PATH_INFO: `/v3/domains/45606a50db58440aa49f0db3b18caf77` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:16.753049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e58b5c-686a-490d-9395-a38e6cc0ca43 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:36:16.769224 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-a1e58b5c-686a-490d-9395-a38e6cc0ca43 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Could not find domain: 45606a50db58440aa49f0db3b18caf77.: keystone.exception.DomainNotFound: Could not find domain: 45606a50db58440aa49f0db3b18caf77. May 02 10:36:16.769224 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:16.769224 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 02 10:36:16.769224 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 02 10:36:16.769224 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:36:16.769224 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:36:16.769224 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:36:16.769224 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:36:16.769224 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 45606a50db58440aa49f0db3b18caf77. May 02 10:36:16.769224 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:16.769224 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:36:16.769224 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:16.769224 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:16.769224 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:36:16.769224 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:36:16.770584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:36:16.770584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:36:16.770584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:36:16.770584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:36:16.770584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:36:16.770584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:36:16.770584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:36:16.770584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:36:16.770584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete May 02 10:36:16.770584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') May 02 10:36:16.770584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:36:16.770584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:36:16.770584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:36:16.770584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:36:16.770584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:36:16.770584 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:36:16.771902 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:36:16.771902 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:36:16.771902 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:36:16.771902 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:36:16.771902 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:36:16.771902 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:36:16.771902 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:36:16.771902 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:36:16.771902 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:36:16.771902 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:36:16.771902 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:36:16.771902 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:36:16.771902 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:36:16.771902 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:36:16.771902 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 02 10:36:16.771902 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:36:16.771902 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 45606a50db58440aa49f0db3b18caf77. May 02 10:36:16.773445 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:16.773445 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2411/4812] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:36:16 2022] DELETE /identity/v3/domains/45606a50db58440aa49f0db3b18caf77 => generated 112 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 02 10:36:16.778314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a65e1b-dbe5-4522-9330-75a25314d00d tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:16.780105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d3a65e1b-dbe5-4522-9330-75a25314d00d tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:16.794673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a65e1b-dbe5-4522-9330-75a25314d00d tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:16.799687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b499c-7bf6-4ad4-98f8-ed9aed2a4ebf tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f539effa5c546f89783d3c4d3b8e0f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eddcd2d662e41378bfbb0843fcd520e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:16.800425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b499c-7bf6-4ad4-98f8-ed9aed2a4ebf tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:16.800754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b499c-7bf6-4ad4-98f8-ed9aed2a4ebf tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:16.801157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b499c-7bf6-4ad4-98f8-ed9aed2a4ebf tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:16.801900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b499c-7bf6-4ad4-98f8-ed9aed2a4ebf tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:16.803502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b499c-7bf6-4ad4-98f8-ed9aed2a4ebf tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:16.881575 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2402/4813] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:36:16 2022] POST /identity/v3/domains => generated 253 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:36:16.887443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e58b5c-686a-490d-9395-a38e6cc0ca43 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:16.899038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e58b5c-686a-490d-9395-a38e6cc0ca43 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:16.955950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69214fa3-e2fa-455f-bf81-10cf56b6c292 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f539effa5c546f89783d3c4d3b8e0f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eddcd2d662e41378bfbb0843fcd520e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:16.956643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69214fa3-e2fa-455f-bf81-10cf56b6c292 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:16.956933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69214fa3-e2fa-455f-bf81-10cf56b6c292 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:16.957214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69214fa3-e2fa-455f-bf81-10cf56b6c292 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:16.957940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69214fa3-e2fa-455f-bf81-10cf56b6c292 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:16.959565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69214fa3-e2fa-455f-bf81-10cf56b6c292 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:17.013018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.sql.core [None req-69214fa3-e2fa-455f-bf81-10cf56b6c292 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1764434346' for key 'project.ixu_project_name_domain_id'") May 02 10:36:17.013018 ncdv-master-1 devstack@keystone.service[91118]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 02 10:36:17.013018 ncdv-master-1 devstack@keystone.service[91118]: [parameters: {'id': 'd5f2c80bab72413f82acdebc32c7e74b', 'name': 'tempest-domain-dup-1764434346', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] May 02 10:36:17.013018 ncdv-master-1 devstack@keystone.service[91118]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91118) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 02 10:36:17.021158 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-69214fa3-e2fa-455f-bf81-10cf56b6c292 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1764434346.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1764434346. May 02 10:36:17.021158 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:17.021158 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 02 10:36:17.021158 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self.dialect.do_execute( May 02 10:36:17.021158 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 02 10:36:17.021158 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 02 10:36:17.021158 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 02 10:36:17.021158 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application result = self._query(query) May 02 10:36:17.021158 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 02 10:36:17.021158 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application conn.query(q) May 02 10:36:17.021158 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 02 10:36:17.021158 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 02 10:36:17.021158 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 02 10:36:17.023849 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application result.read() May 02 10:36:17.023849 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 02 10:36:17.023849 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 02 10:36:17.023849 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 02 10:36:17.023849 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application packet.raise_for_error() May 02 10:36:17.023849 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 02 10:36:17.023849 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 02 10:36:17.023849 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 02 10:36:17.023849 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 02 10:36:17.023849 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-1764434346' for key 'project.ixu_project_name_domain_id'") May 02 10:36:17.023849 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:17.023849 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 02 10:36:17.023849 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:17.023849 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:17.023849 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 02 10:36:17.023849 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 02 10:36:17.023849 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 02 10:36:17.023849 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return project_ref.to_dict() May 02 10:36:17.025320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 02 10:36:17.025320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application next(self.gen) May 02 10:36:17.025320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 02 10:36:17.025320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application yield resource May 02 10:36:17.025320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 02 10:36:17.025320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application next(self.gen) May 02 10:36:17.025320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 02 10:36:17.025320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self.session.rollback() May 02 10:36:17.025320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 02 10:36:17.025320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self.force_reraise() May 02 10:36:17.025320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 02 10:36:17.025320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise self.value May 02 10:36:17.025320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 02 10:36:17.025320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 02 10:36:17.025320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 02 10:36:17.025320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application session.commit() May 02 10:36:17.025320 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 02 10:36:17.026636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 02 10:36:17.026636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 02 10:36:17.026636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._prepare_impl() May 02 10:36:17.026636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 02 10:36:17.026636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self.session.flush() May 02 10:36:17.026636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 02 10:36:17.026636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._flush(objects) May 02 10:36:17.026636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 02 10:36:17.026636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 02 10:36:17.026636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 02 10:36:17.026636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application compat.raise_( May 02 10:36:17.026636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 02 10:36:17.026636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception May 02 10:36:17.026636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 02 10:36:17.026636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application flush_context.execute() May 02 10:36:17.026636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 02 10:36:17.026636 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rec.execute(self) May 02 10:36:17.028053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 02 10:36:17.028053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 02 10:36:17.028053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 02 10:36:17.028053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application _emit_insert_statements( May 02 10:36:17.028053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 02 10:36:17.028053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application c = connection._execute_20( May 02 10:36:17.028053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 02 10:36:17.028053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 02 10:36:17.028053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 02 10:36:17.028053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 02 10:36:17.028053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 02 10:36:17.028053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ret = self._execute_context( May 02 10:36:17.028053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 02 10:36:17.028053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 02 10:36:17.028053 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 02 10:36:17.029291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 02 10:36:17.029291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 02 10:36:17.029291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception May 02 10:36:17.029291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 02 10:36:17.029291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self.dialect.do_execute( May 02 10:36:17.029291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 02 10:36:17.029291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 02 10:36:17.029291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 02 10:36:17.029291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application result = self._query(query) May 02 10:36:17.029291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 02 10:36:17.029291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application conn.query(q) May 02 10:36:17.029291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 02 10:36:17.029291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 02 10:36:17.029291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 02 10:36:17.029291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application result.read() May 02 10:36:17.029291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 02 10:36:17.029291 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 02 10:36:17.030576 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 02 10:36:17.030576 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application packet.raise_for_error() May 02 10:36:17.030576 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 02 10:36:17.030576 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 02 10:36:17.030576 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 02 10:36:17.030576 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 02 10:36:17.030576 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1764434346' for key 'project.ixu_project_name_domain_id'") May 02 10:36:17.030576 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 02 10:36:17.030576 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [parameters: {'id': 'd5f2c80bab72413f82acdebc32c7e74b', 'name': 'tempest-domain-dup-1764434346', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] May 02 10:36:17.030576 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 02 10:36:17.030576 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:17.030576 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:36:17.030576 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:17.030576 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:17.031607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 02 10:36:17.031607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 02 10:36:17.031607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 02 10:36:17.031607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 02 10:36:17.031607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-1764434346. May 02 10:36:17.031607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:17.031607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:36:17.031607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:17.031607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:17.031607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:36:17.031607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:36:17.031607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:36:17.031607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:36:17.031607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:36:17.031607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:36:17.031607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:36:17.031607 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:36:17.032912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:36:17.032912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:36:17.032912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post May 02 10:36:17.032912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( May 02 10:36:17.032912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:36:17.032912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:36:17.032912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain May 02 10:36:17.032912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application is_domain_project = self.create_project( May 02 10:36:17.032912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:36:17.032912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:36:17.032912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 02 10:36:17.032912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.Conflict( May 02 10:36:17.032912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1764434346. May 02 10:36:17.032912 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:17.032912 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2412/4814] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:36:16 2022] POST /identity/v3/domains => generated 212 bytes in 136 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 02 10:36:17.034156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b499c-7bf6-4ad4-98f8-ed9aed2a4ebf tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:17.038494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b499c-7bf6-4ad4-98f8-ed9aed2a4ebf tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:17.043211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d75c57-5f34-4717-bc70-a034c6941d76 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f539effa5c546f89783d3c4d3b8e0f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eddcd2d662e41378bfbb0843fcd520e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:17.044097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d75c57-5f34-4717-bc70-a034c6941d76 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:17.044396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d75c57-5f34-4717-bc70-a034c6941d76 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:17.044710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d75c57-5f34-4717-bc70-a034c6941d76 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] PATH_INFO: `/v3/domains/81287791b66446e3ac00c3b6ad7c5a83` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:17.056424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d75c57-5f34-4717-bc70-a034c6941d76 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=81287791b66446e3ac00c3b6ad7c5a83)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:17.064811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d75c57-5f34-4717-bc70-a034c6941d76 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:17.086297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b8d75c57-5f34-4717-bc70-a034c6941d76 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '81287791b66446e3ac00c3b6ad7c5a83'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:17.087117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b8d75c57-5f34-4717-bc70-a034c6941d76 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '81287791b66446e3ac00c3b6ad7c5a83'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:17.184536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b8d75c57-5f34-4717-bc70-a034c6941d76 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '81287791b66446e3ac00c3b6ad7c5a83'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:17.185338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b8d75c57-5f34-4717-bc70-a034c6941d76 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '81287791b66446e3ac00c3b6ad7c5a83'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:17.191946 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2403/4815] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:36:17 2022] PATCH /identity/v3/domains/81287791b66446e3ac00c3b6ad7c5a83 => generated 254 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:17.193509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69214fa3-e2fa-455f-bf81-10cf56b6c292 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:17.195568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-69214fa3-e2fa-455f-bf81-10cf56b6c292 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:17.211428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69214fa3-e2fa-455f-bf81-10cf56b6c292 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:17.270079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c98f9-526e-4da7-9767-01f3d8bfa616 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f539effa5c546f89783d3c4d3b8e0f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eddcd2d662e41378bfbb0843fcd520e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:17.270878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c98f9-526e-4da7-9767-01f3d8bfa616 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:17.271177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c98f9-526e-4da7-9767-01f3d8bfa616 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:17.271497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c98f9-526e-4da7-9767-01f3d8bfa616 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] PATH_INFO: `/v3/domains/81287791b66446e3ac00c3b6ad7c5a83` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:17.283012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c98f9-526e-4da7-9767-01f3d8bfa616 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=81287791b66446e3ac00c3b6ad7c5a83)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:17.284710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c98f9-526e-4da7-9767-01f3d8bfa616 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:17.309703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a1c98f9-526e-4da7-9767-01f3d8bfa616 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '81287791b66446e3ac00c3b6ad7c5a83'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:17.313766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a1c98f9-526e-4da7-9767-01f3d8bfa616 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '81287791b66446e3ac00c3b6ad7c5a83'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:17.405434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a1c98f9-526e-4da7-9767-01f3d8bfa616 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81287791b66446e3ac00c3b6ad7c5a83', 'request_id': 'req-5a1c98f9-526e-4da7-9767-01f3d8bfa616'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:17.471013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a1c98f9-526e-4da7-9767-01f3d8bfa616 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81287791b66446e3ac00c3b6ad7c5a83', 'request_id': 'req-5a1c98f9-526e-4da7-9767-01f3d8bfa616'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:17.480125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a1c98f9-526e-4da7-9767-01f3d8bfa616 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81287791b66446e3ac00c3b6ad7c5a83', 'request_id': 'req-5a1c98f9-526e-4da7-9767-01f3d8bfa616'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:17.494709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a1c98f9-526e-4da7-9767-01f3d8bfa616 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] The token cache is being invalidate because project 81287791b66446e3ac00c3b6ad7c5a83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:17.495633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a1c98f9-526e-4da7-9767-01f3d8bfa616 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:17.495851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a1c98f9-526e-4da7-9767-01f3d8bfa616 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:17.505710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a1c98f9-526e-4da7-9767-01f3d8bfa616 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '81287791b66446e3ac00c3b6ad7c5a83', 'request_id': 'req-5a1c98f9-526e-4da7-9767-01f3d8bfa616'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:17.506954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a1c98f9-526e-4da7-9767-01f3d8bfa616 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '81287791b66446e3ac00c3b6ad7c5a83', 'request_id': 'req-5a1c98f9-526e-4da7-9767-01f3d8bfa616'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:17.511118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a1c98f9-526e-4da7-9767-01f3d8bfa616 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '81287791b66446e3ac00c3b6ad7c5a83', 'request_id': 'req-5a1c98f9-526e-4da7-9767-01f3d8bfa616'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:17.518827 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2413/4816] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:36:17 2022] DELETE /identity/v3/domains/81287791b66446e3ac00c3b6ad7c5a83 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:17.523795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d75c57-5f34-4717-bc70-a034c6941d76 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:17.534054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d75c57-5f34-4717-bc70-a034c6941d76 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:17.601812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf6a83-b31b-487a-badd-925eb9fe8ca4 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f539effa5c546f89783d3c4d3b8e0f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2eddcd2d662e41378bfbb0843fcd520e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:17.602691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf6a83-b31b-487a-badd-925eb9fe8ca4 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:17.602985 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf6a83-b31b-487a-badd-925eb9fe8ca4 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:17.603273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf6a83-b31b-487a-badd-925eb9fe8ca4 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] PATH_INFO: `/v3/domains/de4fc9f8b8b54e1ab45adf30698ce526` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:17.611135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf6a83-b31b-487a-badd-925eb9fe8ca4 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:36:17.621643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-d2cf6a83-b31b-487a-badd-925eb9fe8ca4 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Could not find domain: de4fc9f8b8b54e1ab45adf30698ce526.: keystone.exception.DomainNotFound: Could not find domain: de4fc9f8b8b54e1ab45adf30698ce526. May 02 10:36:17.621643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:17.621643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 02 10:36:17.621643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 02 10:36:17.621643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:36:17.621643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:36:17.621643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:36:17.621643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:36:17.621643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: de4fc9f8b8b54e1ab45adf30698ce526. May 02 10:36:17.621643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:17.621643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:36:17.621643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:17.621643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:17.621643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:36:17.621643 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:36:17.626644 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:36:17.626644 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:36:17.626644 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:36:17.626644 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:36:17.626644 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:36:17.626644 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:36:17.626644 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:36:17.626644 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:36:17.626644 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 02 10:36:17.626644 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 02 10:36:17.626644 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:36:17.626644 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:36:17.626644 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:36:17.626644 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:36:17.626644 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:36:17.626644 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:36:17.627975 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:36:17.627975 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:36:17.627975 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:36:17.627975 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:36:17.627975 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:36:17.627975 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:36:17.627975 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:36:17.627975 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:36:17.627975 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:36:17.627975 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:36:17.627975 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:36:17.627975 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:36:17.627975 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:36:17.627975 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:36:17.627975 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 02 10:36:17.627975 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:36:17.627975 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: de4fc9f8b8b54e1ab45adf30698ce526. May 02 10:36:17.629118 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:17.629118 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2404/4817] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:36:17 2022] PATCH /identity/v3/domains/de4fc9f8b8b54e1ab45adf30698ce526 => generated 112 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:36:17.629760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c98f9-526e-4da7-9767-01f3d8bfa616 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:17.629760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5a1c98f9-526e-4da7-9767-01f3d8bfa616 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:17.699857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c98f9-526e-4da7-9767-01f3d8bfa616 tempest-DomainsNegativeTestJSON-150198608 tempest-DomainsNegativeTestJSON-150198608-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:17.704994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab1772-3428-4eb3-81d3-25f43785a967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:17.709891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab1772-3428-4eb3-81d3-25f43785a967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:17.709891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab1772-3428-4eb3-81d3-25f43785a967 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:17.709891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab1772-3428-4eb3-81d3-25f43785a967 admin admin] PATH_INFO: `/v3/users/72175c67d99b4fb0becacfc57ce439f7` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:17.709891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab1772-3428-4eb3-81d3-25f43785a967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72175c67d99b4fb0becacfc57ce439f7)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:17.709891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab1772-3428-4eb3-81d3-25f43785a967 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:17.920719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ceab1772-3428-4eb3-81d3-25f43785a967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72175c67d99b4fb0becacfc57ce439f7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:17.933758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ceab1772-3428-4eb3-81d3-25f43785a967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72175c67d99b4fb0becacfc57ce439f7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:17.934500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ceab1772-3428-4eb3-81d3-25f43785a967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72175c67d99b4fb0becacfc57ce439f7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:17.941362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ceab1772-3428-4eb3-81d3-25f43785a967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72175c67d99b4fb0becacfc57ce439f7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:18.110507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ceab1772-3428-4eb3-81d3-25f43785a967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72175c67d99b4fb0becacfc57ce439f7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:18.121281 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2414/4818] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:17 2022] DELETE /identity/v3/users/72175c67d99b4fb0becacfc57ce439f7 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:18.125887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696348ba-9d94-4fd1-97ad-96e482eb3375 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:18.131204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696348ba-9d94-4fd1-97ad-96e482eb3375 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:18.131204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696348ba-9d94-4fd1-97ad-96e482eb3375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:18.146601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-696348ba-9d94-4fd1-97ad-96e482eb3375 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:18.147834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-696348ba-9d94-4fd1-97ad-96e482eb3375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:18.236087 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2405/4819] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:18.246556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab1772-3428-4eb3-81d3-25f43785a967 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:18.248029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ceab1772-3428-4eb3-81d3-25f43785a967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:18.309670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab1772-3428-4eb3-81d3-25f43785a967 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:18.313688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31030901-76f1-4b05-9b43-962387bc20a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:18.314379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31030901-76f1-4b05-9b43-962387bc20a6 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:18.314647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31030901-76f1-4b05-9b43-962387bc20a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:18.315007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31030901-76f1-4b05-9b43-962387bc20a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:18.325284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31030901-76f1-4b05-9b43-962387bc20a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:18.327061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31030901-76f1-4b05-9b43-962387bc20a6 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:18.337923 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2415/4820] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:36:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:36:19.122299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696348ba-9d94-4fd1-97ad-96e482eb3375 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:19.123879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-696348ba-9d94-4fd1-97ad-96e482eb3375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:19.154271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696348ba-9d94-4fd1-97ad-96e482eb3375 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:19.160777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9812476-9eeb-468b-9e6c-8265e26a343b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:19.162136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9812476-9eeb-468b-9e6c-8265e26a343b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:19.162432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9812476-9eeb-468b-9e6c-8265e26a343b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:19.162714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9812476-9eeb-468b-9e6c-8265e26a343b admin admin] PATH_INFO: `/v3/projects/3e9d1ad482844af6b7fbfa65d7990d91` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:19.164142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9812476-9eeb-468b-9e6c-8265e26a343b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e9d1ad482844af6b7fbfa65d7990d91)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:19.166381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9812476-9eeb-468b-9e6c-8265e26a343b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:19.354859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d9812476-9eeb-468b-9e6c-8265e26a343b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e9d1ad482844af6b7fbfa65d7990d91', 'request_id': 'req-d9812476-9eeb-468b-9e6c-8265e26a343b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:19.363184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d9812476-9eeb-468b-9e6c-8265e26a343b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e9d1ad482844af6b7fbfa65d7990d91', 'request_id': 'req-d9812476-9eeb-468b-9e6c-8265e26a343b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:19.442496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d9812476-9eeb-468b-9e6c-8265e26a343b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e9d1ad482844af6b7fbfa65d7990d91', 'request_id': 'req-d9812476-9eeb-468b-9e6c-8265e26a343b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:19.454280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d9812476-9eeb-468b-9e6c-8265e26a343b admin admin] The token cache is being invalidate because project 3e9d1ad482844af6b7fbfa65d7990d91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:19.454698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d9812476-9eeb-468b-9e6c-8265e26a343b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:19.455541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d9812476-9eeb-468b-9e6c-8265e26a343b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:19.457368 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2406/4821] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:36:19 2022] DELETE /identity/v3/projects/3e9d1ad482844af6b7fbfa65d7990d91 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:19.461283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31030901-76f1-4b05-9b43-962387bc20a6 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:19.472819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31030901-76f1-4b05-9b43-962387bc20a6 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:19.544400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6b50f-8e2c-4a44-9fcc-336881f5f737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:19.548989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6b50f-8e2c-4a44-9fcc-336881f5f737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:19.548989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6b50f-8e2c-4a44-9fcc-336881f5f737 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:19.548989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6b50f-8e2c-4a44-9fcc-336881f5f737 admin admin] PATH_INFO: `/v3/users/0f539effa5c546f89783d3c4d3b8e0f3` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:19.548989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6b50f-8e2c-4a44-9fcc-336881f5f737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f539effa5c546f89783d3c4d3b8e0f3)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:19.548989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6b50f-8e2c-4a44-9fcc-336881f5f737 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:19.785783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f8f6b50f-8e2c-4a44-9fcc-336881f5f737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f539effa5c546f89783d3c4d3b8e0f3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:19.803037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f8f6b50f-8e2c-4a44-9fcc-336881f5f737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f539effa5c546f89783d3c4d3b8e0f3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:19.804528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f8f6b50f-8e2c-4a44-9fcc-336881f5f737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f539effa5c546f89783d3c4d3b8e0f3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:19.814688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f8f6b50f-8e2c-4a44-9fcc-336881f5f737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f539effa5c546f89783d3c4d3b8e0f3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:19.897829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f8f6b50f-8e2c-4a44-9fcc-336881f5f737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f539effa5c546f89783d3c4d3b8e0f3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:19.911106 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2416/4822] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:19 2022] DELETE /identity/v3/users/0f539effa5c546f89783d3c4d3b8e0f3 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:20.738863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9812476-9eeb-468b-9e6c-8265e26a343b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:20.740397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d9812476-9eeb-468b-9e6c-8265e26a343b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:20.757600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9812476-9eeb-468b-9e6c-8265e26a343b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:20.918866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e81816-247a-4e86-9f82-ee9fd49dc930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:20.920185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e81816-247a-4e86-9f82-ee9fd49dc930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:20.920712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e81816-247a-4e86-9f82-ee9fd49dc930 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:20.921204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e81816-247a-4e86-9f82-ee9fd49dc930 admin admin] PATH_INFO: `/v3/projects/2eddcd2d662e41378bfbb0843fcd520e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:20.923925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e81816-247a-4e86-9f82-ee9fd49dc930 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eddcd2d662e41378bfbb0843fcd520e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:20.928586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e81816-247a-4e86-9f82-ee9fd49dc930 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:21.081137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-93e81816-247a-4e86-9f82-ee9fd49dc930 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eddcd2d662e41378bfbb0843fcd520e', 'request_id': 'req-93e81816-247a-4e86-9f82-ee9fd49dc930'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:21.095783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-93e81816-247a-4e86-9f82-ee9fd49dc930 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eddcd2d662e41378bfbb0843fcd520e', 'request_id': 'req-93e81816-247a-4e86-9f82-ee9fd49dc930'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:21.236476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-93e81816-247a-4e86-9f82-ee9fd49dc930 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eddcd2d662e41378bfbb0843fcd520e', 'request_id': 'req-93e81816-247a-4e86-9f82-ee9fd49dc930'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:21.264259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-93e81816-247a-4e86-9f82-ee9fd49dc930 admin admin] The token cache is being invalidate because project 2eddcd2d662e41378bfbb0843fcd520e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:21.267152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-93e81816-247a-4e86-9f82-ee9fd49dc930 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:21.268182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-93e81816-247a-4e86-9f82-ee9fd49dc930 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:21.271542 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2407/4823] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:36:20 2022] DELETE /identity/v3/projects/2eddcd2d662e41378bfbb0843fcd520e => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:21.276631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905cba9-8874-450f-af6f-d480866b4e84 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:21.277154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905cba9-8874-450f-af6f-d480866b4e84 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:21.277267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905cba9-8874-450f-af6f-d480866b4e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:21.302325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-7905cba9-8874-450f-af6f-d480866b4e84 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:21.304396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7905cba9-8874-450f-af6f-d480866b4e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:21.385931 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2417/4824] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:21.394440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bebc8f-d8bf-4c17-90d8-1a3dcde5f011 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:21.394737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bebc8f-d8bf-4c17-90d8-1a3dcde5f011 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:21.395023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bebc8f-d8bf-4c17-90d8-1a3dcde5f011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:21.414775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b8bebc8f-d8bf-4c17-90d8-1a3dcde5f011 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:21.416171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b8bebc8f-d8bf-4c17-90d8-1a3dcde5f011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:21.428763 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2408/4825] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:21.433257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905cba9-8874-450f-af6f-d480866b4e84 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:21.444132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905cba9-8874-450f-af6f-d480866b4e84 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:21.448939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f5be0-12eb-4f83-8a8e-0936d2fc3ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:21.449606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f5be0-12eb-4f83-8a8e-0936d2fc3ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:21.450090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f5be0-12eb-4f83-8a8e-0936d2fc3ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:21.450359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f5be0-12eb-4f83-8a8e-0936d2fc3ee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:21.451099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f5be0-12eb-4f83-8a8e-0936d2fc3ee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:36:21.451415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f5be0-12eb-4f83-8a8e-0936d2fc3ee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:21.453125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f5be0-12eb-4f83-8a8e-0936d2fc3ee4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:21.466398 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2418/4826] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:36:21.473137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bebc8f-d8bf-4c17-90d8-1a3dcde5f011 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:21.492239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bebc8f-d8bf-4c17-90d8-1a3dcde5f011 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:21.498717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbda21-a90e-4efb-a225-36f3e1a15987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:21.499546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbda21-a90e-4efb-a225-36f3e1a15987 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:21.499838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbda21-a90e-4efb-a225-36f3e1a15987 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:21.500944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbda21-a90e-4efb-a225-36f3e1a15987 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:21.504657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbda21-a90e-4efb-a225-36f3e1a15987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:21.504657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbda21-a90e-4efb-a225-36f3e1a15987 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:21.635133 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2409/4827] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:36:21 2022] POST /identity/v3/projects => generated 367 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:36:21.635277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f5be0-12eb-4f83-8a8e-0936d2fc3ee4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:21.656813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f5be0-12eb-4f83-8a8e-0936d2fc3ee4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:21.829671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253388a9-e2f6-41f6-b633-36f625e029d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:21.830434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253388a9-e2f6-41f6-b633-36f625e029d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:21.830765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253388a9-e2f6-41f6-b633-36f625e029d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:21.831098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253388a9-e2f6-41f6-b633-36f625e029d1 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:21.831815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253388a9-e2f6-41f6-b633-36f625e029d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:21.834054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253388a9-e2f6-41f6-b633-36f625e029d1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:21.940816 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2419/4828] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:36:21 2022] POST /identity/v3/users => generated 284 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:36:21.945674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbda21-a90e-4efb-a225-36f3e1a15987 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:21.957497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbda21-a90e-4efb-a225-36f3e1a15987 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:21.967297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208370a-5df9-4cdf-9d2e-3d62c64a671c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:21.968356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208370a-5df9-4cdf-9d2e-3d62c64a671c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:21.968929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208370a-5df9-4cdf-9d2e-3d62c64a671c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:21.969741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208370a-5df9-4cdf-9d2e-3d62c64a671c admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:21.970630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208370a-5df9-4cdf-9d2e-3d62c64a671c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:21.972343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208370a-5df9-4cdf-9d2e-3d62c64a671c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:21.984308 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2410/4829] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:36:21.994892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253388a9-e2f6-41f6-b633-36f625e029d1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:22.007214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253388a9-e2f6-41f6-b633-36f625e029d1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:22.014151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea78025-a968-4327-9528-e121c470a198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:22.015052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea78025-a968-4327-9528-e121c470a198 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:22.015420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea78025-a968-4327-9528-e121c470a198 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:22.015803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea78025-a968-4327-9528-e121c470a198 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:22.016643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea78025-a968-4327-9528-e121c470a198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:22.019051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea78025-a968-4327-9528-e121c470a198 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:22.031804 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2420/4830] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:22.036203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208370a-5df9-4cdf-9d2e-3d62c64a671c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:22.048707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208370a-5df9-4cdf-9d2e-3d62c64a671c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:22.054690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcd5c9-e9a3-4c06-96e0-31ae32f32e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:22.055602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcd5c9-e9a3-4c06-96e0-31ae32f32e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:22.056078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcd5c9-e9a3-4c06-96e0-31ae32f32e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:22.056534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcd5c9-e9a3-4c06-96e0-31ae32f32e48 admin admin] PATH_INFO: `/v3/projects/e5c1f639e63d49488b692601f2f8d08d/users/0b84e482c4e149378c519471788c93ee/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:22.075625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dcd5c9-e9a3-4c06-96e0-31ae32f32e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c1f639e63d49488b692601f2f8d08d, user_id=0b84e482c4e149378c519471788c93ee, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:22.079066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dcd5c9-e9a3-4c06-96e0-31ae32f32e48 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:22.174663 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2411/4831] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:22 2022] PUT /identity/v3/projects/e5c1f639e63d49488b692601f2f8d08d/users/0b84e482c4e149378c519471788c93ee/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:22.185870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd3280-af46-4481-a663-27302cba7384 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:22.186161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd3280-af46-4481-a663-27302cba7384 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:22.186437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd3280-af46-4481-a663-27302cba7384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:22.266386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-73bd3280-af46-4481-a663-27302cba7384 None None] MFA Rules not processed for user `0b84e482c4e149378c519471788c93ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:22.267957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-73bd3280-af46-4481-a663-27302cba7384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:22.434070 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2421/4832] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:22.443386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcd5c9-e9a3-4c06-96e0-31ae32f32e48 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:22.527895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcd5c9-e9a3-4c06-96e0-31ae32f32e48 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:22.534703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0c714-d2ad-4563-bf3b-d3cb323d2c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:22.535971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0c714-d2ad-4563-bf3b-d3cb323d2c15 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:22.535971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0c714-d2ad-4563-bf3b-d3cb323d2c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:22.536187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0c714-d2ad-4563-bf3b-d3cb323d2c15 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:22.537076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0c714-d2ad-4563-bf3b-d3cb323d2c15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:22.538924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0c714-d2ad-4563-bf3b-d3cb323d2c15 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:22.688754 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2412/4833] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:36:22 2022] POST /identity/v3/projects => generated 367 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:22.691588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd3280-af46-4481-a663-27302cba7384 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:22.713086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd3280-af46-4481-a663-27302cba7384 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:22.814023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98194916-5f34-486b-a46c-4d4989c22338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:22.816389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98194916-5f34-486b-a46c-4d4989c22338 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:22.816730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98194916-5f34-486b-a46c-4d4989c22338 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:22.817183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98194916-5f34-486b-a46c-4d4989c22338 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:22.819354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98194916-5f34-486b-a46c-4d4989c22338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:22.822312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98194916-5f34-486b-a46c-4d4989c22338 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:22.934510 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2422/4834] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:36:22 2022] POST /identity/v3/users => generated 290 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:22.938751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0c714-d2ad-4563-bf3b-d3cb323d2c15 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:22.957264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0c714-d2ad-4563-bf3b-d3cb323d2c15 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:22.966701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5c6de-231f-4537-8122-19bdf616d657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:22.968863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5c6de-231f-4537-8122-19bdf616d657 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:22.975502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5c6de-231f-4537-8122-19bdf616d657 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:22.975502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5c6de-231f-4537-8122-19bdf616d657 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:22.975502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5c6de-231f-4537-8122-19bdf616d657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:22.975502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5c6de-231f-4537-8122-19bdf616d657 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:22.990763 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2413/4835] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:22.995156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98194916-5f34-486b-a46c-4d4989c22338 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:23.021699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98194916-5f34-486b-a46c-4d4989c22338 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:23.027918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c8c86-8857-4d90-b8e2-129cd868be63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:23.028895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c8c86-8857-4d90-b8e2-129cd868be63 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:23.029186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c8c86-8857-4d90-b8e2-129cd868be63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:23.029474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c8c86-8857-4d90-b8e2-129cd868be63 admin admin] PATH_INFO: `/v3/projects/39195c3b950741eaa1695111537df3b4/users/88a2eff3975d45a4b5c35c467850d3d1/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:23.048105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c8c86-8857-4d90-b8e2-129cd868be63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39195c3b950741eaa1695111537df3b4, user_id=88a2eff3975d45a4b5c35c467850d3d1, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:23.051125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c8c86-8857-4d90-b8e2-129cd868be63 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:23.104657 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2423/4836] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:22 2022] PUT /identity/v3/projects/39195c3b950741eaa1695111537df3b4/users/88a2eff3975d45a4b5c35c467850d3d1/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:23.108682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5c6de-231f-4537-8122-19bdf616d657 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:23.120809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5c6de-231f-4537-8122-19bdf616d657 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:23.192080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfbc46-2d56-4d94-824b-fa1d2af1e8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:23.192789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfbc46-2d56-4d94-824b-fa1d2af1e8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:23.193247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfbc46-2d56-4d94-824b-fa1d2af1e8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:23.193529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfbc46-2d56-4d94-824b-fa1d2af1e8a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:23.194259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfbc46-2d56-4d94-824b-fa1d2af1e8a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:23.195884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfbc46-2d56-4d94-824b-fa1d2af1e8a0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:23.206995 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2414/4837] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:23.211219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c8c86-8857-4d90-b8e2-129cd868be63 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:23.221991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c8c86-8857-4d90-b8e2-129cd868be63 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:23.226854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5348fd-0f1f-4044-b348-14372225c421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:23.227928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5348fd-0f1f-4044-b348-14372225c421 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:23.228646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5348fd-0f1f-4044-b348-14372225c421 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:23.228646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5348fd-0f1f-4044-b348-14372225c421 admin admin] PATH_INFO: `/v3/projects/39195c3b950741eaa1695111537df3b4/users/88a2eff3975d45a4b5c35c467850d3d1/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:23.230843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5348fd-0f1f-4044-b348-14372225c421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39195c3b950741eaa1695111537df3b4, user_id=88a2eff3975d45a4b5c35c467850d3d1, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:23.233383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5348fd-0f1f-4044-b348-14372225c421 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:23.252467 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2424/4838] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:23 2022] PUT /identity/v3/projects/39195c3b950741eaa1695111537df3b4/users/88a2eff3975d45a4b5c35c467850d3d1/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:23.263503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a0ac3-ff68-45da-9577-90fa37a9047b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:23.263802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a0ac3-ff68-45da-9577-90fa37a9047b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:23.264072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a0ac3-ff68-45da-9577-90fa37a9047b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:23.296406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-150a0ac3-ff68-45da-9577-90fa37a9047b None None] MFA Rules not processed for user `88a2eff3975d45a4b5c35c467850d3d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:23.298664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-150a0ac3-ff68-45da-9577-90fa37a9047b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:23.385591 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2415/4839] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:23 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:23.387126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5348fd-0f1f-4044-b348-14372225c421 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:23.400568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5348fd-0f1f-4044-b348-14372225c421 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:23.406738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129b36a-390e-407e-87a9-fc25989188cd tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a2eff3975d45a4b5c35c467850d3d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39195c3b950741eaa1695111537df3b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:23.407410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129b36a-390e-407e-87a9-fc25989188cd tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:23.407691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129b36a-390e-407e-87a9-fc25989188cd tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:23.408822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129b36a-390e-407e-87a9-fc25989188cd tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:23.409487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129b36a-390e-407e-87a9-fc25989188cd tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:23.411082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129b36a-390e-407e-87a9-fc25989188cd tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:23.472510 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2425/4840] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:36:23 2022] POST /identity/v3/domains => generated 277 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:23.476300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a0ac3-ff68-45da-9577-90fa37a9047b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:23.487052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a0ac3-ff68-45da-9577-90fa37a9047b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:23.548317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9726eec-8096-407b-80dd-363bf5cf9d64 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a2eff3975d45a4b5c35c467850d3d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39195c3b950741eaa1695111537df3b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:23.549091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9726eec-8096-407b-80dd-363bf5cf9d64 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:23.549360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9726eec-8096-407b-80dd-363bf5cf9d64 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:23.549642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9726eec-8096-407b-80dd-363bf5cf9d64 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:23.550382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9726eec-8096-407b-80dd-363bf5cf9d64 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:23.552640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9726eec-8096-407b-80dd-363bf5cf9d64 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:23.669224 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2416/4841] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:36:23 2022] POST /identity/v3/users => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:36:23.671269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129b36a-390e-407e-87a9-fc25989188cd tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:23.684396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129b36a-390e-407e-87a9-fc25989188cd tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:23.691424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d82b1f-b549-4ef2-bad5-ec32fcc3a739 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a2eff3975d45a4b5c35c467850d3d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39195c3b950741eaa1695111537df3b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:23.692257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d82b1f-b549-4ef2-bad5-ec32fcc3a739 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:23.692644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d82b1f-b549-4ef2-bad5-ec32fcc3a739 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:23.693081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d82b1f-b549-4ef2-bad5-ec32fcc3a739 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:23.695735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d82b1f-b549-4ef2-bad5-ec32fcc3a739 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:23.697717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d82b1f-b549-4ef2-bad5-ec32fcc3a739 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:23.834731 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2426/4842] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:36:23 2022] POST /identity/v3/users => generated 322 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:23.835752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9726eec-8096-407b-80dd-363bf5cf9d64 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:23.849797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9726eec-8096-407b-80dd-363bf5cf9d64 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:23.857158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d86b80-f410-4221-b660-edf34e613b30 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a2eff3975d45a4b5c35c467850d3d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39195c3b950741eaa1695111537df3b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:23.858364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d86b80-f410-4221-b660-edf34e613b30 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:23.859972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d86b80-f410-4221-b660-edf34e613b30 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:23.859972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d86b80-f410-4221-b660-edf34e613b30 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] PATH_INFO: `/v3/users/dc4938b12e954ba2abfbb938d5bb2284` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:23.887702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d86b80-f410-4221-b660-edf34e613b30 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorizing `identity:get_user(user_id=dc4938b12e954ba2abfbb938d5bb2284)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:23.896544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d86b80-f410-4221-b660-edf34e613b30 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:23.900641 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2417/4843] 10.222.0.16 () {58 vars in 1220 bytes} [Mon May 2 10:36:23 2022] GET /identity/v3/users/dc4938b12e954ba2abfbb938d5bb2284 => generated 346 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:23.905310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d82b1f-b549-4ef2-bad5-ec32fcc3a739 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:23.929477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d82b1f-b549-4ef2-bad5-ec32fcc3a739 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:23.945604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb657c-4c90-4d82-b57f-818fd6f8c8fd tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a2eff3975d45a4b5c35c467850d3d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39195c3b950741eaa1695111537df3b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:23.945604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb657c-4c90-4d82-b57f-818fd6f8c8fd tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:23.945604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb657c-4c90-4d82-b57f-818fd6f8c8fd tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:23.945989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb657c-4c90-4d82-b57f-818fd6f8c8fd tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:23.946638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb657c-4c90-4d82-b57f-818fd6f8c8fd tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Adding query filter params (domain_id=260a55a51fcf4bb8909932528cdb2667) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:36:23.947089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb657c-4c90-4d82-b57f-818fd6f8c8fd tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:23.948431 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-f3bb657c-4c90-4d82-b57f-818fd6f8c8fd tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:23.948431 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:23.948431 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:23.951039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb657c-4c90-4d82-b57f-818fd6f8c8fd tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:23.972804 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2427/4844] 10.222.0.16 () {58 vars in 1206 bytes} [Mon May 2 10:36:23 2022] GET /identity/v3/users?domain_id=260a55a51fcf4bb8909932528cdb2667 => generated 483 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:23.974095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d86b80-f410-4221-b660-edf34e613b30 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:23.985717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d86b80-f410-4221-b660-edf34e613b30 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:23.990338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74c3eb-9931-4094-834d-4984ef6e8374 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a2eff3975d45a4b5c35c467850d3d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39195c3b950741eaa1695111537df3b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:23.991005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74c3eb-9931-4094-834d-4984ef6e8374 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:23.991292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74c3eb-9931-4094-834d-4984ef6e8374 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:23.991575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74c3eb-9931-4094-834d-4984ef6e8374 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:23.992340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74c3eb-9931-4094-834d-4984ef6e8374 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:23.993395 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-2a74c3eb-9931-4094-834d-4984ef6e8374 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:23.993395 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:23.993395 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:23.994543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74c3eb-9931-4094-834d-4984ef6e8374 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:24.038304 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2418/4845] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:23 2022] GET /identity/v3/users => generated 9453 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:24.044010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb657c-4c90-4d82-b57f-818fd6f8c8fd tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:24.054003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb657c-4c90-4d82-b57f-818fd6f8c8fd tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:24.058729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f180d7-f1e5-478a-a43d-3814328196e9 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a2eff3975d45a4b5c35c467850d3d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39195c3b950741eaa1695111537df3b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:24.059539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f180d7-f1e5-478a-a43d-3814328196e9 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:24.059775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f180d7-f1e5-478a-a43d-3814328196e9 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:24.060061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f180d7-f1e5-478a-a43d-3814328196e9 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:24.060916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f180d7-f1e5-478a-a43d-3814328196e9 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Adding query filter params (name=tempest-test_user-288755067) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:36:24.061234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f180d7-f1e5-478a-a43d-3814328196e9 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:24.063148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f180d7-f1e5-478a-a43d-3814328196e9 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:24.084207 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2428/4846] 10.222.0.16 () {58 vars in 1186 bytes} [Mon May 2 10:36:24 2022] GET /identity/v3/users?name=tempest-test_user-288755067 => generated 473 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:36:24.088749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74c3eb-9931-4094-834d-4984ef6e8374 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:24.113962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74c3eb-9931-4094-834d-4984ef6e8374 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:24.119133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6f2ca-3101-480e-b02b-5760dfbb6f88 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a2eff3975d45a4b5c35c467850d3d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39195c3b950741eaa1695111537df3b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:24.119896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6f2ca-3101-480e-b02b-5760dfbb6f88 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:24.120253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6f2ca-3101-480e-b02b-5760dfbb6f88 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:24.120704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6f2ca-3101-480e-b02b-5760dfbb6f88 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:24.121655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6f2ca-3101-480e-b02b-5760dfbb6f88 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:36:24.122051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6f2ca-3101-480e-b02b-5760dfbb6f88 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:24.123988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6f2ca-3101-480e-b02b-5760dfbb6f88 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:24.145006 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2419/4847] 10.222.0.16 () {58 vars in 1148 bytes} [Mon May 2 10:36:24 2022] GET /identity/v3/users?enabled=False => generated 430 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:24.150315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f180d7-f1e5-478a-a43d-3814328196e9 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:24.160866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f180d7-f1e5-478a-a43d-3814328196e9 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:24.165846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac3433-245b-4b88-bdb2-4e659852ca80 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a2eff3975d45a4b5c35c467850d3d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39195c3b950741eaa1695111537df3b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:24.166837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac3433-245b-4b88-bdb2-4e659852ca80 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:24.167318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac3433-245b-4b88-bdb2-4e659852ca80 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:24.167783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac3433-245b-4b88-bdb2-4e659852ca80 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] PATH_INFO: `/v3/users/1ea60615a85a40a2b4b2e77d3b89ed18` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:24.186442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac3433-245b-4b88-bdb2-4e659852ca80 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1ea60615a85a40a2b4b2e77d3b89ed18)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:24.186442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac3433-245b-4b88-bdb2-4e659852ca80 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:24.299116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-33ac3433-245b-4b88-bdb2-4e659852ca80 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea60615a85a40a2b4b2e77d3b89ed18'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:24.315717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-33ac3433-245b-4b88-bdb2-4e659852ca80 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea60615a85a40a2b4b2e77d3b89ed18'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:24.316685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-33ac3433-245b-4b88-bdb2-4e659852ca80 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea60615a85a40a2b4b2e77d3b89ed18'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:24.330020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-33ac3433-245b-4b88-bdb2-4e659852ca80 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea60615a85a40a2b4b2e77d3b89ed18'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:24.442711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-33ac3433-245b-4b88-bdb2-4e659852ca80 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea60615a85a40a2b4b2e77d3b89ed18'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:24.450125 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2429/4848] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:24 2022] DELETE /identity/v3/users/1ea60615a85a40a2b4b2e77d3b89ed18 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:24.455480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6f2ca-3101-480e-b02b-5760dfbb6f88 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:24.457265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3cf6f2ca-3101-480e-b02b-5760dfbb6f88 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:24.473358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6f2ca-3101-480e-b02b-5760dfbb6f88 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:24.540425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f435bd-6f25-4e09-a4ce-65c58a2dc9f6 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a2eff3975d45a4b5c35c467850d3d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39195c3b950741eaa1695111537df3b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:24.540425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f435bd-6f25-4e09-a4ce-65c58a2dc9f6 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:24.540425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f435bd-6f25-4e09-a4ce-65c58a2dc9f6 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:24.540822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f435bd-6f25-4e09-a4ce-65c58a2dc9f6 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] PATH_INFO: `/v3/users/dc4938b12e954ba2abfbb938d5bb2284` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:24.540822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f435bd-6f25-4e09-a4ce-65c58a2dc9f6 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorizing `identity:delete_user(user_id=dc4938b12e954ba2abfbb938d5bb2284)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:24.541925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f435bd-6f25-4e09-a4ce-65c58a2dc9f6 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:24.683620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3f435bd-6f25-4e09-a4ce-65c58a2dc9f6 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc4938b12e954ba2abfbb938d5bb2284'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:24.696784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3f435bd-6f25-4e09-a4ce-65c58a2dc9f6 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc4938b12e954ba2abfbb938d5bb2284'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:24.697727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3f435bd-6f25-4e09-a4ce-65c58a2dc9f6 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc4938b12e954ba2abfbb938d5bb2284'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:24.713906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3f435bd-6f25-4e09-a4ce-65c58a2dc9f6 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc4938b12e954ba2abfbb938d5bb2284'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:24.773439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac3433-245b-4b88-bdb2-4e659852ca80 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:24.775146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-33ac3433-245b-4b88-bdb2-4e659852ca80 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:24.802278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3f435bd-6f25-4e09-a4ce-65c58a2dc9f6 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc4938b12e954ba2abfbb938d5bb2284'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:24.809750 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2420/4849] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:24 2022] DELETE /identity/v3/users/dc4938b12e954ba2abfbb938d5bb2284 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:24.813998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f435bd-6f25-4e09-a4ce-65c58a2dc9f6 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:24.815673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d3f435bd-6f25-4e09-a4ce-65c58a2dc9f6 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:24.842319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac3433-245b-4b88-bdb2-4e659852ca80 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:24.884363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f435bd-6f25-4e09-a4ce-65c58a2dc9f6 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:24.889716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77529a1e-757f-4150-9725-3944941c3517 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a2eff3975d45a4b5c35c467850d3d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39195c3b950741eaa1695111537df3b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:24.890109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77529a1e-757f-4150-9725-3944941c3517 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:24.890395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77529a1e-757f-4150-9725-3944941c3517 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:24.890718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77529a1e-757f-4150-9725-3944941c3517 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] PATH_INFO: `/v3/domains/260a55a51fcf4bb8909932528cdb2667` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:24.892055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77529a1e-757f-4150-9725-3944941c3517 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=260a55a51fcf4bb8909932528cdb2667)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:24.893801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77529a1e-757f-4150-9725-3944941c3517 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:24.899232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052385f-43f7-4cd4-87a3-53bb15a7dd9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:24.899976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052385f-43f7-4cd4-87a3-53bb15a7dd9f service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:24.900544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052385f-43f7-4cd4-87a3-53bb15a7dd9f service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:24.900931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052385f-43f7-4cd4-87a3-53bb15a7dd9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:24.902876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d052385f-43f7-4cd4-87a3-53bb15a7dd9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:24.926207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-77529a1e-757f-4150-9725-3944941c3517 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '260a55a51fcf4bb8909932528cdb2667'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:24.927019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-77529a1e-757f-4150-9725-3944941c3517 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '260a55a51fcf4bb8909932528cdb2667'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:25.006451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052385f-43f7-4cd4-87a3-53bb15a7dd9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:25.007978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052385f-43f7-4cd4-87a3-53bb15a7dd9f service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:25.023185 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2430/4850] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:36:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:36:25.099992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-77529a1e-757f-4150-9725-3944941c3517 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '260a55a51fcf4bb8909932528cdb2667'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:25.101400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-77529a1e-757f-4150-9725-3944941c3517 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '260a55a51fcf4bb8909932528cdb2667'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:25.108076 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2421/4851] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:36:24 2022] PATCH /identity/v3/domains/260a55a51fcf4bb8909932528cdb2667 => generated 278 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:36:25.112545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052385f-43f7-4cd4-87a3-53bb15a7dd9f service cinder] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:25.127913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052385f-43f7-4cd4-87a3-53bb15a7dd9f service cinder] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:25.206548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459db4d6-72fd-422e-84b5-5b90bc10b306 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88a2eff3975d45a4b5c35c467850d3d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39195c3b950741eaa1695111537df3b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:25.207575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459db4d6-72fd-422e-84b5-5b90bc10b306 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:25.207867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459db4d6-72fd-422e-84b5-5b90bc10b306 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:25.208146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459db4d6-72fd-422e-84b5-5b90bc10b306 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] PATH_INFO: `/v3/domains/260a55a51fcf4bb8909932528cdb2667` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:25.219551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459db4d6-72fd-422e-84b5-5b90bc10b306 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=260a55a51fcf4bb8909932528cdb2667)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:25.221231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459db4d6-72fd-422e-84b5-5b90bc10b306 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:25.244804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-459db4d6-72fd-422e-84b5-5b90bc10b306 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '260a55a51fcf4bb8909932528cdb2667'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:25.248641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-459db4d6-72fd-422e-84b5-5b90bc10b306 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '260a55a51fcf4bb8909932528cdb2667'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:25.384653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-459db4d6-72fd-422e-84b5-5b90bc10b306 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '260a55a51fcf4bb8909932528cdb2667', 'request_id': 'req-459db4d6-72fd-422e-84b5-5b90bc10b306'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:25.499396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-459db4d6-72fd-422e-84b5-5b90bc10b306 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '260a55a51fcf4bb8909932528cdb2667', 'request_id': 'req-459db4d6-72fd-422e-84b5-5b90bc10b306'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:25.509715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-459db4d6-72fd-422e-84b5-5b90bc10b306 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '260a55a51fcf4bb8909932528cdb2667', 'request_id': 'req-459db4d6-72fd-422e-84b5-5b90bc10b306'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:25.524282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-459db4d6-72fd-422e-84b5-5b90bc10b306 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] The token cache is being invalidate because project 260a55a51fcf4bb8909932528cdb2667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:25.524894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-459db4d6-72fd-422e-84b5-5b90bc10b306 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:25.525880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-459db4d6-72fd-422e-84b5-5b90bc10b306 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:25.534473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-459db4d6-72fd-422e-84b5-5b90bc10b306 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '260a55a51fcf4bb8909932528cdb2667', 'request_id': 'req-459db4d6-72fd-422e-84b5-5b90bc10b306'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:25.535476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-459db4d6-72fd-422e-84b5-5b90bc10b306 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '260a55a51fcf4bb8909932528cdb2667', 'request_id': 'req-459db4d6-72fd-422e-84b5-5b90bc10b306'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:25.550463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-459db4d6-72fd-422e-84b5-5b90bc10b306 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '260a55a51fcf4bb8909932528cdb2667', 'request_id': 'req-459db4d6-72fd-422e-84b5-5b90bc10b306'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:25.565468 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2431/4852] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:36:25 2022] DELETE /identity/v3/domains/260a55a51fcf4bb8909932528cdb2667 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:25.569797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77529a1e-757f-4150-9725-3944941c3517 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:25.576716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-77529a1e-757f-4150-9725-3944941c3517 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:25.679237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77529a1e-757f-4150-9725-3944941c3517 tempest-UsersV3TestJSON-1766940726 tempest-UsersV3TestJSON-1766940726-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:25.747487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9c953-6dd8-4b07-8734-02492513b327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:25.748555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9c953-6dd8-4b07-8734-02492513b327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:25.748891 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9c953-6dd8-4b07-8734-02492513b327 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:25.749158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9c953-6dd8-4b07-8734-02492513b327 admin admin] PATH_INFO: `/v3/users/0b84e482c4e149378c519471788c93ee` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:25.751318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9c953-6dd8-4b07-8734-02492513b327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b84e482c4e149378c519471788c93ee)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:25.753429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9c953-6dd8-4b07-8734-02492513b327 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:25.973683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1de9c953-6dd8-4b07-8734-02492513b327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b84e482c4e149378c519471788c93ee'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:25.996873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1de9c953-6dd8-4b07-8734-02492513b327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b84e482c4e149378c519471788c93ee'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:25.998505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1de9c953-6dd8-4b07-8734-02492513b327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b84e482c4e149378c519471788c93ee'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:26.007014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1de9c953-6dd8-4b07-8734-02492513b327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b84e482c4e149378c519471788c93ee'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:26.113659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1de9c953-6dd8-4b07-8734-02492513b327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b84e482c4e149378c519471788c93ee'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:26.121753 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2422/4853] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:25 2022] DELETE /identity/v3/users/0b84e482c4e149378c519471788c93ee => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:26.126792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326317c1-1bdf-4b31-b22c-64fc8eaa0fe7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:26.127278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326317c1-1bdf-4b31-b22c-64fc8eaa0fe7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:26.127506 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326317c1-1bdf-4b31-b22c-64fc8eaa0fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:26.146877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-326317c1-1bdf-4b31-b22c-64fc8eaa0fe7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:26.148110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-326317c1-1bdf-4b31-b22c-64fc8eaa0fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:26.209841 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2432/4854] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:26.221386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9c953-6dd8-4b07-8734-02492513b327 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:26.221710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1de9c953-6dd8-4b07-8734-02492513b327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:26.290698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9c953-6dd8-4b07-8734-02492513b327 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:26.310937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40416b9e-9c61-4aee-a423-4e7cbecb7556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:26.312082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40416b9e-9c61-4aee-a423-4e7cbecb7556 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:26.312577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40416b9e-9c61-4aee-a423-4e7cbecb7556 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:26.313075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40416b9e-9c61-4aee-a423-4e7cbecb7556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:26.330187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40416b9e-9c61-4aee-a423-4e7cbecb7556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:26.334245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40416b9e-9c61-4aee-a423-4e7cbecb7556 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:26.350773 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2423/4855] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:36:27.193696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326317c1-1bdf-4b31-b22c-64fc8eaa0fe7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:27.195800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-326317c1-1bdf-4b31-b22c-64fc8eaa0fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:27.216209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326317c1-1bdf-4b31-b22c-64fc8eaa0fe7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:27.222055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ad4de-b412-4e8c-ae5e-c3b30753eb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:27.225014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ad4de-b412-4e8c-ae5e-c3b30753eb84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:27.225014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ad4de-b412-4e8c-ae5e-c3b30753eb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:27.225014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ad4de-b412-4e8c-ae5e-c3b30753eb84 admin admin] PATH_INFO: `/v3/projects/e5c1f639e63d49488b692601f2f8d08d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:27.225014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ad4de-b412-4e8c-ae5e-c3b30753eb84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5c1f639e63d49488b692601f2f8d08d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:27.226757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ad4de-b412-4e8c-ae5e-c3b30753eb84 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:27.352702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d37ad4de-b412-4e8c-ae5e-c3b30753eb84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5c1f639e63d49488b692601f2f8d08d', 'request_id': 'req-d37ad4de-b412-4e8c-ae5e-c3b30753eb84'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:27.430475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d37ad4de-b412-4e8c-ae5e-c3b30753eb84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5c1f639e63d49488b692601f2f8d08d', 'request_id': 'req-d37ad4de-b412-4e8c-ae5e-c3b30753eb84'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:27.438549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d37ad4de-b412-4e8c-ae5e-c3b30753eb84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5c1f639e63d49488b692601f2f8d08d', 'request_id': 'req-d37ad4de-b412-4e8c-ae5e-c3b30753eb84'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:27.449045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d37ad4de-b412-4e8c-ae5e-c3b30753eb84 admin admin] The token cache is being invalidate because project e5c1f639e63d49488b692601f2f8d08d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:27.449420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d37ad4de-b412-4e8c-ae5e-c3b30753eb84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:27.450173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d37ad4de-b412-4e8c-ae5e-c3b30753eb84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:27.451834 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2433/4856] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:36:27 2022] DELETE /identity/v3/projects/e5c1f639e63d49488b692601f2f8d08d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:27.456335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40416b9e-9c61-4aee-a423-4e7cbecb7556 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:27.466262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40416b9e-9c61-4aee-a423-4e7cbecb7556 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:27.540300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8ff32-1307-43ce-af71-db9a547123fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:27.541322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8ff32-1307-43ce-af71-db9a547123fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:27.541620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8ff32-1307-43ce-af71-db9a547123fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:27.541949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8ff32-1307-43ce-af71-db9a547123fa admin admin] PATH_INFO: `/v3/users/88a2eff3975d45a4b5c35c467850d3d1` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:27.543240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8ff32-1307-43ce-af71-db9a547123fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=88a2eff3975d45a4b5c35c467850d3d1)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:27.545304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8ff32-1307-43ce-af71-db9a547123fa admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:27.839830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-acc8ff32-1307-43ce-af71-db9a547123fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88a2eff3975d45a4b5c35c467850d3d1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:27.853103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-acc8ff32-1307-43ce-af71-db9a547123fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88a2eff3975d45a4b5c35c467850d3d1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:27.853845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-acc8ff32-1307-43ce-af71-db9a547123fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88a2eff3975d45a4b5c35c467850d3d1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:27.861199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-acc8ff32-1307-43ce-af71-db9a547123fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88a2eff3975d45a4b5c35c467850d3d1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:27.931159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-acc8ff32-1307-43ce-af71-db9a547123fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88a2eff3975d45a4b5c35c467850d3d1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:27.941243 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2424/4857] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:27 2022] DELETE /identity/v3/users/88a2eff3975d45a4b5c35c467850d3d1 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:28.724835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ad4de-b412-4e8c-ae5e-c3b30753eb84 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:28.726796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d37ad4de-b412-4e8c-ae5e-c3b30753eb84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:28.743752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ad4de-b412-4e8c-ae5e-c3b30753eb84 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:28.819465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233dbec-699c-42ee-a814-ec876f50d18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:28.820665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233dbec-699c-42ee-a814-ec876f50d18d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:28.820945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233dbec-699c-42ee-a814-ec876f50d18d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:28.821228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233dbec-699c-42ee-a814-ec876f50d18d admin admin] PATH_INFO: `/v3/projects/39195c3b950741eaa1695111537df3b4` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:28.823816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233dbec-699c-42ee-a814-ec876f50d18d admin admin] RBAC: Authorizing `identity:delete_project(project_id=39195c3b950741eaa1695111537df3b4)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:28.824875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233dbec-699c-42ee-a814-ec876f50d18d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:28.959896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9233dbec-699c-42ee-a814-ec876f50d18d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39195c3b950741eaa1695111537df3b4', 'request_id': 'req-9233dbec-699c-42ee-a814-ec876f50d18d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:29.035832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9233dbec-699c-42ee-a814-ec876f50d18d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39195c3b950741eaa1695111537df3b4', 'request_id': 'req-9233dbec-699c-42ee-a814-ec876f50d18d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:29.045866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9233dbec-699c-42ee-a814-ec876f50d18d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39195c3b950741eaa1695111537df3b4', 'request_id': 'req-9233dbec-699c-42ee-a814-ec876f50d18d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:29.062701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9233dbec-699c-42ee-a814-ec876f50d18d admin admin] The token cache is being invalidate because project 39195c3b950741eaa1695111537df3b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:29.063363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9233dbec-699c-42ee-a814-ec876f50d18d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:29.065148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9233dbec-699c-42ee-a814-ec876f50d18d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:29.067624 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2434/4858] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:36:28 2022] DELETE /identity/v3/projects/39195c3b950741eaa1695111537df3b4 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:29.072356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa4e9f-f254-4025-b5ad-d13327ef1f39 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:29.072965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa4e9f-f254-4025-b5ad-d13327ef1f39 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:29.073073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa4e9f-f254-4025-b5ad-d13327ef1f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:29.136007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-30aa4e9f-f254-4025-b5ad-d13327ef1f39 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:29.136502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-30aa4e9f-f254-4025-b5ad-d13327ef1f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:29.215763 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2425/4859] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:29.223314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f1cfd-2b14-4894-963c-13fb294537d4 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:29.226711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f1cfd-2b14-4894-963c-13fb294537d4 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:29.226711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f1cfd-2b14-4894-963c-13fb294537d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:29.248445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2d3f1cfd-2b14-4894-963c-13fb294537d4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:29.251134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2d3f1cfd-2b14-4894-963c-13fb294537d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:29.264406 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2435/4860] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:29.264946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa4e9f-f254-4025-b5ad-d13327ef1f39 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:29.285374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa4e9f-f254-4025-b5ad-d13327ef1f39 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:29.302021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66990d-434a-4895-8b88-e3f6e0c9b37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:29.303085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66990d-434a-4895-8b88-e3f6e0c9b37d admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:29.303677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66990d-434a-4895-8b88-e3f6e0c9b37d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:29.303961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66990d-434a-4895-8b88-e3f6e0c9b37d admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:29.305273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66990d-434a-4895-8b88-e3f6e0c9b37d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:36:29.305926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66990d-434a-4895-8b88-e3f6e0c9b37d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:29.307919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66990d-434a-4895-8b88-e3f6e0c9b37d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:29.324371 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2426/4861] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:29.328810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f1cfd-2b14-4894-963c-13fb294537d4 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:29.339107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f1cfd-2b14-4894-963c-13fb294537d4 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:29.344420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c81cd-35c5-4aa7-a542-ac8fd6802862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:29.345928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c81cd-35c5-4aa7-a542-ac8fd6802862 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:29.346461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c81cd-35c5-4aa7-a542-ac8fd6802862 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:29.346811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c81cd-35c5-4aa7-a542-ac8fd6802862 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:29.348477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c81cd-35c5-4aa7-a542-ac8fd6802862 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:29.350940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c81cd-35c5-4aa7-a542-ac8fd6802862 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:29.456870 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2436/4862] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:36:29 2022] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:29.460987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66990d-434a-4895-8b88-e3f6e0c9b37d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:29.475323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66990d-434a-4895-8b88-e3f6e0c9b37d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:29.581924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92962f2b-68b5-4f54-b64e-ba8758e03336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:29.582698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92962f2b-68b5-4f54-b64e-ba8758e03336 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:29.582993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92962f2b-68b5-4f54-b64e-ba8758e03336 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:29.583454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92962f2b-68b5-4f54-b64e-ba8758e03336 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:29.584164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92962f2b-68b5-4f54-b64e-ba8758e03336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:29.586412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92962f2b-68b5-4f54-b64e-ba8758e03336 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:29.689160 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2427/4863] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:36:29 2022] POST /identity/v3/users => generated 284 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:29.693517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c81cd-35c5-4aa7-a542-ac8fd6802862 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:29.704461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c81cd-35c5-4aa7-a542-ac8fd6802862 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:29.709675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200873cf-75fb-48d2-8941-8eb5ffdcdb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:29.710358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200873cf-75fb-48d2-8941-8eb5ffdcdb9b admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:29.710642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200873cf-75fb-48d2-8941-8eb5ffdcdb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:29.710920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200873cf-75fb-48d2-8941-8eb5ffdcdb9b admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:29.711711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200873cf-75fb-48d2-8941-8eb5ffdcdb9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:29.713365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200873cf-75fb-48d2-8941-8eb5ffdcdb9b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:29.727585 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2437/4864] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:29.731234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92962f2b-68b5-4f54-b64e-ba8758e03336 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:29.743021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92962f2b-68b5-4f54-b64e-ba8758e03336 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:29.747701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07c211-9280-4103-9e22-7becc3b0ffa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:29.748513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07c211-9280-4103-9e22-7becc3b0ffa2 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:29.748849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07c211-9280-4103-9e22-7becc3b0ffa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:29.749132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07c211-9280-4103-9e22-7becc3b0ffa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:29.749861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07c211-9280-4103-9e22-7becc3b0ffa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:29.751722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07c211-9280-4103-9e22-7becc3b0ffa2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:29.765340 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2428/4865] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:29.779390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200873cf-75fb-48d2-8941-8eb5ffdcdb9b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:29.792148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200873cf-75fb-48d2-8941-8eb5ffdcdb9b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:29.798203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720c5ad-3d08-4d53-b723-edafae855659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:29.804652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720c5ad-3d08-4d53-b723-edafae855659 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:29.804652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720c5ad-3d08-4d53-b723-edafae855659 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:29.804652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720c5ad-3d08-4d53-b723-edafae855659 admin admin] PATH_INFO: `/v3/projects/1376e56d351345ed8992c9b6ead2220b/users/d0178a5287a04d1c92c0ae4f7677cdd7/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:29.815918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720c5ad-3d08-4d53-b723-edafae855659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1376e56d351345ed8992c9b6ead2220b, user_id=d0178a5287a04d1c92c0ae4f7677cdd7, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:29.819086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720c5ad-3d08-4d53-b723-edafae855659 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:29.932318 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2438/4866] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:29 2022] PUT /identity/v3/projects/1376e56d351345ed8992c9b6ead2220b/users/d0178a5287a04d1c92c0ae4f7677cdd7/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:29.946142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2054d-5ba8-40a4-a468-12426e2fbe1f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:29.946886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2054d-5ba8-40a4-a468-12426e2fbe1f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:29.947352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2054d-5ba8-40a4-a468-12426e2fbe1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:29.991319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-cda2054d-5ba8-40a4-a468-12426e2fbe1f None None] MFA Rules not processed for user `d0178a5287a04d1c92c0ae4f7677cdd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:29.993319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cda2054d-5ba8-40a4-a468-12426e2fbe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:30.077185 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2429/4867] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:36:30.082226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720c5ad-3d08-4d53-b723-edafae855659 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:30.153362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720c5ad-3d08-4d53-b723-edafae855659 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:30.158942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83827330-19ac-47b9-ba44-b8e390747d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:30.159610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83827330-19ac-47b9-ba44-b8e390747d80 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:30.159902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83827330-19ac-47b9-ba44-b8e390747d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:30.160188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83827330-19ac-47b9-ba44-b8e390747d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:30.160925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83827330-19ac-47b9-ba44-b8e390747d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:30.162888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83827330-19ac-47b9-ba44-b8e390747d80 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:30.228321 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2439/4868] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:36:30 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:30.232444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2054d-5ba8-40a4-a468-12426e2fbe1f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:30.243483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2054d-5ba8-40a4-a468-12426e2fbe1f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:30.311337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d2952-388b-4ca6-8b19-23a58e051bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:30.312266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d2952-388b-4ca6-8b19-23a58e051bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:30.312990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d2952-388b-4ca6-8b19-23a58e051bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:30.313784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d2952-388b-4ca6-8b19-23a58e051bf7 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:30.314936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d2952-388b-4ca6-8b19-23a58e051bf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:30.317219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d2952-388b-4ca6-8b19-23a58e051bf7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:30.436622 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2430/4869] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:36:30 2022] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:30.438362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83827330-19ac-47b9-ba44-b8e390747d80 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:30.452337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83827330-19ac-47b9-ba44-b8e390747d80 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:30.458426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1bcc4-3b72-4cd1-bef3-55d5769f2512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:30.459392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1bcc4-3b72-4cd1-bef3-55d5769f2512 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:30.459839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1bcc4-3b72-4cd1-bef3-55d5769f2512 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:30.460273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1bcc4-3b72-4cd1-bef3-55d5769f2512 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:30.461474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1bcc4-3b72-4cd1-bef3-55d5769f2512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:30.463573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1bcc4-3b72-4cd1-bef3-55d5769f2512 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:30.481829 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2440/4870] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:30.483456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d2952-388b-4ca6-8b19-23a58e051bf7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:30.494914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d2952-388b-4ca6-8b19-23a58e051bf7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:30.500990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038898a7-2fdc-47fa-bcf6-a1c3399d2db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:30.502064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038898a7-2fdc-47fa-bcf6-a1c3399d2db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:30.502266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038898a7-2fdc-47fa-bcf6-a1c3399d2db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:30.502724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038898a7-2fdc-47fa-bcf6-a1c3399d2db8 admin admin] PATH_INFO: `/v3/projects/853886e208834ca8ac767f3cdb4078a4/users/a7274437e2094ccf98150ba324605dd6/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:30.520160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038898a7-2fdc-47fa-bcf6-a1c3399d2db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=853886e208834ca8ac767f3cdb4078a4, user_id=a7274437e2094ccf98150ba324605dd6, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:30.523746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038898a7-2fdc-47fa-bcf6-a1c3399d2db8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:30.646539 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2431/4871] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:30 2022] PUT /identity/v3/projects/853886e208834ca8ac767f3cdb4078a4/users/a7274437e2094ccf98150ba324605dd6/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:30.647848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1bcc4-3b72-4cd1-bef3-55d5769f2512 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:30.686306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1bcc4-3b72-4cd1-bef3-55d5769f2512 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:30.815545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e5e95-43f1-4691-b2b3-1f3e6a343716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:30.816436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e5e95-43f1-4691-b2b3-1f3e6a343716 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:30.816768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e5e95-43f1-4691-b2b3-1f3e6a343716 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:30.817054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e5e95-43f1-4691-b2b3-1f3e6a343716 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:30.817826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e5e95-43f1-4691-b2b3-1f3e6a343716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:30.819644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e5e95-43f1-4691-b2b3-1f3e6a343716 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:30.832013 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2441/4872] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:30.836382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038898a7-2fdc-47fa-bcf6-a1c3399d2db8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:30.851291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038898a7-2fdc-47fa-bcf6-a1c3399d2db8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:30.868986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b0e3b-f6be-40b5-befa-ff47bfd71170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:30.870188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b0e3b-f6be-40b5-befa-ff47bfd71170 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:30.870485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b0e3b-f6be-40b5-befa-ff47bfd71170 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:30.870775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b0e3b-f6be-40b5-befa-ff47bfd71170 admin admin] PATH_INFO: `/v3/projects/853886e208834ca8ac767f3cdb4078a4/users/a7274437e2094ccf98150ba324605dd6/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:30.873367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b0e3b-f6be-40b5-befa-ff47bfd71170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=853886e208834ca8ac767f3cdb4078a4, user_id=a7274437e2094ccf98150ba324605dd6, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:30.878164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b0e3b-f6be-40b5-befa-ff47bfd71170 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:30.889275 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2432/4873] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:30 2022] PUT /identity/v3/projects/853886e208834ca8ac767f3cdb4078a4/users/a7274437e2094ccf98150ba324605dd6/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:30.900294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301d5b7-b1f3-4200-864f-dc433c381108 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:30.900587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301d5b7-b1f3-4200-864f-dc433c381108 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:30.905068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301d5b7-b1f3-4200-864f-dc433c381108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:30.941225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0301d5b7-b1f3-4200-864f-dc433c381108 None None] MFA Rules not processed for user `a7274437e2094ccf98150ba324605dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:30.943065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0301d5b7-b1f3-4200-864f-dc433c381108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:31.054491 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2442/4874] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:30 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:31.059046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b0e3b-f6be-40b5-befa-ff47bfd71170 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:31.077316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b0e3b-f6be-40b5-befa-ff47bfd71170 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:31.079677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f0dba-21ac-4f31-9614-7ef69ba27861 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:31.080547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f0dba-21ac-4f31-9614-7ef69ba27861 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:31.081050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f0dba-21ac-4f31-9614-7ef69ba27861 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:31.081778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f0dba-21ac-4f31-9614-7ef69ba27861 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:31.082960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f0dba-21ac-4f31-9614-7ef69ba27861 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:31.084144 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-306f0dba-21ac-4f31-9614-7ef69ba27861 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:31.084144 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:31.084144 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:31.085419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f0dba-21ac-4f31-9614-7ef69ba27861 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:31.150090 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2433/4875] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:36:31 2022] POST /identity/v3/roles => generated 235 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:31.157437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301d5b7-b1f3-4200-864f-dc433c381108 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:31.176982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301d5b7-b1f3-4200-864f-dc433c381108 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:31.184881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff751057-787d-409a-b2bd-a847f7e0e158 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:31.186490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff751057-787d-409a-b2bd-a847f7e0e158 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:31.187100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff751057-787d-409a-b2bd-a847f7e0e158 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:31.188186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff751057-787d-409a-b2bd-a847f7e0e158 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:31.190095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff751057-787d-409a-b2bd-a847f7e0e158 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:31.191953 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-ff751057-787d-409a-b2bd-a847f7e0e158 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:31.191953 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:31.191953 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:31.196001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff751057-787d-409a-b2bd-a847f7e0e158 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:31.279039 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2443/4876] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:36:31 2022] POST /identity/v3/roles => generated 235 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:31.284680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f0dba-21ac-4f31-9614-7ef69ba27861 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:31.296506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f0dba-21ac-4f31-9614-7ef69ba27861 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:31.302967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ce411-39c6-44f1-8c4c-01b2a117b174 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:31.304121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ce411-39c6-44f1-8c4c-01b2a117b174 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:31.304642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ce411-39c6-44f1-8c4c-01b2a117b174 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:31.305019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ce411-39c6-44f1-8c4c-01b2a117b174 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:31.305839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ce411-39c6-44f1-8c4c-01b2a117b174 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:31.307705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ce411-39c6-44f1-8c4c-01b2a117b174 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:31.414546 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2434/4877] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:36:31 2022] POST /identity/v3/roles => generated 233 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:31.418869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff751057-787d-409a-b2bd-a847f7e0e158 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:31.429964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff751057-787d-409a-b2bd-a847f7e0e158 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:31.435268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40323eac-d348-464f-b76c-5a3c9882d1f0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:31.437701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40323eac-d348-464f-b76c-5a3c9882d1f0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:31.437701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40323eac-d348-464f-b76c-5a3c9882d1f0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:31.437701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40323eac-d348-464f-b76c-5a3c9882d1f0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:31.437701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40323eac-d348-464f-b76c-5a3c9882d1f0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:31.440204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40323eac-d348-464f-b76c-5a3c9882d1f0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:31.555778 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2444/4878] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:36:31 2022] POST /identity/v3/domains => generated 275 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:31.560113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ce411-39c6-44f1-8c4c-01b2a117b174 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:31.571289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ce411-39c6-44f1-8c4c-01b2a117b174 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:31.632717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f8780-3ad6-4b16-a3be-5d6d410ee97d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:31.633442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f8780-3ad6-4b16-a3be-5d6d410ee97d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:31.633731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f8780-3ad6-4b16-a3be-5d6d410ee97d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:31.634031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f8780-3ad6-4b16-a3be-5d6d410ee97d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:31.634730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f8780-3ad6-4b16-a3be-5d6d410ee97d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:31.636916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f8780-3ad6-4b16-a3be-5d6d410ee97d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:31.780899 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2435/4879] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:36:31 2022] POST /identity/v3/projects => generated 399 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:31.787829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40323eac-d348-464f-b76c-5a3c9882d1f0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:31.806726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40323eac-d348-464f-b76c-5a3c9882d1f0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:31.872685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af036fc-795a-49e6-9654-4ed3068fb6cb tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:31.873357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af036fc-795a-49e6-9654-4ed3068fb6cb tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:31.873642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af036fc-795a-49e6-9654-4ed3068fb6cb tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:31.873916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af036fc-795a-49e6-9654-4ed3068fb6cb tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/groups` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:31.874639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af036fc-795a-49e6-9654-4ed3068fb6cb tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:31.875951 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-1af036fc-795a-49e6-9654-4ed3068fb6cb tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:31.875951 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:31.875951 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:31.877169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af036fc-795a-49e6-9654-4ed3068fb6cb tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:31.977860 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2445/4880] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 2 10:36:31 2022] POST /identity/v3/groups => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:31.982841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f8780-3ad6-4b16-a3be-5d6d410ee97d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:32.003049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f8780-3ad6-4b16-a3be-5d6d410ee97d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:32.010034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b4a0f-465e-4c02-afe4-20824abb69ae tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:32.011529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b4a0f-465e-4c02-afe4-20824abb69ae tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:32.011830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b4a0f-465e-4c02-afe4-20824abb69ae tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:32.012121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b4a0f-465e-4c02-afe4-20824abb69ae tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:32.012902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b4a0f-465e-4c02-afe4-20824abb69ae tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:32.014498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b4a0f-465e-4c02-afe4-20824abb69ae tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:32.164269 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2436/4881] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:36:31 2022] POST /identity/v3/roles => generated 234 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:32.165546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af036fc-795a-49e6-9654-4ed3068fb6cb tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:32.183867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af036fc-795a-49e6-9654-4ed3068fb6cb tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:32.192480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93ce6c-5c3d-4b3b-9998-ca73457e5749 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:32.193613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93ce6c-5c3d-4b3b-9998-ca73457e5749 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:32.194201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93ce6c-5c3d-4b3b-9998-ca73457e5749 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:32.195145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93ce6c-5c3d-4b3b-9998-ca73457e5749 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:32.196345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93ce6c-5c3d-4b3b-9998-ca73457e5749 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:32.198519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93ce6c-5c3d-4b3b-9998-ca73457e5749 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:32.337605 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2446/4882] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:36:32 2022] POST /identity/v3/users => generated 439 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:32.342361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b4a0f-465e-4c02-afe4-20824abb69ae tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:32.356343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b4a0f-465e-4c02-afe4-20824abb69ae tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:32.374490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8bd30-1802-44bb-81b1-0c944febe607 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:32.376447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8bd30-1802-44bb-81b1-0c944febe607 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:32.377401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8bd30-1802-44bb-81b1-0c944febe607 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:32.377721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8bd30-1802-44bb-81b1-0c944febe607 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:32.378676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8bd30-1802-44bb-81b1-0c944febe607 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:32.379720 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-d3e8bd30-1802-44bb-81b1-0c944febe607 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:32.379720 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:32.379720 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:32.380799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8bd30-1802-44bb-81b1-0c944febe607 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:32.518079 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2437/4883] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:36:32 2022] POST /identity/v3/roles => generated 269 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:36:32.519342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93ce6c-5c3d-4b3b-9998-ca73457e5749 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:32.539899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93ce6c-5c3d-4b3b-9998-ca73457e5749 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:32.545634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4239c0-312d-42e1-8c0f-c64b36805472 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:32.554910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4239c0-312d-42e1-8c0f-c64b36805472 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:32.554910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4239c0-312d-42e1-8c0f-c64b36805472 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:32.554910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4239c0-312d-42e1-8c0f-c64b36805472 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/users/79e23cfdcd5d482681f5b014d501db9d/roles/c5e3209acc424a70a5eef283e7df5b49` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:32.568301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4239c0-312d-42e1-8c0f-c64b36805472 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2d6ee2b10f004a1085ce72c9fa8b67ff, user_id=79e23cfdcd5d482681f5b014d501db9d, role_id=c5e3209acc424a70a5eef283e7df5b49)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:32.571220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4239c0-312d-42e1-8c0f-c64b36805472 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:32.700340 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2447/4884] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:32 2022] PUT /identity/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/users/79e23cfdcd5d482681f5b014d501db9d/roles/c5e3209acc424a70a5eef283e7df5b49 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:32.709188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8bd30-1802-44bb-81b1-0c944febe607 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:32.723333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8bd30-1802-44bb-81b1-0c944febe607 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:32.821053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd14f7-4452-4758-87f1-4e8a455c5d52 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:32.822009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd14f7-4452-4758-87f1-4e8a455c5d52 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:32.822300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd14f7-4452-4758-87f1-4e8a455c5d52 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:32.822592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd14f7-4452-4758-87f1-4e8a455c5d52 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:32.823470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd14f7-4452-4758-87f1-4e8a455c5d52 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Adding query filter params (scope.project.id=2d6ee2b10f004a1085ce72c9fa8b67ff, user.id=79e23cfdcd5d482681f5b014d501db9d) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:36:32.823790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd14f7-4452-4758-87f1-4e8a455c5d52 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:32.824839 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-fcbd14f7-4452-4758-87f1-4e8a455c5d52 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:32.824839 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:32.824839 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:32.825989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd14f7-4452-4758-87f1-4e8a455c5d52 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:32.873675 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2438/4885] 10.222.0.16 () {58 vars in 1355 bytes} [Mon May 2 10:36:32 2022] GET /identity/v3/role_assignments?scope.project.id=2d6ee2b10f004a1085ce72c9fa8b67ff&user.id=79e23cfdcd5d482681f5b014d501db9d&effective => generated 228 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:32.878510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4239c0-312d-42e1-8c0f-c64b36805472 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:32.890256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4239c0-312d-42e1-8c0f-c64b36805472 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:32.895372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d787b43-e2f3-4697-ba3d-b7c43363e378 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:32.896294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d787b43-e2f3-4697-ba3d-b7c43363e378 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:32.896581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d787b43-e2f3-4697-ba3d-b7c43363e378 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:32.896884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d787b43-e2f3-4697-ba3d-b7c43363e378 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/users/79e23cfdcd5d482681f5b014d501db9d/roles/c5e3209acc424a70a5eef283e7df5b49` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:32.899131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d787b43-e2f3-4697-ba3d-b7c43363e378 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=2d6ee2b10f004a1085ce72c9fa8b67ff, user_id=79e23cfdcd5d482681f5b014d501db9d, role_id=c5e3209acc424a70a5eef283e7df5b49)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:32.900190 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-3d787b43-e2f3-4697-ba3d-b7c43363e378 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:32.900190 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:32.900190 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:32.902132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d787b43-e2f3-4697-ba3d-b7c43363e378 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:32.909728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3d787b43-e2f3-4697-ba3d-b7c43363e378 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invalidating the token cache because role c5e3209acc424a70a5eef283e7df5b49 was removed from user 79e23cfdcd5d482681f5b014d501db9d on project 2d6ee2b10f004a1085ce72c9fa8b67ff. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:32.910028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3d787b43-e2f3-4697-ba3d-b7c43363e378 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:32.910843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3d787b43-e2f3-4697-ba3d-b7c43363e378 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:33.019212 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2448/4886] 10.222.0.16 () {58 vars in 1466 bytes} [Mon May 2 10:36:32 2022] DELETE /identity/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/users/79e23cfdcd5d482681f5b014d501db9d/roles/c5e3209acc424a70a5eef283e7df5b49 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:33.023362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd14f7-4452-4758-87f1-4e8a455c5d52 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:33.025120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fcbd14f7-4452-4758-87f1-4e8a455c5d52 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:33.038504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd14f7-4452-4758-87f1-4e8a455c5d52 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:33.112193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174fd8e-0c83-41ef-82c1-713adbc03a03 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:33.113925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174fd8e-0c83-41ef-82c1-713adbc03a03 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:33.114216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174fd8e-0c83-41ef-82c1-713adbc03a03 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:33.114547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174fd8e-0c83-41ef-82c1-713adbc03a03 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/c5e3209acc424a70a5eef283e7df5b49` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:33.115804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174fd8e-0c83-41ef-82c1-713adbc03a03 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=c5e3209acc424a70a5eef283e7df5b49)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:33.117904 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-9174fd8e-0c83-41ef-82c1-713adbc03a03 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:33.117904 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:33.117904 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:33.125063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174fd8e-0c83-41ef-82c1-713adbc03a03 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:33.262756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9174fd8e-0c83-41ef-82c1-713adbc03a03 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invalidating the token cache because role c5e3209acc424a70a5eef283e7df5b49 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:33.263435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9174fd8e-0c83-41ef-82c1-713adbc03a03 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:33.265945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9174fd8e-0c83-41ef-82c1-713adbc03a03 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:33.268345 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2439/4887] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:33 2022] DELETE /identity/v3/roles/c5e3209acc424a70a5eef283e7df5b49 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:33.273608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d787b43-e2f3-4697-ba3d-b7c43363e378 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:33.284330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d787b43-e2f3-4697-ba3d-b7c43363e378 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:33.382494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac60278-8193-4343-927d-6877719f062c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:33.383772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac60278-8193-4343-927d-6877719f062c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:33.389206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac60278-8193-4343-927d-6877719f062c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:33.389617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac60278-8193-4343-927d-6877719f062c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/users/79e23cfdcd5d482681f5b014d501db9d/roles/5ebc102e533e46c4afab9b94c70fe742` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:33.392930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac60278-8193-4343-927d-6877719f062c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2d6ee2b10f004a1085ce72c9fa8b67ff, user_id=79e23cfdcd5d482681f5b014d501db9d, role_id=5ebc102e533e46c4afab9b94c70fe742)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:33.396066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac60278-8193-4343-927d-6877719f062c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:33.466530 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2449/4888] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:33 2022] PUT /identity/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/users/79e23cfdcd5d482681f5b014d501db9d/roles/5ebc102e533e46c4afab9b94c70fe742 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:33.471339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174fd8e-0c83-41ef-82c1-713adbc03a03 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:33.472790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9174fd8e-0c83-41ef-82c1-713adbc03a03 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:33.485845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174fd8e-0c83-41ef-82c1-713adbc03a03 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:33.561427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57bcbe-8e05-4f38-b4f5-139d76c72f9b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:33.562934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57bcbe-8e05-4f38-b4f5-139d76c72f9b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:33.563219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57bcbe-8e05-4f38-b4f5-139d76c72f9b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:33.563493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57bcbe-8e05-4f38-b4f5-139d76c72f9b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:33.565434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57bcbe-8e05-4f38-b4f5-139d76c72f9b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5ebc102e533e46c4afab9b94c70fe742, implied_role_id=29ae2d1e301c43dcb4d7584f3670224e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:33.566457 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-5d57bcbe-8e05-4f38-b4f5-139d76c72f9b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:33.566457 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:33.566457 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:33.569877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57bcbe-8e05-4f38-b4f5-139d76c72f9b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:33.669260 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2440/4889] 10.222.0.16 () {60 vars in 1362 bytes} [Mon May 2 10:36:33 2022] PUT /identity/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e => generated 521 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:33.680177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac60278-8193-4343-927d-6877719f062c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:33.692182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac60278-8193-4343-927d-6877719f062c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:33.750119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a33f9-5586-4862-be97-92e8edd4243c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:33.751046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a33f9-5586-4862-be97-92e8edd4243c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:33.751329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a33f9-5586-4862-be97-92e8edd4243c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:33.751650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a33f9-5586-4862-be97-92e8edd4243c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:33.752480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a33f9-5586-4862-be97-92e8edd4243c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Adding query filter params (scope.project.id=2d6ee2b10f004a1085ce72c9fa8b67ff, user.id=79e23cfdcd5d482681f5b014d501db9d) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:36:33.752941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a33f9-5586-4862-be97-92e8edd4243c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:33.753957 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-f59a33f9-5586-4862-be97-92e8edd4243c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:33.753957 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:33.753957 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:33.759177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a33f9-5586-4862-be97-92e8edd4243c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:33.818929 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2450/4890] 10.222.0.16 () {58 vars in 1355 bytes} [Mon May 2 10:36:33 2022] GET /identity/v3/role_assignments?scope.project.id=2d6ee2b10f004a1085ce72c9fa8b67ff&user.id=79e23cfdcd5d482681f5b014d501db9d&effective => generated 1061 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:33.821931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57bcbe-8e05-4f38-b4f5-139d76c72f9b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:33.837963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57bcbe-8e05-4f38-b4f5-139d76c72f9b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:33.842608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53128b60-1306-4e06-9d0e-6fc5b79ce6a0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:33.843577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53128b60-1306-4e06-9d0e-6fc5b79ce6a0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:33.843866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53128b60-1306-4e06-9d0e-6fc5b79ce6a0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:33.844142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53128b60-1306-4e06-9d0e-6fc5b79ce6a0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:33.846057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53128b60-1306-4e06-9d0e-6fc5b79ce6a0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5ebc102e533e46c4afab9b94c70fe742, implied_role_id=29ae2d1e301c43dcb4d7584f3670224e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:33.847236 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-53128b60-1306-4e06-9d0e-6fc5b79ce6a0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:33.847236 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:33.847236 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:33.848450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53128b60-1306-4e06-9d0e-6fc5b79ce6a0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:33.957045 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2441/4891] 10.222.0.16 () {58 vars in 1346 bytes} [Mon May 2 10:36:33 2022] DELETE /identity/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:33.961441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a33f9-5586-4862-be97-92e8edd4243c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:33.971499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a33f9-5586-4862-be97-92e8edd4243c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:34.029250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320d494-15c7-4a08-82c2-faa843d1a04b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:34.030058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320d494-15c7-4a08-82c2-faa843d1a04b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:34.030358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320d494-15c7-4a08-82c2-faa843d1a04b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:34.030647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320d494-15c7-4a08-82c2-faa843d1a04b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:34.031512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320d494-15c7-4a08-82c2-faa843d1a04b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Adding query filter params (scope.project.id=2d6ee2b10f004a1085ce72c9fa8b67ff, user.id=79e23cfdcd5d482681f5b014d501db9d) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:36:34.031834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320d494-15c7-4a08-82c2-faa843d1a04b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:34.034082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320d494-15c7-4a08-82c2-faa843d1a04b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:34.081695 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2451/4892] 10.222.0.16 () {58 vars in 1355 bytes} [Mon May 2 10:36:33 2022] GET /identity/v3/role_assignments?scope.project.id=2d6ee2b10f004a1085ce72c9fa8b67ff&user.id=79e23cfdcd5d482681f5b014d501db9d&effective => generated 577 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:34.085742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53128b60-1306-4e06-9d0e-6fc5b79ce6a0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:34.095885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53128b60-1306-4e06-9d0e-6fc5b79ce6a0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:34.100470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88484be-d6fe-4695-8646-12b7cc74360e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:34.101827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88484be-d6fe-4695-8646-12b7cc74360e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:34.102111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88484be-d6fe-4695-8646-12b7cc74360e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:34.102393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88484be-d6fe-4695-8646-12b7cc74360e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:34.104110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88484be-d6fe-4695-8646-12b7cc74360e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5ebc102e533e46c4afab9b94c70fe742, implied_role_id=29ae2d1e301c43dcb4d7584f3670224e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:34.106454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88484be-d6fe-4695-8646-12b7cc74360e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:34.126532 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-c88484be-d6fe-4695-8646-12b7cc74360e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] 5ebc102e533e46c4afab9b94c70fe742 does not imply 29ae2d1e301c43dcb4d7584f3670224e.: keystone.exception.ImpliedRoleNotFound: 5ebc102e533e46c4afab9b94c70fe742 does not imply 29ae2d1e301c43dcb4d7584f3670224e. May 02 10:36:34.126532 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:34.126532 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role May 02 10:36:34.126532 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = query.one() May 02 10:36:34.126532 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one May 02 10:36:34.126532 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._iter().one() May 02 10:36:34.126532 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one May 02 10:36:34.126532 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._only_one_row( May 02 10:36:34.126532 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row May 02 10:36:34.126532 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exc.NoResultFound( May 02 10:36:34.126532 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required May 02 10:36:34.126532 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:34.126532 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:36:34.126532 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:34.126532 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:34.126532 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:36:34.132557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:36:34.132557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:36:34.132557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:36:34.132557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:36:34.132557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:36:34.132557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:36:34.132557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:36:34.132557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:36:34.132557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:36:34.132557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete May 02 10:36:34.132557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) May 02 10:36:34.132557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:36:34.132557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:36:34.132557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role May 02 10:36:34.132557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) May 02 10:36:34.132557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role May 02 10:36:34.134057 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, May 02 10:36:34.134057 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role May 02 10:36:34.134057 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( May 02 10:36:34.134057 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 5ebc102e533e46c4afab9b94c70fe742 does not imply 29ae2d1e301c43dcb4d7584f3670224e. May 02 10:36:34.134057 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:34.134057 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2442/4893] 10.222.0.16 () {58 vars in 1346 bytes} [Mon May 2 10:36:34 2022] DELETE /identity/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e => generated 137 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:36:34.135327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320d494-15c7-4a08-82c2-faa843d1a04b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:34.149379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320d494-15c7-4a08-82c2-faa843d1a04b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:34.155156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016006a6-7fcc-4844-86f1-5421419d0449 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:34.156564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016006a6-7fcc-4844-86f1-5421419d0449 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:34.156953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016006a6-7fcc-4844-86f1-5421419d0449 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:34.157239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016006a6-7fcc-4844-86f1-5421419d0449 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/users/79e23cfdcd5d482681f5b014d501db9d/roles/5ebc102e533e46c4afab9b94c70fe742` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:34.159493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016006a6-7fcc-4844-86f1-5421419d0449 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=2d6ee2b10f004a1085ce72c9fa8b67ff, user_id=79e23cfdcd5d482681f5b014d501db9d, role_id=5ebc102e533e46c4afab9b94c70fe742)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:34.162437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016006a6-7fcc-4844-86f1-5421419d0449 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:34.168137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-016006a6-7fcc-4844-86f1-5421419d0449 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invalidating the token cache because role 5ebc102e533e46c4afab9b94c70fe742 was removed from user 79e23cfdcd5d482681f5b014d501db9d on project 2d6ee2b10f004a1085ce72c9fa8b67ff. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:34.168427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-016006a6-7fcc-4844-86f1-5421419d0449 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:34.169146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-016006a6-7fcc-4844-86f1-5421419d0449 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:34.400107 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2452/4894] 10.222.0.16 () {58 vars in 1466 bytes} [Mon May 2 10:36:34 2022] DELETE /identity/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/users/79e23cfdcd5d482681f5b014d501db9d/roles/5ebc102e533e46c4afab9b94c70fe742 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:34.405464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88484be-d6fe-4695-8646-12b7cc74360e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:34.407709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c88484be-d6fe-4695-8646-12b7cc74360e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:34.420339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88484be-d6fe-4695-8646-12b7cc74360e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:34.481609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473f378-957b-44a3-9929-5e6341ba763d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:34.482597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473f378-957b-44a3-9929-5e6341ba763d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:34.482880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473f378-957b-44a3-9929-5e6341ba763d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:34.483158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473f378-957b-44a3-9929-5e6341ba763d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:34.484519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473f378-957b-44a3-9929-5e6341ba763d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:34.486203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473f378-957b-44a3-9929-5e6341ba763d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:34.568263 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2443/4895] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:36:34 2022] POST /identity/v3/roles => generated 271 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:34.572372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016006a6-7fcc-4844-86f1-5421419d0449 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:34.582881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016006a6-7fcc-4844-86f1-5421419d0449 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:34.587663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308aaf8b-386f-4cb1-a727-60e0d9d7622c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:34.588317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308aaf8b-386f-4cb1-a727-60e0d9d7622c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:34.588623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308aaf8b-386f-4cb1-a727-60e0d9d7622c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:34.588918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308aaf8b-386f-4cb1-a727-60e0d9d7622c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:34.589801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308aaf8b-386f-4cb1-a727-60e0d9d7622c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Adding query filter params (domain_id=e7052f575a0d43f7b6cfdf3a935e384d) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:36:34.590157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308aaf8b-386f-4cb1-a727-60e0d9d7622c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:34.591152 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-308aaf8b-386f-4cb1-a727-60e0d9d7622c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:34.591152 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:34.591152 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:34.592036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308aaf8b-386f-4cb1-a727-60e0d9d7622c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:34.600981 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2453/4896] 10.222.0.16 () {58 vars in 1206 bytes} [Mon May 2 10:36:34 2022] GET /identity/v3/roles?domain_id=e7052f575a0d43f7b6cfdf3a935e384d => generated 408 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:34.604726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473f378-957b-44a3-9929-5e6341ba763d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:34.615428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473f378-957b-44a3-9929-5e6341ba763d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:34.620181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74f628-46db-4f20-9973-35ced89cc47e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:34.621191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74f628-46db-4f20-9973-35ced89cc47e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:34.621481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74f628-46db-4f20-9973-35ced89cc47e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:34.621766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74f628-46db-4f20-9973-35ced89cc47e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/863864dd767542a5a5f10f5111f97a3c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:34.623003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b74f628-46db-4f20-9973-35ced89cc47e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=863864dd767542a5a5f10f5111f97a3c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:34.624635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b74f628-46db-4f20-9973-35ced89cc47e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:34.723280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4b74f628-46db-4f20-9973-35ced89cc47e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invalidating the token cache because role 863864dd767542a5a5f10f5111f97a3c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:34.723582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4b74f628-46db-4f20-9973-35ced89cc47e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:34.724295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4b74f628-46db-4f20-9973-35ced89cc47e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:34.726462 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2444/4897] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:34 2022] DELETE /identity/v3/roles/863864dd767542a5a5f10f5111f97a3c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:34.730895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308aaf8b-386f-4cb1-a727-60e0d9d7622c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:34.734514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-308aaf8b-386f-4cb1-a727-60e0d9d7622c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:34.747565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308aaf8b-386f-4cb1-a727-60e0d9d7622c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:34.808239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa718884-1d1d-4eaa-8a6e-031c2055fb96 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:34.809157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa718884-1d1d-4eaa-8a6e-031c2055fb96 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:34.809443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa718884-1d1d-4eaa-8a6e-031c2055fb96 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:34.809723 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa718884-1d1d-4eaa-8a6e-031c2055fb96 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:34.810468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa718884-1d1d-4eaa-8a6e-031c2055fb96 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Adding query filter params (domain_id=e7052f575a0d43f7b6cfdf3a935e384d) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:36:34.810778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa718884-1d1d-4eaa-8a6e-031c2055fb96 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:34.813090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa718884-1d1d-4eaa-8a6e-031c2055fb96 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:34.824182 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2454/4898] 10.222.0.16 () {58 vars in 1206 bytes} [Mon May 2 10:36:34 2022] GET /identity/v3/roles?domain_id=e7052f575a0d43f7b6cfdf3a935e384d => generated 148 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:34.825442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74f628-46db-4f20-9973-35ced89cc47e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:34.838830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74f628-46db-4f20-9973-35ced89cc47e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:34.845372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80549231-3e1a-440a-99af-705ea6990802 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:34.846566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80549231-3e1a-440a-99af-705ea6990802 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:34.849107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80549231-3e1a-440a-99af-705ea6990802 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:34.849107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80549231-3e1a-440a-99af-705ea6990802 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/863864dd767542a5a5f10f5111f97a3c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:34.859366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80549231-3e1a-440a-99af-705ea6990802 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:36:34.869234 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-80549231-3e1a-440a-99af-705ea6990802 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Could not find role: 863864dd767542a5a5f10f5111f97a3c.: keystone.exception.RoleNotFound: Could not find role: 863864dd767542a5a5f10f5111f97a3c. May 02 10:36:34.869234 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:34.869234 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:36:34.869234 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:36:34.869234 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:36:34.869234 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:36:34.869234 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:36:34.869234 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:36:34.869234 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:36:34.869234 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:36:34.869234 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:36:34.869234 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:36:34.869234 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete May 02 10:36:34.869234 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') May 02 10:36:34.870480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:36:34.870480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:36:34.870480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:36:34.870480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:36:34.870480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:36:34.870480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:36:34.870480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:36:34.870480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:36:34.870480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:36:34.870480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:36:34.870480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:36:34.870480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:36:34.870480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:36:34.870480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:36:34.870480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:36:34.870480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:36:34.871569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:36:34.871569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:36:34.871569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:36:34.871569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:36:34.871569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 02 10:36:34.871569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 02 10:36:34.871569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 02 10:36:34.871569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 02 10:36:34.871569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 02 10:36:34.871569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 10:36:34.871569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 863864dd767542a5a5f10f5111f97a3c. May 02 10:36:34.871569 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:34.872435 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2445/4899] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:34 2022] DELETE /identity/v3/roles/863864dd767542a5a5f10f5111f97a3c => generated 110 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:36:34.876251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa718884-1d1d-4eaa-8a6e-031c2055fb96 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:34.895223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa718884-1d1d-4eaa-8a6e-031c2055fb96 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:34.901756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75809d-0fc7-43ab-b60d-dd765b65744c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:34.902912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75809d-0fc7-43ab-b60d-dd765b65744c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:34.903073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75809d-0fc7-43ab-b60d-dd765b65744c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:34.903454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75809d-0fc7-43ab-b60d-dd765b65744c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/domains/e7052f575a0d43f7b6cfdf3a935e384d/groups/7bb99e9056194efc85304b45833c6a52/roles/1d0c78abff934f80bfe409639da6b445` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:34.912754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75809d-0fc7-43ab-b60d-dd765b65744c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e7052f575a0d43f7b6cfdf3a935e384d, group_id=7bb99e9056194efc85304b45833c6a52, role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:34.915406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75809d-0fc7-43ab-b60d-dd765b65744c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:35.014315 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2455/4900] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:34 2022] PUT /identity/v3/domains/e7052f575a0d43f7b6cfdf3a935e384d/groups/7bb99e9056194efc85304b45833c6a52/roles/1d0c78abff934f80bfe409639da6b445 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:35.019133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80549231-3e1a-440a-99af-705ea6990802 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:35.033351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80549231-3e1a-440a-99af-705ea6990802 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:35.116494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d8eac-3cbc-48a5-a54b-1c4366ed68f5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:35.117854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d8eac-3cbc-48a5-a54b-1c4366ed68f5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:35.118154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d8eac-3cbc-48a5-a54b-1c4366ed68f5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:35.118443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d8eac-3cbc-48a5-a54b-1c4366ed68f5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/domains/e7052f575a0d43f7b6cfdf3a935e384d/groups/7bb99e9056194efc85304b45833c6a52/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:35.120438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d8eac-3cbc-48a5-a54b-1c4366ed68f5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=e7052f575a0d43f7b6cfdf3a935e384d, group_id=7bb99e9056194efc85304b45833c6a52)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:35.121652 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-072d8eac-3cbc-48a5-a54b-1c4366ed68f5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:35.121652 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:35.121652 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:35.127114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d8eac-3cbc-48a5-a54b-1c4366ed68f5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:35.141678 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2446/4901] 10.222.0.16 () {58 vars in 1364 bytes} [Mon May 2 10:36:35 2022] GET /identity/v3/domains/e7052f575a0d43f7b6cfdf3a935e384d/groups/7bb99e9056194efc85304b45833c6a52/roles => generated 409 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:35.143186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75809d-0fc7-43ab-b60d-dd765b65744c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:35.155128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75809d-0fc7-43ab-b60d-dd765b65744c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:35.160820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad305e-81d9-432c-84bd-565c6189b979 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:35.162033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad305e-81d9-432c-84bd-565c6189b979 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:35.162370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad305e-81d9-432c-84bd-565c6189b979 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:35.162536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad305e-81d9-432c-84bd-565c6189b979 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/domains/e7052f575a0d43f7b6cfdf3a935e384d/groups/7bb99e9056194efc85304b45833c6a52/roles/1d0c78abff934f80bfe409639da6b445` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:35.164908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad305e-81d9-432c-84bd-565c6189b979 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=e7052f575a0d43f7b6cfdf3a935e384d, group_id=7bb99e9056194efc85304b45833c6a52, role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:35.165928 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-afad305e-81d9-432c-84bd-565c6189b979 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:35.165928 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:35.165928 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:35.167987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad305e-81d9-432c-84bd-565c6189b979 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:35.188447 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2456/4902] 10.222.0.16 () {58 vars in 1464 bytes} [Mon May 2 10:36:35 2022] HEAD /identity/v3/domains/e7052f575a0d43f7b6cfdf3a935e384d/groups/7bb99e9056194efc85304b45833c6a52/roles/1d0c78abff934f80bfe409639da6b445 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:35.189376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d8eac-3cbc-48a5-a54b-1c4366ed68f5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:35.204366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d8eac-3cbc-48a5-a54b-1c4366ed68f5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:35.209380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9497f-2b4c-412c-8cc4-5dc665b6a698 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:35.210455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9497f-2b4c-412c-8cc4-5dc665b6a698 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:35.210740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9497f-2b4c-412c-8cc4-5dc665b6a698 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:35.211021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9497f-2b4c-412c-8cc4-5dc665b6a698 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/domains/e7052f575a0d43f7b6cfdf3a935e384d/groups/7bb99e9056194efc85304b45833c6a52/roles/1d0c78abff934f80bfe409639da6b445` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:35.213339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9497f-2b4c-412c-8cc4-5dc665b6a698 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e7052f575a0d43f7b6cfdf3a935e384d, group_id=7bb99e9056194efc85304b45833c6a52, role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:35.214363 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-bcb9497f-2b4c-412c-8cc4-5dc665b6a698 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:35.214363 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:35.214363 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:35.216275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9497f-2b4c-412c-8cc4-5dc665b6a698 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:35.223414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bcb9497f-2b4c-412c-8cc4-5dc665b6a698 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invalidating the token cache because role 1d0c78abff934f80bfe409639da6b445 was removed from group 7bb99e9056194efc85304b45833c6a52 on domain e7052f575a0d43f7b6cfdf3a935e384d. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:35.223704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bcb9497f-2b4c-412c-8cc4-5dc665b6a698 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:35.224464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bcb9497f-2b4c-412c-8cc4-5dc665b6a698 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:35.322729 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2447/4903] 10.222.0.16 () {58 vars in 1466 bytes} [Mon May 2 10:36:35 2022] DELETE /identity/v3/domains/e7052f575a0d43f7b6cfdf3a935e384d/groups/7bb99e9056194efc85304b45833c6a52/roles/1d0c78abff934f80bfe409639da6b445 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:35.329068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad305e-81d9-432c-84bd-565c6189b979 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:35.330966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-afad305e-81d9-432c-84bd-565c6189b979 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:35.346100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad305e-81d9-432c-84bd-565c6189b979 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:35.411118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72650e3-48d0-4e27-a3c5-ae3beeb360f0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:35.412418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72650e3-48d0-4e27-a3c5-ae3beeb360f0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:35.412673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72650e3-48d0-4e27-a3c5-ae3beeb360f0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:35.412956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72650e3-48d0-4e27-a3c5-ae3beeb360f0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/groups/7bb99e9056194efc85304b45833c6a52/roles/1d0c78abff934f80bfe409639da6b445` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:35.415231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72650e3-48d0-4e27-a3c5-ae3beeb360f0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2d6ee2b10f004a1085ce72c9fa8b67ff, group_id=7bb99e9056194efc85304b45833c6a52, role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:35.418062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72650e3-48d0-4e27-a3c5-ae3beeb360f0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:35.516737 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2457/4904] 10.222.0.16 () {60 vars in 1485 bytes} [Mon May 2 10:36:35 2022] PUT /identity/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/groups/7bb99e9056194efc85304b45833c6a52/roles/1d0c78abff934f80bfe409639da6b445 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:35.521025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9497f-2b4c-412c-8cc4-5dc665b6a698 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:35.531129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9497f-2b4c-412c-8cc4-5dc665b6a698 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:35.590398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cec6a9-fea3-41ea-b076-70e2e3b2d321 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:35.593841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cec6a9-fea3-41ea-b076-70e2e3b2d321 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:35.593841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cec6a9-fea3-41ea-b076-70e2e3b2d321 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:35.593841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cec6a9-fea3-41ea-b076-70e2e3b2d321 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/groups/7bb99e9056194efc85304b45833c6a52/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:35.593841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cec6a9-fea3-41ea-b076-70e2e3b2d321 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:list_grants(project_id=2d6ee2b10f004a1085ce72c9fa8b67ff, group_id=7bb99e9056194efc85304b45833c6a52)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:35.596062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cec6a9-fea3-41ea-b076-70e2e3b2d321 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:35.607386 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2448/4905] 10.222.0.16 () {58 vars in 1367 bytes} [Mon May 2 10:36:35 2022] GET /identity/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/groups/7bb99e9056194efc85304b45833c6a52/roles => generated 410 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:35.611929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72650e3-48d0-4e27-a3c5-ae3beeb360f0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:35.622857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72650e3-48d0-4e27-a3c5-ae3beeb360f0 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:35.628650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e5431-e618-4477-9f58-28faa142b60e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:35.629558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e5431-e618-4477-9f58-28faa142b60e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:35.629847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e5431-e618-4477-9f58-28faa142b60e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:35.630129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e5431-e618-4477-9f58-28faa142b60e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/groups/7bb99e9056194efc85304b45833c6a52/users/79e23cfdcd5d482681f5b014d501db9d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:35.631892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e5431-e618-4477-9f58-28faa142b60e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=7bb99e9056194efc85304b45833c6a52, user_id=79e23cfdcd5d482681f5b014d501db9d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:35.632972 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-b42e5431-e618-4477-9f58-28faa142b60e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:35.632972 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:35.632972 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:35.634157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e5431-e618-4477-9f58-28faa142b60e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:35.727733 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2458/4906] 10.222.0.16 () {60 vars in 1359 bytes} [Mon May 2 10:36:35 2022] PUT /identity/v3/groups/7bb99e9056194efc85304b45833c6a52/users/79e23cfdcd5d482681f5b014d501db9d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:35.732297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553921d4-afda-46b2-a1a4-2dbc2d655108 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:35.732588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553921d4-afda-46b2-a1a4-2dbc2d655108 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:35.732897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553921d4-afda-46b2-a1a4-2dbc2d655108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:35.797259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-553921d4-afda-46b2-a1a4-2dbc2d655108 None None] MFA Rules not processed for user `79e23cfdcd5d482681f5b014d501db9d`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:35.797259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-553921d4-afda-46b2-a1a4-2dbc2d655108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:35.908752 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2449/4907] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:35 2022] POST /identity/v3/auth/tokens => generated 3253 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:35.913138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e5431-e618-4477-9f58-28faa142b60e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:35.940918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8012969-0836-4f75-9d07-f5362b8acacd None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:35.940918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8012969-0836-4f75-9d07-f5362b8acacd None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:35.940918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8012969-0836-4f75-9d07-f5362b8acacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:35.968046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a8012969-0836-4f75-9d07-f5362b8acacd None None] MFA Rules not processed for user `f2140817178b44e99d837e98eff69629`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:35.973610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a8012969-0836-4f75-9d07-f5362b8acacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:36.036960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e5431-e618-4477-9f58-28faa142b60e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:36.047637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270d28f-f774-4ad0-888e-3c041257feac tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:36.048904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d28f-f774-4ad0-888e-3c041257feac tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:36.049374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d28f-f774-4ad0-888e-3c041257feac tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:36.049833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d28f-f774-4ad0-888e-3c041257feac tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/groups/7bb99e9056194efc85304b45833c6a52/roles/1d0c78abff934f80bfe409639da6b445` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:36.052653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270d28f-f774-4ad0-888e-3c041257feac tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:check_grant(project_id=2d6ee2b10f004a1085ce72c9fa8b67ff, group_id=7bb99e9056194efc85304b45833c6a52, role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:36.056589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270d28f-f774-4ad0-888e-3c041257feac tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:36.056837 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2450/4908] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:36.067564 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2459/4909] 10.222.0.16 () {58 vars in 1467 bytes} [Mon May 2 10:36:35 2022] HEAD /identity/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/groups/7bb99e9056194efc85304b45833c6a52/roles/1d0c78abff934f80bfe409639da6b445 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:36.079412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8012969-0836-4f75-9d07-f5362b8acacd None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:36.091350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8012969-0836-4f75-9d07-f5362b8acacd None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:36.099988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba8da5-1fed-43fc-a9dc-6f9a4183a0f4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:36.100929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba8da5-1fed-43fc-a9dc-6f9a4183a0f4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:36.101280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba8da5-1fed-43fc-a9dc-6f9a4183a0f4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:36.101563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba8da5-1fed-43fc-a9dc-6f9a4183a0f4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/groups/7bb99e9056194efc85304b45833c6a52/roles/1d0c78abff934f80bfe409639da6b445` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:36.103901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba8da5-1fed-43fc-a9dc-6f9a4183a0f4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=2d6ee2b10f004a1085ce72c9fa8b67ff, group_id=7bb99e9056194efc85304b45833c6a52, role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:36.106876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba8da5-1fed-43fc-a9dc-6f9a4183a0f4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:36.113290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9dba8da5-1fed-43fc-a9dc-6f9a4183a0f4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invalidating the token cache because role 1d0c78abff934f80bfe409639da6b445 was removed from group 7bb99e9056194efc85304b45833c6a52 on project 2d6ee2b10f004a1085ce72c9fa8b67ff. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:36.113581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9dba8da5-1fed-43fc-a9dc-6f9a4183a0f4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:36.114687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9dba8da5-1fed-43fc-a9dc-6f9a4183a0f4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:36.212490 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2451/4910] 10.222.0.16 () {58 vars in 1469 bytes} [Mon May 2 10:36:36 2022] DELETE /identity/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/groups/7bb99e9056194efc85304b45833c6a52/roles/1d0c78abff934f80bfe409639da6b445 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:36.216592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270d28f-f774-4ad0-888e-3c041257feac tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:36.219486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f270d28f-f774-4ad0-888e-3c041257feac tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:36.233943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270d28f-f774-4ad0-888e-3c041257feac tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:36.300536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89b4ef-019a-4c28-81c6-bcab627b121a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:36.301670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89b4ef-019a-4c28-81c6-bcab627b121a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:36.302016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89b4ef-019a-4c28-81c6-bcab627b121a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:36.302359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89b4ef-019a-4c28-81c6-bcab627b121a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/groups/7bb99e9056194efc85304b45833c6a52/users/79e23cfdcd5d482681f5b014d501db9d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:36.304299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89b4ef-019a-4c28-81c6-bcab627b121a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=7bb99e9056194efc85304b45833c6a52, user_id=79e23cfdcd5d482681f5b014d501db9d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:36.305734 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-ed89b4ef-019a-4c28-81c6-bcab627b121a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:36.305734 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:36.305734 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:36.307304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89b4ef-019a-4c28-81c6-bcab627b121a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:36.390745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ed89b4ef-019a-4c28-81c6-bcab627b121a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '79e23cfdcd5d482681f5b014d501db9d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:36.487894 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2460/4911] 10.222.0.16 () {58 vars in 1343 bytes} [Mon May 2 10:36:36 2022] DELETE /identity/v3/groups/7bb99e9056194efc85304b45833c6a52/users/79e23cfdcd5d482681f5b014d501db9d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:36.489099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba8da5-1fed-43fc-a9dc-6f9a4183a0f4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:36.504645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba8da5-1fed-43fc-a9dc-6f9a4183a0f4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:36.572719 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f0f81-435e-4064-8c75-07f8ddb5b2c3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:36.574305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f0f81-435e-4064-8c75-07f8ddb5b2c3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:36.574790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f0f81-435e-4064-8c75-07f8ddb5b2c3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:36.575076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f0f81-435e-4064-8c75-07f8ddb5b2c3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/system/groups/7bb99e9056194efc85304b45833c6a52/roles/1d0c78abff934f80bfe409639da6b445` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:36.576882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f0f81-435e-4064-8c75-07f8ddb5b2c3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=7bb99e9056194efc85304b45833c6a52, role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:36.578298 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-616f0f81-435e-4064-8c75-07f8ddb5b2c3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:36.578298 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:36.578298 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:36.579195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f0f81-435e-4064-8c75-07f8ddb5b2c3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:36.744084 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2452/4912] 10.222.0.16 () {60 vars in 1380 bytes} [Mon May 2 10:36:36 2022] PUT /identity/v3/system/groups/7bb99e9056194efc85304b45833c6a52/roles/1d0c78abff934f80bfe409639da6b445 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:36.746799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89b4ef-019a-4c28-81c6-bcab627b121a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:36.757644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89b4ef-019a-4c28-81c6-bcab627b121a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:36.762380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d41989-619c-4eeb-a5ac-addcf030f090 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:36.767157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d41989-619c-4eeb-a5ac-addcf030f090 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:36.767157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d41989-619c-4eeb-a5ac-addcf030f090 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:36.767157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d41989-619c-4eeb-a5ac-addcf030f090 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/system/groups/7bb99e9056194efc85304b45833c6a52/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:36.767157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d41989-619c-4eeb-a5ac-addcf030f090 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=7bb99e9056194efc85304b45833c6a52)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:36.767576 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-f7d41989-619c-4eeb-a5ac-addcf030f090 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:36.767576 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:36.767576 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:36.767576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d41989-619c-4eeb-a5ac-addcf030f090 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:36.778791 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2461/4913] 10.222.0.16 () {58 vars in 1262 bytes} [Mon May 2 10:36:36 2022] GET /identity/v3/system/groups/7bb99e9056194efc85304b45833c6a52/roles => generated 375 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:36.783340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f0f81-435e-4064-8c75-07f8ddb5b2c3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:36.793467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f0f81-435e-4064-8c75-07f8ddb5b2c3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:36.799060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb2af5-904f-4421-b134-1476c1858fb6 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:36.799991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb2af5-904f-4421-b134-1476c1858fb6 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:36.800336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb2af5-904f-4421-b134-1476c1858fb6 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:36.800678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb2af5-904f-4421-b134-1476c1858fb6 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/system/groups/7bb99e9056194efc85304b45833c6a52/roles/1d0c78abff934f80bfe409639da6b445` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:36.802675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb2af5-904f-4421-b134-1476c1858fb6 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=7bb99e9056194efc85304b45833c6a52, role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:36.803699 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-ecdb2af5-904f-4421-b134-1476c1858fb6 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:36.803699 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:36.803699 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:36.804593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb2af5-904f-4421-b134-1476c1858fb6 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:36.817737 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2453/4914] 10.222.0.16 () {58 vars in 1362 bytes} [Mon May 2 10:36:36 2022] HEAD /identity/v3/system/groups/7bb99e9056194efc85304b45833c6a52/roles/1d0c78abff934f80bfe409639da6b445 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:36.821438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d41989-619c-4eeb-a5ac-addcf030f090 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:36.832449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d41989-619c-4eeb-a5ac-addcf030f090 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:36.837160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa3b2d-4b8f-4776-b312-fc479bcd0cad tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:36.838017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa3b2d-4b8f-4776-b312-fc479bcd0cad tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:36.838391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa3b2d-4b8f-4776-b312-fc479bcd0cad tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:36.838704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa3b2d-4b8f-4776-b312-fc479bcd0cad tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/system/groups/7bb99e9056194efc85304b45833c6a52/roles/1d0c78abff934f80bfe409639da6b445` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:36.840645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa3b2d-4b8f-4776-b312-fc479bcd0cad tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=7bb99e9056194efc85304b45833c6a52, role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:36.841698 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-86aa3b2d-4b8f-4776-b312-fc479bcd0cad tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:36.841698 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:36.841698 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:36.842743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa3b2d-4b8f-4776-b312-fc479bcd0cad tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:36.945900 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2462/4915] 10.222.0.16 () {58 vars in 1364 bytes} [Mon May 2 10:36:36 2022] DELETE /identity/v3/system/groups/7bb99e9056194efc85304b45833c6a52/roles/1d0c78abff934f80bfe409639da6b445 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:36.951037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb2af5-904f-4421-b134-1476c1858fb6 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:36.962165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb2af5-904f-4421-b134-1476c1858fb6 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:36.967068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffeabbb-af0e-4c28-bfc0-6c866ba92a93 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:36.967979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffeabbb-af0e-4c28-bfc0-6c866ba92a93 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:36.968851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffeabbb-af0e-4c28-bfc0-6c866ba92a93 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:36.969143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffeabbb-af0e-4c28-bfc0-6c866ba92a93 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/domains/e7052f575a0d43f7b6cfdf3a935e384d/users/79e23cfdcd5d482681f5b014d501db9d/roles/1d0c78abff934f80bfe409639da6b445` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:36.971712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffeabbb-af0e-4c28-bfc0-6c866ba92a93 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e7052f575a0d43f7b6cfdf3a935e384d, user_id=79e23cfdcd5d482681f5b014d501db9d, role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:36.974464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffeabbb-af0e-4c28-bfc0-6c866ba92a93 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:37.088666 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2454/4916] 10.222.0.16 () {60 vars in 1479 bytes} [Mon May 2 10:36:36 2022] PUT /identity/v3/domains/e7052f575a0d43f7b6cfdf3a935e384d/users/79e23cfdcd5d482681f5b014d501db9d/roles/1d0c78abff934f80bfe409639da6b445 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:37.091291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa3b2d-4b8f-4776-b312-fc479bcd0cad tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:37.116171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa3b2d-4b8f-4776-b312-fc479bcd0cad tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:37.174769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b6ea7-0561-47c8-be71-29e188f31702 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:37.175661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b6ea7-0561-47c8-be71-29e188f31702 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:37.175943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b6ea7-0561-47c8-be71-29e188f31702 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:37.176226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b6ea7-0561-47c8-be71-29e188f31702 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/domains/e7052f575a0d43f7b6cfdf3a935e384d/users/79e23cfdcd5d482681f5b014d501db9d/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:37.185110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b6ea7-0561-47c8-be71-29e188f31702 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=e7052f575a0d43f7b6cfdf3a935e384d, user_id=79e23cfdcd5d482681f5b014d501db9d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:37.189974 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-0d1b6ea7-0561-47c8-be71-29e188f31702 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:37.189974 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:37.189974 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:37.189974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b6ea7-0561-47c8-be71-29e188f31702 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:37.201156 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2463/4917] 10.222.0.16 () {58 vars in 1361 bytes} [Mon May 2 10:36:37 2022] GET /identity/v3/domains/e7052f575a0d43f7b6cfdf3a935e384d/users/79e23cfdcd5d482681f5b014d501db9d/roles => generated 408 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:37.206053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffeabbb-af0e-4c28-bfc0-6c866ba92a93 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:37.224629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffeabbb-af0e-4c28-bfc0-6c866ba92a93 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:37.226541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12abad-93f6-476f-a445-4d5efe097806 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:37.227458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12abad-93f6-476f-a445-4d5efe097806 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:37.227745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12abad-93f6-476f-a445-4d5efe097806 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:37.228026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12abad-93f6-476f-a445-4d5efe097806 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/domains/e7052f575a0d43f7b6cfdf3a935e384d/users/79e23cfdcd5d482681f5b014d501db9d/roles/1d0c78abff934f80bfe409639da6b445` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:37.230350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12abad-93f6-476f-a445-4d5efe097806 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=e7052f575a0d43f7b6cfdf3a935e384d, user_id=79e23cfdcd5d482681f5b014d501db9d, role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:37.231388 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-dc12abad-93f6-476f-a445-4d5efe097806 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:37.231388 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:37.231388 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:37.233365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12abad-93f6-476f-a445-4d5efe097806 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:37.239333 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2455/4918] 10.222.0.16 () {58 vars in 1461 bytes} [Mon May 2 10:36:37 2022] HEAD /identity/v3/domains/e7052f575a0d43f7b6cfdf3a935e384d/users/79e23cfdcd5d482681f5b014d501db9d/roles/1d0c78abff934f80bfe409639da6b445 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:37.243501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b6ea7-0561-47c8-be71-29e188f31702 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:37.255744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b6ea7-0561-47c8-be71-29e188f31702 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:37.260377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a42921-89d6-4dc6-be2d-5c8823fc2057 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:37.261317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a42921-89d6-4dc6-be2d-5c8823fc2057 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:37.261610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a42921-89d6-4dc6-be2d-5c8823fc2057 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:37.261892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a42921-89d6-4dc6-be2d-5c8823fc2057 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/domains/e7052f575a0d43f7b6cfdf3a935e384d/users/79e23cfdcd5d482681f5b014d501db9d/roles/1d0c78abff934f80bfe409639da6b445` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:37.264434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a42921-89d6-4dc6-be2d-5c8823fc2057 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e7052f575a0d43f7b6cfdf3a935e384d, user_id=79e23cfdcd5d482681f5b014d501db9d, role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:37.267847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a42921-89d6-4dc6-be2d-5c8823fc2057 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:37.275085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b3a42921-89d6-4dc6-be2d-5c8823fc2057 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invalidating the token cache because role 1d0c78abff934f80bfe409639da6b445 was removed from user 79e23cfdcd5d482681f5b014d501db9d on domain e7052f575a0d43f7b6cfdf3a935e384d. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:37.275573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b3a42921-89d6-4dc6-be2d-5c8823fc2057 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:37.276506 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b3a42921-89d6-4dc6-be2d-5c8823fc2057 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:37.403409 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2464/4919] 10.222.0.16 () {58 vars in 1463 bytes} [Mon May 2 10:36:37 2022] DELETE /identity/v3/domains/e7052f575a0d43f7b6cfdf3a935e384d/users/79e23cfdcd5d482681f5b014d501db9d/roles/1d0c78abff934f80bfe409639da6b445 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:37.408350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12abad-93f6-476f-a445-4d5efe097806 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:37.410118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-dc12abad-93f6-476f-a445-4d5efe097806 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:37.423782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12abad-93f6-476f-a445-4d5efe097806 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:37.517051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5029fc-487b-4a93-a71c-88b1ef8ba437 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:37.518090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5029fc-487b-4a93-a71c-88b1ef8ba437 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:37.518495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5029fc-487b-4a93-a71c-88b1ef8ba437 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:37.518869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5029fc-487b-4a93-a71c-88b1ef8ba437 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/users/79e23cfdcd5d482681f5b014d501db9d/roles/1d0c78abff934f80bfe409639da6b445` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:37.525028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5029fc-487b-4a93-a71c-88b1ef8ba437 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2d6ee2b10f004a1085ce72c9fa8b67ff, user_id=79e23cfdcd5d482681f5b014d501db9d, role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:37.528303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5029fc-487b-4a93-a71c-88b1ef8ba437 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:37.657582 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2456/4920] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:37 2022] PUT /identity/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/users/79e23cfdcd5d482681f5b014d501db9d/roles/1d0c78abff934f80bfe409639da6b445 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:37.658152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a42921-89d6-4dc6-be2d-5c8823fc2057 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:37.668196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a42921-89d6-4dc6-be2d-5c8823fc2057 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:37.821729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5672f-961f-405d-ae31-9d4a8285e4ca tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:37.824610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5672f-961f-405d-ae31-9d4a8285e4ca tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:37.824610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5672f-961f-405d-ae31-9d4a8285e4ca tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:37.824610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5672f-961f-405d-ae31-9d4a8285e4ca tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/users/79e23cfdcd5d482681f5b014d501db9d/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:37.827714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5672f-961f-405d-ae31-9d4a8285e4ca tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:list_grants(project_id=2d6ee2b10f004a1085ce72c9fa8b67ff, user_id=79e23cfdcd5d482681f5b014d501db9d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:37.831486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5672f-961f-405d-ae31-9d4a8285e4ca tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:37.849177 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2465/4921] 10.222.0.16 () {58 vars in 1364 bytes} [Mon May 2 10:36:37 2022] GET /identity/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/users/79e23cfdcd5d482681f5b014d501db9d/roles => generated 409 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:37.853132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5029fc-487b-4a93-a71c-88b1ef8ba437 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:37.865826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5029fc-487b-4a93-a71c-88b1ef8ba437 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:37.872059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed31acf-5d10-474b-ad2a-5ece9eeb9f2c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:37.873060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed31acf-5d10-474b-ad2a-5ece9eeb9f2c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:37.876292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed31acf-5d10-474b-ad2a-5ece9eeb9f2c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:37.876292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed31acf-5d10-474b-ad2a-5ece9eeb9f2c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/users/79e23cfdcd5d482681f5b014d501db9d/roles/1d0c78abff934f80bfe409639da6b445` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:37.877650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed31acf-5d10-474b-ad2a-5ece9eeb9f2c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:check_grant(project_id=2d6ee2b10f004a1085ce72c9fa8b67ff, user_id=79e23cfdcd5d482681f5b014d501db9d, role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:37.880511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed31acf-5d10-474b-ad2a-5ece9eeb9f2c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:37.887127 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2457/4922] 10.222.0.16 () {58 vars in 1464 bytes} [Mon May 2 10:36:37 2022] HEAD /identity/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/users/79e23cfdcd5d482681f5b014d501db9d/roles/1d0c78abff934f80bfe409639da6b445 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:37.891192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5672f-961f-405d-ae31-9d4a8285e4ca tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:37.910035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5672f-961f-405d-ae31-9d4a8285e4ca tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:37.922899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4828773-b71d-44e2-8a19-02e801314e90 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:37.924219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4828773-b71d-44e2-8a19-02e801314e90 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:37.924567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4828773-b71d-44e2-8a19-02e801314e90 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:37.928184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4828773-b71d-44e2-8a19-02e801314e90 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/users/79e23cfdcd5d482681f5b014d501db9d/roles/1d0c78abff934f80bfe409639da6b445` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:37.928184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4828773-b71d-44e2-8a19-02e801314e90 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=2d6ee2b10f004a1085ce72c9fa8b67ff, user_id=79e23cfdcd5d482681f5b014d501db9d, role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:37.930850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4828773-b71d-44e2-8a19-02e801314e90 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:37.937656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b4828773-b71d-44e2-8a19-02e801314e90 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invalidating the token cache because role 1d0c78abff934f80bfe409639da6b445 was removed from user 79e23cfdcd5d482681f5b014d501db9d on project 2d6ee2b10f004a1085ce72c9fa8b67ff. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:37.938305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b4828773-b71d-44e2-8a19-02e801314e90 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:37.939727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b4828773-b71d-44e2-8a19-02e801314e90 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:38.047666 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2466/4923] 10.222.0.16 () {58 vars in 1466 bytes} [Mon May 2 10:36:37 2022] DELETE /identity/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff/users/79e23cfdcd5d482681f5b014d501db9d/roles/1d0c78abff934f80bfe409639da6b445 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:38.052638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed31acf-5d10-474b-ad2a-5ece9eeb9f2c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:38.054715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3ed31acf-5d10-474b-ad2a-5ece9eeb9f2c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:38.074975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed31acf-5d10-474b-ad2a-5ece9eeb9f2c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:38.203900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503348c-be4d-44f8-bb2f-3a64a790c951 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:38.204570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503348c-be4d-44f8-bb2f-3a64a790c951 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:38.204876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503348c-be4d-44f8-bb2f-3a64a790c951 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:38.205157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503348c-be4d-44f8-bb2f-3a64a790c951 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/system/users/79e23cfdcd5d482681f5b014d501db9d/roles/1d0c78abff934f80bfe409639da6b445` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:38.209498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503348c-be4d-44f8-bb2f-3a64a790c951 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=79e23cfdcd5d482681f5b014d501db9d, role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:38.210542 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-a503348c-be4d-44f8-bb2f-3a64a790c951 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:38.210542 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:38.210542 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:38.211902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503348c-be4d-44f8-bb2f-3a64a790c951 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:38.272816 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2458/4924] 10.222.0.16 () {60 vars in 1377 bytes} [Mon May 2 10:36:38 2022] PUT /identity/v3/system/users/79e23cfdcd5d482681f5b014d501db9d/roles/1d0c78abff934f80bfe409639da6b445 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:38.283548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4828773-b71d-44e2-8a19-02e801314e90 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:38.288115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4828773-b71d-44e2-8a19-02e801314e90 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:38.294240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79250ed-3507-4f22-8309-7b306e76d3d6 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:38.295168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79250ed-3507-4f22-8309-7b306e76d3d6 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:38.295673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79250ed-3507-4f22-8309-7b306e76d3d6 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:38.295786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79250ed-3507-4f22-8309-7b306e76d3d6 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/system/users/79e23cfdcd5d482681f5b014d501db9d/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:38.297054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79250ed-3507-4f22-8309-7b306e76d3d6 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=79e23cfdcd5d482681f5b014d501db9d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:38.305856 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-b79250ed-3507-4f22-8309-7b306e76d3d6 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:38.305856 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:38.305856 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:38.307920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79250ed-3507-4f22-8309-7b306e76d3d6 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:38.341691 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2467/4925] 10.222.0.16 () {58 vars in 1259 bytes} [Mon May 2 10:36:38 2022] GET /identity/v3/system/users/79e23cfdcd5d482681f5b014d501db9d/roles => generated 374 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:38.346314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503348c-be4d-44f8-bb2f-3a64a790c951 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:38.357643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503348c-be4d-44f8-bb2f-3a64a790c951 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:38.364068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea56ee-b241-4998-8ab0-04342916fc92 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:38.366033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea56ee-b241-4998-8ab0-04342916fc92 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:38.366327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea56ee-b241-4998-8ab0-04342916fc92 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:38.366825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea56ee-b241-4998-8ab0-04342916fc92 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/system/users/79e23cfdcd5d482681f5b014d501db9d/roles/1d0c78abff934f80bfe409639da6b445` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:38.369140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea56ee-b241-4998-8ab0-04342916fc92 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=79e23cfdcd5d482681f5b014d501db9d, role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:38.370499 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-60ea56ee-b241-4998-8ab0-04342916fc92 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:38.370499 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:38.370499 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:38.371859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea56ee-b241-4998-8ab0-04342916fc92 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:38.379369 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2459/4926] 10.222.0.16 () {58 vars in 1359 bytes} [Mon May 2 10:36:38 2022] HEAD /identity/v3/system/users/79e23cfdcd5d482681f5b014d501db9d/roles/1d0c78abff934f80bfe409639da6b445 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:38.383374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79250ed-3507-4f22-8309-7b306e76d3d6 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:38.404167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79250ed-3507-4f22-8309-7b306e76d3d6 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:38.417568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53948666-8add-4c37-adf0-64847a4afd9e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:38.418572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53948666-8add-4c37-adf0-64847a4afd9e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:38.418868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53948666-8add-4c37-adf0-64847a4afd9e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:38.419150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53948666-8add-4c37-adf0-64847a4afd9e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/system/users/79e23cfdcd5d482681f5b014d501db9d/roles/1d0c78abff934f80bfe409639da6b445` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:38.423244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53948666-8add-4c37-adf0-64847a4afd9e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=79e23cfdcd5d482681f5b014d501db9d, role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:38.423244 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-53948666-8add-4c37-adf0-64847a4afd9e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:38.423244 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:38.423244 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:38.424633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53948666-8add-4c37-adf0-64847a4afd9e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:38.498265 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2468/4927] 10.222.0.16 () {58 vars in 1361 bytes} [Mon May 2 10:36:38 2022] DELETE /identity/v3/system/users/79e23cfdcd5d482681f5b014d501db9d/roles/1d0c78abff934f80bfe409639da6b445 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:38.499603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea56ee-b241-4998-8ab0-04342916fc92 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:38.511774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea56ee-b241-4998-8ab0-04342916fc92 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:38.517565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26999c9c-a8c8-428c-b555-895b344f058b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:38.518468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26999c9c-a8c8-428c-b555-895b344f058b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:38.518764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26999c9c-a8c8-428c-b555-895b344f058b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:38.519051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26999c9c-a8c8-428c-b555-895b344f058b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:38.519807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26999c9c-a8c8-428c-b555-895b344f058b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:38.526239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26999c9c-a8c8-428c-b555-895b344f058b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:38.616848 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2460/4928] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:36:38 2022] POST /identity/v3/roles => generated 270 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:38.621425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53948666-8add-4c37-adf0-64847a4afd9e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:38.634198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53948666-8add-4c37-adf0-64847a4afd9e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:38.641759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afce0b-7e1a-4b01-8ad3-ded8eefba82e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:38.641759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afce0b-7e1a-4b01-8ad3-ded8eefba82e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:38.641759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afce0b-7e1a-4b01-8ad3-ded8eefba82e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:38.642314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afce0b-7e1a-4b01-8ad3-ded8eefba82e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:38.642314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afce0b-7e1a-4b01-8ad3-ded8eefba82e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:38.643321 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-33afce0b-7e1a-4b01-8ad3-ded8eefba82e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:38.643321 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:38.643321 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:38.644219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afce0b-7e1a-4b01-8ad3-ded8eefba82e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:38.743463 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2469/4929] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:36:38 2022] POST /identity/v3/roles => generated 270 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:38.745226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26999c9c-a8c8-428c-b555-895b344f058b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:38.756214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26999c9c-a8c8-428c-b555-895b344f058b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:38.765584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec60a77-cbb7-42ba-8019-9907a5e100ad tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:38.766793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec60a77-cbb7-42ba-8019-9907a5e100ad tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:38.767252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec60a77-cbb7-42ba-8019-9907a5e100ad tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:38.767928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec60a77-cbb7-42ba-8019-9907a5e100ad tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/64d614ae9ce440878702f50d94537f1e/implies/3f41ad8a166b40b48b33c0a53c22d34e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:38.776195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec60a77-cbb7-42ba-8019-9907a5e100ad tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=64d614ae9ce440878702f50d94537f1e, implied_role_id=3f41ad8a166b40b48b33c0a53c22d34e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:38.781509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec60a77-cbb7-42ba-8019-9907a5e100ad tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:38.954300 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2461/4930] 10.222.0.16 () {60 vars in 1362 bytes} [Mon May 2 10:36:38 2022] PUT /identity/v3/roles/64d614ae9ce440878702f50d94537f1e/implies/3f41ad8a166b40b48b33c0a53c22d34e => generated 531 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:38.957688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afce0b-7e1a-4b01-8ad3-ded8eefba82e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:38.969674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afce0b-7e1a-4b01-8ad3-ded8eefba82e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:39.069669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa3e6f-5535-4790-9d6a-79cfdd6a73fb tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:39.070361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa3e6f-5535-4790-9d6a-79cfdd6a73fb tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:39.070817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa3e6f-5535-4790-9d6a-79cfdd6a73fb tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:39.071440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa3e6f-5535-4790-9d6a-79cfdd6a73fb tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:39.072300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa3e6f-5535-4790-9d6a-79cfdd6a73fb tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:39.074050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa3e6f-5535-4790-9d6a-79cfdd6a73fb tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:39.206971 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2470/4931] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:36:38 2022] POST /identity/v3/domains => generated 276 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:36:39.208096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec60a77-cbb7-42ba-8019-9907a5e100ad tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:39.225634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec60a77-cbb7-42ba-8019-9907a5e100ad tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:39.289382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa3e9c-bf0f-4ee0-8de4-69dc55a5bb2d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:39.290111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa3e9c-bf0f-4ee0-8de4-69dc55a5bb2d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:39.290418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa3e9c-bf0f-4ee0-8de4-69dc55a5bb2d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:39.290697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa3e9c-bf0f-4ee0-8de4-69dc55a5bb2d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:39.291465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa3e9c-bf0f-4ee0-8de4-69dc55a5bb2d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:39.293141 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa3e9c-bf0f-4ee0-8de4-69dc55a5bb2d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:39.329935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec08b2-7332-4f88-9c82-903b03225649 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:39.330486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec08b2-7332-4f88-9c82-903b03225649 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:39.330748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec08b2-7332-4f88-9c82-903b03225649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:39.369043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1fec08b2-7332-4f88-9c82-903b03225649 None None] MFA Rules not processed for user `aa1943e65db34e1da273b41c8a3d2faf`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:39.370366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1fec08b2-7332-4f88-9c82-903b03225649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:39.398376 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2462/4932] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:36:39 2022] POST /identity/v3/roles => generated 269 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:39.399332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa3e9c-bf0f-4ee0-8de4-69dc55a5bb2d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:39.416445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa3e9c-bf0f-4ee0-8de4-69dc55a5bb2d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:39.423951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0382f4-4b2f-46e9-9fe1-89ce6956fa0e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:39.425218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0382f4-4b2f-46e9-9fe1-89ce6956fa0e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:39.425657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0382f4-4b2f-46e9-9fe1-89ce6956fa0e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:39.426008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0382f4-4b2f-46e9-9fe1-89ce6956fa0e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/64d614ae9ce440878702f50d94537f1e/implies/2f1b377311d94483a58949946131bc1d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:39.428772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0382f4-4b2f-46e9-9fe1-89ce6956fa0e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=64d614ae9ce440878702f50d94537f1e, implied_role_id=2f1b377311d94483a58949946131bc1d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:39.431338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0382f4-4b2f-46e9-9fe1-89ce6956fa0e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:39.502451 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2471/4933] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:36:39.597770 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2463/4934] 10.222.0.16 () {60 vars in 1362 bytes} [Mon May 2 10:36:39 2022] PUT /identity/v3/roles/64d614ae9ce440878702f50d94537f1e/implies/2f1b377311d94483a58949946131bc1d => generated 530 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:39.603410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec08b2-7332-4f88-9c82-903b03225649 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:39.615161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec08b2-7332-4f88-9c82-903b03225649 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:39.706715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b534796-51f3-4c12-b55a-9648ced0857c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:39.707593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b534796-51f3-4c12-b55a-9648ced0857c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:39.707884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b534796-51f3-4c12-b55a-9648ced0857c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:39.708166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b534796-51f3-4c12-b55a-9648ced0857c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/64d614ae9ce440878702f50d94537f1e/implies/1d0c78abff934f80bfe409639da6b445` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:39.710013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b534796-51f3-4c12-b55a-9648ced0857c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=64d614ae9ce440878702f50d94537f1e, implied_role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:39.711039 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-1b534796-51f3-4c12-b55a-9648ced0857c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:39.711039 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:39.711039 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:39.711930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b534796-51f3-4c12-b55a-9648ced0857c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:39.821575 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2472/4935] 10.222.0.16 () {60 vars in 1362 bytes} [Mon May 2 10:36:39 2022] PUT /identity/v3/roles/64d614ae9ce440878702f50d94537f1e/implies/1d0c78abff934f80bfe409639da6b445 => generated 525 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:36:39.825956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0382f4-4b2f-46e9-9fe1-89ce6956fa0e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:39.837343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0382f4-4b2f-46e9-9fe1-89ce6956fa0e tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:39.898304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98701d0-ec6a-474f-822c-e377cc7eec4c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:39.903632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98701d0-ec6a-474f-822c-e377cc7eec4c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:39.903632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98701d0-ec6a-474f-822c-e377cc7eec4c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:39.903632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98701d0-ec6a-474f-822c-e377cc7eec4c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/1d0c78abff934f80bfe409639da6b445/implies/64d614ae9ce440878702f50d94537f1e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:39.903632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98701d0-ec6a-474f-822c-e377cc7eec4c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=1d0c78abff934f80bfe409639da6b445, implied_role_id=64d614ae9ce440878702f50d94537f1e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:39.904092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98701d0-ec6a-474f-822c-e377cc7eec4c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:39.933205 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-d98701d0-ec6a-474f-822c-e377cc7eec4c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] 64d614ae9ce440878702f50d94537f1e cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 64d614ae9ce440878702f50d94537f1e cannot be an implied roles. May 02 10:36:39.933205 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:39.933205 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:36:39.933205 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:36:39.933205 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:36:39.933205 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:36:39.933205 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:36:39.933205 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:36:39.933205 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:36:39.933205 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:36:39.933205 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:36:39.933205 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:36:39.933205 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put May 02 10:36:39.933205 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) May 02 10:36:39.934462 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:36:39.934462 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:36:39.934462 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role May 02 10:36:39.934462 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, May 02 10:36:39.934462 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 64d614ae9ce440878702f50d94537f1e cannot be an implied roles. May 02 10:36:39.934462 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:39.938429 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2464/4936] 10.222.0.16 () {60 vars in 1362 bytes} [Mon May 2 10:36:39 2022] PUT /identity/v3/roles/1d0c78abff934f80bfe409639da6b445/implies/64d614ae9ce440878702f50d94537f1e => generated 116 bytes in 109 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) May 02 10:36:39.938995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b534796-51f3-4c12-b55a-9648ced0857c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:39.954308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b534796-51f3-4c12-b55a-9648ced0857c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:39.966971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113b3f1-7c31-4ac4-94a3-4d507f748564 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:39.968819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113b3f1-7c31-4ac4-94a3-4d507f748564 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:39.969426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113b3f1-7c31-4ac4-94a3-4d507f748564 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:39.969737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113b3f1-7c31-4ac4-94a3-4d507f748564 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/64d614ae9ce440878702f50d94537f1e/implies/1d0c78abff934f80bfe409639da6b445` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:39.973155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113b3f1-7c31-4ac4-94a3-4d507f748564 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=64d614ae9ce440878702f50d94537f1e, implied_role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:39.974436 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-4113b3f1-7c31-4ac4-94a3-4d507f748564 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:39.974436 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:39.974436 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:39.976036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113b3f1-7c31-4ac4-94a3-4d507f748564 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:40.059365 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2473/4937] 10.222.0.16 () {58 vars in 1346 bytes} [Mon May 2 10:36:39 2022] DELETE /identity/v3/roles/64d614ae9ce440878702f50d94537f1e/implies/1d0c78abff934f80bfe409639da6b445 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:40.060581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98701d0-ec6a-474f-822c-e377cc7eec4c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:40.071516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98701d0-ec6a-474f-822c-e377cc7eec4c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:40.134228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5ba27-1778-43dc-a6a8-0f872ef7b914 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:40.135165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5ba27-1778-43dc-a6a8-0f872ef7b914 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:40.135457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5ba27-1778-43dc-a6a8-0f872ef7b914 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:40.135732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5ba27-1778-43dc-a6a8-0f872ef7b914 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/64d614ae9ce440878702f50d94537f1e/implies/2f1b377311d94483a58949946131bc1d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:40.137540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5ba27-1778-43dc-a6a8-0f872ef7b914 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=64d614ae9ce440878702f50d94537f1e, implied_role_id=2f1b377311d94483a58949946131bc1d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:40.139812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5ba27-1778-43dc-a6a8-0f872ef7b914 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:40.225469 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2465/4938] 10.222.0.16 () {58 vars in 1346 bytes} [Mon May 2 10:36:40 2022] DELETE /identity/v3/roles/64d614ae9ce440878702f50d94537f1e/implies/2f1b377311d94483a58949946131bc1d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:40.229592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113b3f1-7c31-4ac4-94a3-4d507f748564 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:40.240912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113b3f1-7c31-4ac4-94a3-4d507f748564 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:40.374982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee8256-0c30-4792-bdef-b2a2af225b07 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:40.376123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee8256-0c30-4792-bdef-b2a2af225b07 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:40.376442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee8256-0c30-4792-bdef-b2a2af225b07 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:40.377394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee8256-0c30-4792-bdef-b2a2af225b07 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/2f1b377311d94483a58949946131bc1d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:40.378909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee8256-0c30-4792-bdef-b2a2af225b07 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=2f1b377311d94483a58949946131bc1d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:40.380162 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-59ee8256-0c30-4792-bdef-b2a2af225b07 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:40.380162 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:40.380162 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:40.381114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee8256-0c30-4792-bdef-b2a2af225b07 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:40.519266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-59ee8256-0c30-4792-bdef-b2a2af225b07 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invalidating the token cache because role 2f1b377311d94483a58949946131bc1d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:40.519569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-59ee8256-0c30-4792-bdef-b2a2af225b07 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:40.520524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-59ee8256-0c30-4792-bdef-b2a2af225b07 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:40.525519 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2474/4939] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:40 2022] DELETE /identity/v3/roles/2f1b377311d94483a58949946131bc1d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:40.527661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5ba27-1778-43dc-a6a8-0f872ef7b914 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:40.530222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6ee5ba27-1778-43dc-a6a8-0f872ef7b914 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:40.560326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5ba27-1778-43dc-a6a8-0f872ef7b914 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:40.661706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f732b2-1f82-4d49-bb80-e8525645448d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:40.662929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f732b2-1f82-4d49-bb80-e8525645448d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:40.663222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f732b2-1f82-4d49-bb80-e8525645448d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:40.663499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f732b2-1f82-4d49-bb80-e8525645448d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/domains/494dcc73897b4f6aa90362571b3b8423` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:40.675958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f732b2-1f82-4d49-bb80-e8525645448d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=494dcc73897b4f6aa90362571b3b8423)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:40.677237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f732b2-1f82-4d49-bb80-e8525645448d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:40.700620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-35f732b2-1f82-4d49-bb80-e8525645448d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '494dcc73897b4f6aa90362571b3b8423'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:40.701491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-35f732b2-1f82-4d49-bb80-e8525645448d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '494dcc73897b4f6aa90362571b3b8423'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:40.793859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-35f732b2-1f82-4d49-bb80-e8525645448d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '494dcc73897b4f6aa90362571b3b8423'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:40.799606 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-35f732b2-1f82-4d49-bb80-e8525645448d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '494dcc73897b4f6aa90362571b3b8423'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:40.803548 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2466/4940] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:36:40 2022] PATCH /identity/v3/domains/494dcc73897b4f6aa90362571b3b8423 => generated 277 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:40.807418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee8256-0c30-4792-bdef-b2a2af225b07 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:40.833040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee8256-0c30-4792-bdef-b2a2af225b07 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:40.940042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:40.941949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:40.942365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:40.942784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/domains/494dcc73897b4f6aa90362571b3b8423` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:40.958751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=494dcc73897b4f6aa90362571b3b8423)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:40.960428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:40.986894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '494dcc73897b4f6aa90362571b3b8423'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:40.990393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '494dcc73897b4f6aa90362571b3b8423'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:41.185130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '494dcc73897b4f6aa90362571b3b8423', 'request_id': 'req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:41.246769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '494dcc73897b4f6aa90362571b3b8423', 'request_id': 'req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:41.265623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '494dcc73897b4f6aa90362571b3b8423', 'request_id': 'req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:41.304104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] The token cache is being invalidate because project 494dcc73897b4f6aa90362571b3b8423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:41.305378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:41.308751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:41.334209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '494dcc73897b4f6aa90362571b3b8423', 'request_id': 'req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:41.335300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '494dcc73897b4f6aa90362571b3b8423', 'request_id': 'req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:41.341234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '494dcc73897b4f6aa90362571b3b8423', 'request_id': 'req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:41.357909 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2475/4941] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:36:40 2022] DELETE /identity/v3/domains/494dcc73897b4f6aa90362571b3b8423 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:41.362114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f732b2-1f82-4d49-bb80-e8525645448d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:41.364445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-35f732b2-1f82-4d49-bb80-e8525645448d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:41.413846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f732b2-1f82-4d49-bb80-e8525645448d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:41.480625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ee56e-c841-4ccb-bc13-8ec46f927482 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:41.481698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ee56e-c841-4ccb-bc13-8ec46f927482 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:41.482046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ee56e-c841-4ccb-bc13-8ec46f927482 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:41.483070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ee56e-c841-4ccb-bc13-8ec46f927482 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/64d614ae9ce440878702f50d94537f1e/implies/3f41ad8a166b40b48b33c0a53c22d34e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:41.484695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ee56e-c841-4ccb-bc13-8ec46f927482 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=64d614ae9ce440878702f50d94537f1e, implied_role_id=3f41ad8a166b40b48b33c0a53c22d34e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:41.486528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ee56e-c841-4ccb-bc13-8ec46f927482 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:41.592008 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2467/4942] 10.222.0.16 () {58 vars in 1346 bytes} [Mon May 2 10:36:41 2022] DELETE /identity/v3/roles/64d614ae9ce440878702f50d94537f1e/implies/3f41ad8a166b40b48b33c0a53c22d34e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:41.596509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:41.598097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:41.620256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c0e4b-0e65-4d64-bf20-4f5a6d2e7404 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:41.700967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a7d61-07bc-4601-af1a-e2ac49ac143a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:41.702167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a7d61-07bc-4601-af1a-e2ac49ac143a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:41.703242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a7d61-07bc-4601-af1a-e2ac49ac143a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:41.703841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a7d61-07bc-4601-af1a-e2ac49ac143a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/3f41ad8a166b40b48b33c0a53c22d34e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:41.706680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a7d61-07bc-4601-af1a-e2ac49ac143a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=3f41ad8a166b40b48b33c0a53c22d34e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:41.708429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a7d61-07bc-4601-af1a-e2ac49ac143a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:41.826856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4b1a7d61-07bc-4601-af1a-e2ac49ac143a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invalidating the token cache because role 3f41ad8a166b40b48b33c0a53c22d34e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:41.827161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4b1a7d61-07bc-4601-af1a-e2ac49ac143a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:41.837934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4b1a7d61-07bc-4601-af1a-e2ac49ac143a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:41.852574 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2476/4943] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:41 2022] DELETE /identity/v3/roles/3f41ad8a166b40b48b33c0a53c22d34e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:41.857318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ee56e-c841-4ccb-bc13-8ec46f927482 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:41.859623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-211ee56e-c841-4ccb-bc13-8ec46f927482 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:41.884437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ee56e-c841-4ccb-bc13-8ec46f927482 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:42.038015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33828f-8da7-4f56-bae0-486faff8f4a1 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:42.038914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33828f-8da7-4f56-bae0-486faff8f4a1 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:42.039243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33828f-8da7-4f56-bae0-486faff8f4a1 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:42.042343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33828f-8da7-4f56-bae0-486faff8f4a1 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/64d614ae9ce440878702f50d94537f1e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:42.058660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33828f-8da7-4f56-bae0-486faff8f4a1 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=64d614ae9ce440878702f50d94537f1e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:42.058660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33828f-8da7-4f56-bae0-486faff8f4a1 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:42.273546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1f33828f-8da7-4f56-bae0-486faff8f4a1 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invalidating the token cache because role 64d614ae9ce440878702f50d94537f1e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:42.273842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1f33828f-8da7-4f56-bae0-486faff8f4a1 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:42.274526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1f33828f-8da7-4f56-bae0-486faff8f4a1 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:42.276945 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2468/4944] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:41 2022] DELETE /identity/v3/roles/64d614ae9ce440878702f50d94537f1e => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:42.283258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a7d61-07bc-4601-af1a-e2ac49ac143a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:42.311307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a7d61-07bc-4601-af1a-e2ac49ac143a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:42.379615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abab8b9-8140-4e64-baf8-f8e5dd5e86d3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:42.380926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abab8b9-8140-4e64-baf8-f8e5dd5e86d3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:42.381458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abab8b9-8140-4e64-baf8-f8e5dd5e86d3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:42.381899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abab8b9-8140-4e64-baf8-f8e5dd5e86d3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:42.384135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abab8b9-8140-4e64-baf8-f8e5dd5e86d3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5ebc102e533e46c4afab9b94c70fe742, implied_role_id=29ae2d1e301c43dcb4d7584f3670224e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:42.385962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abab8b9-8140-4e64-baf8-f8e5dd5e86d3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:42.545893 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2477/4945] 10.222.0.16 () {60 vars in 1362 bytes} [Mon May 2 10:36:42 2022] PUT /identity/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e => generated 521 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:42.546091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33828f-8da7-4f56-bae0-486faff8f4a1 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:42.548157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1f33828f-8da7-4f56-bae0-486faff8f4a1 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:42.571851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33828f-8da7-4f56-bae0-486faff8f4a1 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:42.661386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099ba9b-9dcc-4fdc-9ac1-851e9213c6a7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:42.662326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099ba9b-9dcc-4fdc-9ac1-851e9213c6a7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:42.662611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099ba9b-9dcc-4fdc-9ac1-851e9213c6a7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:42.662894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099ba9b-9dcc-4fdc-9ac1-851e9213c6a7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:42.664787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099ba9b-9dcc-4fdc-9ac1-851e9213c6a7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=5ebc102e533e46c4afab9b94c70fe742, implied_role_id=29ae2d1e301c43dcb4d7584f3670224e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:42.665838 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-4099ba9b-9dcc-4fdc-9ac1-851e9213c6a7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:42.665838 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:42.665838 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:42.666722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099ba9b-9dcc-4fdc-9ac1-851e9213c6a7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:42.667733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099ba9b-9dcc-4fdc-9ac1-851e9213c6a7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=5ebc102e533e46c4afab9b94c70fe742, implied_role_id=29ae2d1e301c43dcb4d7584f3670224e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:42.673162 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-4099ba9b-9dcc-4fdc-9ac1-851e9213c6a7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:42.673162 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:42.673162 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:42.675424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099ba9b-9dcc-4fdc-9ac1-851e9213c6a7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:42.687717 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2469/4946] 10.222.0.16 () {58 vars in 1344 bytes} [Mon May 2 10:36:42 2022] HEAD /identity/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:42.688687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abab8b9-8140-4e64-baf8-f8e5dd5e86d3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:42.700052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abab8b9-8140-4e64-baf8-f8e5dd5e86d3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:42.706414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb99df-d1d6-4ccb-a8bf-b62c69ab6637 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:42.708648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb99df-d1d6-4ccb-a8bf-b62c69ab6637 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:42.708648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb99df-d1d6-4ccb-a8bf-b62c69ab6637 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:42.708648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb99df-d1d6-4ccb-a8bf-b62c69ab6637 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:42.710257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb99df-d1d6-4ccb-a8bf-b62c69ab6637 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=5ebc102e533e46c4afab9b94c70fe742, implied_role_id=29ae2d1e301c43dcb4d7584f3670224e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:42.711174 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-7dbb99df-d1d6-4ccb-a8bf-b62c69ab6637 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:42.711174 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:42.711174 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:42.712904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb99df-d1d6-4ccb-a8bf-b62c69ab6637 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:42.738620 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2478/4947] 10.222.0.16 () {58 vars in 1343 bytes} [Mon May 2 10:36:42 2022] GET /identity/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e => generated 521 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:42.740351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099ba9b-9dcc-4fdc-9ac1-851e9213c6a7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:42.756773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099ba9b-9dcc-4fdc-9ac1-851e9213c6a7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:42.762511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bfe44-1272-4322-9420-bce6538431ae tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:42.763432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bfe44-1272-4322-9420-bce6538431ae tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:42.763716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bfe44-1272-4322-9420-bce6538431ae tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:42.763995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bfe44-1272-4322-9420-bce6538431ae tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:42.766371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7bfe44-1272-4322-9420-bce6538431ae tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5ebc102e533e46c4afab9b94c70fe742, implied_role_id=29ae2d1e301c43dcb4d7584f3670224e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:42.768023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7bfe44-1272-4322-9420-bce6538431ae tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:42.864250 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2470/4948] 10.222.0.16 () {58 vars in 1346 bytes} [Mon May 2 10:36:42 2022] DELETE /identity/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:42.868484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb99df-d1d6-4ccb-a8bf-b62c69ab6637 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:42.881256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb99df-d1d6-4ccb-a8bf-b62c69ab6637 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:42.997272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e760b-494c-414c-9931-f6f1f92a2871 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:42.998412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e760b-494c-414c-9931-f6f1f92a2871 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:42.998810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e760b-494c-414c-9931-f6f1f92a2871 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:42.999952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e760b-494c-414c-9931-f6f1f92a2871 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:43.002665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e760b-494c-414c-9931-f6f1f92a2871 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=5ebc102e533e46c4afab9b94c70fe742, implied_role_id=29ae2d1e301c43dcb4d7584f3670224e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:43.004576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e760b-494c-414c-9931-f6f1f92a2871 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:43.025808 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-024e760b-494c-414c-9931-f6f1f92a2871 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] 5ebc102e533e46c4afab9b94c70fe742 does not imply 29ae2d1e301c43dcb4d7584f3670224e.: keystone.exception.ImpliedRoleNotFound: 5ebc102e533e46c4afab9b94c70fe742 does not imply 29ae2d1e301c43dcb4d7584f3670224e. May 02 10:36:43.025808 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:43.025808 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role May 02 10:36:43.025808 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = query.one() May 02 10:36:43.025808 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one May 02 10:36:43.025808 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._iter().one() May 02 10:36:43.025808 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one May 02 10:36:43.025808 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._only_one_row( May 02 10:36:43.025808 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row May 02 10:36:43.025808 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exc.NoResultFound( May 02 10:36:43.025808 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required May 02 10:36:43.025808 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:43.025808 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:36:43.025808 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:43.025808 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:43.025808 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:36:43.029331 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:36:43.029331 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:36:43.029331 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:36:43.029331 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:36:43.029331 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:36:43.029331 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:36:43.029331 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:36:43.029331 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:36:43.029331 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:36:43.029331 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get May 02 10:36:43.029331 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) May 02 10:36:43.029331 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role May 02 10:36:43.029331 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( May 02 10:36:43.029331 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role May 02 10:36:43.029331 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, May 02 10:36:43.029331 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role May 02 10:36:43.030639 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( May 02 10:36:43.030639 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 5ebc102e533e46c4afab9b94c70fe742 does not imply 29ae2d1e301c43dcb4d7584f3670224e. May 02 10:36:43.030639 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:36:43.030639 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2479/4949] 10.222.0.16 () {58 vars in 1343 bytes} [Mon May 2 10:36:42 2022] GET /identity/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e => generated 137 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 02 10:36:43.032303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bfe44-1272-4322-9420-bce6538431ae tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:43.044077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7bfe44-1272-4322-9420-bce6538431ae tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:43.050426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6037d90-5f16-4390-b30f-754047d450a3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:43.056805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6037d90-5f16-4390-b30f-754047d450a3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:43.056805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6037d90-5f16-4390-b30f-754047d450a3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:43.056805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6037d90-5f16-4390-b30f-754047d450a3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:43.056805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6037d90-5f16-4390-b30f-754047d450a3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5ebc102e533e46c4afab9b94c70fe742, implied_role_id=29ae2d1e301c43dcb4d7584f3670224e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:43.057281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6037d90-5f16-4390-b30f-754047d450a3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:43.074480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-c6037d90-5f16-4390-b30f-754047d450a3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] 5ebc102e533e46c4afab9b94c70fe742 does not imply 29ae2d1e301c43dcb4d7584f3670224e.: keystone.exception.ImpliedRoleNotFound: 5ebc102e533e46c4afab9b94c70fe742 does not imply 29ae2d1e301c43dcb4d7584f3670224e. May 02 10:36:43.074480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:43.074480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role May 02 10:36:43.074480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = query.one() May 02 10:36:43.074480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one May 02 10:36:43.074480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._iter().one() May 02 10:36:43.074480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one May 02 10:36:43.074480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._only_one_row( May 02 10:36:43.074480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row May 02 10:36:43.074480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exc.NoResultFound( May 02 10:36:43.074480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required May 02 10:36:43.074480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:43.074480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:36:43.074480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:43.074480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:43.074480 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:36:43.075880 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:36:43.075880 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:36:43.075880 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:36:43.075880 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:36:43.075880 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:36:43.075880 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:36:43.075880 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:36:43.075880 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:36:43.075880 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:36:43.075880 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete May 02 10:36:43.075880 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) May 02 10:36:43.075880 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:36:43.075880 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:36:43.075880 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role May 02 10:36:43.075880 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) May 02 10:36:43.075880 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role May 02 10:36:43.077238 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, May 02 10:36:43.077238 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role May 02 10:36:43.077238 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( May 02 10:36:43.077238 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 5ebc102e533e46c4afab9b94c70fe742 does not imply 29ae2d1e301c43dcb4d7584f3670224e. May 02 10:36:43.077238 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:43.080760 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2471/4950] 10.222.0.16 () {58 vars in 1346 bytes} [Mon May 2 10:36:43 2022] DELETE /identity/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e => generated 137 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:36:43.085476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e760b-494c-414c-9931-f6f1f92a2871 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:43.095881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e760b-494c-414c-9931-f6f1f92a2871 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:43.101720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b19fb-a1e9-45a1-8bc2-ea1f427c90b1 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:43.103220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b19fb-a1e9-45a1-8bc2-ea1f427c90b1 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:43.103603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b19fb-a1e9-45a1-8bc2-ea1f427c90b1 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:43.103976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b19fb-a1e9-45a1-8bc2-ea1f427c90b1 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:43.105948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b19fb-a1e9-45a1-8bc2-ea1f427c90b1 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5ebc102e533e46c4afab9b94c70fe742, implied_role_id=29ae2d1e301c43dcb4d7584f3670224e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:43.107626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b19fb-a1e9-45a1-8bc2-ea1f427c90b1 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:43.299293 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2480/4951] 10.222.0.16 () {60 vars in 1362 bytes} [Mon May 2 10:36:43 2022] PUT /identity/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e => generated 521 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:43.299666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6037d90-5f16-4390-b30f-754047d450a3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:43.312943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6037d90-5f16-4390-b30f-754047d450a3 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:43.420284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18586c2-ddc4-4dc6-b699-5d55e67c1869 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:43.422021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18586c2-ddc4-4dc6-b699-5d55e67c1869 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:43.423263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18586c2-ddc4-4dc6-b699-5d55e67c1869 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:43.423788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18586c2-ddc4-4dc6-b699-5d55e67c1869 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/35bc447f4309488aa2abe5ac7e55e27f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:43.427229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18586c2-ddc4-4dc6-b699-5d55e67c1869 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5ebc102e533e46c4afab9b94c70fe742, implied_role_id=35bc447f4309488aa2abe5ac7e55e27f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:43.429508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18586c2-ddc4-4dc6-b699-5d55e67c1869 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:43.568238 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2472/4952] 10.222.0.16 () {60 vars in 1362 bytes} [Mon May 2 10:36:43 2022] PUT /identity/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/35bc447f4309488aa2abe5ac7e55e27f => generated 519 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:36:43.573141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b19fb-a1e9-45a1-8bc2-ea1f427c90b1 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:43.590095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b19fb-a1e9-45a1-8bc2-ea1f427c90b1 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:43.711950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457a367-063f-4c02-8a75-66b3481097a5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:43.713578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457a367-063f-4c02-8a75-66b3481097a5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:43.713578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457a367-063f-4c02-8a75-66b3481097a5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:43.713819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457a367-063f-4c02-8a75-66b3481097a5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/35bc447f4309488aa2abe5ac7e55e27f/implies/1d0c78abff934f80bfe409639da6b445` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:43.717418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457a367-063f-4c02-8a75-66b3481097a5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=35bc447f4309488aa2abe5ac7e55e27f, implied_role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:43.718908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457a367-063f-4c02-8a75-66b3481097a5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:43.909822 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2481/4953] 10.222.0.16 () {60 vars in 1362 bytes} [Mon May 2 10:36:43 2022] PUT /identity/v3/roles/35bc447f4309488aa2abe5ac7e55e27f/implies/1d0c78abff934f80bfe409639da6b445 => generated 518 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:43.913919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18586c2-ddc4-4dc6-b699-5d55e67c1869 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:43.928485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18586c2-ddc4-4dc6-b699-5d55e67c1869 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:44.007166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4fc97-3243-4654-8fda-4a6104ae7fc7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:44.007835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4fc97-3243-4654-8fda-4a6104ae7fc7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:44.008121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4fc97-3243-4654-8fda-4a6104ae7fc7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:44.008533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4fc97-3243-4654-8fda-4a6104ae7fc7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:44.009256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4fc97-3243-4654-8fda-4a6104ae7fc7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:44.010345 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-1ca4fc97-3243-4654-8fda-4a6104ae7fc7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:44.010345 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:44.010345 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:44.011241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4fc97-3243-4654-8fda-4a6104ae7fc7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:44.036320 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2473/4954] 10.222.0.16 () {58 vars in 1151 bytes} [Mon May 2 10:36:43 2022] GET /identity/v3/role_inferences => generated 1603 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:44.037676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457a367-063f-4c02-8a75-66b3481097a5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:44.048810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457a367-063f-4c02-8a75-66b3481097a5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:44.055236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19477fcf-50ed-4b2e-ae20-c4dde9123f88 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:44.056198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19477fcf-50ed-4b2e-ae20-c4dde9123f88 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:44.056471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19477fcf-50ed-4b2e-ae20-c4dde9123f88 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:44.056801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19477fcf-50ed-4b2e-ae20-c4dde9123f88 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/35bc447f4309488aa2abe5ac7e55e27f/implies/1d0c78abff934f80bfe409639da6b445` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:44.058687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19477fcf-50ed-4b2e-ae20-c4dde9123f88 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=35bc447f4309488aa2abe5ac7e55e27f, implied_role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:44.063764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19477fcf-50ed-4b2e-ae20-c4dde9123f88 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:44.136418 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2482/4955] 10.222.0.16 () {58 vars in 1346 bytes} [Mon May 2 10:36:44 2022] DELETE /identity/v3/roles/35bc447f4309488aa2abe5ac7e55e27f/implies/1d0c78abff934f80bfe409639da6b445 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:44.137627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4fc97-3243-4654-8fda-4a6104ae7fc7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:44.154254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4fc97-3243-4654-8fda-4a6104ae7fc7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:44.241782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19477fcf-50ed-4b2e-ae20-c4dde9123f88 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:44.243566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-19477fcf-50ed-4b2e-ae20-c4dde9123f88 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:44.266437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945752e-8a51-47ea-ac60-5e2cca1b7a75 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:44.268113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945752e-8a51-47ea-ac60-5e2cca1b7a75 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:44.268113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945752e-8a51-47ea-ac60-5e2cca1b7a75 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:44.268113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945752e-8a51-47ea-ac60-5e2cca1b7a75 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/35bc447f4309488aa2abe5ac7e55e27f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:44.270365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945752e-8a51-47ea-ac60-5e2cca1b7a75 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5ebc102e533e46c4afab9b94c70fe742, implied_role_id=35bc447f4309488aa2abe5ac7e55e27f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:44.274288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945752e-8a51-47ea-ac60-5e2cca1b7a75 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:44.348863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19477fcf-50ed-4b2e-ae20-c4dde9123f88 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:44.353820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b424c2-b239-4575-991e-331653289571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:44.354995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b424c2-b239-4575-991e-331653289571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:44.355523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b424c2-b239-4575-991e-331653289571 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:44.356026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b424c2-b239-4575-991e-331653289571 admin admin] PATH_INFO: `/v3/users/061ef885372742f0a9be8d967060ffe7` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:44.361831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b424c2-b239-4575-991e-331653289571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=061ef885372742f0a9be8d967060ffe7)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:44.363994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b424c2-b239-4575-991e-331653289571 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:44.437195 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2474/4956] 10.222.0.16 () {58 vars in 1346 bytes} [Mon May 2 10:36:44 2022] DELETE /identity/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/35bc447f4309488aa2abe5ac7e55e27f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:44.441496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945752e-8a51-47ea-ac60-5e2cca1b7a75 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:44.502323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945752e-8a51-47ea-ac60-5e2cca1b7a75 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:44.507115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d8a2c-1b19-463e-8b0c-aed2f7184dd5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:44.508119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d8a2c-1b19-463e-8b0c-aed2f7184dd5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:44.508406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d8a2c-1b19-463e-8b0c-aed2f7184dd5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:44.508786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d8a2c-1b19-463e-8b0c-aed2f7184dd5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:44.513963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d8a2c-1b19-463e-8b0c-aed2f7184dd5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5ebc102e533e46c4afab9b94c70fe742, implied_role_id=29ae2d1e301c43dcb4d7584f3670224e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:44.516314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d8a2c-1b19-463e-8b0c-aed2f7184dd5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:44.606189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-95b424c2-b239-4575-991e-331653289571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '061ef885372742f0a9be8d967060ffe7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:44.617642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-95b424c2-b239-4575-991e-331653289571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '061ef885372742f0a9be8d967060ffe7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:44.618370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-95b424c2-b239-4575-991e-331653289571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '061ef885372742f0a9be8d967060ffe7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:44.625433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-95b424c2-b239-4575-991e-331653289571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '061ef885372742f0a9be8d967060ffe7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:44.627525 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2475/4957] 10.222.0.16 () {58 vars in 1346 bytes} [Mon May 2 10:36:44 2022] DELETE /identity/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:44.629146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d8a2c-1b19-463e-8b0c-aed2f7184dd5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:44.633240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-391d8a2c-1b19-463e-8b0c-aed2f7184dd5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:44.704998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d8a2c-1b19-463e-8b0c-aed2f7184dd5 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:44.709779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7714f-60ba-465b-83cb-3f31cbe3288f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:44.710663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7714f-60ba-465b-83cb-3f31cbe3288f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:44.710952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7714f-60ba-465b-83cb-3f31cbe3288f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:44.711234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7714f-60ba-465b-83cb-3f31cbe3288f admin admin] PATH_INFO: `/v3/users/2db7a6aedbab4785a793449ecf998dd7` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:44.712457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7714f-60ba-465b-83cb-3f31cbe3288f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2db7a6aedbab4785a793449ecf998dd7)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:44.714516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7714f-60ba-465b-83cb-3f31cbe3288f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:44.744641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-95b424c2-b239-4575-991e-331653289571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '061ef885372742f0a9be8d967060ffe7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:44.753394 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2483/4958] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:44 2022] DELETE /identity/v3/users/061ef885372742f0a9be8d967060ffe7 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:44.756450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b424c2-b239-4575-991e-331653289571 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:44.756450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-95b424c2-b239-4575-991e-331653289571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:44.832412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b424c2-b239-4575-991e-331653289571 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:44.838080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30652bf-1bf9-4669-b4e1-751165b12369 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:44.838919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30652bf-1bf9-4669-b4e1-751165b12369 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:44.839249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30652bf-1bf9-4669-b4e1-751165b12369 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:44.839567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30652bf-1bf9-4669-b4e1-751165b12369 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:44.840391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30652bf-1bf9-4669-b4e1-751165b12369 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:44.842264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30652bf-1bf9-4669-b4e1-751165b12369 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:44.860295 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2484/4959] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:44 2022] GET /identity/v3/roles => generated 2321 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:44.860295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbc4c1-4cda-45cd-b4e3-85ba31c1feb5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:44.860295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbc4c1-4cda-45cd-b4e3-85ba31c1feb5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:44.860295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbc4c1-4cda-45cd-b4e3-85ba31c1feb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:44.885915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fecbc4c1-4cda-45cd-b4e3-85ba31c1feb5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:44.887277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fecbc4c1-4cda-45cd-b4e3-85ba31c1feb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:44.954609 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2485/4960] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:44.954609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbc4c1-4cda-45cd-b4e3-85ba31c1feb5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:44.964307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbc4c1-4cda-45cd-b4e3-85ba31c1feb5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:44.971266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db460bd4-cb6f-4ac0-8988-a28ddc8a5827 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:44.973005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db460bd4-cb6f-4ac0-8988-a28ddc8a5827 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:44.973005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db460bd4-cb6f-4ac0-8988-a28ddc8a5827 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:44.973241 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db460bd4-cb6f-4ac0-8988-a28ddc8a5827 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:44.974056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db460bd4-cb6f-4ac0-8988-a28ddc8a5827 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:44.977715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db460bd4-cb6f-4ac0-8988-a28ddc8a5827 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:44.987220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e6c7714f-60ba-465b-83cb-3f31cbe3288f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2db7a6aedbab4785a793449ecf998dd7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:45.000354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e6c7714f-60ba-465b-83cb-3f31cbe3288f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2db7a6aedbab4785a793449ecf998dd7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:45.001383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e6c7714f-60ba-465b-83cb-3f31cbe3288f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2db7a6aedbab4785a793449ecf998dd7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:45.008626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e6c7714f-60ba-465b-83cb-3f31cbe3288f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2db7a6aedbab4785a793449ecf998dd7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:45.113340 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2486/4961] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:36:44 2022] POST /identity/v3/roles => generated 235 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:45.114581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db460bd4-cb6f-4ac0-8988-a28ddc8a5827 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:45.117695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-db460bd4-cb6f-4ac0-8988-a28ddc8a5827 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:45.162277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e6c7714f-60ba-465b-83cb-3f31cbe3288f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2db7a6aedbab4785a793449ecf998dd7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:45.170088 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2476/4962] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:44 2022] DELETE /identity/v3/users/2db7a6aedbab4785a793449ecf998dd7 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:45.175569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7714f-60ba-465b-83cb-3f31cbe3288f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:45.177100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e6c7714f-60ba-465b-83cb-3f31cbe3288f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:45.190678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db460bd4-cb6f-4ac0-8988-a28ddc8a5827 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:45.265528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7714f-60ba-465b-83cb-3f31cbe3288f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:45.278212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970799e-3edb-4110-96e6-57352bf36666 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:45.279635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970799e-3edb-4110-96e6-57352bf36666 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:45.282702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970799e-3edb-4110-96e6-57352bf36666 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:45.282702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970799e-3edb-4110-96e6-57352bf36666 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/a249fb3944d64aeb876ee10c634082d3` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:45.282961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970799e-3edb-4110-96e6-57352bf36666 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:update_role(role_id=a249fb3944d64aeb876ee10c634082d3)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:45.284117 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-4970799e-3edb-4110-96e6-57352bf36666 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:45.284117 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:45.284117 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:45.285693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970799e-3edb-4110-96e6-57352bf36666 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:45.292448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc1b1e-2de4-40e4-9161-6e976c52fbe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:45.294981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc1b1e-2de4-40e4-9161-6e976c52fbe9 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:45.298108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc1b1e-2de4-40e4-9161-6e976c52fbe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:45.299022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc1b1e-2de4-40e4-9161-6e976c52fbe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:45.301710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d3fc1b1e-2de4-40e4-9161-6e976c52fbe9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:45.386731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc1b1e-2de4-40e4-9161-6e976c52fbe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:45.388200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc1b1e-2de4-40e4-9161-6e976c52fbe9 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:45.391428 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2477/4963] 10.222.0.16 () {60 vars in 1242 bytes} [Mon May 2 10:36:45 2022] PATCH /identity/v3/roles/a249fb3944d64aeb876ee10c634082d3 => generated 238 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:45.395737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970799e-3edb-4110-96e6-57352bf36666 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:45.398940 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2487/4964] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:36:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:36:45.428324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970799e-3edb-4110-96e6-57352bf36666 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:45.432319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eeab95-c42a-4cd9-a1c6-454e34b09789 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:45.433607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eeab95-c42a-4cd9-a1c6-454e34b09789 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:45.433902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eeab95-c42a-4cd9-a1c6-454e34b09789 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:45.434913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eeab95-c42a-4cd9-a1c6-454e34b09789 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/a249fb3944d64aeb876ee10c634082d3` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:45.451532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eeab95-c42a-4cd9-a1c6-454e34b09789 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:get_role(role_id=a249fb3944d64aeb876ee10c634082d3)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:45.451532 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-53eeab95-c42a-4cd9-a1c6-454e34b09789 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:45.451532 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:45.451532 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:45.451532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eeab95-c42a-4cd9-a1c6-454e34b09789 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:45.462769 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2478/4965] 10.222.0.16 () {58 vars in 1220 bytes} [Mon May 2 10:36:45 2022] GET /identity/v3/roles/a249fb3944d64aeb876ee10c634082d3 => generated 238 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:45.464275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc1b1e-2de4-40e4-9161-6e976c52fbe9 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:45.480015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc1b1e-2de4-40e4-9161-6e976c52fbe9 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:45.481467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848fa33-4b98-4b69-a607-5f648988ce4b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:45.482037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848fa33-4b98-4b69-a607-5f648988ce4b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:45.482380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848fa33-4b98-4b69-a607-5f648988ce4b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:45.482655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848fa33-4b98-4b69-a607-5f648988ce4b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:45.483930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848fa33-4b98-4b69-a607-5f648988ce4b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:45.485885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848fa33-4b98-4b69-a607-5f648988ce4b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:45.486027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eeab95-c42a-4cd9-a1c6-454e34b09789 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:45.487979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-53eeab95-c42a-4cd9-a1c6-454e34b09789 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:45.508920 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2488/4966] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:45 2022] GET /identity/v3/roles => generated 2550 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:45.516513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848fa33-4b98-4b69-a607-5f648988ce4b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:45.518411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eeab95-c42a-4cd9-a1c6-454e34b09789 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:45.523729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e6d8e-3075-43f2-832d-20e312b63488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:45.524679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e6d8e-3075-43f2-832d-20e312b63488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:45.524969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e6d8e-3075-43f2-832d-20e312b63488 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:45.525415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e6d8e-3075-43f2-832d-20e312b63488 admin admin] PATH_INFO: `/v3/projects/553b9c7e4f82450f827b71deadd7474c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:45.538338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e6d8e-3075-43f2-832d-20e312b63488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=553b9c7e4f82450f827b71deadd7474c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:45.538338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e6d8e-3075-43f2-832d-20e312b63488 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:45.543579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848fa33-4b98-4b69-a607-5f648988ce4b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:45.555020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe57d7-773b-40d9-8e55-19913b53101b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:45.556279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe57d7-773b-40d9-8e55-19913b53101b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:45.557718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe57d7-773b-40d9-8e55-19913b53101b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:45.558015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe57d7-773b-40d9-8e55-19913b53101b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/a249fb3944d64aeb876ee10c634082d3` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:45.562941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe57d7-773b-40d9-8e55-19913b53101b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a249fb3944d64aeb876ee10c634082d3)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:45.566980 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-26fe57d7-773b-40d9-8e55-19913b53101b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:45.566980 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:45.566980 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:45.567948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe57d7-773b-40d9-8e55-19913b53101b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:45.711972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-26fe57d7-773b-40d9-8e55-19913b53101b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invalidating the token cache because role a249fb3944d64aeb876ee10c634082d3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:45.713142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-26fe57d7-773b-40d9-8e55-19913b53101b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:45.714146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-26fe57d7-773b-40d9-8e55-19913b53101b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:45.723758 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2489/4967] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:45 2022] DELETE /identity/v3/roles/a249fb3944d64aeb876ee10c634082d3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:45.725106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe57d7-773b-40d9-8e55-19913b53101b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:45.728555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-26fe57d7-773b-40d9-8e55-19913b53101b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:45.735771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-991e6d8e-3075-43f2-832d-20e312b63488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '553b9c7e4f82450f827b71deadd7474c', 'request_id': 'req-991e6d8e-3075-43f2-832d-20e312b63488'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:45.748856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-991e6d8e-3075-43f2-832d-20e312b63488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '553b9c7e4f82450f827b71deadd7474c', 'request_id': 'req-991e6d8e-3075-43f2-832d-20e312b63488'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:45.835940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-991e6d8e-3075-43f2-832d-20e312b63488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '553b9c7e4f82450f827b71deadd7474c', 'request_id': 'req-991e6d8e-3075-43f2-832d-20e312b63488'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:45.844349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe57d7-773b-40d9-8e55-19913b53101b tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:45.852007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d2cb8-b62d-4f2d-b060-2967f071bd3a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:45.855123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d2cb8-b62d-4f2d-b060-2967f071bd3a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:45.856136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d2cb8-b62d-4f2d-b060-2967f071bd3a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:45.856833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d2cb8-b62d-4f2d-b060-2967f071bd3a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:45.859531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d2cb8-b62d-4f2d-b060-2967f071bd3a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5ebc102e533e46c4afab9b94c70fe742, implied_role_id=29ae2d1e301c43dcb4d7584f3670224e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:45.860438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-991e6d8e-3075-43f2-832d-20e312b63488 admin admin] The token cache is being invalidate because project 553b9c7e4f82450f827b71deadd7474c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:45.860781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-991e6d8e-3075-43f2-832d-20e312b63488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:45.861855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-991e6d8e-3075-43f2-832d-20e312b63488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:45.862761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d2cb8-b62d-4f2d-b060-2967f071bd3a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:45.878136 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2479/4968] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:36:45 2022] DELETE /identity/v3/projects/553b9c7e4f82450f827b71deadd7474c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:45.892389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00b9b2-062a-4c21-b94d-65e3eb03accd None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:45.892389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00b9b2-062a-4c21-b94d-65e3eb03accd None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:45.892389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00b9b2-062a-4c21-b94d-65e3eb03accd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:45.955346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-db00b9b2-062a-4c21-b94d-65e3eb03accd None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:45.955346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-db00b9b2-062a-4c21-b94d-65e3eb03accd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:46.074299 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2480/4969] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:46.083439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32721931-8bee-4fc5-979a-c6dfefdcf3c6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:46.083925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32721931-8bee-4fc5-979a-c6dfefdcf3c6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:46.084403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32721931-8bee-4fc5-979a-c6dfefdcf3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:46.101984 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2490/4970] 10.222.0.16 () {60 vars in 1362 bytes} [Mon May 2 10:36:45 2022] PUT /identity/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e => generated 521 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:46.118496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d2cb8-b62d-4f2d-b060-2967f071bd3a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:46.118685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-32721931-8bee-4fc5-979a-c6dfefdcf3c6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:46.121506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-32721931-8bee-4fc5-979a-c6dfefdcf3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:46.128077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5f8d2cb8-b62d-4f2d-b060-2967f071bd3a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:46.261433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d2cb8-b62d-4f2d-b060-2967f071bd3a tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:46.268380 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2481/4971] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:46.269324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b9824-b896-474e-a852-a1c324a4f5ce tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:46.269645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32721931-8bee-4fc5-979a-c6dfefdcf3c6 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:46.270708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b9824-b896-474e-a852-a1c324a4f5ce tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:46.271090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b9824-b896-474e-a852-a1c324a4f5ce tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:46.271384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-32721931-8bee-4fc5-979a-c6dfefdcf3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:46.271739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b9824-b896-474e-a852-a1c324a4f5ce tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/35bc447f4309488aa2abe5ac7e55e27f` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:46.273629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b9824-b896-474e-a852-a1c324a4f5ce tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5ebc102e533e46c4afab9b94c70fe742, implied_role_id=35bc447f4309488aa2abe5ac7e55e27f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:46.275312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b9824-b896-474e-a852-a1c324a4f5ce tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:46.293285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32721931-8bee-4fc5-979a-c6dfefdcf3c6 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:46.305250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39685b78-9284-4b67-8562-dacdc4eda528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:46.306246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39685b78-9284-4b67-8562-dacdc4eda528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:46.306590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39685b78-9284-4b67-8562-dacdc4eda528 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:46.306871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39685b78-9284-4b67-8562-dacdc4eda528 admin admin] PATH_INFO: `/v3/projects/cdb85581362c41929cd74827f6654a89` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:46.308223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39685b78-9284-4b67-8562-dacdc4eda528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb85581362c41929cd74827f6654a89)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:46.310177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39685b78-9284-4b67-8562-dacdc4eda528 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:46.372144 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2491/4972] 10.222.0.16 () {60 vars in 1362 bytes} [Mon May 2 10:36:46 2022] PUT /identity/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/35bc447f4309488aa2abe5ac7e55e27f => generated 519 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:46.373244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b9824-b896-474e-a852-a1c324a4f5ce tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:46.451980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-39685b78-9284-4b67-8562-dacdc4eda528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb85581362c41929cd74827f6654a89', 'request_id': 'req-39685b78-9284-4b67-8562-dacdc4eda528'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:46.458049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b9824-b896-474e-a852-a1c324a4f5ce tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:46.462004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-39685b78-9284-4b67-8562-dacdc4eda528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb85581362c41929cd74827f6654a89', 'request_id': 'req-39685b78-9284-4b67-8562-dacdc4eda528'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:46.518773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005272b-f390-44f4-9334-39070b55d322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:46.519589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005272b-f390-44f4-9334-39070b55d322 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:46.519883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005272b-f390-44f4-9334-39070b55d322 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:46.520167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005272b-f390-44f4-9334-39070b55d322 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:46.521067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b005272b-f390-44f4-9334-39070b55d322 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:36:46.521385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b005272b-f390-44f4-9334-39070b55d322 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:46.522990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b005272b-f390-44f4-9334-39070b55d322 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:46.539214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-39685b78-9284-4b67-8562-dacdc4eda528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb85581362c41929cd74827f6654a89', 'request_id': 'req-39685b78-9284-4b67-8562-dacdc4eda528'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:46.550691 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2492/4973] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:46.552236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005272b-f390-44f4-9334-39070b55d322 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:46.554817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-39685b78-9284-4b67-8562-dacdc4eda528 admin admin] The token cache is being invalidate because project cdb85581362c41929cd74827f6654a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:46.555303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-39685b78-9284-4b67-8562-dacdc4eda528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:46.559096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-39685b78-9284-4b67-8562-dacdc4eda528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:46.559096 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2482/4974] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:36:46 2022] DELETE /identity/v3/projects/cdb85581362c41929cd74827f6654a89 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:46.559096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39685b78-9284-4b67-8562-dacdc4eda528 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:46.560577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-39685b78-9284-4b67-8562-dacdc4eda528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:46.574908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39685b78-9284-4b67-8562-dacdc4eda528 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:46.580838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b65ea-6004-44b4-9696-12eddc781c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:46.581597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b65ea-6004-44b4-9696-12eddc781c04 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:46.582300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b65ea-6004-44b4-9696-12eddc781c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:46.582300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b65ea-6004-44b4-9696-12eddc781c04 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:46.583467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b65ea-6004-44b4-9696-12eddc781c04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:46.585402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b65ea-6004-44b4-9696-12eddc781c04 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:46.627191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005272b-f390-44f4-9334-39070b55d322 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:46.632244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1614937-e375-4129-9ef2-3183958ff7e8 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:46.633214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1614937-e375-4129-9ef2-3183958ff7e8 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:46.633529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1614937-e375-4129-9ef2-3183958ff7e8 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:46.633811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1614937-e375-4129-9ef2-3183958ff7e8 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/35bc447f4309488aa2abe5ac7e55e27f/implies/1d0c78abff934f80bfe409639da6b445` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:46.636201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1614937-e375-4129-9ef2-3183958ff7e8 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=35bc447f4309488aa2abe5ac7e55e27f, implied_role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:46.638101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1614937-e375-4129-9ef2-3183958ff7e8 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:46.668274 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2483/4975] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:36:46 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:46.669803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b65ea-6004-44b4-9696-12eddc781c04 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:46.672110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-aa1b65ea-6004-44b4-9696-12eddc781c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:46.707778 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2493/4976] 10.222.0.16 () {60 vars in 1362 bytes} [Mon May 2 10:36:46 2022] PUT /identity/v3/roles/35bc447f4309488aa2abe5ac7e55e27f/implies/1d0c78abff934f80bfe409639da6b445 => generated 518 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:46.709471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1614937-e375-4129-9ef2-3183958ff7e8 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:46.756117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b65ea-6004-44b4-9696-12eddc781c04 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:46.787898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1614937-e375-4129-9ef2-3183958ff7e8 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:46.793426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdc67b-88b0-4955-85d2-d1e5682aebdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:46.794318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdc67b-88b0-4955-85d2-d1e5682aebdb admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:46.794713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdc67b-88b0-4955-85d2-d1e5682aebdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:46.795093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdc67b-88b0-4955-85d2-d1e5682aebdb admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:46.796426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fdc67b-88b0-4955-85d2-d1e5682aebdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:46.798587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fdc67b-88b0-4955-85d2-d1e5682aebdb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:46.815351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1c788-73e7-4735-a5e7-35934f4ee47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:46.816983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1c788-73e7-4735-a5e7-35934f4ee47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:46.817455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1c788-73e7-4735-a5e7-35934f4ee47c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:46.817949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1c788-73e7-4735-a5e7-35934f4ee47c admin admin] PATH_INFO: `/v3/users/1dd1170a5a804fdfab265f86213ff665` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:46.819293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1c788-73e7-4735-a5e7-35934f4ee47c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dd1170a5a804fdfab265f86213ff665)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:46.821297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1c788-73e7-4735-a5e7-35934f4ee47c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:46.941022 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2494/4977] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:36:46 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:46.941879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdc67b-88b0-4955-85d2-d1e5682aebdb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:46.947605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-04fdc67b-88b0-4955-85d2-d1e5682aebdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:47.031129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdc67b-88b0-4955-85d2-d1e5682aebdb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:47.040724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9ee1c788-73e7-4735-a5e7-35934f4ee47c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dd1170a5a804fdfab265f86213ff665'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:47.048126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91faa8e-9758-46ab-b1ac-1b332297fdc9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:47.049050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91faa8e-9758-46ab-b1ac-1b332297fdc9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:47.052711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91faa8e-9758-46ab-b1ac-1b332297fdc9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:47.052711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91faa8e-9758-46ab-b1ac-1b332297fdc9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/35bc447f4309488aa2abe5ac7e55e27f/implies` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:47.052711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91faa8e-9758-46ab-b1ac-1b332297fdc9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=35bc447f4309488aa2abe5ac7e55e27f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:47.052711 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-a91faa8e-9758-46ab-b1ac-1b332297fdc9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:47.052711 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:47.052711 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:47.053365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91faa8e-9758-46ab-b1ac-1b332297fdc9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:47.059141 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9ee1c788-73e7-4735-a5e7-35934f4ee47c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dd1170a5a804fdfab265f86213ff665'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:47.060067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9ee1c788-73e7-4735-a5e7-35934f4ee47c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dd1170a5a804fdfab265f86213ff665'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:47.066116 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2495/4978] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 2 10:36:46 2022] GET /identity/v3/roles/35bc447f4309488aa2abe5ac7e55e27f/implies => generated 487 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:47.066116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91faa8e-9758-46ab-b1ac-1b332297fdc9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:47.069608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9ee1c788-73e7-4735-a5e7-35934f4ee47c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dd1170a5a804fdfab265f86213ff665'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:47.077707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91faa8e-9758-46ab-b1ac-1b332297fdc9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:47.082468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d38406-e0db-4624-b107-17790ea1df9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:47.083207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d38406-e0db-4624-b107-17790ea1df9c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:47.083559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d38406-e0db-4624-b107-17790ea1df9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:47.083927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d38406-e0db-4624-b107-17790ea1df9c admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:47.084769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d38406-e0db-4624-b107-17790ea1df9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:47.086430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d38406-e0db-4624-b107-17790ea1df9c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:47.107120 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2496/4979] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:47 2022] GET /identity/v3/roles => generated 2321 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:47.107120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d38406-e0db-4624-b107-17790ea1df9c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:47.118372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d38406-e0db-4624-b107-17790ea1df9c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:47.123141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913eee85-fa24-4e61-bdce-23922ffff097 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:47.124839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eee85-fa24-4e61-bdce-23922ffff097 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:47.125391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eee85-fa24-4e61-bdce-23922ffff097 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:47.126160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eee85-fa24-4e61-bdce-23922ffff097 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:47.127459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913eee85-fa24-4e61-bdce-23922ffff097 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=5ebc102e533e46c4afab9b94c70fe742)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:47.129182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913eee85-fa24-4e61-bdce-23922ffff097 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:47.142240 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2497/4980] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 2 10:36:47 2022] GET /identity/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies => generated 659 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:47.142240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913eee85-fa24-4e61-bdce-23922ffff097 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:47.150464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9ee1c788-73e7-4735-a5e7-35934f4ee47c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dd1170a5a804fdfab265f86213ff665'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:47.154718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913eee85-fa24-4e61-bdce-23922ffff097 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:47.162564 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2484/4981] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:46 2022] DELETE /identity/v3/users/1dd1170a5a804fdfab265f86213ff665 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:47.162785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5e018-f373-4427-a351-755b18f24a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:47.162920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1c788-73e7-4735-a5e7-35934f4ee47c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:47.163027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5e018-f373-4427-a351-755b18f24a4d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:47.163027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5e018-f373-4427-a351-755b18f24a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:47.163027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5e018-f373-4427-a351-755b18f24a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:47.163027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5e018-f373-4427-a351-755b18f24a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:47.168140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5e018-f373-4427-a351-755b18f24a4d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:47.174600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9ee1c788-73e7-4735-a5e7-35934f4ee47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:47.177222 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2498/4982] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:47 2022] GET /identity/v3/roles => generated 2321 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:47.181254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5e018-f373-4427-a351-755b18f24a4d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:47.184520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9ee5e018-f373-4427-a351-755b18f24a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:47.209195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5e018-f373-4427-a351-755b18f24a4d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:47.274708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1c788-73e7-4735-a5e7-35934f4ee47c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:47.279908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdaee5b-7137-4d08-9c0a-66d471f072be tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:47.282472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaee5b-7137-4d08-9c0a-66d471f072be tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:47.282875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaee5b-7137-4d08-9c0a-66d471f072be tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:47.283263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaee5b-7137-4d08-9c0a-66d471f072be tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/35bc447f4309488aa2abe5ac7e55e27f/implies/1d0c78abff934f80bfe409639da6b445` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:47.285275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdaee5b-7137-4d08-9c0a-66d471f072be tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=35bc447f4309488aa2abe5ac7e55e27f, implied_role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:47.287188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdaee5b-7137-4d08-9c0a-66d471f072be tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:47.304055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61035a4-6fd5-4fce-8b45-38b42fcd7c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:47.305052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61035a4-6fd5-4fce-8b45-38b42fcd7c6f admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:47.305574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61035a4-6fd5-4fce-8b45-38b42fcd7c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:47.305971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61035a4-6fd5-4fce-8b45-38b42fcd7c6f admin admin] PATH_INFO: `/v3/projects/82b6fa2217fa4f648fe978e1c9cca3ba/users/8c8a5cbbc43e415a85da2b0074a05138/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:47.333551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61035a4-6fd5-4fce-8b45-38b42fcd7c6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=82b6fa2217fa4f648fe978e1c9cca3ba, user_id=8c8a5cbbc43e415a85da2b0074a05138, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:47.337857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61035a4-6fd5-4fce-8b45-38b42fcd7c6f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:47.431119 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2485/4983] 10.222.0.16 () {58 vars in 1346 bytes} [Mon May 2 10:36:47 2022] DELETE /identity/v3/roles/35bc447f4309488aa2abe5ac7e55e27f/implies/1d0c78abff934f80bfe409639da6b445 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:47.435576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdaee5b-7137-4d08-9c0a-66d471f072be tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:47.471296 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2499/4984] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:47 2022] PUT /identity/v3/projects/82b6fa2217fa4f648fe978e1c9cca3ba/users/8c8a5cbbc43e415a85da2b0074a05138/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:47.478837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d07fb3-9324-430b-87ed-71577543e251 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:47.479371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d07fb3-9324-430b-87ed-71577543e251 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:47.479811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d07fb3-9324-430b-87ed-71577543e251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:47.531011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e1d07fb3-9324-430b-87ed-71577543e251 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:47.533778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e1d07fb3-9324-430b-87ed-71577543e251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:47.548593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdaee5b-7137-4d08-9c0a-66d471f072be tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:47.653044 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2500/4985] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:47.664841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bef24e-4a4b-4841-9c5e-738584bd3a91 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:47.665805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bef24e-4a4b-4841-9c5e-738584bd3a91 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:47.666086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bef24e-4a4b-4841-9c5e-738584bd3a91 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:47.666501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bef24e-4a4b-4841-9c5e-738584bd3a91 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/35bc447f4309488aa2abe5ac7e55e27f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:47.669032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bef24e-4a4b-4841-9c5e-738584bd3a91 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5ebc102e533e46c4afab9b94c70fe742, implied_role_id=35bc447f4309488aa2abe5ac7e55e27f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:47.671229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d07fb3-9324-430b-87ed-71577543e251 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:47.671359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bef24e-4a4b-4841-9c5e-738584bd3a91 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:47.672995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e1d07fb3-9324-430b-87ed-71577543e251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:47.742887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d07fb3-9324-430b-87ed-71577543e251 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:47.749623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbf3ea-4c0a-4b17-be31-996cd919f037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:47.750359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbf3ea-4c0a-4b17-be31-996cd919f037 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:47.750918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbf3ea-4c0a-4b17-be31-996cd919f037 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:47.751201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbf3ea-4c0a-4b17-be31-996cd919f037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:47.761198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbf3ea-4c0a-4b17-be31-996cd919f037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:47.762643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbf3ea-4c0a-4b17-be31-996cd919f037 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:47.768427 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2486/4986] 10.222.0.16 () {58 vars in 1346 bytes} [Mon May 2 10:36:47 2022] DELETE /identity/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/35bc447f4309488aa2abe5ac7e55e27f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:47.773233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bef24e-4a4b-4841-9c5e-738584bd3a91 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:47.774942 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2501/4987] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:36:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:36:47.829983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbf3ea-4c0a-4b17-be31-996cd919f037 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:47.831556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3efbf3ea-4c0a-4b17-be31-996cd919f037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:47.856831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bef24e-4a4b-4841-9c5e-738584bd3a91 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:47.864384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbf3ea-4c0a-4b17-be31-996cd919f037 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:47.869426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4af5d-fcb1-47d7-a458-ef632429cb6c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:47.869426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4af5d-fcb1-47d7-a458-ef632429cb6c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:47.869426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4af5d-fcb1-47d7-a458-ef632429cb6c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:47.869779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4af5d-fcb1-47d7-a458-ef632429cb6c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:47.869779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4af5d-fcb1-47d7-a458-ef632429cb6c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5ebc102e533e46c4afab9b94c70fe742, implied_role_id=29ae2d1e301c43dcb4d7584f3670224e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:47.871403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4af5d-fcb1-47d7-a458-ef632429cb6c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:47.946884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da80e9d-05e7-43e8-8412-a3f1ccf2b476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:47.947918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da80e9d-05e7-43e8-8412-a3f1ccf2b476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:47.948038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da80e9d-05e7-43e8-8412-a3f1ccf2b476 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:47.948308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da80e9d-05e7-43e8-8412-a3f1ccf2b476 admin admin] PATH_INFO: `/v3/projects/e5cb9a319501442caf0ca5d095688bdb` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:47.949760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da80e9d-05e7-43e8-8412-a3f1ccf2b476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5cb9a319501442caf0ca5d095688bdb)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:47.951922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da80e9d-05e7-43e8-8412-a3f1ccf2b476 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:47.980362 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2487/4988] 10.222.0.16 () {58 vars in 1346 bytes} [Mon May 2 10:36:47 2022] DELETE /identity/v3/roles/5ebc102e533e46c4afab9b94c70fe742/implies/29ae2d1e301c43dcb4d7584f3670224e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:47.986032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4af5d-fcb1-47d7-a458-ef632429cb6c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:48.059601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4af5d-fcb1-47d7-a458-ef632429cb6c tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:48.064713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e45e0-a14a-4844-bd8f-11dbf940f84d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:48.065608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e45e0-a14a-4844-bd8f-11dbf940f84d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:48.066011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e45e0-a14a-4844-bd8f-11dbf940f84d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:48.066242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e45e0-a14a-4844-bd8f-11dbf940f84d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/domains/494dcc73897b4f6aa90362571b3b8423` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:48.078187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e45e0-a14a-4844-bd8f-11dbf940f84d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:36:48.107472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-fd6e45e0-a14a-4844-bd8f-11dbf940f84d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Could not find domain: 494dcc73897b4f6aa90362571b3b8423.: keystone.exception.DomainNotFound: Could not find domain: 494dcc73897b4f6aa90362571b3b8423. May 02 10:36:48.107472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:48.107472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 02 10:36:48.107472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 02 10:36:48.107472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:36:48.107472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:36:48.107472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:36:48.107472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:36:48.107472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 494dcc73897b4f6aa90362571b3b8423. May 02 10:36:48.107472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:48.107472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:36:48.107472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:48.107472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:48.107472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:36:48.107472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:36:48.107472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:36:48.115447 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:36:48.115447 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:36:48.115447 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:36:48.115447 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:36:48.115447 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:36:48.115447 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:36:48.115447 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:36:48.115447 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 02 10:36:48.115447 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 02 10:36:48.115447 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:36:48.115447 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:36:48.115447 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:36:48.115447 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:36:48.115447 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:36:48.115447 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:36:48.115447 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:36:48.116788 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:36:48.116788 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:36:48.116788 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:36:48.116788 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:36:48.116788 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:36:48.116788 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:36:48.116788 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:36:48.116788 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:36:48.116788 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:36:48.116788 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:36:48.116788 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:36:48.116788 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:36:48.116788 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:36:48.116788 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 02 10:36:48.116788 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:36:48.116788 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 494dcc73897b4f6aa90362571b3b8423. May 02 10:36:48.116788 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:48.121982 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2488/4989] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:36:47 2022] PATCH /identity/v3/domains/494dcc73897b4f6aa90362571b3b8423 => generated 112 bytes in 133 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:36:48.123366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e45e0-a14a-4844-bd8f-11dbf940f84d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:48.142556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e45e0-a14a-4844-bd8f-11dbf940f84d tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:48.144526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7da80e9d-05e7-43e8-8412-a3f1ccf2b476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5cb9a319501442caf0ca5d095688bdb', 'request_id': 'req-7da80e9d-05e7-43e8-8412-a3f1ccf2b476'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:48.204471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41159fab-6d62-4475-a4e5-f59dd12af938 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:48.208632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41159fab-6d62-4475-a4e5-f59dd12af938 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:48.208632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41159fab-6d62-4475-a4e5-f59dd12af938 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:48.208632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41159fab-6d62-4475-a4e5-f59dd12af938 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/users/79e23cfdcd5d482681f5b014d501db9d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:48.208632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41159fab-6d62-4475-a4e5-f59dd12af938 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_user(user_id=79e23cfdcd5d482681f5b014d501db9d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:48.209775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41159fab-6d62-4475-a4e5-f59dd12af938 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:48.252963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7da80e9d-05e7-43e8-8412-a3f1ccf2b476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5cb9a319501442caf0ca5d095688bdb', 'request_id': 'req-7da80e9d-05e7-43e8-8412-a3f1ccf2b476'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:48.271662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7da80e9d-05e7-43e8-8412-a3f1ccf2b476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5cb9a319501442caf0ca5d095688bdb', 'request_id': 'req-7da80e9d-05e7-43e8-8412-a3f1ccf2b476'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:48.290350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7da80e9d-05e7-43e8-8412-a3f1ccf2b476 admin admin] The token cache is being invalidate because project e5cb9a319501442caf0ca5d095688bdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:48.290753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7da80e9d-05e7-43e8-8412-a3f1ccf2b476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:48.291526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7da80e9d-05e7-43e8-8412-a3f1ccf2b476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:48.293477 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2502/4990] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:36:47 2022] DELETE /identity/v3/projects/e5cb9a319501442caf0ca5d095688bdb => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:48.297236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da80e9d-05e7-43e8-8412-a3f1ccf2b476 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:48.298778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7da80e9d-05e7-43e8-8412-a3f1ccf2b476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:48.376363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da80e9d-05e7-43e8-8412-a3f1ccf2b476 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:48.382393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9e339-ff01-4e02-9f0f-024cb5bd1341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:48.383304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9e339-ff01-4e02-9f0f-024cb5bd1341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:48.383587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9e339-ff01-4e02-9f0f-024cb5bd1341 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:48.383865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9e339-ff01-4e02-9f0f-024cb5bd1341 admin admin] PATH_INFO: `/v3/users/9651df8a727e4ab09b344717cd82cc92` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:48.385221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9e339-ff01-4e02-9f0f-024cb5bd1341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9651df8a727e4ab09b344717cd82cc92)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:48.387162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9e339-ff01-4e02-9f0f-024cb5bd1341 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:48.421269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-41159fab-6d62-4475-a4e5-f59dd12af938 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79e23cfdcd5d482681f5b014d501db9d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:48.441312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-41159fab-6d62-4475-a4e5-f59dd12af938 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79e23cfdcd5d482681f5b014d501db9d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:48.442349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-41159fab-6d62-4475-a4e5-f59dd12af938 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79e23cfdcd5d482681f5b014d501db9d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:48.451110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-41159fab-6d62-4475-a4e5-f59dd12af938 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79e23cfdcd5d482681f5b014d501db9d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:48.546580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-41159fab-6d62-4475-a4e5-f59dd12af938 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79e23cfdcd5d482681f5b014d501db9d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:48.570139 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2489/4991] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:48 2022] DELETE /identity/v3/users/79e23cfdcd5d482681f5b014d501db9d => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:48.574046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41159fab-6d62-4475-a4e5-f59dd12af938 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:48.575491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-41159fab-6d62-4475-a4e5-f59dd12af938 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:48.616134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-09d9e339-ff01-4e02-9f0f-024cb5bd1341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9651df8a727e4ab09b344717cd82cc92'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:48.632327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-09d9e339-ff01-4e02-9f0f-024cb5bd1341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9651df8a727e4ab09b344717cd82cc92'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:48.636169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-09d9e339-ff01-4e02-9f0f-024cb5bd1341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9651df8a727e4ab09b344717cd82cc92'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:48.641131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-09d9e339-ff01-4e02-9f0f-024cb5bd1341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9651df8a727e4ab09b344717cd82cc92'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:48.652546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41159fab-6d62-4475-a4e5-f59dd12af938 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:48.659284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e889cd-b239-44de-bd02-b90d5aff2db7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:48.659284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e889cd-b239-44de-bd02-b90d5aff2db7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:48.659698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e889cd-b239-44de-bd02-b90d5aff2db7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:48.659912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e889cd-b239-44de-bd02-b90d5aff2db7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/1d0c78abff934f80bfe409639da6b445` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:48.661430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e889cd-b239-44de-bd02-b90d5aff2db7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1d0c78abff934f80bfe409639da6b445)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:48.662482 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-39e889cd-b239-44de-bd02-b90d5aff2db7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:48.662482 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:36:48.662482 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:36:48.663408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e889cd-b239-44de-bd02-b90d5aff2db7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:48.710663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-09d9e339-ff01-4e02-9f0f-024cb5bd1341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9651df8a727e4ab09b344717cd82cc92'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:48.721512 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2503/4992] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:48 2022] DELETE /identity/v3/users/9651df8a727e4ab09b344717cd82cc92 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:48.813897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-39e889cd-b239-44de-bd02-b90d5aff2db7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invalidating the token cache because role 1d0c78abff934f80bfe409639da6b445 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:48.820034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-39e889cd-b239-44de-bd02-b90d5aff2db7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:48.820034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-39e889cd-b239-44de-bd02-b90d5aff2db7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:48.820034 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2490/4993] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:48 2022] DELETE /identity/v3/roles/1d0c78abff934f80bfe409639da6b445 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:48.822028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9e339-ff01-4e02-9f0f-024cb5bd1341 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:48.823571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-09d9e339-ff01-4e02-9f0f-024cb5bd1341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:48.935728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9e339-ff01-4e02-9f0f-024cb5bd1341 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:49.025060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e54b4-6b3c-4899-b758-78c11367fae9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:49.025951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e54b4-6b3c-4899-b758-78c11367fae9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:49.026289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e54b4-6b3c-4899-b758-78c11367fae9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:49.026569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e54b4-6b3c-4899-b758-78c11367fae9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/groups/7bb99e9056194efc85304b45833c6a52` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:49.027914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e54b4-6b3c-4899-b758-78c11367fae9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_group(group_id=7bb99e9056194efc85304b45833c6a52)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:49.029556 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-ae9e54b4-6b3c-4899-b758-78c11367fae9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:36:49.029556 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:36:49.029556 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:36:49.030384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e54b4-6b3c-4899-b758-78c11367fae9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:49.206538 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2504/4994] 10.222.0.16 () {58 vars in 1226 bytes} [Mon May 2 10:36:48 2022] DELETE /identity/v3/groups/7bb99e9056194efc85304b45833c6a52 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:49.211300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e889cd-b239-44de-bd02-b90d5aff2db7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:49.212215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-39e889cd-b239-44de-bd02-b90d5aff2db7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:49.234882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e889cd-b239-44de-bd02-b90d5aff2db7 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:49.301079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ebcb0-b386-4603-a868-27ffcf64fed4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:49.302066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ebcb0-b386-4603-a868-27ffcf64fed4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:49.302430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ebcb0-b386-4603-a868-27ffcf64fed4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:49.302787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ebcb0-b386-4603-a868-27ffcf64fed4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:49.304095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ebcb0-b386-4603-a868-27ffcf64fed4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2d6ee2b10f004a1085ce72c9fa8b67ff)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:49.306206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ebcb0-b386-4603-a868-27ffcf64fed4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:49.357665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e54b4-6b3c-4899-b758-78c11367fae9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:49.360278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ae9e54b4-6b3c-4899-b758-78c11367fae9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:49.443727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0c1ebcb0-b386-4603-a868-27ffcf64fed4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d6ee2b10f004a1085ce72c9fa8b67ff', 'request_id': 'req-0c1ebcb0-b386-4603-a868-27ffcf64fed4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:49.452574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0c1ebcb0-b386-4603-a868-27ffcf64fed4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d6ee2b10f004a1085ce72c9fa8b67ff', 'request_id': 'req-0c1ebcb0-b386-4603-a868-27ffcf64fed4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:49.456758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e54b4-6b3c-4899-b758-78c11367fae9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:49.522313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57279f1c-7b7e-4cf7-b3a5-06d6925d2dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:49.523196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57279f1c-7b7e-4cf7-b3a5-06d6925d2dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:49.523486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57279f1c-7b7e-4cf7-b3a5-06d6925d2dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:49.523777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57279f1c-7b7e-4cf7-b3a5-06d6925d2dbd admin admin] PATH_INFO: `/v3/projects/a5189e16dd1c44e5875900f2e5110652` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:49.525058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57279f1c-7b7e-4cf7-b3a5-06d6925d2dbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5189e16dd1c44e5875900f2e5110652)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:49.527150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57279f1c-7b7e-4cf7-b3a5-06d6925d2dbd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:49.533185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0c1ebcb0-b386-4603-a868-27ffcf64fed4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d6ee2b10f004a1085ce72c9fa8b67ff', 'request_id': 'req-0c1ebcb0-b386-4603-a868-27ffcf64fed4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:49.549516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0c1ebcb0-b386-4603-a868-27ffcf64fed4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] The token cache is being invalidate because project 2d6ee2b10f004a1085ce72c9fa8b67ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:49.549813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0c1ebcb0-b386-4603-a868-27ffcf64fed4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:49.553636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0c1ebcb0-b386-4603-a868-27ffcf64fed4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:49.556671 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2491/4995] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:36:49 2022] DELETE /identity/v3/projects/2d6ee2b10f004a1085ce72c9fa8b67ff => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:49.560283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ebcb0-b386-4603-a868-27ffcf64fed4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:49.562890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0c1ebcb0-b386-4603-a868-27ffcf64fed4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:49.640478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ebcb0-b386-4603-a868-27ffcf64fed4 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:49.645864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bb851-b9d3-4385-9127-3baed3489959 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:49.646730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bb851-b9d3-4385-9127-3baed3489959 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:49.647015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bb851-b9d3-4385-9127-3baed3489959 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:49.647291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bb851-b9d3-4385-9127-3baed3489959 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/domains/e7052f575a0d43f7b6cfdf3a935e384d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:49.648678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794bb851-b9d3-4385-9127-3baed3489959 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e7052f575a0d43f7b6cfdf3a935e384d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:49.650329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794bb851-b9d3-4385-9127-3baed3489959 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:49.679952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-57279f1c-7b7e-4cf7-b3a5-06d6925d2dbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5189e16dd1c44e5875900f2e5110652', 'request_id': 'req-57279f1c-7b7e-4cf7-b3a5-06d6925d2dbd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:49.683087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-794bb851-b9d3-4385-9127-3baed3489959 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e7052f575a0d43f7b6cfdf3a935e384d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:49.683925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-794bb851-b9d3-4385-9127-3baed3489959 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e7052f575a0d43f7b6cfdf3a935e384d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:49.790335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-57279f1c-7b7e-4cf7-b3a5-06d6925d2dbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5189e16dd1c44e5875900f2e5110652', 'request_id': 'req-57279f1c-7b7e-4cf7-b3a5-06d6925d2dbd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:49.800625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-57279f1c-7b7e-4cf7-b3a5-06d6925d2dbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5189e16dd1c44e5875900f2e5110652', 'request_id': 'req-57279f1c-7b7e-4cf7-b3a5-06d6925d2dbd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:49.813810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-57279f1c-7b7e-4cf7-b3a5-06d6925d2dbd admin admin] The token cache is being invalidate because project a5189e16dd1c44e5875900f2e5110652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:49.814529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-57279f1c-7b7e-4cf7-b3a5-06d6925d2dbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:49.815714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-57279f1c-7b7e-4cf7-b3a5-06d6925d2dbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:49.818125 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2505/4996] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:36:49 2022] DELETE /identity/v3/projects/a5189e16dd1c44e5875900f2e5110652 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:49.820086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1cc77-4637-4ff8-87fe-86af39a4c398 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:49.820411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1cc77-4637-4ff8-87fe-86af39a4c398 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:49.820745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1cc77-4637-4ff8-87fe-86af39a4c398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:49.829290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-794bb851-b9d3-4385-9127-3baed3489959 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e7052f575a0d43f7b6cfdf3a935e384d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:49.830621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-794bb851-b9d3-4385-9127-3baed3489959 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e7052f575a0d43f7b6cfdf3a935e384d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:49.833586 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2492/4997] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:36:49 2022] PATCH /identity/v3/domains/e7052f575a0d43f7b6cfdf3a935e384d => generated 276 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:49.835276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8e408-c527-4303-84b0-05a149520be6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:49.835642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8e408-c527-4303-84b0-05a149520be6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:49.835949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8e408-c527-4303-84b0-05a149520be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:49.848429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f9a1cc77-4637-4ff8-87fe-86af39a4c398 None None] MFA Rules not processed for user `8c8a5cbbc43e415a85da2b0074a05138`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:49.849746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f9a1cc77-4637-4ff8-87fe-86af39a4c398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:49.856292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a5d8e408-c527-4303-84b0-05a149520be6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:49.857622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a5d8e408-c527-4303-84b0-05a149520be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:49.915955 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2506/4998] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:49.917228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1cc77-4637-4ff8-87fe-86af39a4c398 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:49.918429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f9a1cc77-4637-4ff8-87fe-86af39a4c398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:49.919229 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2493/4999] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:49.932126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22253c-1c82-4227-8b2e-de389c196630 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:49.932126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22253c-1c82-4227-8b2e-de389c196630 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:49.932126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22253c-1c82-4227-8b2e-de389c196630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:49.949499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4f22253c-1c82-4227-8b2e-de389c196630 None None] MFA Rules not processed for user `8c8a5cbbc43e415a85da2b0074a05138`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:49.951338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4f22253c-1c82-4227-8b2e-de389c196630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:49.969721 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2494/5000] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:36:49.972200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbd75e-2919-4d82-bd88-4d12c22e21f5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:49.972499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbd75e-2919-4d82-bd88-4d12c22e21f5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:49.973047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbd75e-2919-4d82-bd88-4d12c22e21f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:49.996743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4ecbd75e-2919-4d82-bd88-4d12c22e21f5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:49.998174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1cc77-4637-4ff8-87fe-86af39a4c398 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:49.999242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4ecbd75e-2919-4d82-bd88-4d12c22e21f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:50.004321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f13905-8a76-402f-8885-9283983bfd42 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:50.005739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f13905-8a76-402f-8885-9283983bfd42 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:50.006685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f13905-8a76-402f-8885-9283983bfd42 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:50.007187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f13905-8a76-402f-8885-9283983bfd42 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/domains/e7052f575a0d43f7b6cfdf3a935e384d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:50.014458 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2495/5001] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:50.017725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbd75e-2919-4d82-bd88-4d12c22e21f5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:50.018060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4ecbd75e-2919-4d82-bd88-4d12c22e21f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:50.023192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f13905-8a76-402f-8885-9283983bfd42 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e7052f575a0d43f7b6cfdf3a935e384d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:50.025155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f13905-8a76-402f-8885-9283983bfd42 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:50.058932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e7f13905-8a76-402f-8885-9283983bfd42 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e7052f575a0d43f7b6cfdf3a935e384d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:50.068893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e7f13905-8a76-402f-8885-9283983bfd42 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e7052f575a0d43f7b6cfdf3a935e384d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:50.150859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbd75e-2919-4d82-bd88-4d12c22e21f5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:50.161259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60850c05-8ff4-4f35-84d4-11469dbbe61b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:50.162147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60850c05-8ff4-4f35-84d4-11469dbbe61b service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:50.162453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60850c05-8ff4-4f35-84d4-11469dbbe61b service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:50.162738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60850c05-8ff4-4f35-84d4-11469dbbe61b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:50.175303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60850c05-8ff4-4f35-84d4-11469dbbe61b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:50.176962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60850c05-8ff4-4f35-84d4-11469dbbe61b service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:50.187785 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2496/5002] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:36:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:36:50.197941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60850c05-8ff4-4f35-84d4-11469dbbe61b service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:50.220380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60850c05-8ff4-4f35-84d4-11469dbbe61b service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:50.240621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e7f13905-8a76-402f-8885-9283983bfd42 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7052f575a0d43f7b6cfdf3a935e384d', 'request_id': 'req-e7f13905-8a76-402f-8885-9283983bfd42'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:50.328881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e7f13905-8a76-402f-8885-9283983bfd42 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7052f575a0d43f7b6cfdf3a935e384d', 'request_id': 'req-e7f13905-8a76-402f-8885-9283983bfd42'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:50.341129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e7f13905-8a76-402f-8885-9283983bfd42 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7052f575a0d43f7b6cfdf3a935e384d', 'request_id': 'req-e7f13905-8a76-402f-8885-9283983bfd42'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:50.342015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34740ad3-fe83-4f6d-b286-b82dd6b37c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:50.343591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34740ad3-fe83-4f6d-b286-b82dd6b37c1e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:50.344100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34740ad3-fe83-4f6d-b286-b82dd6b37c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:50.344557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34740ad3-fe83-4f6d-b286-b82dd6b37c1e admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:50.345924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34740ad3-fe83-4f6d-b286-b82dd6b37c1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:36:50.346541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34740ad3-fe83-4f6d-b286-b82dd6b37c1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:50.348407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34740ad3-fe83-4f6d-b286-b82dd6b37c1e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:50.367588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e7f13905-8a76-402f-8885-9283983bfd42 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] The token cache is being invalidate because project e7052f575a0d43f7b6cfdf3a935e384d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:50.367588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e7f13905-8a76-402f-8885-9283983bfd42 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:50.369681 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2497/5003] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:50.370135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e7f13905-8a76-402f-8885-9283983bfd42 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:50.371518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34740ad3-fe83-4f6d-b286-b82dd6b37c1e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:50.377088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-34740ad3-fe83-4f6d-b286-b82dd6b37c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:50.387855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e7f13905-8a76-402f-8885-9283983bfd42 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e7052f575a0d43f7b6cfdf3a935e384d', 'request_id': 'req-e7f13905-8a76-402f-8885-9283983bfd42'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:50.388960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e7f13905-8a76-402f-8885-9283983bfd42 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e7052f575a0d43f7b6cfdf3a935e384d', 'request_id': 'req-e7f13905-8a76-402f-8885-9283983bfd42'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:50.401775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e7f13905-8a76-402f-8885-9283983bfd42 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e7052f575a0d43f7b6cfdf3a935e384d', 'request_id': 'req-e7f13905-8a76-402f-8885-9283983bfd42'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:50.409698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34740ad3-fe83-4f6d-b286-b82dd6b37c1e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:50.416894 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2507/5004] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:36:49 2022] DELETE /identity/v3/domains/e7052f575a0d43f7b6cfdf3a935e384d => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:50.421404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f13905-8a76-402f-8885-9283983bfd42 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:50.425369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e7f13905-8a76-402f-8885-9283983bfd42 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:50.428319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f43a6-d2eb-45eb-8613-ddc09ff4d7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:50.429045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f43a6-d2eb-45eb-8613-ddc09ff4d7ef admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:50.429452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f43a6-d2eb-45eb-8613-ddc09ff4d7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:50.429738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f43a6-d2eb-45eb-8613-ddc09ff4d7ef admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:50.430549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f43a6-d2eb-45eb-8613-ddc09ff4d7ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:50.437617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f43a6-d2eb-45eb-8613-ddc09ff4d7ef admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:50.542587 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2498/5005] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:36:50 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:50.548275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f13905-8a76-402f-8885-9283983bfd42 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:50.552704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f43a6-d2eb-45eb-8613-ddc09ff4d7ef admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:50.554837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-366f43a6-d2eb-45eb-8613-ddc09ff4d7ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:50.643112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f43a6-d2eb-45eb-8613-ddc09ff4d7ef admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:50.656639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce694c03-72f5-402c-95b4-c310003db6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:50.657592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce694c03-72f5-402c-95b4-c310003db6a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:50.657966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce694c03-72f5-402c-95b4-c310003db6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:50.658344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce694c03-72f5-402c-95b4-c310003db6a5 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:50.659199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce694c03-72f5-402c-95b4-c310003db6a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:50.661316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce694c03-72f5-402c-95b4-c310003db6a5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:50.703056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775dd70-090f-478c-8d3c-1e9658006a21 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:50.704231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775dd70-090f-478c-8d3c-1e9658006a21 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:50.704642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775dd70-090f-478c-8d3c-1e9658006a21 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:50.704948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775dd70-090f-478c-8d3c-1e9658006a21 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/35bc447f4309488aa2abe5ac7e55e27f` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:50.707292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775dd70-090f-478c-8d3c-1e9658006a21 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_role(role_id=35bc447f4309488aa2abe5ac7e55e27f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:50.715257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775dd70-090f-478c-8d3c-1e9658006a21 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:50.746362 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2499/5006] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:36:50 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:50.751110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce694c03-72f5-402c-95b4-c310003db6a5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:50.766840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce694c03-72f5-402c-95b4-c310003db6a5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:50.773313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71271ebc-81f3-454e-8aed-4136619a5b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:50.777632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71271ebc-81f3-454e-8aed-4136619a5b34 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:50.777632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71271ebc-81f3-454e-8aed-4136619a5b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:50.777632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71271ebc-81f3-454e-8aed-4136619a5b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:50.777632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71271ebc-81f3-454e-8aed-4136619a5b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:50.787514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71271ebc-81f3-454e-8aed-4136619a5b34 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:50.812219 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2500/5007] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:50 2022] GET /identity/v3/roles => generated 2096 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:50.813459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71271ebc-81f3-454e-8aed-4136619a5b34 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:50.831926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71271ebc-81f3-454e-8aed-4136619a5b34 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:50.832480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d775dd70-090f-478c-8d3c-1e9658006a21 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invalidating the token cache because role 35bc447f4309488aa2abe5ac7e55e27f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:50.832480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d775dd70-090f-478c-8d3c-1e9658006a21 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:50.832480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d775dd70-090f-478c-8d3c-1e9658006a21 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:50.836302 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2508/5008] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:50 2022] DELETE /identity/v3/roles/35bc447f4309488aa2abe5ac7e55e27f => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:50.840208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775dd70-090f-478c-8d3c-1e9658006a21 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:50.841828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d775dd70-090f-478c-8d3c-1e9658006a21 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:50.845280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e74ce-8750-4938-a71b-e56aa2918088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:50.846267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e74ce-8750-4938-a71b-e56aa2918088 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:50.847247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e74ce-8750-4938-a71b-e56aa2918088 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:50.847727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e74ce-8750-4938-a71b-e56aa2918088 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:50.849309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e74ce-8750-4938-a71b-e56aa2918088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:50.854842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e74ce-8750-4938-a71b-e56aa2918088 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:50.882519 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2501/5009] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:50 2022] GET /identity/v3/roles => generated 1872 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:50.883424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e74ce-8750-4938-a71b-e56aa2918088 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:50.885393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5a3e74ce-8750-4938-a71b-e56aa2918088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:50.901598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e74ce-8750-4938-a71b-e56aa2918088 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:50.970290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f990b-5700-4855-b7b5-4f611de6198d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:50.971080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f990b-5700-4855-b7b5-4f611de6198d admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:50.971381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f990b-5700-4855-b7b5-4f611de6198d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:50.971649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f990b-5700-4855-b7b5-4f611de6198d admin admin] PATH_INFO: `/v3/projects/b127cef917194b08812c5e3a1b1e400f/users/81f26e103a9341e89db4c1748b78c80d/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:50.972315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775dd70-090f-478c-8d3c-1e9658006a21 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:50.982529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46320814-c035-4c94-b526-e396aaee1ac8 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:50.984157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46320814-c035-4c94-b526-e396aaee1ac8 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:50.985118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46320814-c035-4c94-b526-e396aaee1ac8 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:50.985578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46320814-c035-4c94-b526-e396aaee1ac8 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/29ae2d1e301c43dcb4d7584f3670224e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:50.988092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46320814-c035-4c94-b526-e396aaee1ac8 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_role(role_id=29ae2d1e301c43dcb4d7584f3670224e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:50.989469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f990b-5700-4855-b7b5-4f611de6198d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b127cef917194b08812c5e3a1b1e400f, user_id=81f26e103a9341e89db4c1748b78c80d, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:50.992422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46320814-c035-4c94-b526-e396aaee1ac8 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:50.992886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f990b-5700-4855-b7b5-4f611de6198d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:51.124654 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2502/5010] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:50 2022] PUT /identity/v3/projects/b127cef917194b08812c5e3a1b1e400f/users/81f26e103a9341e89db4c1748b78c80d/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:51.229466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f0bad-a1ac-4d75-b1bf-0bbeae31fcf8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:51.229756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f0bad-a1ac-4d75-b1bf-0bbeae31fcf8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:51.230032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f0bad-a1ac-4d75-b1bf-0bbeae31fcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:51.239045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-46320814-c035-4c94-b526-e396aaee1ac8 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invalidating the token cache because role 29ae2d1e301c43dcb4d7584f3670224e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:51.239525 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-46320814-c035-4c94-b526-e396aaee1ac8 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:51.241072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-46320814-c035-4c94-b526-e396aaee1ac8 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:51.247213 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2509/5011] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:50 2022] DELETE /identity/v3/roles/29ae2d1e301c43dcb4d7584f3670224e => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:51.251229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46320814-c035-4c94-b526-e396aaee1ac8 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:51.253283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-46320814-c035-4c94-b526-e396aaee1ac8 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:51.265470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0a5f0bad-a1ac-4d75-b1bf-0bbeae31fcf8 None None] MFA Rules not processed for user `81f26e103a9341e89db4c1748b78c80d`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:51.266841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0a5f0bad-a1ac-4d75-b1bf-0bbeae31fcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:51.366972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46320814-c035-4c94-b526-e396aaee1ac8 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:51.371971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05712846-9e33-444a-bcdf-254f2fe86ba9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7274437e2094ccf98150ba324605dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853886e208834ca8ac767f3cdb4078a4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:51.372911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05712846-9e33-444a-bcdf-254f2fe86ba9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:51.373201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05712846-9e33-444a-bcdf-254f2fe86ba9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:51.373482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05712846-9e33-444a-bcdf-254f2fe86ba9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] PATH_INFO: `/v3/roles/5ebc102e533e46c4afab9b94c70fe742` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:51.375110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05712846-9e33-444a-bcdf-254f2fe86ba9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5ebc102e533e46c4afab9b94c70fe742)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:51.377147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05712846-9e33-444a-bcdf-254f2fe86ba9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:51.488352 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2503/5012] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:36:51.501261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f0bad-a1ac-4d75-b1bf-0bbeae31fcf8 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:51.501959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-05712846-9e33-444a-bcdf-254f2fe86ba9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invalidating the token cache because role 5ebc102e533e46c4afab9b94c70fe742 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:51.502288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-05712846-9e33-444a-bcdf-254f2fe86ba9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:51.502604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0a5f0bad-a1ac-4d75-b1bf-0bbeae31fcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:51.503152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-05712846-9e33-444a-bcdf-254f2fe86ba9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:51.506081 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2510/5013] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:51 2022] DELETE /identity/v3/roles/5ebc102e533e46c4afab9b94c70fe742 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:51.510294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05712846-9e33-444a-bcdf-254f2fe86ba9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:51.511607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-05712846-9e33-444a-bcdf-254f2fe86ba9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:51.559455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f0bad-a1ac-4d75-b1bf-0bbeae31fcf8 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:51.579656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05712846-9e33-444a-bcdf-254f2fe86ba9 tempest-RolesV3TestJSON-1845440472 tempest-RolesV3TestJSON-1845440472-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:51.584659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e9fbd-4a70-4181-83af-16bd1a10df80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:51.585545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e9fbd-4a70-4181-83af-16bd1a10df80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:51.585829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e9fbd-4a70-4181-83af-16bd1a10df80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:51.586109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e9fbd-4a70-4181-83af-16bd1a10df80 admin admin] PATH_INFO: `/v3/users/d0178a5287a04d1c92c0ae4f7677cdd7` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:51.587326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e9fbd-4a70-4181-83af-16bd1a10df80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0178a5287a04d1c92c0ae4f7677cdd7)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:51.589279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e9fbd-4a70-4181-83af-16bd1a10df80 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:51.612591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0860d-5b60-4754-8c21-b9fa964132d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:51.613436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0860d-5b60-4754-8c21-b9fa964132d8 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:51.613842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0860d-5b60-4754-8c21-b9fa964132d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:51.614229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0860d-5b60-4754-8c21-b9fa964132d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:51.616186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-94e0860d-5b60-4754-8c21-b9fa964132d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:51.691385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0860d-5b60-4754-8c21-b9fa964132d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:51.692989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0860d-5b60-4754-8c21-b9fa964132d8 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:51.703065 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2504/5014] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:36:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:36:51.722942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0860d-5b60-4754-8c21-b9fa964132d8 service cinder] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:51.724384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-94e0860d-5b60-4754-8c21-b9fa964132d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:51.743676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0860d-5b60-4754-8c21-b9fa964132d8 service cinder] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:51.743676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1037510-4a84-470a-8be4-4127f37e51d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:51.743893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1037510-4a84-470a-8be4-4127f37e51d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:51.744143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1037510-4a84-470a-8be4-4127f37e51d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:51.744456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1037510-4a84-470a-8be4-4127f37e51d4 admin admin] PATH_INFO: `/v3/users/81f26e103a9341e89db4c1748b78c80d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:51.745805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1037510-4a84-470a-8be4-4127f37e51d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81f26e103a9341e89db4c1748b78c80d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:51.747753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1037510-4a84-470a-8be4-4127f37e51d4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:51.812142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-be0e9fbd-4a70-4181-83af-16bd1a10df80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0178a5287a04d1c92c0ae4f7677cdd7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:51.824375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-be0e9fbd-4a70-4181-83af-16bd1a10df80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0178a5287a04d1c92c0ae4f7677cdd7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:51.825145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-be0e9fbd-4a70-4181-83af-16bd1a10df80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0178a5287a04d1c92c0ae4f7677cdd7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:51.831894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-be0e9fbd-4a70-4181-83af-16bd1a10df80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0178a5287a04d1c92c0ae4f7677cdd7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:51.904005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-be0e9fbd-4a70-4181-83af-16bd1a10df80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0178a5287a04d1c92c0ae4f7677cdd7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:51.911669 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2511/5015] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:51 2022] DELETE /identity/v3/users/d0178a5287a04d1c92c0ae4f7677cdd7 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:51.916256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f81e3-21ae-482d-b7ee-2a85464038f3 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:51.916550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f81e3-21ae-482d-b7ee-2a85464038f3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:51.916950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f81e3-21ae-482d-b7ee-2a85464038f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:51.938873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b82f81e3-21ae-482d-b7ee-2a85464038f3 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:51.940088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b82f81e3-21ae-482d-b7ee-2a85464038f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:51.985041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f1037510-4a84-470a-8be4-4127f37e51d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81f26e103a9341e89db4c1748b78c80d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:52.006355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f1037510-4a84-470a-8be4-4127f37e51d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81f26e103a9341e89db4c1748b78c80d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:52.007414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f1037510-4a84-470a-8be4-4127f37e51d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81f26e103a9341e89db4c1748b78c80d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:52.015704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f1037510-4a84-470a-8be4-4127f37e51d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81f26e103a9341e89db4c1748b78c80d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:52.043111 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2512/5016] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:36:52.046159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f81e3-21ae-482d-b7ee-2a85464038f3 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:52.048650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b82f81e3-21ae-482d-b7ee-2a85464038f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:52.088594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f1037510-4a84-470a-8be4-4127f37e51d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81f26e103a9341e89db4c1748b78c80d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:52.104874 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2505/5017] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:51 2022] DELETE /identity/v3/users/81f26e103a9341e89db4c1748b78c80d => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:52.107452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eac81d-4d46-4498-b754-4d14b4a382cc None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:52.110166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eac81d-4d46-4498-b754-4d14b4a382cc None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:52.110655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eac81d-4d46-4498-b754-4d14b4a382cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:52.122884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f81e3-21ae-482d-b7ee-2a85464038f3 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:52.143549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-05eac81d-4d46-4498-b754-4d14b4a382cc None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:52.145502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-05eac81d-4d46-4498-b754-4d14b4a382cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:52.203502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f17be-0a9f-438e-921d-c019525c34a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:52.204426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f17be-0a9f-438e-921d-c019525c34a3 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:52.204757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f17be-0a9f-438e-921d-c019525c34a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:52.205099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f17be-0a9f-438e-921d-c019525c34a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:52.207219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a50f17be-0a9f-438e-921d-c019525c34a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:52.240110 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2506/5018] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:52.253416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eac81d-4d46-4498-b754-4d14b4a382cc None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:52.258745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-05eac81d-4d46-4498-b754-4d14b4a382cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:52.280070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eac81d-4d46-4498-b754-4d14b4a382cc None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:52.284780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302c7bb-98d4-4b2b-a30a-fc815b11e38f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:52.286422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302c7bb-98d4-4b2b-a30a-fc815b11e38f service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:52.286981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302c7bb-98d4-4b2b-a30a-fc815b11e38f service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:52.287266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302c7bb-98d4-4b2b-a30a-fc815b11e38f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:52.300291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f17be-0a9f-438e-921d-c019525c34a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:52.300935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302c7bb-98d4-4b2b-a30a-fc815b11e38f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:52.301987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302c7bb-98d4-4b2b-a30a-fc815b11e38f service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:52.303800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f17be-0a9f-438e-921d-c019525c34a3 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:52.315117 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2507/5019] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:36:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:36:52.317612 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2513/5020] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:36:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:36:52.921640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302c7bb-98d4-4b2b-a30a-fc815b11e38f service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:52.923730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b302c7bb-98d4-4b2b-a30a-fc815b11e38f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:52.945967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302c7bb-98d4-4b2b-a30a-fc815b11e38f service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:52.953381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97cdf0-00c8-4f9d-a869-5ddd77c94835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:52.954695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97cdf0-00c8-4f9d-a869-5ddd77c94835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:52.955730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97cdf0-00c8-4f9d-a869-5ddd77c94835 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:52.956746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97cdf0-00c8-4f9d-a869-5ddd77c94835 admin admin] PATH_INFO: `/v3/projects/1376e56d351345ed8992c9b6ead2220b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:52.958441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97cdf0-00c8-4f9d-a869-5ddd77c94835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1376e56d351345ed8992c9b6ead2220b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:52.961482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97cdf0-00c8-4f9d-a869-5ddd77c94835 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:53.009783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f17be-0a9f-438e-921d-c019525c34a3 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:53.009783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a50f17be-0a9f-438e-921d-c019525c34a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:53.030727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f17be-0a9f-438e-921d-c019525c34a3 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:53.041801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b6fa0-28ed-40b8-aee6-3201d2337a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:53.044257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b6fa0-28ed-40b8-aee6-3201d2337a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:53.044257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b6fa0-28ed-40b8-aee6-3201d2337a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:53.044257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b6fa0-28ed-40b8-aee6-3201d2337a8e admin admin] PATH_INFO: `/v3/projects/b127cef917194b08812c5e3a1b1e400f` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:53.046722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b6fa0-28ed-40b8-aee6-3201d2337a8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b127cef917194b08812c5e3a1b1e400f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:53.048380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b6fa0-28ed-40b8-aee6-3201d2337a8e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:53.175662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4f97cdf0-00c8-4f9d-a869-5ddd77c94835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1376e56d351345ed8992c9b6ead2220b', 'request_id': 'req-4f97cdf0-00c8-4f9d-a869-5ddd77c94835'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:53.182926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4f97cdf0-00c8-4f9d-a869-5ddd77c94835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1376e56d351345ed8992c9b6ead2220b', 'request_id': 'req-4f97cdf0-00c8-4f9d-a869-5ddd77c94835'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:53.206006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-896b6fa0-28ed-40b8-aee6-3201d2337a8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b127cef917194b08812c5e3a1b1e400f', 'request_id': 'req-896b6fa0-28ed-40b8-aee6-3201d2337a8e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:53.283974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4f97cdf0-00c8-4f9d-a869-5ddd77c94835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1376e56d351345ed8992c9b6ead2220b', 'request_id': 'req-4f97cdf0-00c8-4f9d-a869-5ddd77c94835'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:53.299149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4f97cdf0-00c8-4f9d-a869-5ddd77c94835 admin admin] The token cache is being invalidate because project 1376e56d351345ed8992c9b6ead2220b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:53.299490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4f97cdf0-00c8-4f9d-a869-5ddd77c94835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:53.300102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4f97cdf0-00c8-4f9d-a869-5ddd77c94835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:53.301712 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2508/5021] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:36:52 2022] DELETE /identity/v3/projects/1376e56d351345ed8992c9b6ead2220b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:53.313265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97cdf0-00c8-4f9d-a869-5ddd77c94835 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:53.314945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4f97cdf0-00c8-4f9d-a869-5ddd77c94835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:53.345157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-896b6fa0-28ed-40b8-aee6-3201d2337a8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b127cef917194b08812c5e3a1b1e400f', 'request_id': 'req-896b6fa0-28ed-40b8-aee6-3201d2337a8e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:53.353864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-896b6fa0-28ed-40b8-aee6-3201d2337a8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b127cef917194b08812c5e3a1b1e400f', 'request_id': 'req-896b6fa0-28ed-40b8-aee6-3201d2337a8e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:53.368649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-896b6fa0-28ed-40b8-aee6-3201d2337a8e admin admin] The token cache is being invalidate because project b127cef917194b08812c5e3a1b1e400f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:53.368943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-896b6fa0-28ed-40b8-aee6-3201d2337a8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:53.369714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-896b6fa0-28ed-40b8-aee6-3201d2337a8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:53.371641 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2514/5022] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:36:53 2022] DELETE /identity/v3/projects/b127cef917194b08812c5e3a1b1e400f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:53.376687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b3f06-ac00-4eb2-91f1-9440294cd11a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:53.377007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b3f06-ac00-4eb2-91f1-9440294cd11a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:53.377299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b3f06-ac00-4eb2-91f1-9440294cd11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:53.392996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97cdf0-00c8-4f9d-a869-5ddd77c94835 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:53.396817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1b9b3f06-ac00-4eb2-91f1-9440294cd11a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:53.398041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1b9b3f06-ac00-4eb2-91f1-9440294cd11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:53.457762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50954b-4faf-45bb-8d24-df41bb3571c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:53.464091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50954b-4faf-45bb-8d24-df41bb3571c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:53.464091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50954b-4faf-45bb-8d24-df41bb3571c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:53.464091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50954b-4faf-45bb-8d24-df41bb3571c0 admin admin] PATH_INFO: `/v3/users/a7274437e2094ccf98150ba324605dd6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:53.464091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50954b-4faf-45bb-8d24-df41bb3571c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7274437e2094ccf98150ba324605dd6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:53.464091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50954b-4faf-45bb-8d24-df41bb3571c0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:53.464556 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2515/5023] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:36:53.472687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449e13c-4093-4d73-bf94-d1e499d3c7d6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:53.472979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449e13c-4093-4d73-bf94-d1e499d3c7d6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:53.473255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449e13c-4093-4d73-bf94-d1e499d3c7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:53.492251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-5449e13c-4093-4d73-bf94-d1e499d3c7d6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:53.493528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5449e13c-4093-4d73-bf94-d1e499d3c7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:53.502075 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2516/5024] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:36:53.510520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449e13c-4093-4d73-bf94-d1e499d3c7d6 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:53.515881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449e13c-4093-4d73-bf94-d1e499d3c7d6 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:53.521405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc125b-a0e0-4931-99bf-5057b134e439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:53.522091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc125b-a0e0-4931-99bf-5057b134e439 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:53.522377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc125b-a0e0-4931-99bf-5057b134e439 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:53.522654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc125b-a0e0-4931-99bf-5057b134e439 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:53.523434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc125b-a0e0-4931-99bf-5057b134e439 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:36:53.523696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc125b-a0e0-4931-99bf-5057b134e439 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:53.525403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc125b-a0e0-4931-99bf-5057b134e439 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:53.539765 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2517/5025] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:53.544263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc125b-a0e0-4931-99bf-5057b134e439 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:53.554868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc125b-a0e0-4931-99bf-5057b134e439 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:53.559802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849f8b3-45ce-440c-8a66-107a2ab4225b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:53.560578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849f8b3-45ce-440c-8a66-107a2ab4225b admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:53.560896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849f8b3-45ce-440c-8a66-107a2ab4225b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:53.561252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849f8b3-45ce-440c-8a66-107a2ab4225b admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:53.561928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849f8b3-45ce-440c-8a66-107a2ab4225b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:53.563816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849f8b3-45ce-440c-8a66-107a2ab4225b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:53.706029 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2518/5026] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:36:53 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:36:53.711152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849f8b3-45ce-440c-8a66-107a2ab4225b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:53.721280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1f50954b-4faf-45bb-8d24-df41bb3571c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7274437e2094ccf98150ba324605dd6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:53.738080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1f50954b-4faf-45bb-8d24-df41bb3571c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7274437e2094ccf98150ba324605dd6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:53.738816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1f50954b-4faf-45bb-8d24-df41bb3571c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7274437e2094ccf98150ba324605dd6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:53.745825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1f50954b-4faf-45bb-8d24-df41bb3571c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7274437e2094ccf98150ba324605dd6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:53.785058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849f8b3-45ce-440c-8a66-107a2ab4225b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:53.789710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da07aa3-6f35-4aeb-9854-a2b7fa566f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:53.790384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da07aa3-6f35-4aeb-9854-a2b7fa566f52 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:53.790671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da07aa3-6f35-4aeb-9854-a2b7fa566f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:53.790955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da07aa3-6f35-4aeb-9854-a2b7fa566f52 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:53.791645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da07aa3-6f35-4aeb-9854-a2b7fa566f52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:53.793616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da07aa3-6f35-4aeb-9854-a2b7fa566f52 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:53.841771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1f50954b-4faf-45bb-8d24-df41bb3571c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7274437e2094ccf98150ba324605dd6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:53.848489 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2509/5027] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:53 2022] DELETE /identity/v3/users/a7274437e2094ccf98150ba324605dd6 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:53.879229 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2519/5028] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:36:53 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:53.885889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50954b-4faf-45bb-8d24-df41bb3571c0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:53.890921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1f50954b-4faf-45bb-8d24-df41bb3571c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:53.978579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50954b-4faf-45bb-8d24-df41bb3571c0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:53.983586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c91410-edad-406b-b8ad-419ccdf2a121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:53.984265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c91410-edad-406b-b8ad-419ccdf2a121 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:53.984546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c91410-edad-406b-b8ad-419ccdf2a121 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:53.984868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c91410-edad-406b-b8ad-419ccdf2a121 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:53.985652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c91410-edad-406b-b8ad-419ccdf2a121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:53.988245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c91410-edad-406b-b8ad-419ccdf2a121 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:53.999961 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2510/5029] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:54.005018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da07aa3-6f35-4aeb-9854-a2b7fa566f52 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:54.029123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da07aa3-6f35-4aeb-9854-a2b7fa566f52 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:54.036429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f08cc-6d1b-487d-9e17-4fc4c5ab3fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:54.037509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f08cc-6d1b-487d-9e17-4fc4c5ab3fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:54.037509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f08cc-6d1b-487d-9e17-4fc4c5ab3fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:54.037800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f08cc-6d1b-487d-9e17-4fc4c5ab3fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:54.038484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f08cc-6d1b-487d-9e17-4fc4c5ab3fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:54.040222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f08cc-6d1b-487d-9e17-4fc4c5ab3fd9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:54.064670 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2520/5030] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:36:54.065471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c91410-edad-406b-b8ad-419ccdf2a121 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:54.076993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c91410-edad-406b-b8ad-419ccdf2a121 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:54.083077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ec202-c82d-4577-b866-14770c7021a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:54.083913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ec202-c82d-4577-b866-14770c7021a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:54.084246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ec202-c82d-4577-b866-14770c7021a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:54.089882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ec202-c82d-4577-b866-14770c7021a1 admin admin] PATH_INFO: `/v3/projects/be1e0a81898b455dbad1377adec39dcc/users/f176aec4c2664ef0bb5a02a7cd27a6f5/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:54.102522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ec202-c82d-4577-b866-14770c7021a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1e0a81898b455dbad1377adec39dcc, user_id=f176aec4c2664ef0bb5a02a7cd27a6f5, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:54.105749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ec202-c82d-4577-b866-14770c7021a1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:54.231035 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2511/5031] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:54 2022] PUT /identity/v3/projects/be1e0a81898b455dbad1377adec39dcc/users/f176aec4c2664ef0bb5a02a7cd27a6f5/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:54.242971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ac856-8591-4028-8506-86ac40c76a9f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:54.243272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ac856-8591-4028-8506-86ac40c76a9f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:54.243558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ac856-8591-4028-8506-86ac40c76a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:54.274662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-db2ac856-8591-4028-8506-86ac40c76a9f None None] MFA Rules not processed for user `f176aec4c2664ef0bb5a02a7cd27a6f5`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:54.275983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-db2ac856-8591-4028-8506-86ac40c76a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:54.356017 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2521/5032] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:54.357381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ec202-c82d-4577-b866-14770c7021a1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:54.447872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ec202-c82d-4577-b866-14770c7021a1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:54.457525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6bdaa-85e8-41f5-92fd-7552381b4ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:54.458597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6bdaa-85e8-41f5-92fd-7552381b4ccc admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:54.461072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6bdaa-85e8-41f5-92fd-7552381b4ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:54.461072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6bdaa-85e8-41f5-92fd-7552381b4ccc admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:54.461072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6bdaa-85e8-41f5-92fd-7552381b4ccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:54.465254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6bdaa-85e8-41f5-92fd-7552381b4ccc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:54.590756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ac856-8591-4028-8506-86ac40c76a9f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:54.592873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-db2ac856-8591-4028-8506-86ac40c76a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:54.622789 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2512/5033] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:36:54 2022] POST /identity/v3/projects => generated 375 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:54.622903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ac856-8591-4028-8506-86ac40c76a9f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:54.624127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6bdaa-85e8-41f5-92fd-7552381b4ccc admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:54.708591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cbd2a-7732-40fd-b255-1ab108f8c21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:54.709779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cbd2a-7732-40fd-b255-1ab108f8c21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:54.711253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cbd2a-7732-40fd-b255-1ab108f8c21c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:54.711741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cbd2a-7732-40fd-b255-1ab108f8c21c admin admin] PATH_INFO: `/v3/projects/853886e208834ca8ac767f3cdb4078a4` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:54.716373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643cbd2a-7732-40fd-b255-1ab108f8c21c admin admin] RBAC: Authorizing `identity:delete_project(project_id=853886e208834ca8ac767f3cdb4078a4)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:54.724568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643cbd2a-7732-40fd-b255-1ab108f8c21c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:54.767038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6bdaa-85e8-41f5-92fd-7552381b4ccc admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:54.777295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d3202-f017-42e1-805f-f5a98b6ccdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:54.778296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d3202-f017-42e1-805f-f5a98b6ccdaa admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:54.779213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d3202-f017-42e1-805f-f5a98b6ccdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:54.779592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d3202-f017-42e1-805f-f5a98b6ccdaa admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:54.781180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d3202-f017-42e1-805f-f5a98b6ccdaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:54.783476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d3202-f017-42e1-805f-f5a98b6ccdaa admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:54.870406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-643cbd2a-7732-40fd-b255-1ab108f8c21c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '853886e208834ca8ac767f3cdb4078a4', 'request_id': 'req-643cbd2a-7732-40fd-b255-1ab108f8c21c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:54.905502 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2513/5034] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:36:54 2022] POST /identity/v3/users => generated 294 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:36:54.912085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d3202-f017-42e1-805f-f5a98b6ccdaa admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:54.921961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d3202-f017-42e1-805f-f5a98b6ccdaa admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:54.979615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb375cc-2002-45d6-a64c-77ebae47cc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:54.980540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb375cc-2002-45d6-a64c-77ebae47cc34 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:54.981037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb375cc-2002-45d6-a64c-77ebae47cc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:54.981323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb375cc-2002-45d6-a64c-77ebae47cc34 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:54.982098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb375cc-2002-45d6-a64c-77ebae47cc34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:54.983207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-643cbd2a-7732-40fd-b255-1ab108f8c21c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '853886e208834ca8ac767f3cdb4078a4', 'request_id': 'req-643cbd2a-7732-40fd-b255-1ab108f8c21c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:54.983728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb375cc-2002-45d6-a64c-77ebae47cc34 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:54.990136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-643cbd2a-7732-40fd-b255-1ab108f8c21c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '853886e208834ca8ac767f3cdb4078a4', 'request_id': 'req-643cbd2a-7732-40fd-b255-1ab108f8c21c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:54.998995 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2514/5035] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:36:55.000344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb375cc-2002-45d6-a64c-77ebae47cc34 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:55.001164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-643cbd2a-7732-40fd-b255-1ab108f8c21c admin admin] The token cache is being invalidate because project 853886e208834ca8ac767f3cdb4078a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:55.001474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-643cbd2a-7732-40fd-b255-1ab108f8c21c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:55.002140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-643cbd2a-7732-40fd-b255-1ab108f8c21c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:55.011802 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2522/5036] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:36:54 2022] DELETE /identity/v3/projects/853886e208834ca8ac767f3cdb4078a4 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:55.012034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb375cc-2002-45d6-a64c-77ebae47cc34 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:55.013832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f89e81-c062-4e4c-a829-eb54b6d37862 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:55.024695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f89e81-c062-4e4c-a829-eb54b6d37862 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:55.024695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f89e81-c062-4e4c-a829-eb54b6d37862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:55.024927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e653b4-6103-4cbb-9573-12a291786c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:55.024927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e653b4-6103-4cbb-9573-12a291786c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:55.024927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e653b4-6103-4cbb-9573-12a291786c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:55.024927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e653b4-6103-4cbb-9573-12a291786c74 admin admin] PATH_INFO: `/v3/projects/aaaf04bd846b4448b671fcab899e442b/users/718a00d2305f4715bebf41bc26c02d27/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:55.035371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e653b4-6103-4cbb-9573-12a291786c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaaf04bd846b4448b671fcab899e442b, user_id=718a00d2305f4715bebf41bc26c02d27, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:55.035566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c8f89e81-c062-4e4c-a829-eb54b6d37862 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:55.036676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c8f89e81-c062-4e4c-a829-eb54b6d37862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:55.039186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e653b4-6103-4cbb-9573-12a291786c74 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:55.052699 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2523/5037] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:55.055176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfca5a-0d78-4696-9341-f3cb404e12b6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:55.055176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfca5a-0d78-4696-9341-f3cb404e12b6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:55.055176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfca5a-0d78-4696-9341-f3cb404e12b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:55.072888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-97dfca5a-0d78-4696-9341-f3cb404e12b6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:55.077204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-97dfca5a-0d78-4696-9341-f3cb404e12b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:55.083005 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2524/5038] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:55.087451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfca5a-0d78-4696-9341-f3cb404e12b6 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:55.097284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfca5a-0d78-4696-9341-f3cb404e12b6 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:55.101514 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2515/5039] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:54 2022] PUT /identity/v3/projects/aaaf04bd846b4448b671fcab899e442b/users/718a00d2305f4715bebf41bc26c02d27/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:55.106995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e653b4-6103-4cbb-9573-12a291786c74 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:55.112012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f5e653b4-6103-4cbb-9573-12a291786c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:55.174222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9a5c9-8537-4d80-a3c5-35d097ab35ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:55.174911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9a5c9-8537-4d80-a3c5-35d097ab35ce admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:55.175211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9a5c9-8537-4d80-a3c5-35d097ab35ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:55.175492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9a5c9-8537-4d80-a3c5-35d097ab35ce admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:55.176368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9a5c9-8537-4d80-a3c5-35d097ab35ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:36:55.176518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9a5c9-8537-4d80-a3c5-35d097ab35ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:55.178493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9a5c9-8537-4d80-a3c5-35d097ab35ce admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:55.185508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e653b4-6103-4cbb-9573-12a291786c74 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:55.191604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae88964-ba4e-48c8-a790-0ed0a73ba79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:55.192318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae88964-ba4e-48c8-a790-0ed0a73ba79c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:55.192450 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2525/5040] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:36:55.196037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae88964-ba4e-48c8-a790-0ed0a73ba79c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:55.196342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae88964-ba4e-48c8-a790-0ed0a73ba79c admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:55.197075 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9a5c9-8537-4d80-a3c5-35d097ab35ce admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:55.197247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae88964-ba4e-48c8-a790-0ed0a73ba79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:55.198760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae88964-ba4e-48c8-a790-0ed0a73ba79c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:55.208696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9a5c9-8537-4d80-a3c5-35d097ab35ce admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:55.212550 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2516/5041] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:55.213580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036de359-415a-4041-b9ab-8089a3260430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:55.214239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036de359-415a-4041-b9ab-8089a3260430 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:55.214528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036de359-415a-4041-b9ab-8089a3260430 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:55.214806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036de359-415a-4041-b9ab-8089a3260430 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:55.215648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036de359-415a-4041-b9ab-8089a3260430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:55.216782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae88964-ba4e-48c8-a790-0ed0a73ba79c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:55.217743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036de359-415a-4041-b9ab-8089a3260430 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:55.227101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae88964-ba4e-48c8-a790-0ed0a73ba79c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:55.232378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2d7f8-b646-47b7-bbcd-bc98dae706f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:55.233769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2d7f8-b646-47b7-bbcd-bc98dae706f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:55.233769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2d7f8-b646-47b7-bbcd-bc98dae706f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:55.234074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2d7f8-b646-47b7-bbcd-bc98dae706f2 admin admin] PATH_INFO: `/v3/projects/aaaf04bd846b4448b671fcab899e442b/users/718a00d2305f4715bebf41bc26c02d27/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:55.236196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2d7f8-b646-47b7-bbcd-bc98dae706f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaaf04bd846b4448b671fcab899e442b, user_id=718a00d2305f4715bebf41bc26c02d27, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:55.238999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2d7f8-b646-47b7-bbcd-bc98dae706f2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:55.252215 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2517/5042] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:55 2022] PUT /identity/v3/projects/aaaf04bd846b4448b671fcab899e442b/users/718a00d2305f4715bebf41bc26c02d27/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:55.263461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54127e2f-b3a4-4850-8ff1-4ac3faf2b129 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:55.263789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54127e2f-b3a4-4850-8ff1-4ac3faf2b129 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:55.264088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54127e2f-b3a4-4850-8ff1-4ac3faf2b129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:55.291965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-54127e2f-b3a4-4850-8ff1-4ac3faf2b129 None None] MFA Rules not processed for user `718a00d2305f4715bebf41bc26c02d27`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:55.293303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-54127e2f-b3a4-4850-8ff1-4ac3faf2b129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:55.333470 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2526/5043] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:36:55 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:36:55.334734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036de359-415a-4041-b9ab-8089a3260430 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:55.368124 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2518/5044] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:36:55.381176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54127e2f-b3a4-4850-8ff1-4ac3faf2b129 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:55.382646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-54127e2f-b3a4-4850-8ff1-4ac3faf2b129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:55.404486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036de359-415a-4041-b9ab-8089a3260430 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:55.409246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd98b4-7312-4cb5-89fd-46d87f4beb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:55.409917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd98b4-7312-4cb5-89fd-46d87f4beb03 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:55.410324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd98b4-7312-4cb5-89fd-46d87f4beb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:55.410606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd98b4-7312-4cb5-89fd-46d87f4beb03 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:55.411327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd98b4-7312-4cb5-89fd-46d87f4beb03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:55.413280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd98b4-7312-4cb5-89fd-46d87f4beb03 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:55.442027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54127e2f-b3a4-4850-8ff1-4ac3faf2b129 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:55.492494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0e4fd-1e6e-454e-a42b-8a473e0a1d20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:55.493277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0e4fd-1e6e-454e-a42b-8a473e0a1d20 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:55.493563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0e4fd-1e6e-454e-a42b-8a473e0a1d20 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:55.494632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0e4fd-1e6e-454e-a42b-8a473e0a1d20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:55.495744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c5f0e4fd-1e6e-454e-a42b-8a473e0a1d20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:55.527996 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2527/5045] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:36:55 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:55.537702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd98b4-7312-4cb5-89fd-46d87f4beb03 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:55.551553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd98b4-7312-4cb5-89fd-46d87f4beb03 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:55.559120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079c4b4-d57b-4924-a520-56dc2e16cee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:55.561703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079c4b4-d57b-4924-a520-56dc2e16cee8 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:55.561997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079c4b4-d57b-4924-a520-56dc2e16cee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:55.562277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079c4b4-d57b-4924-a520-56dc2e16cee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:55.563021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079c4b4-d57b-4924-a520-56dc2e16cee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:55.564669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079c4b4-d57b-4924-a520-56dc2e16cee8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:55.577583 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2528/5046] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:55.581373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0e4fd-1e6e-454e-a42b-8a473e0a1d20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:55.581549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079c4b4-d57b-4924-a520-56dc2e16cee8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:55.583252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0e4fd-1e6e-454e-a42b-8a473e0a1d20 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:55.594638 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2519/5047] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:36:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:36:55.600650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079c4b4-d57b-4924-a520-56dc2e16cee8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:55.600650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c6744-9724-4496-a08c-e0a0ede2b48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:55.600650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c6744-9724-4496-a08c-e0a0ede2b48c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:55.601670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c6744-9724-4496-a08c-e0a0ede2b48c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:55.601670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c6744-9724-4496-a08c-e0a0ede2b48c admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:55.602646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c6744-9724-4496-a08c-e0a0ede2b48c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:55.604245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c6744-9724-4496-a08c-e0a0ede2b48c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:55.624349 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2529/5048] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:55.629062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0e4fd-1e6e-454e-a42b-8a473e0a1d20 service cinder] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:55.653240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0e4fd-1e6e-454e-a42b-8a473e0a1d20 service cinder] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:55.658900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9da0c3-4e41-4b12-a85e-11255761c212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:55.659916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9da0c3-4e41-4b12-a85e-11255761c212 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:55.660323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9da0c3-4e41-4b12-a85e-11255761c212 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:55.660778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9da0c3-4e41-4b12-a85e-11255761c212 admin admin] PATH_INFO: `/v3/projects/00c3002a0f7843ceacefdefd9b417816/users/6170c56a470d4ecc9f5ba1793e8f5011/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:55.681835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9da0c3-4e41-4b12-a85e-11255761c212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00c3002a0f7843ceacefdefd9b417816, user_id=6170c56a470d4ecc9f5ba1793e8f5011, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:55.684671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9da0c3-4e41-4b12-a85e-11255761c212 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:55.768128 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2520/5049] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:55 2022] PUT /identity/v3/projects/00c3002a0f7843ceacefdefd9b417816/users/6170c56a470d4ecc9f5ba1793e8f5011/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:55.780495 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851866e3-6c71-4f5d-bdb5-9cb9f1fcb085 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:55.780952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851866e3-6c71-4f5d-bdb5-9cb9f1fcb085 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:55.781402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851866e3-6c71-4f5d-bdb5-9cb9f1fcb085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:55.810032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-851866e3-6c71-4f5d-bdb5-9cb9f1fcb085 None None] MFA Rules not processed for user `6170c56a470d4ecc9f5ba1793e8f5011`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:55.812144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-851866e3-6c71-4f5d-bdb5-9cb9f1fcb085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:55.899517 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2530/5050] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:55.906886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9da0c3-4e41-4b12-a85e-11255761c212 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:55.922835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9da0c3-4e41-4b12-a85e-11255761c212 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:55.928255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b43604-7b2f-4b2d-a2a4-848e1afd696a tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6170c56a470d4ecc9f5ba1793e8f5011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00c3002a0f7843ceacefdefd9b417816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:55.929176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b43604-7b2f-4b2d-a2a4-848e1afd696a tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:55.929489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b43604-7b2f-4b2d-a2a4-848e1afd696a tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:55.929845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b43604-7b2f-4b2d-a2a4-848e1afd696a tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] PATH_INFO: `/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:55.934878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b43604-7b2f-4b2d-a2a4-848e1afd696a tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=6170c56a470d4ecc9f5ba1793e8f5011)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:55.937232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b43604-7b2f-4b2d-a2a4-848e1afd696a tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:56.204355 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2521/5051] 10.222.0.16 () {60 vars in 1298 bytes} [Mon May 2 10:36:55 2022] POST /identity/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2 => generated 367 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:56.208725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851866e3-6c71-4f5d-bdb5-9cb9f1fcb085 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:56.219763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851866e3-6c71-4f5d-bdb5-9cb9f1fcb085 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:56.224893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790419db-4393-4286-b8be-0e673304dc00 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6170c56a470d4ecc9f5ba1793e8f5011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00c3002a0f7843ceacefdefd9b417816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:56.225911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790419db-4393-4286-b8be-0e673304dc00 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:56.226674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790419db-4393-4286-b8be-0e673304dc00 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:56.226674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790419db-4393-4286-b8be-0e673304dc00 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] PATH_INFO: `/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2/ffd715de84b44f119a3f6ab2c8818f1e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:56.229912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790419db-4393-4286-b8be-0e673304dc00 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=6170c56a470d4ecc9f5ba1793e8f5011, credential_id=ffd715de84b44f119a3f6ab2c8818f1e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:56.231490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790419db-4393-4286-b8be-0e673304dc00 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:56.409149 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2531/5052] 10.222.0.16 () {58 vars in 1379 bytes} [Mon May 2 10:36:56 2022] DELETE /identity/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2/ffd715de84b44f119a3f6ab2c8818f1e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:56.409774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b43604-7b2f-4b2d-a2a4-848e1afd696a tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:56.422521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b43604-7b2f-4b2d-a2a4-848e1afd696a tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:56.428341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce882ae-2e71-4860-816b-d83187a73fa0 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6170c56a470d4ecc9f5ba1793e8f5011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00c3002a0f7843ceacefdefd9b417816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:56.430005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce882ae-2e71-4860-816b-d83187a73fa0 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:56.430482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce882ae-2e71-4860-816b-d83187a73fa0 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:56.431065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce882ae-2e71-4860-816b-d83187a73fa0 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] PATH_INFO: `/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:56.431947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce882ae-2e71-4860-816b-d83187a73fa0 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=6170c56a470d4ecc9f5ba1793e8f5011)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:56.434364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce882ae-2e71-4860-816b-d83187a73fa0 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:56.531613 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2522/5053] 10.222.0.16 () {60 vars in 1298 bytes} [Mon May 2 10:36:56 2022] POST /identity/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2 => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:56.535810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790419db-4393-4286-b8be-0e673304dc00 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:56.545160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790419db-4393-4286-b8be-0e673304dc00 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:56.552653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff1552-4db8-47cb-93e7-305ac48aa9ed tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6170c56a470d4ecc9f5ba1793e8f5011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00c3002a0f7843ceacefdefd9b417816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:56.552653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff1552-4db8-47cb-93e7-305ac48aa9ed tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:56.553031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff1552-4db8-47cb-93e7-305ac48aa9ed tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:56.553190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff1552-4db8-47cb-93e7-305ac48aa9ed tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] PATH_INFO: `/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2/73164e0296b24bbc86d0c9bf90a90be0` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:56.555456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff1552-4db8-47cb-93e7-305ac48aa9ed tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=6170c56a470d4ecc9f5ba1793e8f5011, credential_id=73164e0296b24bbc86d0c9bf90a90be0)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:56.556951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff1552-4db8-47cb-93e7-305ac48aa9ed tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:56.657967 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2532/5054] 10.222.0.16 () {58 vars in 1379 bytes} [Mon May 2 10:36:56 2022] DELETE /identity/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2/73164e0296b24bbc86d0c9bf90a90be0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:56.659478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce882ae-2e71-4860-816b-d83187a73fa0 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:56.668744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce882ae-2e71-4860-816b-d83187a73fa0 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:56.700652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07594f-b635-4504-82b8-0c4b9586fb9b tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6170c56a470d4ecc9f5ba1793e8f5011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00c3002a0f7843ceacefdefd9b417816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:56.707075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07594f-b635-4504-82b8-0c4b9586fb9b tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:56.709453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07594f-b635-4504-82b8-0c4b9586fb9b tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:56.709790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07594f-b635-4504-82b8-0c4b9586fb9b tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] PATH_INFO: `/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2/73164e0296b24bbc86d0c9bf90a90be0` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:56.752285 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-2c07594f-b635-4504-82b8-0c4b9586fb9b tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Could not find credential: ac6c0bfbe110ac954d106183a887488d0be97d203923a64b3a0675119a45feba.: keystone.exception.CredentialNotFound: Could not find credential: ac6c0bfbe110ac954d106183a887488d0be97d203923a64b3a0675119a45feba. May 02 10:36:56.752285 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:36:56.752285 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:36:56.752285 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:36:56.752285 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:36:56.752285 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:36:56.752285 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:36:56.752285 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:36:56.752285 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:36:56.752285 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:36:56.752285 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:36:56.752285 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:36:56.752285 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get May 02 10:36:56.752285 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call( May 02 10:36:56.753552 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call May 02 10:36:56.753552 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() May 02 10:36:56.753552 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match May 02 10:36:56.753552 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( May 02 10:36:56.753552 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:36:56.753552 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:36:56.753552 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential May 02 10:36:56.753552 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) May 02 10:36:56.753552 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:36:56.753552 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:36:56.753552 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:36:56.753552 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:36:56.753552 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:36:56.753552 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:36:56.753552 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:36:56.753552 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:36:56.758982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:36:56.758982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:36:56.758982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:36:56.758982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:36:56.758982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:36:56.758982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:36:56.758982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential May 02 10:36:56.758982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) May 02 10:36:56.758982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential May 02 10:36:56.758982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() May 02 10:36:56.758982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential May 02 10:36:56.758982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) May 02 10:36:56.758982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: ac6c0bfbe110ac954d106183a887488d0be97d203923a64b3a0675119a45feba. May 02 10:36:56.758982 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:36:56.758982 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2523/5055] 10.222.0.16 () {58 vars in 1376 bytes} [Mon May 2 10:36:56 2022] GET /identity/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2/73164e0296b24bbc86d0c9bf90a90be0 => generated 148 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:36:56.760635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff1552-4db8-47cb-93e7-305ac48aa9ed tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:56.769881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff1552-4db8-47cb-93e7-305ac48aa9ed tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:56.776031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e3142-b143-40c9-9d69-42af40bbd5d4 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6170c56a470d4ecc9f5ba1793e8f5011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00c3002a0f7843ceacefdefd9b417816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:56.777335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e3142-b143-40c9-9d69-42af40bbd5d4 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:56.777335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e3142-b143-40c9-9d69-42af40bbd5d4 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:56.777556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e3142-b143-40c9-9d69-42af40bbd5d4 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] PATH_INFO: `/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:56.778250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e3142-b143-40c9-9d69-42af40bbd5d4 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=6170c56a470d4ecc9f5ba1793e8f5011)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:56.780353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e3142-b143-40c9-9d69-42af40bbd5d4 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:56.905836 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2533/5056] 10.222.0.16 () {60 vars in 1298 bytes} [Mon May 2 10:36:56 2022] POST /identity/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2 => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:56.909677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07594f-b635-4504-82b8-0c4b9586fb9b tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:56.922632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07594f-b635-4504-82b8-0c4b9586fb9b tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:56.927926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd1975-aa90-4e2d-bf69-7255f3951814 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6170c56a470d4ecc9f5ba1793e8f5011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00c3002a0f7843ceacefdefd9b417816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:56.928803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd1975-aa90-4e2d-bf69-7255f3951814 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:56.931407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd1975-aa90-4e2d-bf69-7255f3951814 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:56.931407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd1975-aa90-4e2d-bf69-7255f3951814 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] PATH_INFO: `/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:56.931407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd1975-aa90-4e2d-bf69-7255f3951814 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=6170c56a470d4ecc9f5ba1793e8f5011)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:56.931964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd1975-aa90-4e2d-bf69-7255f3951814 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:57.032648 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2524/5057] 10.222.0.16 () {60 vars in 1298 bytes} [Mon May 2 10:36:56 2022] POST /identity/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2 => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:57.036459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e3142-b143-40c9-9d69-42af40bbd5d4 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:57.051092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e3142-b143-40c9-9d69-42af40bbd5d4 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:57.057051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621d1eb-c6fa-48a9-bddd-18a0c1f7f70b tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6170c56a470d4ecc9f5ba1793e8f5011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00c3002a0f7843ceacefdefd9b417816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:57.058029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621d1eb-c6fa-48a9-bddd-18a0c1f7f70b tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:57.058407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621d1eb-c6fa-48a9-bddd-18a0c1f7f70b tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:57.058778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621d1eb-c6fa-48a9-bddd-18a0c1f7f70b tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] PATH_INFO: `/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:57.059508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621d1eb-c6fa-48a9-bddd-18a0c1f7f70b tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=6170c56a470d4ecc9f5ba1793e8f5011)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:57.061853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621d1eb-c6fa-48a9-bddd-18a0c1f7f70b tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:57.075944 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2534/5058] 10.222.0.16 () {58 vars in 1277 bytes} [Mon May 2 10:36:57 2022] GET /identity/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2 => generated 865 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:57.080580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd1975-aa90-4e2d-bf69-7255f3951814 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:57.094075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd1975-aa90-4e2d-bf69-7255f3951814 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:57.100612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f578c3-abbf-4165-b26a-ff8f458f4211 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6170c56a470d4ecc9f5ba1793e8f5011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00c3002a0f7843ceacefdefd9b417816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:57.102126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f578c3-abbf-4165-b26a-ff8f458f4211 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:57.111451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f578c3-abbf-4165-b26a-ff8f458f4211 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:57.112108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f578c3-abbf-4165-b26a-ff8f458f4211 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] PATH_INFO: `/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2/2dc233e0df8b41dd81ce5406e84c2fe7` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:57.116283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f578c3-abbf-4165-b26a-ff8f458f4211 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=6170c56a470d4ecc9f5ba1793e8f5011, credential_id=2dc233e0df8b41dd81ce5406e84c2fe7)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:57.117848 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f578c3-abbf-4165-b26a-ff8f458f4211 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:57.229357 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2525/5059] 10.222.0.16 () {58 vars in 1379 bytes} [Mon May 2 10:36:57 2022] DELETE /identity/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2/2dc233e0df8b41dd81ce5406e84c2fe7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:57.233486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621d1eb-c6fa-48a9-bddd-18a0c1f7f70b tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:57.247443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621d1eb-c6fa-48a9-bddd-18a0c1f7f70b tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:57.254366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca54c8-cf11-4f81-a599-c0ef08a4f8e2 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6170c56a470d4ecc9f5ba1793e8f5011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00c3002a0f7843ceacefdefd9b417816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:57.255885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca54c8-cf11-4f81-a599-c0ef08a4f8e2 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:57.256423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca54c8-cf11-4f81-a599-c0ef08a4f8e2 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:57.256905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca54c8-cf11-4f81-a599-c0ef08a4f8e2 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] PATH_INFO: `/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2/412bd194cfcb4d0ea43ed31a398d5297` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:57.259616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca54c8-cf11-4f81-a599-c0ef08a4f8e2 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=6170c56a470d4ecc9f5ba1793e8f5011, credential_id=412bd194cfcb4d0ea43ed31a398d5297)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:57.261365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca54c8-cf11-4f81-a599-c0ef08a4f8e2 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:57.339125 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2535/5060] 10.222.0.16 () {58 vars in 1379 bytes} [Mon May 2 10:36:57 2022] DELETE /identity/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2/412bd194cfcb4d0ea43ed31a398d5297 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:36:57.346223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f578c3-abbf-4165-b26a-ff8f458f4211 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:57.356137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f578c3-abbf-4165-b26a-ff8f458f4211 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:57.360839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf786ba-af29-4852-9556-99aa69c176e7 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6170c56a470d4ecc9f5ba1793e8f5011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00c3002a0f7843ceacefdefd9b417816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:57.361669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf786ba-af29-4852-9556-99aa69c176e7 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:57.362033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf786ba-af29-4852-9556-99aa69c176e7 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:57.362314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf786ba-af29-4852-9556-99aa69c176e7 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] PATH_INFO: `/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:57.363025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf786ba-af29-4852-9556-99aa69c176e7 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=6170c56a470d4ecc9f5ba1793e8f5011)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:57.364525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf786ba-af29-4852-9556-99aa69c176e7 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:57.464987 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2526/5061] 10.222.0.16 () {60 vars in 1298 bytes} [Mon May 2 10:36:57 2022] POST /identity/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2 => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:57.468802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca54c8-cf11-4f81-a599-c0ef08a4f8e2 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:57.478188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca54c8-cf11-4f81-a599-c0ef08a4f8e2 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:57.482645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9167d-c370-4d25-86df-d88e4dcf078b tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6170c56a470d4ecc9f5ba1793e8f5011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00c3002a0f7843ceacefdefd9b417816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:57.483262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9167d-c370-4d25-86df-d88e4dcf078b tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:57.483554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9167d-c370-4d25-86df-d88e4dcf078b tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:57.483835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9167d-c370-4d25-86df-d88e4dcf078b tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] PATH_INFO: `/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2/2f095d382a644943819ddea094e7c400` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:57.485875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9167d-c370-4d25-86df-d88e4dcf078b tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=6170c56a470d4ecc9f5ba1793e8f5011, credential_id=2f095d382a644943819ddea094e7c400)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:57.492642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9167d-c370-4d25-86df-d88e4dcf078b tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:57.499780 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2536/5062] 10.222.0.16 () {58 vars in 1376 bytes} [Mon May 2 10:36:57 2022] GET /identity/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2/2f095d382a644943819ddea094e7c400 => generated 367 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:36:57.501493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf786ba-af29-4852-9556-99aa69c176e7 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:57.515550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf786ba-af29-4852-9556-99aa69c176e7 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:57.537108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2c227-9592-45cb-9605-10154d912ef8 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6170c56a470d4ecc9f5ba1793e8f5011', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00c3002a0f7843ceacefdefd9b417816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:57.550423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2c227-9592-45cb-9605-10154d912ef8 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:57.554235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2c227-9592-45cb-9605-10154d912ef8 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:57.554235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2c227-9592-45cb-9605-10154d912ef8 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] PATH_INFO: `/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2/2f095d382a644943819ddea094e7c400` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:57.554235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2c227-9592-45cb-9605-10154d912ef8 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=6170c56a470d4ecc9f5ba1793e8f5011, credential_id=2f095d382a644943819ddea094e7c400)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:57.554893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2c227-9592-45cb-9605-10154d912ef8 tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:57.624572 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2527/5063] 10.222.0.16 () {58 vars in 1379 bytes} [Mon May 2 10:36:57 2022] DELETE /identity/v3/users/6170c56a470d4ecc9f5ba1793e8f5011/credentials/OS-EC2/2f095d382a644943819ddea094e7c400 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:57.629765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9167d-c370-4d25-86df-d88e4dcf078b tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:57.727503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9167d-c370-4d25-86df-d88e4dcf078b tempest-EC2CredentialsTest-130774797 tempest-EC2CredentialsTest-130774797-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:57.734067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6949d-f9db-4824-8cc0-990054eed5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:57.734999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6949d-f9db-4824-8cc0-990054eed5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:57.735498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6949d-f9db-4824-8cc0-990054eed5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:57.735959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6949d-f9db-4824-8cc0-990054eed5d1 admin admin] PATH_INFO: `/v3/users/6170c56a470d4ecc9f5ba1793e8f5011` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:57.744852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6949d-f9db-4824-8cc0-990054eed5d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6170c56a470d4ecc9f5ba1793e8f5011)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:57.747937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6949d-f9db-4824-8cc0-990054eed5d1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:58.060467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ce6949d-f9db-4824-8cc0-990054eed5d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6170c56a470d4ecc9f5ba1793e8f5011'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:58.072314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ce6949d-f9db-4824-8cc0-990054eed5d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6170c56a470d4ecc9f5ba1793e8f5011'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:58.073129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ce6949d-f9db-4824-8cc0-990054eed5d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6170c56a470d4ecc9f5ba1793e8f5011'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:58.079835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ce6949d-f9db-4824-8cc0-990054eed5d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6170c56a470d4ecc9f5ba1793e8f5011'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:58.195838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ce6949d-f9db-4824-8cc0-990054eed5d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6170c56a470d4ecc9f5ba1793e8f5011'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:58.202852 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2537/5064] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:36:57 2022] DELETE /identity/v3/users/6170c56a470d4ecc9f5ba1793e8f5011 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:58.208311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00a4ea-900e-46bc-9c5f-db7c442b97fd None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:58.208630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00a4ea-900e-46bc-9c5f-db7c442b97fd None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:58.208916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00a4ea-900e-46bc-9c5f-db7c442b97fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:58.228902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9b00a4ea-900e-46bc-9c5f-db7c442b97fd None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:58.230136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9b00a4ea-900e-46bc-9c5f-db7c442b97fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:58.289785 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2528/5065] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:58.301238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6949d-f9db-4824-8cc0-990054eed5d1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:58.303414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8ce6949d-f9db-4824-8cc0-990054eed5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:58.368756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6949d-f9db-4824-8cc0-990054eed5d1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:58.373655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c671824-16b4-4288-8b49-b373fb2f28a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:58.373951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c671824-16b4-4288-8b49-b373fb2f28a2 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:58.374239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c671824-16b4-4288-8b49-b373fb2f28a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:58.374547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c671824-16b4-4288-8b49-b373fb2f28a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:58.389593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c671824-16b4-4288-8b49-b373fb2f28a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:58.391148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c671824-16b4-4288-8b49-b373fb2f28a2 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:58.405310 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2538/5066] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:36:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:36:58.956852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00a4ea-900e-46bc-9c5f-db7c442b97fd None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:58.956852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9b00a4ea-900e-46bc-9c5f-db7c442b97fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:58.974540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00a4ea-900e-46bc-9c5f-db7c442b97fd None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:58.985749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389352a0-9721-4012-87ce-12941ba034e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:58.986665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389352a0-9721-4012-87ce-12941ba034e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:58.987042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389352a0-9721-4012-87ce-12941ba034e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:58.987324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389352a0-9721-4012-87ce-12941ba034e4 admin admin] PATH_INFO: `/v3/projects/00c3002a0f7843ceacefdefd9b417816` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:58.988578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389352a0-9721-4012-87ce-12941ba034e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00c3002a0f7843ceacefdefd9b417816)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:58.990694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389352a0-9721-4012-87ce-12941ba034e4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:59.131518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-389352a0-9721-4012-87ce-12941ba034e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00c3002a0f7843ceacefdefd9b417816', 'request_id': 'req-389352a0-9721-4012-87ce-12941ba034e4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:59.139656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-389352a0-9721-4012-87ce-12941ba034e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00c3002a0f7843ceacefdefd9b417816', 'request_id': 'req-389352a0-9721-4012-87ce-12941ba034e4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:59.225794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-389352a0-9721-4012-87ce-12941ba034e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00c3002a0f7843ceacefdefd9b417816', 'request_id': 'req-389352a0-9721-4012-87ce-12941ba034e4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:59.238833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-389352a0-9721-4012-87ce-12941ba034e4 admin admin] The token cache is being invalidate because project 00c3002a0f7843ceacefdefd9b417816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:36:59.239625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-389352a0-9721-4012-87ce-12941ba034e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:59.240759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-389352a0-9721-4012-87ce-12941ba034e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:36:59.242406 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2529/5067] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:36:58 2022] DELETE /identity/v3/projects/00c3002a0f7843ceacefdefd9b417816 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:36:59.248246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23417a2-0d34-4cee-9165-e4dbeee07837 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:59.249364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23417a2-0d34-4cee-9165-e4dbeee07837 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:59.249364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23417a2-0d34-4cee-9165-e4dbeee07837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:59.269264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b23417a2-0d34-4cee-9165-e4dbeee07837 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:59.270955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b23417a2-0d34-4cee-9165-e4dbeee07837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:59.356766 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2539/5068] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:36:59.423379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17403702-0d99-47ce-9bee-7fe0e25e050f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:59.423669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17403702-0d99-47ce-9bee-7fe0e25e050f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:59.423952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17403702-0d99-47ce-9bee-7fe0e25e050f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:59.442756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-17403702-0d99-47ce-9bee-7fe0e25e050f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:36:59.444965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-17403702-0d99-47ce-9bee-7fe0e25e050f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:36:59.452379 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2530/5069] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:36:59.457700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23417a2-0d34-4cee-9165-e4dbeee07837 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:59.468862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23417a2-0d34-4cee-9165-e4dbeee07837 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:59.473833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b661a-8db1-417d-b566-1d5613e81fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:59.474505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b661a-8db1-417d-b566-1d5613e81fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:59.474974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b661a-8db1-417d-b566-1d5613e81fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:59.475260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b661a-8db1-417d-b566-1d5613e81fe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:59.476007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b661a-8db1-417d-b566-1d5613e81fe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:36:59.476321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b661a-8db1-417d-b566-1d5613e81fe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:59.478016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b661a-8db1-417d-b566-1d5613e81fe9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:59.491146 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2540/5070] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:36:59.495494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17403702-0d99-47ce-9bee-7fe0e25e050f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:59.505783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17403702-0d99-47ce-9bee-7fe0e25e050f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:59.510532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7dfc33-2187-4e5c-9b0b-f1325d9cff27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:59.518875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dfc33-2187-4e5c-9b0b-f1325d9cff27 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:59.518875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dfc33-2187-4e5c-9b0b-f1325d9cff27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:59.518875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dfc33-2187-4e5c-9b0b-f1325d9cff27 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:59.518875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7dfc33-2187-4e5c-9b0b-f1325d9cff27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:59.518875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7dfc33-2187-4e5c-9b0b-f1325d9cff27 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:59.626847 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2531/5071] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:36:59 2022] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:36:59.632276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b661a-8db1-417d-b566-1d5613e81fe9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:59.642993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b661a-8db1-417d-b566-1d5613e81fe9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:59.714824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bb743-5f89-42fd-bcb7-8ae66878bdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:59.720738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bb743-5f89-42fd-bcb7-8ae66878bdbc admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:59.720738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bb743-5f89-42fd-bcb7-8ae66878bdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:59.720738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bb743-5f89-42fd-bcb7-8ae66878bdbc admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:59.720738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bb743-5f89-42fd-bcb7-8ae66878bdbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:59.720738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bb743-5f89-42fd-bcb7-8ae66878bdbc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:59.847390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7dfc33-2187-4e5c-9b0b-f1325d9cff27 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:59.855418 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2541/5072] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:36:59 2022] POST /identity/v3/users => generated 300 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:36:59.861417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7dfc33-2187-4e5c-9b0b-f1325d9cff27 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:59.867043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcc842-587f-46ba-b231-0a8094a21023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:59.867855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcc842-587f-46ba-b231-0a8094a21023 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:59.868304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcc842-587f-46ba-b231-0a8094a21023 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:59.868911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcc842-587f-46ba-b231-0a8094a21023 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:59.869845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcc842-587f-46ba-b231-0a8094a21023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:59.872224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcc842-587f-46ba-b231-0a8094a21023 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:36:59.900839 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2532/5073] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:36:59.902578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bb743-5f89-42fd-bcb7-8ae66878bdbc admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:36:59.913129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bb743-5f89-42fd-bcb7-8ae66878bdbc admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:36:59.917952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e2cff-59fa-4bab-960b-ecceedafb177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:36:59.918834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e2cff-59fa-4bab-960b-ecceedafb177 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:36:59.919116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e2cff-59fa-4bab-960b-ecceedafb177 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:36:59.919445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e2cff-59fa-4bab-960b-ecceedafb177 admin admin] PATH_INFO: `/v3/projects/ff7ac498e3d04c9bbe07ae9fd9c3baef/users/c7bef6a5b7da43a6855e4a606fc1f8a0/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:36:59.936966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e2cff-59fa-4bab-960b-ecceedafb177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff7ac498e3d04c9bbe07ae9fd9c3baef, user_id=c7bef6a5b7da43a6855e4a606fc1f8a0, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:36:59.939667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e2cff-59fa-4bab-960b-ecceedafb177 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:00.076098 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2542/5074] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:36:59 2022] PUT /identity/v3/projects/ff7ac498e3d04c9bbe07ae9fd9c3baef/users/c7bef6a5b7da43a6855e4a606fc1f8a0/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:37:00.080715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcc842-587f-46ba-b231-0a8094a21023 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:00.090420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcc842-587f-46ba-b231-0a8094a21023 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:00.147894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec3c3f-3519-4138-a514-b8116294ae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:00.148497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec3c3f-3519-4138-a514-b8116294ae96 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:00.148843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec3c3f-3519-4138-a514-b8116294ae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:00.149125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec3c3f-3519-4138-a514-b8116294ae96 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:00.149942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec3c3f-3519-4138-a514-b8116294ae96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:00.151580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec3c3f-3519-4138-a514-b8116294ae96 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:00.162952 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2533/5075] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:00.167142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e2cff-59fa-4bab-960b-ecceedafb177 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:00.177189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e2cff-59fa-4bab-960b-ecceedafb177 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:00.181779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095947e-9cb3-4d25-9b39-cc69654eb289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:00.182658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095947e-9cb3-4d25-9b39-cc69654eb289 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:00.182951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095947e-9cb3-4d25-9b39-cc69654eb289 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:00.183235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095947e-9cb3-4d25-9b39-cc69654eb289 admin admin] PATH_INFO: `/v3/projects/ff7ac498e3d04c9bbe07ae9fd9c3baef/users/c7bef6a5b7da43a6855e4a606fc1f8a0/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:00.185256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095947e-9cb3-4d25-9b39-cc69654eb289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff7ac498e3d04c9bbe07ae9fd9c3baef, user_id=c7bef6a5b7da43a6855e4a606fc1f8a0, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:00.187934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095947e-9cb3-4d25-9b39-cc69654eb289 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:00.199201 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2543/5076] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:37:00 2022] PUT /identity/v3/projects/ff7ac498e3d04c9bbe07ae9fd9c3baef/users/c7bef6a5b7da43a6855e4a606fc1f8a0/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:00.210807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa30fc-e481-4c36-8099-1cd8439a9a0d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:00.211096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa30fc-e481-4c36-8099-1cd8439a9a0d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:00.211379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa30fc-e481-4c36-8099-1cd8439a9a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:00.244279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9ffa30fc-e481-4c36-8099-1cd8439a9a0d None None] MFA Rules not processed for user `c7bef6a5b7da43a6855e4a606fc1f8a0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:00.245559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9ffa30fc-e481-4c36-8099-1cd8439a9a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:00.318902 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2534/5077] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:37:00.323523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095947e-9cb3-4d25-9b39-cc69654eb289 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:00.390229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095947e-9cb3-4d25-9b39-cc69654eb289 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:00.394960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c32c29-7070-4e7d-8520-43e79522599c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:00.395623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c32c29-7070-4e7d-8520-43e79522599c admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:00.395909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c32c29-7070-4e7d-8520-43e79522599c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:00.396192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c32c29-7070-4e7d-8520-43e79522599c admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:00.396946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c32c29-7070-4e7d-8520-43e79522599c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:00.398885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c32c29-7070-4e7d-8520-43e79522599c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:00.513178 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2544/5078] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:37:00 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:37:00.515325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa30fc-e481-4c36-8099-1cd8439a9a0d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:00.526020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa30fc-e481-4c36-8099-1cd8439a9a0d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:00.583718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d349c1-10c5-488a-a23d-e13d8fed5fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:00.584567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d349c1-10c5-488a-a23d-e13d8fed5fcb admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:00.584982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d349c1-10c5-488a-a23d-e13d8fed5fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:00.585368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d349c1-10c5-488a-a23d-e13d8fed5fcb admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:00.586174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d349c1-10c5-488a-a23d-e13d8fed5fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:00.588259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d349c1-10c5-488a-a23d-e13d8fed5fcb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:00.671156 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2535/5079] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:37:00 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:37:00.675756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c32c29-7070-4e7d-8520-43e79522599c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:00.686994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c32c29-7070-4e7d-8520-43e79522599c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:00.692094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f99998-34b4-437b-83eb-0488102b5d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:00.692852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f99998-34b4-437b-83eb-0488102b5d0d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:00.693147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f99998-34b4-437b-83eb-0488102b5d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:00.693429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f99998-34b4-437b-83eb-0488102b5d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:00.694229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f99998-34b4-437b-83eb-0488102b5d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:00.695825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f99998-34b4-437b-83eb-0488102b5d0d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:00.706839 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2545/5080] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:00.710818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d349c1-10c5-488a-a23d-e13d8fed5fcb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:00.721299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d349c1-10c5-488a-a23d-e13d8fed5fcb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:00.726489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780e81d-594f-4487-8bb8-e5a81f318fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:00.727167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780e81d-594f-4487-8bb8-e5a81f318fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:00.727457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780e81d-594f-4487-8bb8-e5a81f318fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:00.727737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780e81d-594f-4487-8bb8-e5a81f318fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:00.728585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780e81d-594f-4487-8bb8-e5a81f318fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:00.730224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780e81d-594f-4487-8bb8-e5a81f318fd6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:00.743007 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2536/5081] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:00.747289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f99998-34b4-437b-83eb-0488102b5d0d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:00.758769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f99998-34b4-437b-83eb-0488102b5d0d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:00.764037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753464c-0ecc-423c-997e-e3f92725fcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:00.767235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753464c-0ecc-423c-997e-e3f92725fcd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:00.767402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753464c-0ecc-423c-997e-e3f92725fcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:00.767781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753464c-0ecc-423c-997e-e3f92725fcd6 admin admin] PATH_INFO: `/v3/projects/59205f4486eb4c6ebb00fb1c4cf7ef6d/users/744269cf1055453197a4bc066c9ac50e/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:00.785274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753464c-0ecc-423c-997e-e3f92725fcd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59205f4486eb4c6ebb00fb1c4cf7ef6d, user_id=744269cf1055453197a4bc066c9ac50e, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:00.790855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753464c-0ecc-423c-997e-e3f92725fcd6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:00.858745 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2546/5082] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:37:00 2022] PUT /identity/v3/projects/59205f4486eb4c6ebb00fb1c4cf7ef6d/users/744269cf1055453197a4bc066c9ac50e/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:00.870567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b0a91-147e-4b5a-b894-e53eb52ab8eb None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:00.870862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b0a91-147e-4b5a-b894-e53eb52ab8eb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:00.871145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b0a91-147e-4b5a-b894-e53eb52ab8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:00.901187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-800b0a91-147e-4b5a-b894-e53eb52ab8eb None None] MFA Rules not processed for user `744269cf1055453197a4bc066c9ac50e`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:00.902518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-800b0a91-147e-4b5a-b894-e53eb52ab8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:00.981637 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2537/5083] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:37:01.001249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753464c-0ecc-423c-997e-e3f92725fcd6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:01.001249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5753464c-0ecc-423c-997e-e3f92725fcd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:01.106427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753464c-0ecc-423c-997e-e3f92725fcd6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:01.118884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e3469-b22d-4f57-87f2-d70919534271 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:01.119644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e3469-b22d-4f57-87f2-d70919534271 service glance] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:01.119931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e3469-b22d-4f57-87f2-d70919534271 service glance] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:01.120359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e3469-b22d-4f57-87f2-d70919534271 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:01.186883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e3469-b22d-4f57-87f2-d70919534271 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:01.188242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e3469-b22d-4f57-87f2-d70919534271 service glance] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:01.198609 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2547/5084] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:37:01.837140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b0a91-147e-4b5a-b894-e53eb52ab8eb None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:01.901394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b0a91-147e-4b5a-b894-e53eb52ab8eb None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:01.906470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30930ab5-c967-43ca-bbdc-175221e3589e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:01.907325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30930ab5-c967-43ca-bbdc-175221e3589e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:01.907603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30930ab5-c967-43ca-bbdc-175221e3589e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:01.907874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30930ab5-c967-43ca-bbdc-175221e3589e admin admin] PATH_INFO: `/v3/users/c7bef6a5b7da43a6855e4a606fc1f8a0` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:01.909214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30930ab5-c967-43ca-bbdc-175221e3589e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7bef6a5b7da43a6855e4a606fc1f8a0)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:01.912375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30930ab5-c967-43ca-bbdc-175221e3589e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:02.118083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30930ab5-c967-43ca-bbdc-175221e3589e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7bef6a5b7da43a6855e4a606fc1f8a0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:02.137735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30930ab5-c967-43ca-bbdc-175221e3589e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7bef6a5b7da43a6855e4a606fc1f8a0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:02.138419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30930ab5-c967-43ca-bbdc-175221e3589e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7bef6a5b7da43a6855e4a606fc1f8a0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:02.147852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30930ab5-c967-43ca-bbdc-175221e3589e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7bef6a5b7da43a6855e4a606fc1f8a0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:02.212155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30930ab5-c967-43ca-bbdc-175221e3589e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7bef6a5b7da43a6855e4a606fc1f8a0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:02.222984 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2538/5085] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:37:01 2022] DELETE /identity/v3/users/c7bef6a5b7da43a6855e4a606fc1f8a0 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:37:02.227749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211182f-9d83-429d-9953-81b19161f7b2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:02.228246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211182f-9d83-429d-9953-81b19161f7b2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:02.228472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211182f-9d83-429d-9953-81b19161f7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:02.247931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a211182f-9d83-429d-9953-81b19161f7b2 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:02.250048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a211182f-9d83-429d-9953-81b19161f7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:02.335281 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2548/5086] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:02.344982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30930ab5-c967-43ca-bbdc-175221e3589e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:02.353116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-30930ab5-c967-43ca-bbdc-175221e3589e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:02.419093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30930ab5-c967-43ca-bbdc-175221e3589e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:02.421347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a2ddf-0448-4820-9eb8-fc5151886969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:02.422163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a2ddf-0448-4820-9eb8-fc5151886969 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:02.422456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a2ddf-0448-4820-9eb8-fc5151886969 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:02.422765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a2ddf-0448-4820-9eb8-fc5151886969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:02.433270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a2ddf-0448-4820-9eb8-fc5151886969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:02.435106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a2ddf-0448-4820-9eb8-fc5151886969 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:02.446006 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2539/5087] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:37:02.900915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211182f-9d83-429d-9953-81b19161f7b2 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:02.902894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a211182f-9d83-429d-9953-81b19161f7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:02.917273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211182f-9d83-429d-9953-81b19161f7b2 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:02.923244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bba942-2ba2-445a-aec6-d58d0a30582c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:02.924718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bba942-2ba2-445a-aec6-d58d0a30582c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:02.925013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bba942-2ba2-445a-aec6-d58d0a30582c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:02.925304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bba942-2ba2-445a-aec6-d58d0a30582c admin admin] PATH_INFO: `/v3/projects/ff7ac498e3d04c9bbe07ae9fd9c3baef` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:02.926548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bba942-2ba2-445a-aec6-d58d0a30582c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff7ac498e3d04c9bbe07ae9fd9c3baef)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:02.928548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bba942-2ba2-445a-aec6-d58d0a30582c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:03.093064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74bba942-2ba2-445a-aec6-d58d0a30582c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff7ac498e3d04c9bbe07ae9fd9c3baef', 'request_id': 'req-74bba942-2ba2-445a-aec6-d58d0a30582c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:03.173037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74bba942-2ba2-445a-aec6-d58d0a30582c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff7ac498e3d04c9bbe07ae9fd9c3baef', 'request_id': 'req-74bba942-2ba2-445a-aec6-d58d0a30582c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:03.180091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74bba942-2ba2-445a-aec6-d58d0a30582c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff7ac498e3d04c9bbe07ae9fd9c3baef', 'request_id': 'req-74bba942-2ba2-445a-aec6-d58d0a30582c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:03.190505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74bba942-2ba2-445a-aec6-d58d0a30582c admin admin] The token cache is being invalidate because project ff7ac498e3d04c9bbe07ae9fd9c3baef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:37:03.190818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74bba942-2ba2-445a-aec6-d58d0a30582c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:03.191479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74bba942-2ba2-445a-aec6-d58d0a30582c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:03.193086 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2549/5088] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:37:02 2022] DELETE /identity/v3/projects/ff7ac498e3d04c9bbe07ae9fd9c3baef => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:03.197135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a2ddf-0448-4820-9eb8-fc5151886969 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:03.207616 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a2ddf-0448-4820-9eb8-fc5151886969 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:03.265344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c694b7f-917a-4bb5-beac-10f583e6edc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:03.266360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c694b7f-917a-4bb5-beac-10f583e6edc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:03.266792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c694b7f-917a-4bb5-beac-10f583e6edc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:03.267098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c694b7f-917a-4bb5-beac-10f583e6edc4 admin admin] PATH_INFO: `/v3/users/744269cf1055453197a4bc066c9ac50e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:03.268292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c694b7f-917a-4bb5-beac-10f583e6edc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=744269cf1055453197a4bc066c9ac50e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:03.270336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c694b7f-917a-4bb5-beac-10f583e6edc4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:03.490016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1c694b7f-917a-4bb5-beac-10f583e6edc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '744269cf1055453197a4bc066c9ac50e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:03.501766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1c694b7f-917a-4bb5-beac-10f583e6edc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '744269cf1055453197a4bc066c9ac50e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:03.502468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1c694b7f-917a-4bb5-beac-10f583e6edc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '744269cf1055453197a4bc066c9ac50e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:03.509414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1c694b7f-917a-4bb5-beac-10f583e6edc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '744269cf1055453197a4bc066c9ac50e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:03.606787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1c694b7f-917a-4bb5-beac-10f583e6edc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '744269cf1055453197a4bc066c9ac50e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:03.613844 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2540/5089] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:37:03 2022] DELETE /identity/v3/users/744269cf1055453197a4bc066c9ac50e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:04.066252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bba942-2ba2-445a-aec6-d58d0a30582c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:04.068574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-74bba942-2ba2-445a-aec6-d58d0a30582c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:04.082155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bba942-2ba2-445a-aec6-d58d0a30582c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:04.151044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953a44c-9acb-4079-b71a-62e1aa01419b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:04.152197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953a44c-9acb-4079-b71a-62e1aa01419b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:04.152486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953a44c-9acb-4079-b71a-62e1aa01419b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:04.152984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953a44c-9acb-4079-b71a-62e1aa01419b admin admin] PATH_INFO: `/v3/projects/59205f4486eb4c6ebb00fb1c4cf7ef6d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:04.154261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953a44c-9acb-4079-b71a-62e1aa01419b admin admin] RBAC: Authorizing `identity:delete_project(project_id=59205f4486eb4c6ebb00fb1c4cf7ef6d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:04.157051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953a44c-9acb-4079-b71a-62e1aa01419b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:04.266479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6953a44c-9acb-4079-b71a-62e1aa01419b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59205f4486eb4c6ebb00fb1c4cf7ef6d', 'request_id': 'req-6953a44c-9acb-4079-b71a-62e1aa01419b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:04.375088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6953a44c-9acb-4079-b71a-62e1aa01419b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59205f4486eb4c6ebb00fb1c4cf7ef6d', 'request_id': 'req-6953a44c-9acb-4079-b71a-62e1aa01419b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:04.383811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6953a44c-9acb-4079-b71a-62e1aa01419b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59205f4486eb4c6ebb00fb1c4cf7ef6d', 'request_id': 'req-6953a44c-9acb-4079-b71a-62e1aa01419b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:04.396386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6953a44c-9acb-4079-b71a-62e1aa01419b admin admin] The token cache is being invalidate because project 59205f4486eb4c6ebb00fb1c4cf7ef6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:37:04.396726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6953a44c-9acb-4079-b71a-62e1aa01419b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:04.397402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6953a44c-9acb-4079-b71a-62e1aa01419b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:04.399316 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2550/5090] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:37:04 2022] DELETE /identity/v3/projects/59205f4486eb4c6ebb00fb1c4cf7ef6d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:04.405992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c63a50-7557-43ad-85b1-55f34f142ac4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:04.406536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c63a50-7557-43ad-85b1-55f34f142ac4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:04.406536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c63a50-7557-43ad-85b1-55f34f142ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:04.426273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-19c63a50-7557-43ad-85b1-55f34f142ac4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:04.434482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-19c63a50-7557-43ad-85b1-55f34f142ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:04.440279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953a44c-9acb-4079-b71a-62e1aa01419b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:04.442543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6953a44c-9acb-4079-b71a-62e1aa01419b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:04.515153 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2541/5091] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:04.527410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72d3ce-5efd-408c-b63e-7581e05f8cc7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:04.527947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72d3ce-5efd-408c-b63e-7581e05f8cc7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:04.528454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72d3ce-5efd-408c-b63e-7581e05f8cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:04.549329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953a44c-9acb-4079-b71a-62e1aa01419b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:04.556137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946522bd-ffca-4741-8693-32ef9001f0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:04.556760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946522bd-ffca-4741-8693-32ef9001f0f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:04.557045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946522bd-ffca-4741-8693-32ef9001f0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:04.557322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946522bd-ffca-4741-8693-32ef9001f0f9 admin admin] PATH_INFO: `/v3/users/f2140817178b44e99d837e98eff69629` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:04.558743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946522bd-ffca-4741-8693-32ef9001f0f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2140817178b44e99d837e98eff69629)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:04.565350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-fd72d3ce-5efd-408c-b63e-7581e05f8cc7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:04.565516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946522bd-ffca-4741-8693-32ef9001f0f9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:04.566677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fd72d3ce-5efd-408c-b63e-7581e05f8cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:04.584763 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2542/5092] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:04.586530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72d3ce-5efd-408c-b63e-7581e05f8cc7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:04.603233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72d3ce-5efd-408c-b63e-7581e05f8cc7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:04.614472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a77ff1-9e81-43a1-a869-7e5b2f11adc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:04.615080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a77ff1-9e81-43a1-a869-7e5b2f11adc2 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:04.616178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a77ff1-9e81-43a1-a869-7e5b2f11adc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:04.616481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a77ff1-9e81-43a1-a869-7e5b2f11adc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:04.617260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a77ff1-9e81-43a1-a869-7e5b2f11adc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:37:04.617578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a77ff1-9e81-43a1-a869-7e5b2f11adc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:04.636640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a77ff1-9e81-43a1-a869-7e5b2f11adc2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:04.647266 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2543/5093] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:37:04.652108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a77ff1-9e81-43a1-a869-7e5b2f11adc2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:04.671188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a77ff1-9e81-43a1-a869-7e5b2f11adc2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:04.677543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520e01c-3655-4ca8-b60a-ce84737022b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:04.678232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520e01c-3655-4ca8-b60a-ce84737022b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:04.678563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520e01c-3655-4ca8-b60a-ce84737022b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:04.678843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520e01c-3655-4ca8-b60a-ce84737022b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:04.679734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520e01c-3655-4ca8-b60a-ce84737022b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:04.681800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520e01c-3655-4ca8-b60a-ce84737022b2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:04.759675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-946522bd-ffca-4741-8693-32ef9001f0f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2140817178b44e99d837e98eff69629'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:04.770987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-946522bd-ffca-4741-8693-32ef9001f0f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2140817178b44e99d837e98eff69629'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:04.771669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-946522bd-ffca-4741-8693-32ef9001f0f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2140817178b44e99d837e98eff69629'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:04.778451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-946522bd-ffca-4741-8693-32ef9001f0f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2140817178b44e99d837e98eff69629'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:04.785642 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2544/5094] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:37:04 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:37:04.789690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520e01c-3655-4ca8-b60a-ce84737022b2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:04.850441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520e01c-3655-4ca8-b60a-ce84737022b2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:04.855385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ae23c-b43b-4a86-83cf-f7f0893e4910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:04.856059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ae23c-b43b-4a86-83cf-f7f0893e4910 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:04.856343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ae23c-b43b-4a86-83cf-f7f0893e4910 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:04.856675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ae23c-b43b-4a86-83cf-f7f0893e4910 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:04.857368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ae23c-b43b-4a86-83cf-f7f0893e4910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:04.859810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ae23c-b43b-4a86-83cf-f7f0893e4910 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:04.892717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-946522bd-ffca-4741-8693-32ef9001f0f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2140817178b44e99d837e98eff69629'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:04.899383 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2551/5095] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:37:04 2022] DELETE /identity/v3/users/f2140817178b44e99d837e98eff69629 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:37:04.991120 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2545/5096] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:37:04 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:37:04.995363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946522bd-ffca-4741-8693-32ef9001f0f9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:04.996813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-946522bd-ffca-4741-8693-32ef9001f0f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:05.062504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946522bd-ffca-4741-8693-32ef9001f0f9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:05.067778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fa201-ec96-47f1-8fae-4c3e3d5e4c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:05.068460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fa201-ec96-47f1-8fae-4c3e3d5e4c8e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:05.068837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fa201-ec96-47f1-8fae-4c3e3d5e4c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:05.069190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fa201-ec96-47f1-8fae-4c3e3d5e4c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:05.069922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fa201-ec96-47f1-8fae-4c3e3d5e4c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:05.071524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fa201-ec96-47f1-8fae-4c3e3d5e4c8e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:05.081793 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2552/5097] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:05.086492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ae23c-b43b-4a86-83cf-f7f0893e4910 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:05.098474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ae23c-b43b-4a86-83cf-f7f0893e4910 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:05.110050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e967071-4e3c-4e42-8cbe-bd9a7be0fd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:05.110737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e967071-4e3c-4e42-8cbe-bd9a7be0fd46 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:05.111026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e967071-4e3c-4e42-8cbe-bd9a7be0fd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:05.111312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e967071-4e3c-4e42-8cbe-bd9a7be0fd46 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:05.112050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e967071-4e3c-4e42-8cbe-bd9a7be0fd46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:05.113701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e967071-4e3c-4e42-8cbe-bd9a7be0fd46 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:05.123947 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2546/5098] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:05.128515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fa201-ec96-47f1-8fae-4c3e3d5e4c8e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:05.140009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fa201-ec96-47f1-8fae-4c3e3d5e4c8e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:05.141251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e967071-4e3c-4e42-8cbe-bd9a7be0fd46 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:05.143088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0e967071-4e3c-4e42-8cbe-bd9a7be0fd46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:05.145130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c2cbf-3614-43a9-8e05-b7502806f2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:05.146646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c2cbf-3614-43a9-8e05-b7502806f2e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:05.146646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c2cbf-3614-43a9-8e05-b7502806f2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:05.146887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c2cbf-3614-43a9-8e05-b7502806f2e3 admin admin] PATH_INFO: `/v3/projects/c330c158e6f047498339481f1e0eff42/users/84e1f057e4714142a2b9c36b9d9cef04/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:05.158764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e967071-4e3c-4e42-8cbe-bd9a7be0fd46 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:05.163695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c898e85-a4a3-4877-9a15-f679a5d0f1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:05.164687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c898e85-a4a3-4877-9a15-f679a5d0f1fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:05.165043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c898e85-a4a3-4877-9a15-f679a5d0f1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:05.165332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c898e85-a4a3-4877-9a15-f679a5d0f1fc admin admin] PATH_INFO: `/v3/projects/f5afcabc10d742cd84c60d17f855e5e8` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:05.166677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c898e85-a4a3-4877-9a15-f679a5d0f1fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5afcabc10d742cd84c60d17f855e5e8)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:05.168838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c898e85-a4a3-4877-9a15-f679a5d0f1fc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:05.182972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c2cbf-3614-43a9-8e05-b7502806f2e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c330c158e6f047498339481f1e0eff42, user_id=84e1f057e4714142a2b9c36b9d9cef04, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:05.189291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c2cbf-3614-43a9-8e05-b7502806f2e3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:05.328071 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2553/5099] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:37:05 2022] PUT /identity/v3/projects/c330c158e6f047498339481f1e0eff42/users/84e1f057e4714142a2b9c36b9d9cef04/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:05.338809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1347098-162a-4f60-abaa-20424a940d84 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:05.340458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1347098-162a-4f60-abaa-20424a940d84 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:05.340458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1347098-162a-4f60-abaa-20424a940d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:05.356899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5c898e85-a4a3-4877-9a15-f679a5d0f1fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5afcabc10d742cd84c60d17f855e5e8', 'request_id': 'req-5c898e85-a4a3-4877-9a15-f679a5d0f1fc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:05.364188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5c898e85-a4a3-4877-9a15-f679a5d0f1fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5afcabc10d742cd84c60d17f855e5e8', 'request_id': 'req-5c898e85-a4a3-4877-9a15-f679a5d0f1fc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:05.367475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a1347098-162a-4f60-abaa-20424a940d84 None None] MFA Rules not processed for user `84e1f057e4714142a2b9c36b9d9cef04`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:05.368720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a1347098-162a-4f60-abaa-20424a940d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:05.432697 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2554/5100] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:37:05.443933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1347098-162a-4f60-abaa-20424a940d84 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:05.445371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a1347098-162a-4f60-abaa-20424a940d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:05.445861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5c898e85-a4a3-4877-9a15-f679a5d0f1fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5afcabc10d742cd84c60d17f855e5e8', 'request_id': 'req-5c898e85-a4a3-4877-9a15-f679a5d0f1fc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:05.457319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5c898e85-a4a3-4877-9a15-f679a5d0f1fc admin admin] The token cache is being invalidate because project f5afcabc10d742cd84c60d17f855e5e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:37:05.457622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5c898e85-a4a3-4877-9a15-f679a5d0f1fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:05.458256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5c898e85-a4a3-4877-9a15-f679a5d0f1fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:05.459804 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2547/5101] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:37:05 2022] DELETE /identity/v3/projects/f5afcabc10d742cd84c60d17f855e5e8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:05.465530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b4207-9b95-4662-8cfb-ac6b249c3b87 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:05.465824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b4207-9b95-4662-8cfb-ac6b249c3b87 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:05.466103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b4207-9b95-4662-8cfb-ac6b249c3b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:05.483995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-224b4207-9b95-4662-8cfb-ac6b249c3b87 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:05.485188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-224b4207-9b95-4662-8cfb-ac6b249c3b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:05.503193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1347098-162a-4f60-abaa-20424a940d84 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:05.506910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e4eca-984a-4ced-a671-5bc4cce8e28b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:05.507560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e4eca-984a-4ced-a671-5bc4cce8e28b service glance] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:05.507847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e4eca-984a-4ced-a671-5bc4cce8e28b service glance] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:05.508129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e4eca-984a-4ced-a671-5bc4cce8e28b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:05.509953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b34e4eca-984a-4ced-a671-5bc4cce8e28b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:05.521812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e4eca-984a-4ced-a671-5bc4cce8e28b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:05.524564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e4eca-984a-4ced-a671-5bc4cce8e28b service glance] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:05.535624 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2555/5102] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:37:05.545200 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2548/5103] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:05.557476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18684b-cd9a-441d-96d0-e34dd183f951 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:05.557773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18684b-cd9a-441d-96d0-e34dd183f951 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:05.558063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18684b-cd9a-441d-96d0-e34dd183f951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:05.584245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-da18684b-cd9a-441d-96d0-e34dd183f951 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:05.584245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-da18684b-cd9a-441d-96d0-e34dd183f951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:05.590665 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2556/5104] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:05.595573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b4207-9b95-4662-8cfb-ac6b249c3b87 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:05.605591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b4207-9b95-4662-8cfb-ac6b249c3b87 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:05.610642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b4c84-7d1d-4a39-8fc3-1570279bd2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:05.611327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b4c84-7d1d-4a39-8fc3-1570279bd2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:05.611612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b4c84-7d1d-4a39-8fc3-1570279bd2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:05.611889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b4c84-7d1d-4a39-8fc3-1570279bd2c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:05.612662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b4c84-7d1d-4a39-8fc3-1570279bd2c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:37:05.612968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b4c84-7d1d-4a39-8fc3-1570279bd2c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:05.614601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b4c84-7d1d-4a39-8fc3-1570279bd2c9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:05.626641 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2549/5105] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:37:05.636304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18684b-cd9a-441d-96d0-e34dd183f951 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:05.646210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18684b-cd9a-441d-96d0-e34dd183f951 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:05.650834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b99452-55cc-44d3-bea0-dd342a011bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:05.651670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b99452-55cc-44d3-bea0-dd342a011bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:05.656996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b99452-55cc-44d3-bea0-dd342a011bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:05.656996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b99452-55cc-44d3-bea0-dd342a011bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:05.656996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b99452-55cc-44d3-bea0-dd342a011bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:05.656996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b99452-55cc-44d3-bea0-dd342a011bd4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:05.762925 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2557/5106] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:37:05 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:37:05.767674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b4c84-7d1d-4a39-8fc3-1570279bd2c9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:05.778342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b4c84-7d1d-4a39-8fc3-1570279bd2c9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:05.845794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f194348-1ce5-45d9-9a01-76a09eb235ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:05.846532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f194348-1ce5-45d9-9a01-76a09eb235ad admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:05.846820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f194348-1ce5-45d9-9a01-76a09eb235ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:05.847102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f194348-1ce5-45d9-9a01-76a09eb235ad admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:05.847787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f194348-1ce5-45d9-9a01-76a09eb235ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:05.849773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f194348-1ce5-45d9-9a01-76a09eb235ad admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:05.939454 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2550/5107] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:37:05 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:37:05.943772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b99452-55cc-44d3-bea0-dd342a011bd4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:05.954818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b99452-55cc-44d3-bea0-dd342a011bd4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:05.959419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00311f67-af16-4602-8e2e-d6e1eb481406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:05.960080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00311f67-af16-4602-8e2e-d6e1eb481406 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:05.960366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00311f67-af16-4602-8e2e-d6e1eb481406 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:05.960696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00311f67-af16-4602-8e2e-d6e1eb481406 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:05.961424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00311f67-af16-4602-8e2e-d6e1eb481406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:05.963036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00311f67-af16-4602-8e2e-d6e1eb481406 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:05.973224 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2558/5108] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:05.977449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f194348-1ce5-45d9-9a01-76a09eb235ad admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:05.987446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f194348-1ce5-45d9-9a01-76a09eb235ad admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:05.992648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663b761-5618-4e74-a613-5f112c8f0b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:05.993313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663b761-5618-4e74-a613-5f112c8f0b1f admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:05.993594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663b761-5618-4e74-a613-5f112c8f0b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:05.993877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663b761-5618-4e74-a613-5f112c8f0b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:05.994593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663b761-5618-4e74-a613-5f112c8f0b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:05.996184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663b761-5618-4e74-a613-5f112c8f0b1f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:06.011349 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2551/5109] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:06.016273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00311f67-af16-4602-8e2e-d6e1eb481406 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:06.028357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00311f67-af16-4602-8e2e-d6e1eb481406 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:06.033368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e733c-56d2-48ad-a84b-6f7070b0560e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:06.037317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e733c-56d2-48ad-a84b-6f7070b0560e admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:06.037317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e733c-56d2-48ad-a84b-6f7070b0560e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:06.037317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e733c-56d2-48ad-a84b-6f7070b0560e admin admin] PATH_INFO: `/v3/projects/538f234d5ed04b63bcc853995b600847/users/4a43413a459e451fb05f9dc9e8bd1d6c/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:06.051727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e733c-56d2-48ad-a84b-6f7070b0560e admin admin] RBAC: Authorizing `identity:create_grant(project_id=538f234d5ed04b63bcc853995b600847, user_id=4a43413a459e451fb05f9dc9e8bd1d6c, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:06.054567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e733c-56d2-48ad-a84b-6f7070b0560e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:06.150600 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2559/5110] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:37:06 2022] PUT /identity/v3/projects/538f234d5ed04b63bcc853995b600847/users/4a43413a459e451fb05f9dc9e8bd1d6c/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:06.160921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd56bb-2366-4961-a5f6-30c719eada66 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:06.161212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd56bb-2366-4961-a5f6-30c719eada66 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:06.161490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd56bb-2366-4961-a5f6-30c719eada66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:06.188366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a1dd56bb-2366-4961-a5f6-30c719eada66 None None] MFA Rules not processed for user `4a43413a459e451fb05f9dc9e8bd1d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:06.189574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a1dd56bb-2366-4961-a5f6-30c719eada66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:06.258258 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2552/5111] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:06.273053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e733c-56d2-48ad-a84b-6f7070b0560e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:06.275445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-993e733c-56d2-48ad-a84b-6f7070b0560e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:06.356251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e733c-56d2-48ad-a84b-6f7070b0560e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:06.362963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264a440-1eac-4679-9038-344a701a03c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:06.363624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264a440-1eac-4679-9038-344a701a03c5 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:06.363913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264a440-1eac-4679-9038-344a701a03c5 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:06.364192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264a440-1eac-4679-9038-344a701a03c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:06.372193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264a440-1eac-4679-9038-344a701a03c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:06.374471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264a440-1eac-4679-9038-344a701a03c5 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:06.383744 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2560/5112] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:37:06.994571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd56bb-2366-4961-a5f6-30c719eada66 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:06.995980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a1dd56bb-2366-4961-a5f6-30c719eada66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:07.063468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd56bb-2366-4961-a5f6-30c719eada66 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:07.068065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01277d-170e-430a-8fa5-6fd71b833ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:07.069216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01277d-170e-430a-8fa5-6fd71b833ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:07.069527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01277d-170e-430a-8fa5-6fd71b833ade admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:07.069900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01277d-170e-430a-8fa5-6fd71b833ade admin admin] PATH_INFO: `/v3/users/84e1f057e4714142a2b9c36b9d9cef04` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:07.071107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01277d-170e-430a-8fa5-6fd71b833ade admin admin] RBAC: Authorizing `identity:delete_user(user_id=84e1f057e4714142a2b9c36b9d9cef04)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:07.073078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01277d-170e-430a-8fa5-6fd71b833ade admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:07.348868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0a01277d-170e-430a-8fa5-6fd71b833ade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84e1f057e4714142a2b9c36b9d9cef04'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:07.362722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0a01277d-170e-430a-8fa5-6fd71b833ade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84e1f057e4714142a2b9c36b9d9cef04'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:07.363559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0a01277d-170e-430a-8fa5-6fd71b833ade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84e1f057e4714142a2b9c36b9d9cef04'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:07.372141 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0a01277d-170e-430a-8fa5-6fd71b833ade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84e1f057e4714142a2b9c36b9d9cef04'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:07.475443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0a01277d-170e-430a-8fa5-6fd71b833ade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84e1f057e4714142a2b9c36b9d9cef04'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:07.481705 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2553/5113] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:37:06 2022] DELETE /identity/v3/users/84e1f057e4714142a2b9c36b9d9cef04 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:07.486828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ce893-d5e9-419e-86dc-5c7986ef101b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:07.487323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ce893-d5e9-419e-86dc-5c7986ef101b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:07.487432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ce893-d5e9-419e-86dc-5c7986ef101b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:07.505347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b88ce893-d5e9-419e-86dc-5c7986ef101b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:07.506545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b88ce893-d5e9-419e-86dc-5c7986ef101b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:07.566740 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2561/5114] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:07.576962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01277d-170e-430a-8fa5-6fd71b833ade admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:07.578380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0a01277d-170e-430a-8fa5-6fd71b833ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:07.635022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01277d-170e-430a-8fa5-6fd71b833ade admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:07.640453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7f452-1d36-48fa-9e89-ef0cb55d831e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:07.640453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7f452-1d36-48fa-9e89-ef0cb55d831e service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:07.640453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7f452-1d36-48fa-9e89-ef0cb55d831e service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:07.640453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7f452-1d36-48fa-9e89-ef0cb55d831e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:07.650542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7f452-1d36-48fa-9e89-ef0cb55d831e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:07.651999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe7f452-1d36-48fa-9e89-ef0cb55d831e service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:07.662760 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2554/5115] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:37:08.129516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ce893-d5e9-419e-86dc-5c7986ef101b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:08.131145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b88ce893-d5e9-419e-86dc-5c7986ef101b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:08.143650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ce893-d5e9-419e-86dc-5c7986ef101b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:08.148548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65b540-bfe3-444d-aa14-b233806f9237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:08.149515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65b540-bfe3-444d-aa14-b233806f9237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:08.149809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65b540-bfe3-444d-aa14-b233806f9237 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:08.150091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65b540-bfe3-444d-aa14-b233806f9237 admin admin] PATH_INFO: `/v3/projects/c330c158e6f047498339481f1e0eff42` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:08.151303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65b540-bfe3-444d-aa14-b233806f9237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c330c158e6f047498339481f1e0eff42)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:08.153322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65b540-bfe3-444d-aa14-b233806f9237 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:08.321362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dd65b540-bfe3-444d-aa14-b233806f9237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c330c158e6f047498339481f1e0eff42', 'request_id': 'req-dd65b540-bfe3-444d-aa14-b233806f9237'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:08.395515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dd65b540-bfe3-444d-aa14-b233806f9237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c330c158e6f047498339481f1e0eff42', 'request_id': 'req-dd65b540-bfe3-444d-aa14-b233806f9237'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:08.402104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dd65b540-bfe3-444d-aa14-b233806f9237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c330c158e6f047498339481f1e0eff42', 'request_id': 'req-dd65b540-bfe3-444d-aa14-b233806f9237'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:08.413097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dd65b540-bfe3-444d-aa14-b233806f9237 admin admin] The token cache is being invalidate because project c330c158e6f047498339481f1e0eff42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:37:08.413386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dd65b540-bfe3-444d-aa14-b233806f9237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:08.414022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dd65b540-bfe3-444d-aa14-b233806f9237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:08.415608 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2562/5116] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:37:08 2022] DELETE /identity/v3/projects/c330c158e6f047498339481f1e0eff42 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:08.420713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56efe4-4b21-4b7f-bfb8-584eb3988415 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:08.422784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56efe4-4b21-4b7f-bfb8-584eb3988415 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:08.422784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56efe4-4b21-4b7f-bfb8-584eb3988415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:08.438750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5f56efe4-4b21-4b7f-bfb8-584eb3988415 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:08.440267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5f56efe4-4b21-4b7f-bfb8-584eb3988415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:08.497002 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2555/5117] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:08.505970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97694547-5f9a-4270-a76e-06f1a984d5a2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:08.506467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97694547-5f9a-4270-a76e-06f1a984d5a2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:08.506585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97694547-5f9a-4270-a76e-06f1a984d5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:08.525225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-97694547-5f9a-4270-a76e-06f1a984d5a2 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:08.526433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-97694547-5f9a-4270-a76e-06f1a984d5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:08.535050 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2563/5118] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:08.539279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56efe4-4b21-4b7f-bfb8-584eb3988415 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:08.549185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56efe4-4b21-4b7f-bfb8-584eb3988415 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:08.553778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19de368-19b6-4354-a1f2-8fec21c0c38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:08.555444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19de368-19b6-4354-a1f2-8fec21c0c38e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:08.555444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19de368-19b6-4354-a1f2-8fec21c0c38e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:08.555444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19de368-19b6-4354-a1f2-8fec21c0c38e admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:08.555760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19de368-19b6-4354-a1f2-8fec21c0c38e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:37:08.556008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19de368-19b6-4354-a1f2-8fec21c0c38e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:08.557645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19de368-19b6-4354-a1f2-8fec21c0c38e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:08.569165 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2556/5119] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:37:08.573628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97694547-5f9a-4270-a76e-06f1a984d5a2 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:08.583331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97694547-5f9a-4270-a76e-06f1a984d5a2 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:08.587969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d9f10-dee3-4b5f-838e-e3ec894753f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:08.589370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d9f10-dee3-4b5f-838e-e3ec894753f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:08.589669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d9f10-dee3-4b5f-838e-e3ec894753f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:08.589975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d9f10-dee3-4b5f-838e-e3ec894753f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:08.591354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d9f10-dee3-4b5f-838e-e3ec894753f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:08.593914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d9f10-dee3-4b5f-838e-e3ec894753f2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:08.660455 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2564/5120] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:37:08 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:37:08.664645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19de368-19b6-4354-a1f2-8fec21c0c38e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:08.675281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19de368-19b6-4354-a1f2-8fec21c0c38e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:08.734507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf12a3-c910-41fe-b03d-415d133d9827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:08.735175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf12a3-c910-41fe-b03d-415d133d9827 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:08.735490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf12a3-c910-41fe-b03d-415d133d9827 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:08.735771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf12a3-c910-41fe-b03d-415d133d9827 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:08.736516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf12a3-c910-41fe-b03d-415d133d9827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:08.742440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf12a3-c910-41fe-b03d-415d133d9827 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:08.853212 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2557/5121] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:37:08 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:37:08.857374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d9f10-dee3-4b5f-838e-e3ec894753f2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:08.867808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d9f10-dee3-4b5f-838e-e3ec894753f2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:08.873723 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2e1d1-ccd7-4a3d-86f2-15cc085f3bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:08.874490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2e1d1-ccd7-4a3d-86f2-15cc085f3bab admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:08.880278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2e1d1-ccd7-4a3d-86f2-15cc085f3bab admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:08.880278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2e1d1-ccd7-4a3d-86f2-15cc085f3bab admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:08.880278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2e1d1-ccd7-4a3d-86f2-15cc085f3bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:08.880278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2e1d1-ccd7-4a3d-86f2-15cc085f3bab admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:08.889755 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2565/5122] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:08.893754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf12a3-c910-41fe-b03d-415d133d9827 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:08.906455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf12a3-c910-41fe-b03d-415d133d9827 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:08.911285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693095a-0d9e-458d-a0cf-ef1169c6cfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:08.911883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693095a-0d9e-458d-a0cf-ef1169c6cfce admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:08.912167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693095a-0d9e-458d-a0cf-ef1169c6cfce admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:08.912446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693095a-0d9e-458d-a0cf-ef1169c6cfce admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:08.913209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693095a-0d9e-458d-a0cf-ef1169c6cfce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:08.914854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693095a-0d9e-458d-a0cf-ef1169c6cfce admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:08.925730 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2558/5123] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:08.929682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2e1d1-ccd7-4a3d-86f2-15cc085f3bab admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:08.942037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2e1d1-ccd7-4a3d-86f2-15cc085f3bab admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:08.947088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18ed0c-fb37-494a-8efd-9e7a1ff7c4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:08.948088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18ed0c-fb37-494a-8efd-9e7a1ff7c4ef admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:08.948460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18ed0c-fb37-494a-8efd-9e7a1ff7c4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:08.949003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18ed0c-fb37-494a-8efd-9e7a1ff7c4ef admin admin] PATH_INFO: `/v3/projects/569626a5090d415faecfbd78c1f7eb59/users/478df784fc8748ccb42fd144dea95848/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:08.965055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18ed0c-fb37-494a-8efd-9e7a1ff7c4ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=569626a5090d415faecfbd78c1f7eb59, user_id=478df784fc8748ccb42fd144dea95848, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:08.967942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18ed0c-fb37-494a-8efd-9e7a1ff7c4ef admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:09.099277 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2566/5124] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:37:08 2022] PUT /identity/v3/projects/569626a5090d415faecfbd78c1f7eb59/users/478df784fc8748ccb42fd144dea95848/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:09.112320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ef44f-44e5-49b5-b43c-d15948bc87b2 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:09.112645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ef44f-44e5-49b5-b43c-d15948bc87b2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:09.113617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ef44f-44e5-49b5-b43c-d15948bc87b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:09.142675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-741ef44f-44e5-49b5-b43c-d15948bc87b2 None None] MFA Rules not processed for user `478df784fc8748ccb42fd144dea95848`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:09.143924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-741ef44f-44e5-49b5-b43c-d15948bc87b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:09.210320 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2559/5125] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:09.214868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18ed0c-fb37-494a-8efd-9e7a1ff7c4ef admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:09.277232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18ed0c-fb37-494a-8efd-9e7a1ff7c4ef admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:09.282144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3ce35-e3d3-4093-b65c-b62300fb59c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:09.282835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3ce35-e3d3-4093-b65c-b62300fb59c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:09.283169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3ce35-e3d3-4093-b65c-b62300fb59c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:09.283509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3ce35-e3d3-4093-b65c-b62300fb59c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:09.284160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3ce35-e3d3-4093-b65c-b62300fb59c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:09.286183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3ce35-e3d3-4093-b65c-b62300fb59c8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:09.417995 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2567/5126] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:37:09 2022] POST /identity/v3/projects => generated 381 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:37:09.422800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ef44f-44e5-49b5-b43c-d15948bc87b2 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:09.441346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ef44f-44e5-49b5-b43c-d15948bc87b2 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:09.498152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5dac0-29d2-4dd6-b641-e05617b2ec61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:09.498745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5dac0-29d2-4dd6-b641-e05617b2ec61 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:09.499030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5dac0-29d2-4dd6-b641-e05617b2ec61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:09.499347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5dac0-29d2-4dd6-b641-e05617b2ec61 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:09.500027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5dac0-29d2-4dd6-b641-e05617b2ec61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:09.502237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5dac0-29d2-4dd6-b641-e05617b2ec61 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:09.608106 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2560/5127] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:37:09 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:37:09.612322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3ce35-e3d3-4093-b65c-b62300fb59c8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:09.622642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3ce35-e3d3-4093-b65c-b62300fb59c8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:09.627587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38ca2b-871b-44da-a17b-2e85162a9f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:09.631678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38ca2b-871b-44da-a17b-2e85162a9f34 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:09.631678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38ca2b-871b-44da-a17b-2e85162a9f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:09.631678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38ca2b-871b-44da-a17b-2e85162a9f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:09.631678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38ca2b-871b-44da-a17b-2e85162a9f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:09.631678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38ca2b-871b-44da-a17b-2e85162a9f34 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:09.641460 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2568/5128] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:09.645379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5dac0-29d2-4dd6-b641-e05617b2ec61 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:09.656195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5dac0-29d2-4dd6-b641-e05617b2ec61 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:09.682487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75fa4c-4853-40db-9938-ec9711d58ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:09.682487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75fa4c-4853-40db-9938-ec9711d58ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:09.682487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75fa4c-4853-40db-9938-ec9711d58ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:09.682487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75fa4c-4853-40db-9938-ec9711d58ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:09.682900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75fa4c-4853-40db-9938-ec9711d58ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:09.682900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75fa4c-4853-40db-9938-ec9711d58ff5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:09.682900 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2561/5129] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:09.684369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38ca2b-871b-44da-a17b-2e85162a9f34 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:09.694447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38ca2b-871b-44da-a17b-2e85162a9f34 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:09.699062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d7cc1-6e6d-49a7-bb11-f5d2050588e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:09.699945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d7cc1-6e6d-49a7-bb11-f5d2050588e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:09.700233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d7cc1-6e6d-49a7-bb11-f5d2050588e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:09.700517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d7cc1-6e6d-49a7-bb11-f5d2050588e1 admin admin] PATH_INFO: `/v3/projects/da2382e8ac404fef95e912f3231af575/users/0bdf91373b2241f8806e720e86d1db53/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:09.714900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d7cc1-6e6d-49a7-bb11-f5d2050588e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da2382e8ac404fef95e912f3231af575, user_id=0bdf91373b2241f8806e720e86d1db53, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:09.718191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d7cc1-6e6d-49a7-bb11-f5d2050588e1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:09.784948 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2569/5130] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:37:09 2022] PUT /identity/v3/projects/da2382e8ac404fef95e912f3231af575/users/0bdf91373b2241f8806e720e86d1db53/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:09.795327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc20c03-651d-4a77-a356-e4e618bf1cc8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:09.795617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc20c03-651d-4a77-a356-e4e618bf1cc8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:09.795898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc20c03-651d-4a77-a356-e4e618bf1cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:09.822045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9bc20c03-651d-4a77-a356-e4e618bf1cc8 None None] MFA Rules not processed for user `0bdf91373b2241f8806e720e86d1db53`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:09.823257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9bc20c03-651d-4a77-a356-e4e618bf1cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:09.890224 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2562/5131] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:09.894952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d7cc1-6e6d-49a7-bb11-f5d2050588e1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:09.954765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d7cc1-6e6d-49a7-bb11-f5d2050588e1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:09.959461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9416a3a-ed87-48a2-a00b-0120b93fb1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:09.960183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9416a3a-ed87-48a2-a00b-0120b93fb1df admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:09.960467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9416a3a-ed87-48a2-a00b-0120b93fb1df admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:09.960781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9416a3a-ed87-48a2-a00b-0120b93fb1df admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:09.961521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9416a3a-ed87-48a2-a00b-0120b93fb1df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:09.963405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9416a3a-ed87-48a2-a00b-0120b93fb1df admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:10.054608 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2570/5132] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:37:09 2022] POST /identity/v3/projects => generated 381 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:37:10.058579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc20c03-651d-4a77-a356-e4e618bf1cc8 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:10.069739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc20c03-651d-4a77-a356-e4e618bf1cc8 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:10.132364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852bc32c-3616-4283-a864-16851142f6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:10.133078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bc32c-3616-4283-a864-16851142f6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:10.133367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bc32c-3616-4283-a864-16851142f6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:10.133651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bc32c-3616-4283-a864-16851142f6b2 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:10.134367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852bc32c-3616-4283-a864-16851142f6b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:10.136351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852bc32c-3616-4283-a864-16851142f6b2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:10.234247 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2563/5133] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:37:10 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:37:10.235640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9416a3a-ed87-48a2-a00b-0120b93fb1df admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:10.246743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9416a3a-ed87-48a2-a00b-0120b93fb1df admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:10.252484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9e00a-d4a4-47c3-82c5-0b9878f2a84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:10.253211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9e00a-d4a4-47c3-82c5-0b9878f2a84a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:10.253509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9e00a-d4a4-47c3-82c5-0b9878f2a84a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:10.253771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9e00a-d4a4-47c3-82c5-0b9878f2a84a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:10.254496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9e00a-d4a4-47c3-82c5-0b9878f2a84a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:10.256148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9e00a-d4a4-47c3-82c5-0b9878f2a84a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:10.267737 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2571/5134] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:10.275194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852bc32c-3616-4283-a864-16851142f6b2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:10.285401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852bc32c-3616-4283-a864-16851142f6b2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:10.290344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7debf7-03c1-4d4a-bbf1-53e8774066ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:10.291229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7debf7-03c1-4d4a-bbf1-53e8774066ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:10.291515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7debf7-03c1-4d4a-bbf1-53e8774066ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:10.291790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7debf7-03c1-4d4a-bbf1-53e8774066ff admin admin] PATH_INFO: `/v3/projects/cfa9f33b66b04241a2c5381504f75586/users/502db961755b4ea1bd83b2da10ac272e/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:10.306407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7debf7-03c1-4d4a-bbf1-53e8774066ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa9f33b66b04241a2c5381504f75586, user_id=502db961755b4ea1bd83b2da10ac272e, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:10.309071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7debf7-03c1-4d4a-bbf1-53e8774066ff admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:10.400915 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2564/5135] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:37:10 2022] PUT /identity/v3/projects/cfa9f33b66b04241a2c5381504f75586/users/502db961755b4ea1bd83b2da10ac272e/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:10.405129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9e00a-d4a4-47c3-82c5-0b9878f2a84a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:10.414908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9e00a-d4a4-47c3-82c5-0b9878f2a84a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:10.470815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423949a4-bf88-447b-a62a-a9fdbc107619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:10.471483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423949a4-bf88-447b-a62a-a9fdbc107619 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:10.471769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423949a4-bf88-447b-a62a-a9fdbc107619 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:10.472046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423949a4-bf88-447b-a62a-a9fdbc107619 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:10.472799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423949a4-bf88-447b-a62a-a9fdbc107619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:10.474403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423949a4-bf88-447b-a62a-a9fdbc107619 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:10.484236 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2572/5136] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:10.488515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7debf7-03c1-4d4a-bbf1-53e8774066ff admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:10.500121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7debf7-03c1-4d4a-bbf1-53e8774066ff admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:10.505392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087eb524-6dd3-430e-8810-6fb5a490a4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:10.506276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087eb524-6dd3-430e-8810-6fb5a490a4dd admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:10.506557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087eb524-6dd3-430e-8810-6fb5a490a4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:10.507681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087eb524-6dd3-430e-8810-6fb5a490a4dd admin admin] PATH_INFO: `/v3/projects/cfa9f33b66b04241a2c5381504f75586/users/502db961755b4ea1bd83b2da10ac272e/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:10.508988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087eb524-6dd3-430e-8810-6fb5a490a4dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa9f33b66b04241a2c5381504f75586, user_id=502db961755b4ea1bd83b2da10ac272e, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:10.511613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087eb524-6dd3-430e-8810-6fb5a490a4dd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:10.522503 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2565/5137] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:37:10 2022] PUT /identity/v3/projects/cfa9f33b66b04241a2c5381504f75586/users/502db961755b4ea1bd83b2da10ac272e/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:10.533575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f58f8-b300-4863-bd76-da1d5c2963d7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:10.533867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f58f8-b300-4863-bd76-da1d5c2963d7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:10.534177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f58f8-b300-4863-bd76-da1d5c2963d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:10.562422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9d4f58f8-b300-4863-bd76-da1d5c2963d7 None None] MFA Rules not processed for user `502db961755b4ea1bd83b2da10ac272e`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:10.563813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9d4f58f8-b300-4863-bd76-da1d5c2963d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:10.637873 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2573/5138] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:10.648199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087eb524-6dd3-430e-8810-6fb5a490a4dd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:10.650034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-087eb524-6dd3-430e-8810-6fb5a490a4dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:10.706482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087eb524-6dd3-430e-8810-6fb5a490a4dd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:10.710210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb71daf-b6aa-445d-85ec-a3d8b8d32642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:10.710859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb71daf-b6aa-445d-85ec-a3d8b8d32642 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:10.711143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb71daf-b6aa-445d-85ec-a3d8b8d32642 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:10.711424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb71daf-b6aa-445d-85ec-a3d8b8d32642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:10.766540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb71daf-b6aa-445d-85ec-a3d8b8d32642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:10.768038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb71daf-b6aa-445d-85ec-a3d8b8d32642 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:10.777369 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2566/5139] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:37:12.934522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f58f8-b300-4863-bd76-da1d5c2963d7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:12.934522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9d4f58f8-b300-4863-bd76-da1d5c2963d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:13.001966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f58f8-b300-4863-bd76-da1d5c2963d7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:13.006682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57088c8b-22f1-4bce-9164-6a54d1ee1c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:13.007702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57088c8b-22f1-4bce-9164-6a54d1ee1c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:13.007997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57088c8b-22f1-4bce-9164-6a54d1ee1c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:13.008303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57088c8b-22f1-4bce-9164-6a54d1ee1c6c admin admin] PATH_INFO: `/v3/users/f176aec4c2664ef0bb5a02a7cd27a6f5` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:13.009504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57088c8b-22f1-4bce-9164-6a54d1ee1c6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f176aec4c2664ef0bb5a02a7cd27a6f5)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:13.011518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57088c8b-22f1-4bce-9164-6a54d1ee1c6c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:13.196893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-57088c8b-22f1-4bce-9164-6a54d1ee1c6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f176aec4c2664ef0bb5a02a7cd27a6f5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:13.208376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-57088c8b-22f1-4bce-9164-6a54d1ee1c6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f176aec4c2664ef0bb5a02a7cd27a6f5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:13.208994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-57088c8b-22f1-4bce-9164-6a54d1ee1c6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f176aec4c2664ef0bb5a02a7cd27a6f5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:13.215681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-57088c8b-22f1-4bce-9164-6a54d1ee1c6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f176aec4c2664ef0bb5a02a7cd27a6f5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:13.310095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-57088c8b-22f1-4bce-9164-6a54d1ee1c6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f176aec4c2664ef0bb5a02a7cd27a6f5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:13.316983 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2574/5140] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:37:12 2022] DELETE /identity/v3/users/f176aec4c2664ef0bb5a02a7cd27a6f5 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:13.322251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50b25a-35cd-4507-8084-3322621b7f05 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:13.322762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50b25a-35cd-4507-8084-3322621b7f05 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:13.322855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50b25a-35cd-4507-8084-3322621b7f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:13.341724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-1e50b25a-35cd-4507-8084-3322621b7f05 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:13.343432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1e50b25a-35cd-4507-8084-3322621b7f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:13.416380 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2567/5141] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:13.426890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57088c8b-22f1-4bce-9164-6a54d1ee1c6c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:13.428471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-57088c8b-22f1-4bce-9164-6a54d1ee1c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:13.490389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57088c8b-22f1-4bce-9164-6a54d1ee1c6c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:13.494304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cb283-bfcb-4a35-aead-65529da0f521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:13.495087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cb283-bfcb-4a35-aead-65529da0f521 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:13.495442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cb283-bfcb-4a35-aead-65529da0f521 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:13.495818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cb283-bfcb-4a35-aead-65529da0f521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:13.505674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17cb283-bfcb-4a35-aead-65529da0f521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:13.507202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17cb283-bfcb-4a35-aead-65529da0f521 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:13.517999 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2575/5142] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:37:14.200199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50b25a-35cd-4507-8084-3322621b7f05 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:14.202859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1e50b25a-35cd-4507-8084-3322621b7f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:14.227892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50b25a-35cd-4507-8084-3322621b7f05 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:14.234206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140492e-2655-47cc-bf39-1e0430dd754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:14.235376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140492e-2655-47cc-bf39-1e0430dd754d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:14.236320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140492e-2655-47cc-bf39-1e0430dd754d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:14.236320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140492e-2655-47cc-bf39-1e0430dd754d admin admin] PATH_INFO: `/v3/projects/be1e0a81898b455dbad1377adec39dcc` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:14.239544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140492e-2655-47cc-bf39-1e0430dd754d admin admin] RBAC: Authorizing `identity:delete_project(project_id=be1e0a81898b455dbad1377adec39dcc)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:14.241612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140492e-2655-47cc-bf39-1e0430dd754d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:14.393032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7140492e-2655-47cc-bf39-1e0430dd754d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be1e0a81898b455dbad1377adec39dcc', 'request_id': 'req-7140492e-2655-47cc-bf39-1e0430dd754d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:14.404310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7140492e-2655-47cc-bf39-1e0430dd754d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be1e0a81898b455dbad1377adec39dcc', 'request_id': 'req-7140492e-2655-47cc-bf39-1e0430dd754d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:14.497155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7140492e-2655-47cc-bf39-1e0430dd754d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be1e0a81898b455dbad1377adec39dcc', 'request_id': 'req-7140492e-2655-47cc-bf39-1e0430dd754d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:14.509014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7140492e-2655-47cc-bf39-1e0430dd754d admin admin] The token cache is being invalidate because project be1e0a81898b455dbad1377adec39dcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:37:14.509253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7140492e-2655-47cc-bf39-1e0430dd754d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:14.509901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7140492e-2655-47cc-bf39-1e0430dd754d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:14.511439 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2568/5143] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:37:14 2022] DELETE /identity/v3/projects/be1e0a81898b455dbad1377adec39dcc => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:14.515341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cb283-bfcb-4a35-aead-65529da0f521 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:14.527809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cb283-bfcb-4a35-aead-65529da0f521 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:14.584367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e586d-6938-41c2-aee6-85d34837d8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:14.585714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e586d-6938-41c2-aee6-85d34837d8b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:14.586353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e586d-6938-41c2-aee6-85d34837d8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:14.586639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e586d-6938-41c2-aee6-85d34837d8b1 admin admin] PATH_INFO: `/v3/users/718a00d2305f4715bebf41bc26c02d27` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:14.589807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e586d-6938-41c2-aee6-85d34837d8b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=718a00d2305f4715bebf41bc26c02d27)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:14.591915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e586d-6938-41c2-aee6-85d34837d8b1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:14.771325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-915e586d-6938-41c2-aee6-85d34837d8b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '718a00d2305f4715bebf41bc26c02d27'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:14.785619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-915e586d-6938-41c2-aee6-85d34837d8b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '718a00d2305f4715bebf41bc26c02d27'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:14.786611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-915e586d-6938-41c2-aee6-85d34837d8b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '718a00d2305f4715bebf41bc26c02d27'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:14.794163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-915e586d-6938-41c2-aee6-85d34837d8b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '718a00d2305f4715bebf41bc26c02d27'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:14.893089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-915e586d-6938-41c2-aee6-85d34837d8b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '718a00d2305f4715bebf41bc26c02d27'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:14.915632 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2576/5144] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:37:14 2022] DELETE /identity/v3/users/718a00d2305f4715bebf41bc26c02d27 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:15.665188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140492e-2655-47cc-bf39-1e0430dd754d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:15.667198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7140492e-2655-47cc-bf39-1e0430dd754d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:15.685360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140492e-2655-47cc-bf39-1e0430dd754d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:15.801178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e1b2c-9e6d-41a6-915e-52d28fd9ab58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:15.802173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e1b2c-9e6d-41a6-915e-52d28fd9ab58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:15.802626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e1b2c-9e6d-41a6-915e-52d28fd9ab58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:15.802921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e1b2c-9e6d-41a6-915e-52d28fd9ab58 admin admin] PATH_INFO: `/v3/projects/aaaf04bd846b4448b671fcab899e442b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:15.804190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e1b2c-9e6d-41a6-915e-52d28fd9ab58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaaf04bd846b4448b671fcab899e442b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:15.810520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e1b2c-9e6d-41a6-915e-52d28fd9ab58 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:15.942119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e63e1b2c-9e6d-41a6-915e-52d28fd9ab58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaaf04bd846b4448b671fcab899e442b', 'request_id': 'req-e63e1b2c-9e6d-41a6-915e-52d28fd9ab58'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:15.950756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e63e1b2c-9e6d-41a6-915e-52d28fd9ab58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaaf04bd846b4448b671fcab899e442b', 'request_id': 'req-e63e1b2c-9e6d-41a6-915e-52d28fd9ab58'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:16.074353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e63e1b2c-9e6d-41a6-915e-52d28fd9ab58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaaf04bd846b4448b671fcab899e442b', 'request_id': 'req-e63e1b2c-9e6d-41a6-915e-52d28fd9ab58'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:16.085684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e63e1b2c-9e6d-41a6-915e-52d28fd9ab58 admin admin] The token cache is being invalidate because project aaaf04bd846b4448b671fcab899e442b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:37:16.085976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e63e1b2c-9e6d-41a6-915e-52d28fd9ab58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:16.086649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e63e1b2c-9e6d-41a6-915e-52d28fd9ab58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:16.088230 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2569/5145] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:37:15 2022] DELETE /identity/v3/projects/aaaf04bd846b4448b671fcab899e442b => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:16.093449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556f818-456d-48c7-ba93-54443ca43805 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:16.093989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556f818-456d-48c7-ba93-54443ca43805 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:16.094106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556f818-456d-48c7-ba93-54443ca43805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:16.115037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d556f818-456d-48c7-ba93-54443ca43805 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:16.116290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d556f818-456d-48c7-ba93-54443ca43805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:16.183411 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2577/5146] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:37:16.191938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ebd8b-181a-4779-9593-c6aa5b49fcbc None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:16.192226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ebd8b-181a-4779-9593-c6aa5b49fcbc None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:16.192505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ebd8b-181a-4779-9593-c6aa5b49fcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:16.233226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-327ebd8b-181a-4779-9593-c6aa5b49fcbc None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:16.234655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-327ebd8b-181a-4779-9593-c6aa5b49fcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:16.244301 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2570/5147] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:16.249983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556f818-456d-48c7-ba93-54443ca43805 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:16.263374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556f818-456d-48c7-ba93-54443ca43805 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:16.276238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ef8bf-2193-4e0b-9220-0d4778063f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:16.276953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ef8bf-2193-4e0b-9220-0d4778063f67 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:16.277234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ef8bf-2193-4e0b-9220-0d4778063f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:16.277773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ef8bf-2193-4e0b-9220-0d4778063f67 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:16.278605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ef8bf-2193-4e0b-9220-0d4778063f67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:37:16.278982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ef8bf-2193-4e0b-9220-0d4778063f67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:16.281857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ef8bf-2193-4e0b-9220-0d4778063f67 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:16.295632 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2578/5148] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:37:16.299969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ebd8b-181a-4779-9593-c6aa5b49fcbc None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:16.310174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ebd8b-181a-4779-9593-c6aa5b49fcbc None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:16.315836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366f44e-dc27-4e07-b127-b6f7d169e778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:16.316906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366f44e-dc27-4e07-b127-b6f7d169e778 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:16.317253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366f44e-dc27-4e07-b127-b6f7d169e778 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:16.317592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366f44e-dc27-4e07-b127-b6f7d169e778 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:16.318409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366f44e-dc27-4e07-b127-b6f7d169e778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:16.320416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366f44e-dc27-4e07-b127-b6f7d169e778 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:16.419584 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2571/5149] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:37:16 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:37:16.423991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ef8bf-2193-4e0b-9220-0d4778063f67 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:16.434451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ef8bf-2193-4e0b-9220-0d4778063f67 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:16.490580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2355f52-95a9-4ccd-aaf7-91b1ec841038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:16.491312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2355f52-95a9-4ccd-aaf7-91b1ec841038 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:16.491636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2355f52-95a9-4ccd-aaf7-91b1ec841038 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:16.491917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2355f52-95a9-4ccd-aaf7-91b1ec841038 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:16.492645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2355f52-95a9-4ccd-aaf7-91b1ec841038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:16.494554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2355f52-95a9-4ccd-aaf7-91b1ec841038 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:16.609606 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2579/5150] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:37:16 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:37:16.611030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366f44e-dc27-4e07-b127-b6f7d169e778 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:16.621830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366f44e-dc27-4e07-b127-b6f7d169e778 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:16.627344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885ecdd-4419-4fce-a640-4aed5e8f7a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:16.628012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885ecdd-4419-4fce-a640-4aed5e8f7a04 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:16.628417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885ecdd-4419-4fce-a640-4aed5e8f7a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:16.628731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885ecdd-4419-4fce-a640-4aed5e8f7a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:16.629458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885ecdd-4419-4fce-a640-4aed5e8f7a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:16.631049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885ecdd-4419-4fce-a640-4aed5e8f7a04 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:16.641840 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2572/5151] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:16.645662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2355f52-95a9-4ccd-aaf7-91b1ec841038 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:16.655884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2355f52-95a9-4ccd-aaf7-91b1ec841038 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:16.660634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75e9aa-f971-45b5-9bb9-7d0c49239ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:16.661328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75e9aa-f971-45b5-9bb9-7d0c49239ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:16.661614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75e9aa-f971-45b5-9bb9-7d0c49239ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:16.661955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75e9aa-f971-45b5-9bb9-7d0c49239ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:16.662632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75e9aa-f971-45b5-9bb9-7d0c49239ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:16.664258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75e9aa-f971-45b5-9bb9-7d0c49239ec6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:16.678216 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2580/5152] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:16.679495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885ecdd-4419-4fce-a640-4aed5e8f7a04 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:16.692169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885ecdd-4419-4fce-a640-4aed5e8f7a04 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:16.697440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e3c8e-3076-4cd4-911d-6e3303cb0640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:16.698601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e3c8e-3076-4cd4-911d-6e3303cb0640 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:16.698888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e3c8e-3076-4cd4-911d-6e3303cb0640 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:16.699166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e3c8e-3076-4cd4-911d-6e3303cb0640 admin admin] PATH_INFO: `/v3/projects/c0a41b924ad64c92920208d7b63a8910/users/0d746eb0b3b248a48fde2b7df0d8c9bc/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:16.714012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e3c8e-3076-4cd4-911d-6e3303cb0640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a41b924ad64c92920208d7b63a8910, user_id=0d746eb0b3b248a48fde2b7df0d8c9bc, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:16.716754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e3c8e-3076-4cd4-911d-6e3303cb0640 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:16.818121 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2573/5153] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:37:16 2022] PUT /identity/v3/projects/c0a41b924ad64c92920208d7b63a8910/users/0d746eb0b3b248a48fde2b7df0d8c9bc/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:16.829083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db066494-4658-4bde-b5c0-9f682b1b47ba None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:16.829375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db066494-4658-4bde-b5c0-9f682b1b47ba None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:16.829660 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db066494-4658-4bde-b5c0-9f682b1b47ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:16.859376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-db066494-4658-4bde-b5c0-9f682b1b47ba None None] MFA Rules not processed for user `0d746eb0b3b248a48fde2b7df0d8c9bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:16.860632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-db066494-4658-4bde-b5c0-9f682b1b47ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:16.926887 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2581/5154] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:16.931576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e3c8e-3076-4cd4-911d-6e3303cb0640 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:16.993424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e3c8e-3076-4cd4-911d-6e3303cb0640 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:16.998138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5d489-be5d-481a-8446-bcff04116303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:16.998811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5d489-be5d-481a-8446-bcff04116303 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:16.999105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5d489-be5d-481a-8446-bcff04116303 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:16.999385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5d489-be5d-481a-8446-bcff04116303 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:17.000097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5d489-be5d-481a-8446-bcff04116303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:17.002323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5d489-be5d-481a-8446-bcff04116303 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:17.160507 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2574/5155] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:37:16 2022] POST /identity/v3/projects => generated 383 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:37:17.161667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db066494-4658-4bde-b5c0-9f682b1b47ba None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:17.173125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db066494-4658-4bde-b5c0-9f682b1b47ba None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:17.227667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d7af2-8f83-46d3-ab5c-11b72d64ee8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:17.228239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d7af2-8f83-46d3-ab5c-11b72d64ee8c admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:17.228531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d7af2-8f83-46d3-ab5c-11b72d64ee8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:17.228917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d7af2-8f83-46d3-ab5c-11b72d64ee8c admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:17.229623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d7af2-8f83-46d3-ab5c-11b72d64ee8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:17.231527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d7af2-8f83-46d3-ab5c-11b72d64ee8c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:17.313546 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2582/5156] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:37:17 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:37:17.318467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5d489-be5d-481a-8446-bcff04116303 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:17.331005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5d489-be5d-481a-8446-bcff04116303 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:17.336138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712646ba-4972-4818-9503-309184387bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:17.337038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712646ba-4972-4818-9503-309184387bda admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:17.337383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712646ba-4972-4818-9503-309184387bda admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:17.337779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712646ba-4972-4818-9503-309184387bda admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:17.338823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712646ba-4972-4818-9503-309184387bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:17.340785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712646ba-4972-4818-9503-309184387bda admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:17.355359 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2575/5157] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:17.359353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d7af2-8f83-46d3-ab5c-11b72d64ee8c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:17.377494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d7af2-8f83-46d3-ab5c-11b72d64ee8c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:17.388938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9841b-8b9c-4c19-a5ff-72add9f03a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:17.388938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9841b-8b9c-4c19-a5ff-72add9f03a45 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:17.388938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9841b-8b9c-4c19-a5ff-72add9f03a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:17.388938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9841b-8b9c-4c19-a5ff-72add9f03a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:17.391167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9841b-8b9c-4c19-a5ff-72add9f03a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:17.392925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9841b-8b9c-4c19-a5ff-72add9f03a45 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:17.405914 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2583/5158] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:37:17.409894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712646ba-4972-4818-9503-309184387bda admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:17.421517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712646ba-4972-4818-9503-309184387bda admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:17.427517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8570b-a95a-4b81-8960-93592ad0760a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:17.428166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8570b-a95a-4b81-8960-93592ad0760a admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:17.428454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8570b-a95a-4b81-8960-93592ad0760a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:17.428781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8570b-a95a-4b81-8960-93592ad0760a admin admin] PATH_INFO: `/v3/projects/c6ea813396404385a00ac239ef5360e6/users/562fd54dba7a461e861b7f890a883714/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:17.451079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8570b-a95a-4b81-8960-93592ad0760a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ea813396404385a00ac239ef5360e6, user_id=562fd54dba7a461e861b7f890a883714, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:17.455868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8570b-a95a-4b81-8960-93592ad0760a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:17.551627 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2576/5159] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:37:17 2022] PUT /identity/v3/projects/c6ea813396404385a00ac239ef5360e6/users/562fd54dba7a461e861b7f890a883714/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:17.562267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94502d4-5bcc-421b-9c12-bf6b83779e1b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:17.562646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94502d4-5bcc-421b-9c12-bf6b83779e1b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:17.563004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94502d4-5bcc-421b-9c12-bf6b83779e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:17.599174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b94502d4-5bcc-421b-9c12-bf6b83779e1b None None] MFA Rules not processed for user `562fd54dba7a461e861b7f890a883714`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:17.600460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b94502d4-5bcc-421b-9c12-bf6b83779e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:17.675205 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2584/5160] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:37:17.679935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8570b-a95a-4b81-8960-93592ad0760a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:17.750216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8570b-a95a-4b81-8960-93592ad0760a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:17.755313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423c702-876e-4fb4-99b7-29e10546f0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:17.756064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423c702-876e-4fb4-99b7-29e10546f0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:17.756348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423c702-876e-4fb4-99b7-29e10546f0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:17.756674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423c702-876e-4fb4-99b7-29e10546f0a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:17.757349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423c702-876e-4fb4-99b7-29e10546f0a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:17.759266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423c702-876e-4fb4-99b7-29e10546f0a2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:17.854564 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2577/5161] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:37:17 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:37:17.854718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94502d4-5bcc-421b-9c12-bf6b83779e1b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:17.867148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94502d4-5bcc-421b-9c12-bf6b83779e1b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:17.933313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb2655-eea1-4897-88e1-b541209089d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:17.934005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb2655-eea1-4897-88e1-b541209089d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:17.934694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb2655-eea1-4897-88e1-b541209089d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:17.934694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb2655-eea1-4897-88e1-b541209089d0 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:17.935234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb2655-eea1-4897-88e1-b541209089d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:17.938292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb2655-eea1-4897-88e1-b541209089d0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:18.043401 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2585/5162] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:37:17 2022] POST /identity/v3/users => generated 298 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:37:18.044677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423c702-876e-4fb4-99b7-29e10546f0a2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:18.055697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423c702-876e-4fb4-99b7-29e10546f0a2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:18.061429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9c113-03d3-4d7b-ba13-428b1b879826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:18.065876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9c113-03d3-4d7b-ba13-428b1b879826 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:18.065876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9c113-03d3-4d7b-ba13-428b1b879826 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:18.065876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9c113-03d3-4d7b-ba13-428b1b879826 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:18.065876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9c113-03d3-4d7b-ba13-428b1b879826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:18.065876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9c113-03d3-4d7b-ba13-428b1b879826 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:18.076549 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2578/5163] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:18.081668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb2655-eea1-4897-88e1-b541209089d0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:18.093621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb2655-eea1-4897-88e1-b541209089d0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:18.098580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037602a3-e742-4189-942e-03e468fe5df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:18.100480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037602a3-e742-4189-942e-03e468fe5df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:18.100815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037602a3-e742-4189-942e-03e468fe5df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:18.101387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037602a3-e742-4189-942e-03e468fe5df6 admin admin] PATH_INFO: `/v3/projects/2530663ea9664bf2812d1cecc8d8f4e6/users/e9ca159facc94c258f05904c3246089a/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:18.118170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037602a3-e742-4189-942e-03e468fe5df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2530663ea9664bf2812d1cecc8d8f4e6, user_id=e9ca159facc94c258f05904c3246089a, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:18.123517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037602a3-e742-4189-942e-03e468fe5df6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:18.219515 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2586/5164] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:37:18 2022] PUT /identity/v3/projects/2530663ea9664bf2812d1cecc8d8f4e6/users/e9ca159facc94c258f05904c3246089a/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:18.223744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9c113-03d3-4d7b-ba13-428b1b879826 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:18.236517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9c113-03d3-4d7b-ba13-428b1b879826 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:18.321838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e4c7a-7d70-464e-9100-d61748cfa730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:18.323014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e4c7a-7d70-464e-9100-d61748cfa730 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:18.323479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e4c7a-7d70-464e-9100-d61748cfa730 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:18.324738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e4c7a-7d70-464e-9100-d61748cfa730 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:18.325826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e4c7a-7d70-464e-9100-d61748cfa730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:18.330894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e4c7a-7d70-464e-9100-d61748cfa730 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:18.349809 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2579/5165] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:18.354677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037602a3-e742-4189-942e-03e468fe5df6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:18.378003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037602a3-e742-4189-942e-03e468fe5df6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:18.391334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d832f-b3e0-42a8-a55e-c7df7ffd9644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:18.392270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d832f-b3e0-42a8-a55e-c7df7ffd9644 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:18.400168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d832f-b3e0-42a8-a55e-c7df7ffd9644 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:18.400168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d832f-b3e0-42a8-a55e-c7df7ffd9644 admin admin] PATH_INFO: `/v3/projects/2530663ea9664bf2812d1cecc8d8f4e6/users/e9ca159facc94c258f05904c3246089a/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:18.400168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d832f-b3e0-42a8-a55e-c7df7ffd9644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2530663ea9664bf2812d1cecc8d8f4e6, user_id=e9ca159facc94c258f05904c3246089a, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:18.402005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d832f-b3e0-42a8-a55e-c7df7ffd9644 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:18.416721 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2587/5166] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:37:18 2022] PUT /identity/v3/projects/2530663ea9664bf2812d1cecc8d8f4e6/users/e9ca159facc94c258f05904c3246089a/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:37:18.428050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45cfb8-b858-4e1f-b284-d35efad9cc39 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:18.428355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45cfb8-b858-4e1f-b284-d35efad9cc39 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:18.428689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45cfb8-b858-4e1f-b284-d35efad9cc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:18.462385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3c45cfb8-b858-4e1f-b284-d35efad9cc39 None None] MFA Rules not processed for user `e9ca159facc94c258f05904c3246089a`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:18.463821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3c45cfb8-b858-4e1f-b284-d35efad9cc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:18.549473 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2580/5167] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:18.562608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d832f-b3e0-42a8-a55e-c7df7ffd9644 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:18.564568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c96d832f-b3e0-42a8-a55e-c7df7ffd9644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:18.665728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d832f-b3e0-42a8-a55e-c7df7ffd9644 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:18.670317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9045c5-ed05-453d-b998-dbdbfed65a89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:18.672231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9045c5-ed05-453d-b998-dbdbfed65a89 service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:18.672231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9045c5-ed05-453d-b998-dbdbfed65a89 service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:18.673555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9045c5-ed05-453d-b998-dbdbfed65a89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:18.753909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9045c5-ed05-453d-b998-dbdbfed65a89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:18.755431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9045c5-ed05-453d-b998-dbdbfed65a89 service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:18.773856 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2588/5168] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:37:19.491909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45cfb8-b858-4e1f-b284-d35efad9cc39 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:19.493559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3c45cfb8-b858-4e1f-b284-d35efad9cc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:19.574026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45cfb8-b858-4e1f-b284-d35efad9cc39 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:19.577762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b54f5c-64c5-4d47-8f7b-d5fa696aa809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:19.578518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b54f5c-64c5-4d47-8f7b-d5fa696aa809 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:19.578808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b54f5c-64c5-4d47-8f7b-d5fa696aa809 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:19.579133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b54f5c-64c5-4d47-8f7b-d5fa696aa809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:19.581552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-91b54f5c-64c5-4d47-8f7b-d5fa696aa809 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:19.680340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b54f5c-64c5-4d47-8f7b-d5fa696aa809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:19.681887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b54f5c-64c5-4d47-8f7b-d5fa696aa809 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:19.695668 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2581/5169] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:37:20.551601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9045c5-ed05-453d-b998-dbdbfed65a89 service cinder] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:20.553065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1f9045c5-ed05-453d-b998-dbdbfed65a89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:20.619464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9045c5-ed05-453d-b998-dbdbfed65a89 service cinder] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:20.629950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3a8cd-99e7-4450-8f55-25873286633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:20.629950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3a8cd-99e7-4450-8f55-25873286633e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:20.629950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3a8cd-99e7-4450-8f55-25873286633e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:20.629950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3a8cd-99e7-4450-8f55-25873286633e admin admin] PATH_INFO: `/v3/users/4a43413a459e451fb05f9dc9e8bd1d6c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:20.630446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3a8cd-99e7-4450-8f55-25873286633e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a43413a459e451fb05f9dc9e8bd1d6c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:20.630446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3a8cd-99e7-4450-8f55-25873286633e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:20.894934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0cc3a8cd-99e7-4450-8f55-25873286633e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a43413a459e451fb05f9dc9e8bd1d6c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:20.910858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0cc3a8cd-99e7-4450-8f55-25873286633e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a43413a459e451fb05f9dc9e8bd1d6c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:20.910858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0cc3a8cd-99e7-4450-8f55-25873286633e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a43413a459e451fb05f9dc9e8bd1d6c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:20.915341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0cc3a8cd-99e7-4450-8f55-25873286633e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a43413a459e451fb05f9dc9e8bd1d6c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:21.017003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0cc3a8cd-99e7-4450-8f55-25873286633e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a43413a459e451fb05f9dc9e8bd1d6c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:21.023378 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2589/5170] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:37:20 2022] DELETE /identity/v3/users/4a43413a459e451fb05f9dc9e8bd1d6c => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:21.027937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c289360-6d51-4309-80ad-807aad807a40 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:21.028526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c289360-6d51-4309-80ad-807aad807a40 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:21.028526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c289360-6d51-4309-80ad-807aad807a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:21.046133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9c289360-6d51-4309-80ad-807aad807a40 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:21.047325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9c289360-6d51-4309-80ad-807aad807a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:21.111991 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2582/5171] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:21.122823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3a8cd-99e7-4450-8f55-25873286633e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:21.124423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0cc3a8cd-99e7-4450-8f55-25873286633e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:21.194357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3a8cd-99e7-4450-8f55-25873286633e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:21.221365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067b9b1-ce28-4a17-b81f-fe1cf83e5234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:21.222109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067b9b1-ce28-4a17-b81f-fe1cf83e5234 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:21.222401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067b9b1-ce28-4a17-b81f-fe1cf83e5234 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:21.222678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067b9b1-ce28-4a17-b81f-fe1cf83e5234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:21.243169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067b9b1-ce28-4a17-b81f-fe1cf83e5234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:21.243169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067b9b1-ce28-4a17-b81f-fe1cf83e5234 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:21.255155 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2590/5172] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:37:21.746315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c289360-6d51-4309-80ad-807aad807a40 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:21.747855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9c289360-6d51-4309-80ad-807aad807a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:21.763792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c289360-6d51-4309-80ad-807aad807a40 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:21.768791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04bbbc-3bde-4183-b83b-2908fc8276d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:21.769686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04bbbc-3bde-4183-b83b-2908fc8276d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:21.769969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04bbbc-3bde-4183-b83b-2908fc8276d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:21.770243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04bbbc-3bde-4183-b83b-2908fc8276d8 admin admin] PATH_INFO: `/v3/projects/538f234d5ed04b63bcc853995b600847` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:21.772354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04bbbc-3bde-4183-b83b-2908fc8276d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=538f234d5ed04b63bcc853995b600847)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:21.774696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04bbbc-3bde-4183-b83b-2908fc8276d8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:21.935916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3a04bbbc-3bde-4183-b83b-2908fc8276d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538f234d5ed04b63bcc853995b600847', 'request_id': 'req-3a04bbbc-3bde-4183-b83b-2908fc8276d8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:21.946829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3a04bbbc-3bde-4183-b83b-2908fc8276d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538f234d5ed04b63bcc853995b600847', 'request_id': 'req-3a04bbbc-3bde-4183-b83b-2908fc8276d8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:22.014844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067b9b1-ce28-4a17-b81f-fe1cf83e5234 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:22.024841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b067b9b1-ce28-4a17-b81f-fe1cf83e5234 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:22.084094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067b9b1-ce28-4a17-b81f-fe1cf83e5234 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:22.093399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3a04bbbc-3bde-4183-b83b-2908fc8276d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538f234d5ed04b63bcc853995b600847', 'request_id': 'req-3a04bbbc-3bde-4183-b83b-2908fc8276d8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:22.105548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3a04bbbc-3bde-4183-b83b-2908fc8276d8 admin admin] The token cache is being invalidate because project 538f234d5ed04b63bcc853995b600847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:37:22.105844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3a04bbbc-3bde-4183-b83b-2908fc8276d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:22.106500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3a04bbbc-3bde-4183-b83b-2908fc8276d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:22.109473 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2583/5173] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:37:21 2022] DELETE /identity/v3/projects/538f234d5ed04b63bcc853995b600847 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:22.114417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783285f-3fde-417b-a8e9-51aea5c7de7f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:22.114705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783285f-3fde-417b-a8e9-51aea5c7de7f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:22.115009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783285f-3fde-417b-a8e9-51aea5c7de7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:22.138278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3783285f-3fde-417b-a8e9-51aea5c7de7f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:22.139532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3783285f-3fde-417b-a8e9-51aea5c7de7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:22.155652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884b6eb-5cd5-4832-ad23-5ed3774e7452 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:22.156848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884b6eb-5cd5-4832-ad23-5ed3774e7452 service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:22.157138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884b6eb-5cd5-4832-ad23-5ed3774e7452 service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:22.157411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884b6eb-5cd5-4832-ad23-5ed3774e7452 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:22.159809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1884b6eb-5cd5-4832-ad23-5ed3774e7452 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:22.208183 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2584/5174] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:37:22.210192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330444d-8013-4415-940f-40cdfb6353e2 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:22.210482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330444d-8013-4415-940f-40cdfb6353e2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:22.210859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330444d-8013-4415-940f-40cdfb6353e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:22.234948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884b6eb-5cd5-4832-ad23-5ed3774e7452 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:22.236812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884b6eb-5cd5-4832-ad23-5ed3774e7452 service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:22.242103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6330444d-8013-4415-940f-40cdfb6353e2 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:22.243889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6330444d-8013-4415-940f-40cdfb6353e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:22.246673 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2591/5175] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:37:22.258219 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2585/5176] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:22.266303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884b6eb-5cd5-4832-ad23-5ed3774e7452 service cinder] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:22.279348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884b6eb-5cd5-4832-ad23-5ed3774e7452 service cinder] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:22.289547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ce30f-8633-4dc6-8343-5a4583d23560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:22.289547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ce30f-8633-4dc6-8343-5a4583d23560 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:22.289547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ce30f-8633-4dc6-8343-5a4583d23560 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:22.289547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ce30f-8633-4dc6-8343-5a4583d23560 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:22.290067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ce30f-8633-4dc6-8343-5a4583d23560 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:37:22.290067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ce30f-8633-4dc6-8343-5a4583d23560 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:22.290067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ce30f-8633-4dc6-8343-5a4583d23560 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:22.309596 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2592/5177] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:37:22.311952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330444d-8013-4415-940f-40cdfb6353e2 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:22.324988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330444d-8013-4415-940f-40cdfb6353e2 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:22.332051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b2444-e90e-4ce5-bf7f-43b558591e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:22.333133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b2444-e90e-4ce5-bf7f-43b558591e79 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:22.333736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b2444-e90e-4ce5-bf7f-43b558591e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:22.334121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b2444-e90e-4ce5-bf7f-43b558591e79 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:22.337140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b2444-e90e-4ce5-bf7f-43b558591e79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:22.339480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b2444-e90e-4ce5-bf7f-43b558591e79 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:22.459091 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2586/5178] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:37:22 2022] POST /identity/v3/projects => generated 365 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:37:22.463034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ce30f-8633-4dc6-8343-5a4583d23560 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:22.491655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ce30f-8633-4dc6-8343-5a4583d23560 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:22.552337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb46c1-3314-47a8-aa5c-7647d5582d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:22.553061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb46c1-3314-47a8-aa5c-7647d5582d25 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:22.553352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb46c1-3314-47a8-aa5c-7647d5582d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:22.553635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb46c1-3314-47a8-aa5c-7647d5582d25 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:22.554558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb46c1-3314-47a8-aa5c-7647d5582d25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:22.556522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb46c1-3314-47a8-aa5c-7647d5582d25 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:22.711923 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2593/5179] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:37:22 2022] POST /identity/v3/users => generated 283 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:37:22.713163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b2444-e90e-4ce5-bf7f-43b558591e79 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:22.723888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b2444-e90e-4ce5-bf7f-43b558591e79 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:22.729058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adcab1-c0cb-41bd-9c87-4008eb574606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:22.729835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adcab1-c0cb-41bd-9c87-4008eb574606 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:22.730125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adcab1-c0cb-41bd-9c87-4008eb574606 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:22.730409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adcab1-c0cb-41bd-9c87-4008eb574606 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:22.731600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adcab1-c0cb-41bd-9c87-4008eb574606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:22.733772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adcab1-c0cb-41bd-9c87-4008eb574606 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:22.744966 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2587/5180] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:22.749987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb46c1-3314-47a8-aa5c-7647d5582d25 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:22.763415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb46c1-3314-47a8-aa5c-7647d5582d25 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:22.769150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe938d2-3188-438d-b97b-10b47ebad43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:22.769957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe938d2-3188-438d-b97b-10b47ebad43e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:22.770317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe938d2-3188-438d-b97b-10b47ebad43e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:22.775293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe938d2-3188-438d-b97b-10b47ebad43e admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:22.776480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe938d2-3188-438d-b97b-10b47ebad43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:22.778349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe938d2-3188-438d-b97b-10b47ebad43e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:22.789984 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2594/5181] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:22.794209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adcab1-c0cb-41bd-9c87-4008eb574606 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:22.806535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adcab1-c0cb-41bd-9c87-4008eb574606 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:22.820163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410d42f-de17-49ea-838c-d355f47eb2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:22.821129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410d42f-de17-49ea-838c-d355f47eb2e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:22.821568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410d42f-de17-49ea-838c-d355f47eb2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:22.821914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410d42f-de17-49ea-838c-d355f47eb2e6 admin admin] PATH_INFO: `/v3/projects/28b3733aca9542b3a9d873766a883fac/users/1b9118b995654db585d0f47f4e97475c/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:22.837587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410d42f-de17-49ea-838c-d355f47eb2e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b3733aca9542b3a9d873766a883fac, user_id=1b9118b995654db585d0f47f4e97475c, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:22.840289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410d42f-de17-49ea-838c-d355f47eb2e6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:22.912423 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2588/5182] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:37:22 2022] PUT /identity/v3/projects/28b3733aca9542b3a9d873766a883fac/users/1b9118b995654db585d0f47f4e97475c/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:22.926537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941deb3c-af89-4e0e-b61f-23695abf914a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:22.926776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941deb3c-af89-4e0e-b61f-23695abf914a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:22.926876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941deb3c-af89-4e0e-b61f-23695abf914a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:22.958974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-941deb3c-af89-4e0e-b61f-23695abf914a None None] MFA Rules not processed for user `1b9118b995654db585d0f47f4e97475c`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:22.961848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-941deb3c-af89-4e0e-b61f-23695abf914a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:23.028780 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2595/5183] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:22 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:23.040738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410d42f-de17-49ea-838c-d355f47eb2e6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:23.042592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1410d42f-de17-49ea-838c-d355f47eb2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:23.109701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410d42f-de17-49ea-838c-d355f47eb2e6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:23.113768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9caf4-6747-4253-b82f-0c2cd87a5cdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:23.114633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9caf4-6747-4253-b82f-0c2cd87a5cdb service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:23.115142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9caf4-6747-4253-b82f-0c2cd87a5cdb service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:23.115396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9caf4-6747-4253-b82f-0c2cd87a5cdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:23.126114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9caf4-6747-4253-b82f-0c2cd87a5cdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:23.129754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9caf4-6747-4253-b82f-0c2cd87a5cdb service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:23.137735 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2589/5184] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:37:24.191379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941deb3c-af89-4e0e-b61f-23695abf914a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:24.192863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-941deb3c-af89-4e0e-b61f-23695abf914a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:24.205469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941deb3c-af89-4e0e-b61f-23695abf914a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:24.209263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f9411-106e-4ec8-ae4d-39ec0ed1b4f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:24.209920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f9411-106e-4ec8-ae4d-39ec0ed1b4f7 service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:24.210208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f9411-106e-4ec8-ae4d-39ec0ed1b4f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:24.210535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f9411-106e-4ec8-ae4d-39ec0ed1b4f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:24.212314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a27f9411-106e-4ec8-ae4d-39ec0ed1b4f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:24.278899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f9411-106e-4ec8-ae4d-39ec0ed1b4f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:24.281247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f9411-106e-4ec8-ae4d-39ec0ed1b4f7 service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:24.293851 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2596/5185] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:37:25.280104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9caf4-6747-4253-b82f-0c2cd87a5cdb service cinder] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:25.281582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f1d9caf4-6747-4253-b82f-0c2cd87a5cdb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:25.338339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9caf4-6747-4253-b82f-0c2cd87a5cdb service cinder] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:25.341973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1324b-e6fb-4507-985e-88b0c916fa5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:25.342615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1324b-e6fb-4507-985e-88b0c916fa5e service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:25.342908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1324b-e6fb-4507-985e-88b0c916fa5e service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:25.343186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1324b-e6fb-4507-985e-88b0c916fa5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:25.344976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-04d1324b-e6fb-4507-985e-88b0c916fa5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:25.402312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1324b-e6fb-4507-985e-88b0c916fa5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:25.403750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1324b-e6fb-4507-985e-88b0c916fa5e service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:25.412657 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2590/5186] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:37:33.363530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f9411-106e-4ec8-ae4d-39ec0ed1b4f7 service cinder] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:33.365145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a27f9411-106e-4ec8-ae4d-39ec0ed1b4f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:33.432477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f9411-106e-4ec8-ae4d-39ec0ed1b4f7 service cinder] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:33.437515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c8933-3530-4422-8551-cd1c14a32911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:33.439121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c8933-3530-4422-8551-cd1c14a32911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:33.439463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c8933-3530-4422-8551-cd1c14a32911 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:33.439751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c8933-3530-4422-8551-cd1c14a32911 admin admin] PATH_INFO: `/v3/users/478df784fc8748ccb42fd144dea95848` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:33.441017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c8933-3530-4422-8551-cd1c14a32911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=478df784fc8748ccb42fd144dea95848)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:33.445646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c8933-3530-4422-8551-cd1c14a32911 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:33.669045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d14c8933-3530-4422-8551-cd1c14a32911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '478df784fc8748ccb42fd144dea95848'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:33.681224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d14c8933-3530-4422-8551-cd1c14a32911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '478df784fc8748ccb42fd144dea95848'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:33.681923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d14c8933-3530-4422-8551-cd1c14a32911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '478df784fc8748ccb42fd144dea95848'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:33.690128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d14c8933-3530-4422-8551-cd1c14a32911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '478df784fc8748ccb42fd144dea95848'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:33.784030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d14c8933-3530-4422-8551-cd1c14a32911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '478df784fc8748ccb42fd144dea95848'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:33.791320 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2597/5187] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:37:33 2022] DELETE /identity/v3/users/478df784fc8748ccb42fd144dea95848 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:33.795892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242f3df-f29a-41ba-a8fc-6249b86310f8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:33.798007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242f3df-f29a-41ba-a8fc-6249b86310f8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:33.798007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242f3df-f29a-41ba-a8fc-6249b86310f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:33.815246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b242f3df-f29a-41ba-a8fc-6249b86310f8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:33.816629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b242f3df-f29a-41ba-a8fc-6249b86310f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:33.884160 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2591/5188] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:33.894527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c8933-3530-4422-8551-cd1c14a32911 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:33.895996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d14c8933-3530-4422-8551-cd1c14a32911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:33.953695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c8933-3530-4422-8551-cd1c14a32911 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:33.957247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646c151-4569-4a83-9e4c-eb5e2e07315d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:33.957940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646c151-4569-4a83-9e4c-eb5e2e07315d service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:33.958228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646c151-4569-4a83-9e4c-eb5e2e07315d service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:33.958512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646c151-4569-4a83-9e4c-eb5e2e07315d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:33.967686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646c151-4569-4a83-9e4c-eb5e2e07315d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:33.969167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646c151-4569-4a83-9e4c-eb5e2e07315d service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:33.979157 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2598/5189] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:37:34.299074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242f3df-f29a-41ba-a8fc-6249b86310f8 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:34.300719 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b242f3df-f29a-41ba-a8fc-6249b86310f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:34.313176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242f3df-f29a-41ba-a8fc-6249b86310f8 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:34.323201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d1f85-b7a3-440f-a4c1-f9f0c873d6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:34.323201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d1f85-b7a3-440f-a4c1-f9f0c873d6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:34.323201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d1f85-b7a3-440f-a4c1-f9f0c873d6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:34.323201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d1f85-b7a3-440f-a4c1-f9f0c873d6ba admin admin] PATH_INFO: `/v3/projects/569626a5090d415faecfbd78c1f7eb59` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:34.324073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d1f85-b7a3-440f-a4c1-f9f0c873d6ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=569626a5090d415faecfbd78c1f7eb59)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:34.324073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d1f85-b7a3-440f-a4c1-f9f0c873d6ba admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:34.457622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-045d1f85-b7a3-440f-a4c1-f9f0c873d6ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '569626a5090d415faecfbd78c1f7eb59', 'request_id': 'req-045d1f85-b7a3-440f-a4c1-f9f0c873d6ba'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:34.463732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-045d1f85-b7a3-440f-a4c1-f9f0c873d6ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '569626a5090d415faecfbd78c1f7eb59', 'request_id': 'req-045d1f85-b7a3-440f-a4c1-f9f0c873d6ba'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:34.537979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-045d1f85-b7a3-440f-a4c1-f9f0c873d6ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '569626a5090d415faecfbd78c1f7eb59', 'request_id': 'req-045d1f85-b7a3-440f-a4c1-f9f0c873d6ba'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:34.549175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-045d1f85-b7a3-440f-a4c1-f9f0c873d6ba admin admin] The token cache is being invalidate because project 569626a5090d415faecfbd78c1f7eb59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:37:34.549476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-045d1f85-b7a3-440f-a4c1-f9f0c873d6ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:34.550194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-045d1f85-b7a3-440f-a4c1-f9f0c873d6ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:34.551793 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2592/5190] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:37:34 2022] DELETE /identity/v3/projects/569626a5090d415faecfbd78c1f7eb59 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:34.555860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646c151-4569-4a83-9e4c-eb5e2e07315d service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:34.566501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646c151-4569-4a83-9e4c-eb5e2e07315d service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:34.625003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4179b5-5a39-436c-bcb2-06429f6654bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:34.626409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4179b5-5a39-436c-bcb2-06429f6654bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:34.626544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4179b5-5a39-436c-bcb2-06429f6654bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:34.626711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4179b5-5a39-436c-bcb2-06429f6654bb admin admin] PATH_INFO: `/v3/users/0bdf91373b2241f8806e720e86d1db53` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:34.627921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4179b5-5a39-436c-bcb2-06429f6654bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bdf91373b2241f8806e720e86d1db53)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:34.629916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4179b5-5a39-436c-bcb2-06429f6654bb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:34.905613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-de4179b5-5a39-436c-bcb2-06429f6654bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bdf91373b2241f8806e720e86d1db53'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:34.916728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-de4179b5-5a39-436c-bcb2-06429f6654bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bdf91373b2241f8806e720e86d1db53'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:34.917404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-de4179b5-5a39-436c-bcb2-06429f6654bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bdf91373b2241f8806e720e86d1db53'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:34.923995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-de4179b5-5a39-436c-bcb2-06429f6654bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bdf91373b2241f8806e720e86d1db53'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:35.029782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d1f85-b7a3-440f-a4c1-f9f0c873d6ba admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:35.031494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-045d1f85-b7a3-440f-a4c1-f9f0c873d6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:35.102962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-de4179b5-5a39-436c-bcb2-06429f6654bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bdf91373b2241f8806e720e86d1db53'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:35.111241 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2599/5191] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:37:34 2022] DELETE /identity/v3/users/0bdf91373b2241f8806e720e86d1db53 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:35.116120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d1f85-b7a3-440f-a4c1-f9f0c873d6ba admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:35.191798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1cef8-04c4-49f0-90db-6217d58dac3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:35.192710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1cef8-04c4-49f0-90db-6217d58dac3f service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:35.193006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1cef8-04c4-49f0-90db-6217d58dac3f service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:35.193564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1cef8-04c4-49f0-90db-6217d58dac3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:35.195489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-40b1cef8-04c4-49f0-90db-6217d58dac3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:35.211983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1cef8-04c4-49f0-90db-6217d58dac3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:35.211983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1cef8-04c4-49f0-90db-6217d58dac3f service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:35.223057 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2593/5192] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:37:35.545548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4179b5-5a39-436c-bcb2-06429f6654bb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:35.547484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-de4179b5-5a39-436c-bcb2-06429f6654bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:35.626353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4179b5-5a39-436c-bcb2-06429f6654bb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:35.631455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c90d7-62da-4fd5-a087-48e39f4bf5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:35.632422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c90d7-62da-4fd5-a087-48e39f4bf5d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:35.632800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c90d7-62da-4fd5-a087-48e39f4bf5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:35.633156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c90d7-62da-4fd5-a087-48e39f4bf5d2 admin admin] PATH_INFO: `/v3/projects/da2382e8ac404fef95e912f3231af575` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:35.634594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c90d7-62da-4fd5-a087-48e39f4bf5d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da2382e8ac404fef95e912f3231af575)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:35.636590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c90d7-62da-4fd5-a087-48e39f4bf5d2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:35.743293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b91c90d7-62da-4fd5-a087-48e39f4bf5d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da2382e8ac404fef95e912f3231af575', 'request_id': 'req-b91c90d7-62da-4fd5-a087-48e39f4bf5d2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:35.874688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b91c90d7-62da-4fd5-a087-48e39f4bf5d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da2382e8ac404fef95e912f3231af575', 'request_id': 'req-b91c90d7-62da-4fd5-a087-48e39f4bf5d2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:35.884630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b91c90d7-62da-4fd5-a087-48e39f4bf5d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da2382e8ac404fef95e912f3231af575', 'request_id': 'req-b91c90d7-62da-4fd5-a087-48e39f4bf5d2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:35.895621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b91c90d7-62da-4fd5-a087-48e39f4bf5d2 admin admin] The token cache is being invalidate because project da2382e8ac404fef95e912f3231af575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:37:35.895909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b91c90d7-62da-4fd5-a087-48e39f4bf5d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:35.896836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b91c90d7-62da-4fd5-a087-48e39f4bf5d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:35.898537 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2600/5193] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:37:35 2022] DELETE /identity/v3/projects/da2382e8ac404fef95e912f3231af575 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:35.903146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1cef8-04c4-49f0-90db-6217d58dac3f service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:35.925753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1cef8-04c4-49f0-90db-6217d58dac3f service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:35.957183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c90d7-62da-4fd5-a087-48e39f4bf5d2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:35.958669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b91c90d7-62da-4fd5-a087-48e39f4bf5d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:35.988576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af057821-0b4b-4dff-b4a2-204ec7c48809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:35.989530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af057821-0b4b-4dff-b4a2-204ec7c48809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:35.989819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af057821-0b4b-4dff-b4a2-204ec7c48809 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:35.990097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af057821-0b4b-4dff-b4a2-204ec7c48809 admin admin] PATH_INFO: `/v3/users/502db961755b4ea1bd83b2da10ac272e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:35.991362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af057821-0b4b-4dff-b4a2-204ec7c48809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=502db961755b4ea1bd83b2da10ac272e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:35.993440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af057821-0b4b-4dff-b4a2-204ec7c48809 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:36.049823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c90d7-62da-4fd5-a087-48e39f4bf5d2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:36.074448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab337af-687f-4c35-b1f0-5652c8c6824c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:36.074448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab337af-687f-4c35-b1f0-5652c8c6824c service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:36.074448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab337af-687f-4c35-b1f0-5652c8c6824c service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:36.074448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab337af-687f-4c35-b1f0-5652c8c6824c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:36.075410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bab337af-687f-4c35-b1f0-5652c8c6824c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:36.075410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab337af-687f-4c35-b1f0-5652c8c6824c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:36.075410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab337af-687f-4c35-b1f0-5652c8c6824c service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:36.088498 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2601/5194] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:37:36.306355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-af057821-0b4b-4dff-b4a2-204ec7c48809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '502db961755b4ea1bd83b2da10ac272e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:36.318261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-af057821-0b4b-4dff-b4a2-204ec7c48809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '502db961755b4ea1bd83b2da10ac272e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:36.319060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-af057821-0b4b-4dff-b4a2-204ec7c48809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '502db961755b4ea1bd83b2da10ac272e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:36.326693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-af057821-0b4b-4dff-b4a2-204ec7c48809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '502db961755b4ea1bd83b2da10ac272e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:36.462236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-af057821-0b4b-4dff-b4a2-204ec7c48809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '502db961755b4ea1bd83b2da10ac272e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:36.469620 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2594/5195] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:37:35 2022] DELETE /identity/v3/users/502db961755b4ea1bd83b2da10ac272e => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:36.921212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab337af-687f-4c35-b1f0-5652c8c6824c service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:36.922672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bab337af-687f-4c35-b1f0-5652c8c6824c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:36.947424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab337af-687f-4c35-b1f0-5652c8c6824c service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:37.011788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650cd6d-a790-402a-b773-6034b8af0466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:37.012796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650cd6d-a790-402a-b773-6034b8af0466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:37.013149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650cd6d-a790-402a-b773-6034b8af0466 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:37.014014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650cd6d-a790-402a-b773-6034b8af0466 admin admin] PATH_INFO: `/v3/projects/cfa9f33b66b04241a2c5381504f75586` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:37.015568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650cd6d-a790-402a-b773-6034b8af0466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa9f33b66b04241a2c5381504f75586)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:37.017698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650cd6d-a790-402a-b773-6034b8af0466 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:37.131981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5650cd6d-a790-402a-b773-6034b8af0466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa9f33b66b04241a2c5381504f75586', 'request_id': 'req-5650cd6d-a790-402a-b773-6034b8af0466'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:37.183273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5650cd6d-a790-402a-b773-6034b8af0466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa9f33b66b04241a2c5381504f75586', 'request_id': 'req-5650cd6d-a790-402a-b773-6034b8af0466'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:37.191325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5650cd6d-a790-402a-b773-6034b8af0466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa9f33b66b04241a2c5381504f75586', 'request_id': 'req-5650cd6d-a790-402a-b773-6034b8af0466'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:37.202236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5650cd6d-a790-402a-b773-6034b8af0466 admin admin] The token cache is being invalidate because project cfa9f33b66b04241a2c5381504f75586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:37:37.202595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5650cd6d-a790-402a-b773-6034b8af0466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:37.203187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5650cd6d-a790-402a-b773-6034b8af0466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:37.208026 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2602/5196] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:37:36 2022] DELETE /identity/v3/projects/cfa9f33b66b04241a2c5381504f75586 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:37.211275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f943f-2d99-4503-89ae-8459ef2b8b75 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:37.211275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f943f-2d99-4503-89ae-8459ef2b8b75 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:37.211275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f943f-2d99-4503-89ae-8459ef2b8b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:37.236751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-211f943f-2d99-4503-89ae-8459ef2b8b75 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:37.237993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-211f943f-2d99-4503-89ae-8459ef2b8b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:37.297947 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2595/5197] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:37.305846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a895c-488b-4ea4-8d36-1e96033a2dce None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:37.306137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a895c-488b-4ea4-8d36-1e96033a2dce None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:37.306415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a895c-488b-4ea4-8d36-1e96033a2dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:37.339016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f65a895c-488b-4ea4-8d36-1e96033a2dce None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:37.341429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f65a895c-488b-4ea4-8d36-1e96033a2dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:37.349285 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2603/5198] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:37.353606 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f943f-2d99-4503-89ae-8459ef2b8b75 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:37.364358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f943f-2d99-4503-89ae-8459ef2b8b75 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:37.372573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc5705-b725-4c18-95a4-7696809d57be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:37.373842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc5705-b725-4c18-95a4-7696809d57be admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:37.374177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc5705-b725-4c18-95a4-7696809d57be admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:37.374568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc5705-b725-4c18-95a4-7696809d57be admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:37.376132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc5705-b725-4c18-95a4-7696809d57be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:37:37.376413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc5705-b725-4c18-95a4-7696809d57be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:37.378128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc5705-b725-4c18-95a4-7696809d57be admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:37.395749 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2596/5199] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:37:37.398304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a895c-488b-4ea4-8d36-1e96033a2dce None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:37.407534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a895c-488b-4ea4-8d36-1e96033a2dce None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:37.412271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38a13e-6c37-4638-82d8-e3e65f7cf50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:37.412973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38a13e-6c37-4638-82d8-e3e65f7cf50e admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:37.413254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38a13e-6c37-4638-82d8-e3e65f7cf50e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:37.413529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38a13e-6c37-4638-82d8-e3e65f7cf50e admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:37.414219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38a13e-6c37-4638-82d8-e3e65f7cf50e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:37.416160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38a13e-6c37-4638-82d8-e3e65f7cf50e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:37.516412 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2604/5200] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:37:37 2022] POST /identity/v3/projects => generated 399 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:37:37.520632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc5705-b725-4c18-95a4-7696809d57be admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:37.532014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc5705-b725-4c18-95a4-7696809d57be admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:37.588199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d973c54-fc94-4711-97a0-daa00c18a090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:37.588933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d973c54-fc94-4711-97a0-daa00c18a090 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:37.589227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d973c54-fc94-4711-97a0-daa00c18a090 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:37.589513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d973c54-fc94-4711-97a0-daa00c18a090 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:37.590224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d973c54-fc94-4711-97a0-daa00c18a090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:37.592222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d973c54-fc94-4711-97a0-daa00c18a090 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:37.722155 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2597/5201] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:37:37 2022] POST /identity/v3/users => generated 300 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:37:37.722406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38a13e-6c37-4638-82d8-e3e65f7cf50e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:37.731539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38a13e-6c37-4638-82d8-e3e65f7cf50e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:37.738886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6836d-13d5-49fa-99cb-8f4432abf84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:37.739573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6836d-13d5-49fa-99cb-8f4432abf84d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:37.739867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6836d-13d5-49fa-99cb-8f4432abf84d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:37.740142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6836d-13d5-49fa-99cb-8f4432abf84d admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:37.740939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6836d-13d5-49fa-99cb-8f4432abf84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:37.742970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6836d-13d5-49fa-99cb-8f4432abf84d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:37.767415 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2605/5202] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:37:37.768904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d973c54-fc94-4711-97a0-daa00c18a090 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:37.780172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d973c54-fc94-4711-97a0-daa00c18a090 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:37.785638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b93852-a7fa-4d1a-8902-0cf39ab34a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:37.786569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b93852-a7fa-4d1a-8902-0cf39ab34a75 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:37.786932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b93852-a7fa-4d1a-8902-0cf39ab34a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:37.787281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b93852-a7fa-4d1a-8902-0cf39ab34a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:37.788117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b93852-a7fa-4d1a-8902-0cf39ab34a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:37.789891 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b93852-a7fa-4d1a-8902-0cf39ab34a75 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:37.802269 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2598/5203] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:37.806556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6836d-13d5-49fa-99cb-8f4432abf84d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:37.817468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6836d-13d5-49fa-99cb-8f4432abf84d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:37.822337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32beb3-3e6a-4d21-ba9b-b7bd5f5ac6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:37.825140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32beb3-3e6a-4d21-ba9b-b7bd5f5ac6a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:37.825140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32beb3-3e6a-4d21-ba9b-b7bd5f5ac6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:37.825140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32beb3-3e6a-4d21-ba9b-b7bd5f5ac6a4 admin admin] PATH_INFO: `/v3/projects/68e0c9ebd65f46ba8fc93f21fb8bd31b/users/73e632b584f04fdf8f9296a3cb4c9217/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:37.839436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32beb3-3e6a-4d21-ba9b-b7bd5f5ac6a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e0c9ebd65f46ba8fc93f21fb8bd31b, user_id=73e632b584f04fdf8f9296a3cb4c9217, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:37.842419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32beb3-3e6a-4d21-ba9b-b7bd5f5ac6a4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:37.967592 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2606/5204] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:37:37 2022] PUT /identity/v3/projects/68e0c9ebd65f46ba8fc93f21fb8bd31b/users/73e632b584f04fdf8f9296a3cb4c9217/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:37.978676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdc311-2d52-4610-88d5-f34dd7b9976d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:37.978864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdc311-2d52-4610-88d5-f34dd7b9976d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:37.979146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdc311-2d52-4610-88d5-f34dd7b9976d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:38.016251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-40fdc311-2d52-4610-88d5-f34dd7b9976d None None] MFA Rules not processed for user `73e632b584f04fdf8f9296a3cb4c9217`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:38.017503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-40fdc311-2d52-4610-88d5-f34dd7b9976d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:38.081392 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2599/5205] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:38.085633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32beb3-3e6a-4d21-ba9b-b7bd5f5ac6a4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:38.162609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32beb3-3e6a-4d21-ba9b-b7bd5f5ac6a4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:38.170809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9b929-3890-4414-993b-8edf46b8b082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:38.171523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9b929-3890-4414-993b-8edf46b8b082 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:38.171805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9b929-3890-4414-993b-8edf46b8b082 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:38.172040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9b929-3890-4414-993b-8edf46b8b082 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:38.172836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9b929-3890-4414-993b-8edf46b8b082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:38.175036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9b929-3890-4414-993b-8edf46b8b082 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:38.316642 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2607/5206] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:37:38 2022] POST /identity/v3/projects => generated 397 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:37:38.329124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdc311-2d52-4610-88d5-f34dd7b9976d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:38.339950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdc311-2d52-4610-88d5-f34dd7b9976d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:38.400442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c113a6-5d93-4688-bd65-030e77680bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:38.401247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c113a6-5d93-4688-bd65-030e77680bcb admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:38.401427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c113a6-5d93-4688-bd65-030e77680bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:38.401703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c113a6-5d93-4688-bd65-030e77680bcb admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:38.402396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c113a6-5d93-4688-bd65-030e77680bcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:38.405872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c113a6-5d93-4688-bd65-030e77680bcb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:38.492319 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2600/5207] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:37:38 2022] POST /identity/v3/users => generated 305 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:37:38.496199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9b929-3890-4414-993b-8edf46b8b082 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:38.506880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9b929-3890-4414-993b-8edf46b8b082 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:38.511653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e1ac7-c5e1-421a-bab3-85c0670833bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:38.512312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e1ac7-c5e1-421a-bab3-85c0670833bd admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:38.512623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e1ac7-c5e1-421a-bab3-85c0670833bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:38.512933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e1ac7-c5e1-421a-bab3-85c0670833bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:38.515080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e1ac7-c5e1-421a-bab3-85c0670833bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:38.518362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e1ac7-c5e1-421a-bab3-85c0670833bd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:38.534468 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2608/5208] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:38.535345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c113a6-5d93-4688-bd65-030e77680bcb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:38.545780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c113a6-5d93-4688-bd65-030e77680bcb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:38.551678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b8a0e-29f8-4544-b036-dd83ad5060fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:38.552566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b8a0e-29f8-4544-b036-dd83ad5060fc admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:38.552887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b8a0e-29f8-4544-b036-dd83ad5060fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:38.553148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b8a0e-29f8-4544-b036-dd83ad5060fc admin admin] PATH_INFO: `/v3/projects/77208e5dd7e44bfe92977318fb47a698/users/fa4909ac988a4b5595233744b5ccdc91/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:38.569112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b8a0e-29f8-4544-b036-dd83ad5060fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=77208e5dd7e44bfe92977318fb47a698, user_id=fa4909ac988a4b5595233744b5ccdc91, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:38.572132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b8a0e-29f8-4544-b036-dd83ad5060fc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:38.652161 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2601/5209] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:37:38 2022] PUT /identity/v3/projects/77208e5dd7e44bfe92977318fb47a698/users/fa4909ac988a4b5595233744b5ccdc91/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:38.656318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e1ac7-c5e1-421a-bab3-85c0670833bd admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:38.666300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e1ac7-c5e1-421a-bab3-85c0670833bd admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:38.737379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2be9f-c5b8-4699-8266-8de690e9bf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:38.738229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2be9f-c5b8-4699-8266-8de690e9bf4d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:38.738523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2be9f-c5b8-4699-8266-8de690e9bf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:38.738837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2be9f-c5b8-4699-8266-8de690e9bf4d admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:38.739619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2be9f-c5b8-4699-8266-8de690e9bf4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:38.741272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2be9f-c5b8-4699-8266-8de690e9bf4d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:38.755378 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2609/5210] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:38.757179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b8a0e-29f8-4544-b036-dd83ad5060fc admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:38.768827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b8a0e-29f8-4544-b036-dd83ad5060fc admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:38.773720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d156e-b91e-45f0-9712-cc607ac22e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:38.774757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d156e-b91e-45f0-9712-cc607ac22e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:38.775140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d156e-b91e-45f0-9712-cc607ac22e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:38.775339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d156e-b91e-45f0-9712-cc607ac22e02 admin admin] PATH_INFO: `/v3/projects/77208e5dd7e44bfe92977318fb47a698/users/fa4909ac988a4b5595233744b5ccdc91/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:38.777512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d156e-b91e-45f0-9712-cc607ac22e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77208e5dd7e44bfe92977318fb47a698, user_id=fa4909ac988a4b5595233744b5ccdc91, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:38.780435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d156e-b91e-45f0-9712-cc607ac22e02 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:38.791326 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2602/5211] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:37:38 2022] PUT /identity/v3/projects/77208e5dd7e44bfe92977318fb47a698/users/fa4909ac988a4b5595233744b5ccdc91/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:37:38.801394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9455cd-e8c7-4134-8484-0fe7b968c1d3 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:38.802213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9455cd-e8c7-4134-8484-0fe7b968c1d3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:38.802213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9455cd-e8c7-4134-8484-0fe7b968c1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:38.840891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fb9455cd-e8c7-4134-8484-0fe7b968c1d3 None None] MFA Rules not processed for user `fa4909ac988a4b5595233744b5ccdc91`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:38.842255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fb9455cd-e8c7-4134-8484-0fe7b968c1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:38.915474 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2610/5212] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:38 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:38.932699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d156e-b91e-45f0-9712-cc607ac22e02 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:38.934446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ed9d156e-b91e-45f0-9712-cc607ac22e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:39.001644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d156e-b91e-45f0-9712-cc607ac22e02 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:39.005313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eaf951-4800-4aa8-8ac5-64da7482c4a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:39.005995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaf951-4800-4aa8-8ac5-64da7482c4a6 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:39.006227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaf951-4800-4aa8-8ac5-64da7482c4a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:39.006505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaf951-4800-4aa8-8ac5-64da7482c4a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:39.065508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eaf951-4800-4aa8-8ac5-64da7482c4a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:39.066986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eaf951-4800-4aa8-8ac5-64da7482c4a6 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:39.076772 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2603/5213] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:37:40.001631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9455cd-e8c7-4134-8484-0fe7b968c1d3 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:40.003410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fb9455cd-e8c7-4134-8484-0fe7b968c1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:40.081264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9455cd-e8c7-4134-8484-0fe7b968c1d3 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:40.087432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de020ec0-efef-4ec5-8f08-f9489c0321af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:40.087728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de020ec0-efef-4ec5-8f08-f9489c0321af service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:40.088017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de020ec0-efef-4ec5-8f08-f9489c0321af service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:40.088302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de020ec0-efef-4ec5-8f08-f9489c0321af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:40.098842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de020ec0-efef-4ec5-8f08-f9489c0321af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:40.100810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de020ec0-efef-4ec5-8f08-f9489c0321af service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:40.111063 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2611/5214] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:37:46.213255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee401ef-2de7-42ee-8fad-248184865d7e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:46.213809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee401ef-2de7-42ee-8fad-248184865d7e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:46.213809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee401ef-2de7-42ee-8fad-248184865d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:46.241018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-1ee401ef-2de7-42ee-8fad-248184865d7e None None] MFA Rules not processed for user `8c8a5cbbc43e415a85da2b0074a05138`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:46.242312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1ee401ef-2de7-42ee-8fad-248184865d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:46.324009 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2604/5215] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:48.834669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de020ec0-efef-4ec5-8f08-f9489c0321af service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:48.906949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de020ec0-efef-4ec5-8f08-f9489c0321af service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:48.911845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b6c98-3e50-4a44-b831-5c42fdf5c374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:48.913354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b6c98-3e50-4a44-b831-5c42fdf5c374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:48.913354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b6c98-3e50-4a44-b831-5c42fdf5c374 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:48.913354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b6c98-3e50-4a44-b831-5c42fdf5c374 admin admin] PATH_INFO: `/v3/users/73e632b584f04fdf8f9296a3cb4c9217` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:48.914542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b6c98-3e50-4a44-b831-5c42fdf5c374 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73e632b584f04fdf8f9296a3cb4c9217)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:48.916632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b6c98-3e50-4a44-b831-5c42fdf5c374 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:49.112074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-144b6c98-3e50-4a44-b831-5c42fdf5c374 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73e632b584f04fdf8f9296a3cb4c9217'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:49.124353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-144b6c98-3e50-4a44-b831-5c42fdf5c374 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73e632b584f04fdf8f9296a3cb4c9217'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:49.125059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-144b6c98-3e50-4a44-b831-5c42fdf5c374 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73e632b584f04fdf8f9296a3cb4c9217'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:49.131936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-144b6c98-3e50-4a44-b831-5c42fdf5c374 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73e632b584f04fdf8f9296a3cb4c9217'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:49.227854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-144b6c98-3e50-4a44-b831-5c42fdf5c374 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73e632b584f04fdf8f9296a3cb4c9217'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:49.235057 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2612/5216] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:37:48 2022] DELETE /identity/v3/users/73e632b584f04fdf8f9296a3cb4c9217 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:49.239725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f1344-d595-4861-a3a4-1191ea8803e8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:49.240277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f1344-d595-4861-a3a4-1191ea8803e8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:49.240386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f1344-d595-4861-a3a4-1191ea8803e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:49.259975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-010f1344-d595-4861-a3a4-1191ea8803e8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:49.261238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-010f1344-d595-4861-a3a4-1191ea8803e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:49.324312 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2605/5217] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:49.343493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b6c98-3e50-4a44-b831-5c42fdf5c374 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:49.344973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-144b6c98-3e50-4a44-b831-5c42fdf5c374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:49.402812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b6c98-3e50-4a44-b831-5c42fdf5c374 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:49.407020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07881d88-f751-45ce-b1d2-1724cf72233b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:49.407704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07881d88-f751-45ce-b1d2-1724cf72233b service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:49.407990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07881d88-f751-45ce-b1d2-1724cf72233b service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:49.408267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07881d88-f751-45ce-b1d2-1724cf72233b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:49.418016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07881d88-f751-45ce-b1d2-1724cf72233b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:49.420041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07881d88-f751-45ce-b1d2-1724cf72233b service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:49.432957 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2613/5218] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:37:49.802505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f1344-d595-4861-a3a4-1191ea8803e8 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:49.804314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-010f1344-d595-4861-a3a4-1191ea8803e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:49.818511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f1344-d595-4861-a3a4-1191ea8803e8 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:49.829696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788a7b5-d5ed-4662-8842-a4efdd35e2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:49.832317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788a7b5-d5ed-4662-8842-a4efdd35e2d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:49.832735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788a7b5-d5ed-4662-8842-a4efdd35e2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:49.833304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788a7b5-d5ed-4662-8842-a4efdd35e2d2 admin admin] PATH_INFO: `/v3/projects/68e0c9ebd65f46ba8fc93f21fb8bd31b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:49.835912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788a7b5-d5ed-4662-8842-a4efdd35e2d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68e0c9ebd65f46ba8fc93f21fb8bd31b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:49.858766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788a7b5-d5ed-4662-8842-a4efdd35e2d2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:50.002335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d788a7b5-d5ed-4662-8842-a4efdd35e2d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68e0c9ebd65f46ba8fc93f21fb8bd31b', 'request_id': 'req-d788a7b5-d5ed-4662-8842-a4efdd35e2d2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:50.008789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d788a7b5-d5ed-4662-8842-a4efdd35e2d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68e0c9ebd65f46ba8fc93f21fb8bd31b', 'request_id': 'req-d788a7b5-d5ed-4662-8842-a4efdd35e2d2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:50.102678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d788a7b5-d5ed-4662-8842-a4efdd35e2d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68e0c9ebd65f46ba8fc93f21fb8bd31b', 'request_id': 'req-d788a7b5-d5ed-4662-8842-a4efdd35e2d2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:50.115335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d788a7b5-d5ed-4662-8842-a4efdd35e2d2 admin admin] The token cache is being invalidate because project 68e0c9ebd65f46ba8fc93f21fb8bd31b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:37:50.115699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d788a7b5-d5ed-4662-8842-a4efdd35e2d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:50.116673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d788a7b5-d5ed-4662-8842-a4efdd35e2d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:50.118608 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2606/5219] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:37:49 2022] DELETE /identity/v3/projects/68e0c9ebd65f46ba8fc93f21fb8bd31b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:50.125217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07881d88-f751-45ce-b1d2-1724cf72233b service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:50.136193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07881d88-f751-45ce-b1d2-1724cf72233b service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:50.195267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79292cb1-098e-4290-938a-403e216c1c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:50.196170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79292cb1-098e-4290-938a-403e216c1c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:50.196457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79292cb1-098e-4290-938a-403e216c1c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:50.196782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79292cb1-098e-4290-938a-403e216c1c78 admin admin] PATH_INFO: `/v3/users/fa4909ac988a4b5595233744b5ccdc91` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:50.198056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79292cb1-098e-4290-938a-403e216c1c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4909ac988a4b5595233744b5ccdc91)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:50.199897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79292cb1-098e-4290-938a-403e216c1c78 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:50.438018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-79292cb1-098e-4290-938a-403e216c1c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4909ac988a4b5595233744b5ccdc91'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:50.450559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-79292cb1-098e-4290-938a-403e216c1c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4909ac988a4b5595233744b5ccdc91'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:50.451219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-79292cb1-098e-4290-938a-403e216c1c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4909ac988a4b5595233744b5ccdc91'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:50.460271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-79292cb1-098e-4290-938a-403e216c1c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4909ac988a4b5595233744b5ccdc91'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:50.537377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-79292cb1-098e-4290-938a-403e216c1c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4909ac988a4b5595233744b5ccdc91'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:50.543806 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2614/5220] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:37:50 2022] DELETE /identity/v3/users/fa4909ac988a4b5595233744b5ccdc91 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:50.860046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788a7b5-d5ed-4662-8842-a4efdd35e2d2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:50.862364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d788a7b5-d5ed-4662-8842-a4efdd35e2d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:50.890818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788a7b5-d5ed-4662-8842-a4efdd35e2d2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:50.956583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63377320-3d24-4e71-9e93-ab3f9be80d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:50.957582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63377320-3d24-4e71-9e93-ab3f9be80d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:50.957900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63377320-3d24-4e71-9e93-ab3f9be80d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:50.958181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63377320-3d24-4e71-9e93-ab3f9be80d32 admin admin] PATH_INFO: `/v3/projects/77208e5dd7e44bfe92977318fb47a698` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:50.959503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63377320-3d24-4e71-9e93-ab3f9be80d32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77208e5dd7e44bfe92977318fb47a698)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:50.961494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63377320-3d24-4e71-9e93-ab3f9be80d32 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:51.129000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-63377320-3d24-4e71-9e93-ab3f9be80d32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77208e5dd7e44bfe92977318fb47a698', 'request_id': 'req-63377320-3d24-4e71-9e93-ab3f9be80d32'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:51.137442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-63377320-3d24-4e71-9e93-ab3f9be80d32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77208e5dd7e44bfe92977318fb47a698', 'request_id': 'req-63377320-3d24-4e71-9e93-ab3f9be80d32'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:51.204568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-63377320-3d24-4e71-9e93-ab3f9be80d32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77208e5dd7e44bfe92977318fb47a698', 'request_id': 'req-63377320-3d24-4e71-9e93-ab3f9be80d32'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:51.219500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-63377320-3d24-4e71-9e93-ab3f9be80d32 admin admin] The token cache is being invalidate because project 77208e5dd7e44bfe92977318fb47a698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:37:51.219970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-63377320-3d24-4e71-9e93-ab3f9be80d32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:51.220903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-63377320-3d24-4e71-9e93-ab3f9be80d32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:51.225826 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2607/5221] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:37:50 2022] DELETE /identity/v3/projects/77208e5dd7e44bfe92977318fb47a698 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:51.228253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801e4f4-3c02-4758-9b62-b8d11f1a756a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:51.229158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801e4f4-3c02-4758-9b62-b8d11f1a756a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:51.229692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801e4f4-3c02-4758-9b62-b8d11f1a756a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:51.255304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4801e4f4-3c02-4758-9b62-b8d11f1a756a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:51.256685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4801e4f4-3c02-4758-9b62-b8d11f1a756a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:51.338949 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2615/5222] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:51.347507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27b170-30f1-4734-bfa1-39dae50d74fc None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:51.348186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27b170-30f1-4734-bfa1-39dae50d74fc None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:51.348529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27b170-30f1-4734-bfa1-39dae50d74fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:51.393259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ba27b170-30f1-4734-bfa1-39dae50d74fc None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:51.395843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ba27b170-30f1-4734-bfa1-39dae50d74fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:51.405140 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2608/5223] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:51.409458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801e4f4-3c02-4758-9b62-b8d11f1a756a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:51.419491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801e4f4-3c02-4758-9b62-b8d11f1a756a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:51.429023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cee5f-91ff-4820-a0de-4e788102b72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:51.431850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cee5f-91ff-4820-a0de-4e788102b72a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:51.431850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cee5f-91ff-4820-a0de-4e788102b72a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:51.431850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cee5f-91ff-4820-a0de-4e788102b72a admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:51.431850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cee5f-91ff-4820-a0de-4e788102b72a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:37:51.431850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cee5f-91ff-4820-a0de-4e788102b72a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:51.433208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cee5f-91ff-4820-a0de-4e788102b72a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:51.445490 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2616/5224] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:37:51.449752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27b170-30f1-4734-bfa1-39dae50d74fc None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:51.459437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27b170-30f1-4734-bfa1-39dae50d74fc None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:51.464131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cee1ac-2555-43a4-8139-86f0fb64e2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:51.464811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cee1ac-2555-43a4-8139-86f0fb64e2cc admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:51.465099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cee1ac-2555-43a4-8139-86f0fb64e2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:51.465383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cee1ac-2555-43a4-8139-86f0fb64e2cc admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:51.466115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cee1ac-2555-43a4-8139-86f0fb64e2cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:51.468023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cee1ac-2555-43a4-8139-86f0fb64e2cc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:51.584319 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2609/5225] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:37:51 2022] POST /identity/v3/projects => generated 353 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:37:51.588377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cee5f-91ff-4820-a0de-4e788102b72a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:51.600127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cee5f-91ff-4820-a0de-4e788102b72a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:51.660079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb57cd-6aab-482a-ab98-aff37078856b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:51.660896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb57cd-6aab-482a-ab98-aff37078856b admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:51.661186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb57cd-6aab-482a-ab98-aff37078856b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:51.661474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb57cd-6aab-482a-ab98-aff37078856b admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:51.662184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb57cd-6aab-482a-ab98-aff37078856b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:51.664264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb57cd-6aab-482a-ab98-aff37078856b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:51.768287 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2617/5226] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:37:51 2022] POST /identity/v3/users => generated 277 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:37:51.775196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cee1ac-2555-43a4-8139-86f0fb64e2cc admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:51.785588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cee1ac-2555-43a4-8139-86f0fb64e2cc admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:51.790453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51822231-ea6a-4e56-9605-ac5315e23382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:51.791120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51822231-ea6a-4e56-9605-ac5315e23382 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:51.791411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51822231-ea6a-4e56-9605-ac5315e23382 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:51.791695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51822231-ea6a-4e56-9605-ac5315e23382 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:51.792427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51822231-ea6a-4e56-9605-ac5315e23382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:51.794729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51822231-ea6a-4e56-9605-ac5315e23382 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:51.806582 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2610/5227] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:51.811309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb57cd-6aab-482a-ab98-aff37078856b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:51.823282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb57cd-6aab-482a-ab98-aff37078856b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:51.828252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb091d52-3559-4300-9268-b95ca7797830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:51.828946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb091d52-3559-4300-9268-b95ca7797830 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:51.829229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb091d52-3559-4300-9268-b95ca7797830 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:51.829505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb091d52-3559-4300-9268-b95ca7797830 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:51.830228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb091d52-3559-4300-9268-b95ca7797830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:51.831828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb091d52-3559-4300-9268-b95ca7797830 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:51.842021 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2618/5228] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:37:51.846163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51822231-ea6a-4e56-9605-ac5315e23382 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:51.857247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51822231-ea6a-4e56-9605-ac5315e23382 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:51.862306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c6d7c-12e4-48b0-aca1-9cc27147d226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:51.863229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c6d7c-12e4-48b0-aca1-9cc27147d226 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:51.863546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c6d7c-12e4-48b0-aca1-9cc27147d226 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:51.863836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c6d7c-12e4-48b0-aca1-9cc27147d226 admin admin] PATH_INFO: `/v3/projects/fca53900a5944d5a8378dce270860348/users/4d970a77dd5a4b6fa79c63576b1204c1/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:51.880966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c6d7c-12e4-48b0-aca1-9cc27147d226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fca53900a5944d5a8378dce270860348, user_id=4d970a77dd5a4b6fa79c63576b1204c1, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:51.883725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c6d7c-12e4-48b0-aca1-9cc27147d226 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:52.005969 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2611/5229] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:37:51 2022] PUT /identity/v3/projects/fca53900a5944d5a8378dce270860348/users/4d970a77dd5a4b6fa79c63576b1204c1/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:52.017496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41544d59-d8e4-40fe-b2d2-d31058146e53 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:52.018085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41544d59-d8e4-40fe-b2d2-d31058146e53 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:52.018688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41544d59-d8e4-40fe-b2d2-d31058146e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:52.048107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-41544d59-d8e4-40fe-b2d2-d31058146e53 None None] MFA Rules not processed for user `4d970a77dd5a4b6fa79c63576b1204c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:52.049477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-41544d59-d8e4-40fe-b2d2-d31058146e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:52.118626 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2619/5230] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:52 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:37:52.123105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c6d7c-12e4-48b0-aca1-9cc27147d226 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:52.184239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c6d7c-12e4-48b0-aca1-9cc27147d226 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:52.189494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff89d7-1d5e-4470-94e4-85f9b0d99043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:52.190158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff89d7-1d5e-4470-94e4-85f9b0d99043 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:52.190445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff89d7-1d5e-4470-94e4-85f9b0d99043 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:52.190713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff89d7-1d5e-4470-94e4-85f9b0d99043 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:52.191415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff89d7-1d5e-4470-94e4-85f9b0d99043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:52.194080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff89d7-1d5e-4470-94e4-85f9b0d99043 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:52.294613 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2612/5231] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:37:52 2022] POST /identity/v3/projects => generated 355 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:37:52.298850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41544d59-d8e4-40fe-b2d2-d31058146e53 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:52.311052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41544d59-d8e4-40fe-b2d2-d31058146e53 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:52.373359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77b379-f85a-44cd-924f-4b4b8e6e984d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:52.374435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77b379-f85a-44cd-924f-4b4b8e6e984d admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:52.374898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77b379-f85a-44cd-924f-4b4b8e6e984d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:52.375178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77b379-f85a-44cd-924f-4b4b8e6e984d admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:52.376149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77b379-f85a-44cd-924f-4b4b8e6e984d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:52.378078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77b379-f85a-44cd-924f-4b4b8e6e984d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:52.461061 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2620/5232] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:37:52 2022] POST /identity/v3/users => generated 284 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:37:52.462309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff89d7-1d5e-4470-94e4-85f9b0d99043 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:52.473155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff89d7-1d5e-4470-94e4-85f9b0d99043 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:52.477890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f50963-7268-4913-886d-28ce34d1dfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:52.478553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f50963-7268-4913-886d-28ce34d1dfc8 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:52.478856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f50963-7268-4913-886d-28ce34d1dfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:52.479604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f50963-7268-4913-886d-28ce34d1dfc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:52.479825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f50963-7268-4913-886d-28ce34d1dfc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:52.481471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f50963-7268-4913-886d-28ce34d1dfc8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:52.492469 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2613/5233] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:52.496959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77b379-f85a-44cd-924f-4b4b8e6e984d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:52.509346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77b379-f85a-44cd-924f-4b4b8e6e984d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:52.514231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85aa1f-d3e3-4c45-94fc-123c5ff26881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:52.515149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85aa1f-d3e3-4c45-94fc-123c5ff26881 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:52.515529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85aa1f-d3e3-4c45-94fc-123c5ff26881 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:52.515815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85aa1f-d3e3-4c45-94fc-123c5ff26881 admin admin] PATH_INFO: `/v3/projects/6b83d213615e457ea1227d42de194a07/users/72a1037e8fe94701be9a7f94342f6a93/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:52.535984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85aa1f-d3e3-4c45-94fc-123c5ff26881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b83d213615e457ea1227d42de194a07, user_id=72a1037e8fe94701be9a7f94342f6a93, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:52.535984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85aa1f-d3e3-4c45-94fc-123c5ff26881 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:52.600112 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2621/5234] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:37:52 2022] PUT /identity/v3/projects/6b83d213615e457ea1227d42de194a07/users/72a1037e8fe94701be9a7f94342f6a93/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:52.603546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f50963-7268-4913-886d-28ce34d1dfc8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:52.615348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f50963-7268-4913-886d-28ce34d1dfc8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:52.673033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496582f-00c0-4032-8db7-c7aea6aaeb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:52.673716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496582f-00c0-4032-8db7-c7aea6aaeb6f admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:52.674034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496582f-00c0-4032-8db7-c7aea6aaeb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:52.678031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496582f-00c0-4032-8db7-c7aea6aaeb6f admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:52.678031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496582f-00c0-4032-8db7-c7aea6aaeb6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:52.678031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496582f-00c0-4032-8db7-c7aea6aaeb6f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:52.687544 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2614/5235] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:52.691701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85aa1f-d3e3-4c45-94fc-123c5ff26881 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:52.701995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85aa1f-d3e3-4c45-94fc-123c5ff26881 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:52.707777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5586076-1a63-4296-a66f-0b5cccaf1b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:52.708732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5586076-1a63-4296-a66f-0b5cccaf1b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:52.714799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5586076-1a63-4296-a66f-0b5cccaf1b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:52.714799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5586076-1a63-4296-a66f-0b5cccaf1b2c admin admin] PATH_INFO: `/v3/projects/6b83d213615e457ea1227d42de194a07/users/72a1037e8fe94701be9a7f94342f6a93/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:52.714799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5586076-1a63-4296-a66f-0b5cccaf1b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b83d213615e457ea1227d42de194a07, user_id=72a1037e8fe94701be9a7f94342f6a93, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:52.714799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5586076-1a63-4296-a66f-0b5cccaf1b2c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:52.725495 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2622/5236] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:37:52 2022] PUT /identity/v3/projects/6b83d213615e457ea1227d42de194a07/users/72a1037e8fe94701be9a7f94342f6a93/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:52.736754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ce018-bd86-44ab-893f-fcc767882330 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:52.737186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ce018-bd86-44ab-893f-fcc767882330 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:52.741225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ce018-bd86-44ab-893f-fcc767882330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:52.768493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-344ce018-bd86-44ab-893f-fcc767882330 None None] MFA Rules not processed for user `72a1037e8fe94701be9a7f94342f6a93`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:52.769949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-344ce018-bd86-44ab-893f-fcc767882330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:52.837991 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2615/5237] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:52 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:52.843181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5586076-1a63-4296-a66f-0b5cccaf1b2c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:52.853794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5586076-1a63-4296-a66f-0b5cccaf1b2c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:52.859003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec95508-adcd-4c3d-898a-7fd00ee11440 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72a1037e8fe94701be9a7f94342f6a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b83d213615e457ea1227d42de194a07', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:52.861648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec95508-adcd-4c3d-898a-7fd00ee11440 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:52.861648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec95508-adcd-4c3d-898a-7fd00ee11440 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:52.861648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec95508-adcd-4c3d-898a-7fd00ee11440 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:52.861648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec95508-adcd-4c3d-898a-7fd00ee11440 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:37:52.861648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec95508-adcd-4c3d-898a-7fd00ee11440 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:52.862886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec95508-adcd-4c3d-898a-7fd00ee11440 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:52.876070 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2623/5238] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:37:52.880751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ce018-bd86-44ab-893f-fcc767882330 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:52.895108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ce018-bd86-44ab-893f-fcc767882330 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:52.897810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c51603-568c-4dbe-a650-9c92faa117f7 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72a1037e8fe94701be9a7f94342f6a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b83d213615e457ea1227d42de194a07', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:52.898467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c51603-568c-4dbe-a650-9c92faa117f7 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:52.898748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c51603-568c-4dbe-a650-9c92faa117f7 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:52.899027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c51603-568c-4dbe-a650-9c92faa117f7 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:52.899722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c51603-568c-4dbe-a650-9c92faa117f7 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:52.901837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c51603-568c-4dbe-a650-9c92faa117f7 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:53.019015 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2616/5239] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:37:52 2022] POST /identity/v3/projects => generated 349 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:37:53.023426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec95508-adcd-4c3d-898a-7fd00ee11440 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:53.034387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec95508-adcd-4c3d-898a-7fd00ee11440 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:53.088255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffba6c-4ae5-40d4-b2e3-0963aea163e6 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72a1037e8fe94701be9a7f94342f6a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b83d213615e457ea1227d42de194a07', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:53.088848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffba6c-4ae5-40d4-b2e3-0963aea163e6 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:53.089138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffba6c-4ae5-40d4-b2e3-0963aea163e6 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:53.089424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffba6c-4ae5-40d4-b2e3-0963aea163e6 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:53.090152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffba6c-4ae5-40d4-b2e3-0963aea163e6 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:37:53.090467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffba6c-4ae5-40d4-b2e3-0963aea163e6 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:53.092545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffba6c-4ae5-40d4-b2e3-0963aea163e6 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:53.109637 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2624/5240] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:37:53.116037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c51603-568c-4dbe-a650-9c92faa117f7 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:53.118149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-41c51603-568c-4dbe-a650-9c92faa117f7 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:53.174912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c51603-568c-4dbe-a650-9c92faa117f7 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:53.178689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c14bf-1967-4b49-92f6-844244bdfbae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:53.179365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c14bf-1967-4b49-92f6-844244bdfbae service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:53.179654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c14bf-1967-4b49-92f6-844244bdfbae service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:53.179933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c14bf-1967-4b49-92f6-844244bdfbae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:53.189056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c14bf-1967-4b49-92f6-844244bdfbae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:53.190537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c14bf-1967-4b49-92f6-844244bdfbae service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:53.199895 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2617/5241] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:53 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:37:53.590593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffba6c-4ae5-40d4-b2e3-0963aea163e6 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:53.601952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffba6c-4ae5-40d4-b2e3-0963aea163e6 tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:53.606506 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621a5d6-64b1-4fb8-b23e-e913c4a4aa2b tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72a1037e8fe94701be9a7f94342f6a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b83d213615e457ea1227d42de194a07', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:53.607338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621a5d6-64b1-4fb8-b23e-e913c4a4aa2b tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:53.607637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621a5d6-64b1-4fb8-b23e-e913c4a4aa2b tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:53.607882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621a5d6-64b1-4fb8-b23e-e913c4a4aa2b tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] PATH_INFO: `/v3/projects/68be0c9b455f42389f3d986039c80f3c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:53.610132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621a5d6-64b1-4fb8-b23e-e913c4a4aa2b tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] RBAC: Authorizing `identity:delete_project(project_id=68be0c9b455f42389f3d986039c80f3c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:53.611065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621a5d6-64b1-4fb8-b23e-e913c4a4aa2b tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:53.739685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e621a5d6-64b1-4fb8-b23e-e913c4a4aa2b tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68be0c9b455f42389f3d986039c80f3c', 'request_id': 'req-e621a5d6-64b1-4fb8-b23e-e913c4a4aa2b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:53.898612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e621a5d6-64b1-4fb8-b23e-e913c4a4aa2b tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68be0c9b455f42389f3d986039c80f3c', 'request_id': 'req-e621a5d6-64b1-4fb8-b23e-e913c4a4aa2b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:53.915038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e621a5d6-64b1-4fb8-b23e-e913c4a4aa2b tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68be0c9b455f42389f3d986039c80f3c', 'request_id': 'req-e621a5d6-64b1-4fb8-b23e-e913c4a4aa2b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:53.921717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e621a5d6-64b1-4fb8-b23e-e913c4a4aa2b tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] The token cache is being invalidate because project 68be0c9b455f42389f3d986039c80f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:37:53.921878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e621a5d6-64b1-4fb8-b23e-e913c4a4aa2b tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:53.922587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e621a5d6-64b1-4fb8-b23e-e913c4a4aa2b tempest-QuotasTest-420333371 tempest-QuotasTest-420333371-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:53.924162 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2625/5242] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:37:53 2022] DELETE /identity/v3/projects/68be0c9b455f42389f3d986039c80f3c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:54.046241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c14bf-1967-4b49-92f6-844244bdfbae service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:54.105988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c14bf-1967-4b49-92f6-844244bdfbae service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:54.182374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbb950-1b66-4a6f-a5e3-7fa9ddb1d740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:54.182374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbb950-1b66-4a6f-a5e3-7fa9ddb1d740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:54.182374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbb950-1b66-4a6f-a5e3-7fa9ddb1d740 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:54.182374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbb950-1b66-4a6f-a5e3-7fa9ddb1d740 admin admin] PATH_INFO: `/v3/users/4d970a77dd5a4b6fa79c63576b1204c1` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:54.182817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbb950-1b66-4a6f-a5e3-7fa9ddb1d740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d970a77dd5a4b6fa79c63576b1204c1)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:54.182817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbb950-1b66-4a6f-a5e3-7fa9ddb1d740 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:54.380256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6cbb950-1b66-4a6f-a5e3-7fa9ddb1d740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d970a77dd5a4b6fa79c63576b1204c1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:54.393121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6cbb950-1b66-4a6f-a5e3-7fa9ddb1d740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d970a77dd5a4b6fa79c63576b1204c1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:54.393763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6cbb950-1b66-4a6f-a5e3-7fa9ddb1d740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d970a77dd5a4b6fa79c63576b1204c1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:54.400455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6cbb950-1b66-4a6f-a5e3-7fa9ddb1d740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d970a77dd5a4b6fa79c63576b1204c1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:54.474417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6cbb950-1b66-4a6f-a5e3-7fa9ddb1d740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d970a77dd5a4b6fa79c63576b1204c1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:54.480710 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2618/5243] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:37:54 2022] DELETE /identity/v3/users/4d970a77dd5a4b6fa79c63576b1204c1 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:54.485993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01557ed-c5b5-4dd4-9b95-ed9d83018b6f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:54.494034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01557ed-c5b5-4dd4-9b95-ed9d83018b6f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:54.494034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01557ed-c5b5-4dd4-9b95-ed9d83018b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:54.503753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b01557ed-c5b5-4dd4-9b95-ed9d83018b6f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:54.504999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b01557ed-c5b5-4dd4-9b95-ed9d83018b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:54.563845 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2626/5244] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:54.573459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbb950-1b66-4a6f-a5e3-7fa9ddb1d740 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:54.574863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d6cbb950-1b66-4a6f-a5e3-7fa9ddb1d740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:54.633777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbb950-1b66-4a6f-a5e3-7fa9ddb1d740 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:54.637426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8165a-0ec4-42ad-a973-40f4cf9bc19d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:54.638138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8165a-0ec4-42ad-a973-40f4cf9bc19d service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:54.638427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8165a-0ec4-42ad-a973-40f4cf9bc19d service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:54.638706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8165a-0ec4-42ad-a973-40f4cf9bc19d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:54.648309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8165a-0ec4-42ad-a973-40f4cf9bc19d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:54.649801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8165a-0ec4-42ad-a973-40f4cf9bc19d service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:54.660241 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2619/5245] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:37:55.213096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01557ed-c5b5-4dd4-9b95-ed9d83018b6f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:55.214566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b01557ed-c5b5-4dd4-9b95-ed9d83018b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:55.229770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01557ed-c5b5-4dd4-9b95-ed9d83018b6f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:55.235394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d58531-4e6b-4968-bf77-1db887f8ece9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:55.236997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d58531-4e6b-4968-bf77-1db887f8ece9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:55.237640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d58531-4e6b-4968-bf77-1db887f8ece9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:55.237928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d58531-4e6b-4968-bf77-1db887f8ece9 admin admin] PATH_INFO: `/v3/projects/fca53900a5944d5a8378dce270860348` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:55.239623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d58531-4e6b-4968-bf77-1db887f8ece9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fca53900a5944d5a8378dce270860348)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:55.244246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d58531-4e6b-4968-bf77-1db887f8ece9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:55.373331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-05d58531-4e6b-4968-bf77-1db887f8ece9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fca53900a5944d5a8378dce270860348', 'request_id': 'req-05d58531-4e6b-4968-bf77-1db887f8ece9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:55.438550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-05d58531-4e6b-4968-bf77-1db887f8ece9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fca53900a5944d5a8378dce270860348', 'request_id': 'req-05d58531-4e6b-4968-bf77-1db887f8ece9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:55.445105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-05d58531-4e6b-4968-bf77-1db887f8ece9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fca53900a5944d5a8378dce270860348', 'request_id': 'req-05d58531-4e6b-4968-bf77-1db887f8ece9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:55.455286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-05d58531-4e6b-4968-bf77-1db887f8ece9 admin admin] The token cache is being invalidate because project fca53900a5944d5a8378dce270860348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:37:55.455577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-05d58531-4e6b-4968-bf77-1db887f8ece9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:55.456202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-05d58531-4e6b-4968-bf77-1db887f8ece9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:55.457772 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2627/5246] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:37:55 2022] DELETE /identity/v3/projects/fca53900a5944d5a8378dce270860348 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:55.461944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8165a-0ec4-42ad-a973-40f4cf9bc19d service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:55.472083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8165a-0ec4-42ad-a973-40f4cf9bc19d service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:55.527572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e196f7-5481-465d-ba92-7e9ecb03570a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:55.529110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e196f7-5481-465d-ba92-7e9ecb03570a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:55.529395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e196f7-5481-465d-ba92-7e9ecb03570a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:55.529672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e196f7-5481-465d-ba92-7e9ecb03570a admin admin] PATH_INFO: `/v3/users/72a1037e8fe94701be9a7f94342f6a93` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:55.530910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e196f7-5481-465d-ba92-7e9ecb03570a admin admin] RBAC: Authorizing `identity:delete_user(user_id=72a1037e8fe94701be9a7f94342f6a93)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:55.532878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e196f7-5481-465d-ba92-7e9ecb03570a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:55.705163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-07e196f7-5481-465d-ba92-7e9ecb03570a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72a1037e8fe94701be9a7f94342f6a93'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:55.717749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-07e196f7-5481-465d-ba92-7e9ecb03570a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72a1037e8fe94701be9a7f94342f6a93'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:55.718474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-07e196f7-5481-465d-ba92-7e9ecb03570a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72a1037e8fe94701be9a7f94342f6a93'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:55.725287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-07e196f7-5481-465d-ba92-7e9ecb03570a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72a1037e8fe94701be9a7f94342f6a93'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:55.805529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-07e196f7-5481-465d-ba92-7e9ecb03570a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72a1037e8fe94701be9a7f94342f6a93'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:55.812340 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2620/5247] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:37:55 2022] DELETE /identity/v3/users/72a1037e8fe94701be9a7f94342f6a93 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:56.299821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d58531-4e6b-4968-bf77-1db887f8ece9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:56.301370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-05d58531-4e6b-4968-bf77-1db887f8ece9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:56.316926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d58531-4e6b-4968-bf77-1db887f8ece9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:56.374100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836d232-2b46-4885-9060-9a8cf017476e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:56.374969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836d232-2b46-4885-9060-9a8cf017476e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:56.375256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836d232-2b46-4885-9060-9a8cf017476e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:56.375530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836d232-2b46-4885-9060-9a8cf017476e admin admin] PATH_INFO: `/v3/projects/6b83d213615e457ea1227d42de194a07` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:56.377059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836d232-2b46-4885-9060-9a8cf017476e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b83d213615e457ea1227d42de194a07)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:56.378955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836d232-2b46-4885-9060-9a8cf017476e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:56.515628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0836d232-2b46-4885-9060-9a8cf017476e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b83d213615e457ea1227d42de194a07', 'request_id': 'req-0836d232-2b46-4885-9060-9a8cf017476e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:56.618908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0836d232-2b46-4885-9060-9a8cf017476e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b83d213615e457ea1227d42de194a07', 'request_id': 'req-0836d232-2b46-4885-9060-9a8cf017476e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:56.627184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0836d232-2b46-4885-9060-9a8cf017476e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b83d213615e457ea1227d42de194a07', 'request_id': 'req-0836d232-2b46-4885-9060-9a8cf017476e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:56.638503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0836d232-2b46-4885-9060-9a8cf017476e admin admin] The token cache is being invalidate because project 6b83d213615e457ea1227d42de194a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:37:56.638798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0836d232-2b46-4885-9060-9a8cf017476e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:56.639482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0836d232-2b46-4885-9060-9a8cf017476e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:56.641414 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2628/5248] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:37:56 2022] DELETE /identity/v3/projects/6b83d213615e457ea1227d42de194a07 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:37:56.647419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbae37-3388-4319-b37b-3d8f52e2e3c0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:56.648237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbae37-3388-4319-b37b-3d8f52e2e3c0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:56.648519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbae37-3388-4319-b37b-3d8f52e2e3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:56.666861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b0cbae37-3388-4319-b37b-3d8f52e2e3c0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:56.668060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b0cbae37-3388-4319-b37b-3d8f52e2e3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:56.726428 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2621/5249] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:56.735222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b88b40-3b5e-4ebc-a8fc-319cb560c4d9 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:56.735512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b88b40-3b5e-4ebc-a8fc-319cb560c4d9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:56.735793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b88b40-3b5e-4ebc-a8fc-319cb560c4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:56.753809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b2b88b40-3b5e-4ebc-a8fc-319cb560c4d9 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:56.754998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b2b88b40-3b5e-4ebc-a8fc-319cb560c4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:56.762859 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2629/5250] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:56.767052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbae37-3388-4319-b37b-3d8f52e2e3c0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:56.777095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbae37-3388-4319-b37b-3d8f52e2e3c0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:56.782278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebf3ae-041e-4477-8beb-4317923bb360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:56.782935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebf3ae-041e-4477-8beb-4317923bb360 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:56.783216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebf3ae-041e-4477-8beb-4317923bb360 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:56.783491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebf3ae-041e-4477-8beb-4317923bb360 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:56.784208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebf3ae-041e-4477-8beb-4317923bb360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:37:56.784514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebf3ae-041e-4477-8beb-4317923bb360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:56.786142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebf3ae-041e-4477-8beb-4317923bb360 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:56.802218 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2622/5251] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:37:56.803027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b88b40-3b5e-4ebc-a8fc-319cb560c4d9 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:56.813430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b88b40-3b5e-4ebc-a8fc-319cb560c4d9 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:56.819048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412ac6b-8c9b-4b2a-a4e9-409af6c66662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:56.819745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412ac6b-8c9b-4b2a-a4e9-409af6c66662 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:56.820034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412ac6b-8c9b-4b2a-a4e9-409af6c66662 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:56.820309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412ac6b-8c9b-4b2a-a4e9-409af6c66662 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:56.821047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412ac6b-8c9b-4b2a-a4e9-409af6c66662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:56.823045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412ac6b-8c9b-4b2a-a4e9-409af6c66662 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:56.898787 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2630/5252] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:37:56 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:37:56.902792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebf3ae-041e-4477-8beb-4317923bb360 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:56.914031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebf3ae-041e-4477-8beb-4317923bb360 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:56.969683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b12661-5eff-4c18-a49a-49ef14c4e936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:56.970762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b12661-5eff-4c18-a49a-49ef14c4e936 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:56.971021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b12661-5eff-4c18-a49a-49ef14c4e936 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:56.971305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b12661-5eff-4c18-a49a-49ef14c4e936 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:56.972032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b12661-5eff-4c18-a49a-49ef14c4e936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:56.973994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b12661-5eff-4c18-a49a-49ef14c4e936 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:57.040879 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2623/5253] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:37:56 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:37:57.045028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412ac6b-8c9b-4b2a-a4e9-409af6c66662 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:57.056206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412ac6b-8c9b-4b2a-a4e9-409af6c66662 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:57.060974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d769a56-4437-4f21-a8aa-f4c03095c77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:57.061646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d769a56-4437-4f21-a8aa-f4c03095c77a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:57.062648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d769a56-4437-4f21-a8aa-f4c03095c77a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:57.062927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d769a56-4437-4f21-a8aa-f4c03095c77a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:57.063664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d769a56-4437-4f21-a8aa-f4c03095c77a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:57.065329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d769a56-4437-4f21-a8aa-f4c03095c77a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:57.076811 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2631/5254] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:57.080988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b12661-5eff-4c18-a49a-49ef14c4e936 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:57.091481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b12661-5eff-4c18-a49a-49ef14c4e936 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:57.096351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32a640-65ca-4db6-944b-62ad5cf847d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:57.097066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32a640-65ca-4db6-944b-62ad5cf847d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:57.097339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32a640-65ca-4db6-944b-62ad5cf847d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:57.097685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32a640-65ca-4db6-944b-62ad5cf847d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:57.098427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32a640-65ca-4db6-944b-62ad5cf847d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:57.100004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32a640-65ca-4db6-944b-62ad5cf847d8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:57.115605 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2624/5255] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:57.119833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d769a56-4437-4f21-a8aa-f4c03095c77a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:57.130063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d769a56-4437-4f21-a8aa-f4c03095c77a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:57.134849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada97aa-2449-4913-9c6c-248e19e4ed20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:57.135729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada97aa-2449-4913-9c6c-248e19e4ed20 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:57.136012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada97aa-2449-4913-9c6c-248e19e4ed20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:57.136287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada97aa-2449-4913-9c6c-248e19e4ed20 admin admin] PATH_INFO: `/v3/projects/bb850d4d6d4e4aaaa1770711f0f47564/users/0002b2ad28cb4be98a964ee5ebeb036d/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:57.151596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada97aa-2449-4913-9c6c-248e19e4ed20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb850d4d6d4e4aaaa1770711f0f47564, user_id=0002b2ad28cb4be98a964ee5ebeb036d, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:57.155732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada97aa-2449-4913-9c6c-248e19e4ed20 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:57.269299 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2632/5256] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:37:57 2022] PUT /identity/v3/projects/bb850d4d6d4e4aaaa1770711f0f47564/users/0002b2ad28cb4be98a964ee5ebeb036d/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:57.282082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c95c0-307f-47de-940f-ab1ace0083a7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:57.282369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c95c0-307f-47de-940f-ab1ace0083a7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:57.282645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c95c0-307f-47de-940f-ab1ace0083a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:57.309248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ec8c95c0-307f-47de-940f-ab1ace0083a7 None None] MFA Rules not processed for user `0002b2ad28cb4be98a964ee5ebeb036d`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:57.310428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ec8c95c0-307f-47de-940f-ab1ace0083a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:57.379431 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2625/5257] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:57.383620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada97aa-2449-4913-9c6c-248e19e4ed20 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:57.445319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada97aa-2449-4913-9c6c-248e19e4ed20 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:57.450801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9da1d-7cdf-46d4-9f8a-08f52705cfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:57.451511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9da1d-7cdf-46d4-9f8a-08f52705cfa3 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:57.451799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9da1d-7cdf-46d4-9f8a-08f52705cfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:57.452078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9da1d-7cdf-46d4-9f8a-08f52705cfa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:57.452798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9da1d-7cdf-46d4-9f8a-08f52705cfa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:57.454697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9da1d-7cdf-46d4-9f8a-08f52705cfa3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:57.562381 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2633/5258] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:37:57 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:37:57.566416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c95c0-307f-47de-940f-ab1ace0083a7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:57.577598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c95c0-307f-47de-940f-ab1ace0083a7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:57.631103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99f2b1-68f8-4358-981b-5cbf9cfdf92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:57.631820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99f2b1-68f8-4358-981b-5cbf9cfdf92e admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:57.632107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99f2b1-68f8-4358-981b-5cbf9cfdf92e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:57.632390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99f2b1-68f8-4358-981b-5cbf9cfdf92e admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:57.633162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec99f2b1-68f8-4358-981b-5cbf9cfdf92e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:57.635155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec99f2b1-68f8-4358-981b-5cbf9cfdf92e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:57.709544 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2626/5259] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:37:57 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:37:57.713536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9da1d-7cdf-46d4-9f8a-08f52705cfa3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:57.724677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9da1d-7cdf-46d4-9f8a-08f52705cfa3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:57.729299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937501a-7a37-4911-8767-a0fc8dfe6895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:57.729969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937501a-7a37-4911-8767-a0fc8dfe6895 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:57.730253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937501a-7a37-4911-8767-a0fc8dfe6895 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:57.730573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937501a-7a37-4911-8767-a0fc8dfe6895 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:57.731879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937501a-7a37-4911-8767-a0fc8dfe6895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:57.733539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937501a-7a37-4911-8767-a0fc8dfe6895 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:57.743707 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2634/5260] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:57.748636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99f2b1-68f8-4358-981b-5cbf9cfdf92e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:57.759112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99f2b1-68f8-4358-981b-5cbf9cfdf92e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:57.763753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738c689-76f8-40ee-9727-fa0a48dc63b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:57.764666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738c689-76f8-40ee-9727-fa0a48dc63b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:57.764955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738c689-76f8-40ee-9727-fa0a48dc63b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:57.765241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738c689-76f8-40ee-9727-fa0a48dc63b8 admin admin] PATH_INFO: `/v3/projects/b1a10e8dda3c4a9fa1d4bf00147daafe/users/d7412c3f8680425298656c66656c5bb0/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:57.781602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738c689-76f8-40ee-9727-fa0a48dc63b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1a10e8dda3c4a9fa1d4bf00147daafe, user_id=d7412c3f8680425298656c66656c5bb0, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:57.786784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738c689-76f8-40ee-9727-fa0a48dc63b8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:58.064038 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2627/5261] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:37:57 2022] PUT /identity/v3/projects/b1a10e8dda3c4a9fa1d4bf00147daafe/users/d7412c3f8680425298656c66656c5bb0/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:37:58.068064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937501a-7a37-4911-8767-a0fc8dfe6895 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:58.078061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937501a-7a37-4911-8767-a0fc8dfe6895 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:58.140621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d38e4-9cf5-4edc-8af7-b6b64344f974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:58.141318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d38e4-9cf5-4edc-8af7-b6b64344f974 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:58.141603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d38e4-9cf5-4edc-8af7-b6b64344f974 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:58.141883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d38e4-9cf5-4edc-8af7-b6b64344f974 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:58.142617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d38e4-9cf5-4edc-8af7-b6b64344f974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:58.144224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d38e4-9cf5-4edc-8af7-b6b64344f974 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:58.154757 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2635/5262] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:37:58.159013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738c689-76f8-40ee-9727-fa0a48dc63b8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:58.169915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738c689-76f8-40ee-9727-fa0a48dc63b8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:58.174760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2d392-e1cf-475e-97fa-cba18bea297f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:58.176093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2d392-e1cf-475e-97fa-cba18bea297f admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:58.176480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2d392-e1cf-475e-97fa-cba18bea297f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:58.176906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2d392-e1cf-475e-97fa-cba18bea297f admin admin] PATH_INFO: `/v3/projects/b1a10e8dda3c4a9fa1d4bf00147daafe/users/d7412c3f8680425298656c66656c5bb0/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:58.179614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2d392-e1cf-475e-97fa-cba18bea297f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1a10e8dda3c4a9fa1d4bf00147daafe, user_id=d7412c3f8680425298656c66656c5bb0, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:58.183412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2d392-e1cf-475e-97fa-cba18bea297f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:58.194710 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2628/5263] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:37:58 2022] PUT /identity/v3/projects/b1a10e8dda3c4a9fa1d4bf00147daafe/users/d7412c3f8680425298656c66656c5bb0/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:58.204629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905930fb-b417-4283-949f-ff387aa49a37 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:58.204930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905930fb-b417-4283-949f-ff387aa49a37 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:58.205215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905930fb-b417-4283-949f-ff387aa49a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:58.233873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-905930fb-b417-4283-949f-ff387aa49a37 None None] MFA Rules not processed for user `d7412c3f8680425298656c66656c5bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:58.235123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-905930fb-b417-4283-949f-ff387aa49a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:58.305564 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2636/5264] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:37:58.322766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2d392-e1cf-475e-97fa-cba18bea297f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:58.324481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bca2d392-e1cf-475e-97fa-cba18bea297f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:58.387675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2d392-e1cf-475e-97fa-cba18bea297f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:58.391420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958366b-36fc-43a5-870d-437843008101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:58.392356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958366b-36fc-43a5-870d-437843008101 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:58.392679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958366b-36fc-43a5-870d-437843008101 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:58.392993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958366b-36fc-43a5-870d-437843008101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:58.405685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958366b-36fc-43a5-870d-437843008101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:58.407151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958366b-36fc-43a5-870d-437843008101 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:58.417485 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2629/5265] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:37:58.945206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905930fb-b417-4283-949f-ff387aa49a37 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:58.946681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-905930fb-b417-4283-949f-ff387aa49a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:59.023501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905930fb-b417-4283-949f-ff387aa49a37 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:59.028106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742042b-10e1-4183-a8e6-50060716b248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:59.029032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742042b-10e1-4183-a8e6-50060716b248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:59.029318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742042b-10e1-4183-a8e6-50060716b248 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:59.029600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742042b-10e1-4183-a8e6-50060716b248 admin admin] PATH_INFO: `/v3/users/0d746eb0b3b248a48fde2b7df0d8c9bc` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:59.030826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742042b-10e1-4183-a8e6-50060716b248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d746eb0b3b248a48fde2b7df0d8c9bc)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:59.032908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742042b-10e1-4183-a8e6-50060716b248 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:59.358861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0742042b-10e1-4183-a8e6-50060716b248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d746eb0b3b248a48fde2b7df0d8c9bc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:59.373557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0742042b-10e1-4183-a8e6-50060716b248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d746eb0b3b248a48fde2b7df0d8c9bc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:59.374404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0742042b-10e1-4183-a8e6-50060716b248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d746eb0b3b248a48fde2b7df0d8c9bc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:59.387267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0742042b-10e1-4183-a8e6-50060716b248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d746eb0b3b248a48fde2b7df0d8c9bc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:59.469028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0742042b-10e1-4183-a8e6-50060716b248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d746eb0b3b248a48fde2b7df0d8c9bc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:37:59.481709 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2637/5266] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:37:58 2022] DELETE /identity/v3/users/0d746eb0b3b248a48fde2b7df0d8c9bc => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:37:59.486297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cc3ef-0703-438d-9800-e2212996d9da None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:59.486847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cc3ef-0703-438d-9800-e2212996d9da None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:59.486993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cc3ef-0703-438d-9800-e2212996d9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:59.506374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-156cc3ef-0703-438d-9800-e2212996d9da None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:37:59.507570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-156cc3ef-0703-438d-9800-e2212996d9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:59.568446 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2630/5267] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:37:59.582336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742042b-10e1-4183-a8e6-50060716b248 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:37:59.584072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0742042b-10e1-4183-a8e6-50060716b248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:37:59.673638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742042b-10e1-4183-a8e6-50060716b248 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:37:59.679689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd499b9f-97c9-481d-98ef-92affd0935ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:37:59.684348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd499b9f-97c9-481d-98ef-92affd0935ca service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:37:59.684348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd499b9f-97c9-481d-98ef-92affd0935ca service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:37:59.684348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd499b9f-97c9-481d-98ef-92affd0935ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:37:59.692513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd499b9f-97c9-481d-98ef-92affd0935ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:37:59.694130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd499b9f-97c9-481d-98ef-92affd0935ca service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:37:59.706330 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2638/5268] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:38:00.260384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cc3ef-0703-438d-9800-e2212996d9da None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:00.260384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-156cc3ef-0703-438d-9800-e2212996d9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:00.270531 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cc3ef-0703-438d-9800-e2212996d9da None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:00.275347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7679926-2357-46c5-aab4-3e96d8f6fab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:00.276471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7679926-2357-46c5-aab4-3e96d8f6fab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:00.276809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7679926-2357-46c5-aab4-3e96d8f6fab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:00.277279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7679926-2357-46c5-aab4-3e96d8f6fab3 admin admin] PATH_INFO: `/v3/projects/c0a41b924ad64c92920208d7b63a8910` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:00.279281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7679926-2357-46c5-aab4-3e96d8f6fab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0a41b924ad64c92920208d7b63a8910)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:00.281457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7679926-2357-46c5-aab4-3e96d8f6fab3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:00.432355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f7679926-2357-46c5-aab4-3e96d8f6fab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0a41b924ad64c92920208d7b63a8910', 'request_id': 'req-f7679926-2357-46c5-aab4-3e96d8f6fab3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:00.443555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f7679926-2357-46c5-aab4-3e96d8f6fab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0a41b924ad64c92920208d7b63a8910', 'request_id': 'req-f7679926-2357-46c5-aab4-3e96d8f6fab3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:00.548897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f7679926-2357-46c5-aab4-3e96d8f6fab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0a41b924ad64c92920208d7b63a8910', 'request_id': 'req-f7679926-2357-46c5-aab4-3e96d8f6fab3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:00.560460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f7679926-2357-46c5-aab4-3e96d8f6fab3 admin admin] The token cache is being invalidate because project c0a41b924ad64c92920208d7b63a8910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:00.560787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f7679926-2357-46c5-aab4-3e96d8f6fab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:00.561440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f7679926-2357-46c5-aab4-3e96d8f6fab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:00.562993 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2631/5269] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:00 2022] DELETE /identity/v3/projects/c0a41b924ad64c92920208d7b63a8910 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:00.566920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd499b9f-97c9-481d-98ef-92affd0935ca service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:00.577111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd499b9f-97c9-481d-98ef-92affd0935ca service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:00.640574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96a2ad-072d-40ae-b1bd-42d016837c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:00.641475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96a2ad-072d-40ae-b1bd-42d016837c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:00.641759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96a2ad-072d-40ae-b1bd-42d016837c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:00.642090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96a2ad-072d-40ae-b1bd-42d016837c82 admin admin] PATH_INFO: `/v3/users/562fd54dba7a461e861b7f890a883714` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:00.643236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96a2ad-072d-40ae-b1bd-42d016837c82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=562fd54dba7a461e861b7f890a883714)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:00.645309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96a2ad-072d-40ae-b1bd-42d016837c82 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:00.915008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-df96a2ad-072d-40ae-b1bd-42d016837c82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '562fd54dba7a461e861b7f890a883714'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:00.928057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-df96a2ad-072d-40ae-b1bd-42d016837c82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '562fd54dba7a461e861b7f890a883714'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:00.928827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-df96a2ad-072d-40ae-b1bd-42d016837c82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '562fd54dba7a461e861b7f890a883714'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:00.936181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-df96a2ad-072d-40ae-b1bd-42d016837c82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '562fd54dba7a461e861b7f890a883714'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:01.056055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-df96a2ad-072d-40ae-b1bd-42d016837c82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '562fd54dba7a461e861b7f890a883714'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:01.064746 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2639/5270] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:00 2022] DELETE /identity/v3/users/562fd54dba7a461e861b7f890a883714 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:01.780123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7679926-2357-46c5-aab4-3e96d8f6fab3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:01.781645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f7679926-2357-46c5-aab4-3e96d8f6fab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:01.795302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7679926-2357-46c5-aab4-3e96d8f6fab3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:01.864327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7f183-cf79-4443-b8aa-72e31283c182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:01.865264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7f183-cf79-4443-b8aa-72e31283c182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:01.865552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7f183-cf79-4443-b8aa-72e31283c182 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:01.865846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7f183-cf79-4443-b8aa-72e31283c182 admin admin] PATH_INFO: `/v3/projects/c6ea813396404385a00ac239ef5360e6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:01.867084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7f183-cf79-4443-b8aa-72e31283c182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6ea813396404385a00ac239ef5360e6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:01.869057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7f183-cf79-4443-b8aa-72e31283c182 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:01.971512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1da7f183-cf79-4443-b8aa-72e31283c182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6ea813396404385a00ac239ef5360e6', 'request_id': 'req-1da7f183-cf79-4443-b8aa-72e31283c182'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:01.977954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1da7f183-cf79-4443-b8aa-72e31283c182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6ea813396404385a00ac239ef5360e6', 'request_id': 'req-1da7f183-cf79-4443-b8aa-72e31283c182'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:02.063208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1da7f183-cf79-4443-b8aa-72e31283c182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6ea813396404385a00ac239ef5360e6', 'request_id': 'req-1da7f183-cf79-4443-b8aa-72e31283c182'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:02.077284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1da7f183-cf79-4443-b8aa-72e31283c182 admin admin] The token cache is being invalidate because project c6ea813396404385a00ac239ef5360e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:02.077864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1da7f183-cf79-4443-b8aa-72e31283c182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:02.078913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1da7f183-cf79-4443-b8aa-72e31283c182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:02.081562 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2632/5271] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:01 2022] DELETE /identity/v3/projects/c6ea813396404385a00ac239ef5360e6 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:02.090893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96a2ad-072d-40ae-b1bd-42d016837c82 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:02.090893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-df96a2ad-072d-40ae-b1bd-42d016837c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:02.102477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96a2ad-072d-40ae-b1bd-42d016837c82 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:02.158746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da3f1e-5dbb-41e6-9e56-92a1a500b8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:02.160459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da3f1e-5dbb-41e6-9e56-92a1a500b8ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:02.160945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da3f1e-5dbb-41e6-9e56-92a1a500b8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:02.161404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da3f1e-5dbb-41e6-9e56-92a1a500b8ab admin admin] PATH_INFO: `/v3/users/e9ca159facc94c258f05904c3246089a` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:02.162794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da3f1e-5dbb-41e6-9e56-92a1a500b8ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ca159facc94c258f05904c3246089a)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:02.165002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da3f1e-5dbb-41e6-9e56-92a1a500b8ab admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:02.456305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-92da3f1e-5dbb-41e6-9e56-92a1a500b8ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ca159facc94c258f05904c3246089a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:02.477198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-92da3f1e-5dbb-41e6-9e56-92a1a500b8ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ca159facc94c258f05904c3246089a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:02.477955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-92da3f1e-5dbb-41e6-9e56-92a1a500b8ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ca159facc94c258f05904c3246089a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:02.485429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-92da3f1e-5dbb-41e6-9e56-92a1a500b8ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ca159facc94c258f05904c3246089a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:02.560877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-92da3f1e-5dbb-41e6-9e56-92a1a500b8ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ca159facc94c258f05904c3246089a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:02.569363 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2640/5272] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:02 2022] DELETE /identity/v3/users/e9ca159facc94c258f05904c3246089a => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:03.002923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7f183-cf79-4443-b8aa-72e31283c182 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:03.004833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1da7f183-cf79-4443-b8aa-72e31283c182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:03.034666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7f183-cf79-4443-b8aa-72e31283c182 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:03.084695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ace798-dddc-42b4-850c-6243aaf47e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:03.085514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ace798-dddc-42b4-850c-6243aaf47e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:03.085797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ace798-dddc-42b4-850c-6243aaf47e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:03.086126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ace798-dddc-42b4-850c-6243aaf47e8b admin admin] PATH_INFO: `/v3/projects/2530663ea9664bf2812d1cecc8d8f4e6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:03.087306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ace798-dddc-42b4-850c-6243aaf47e8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2530663ea9664bf2812d1cecc8d8f4e6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:03.089303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ace798-dddc-42b4-850c-6243aaf47e8b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:03.176908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-08ace798-dddc-42b4-850c-6243aaf47e8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2530663ea9664bf2812d1cecc8d8f4e6', 'request_id': 'req-08ace798-dddc-42b4-850c-6243aaf47e8b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:03.182880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-08ace798-dddc-42b4-850c-6243aaf47e8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2530663ea9664bf2812d1cecc8d8f4e6', 'request_id': 'req-08ace798-dddc-42b4-850c-6243aaf47e8b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:03.257155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-08ace798-dddc-42b4-850c-6243aaf47e8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2530663ea9664bf2812d1cecc8d8f4e6', 'request_id': 'req-08ace798-dddc-42b4-850c-6243aaf47e8b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:03.268651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-08ace798-dddc-42b4-850c-6243aaf47e8b admin admin] The token cache is being invalidate because project 2530663ea9664bf2812d1cecc8d8f4e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:03.268951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-08ace798-dddc-42b4-850c-6243aaf47e8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:03.269600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-08ace798-dddc-42b4-850c-6243aaf47e8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:03.271169 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2633/5273] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:03 2022] DELETE /identity/v3/projects/2530663ea9664bf2812d1cecc8d8f4e6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:03.276007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569623ec-69c6-4759-a134-e9a9229dbc85 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:03.276502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569623ec-69c6-4759-a134-e9a9229dbc85 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:03.276661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569623ec-69c6-4759-a134-e9a9229dbc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:03.295807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-569623ec-69c6-4759-a134-e9a9229dbc85 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:03.297095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-569623ec-69c6-4759-a134-e9a9229dbc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:03.356757 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2641/5274] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:03.364681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829ae24-4fef-404e-8cee-ff55761db87d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:03.365063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829ae24-4fef-404e-8cee-ff55761db87d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:03.365348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829ae24-4fef-404e-8cee-ff55761db87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:03.384839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d829ae24-4fef-404e-8cee-ff55761db87d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:03.386064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d829ae24-4fef-404e-8cee-ff55761db87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:03.395602 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2634/5275] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:38:03.400002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569623ec-69c6-4759-a134-e9a9229dbc85 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:03.410860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569623ec-69c6-4759-a134-e9a9229dbc85 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:03.415758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f925291-f514-4e2b-b916-27f7c8b328c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:03.416691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f925291-f514-4e2b-b916-27f7c8b328c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:03.416990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f925291-f514-4e2b-b916-27f7c8b328c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:03.417319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f925291-f514-4e2b-b916-27f7c8b328c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:03.418045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f925291-f514-4e2b-b916-27f7c8b328c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:38:03.418360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f925291-f514-4e2b-b916-27f7c8b328c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:03.420060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f925291-f514-4e2b-b916-27f7c8b328c1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:03.436753 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2642/5276] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:03.438210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829ae24-4fef-404e-8cee-ff55761db87d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:03.448069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829ae24-4fef-404e-8cee-ff55761db87d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:03.453501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a2b46-c480-4b68-96d7-bba9061ac4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:03.454156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a2b46-c480-4b68-96d7-bba9061ac4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:03.454440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a2b46-c480-4b68-96d7-bba9061ac4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:03.454718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a2b46-c480-4b68-96d7-bba9061ac4d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:03.455403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a2b46-c480-4b68-96d7-bba9061ac4d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:03.457355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a2b46-c480-4b68-96d7-bba9061ac4d2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:03.659131 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2635/5277] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:38:03 2022] POST /identity/v3/projects => generated 375 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:03.663390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f925291-f514-4e2b-b916-27f7c8b328c1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:03.674176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f925291-f514-4e2b-b916-27f7c8b328c1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:03.739478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e33de-489f-40aa-8038-65c5638afc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:03.740159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e33de-489f-40aa-8038-65c5638afc66 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:03.740445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e33de-489f-40aa-8038-65c5638afc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:03.740760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e33de-489f-40aa-8038-65c5638afc66 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:03.741464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e33de-489f-40aa-8038-65c5638afc66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:03.743368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e33de-489f-40aa-8038-65c5638afc66 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:03.863347 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2643/5278] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:38:03 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:38:03.867320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a2b46-c480-4b68-96d7-bba9061ac4d2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:03.877965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a2b46-c480-4b68-96d7-bba9061ac4d2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:03.882514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2840da2-c0de-4aeb-8a70-9d423e6a1272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:03.883183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2840da2-c0de-4aeb-8a70-9d423e6a1272 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:03.883466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2840da2-c0de-4aeb-8a70-9d423e6a1272 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:03.883743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2840da2-c0de-4aeb-8a70-9d423e6a1272 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:03.884473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2840da2-c0de-4aeb-8a70-9d423e6a1272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:03.886115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2840da2-c0de-4aeb-8a70-9d423e6a1272 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:03.897315 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2636/5279] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:38:03.901398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e33de-489f-40aa-8038-65c5638afc66 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:03.911857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e33de-489f-40aa-8038-65c5638afc66 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:03.916707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5ebdb-0a21-4944-8bd1-0899bb981815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:03.917402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5ebdb-0a21-4944-8bd1-0899bb981815 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:03.917691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5ebdb-0a21-4944-8bd1-0899bb981815 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:03.917971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5ebdb-0a21-4944-8bd1-0899bb981815 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:03.918731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5ebdb-0a21-4944-8bd1-0899bb981815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:03.920423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5ebdb-0a21-4944-8bd1-0899bb981815 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:03.930319 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2644/5280] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:38:03.934450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2840da2-c0de-4aeb-8a70-9d423e6a1272 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:03.944282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2840da2-c0de-4aeb-8a70-9d423e6a1272 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:03.948855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0081752-e331-4398-ad64-34566027d9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:03.952012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0081752-e331-4398-ad64-34566027d9e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:03.952012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0081752-e331-4398-ad64-34566027d9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:03.952012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0081752-e331-4398-ad64-34566027d9e8 admin admin] PATH_INFO: `/v3/projects/29e616a0c8df45e6987aced1da716382/users/4d8ba23c64c2410da6059165b4f20bfa/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:03.965193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0081752-e331-4398-ad64-34566027d9e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e616a0c8df45e6987aced1da716382, user_id=4d8ba23c64c2410da6059165b4f20bfa, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:03.968567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0081752-e331-4398-ad64-34566027d9e8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:04.120433 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2637/5281] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:03 2022] PUT /identity/v3/projects/29e616a0c8df45e6987aced1da716382/users/4d8ba23c64c2410da6059165b4f20bfa/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:04.131957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c16bb-8047-4994-be42-93ce0b85a86e None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:04.132096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c16bb-8047-4994-be42-93ce0b85a86e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:04.132267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c16bb-8047-4994-be42-93ce0b85a86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:04.160967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e07c16bb-8047-4994-be42-93ce0b85a86e None None] MFA Rules not processed for user `4d8ba23c64c2410da6059165b4f20bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:04.162244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e07c16bb-8047-4994-be42-93ce0b85a86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:04.233616 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2645/5282] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:04.248160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0081752-e331-4398-ad64-34566027d9e8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:04.252040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b0081752-e331-4398-ad64-34566027d9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:04.316081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0081752-e331-4398-ad64-34566027d9e8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:04.320219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d125bc-5e60-405f-84da-a83849e926ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:04.321423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d125bc-5e60-405f-84da-a83849e926ab service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:04.321423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d125bc-5e60-405f-84da-a83849e926ab service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:04.321659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d125bc-5e60-405f-84da-a83849e926ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:04.333543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d125bc-5e60-405f-84da-a83849e926ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:04.335204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d125bc-5e60-405f-84da-a83849e926ab service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:04.348151 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2638/5283] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:38:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:38:06.146063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c16bb-8047-4994-be42-93ce0b85a86e None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:06.147812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e07c16bb-8047-4994-be42-93ce0b85a86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:06.223861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c16bb-8047-4994-be42-93ce0b85a86e None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:06.229584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08bda5-3e87-4143-b61c-8153a122da89 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7412c3f8680425298656c66656c5bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a10e8dda3c4a9fa1d4bf00147daafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:06.230678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08bda5-3e87-4143-b61c-8153a122da89 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:06.231666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08bda5-3e87-4143-b61c-8153a122da89 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:06.232003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08bda5-3e87-4143-b61c-8153a122da89 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:06.232909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08bda5-3e87-4143-b61c-8153a122da89 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:38:06.233672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08bda5-3e87-4143-b61c-8153a122da89 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:06.235067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08bda5-3e87-4143-b61c-8153a122da89 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:06.256240 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2646/5284] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:06.257455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d125bc-5e60-405f-84da-a83849e926ab service cinder] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:06.268501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d125bc-5e60-405f-84da-a83849e926ab service cinder] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:06.274202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62542165-3fe1-4ac4-8a2f-dd9aa8053a6e tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7412c3f8680425298656c66656c5bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a10e8dda3c4a9fa1d4bf00147daafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:06.277771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62542165-3fe1-4ac4-8a2f-dd9aa8053a6e tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:06.277771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62542165-3fe1-4ac4-8a2f-dd9aa8053a6e tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:06.277771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62542165-3fe1-4ac4-8a2f-dd9aa8053a6e tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:06.277771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62542165-3fe1-4ac4-8a2f-dd9aa8053a6e tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:06.278287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62542165-3fe1-4ac4-8a2f-dd9aa8053a6e tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:06.385138 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2639/5285] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:38:06 2022] POST /identity/v3/projects => generated 349 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:06.389460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08bda5-3e87-4143-b61c-8153a122da89 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:06.399435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08bda5-3e87-4143-b61c-8153a122da89 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:06.453947 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5d493-094d-4fd6-8c41-585508cd3c6d tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7412c3f8680425298656c66656c5bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a10e8dda3c4a9fa1d4bf00147daafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:06.454533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5d493-094d-4fd6-8c41-585508cd3c6d tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:06.454820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5d493-094d-4fd6-8c41-585508cd3c6d tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:06.455099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5d493-094d-4fd6-8c41-585508cd3c6d tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:06.455983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5d493-094d-4fd6-8c41-585508cd3c6d tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:38:06.456294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5d493-094d-4fd6-8c41-585508cd3c6d tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:06.457913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5d493-094d-4fd6-8c41-585508cd3c6d tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:06.469280 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2647/5286] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:07.109164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30398165-4beb-4958-b9fb-981ba93361e6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:07.109459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30398165-4beb-4958-b9fb-981ba93361e6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:07.109748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30398165-4beb-4958-b9fb-981ba93361e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:07.130268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-30398165-4beb-4958-b9fb-981ba93361e6 None None] MFA Rules not processed for user `aa1943e65db34e1da273b41c8a3d2faf`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:07.131511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-30398165-4beb-4958-b9fb-981ba93361e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:07.148438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5d493-094d-4fd6-8c41-585508cd3c6d tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:07.167121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5d493-094d-4fd6-8c41-585508cd3c6d tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:07.175494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2cbce-4242-4835-8fe4-469281cc0594 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7412c3f8680425298656c66656c5bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a10e8dda3c4a9fa1d4bf00147daafe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:07.182330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2cbce-4242-4835-8fe4-469281cc0594 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:07.182330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2cbce-4242-4835-8fe4-469281cc0594 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:07.182330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2cbce-4242-4835-8fe4-469281cc0594 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] PATH_INFO: `/v3/projects/13014411e9ee4ccbbb3afd4184fdbd71` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:07.182330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2cbce-4242-4835-8fe4-469281cc0594 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] RBAC: Authorizing `identity:delete_project(project_id=13014411e9ee4ccbbb3afd4184fdbd71)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:07.184590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2cbce-4242-4835-8fe4-469281cc0594 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:07.217573 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2640/5287] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:07.339627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-abf2cbce-4242-4835-8fe4-469281cc0594 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13014411e9ee4ccbbb3afd4184fdbd71', 'request_id': 'req-abf2cbce-4242-4835-8fe4-469281cc0594'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:07.416434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-abf2cbce-4242-4835-8fe4-469281cc0594 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13014411e9ee4ccbbb3afd4184fdbd71', 'request_id': 'req-abf2cbce-4242-4835-8fe4-469281cc0594'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:07.424056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-abf2cbce-4242-4835-8fe4-469281cc0594 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13014411e9ee4ccbbb3afd4184fdbd71', 'request_id': 'req-abf2cbce-4242-4835-8fe4-469281cc0594'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:07.435123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-abf2cbce-4242-4835-8fe4-469281cc0594 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] The token cache is being invalidate because project 13014411e9ee4ccbbb3afd4184fdbd71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:07.435784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-abf2cbce-4242-4835-8fe4-469281cc0594 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:07.438847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-abf2cbce-4242-4835-8fe4-469281cc0594 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:07.440437 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2648/5288] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:07 2022] DELETE /identity/v3/projects/13014411e9ee4ccbbb3afd4184fdbd71 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:07.451731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30398165-4beb-4958-b9fb-981ba93361e6 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:07.453189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-30398165-4beb-4958-b9fb-981ba93361e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:07.509792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30398165-4beb-4958-b9fb-981ba93361e6 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:07.556338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd2d2d-0b38-4eca-9da1-ca6914e08807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:07.556948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd2d2d-0b38-4eca-9da1-ca6914e08807 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:07.557236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd2d2d-0b38-4eca-9da1-ca6914e08807 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:07.557513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd2d2d-0b38-4eca-9da1-ca6914e08807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:07.559897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-98dd2d2d-0b38-4eca-9da1-ca6914e08807 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:07.620249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd2d2d-0b38-4eca-9da1-ca6914e08807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:07.622861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd2d2d-0b38-4eca-9da1-ca6914e08807 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:07.633221 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2641/5289] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:38:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:38:12.082643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2cbce-4242-4835-8fe4-469281cc0594 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:12.087864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-abf2cbce-4242-4835-8fe4-469281cc0594 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:12.189128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2cbce-4242-4835-8fe4-469281cc0594 tempest-RoutersIpV6AdminTest-2094983253 tempest-RoutersIpV6AdminTest-2094983253-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:12.195057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb1e3f-e834-4b10-ab78-08080fde4430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:12.196176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb1e3f-e834-4b10-ab78-08080fde4430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:12.196706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb1e3f-e834-4b10-ab78-08080fde4430 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:12.197094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb1e3f-e834-4b10-ab78-08080fde4430 admin admin] PATH_INFO: `/v3/users/1b9118b995654db585d0f47f4e97475c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:12.199691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb1e3f-e834-4b10-ab78-08080fde4430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9118b995654db585d0f47f4e97475c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:12.204663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb1e3f-e834-4b10-ab78-08080fde4430 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:12.425033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7ccb1e3f-e834-4b10-ab78-08080fde4430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9118b995654db585d0f47f4e97475c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:12.448344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7ccb1e3f-e834-4b10-ab78-08080fde4430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9118b995654db585d0f47f4e97475c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:12.452073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7ccb1e3f-e834-4b10-ab78-08080fde4430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9118b995654db585d0f47f4e97475c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:12.462543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7ccb1e3f-e834-4b10-ab78-08080fde4430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9118b995654db585d0f47f4e97475c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:12.606771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7ccb1e3f-e834-4b10-ab78-08080fde4430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9118b995654db585d0f47f4e97475c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:12.616335 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2649/5290] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:12 2022] DELETE /identity/v3/users/1b9118b995654db585d0f47f4e97475c => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:12.618149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7889d-deb2-444b-bc5d-0ae069350315 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:12.618650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7889d-deb2-444b-bc5d-0ae069350315 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:12.618778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7889d-deb2-444b-bc5d-0ae069350315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:12.642047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-92c7889d-deb2-444b-bc5d-0ae069350315 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:12.643353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-92c7889d-deb2-444b-bc5d-0ae069350315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:12.707113 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2642/5291] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:12.719057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb1e3f-e834-4b10-ab78-08080fde4430 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:12.720822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7ccb1e3f-e834-4b10-ab78-08080fde4430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:12.787387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb1e3f-e834-4b10-ab78-08080fde4430 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:12.791423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76a3c9-192b-485a-946c-095448c84bf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:12.792416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76a3c9-192b-485a-946c-095448c84bf9 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:12.793101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76a3c9-192b-485a-946c-095448c84bf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:12.793609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76a3c9-192b-485a-946c-095448c84bf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:12.810120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76a3c9-192b-485a-946c-095448c84bf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:12.812692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76a3c9-192b-485a-946c-095448c84bf9 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:12.825105 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2650/5292] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:38:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:38:13.708357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7889d-deb2-444b-bc5d-0ae069350315 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:13.710463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-92c7889d-deb2-444b-bc5d-0ae069350315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:13.725678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7889d-deb2-444b-bc5d-0ae069350315 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:13.733636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5f760-4cfc-44b7-96ce-f858437b7b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:13.734592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5f760-4cfc-44b7-96ce-f858437b7b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:13.735094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5f760-4cfc-44b7-96ce-f858437b7b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:13.735577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5f760-4cfc-44b7-96ce-f858437b7b0d admin admin] PATH_INFO: `/v3/projects/28b3733aca9542b3a9d873766a883fac` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:13.737043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5f760-4cfc-44b7-96ce-f858437b7b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=28b3733aca9542b3a9d873766a883fac)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:13.739711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5f760-4cfc-44b7-96ce-f858437b7b0d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:13.949103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6d5f760-4cfc-44b7-96ce-f858437b7b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28b3733aca9542b3a9d873766a883fac', 'request_id': 'req-d6d5f760-4cfc-44b7-96ce-f858437b7b0d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:13.954280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6d5f760-4cfc-44b7-96ce-f858437b7b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28b3733aca9542b3a9d873766a883fac', 'request_id': 'req-d6d5f760-4cfc-44b7-96ce-f858437b7b0d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:14.023047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6d5f760-4cfc-44b7-96ce-f858437b7b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28b3733aca9542b3a9d873766a883fac', 'request_id': 'req-d6d5f760-4cfc-44b7-96ce-f858437b7b0d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:14.035736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6d5f760-4cfc-44b7-96ce-f858437b7b0d admin admin] The token cache is being invalidate because project 28b3733aca9542b3a9d873766a883fac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:14.036029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6d5f760-4cfc-44b7-96ce-f858437b7b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:14.036735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6d5f760-4cfc-44b7-96ce-f858437b7b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:14.043049 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2643/5293] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:13 2022] DELETE /identity/v3/projects/28b3733aca9542b3a9d873766a883fac => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:14.045340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff60feb-effd-4889-96f7-3122e87031ca None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:14.046224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff60feb-effd-4889-96f7-3122e87031ca None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:14.046830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff60feb-effd-4889-96f7-3122e87031ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:14.068097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0ff60feb-effd-4889-96f7-3122e87031ca None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:14.069671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0ff60feb-effd-4889-96f7-3122e87031ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:14.154369 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2651/5294] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:14.176743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf53c2b-5a06-4355-8493-5d079d20c975 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:14.177483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf53c2b-5a06-4355-8493-5d079d20c975 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:14.178496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf53c2b-5a06-4355-8493-5d079d20c975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:14.215875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8bf53c2b-5a06-4355-8493-5d079d20c975 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:14.217105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8bf53c2b-5a06-4355-8493-5d079d20c975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:14.236833 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2644/5295] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:14.240790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff60feb-effd-4889-96f7-3122e87031ca None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:14.259503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff60feb-effd-4889-96f7-3122e87031ca None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:14.267601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf249f3a-ad24-4320-8946-2621a5a3effc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:14.268299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf249f3a-ad24-4320-8946-2621a5a3effc admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:14.268565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf249f3a-ad24-4320-8946-2621a5a3effc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:14.269056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf249f3a-ad24-4320-8946-2621a5a3effc admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:14.269787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf249f3a-ad24-4320-8946-2621a5a3effc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:38:14.270283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf249f3a-ad24-4320-8946-2621a5a3effc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:14.271955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf249f3a-ad24-4320-8946-2621a5a3effc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:14.301142 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2652/5296] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:14.304259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf53c2b-5a06-4355-8493-5d079d20c975 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:14.314627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf53c2b-5a06-4355-8493-5d079d20c975 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:14.332962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6105926-8123-4b56-9172-19ee1d63d235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:14.333882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6105926-8123-4b56-9172-19ee1d63d235 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:14.334357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6105926-8123-4b56-9172-19ee1d63d235 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:14.334804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6105926-8123-4b56-9172-19ee1d63d235 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:14.335872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6105926-8123-4b56-9172-19ee1d63d235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:14.338051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6105926-8123-4b56-9172-19ee1d63d235 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:14.462286 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2645/5297] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:38:14 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:14.467286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf249f3a-ad24-4320-8946-2621a5a3effc admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:14.479917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf249f3a-ad24-4320-8946-2621a5a3effc admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:14.598451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf47223-e772-4451-bca1-f623d894cc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:14.599312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf47223-e772-4451-bca1-f623d894cc52 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:14.599688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf47223-e772-4451-bca1-f623d894cc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:14.600105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf47223-e772-4451-bca1-f623d894cc52 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:14.600908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf47223-e772-4451-bca1-f623d894cc52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:14.603397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf47223-e772-4451-bca1-f623d894cc52 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:14.722335 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2653/5298] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:38:14 2022] POST /identity/v3/users => generated 286 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:14.726871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6105926-8123-4b56-9172-19ee1d63d235 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:14.743814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6105926-8123-4b56-9172-19ee1d63d235 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:14.755329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b183f39-514f-438f-82f5-b2bd31e294af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:14.755329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b183f39-514f-438f-82f5-b2bd31e294af admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:14.755329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b183f39-514f-438f-82f5-b2bd31e294af admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:14.755329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b183f39-514f-438f-82f5-b2bd31e294af admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:14.755820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b183f39-514f-438f-82f5-b2bd31e294af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:14.757162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b183f39-514f-438f-82f5-b2bd31e294af admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:14.769961 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2646/5299] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:38:14.774299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf47223-e772-4451-bca1-f623d894cc52 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:14.787944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf47223-e772-4451-bca1-f623d894cc52 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:14.795305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8a5ab-4f20-4657-8d7f-c24a73458a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:14.796076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8a5ab-4f20-4657-8d7f-c24a73458a37 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:14.796367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8a5ab-4f20-4657-8d7f-c24a73458a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:14.796719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8a5ab-4f20-4657-8d7f-c24a73458a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:14.798333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8a5ab-4f20-4657-8d7f-c24a73458a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:14.800114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8a5ab-4f20-4657-8d7f-c24a73458a37 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:14.817629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b183f39-514f-438f-82f5-b2bd31e294af admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:14.830362 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2654/5300] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:38:14.832489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b183f39-514f-438f-82f5-b2bd31e294af admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:14.837780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709078d4-2ad6-4318-8a3c-d1bfd7805364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:14.838979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709078d4-2ad6-4318-8a3c-d1bfd7805364 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:14.839272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709078d4-2ad6-4318-8a3c-d1bfd7805364 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:14.839747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709078d4-2ad6-4318-8a3c-d1bfd7805364 admin admin] PATH_INFO: `/v3/projects/d35b4676d9034f13832f2d134b9236cf/users/3acf0b2c23e148c8913d49aea1671591/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:14.869557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709078d4-2ad6-4318-8a3c-d1bfd7805364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35b4676d9034f13832f2d134b9236cf, user_id=3acf0b2c23e148c8913d49aea1671591, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:14.873056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709078d4-2ad6-4318-8a3c-d1bfd7805364 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:14.990083 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2647/5301] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:14 2022] PUT /identity/v3/projects/d35b4676d9034f13832f2d134b9236cf/users/3acf0b2c23e148c8913d49aea1671591/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:15.001175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c591a-9141-413e-8016-ef0fe22e56b1 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:15.001469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c591a-9141-413e-8016-ef0fe22e56b1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:15.001754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c591a-9141-413e-8016-ef0fe22e56b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:15.049718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-932c591a-9141-413e-8016-ef0fe22e56b1 None None] MFA Rules not processed for user `3acf0b2c23e148c8913d49aea1671591`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:15.052689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-932c591a-9141-413e-8016-ef0fe22e56b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:15.147481 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2655/5302] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:15.153112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709078d4-2ad6-4318-8a3c-d1bfd7805364 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:15.265657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709078d4-2ad6-4318-8a3c-d1bfd7805364 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:15.276994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba5b50-9e67-4898-8b55-c5fefa3bf01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:15.276994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba5b50-9e67-4898-8b55-c5fefa3bf01f admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:15.276994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba5b50-9e67-4898-8b55-c5fefa3bf01f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:15.276994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba5b50-9e67-4898-8b55-c5fefa3bf01f admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:15.278110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba5b50-9e67-4898-8b55-c5fefa3bf01f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:15.278110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba5b50-9e67-4898-8b55-c5fefa3bf01f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:15.405910 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2648/5303] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:38:15 2022] POST /identity/v3/projects => generated 375 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:15.409842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c591a-9141-413e-8016-ef0fe22e56b1 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:15.421144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c591a-9141-413e-8016-ef0fe22e56b1 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:15.492168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749866ab-3f27-48d9-8b93-3cd41352c485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:15.493645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749866ab-3f27-48d9-8b93-3cd41352c485 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:15.494005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749866ab-3f27-48d9-8b93-3cd41352c485 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:15.494350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749866ab-3f27-48d9-8b93-3cd41352c485 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:15.495581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749866ab-3f27-48d9-8b93-3cd41352c485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:15.499479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749866ab-3f27-48d9-8b93-3cd41352c485 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:15.597816 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2656/5304] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:38:15 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:15.601402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba5b50-9e67-4898-8b55-c5fefa3bf01f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:15.613680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba5b50-9e67-4898-8b55-c5fefa3bf01f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:15.618684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8592bcc-dddb-48b3-aae8-834ed0a9f4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:15.619365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8592bcc-dddb-48b3-aae8-834ed0a9f4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:15.619633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8592bcc-dddb-48b3-aae8-834ed0a9f4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:15.620118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8592bcc-dddb-48b3-aae8-834ed0a9f4f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:15.620878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8592bcc-dddb-48b3-aae8-834ed0a9f4f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:15.623160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8592bcc-dddb-48b3-aae8-834ed0a9f4f1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:15.643582 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2649/5305] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:38:15.647967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749866ab-3f27-48d9-8b93-3cd41352c485 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:15.674518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749866ab-3f27-48d9-8b93-3cd41352c485 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:15.682219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cdb8d-d153-4bc9-8283-357efd957528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:15.683679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cdb8d-d153-4bc9-8283-357efd957528 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:15.684681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cdb8d-d153-4bc9-8283-357efd957528 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:15.684905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cdb8d-d153-4bc9-8283-357efd957528 admin admin] PATH_INFO: `/v3/projects/7450e958af574542bdef926127e340d7/users/546bb086783348c58a1cd68b488cb079/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:15.704218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cdb8d-d153-4bc9-8283-357efd957528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7450e958af574542bdef926127e340d7, user_id=546bb086783348c58a1cd68b488cb079, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:15.707656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cdb8d-d153-4bc9-8283-357efd957528 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:15.814160 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2657/5306] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:15 2022] PUT /identity/v3/projects/7450e958af574542bdef926127e340d7/users/546bb086783348c58a1cd68b488cb079/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:15.818453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8592bcc-dddb-48b3-aae8-834ed0a9f4f1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:15.835926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8592bcc-dddb-48b3-aae8-834ed0a9f4f1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:15.917671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca447ad-c823-4577-ba51-28c64e26b7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:15.919135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca447ad-c823-4577-ba51-28c64e26b7bf admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:15.919135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca447ad-c823-4577-ba51-28c64e26b7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:15.919135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca447ad-c823-4577-ba51-28c64e26b7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:15.919654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca447ad-c823-4577-ba51-28c64e26b7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:15.921350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca447ad-c823-4577-ba51-28c64e26b7bf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:15.940828 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2650/5307] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:38:15.943262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cdb8d-d153-4bc9-8283-357efd957528 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:15.955128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cdb8d-d153-4bc9-8283-357efd957528 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:15.961684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43482d47-1855-4689-b538-948ce59f0cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:15.962744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43482d47-1855-4689-b538-948ce59f0cf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:15.963045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43482d47-1855-4689-b538-948ce59f0cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:15.963570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43482d47-1855-4689-b538-948ce59f0cf8 admin admin] PATH_INFO: `/v3/projects/7450e958af574542bdef926127e340d7/users/546bb086783348c58a1cd68b488cb079/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:15.966209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43482d47-1855-4689-b538-948ce59f0cf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7450e958af574542bdef926127e340d7, user_id=546bb086783348c58a1cd68b488cb079, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:15.969981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43482d47-1855-4689-b538-948ce59f0cf8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:15.989531 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2658/5308] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:15 2022] PUT /identity/v3/projects/7450e958af574542bdef926127e340d7/users/546bb086783348c58a1cd68b488cb079/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:15.991353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f47f3-afe1-4a0c-bda2-74e4df7ea7f4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:15.991641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f47f3-afe1-4a0c-bda2-74e4df7ea7f4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:15.991946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f47f3-afe1-4a0c-bda2-74e4df7ea7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:16.023097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-170f47f3-afe1-4a0c-bda2-74e4df7ea7f4 None None] MFA Rules not processed for user `546bb086783348c58a1cd68b488cb079`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:16.024423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-170f47f3-afe1-4a0c-bda2-74e4df7ea7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:16.107743 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2651/5309] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:16.113392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43482d47-1855-4689-b538-948ce59f0cf8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:16.125611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43482d47-1855-4689-b538-948ce59f0cf8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:16.140499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f796af2-1bd7-4cec-971f-9472f34473cb tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '546bb086783348c58a1cd68b488cb079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7450e958af574542bdef926127e340d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:16.141488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f796af2-1bd7-4cec-971f-9472f34473cb tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:16.141680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f796af2-1bd7-4cec-971f-9472f34473cb tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:16.141954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f796af2-1bd7-4cec-971f-9472f34473cb tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:16.143136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f796af2-1bd7-4cec-971f-9472f34473cb tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:16.145077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f796af2-1bd7-4cec-971f-9472f34473cb tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:16.258361 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2659/5310] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:38:16 2022] POST /identity/v3/domains => generated 245 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:16.263269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f47f3-afe1-4a0c-bda2-74e4df7ea7f4 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:16.275470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f47f3-afe1-4a0c-bda2-74e4df7ea7f4 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:16.349524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55feb58-0747-4d46-a201-d1f9b46d3bb0 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '546bb086783348c58a1cd68b488cb079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7450e958af574542bdef926127e340d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:16.350408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55feb58-0747-4d46-a201-d1f9b46d3bb0 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:16.351259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55feb58-0747-4d46-a201-d1f9b46d3bb0 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:16.351259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55feb58-0747-4d46-a201-d1f9b46d3bb0 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:16.351690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55feb58-0747-4d46-a201-d1f9b46d3bb0 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:16.354008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55feb58-0747-4d46-a201-d1f9b46d3bb0 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:16.459180 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2652/5311] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:38:16 2022] POST /identity/v3/projects => generated 407 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:16.460380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f796af2-1bd7-4cec-971f-9472f34473cb tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:16.472108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f796af2-1bd7-4cec-971f-9472f34473cb tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:16.538415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4985f63-51dc-46c0-ace2-70ea62e5bdc3 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '546bb086783348c58a1cd68b488cb079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7450e958af574542bdef926127e340d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:16.539112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4985f63-51dc-46c0-ace2-70ea62e5bdc3 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:16.539399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4985f63-51dc-46c0-ace2-70ea62e5bdc3 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:16.539684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4985f63-51dc-46c0-ace2-70ea62e5bdc3 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:16.540389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4985f63-51dc-46c0-ace2-70ea62e5bdc3 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:16.542429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4985f63-51dc-46c0-ace2-70ea62e5bdc3 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:16.651811 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2660/5312] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:38:16 2022] POST /identity/v3/users => generated 348 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:16.656035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55feb58-0747-4d46-a201-d1f9b46d3bb0 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:16.667248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55feb58-0747-4d46-a201-d1f9b46d3bb0 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:16.673279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a76d8-31a0-45f7-8fcb-94be3b472fe9 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '546bb086783348c58a1cd68b488cb079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7450e958af574542bdef926127e340d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:16.674020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a76d8-31a0-45f7-8fcb-94be3b472fe9 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:16.684428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a76d8-31a0-45f7-8fcb-94be3b472fe9 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:16.684428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a76d8-31a0-45f7-8fcb-94be3b472fe9 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:16.684428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a76d8-31a0-45f7-8fcb-94be3b472fe9 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:16.684428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a76d8-31a0-45f7-8fcb-94be3b472fe9 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:16.688863 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2653/5313] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:38:16.693154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4985f63-51dc-46c0-ace2-70ea62e5bdc3 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:16.703723 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4985f63-51dc-46c0-ace2-70ea62e5bdc3 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:16.708693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d4c42-d0be-4650-94b3-c44b18795c5b tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '546bb086783348c58a1cd68b488cb079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7450e958af574542bdef926127e340d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:16.709681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d4c42-d0be-4650-94b3-c44b18795c5b tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:16.710033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d4c42-d0be-4650-94b3-c44b18795c5b tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:16.710383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d4c42-d0be-4650-94b3-c44b18795c5b tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] PATH_INFO: `/v3/projects/4f92fcb0ab5e4eb796f1815f9c85ddb9/users/590e253233b94fb6942bfdbfb3ab4bab/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:16.726936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d4c42-d0be-4650-94b3-c44b18795c5b tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4f92fcb0ab5e4eb796f1815f9c85ddb9, user_id=590e253233b94fb6942bfdbfb3ab4bab, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:16.730920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d4c42-d0be-4650-94b3-c44b18795c5b tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:16.816657 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2661/5314] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:16 2022] PUT /identity/v3/projects/4f92fcb0ab5e4eb796f1815f9c85ddb9/users/590e253233b94fb6942bfdbfb3ab4bab/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:16.827675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc9e6d-2b51-4502-be0f-2b6607bf082b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:16.828570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc9e6d-2b51-4502-be0f-2b6607bf082b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:16.829094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc9e6d-2b51-4502-be0f-2b6607bf082b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:16.944565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-dfbc9e6d-2b51-4502-be0f-2b6607bf082b None None] MFA Rules not processed for user `590e253233b94fb6942bfdbfb3ab4bab`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:16.945809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-dfbc9e6d-2b51-4502-be0f-2b6607bf082b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:16.972524 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2654/5315] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:16 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:16.975429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb7d83-76ad-4ac3-9d9b-762fe1c9556d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:16.975968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb7d83-76ad-4ac3-9d9b-762fe1c9556d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:16.976936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb7d83-76ad-4ac3-9d9b-762fe1c9556d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:17.001956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c5cb7d83-76ad-4ac3-9d9b-762fe1c9556d None None] MFA Rules not processed for user `590e253233b94fb6942bfdbfb3ab4bab`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:17.003650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c5cb7d83-76ad-4ac3-9d9b-762fe1c9556d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:17.021417 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2662/5316] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:16 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:17.022560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc9e6d-2b51-4502-be0f-2b6607bf082b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:17.033754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc9e6d-2b51-4502-be0f-2b6607bf082b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:17.038594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350a634-9374-47d8-89cd-abf9403af9d7 tempest-test_project-50768041 tempest-user-1512506525] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590e253233b94fb6942bfdbfb3ab4bab', 'user_domain_id': '9df1a2b42e904a56b30de20b2338fb4a', 'system_scope': None, 'project_id': '4f92fcb0ab5e4eb796f1815f9c85ddb9', 'project_domain_id': '9df1a2b42e904a56b30de20b2338fb4a', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:17.039239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350a634-9374-47d8-89cd-abf9403af9d7 tempest-test_project-50768041 tempest-user-1512506525] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:17.039522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350a634-9374-47d8-89cd-abf9403af9d7 tempest-test_project-50768041 tempest-user-1512506525] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:17.039854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350a634-9374-47d8-89cd-abf9403af9d7 tempest-test_project-50768041 tempest-user-1512506525] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:17.049145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350a634-9374-47d8-89cd-abf9403af9d7 tempest-test_project-50768041 tempest-user-1512506525] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:17.050956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350a634-9374-47d8-89cd-abf9403af9d7 tempest-test_project-50768041 tempest-user-1512506525] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:17.062591 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2655/5317] 10.222.0.16 () {56 vars in 1283 bytes} [Mon May 2 10:38:17 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:38:17.067289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb7d83-76ad-4ac3-9d9b-762fe1c9556d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:17.166966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb7d83-76ad-4ac3-9d9b-762fe1c9556d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:17.174812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f11063-2860-4ff4-8eff-2a0344da3700 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '546bb086783348c58a1cd68b488cb079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7450e958af574542bdef926127e340d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:17.176686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f11063-2860-4ff4-8eff-2a0344da3700 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:17.177217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f11063-2860-4ff4-8eff-2a0344da3700 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:17.177606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f11063-2860-4ff4-8eff-2a0344da3700 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] PATH_INFO: `/v3/users/590e253233b94fb6942bfdbfb3ab4bab` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:17.179087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f11063-2860-4ff4-8eff-2a0344da3700 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: Authorizing `identity:delete_user(user_id=590e253233b94fb6942bfdbfb3ab4bab)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:17.181288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f11063-2860-4ff4-8eff-2a0344da3700 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:17.413988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-70f11063-2860-4ff4-8eff-2a0344da3700 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '590e253233b94fb6942bfdbfb3ab4bab'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:17.431362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-70f11063-2860-4ff4-8eff-2a0344da3700 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '590e253233b94fb6942bfdbfb3ab4bab'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:17.432391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-70f11063-2860-4ff4-8eff-2a0344da3700 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '590e253233b94fb6942bfdbfb3ab4bab'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:17.443745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-70f11063-2860-4ff4-8eff-2a0344da3700 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '590e253233b94fb6942bfdbfb3ab4bab'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:17.514153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-70f11063-2860-4ff4-8eff-2a0344da3700 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '590e253233b94fb6942bfdbfb3ab4bab'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:17.522014 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2663/5318] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:17 2022] DELETE /identity/v3/users/590e253233b94fb6942bfdbfb3ab4bab => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:17.526390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350a634-9374-47d8-89cd-abf9403af9d7 tempest-test_project-50768041 tempest-user-1512506525] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:17.546270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350a634-9374-47d8-89cd-abf9403af9d7 tempest-test_project-50768041 tempest-user-1512506525] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:17.620739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6875b2b-e48d-4af9-87de-d4a9712c871b tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '546bb086783348c58a1cd68b488cb079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7450e958af574542bdef926127e340d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:17.622115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6875b2b-e48d-4af9-87de-d4a9712c871b tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:17.622462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6875b2b-e48d-4af9-87de-d4a9712c871b tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:17.622738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6875b2b-e48d-4af9-87de-d4a9712c871b tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] PATH_INFO: `/v3/projects/4f92fcb0ab5e4eb796f1815f9c85ddb9` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:17.623926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6875b2b-e48d-4af9-87de-d4a9712c871b tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4f92fcb0ab5e4eb796f1815f9c85ddb9)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:17.626206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6875b2b-e48d-4af9-87de-d4a9712c871b tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:17.786337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f6875b2b-e48d-4af9-87de-d4a9712c871b tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f92fcb0ab5e4eb796f1815f9c85ddb9', 'request_id': 'req-f6875b2b-e48d-4af9-87de-d4a9712c871b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:17.796076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f6875b2b-e48d-4af9-87de-d4a9712c871b tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f92fcb0ab5e4eb796f1815f9c85ddb9', 'request_id': 'req-f6875b2b-e48d-4af9-87de-d4a9712c871b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:17.867045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f6875b2b-e48d-4af9-87de-d4a9712c871b tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f92fcb0ab5e4eb796f1815f9c85ddb9', 'request_id': 'req-f6875b2b-e48d-4af9-87de-d4a9712c871b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:17.884922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f6875b2b-e48d-4af9-87de-d4a9712c871b tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] The token cache is being invalidate because project 4f92fcb0ab5e4eb796f1815f9c85ddb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:17.885494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f6875b2b-e48d-4af9-87de-d4a9712c871b tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:17.886170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f6875b2b-e48d-4af9-87de-d4a9712c871b tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:17.888545 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2656/5319] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:17 2022] DELETE /identity/v3/projects/4f92fcb0ab5e4eb796f1815f9c85ddb9 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:17.892418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f11063-2860-4ff4-8eff-2a0344da3700 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:17.895234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-70f11063-2860-4ff4-8eff-2a0344da3700 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:17.911797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f11063-2860-4ff4-8eff-2a0344da3700 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:17.984877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c1b75-0cd5-4964-8ac3-7dcf7715ba13 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '546bb086783348c58a1cd68b488cb079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7450e958af574542bdef926127e340d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:17.985786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c1b75-0cd5-4964-8ac3-7dcf7715ba13 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:17.986167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c1b75-0cd5-4964-8ac3-7dcf7715ba13 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:17.986359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c1b75-0cd5-4964-8ac3-7dcf7715ba13 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] PATH_INFO: `/v3/domains/9df1a2b42e904a56b30de20b2338fb4a` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:17.987722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c1b75-0cd5-4964-8ac3-7dcf7715ba13 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9df1a2b42e904a56b30de20b2338fb4a)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:17.989397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c1b75-0cd5-4964-8ac3-7dcf7715ba13 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:18.013942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6d8c1b75-0cd5-4964-8ac3-7dcf7715ba13 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9df1a2b42e904a56b30de20b2338fb4a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:18.014820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6d8c1b75-0cd5-4964-8ac3-7dcf7715ba13 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9df1a2b42e904a56b30de20b2338fb4a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:18.085176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6d8c1b75-0cd5-4964-8ac3-7dcf7715ba13 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9df1a2b42e904a56b30de20b2338fb4a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:18.085714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6d8c1b75-0cd5-4964-8ac3-7dcf7715ba13 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9df1a2b42e904a56b30de20b2338fb4a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:18.088694 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2664/5320] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:38:17 2022] PATCH /identity/v3/domains/9df1a2b42e904a56b30de20b2338fb4a => generated 246 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:38:18.093345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6875b2b-e48d-4af9-87de-d4a9712c871b tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:18.097208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f6875b2b-e48d-4af9-87de-d4a9712c871b tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:18.111816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6875b2b-e48d-4af9-87de-d4a9712c871b tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:18.176135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adb472-bc17-4056-b915-e50d470a9506 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '546bb086783348c58a1cd68b488cb079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7450e958af574542bdef926127e340d7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:18.177037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adb472-bc17-4056-b915-e50d470a9506 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:18.177323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adb472-bc17-4056-b915-e50d470a9506 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:18.177603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adb472-bc17-4056-b915-e50d470a9506 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] PATH_INFO: `/v3/domains/9df1a2b42e904a56b30de20b2338fb4a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:18.188556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adb472-bc17-4056-b915-e50d470a9506 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9df1a2b42e904a56b30de20b2338fb4a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:18.190205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adb472-bc17-4056-b915-e50d470a9506 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:18.225258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-98adb472-bc17-4056-b915-e50d470a9506 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9df1a2b42e904a56b30de20b2338fb4a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:18.241898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-98adb472-bc17-4056-b915-e50d470a9506 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9df1a2b42e904a56b30de20b2338fb4a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:18.373746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-98adb472-bc17-4056-b915-e50d470a9506 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9df1a2b42e904a56b30de20b2338fb4a', 'request_id': 'req-98adb472-bc17-4056-b915-e50d470a9506'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:18.381286 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-98adb472-bc17-4056-b915-e50d470a9506 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9df1a2b42e904a56b30de20b2338fb4a', 'request_id': 'req-98adb472-bc17-4056-b915-e50d470a9506'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:18.436395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-98adb472-bc17-4056-b915-e50d470a9506 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9df1a2b42e904a56b30de20b2338fb4a', 'request_id': 'req-98adb472-bc17-4056-b915-e50d470a9506'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:18.448580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-98adb472-bc17-4056-b915-e50d470a9506 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] The token cache is being invalidate because project 9df1a2b42e904a56b30de20b2338fb4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:18.448902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-98adb472-bc17-4056-b915-e50d470a9506 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:18.450115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-98adb472-bc17-4056-b915-e50d470a9506 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:18.458690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-98adb472-bc17-4056-b915-e50d470a9506 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9df1a2b42e904a56b30de20b2338fb4a', 'request_id': 'req-98adb472-bc17-4056-b915-e50d470a9506'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:18.462073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-98adb472-bc17-4056-b915-e50d470a9506 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9df1a2b42e904a56b30de20b2338fb4a', 'request_id': 'req-98adb472-bc17-4056-b915-e50d470a9506'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:18.462753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-98adb472-bc17-4056-b915-e50d470a9506 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9df1a2b42e904a56b30de20b2338fb4a', 'request_id': 'req-98adb472-bc17-4056-b915-e50d470a9506'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:18.468826 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2657/5321] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:38:18 2022] DELETE /identity/v3/domains/9df1a2b42e904a56b30de20b2338fb4a => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:18.474006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c1b75-0cd5-4964-8ac3-7dcf7715ba13 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:18.475509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6d8c1b75-0cd5-4964-8ac3-7dcf7715ba13 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:18.544203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c1b75-0cd5-4964-8ac3-7dcf7715ba13 tempest-TestDefaultProjectId-524489913 tempest-TestDefaultProjectId-524489913-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:18.603467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6fcb9-bd54-4585-ad75-9eccd611cc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:18.604511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6fcb9-bd54-4585-ad75-9eccd611cc2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:18.604836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6fcb9-bd54-4585-ad75-9eccd611cc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:18.605124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6fcb9-bd54-4585-ad75-9eccd611cc2c admin admin] PATH_INFO: `/v3/users/3acf0b2c23e148c8913d49aea1671591` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:18.606388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6fcb9-bd54-4585-ad75-9eccd611cc2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3acf0b2c23e148c8913d49aea1671591)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:18.608517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6fcb9-bd54-4585-ad75-9eccd611cc2c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:18.842741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69f6fcb9-bd54-4585-ad75-9eccd611cc2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3acf0b2c23e148c8913d49aea1671591'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:18.855974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69f6fcb9-bd54-4585-ad75-9eccd611cc2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3acf0b2c23e148c8913d49aea1671591'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:18.857098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69f6fcb9-bd54-4585-ad75-9eccd611cc2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3acf0b2c23e148c8913d49aea1671591'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:18.867877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69f6fcb9-bd54-4585-ad75-9eccd611cc2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3acf0b2c23e148c8913d49aea1671591'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:18.959072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69f6fcb9-bd54-4585-ad75-9eccd611cc2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3acf0b2c23e148c8913d49aea1671591'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:18.965446 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2665/5322] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:18 2022] DELETE /identity/v3/users/3acf0b2c23e148c8913d49aea1671591 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:18.969945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c44dd4-e39f-412e-be49-33e709f3c780 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:18.970453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c44dd4-e39f-412e-be49-33e709f3c780 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:18.970565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c44dd4-e39f-412e-be49-33e709f3c780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:18.991399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-16c44dd4-e39f-412e-be49-33e709f3c780 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:18.992859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-16c44dd4-e39f-412e-be49-33e709f3c780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:19.076438 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2658/5323] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:19.090908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6fcb9-bd54-4585-ad75-9eccd611cc2c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:19.095734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-69f6fcb9-bd54-4585-ad75-9eccd611cc2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:19.166523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6fcb9-bd54-4585-ad75-9eccd611cc2c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:19.171053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa8525-652d-48e2-a8ba-ad3dfe41385a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:19.171725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa8525-652d-48e2-a8ba-ad3dfe41385a service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:19.172012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa8525-652d-48e2-a8ba-ad3dfe41385a service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:19.172292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa8525-652d-48e2-a8ba-ad3dfe41385a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:19.182566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa8525-652d-48e2-a8ba-ad3dfe41385a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:19.184896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa8525-652d-48e2-a8ba-ad3dfe41385a service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:19.198009 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2666/5324] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:38:19.821771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c44dd4-e39f-412e-be49-33e709f3c780 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:19.821771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-16c44dd4-e39f-412e-be49-33e709f3c780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:19.833425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c44dd4-e39f-412e-be49-33e709f3c780 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:19.840879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0f74e-19b3-4134-b9c5-9aff5e04791d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:19.842290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0f74e-19b3-4134-b9c5-9aff5e04791d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:19.844837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0f74e-19b3-4134-b9c5-9aff5e04791d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:19.845220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0f74e-19b3-4134-b9c5-9aff5e04791d admin admin] PATH_INFO: `/v3/projects/d35b4676d9034f13832f2d134b9236cf` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:19.847247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0f74e-19b3-4134-b9c5-9aff5e04791d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d35b4676d9034f13832f2d134b9236cf)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:19.849478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0f74e-19b3-4134-b9c5-9aff5e04791d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:20.002167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6cf0f74e-19b3-4134-b9c5-9aff5e04791d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd35b4676d9034f13832f2d134b9236cf', 'request_id': 'req-6cf0f74e-19b3-4134-b9c5-9aff5e04791d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:20.008772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6cf0f74e-19b3-4134-b9c5-9aff5e04791d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd35b4676d9034f13832f2d134b9236cf', 'request_id': 'req-6cf0f74e-19b3-4134-b9c5-9aff5e04791d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:20.101220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6cf0f74e-19b3-4134-b9c5-9aff5e04791d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd35b4676d9034f13832f2d134b9236cf', 'request_id': 'req-6cf0f74e-19b3-4134-b9c5-9aff5e04791d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:20.117436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6cf0f74e-19b3-4134-b9c5-9aff5e04791d admin admin] The token cache is being invalidate because project d35b4676d9034f13832f2d134b9236cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:20.117983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6cf0f74e-19b3-4134-b9c5-9aff5e04791d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:20.118659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6cf0f74e-19b3-4134-b9c5-9aff5e04791d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:20.120578 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2659/5325] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:19 2022] DELETE /identity/v3/projects/d35b4676d9034f13832f2d134b9236cf => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:20.125319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa8525-652d-48e2-a8ba-ad3dfe41385a service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:20.135708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa8525-652d-48e2-a8ba-ad3dfe41385a service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:20.208477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82937a-5446-469e-b2c5-390f3e9cc9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:20.208477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82937a-5446-469e-b2c5-390f3e9cc9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:20.208837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82937a-5446-469e-b2c5-390f3e9cc9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:20.209089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82937a-5446-469e-b2c5-390f3e9cc9ae admin admin] PATH_INFO: `/v3/users/546bb086783348c58a1cd68b488cb079` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:20.210352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82937a-5446-469e-b2c5-390f3e9cc9ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=546bb086783348c58a1cd68b488cb079)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:20.212321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82937a-5446-469e-b2c5-390f3e9cc9ae admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:20.478075 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5e82937a-5446-469e-b2c5-390f3e9cc9ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '546bb086783348c58a1cd68b488cb079'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:20.493565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5e82937a-5446-469e-b2c5-390f3e9cc9ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '546bb086783348c58a1cd68b488cb079'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:20.494331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5e82937a-5446-469e-b2c5-390f3e9cc9ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '546bb086783348c58a1cd68b488cb079'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:20.504383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5e82937a-5446-469e-b2c5-390f3e9cc9ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '546bb086783348c58a1cd68b488cb079'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:20.598273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5e82937a-5446-469e-b2c5-390f3e9cc9ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '546bb086783348c58a1cd68b488cb079'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:20.604580 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2667/5326] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:20 2022] DELETE /identity/v3/users/546bb086783348c58a1cd68b488cb079 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:21.088135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0f74e-19b3-4134-b9c5-9aff5e04791d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:21.090310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6cf0f74e-19b3-4134-b9c5-9aff5e04791d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:21.105270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0f74e-19b3-4134-b9c5-9aff5e04791d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:21.172915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fc089-8af4-42a1-9882-09648dbd5dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:21.173778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fc089-8af4-42a1-9882-09648dbd5dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:21.174084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fc089-8af4-42a1-9882-09648dbd5dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:21.174355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fc089-8af4-42a1-9882-09648dbd5dc1 admin admin] PATH_INFO: `/v3/projects/7450e958af574542bdef926127e340d7` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:21.175556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004fc089-8af4-42a1-9882-09648dbd5dc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7450e958af574542bdef926127e340d7)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:21.177538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004fc089-8af4-42a1-9882-09648dbd5dc1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:21.285241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-004fc089-8af4-42a1-9882-09648dbd5dc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7450e958af574542bdef926127e340d7', 'request_id': 'req-004fc089-8af4-42a1-9882-09648dbd5dc1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:21.291496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-004fc089-8af4-42a1-9882-09648dbd5dc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7450e958af574542bdef926127e340d7', 'request_id': 'req-004fc089-8af4-42a1-9882-09648dbd5dc1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:21.410725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-004fc089-8af4-42a1-9882-09648dbd5dc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7450e958af574542bdef926127e340d7', 'request_id': 'req-004fc089-8af4-42a1-9882-09648dbd5dc1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:21.423213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-004fc089-8af4-42a1-9882-09648dbd5dc1 admin admin] The token cache is being invalidate because project 7450e958af574542bdef926127e340d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:21.423510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-004fc089-8af4-42a1-9882-09648dbd5dc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:21.424223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-004fc089-8af4-42a1-9882-09648dbd5dc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:21.425938 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2660/5327] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:21 2022] DELETE /identity/v3/projects/7450e958af574542bdef926127e340d7 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:21.430980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08963aec-59bc-4c23-92bf-2694f388a997 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:21.430980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08963aec-59bc-4c23-92bf-2694f388a997 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:21.431556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08963aec-59bc-4c23-92bf-2694f388a997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:21.450832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-08963aec-59bc-4c23-92bf-2694f388a997 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:21.452051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-08963aec-59bc-4c23-92bf-2694f388a997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:21.509281 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2668/5328] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:38:21.517519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599dbf1-1e85-4b79-9438-e75b2263205f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:21.517811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599dbf1-1e85-4b79-9438-e75b2263205f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:21.518095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599dbf1-1e85-4b79-9438-e75b2263205f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:21.536194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8599dbf1-1e85-4b79-9438-e75b2263205f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:21.537431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8599dbf1-1e85-4b79-9438-e75b2263205f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:21.545652 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2661/5329] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:21.549857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08963aec-59bc-4c23-92bf-2694f388a997 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:21.560157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08963aec-59bc-4c23-92bf-2694f388a997 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:21.564900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84f99a-58de-4667-bb9e-fdc28e5cf05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:21.565559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84f99a-58de-4667-bb9e-fdc28e5cf05e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:21.565841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84f99a-58de-4667-bb9e-fdc28e5cf05e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:21.566118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84f99a-58de-4667-bb9e-fdc28e5cf05e admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:21.566841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84f99a-58de-4667-bb9e-fdc28e5cf05e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:38:21.567160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84f99a-58de-4667-bb9e-fdc28e5cf05e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:21.568727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84f99a-58de-4667-bb9e-fdc28e5cf05e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:21.581102 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2669/5330] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:21.585484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599dbf1-1e85-4b79-9438-e75b2263205f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:21.595108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599dbf1-1e85-4b79-9438-e75b2263205f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:21.602109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e922e0-64d5-4dd6-b163-2b69011c5867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:21.602782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e922e0-64d5-4dd6-b163-2b69011c5867 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:21.609258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e922e0-64d5-4dd6-b163-2b69011c5867 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:21.609258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e922e0-64d5-4dd6-b163-2b69011c5867 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:21.609258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e922e0-64d5-4dd6-b163-2b69011c5867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:21.609258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e922e0-64d5-4dd6-b163-2b69011c5867 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:21.695985 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2662/5331] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:38:21 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:38:21.697306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84f99a-58de-4667-bb9e-fdc28e5cf05e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:21.707904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84f99a-58de-4667-bb9e-fdc28e5cf05e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:21.766966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1eb18b-af34-483b-9868-9605d6e755e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:21.767654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1eb18b-af34-483b-9868-9605d6e755e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:21.767938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1eb18b-af34-483b-9868-9605d6e755e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:21.768218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1eb18b-af34-483b-9868-9605d6e755e1 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:21.768950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1eb18b-af34-483b-9868-9605d6e755e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:21.770915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1eb18b-af34-483b-9868-9605d6e755e1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:22.009027 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2670/5332] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:38:21 2022] POST /identity/v3/users => generated 285 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:22.010125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e922e0-64d5-4dd6-b163-2b69011c5867 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:22.020633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e922e0-64d5-4dd6-b163-2b69011c5867 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:22.025602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206648fe-98b6-40ce-b7bc-bf975b2f0d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:22.026382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206648fe-98b6-40ce-b7bc-bf975b2f0d23 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:22.030754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206648fe-98b6-40ce-b7bc-bf975b2f0d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:22.030754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206648fe-98b6-40ce-b7bc-bf975b2f0d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:22.030754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206648fe-98b6-40ce-b7bc-bf975b2f0d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:22.030754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206648fe-98b6-40ce-b7bc-bf975b2f0d23 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:22.044340 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2663/5333] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:38:22.045857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1eb18b-af34-483b-9868-9605d6e755e1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:22.055701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1eb18b-af34-483b-9868-9605d6e755e1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:22.060914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095eb11-862f-4f27-9e32-917a7bd11ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:22.061572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095eb11-862f-4f27-9e32-917a7bd11ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:22.061854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095eb11-862f-4f27-9e32-917a7bd11ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:22.062131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095eb11-862f-4f27-9e32-917a7bd11ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:22.062846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095eb11-862f-4f27-9e32-917a7bd11ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:22.064422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095eb11-862f-4f27-9e32-917a7bd11ac6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:22.078436 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2671/5334] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:38:22.082459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206648fe-98b6-40ce-b7bc-bf975b2f0d23 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:22.089796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206648fe-98b6-40ce-b7bc-bf975b2f0d23 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:22.096902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ae3d7-721b-40bd-a467-64f4ffc73449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:22.097910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ae3d7-721b-40bd-a467-64f4ffc73449 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:22.098267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ae3d7-721b-40bd-a467-64f4ffc73449 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:22.098622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ae3d7-721b-40bd-a467-64f4ffc73449 admin admin] PATH_INFO: `/v3/projects/e1c11aa9d60a4ebc88025b34cf9c418c/users/b620c3c369414089a6441bd8140c3145/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:22.117650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ae3d7-721b-40bd-a467-64f4ffc73449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c11aa9d60a4ebc88025b34cf9c418c, user_id=b620c3c369414089a6441bd8140c3145, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:22.120329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ae3d7-721b-40bd-a467-64f4ffc73449 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:22.182678 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2664/5335] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:22 2022] PUT /identity/v3/projects/e1c11aa9d60a4ebc88025b34cf9c418c/users/b620c3c369414089a6441bd8140c3145/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:22.196229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d415c-944b-4881-908b-7849e6eb3297 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:22.196508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d415c-944b-4881-908b-7849e6eb3297 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:22.196885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d415c-944b-4881-908b-7849e6eb3297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:22.225430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ca5d415c-944b-4881-908b-7849e6eb3297 None None] MFA Rules not processed for user `b620c3c369414089a6441bd8140c3145`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:22.226630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ca5d415c-944b-4881-908b-7849e6eb3297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:22.301743 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2672/5336] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:38:22.303571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ae3d7-721b-40bd-a467-64f4ffc73449 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:22.370140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ae3d7-721b-40bd-a467-64f4ffc73449 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:22.374935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7554d53-98b1-476e-adad-7f847c827b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:22.375598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7554d53-98b1-476e-adad-7f847c827b46 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:22.376136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7554d53-98b1-476e-adad-7f847c827b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:22.376415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7554d53-98b1-476e-adad-7f847c827b46 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:22.377135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7554d53-98b1-476e-adad-7f847c827b46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:22.379058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7554d53-98b1-476e-adad-7f847c827b46 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:22.462144 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2665/5337] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:38:22 2022] POST /identity/v3/projects => generated 371 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:38:22.464530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d415c-944b-4881-908b-7849e6eb3297 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:22.475441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d415c-944b-4881-908b-7849e6eb3297 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:22.535900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f514da8-26b0-4e15-b860-89604210c6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:22.536488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f514da8-26b0-4e15-b860-89604210c6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:22.536801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f514da8-26b0-4e15-b860-89604210c6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:22.537093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f514da8-26b0-4e15-b860-89604210c6f7 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:22.537941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f514da8-26b0-4e15-b860-89604210c6f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:22.539857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f514da8-26b0-4e15-b860-89604210c6f7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:22.639890 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2673/5338] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:38:22 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:22.643939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7554d53-98b1-476e-adad-7f847c827b46 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:22.656149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7554d53-98b1-476e-adad-7f847c827b46 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:22.661834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72c64a-d9d5-4577-972e-97595ff98aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:22.662606 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72c64a-d9d5-4577-972e-97595ff98aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:22.662892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72c64a-d9d5-4577-972e-97595ff98aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:22.663195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72c64a-d9d5-4577-972e-97595ff98aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:22.664011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72c64a-d9d5-4577-972e-97595ff98aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:22.665689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72c64a-d9d5-4577-972e-97595ff98aa7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:22.677209 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2666/5339] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:38:22.681257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f514da8-26b0-4e15-b860-89604210c6f7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:22.692223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f514da8-26b0-4e15-b860-89604210c6f7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:22.696946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521fec6-35da-4c10-be7d-f11c96a4ec22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:22.697835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521fec6-35da-4c10-be7d-f11c96a4ec22 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:22.698122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521fec6-35da-4c10-be7d-f11c96a4ec22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:22.698399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521fec6-35da-4c10-be7d-f11c96a4ec22 admin admin] PATH_INFO: `/v3/projects/5a5779f9a13b4c4bb89af84ad829efa3/users/24e8cfad5a1c46cc897c12aaa05e575c/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:22.713806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521fec6-35da-4c10-be7d-f11c96a4ec22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5779f9a13b4c4bb89af84ad829efa3, user_id=24e8cfad5a1c46cc897c12aaa05e575c, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:22.719409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521fec6-35da-4c10-be7d-f11c96a4ec22 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:22.782498 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2674/5340] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:22 2022] PUT /identity/v3/projects/5a5779f9a13b4c4bb89af84ad829efa3/users/24e8cfad5a1c46cc897c12aaa05e575c/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:22.786544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72c64a-d9d5-4577-972e-97595ff98aa7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:22.797443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72c64a-d9d5-4577-972e-97595ff98aa7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:22.856998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dec5aa-412b-4ebe-bd0b-5be581c42af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:22.857697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dec5aa-412b-4ebe-bd0b-5be581c42af9 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:22.857986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dec5aa-412b-4ebe-bd0b-5be581c42af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:22.858261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dec5aa-412b-4ebe-bd0b-5be581c42af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:22.858987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dec5aa-412b-4ebe-bd0b-5be581c42af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:22.860673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dec5aa-412b-4ebe-bd0b-5be581c42af9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:22.871953 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2667/5341] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:38:22.876353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521fec6-35da-4c10-be7d-f11c96a4ec22 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:22.888475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521fec6-35da-4c10-be7d-f11c96a4ec22 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:22.893816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961eeacc-96ea-494c-9aa0-2a4079fb72c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:22.894908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eeacc-96ea-494c-9aa0-2a4079fb72c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:22.895265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eeacc-96ea-494c-9aa0-2a4079fb72c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:22.895612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eeacc-96ea-494c-9aa0-2a4079fb72c8 admin admin] PATH_INFO: `/v3/projects/5a5779f9a13b4c4bb89af84ad829efa3/users/24e8cfad5a1c46cc897c12aaa05e575c/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:22.897837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961eeacc-96ea-494c-9aa0-2a4079fb72c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5779f9a13b4c4bb89af84ad829efa3, user_id=24e8cfad5a1c46cc897c12aaa05e575c, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:22.907646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961eeacc-96ea-494c-9aa0-2a4079fb72c8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:22.928644 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2675/5342] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:22 2022] PUT /identity/v3/projects/5a5779f9a13b4c4bb89af84ad829efa3/users/24e8cfad5a1c46cc897c12aaa05e575c/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:22.937616 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c41b4-cb00-42d7-9307-36c754080de2 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:22.937970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c41b4-cb00-42d7-9307-36c754080de2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:22.938266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c41b4-cb00-42d7-9307-36c754080de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:22.970602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b58c41b4-cb00-42d7-9307-36c754080de2 None None] MFA Rules not processed for user `24e8cfad5a1c46cc897c12aaa05e575c`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:22.971918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b58c41b4-cb00-42d7-9307-36c754080de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:23.066472 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2668/5343] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:22 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:23.070935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961eeacc-96ea-494c-9aa0-2a4079fb72c8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:23.081616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961eeacc-96ea-494c-9aa0-2a4079fb72c8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:23.087165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192aa66-0b39-4d06-9288-f7f572cb5ac7 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:23.087838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192aa66-0b39-4d06-9288-f7f572cb5ac7 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:23.088128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192aa66-0b39-4d06-9288-f7f572cb5ac7 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:23.088442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192aa66-0b39-4d06-9288-f7f572cb5ac7 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:23.089251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192aa66-0b39-4d06-9288-f7f572cb5ac7 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:23.090808 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-5192aa66-0b39-4d06-9288-f7f572cb5ac7 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:38:23.090808 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:38:23.090808 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:38:23.098923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192aa66-0b39-4d06-9288-f7f572cb5ac7 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:23.178100 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2676/5344] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:38:23 2022] POST /identity/v3/services => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:23.182323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c41b4-cb00-42d7-9307-36c754080de2 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:23.191613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c41b4-cb00-42d7-9307-36c754080de2 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:23.206916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc37fac-eb85-4b33-83fb-f993fa08e9da tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:23.207585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc37fac-eb85-4b33-83fb-f993fa08e9da tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:23.207872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc37fac-eb85-4b33-83fb-f993fa08e9da tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:23.208150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc37fac-eb85-4b33-83fb-f993fa08e9da tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:23.208987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc37fac-eb85-4b33-83fb-f993fa08e9da tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:23.216462 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-7cc37fac-eb85-4b33-83fb-f993fa08e9da tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:38:23.216462 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:38:23.216462 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:38:23.216462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc37fac-eb85-4b33-83fb-f993fa08e9da tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:23.306653 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-7cc37fac-eb85-4b33-83fb-f993fa08e9da tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1998890299. To ensure interoperability, identifiers should be a valid uuid. May 02 10:38:23.306653 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 02 10:38:23.306653 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:38:23.400841 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2669/5345] 10.222.0.16 () {60 vars in 1155 bytes} [Mon May 2 10:38:23 2022] POST /identity/v3/endpoints => generated 360 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:23.405653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192aa66-0b39-4d06-9288-f7f572cb5ac7 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:23.417134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192aa66-0b39-4d06-9288-f7f572cb5ac7 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:23.432515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f149e6-0262-4d0a-8145-6a7767d59640 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:23.433552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f149e6-0262-4d0a-8145-6a7767d59640 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:23.433872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f149e6-0262-4d0a-8145-6a7767d59640 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:23.434156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f149e6-0262-4d0a-8145-6a7767d59640 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/regions/tempest-region-1998890299` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:23.434822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f149e6-0262-4d0a-8145-6a7767d59640 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1998890299)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:23.435965 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f149e6-0262-4d0a-8145-6a7767d59640 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:23.438008 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2677/5346] 10.222.0.16 () {58 vars in 1205 bytes} [Mon May 2 10:38:23 2022] GET /identity/v3/regions/tempest-region-1998890299 => generated 180 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:23.442175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc37fac-eb85-4b33-83fb-f993fa08e9da tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:23.454226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc37fac-eb85-4b33-83fb-f993fa08e9da tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:23.458962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771369e4-af4a-45ca-a930-f7ae6a1d2831 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:23.459675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771369e4-af4a-45ca-a930-f7ae6a1d2831 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:23.459967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771369e4-af4a-45ca-a930-f7ae6a1d2831 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:23.460252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771369e4-af4a-45ca-a930-f7ae6a1d2831 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:23.461060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771369e4-af4a-45ca-a930-f7ae6a1d2831 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:23.462085 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-771369e4-af4a-45ca-a930-f7ae6a1d2831 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:38:23.462085 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:38:23.462085 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:38:23.462979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771369e4-af4a-45ca-a930-f7ae6a1d2831 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:23.561265 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2670/5347] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:38:23 2022] POST /identity/v3/services => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:23.562387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f149e6-0262-4d0a-8145-6a7767d59640 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:23.572722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f149e6-0262-4d0a-8145-6a7767d59640 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:23.589021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfaa88c-f2f1-47f2-a9ce-cec3ee9a0bdf tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:23.590414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfaa88c-f2f1-47f2-a9ce-cec3ee9a0bdf tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:23.590704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfaa88c-f2f1-47f2-a9ce-cec3ee9a0bdf tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:23.590984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfaa88c-f2f1-47f2-a9ce-cec3ee9a0bdf tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:23.591744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfaa88c-f2f1-47f2-a9ce-cec3ee9a0bdf tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:23.592833 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-6dfaa88c-f2f1-47f2-a9ce-cec3ee9a0bdf tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:38:23.592833 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:38:23.592833 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:38:23.593856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfaa88c-f2f1-47f2-a9ce-cec3ee9a0bdf tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:23.674214 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-6dfaa88c-f2f1-47f2-a9ce-cec3ee9a0bdf tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1358929222. To ensure interoperability, identifiers should be a valid uuid. May 02 10:38:23.674214 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 02 10:38:23.674214 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:38:23.766091 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2678/5348] 10.222.0.16 () {60 vars in 1155 bytes} [Mon May 2 10:38:23 2022] POST /identity/v3/endpoints => generated 362 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:38:23.770407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771369e4-af4a-45ca-a930-f7ae6a1d2831 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:23.780776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771369e4-af4a-45ca-a930-f7ae6a1d2831 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:23.796784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1653660-61fd-4cfb-a657-614d221fd450 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:23.797657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1653660-61fd-4cfb-a657-614d221fd450 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:23.797966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1653660-61fd-4cfb-a657-614d221fd450 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:23.798273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1653660-61fd-4cfb-a657-614d221fd450 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/regions/tempest-region-1358929222` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:23.798924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1653660-61fd-4cfb-a657-614d221fd450 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1358929222)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:23.799997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1653660-61fd-4cfb-a657-614d221fd450 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:23.802058 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2671/5349] 10.222.0.16 () {58 vars in 1205 bytes} [Mon May 2 10:38:23 2022] GET /identity/v3/regions/tempest-region-1358929222 => generated 180 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:23.806497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfaa88c-f2f1-47f2-a9ce-cec3ee9a0bdf tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:23.822418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfaa88c-f2f1-47f2-a9ce-cec3ee9a0bdf tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:23.822418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfe6fa-3f55-4836-bd14-c2db824bb3ad tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:23.822725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfe6fa-3f55-4836-bd14-c2db824bb3ad tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:23.822868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfe6fa-3f55-4836-bd14-c2db824bb3ad tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:23.823174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfe6fa-3f55-4836-bd14-c2db824bb3ad tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:23.824531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dfe6fa-3f55-4836-bd14-c2db824bb3ad tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:23.826132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dfe6fa-3f55-4836-bd14-c2db824bb3ad tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:23.936617 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-b3dfe6fa-3f55-4836-bd14-c2db824bb3ad tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1147796569. To ensure interoperability, identifiers should be a valid uuid. May 02 10:38:23.936617 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 02 10:38:23.936617 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:38:24.047080 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2679/5350] 10.222.0.16 () {60 vars in 1155 bytes} [Mon May 2 10:38:23 2022] POST /identity/v3/endpoints => generated 360 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:24.051185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1653660-61fd-4cfb-a657-614d221fd450 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:24.061918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1653660-61fd-4cfb-a657-614d221fd450 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:24.077398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6808852-de1a-4ddf-866d-fc3a80129f0f tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:24.078171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6808852-de1a-4ddf-866d-fc3a80129f0f tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:24.078516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6808852-de1a-4ddf-866d-fc3a80129f0f tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:24.078743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6808852-de1a-4ddf-866d-fc3a80129f0f tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/regions/tempest-region-1147796569` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:24.079401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6808852-de1a-4ddf-866d-fc3a80129f0f tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1147796569)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:24.080466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6808852-de1a-4ddf-866d-fc3a80129f0f tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:24.082430 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2672/5351] 10.222.0.16 () {58 vars in 1205 bytes} [Mon May 2 10:38:24 2022] GET /identity/v3/regions/tempest-region-1147796569 => generated 180 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:24.086575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfe6fa-3f55-4836-bd14-c2db824bb3ad tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:24.097607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfe6fa-3f55-4836-bd14-c2db824bb3ad tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:24.108570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831d864-ba97-4987-98d1-87219bb92191 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:24.109650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831d864-ba97-4987-98d1-87219bb92191 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:24.109650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831d864-ba97-4987-98d1-87219bb92191 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:24.109909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831d864-ba97-4987-98d1-87219bb92191 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:24.110557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831d864-ba97-4987-98d1-87219bb92191 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:24.111566 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-e831d864-ba97-4987-98d1-87219bb92191 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:38:24.111566 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:38:24.111566 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:38:24.113214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831d864-ba97-4987-98d1-87219bb92191 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:24.125106 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2680/5352] 10.222.0.16 () {58 vars in 1133 bytes} [Mon May 2 10:38:24 2022] GET /identity/v3/endpoints => generated 4386 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:38:24.129375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6808852-de1a-4ddf-866d-fc3a80129f0f tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:24.139329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6808852-de1a-4ddf-866d-fc3a80129f0f tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:24.143897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b835cd-77e5-4da8-82b5-d4980bf87e65 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:24.144774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b835cd-77e5-4da8-82b5-d4980bf87e65 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:24.145058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b835cd-77e5-4da8-82b5-d4980bf87e65 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:24.145333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b835cd-77e5-4da8-82b5-d4980bf87e65 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/endpoints/d9472780087746c4bcf5ba6098b54869` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:24.151690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b835cd-77e5-4da8-82b5-d4980bf87e65 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=d9472780087746c4bcf5ba6098b54869)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:24.152792 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-89b835cd-77e5-4da8-82b5-d4980bf87e65 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:38:24.152792 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:38:24.152792 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:38:24.153673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b835cd-77e5-4da8-82b5-d4980bf87e65 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:24.155322 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2673/5353] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:24 2022] GET /identity/v3/endpoints/d9472780087746c4bcf5ba6098b54869 => generated 360 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:24.165343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831d864-ba97-4987-98d1-87219bb92191 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:24.176181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831d864-ba97-4987-98d1-87219bb92191 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:24.180983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488277b-8351-4ae0-907f-cced9868bc19 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:24.181833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488277b-8351-4ae0-907f-cced9868bc19 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:24.182120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488277b-8351-4ae0-907f-cced9868bc19 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:24.182413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488277b-8351-4ae0-907f-cced9868bc19 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/endpoints/d9472780087746c4bcf5ba6098b54869` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:24.184281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488277b-8351-4ae0-907f-cced9868bc19 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=d9472780087746c4bcf5ba6098b54869)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:24.185334 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-1488277b-8351-4ae0-907f-cced9868bc19 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:38:24.185334 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:38:24.185334 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:38:24.186314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488277b-8351-4ae0-907f-cced9868bc19 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:24.285052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1488277b-8351-4ae0-907f-cced9868bc19 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'd9472780087746c4bcf5ba6098b54869', 'request_id': 'req-1488277b-8351-4ae0-907f-cced9868bc19'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:24.296018 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2681/5354] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 2 10:38:24 2022] DELETE /identity/v3/endpoints/d9472780087746c4bcf5ba6098b54869 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:24.299867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b835cd-77e5-4da8-82b5-d4980bf87e65 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:24.310508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b835cd-77e5-4da8-82b5-d4980bf87e65 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:24.324996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28c423-355c-4483-9290-7818396a0f3d tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:24.325639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28c423-355c-4483-9290-7818396a0f3d tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:24.325924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28c423-355c-4483-9290-7818396a0f3d tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:24.326202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28c423-355c-4483-9290-7818396a0f3d tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:24.326900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28c423-355c-4483-9290-7818396a0f3d tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:24.327960 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-5d28c423-355c-4483-9290-7818396a0f3d tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:38:24.327960 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:38:24.327960 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:38:24.328820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28c423-355c-4483-9290-7818396a0f3d tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:24.338248 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2674/5355] 10.222.0.16 () {58 vars in 1133 bytes} [Mon May 2 10:38:24 2022] GET /identity/v3/endpoints => generated 4039 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:38:24.342663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488277b-8351-4ae0-907f-cced9868bc19 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:24.353474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488277b-8351-4ae0-907f-cced9868bc19 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:24.358732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f291553-ccb8-4729-8d9e-1828c43f6763 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:24.359595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f291553-ccb8-4729-8d9e-1828c43f6763 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:24.359879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f291553-ccb8-4729-8d9e-1828c43f6763 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:24.360158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f291553-ccb8-4729-8d9e-1828c43f6763 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/endpoints/d9472780087746c4bcf5ba6098b54869` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:24.364547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f291553-ccb8-4729-8d9e-1828c43f6763 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:38:24.381957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-4f291553-ccb8-4729-8d9e-1828c43f6763 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Could not find endpoint: d9472780087746c4bcf5ba6098b54869.: keystone.exception.EndpointNotFound: Could not find endpoint: d9472780087746c4bcf5ba6098b54869. May 02 10:38:24.381957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:38:24.381957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint May 02 10:38:24.381957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() May 02 10:38:24.381957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one May 02 10:38:24.381957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._iter().one() May 02 10:38:24.381957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one May 02 10:38:24.381957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._only_one_row( May 02 10:38:24.381957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row May 02 10:38:24.381957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exc.NoResultFound( May 02 10:38:24.381957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required May 02 10:38:24.381957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:38:24.381957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:38:24.381957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:38:24.381957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:38:24.381957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint May 02 10:38:24.383321 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) May 02 10:38:24.383321 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint May 02 10:38:24.383321 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() May 02 10:38:24.383321 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint May 02 10:38:24.383321 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) May 02 10:38:24.383321 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: d9472780087746c4bcf5ba6098b54869. May 02 10:38:24.383321 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:38:24.383321 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:38:24.383321 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:38:24.383321 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:38:24.383321 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:38:24.383321 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:38:24.383321 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:38:24.383321 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:38:24.383321 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:38:24.383321 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:38:24.383321 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:38:24.384752 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:38:24.384752 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:38:24.384752 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:38:24.384752 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete May 02 10:38:24.384752 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') May 02 10:38:24.384752 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:38:24.384752 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:38:24.384752 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:38:24.384752 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:38:24.384752 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:38:24.384752 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:38:24.384752 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:38:24.384752 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:38:24.384752 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:38:24.384752 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:38:24.384752 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:38:24.385924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:38:24.385924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:38:24.385924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:38:24.385924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:38:24.385924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:38:24.385924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:38:24.385924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:38:24.385924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:38:24.385924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:38:24.385924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint May 02 10:38:24.385924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) May 02 10:38:24.385924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: d9472780087746c4bcf5ba6098b54869. May 02 10:38:24.385924 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:38:24.385924 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2682/5356] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 2 10:38:24 2022] DELETE /identity/v3/endpoints/d9472780087746c4bcf5ba6098b54869 => generated 114 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:38:24.387342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28c423-355c-4483-9290-7818396a0f3d tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:24.397333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28c423-355c-4483-9290-7818396a0f3d tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:24.403628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3cd109-0c9e-4f3d-b18f-468cddd0d70a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:24.404747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cd109-0c9e-4f3d-b18f-468cddd0d70a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:24.405218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cd109-0c9e-4f3d-b18f-468cddd0d70a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:24.405503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cd109-0c9e-4f3d-b18f-468cddd0d70a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/regions/tempest-region-1147796569` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:24.406172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3cd109-0c9e-4f3d-b18f-468cddd0d70a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1147796569)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:24.407782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3cd109-0c9e-4f3d-b18f-468cddd0d70a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:24.479613 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-4d3cd109-0c9e-4f3d-b18f-468cddd0d70a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1147796569. To ensure interoperability, identifiers should be a valid uuid. May 02 10:38:24.479613 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 02 10:38:24.479613 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:38:24.489161 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2675/5357] 10.222.0.16 () {58 vars in 1208 bytes} [Mon May 2 10:38:24 2022] DELETE /identity/v3/regions/tempest-region-1147796569 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:24.494335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f291553-ccb8-4729-8d9e-1828c43f6763 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:24.505406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f291553-ccb8-4729-8d9e-1828c43f6763 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:24.519824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47584a54-1f18-401a-8889-e74899ef4621 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:24.524103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47584a54-1f18-401a-8889-e74899ef4621 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:24.524103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47584a54-1f18-401a-8889-e74899ef4621 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:24.524103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47584a54-1f18-401a-8889-e74899ef4621 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:24.524103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47584a54-1f18-401a-8889-e74899ef4621 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:24.524103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47584a54-1f18-401a-8889-e74899ef4621 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:24.535817 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2683/5358] 10.222.0.16 () {58 vars in 1133 bytes} [Mon May 2 10:38:24 2022] GET /identity/v3/endpoints => generated 4039 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:38:24.536846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3cd109-0c9e-4f3d-b18f-468cddd0d70a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:24.555567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3cd109-0c9e-4f3d-b18f-468cddd0d70a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:24.560540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c65d7e-3163-4727-b8e7-fb52248b7506 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:24.561256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c65d7e-3163-4727-b8e7-fb52248b7506 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:24.561545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c65d7e-3163-4727-b8e7-fb52248b7506 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:24.561824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c65d7e-3163-4727-b8e7-fb52248b7506 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:24.562587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c65d7e-3163-4727-b8e7-fb52248b7506 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Adding query filter params (service_id=b025ab9ca28e4117ac1c7535c75f9e42) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:38:24.562873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c65d7e-3163-4727-b8e7-fb52248b7506 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:24.564591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c65d7e-3163-4727-b8e7-fb52248b7506 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:24.571182 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2676/5359] 10.222.0.16 () {58 vars in 1220 bytes} [Mon May 2 10:38:24 2022] GET /identity/v3/endpoints?service_id=b025ab9ca28e4117ac1c7535c75f9e42 => generated 502 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:24.575526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47584a54-1f18-401a-8889-e74899ef4621 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:24.587534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47584a54-1f18-401a-8889-e74899ef4621 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:24.592865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7b1be-07f1-4f6f-8811-8682b1a2e37a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:24.593519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7b1be-07f1-4f6f-8811-8682b1a2e37a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:24.593805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7b1be-07f1-4f6f-8811-8682b1a2e37a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:24.594084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7b1be-07f1-4f6f-8811-8682b1a2e37a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:24.594814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7b1be-07f1-4f6f-8811-8682b1a2e37a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Adding query filter params (service_id=e9214fbe091449ada51ee5fc7688e9ab) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:38:24.595124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7b1be-07f1-4f6f-8811-8682b1a2e37a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:24.596785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7b1be-07f1-4f6f-8811-8682b1a2e37a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:24.603204 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2684/5360] 10.222.0.16 () {58 vars in 1220 bytes} [Mon May 2 10:38:24 2022] GET /identity/v3/endpoints?service_id=e9214fbe091449ada51ee5fc7688e9ab => generated 504 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:24.608032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c65d7e-3163-4727-b8e7-fb52248b7506 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:24.618537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c65d7e-3163-4727-b8e7-fb52248b7506 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:24.623429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdccd68-6416-45cd-8e71-52bab003e7ee tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:24.624083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdccd68-6416-45cd-8e71-52bab003e7ee tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:24.624375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdccd68-6416-45cd-8e71-52bab003e7ee tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:24.624702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdccd68-6416-45cd-8e71-52bab003e7ee tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:24.625500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdccd68-6416-45cd-8e71-52bab003e7ee tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:38:24.626062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdccd68-6416-45cd-8e71-52bab003e7ee tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:24.627693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdccd68-6416-45cd-8e71-52bab003e7ee tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:24.637256 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2677/5361] 10.222.0.16 () {58 vars in 1166 bytes} [Mon May 2 10:38:24 2022] GET /identity/v3/endpoints?interface=public => generated 3395 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:38:24.642808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7b1be-07f1-4f6f-8811-8682b1a2e37a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:24.651060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7b1be-07f1-4f6f-8811-8682b1a2e37a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:24.656215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29380b98-5f1b-4bca-b71c-10ab93b23b37 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:24.656939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29380b98-5f1b-4bca-b71c-10ab93b23b37 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:24.657222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29380b98-5f1b-4bca-b71c-10ab93b23b37 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:24.657502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29380b98-5f1b-4bca-b71c-10ab93b23b37 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:24.658231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29380b98-5f1b-4bca-b71c-10ab93b23b37 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:38:24.658538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29380b98-5f1b-4bca-b71c-10ab93b23b37 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:24.660113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29380b98-5f1b-4bca-b71c-10ab93b23b37 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:24.666606 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2685/5362] 10.222.0.16 () {58 vars in 1170 bytes} [Mon May 2 10:38:24 2022] GET /identity/v3/endpoints?interface=internal => generated 479 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:24.675307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdccd68-6416-45cd-8e71-52bab003e7ee tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:24.685359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdccd68-6416-45cd-8e71-52bab003e7ee tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:24.690231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5909c-d932-48b1-878a-434469d7bb5e tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:24.690888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5909c-d932-48b1-878a-434469d7bb5e tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:24.694645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5909c-d932-48b1-878a-434469d7bb5e tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:24.694645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5909c-d932-48b1-878a-434469d7bb5e tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:24.694645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5909c-d932-48b1-878a-434469d7bb5e tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:24.694645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5909c-d932-48b1-878a-434469d7bb5e tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:24.811561 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2678/5363] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:38:24 2022] POST /identity/v3/services => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:24.815600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29380b98-5f1b-4bca-b71c-10ab93b23b37 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:24.827911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29380b98-5f1b-4bca-b71c-10ab93b23b37 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:24.844765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6014a2-ded4-4d3d-9146-91b13fd3a190 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:24.845437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6014a2-ded4-4d3d-9146-91b13fd3a190 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:24.845811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6014a2-ded4-4d3d-9146-91b13fd3a190 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:24.846098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6014a2-ded4-4d3d-9146-91b13fd3a190 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:24.846849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6014a2-ded4-4d3d-9146-91b13fd3a190 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:24.848563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6014a2-ded4-4d3d-9146-91b13fd3a190 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:24.941794 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-1f6014a2-ded4-4d3d-9146-91b13fd3a190 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-6857179. To ensure interoperability, identifiers should be a valid uuid. May 02 10:38:24.941794 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 02 10:38:24.941794 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:38:25.045349 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2686/5364] 10.222.0.16 () {60 vars in 1155 bytes} [Mon May 2 10:38:24 2022] POST /identity/v3/endpoints => generated 355 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:25.049434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5909c-d932-48b1-878a-434469d7bb5e tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:25.059681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5909c-d932-48b1-878a-434469d7bb5e tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:25.078336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e17b43-b9f0-4b13-b81c-41f4166f1da6 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:25.078336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e17b43-b9f0-4b13-b81c-41f4166f1da6 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:25.078591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e17b43-b9f0-4b13-b81c-41f4166f1da6 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:25.078708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e17b43-b9f0-4b13-b81c-41f4166f1da6 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/regions/tempest-region-6857179` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:25.079307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e17b43-b9f0-4b13-b81c-41f4166f1da6 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-6857179)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:25.080385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e17b43-b9f0-4b13-b81c-41f4166f1da6 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:25.082316 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2679/5365] 10.222.0.16 () {58 vars in 1196 bytes} [Mon May 2 10:38:25 2022] GET /identity/v3/regions/tempest-region-6857179 => generated 174 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:25.086369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6014a2-ded4-4d3d-9146-91b13fd3a190 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:25.098217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6014a2-ded4-4d3d-9146-91b13fd3a190 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:25.104264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a879155-5329-4ffc-8231-9657966416de tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:25.107177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a879155-5329-4ffc-8231-9657966416de tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:25.107177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a879155-5329-4ffc-8231-9657966416de tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:25.107177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a879155-5329-4ffc-8231-9657966416de tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/endpoints/577a4bf0ce3b45e8b0cf1fac629cbb86` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:25.111595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a879155-5329-4ffc-8231-9657966416de tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=577a4bf0ce3b45e8b0cf1fac629cbb86)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:25.112592 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-0a879155-5329-4ffc-8231-9657966416de tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:38:25.112592 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:38:25.112592 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:38:25.113509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a879155-5329-4ffc-8231-9657966416de tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:25.171022 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-0a879155-5329-4ffc-8231-9657966416de tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1230219070. To ensure interoperability, identifiers should be a valid uuid. May 02 10:38:25.171022 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 02 10:38:25.171022 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:38:25.291316 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2687/5366] 10.222.0.16 () {60 vars in 1255 bytes} [Mon May 2 10:38:25 2022] PATCH /identity/v3/endpoints/577a4bf0ce3b45e8b0cf1fac629cbb86 => generated 364 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:25.295308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e17b43-b9f0-4b13-b81c-41f4166f1da6 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:25.305810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e17b43-b9f0-4b13-b81c-41f4166f1da6 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:25.324870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fbeb7-0573-4bed-a2fa-239b251fcc3f tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:25.325703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fbeb7-0573-4bed-a2fa-239b251fcc3f tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:25.325987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fbeb7-0573-4bed-a2fa-239b251fcc3f tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:25.326262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fbeb7-0573-4bed-a2fa-239b251fcc3f tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/regions/tempest-region-1230219070` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:25.326903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1fbeb7-0573-4bed-a2fa-239b251fcc3f tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1230219070)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:25.328039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1fbeb7-0573-4bed-a2fa-239b251fcc3f tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:25.332831 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2680/5367] 10.222.0.16 () {58 vars in 1205 bytes} [Mon May 2 10:38:25 2022] GET /identity/v3/regions/tempest-region-1230219070 => generated 180 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:25.334294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a879155-5329-4ffc-8231-9657966416de tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:25.344892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a879155-5329-4ffc-8231-9657966416de tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:25.349570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d94095-e979-4d0a-b3de-c5cbd46dd085 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:25.350355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d94095-e979-4d0a-b3de-c5cbd46dd085 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:25.350641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d94095-e979-4d0a-b3de-c5cbd46dd085 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:25.350986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d94095-e979-4d0a-b3de-c5cbd46dd085 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/endpoints/577a4bf0ce3b45e8b0cf1fac629cbb86` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:25.358010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d94095-e979-4d0a-b3de-c5cbd46dd085 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=577a4bf0ce3b45e8b0cf1fac629cbb86)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:25.359664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d94095-e979-4d0a-b3de-c5cbd46dd085 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:25.445039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-06d94095-e979-4d0a-b3de-c5cbd46dd085 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '577a4bf0ce3b45e8b0cf1fac629cbb86', 'request_id': 'req-06d94095-e979-4d0a-b3de-c5cbd46dd085'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:25.457301 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2688/5368] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 2 10:38:25 2022] DELETE /identity/v3/endpoints/577a4bf0ce3b45e8b0cf1fac629cbb86 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:25.461086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fbeb7-0573-4bed-a2fa-239b251fcc3f tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:25.478675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fbeb7-0573-4bed-a2fa-239b251fcc3f tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:25.504333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3e4d7-c3d2-437b-8ed9-59461ebb66c4 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:25.505206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3e4d7-c3d2-437b-8ed9-59461ebb66c4 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:25.505486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3e4d7-c3d2-437b-8ed9-59461ebb66c4 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:25.505764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3e4d7-c3d2-437b-8ed9-59461ebb66c4 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/regions/tempest-region-1230219070` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:25.506412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3e4d7-c3d2-437b-8ed9-59461ebb66c4 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1230219070)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:25.508043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3e4d7-c3d2-437b-8ed9-59461ebb66c4 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:25.599428 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-c0a3e4d7-c3d2-437b-8ed9-59461ebb66c4 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1230219070. To ensure interoperability, identifiers should be a valid uuid. May 02 10:38:25.599428 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 02 10:38:25.599428 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:38:25.608560 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2681/5369] 10.222.0.16 () {58 vars in 1208 bytes} [Mon May 2 10:38:25 2022] DELETE /identity/v3/regions/tempest-region-1230219070 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:25.612342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d94095-e979-4d0a-b3de-c5cbd46dd085 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:25.624133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d94095-e979-4d0a-b3de-c5cbd46dd085 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:25.644304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed4fdd-dc6b-4054-b958-26711ce95f17 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:25.645292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed4fdd-dc6b-4054-b958-26711ce95f17 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:25.645674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed4fdd-dc6b-4054-b958-26711ce95f17 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:25.646021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed4fdd-dc6b-4054-b958-26711ce95f17 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/regions/tempest-region-6857179` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:25.646861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed4fdd-dc6b-4054-b958-26711ce95f17 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-6857179)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:25.648506 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed4fdd-dc6b-4054-b958-26711ce95f17 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:25.749793 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2689/5370] 10.222.0.16 () {58 vars in 1199 bytes} [Mon May 2 10:38:25 2022] DELETE /identity/v3/regions/tempest-region-6857179 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:25.754107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3e4d7-c3d2-437b-8ed9-59461ebb66c4 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:25.764534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3e4d7-c3d2-437b-8ed9-59461ebb66c4 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:25.779809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439269a-392f-44e8-bc04-3feabb7df773 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:25.780832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439269a-392f-44e8-bc04-3feabb7df773 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:25.781125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439269a-392f-44e8-bc04-3feabb7df773 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:25.781404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439269a-392f-44e8-bc04-3feabb7df773 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/services/99f2dd5c3fdb47d384ee2a221d45df6d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:25.782056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439269a-392f-44e8-bc04-3feabb7df773 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:delete_service(service_id=99f2dd5c3fdb47d384ee2a221d45df6d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:25.783075 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-4439269a-392f-44e8-bc04-3feabb7df773 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:38:25.783075 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:38:25.783075 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:38:25.783966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439269a-392f-44e8-bc04-3feabb7df773 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:25.875190 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2682/5371] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:25 2022] DELETE /identity/v3/services/99f2dd5c3fdb47d384ee2a221d45df6d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:25.880748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed4fdd-dc6b-4054-b958-26711ce95f17 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:25.891231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed4fdd-dc6b-4054-b958-26711ce95f17 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:25.906200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13fc1e-abc3-47f4-a331-855fdb6d51ec tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:25.907043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13fc1e-abc3-47f4-a331-855fdb6d51ec tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:25.907329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13fc1e-abc3-47f4-a331-855fdb6d51ec tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:25.907607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13fc1e-abc3-47f4-a331-855fdb6d51ec tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/endpoints/692d07c78c434e7eb73e8f04356952f4` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:25.912666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13fc1e-abc3-47f4-a331-855fdb6d51ec tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=692d07c78c434e7eb73e8f04356952f4)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:25.914272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13fc1e-abc3-47f4-a331-855fdb6d51ec tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:25.975929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ff13fc1e-abc3-47f4-a331-855fdb6d51ec tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '692d07c78c434e7eb73e8f04356952f4', 'request_id': 'req-ff13fc1e-abc3-47f4-a331-855fdb6d51ec'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:25.987363 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2690/5372] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 2 10:38:25 2022] DELETE /identity/v3/endpoints/692d07c78c434e7eb73e8f04356952f4 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:25.991341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439269a-392f-44e8-bc04-3feabb7df773 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:26.002407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439269a-392f-44e8-bc04-3feabb7df773 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:26.016954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55e3cb-9cc4-4950-84be-8b73429ff5a0 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:26.017783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55e3cb-9cc4-4950-84be-8b73429ff5a0 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:26.018068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55e3cb-9cc4-4950-84be-8b73429ff5a0 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:26.018347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55e3cb-9cc4-4950-84be-8b73429ff5a0 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/regions/tempest-region-1358929222` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:26.019001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55e3cb-9cc4-4950-84be-8b73429ff5a0 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1358929222)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:26.020659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55e3cb-9cc4-4950-84be-8b73429ff5a0 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:26.100988 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-dc55e3cb-9cc4-4950-84be-8b73429ff5a0 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1358929222. To ensure interoperability, identifiers should be a valid uuid. May 02 10:38:26.100988 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 02 10:38:26.100988 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:38:26.111330 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2683/5373] 10.222.0.16 () {58 vars in 1208 bytes} [Mon May 2 10:38:25 2022] DELETE /identity/v3/regions/tempest-region-1358929222 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:26.115547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13fc1e-abc3-47f4-a331-855fdb6d51ec tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:26.126143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13fc1e-abc3-47f4-a331-855fdb6d51ec tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:26.141019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7e38b-b2e9-4b83-9393-40acc23c862e tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:26.141869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7e38b-b2e9-4b83-9393-40acc23c862e tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:26.142158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7e38b-b2e9-4b83-9393-40acc23c862e tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:26.142434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7e38b-b2e9-4b83-9393-40acc23c862e tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/services/e9214fbe091449ada51ee5fc7688e9ab` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:26.143083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7e38b-b2e9-4b83-9393-40acc23c862e tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:delete_service(service_id=e9214fbe091449ada51ee5fc7688e9ab)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:26.144088 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-76e7e38b-b2e9-4b83-9393-40acc23c862e tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:38:26.144088 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:38:26.144088 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:38:26.145007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7e38b-b2e9-4b83-9393-40acc23c862e tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:26.257872 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2691/5374] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:26 2022] DELETE /identity/v3/services/e9214fbe091449ada51ee5fc7688e9ab => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:26.262483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55e3cb-9cc4-4950-84be-8b73429ff5a0 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:26.272977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55e3cb-9cc4-4950-84be-8b73429ff5a0 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:26.288692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad58a2-29c3-427f-a5a6-fa5834f94a78 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:26.289544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad58a2-29c3-427f-a5a6-fa5834f94a78 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:26.289832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad58a2-29c3-427f-a5a6-fa5834f94a78 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:26.290113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad58a2-29c3-427f-a5a6-fa5834f94a78 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/endpoints/6e28c93feb60442ab9dabc315c2759fd` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:26.295381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad58a2-29c3-427f-a5a6-fa5834f94a78 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=6e28c93feb60442ab9dabc315c2759fd)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:26.296415 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-33ad58a2-29c3-427f-a5a6-fa5834f94a78 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:38:26.296415 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:38:26.296415 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:38:26.297349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad58a2-29c3-427f-a5a6-fa5834f94a78 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:26.393125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-33ad58a2-29c3-427f-a5a6-fa5834f94a78 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '6e28c93feb60442ab9dabc315c2759fd', 'request_id': 'req-33ad58a2-29c3-427f-a5a6-fa5834f94a78'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:26.404283 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2684/5375] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 2 10:38:26 2022] DELETE /identity/v3/endpoints/6e28c93feb60442ab9dabc315c2759fd => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:26.408342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7e38b-b2e9-4b83-9393-40acc23c862e tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:26.419094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7e38b-b2e9-4b83-9393-40acc23c862e tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:26.433401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab813e4-9496-45a5-8b89-1283e1e00346 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:26.435387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab813e4-9496-45a5-8b89-1283e1e00346 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:26.435387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab813e4-9496-45a5-8b89-1283e1e00346 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:26.435387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab813e4-9496-45a5-8b89-1283e1e00346 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/regions/tempest-region-1998890299` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:26.435709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab813e4-9496-45a5-8b89-1283e1e00346 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1998890299)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:26.437143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab813e4-9496-45a5-8b89-1283e1e00346 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:26.524685 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-8ab813e4-9496-45a5-8b89-1283e1e00346 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1998890299. To ensure interoperability, identifiers should be a valid uuid. May 02 10:38:26.524685 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 02 10:38:26.524685 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:38:26.536741 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2692/5376] 10.222.0.16 () {58 vars in 1208 bytes} [Mon May 2 10:38:26 2022] DELETE /identity/v3/regions/tempest-region-1998890299 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:26.540508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad58a2-29c3-427f-a5a6-fa5834f94a78 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:26.551684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad58a2-29c3-427f-a5a6-fa5834f94a78 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:26.567574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e832e-9159-4077-8f39-4482d881524a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e8cfad5a1c46cc897c12aaa05e575c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a5779f9a13b4c4bb89af84ad829efa3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:26.568404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e832e-9159-4077-8f39-4482d881524a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:26.568725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e832e-9159-4077-8f39-4482d881524a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:26.569081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e832e-9159-4077-8f39-4482d881524a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] PATH_INFO: `/v3/services/b025ab9ca28e4117ac1c7535c75f9e42` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:26.569776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e832e-9159-4077-8f39-4482d881524a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b025ab9ca28e4117ac1c7535c75f9e42)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:26.571382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e832e-9159-4077-8f39-4482d881524a tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:26.664777 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2685/5377] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:26 2022] DELETE /identity/v3/services/b025ab9ca28e4117ac1c7535c75f9e42 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:26.669357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab813e4-9496-45a5-8b89-1283e1e00346 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:26.743360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab813e4-9496-45a5-8b89-1283e1e00346 tempest-EndPointsTestJSON-2073506339 tempest-EndPointsTestJSON-2073506339-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:26.758247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6b816-501b-4f72-92d7-693e4d44512e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:26.759138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6b816-501b-4f72-92d7-693e4d44512e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:26.759421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6b816-501b-4f72-92d7-693e4d44512e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:26.759698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6b816-501b-4f72-92d7-693e4d44512e admin admin] PATH_INFO: `/v3/users/b620c3c369414089a6441bd8140c3145` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:26.760920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6b816-501b-4f72-92d7-693e4d44512e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b620c3c369414089a6441bd8140c3145)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:26.762971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6b816-501b-4f72-92d7-693e4d44512e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:27.041639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75c6b816-501b-4f72-92d7-693e4d44512e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b620c3c369414089a6441bd8140c3145'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:27.053083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75c6b816-501b-4f72-92d7-693e4d44512e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b620c3c369414089a6441bd8140c3145'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:27.056346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75c6b816-501b-4f72-92d7-693e4d44512e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b620c3c369414089a6441bd8140c3145'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:27.060450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75c6b816-501b-4f72-92d7-693e4d44512e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b620c3c369414089a6441bd8140c3145'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:27.142328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75c6b816-501b-4f72-92d7-693e4d44512e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b620c3c369414089a6441bd8140c3145'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:27.148551 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2693/5378] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:26 2022] DELETE /identity/v3/users/b620c3c369414089a6441bd8140c3145 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:27.153684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c4c9b-8a23-4309-bef7-c4c48519c469 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:27.155547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c4c9b-8a23-4309-bef7-c4c48519c469 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:27.155547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c4c9b-8a23-4309-bef7-c4c48519c469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:27.174503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-930c4c9b-8a23-4309-bef7-c4c48519c469 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:27.175736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-930c4c9b-8a23-4309-bef7-c4c48519c469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:27.235471 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2686/5379] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:27.255553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6b816-501b-4f72-92d7-693e4d44512e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:27.257125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-75c6b816-501b-4f72-92d7-693e4d44512e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:27.327637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6b816-501b-4f72-92d7-693e4d44512e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:27.331420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b274097-1655-4bd3-9fb0-62124289774e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:27.332070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b274097-1655-4bd3-9fb0-62124289774e service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:27.332357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b274097-1655-4bd3-9fb0-62124289774e service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:27.332667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b274097-1655-4bd3-9fb0-62124289774e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:27.342588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b274097-1655-4bd3-9fb0-62124289774e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:27.344017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b274097-1655-4bd3-9fb0-62124289774e service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:27.353737 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2694/5380] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:38:27.740333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c4c9b-8a23-4309-bef7-c4c48519c469 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:27.741952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-930c4c9b-8a23-4309-bef7-c4c48519c469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:27.763839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c4c9b-8a23-4309-bef7-c4c48519c469 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:27.770094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14a262-02d5-48a2-a1fa-1cb49516708a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:27.771526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14a262-02d5-48a2-a1fa-1cb49516708a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:27.771820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14a262-02d5-48a2-a1fa-1cb49516708a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:27.772332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14a262-02d5-48a2-a1fa-1cb49516708a admin admin] PATH_INFO: `/v3/projects/e1c11aa9d60a4ebc88025b34cf9c418c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:27.776356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14a262-02d5-48a2-a1fa-1cb49516708a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1c11aa9d60a4ebc88025b34cf9c418c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:27.776356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14a262-02d5-48a2-a1fa-1cb49516708a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:27.936800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5e14a262-02d5-48a2-a1fa-1cb49516708a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1c11aa9d60a4ebc88025b34cf9c418c', 'request_id': 'req-5e14a262-02d5-48a2-a1fa-1cb49516708a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:27.942897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5e14a262-02d5-48a2-a1fa-1cb49516708a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1c11aa9d60a4ebc88025b34cf9c418c', 'request_id': 'req-5e14a262-02d5-48a2-a1fa-1cb49516708a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:28.061226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5e14a262-02d5-48a2-a1fa-1cb49516708a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1c11aa9d60a4ebc88025b34cf9c418c', 'request_id': 'req-5e14a262-02d5-48a2-a1fa-1cb49516708a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:28.071729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5e14a262-02d5-48a2-a1fa-1cb49516708a admin admin] The token cache is being invalidate because project e1c11aa9d60a4ebc88025b34cf9c418c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:28.072056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5e14a262-02d5-48a2-a1fa-1cb49516708a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:28.072754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5e14a262-02d5-48a2-a1fa-1cb49516708a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:28.074349 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2687/5381] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:27 2022] DELETE /identity/v3/projects/e1c11aa9d60a4ebc88025b34cf9c418c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:28.078345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b274097-1655-4bd3-9fb0-62124289774e service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:28.087926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b274097-1655-4bd3-9fb0-62124289774e service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:28.149428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100924e-8eb2-4103-b3da-1288cc7f8a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:28.150340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100924e-8eb2-4103-b3da-1288cc7f8a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:28.150586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100924e-8eb2-4103-b3da-1288cc7f8a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:28.150866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100924e-8eb2-4103-b3da-1288cc7f8a99 admin admin] PATH_INFO: `/v3/users/24e8cfad5a1c46cc897c12aaa05e575c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:28.152577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100924e-8eb2-4103-b3da-1288cc7f8a99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24e8cfad5a1c46cc897c12aaa05e575c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:28.154670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100924e-8eb2-4103-b3da-1288cc7f8a99 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:28.403674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5100924e-8eb2-4103-b3da-1288cc7f8a99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24e8cfad5a1c46cc897c12aaa05e575c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:28.415545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5100924e-8eb2-4103-b3da-1288cc7f8a99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24e8cfad5a1c46cc897c12aaa05e575c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:28.416248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5100924e-8eb2-4103-b3da-1288cc7f8a99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24e8cfad5a1c46cc897c12aaa05e575c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:28.423069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5100924e-8eb2-4103-b3da-1288cc7f8a99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24e8cfad5a1c46cc897c12aaa05e575c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:28.639245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5100924e-8eb2-4103-b3da-1288cc7f8a99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24e8cfad5a1c46cc897c12aaa05e575c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:28.646088 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2695/5382] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:28 2022] DELETE /identity/v3/users/24e8cfad5a1c46cc897c12aaa05e575c => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:29.406712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14a262-02d5-48a2-a1fa-1cb49516708a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:29.408804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5e14a262-02d5-48a2-a1fa-1cb49516708a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:29.433260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14a262-02d5-48a2-a1fa-1cb49516708a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:29.492097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e9899-6e89-4d04-81da-6cb3eea53d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:29.493009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e9899-6e89-4d04-81da-6cb3eea53d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:29.493302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e9899-6e89-4d04-81da-6cb3eea53d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:29.493588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e9899-6e89-4d04-81da-6cb3eea53d84 admin admin] PATH_INFO: `/v3/projects/5a5779f9a13b4c4bb89af84ad829efa3` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:29.494807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e9899-6e89-4d04-81da-6cb3eea53d84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a5779f9a13b4c4bb89af84ad829efa3)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:29.496872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e9899-6e89-4d04-81da-6cb3eea53d84 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:29.639691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e41e9899-6e89-4d04-81da-6cb3eea53d84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a5779f9a13b4c4bb89af84ad829efa3', 'request_id': 'req-e41e9899-6e89-4d04-81da-6cb3eea53d84'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:29.645725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e41e9899-6e89-4d04-81da-6cb3eea53d84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a5779f9a13b4c4bb89af84ad829efa3', 'request_id': 'req-e41e9899-6e89-4d04-81da-6cb3eea53d84'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:29.775386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e41e9899-6e89-4d04-81da-6cb3eea53d84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a5779f9a13b4c4bb89af84ad829efa3', 'request_id': 'req-e41e9899-6e89-4d04-81da-6cb3eea53d84'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:29.786498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e41e9899-6e89-4d04-81da-6cb3eea53d84 admin admin] The token cache is being invalidate because project 5a5779f9a13b4c4bb89af84ad829efa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:29.786899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e41e9899-6e89-4d04-81da-6cb3eea53d84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:29.787619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e41e9899-6e89-4d04-81da-6cb3eea53d84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:29.789334 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2688/5383] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:29 2022] DELETE /identity/v3/projects/5a5779f9a13b4c4bb89af84ad829efa3 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:29.794239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4767b5-bb06-4eda-8377-4f7ef77d292a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:29.794740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4767b5-bb06-4eda-8377-4f7ef77d292a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:29.794866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4767b5-bb06-4eda-8377-4f7ef77d292a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:29.813521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-be4767b5-bb06-4eda-8377-4f7ef77d292a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:29.814760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-be4767b5-bb06-4eda-8377-4f7ef77d292a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:29.881189 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2696/5384] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:29.890677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973bc2b-5a76-4b0d-b887-50c8247b03cd None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:29.891325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973bc2b-5a76-4b0d-b887-50c8247b03cd None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:29.892018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973bc2b-5a76-4b0d-b887-50c8247b03cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:29.911412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3973bc2b-5a76-4b0d-b887-50c8247b03cd None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:29.912720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3973bc2b-5a76-4b0d-b887-50c8247b03cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:29.921174 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2689/5385] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:29.926182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4767b5-bb06-4eda-8377-4f7ef77d292a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:29.936012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4767b5-bb06-4eda-8377-4f7ef77d292a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:29.941062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0131468-3758-4d0a-92b3-b0c05eb767a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:29.941805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0131468-3758-4d0a-92b3-b0c05eb767a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:29.942084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0131468-3758-4d0a-92b3-b0c05eb767a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:29.942373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0131468-3758-4d0a-92b3-b0c05eb767a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:29.943113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0131468-3758-4d0a-92b3-b0c05eb767a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:38:29.943429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0131468-3758-4d0a-92b3-b0c05eb767a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:29.945099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0131468-3758-4d0a-92b3-b0c05eb767a1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:29.958211 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2697/5386] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:29.962962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973bc2b-5a76-4b0d-b887-50c8247b03cd None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:29.972319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973bc2b-5a76-4b0d-b887-50c8247b03cd None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:29.977512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe156ff-a2ba-4cd3-8c14-3785af3244b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:29.978112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe156ff-a2ba-4cd3-8c14-3785af3244b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:29.978400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe156ff-a2ba-4cd3-8c14-3785af3244b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:29.978679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe156ff-a2ba-4cd3-8c14-3785af3244b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:29.979386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe156ff-a2ba-4cd3-8c14-3785af3244b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:29.981907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe156ff-a2ba-4cd3-8c14-3785af3244b5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:30.063344 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2690/5387] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:38:29 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:30.067982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0131468-3758-4d0a-92b3-b0c05eb767a1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:30.078139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0131468-3758-4d0a-92b3-b0c05eb767a1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:30.152830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83a994-9eb5-4156-9a7d-33b93a94bad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:30.153519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83a994-9eb5-4156-9a7d-33b93a94bad4 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:30.153808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83a994-9eb5-4156-9a7d-33b93a94bad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:30.154217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83a994-9eb5-4156-9a7d-33b93a94bad4 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:30.154957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83a994-9eb5-4156-9a7d-33b93a94bad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:30.156903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83a994-9eb5-4156-9a7d-33b93a94bad4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:30.257948 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2698/5388] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:38:30 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:30.265771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe156ff-a2ba-4cd3-8c14-3785af3244b5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:30.276146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe156ff-a2ba-4cd3-8c14-3785af3244b5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:30.280947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd3562-57de-4ee2-a79b-c93d18691fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:30.281614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd3562-57de-4ee2-a79b-c93d18691fdd admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:30.281906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd3562-57de-4ee2-a79b-c93d18691fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:30.282186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd3562-57de-4ee2-a79b-c93d18691fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:30.282917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd3562-57de-4ee2-a79b-c93d18691fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:30.284521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd3562-57de-4ee2-a79b-c93d18691fdd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:30.295673 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2691/5389] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:38:30.299628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83a994-9eb5-4156-9a7d-33b93a94bad4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:30.310901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83a994-9eb5-4156-9a7d-33b93a94bad4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:30.327089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f2beb-a51e-4530-81f6-2e2bfd3c42ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:30.327089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f2beb-a51e-4530-81f6-2e2bfd3c42ec admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:30.327089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f2beb-a51e-4530-81f6-2e2bfd3c42ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:30.327089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f2beb-a51e-4530-81f6-2e2bfd3c42ec admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:30.328357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f2beb-a51e-4530-81f6-2e2bfd3c42ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:30.328357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f2beb-a51e-4530-81f6-2e2bfd3c42ec admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:30.334298 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2699/5390] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:38:30.335479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd3562-57de-4ee2-a79b-c93d18691fdd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:30.347553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd3562-57de-4ee2-a79b-c93d18691fdd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:30.355627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987bf674-2953-47dc-a817-859ee94b8492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:30.355627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987bf674-2953-47dc-a817-859ee94b8492 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:30.355627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987bf674-2953-47dc-a817-859ee94b8492 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:30.355627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987bf674-2953-47dc-a817-859ee94b8492 admin admin] PATH_INFO: `/v3/projects/737fa4d7f407440cbf238f6636b0df3d/users/48bfd14e480a4fe491f885a7326fb70a/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:30.375295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987bf674-2953-47dc-a817-859ee94b8492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=737fa4d7f407440cbf238f6636b0df3d, user_id=48bfd14e480a4fe491f885a7326fb70a, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:30.378978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987bf674-2953-47dc-a817-859ee94b8492 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:30.455873 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2692/5391] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:30 2022] PUT /identity/v3/projects/737fa4d7f407440cbf238f6636b0df3d/users/48bfd14e480a4fe491f885a7326fb70a/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:30.467613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36308b-60ff-415e-9190-163d08cf36e3 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:30.467899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36308b-60ff-415e-9190-163d08cf36e3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:30.468180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36308b-60ff-415e-9190-163d08cf36e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:30.500572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1e36308b-60ff-415e-9190-163d08cf36e3 None None] MFA Rules not processed for user `48bfd14e480a4fe491f885a7326fb70a`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:30.502441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1e36308b-60ff-415e-9190-163d08cf36e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:30.568894 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2700/5392] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:30.573345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987bf674-2953-47dc-a817-859ee94b8492 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:30.636816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987bf674-2953-47dc-a817-859ee94b8492 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:30.643084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe5c66-9f43-49be-b4b9-09857d2fd7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:30.643855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe5c66-9f43-49be-b4b9-09857d2fd7f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:30.644141 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe5c66-9f43-49be-b4b9-09857d2fd7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:30.644420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe5c66-9f43-49be-b4b9-09857d2fd7f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:30.645158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe5c66-9f43-49be-b4b9-09857d2fd7f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:30.649142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe5c66-9f43-49be-b4b9-09857d2fd7f1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:30.735844 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2693/5393] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:38:30 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:30.737040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36308b-60ff-415e-9190-163d08cf36e3 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:30.748699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36308b-60ff-415e-9190-163d08cf36e3 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:30.806217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179835d5-35ce-4218-8390-d9d4997c49a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:30.806915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179835d5-35ce-4218-8390-d9d4997c49a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:30.807096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179835d5-35ce-4218-8390-d9d4997c49a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:30.807376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179835d5-35ce-4218-8390-d9d4997c49a2 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:30.808198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179835d5-35ce-4218-8390-d9d4997c49a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:30.810187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179835d5-35ce-4218-8390-d9d4997c49a2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:30.922461 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2701/5394] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:38:30 2022] POST /identity/v3/users => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:30.926158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe5c66-9f43-49be-b4b9-09857d2fd7f1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:30.936792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe5c66-9f43-49be-b4b9-09857d2fd7f1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:30.942205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f454bc-0ef3-4420-9264-d0344c865563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:30.942689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f454bc-0ef3-4420-9264-d0344c865563 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:30.942990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f454bc-0ef3-4420-9264-d0344c865563 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:30.943273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f454bc-0ef3-4420-9264-d0344c865563 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:30.943997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f454bc-0ef3-4420-9264-d0344c865563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:30.945663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f454bc-0ef3-4420-9264-d0344c865563 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:30.957630 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2694/5395] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:38:30.961008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179835d5-35ce-4218-8390-d9d4997c49a2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:30.971819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179835d5-35ce-4218-8390-d9d4997c49a2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:30.978439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655a2b3-85d1-4dc4-8f7e-a4091b72876e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:30.978866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655a2b3-85d1-4dc4-8f7e-a4091b72876e admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:30.979286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655a2b3-85d1-4dc4-8f7e-a4091b72876e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:30.979572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655a2b3-85d1-4dc4-8f7e-a4091b72876e admin admin] PATH_INFO: `/v3/projects/5870e234534149d8acd30f405561f896/users/a848edf28a364b99929c10977ad02363/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:30.994978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655a2b3-85d1-4dc4-8f7e-a4091b72876e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5870e234534149d8acd30f405561f896, user_id=a848edf28a364b99929c10977ad02363, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:30.998689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655a2b3-85d1-4dc4-8f7e-a4091b72876e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:31.097899 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2702/5396] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:30 2022] PUT /identity/v3/projects/5870e234534149d8acd30f405561f896/users/a848edf28a364b99929c10977ad02363/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:31.102281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f454bc-0ef3-4420-9264-d0344c865563 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:31.112714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f454bc-0ef3-4420-9264-d0344c865563 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:31.172334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c2078-f1b8-442c-a389-87474f0208a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:31.173043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c2078-f1b8-442c-a389-87474f0208a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:31.173329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c2078-f1b8-442c-a389-87474f0208a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:31.173605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c2078-f1b8-442c-a389-87474f0208a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:31.174328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c2078-f1b8-442c-a389-87474f0208a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:31.175930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c2078-f1b8-442c-a389-87474f0208a4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:31.186956 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2695/5397] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:38:31.191098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655a2b3-85d1-4dc4-8f7e-a4091b72876e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:31.203169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655a2b3-85d1-4dc4-8f7e-a4091b72876e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:31.207930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98153b8-6d39-4407-86f3-51501999ec3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:31.208844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98153b8-6d39-4407-86f3-51501999ec3a admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:31.209133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98153b8-6d39-4407-86f3-51501999ec3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:31.209435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98153b8-6d39-4407-86f3-51501999ec3a admin admin] PATH_INFO: `/v3/projects/5870e234534149d8acd30f405561f896/users/a848edf28a364b99929c10977ad02363/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:31.211449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98153b8-6d39-4407-86f3-51501999ec3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5870e234534149d8acd30f405561f896, user_id=a848edf28a364b99929c10977ad02363, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:31.214223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98153b8-6d39-4407-86f3-51501999ec3a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:31.224563 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2703/5398] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:31 2022] PUT /identity/v3/projects/5870e234534149d8acd30f405561f896/users/a848edf28a364b99929c10977ad02363/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:31.234854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4579d-4097-40b9-a00a-5d7c8de44394 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:31.235139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4579d-4097-40b9-a00a-5d7c8de44394 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:31.235421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4579d-4097-40b9-a00a-5d7c8de44394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:31.275166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-18e4579d-4097-40b9-a00a-5d7c8de44394 None None] MFA Rules not processed for user `a848edf28a364b99929c10977ad02363`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:31.276779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-18e4579d-4097-40b9-a00a-5d7c8de44394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:31.372995 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2696/5399] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:38:31.374169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98153b8-6d39-4407-86f3-51501999ec3a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:31.387836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98153b8-6d39-4407-86f3-51501999ec3a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:31.393709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b32220-8d9a-4816-bc17-49446b39ae52 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a848edf28a364b99929c10977ad02363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5870e234534149d8acd30f405561f896', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:31.394526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b32220-8d9a-4816-bc17-49446b39ae52 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:31.394890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b32220-8d9a-4816-bc17-49446b39ae52 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:31.395246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b32220-8d9a-4816-bc17-49446b39ae52 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:31.396063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b32220-8d9a-4816-bc17-49446b39ae52 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:31.398404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b32220-8d9a-4816-bc17-49446b39ae52 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:31.506430 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2704/5400] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:38:31 2022] POST /identity/v3/projects => generated 360 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:38:31.508124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4579d-4097-40b9-a00a-5d7c8de44394 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:31.526256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4579d-4097-40b9-a00a-5d7c8de44394 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:31.587920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed69ab-6607-410b-934d-22ecbeda8578 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a848edf28a364b99929c10977ad02363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5870e234534149d8acd30f405561f896', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:31.588939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed69ab-6607-410b-934d-22ecbeda8578 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:31.589296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed69ab-6607-410b-934d-22ecbeda8578 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:31.589553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed69ab-6607-410b-934d-22ecbeda8578 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] PATH_INFO: `/v3/projects/9eebd691ebf54cc2947c8ee638b69838/tags/tempest-tag-2098988076` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:31.590838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed69ab-6607-410b-934d-22ecbeda8578 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=9eebd691ebf54cc2947c8ee638b69838, value=tempest-tag-2098988076)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:31.592995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed69ab-6607-410b-934d-22ecbeda8578 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:31.696219 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-45ed69ab-6607-410b-934d-22ecbeda8578 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-2098988076. To ensure interoperability, identifiers should be a valid uuid. May 02 10:38:31.696219 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 02 10:38:31.696219 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:38:31.702120 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2697/5401] 10.222.0.16 () {60 vars in 1332 bytes} [Mon May 2 10:38:31 2022] PUT /identity/v3/projects/9eebd691ebf54cc2947c8ee638b69838/tags/tempest-tag-2098988076 => generated 0 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) May 02 10:38:31.706396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b32220-8d9a-4816-bc17-49446b39ae52 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:31.717182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b32220-8d9a-4816-bc17-49446b39ae52 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:31.721830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b080e70-c4ea-428d-adf7-91618ad31d3f tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a848edf28a364b99929c10977ad02363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5870e234534149d8acd30f405561f896', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:31.722722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b080e70-c4ea-428d-adf7-91618ad31d3f tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:31.728300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b080e70-c4ea-428d-adf7-91618ad31d3f tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:31.728300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b080e70-c4ea-428d-adf7-91618ad31d3f tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] PATH_INFO: `/v3/projects/9eebd691ebf54cc2947c8ee638b69838/tags/tempest-tag-2098988076` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:31.735205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b080e70-c4ea-428d-adf7-91618ad31d3f tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=9eebd691ebf54cc2947c8ee638b69838, value=tempest-tag-2098988076)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:31.737486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b080e70-c4ea-428d-adf7-91618ad31d3f tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:31.749749 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2705/5402] 10.222.0.16 () {58 vars in 1313 bytes} [Mon May 2 10:38:31 2022] GET /identity/v3/projects/9eebd691ebf54cc2947c8ee638b69838/tags/tempest-tag-2098988076 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:31.754332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed69ab-6607-410b-934d-22ecbeda8578 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:31.764233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed69ab-6607-410b-934d-22ecbeda8578 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:31.768863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888262e2-1c33-42ff-9351-07fd3b88251e tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a848edf28a364b99929c10977ad02363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5870e234534149d8acd30f405561f896', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:31.769692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888262e2-1c33-42ff-9351-07fd3b88251e tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:31.769977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888262e2-1c33-42ff-9351-07fd3b88251e tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:31.770251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888262e2-1c33-42ff-9351-07fd3b88251e tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] PATH_INFO: `/v3/projects/9eebd691ebf54cc2947c8ee638b69838/tags` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:31.771501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888262e2-1c33-42ff-9351-07fd3b88251e tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=9eebd691ebf54cc2947c8ee638b69838)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:31.773672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888262e2-1c33-42ff-9351-07fd3b88251e tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:31.897658 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2698/5403] 10.222.0.16 () {60 vars in 1264 bytes} [Mon May 2 10:38:31 2022] PUT /identity/v3/projects/9eebd691ebf54cc2947c8ee638b69838/tags => generated 139 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:31.902444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b080e70-c4ea-428d-adf7-91618ad31d3f tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:31.912539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b080e70-c4ea-428d-adf7-91618ad31d3f tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:31.918395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63cfb6-8c0e-433e-bbe4-781753024ebb tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a848edf28a364b99929c10977ad02363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5870e234534149d8acd30f405561f896', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:31.919891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63cfb6-8c0e-433e-bbe4-781753024ebb tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:31.920203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63cfb6-8c0e-433e-bbe4-781753024ebb tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:31.920454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63cfb6-8c0e-433e-bbe4-781753024ebb tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] PATH_INFO: `/v3/projects/9eebd691ebf54cc2947c8ee638b69838/tags` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:31.932693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63cfb6-8c0e-433e-bbe4-781753024ebb tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=9eebd691ebf54cc2947c8ee638b69838)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:31.934833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63cfb6-8c0e-433e-bbe4-781753024ebb tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:31.945809 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2706/5404] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 2 10:38:31 2022] GET /identity/v3/projects/9eebd691ebf54cc2947c8ee638b69838/tags => generated 139 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:31.950622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888262e2-1c33-42ff-9351-07fd3b88251e tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:31.963527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888262e2-1c33-42ff-9351-07fd3b88251e tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:31.970180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5068c-ed7c-44c8-979d-e2dc4f6a5707 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a848edf28a364b99929c10977ad02363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5870e234534149d8acd30f405561f896', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:31.971050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5068c-ed7c-44c8-979d-e2dc4f6a5707 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:31.971334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5068c-ed7c-44c8-979d-e2dc4f6a5707 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:31.971611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5068c-ed7c-44c8-979d-e2dc4f6a5707 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] PATH_INFO: `/v3/projects/9eebd691ebf54cc2947c8ee638b69838/tags/tempest-tag-808910874` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:31.972861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5068c-ed7c-44c8-979d-e2dc4f6a5707 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=9eebd691ebf54cc2947c8ee638b69838, value=tempest-tag-808910874)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:31.974975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5068c-ed7c-44c8-979d-e2dc4f6a5707 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:32.108786 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-29e5068c-ed7c-44c8-979d-e2dc4f6a5707 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-808910874. To ensure interoperability, identifiers should be a valid uuid. May 02 10:38:32.108786 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 02 10:38:32.108786 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:38:32.115397 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2699/5405] 10.222.0.16 () {58 vars in 1313 bytes} [Mon May 2 10:38:31 2022] DELETE /identity/v3/projects/9eebd691ebf54cc2947c8ee638b69838/tags/tempest-tag-808910874 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:32.119808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63cfb6-8c0e-433e-bbe4-781753024ebb tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:32.130414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63cfb6-8c0e-433e-bbe4-781753024ebb tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:32.136915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039b31e-4330-4084-9258-4445f5800647 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a848edf28a364b99929c10977ad02363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5870e234534149d8acd30f405561f896', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:32.137795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039b31e-4330-4084-9258-4445f5800647 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:32.138078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039b31e-4330-4084-9258-4445f5800647 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:32.138361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039b31e-4330-4084-9258-4445f5800647 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] PATH_INFO: `/v3/projects/9eebd691ebf54cc2947c8ee638b69838/tags/tempest-tag-808910874` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:32.149424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039b31e-4330-4084-9258-4445f5800647 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=9eebd691ebf54cc2947c8ee638b69838, value=tempest-tag-808910874)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:32.153210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039b31e-4330-4084-9258-4445f5800647 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:32.173957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-0039b31e-4330-4084-9258-4445f5800647 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Could not find project tag: tempest-tag-808910874.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-808910874. May 02 10:38:32.173957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:38:32.173957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:38:32.173957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:38:32.173957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:38:32.173957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:38:32.173957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:38:32.173957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:38:32.173957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:38:32.173957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:38:32.173957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:38:32.173957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:38:32.173957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get May 02 10:38:32.173957 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) May 02 10:38:32.175328 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:38:32.175328 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:38:32.175328 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag May 02 10:38:32.175328 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) May 02 10:38:32.175328 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-808910874. May 02 10:38:32.175328 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:38:32.175328 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2707/5406] 10.222.0.16 () {58 vars in 1310 bytes} [Mon May 2 10:38:32 2022] GET /identity/v3/projects/9eebd691ebf54cc2947c8ee638b69838/tags/tempest-tag-808910874 => generated 106 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 02 10:38:32.185060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5068c-ed7c-44c8-979d-e2dc4f6a5707 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:32.196365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5068c-ed7c-44c8-979d-e2dc4f6a5707 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:32.201509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105402e9-89ad-4011-a137-37007947e3cc tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a848edf28a364b99929c10977ad02363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5870e234534149d8acd30f405561f896', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:32.202351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105402e9-89ad-4011-a137-37007947e3cc tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:32.202636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105402e9-89ad-4011-a137-37007947e3cc tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:32.202992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105402e9-89ad-4011-a137-37007947e3cc tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] PATH_INFO: `/v3/projects/9eebd691ebf54cc2947c8ee638b69838/tags` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:32.204731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105402e9-89ad-4011-a137-37007947e3cc tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=9eebd691ebf54cc2947c8ee638b69838)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:32.206856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105402e9-89ad-4011-a137-37007947e3cc tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:32.303741 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2700/5407] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 2 10:38:32 2022] DELETE /identity/v3/projects/9eebd691ebf54cc2947c8ee638b69838/tags => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:32.307765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039b31e-4330-4084-9258-4445f5800647 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:32.324987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039b31e-4330-4084-9258-4445f5800647 tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:32.330351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef366b3-5359-4f29-95ab-785fe795452a tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a848edf28a364b99929c10977ad02363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5870e234534149d8acd30f405561f896', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:32.331299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef366b3-5359-4f29-95ab-785fe795452a tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:32.331717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef366b3-5359-4f29-95ab-785fe795452a tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:32.332057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef366b3-5359-4f29-95ab-785fe795452a tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] PATH_INFO: `/v3/projects/9eebd691ebf54cc2947c8ee638b69838/tags` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:32.344496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef366b3-5359-4f29-95ab-785fe795452a tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=9eebd691ebf54cc2947c8ee638b69838)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:32.347333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef366b3-5359-4f29-95ab-785fe795452a tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:32.359965 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2708/5408] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 2 10:38:32 2022] GET /identity/v3/projects/9eebd691ebf54cc2947c8ee638b69838/tags => generated 66 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 02 10:38:32.363799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105402e9-89ad-4011-a137-37007947e3cc tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:32.377117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105402e9-89ad-4011-a137-37007947e3cc tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:32.385356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4525b2-2261-4466-8c1f-d1c90885df9f tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a848edf28a364b99929c10977ad02363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5870e234534149d8acd30f405561f896', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:32.387003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4525b2-2261-4466-8c1f-d1c90885df9f tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:32.387300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4525b2-2261-4466-8c1f-d1c90885df9f tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:32.387587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4525b2-2261-4466-8c1f-d1c90885df9f tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] PATH_INFO: `/v3/projects/9eebd691ebf54cc2947c8ee638b69838` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:32.388840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4525b2-2261-4466-8c1f-d1c90885df9f tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9eebd691ebf54cc2947c8ee638b69838)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:32.390829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4525b2-2261-4466-8c1f-d1c90885df9f tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:32.608153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8f4525b2-2261-4466-8c1f-d1c90885df9f tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eebd691ebf54cc2947c8ee638b69838', 'request_id': 'req-8f4525b2-2261-4466-8c1f-d1c90885df9f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:32.619857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8f4525b2-2261-4466-8c1f-d1c90885df9f tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eebd691ebf54cc2947c8ee638b69838', 'request_id': 'req-8f4525b2-2261-4466-8c1f-d1c90885df9f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:32.714659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8f4525b2-2261-4466-8c1f-d1c90885df9f tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eebd691ebf54cc2947c8ee638b69838', 'request_id': 'req-8f4525b2-2261-4466-8c1f-d1c90885df9f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:32.728171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8f4525b2-2261-4466-8c1f-d1c90885df9f tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] The token cache is being invalidate because project 9eebd691ebf54cc2947c8ee638b69838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:32.729073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8f4525b2-2261-4466-8c1f-d1c90885df9f tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:32.730071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8f4525b2-2261-4466-8c1f-d1c90885df9f tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:32.732524 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2701/5409] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:32 2022] DELETE /identity/v3/projects/9eebd691ebf54cc2947c8ee638b69838 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:32.737772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef366b3-5359-4f29-95ab-785fe795452a tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:32.741034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6ef366b3-5359-4f29-95ab-785fe795452a tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:32.820188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef366b3-5359-4f29-95ab-785fe795452a tempest-IdentityV3ProjectTagsTest-45270031 tempest-IdentityV3ProjectTagsTest-45270031-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:32.881771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c143621-b68c-4455-81c5-6b7c77f0d3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:32.882946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c143621-b68c-4455-81c5-6b7c77f0d3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:32.883382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c143621-b68c-4455-81c5-6b7c77f0d3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:32.883736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c143621-b68c-4455-81c5-6b7c77f0d3d2 admin admin] PATH_INFO: `/v3/users/48bfd14e480a4fe491f885a7326fb70a` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:32.885111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c143621-b68c-4455-81c5-6b7c77f0d3d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48bfd14e480a4fe491f885a7326fb70a)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:32.887670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c143621-b68c-4455-81c5-6b7c77f0d3d2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:33.240650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3c143621-b68c-4455-81c5-6b7c77f0d3d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48bfd14e480a4fe491f885a7326fb70a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:33.255758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3c143621-b68c-4455-81c5-6b7c77f0d3d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48bfd14e480a4fe491f885a7326fb70a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:33.256613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3c143621-b68c-4455-81c5-6b7c77f0d3d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48bfd14e480a4fe491f885a7326fb70a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:33.263735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3c143621-b68c-4455-81c5-6b7c77f0d3d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48bfd14e480a4fe491f885a7326fb70a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:33.365089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3c143621-b68c-4455-81c5-6b7c77f0d3d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48bfd14e480a4fe491f885a7326fb70a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:33.372432 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2709/5410] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:32 2022] DELETE /identity/v3/users/48bfd14e480a4fe491f885a7326fb70a => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:33.377140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c46dc9-54c6-48b3-8ef8-6af79785425d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:33.377438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c46dc9-54c6-48b3-8ef8-6af79785425d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:33.377724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c46dc9-54c6-48b3-8ef8-6af79785425d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:33.395942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-93c46dc9-54c6-48b3-8ef8-6af79785425d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:33.397174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-93c46dc9-54c6-48b3-8ef8-6af79785425d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:33.459576 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2702/5411] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:38:33.470152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c143621-b68c-4455-81c5-6b7c77f0d3d2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:33.471577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3c143621-b68c-4455-81c5-6b7c77f0d3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:33.537024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c143621-b68c-4455-81c5-6b7c77f0d3d2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:33.540811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77a220-b194-4558-a191-94cc4783388c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:33.541410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77a220-b194-4558-a191-94cc4783388c service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:33.541687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77a220-b194-4558-a191-94cc4783388c service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:33.541967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77a220-b194-4558-a191-94cc4783388c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:33.551997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77a220-b194-4558-a191-94cc4783388c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:33.553425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77a220-b194-4558-a191-94cc4783388c service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:33.565137 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2710/5412] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:38:34.143524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c46dc9-54c6-48b3-8ef8-6af79785425d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:34.145159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-93c46dc9-54c6-48b3-8ef8-6af79785425d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:34.158463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c46dc9-54c6-48b3-8ef8-6af79785425d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:34.163386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c489469-a852-4dfe-9f50-155bc98f7ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:34.167433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c489469-a852-4dfe-9f50-155bc98f7ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:34.167433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c489469-a852-4dfe-9f50-155bc98f7ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:34.167433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c489469-a852-4dfe-9f50-155bc98f7ee0 admin admin] PATH_INFO: `/v3/projects/737fa4d7f407440cbf238f6636b0df3d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:34.167433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c489469-a852-4dfe-9f50-155bc98f7ee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=737fa4d7f407440cbf238f6636b0df3d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:34.168487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c489469-a852-4dfe-9f50-155bc98f7ee0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:34.279814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1c489469-a852-4dfe-9f50-155bc98f7ee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '737fa4d7f407440cbf238f6636b0df3d', 'request_id': 'req-1c489469-a852-4dfe-9f50-155bc98f7ee0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:34.285904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1c489469-a852-4dfe-9f50-155bc98f7ee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '737fa4d7f407440cbf238f6636b0df3d', 'request_id': 'req-1c489469-a852-4dfe-9f50-155bc98f7ee0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:34.388732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1c489469-a852-4dfe-9f50-155bc98f7ee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '737fa4d7f407440cbf238f6636b0df3d', 'request_id': 'req-1c489469-a852-4dfe-9f50-155bc98f7ee0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:34.400219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1c489469-a852-4dfe-9f50-155bc98f7ee0 admin admin] The token cache is being invalidate because project 737fa4d7f407440cbf238f6636b0df3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:34.400508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1c489469-a852-4dfe-9f50-155bc98f7ee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:34.401289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1c489469-a852-4dfe-9f50-155bc98f7ee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:34.402970 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2703/5413] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:34 2022] DELETE /identity/v3/projects/737fa4d7f407440cbf238f6636b0df3d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:34.406959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77a220-b194-4558-a191-94cc4783388c service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:34.416683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77a220-b194-4558-a191-94cc4783388c service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:34.481614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ed614-1b81-4118-8dbb-c14115df21d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:34.482891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ed614-1b81-4118-8dbb-c14115df21d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:34.483175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ed614-1b81-4118-8dbb-c14115df21d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:34.483450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ed614-1b81-4118-8dbb-c14115df21d6 admin admin] PATH_INFO: `/v3/users/a848edf28a364b99929c10977ad02363` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:34.484763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ed614-1b81-4118-8dbb-c14115df21d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a848edf28a364b99929c10977ad02363)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:34.486759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ed614-1b81-4118-8dbb-c14115df21d6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:34.718777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-698ed614-1b81-4118-8dbb-c14115df21d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a848edf28a364b99929c10977ad02363'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:34.734072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-698ed614-1b81-4118-8dbb-c14115df21d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a848edf28a364b99929c10977ad02363'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:34.737038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-698ed614-1b81-4118-8dbb-c14115df21d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a848edf28a364b99929c10977ad02363'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:34.743093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-698ed614-1b81-4118-8dbb-c14115df21d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a848edf28a364b99929c10977ad02363'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:34.799233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-698ed614-1b81-4118-8dbb-c14115df21d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a848edf28a364b99929c10977ad02363'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:34.805571 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2711/5414] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:34 2022] DELETE /identity/v3/users/a848edf28a364b99929c10977ad02363 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:35.373694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c489469-a852-4dfe-9f50-155bc98f7ee0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:35.376032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1c489469-a852-4dfe-9f50-155bc98f7ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:35.391885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c489469-a852-4dfe-9f50-155bc98f7ee0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:35.468585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda1d7b-ac81-47d1-a54f-7bd8f5b6d1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:35.469483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda1d7b-ac81-47d1-a54f-7bd8f5b6d1e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:35.469834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda1d7b-ac81-47d1-a54f-7bd8f5b6d1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:35.470120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda1d7b-ac81-47d1-a54f-7bd8f5b6d1e5 admin admin] PATH_INFO: `/v3/projects/5870e234534149d8acd30f405561f896` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:35.471555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda1d7b-ac81-47d1-a54f-7bd8f5b6d1e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5870e234534149d8acd30f405561f896)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:35.473545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda1d7b-ac81-47d1-a54f-7bd8f5b6d1e5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:35.613039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-acda1d7b-ac81-47d1-a54f-7bd8f5b6d1e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5870e234534149d8acd30f405561f896', 'request_id': 'req-acda1d7b-ac81-47d1-a54f-7bd8f5b6d1e5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:35.621969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-acda1d7b-ac81-47d1-a54f-7bd8f5b6d1e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5870e234534149d8acd30f405561f896', 'request_id': 'req-acda1d7b-ac81-47d1-a54f-7bd8f5b6d1e5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:35.676890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-acda1d7b-ac81-47d1-a54f-7bd8f5b6d1e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5870e234534149d8acd30f405561f896', 'request_id': 'req-acda1d7b-ac81-47d1-a54f-7bd8f5b6d1e5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:35.688430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-acda1d7b-ac81-47d1-a54f-7bd8f5b6d1e5 admin admin] The token cache is being invalidate because project 5870e234534149d8acd30f405561f896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:35.689543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-acda1d7b-ac81-47d1-a54f-7bd8f5b6d1e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:35.690311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-acda1d7b-ac81-47d1-a54f-7bd8f5b6d1e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:35.692251 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2704/5415] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:35 2022] DELETE /identity/v3/projects/5870e234534149d8acd30f405561f896 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:35.697648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56b7f3-bd9e-465b-a670-b86000498c79 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:35.699673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56b7f3-bd9e-465b-a670-b86000498c79 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:35.700141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56b7f3-bd9e-465b-a670-b86000498c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:35.721261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4c56b7f3-bd9e-465b-a670-b86000498c79 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:35.722541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4c56b7f3-bd9e-465b-a670-b86000498c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:35.791140 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2712/5416] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:35.799235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3402fd-3229-4989-813b-1fff3796436b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:35.799522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3402fd-3229-4989-813b-1fff3796436b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:35.799809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3402fd-3229-4989-813b-1fff3796436b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:35.820035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-af3402fd-3229-4989-813b-1fff3796436b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:35.821523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-af3402fd-3229-4989-813b-1fff3796436b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:35.830590 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2705/5417] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:35.835206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56b7f3-bd9e-465b-a670-b86000498c79 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:35.846576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56b7f3-bd9e-465b-a670-b86000498c79 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:35.851913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95c018-69ba-48ab-a90b-865829846d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:35.852810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95c018-69ba-48ab-a90b-865829846d54 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:35.853251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95c018-69ba-48ab-a90b-865829846d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:35.853538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95c018-69ba-48ab-a90b-865829846d54 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:35.854288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95c018-69ba-48ab-a90b-865829846d54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:38:35.854602 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95c018-69ba-48ab-a90b-865829846d54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:35.856239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95c018-69ba-48ab-a90b-865829846d54 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:35.873429 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2713/5418] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:35.876228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3402fd-3229-4989-813b-1fff3796436b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:35.886844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3402fd-3229-4989-813b-1fff3796436b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:35.891647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be2407-cc61-46bc-91f0-25939c370f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:35.896049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be2407-cc61-46bc-91f0-25939c370f5f admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:35.896049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be2407-cc61-46bc-91f0-25939c370f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:35.896049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be2407-cc61-46bc-91f0-25939c370f5f admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:35.896049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be2407-cc61-46bc-91f0-25939c370f5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:35.896049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be2407-cc61-46bc-91f0-25939c370f5f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:35.994272 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2706/5419] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:38:35 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:35.998708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95c018-69ba-48ab-a90b-865829846d54 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:36.012738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95c018-69ba-48ab-a90b-865829846d54 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:36.082606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fdc46-5b0e-414b-8188-a72c42bab3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:36.083592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fdc46-5b0e-414b-8188-a72c42bab3de admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:36.083875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fdc46-5b0e-414b-8188-a72c42bab3de admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:36.084318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fdc46-5b0e-414b-8188-a72c42bab3de admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:36.087550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fdc46-5b0e-414b-8188-a72c42bab3de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:36.092836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fdc46-5b0e-414b-8188-a72c42bab3de admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:36.228347 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2714/5420] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:38:35 2022] POST /identity/v3/users => generated 284 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:38:36.233402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be2407-cc61-46bc-91f0-25939c370f5f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:36.244804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be2407-cc61-46bc-91f0-25939c370f5f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:36.249880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c1a90-aa0e-40bd-b6c5-fccb4378baea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:36.256815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c1a90-aa0e-40bd-b6c5-fccb4378baea admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:36.256815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c1a90-aa0e-40bd-b6c5-fccb4378baea admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:36.256815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c1a90-aa0e-40bd-b6c5-fccb4378baea admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:36.256815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c1a90-aa0e-40bd-b6c5-fccb4378baea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:36.256815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c1a90-aa0e-40bd-b6c5-fccb4378baea admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:36.275604 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2707/5421] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:38:36.280287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fdc46-5b0e-414b-8188-a72c42bab3de admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:36.291331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fdc46-5b0e-414b-8188-a72c42bab3de admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:36.297143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37078e-8777-4344-a901-05a4cdcfe39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:36.297946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37078e-8777-4344-a901-05a4cdcfe39d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:36.298298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37078e-8777-4344-a901-05a4cdcfe39d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:36.298680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37078e-8777-4344-a901-05a4cdcfe39d admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:36.299735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37078e-8777-4344-a901-05a4cdcfe39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:36.301372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37078e-8777-4344-a901-05a4cdcfe39d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:36.315465 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2715/5422] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:38:36.317595 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c1a90-aa0e-40bd-b6c5-fccb4378baea admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:36.327968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c1a90-aa0e-40bd-b6c5-fccb4378baea admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:36.333147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a36186-e0d3-4f8c-954f-e71220e8d1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:36.334071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a36186-e0d3-4f8c-954f-e71220e8d1bb admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:36.334520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a36186-e0d3-4f8c-954f-e71220e8d1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:36.334867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a36186-e0d3-4f8c-954f-e71220e8d1bb admin admin] PATH_INFO: `/v3/projects/f60f33285618445b94dc15469fe8226c/users/a2f248dec25d4fea8a49e6df62a22346/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:36.351680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a36186-e0d3-4f8c-954f-e71220e8d1bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60f33285618445b94dc15469fe8226c, user_id=a2f248dec25d4fea8a49e6df62a22346, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:36.354458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a36186-e0d3-4f8c-954f-e71220e8d1bb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:36.427889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de51948-b438-475c-baf4-7dd5adc406d6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:36.428334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de51948-b438-475c-baf4-7dd5adc406d6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:36.428719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de51948-b438-475c-baf4-7dd5adc406d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:36.442717 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2708/5423] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:36 2022] PUT /identity/v3/projects/f60f33285618445b94dc15469fe8226c/users/a2f248dec25d4fea8a49e6df62a22346/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:36.449733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9de51948-b438-475c-baf4-7dd5adc406d6 None None] MFA Rules not processed for user `8c8a5cbbc43e415a85da2b0074a05138`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:36.450959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9de51948-b438-475c-baf4-7dd5adc406d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:36.453040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f994d0b-9de3-4e28-acf5-09cb05eae8ef None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:36.453408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f994d0b-9de3-4e28-acf5-09cb05eae8ef None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:36.453756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f994d0b-9de3-4e28-acf5-09cb05eae8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:36.484214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0f994d0b-9de3-4e28-acf5-09cb05eae8ef None None] MFA Rules not processed for user `a2f248dec25d4fea8a49e6df62a22346`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:36.485483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0f994d0b-9de3-4e28-acf5-09cb05eae8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:36.525801 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2716/5424] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:38:36.562618 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2709/5425] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:36.563424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de51948-b438-475c-baf4-7dd5adc406d6 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:36.642456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de51948-b438-475c-baf4-7dd5adc406d6 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:36.647377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de677f4-804d-4331-8cdd-f8de6eb879f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:36.648312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de677f4-804d-4331-8cdd-f8de6eb879f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:36.648914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de677f4-804d-4331-8cdd-f8de6eb879f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:36.649658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de677f4-804d-4331-8cdd-f8de6eb879f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:36.651053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de677f4-804d-4331-8cdd-f8de6eb879f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:36.654958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de677f4-804d-4331-8cdd-f8de6eb879f0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:36.745125 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2717/5426] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:38:36 2022] POST /identity/v3/projects => generated 367 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:38:36.749413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f994d0b-9de3-4e28-acf5-09cb05eae8ef None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:36.761956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f994d0b-9de3-4e28-acf5-09cb05eae8ef None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:36.826163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f776db-2b50-4142-aa40-9c4699244bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:36.826854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f776db-2b50-4142-aa40-9c4699244bdf admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:36.827140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f776db-2b50-4142-aa40-9c4699244bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:36.827564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f776db-2b50-4142-aa40-9c4699244bdf admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:36.828356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f776db-2b50-4142-aa40-9c4699244bdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:36.830407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f776db-2b50-4142-aa40-9c4699244bdf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:36.919317 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2710/5427] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:38:36 2022] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:36.923383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de677f4-804d-4331-8cdd-f8de6eb879f0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:36.935250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de677f4-804d-4331-8cdd-f8de6eb879f0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:36.941437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a494940-1e6c-4ddc-a92a-0969deb19b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:36.942787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a494940-1e6c-4ddc-a92a-0969deb19b85 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:36.942987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a494940-1e6c-4ddc-a92a-0969deb19b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:36.944244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a494940-1e6c-4ddc-a92a-0969deb19b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:36.944244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a494940-1e6c-4ddc-a92a-0969deb19b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:36.946565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a494940-1e6c-4ddc-a92a-0969deb19b85 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:36.959933 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2718/5428] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:38:36.964369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f776db-2b50-4142-aa40-9c4699244bdf admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:36.975205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f776db-2b50-4142-aa40-9c4699244bdf admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:36.980989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca415d9-06a9-404c-9f7c-cb863565c4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:36.982050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca415d9-06a9-404c-9f7c-cb863565c4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:36.982438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca415d9-06a9-404c-9f7c-cb863565c4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:36.982813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca415d9-06a9-404c-9f7c-cb863565c4e3 admin admin] PATH_INFO: `/v3/projects/7d77e597d57e47e08182448baae93696/users/219abee2f66141b1a8f57d2f4c3ee789/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:36.999699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca415d9-06a9-404c-9f7c-cb863565c4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d77e597d57e47e08182448baae93696, user_id=219abee2f66141b1a8f57d2f4c3ee789, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:37.002873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca415d9-06a9-404c-9f7c-cb863565c4e3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:37.075376 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2711/5429] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:36 2022] PUT /identity/v3/projects/7d77e597d57e47e08182448baae93696/users/219abee2f66141b1a8f57d2f4c3ee789/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:37.079294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a494940-1e6c-4ddc-a92a-0969deb19b85 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:37.092268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a494940-1e6c-4ddc-a92a-0969deb19b85 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:37.150655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3a401-355d-4743-8e51-9a1b62725bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:37.151305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3a401-355d-4743-8e51-9a1b62725bbf admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:37.152573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3a401-355d-4743-8e51-9a1b62725bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:37.152573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3a401-355d-4743-8e51-9a1b62725bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:37.153118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3a401-355d-4743-8e51-9a1b62725bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:37.154710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3a401-355d-4743-8e51-9a1b62725bbf admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:37.164464 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2719/5430] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:38:37.169282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca415d9-06a9-404c-9f7c-cb863565c4e3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:37.179860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca415d9-06a9-404c-9f7c-cb863565c4e3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:37.185123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dca273-acb4-46e9-a8f3-84e736747530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:37.186018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dca273-acb4-46e9-a8f3-84e736747530 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:37.186801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dca273-acb4-46e9-a8f3-84e736747530 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:37.187091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dca273-acb4-46e9-a8f3-84e736747530 admin admin] PATH_INFO: `/v3/projects/7d77e597d57e47e08182448baae93696/users/219abee2f66141b1a8f57d2f4c3ee789/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:37.189905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dca273-acb4-46e9-a8f3-84e736747530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d77e597d57e47e08182448baae93696, user_id=219abee2f66141b1a8f57d2f4c3ee789, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:37.192632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dca273-acb4-46e9-a8f3-84e736747530 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:37.207006 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2712/5431] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:37 2022] PUT /identity/v3/projects/7d77e597d57e47e08182448baae93696/users/219abee2f66141b1a8f57d2f4c3ee789/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:37.218696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3920f8e-55ca-4a8d-9377-85b12d09df4d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:37.218696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3920f8e-55ca-4a8d-9377-85b12d09df4d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:37.218696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3920f8e-55ca-4a8d-9377-85b12d09df4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:37.247432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f3920f8e-55ca-4a8d-9377-85b12d09df4d None None] MFA Rules not processed for user `219abee2f66141b1a8f57d2f4c3ee789`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:37.248683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f3920f8e-55ca-4a8d-9377-85b12d09df4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:37.327151 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2720/5432] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:37 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:37.332165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dca273-acb4-46e9-a8f3-84e736747530 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:37.344244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dca273-acb4-46e9-a8f3-84e736747530 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:37.349156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33871086-b001-4571-8a8c-181c72669860 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:37.349849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33871086-b001-4571-8a8c-181c72669860 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:37.350138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33871086-b001-4571-8a8c-181c72669860 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:37.350415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33871086-b001-4571-8a8c-181c72669860 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:37.351119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33871086-b001-4571-8a8c-181c72669860 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:37.353000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33871086-b001-4571-8a8c-181c72669860 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:37.447063 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2713/5433] 10.222.0.16 () {60 vars in 1151 bytes} [Mon May 2 10:38:37 2022] POST /identity/v3/projects => generated 329 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:37.449176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3920f8e-55ca-4a8d-9377-85b12d09df4d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:37.458740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3920f8e-55ca-4a8d-9377-85b12d09df4d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:37.517907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8b0f1-6187-4e55-ab49-4e1525e94aac tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:37.520649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8b0f1-6187-4e55-ab49-4e1525e94aac tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:37.520649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8b0f1-6187-4e55-ab49-4e1525e94aac tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:37.520649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8b0f1-6187-4e55-ab49-4e1525e94aac tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:37.520649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8b0f1-6187-4e55-ab49-4e1525e94aac tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:37.522203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8b0f1-6187-4e55-ab49-4e1525e94aac tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:37.654345 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2721/5434] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:38:37 2022] POST /identity/v3/users => generated 416 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:37.658389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33871086-b001-4571-8a8c-181c72669860 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:37.668481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33871086-b001-4571-8a8c-181c72669860 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:37.673516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05525645-8f6f-4337-8c9f-fabec7a6c5e0 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:37.674475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05525645-8f6f-4337-8c9f-fabec7a6c5e0 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:37.674854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05525645-8f6f-4337-8c9f-fabec7a6c5e0 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:37.675569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05525645-8f6f-4337-8c9f-fabec7a6c5e0 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:37.676431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05525645-8f6f-4337-8c9f-fabec7a6c5e0 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:37.678747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05525645-8f6f-4337-8c9f-fabec7a6c5e0 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:37.840953 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2714/5435] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:38:37 2022] POST /identity/v3/roles => generated 243 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:37.842185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8b0f1-6187-4e55-ab49-4e1525e94aac tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:37.861167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8b0f1-6187-4e55-ab49-4e1525e94aac tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:37.866739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827fbe9-3708-45b5-9d5d-5c2d20e36da6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:37.867248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827fbe9-3708-45b5-9d5d-5c2d20e36da6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:37.869840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827fbe9-3708-45b5-9d5d-5c2d20e36da6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:37.870631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827fbe9-3708-45b5-9d5d-5c2d20e36da6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:37.871453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e827fbe9-3708-45b5-9d5d-5c2d20e36da6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:37.873182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e827fbe9-3708-45b5-9d5d-5c2d20e36da6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:38.046511 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2722/5436] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:38:37 2022] POST /identity/v3/roles => generated 246 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:38.051255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05525645-8f6f-4337-8c9f-fabec7a6c5e0 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:38.063625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05525645-8f6f-4337-8c9f-fabec7a6c5e0 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:38.068848 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52d977-4ee3-4dc2-9676-223521cb24b9 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:38.069790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52d977-4ee3-4dc2-9676-223521cb24b9 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:38.070084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52d977-4ee3-4dc2-9676-223521cb24b9 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:38.070368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52d977-4ee3-4dc2-9676-223521cb24b9 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects/33c1f95a360d4995aa893cc1d5b9bcae/users/f07e0d249cc541b19cbd51c178c9c575/roles/cadab6613d42490fb82b279d3674584d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:38.090295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52d977-4ee3-4dc2-9676-223521cb24b9 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_grant(project_id=33c1f95a360d4995aa893cc1d5b9bcae, user_id=f07e0d249cc541b19cbd51c178c9c575, role_id=cadab6613d42490fb82b279d3674584d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:38.096799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52d977-4ee3-4dc2-9676-223521cb24b9 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:38.221588 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2715/5437] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:38 2022] PUT /identity/v3/projects/33c1f95a360d4995aa893cc1d5b9bcae/users/f07e0d249cc541b19cbd51c178c9c575/roles/cadab6613d42490fb82b279d3674584d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:38.225639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827fbe9-3708-45b5-9d5d-5c2d20e36da6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:38.238673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827fbe9-3708-45b5-9d5d-5c2d20e36da6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:38.333387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599924b6-ffd9-4796-ab99-c1fee1b3a352 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:38.334773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599924b6-ffd9-4796-ab99-c1fee1b3a352 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:38.335160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599924b6-ffd9-4796-ab99-c1fee1b3a352 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:38.335542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599924b6-ffd9-4796-ab99-c1fee1b3a352 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects/33c1f95a360d4995aa893cc1d5b9bcae/users/f07e0d249cc541b19cbd51c178c9c575/roles/2aaae7671bea4ceeb9eb4b44f509264d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:38.339066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599924b6-ffd9-4796-ab99-c1fee1b3a352 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_grant(project_id=33c1f95a360d4995aa893cc1d5b9bcae, user_id=f07e0d249cc541b19cbd51c178c9c575, role_id=2aaae7671bea4ceeb9eb4b44f509264d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:38.341992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599924b6-ffd9-4796-ab99-c1fee1b3a352 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:38.439026 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2723/5438] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:38 2022] PUT /identity/v3/projects/33c1f95a360d4995aa893cc1d5b9bcae/users/f07e0d249cc541b19cbd51c178c9c575/roles/2aaae7671bea4ceeb9eb4b44f509264d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:38.443231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52d977-4ee3-4dc2-9676-223521cb24b9 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:38.467169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52d977-4ee3-4dc2-9676-223521cb24b9 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:38.531781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877734a-3db5-41bc-8698-10238169b179 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:38.532452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877734a-3db5-41bc-8698-10238169b179 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:38.532771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877734a-3db5-41bc-8698-10238169b179 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:38.533048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877734a-3db5-41bc-8698-10238169b179 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:38.533832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877734a-3db5-41bc-8698-10238169b179 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:38.535877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877734a-3db5-41bc-8698-10238169b179 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:38.567260 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2716/5439] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:38 2022] GET /identity/v3/users => generated 8915 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:38:38.572080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed2dc1-3422-4052-bac2-4bb13214e954 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:38.572377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed2dc1-3422-4052-bac2-4bb13214e954 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:38.572699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed2dc1-3422-4052-bac2-4bb13214e954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:38.655113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e3ed2dc1-3422-4052-bac2-4bb13214e954 None None] MFA Rules not processed for user `f07e0d249cc541b19cbd51c178c9c575`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:38.658092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e3ed2dc1-3422-4052-bac2-4bb13214e954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:38.837449 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2724/5440] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:38 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:38:38.840738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80254d-3d16-42c6-8171-fce499e24813 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:38.841275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80254d-3d16-42c6-8171-fce499e24813 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:38.841750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80254d-3d16-42c6-8171-fce499e24813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:38.873765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4c80254d-3d16-42c6-8171-fce499e24813 None None] MFA Rules not processed for user `f07e0d249cc541b19cbd51c178c9c575`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:38.875981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4c80254d-3d16-42c6-8171-fce499e24813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:38.892747 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2717/5441] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:38 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:38.894324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed2dc1-3422-4052-bac2-4bb13214e954 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:38.907635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed2dc1-3422-4052-bac2-4bb13214e954 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:38.915117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70de951-7bba-4dd8-88ce-14e92fdd4c68 tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07e0d249cc541b19cbd51c178c9c575', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33c1f95a360d4995aa893cc1d5b9bcae', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-622234695', 'tempest-DelegatedRole-591700807'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:38.916239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70de951-7bba-4dd8-88ce-14e92fdd4c68 tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:38.916645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70de951-7bba-4dd8-88ce-14e92fdd4c68 tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:38.921180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70de951-7bba-4dd8-88ce-14e92fdd4c68 tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:38.921180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70de951-7bba-4dd8-88ce-14e92fdd4c68 tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] RBAC: Authorizing `identity:create_trust()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:38.921180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70de951-7bba-4dd8-88ce-14e92fdd4c68 tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:39.132014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80254d-3d16-42c6-8171-fce499e24813 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:39.136666 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2725/5442] 10.222.0.16 () {60 vars in 1173 bytes} [Mon May 2 10:38:38 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:39.149806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80254d-3d16-42c6-8171-fce499e24813 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:39.162797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dd4d9-412d-43e5-9008-95896ed5ea36 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:39.164187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dd4d9-412d-43e5-9008-95896ed5ea36 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:39.164528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dd4d9-412d-43e5-9008-95896ed5ea36 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:39.174525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dd4d9-412d-43e5-9008-95896ed5ea36 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:39.174525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dd4d9-412d-43e5-9008-95896ed5ea36 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:39.174525 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-c67dd4d9-412d-43e5-9008-95896ed5ea36 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:38:39.174525 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:38:39.174525 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:38:39.174525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dd4d9-412d-43e5-9008-95896ed5ea36 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:39.179526 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2718/5443] 10.222.0.16 () {58 vars in 1154 bytes} [Mon May 2 10:38:39 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:39.185788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70de951-7bba-4dd8-88ce-14e92fdd4c68 tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:39.201489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70de951-7bba-4dd8-88ce-14e92fdd4c68 tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:39.208272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10c171-7236-4a26-a0fd-b58aa1e1fccc tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07e0d249cc541b19cbd51c178c9c575', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33c1f95a360d4995aa893cc1d5b9bcae', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-622234695', 'tempest-DelegatedRole-591700807'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:39.209499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10c171-7236-4a26-a0fd-b58aa1e1fccc tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:39.209824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10c171-7236-4a26-a0fd-b58aa1e1fccc tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:39.210090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10c171-7236-4a26-a0fd-b58aa1e1fccc tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] PATH_INFO: `/v3/OS-TRUST/trusts/4825c578760040ebb88bad1f8dcf04ea` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:39.218927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10c171-7236-4a26-a0fd-b58aa1e1fccc tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] RBAC: Authorizing `identity:delete_trust(trust_id=4825c578760040ebb88bad1f8dcf04ea)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:39.220357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10c171-7236-4a26-a0fd-b58aa1e1fccc tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:39.313861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-cb10c171-7236-4a26-a0fd-b58aa1e1fccc tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '4825c578760040ebb88bad1f8dcf04ea', 'request_id': 'req-cb10c171-7236-4a26-a0fd-b58aa1e1fccc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:39.434442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-cb10c171-7236-4a26-a0fd-b58aa1e1fccc tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '4825c578760040ebb88bad1f8dcf04ea', 'request_id': 'req-cb10c171-7236-4a26-a0fd-b58aa1e1fccc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:39.435148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-cb10c171-7236-4a26-a0fd-b58aa1e1fccc tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '4825c578760040ebb88bad1f8dcf04ea', 'request_id': 'req-cb10c171-7236-4a26-a0fd-b58aa1e1fccc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:39.442794 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2726/5444] 10.222.0.16 () {58 vars in 1253 bytes} [Mon May 2 10:38:39 2022] DELETE /identity/v3/OS-TRUST/trusts/4825c578760040ebb88bad1f8dcf04ea => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:39.446765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dd4d9-412d-43e5-9008-95896ed5ea36 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:39.449303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c67dd4d9-412d-43e5-9008-95896ed5ea36 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:39.462785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dd4d9-412d-43e5-9008-95896ed5ea36 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:39.466964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99db9a4-b7c0-4924-bc12-a62233a55142 tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07e0d249cc541b19cbd51c178c9c575', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33c1f95a360d4995aa893cc1d5b9bcae', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-622234695', 'tempest-DelegatedRole-591700807'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:39.468361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99db9a4-b7c0-4924-bc12-a62233a55142 tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:39.468361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99db9a4-b7c0-4924-bc12-a62233a55142 tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:39.469089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99db9a4-b7c0-4924-bc12-a62233a55142 tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] PATH_INFO: `/v3/OS-TRUST/trusts/4825c578760040ebb88bad1f8dcf04ea` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:39.528264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-c99db9a4-b7c0-4924-bc12-a62233a55142 tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] Could not find trust: 4825c578760040ebb88bad1f8dcf04ea.: keystone.exception.TrustNotFound: Could not find trust: 4825c578760040ebb88bad1f8dcf04ea. May 02 10:38:39.528264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:38:39.528264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:38:39.528264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:38:39.528264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:38:39.528264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:38:39.528264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:38:39.528264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:38:39.528264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:38:39.528264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:38:39.528264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:38:39.528264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:38:39.528264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get May 02 10:38:39.528264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) May 02 10:38:39.528264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust May 02 10:38:39.531106 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', May 02 10:38:39.531106 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call May 02 10:38:39.531106 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() May 02 10:38:39.531106 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement May 02 10:38:39.531106 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( May 02 10:38:39.531106 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:38:39.531106 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:38:39.531106 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust May 02 10:38:39.531106 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) May 02 10:38:39.531106 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust May 02 10:38:39.531106 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) May 02 10:38:39.531106 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 4825c578760040ebb88bad1f8dcf04ea. May 02 10:38:39.531106 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:38:39.531106 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2719/5445] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 2 10:38:39 2022] GET /identity/v3/OS-TRUST/trusts/4825c578760040ebb88bad1f8dcf04ea => generated 111 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:38:39.533883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10c171-7236-4a26-a0fd-b58aa1e1fccc tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:39.535510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-cb10c171-7236-4a26-a0fd-b58aa1e1fccc tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:39.550319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10c171-7236-4a26-a0fd-b58aa1e1fccc tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:39.554964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67493c31-885d-4ffe-acc6-d1b892532a0f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:39.555838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67493c31-885d-4ffe-acc6-d1b892532a0f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:39.556131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67493c31-885d-4ffe-acc6-d1b892532a0f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:39.556424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67493c31-885d-4ffe-acc6-d1b892532a0f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles/2aaae7671bea4ceeb9eb4b44f509264d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:39.558588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67493c31-885d-4ffe-acc6-d1b892532a0f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2aaae7671bea4ceeb9eb4b44f509264d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:39.560198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67493c31-885d-4ffe-acc6-d1b892532a0f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:39.759955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-67493c31-885d-4ffe-acc6-d1b892532a0f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invalidating the token cache because role 2aaae7671bea4ceeb9eb4b44f509264d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:39.766510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-67493c31-885d-4ffe-acc6-d1b892532a0f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:39.766510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-67493c31-885d-4ffe-acc6-d1b892532a0f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:39.766510 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2727/5446] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:39 2022] DELETE /identity/v3/roles/2aaae7671bea4ceeb9eb4b44f509264d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:39.768414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99db9a4-b7c0-4924-bc12-a62233a55142 tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:39.770362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c99db9a4-b7c0-4924-bc12-a62233a55142 tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:39.789364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99db9a4-b7c0-4924-bc12-a62233a55142 tempest-TrustsV3TestJSON-1008260020 tempest-user-1190436322] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:39.865863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3094d2-2cb1-4f6d-a4d2-2197176ef2bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:39.867846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3094d2-2cb1-4f6d-a4d2-2197176ef2bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:39.868152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3094d2-2cb1-4f6d-a4d2-2197176ef2bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:39.870169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3094d2-2cb1-4f6d-a4d2-2197176ef2bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles/cadab6613d42490fb82b279d3674584d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:39.872010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3094d2-2cb1-4f6d-a4d2-2197176ef2bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cadab6613d42490fb82b279d3674584d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:39.874737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3094d2-2cb1-4f6d-a4d2-2197176ef2bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:40.092507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0b3094d2-2cb1-4f6d-a4d2-2197176ef2bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invalidating the token cache because role cadab6613d42490fb82b279d3674584d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:40.094927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0b3094d2-2cb1-4f6d-a4d2-2197176ef2bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:40.094927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0b3094d2-2cb1-4f6d-a4d2-2197176ef2bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:40.097600 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2720/5447] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:39 2022] DELETE /identity/v3/roles/cadab6613d42490fb82b279d3674584d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:40.101580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67493c31-885d-4ffe-acc6-d1b892532a0f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:40.117008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67493c31-885d-4ffe-acc6-d1b892532a0f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:40.179468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631699c5-e57e-42d6-90e6-e01a059081ad tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:40.180455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631699c5-e57e-42d6-90e6-e01a059081ad tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:40.180805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631699c5-e57e-42d6-90e6-e01a059081ad tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:40.181087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631699c5-e57e-42d6-90e6-e01a059081ad tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/users/f07e0d249cc541b19cbd51c178c9c575` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:40.183015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631699c5-e57e-42d6-90e6-e01a059081ad tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f07e0d249cc541b19cbd51c178c9c575)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:40.184886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631699c5-e57e-42d6-90e6-e01a059081ad tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:40.342084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-631699c5-e57e-42d6-90e6-e01a059081ad tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f07e0d249cc541b19cbd51c178c9c575'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:40.355261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-631699c5-e57e-42d6-90e6-e01a059081ad tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f07e0d249cc541b19cbd51c178c9c575'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:40.356177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-631699c5-e57e-42d6-90e6-e01a059081ad tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f07e0d249cc541b19cbd51c178c9c575'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:40.364330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-631699c5-e57e-42d6-90e6-e01a059081ad tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f07e0d249cc541b19cbd51c178c9c575'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:40.440142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-631699c5-e57e-42d6-90e6-e01a059081ad tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f07e0d249cc541b19cbd51c178c9c575'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:40.450410 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2728/5448] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:40 2022] DELETE /identity/v3/users/f07e0d249cc541b19cbd51c178c9c575 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:40.451654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3094d2-2cb1-4f6d-a4d2-2197176ef2bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:40.453224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0b3094d2-2cb1-4f6d-a4d2-2197176ef2bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:40.467524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3094d2-2cb1-4f6d-a4d2-2197176ef2bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:40.543624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a89b6-02fc-40cd-aa2b-604f66da0b2a tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:40.545390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a89b6-02fc-40cd-aa2b-604f66da0b2a tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:40.545905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a89b6-02fc-40cd-aa2b-604f66da0b2a tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:40.546450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a89b6-02fc-40cd-aa2b-604f66da0b2a tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects/33c1f95a360d4995aa893cc1d5b9bcae` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:40.547950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a89b6-02fc-40cd-aa2b-604f66da0b2a tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_project(project_id=33c1f95a360d4995aa893cc1d5b9bcae)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:40.550146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a89b6-02fc-40cd-aa2b-604f66da0b2a tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:40.753284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4d3a89b6-02fc-40cd-aa2b-604f66da0b2a tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33c1f95a360d4995aa893cc1d5b9bcae', 'request_id': 'req-4d3a89b6-02fc-40cd-aa2b-604f66da0b2a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:40.761526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4d3a89b6-02fc-40cd-aa2b-604f66da0b2a tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33c1f95a360d4995aa893cc1d5b9bcae', 'request_id': 'req-4d3a89b6-02fc-40cd-aa2b-604f66da0b2a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:40.834150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4d3a89b6-02fc-40cd-aa2b-604f66da0b2a tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33c1f95a360d4995aa893cc1d5b9bcae', 'request_id': 'req-4d3a89b6-02fc-40cd-aa2b-604f66da0b2a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:40.845290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4d3a89b6-02fc-40cd-aa2b-604f66da0b2a tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] The token cache is being invalidate because project 33c1f95a360d4995aa893cc1d5b9bcae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:40.845579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4d3a89b6-02fc-40cd-aa2b-604f66da0b2a tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:40.846342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4d3a89b6-02fc-40cd-aa2b-604f66da0b2a tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:40.848255 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2721/5449] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:40 2022] DELETE /identity/v3/projects/33c1f95a360d4995aa893cc1d5b9bcae => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:40.855486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631699c5-e57e-42d6-90e6-e01a059081ad tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:40.861112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-631699c5-e57e-42d6-90e6-e01a059081ad tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:40.871530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631699c5-e57e-42d6-90e6-e01a059081ad tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:40.933005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeca381-e87a-487e-97a0-ecd81c577b86 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:40.933686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeca381-e87a-487e-97a0-ecd81c577b86 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:40.933976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeca381-e87a-487e-97a0-ecd81c577b86 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:40.934262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeca381-e87a-487e-97a0-ecd81c577b86 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:40.934973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeca381-e87a-487e-97a0-ecd81c577b86 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:40.937038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeca381-e87a-487e-97a0-ecd81c577b86 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:41.039237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a89b6-02fc-40cd-aa2b-604f66da0b2a tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:41.041063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4d3a89b6-02fc-40cd-aa2b-604f66da0b2a tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:41.044696 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2729/5450] 10.222.0.16 () {60 vars in 1151 bytes} [Mon May 2 10:38:40 2022] POST /identity/v3/projects => generated 329 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:41.059236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a89b6-02fc-40cd-aa2b-604f66da0b2a tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:41.183837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a8167-25d4-47c4-9e98-1721e661d951 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:41.184889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a8167-25d4-47c4-9e98-1721e661d951 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:41.185161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a8167-25d4-47c4-9e98-1721e661d951 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:41.185520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a8167-25d4-47c4-9e98-1721e661d951 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:41.186304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a8167-25d4-47c4-9e98-1721e661d951 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:41.188320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a8167-25d4-47c4-9e98-1721e661d951 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:41.269627 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2722/5451] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:38:41 2022] POST /identity/v3/users => generated 413 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:41.273585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeca381-e87a-487e-97a0-ecd81c577b86 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:41.284568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeca381-e87a-487e-97a0-ecd81c577b86 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:41.290701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b7da9-c359-4f74-b70b-4a3297599b6b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:41.291552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b7da9-c359-4f74-b70b-4a3297599b6b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:41.292449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b7da9-c359-4f74-b70b-4a3297599b6b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:41.300128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b7da9-c359-4f74-b70b-4a3297599b6b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:41.300128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b7da9-c359-4f74-b70b-4a3297599b6b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:41.300128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b7da9-c359-4f74-b70b-4a3297599b6b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:41.389170 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2730/5452] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:38:41 2022] POST /identity/v3/roles => generated 244 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:41.393518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a8167-25d4-47c4-9e98-1721e661d951 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:41.413453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a8167-25d4-47c4-9e98-1721e661d951 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:41.419033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d22c2-1f73-49a7-8230-d61f730ae8fe tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:41.419713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d22c2-1f73-49a7-8230-d61f730ae8fe tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:41.421470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d22c2-1f73-49a7-8230-d61f730ae8fe tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:41.421470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d22c2-1f73-49a7-8230-d61f730ae8fe tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:41.421470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d22c2-1f73-49a7-8230-d61f730ae8fe tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:41.426111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d22c2-1f73-49a7-8230-d61f730ae8fe tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:41.510269 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2723/5453] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:38:41 2022] POST /identity/v3/roles => generated 247 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:41.514265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b7da9-c359-4f74-b70b-4a3297599b6b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:41.528412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b7da9-c359-4f74-b70b-4a3297599b6b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:41.530795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a471e-7971-45d9-8623-402bf38a71f8 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:41.531786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a471e-7971-45d9-8623-402bf38a71f8 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:41.532415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a471e-7971-45d9-8623-402bf38a71f8 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:41.532798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a471e-7971-45d9-8623-402bf38a71f8 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects/0bd06c5d733b43e095f6417965b76183/users/d420628f35d74ccb96dd6dae04d941ce/roles/44f6016f3d4c45f9a869711b1fe29215` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:41.550185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a471e-7971-45d9-8623-402bf38a71f8 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0bd06c5d733b43e095f6417965b76183, user_id=d420628f35d74ccb96dd6dae04d941ce, role_id=44f6016f3d4c45f9a869711b1fe29215)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:41.553245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a471e-7971-45d9-8623-402bf38a71f8 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:41.630250 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2731/5454] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:41 2022] PUT /identity/v3/projects/0bd06c5d733b43e095f6417965b76183/users/d420628f35d74ccb96dd6dae04d941ce/roles/44f6016f3d4c45f9a869711b1fe29215 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:41.634179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d22c2-1f73-49a7-8230-d61f730ae8fe tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:41.645207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d22c2-1f73-49a7-8230-d61f730ae8fe tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:41.715577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c96935-38e5-48d2-97d5-af39221cd9f2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:41.716919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c96935-38e5-48d2-97d5-af39221cd9f2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:41.717448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c96935-38e5-48d2-97d5-af39221cd9f2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:41.717953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c96935-38e5-48d2-97d5-af39221cd9f2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects/0bd06c5d733b43e095f6417965b76183/users/d420628f35d74ccb96dd6dae04d941ce/roles/ba4036e192a34230946db4a084ba3425` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:41.720719 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c96935-38e5-48d2-97d5-af39221cd9f2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0bd06c5d733b43e095f6417965b76183, user_id=d420628f35d74ccb96dd6dae04d941ce, role_id=ba4036e192a34230946db4a084ba3425)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:41.723712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c96935-38e5-48d2-97d5-af39221cd9f2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:41.846965 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2724/5455] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:41 2022] PUT /identity/v3/projects/0bd06c5d733b43e095f6417965b76183/users/d420628f35d74ccb96dd6dae04d941ce/roles/ba4036e192a34230946db4a084ba3425 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:41.851588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a471e-7971-45d9-8623-402bf38a71f8 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:41.864858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a471e-7971-45d9-8623-402bf38a71f8 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:41.931104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9688bb-2e92-4b44-8c8f-f75decb6d2c1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:41.931801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9688bb-2e92-4b44-8c8f-f75decb6d2c1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:41.932093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9688bb-2e92-4b44-8c8f-f75decb6d2c1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:41.932396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9688bb-2e92-4b44-8c8f-f75decb6d2c1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:41.933223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9688bb-2e92-4b44-8c8f-f75decb6d2c1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:41.935540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9688bb-2e92-4b44-8c8f-f75decb6d2c1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:41.986658 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2732/5456] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:41 2022] GET /identity/v3/users => generated 8912 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:38:41.993887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406af89d-fea5-41b3-9702-9f789e922a60 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:41.993887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406af89d-fea5-41b3-9702-9f789e922a60 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:41.993887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406af89d-fea5-41b3-9702-9f789e922a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:42.036094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-406af89d-fea5-41b3-9702-9f789e922a60 None None] MFA Rules not processed for user `d420628f35d74ccb96dd6dae04d941ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:42.037281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-406af89d-fea5-41b3-9702-9f789e922a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:42.145227 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2725/5457] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:42.157303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93582a6c-c917-4bdc-b3ae-ae57ee0430d6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:42.157711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93582a6c-c917-4bdc-b3ae-ae57ee0430d6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:42.158105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93582a6c-c917-4bdc-b3ae-ae57ee0430d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:42.222012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-93582a6c-c917-4bdc-b3ae-ae57ee0430d6 None None] MFA Rules not processed for user `d420628f35d74ccb96dd6dae04d941ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:42.225555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-93582a6c-c917-4bdc-b3ae-ae57ee0430d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:42.251273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406af89d-fea5-41b3-9702-9f789e922a60 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:42.254163 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2733/5458] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:42.263571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406af89d-fea5-41b3-9702-9f789e922a60 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:42.278800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e38e66-b168-422a-8ed0-ac7a438b0ad4 tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd420628f35d74ccb96dd6dae04d941ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bd06c5d733b43e095f6417965b76183', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1989596294', 'tempest-DelegatedRole-1848716476'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:42.279486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e38e66-b168-422a-8ed0-ac7a438b0ad4 tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:42.279773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e38e66-b168-422a-8ed0-ac7a438b0ad4 tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:42.280055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e38e66-b168-422a-8ed0-ac7a438b0ad4 tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:42.280834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e38e66-b168-422a-8ed0-ac7a438b0ad4 tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] RBAC: Authorizing `identity:create_trust()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:42.282004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e38e66-b168-422a-8ed0-ac7a438b0ad4 tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:42.500893 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2726/5459] 10.222.0.16 () {60 vars in 1173 bytes} [Mon May 2 10:38:42 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:42.503473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93582a6c-c917-4bdc-b3ae-ae57ee0430d6 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:42.512948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93582a6c-c917-4bdc-b3ae-ae57ee0430d6 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:42.517291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a29fa-4393-4a6e-a5fb-665ec52235ae tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd420628f35d74ccb96dd6dae04d941ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bd06c5d733b43e095f6417965b76183', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1989596294', 'tempest-DelegatedRole-1848716476'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:42.517934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a29fa-4393-4a6e-a5fb-665ec52235ae tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:42.518218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a29fa-4393-4a6e-a5fb-665ec52235ae tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:42.518496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a29fa-4393-4a6e-a5fb-665ec52235ae tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:42.519210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a29fa-4393-4a6e-a5fb-665ec52235ae tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:42.520562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a29fa-4393-4a6e-a5fb-665ec52235ae tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:42.526538 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2734/5460] 10.222.0.16 () {58 vars in 1251 bytes} [Mon May 2 10:38:42 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=d420628f35d74ccb96dd6dae04d941ce => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:42.530874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e38e66-b168-422a-8ed0-ac7a438b0ad4 tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:42.545954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e38e66-b168-422a-8ed0-ac7a438b0ad4 tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:42.550170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72050a01-696e-4ae6-ba44-c918bd4c3df0 tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd420628f35d74ccb96dd6dae04d941ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bd06c5d733b43e095f6417965b76183', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1989596294', 'tempest-DelegatedRole-1848716476'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:42.551003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72050a01-696e-4ae6-ba44-c918bd4c3df0 tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:42.551291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72050a01-696e-4ae6-ba44-c918bd4c3df0 tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:42.551573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72050a01-696e-4ae6-ba44-c918bd4c3df0 tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] PATH_INFO: `/v3/OS-TRUST/trusts/7c4c27d7d9c34fd8a9d89b612d6d1ad3` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:42.562595 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72050a01-696e-4ae6-ba44-c918bd4c3df0 tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] RBAC: Authorizing `identity:delete_trust(trust_id=7c4c27d7d9c34fd8a9d89b612d6d1ad3)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:42.564704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72050a01-696e-4ae6-ba44-c918bd4c3df0 tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:42.711823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-72050a01-696e-4ae6-ba44-c918bd4c3df0 tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7c4c27d7d9c34fd8a9d89b612d6d1ad3', 'request_id': 'req-72050a01-696e-4ae6-ba44-c918bd4c3df0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:42.716959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-72050a01-696e-4ae6-ba44-c918bd4c3df0 tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '7c4c27d7d9c34fd8a9d89b612d6d1ad3', 'request_id': 'req-72050a01-696e-4ae6-ba44-c918bd4c3df0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:42.868136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-72050a01-696e-4ae6-ba44-c918bd4c3df0 tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7c4c27d7d9c34fd8a9d89b612d6d1ad3', 'request_id': 'req-72050a01-696e-4ae6-ba44-c918bd4c3df0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:42.878301 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2727/5461] 10.222.0.16 () {58 vars in 1253 bytes} [Mon May 2 10:38:42 2022] DELETE /identity/v3/OS-TRUST/trusts/7c4c27d7d9c34fd8a9d89b612d6d1ad3 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:42.882784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a29fa-4393-4a6e-a5fb-665ec52235ae tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:42.885063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e79a29fa-4393-4a6e-a5fb-665ec52235ae tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:42.899817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a29fa-4393-4a6e-a5fb-665ec52235ae tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:42.904437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84901c-0d6a-45be-8c34-32feb159b5ff tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd420628f35d74ccb96dd6dae04d941ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bd06c5d733b43e095f6417965b76183', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1989596294', 'tempest-DelegatedRole-1848716476'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:42.908110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84901c-0d6a-45be-8c34-32feb159b5ff tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:42.908110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84901c-0d6a-45be-8c34-32feb159b5ff tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:42.908110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84901c-0d6a-45be-8c34-32feb159b5ff tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] PATH_INFO: `/v3/OS-TRUST/trusts/7c4c27d7d9c34fd8a9d89b612d6d1ad3` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:42.921672 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-9c84901c-0d6a-45be-8c34-32feb159b5ff tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] Could not find trust: 7c4c27d7d9c34fd8a9d89b612d6d1ad3.: keystone.exception.TrustNotFound: Could not find trust: 7c4c27d7d9c34fd8a9d89b612d6d1ad3. May 02 10:38:42.921672 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:38:42.921672 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:38:42.921672 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:38:42.921672 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:38:42.921672 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:38:42.921672 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:38:42.921672 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:38:42.921672 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:38:42.921672 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:38:42.921672 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:38:42.921672 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:38:42.921672 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get May 02 10:38:42.921672 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) May 02 10:38:42.921672 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust May 02 10:38:42.922995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', May 02 10:38:42.922995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call May 02 10:38:42.922995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() May 02 10:38:42.922995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement May 02 10:38:42.922995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( May 02 10:38:42.922995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:38:42.922995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:38:42.922995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust May 02 10:38:42.922995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) May 02 10:38:42.922995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust May 02 10:38:42.922995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) May 02 10:38:42.922995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 7c4c27d7d9c34fd8a9d89b612d6d1ad3. May 02 10:38:42.922995 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:38:42.927081 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2735/5462] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 2 10:38:42 2022] GET /identity/v3/OS-TRUST/trusts/7c4c27d7d9c34fd8a9d89b612d6d1ad3 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 02 10:38:42.928561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72050a01-696e-4ae6-ba44-c918bd4c3df0 tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:42.930345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-72050a01-696e-4ae6-ba44-c918bd4c3df0 tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:42.948785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72050a01-696e-4ae6-ba44-c918bd4c3df0 tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:42.955108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a2673-2897-4f53-ae2e-6864e0b6c30b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:42.956241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a2673-2897-4f53-ae2e-6864e0b6c30b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:42.956620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a2673-2897-4f53-ae2e-6864e0b6c30b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:42.957111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a2673-2897-4f53-ae2e-6864e0b6c30b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles/ba4036e192a34230946db4a084ba3425` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:42.958906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a2673-2897-4f53-ae2e-6864e0b6c30b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ba4036e192a34230946db4a084ba3425)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:42.960775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a2673-2897-4f53-ae2e-6864e0b6c30b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:43.115993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2d6a2673-2897-4f53-ae2e-6864e0b6c30b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invalidating the token cache because role ba4036e192a34230946db4a084ba3425 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:43.116644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2d6a2673-2897-4f53-ae2e-6864e0b6c30b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:43.117504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2d6a2673-2897-4f53-ae2e-6864e0b6c30b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:43.123988 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2728/5463] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:42 2022] DELETE /identity/v3/roles/ba4036e192a34230946db4a084ba3425 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:43.125302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84901c-0d6a-45be-8c34-32feb159b5ff tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:43.127392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9c84901c-0d6a-45be-8c34-32feb159b5ff tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:43.145460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84901c-0d6a-45be-8c34-32feb159b5ff tempest-TrustsV3TestJSON-1686490891 tempest-user-636464037] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:43.208923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a111d-336b-4dd9-8c27-30130d658c55 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:43.209950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a111d-336b-4dd9-8c27-30130d658c55 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:43.210599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a111d-336b-4dd9-8c27-30130d658c55 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:43.210886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a111d-336b-4dd9-8c27-30130d658c55 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles/44f6016f3d4c45f9a869711b1fe29215` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:43.212442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a111d-336b-4dd9-8c27-30130d658c55 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_role(role_id=44f6016f3d4c45f9a869711b1fe29215)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:43.214813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a111d-336b-4dd9-8c27-30130d658c55 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:43.388006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ce4a111d-336b-4dd9-8c27-30130d658c55 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invalidating the token cache because role 44f6016f3d4c45f9a869711b1fe29215 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:43.388383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ce4a111d-336b-4dd9-8c27-30130d658c55 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:43.389311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ce4a111d-336b-4dd9-8c27-30130d658c55 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:43.397340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a2673-2897-4f53-ae2e-6864e0b6c30b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:43.398643 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2736/5464] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:43 2022] DELETE /identity/v3/roles/44f6016f3d4c45f9a869711b1fe29215 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:43.414081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a2673-2897-4f53-ae2e-6864e0b6c30b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:43.487664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef1cf2-4167-4955-8548-18d9847f34b6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:43.488868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef1cf2-4167-4955-8548-18d9847f34b6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:43.489160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef1cf2-4167-4955-8548-18d9847f34b6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:43.489432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef1cf2-4167-4955-8548-18d9847f34b6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/users/d420628f35d74ccb96dd6dae04d941ce` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:43.490696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef1cf2-4167-4955-8548-18d9847f34b6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d420628f35d74ccb96dd6dae04d941ce)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:43.493458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef1cf2-4167-4955-8548-18d9847f34b6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:43.620478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-07ef1cf2-4167-4955-8548-18d9847f34b6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd420628f35d74ccb96dd6dae04d941ce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:43.634972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-07ef1cf2-4167-4955-8548-18d9847f34b6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd420628f35d74ccb96dd6dae04d941ce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:43.636372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-07ef1cf2-4167-4955-8548-18d9847f34b6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd420628f35d74ccb96dd6dae04d941ce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:43.643803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-07ef1cf2-4167-4955-8548-18d9847f34b6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd420628f35d74ccb96dd6dae04d941ce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:43.705201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a111d-336b-4dd9-8c27-30130d658c55 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:43.707878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ce4a111d-336b-4dd9-8c27-30130d658c55 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:43.710602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-07ef1cf2-4167-4955-8548-18d9847f34b6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd420628f35d74ccb96dd6dae04d941ce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:43.727619 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2729/5465] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:43 2022] DELETE /identity/v3/users/d420628f35d74ccb96dd6dae04d941ce => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:43.728581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef1cf2-4167-4955-8548-18d9847f34b6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:43.730772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-07ef1cf2-4167-4955-8548-18d9847f34b6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:43.804442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a111d-336b-4dd9-8c27-30130d658c55 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:43.818814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef1cf2-4167-4955-8548-18d9847f34b6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:43.826322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c3612-03f3-4dd3-9e9a-348ebbf6635f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:43.834048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c3612-03f3-4dd3-9e9a-348ebbf6635f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:43.834048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c3612-03f3-4dd3-9e9a-348ebbf6635f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:43.834048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c3612-03f3-4dd3-9e9a-348ebbf6635f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects/0bd06c5d733b43e095f6417965b76183` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:43.834048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c3612-03f3-4dd3-9e9a-348ebbf6635f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0bd06c5d733b43e095f6417965b76183)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:43.834048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c3612-03f3-4dd3-9e9a-348ebbf6635f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:43.881935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fb128-dbea-4b39-b423-7c3ac2ff8727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:43.882916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fb128-dbea-4b39-b423-7c3ac2ff8727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:43.883205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fb128-dbea-4b39-b423-7c3ac2ff8727 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:43.883489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fb128-dbea-4b39-b423-7c3ac2ff8727 admin admin] PATH_INFO: `/v3/users/0002b2ad28cb4be98a964ee5ebeb036d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:43.884910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fb128-dbea-4b39-b423-7c3ac2ff8727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0002b2ad28cb4be98a964ee5ebeb036d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:43.887683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fb128-dbea-4b39-b423-7c3ac2ff8727 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:44.100897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-952c3612-03f3-4dd3-9e9a-348ebbf6635f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bd06c5d733b43e095f6417965b76183', 'request_id': 'req-952c3612-03f3-4dd3-9e9a-348ebbf6635f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:44.113698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-952c3612-03f3-4dd3-9e9a-348ebbf6635f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bd06c5d733b43e095f6417965b76183', 'request_id': 'req-952c3612-03f3-4dd3-9e9a-348ebbf6635f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:44.242077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-810fb128-dbea-4b39-b423-7c3ac2ff8727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0002b2ad28cb4be98a964ee5ebeb036d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:44.262449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-810fb128-dbea-4b39-b423-7c3ac2ff8727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0002b2ad28cb4be98a964ee5ebeb036d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:44.263270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-810fb128-dbea-4b39-b423-7c3ac2ff8727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0002b2ad28cb4be98a964ee5ebeb036d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:44.271222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-810fb128-dbea-4b39-b423-7c3ac2ff8727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0002b2ad28cb4be98a964ee5ebeb036d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:44.274181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-952c3612-03f3-4dd3-9e9a-348ebbf6635f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bd06c5d733b43e095f6417965b76183', 'request_id': 'req-952c3612-03f3-4dd3-9e9a-348ebbf6635f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:44.296982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-952c3612-03f3-4dd3-9e9a-348ebbf6635f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] The token cache is being invalidate because project 0bd06c5d733b43e095f6417965b76183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:44.297499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-952c3612-03f3-4dd3-9e9a-348ebbf6635f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:44.298528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-952c3612-03f3-4dd3-9e9a-348ebbf6635f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:44.304112 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2730/5466] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:43 2022] DELETE /identity/v3/projects/0bd06c5d733b43e095f6417965b76183 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:44.312373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c3612-03f3-4dd3-9e9a-348ebbf6635f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:44.312373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-952c3612-03f3-4dd3-9e9a-348ebbf6635f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:44.395061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c3612-03f3-4dd3-9e9a-348ebbf6635f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:44.403639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790e3e0-51b3-449a-87e7-c6e743801b8f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:44.404301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790e3e0-51b3-449a-87e7-c6e743801b8f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:44.404592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790e3e0-51b3-449a-87e7-c6e743801b8f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:44.404896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790e3e0-51b3-449a-87e7-c6e743801b8f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:44.405581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790e3e0-51b3-449a-87e7-c6e743801b8f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:44.407502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790e3e0-51b3-449a-87e7-c6e743801b8f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:44.410769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-810fb128-dbea-4b39-b423-7c3ac2ff8727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0002b2ad28cb4be98a964ee5ebeb036d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:44.418983 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2737/5467] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:43 2022] DELETE /identity/v3/users/0002b2ad28cb4be98a964ee5ebeb036d => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:44.436225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f34db-30ab-4cba-aeea-a112a1744da4 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:44.436521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f34db-30ab-4cba-aeea-a112a1744da4 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:44.436885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f34db-30ab-4cba-aeea-a112a1744da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:44.455530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d16f34db-30ab-4cba-aeea-a112a1744da4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:44.456839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d16f34db-30ab-4cba-aeea-a112a1744da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:44.518170 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2731/5468] 10.222.0.16 () {60 vars in 1151 bytes} [Mon May 2 10:38:44 2022] POST /identity/v3/projects => generated 328 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:44.522847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790e3e0-51b3-449a-87e7-c6e743801b8f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:44.522847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2790e3e0-51b3-449a-87e7-c6e743801b8f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:44.552508 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2738/5469] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:38:44.568078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f34db-30ab-4cba-aeea-a112a1744da4 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:44.569857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d16f34db-30ab-4cba-aeea-a112a1744da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:44.600522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790e3e0-51b3-449a-87e7-c6e743801b8f tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:44.613536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3d6dc-4c00-4d86-9130-a9ac66676e96 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:44.613536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3d6dc-4c00-4d86-9130-a9ac66676e96 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:44.613536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3d6dc-4c00-4d86-9130-a9ac66676e96 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:44.613946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3d6dc-4c00-4d86-9130-a9ac66676e96 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:44.613946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3d6dc-4c00-4d86-9130-a9ac66676e96 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:44.614149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3d6dc-4c00-4d86-9130-a9ac66676e96 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:44.634819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f34db-30ab-4cba-aeea-a112a1744da4 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:44.698872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9786660-fbab-45c4-a9ca-d4c7de07bb00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:44.699529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9786660-fbab-45c4-a9ca-d4c7de07bb00 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:44.699817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9786660-fbab-45c4-a9ca-d4c7de07bb00 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:44.700141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9786660-fbab-45c4-a9ca-d4c7de07bb00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:44.764065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9786660-fbab-45c4-a9ca-d4c7de07bb00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:44.765572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9786660-fbab-45c4-a9ca-d4c7de07bb00 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:44.775435 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2739/5470] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:38:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:38:44.794262 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2732/5471] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:38:44 2022] POST /identity/v3/users => generated 413 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:38:44.796218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9786660-fbab-45c4-a9ca-d4c7de07bb00 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:44.810948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9786660-fbab-45c4-a9ca-d4c7de07bb00 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:44.823518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2bb71-6601-492f-84b8-ba966ea2bd45 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:44.823518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2bb71-6601-492f-84b8-ba966ea2bd45 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:44.823518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2bb71-6601-492f-84b8-ba966ea2bd45 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:44.824066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2bb71-6601-492f-84b8-ba966ea2bd45 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:44.824938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2bb71-6601-492f-84b8-ba966ea2bd45 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:44.829903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2bb71-6601-492f-84b8-ba966ea2bd45 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:44.931883 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2740/5472] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:38:44 2022] POST /identity/v3/roles => generated 243 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:44.935480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3d6dc-4c00-4d86-9130-a9ac66676e96 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:44.946055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3d6dc-4c00-4d86-9130-a9ac66676e96 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:44.951588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248b379-97e7-45ef-bc0d-aca120db1684 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:44.952332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248b379-97e7-45ef-bc0d-aca120db1684 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:44.952741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248b379-97e7-45ef-bc0d-aca120db1684 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:44.953091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248b379-97e7-45ef-bc0d-aca120db1684 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:44.953917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248b379-97e7-45ef-bc0d-aca120db1684 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:44.955698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248b379-97e7-45ef-bc0d-aca120db1684 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:45.083973 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2733/5473] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:38:44 2022] POST /identity/v3/roles => generated 247 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:45.088194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2bb71-6601-492f-84b8-ba966ea2bd45 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:45.104793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2bb71-6601-492f-84b8-ba966ea2bd45 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:45.109666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff67467-5e95-4db1-98f1-cb7a7e10c775 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:45.110608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff67467-5e95-4db1-98f1-cb7a7e10c775 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:45.110901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff67467-5e95-4db1-98f1-cb7a7e10c775 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:45.111184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff67467-5e95-4db1-98f1-cb7a7e10c775 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects/41b1b6b8b872408fb984d5b3bd23d58a/users/38410eb49364478e9a4bc83f602c773b/roles/a52285a4823f40ce97e06936822502aa` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:45.130023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff67467-5e95-4db1-98f1-cb7a7e10c775 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_grant(project_id=41b1b6b8b872408fb984d5b3bd23d58a, user_id=38410eb49364478e9a4bc83f602c773b, role_id=a52285a4823f40ce97e06936822502aa)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:45.133014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff67467-5e95-4db1-98f1-cb7a7e10c775 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:45.210931 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2741/5474] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:45 2022] PUT /identity/v3/projects/41b1b6b8b872408fb984d5b3bd23d58a/users/38410eb49364478e9a4bc83f602c773b/roles/a52285a4823f40ce97e06936822502aa => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:45.215883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248b379-97e7-45ef-bc0d-aca120db1684 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:45.226350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248b379-97e7-45ef-bc0d-aca120db1684 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:45.283661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759491e4-a234-4a83-841f-40f697630243 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:45.284588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759491e4-a234-4a83-841f-40f697630243 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:45.284903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759491e4-a234-4a83-841f-40f697630243 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:45.285188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759491e4-a234-4a83-841f-40f697630243 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects/41b1b6b8b872408fb984d5b3bd23d58a/users/38410eb49364478e9a4bc83f602c773b/roles/221412b2547c4e759728561aed04406d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:45.287477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759491e4-a234-4a83-841f-40f697630243 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_grant(project_id=41b1b6b8b872408fb984d5b3bd23d58a, user_id=38410eb49364478e9a4bc83f602c773b, role_id=221412b2547c4e759728561aed04406d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:45.290519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759491e4-a234-4a83-841f-40f697630243 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:45.344154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff67467-5e95-4db1-98f1-cb7a7e10c775 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:45.345868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9ff67467-5e95-4db1-98f1-cb7a7e10c775 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:45.394270 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2734/5475] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:45 2022] PUT /identity/v3/projects/41b1b6b8b872408fb984d5b3bd23d58a/users/38410eb49364478e9a4bc83f602c773b/roles/221412b2547c4e759728561aed04406d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:45.398343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759491e4-a234-4a83-841f-40f697630243 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:45.419640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff67467-5e95-4db1-98f1-cb7a7e10c775 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:45.471845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759491e4-a234-4a83-841f-40f697630243 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:45.476673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa3d2a-241b-4118-b397-74d22e5e5452 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:45.477432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa3d2a-241b-4118-b397-74d22e5e5452 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:45.477817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa3d2a-241b-4118-b397-74d22e5e5452 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:45.477975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b2748-722f-4a08-a582-620750383fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:45.478181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa3d2a-241b-4118-b397-74d22e5e5452 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:45.478748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b2748-722f-4a08-a582-620750383fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:45.478903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa3d2a-241b-4118-b397-74d22e5e5452 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:45.479017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b2748-722f-4a08-a582-620750383fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:45.479336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b2748-722f-4a08-a582-620750383fa0 admin admin] PATH_INFO: `/v3/projects/bb850d4d6d4e4aaaa1770711f0f47564` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:45.480594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b2748-722f-4a08-a582-620750383fa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb850d4d6d4e4aaaa1770711f0f47564)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:45.480857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa3d2a-241b-4118-b397-74d22e5e5452 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:45.482493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b2748-722f-4a08-a582-620750383fa0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:45.511186 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2735/5476] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:45 2022] GET /identity/v3/users => generated 8633 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:38:45.516008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11d08c-6bd2-4c2c-812c-d51c40bace40 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:45.516296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11d08c-6bd2-4c2c-812c-d51c40bace40 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:45.516575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11d08c-6bd2-4c2c-812c-d51c40bace40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:45.552722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-aa11d08c-6bd2-4c2c-812c-d51c40bace40 None None] MFA Rules not processed for user `38410eb49364478e9a4bc83f602c773b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:45.553938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-aa11d08c-6bd2-4c2c-812c-d51c40bace40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:45.605961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-749b2748-722f-4a08-a582-620750383fa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb850d4d6d4e4aaaa1770711f0f47564', 'request_id': 'req-749b2748-722f-4a08-a582-620750383fa0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:45.617966 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2736/5477] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:38:45.628067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639c48f-db3d-4146-a60e-dc15b87f475b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:45.628298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639c48f-db3d-4146-a60e-dc15b87f475b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:45.628584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639c48f-db3d-4146-a60e-dc15b87f475b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:45.646300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4639c48f-db3d-4146-a60e-dc15b87f475b None None] MFA Rules not processed for user `38410eb49364478e9a4bc83f602c773b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:45.647501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4639c48f-db3d-4146-a60e-dc15b87f475b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:45.661944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-749b2748-722f-4a08-a582-620750383fa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb850d4d6d4e4aaaa1770711f0f47564', 'request_id': 'req-749b2748-722f-4a08-a582-620750383fa0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:45.669733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-749b2748-722f-4a08-a582-620750383fa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb850d4d6d4e4aaaa1770711f0f47564', 'request_id': 'req-749b2748-722f-4a08-a582-620750383fa0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:45.680414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-749b2748-722f-4a08-a582-620750383fa0 admin admin] The token cache is being invalidate because project bb850d4d6d4e4aaaa1770711f0f47564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:45.680757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-749b2748-722f-4a08-a582-620750383fa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:45.681431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-749b2748-722f-4a08-a582-620750383fa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:45.683085 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2742/5478] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:45 2022] DELETE /identity/v3/projects/bb850d4d6d4e4aaaa1770711f0f47564 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:45.687017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b2748-722f-4a08-a582-620750383fa0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:45.688357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-749b2748-722f-4a08-a582-620750383fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:45.703018 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2737/5479] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:38:45.707804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639c48f-db3d-4146-a60e-dc15b87f475b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:45.716737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639c48f-db3d-4146-a60e-dc15b87f475b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:45.721136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453554c-4ca2-4196-868a-ff1be0b872ec tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38410eb49364478e9a4bc83f602c773b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b1b6b8b872408fb984d5b3bd23d58a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-130943857', 'tempest-NotDelegatedRole-2004787893'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:45.721999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453554c-4ca2-4196-868a-ff1be0b872ec tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:45.722291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453554c-4ca2-4196-868a-ff1be0b872ec tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:45.722578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453554c-4ca2-4196-868a-ff1be0b872ec tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:45.723456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453554c-4ca2-4196-868a-ff1be0b872ec tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: Authorizing `identity:create_trust()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:45.724632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453554c-4ca2-4196-868a-ff1be0b872ec tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:45.751139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b2748-722f-4a08-a582-620750383fa0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:45.755962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9926940-e0d6-4b64-802e-44d8ba284324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:45.756874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9926940-e0d6-4b64-802e-44d8ba284324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:45.757162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9926940-e0d6-4b64-802e-44d8ba284324 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:45.757449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9926940-e0d6-4b64-802e-44d8ba284324 admin admin] PATH_INFO: `/v3/users/d7412c3f8680425298656c66656c5bb0` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:45.758657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9926940-e0d6-4b64-802e-44d8ba284324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7412c3f8680425298656c66656c5bb0)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:45.761154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9926940-e0d6-4b64-802e-44d8ba284324 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:45.933971 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2738/5480] 10.222.0.16 () {60 vars in 1173 bytes} [Mon May 2 10:38:45 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:45.936025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453554c-4ca2-4196-868a-ff1be0b872ec tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:45.945343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453554c-4ca2-4196-868a-ff1be0b872ec tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:45.950209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf16502-1572-436e-86a1-97bffe1ab7c0 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38410eb49364478e9a4bc83f602c773b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b1b6b8b872408fb984d5b3bd23d58a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-130943857', 'tempest-NotDelegatedRole-2004787893'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:45.951028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf16502-1572-436e-86a1-97bffe1ab7c0 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:45.951458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf16502-1572-436e-86a1-97bffe1ab7c0 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:45.951679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf16502-1572-436e-86a1-97bffe1ab7c0 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] PATH_INFO: `/v3/OS-TRUST/trusts/dbcf5f8c976f4092a75cf55dd2a79545` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:45.957753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf16502-1572-436e-86a1-97bffe1ab7c0 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: Authorizing `identity:get_trust(trust_id=dbcf5f8c976f4092a75cf55dd2a79545)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:45.959363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf16502-1572-436e-86a1-97bffe1ab7c0 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:45.968016 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2739/5481] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 2 10:38:45 2022] GET /identity/v3/OS-TRUST/trusts/dbcf5f8c976f4092a75cf55dd2a79545 => generated 858 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:38:45.972783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf16502-1572-436e-86a1-97bffe1ab7c0 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:45.983043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf16502-1572-436e-86a1-97bffe1ab7c0 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:45.987275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b6b2e-2528-4140-bac8-eac6a6035af5 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38410eb49364478e9a4bc83f602c773b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b1b6b8b872408fb984d5b3bd23d58a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-130943857', 'tempest-NotDelegatedRole-2004787893'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:45.988055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b6b2e-2528-4140-bac8-eac6a6035af5 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:45.988341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b6b2e-2528-4140-bac8-eac6a6035af5 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:45.988654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b6b2e-2528-4140-bac8-eac6a6035af5 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] PATH_INFO: `/v3/OS-TRUST/trusts/dbcf5f8c976f4092a75cf55dd2a79545/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:45.994845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b6b2e-2528-4140-bac8-eac6a6035af5 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=dbcf5f8c976f4092a75cf55dd2a79545)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:45.996391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b6b2e-2528-4140-bac8-eac6a6035af5 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:46.003904 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2740/5482] 10.222.0.16 () {58 vars in 1268 bytes} [Mon May 2 10:38:45 2022] GET /identity/v3/OS-TRUST/trusts/dbcf5f8c976f4092a75cf55dd2a79545/roles => generated 370 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:46.008109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b6b2e-2528-4140-bac8-eac6a6035af5 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:46.009097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b9926940-e0d6-4b64-802e-44d8ba284324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7412c3f8680425298656c66656c5bb0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:46.022631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b6b2e-2528-4140-bac8-eac6a6035af5 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:46.024377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b9926940-e0d6-4b64-802e-44d8ba284324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7412c3f8680425298656c66656c5bb0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:46.024377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b9926940-e0d6-4b64-802e-44d8ba284324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7412c3f8680425298656c66656c5bb0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:46.030457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046289e9-303d-4a95-9ae3-0123759172e8 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38410eb49364478e9a4bc83f602c773b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b1b6b8b872408fb984d5b3bd23d58a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-130943857', 'tempest-NotDelegatedRole-2004787893'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:46.031570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046289e9-303d-4a95-9ae3-0123759172e8 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:46.031914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046289e9-303d-4a95-9ae3-0123759172e8 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:46.032199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046289e9-303d-4a95-9ae3-0123759172e8 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] PATH_INFO: `/v3/OS-TRUST/trusts/dbcf5f8c976f4092a75cf55dd2a79545/roles/a52285a4823f40ce97e06936822502aa` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:46.032340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b9926940-e0d6-4b64-802e-44d8ba284324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7412c3f8680425298656c66656c5bb0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:46.038480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046289e9-303d-4a95-9ae3-0123759172e8 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: Authorizing `identity:get_role_for_trust(trust_id=dbcf5f8c976f4092a75cf55dd2a79545, role_id=a52285a4823f40ce97e06936822502aa)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:46.039931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046289e9-303d-4a95-9ae3-0123759172e8 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:46.046860 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2741/5483] 10.222.0.16 () {58 vars in 1367 bytes} [Mon May 2 10:38:46 2022] GET /identity/v3/OS-TRUST/trusts/dbcf5f8c976f4092a75cf55dd2a79545/roles/a52285a4823f40ce97e06936822502aa => generated 243 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:38:46.050794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046289e9-303d-4a95-9ae3-0123759172e8 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:46.060542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046289e9-303d-4a95-9ae3-0123759172e8 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:46.064941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f9bd3-39b5-45e6-9e92-fb987b7b938e tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38410eb49364478e9a4bc83f602c773b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b1b6b8b872408fb984d5b3bd23d58a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-130943857', 'tempest-NotDelegatedRole-2004787893'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:46.065825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f9bd3-39b5-45e6-9e92-fb987b7b938e tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] REQUEST_METHOD: `HEAD` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:46.066113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f9bd3-39b5-45e6-9e92-fb987b7b938e tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:46.066394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f9bd3-39b5-45e6-9e92-fb987b7b938e tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] PATH_INFO: `/v3/OS-TRUST/trusts/dbcf5f8c976f4092a75cf55dd2a79545/roles/a52285a4823f40ce97e06936822502aa` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:46.072154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f9bd3-39b5-45e6-9e92-fb987b7b938e tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: Authorizing `identity:get_role_for_trust(trust_id=dbcf5f8c976f4092a75cf55dd2a79545, role_id=a52285a4823f40ce97e06936822502aa)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:46.074191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f9bd3-39b5-45e6-9e92-fb987b7b938e tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:46.080814 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2742/5484] 10.222.0.16 () {58 vars in 1368 bytes} [Mon May 2 10:38:46 2022] HEAD /identity/v3/OS-TRUST/trusts/dbcf5f8c976f4092a75cf55dd2a79545/roles/a52285a4823f40ce97e06936822502aa => generated 0 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:46.085052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f9bd3-39b5-45e6-9e92-fb987b7b938e tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:46.095300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f9bd3-39b5-45e6-9e92-fb987b7b938e tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:46.099832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39995f-2510-4809-85ae-2026e7a2839f tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38410eb49364478e9a4bc83f602c773b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b1b6b8b872408fb984d5b3bd23d58a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-130943857', 'tempest-NotDelegatedRole-2004787893'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:46.100692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39995f-2510-4809-85ae-2026e7a2839f tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:46.104892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39995f-2510-4809-85ae-2026e7a2839f tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:46.104892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39995f-2510-4809-85ae-2026e7a2839f tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] PATH_INFO: `/v3/OS-TRUST/trusts/dbcf5f8c976f4092a75cf55dd2a79545/roles/221412b2547c4e759728561aed04406d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:46.107410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39995f-2510-4809-85ae-2026e7a2839f tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: Authorizing `identity:get_role_for_trust(trust_id=dbcf5f8c976f4092a75cf55dd2a79545, role_id=221412b2547c4e759728561aed04406d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:46.108898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39995f-2510-4809-85ae-2026e7a2839f tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:46.123125 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-ab39995f-2510-4809-85ae-2026e7a2839f tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Could not find role: 221412b2547c4e759728561aed04406d.: keystone.exception.RoleNotFound: Could not find role: 221412b2547c4e759728561aed04406d. May 02 10:38:46.123125 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:38:46.123125 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:38:46.123125 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:38:46.123125 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:38:46.123125 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:38:46.123125 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:38:46.123125 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:38:46.123125 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:38:46.123125 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:38:46.123125 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:38:46.123125 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:38:46.123125 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get May 02 10:38:46.123125 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 10:38:46.125472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 221412b2547c4e759728561aed04406d. May 02 10:38:46.125472 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:38:46.125938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b9926940-e0d6-4b64-802e-44d8ba284324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7412c3f8680425298656c66656c5bb0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:46.126053 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2743/5485] 10.222.0.16 () {58 vars in 1367 bytes} [Mon May 2 10:38:46 2022] GET /identity/v3/OS-TRUST/trusts/dbcf5f8c976f4092a75cf55dd2a79545/roles/221412b2547c4e759728561aed04406d => generated 110 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 02 10:38:46.128962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39995f-2510-4809-85ae-2026e7a2839f tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:46.133580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ab39995f-2510-4809-85ae-2026e7a2839f tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:46.133720 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2743/5486] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:45 2022] DELETE /identity/v3/users/d7412c3f8680425298656c66656c5bb0 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:46.143022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39995f-2510-4809-85ae-2026e7a2839f tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:46.205799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915c0d0-6512-45e9-b57a-2b769618d6f1 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38410eb49364478e9a4bc83f602c773b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b1b6b8b872408fb984d5b3bd23d58a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-130943857', 'tempest-NotDelegatedRole-2004787893'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:46.206636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915c0d0-6512-45e9-b57a-2b769618d6f1 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] REQUEST_METHOD: `HEAD` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:46.206917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915c0d0-6512-45e9-b57a-2b769618d6f1 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:46.207194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915c0d0-6512-45e9-b57a-2b769618d6f1 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] PATH_INFO: `/v3/OS-TRUST/trusts/dbcf5f8c976f4092a75cf55dd2a79545/roles/221412b2547c4e759728561aed04406d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:46.213142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915c0d0-6512-45e9-b57a-2b769618d6f1 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: Authorizing `identity:get_role_for_trust(trust_id=dbcf5f8c976f4092a75cf55dd2a79545, role_id=221412b2547c4e759728561aed04406d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:46.214679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915c0d0-6512-45e9-b57a-2b769618d6f1 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:46.229063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-e915c0d0-6512-45e9-b57a-2b769618d6f1 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Could not find role: 221412b2547c4e759728561aed04406d.: keystone.exception.RoleNotFound: Could not find role: 221412b2547c4e759728561aed04406d. May 02 10:38:46.229063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:38:46.229063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:38:46.229063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:38:46.229063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:38:46.229063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:38:46.229063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:38:46.229063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:38:46.229063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:38:46.229063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:38:46.229063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:38:46.229063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:38:46.229063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get May 02 10:38:46.229063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 10:38:46.230484 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 221412b2547c4e759728561aed04406d. May 02 10:38:46.230484 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:38:46.230813 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2744/5487] 10.222.0.16 () {58 vars in 1368 bytes} [Mon May 2 10:38:46 2022] HEAD /identity/v3/OS-TRUST/trusts/dbcf5f8c976f4092a75cf55dd2a79545/roles/221412b2547c4e759728561aed04406d => generated 0 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:38:46.234733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9926940-e0d6-4b64-802e-44d8ba284324 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:46.246513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9926940-e0d6-4b64-802e-44d8ba284324 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:46.251326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12e1be-7d14-44aa-8bef-0cfa33ff0325 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38410eb49364478e9a4bc83f602c773b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b1b6b8b872408fb984d5b3bd23d58a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-130943857', 'tempest-NotDelegatedRole-2004787893'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:46.252237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12e1be-7d14-44aa-8bef-0cfa33ff0325 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:46.252519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12e1be-7d14-44aa-8bef-0cfa33ff0325 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:46.252819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12e1be-7d14-44aa-8bef-0cfa33ff0325 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] PATH_INFO: `/v3/OS-TRUST/trusts/dbcf5f8c976f4092a75cf55dd2a79545` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:46.259461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12e1be-7d14-44aa-8bef-0cfa33ff0325 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: Authorizing `identity:delete_trust(trust_id=dbcf5f8c976f4092a75cf55dd2a79545)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:46.261474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12e1be-7d14-44aa-8bef-0cfa33ff0325 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:46.409848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4c12e1be-7d14-44aa-8bef-0cfa33ff0325 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'dbcf5f8c976f4092a75cf55dd2a79545', 'request_id': 'req-4c12e1be-7d14-44aa-8bef-0cfa33ff0325'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:46.459371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915c0d0-6512-45e9-b57a-2b769618d6f1 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:46.459371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e915c0d0-6512-45e9-b57a-2b769618d6f1 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:46.480041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4c12e1be-7d14-44aa-8bef-0cfa33ff0325 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'dbcf5f8c976f4092a75cf55dd2a79545', 'request_id': 'req-4c12e1be-7d14-44aa-8bef-0cfa33ff0325'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:46.482172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4c12e1be-7d14-44aa-8bef-0cfa33ff0325 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'dbcf5f8c976f4092a75cf55dd2a79545', 'request_id': 'req-4c12e1be-7d14-44aa-8bef-0cfa33ff0325'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:46.497158 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2744/5488] 10.222.0.16 () {58 vars in 1253 bytes} [Mon May 2 10:38:46 2022] DELETE /identity/v3/OS-TRUST/trusts/dbcf5f8c976f4092a75cf55dd2a79545 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:46.498187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12e1be-7d14-44aa-8bef-0cfa33ff0325 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:46.501142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4c12e1be-7d14-44aa-8bef-0cfa33ff0325 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:46.512890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12e1be-7d14-44aa-8bef-0cfa33ff0325 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:46.517037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289adcf-3a80-4cf7-84e7-2f5b1409d6d4 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38410eb49364478e9a4bc83f602c773b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b1b6b8b872408fb984d5b3bd23d58a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-130943857', 'tempest-NotDelegatedRole-2004787893'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:46.517869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289adcf-3a80-4cf7-84e7-2f5b1409d6d4 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:46.518154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289adcf-3a80-4cf7-84e7-2f5b1409d6d4 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:46.518433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289adcf-3a80-4cf7-84e7-2f5b1409d6d4 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] PATH_INFO: `/v3/OS-TRUST/trusts/dbcf5f8c976f4092a75cf55dd2a79545` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:46.531344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-4289adcf-3a80-4cf7-84e7-2f5b1409d6d4 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Could not find trust: dbcf5f8c976f4092a75cf55dd2a79545.: keystone.exception.TrustNotFound: Could not find trust: dbcf5f8c976f4092a75cf55dd2a79545. May 02 10:38:46.531344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:38:46.531344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:38:46.531344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:38:46.531344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:38:46.531344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:38:46.531344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:38:46.531344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:38:46.531344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:38:46.531344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:38:46.531344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:38:46.531344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:38:46.531344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get May 02 10:38:46.531344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) May 02 10:38:46.531344 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust May 02 10:38:46.541201 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', May 02 10:38:46.541201 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call May 02 10:38:46.541201 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() May 02 10:38:46.541201 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement May 02 10:38:46.541201 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( May 02 10:38:46.541201 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:38:46.541201 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:38:46.541201 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust May 02 10:38:46.541201 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) May 02 10:38:46.541201 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust May 02 10:38:46.541201 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) May 02 10:38:46.541201 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: dbcf5f8c976f4092a75cf55dd2a79545. May 02 10:38:46.541201 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:38:46.541201 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2745/5489] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 2 10:38:46 2022] GET /identity/v3/OS-TRUST/trusts/dbcf5f8c976f4092a75cf55dd2a79545 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:38:46.543297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289adcf-3a80-4cf7-84e7-2f5b1409d6d4 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:46.545385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4289adcf-3a80-4cf7-84e7-2f5b1409d6d4 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:46.559422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915c0d0-6512-45e9-b57a-2b769618d6f1 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:46.564149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245df6a7-e2bb-4f00-bf83-7b4998385539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:46.565233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245df6a7-e2bb-4f00-bf83-7b4998385539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:46.565522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245df6a7-e2bb-4f00-bf83-7b4998385539 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:46.565800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245df6a7-e2bb-4f00-bf83-7b4998385539 admin admin] PATH_INFO: `/v3/projects/b1a10e8dda3c4a9fa1d4bf00147daafe` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:46.567016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245df6a7-e2bb-4f00-bf83-7b4998385539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1a10e8dda3c4a9fa1d4bf00147daafe)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:46.568999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245df6a7-e2bb-4f00-bf83-7b4998385539 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:46.612436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289adcf-3a80-4cf7-84e7-2f5b1409d6d4 tempest-TrustsV3TestJSON-648202713 tempest-user-219063451] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:46.617100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4c17a-0a06-4df1-a26f-4794fc0b281b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:46.617956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4c17a-0a06-4df1-a26f-4794fc0b281b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:46.618243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4c17a-0a06-4df1-a26f-4794fc0b281b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:46.618523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4c17a-0a06-4df1-a26f-4794fc0b281b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles/221412b2547c4e759728561aed04406d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:46.620895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4c17a-0a06-4df1-a26f-4794fc0b281b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_role(role_id=221412b2547c4e759728561aed04406d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:46.622529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4c17a-0a06-4df1-a26f-4794fc0b281b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:46.709314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-245df6a7-e2bb-4f00-bf83-7b4998385539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1a10e8dda3c4a9fa1d4bf00147daafe', 'request_id': 'req-245df6a7-e2bb-4f00-bf83-7b4998385539'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:46.715683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-245df6a7-e2bb-4f00-bf83-7b4998385539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1a10e8dda3c4a9fa1d4bf00147daafe', 'request_id': 'req-245df6a7-e2bb-4f00-bf83-7b4998385539'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:46.775668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-14d4c17a-0a06-4df1-a26f-4794fc0b281b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invalidating the token cache because role 221412b2547c4e759728561aed04406d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:46.776569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-14d4c17a-0a06-4df1-a26f-4794fc0b281b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:46.777279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-14d4c17a-0a06-4df1-a26f-4794fc0b281b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:46.779331 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2746/5490] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:46 2022] DELETE /identity/v3/roles/221412b2547c4e759728561aed04406d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:46.783502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4c17a-0a06-4df1-a26f-4794fc0b281b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:46.784860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-14d4c17a-0a06-4df1-a26f-4794fc0b281b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:46.787798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-245df6a7-e2bb-4f00-bf83-7b4998385539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1a10e8dda3c4a9fa1d4bf00147daafe', 'request_id': 'req-245df6a7-e2bb-4f00-bf83-7b4998385539'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:46.799255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-245df6a7-e2bb-4f00-bf83-7b4998385539 admin admin] The token cache is being invalidate because project b1a10e8dda3c4a9fa1d4bf00147daafe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:46.799542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-245df6a7-e2bb-4f00-bf83-7b4998385539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:46.800175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-245df6a7-e2bb-4f00-bf83-7b4998385539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:46.802034 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2745/5491] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:46 2022] DELETE /identity/v3/projects/b1a10e8dda3c4a9fa1d4bf00147daafe => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:46.808011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30612743-c369-4efb-a92d-85193bfe7c52 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:46.808297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30612743-c369-4efb-a92d-85193bfe7c52 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:46.808567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30612743-c369-4efb-a92d-85193bfe7c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:46.828232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-30612743-c369-4efb-a92d-85193bfe7c52 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:46.829469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-30612743-c369-4efb-a92d-85193bfe7c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:46.848380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4c17a-0a06-4df1-a26f-4794fc0b281b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:46.853099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4bc4b-50d2-46f3-8dca-651b999d42a8 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:46.853958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4bc4b-50d2-46f3-8dca-651b999d42a8 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:46.854760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4bc4b-50d2-46f3-8dca-651b999d42a8 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:46.855041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4bc4b-50d2-46f3-8dca-651b999d42a8 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles/a52285a4823f40ce97e06936822502aa` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:46.856524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4bc4b-50d2-46f3-8dca-651b999d42a8 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a52285a4823f40ce97e06936822502aa)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:46.858137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4bc4b-50d2-46f3-8dca-651b999d42a8 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:46.889196 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2746/5492] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:46.897983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787ae78-f98c-4d9d-8534-926e70e40044 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:46.898284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787ae78-f98c-4d9d-8534-926e70e40044 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:46.898570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787ae78-f98c-4d9d-8534-926e70e40044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:46.917852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2787ae78-f98c-4d9d-8534-926e70e40044 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:46.919034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2787ae78-f98c-4d9d-8534-926e70e40044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:46.927225 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2747/5493] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:38:46.931375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787ae78-f98c-4d9d-8534-926e70e40044 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:46.940976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787ae78-f98c-4d9d-8534-926e70e40044 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:46.945670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aeff81-1897-4edb-887e-100b8a7ef79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:46.949941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aeff81-1897-4edb-887e-100b8a7ef79f admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:46.949941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aeff81-1897-4edb-887e-100b8a7ef79f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:46.949941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aeff81-1897-4edb-887e-100b8a7ef79f admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:46.949941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aeff81-1897-4edb-887e-100b8a7ef79f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:38:46.949941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aeff81-1897-4edb-887e-100b8a7ef79f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:46.949941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aeff81-1897-4edb-887e-100b8a7ef79f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:46.965272 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2748/5494] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:38:46.966116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aeff81-1897-4edb-887e-100b8a7ef79f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:46.975865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aeff81-1897-4edb-887e-100b8a7ef79f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:46.981097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee631b4-898f-40a2-998c-9aab0c22e114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:46.981710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee631b4-898f-40a2-998c-9aab0c22e114 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:46.981994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee631b4-898f-40a2-998c-9aab0c22e114 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:46.982267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee631b4-898f-40a2-998c-9aab0c22e114 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:46.982931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee631b4-898f-40a2-998c-9aab0c22e114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:46.984904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee631b4-898f-40a2-998c-9aab0c22e114 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:47.050109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2dc4bc4b-50d2-46f3-8dca-651b999d42a8 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invalidating the token cache because role a52285a4823f40ce97e06936822502aa has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:47.050687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2dc4bc4b-50d2-46f3-8dca-651b999d42a8 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:47.051084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2dc4bc4b-50d2-46f3-8dca-651b999d42a8 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:47.053071 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2747/5495] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:46 2022] DELETE /identity/v3/roles/a52285a4823f40ce97e06936822502aa => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:47.057553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4bc4b-50d2-46f3-8dca-651b999d42a8 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:47.059033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2dc4bc4b-50d2-46f3-8dca-651b999d42a8 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:47.074462 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2749/5496] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:38:46 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:38:47.078763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee631b4-898f-40a2-998c-9aab0c22e114 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:47.080371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-dee631b4-898f-40a2-998c-9aab0c22e114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:47.129814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4bc4b-50d2-46f3-8dca-651b999d42a8 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:47.147405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee631b4-898f-40a2-998c-9aab0c22e114 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:47.153011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e02f3-6f94-4c54-96ac-8122891237fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:47.153684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e02f3-6f94-4c54-96ac-8122891237fd admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:47.153973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e02f3-6f94-4c54-96ac-8122891237fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:47.154255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e02f3-6f94-4c54-96ac-8122891237fd admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:47.155013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e02f3-6f94-4c54-96ac-8122891237fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:47.157616 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e02f3-6f94-4c54-96ac-8122891237fd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:47.189363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e9473-48c2-4af0-8cc9-29c73a5b6583 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:47.190251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e9473-48c2-4af0-8cc9-29c73a5b6583 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:47.190533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e9473-48c2-4af0-8cc9-29c73a5b6583 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:47.190837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e9473-48c2-4af0-8cc9-29c73a5b6583 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/users/38410eb49364478e9a4bc83f602c773b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:47.192369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e9473-48c2-4af0-8cc9-29c73a5b6583 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_user(user_id=38410eb49364478e9a4bc83f602c773b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:47.194369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e9473-48c2-4af0-8cc9-29c73a5b6583 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:47.239851 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2750/5497] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:38:47 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:38:47.243776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e02f3-6f94-4c54-96ac-8122891237fd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:47.254610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e02f3-6f94-4c54-96ac-8122891237fd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:47.259423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed480246-0513-407c-90d4-257a790781ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:47.260110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480246-0513-407c-90d4-257a790781ec admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:47.260676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480246-0513-407c-90d4-257a790781ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:47.260958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480246-0513-407c-90d4-257a790781ec admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:47.261690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed480246-0513-407c-90d4-257a790781ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:47.263311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed480246-0513-407c-90d4-257a790781ec admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:47.273625 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2751/5498] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:38:47.282151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed480246-0513-407c-90d4-257a790781ec admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:47.293573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed480246-0513-407c-90d4-257a790781ec admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:47.298144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208ed91-1603-4aae-8b43-4c2d9f684b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:47.298852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208ed91-1603-4aae-8b43-4c2d9f684b51 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:47.299138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208ed91-1603-4aae-8b43-4c2d9f684b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:47.299415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208ed91-1603-4aae-8b43-4c2d9f684b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:47.300126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208ed91-1603-4aae-8b43-4c2d9f684b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:47.301759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208ed91-1603-4aae-8b43-4c2d9f684b51 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:47.311884 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2752/5499] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:38:47.317847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208ed91-1603-4aae-8b43-4c2d9f684b51 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:47.325724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208ed91-1603-4aae-8b43-4c2d9f684b51 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:47.329690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e33e9473-48c2-4af0-8cc9-29c73a5b6583 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38410eb49364478e9a4bc83f602c773b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:47.330872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5abcb-72f9-458c-a00f-cd645eb50f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:47.331770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5abcb-72f9-458c-a00f-cd645eb50f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:47.332055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5abcb-72f9-458c-a00f-cd645eb50f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:47.332333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5abcb-72f9-458c-a00f-cd645eb50f9a admin admin] PATH_INFO: `/v3/projects/405646baefae43fab3233af84576b641/users/ffadf605d2f547b889c566880fe43766/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:47.341763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e33e9473-48c2-4af0-8cc9-29c73a5b6583 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38410eb49364478e9a4bc83f602c773b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:47.342487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e33e9473-48c2-4af0-8cc9-29c73a5b6583 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38410eb49364478e9a4bc83f602c773b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:47.347547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5abcb-72f9-458c-a00f-cd645eb50f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=405646baefae43fab3233af84576b641, user_id=ffadf605d2f547b889c566880fe43766, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:47.349358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e33e9473-48c2-4af0-8cc9-29c73a5b6583 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38410eb49364478e9a4bc83f602c773b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:47.350264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5abcb-72f9-458c-a00f-cd645eb50f9a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:47.417207 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2753/5500] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:47 2022] PUT /identity/v3/projects/405646baefae43fab3233af84576b641/users/ffadf605d2f547b889c566880fe43766/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:47.427798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee329646-4a26-4a11-92b3-effbc26270b7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:47.428090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee329646-4a26-4a11-92b3-effbc26270b7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:47.428379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee329646-4a26-4a11-92b3-effbc26270b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:47.443311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e33e9473-48c2-4af0-8cc9-29c73a5b6583 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38410eb49364478e9a4bc83f602c773b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:47.450789 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2748/5501] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:47 2022] DELETE /identity/v3/users/38410eb49364478e9a4bc83f602c773b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:47.454672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e9473-48c2-4af0-8cc9-29c73a5b6583 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:47.456029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e33e9473-48c2-4af0-8cc9-29c73a5b6583 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:47.458000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ee329646-4a26-4a11-92b3-effbc26270b7 None None] MFA Rules not processed for user `ffadf605d2f547b889c566880fe43766`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:47.459267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ee329646-4a26-4a11-92b3-effbc26270b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:47.531777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e9473-48c2-4af0-8cc9-29c73a5b6583 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:47.544438 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2754/5502] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:38:47.545412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a62dc-d7fa-4425-a8a5-d76808f306d1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:47.546311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a62dc-d7fa-4425-a8a5-d76808f306d1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:47.546818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a62dc-d7fa-4425-a8a5-d76808f306d1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:47.546962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a62dc-d7fa-4425-a8a5-d76808f306d1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects/41b1b6b8b872408fb984d5b3bd23d58a` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:47.548554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a62dc-d7fa-4425-a8a5-d76808f306d1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_project(project_id=41b1b6b8b872408fb984d5b3bd23d58a)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:47.550995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a62dc-d7fa-4425-a8a5-d76808f306d1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:47.572786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee329646-4a26-4a11-92b3-effbc26270b7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:47.574358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ee329646-4a26-4a11-92b3-effbc26270b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:47.661589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee329646-4a26-4a11-92b3-effbc26270b7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:47.665616 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26618865-8111-4749-979c-4716f070ebc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:47.666350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26618865-8111-4749-979c-4716f070ebc7 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:47.667465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26618865-8111-4749-979c-4716f070ebc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:47.667750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26618865-8111-4749-979c-4716f070ebc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:47.676569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26618865-8111-4749-979c-4716f070ebc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:47.678128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26618865-8111-4749-979c-4716f070ebc7 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:47.687969 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2755/5503] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:38:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:38:47.702733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26618865-8111-4749-979c-4716f070ebc7 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:47.704330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-26618865-8111-4749-979c-4716f070ebc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:47.773395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26618865-8111-4749-979c-4716f070ebc7 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:47.815883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6e4a62dc-d7fa-4425-a8a5-d76808f306d1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41b1b6b8b872408fb984d5b3bd23d58a', 'request_id': 'req-6e4a62dc-d7fa-4425-a8a5-d76808f306d1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:47.840363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf5ea9-1e01-458d-a448-3f770794c8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:47.841392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf5ea9-1e01-458d-a448-3f770794c8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:47.841717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf5ea9-1e01-458d-a448-3f770794c8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:47.842040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf5ea9-1e01-458d-a448-3f770794c8e5 admin admin] PATH_INFO: `/v3/users/ffadf605d2f547b889c566880fe43766` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:47.843407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf5ea9-1e01-458d-a448-3f770794c8e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffadf605d2f547b889c566880fe43766)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:47.845733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf5ea9-1e01-458d-a448-3f770794c8e5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:47.903551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6e4a62dc-d7fa-4425-a8a5-d76808f306d1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41b1b6b8b872408fb984d5b3bd23d58a', 'request_id': 'req-6e4a62dc-d7fa-4425-a8a5-d76808f306d1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:47.917610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6e4a62dc-d7fa-4425-a8a5-d76808f306d1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41b1b6b8b872408fb984d5b3bd23d58a', 'request_id': 'req-6e4a62dc-d7fa-4425-a8a5-d76808f306d1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:47.930556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6e4a62dc-d7fa-4425-a8a5-d76808f306d1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] The token cache is being invalidate because project 41b1b6b8b872408fb984d5b3bd23d58a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:47.931019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6e4a62dc-d7fa-4425-a8a5-d76808f306d1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:47.931932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6e4a62dc-d7fa-4425-a8a5-d76808f306d1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:47.935065 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2749/5504] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:47 2022] DELETE /identity/v3/projects/41b1b6b8b872408fb984d5b3bd23d58a => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:47.941636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a62dc-d7fa-4425-a8a5-d76808f306d1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:47.941636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6e4a62dc-d7fa-4425-a8a5-d76808f306d1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:48.025528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a62dc-d7fa-4425-a8a5-d76808f306d1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:48.031728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa175762-21da-4ce8-8d3c-0242eebb4b7e tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:48.032868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa175762-21da-4ce8-8d3c-0242eebb4b7e tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:48.038132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa175762-21da-4ce8-8d3c-0242eebb4b7e tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:48.038132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa175762-21da-4ce8-8d3c-0242eebb4b7e tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:48.038132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa175762-21da-4ce8-8d3c-0242eebb4b7e tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:48.038132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa175762-21da-4ce8-8d3c-0242eebb4b7e tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:48.048559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6faf5ea9-1e01-458d-a448-3f770794c8e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffadf605d2f547b889c566880fe43766'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:48.064005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6faf5ea9-1e01-458d-a448-3f770794c8e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffadf605d2f547b889c566880fe43766'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:48.064899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6faf5ea9-1e01-458d-a448-3f770794c8e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffadf605d2f547b889c566880fe43766'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:48.075082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6faf5ea9-1e01-458d-a448-3f770794c8e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffadf605d2f547b889c566880fe43766'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:48.178077 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2750/5505] 10.222.0.16 () {60 vars in 1151 bytes} [Mon May 2 10:38:47 2022] POST /identity/v3/projects => generated 329 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:38:48.183560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa175762-21da-4ce8-8d3c-0242eebb4b7e tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:48.230514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6faf5ea9-1e01-458d-a448-3f770794c8e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffadf605d2f547b889c566880fe43766'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:48.241629 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2756/5506] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:47 2022] DELETE /identity/v3/users/ffadf605d2f547b889c566880fe43766 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:48.247943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e0c58-261c-4fa9-b40b-c1509e3d7508 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:48.248282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e0c58-261c-4fa9-b40b-c1509e3d7508 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:48.249023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e0c58-261c-4fa9-b40b-c1509e3d7508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:48.263405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa175762-21da-4ce8-8d3c-0242eebb4b7e tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:48.273260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4c9e0c58-261c-4fa9-b40b-c1509e3d7508 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:48.275256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4c9e0c58-261c-4fa9-b40b-c1509e3d7508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:48.377062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b8e0b-ac37-4f46-aa65-7d17d246fe8d tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:48.378174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b8e0b-ac37-4f46-aa65-7d17d246fe8d tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:48.379066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b8e0b-ac37-4f46-aa65-7d17d246fe8d tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:48.379715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b8e0b-ac37-4f46-aa65-7d17d246fe8d tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:48.381737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b8e0b-ac37-4f46-aa65-7d17d246fe8d tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:48.384562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b8e0b-ac37-4f46-aa65-7d17d246fe8d tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:48.389644 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2757/5507] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:38:48.402386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e0c58-261c-4fa9-b40b-c1509e3d7508 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:48.404277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4c9e0c58-261c-4fa9-b40b-c1509e3d7508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:48.479941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e0c58-261c-4fa9-b40b-c1509e3d7508 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:48.484560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a051fdb-372e-4969-bad9-dfec2576ac0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:48.485335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a051fdb-372e-4969-bad9-dfec2576ac0a service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:48.485632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a051fdb-372e-4969-bad9-dfec2576ac0a service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:48.485915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a051fdb-372e-4969-bad9-dfec2576ac0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:48.497266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a051fdb-372e-4969-bad9-dfec2576ac0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:48.498941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a051fdb-372e-4969-bad9-dfec2576ac0a service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:48.506093 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2751/5508] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:38:48 2022] POST /identity/v3/users => generated 413 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:48.506981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b8e0b-ac37-4f46-aa65-7d17d246fe8d tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:48.508821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7e2b8e0b-ac37-4f46-aa65-7d17d246fe8d tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:48.511062 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2758/5509] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:38:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:38:48.525629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b8e0b-ac37-4f46-aa65-7d17d246fe8d tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:48.533104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f65edb-65dd-45ef-9a73-8a5ce16a5716 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:48.533848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f65edb-65dd-45ef-9a73-8a5ce16a5716 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:48.534145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f65edb-65dd-45ef-9a73-8a5ce16a5716 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:48.534455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f65edb-65dd-45ef-9a73-8a5ce16a5716 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:48.535272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f65edb-65dd-45ef-9a73-8a5ce16a5716 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:48.537149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f65edb-65dd-45ef-9a73-8a5ce16a5716 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:48.609353 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2752/5510] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:38:48 2022] POST /identity/v3/roles => generated 243 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:48.613383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a051fdb-372e-4969-bad9-dfec2576ac0a service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:48.636364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a051fdb-372e-4969-bad9-dfec2576ac0a service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:48.665616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f65edb-65dd-45ef-9a73-8a5ce16a5716 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:48.668075 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a5f65edb-65dd-45ef-9a73-8a5ce16a5716 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:48.691563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc58180-04f8-437a-953a-6b430e60a264 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:48.695472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc58180-04f8-437a-953a-6b430e60a264 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:48.699070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc58180-04f8-437a-953a-6b430e60a264 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:48.700648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc58180-04f8-437a-953a-6b430e60a264 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:48.701324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f65edb-65dd-45ef-9a73-8a5ce16a5716 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:48.703229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc58180-04f8-437a-953a-6b430e60a264 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:48.708208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9901c4-e44d-47ac-9716-a78251b898e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:48.709223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9901c4-e44d-47ac-9716-a78251b898e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:48.709516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9901c4-e44d-47ac-9716-a78251b898e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:48.709658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc58180-04f8-437a-953a-6b430e60a264 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:48.709854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9901c4-e44d-47ac-9716-a78251b898e9 admin admin] PATH_INFO: `/v3/users/4d8ba23c64c2410da6059165b4f20bfa` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:48.712695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9901c4-e44d-47ac-9716-a78251b898e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d8ba23c64c2410da6059165b4f20bfa)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:48.715286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9901c4-e44d-47ac-9716-a78251b898e9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:48.791189 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2759/5511] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:38:48 2022] POST /identity/v3/roles => generated 247 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:48.795139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc58180-04f8-437a-953a-6b430e60a264 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:48.806493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc58180-04f8-437a-953a-6b430e60a264 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:48.813243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bef6b-a434-4ae3-aa4e-233c99f8cf01 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:48.814539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bef6b-a434-4ae3-aa4e-233c99f8cf01 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:48.814840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bef6b-a434-4ae3-aa4e-233c99f8cf01 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:48.815103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bef6b-a434-4ae3-aa4e-233c99f8cf01 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects/04298af0487f480ea82aeb60c77c254b/users/5b1d6095fed348a6a0288bc21323a2e0/roles/fa36e6896d7146799e38d207f89b5e83` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:48.849050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bef6b-a434-4ae3-aa4e-233c99f8cf01 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_grant(project_id=04298af0487f480ea82aeb60c77c254b, user_id=5b1d6095fed348a6a0288bc21323a2e0, role_id=fa36e6896d7146799e38d207f89b5e83)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:48.853709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bef6b-a434-4ae3-aa4e-233c99f8cf01 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:48.934793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6f9901c4-e44d-47ac-9716-a78251b898e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d8ba23c64c2410da6059165b4f20bfa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:48.946663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6f9901c4-e44d-47ac-9716-a78251b898e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d8ba23c64c2410da6059165b4f20bfa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:48.952263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6f9901c4-e44d-47ac-9716-a78251b898e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d8ba23c64c2410da6059165b4f20bfa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:48.959925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6f9901c4-e44d-47ac-9716-a78251b898e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d8ba23c64c2410da6059165b4f20bfa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:49.068093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6f9901c4-e44d-47ac-9716-a78251b898e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d8ba23c64c2410da6059165b4f20bfa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:49.078339 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2760/5512] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:48 2022] PUT /identity/v3/projects/04298af0487f480ea82aeb60c77c254b/users/5b1d6095fed348a6a0288bc21323a2e0/roles/fa36e6896d7146799e38d207f89b5e83 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:49.084955 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2753/5513] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:48 2022] DELETE /identity/v3/users/4d8ba23c64c2410da6059165b4f20bfa => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:49.088327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dd5c0-497a-42c2-af93-e6e78de432f1 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:49.088666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dd5c0-497a-42c2-af93-e6e78de432f1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:49.088934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dd5c0-497a-42c2-af93-e6e78de432f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:49.120957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bef6b-a434-4ae3-aa4e-233c99f8cf01 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:49.127084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9c9bef6b-a434-4ae3-aa4e-233c99f8cf01 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:49.132860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ba3dd5c0-497a-42c2-af93-e6e78de432f1 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:49.132860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ba3dd5c0-497a-42c2-af93-e6e78de432f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:49.259099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bef6b-a434-4ae3-aa4e-233c99f8cf01 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:49.277238 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2754/5514] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:49.277238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dd5c0-497a-42c2-af93-e6e78de432f1 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:49.285838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ba3dd5c0-497a-42c2-af93-e6e78de432f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:49.300908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dd5c0-497a-42c2-af93-e6e78de432f1 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:49.305846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef932da6-446b-40d2-a6cb-010f4dcb8164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:49.307164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef932da6-446b-40d2-a6cb-010f4dcb8164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:49.307559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef932da6-446b-40d2-a6cb-010f4dcb8164 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:49.307833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef932da6-446b-40d2-a6cb-010f4dcb8164 admin admin] PATH_INFO: `/v3/projects/405646baefae43fab3233af84576b641` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:49.309666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef932da6-446b-40d2-a6cb-010f4dcb8164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=405646baefae43fab3233af84576b641)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:49.311597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef932da6-446b-40d2-a6cb-010f4dcb8164 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:49.324498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf046af-92b3-4424-8caa-023d4cc6a1f2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:49.325512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf046af-92b3-4424-8caa-023d4cc6a1f2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:49.327254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf046af-92b3-4424-8caa-023d4cc6a1f2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:49.327254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf046af-92b3-4424-8caa-023d4cc6a1f2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects/04298af0487f480ea82aeb60c77c254b/users/5b1d6095fed348a6a0288bc21323a2e0/roles/a0e4e7f5cece46ef8b355026406e7c5e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:49.328490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf046af-92b3-4424-8caa-023d4cc6a1f2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_grant(project_id=04298af0487f480ea82aeb60c77c254b, user_id=5b1d6095fed348a6a0288bc21323a2e0, role_id=a0e4e7f5cece46ef8b355026406e7c5e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:49.331311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf046af-92b3-4424-8caa-023d4cc6a1f2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:49.450970 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2761/5515] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:49 2022] PUT /identity/v3/projects/04298af0487f480ea82aeb60c77c254b/users/5b1d6095fed348a6a0288bc21323a2e0/roles/a0e4e7f5cece46ef8b355026406e7c5e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:49.451889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf046af-92b3-4424-8caa-023d4cc6a1f2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:49.453524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1bf046af-92b3-4424-8caa-023d4cc6a1f2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:49.484672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ef932da6-446b-40d2-a6cb-010f4dcb8164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '405646baefae43fab3233af84576b641', 'request_id': 'req-ef932da6-446b-40d2-a6cb-010f4dcb8164'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:49.514279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf046af-92b3-4424-8caa-023d4cc6a1f2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:49.561895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f8b1e-0bb8-4d37-9291-8db8f7178fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:49.562455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f8b1e-0bb8-4d37-9291-8db8f7178fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:49.562744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f8b1e-0bb8-4d37-9291-8db8f7178fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:49.563024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f8b1e-0bb8-4d37-9291-8db8f7178fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:49.622469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f8b1e-0bb8-4d37-9291-8db8f7178fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:49.623913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f8b1e-0bb8-4d37-9291-8db8f7178fa7 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:49.636489 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2762/5516] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:38:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:38:49.638159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ef932da6-446b-40d2-a6cb-010f4dcb8164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '405646baefae43fab3233af84576b641', 'request_id': 'req-ef932da6-446b-40d2-a6cb-010f4dcb8164'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:49.645931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ef932da6-446b-40d2-a6cb-010f4dcb8164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '405646baefae43fab3233af84576b641', 'request_id': 'req-ef932da6-446b-40d2-a6cb-010f4dcb8164'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:49.646144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f8b1e-0bb8-4d37-9291-8db8f7178fa7 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:49.660730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ef932da6-446b-40d2-a6cb-010f4dcb8164 admin admin] The token cache is being invalidate because project 405646baefae43fab3233af84576b641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:49.661080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ef932da6-446b-40d2-a6cb-010f4dcb8164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:49.670471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ef932da6-446b-40d2-a6cb-010f4dcb8164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:49.670471 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2755/5517] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:49 2022] DELETE /identity/v3/projects/405646baefae43fab3233af84576b641 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:49.670471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05534c4b-c879-4c26-9f5e-f43c7b557231 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:49.670471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05534c4b-c879-4c26-9f5e-f43c7b557231 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:49.670930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05534c4b-c879-4c26-9f5e-f43c7b557231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:49.695596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-05534c4b-c879-4c26-9f5e-f43c7b557231 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:49.697417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-05534c4b-c879-4c26-9f5e-f43c7b557231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:49.718754 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2756/5518] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:38:49.729928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743e59c-d06f-4b1d-8645-c08ebc0b443c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:49.730222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743e59c-d06f-4b1d-8645-c08ebc0b443c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:49.738388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743e59c-d06f-4b1d-8645-c08ebc0b443c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:49.756624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f8b1e-0bb8-4d37-9291-8db8f7178fa7 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:49.766221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0c715-4f21-4c47-b618-6c5e03ea33dd tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:49.767243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0c715-4f21-4c47-b618-6c5e03ea33dd tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:49.767735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0c715-4f21-4c47-b618-6c5e03ea33dd tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:49.768253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0c715-4f21-4c47-b618-6c5e03ea33dd tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:49.769502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0c715-4f21-4c47-b618-6c5e03ea33dd tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:49.771663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0c715-4f21-4c47-b618-6c5e03ea33dd tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:49.774545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8743e59c-d06f-4b1d-8645-c08ebc0b443c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:49.777399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8743e59c-d06f-4b1d-8645-c08ebc0b443c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:49.800386 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2757/5519] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:49.805023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743e59c-d06f-4b1d-8645-c08ebc0b443c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:49.808902 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2763/5520] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:49 2022] GET /identity/v3/users => generated 8068 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:38:49.818192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028cf62-600c-4142-87ab-6c579a4daa75 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:49.818192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028cf62-600c-4142-87ab-6c579a4daa75 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:49.818192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028cf62-600c-4142-87ab-6c579a4daa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:49.818460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743e59c-d06f-4b1d-8645-c08ebc0b443c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:49.829825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897612c6-e084-4955-bbfa-b9fc8bd2d136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:49.830542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897612c6-e084-4955-bbfa-b9fc8bd2d136 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:49.830817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897612c6-e084-4955-bbfa-b9fc8bd2d136 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:49.831214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897612c6-e084-4955-bbfa-b9fc8bd2d136 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:49.831997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897612c6-e084-4955-bbfa-b9fc8bd2d136 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:38:49.832312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897612c6-e084-4955-bbfa-b9fc8bd2d136 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:49.834026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897612c6-e084-4955-bbfa-b9fc8bd2d136 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:49.847064 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2758/5521] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:38:49.852432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897612c6-e084-4955-bbfa-b9fc8bd2d136 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:49.863173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2028cf62-600c-4142-87ab-6c579a4daa75 None None] MFA Rules not processed for user `5b1d6095fed348a6a0288bc21323a2e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:49.864042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897612c6-e084-4955-bbfa-b9fc8bd2d136 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:49.864427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2028cf62-600c-4142-87ab-6c579a4daa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:49.869072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08a497-0093-451c-b5b5-7aa102754c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:49.870803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08a497-0093-451c-b5b5-7aa102754c4b admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:49.871198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08a497-0093-451c-b5b5-7aa102754c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:49.871517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08a497-0093-451c-b5b5-7aa102754c4b admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:49.872413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08a497-0093-451c-b5b5-7aa102754c4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:49.874398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08a497-0093-451c-b5b5-7aa102754c4b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:49.937006 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2764/5522] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:49 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:49.947998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b046ea-7d54-468a-9245-58a10c70c233 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:49.948642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b046ea-7d54-468a-9245-58a10c70c233 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:49.950129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b046ea-7d54-468a-9245-58a10c70c233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:49.980183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-51b046ea-7d54-468a-9245-58a10c70c233 None None] MFA Rules not processed for user `5b1d6095fed348a6a0288bc21323a2e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:49.981966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-51b046ea-7d54-468a-9245-58a10c70c233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:49.990884 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2765/5523] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:49 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:49.994174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b046ea-7d54-468a-9245-58a10c70c233 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:50.003762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b046ea-7d54-468a-9245-58a10c70c233 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:50.010371 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2759/5524] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:38:49 2022] POST /identity/v3/projects => generated 353 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:50.011675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08a497-0093-451c-b5b5-7aa102754c4b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:50.112134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2f8b9-3489-4329-b015-e43ebae3807d tempest-TrustsV3TestJSON-1945307387 tempest-user-264679918] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1d6095fed348a6a0288bc21323a2e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04298af0487f480ea82aeb60c77c254b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-526478892', 'tempest-NotDelegatedRole-1123559409'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:50.113266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2f8b9-3489-4329-b015-e43ebae3807d tempest-TrustsV3TestJSON-1945307387 tempest-user-264679918] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:50.113389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2f8b9-3489-4329-b015-e43ebae3807d tempest-TrustsV3TestJSON-1945307387 tempest-user-264679918] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:50.113573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2f8b9-3489-4329-b015-e43ebae3807d tempest-TrustsV3TestJSON-1945307387 tempest-user-264679918] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:50.114353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2f8b9-3489-4329-b015-e43ebae3807d tempest-TrustsV3TestJSON-1945307387 tempest-user-264679918] RBAC: Authorizing `identity:create_trust()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:50.115528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2f8b9-3489-4329-b015-e43ebae3807d tempest-TrustsV3TestJSON-1945307387 tempest-user-264679918] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:50.159595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08a497-0093-451c-b5b5-7aa102754c4b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:50.165949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84aa5b-3b8a-46ea-9ad1-971430befe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:50.167933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84aa5b-3b8a-46ea-9ad1-971430befe4c admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:50.168227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84aa5b-3b8a-46ea-9ad1-971430befe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:50.168515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84aa5b-3b8a-46ea-9ad1-971430befe4c admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:50.169337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84aa5b-3b8a-46ea-9ad1-971430befe4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:50.171413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84aa5b-3b8a-46ea-9ad1-971430befe4c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:50.221904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-15f2f8b9-3489-4329-b015-e43ebae3807d tempest-TrustsV3TestJSON-1945307387 tempest-user-264679918] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. May 02 10:38:50.221904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:38:50.221904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 67, in parse_isotime May 02 10:38:50.221904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) May 02 10:38:50.221904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date May 02 10:38:50.221904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") May 02 10:38:50.221904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' May 02 10:38:50.221904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:38:50.221904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:38:50.221904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:38:50.221904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:38:50.221904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date May 02 10:38:50.221904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) May 02 10:38:50.221904 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 69, in parse_isotime May 02 10:38:50.223331 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise ValueError(str(e)) May 02 10:38:50.223331 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' May 02 10:38:50.223331 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:38:50.223331 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:38:50.223331 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:38:50.223331 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:38:50.223331 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:38:50.223331 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:38:50.223331 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:38:50.223331 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:38:50.223331 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:38:50.223331 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:38:50.223331 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:38:50.223331 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:38:50.223331 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:38:50.223331 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:38:50.223331 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post May 02 10:38:50.223331 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( May 02 10:38:50.224890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date May 02 10:38:50.224890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) May 02 10:38:50.224890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date May 02 10:38:50.224890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() May 02 10:38:50.224890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. May 02 10:38:50.224890 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:38:50.225552 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2766/5525] 10.222.0.16 () {60 vars in 1173 bytes} [Mon May 2 10:38:49 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 231 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) May 02 10:38:50.229602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2f8b9-3489-4329-b015-e43ebae3807d tempest-TrustsV3TestJSON-1945307387 tempest-user-264679918] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:50.233103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-15f2f8b9-3489-4329-b015-e43ebae3807d tempest-TrustsV3TestJSON-1945307387 tempest-user-264679918] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:50.278849 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2760/5526] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:38:50 2022] POST /identity/v3/users => generated 277 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:50.282943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84aa5b-3b8a-46ea-9ad1-971430befe4c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:50.294005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84aa5b-3b8a-46ea-9ad1-971430befe4c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:50.298828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24252c-8d4e-40ee-a66f-c9a175d9456e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:50.299501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24252c-8d4e-40ee-a66f-c9a175d9456e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:50.299792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24252c-8d4e-40ee-a66f-c9a175d9456e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:50.309709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24252c-8d4e-40ee-a66f-c9a175d9456e admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:50.311292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24252c-8d4e-40ee-a66f-c9a175d9456e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:50.317241 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24252c-8d4e-40ee-a66f-c9a175d9456e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:50.320766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2f8b9-3489-4329-b015-e43ebae3807d tempest-TrustsV3TestJSON-1945307387 tempest-user-264679918] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:50.335758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d53fa-f3c4-4dc2-abed-9f000c7c8bbf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:50.336418 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2761/5527] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:50 2022] GET /identity/v3/roles => generated 1892 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:38:50.336845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d53fa-f3c4-4dc2-abed-9f000c7c8bbf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:50.337234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d53fa-f3c4-4dc2-abed-9f000c7c8bbf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:50.338624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d53fa-f3c4-4dc2-abed-9f000c7c8bbf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles/a0e4e7f5cece46ef8b355026406e7c5e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:50.340472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24252c-8d4e-40ee-a66f-c9a175d9456e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:50.342402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5e24252c-8d4e-40ee-a66f-c9a175d9456e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:50.358409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d53fa-f3c4-4dc2-abed-9f000c7c8bbf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a0e4e7f5cece46ef8b355026406e7c5e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:50.360399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24252c-8d4e-40ee-a66f-c9a175d9456e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:50.360717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d53fa-f3c4-4dc2-abed-9f000c7c8bbf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:50.365909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944afe1d-8a17-4ffa-915e-0de4aca4444b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:50.367326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944afe1d-8a17-4ffa-915e-0de4aca4444b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:50.367716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944afe1d-8a17-4ffa-915e-0de4aca4444b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:50.368105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944afe1d-8a17-4ffa-915e-0de4aca4444b admin admin] PATH_INFO: `/v3/projects/29e616a0c8df45e6987aced1da716382` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:50.371296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944afe1d-8a17-4ffa-915e-0de4aca4444b admin admin] RBAC: Authorizing `identity:delete_project(project_id=29e616a0c8df45e6987aced1da716382)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:50.373350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944afe1d-8a17-4ffa-915e-0de4aca4444b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:50.502505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-944afe1d-8a17-4ffa-915e-0de4aca4444b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29e616a0c8df45e6987aced1da716382', 'request_id': 'req-944afe1d-8a17-4ffa-915e-0de4aca4444b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:50.549295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-883d53fa-f3c4-4dc2-abed-9f000c7c8bbf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invalidating the token cache because role a0e4e7f5cece46ef8b355026406e7c5e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:50.549590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-883d53fa-f3c4-4dc2-abed-9f000c7c8bbf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:50.550244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-883d53fa-f3c4-4dc2-abed-9f000c7c8bbf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:50.552429 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2767/5528] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:50 2022] DELETE /identity/v3/roles/a0e4e7f5cece46ef8b355026406e7c5e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:50.553474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d53fa-f3c4-4dc2-abed-9f000c7c8bbf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:50.554801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-883d53fa-f3c4-4dc2-abed-9f000c7c8bbf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:50.576346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-944afe1d-8a17-4ffa-915e-0de4aca4444b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29e616a0c8df45e6987aced1da716382', 'request_id': 'req-944afe1d-8a17-4ffa-915e-0de4aca4444b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:50.585202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-944afe1d-8a17-4ffa-915e-0de4aca4444b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29e616a0c8df45e6987aced1da716382', 'request_id': 'req-944afe1d-8a17-4ffa-915e-0de4aca4444b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:50.594424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-944afe1d-8a17-4ffa-915e-0de4aca4444b admin admin] The token cache is being invalidate because project 29e616a0c8df45e6987aced1da716382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:50.594727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-944afe1d-8a17-4ffa-915e-0de4aca4444b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:50.595505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-944afe1d-8a17-4ffa-915e-0de4aca4444b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:50.597298 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2762/5529] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:50 2022] DELETE /identity/v3/projects/29e616a0c8df45e6987aced1da716382 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:50.600921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944afe1d-8a17-4ffa-915e-0de4aca4444b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:50.600921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-944afe1d-8a17-4ffa-915e-0de4aca4444b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:50.636331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d53fa-f3c4-4dc2-abed-9f000c7c8bbf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:50.643220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a97d46-db62-4b11-8330-b6ac9a04e40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:50.643220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a97d46-db62-4b11-8330-b6ac9a04e40a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:50.643864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a97d46-db62-4b11-8330-b6ac9a04e40a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:50.644311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a97d46-db62-4b11-8330-b6ac9a04e40a admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:50.645555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a97d46-db62-4b11-8330-b6ac9a04e40a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:50.649194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a97d46-db62-4b11-8330-b6ac9a04e40a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:50.664111 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2768/5530] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:50 2022] GET /identity/v3/roles => generated 1654 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:38:50.665645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553e06c-aad0-4719-ad8e-8e3257d811f9 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:50.665940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553e06c-aad0-4719-ad8e-8e3257d811f9 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:50.666434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553e06c-aad0-4719-ad8e-8e3257d811f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:50.674843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944afe1d-8a17-4ffa-915e-0de4aca4444b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:50.688088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6553e06c-aad0-4719-ad8e-8e3257d811f9 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:50.689519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6553e06c-aad0-4719-ad8e-8e3257d811f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:50.698852 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2769/5531] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:50.699640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553e06c-aad0-4719-ad8e-8e3257d811f9 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:50.701026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6553e06c-aad0-4719-ad8e-8e3257d811f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:50.712714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553e06c-aad0-4719-ad8e-8e3257d811f9 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:50.718058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75a128-d18e-42e7-bcb2-aeb3a6341321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:50.718969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75a128-d18e-42e7-bcb2-aeb3a6341321 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:50.719228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75a128-d18e-42e7-bcb2-aeb3a6341321 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:50.719509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75a128-d18e-42e7-bcb2-aeb3a6341321 admin admin] PATH_INFO: `/v3/projects/06845f075da64a279398db4731cbb640/users/17b75cb0349b4af5b82ad8a352da284f/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:50.734641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75a128-d18e-42e7-bcb2-aeb3a6341321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06845f075da64a279398db4731cbb640, user_id=17b75cb0349b4af5b82ad8a352da284f, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:50.735272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db1895-b827-41e4-afc0-702c980d6222 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:50.736144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db1895-b827-41e4-afc0-702c980d6222 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:50.736458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db1895-b827-41e4-afc0-702c980d6222 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:50.736776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db1895-b827-41e4-afc0-702c980d6222 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles/fa36e6896d7146799e38d207f89b5e83` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:50.737799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75a128-d18e-42e7-bcb2-aeb3a6341321 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:50.738284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db1895-b827-41e4-afc0-702c980d6222 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fa36e6896d7146799e38d207f89b5e83)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:50.739887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db1895-b827-41e4-afc0-702c980d6222 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:50.867926 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2770/5532] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:50 2022] PUT /identity/v3/projects/06845f075da64a279398db4731cbb640/users/17b75cb0349b4af5b82ad8a352da284f/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:50.869368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5f3e2-581c-4ebb-8a24-b4e875ccaff4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:50.869768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5f3e2-581c-4ebb-8a24-b4e875ccaff4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:50.870121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5f3e2-581c-4ebb-8a24-b4e875ccaff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:50.893840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-69e5f3e2-581c-4ebb-8a24-b4e875ccaff4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:50.895046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-69e5f3e2-581c-4ebb-8a24-b4e875ccaff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:50.953531 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2771/5533] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:50.954802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d3fcc-bf83-496f-97c9-de4453fb767f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:50.955094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d3fcc-bf83-496f-97c9-de4453fb767f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:50.955373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d3fcc-bf83-496f-97c9-de4453fb767f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:50.981942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-001d3fcc-bf83-496f-97c9-de4453fb767f None None] MFA Rules not processed for user `17b75cb0349b4af5b82ad8a352da284f`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:50.983175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-001d3fcc-bf83-496f-97c9-de4453fb767f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:51.048124 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2772/5534] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:50 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:51.049099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d3fcc-bf83-496f-97c9-de4453fb767f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:51.060070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d3fcc-bf83-496f-97c9-de4453fb767f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:51.064895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030aa08b-ef0a-4aad-b7fb-5d4a4936920b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:51.065554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030aa08b-ef0a-4aad-b7fb-5d4a4936920b admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:51.065845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030aa08b-ef0a-4aad-b7fb-5d4a4936920b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:51.066154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030aa08b-ef0a-4aad-b7fb-5d4a4936920b admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:51.066882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030aa08b-ef0a-4aad-b7fb-5d4a4936920b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:38:51.067193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030aa08b-ef0a-4aad-b7fb-5d4a4936920b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:51.068824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030aa08b-ef0a-4aad-b7fb-5d4a4936920b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:51.080698 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2773/5535] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:51.081627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030aa08b-ef0a-4aad-b7fb-5d4a4936920b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:51.083258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-030aa08b-ef0a-4aad-b7fb-5d4a4936920b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:51.141318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030aa08b-ef0a-4aad-b7fb-5d4a4936920b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:51.145156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96856e3e-b7cc-45ca-bbd6-5a94eab24230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:51.145781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96856e3e-b7cc-45ca-bbd6-5a94eab24230 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:51.146070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96856e3e-b7cc-45ca-bbd6-5a94eab24230 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:51.146345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96856e3e-b7cc-45ca-bbd6-5a94eab24230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:51.146660 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c0db1895-b827-41e4-afc0-702c980d6222 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invalidating the token cache because role fa36e6896d7146799e38d207f89b5e83 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:51.146962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c0db1895-b827-41e4-afc0-702c980d6222 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:51.148467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c0db1895-b827-41e4-afc0-702c980d6222 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:51.150362 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2763/5536] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:50 2022] DELETE /identity/v3/roles/fa36e6896d7146799e38d207f89b5e83 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:51.154686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db1895-b827-41e4-afc0-702c980d6222 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:51.156362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c0db1895-b827-41e4-afc0-702c980d6222 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:51.156739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96856e3e-b7cc-45ca-bbd6-5a94eab24230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:51.158263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96856e3e-b7cc-45ca-bbd6-5a94eab24230 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:51.168643 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2774/5537] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:38:51 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:38:51.169497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96856e3e-b7cc-45ca-bbd6-5a94eab24230 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:51.235215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db1895-b827-41e4-afc0-702c980d6222 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:51.243574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acaea2-0257-4c11-9d29-602c7d6de944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:51.248993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acaea2-0257-4c11-9d29-602c7d6de944 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:51.248993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acaea2-0257-4c11-9d29-602c7d6de944 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:51.248993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acaea2-0257-4c11-9d29-602c7d6de944 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:51.248993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acaea2-0257-4c11-9d29-602c7d6de944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:51.249434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96856e3e-b7cc-45ca-bbd6-5a94eab24230 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:51.249579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acaea2-0257-4c11-9d29-602c7d6de944 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:51.314000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901148b-95c7-419b-9abb-114d60c256bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:51.314899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901148b-95c7-419b-9abb-114d60c256bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:51.315190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901148b-95c7-419b-9abb-114d60c256bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:51.315474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901148b-95c7-419b-9abb-114d60c256bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/users/5b1d6095fed348a6a0288bc21323a2e0` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:51.316789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901148b-95c7-419b-9abb-114d60c256bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5b1d6095fed348a6a0288bc21323a2e0)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:51.318874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901148b-95c7-419b-9abb-114d60c256bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:51.339772 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2764/5538] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:38:51 2022] POST /identity/v3/projects => generated 391 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:51.345086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acaea2-0257-4c11-9d29-602c7d6de944 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:51.433484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b901148b-95c7-419b-9abb-114d60c256bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b1d6095fed348a6a0288bc21323a2e0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:51.435311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acaea2-0257-4c11-9d29-602c7d6de944 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:51.441189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aae4d-7877-4cbf-9797-110a147ee392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:51.441897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aae4d-7877-4cbf-9797-110a147ee392 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:51.442184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aae4d-7877-4cbf-9797-110a147ee392 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:51.442487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aae4d-7877-4cbf-9797-110a147ee392 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:51.443199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8aae4d-7877-4cbf-9797-110a147ee392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:51.445269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8aae4d-7877-4cbf-9797-110a147ee392 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:51.449005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b901148b-95c7-419b-9abb-114d60c256bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b1d6095fed348a6a0288bc21323a2e0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:51.449827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b901148b-95c7-419b-9abb-114d60c256bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b1d6095fed348a6a0288bc21323a2e0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:51.457699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b901148b-95c7-419b-9abb-114d60c256bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b1d6095fed348a6a0288bc21323a2e0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:51.513602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b901148b-95c7-419b-9abb-114d60c256bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b1d6095fed348a6a0288bc21323a2e0'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:51.522376 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2775/5539] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:51 2022] DELETE /identity/v3/users/5b1d6095fed348a6a0288bc21323a2e0 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:51.526895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901148b-95c7-419b-9abb-114d60c256bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:51.528436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b901148b-95c7-419b-9abb-114d60c256bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:51.531311 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2765/5540] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:38:51 2022] POST /identity/v3/users => generated 296 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:38:51.536378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aae4d-7877-4cbf-9797-110a147ee392 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:51.543185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6e8aae4d-7877-4cbf-9797-110a147ee392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:51.560995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aae4d-7877-4cbf-9797-110a147ee392 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:51.617703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901148b-95c7-419b-9abb-114d60c256bc tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:51.621834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312c1a8-8aab-4a46-9258-9757072347e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:51.622719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312c1a8-8aab-4a46-9258-9757072347e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:51.622900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312c1a8-8aab-4a46-9258-9757072347e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:51.623564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312c1a8-8aab-4a46-9258-9757072347e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:51.623784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10b7cc-2d95-40a3-b126-4048d7103faf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:51.624186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312c1a8-8aab-4a46-9258-9757072347e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:51.624685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10b7cc-2d95-40a3-b126-4048d7103faf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:51.624976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10b7cc-2d95-40a3-b126-4048d7103faf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:51.625283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10b7cc-2d95-40a3-b126-4048d7103faf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects/04298af0487f480ea82aeb60c77c254b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:51.626380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312c1a8-8aab-4a46-9258-9757072347e9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:51.626783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10b7cc-2d95-40a3-b126-4048d7103faf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_project(project_id=04298af0487f480ea82aeb60c77c254b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:51.628851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10b7cc-2d95-40a3-b126-4048d7103faf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:51.638013 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2766/5541] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:38:51.641423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312c1a8-8aab-4a46-9258-9757072347e9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:51.652077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312c1a8-8aab-4a46-9258-9757072347e9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:51.657462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012abee-3c8a-4f74-ad88-0ae072bbbd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:51.658115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012abee-3c8a-4f74-ad88-0ae072bbbd34 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:51.660731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012abee-3c8a-4f74-ad88-0ae072bbbd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:51.660731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012abee-3c8a-4f74-ad88-0ae072bbbd34 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:51.660731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012abee-3c8a-4f74-ad88-0ae072bbbd34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:51.661018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012abee-3c8a-4f74-ad88-0ae072bbbd34 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:51.670715 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2767/5542] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:38:51.674617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012abee-3c8a-4f74-ad88-0ae072bbbd34 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:51.684484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012abee-3c8a-4f74-ad88-0ae072bbbd34 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:51.689266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9da80-a7e9-4d26-96e7-d68149afda14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:51.690147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9da80-a7e9-4d26-96e7-d68149afda14 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:51.690431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9da80-a7e9-4d26-96e7-d68149afda14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:51.690881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9da80-a7e9-4d26-96e7-d68149afda14 admin admin] PATH_INFO: `/v3/projects/24d72c31f7ad4e3e96bdb585f2890f6b/users/5c80bb9dda7f460dac27aff66ef40947/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:51.706058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9da80-a7e9-4d26-96e7-d68149afda14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d72c31f7ad4e3e96bdb585f2890f6b, user_id=5c80bb9dda7f460dac27aff66ef40947, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:51.708794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9da80-a7e9-4d26-96e7-d68149afda14 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:51.812771 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2768/5543] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:51 2022] PUT /identity/v3/projects/24d72c31f7ad4e3e96bdb585f2890f6b/users/5c80bb9dda7f460dac27aff66ef40947/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:51.817537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1d10b7cc-2d95-40a3-b126-4048d7103faf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04298af0487f480ea82aeb60c77c254b', 'request_id': 'req-1d10b7cc-2d95-40a3-b126-4048d7103faf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:51.826062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1d10b7cc-2d95-40a3-b126-4048d7103faf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04298af0487f480ea82aeb60c77c254b', 'request_id': 'req-1d10b7cc-2d95-40a3-b126-4048d7103faf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:51.833860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4b33a-9613-4ba8-a407-eea4e8cdac69 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:51.834149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4b33a-9613-4ba8-a407-eea4e8cdac69 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:51.834433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4b33a-9613-4ba8-a407-eea4e8cdac69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:51.882235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fdc4b33a-9613-4ba8-a407-eea4e8cdac69 None None] MFA Rules not processed for user `5c80bb9dda7f460dac27aff66ef40947`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:51.882235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fdc4b33a-9613-4ba8-a407-eea4e8cdac69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:51.902281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1d10b7cc-2d95-40a3-b126-4048d7103faf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04298af0487f480ea82aeb60c77c254b', 'request_id': 'req-1d10b7cc-2d95-40a3-b126-4048d7103faf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:51.919365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1d10b7cc-2d95-40a3-b126-4048d7103faf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] The token cache is being invalidate because project 04298af0487f480ea82aeb60c77c254b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:51.919757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1d10b7cc-2d95-40a3-b126-4048d7103faf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:51.920919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1d10b7cc-2d95-40a3-b126-4048d7103faf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:51.922903 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2776/5544] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:51 2022] DELETE /identity/v3/projects/04298af0487f480ea82aeb60c77c254b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:51.929815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10b7cc-2d95-40a3-b126-4048d7103faf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:51.931551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1d10b7cc-2d95-40a3-b126-4048d7103faf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:51.962159 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2769/5545] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:51.975546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4b33a-9613-4ba8-a407-eea4e8cdac69 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:51.978623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fdc4b33a-9613-4ba8-a407-eea4e8cdac69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:52.026635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10b7cc-2d95-40a3-b126-4048d7103faf tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:52.060176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4b33a-9613-4ba8-a407-eea4e8cdac69 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:52.064615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78863dab-1ad2-482b-afd6-058ff3a0e1b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:52.065411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78863dab-1ad2-482b-afd6-058ff3a0e1b4 service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:52.065941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78863dab-1ad2-482b-afd6-058ff3a0e1b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:52.066324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78863dab-1ad2-482b-afd6-058ff3a0e1b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:52.077466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78863dab-1ad2-482b-afd6-058ff3a0e1b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:52.079588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78863dab-1ad2-482b-afd6-058ff3a0e1b4 service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:52.098254 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2770/5546] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:38:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:38:52.102465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074c225-d626-4f8c-9d23-62707bfa87e2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:52.109087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074c225-d626-4f8c-9d23-62707bfa87e2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:52.109475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074c225-d626-4f8c-9d23-62707bfa87e2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:52.109761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074c225-d626-4f8c-9d23-62707bfa87e2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:52.111326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074c225-d626-4f8c-9d23-62707bfa87e2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:52.113485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074c225-d626-4f8c-9d23-62707bfa87e2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:52.276658 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2777/5547] 10.222.0.16 () {60 vars in 1151 bytes} [Mon May 2 10:38:51 2022] POST /identity/v3/projects => generated 328 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:52.281091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78863dab-1ad2-482b-afd6-058ff3a0e1b4 service cinder] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:52.302462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78863dab-1ad2-482b-afd6-058ff3a0e1b4 service cinder] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:52.360375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0ef45-20e2-4497-a5bd-d94b4ca28ad3 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:52.361116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0ef45-20e2-4497-a5bd-d94b4ca28ad3 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:52.363979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0ef45-20e2-4497-a5bd-d94b4ca28ad3 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:52.363979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0ef45-20e2-4497-a5bd-d94b4ca28ad3 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:52.363979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0ef45-20e2-4497-a5bd-d94b4ca28ad3 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:52.364496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0ef45-20e2-4497-a5bd-d94b4ca28ad3 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:52.491707 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2771/5548] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:38:52 2022] POST /identity/v3/users => generated 413 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:52.496685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074c225-d626-4f8c-9d23-62707bfa87e2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:52.508751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074c225-d626-4f8c-9d23-62707bfa87e2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:52.514556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04adfa-1234-49bd-ba29-ed6e25844c08 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:52.515752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04adfa-1234-49bd-ba29-ed6e25844c08 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:52.515752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04adfa-1234-49bd-ba29-ed6e25844c08 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:52.526786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04adfa-1234-49bd-ba29-ed6e25844c08 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:52.526786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04adfa-1234-49bd-ba29-ed6e25844c08 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:52.526786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04adfa-1234-49bd-ba29-ed6e25844c08 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:52.632004 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2778/5549] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:38:52 2022] POST /identity/v3/roles => generated 243 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:52.636164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0ef45-20e2-4497-a5bd-d94b4ca28ad3 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:52.652866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0ef45-20e2-4497-a5bd-d94b4ca28ad3 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:52.653128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69717476-e84a-4f42-9959-89d1d7975bed tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:52.653787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69717476-e84a-4f42-9959-89d1d7975bed tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:52.654074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69717476-e84a-4f42-9959-89d1d7975bed tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:52.654986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69717476-e84a-4f42-9959-89d1d7975bed tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:52.655750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69717476-e84a-4f42-9959-89d1d7975bed tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:52.657382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69717476-e84a-4f42-9959-89d1d7975bed tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:52.757301 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2772/5550] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:38:52 2022] POST /identity/v3/roles => generated 246 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:52.761935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04adfa-1234-49bd-ba29-ed6e25844c08 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:52.773250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04adfa-1234-49bd-ba29-ed6e25844c08 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:52.778551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33783e1-23c2-4fbe-9ade-86be1229123b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:52.779452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33783e1-23c2-4fbe-9ade-86be1229123b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:52.779735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33783e1-23c2-4fbe-9ade-86be1229123b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:52.780014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33783e1-23c2-4fbe-9ade-86be1229123b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects/54426e17b0b04236831b5d10d24179d7/users/b02d4deb67bd45a0a925d432457fced6/roles/e5da8c7d25114810addbe012c89fd157` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:52.794865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33783e1-23c2-4fbe-9ade-86be1229123b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_grant(project_id=54426e17b0b04236831b5d10d24179d7, user_id=b02d4deb67bd45a0a925d432457fced6, role_id=e5da8c7d25114810addbe012c89fd157)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:52.797601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33783e1-23c2-4fbe-9ade-86be1229123b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:52.988367 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2779/5551] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:52 2022] PUT /identity/v3/projects/54426e17b0b04236831b5d10d24179d7/users/b02d4deb67bd45a0a925d432457fced6/roles/e5da8c7d25114810addbe012c89fd157 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:52.992432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69717476-e84a-4f42-9959-89d1d7975bed tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:53.005802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69717476-e84a-4f42-9959-89d1d7975bed tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:53.068963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022fc34-94d4-4083-8fa1-b698403e5282 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:53.069987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022fc34-94d4-4083-8fa1-b698403e5282 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:53.070354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022fc34-94d4-4083-8fa1-b698403e5282 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:53.070647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022fc34-94d4-4083-8fa1-b698403e5282 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects/54426e17b0b04236831b5d10d24179d7/users/b02d4deb67bd45a0a925d432457fced6/roles/d42401f9797b43f19e4f2e3a50401207` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:53.073754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022fc34-94d4-4083-8fa1-b698403e5282 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_grant(project_id=54426e17b0b04236831b5d10d24179d7, user_id=b02d4deb67bd45a0a925d432457fced6, role_id=d42401f9797b43f19e4f2e3a50401207)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:53.076568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022fc34-94d4-4083-8fa1-b698403e5282 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:53.171109 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2773/5552] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:52 2022] PUT /identity/v3/projects/54426e17b0b04236831b5d10d24179d7/users/b02d4deb67bd45a0a925d432457fced6/roles/d42401f9797b43f19e4f2e3a50401207 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:53.175170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33783e1-23c2-4fbe-9ade-86be1229123b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:53.186789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33783e1-23c2-4fbe-9ade-86be1229123b tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:53.269834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c89b2b-f410-45c0-95cf-20094d6c91a2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:53.270522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c89b2b-f410-45c0-95cf-20094d6c91a2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:53.270814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c89b2b-f410-45c0-95cf-20094d6c91a2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:53.271098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c89b2b-f410-45c0-95cf-20094d6c91a2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:53.272335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c89b2b-f410-45c0-95cf-20094d6c91a2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:53.274365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c89b2b-f410-45c0-95cf-20094d6c91a2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:53.310902 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2780/5553] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:53 2022] GET /identity/v3/users => generated 8623 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:38:53.324966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a07ec9-6896-4e22-9f6f-e84ac705737d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:53.325266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a07ec9-6896-4e22-9f6f-e84ac705737d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:53.325581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a07ec9-6896-4e22-9f6f-e84ac705737d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:53.380978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a3a07ec9-6896-4e22-9f6f-e84ac705737d None None] MFA Rules not processed for user `b02d4deb67bd45a0a925d432457fced6`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:53.384199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a3a07ec9-6896-4e22-9f6f-e84ac705737d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:53.468584 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2774/5554] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:53 2022] POST /identity/v3/auth/tokens => generated 3267 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:53.478383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17d805-66f1-499c-afed-9c998a93614a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:53.479185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17d805-66f1-499c-afed-9c998a93614a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:53.479506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17d805-66f1-499c-afed-9c998a93614a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:53.505954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6c17d805-66f1-499c-afed-9c998a93614a None None] MFA Rules not processed for user `b02d4deb67bd45a0a925d432457fced6`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:53.507362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6c17d805-66f1-499c-afed-9c998a93614a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:53.524901 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2781/5555] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:53 2022] POST /identity/v3/auth/tokens => generated 3267 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:53.529340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a07ec9-6896-4e22-9f6f-e84ac705737d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:53.540659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a07ec9-6896-4e22-9f6f-e84ac705737d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:53.553181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1994c5-e94c-4f34-b195-3dca4f2a9d46 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02d4deb67bd45a0a925d432457fced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54426e17b0b04236831b5d10d24179d7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-871144167', 'tempest-NotDelegatedRole-552677023'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:53.554180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1994c5-e94c-4f34-b195-3dca4f2a9d46 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:53.554339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1994c5-e94c-4f34-b195-3dca4f2a9d46 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:53.554722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1994c5-e94c-4f34-b195-3dca4f2a9d46 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:53.555628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1994c5-e94c-4f34-b195-3dca4f2a9d46 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: Authorizing `identity:create_trust()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:53.558873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1994c5-e94c-4f34-b195-3dca4f2a9d46 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:53.718743 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2775/5556] 10.222.0.16 () {60 vars in 1173 bytes} [Mon May 2 10:38:53 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:53.719524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17d805-66f1-499c-afed-9c998a93614a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:53.729655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17d805-66f1-499c-afed-9c998a93614a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:53.736028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdca21c-9916-4e8b-8c21-e4e0c3f03eaa tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02d4deb67bd45a0a925d432457fced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54426e17b0b04236831b5d10d24179d7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-871144167', 'tempest-NotDelegatedRole-552677023'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:53.736901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdca21c-9916-4e8b-8c21-e4e0c3f03eaa tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:53.737187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdca21c-9916-4e8b-8c21-e4e0c3f03eaa tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:53.737465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdca21c-9916-4e8b-8c21-e4e0c3f03eaa tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] PATH_INFO: `/v3/OS-TRUST/trusts/5b0a39e447f547ab9bfb97610aea5b44` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:53.743962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdca21c-9916-4e8b-8c21-e4e0c3f03eaa tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: Authorizing `identity:get_trust(trust_id=5b0a39e447f547ab9bfb97610aea5b44)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:53.745789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdca21c-9916-4e8b-8c21-e4e0c3f03eaa tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:53.754797 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2782/5557] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 2 10:38:53 2022] GET /identity/v3/OS-TRUST/trusts/5b0a39e447f547ab9bfb97610aea5b44 => generated 833 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:53.758596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1994c5-e94c-4f34-b195-3dca4f2a9d46 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:53.768749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1994c5-e94c-4f34-b195-3dca4f2a9d46 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:53.773084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccb984-e869-420a-a9f2-53f37fa1226b tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02d4deb67bd45a0a925d432457fced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54426e17b0b04236831b5d10d24179d7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-871144167', 'tempest-NotDelegatedRole-552677023'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:53.773872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccb984-e869-420a-a9f2-53f37fa1226b tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:53.774221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccb984-e869-420a-a9f2-53f37fa1226b tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:53.778275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccb984-e869-420a-a9f2-53f37fa1226b tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] PATH_INFO: `/v3/OS-TRUST/trusts/5b0a39e447f547ab9bfb97610aea5b44/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:53.780935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccb984-e869-420a-a9f2-53f37fa1226b tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=5b0a39e447f547ab9bfb97610aea5b44)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:53.782384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccb984-e869-420a-a9f2-53f37fa1226b tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:53.790394 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2776/5558] 10.222.0.16 () {58 vars in 1268 bytes} [Mon May 2 10:38:53 2022] GET /identity/v3/OS-TRUST/trusts/5b0a39e447f547ab9bfb97610aea5b44/roles => generated 370 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:53.795007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdca21c-9916-4e8b-8c21-e4e0c3f03eaa tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:53.807100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdca21c-9916-4e8b-8c21-e4e0c3f03eaa tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:53.809536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8aeff0-0d77-4b62-ab5f-7a90b50db2d4 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02d4deb67bd45a0a925d432457fced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54426e17b0b04236831b5d10d24179d7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-871144167', 'tempest-NotDelegatedRole-552677023'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:53.810420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8aeff0-0d77-4b62-ab5f-7a90b50db2d4 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:53.810704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8aeff0-0d77-4b62-ab5f-7a90b50db2d4 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:53.810978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8aeff0-0d77-4b62-ab5f-7a90b50db2d4 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] PATH_INFO: `/v3/OS-TRUST/trusts/5b0a39e447f547ab9bfb97610aea5b44/roles/e5da8c7d25114810addbe012c89fd157` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:53.817184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8aeff0-0d77-4b62-ab5f-7a90b50db2d4 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: Authorizing `identity:get_role_for_trust(trust_id=5b0a39e447f547ab9bfb97610aea5b44, role_id=e5da8c7d25114810addbe012c89fd157)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:53.818713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8aeff0-0d77-4b62-ab5f-7a90b50db2d4 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:53.825313 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2783/5559] 10.222.0.16 () {58 vars in 1367 bytes} [Mon May 2 10:38:53 2022] GET /identity/v3/OS-TRUST/trusts/5b0a39e447f547ab9bfb97610aea5b44/roles/e5da8c7d25114810addbe012c89fd157 => generated 243 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:53.829428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccb984-e869-420a-a9f2-53f37fa1226b tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:53.840125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccb984-e869-420a-a9f2-53f37fa1226b tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:53.842373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8aeff0-0d77-4b62-ab5f-7a90b50db2d4 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:53.844106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-de8aeff0-0d77-4b62-ab5f-7a90b50db2d4 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:53.844246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e1376-2f40-4090-80ec-3bdd526ff885 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02d4deb67bd45a0a925d432457fced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54426e17b0b04236831b5d10d24179d7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-871144167', 'tempest-NotDelegatedRole-552677023'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:53.844992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e1376-2f40-4090-80ec-3bdd526ff885 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] REQUEST_METHOD: `HEAD` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:53.845279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e1376-2f40-4090-80ec-3bdd526ff885 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:53.845555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e1376-2f40-4090-80ec-3bdd526ff885 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] PATH_INFO: `/v3/OS-TRUST/trusts/5b0a39e447f547ab9bfb97610aea5b44/roles/e5da8c7d25114810addbe012c89fd157` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:53.852394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e1376-2f40-4090-80ec-3bdd526ff885 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: Authorizing `identity:get_role_for_trust(trust_id=5b0a39e447f547ab9bfb97610aea5b44, role_id=e5da8c7d25114810addbe012c89fd157)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:53.854400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e1376-2f40-4090-80ec-3bdd526ff885 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:53.862891 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2777/5560] 10.222.0.16 () {58 vars in 1368 bytes} [Mon May 2 10:38:53 2022] HEAD /identity/v3/OS-TRUST/trusts/5b0a39e447f547ab9bfb97610aea5b44/roles/e5da8c7d25114810addbe012c89fd157 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:53.868529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e1376-2f40-4090-80ec-3bdd526ff885 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:53.878423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e1376-2f40-4090-80ec-3bdd526ff885 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:53.883333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f66df-6725-423e-826f-fa83987fdcf9 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02d4deb67bd45a0a925d432457fced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54426e17b0b04236831b5d10d24179d7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-871144167', 'tempest-NotDelegatedRole-552677023'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:53.884180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f66df-6725-423e-826f-fa83987fdcf9 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:53.884441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f66df-6725-423e-826f-fa83987fdcf9 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:53.884773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f66df-6725-423e-826f-fa83987fdcf9 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] PATH_INFO: `/v3/OS-TRUST/trusts/5b0a39e447f547ab9bfb97610aea5b44/roles/d42401f9797b43f19e4f2e3a50401207` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:53.890558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f66df-6725-423e-826f-fa83987fdcf9 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: Authorizing `identity:get_role_for_trust(trust_id=5b0a39e447f547ab9bfb97610aea5b44, role_id=d42401f9797b43f19e4f2e3a50401207)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:53.894455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f66df-6725-423e-826f-fa83987fdcf9 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:53.906441 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-396f66df-6725-423e-826f-fa83987fdcf9 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Could not find role: d42401f9797b43f19e4f2e3a50401207.: keystone.exception.RoleNotFound: Could not find role: d42401f9797b43f19e4f2e3a50401207. May 02 10:38:53.906441 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:38:53.906441 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:38:53.906441 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:38:53.906441 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:38:53.906441 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:38:53.906441 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:38:53.906441 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:38:53.906441 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:38:53.906441 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:38:53.906441 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:38:53.906441 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:38:53.906441 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get May 02 10:38:53.906441 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 10:38:53.907692 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: d42401f9797b43f19e4f2e3a50401207. May 02 10:38:53.907692 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:38:53.910959 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2778/5561] 10.222.0.16 () {58 vars in 1367 bytes} [Mon May 2 10:38:53 2022] GET /identity/v3/OS-TRUST/trusts/5b0a39e447f547ab9bfb97610aea5b44/roles/d42401f9797b43f19e4f2e3a50401207 => generated 110 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 02 10:38:53.911603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f66df-6725-423e-826f-fa83987fdcf9 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:53.914985 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8aeff0-0d77-4b62-ab5f-7a90b50db2d4 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:53.920689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5646d9a-fedc-4743-b82d-878b17e0bb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:53.925889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5646d9a-fedc-4743-b82d-878b17e0bb32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:53.925889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5646d9a-fedc-4743-b82d-878b17e0bb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:53.925889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5646d9a-fedc-4743-b82d-878b17e0bb32 admin admin] PATH_INFO: `/v3/users/17b75cb0349b4af5b82ad8a352da284f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:53.926774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f66df-6725-423e-826f-fa83987fdcf9 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:53.926895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5646d9a-fedc-4743-b82d-878b17e0bb32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b75cb0349b4af5b82ad8a352da284f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:53.926895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5646d9a-fedc-4743-b82d-878b17e0bb32 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:53.927063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e989b-5faa-420b-9a62-5042c89c623c tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02d4deb67bd45a0a925d432457fced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54426e17b0b04236831b5d10d24179d7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-871144167', 'tempest-NotDelegatedRole-552677023'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:53.927295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e989b-5faa-420b-9a62-5042c89c623c tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] REQUEST_METHOD: `HEAD` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:53.927668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e989b-5faa-420b-9a62-5042c89c623c tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:53.928236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e989b-5faa-420b-9a62-5042c89c623c tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] PATH_INFO: `/v3/OS-TRUST/trusts/5b0a39e447f547ab9bfb97610aea5b44/roles/d42401f9797b43f19e4f2e3a50401207` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:53.934736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e989b-5faa-420b-9a62-5042c89c623c tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: Authorizing `identity:get_role_for_trust(trust_id=5b0a39e447f547ab9bfb97610aea5b44, role_id=d42401f9797b43f19e4f2e3a50401207)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:53.936166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e989b-5faa-420b-9a62-5042c89c623c tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:53.954646 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-4c7e989b-5faa-420b-9a62-5042c89c623c tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Could not find role: d42401f9797b43f19e4f2e3a50401207.: keystone.exception.RoleNotFound: Could not find role: d42401f9797b43f19e4f2e3a50401207. May 02 10:38:53.954646 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:38:53.954646 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:38:53.954646 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:38:53.954646 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:38:53.954646 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:38:53.954646 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:38:53.954646 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:38:53.954646 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:38:53.954646 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:38:53.954646 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:38:53.954646 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:38:53.954646 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get May 02 10:38:53.954646 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 10:38:53.956109 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: d42401f9797b43f19e4f2e3a50401207. May 02 10:38:53.956109 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:38:53.956109 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2779/5562] 10.222.0.16 () {58 vars in 1368 bytes} [Mon May 2 10:38:53 2022] HEAD /identity/v3/OS-TRUST/trusts/5b0a39e447f547ab9bfb97610aea5b44/roles/d42401f9797b43f19e4f2e3a50401207 => generated 0 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) May 02 10:38:53.958987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e989b-5faa-420b-9a62-5042c89c623c tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:53.971308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e989b-5faa-420b-9a62-5042c89c623c tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:53.973616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5625aa-4fd4-4517-b2b1-c7593570b774 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02d4deb67bd45a0a925d432457fced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54426e17b0b04236831b5d10d24179d7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-871144167', 'tempest-NotDelegatedRole-552677023'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:53.974857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5625aa-4fd4-4517-b2b1-c7593570b774 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:53.974857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5625aa-4fd4-4517-b2b1-c7593570b774 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:53.975071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5625aa-4fd4-4517-b2b1-c7593570b774 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] PATH_INFO: `/v3/OS-TRUST/trusts/5b0a39e447f547ab9bfb97610aea5b44` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:53.981303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5625aa-4fd4-4517-b2b1-c7593570b774 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: Authorizing `identity:delete_trust(trust_id=5b0a39e447f547ab9bfb97610aea5b44)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:53.982719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5625aa-4fd4-4517-b2b1-c7593570b774 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:54.106883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bf5625aa-4fd4-4517-b2b1-c7593570b774 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '5b0a39e447f547ab9bfb97610aea5b44', 'request_id': 'req-bf5625aa-4fd4-4517-b2b1-c7593570b774'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:54.154928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d5646d9a-fedc-4743-b82d-878b17e0bb32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b75cb0349b4af5b82ad8a352da284f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:54.166323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d5646d9a-fedc-4743-b82d-878b17e0bb32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b75cb0349b4af5b82ad8a352da284f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:54.166987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d5646d9a-fedc-4743-b82d-878b17e0bb32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b75cb0349b4af5b82ad8a352da284f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:54.174193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d5646d9a-fedc-4743-b82d-878b17e0bb32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b75cb0349b4af5b82ad8a352da284f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:54.210437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bf5625aa-4fd4-4517-b2b1-c7593570b774 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '5b0a39e447f547ab9bfb97610aea5b44', 'request_id': 'req-bf5625aa-4fd4-4517-b2b1-c7593570b774'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:54.211383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bf5625aa-4fd4-4517-b2b1-c7593570b774 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '5b0a39e447f547ab9bfb97610aea5b44', 'request_id': 'req-bf5625aa-4fd4-4517-b2b1-c7593570b774'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:54.218669 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2780/5563] 10.222.0.16 () {58 vars in 1253 bytes} [Mon May 2 10:38:53 2022] DELETE /identity/v3/OS-TRUST/trusts/5b0a39e447f547ab9bfb97610aea5b44 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:54.222597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5625aa-4fd4-4517-b2b1-c7593570b774 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:54.223875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bf5625aa-4fd4-4517-b2b1-c7593570b774 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:54.235125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5625aa-4fd4-4517-b2b1-c7593570b774 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:54.239396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e4945-a7ae-450d-8fdc-706b74802fe6 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b02d4deb67bd45a0a925d432457fced6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54426e17b0b04236831b5d10d24179d7', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-871144167', 'tempest-NotDelegatedRole-552677023'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:54.240211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e4945-a7ae-450d-8fdc-706b74802fe6 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:54.240499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e4945-a7ae-450d-8fdc-706b74802fe6 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:54.240822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e4945-a7ae-450d-8fdc-706b74802fe6 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] PATH_INFO: `/v3/OS-TRUST/trusts/5b0a39e447f547ab9bfb97610aea5b44` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:54.255239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-ee1e4945-a7ae-450d-8fdc-706b74802fe6 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Could not find trust: 5b0a39e447f547ab9bfb97610aea5b44.: keystone.exception.TrustNotFound: Could not find trust: 5b0a39e447f547ab9bfb97610aea5b44. May 02 10:38:54.255239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:38:54.255239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:38:54.255239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:38:54.255239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:38:54.255239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:38:54.255239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:38:54.255239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:38:54.255239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:38:54.255239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:38:54.255239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:38:54.255239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:38:54.255239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get May 02 10:38:54.255239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) May 02 10:38:54.255239 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust May 02 10:38:54.256669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', May 02 10:38:54.256669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call May 02 10:38:54.256669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() May 02 10:38:54.256669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement May 02 10:38:54.256669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( May 02 10:38:54.256669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:38:54.256669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:38:54.256669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust May 02 10:38:54.256669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) May 02 10:38:54.256669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust May 02 10:38:54.256669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) May 02 10:38:54.256669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 5b0a39e447f547ab9bfb97610aea5b44. May 02 10:38:54.256669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:38:54.256669 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2781/5564] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 2 10:38:54 2022] GET /identity/v3/OS-TRUST/trusts/5b0a39e447f547ab9bfb97610aea5b44 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 02 10:38:54.261252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e4945-a7ae-450d-8fdc-706b74802fe6 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:54.263158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ee1e4945-a7ae-450d-8fdc-706b74802fe6 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:54.278470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e4945-a7ae-450d-8fdc-706b74802fe6 tempest-TrustsV3TestJSON-828877792 tempest-user-229337864] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:54.283038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda61ace-171a-48b0-bc5f-fdd0626f34a1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:54.283881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda61ace-171a-48b0-bc5f-fdd0626f34a1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:54.284167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda61ace-171a-48b0-bc5f-fdd0626f34a1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:54.284446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda61ace-171a-48b0-bc5f-fdd0626f34a1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles/d42401f9797b43f19e4f2e3a50401207` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:54.285964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda61ace-171a-48b0-bc5f-fdd0626f34a1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d42401f9797b43f19e4f2e3a50401207)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:54.287550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda61ace-171a-48b0-bc5f-fdd0626f34a1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:54.318760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d5646d9a-fedc-4743-b82d-878b17e0bb32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b75cb0349b4af5b82ad8a352da284f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:54.325618 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2784/5565] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:53 2022] DELETE /identity/v3/users/17b75cb0349b4af5b82ad8a352da284f => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:54.329883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a913f1e-22bd-4e8e-9caf-2d2ccf945646 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:54.330174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a913f1e-22bd-4e8e-9caf-2d2ccf945646 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:54.330458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a913f1e-22bd-4e8e-9caf-2d2ccf945646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:54.348207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6a913f1e-22bd-4e8e-9caf-2d2ccf945646 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:54.349441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6a913f1e-22bd-4e8e-9caf-2d2ccf945646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:54.410323 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2785/5566] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:38:54.420520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a913f1e-22bd-4e8e-9caf-2d2ccf945646 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:54.421950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6a913f1e-22bd-4e8e-9caf-2d2ccf945646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:54.444028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fda61ace-171a-48b0-bc5f-fdd0626f34a1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invalidating the token cache because role d42401f9797b43f19e4f2e3a50401207 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:54.444695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fda61ace-171a-48b0-bc5f-fdd0626f34a1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:54.445015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fda61ace-171a-48b0-bc5f-fdd0626f34a1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:54.446950 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2782/5567] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:54 2022] DELETE /identity/v3/roles/d42401f9797b43f19e4f2e3a50401207 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:54.451476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda61ace-171a-48b0-bc5f-fdd0626f34a1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:54.452903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fda61ace-171a-48b0-bc5f-fdd0626f34a1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:54.484396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a913f1e-22bd-4e8e-9caf-2d2ccf945646 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:54.515920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda61ace-171a-48b0-bc5f-fdd0626f34a1 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:54.520787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e8cc0-7807-4274-bf03-c5ae41444ac6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:54.521648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e8cc0-7807-4274-bf03-c5ae41444ac6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:54.521939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e8cc0-7807-4274-bf03-c5ae41444ac6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:54.522221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e8cc0-7807-4274-bf03-c5ae41444ac6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles/e5da8c7d25114810addbe012c89fd157` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:54.523771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e8cc0-7807-4274-bf03-c5ae41444ac6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e5da8c7d25114810addbe012c89fd157)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:54.525423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e8cc0-7807-4274-bf03-c5ae41444ac6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:54.530333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6eff25-6870-48c7-8574-9527999bbbb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:54.530981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6eff25-6870-48c7-8574-9527999bbbb6 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:54.531269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6eff25-6870-48c7-8574-9527999bbbb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:54.531542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6eff25-6870-48c7-8574-9527999bbbb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:54.533401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1b6eff25-6870-48c7-8574-9527999bbbb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:54.597497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6eff25-6870-48c7-8574-9527999bbbb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:54.598955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6eff25-6870-48c7-8574-9527999bbbb6 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:54.608912 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2786/5568] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:38:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:38:54.690293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ea6e8cc0-7807-4274-bf03-c5ae41444ac6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invalidating the token cache because role e5da8c7d25114810addbe012c89fd157 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:54.690581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ea6e8cc0-7807-4274-bf03-c5ae41444ac6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:54.691264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ea6e8cc0-7807-4274-bf03-c5ae41444ac6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:54.693212 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2783/5569] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:54 2022] DELETE /identity/v3/roles/e5da8c7d25114810addbe012c89fd157 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:54.697449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6eff25-6870-48c7-8574-9527999bbbb6 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:54.711316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6eff25-6870-48c7-8574-9527999bbbb6 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:54.772005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6773c-c16b-4b4a-a0b4-da2595834b29 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:54.772900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6773c-c16b-4b4a-a0b4-da2595834b29 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:54.773190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6773c-c16b-4b4a-a0b4-da2595834b29 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:54.773472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6773c-c16b-4b4a-a0b4-da2595834b29 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/users/b02d4deb67bd45a0a925d432457fced6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:54.774871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6773c-c16b-4b4a-a0b4-da2595834b29 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b02d4deb67bd45a0a925d432457fced6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:54.777367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6773c-c16b-4b4a-a0b4-da2595834b29 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:54.892259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e8cc0-7807-4274-bf03-c5ae41444ac6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:54.893803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ea6e8cc0-7807-4274-bf03-c5ae41444ac6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:54.937003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e9e6773c-c16b-4b4a-a0b4-da2595834b29 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b02d4deb67bd45a0a925d432457fced6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:54.966047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e9e6773c-c16b-4b4a-a0b4-da2595834b29 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b02d4deb67bd45a0a925d432457fced6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:54.966847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e9e6773c-c16b-4b4a-a0b4-da2595834b29 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b02d4deb67bd45a0a925d432457fced6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:54.977334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e9e6773c-c16b-4b4a-a0b4-da2595834b29 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b02d4deb67bd45a0a925d432457fced6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:54.993464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e8cc0-7807-4274-bf03-c5ae41444ac6 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:55.000543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031502dd-25f9-49a2-9714-9925e6c94e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:55.001563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031502dd-25f9-49a2-9714-9925e6c94e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:55.001859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031502dd-25f9-49a2-9714-9925e6c94e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:55.002177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031502dd-25f9-49a2-9714-9925e6c94e62 admin admin] PATH_INFO: `/v3/projects/06845f075da64a279398db4731cbb640` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:55.003461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031502dd-25f9-49a2-9714-9925e6c94e62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06845f075da64a279398db4731cbb640)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:55.005479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031502dd-25f9-49a2-9714-9925e6c94e62 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:55.043195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e9e6773c-c16b-4b4a-a0b4-da2595834b29 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b02d4deb67bd45a0a925d432457fced6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:55.045976 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2787/5570] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:54 2022] DELETE /identity/v3/users/b02d4deb67bd45a0a925d432457fced6 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:55.050168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6773c-c16b-4b4a-a0b4-da2595834b29 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:55.051540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e9e6773c-c16b-4b4a-a0b4-da2595834b29 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:55.117022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6773c-c16b-4b4a-a0b4-da2595834b29 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:55.130394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-031502dd-25f9-49a2-9714-9925e6c94e62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06845f075da64a279398db4731cbb640', 'request_id': 'req-031502dd-25f9-49a2-9714-9925e6c94e62'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:55.171940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85339086-be49-4ffa-bbd8-7c734c176901 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:55.172835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85339086-be49-4ffa-bbd8-7c734c176901 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:55.173126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85339086-be49-4ffa-bbd8-7c734c176901 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:55.173409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85339086-be49-4ffa-bbd8-7c734c176901 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects/54426e17b0b04236831b5d10d24179d7` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:55.174730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85339086-be49-4ffa-bbd8-7c734c176901 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_project(project_id=54426e17b0b04236831b5d10d24179d7)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:55.176702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85339086-be49-4ffa-bbd8-7c734c176901 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:55.221521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-031502dd-25f9-49a2-9714-9925e6c94e62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06845f075da64a279398db4731cbb640', 'request_id': 'req-031502dd-25f9-49a2-9714-9925e6c94e62'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:55.228475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-031502dd-25f9-49a2-9714-9925e6c94e62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06845f075da64a279398db4731cbb640', 'request_id': 'req-031502dd-25f9-49a2-9714-9925e6c94e62'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:55.238857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-031502dd-25f9-49a2-9714-9925e6c94e62 admin admin] The token cache is being invalidate because project 06845f075da64a279398db4731cbb640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:55.239145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-031502dd-25f9-49a2-9714-9925e6c94e62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:55.239823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-031502dd-25f9-49a2-9714-9925e6c94e62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:55.241404 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2784/5571] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:54 2022] DELETE /identity/v3/projects/06845f075da64a279398db4731cbb640 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:55.248592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5d457-2bfd-4674-aa8f-5a6c4fa8df47 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:55.248929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5d457-2bfd-4674-aa8f-5a6c4fa8df47 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:55.249208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5d457-2bfd-4674-aa8f-5a6c4fa8df47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:55.268226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b2e5d457-2bfd-4674-aa8f-5a6c4fa8df47 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:55.269452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b2e5d457-2bfd-4674-aa8f-5a6c4fa8df47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:55.341918 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2785/5572] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:38:55.349468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bbb0f-be1c-4eaa-a121-bfce45f6bca0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:55.349758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bbb0f-be1c-4eaa-a121-bfce45f6bca0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:55.350094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bbb0f-be1c-4eaa-a121-bfce45f6bca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:55.367464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-378bbb0f-be1c-4eaa-a121-bfce45f6bca0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:55.368695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-378bbb0f-be1c-4eaa-a121-bfce45f6bca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:55.420307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-85339086-be49-4ffa-bbd8-7c734c176901 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54426e17b0b04236831b5d10d24179d7', 'request_id': 'req-85339086-be49-4ffa-bbd8-7c734c176901'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:55.425841 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2786/5573] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:38:55.426512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-85339086-be49-4ffa-bbd8-7c734c176901 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54426e17b0b04236831b5d10d24179d7', 'request_id': 'req-85339086-be49-4ffa-bbd8-7c734c176901'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:55.430369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bbb0f-be1c-4eaa-a121-bfce45f6bca0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:55.439763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bbb0f-be1c-4eaa-a121-bfce45f6bca0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:55.444728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d1acc-c9f5-4e7e-a29b-fe060489d5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:55.445438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d1acc-c9f5-4e7e-a29b-fe060489d5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:55.445727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d1acc-c9f5-4e7e-a29b-fe060489d5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:55.446003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d1acc-c9f5-4e7e-a29b-fe060489d5e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:55.446726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d1acc-c9f5-4e7e-a29b-fe060489d5e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:38:55.447031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d1acc-c9f5-4e7e-a29b-fe060489d5e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:55.449613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d1acc-c9f5-4e7e-a29b-fe060489d5e2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:55.461494 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2787/5574] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:55.466279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d1acc-c9f5-4e7e-a29b-fe060489d5e2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:55.476390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d1acc-c9f5-4e7e-a29b-fe060489d5e2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:55.480743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fccca8-bf87-4435-a529-5ace340593f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:55.481383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fccca8-bf87-4435-a529-5ace340593f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:55.481666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fccca8-bf87-4435-a529-5ace340593f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:55.481943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fccca8-bf87-4435-a529-5ace340593f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:55.482629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fccca8-bf87-4435-a529-5ace340593f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:55.486017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fccca8-bf87-4435-a529-5ace340593f6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:55.524907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-85339086-be49-4ffa-bbd8-7c734c176901 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54426e17b0b04236831b5d10d24179d7', 'request_id': 'req-85339086-be49-4ffa-bbd8-7c734c176901'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:55.535333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-85339086-be49-4ffa-bbd8-7c734c176901 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] The token cache is being invalidate because project 54426e17b0b04236831b5d10d24179d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:55.535619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-85339086-be49-4ffa-bbd8-7c734c176901 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:55.536235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-85339086-be49-4ffa-bbd8-7c734c176901 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:55.537838 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2788/5575] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:55 2022] DELETE /identity/v3/projects/54426e17b0b04236831b5d10d24179d7 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:55.543521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85339086-be49-4ffa-bbd8-7c734c176901 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:55.545144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-85339086-be49-4ffa-bbd8-7c734c176901 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:55.610080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85339086-be49-4ffa-bbd8-7c734c176901 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:55.615344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366f878-a8c8-48fb-8960-c279508265ef tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:55.616023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366f878-a8c8-48fb-8960-c279508265ef tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:55.616318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366f878-a8c8-48fb-8960-c279508265ef tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:55.616706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366f878-a8c8-48fb-8960-c279508265ef tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:55.617404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366f878-a8c8-48fb-8960-c279508265ef tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:55.619490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366f878-a8c8-48fb-8960-c279508265ef tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:55.636585 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2788/5576] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:38:55 2022] POST /identity/v3/projects => generated 403 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:38:55.638031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fccca8-bf87-4435-a529-5ace340593f6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:55.639805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f8fccca8-bf87-4435-a529-5ace340593f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:55.701705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fccca8-bf87-4435-a529-5ace340593f6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:55.703387 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2789/5577] 10.222.0.16 () {60 vars in 1151 bytes} [Mon May 2 10:38:55 2022] POST /identity/v3/projects => generated 327 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:38:55.707349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366f878-a8c8-48fb-8960-c279508265ef tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:55.756883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a03e7e-8c88-4d69-9b24-8b324ca31bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:55.757601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03e7e-8c88-4d69-9b24-8b324ca31bda admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:55.758007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03e7e-8c88-4d69-9b24-8b324ca31bda admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:55.763023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03e7e-8c88-4d69-9b24-8b324ca31bda admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:55.763023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a03e7e-8c88-4d69-9b24-8b324ca31bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:55.763023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a03e7e-8c88-4d69-9b24-8b324ca31bda admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:55.769237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366f878-a8c8-48fb-8960-c279508265ef tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:55.773960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a790ce-bc2a-46f6-807d-8fa98aa450e2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:55.774630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a790ce-bc2a-46f6-807d-8fa98aa450e2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:55.774919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a790ce-bc2a-46f6-807d-8fa98aa450e2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:55.775199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a790ce-bc2a-46f6-807d-8fa98aa450e2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:55.775897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a790ce-bc2a-46f6-807d-8fa98aa450e2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:55.777848 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a790ce-bc2a-46f6-807d-8fa98aa450e2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:55.821717 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2789/5578] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:38:55 2022] POST /identity/v3/users => generated 302 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:38:55.826149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a03e7e-8c88-4d69-9b24-8b324ca31bda admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:55.835605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a03e7e-8c88-4d69-9b24-8b324ca31bda admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:55.840769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289722db-fd9f-4d36-9888-c9d99b6ba400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:55.841518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289722db-fd9f-4d36-9888-c9d99b6ba400 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:55.841746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289722db-fd9f-4d36-9888-c9d99b6ba400 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:55.842033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289722db-fd9f-4d36-9888-c9d99b6ba400 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:55.842819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289722db-fd9f-4d36-9888-c9d99b6ba400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:55.844473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289722db-fd9f-4d36-9888-c9d99b6ba400 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:55.846189 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2790/5579] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:38:55 2022] POST /identity/v3/users => generated 416 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:38:55.852176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a790ce-bc2a-46f6-807d-8fa98aa450e2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:55.857791 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2790/5580] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:38:55.858835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289722db-fd9f-4d36-9888-c9d99b6ba400 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:55.863525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a790ce-bc2a-46f6-807d-8fa98aa450e2 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:55.868313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806cf62-4aaf-47eb-994c-341b3915a27d tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:55.869011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806cf62-4aaf-47eb-994c-341b3915a27d tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:55.869151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289722db-fd9f-4d36-9888-c9d99b6ba400 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:55.869361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806cf62-4aaf-47eb-994c-341b3915a27d tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:55.869579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806cf62-4aaf-47eb-994c-341b3915a27d tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:55.870989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806cf62-4aaf-47eb-994c-341b3915a27d tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:55.872584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806cf62-4aaf-47eb-994c-341b3915a27d tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:55.877915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba99132-56b7-4a98-9292-ddb5c7f99a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:55.877915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba99132-56b7-4a98-9292-ddb5c7f99a90 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:55.877915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba99132-56b7-4a98-9292-ddb5c7f99a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:55.877915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba99132-56b7-4a98-9292-ddb5c7f99a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:55.878346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba99132-56b7-4a98-9292-ddb5c7f99a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:55.878447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba99132-56b7-4a98-9292-ddb5c7f99a90 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:55.888973 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2791/5581] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:38:55.893091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba99132-56b7-4a98-9292-ddb5c7f99a90 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:55.902583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba99132-56b7-4a98-9292-ddb5c7f99a90 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:55.907294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa074004-d571-4e38-ba44-33bec6505d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:55.908143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa074004-d571-4e38-ba44-33bec6505d10 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:55.908432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa074004-d571-4e38-ba44-33bec6505d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:55.908757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa074004-d571-4e38-ba44-33bec6505d10 admin admin] PATH_INFO: `/v3/projects/e060caaffb324f08b485555220606f10/users/e285595874384893b01ec8f993252767/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:55.923150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa074004-d571-4e38-ba44-33bec6505d10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e060caaffb324f08b485555220606f10, user_id=e285595874384893b01ec8f993252767, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:55.925934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa074004-d571-4e38-ba44-33bec6505d10 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:55.970955 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2791/5582] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:38:55 2022] POST /identity/v3/roles => generated 244 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:55.974824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806cf62-4aaf-47eb-994c-341b3915a27d tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:55.985600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806cf62-4aaf-47eb-994c-341b3915a27d tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:55.990408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a4316-bee2-4ea2-9332-c818ce705088 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:55.991084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a4316-bee2-4ea2-9332-c818ce705088 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:55.991374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a4316-bee2-4ea2-9332-c818ce705088 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:55.991659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a4316-bee2-4ea2-9332-c818ce705088 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:55.992387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a4316-bee2-4ea2-9332-c818ce705088 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:55.994170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a4316-bee2-4ea2-9332-c818ce705088 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:56.041008 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2792/5583] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:55 2022] PUT /identity/v3/projects/e060caaffb324f08b485555220606f10/users/e285595874384893b01ec8f993252767/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:56.046561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91f438-38e2-4e68-b2a7-ee4666fc52ac None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:56.046921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91f438-38e2-4e68-b2a7-ee4666fc52ac None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:56.047309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91f438-38e2-4e68-b2a7-ee4666fc52ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:56.066962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-7d91f438-38e2-4e68-b2a7-ee4666fc52ac None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:56.067306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7d91f438-38e2-4e68-b2a7-ee4666fc52ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:56.091016 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2792/5584] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:38:55 2022] POST /identity/v3/roles => generated 246 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:38:56.098918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a4316-bee2-4ea2-9332-c818ce705088 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:56.108508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a4316-bee2-4ea2-9332-c818ce705088 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:56.143451 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2793/5585] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:38:56.153247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91f438-38e2-4e68-b2a7-ee4666fc52ac None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:56.154729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7d91f438-38e2-4e68-b2a7-ee4666fc52ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:56.174660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf043dd-1032-4535-a2e8-aaa2e1f8dc2c tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:56.175664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf043dd-1032-4535-a2e8-aaa2e1f8dc2c tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:56.175953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf043dd-1032-4535-a2e8-aaa2e1f8dc2c tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:56.176235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf043dd-1032-4535-a2e8-aaa2e1f8dc2c tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects/39f0602475464ea3afefbb2da308288c/users/efaac0c61d2341c69963092b26375125/roles/a9f4059237154ec0a5a04a76ccc6a3b6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:56.192444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf043dd-1032-4535-a2e8-aaa2e1f8dc2c tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_grant(project_id=39f0602475464ea3afefbb2da308288c, user_id=efaac0c61d2341c69963092b26375125, role_id=a9f4059237154ec0a5a04a76ccc6a3b6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:56.195327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf043dd-1032-4535-a2e8-aaa2e1f8dc2c tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:56.215511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91f438-38e2-4e68-b2a7-ee4666fc52ac None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:56.219389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f39cc-8b51-4cbb-8b23-0a74e76b386f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:56.220470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f39cc-8b51-4cbb-8b23-0a74e76b386f service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:56.220470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f39cc-8b51-4cbb-8b23-0a74e76b386f service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:56.220748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f39cc-8b51-4cbb-8b23-0a74e76b386f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:56.230979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f39cc-8b51-4cbb-8b23-0a74e76b386f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:56.232482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f39cc-8b51-4cbb-8b23-0a74e76b386f service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:56.242556 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2794/5586] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:38:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:38:56.268439 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2793/5587] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:56 2022] PUT /identity/v3/projects/39f0602475464ea3afefbb2da308288c/users/efaac0c61d2341c69963092b26375125/roles/a9f4059237154ec0a5a04a76ccc6a3b6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:56.272682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f39cc-8b51-4cbb-8b23-0a74e76b386f service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:56.284403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f39cc-8b51-4cbb-8b23-0a74e76b386f service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:56.342077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc9766-4920-42a7-a9b6-26d59bfb2c68 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:56.343171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc9766-4920-42a7-a9b6-26d59bfb2c68 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:56.343593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc9766-4920-42a7-a9b6-26d59bfb2c68 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:56.344019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc9766-4920-42a7-a9b6-26d59bfb2c68 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects/39f0602475464ea3afefbb2da308288c/users/efaac0c61d2341c69963092b26375125/roles/4aeb28f60b8a4017892f1bbc52d18656` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:56.349364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc9766-4920-42a7-a9b6-26d59bfb2c68 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:create_grant(project_id=39f0602475464ea3afefbb2da308288c, user_id=efaac0c61d2341c69963092b26375125, role_id=4aeb28f60b8a4017892f1bbc52d18656)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:56.352429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc9766-4920-42a7-a9b6-26d59bfb2c68 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:56.443325 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2795/5588] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:56 2022] PUT /identity/v3/projects/39f0602475464ea3afefbb2da308288c/users/efaac0c61d2341c69963092b26375125/roles/4aeb28f60b8a4017892f1bbc52d18656 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:56.447546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf043dd-1032-4535-a2e8-aaa2e1f8dc2c tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:56.459500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf043dd-1032-4535-a2e8-aaa2e1f8dc2c tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:56.530965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f32e4-3fe8-4a65-b914-bcd6e8686f13 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:56.532311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f32e4-3fe8-4a65-b914-bcd6e8686f13 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:56.532858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f32e4-3fe8-4a65-b914-bcd6e8686f13 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:56.533354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f32e4-3fe8-4a65-b914-bcd6e8686f13 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:56.536827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f32e4-3fe8-4a65-b914-bcd6e8686f13 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:56.536827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f32e4-3fe8-4a65-b914-bcd6e8686f13 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:56.574346 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2794/5589] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:56 2022] GET /identity/v3/users => generated 8651 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:38:56.579507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876bbce-7abb-4edf-a164-e96366d6a94a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:56.580189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876bbce-7abb-4edf-a164-e96366d6a94a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:56.580189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876bbce-7abb-4edf-a164-e96366d6a94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:56.624629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1876bbce-7abb-4edf-a164-e96366d6a94a None None] MFA Rules not processed for user `efaac0c61d2341c69963092b26375125`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:56.626316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1876bbce-7abb-4edf-a164-e96366d6a94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:56.703009 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2796/5590] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:38:56.712947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4230c36-9257-471a-95ed-2b7aaa52f7f9 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:56.713263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4230c36-9257-471a-95ed-2b7aaa52f7f9 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:56.713561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4230c36-9257-471a-95ed-2b7aaa52f7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:56.734882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f4230c36-9257-471a-95ed-2b7aaa52f7f9 None None] MFA Rules not processed for user `efaac0c61d2341c69963092b26375125`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:56.736233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f4230c36-9257-471a-95ed-2b7aaa52f7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:56.764546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876bbce-7abb-4edf-a164-e96366d6a94a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:56.764935 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2795/5591] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:38:56.777540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876bbce-7abb-4edf-a164-e96366d6a94a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:56.782620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb25ff6-ea36-4132-af17-6f81ae861627 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efaac0c61d2341c69963092b26375125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f0602475464ea3afefbb2da308288c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1508978731', 'tempest-NotDelegatedRole-699834328'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:56.783277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb25ff6-ea36-4132-af17-6f81ae861627 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:56.783664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb25ff6-ea36-4132-af17-6f81ae861627 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:56.784643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb25ff6-ea36-4132-af17-6f81ae861627 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:56.785145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb25ff6-ea36-4132-af17-6f81ae861627 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: Authorizing `identity:create_trust()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:56.786369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb25ff6-ea36-4132-af17-6f81ae861627 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:56.957929 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2797/5592] 10.222.0.16 () {60 vars in 1173 bytes} [Mon May 2 10:38:56 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:56.959053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4230c36-9257-471a-95ed-2b7aaa52f7f9 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:56.967716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4230c36-9257-471a-95ed-2b7aaa52f7f9 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:56.988324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e9ed0-423e-4abc-917d-d35e4087d6d5 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efaac0c61d2341c69963092b26375125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f0602475464ea3afefbb2da308288c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1508978731', 'tempest-NotDelegatedRole-699834328'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:56.989598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e9ed0-423e-4abc-917d-d35e4087d6d5 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:56.990060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e9ed0-423e-4abc-917d-d35e4087d6d5 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:56.990515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e9ed0-423e-4abc-917d-d35e4087d6d5 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] PATH_INFO: `/v3/OS-TRUST/trusts/7a6a0a027a184fc5937642f6d81cf9e3` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:56.997542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e9ed0-423e-4abc-917d-d35e4087d6d5 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: Authorizing `identity:get_trust(trust_id=7a6a0a027a184fc5937642f6d81cf9e3)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:57.003726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e9ed0-423e-4abc-917d-d35e4087d6d5 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:57.007348 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2796/5593] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 2 10:38:56 2022] GET /identity/v3/OS-TRUST/trusts/7a6a0a027a184fc5937642f6d81cf9e3 => generated 835 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:57.011665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb25ff6-ea36-4132-af17-6f81ae861627 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:57.021166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb25ff6-ea36-4132-af17-6f81ae861627 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:57.026942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81b136-46bb-423b-90ad-d188e33ad89c tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efaac0c61d2341c69963092b26375125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f0602475464ea3afefbb2da308288c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1508978731', 'tempest-NotDelegatedRole-699834328'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:57.030168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81b136-46bb-423b-90ad-d188e33ad89c tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:57.030168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81b136-46bb-423b-90ad-d188e33ad89c tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:57.030168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81b136-46bb-423b-90ad-d188e33ad89c tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] PATH_INFO: `/v3/OS-TRUST/trusts/7a6a0a027a184fc5937642f6d81cf9e3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:57.034958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81b136-46bb-423b-90ad-d188e33ad89c tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=7a6a0a027a184fc5937642f6d81cf9e3)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:57.036417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81b136-46bb-423b-90ad-d188e33ad89c tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:57.044329 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2798/5594] 10.222.0.16 () {58 vars in 1268 bytes} [Mon May 2 10:38:57 2022] GET /identity/v3/OS-TRUST/trusts/7a6a0a027a184fc5937642f6d81cf9e3/roles => generated 371 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:57.048568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e9ed0-423e-4abc-917d-d35e4087d6d5 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:57.058234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e9ed0-423e-4abc-917d-d35e4087d6d5 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:57.063184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2abfa-967b-4e0e-a03a-271813074778 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efaac0c61d2341c69963092b26375125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f0602475464ea3afefbb2da308288c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1508978731', 'tempest-NotDelegatedRole-699834328'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:57.064493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2abfa-967b-4e0e-a03a-271813074778 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:57.064493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2abfa-967b-4e0e-a03a-271813074778 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:57.064728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2abfa-967b-4e0e-a03a-271813074778 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] PATH_INFO: `/v3/OS-TRUST/trusts/7a6a0a027a184fc5937642f6d81cf9e3/roles/a9f4059237154ec0a5a04a76ccc6a3b6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:57.070718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2abfa-967b-4e0e-a03a-271813074778 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7a6a0a027a184fc5937642f6d81cf9e3, role_id=a9f4059237154ec0a5a04a76ccc6a3b6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:57.072234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2abfa-967b-4e0e-a03a-271813074778 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:57.081960 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2797/5595] 10.222.0.16 () {58 vars in 1367 bytes} [Mon May 2 10:38:57 2022] GET /identity/v3/OS-TRUST/trusts/7a6a0a027a184fc5937642f6d81cf9e3/roles/a9f4059237154ec0a5a04a76ccc6a3b6 => generated 244 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:57.083111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81b136-46bb-423b-90ad-d188e33ad89c tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:57.093841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81b136-46bb-423b-90ad-d188e33ad89c tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:57.102000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62934ae5-f123-4af7-ae45-088766e8009e tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efaac0c61d2341c69963092b26375125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f0602475464ea3afefbb2da308288c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1508978731', 'tempest-NotDelegatedRole-699834328'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:57.105019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62934ae5-f123-4af7-ae45-088766e8009e tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] REQUEST_METHOD: `HEAD` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:57.105420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62934ae5-f123-4af7-ae45-088766e8009e tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:57.105824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62934ae5-f123-4af7-ae45-088766e8009e tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] PATH_INFO: `/v3/OS-TRUST/trusts/7a6a0a027a184fc5937642f6d81cf9e3/roles/a9f4059237154ec0a5a04a76ccc6a3b6` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:57.112801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62934ae5-f123-4af7-ae45-088766e8009e tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7a6a0a027a184fc5937642f6d81cf9e3, role_id=a9f4059237154ec0a5a04a76ccc6a3b6)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:57.116713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62934ae5-f123-4af7-ae45-088766e8009e tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:57.122208 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2799/5596] 10.222.0.16 () {58 vars in 1368 bytes} [Mon May 2 10:38:57 2022] HEAD /identity/v3/OS-TRUST/trusts/7a6a0a027a184fc5937642f6d81cf9e3/roles/a9f4059237154ec0a5a04a76ccc6a3b6 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:38:57.126489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2abfa-967b-4e0e-a03a-271813074778 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:57.137552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2abfa-967b-4e0e-a03a-271813074778 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:57.142044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b5747-3e3e-4d57-a91b-a3691fac5a8d tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efaac0c61d2341c69963092b26375125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f0602475464ea3afefbb2da308288c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1508978731', 'tempest-NotDelegatedRole-699834328'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:57.142981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b5747-3e3e-4d57-a91b-a3691fac5a8d tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:57.143409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b5747-3e3e-4d57-a91b-a3691fac5a8d tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:57.143947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b5747-3e3e-4d57-a91b-a3691fac5a8d tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] PATH_INFO: `/v3/OS-TRUST/trusts/7a6a0a027a184fc5937642f6d81cf9e3/roles/4aeb28f60b8a4017892f1bbc52d18656` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:57.150707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b5747-3e3e-4d57-a91b-a3691fac5a8d tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7a6a0a027a184fc5937642f6d81cf9e3, role_id=4aeb28f60b8a4017892f1bbc52d18656)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:57.152198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b5747-3e3e-4d57-a91b-a3691fac5a8d tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:57.166576 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-528b5747-3e3e-4d57-a91b-a3691fac5a8d tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Could not find role: 4aeb28f60b8a4017892f1bbc52d18656.: keystone.exception.RoleNotFound: Could not find role: 4aeb28f60b8a4017892f1bbc52d18656. May 02 10:38:57.166576 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:38:57.166576 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:38:57.166576 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:38:57.166576 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:38:57.166576 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:38:57.166576 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:38:57.166576 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:38:57.166576 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:38:57.166576 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:38:57.166576 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:38:57.166576 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:38:57.166576 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get May 02 10:38:57.166576 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 10:38:57.167899 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 4aeb28f60b8a4017892f1bbc52d18656. May 02 10:38:57.167899 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:38:57.168076 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2798/5597] 10.222.0.16 () {58 vars in 1367 bytes} [Mon May 2 10:38:57 2022] GET /identity/v3/OS-TRUST/trusts/7a6a0a027a184fc5937642f6d81cf9e3/roles/4aeb28f60b8a4017892f1bbc52d18656 => generated 110 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:38:57.172148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62934ae5-f123-4af7-ae45-088766e8009e tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:57.185215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62934ae5-f123-4af7-ae45-088766e8009e tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:57.186059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ad844-a352-405a-8a2a-d719fcd86a70 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efaac0c61d2341c69963092b26375125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f0602475464ea3afefbb2da308288c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1508978731', 'tempest-NotDelegatedRole-699834328'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:57.186865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ad844-a352-405a-8a2a-d719fcd86a70 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] REQUEST_METHOD: `HEAD` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:57.187146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ad844-a352-405a-8a2a-d719fcd86a70 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:57.187447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ad844-a352-405a-8a2a-d719fcd86a70 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] PATH_INFO: `/v3/OS-TRUST/trusts/7a6a0a027a184fc5937642f6d81cf9e3/roles/4aeb28f60b8a4017892f1bbc52d18656` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:57.193101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ad844-a352-405a-8a2a-d719fcd86a70 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7a6a0a027a184fc5937642f6d81cf9e3, role_id=4aeb28f60b8a4017892f1bbc52d18656)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:57.194536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ad844-a352-405a-8a2a-d719fcd86a70 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:57.209013 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-325ad844-a352-405a-8a2a-d719fcd86a70 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Could not find role: 4aeb28f60b8a4017892f1bbc52d18656.: keystone.exception.RoleNotFound: Could not find role: 4aeb28f60b8a4017892f1bbc52d18656. May 02 10:38:57.209013 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:38:57.209013 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:38:57.209013 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:38:57.209013 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:38:57.209013 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:38:57.209013 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:38:57.209013 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:38:57.209013 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:38:57.209013 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:38:57.209013 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:38:57.209013 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:38:57.209013 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get May 02 10:38:57.209013 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 02 10:38:57.210321 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 4aeb28f60b8a4017892f1bbc52d18656. May 02 10:38:57.210321 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:38:57.210321 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2800/5598] 10.222.0.16 () {58 vars in 1368 bytes} [Mon May 2 10:38:57 2022] HEAD /identity/v3/OS-TRUST/trusts/7a6a0a027a184fc5937642f6d81cf9e3/roles/4aeb28f60b8a4017892f1bbc52d18656 => generated 0 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) May 02 10:38:57.214272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b5747-3e3e-4d57-a91b-a3691fac5a8d tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:57.223635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b5747-3e3e-4d57-a91b-a3691fac5a8d tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:57.228640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715c953-3ac5-449a-8345-3c09792e525b tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efaac0c61d2341c69963092b26375125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f0602475464ea3afefbb2da308288c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1508978731', 'tempest-NotDelegatedRole-699834328'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:57.230354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715c953-3ac5-449a-8345-3c09792e525b tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:57.230354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715c953-3ac5-449a-8345-3c09792e525b tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:57.230354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715c953-3ac5-449a-8345-3c09792e525b tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] PATH_INFO: `/v3/OS-TRUST/trusts/7a6a0a027a184fc5937642f6d81cf9e3` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:57.236222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715c953-3ac5-449a-8345-3c09792e525b tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: Authorizing `identity:delete_trust(trust_id=7a6a0a027a184fc5937642f6d81cf9e3)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:57.237711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715c953-3ac5-449a-8345-3c09792e525b tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:57.335936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8715c953-3ac5-449a-8345-3c09792e525b tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7a6a0a027a184fc5937642f6d81cf9e3', 'request_id': 'req-8715c953-3ac5-449a-8345-3c09792e525b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:57.337143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8715c953-3ac5-449a-8345-3c09792e525b tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '7a6a0a027a184fc5937642f6d81cf9e3', 'request_id': 'req-8715c953-3ac5-449a-8345-3c09792e525b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:57.418814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8715c953-3ac5-449a-8345-3c09792e525b tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7a6a0a027a184fc5937642f6d81cf9e3', 'request_id': 'req-8715c953-3ac5-449a-8345-3c09792e525b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:57.426740 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2799/5599] 10.222.0.16 () {58 vars in 1253 bytes} [Mon May 2 10:38:57 2022] DELETE /identity/v3/OS-TRUST/trusts/7a6a0a027a184fc5937642f6d81cf9e3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:57.430876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ad844-a352-405a-8a2a-d719fcd86a70 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:57.435018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-325ad844-a352-405a-8a2a-d719fcd86a70 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:57.448220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ad844-a352-405a-8a2a-d719fcd86a70 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:57.458948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ca954-452a-402a-8687-3285cb7aec41 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efaac0c61d2341c69963092b26375125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f0602475464ea3afefbb2da308288c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1508978731', 'tempest-NotDelegatedRole-699834328'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:57.458948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ca954-452a-402a-8687-3285cb7aec41 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:57.458948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ca954-452a-402a-8687-3285cb7aec41 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:57.459321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ca954-452a-402a-8687-3285cb7aec41 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] PATH_INFO: `/v3/OS-TRUST/trusts/7a6a0a027a184fc5937642f6d81cf9e3` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:57.466348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-485ca954-452a-402a-8687-3285cb7aec41 tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Could not find trust: 7a6a0a027a184fc5937642f6d81cf9e3.: keystone.exception.TrustNotFound: Could not find trust: 7a6a0a027a184fc5937642f6d81cf9e3. May 02 10:38:57.466348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:38:57.466348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:38:57.466348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:38:57.466348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:38:57.466348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:38:57.466348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:38:57.466348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:38:57.466348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:38:57.466348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:38:57.466348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:38:57.466348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:38:57.466348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get May 02 10:38:57.466348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) May 02 10:38:57.466348 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust May 02 10:38:57.467669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', May 02 10:38:57.467669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call May 02 10:38:57.467669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() May 02 10:38:57.467669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement May 02 10:38:57.467669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( May 02 10:38:57.467669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:38:57.467669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:38:57.467669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust May 02 10:38:57.467669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) May 02 10:38:57.467669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust May 02 10:38:57.467669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) May 02 10:38:57.467669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 7a6a0a027a184fc5937642f6d81cf9e3. May 02 10:38:57.467669 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:38:57.468801 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2801/5600] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 2 10:38:57 2022] GET /identity/v3/OS-TRUST/trusts/7a6a0a027a184fc5937642f6d81cf9e3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:38:57.471775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715c953-3ac5-449a-8345-3c09792e525b tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:57.473360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8715c953-3ac5-449a-8345-3c09792e525b tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:57.490129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715c953-3ac5-449a-8345-3c09792e525b tempest-TrustsV3TestJSON-48143575 tempest-user-1957935348] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:57.494725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d8095-d2bf-4e91-82f4-d5a98f862f2c tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:57.496285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d8095-d2bf-4e91-82f4-d5a98f862f2c tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:57.496569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d8095-d2bf-4e91-82f4-d5a98f862f2c tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:57.496882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d8095-d2bf-4e91-82f4-d5a98f862f2c tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles/4aeb28f60b8a4017892f1bbc52d18656` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:57.498385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d8095-d2bf-4e91-82f4-d5a98f862f2c tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4aeb28f60b8a4017892f1bbc52d18656)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:57.500017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d8095-d2bf-4e91-82f4-d5a98f862f2c tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:57.629927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0c46c-9157-46b8-9819-14e9ce0c5a68 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:57.630462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0c46c-9157-46b8-9819-14e9ce0c5a68 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:57.630658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0c46c-9157-46b8-9819-14e9ce0c5a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:57.662067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-81c0c46c-9157-46b8-9819-14e9ce0c5a68 None None] MFA Rules not processed for user `e285595874384893b01ec8f993252767`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:57.663447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-81c0c46c-9157-46b8-9819-14e9ce0c5a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:57.706542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-960d8095-d2bf-4e91-82f4-d5a98f862f2c tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invalidating the token cache because role 4aeb28f60b8a4017892f1bbc52d18656 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:57.706542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-960d8095-d2bf-4e91-82f4-d5a98f862f2c tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:57.706542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-960d8095-d2bf-4e91-82f4-d5a98f862f2c tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:57.708648 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2800/5601] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:57 2022] DELETE /identity/v3/roles/4aeb28f60b8a4017892f1bbc52d18656 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:57.712498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d8095-d2bf-4e91-82f4-d5a98f862f2c tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:57.714530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-960d8095-d2bf-4e91-82f4-d5a98f862f2c tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:57.758211 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2802/5602] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:38:57.763003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0c46c-9157-46b8-9819-14e9ce0c5a68 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:57.764543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-81c0c46c-9157-46b8-9819-14e9ce0c5a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:57.794630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d8095-d2bf-4e91-82f4-d5a98f862f2c tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:57.800093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1eb87-b433-43a0-9b9f-c4c56c4a90d9 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:57.801134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1eb87-b433-43a0-9b9f-c4c56c4a90d9 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:57.801491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1eb87-b433-43a0-9b9f-c4c56c4a90d9 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:57.801834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1eb87-b433-43a0-9b9f-c4c56c4a90d9 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/roles/a9f4059237154ec0a5a04a76ccc6a3b6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:57.804315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1eb87-b433-43a0-9b9f-c4c56c4a90d9 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a9f4059237154ec0a5a04a76ccc6a3b6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:57.805464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1eb87-b433-43a0-9b9f-c4c56c4a90d9 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:57.851316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0c46c-9157-46b8-9819-14e9ce0c5a68 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:57.915997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a48ea-d7c4-47bd-a8fb-a13bf54a25ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:57.916709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a48ea-d7c4-47bd-a8fb-a13bf54a25ea admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:57.917787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a48ea-d7c4-47bd-a8fb-a13bf54a25ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:57.917924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a48ea-d7c4-47bd-a8fb-a13bf54a25ea admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:57.918490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a48ea-d7c4-47bd-a8fb-a13bf54a25ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:57.920360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a48ea-d7c4-47bd-a8fb-a13bf54a25ea admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:58.075299 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2803/5603] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:38:57 2022] POST /identity/v3/projects => generated 405 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:58.079317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a48ea-d7c4-47bd-a8fb-a13bf54a25ea admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:58.125587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-04a1eb87-b433-43a0-9b9f-c4c56c4a90d9 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invalidating the token cache because role a9f4059237154ec0a5a04a76ccc6a3b6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:58.126390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-04a1eb87-b433-43a0-9b9f-c4c56c4a90d9 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:58.127605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-04a1eb87-b433-43a0-9b9f-c4c56c4a90d9 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:58.130575 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2801/5604] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:57 2022] DELETE /identity/v3/roles/a9f4059237154ec0a5a04a76ccc6a3b6 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:58.134620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1eb87-b433-43a0-9b9f-c4c56c4a90d9 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:58.139194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-04a1eb87-b433-43a0-9b9f-c4c56c4a90d9 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:58.144948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a48ea-d7c4-47bd-a8fb-a13bf54a25ea admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:58.208433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02801918-6362-474f-a534-43653290f6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:58.209199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02801918-6362-474f-a534-43653290f6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:58.214371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02801918-6362-474f-a534-43653290f6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:58.214371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02801918-6362-474f-a534-43653290f6b7 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:58.214371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02801918-6362-474f-a534-43653290f6b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:58.214371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02801918-6362-474f-a534-43653290f6b7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:58.220041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1eb87-b433-43a0-9b9f-c4c56c4a90d9 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:58.225130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abeb38-eb52-4c16-ac38-31f8ba553745 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:58.226165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abeb38-eb52-4c16-ac38-31f8ba553745 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:58.226291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abeb38-eb52-4c16-ac38-31f8ba553745 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:58.226552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abeb38-eb52-4c16-ac38-31f8ba553745 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/users/efaac0c61d2341c69963092b26375125` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:58.227761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abeb38-eb52-4c16-ac38-31f8ba553745 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_user(user_id=efaac0c61d2341c69963092b26375125)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:58.229996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abeb38-eb52-4c16-ac38-31f8ba553745 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:58.331701 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2804/5605] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:38:58 2022] POST /identity/v3/users => generated 309 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:38:58.335485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02801918-6362-474f-a534-43653290f6b7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:58.337143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-02801918-6362-474f-a534-43653290f6b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:58.349948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02801918-6362-474f-a534-43653290f6b7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:58.354647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c4197-9cfc-4301-b5b8-b1ba40854e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:58.355294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c4197-9cfc-4301-b5b8-b1ba40854e2a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:58.355578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c4197-9cfc-4301-b5b8-b1ba40854e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:58.355856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c4197-9cfc-4301-b5b8-b1ba40854e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:58.356570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c4197-9cfc-4301-b5b8-b1ba40854e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:58.358769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c4197-9cfc-4301-b5b8-b1ba40854e2a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:58.368950 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2805/5606] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:38:58.378554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6abeb38-eb52-4c16-ac38-31f8ba553745 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efaac0c61d2341c69963092b26375125'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:58.378907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c4197-9cfc-4301-b5b8-b1ba40854e2a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:58.389305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c4197-9cfc-4301-b5b8-b1ba40854e2a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:58.390723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6abeb38-eb52-4c16-ac38-31f8ba553745 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efaac0c61d2341c69963092b26375125'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:58.391475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6abeb38-eb52-4c16-ac38-31f8ba553745 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efaac0c61d2341c69963092b26375125'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:58.394286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7eacc-53d1-4ef2-b08e-6c6495ef77dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:58.395253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7eacc-53d1-4ef2-b08e-6c6495ef77dc admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:58.395625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7eacc-53d1-4ef2-b08e-6c6495ef77dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:58.395968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7eacc-53d1-4ef2-b08e-6c6495ef77dc admin admin] PATH_INFO: `/v3/projects/26b971880530401f8bed1bae07ffeed4/users/e64408b8611b42b78618b12b673652ae/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:58.398520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6abeb38-eb52-4c16-ac38-31f8ba553745 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efaac0c61d2341c69963092b26375125'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:58.411020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7eacc-53d1-4ef2-b08e-6c6495ef77dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b971880530401f8bed1bae07ffeed4, user_id=e64408b8611b42b78618b12b673652ae, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:58.413713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7eacc-53d1-4ef2-b08e-6c6495ef77dc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:58.478760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d6abeb38-eb52-4c16-ac38-31f8ba553745 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efaac0c61d2341c69963092b26375125'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:58.491189 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2802/5607] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:58 2022] DELETE /identity/v3/users/efaac0c61d2341c69963092b26375125 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:58.493743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abeb38-eb52-4c16-ac38-31f8ba553745 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:58.495697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d6abeb38-eb52-4c16-ac38-31f8ba553745 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:58.535780 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2806/5608] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:58 2022] PUT /identity/v3/projects/26b971880530401f8bed1bae07ffeed4/users/e64408b8611b42b78618b12b673652ae/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:58.539824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7eacc-53d1-4ef2-b08e-6c6495ef77dc admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:58.541501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a7e7eacc-53d1-4ef2-b08e-6c6495ef77dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:58.564482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abeb38-eb52-4c16-ac38-31f8ba553745 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:58.610392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7eacc-53d1-4ef2-b08e-6c6495ef77dc admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:58.617981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ca515-2e53-4489-baa1-44a57c9e0494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:58.622313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ca515-2e53-4489-baa1-44a57c9e0494 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:58.622313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ca515-2e53-4489-baa1-44a57c9e0494 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:58.622313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ca515-2e53-4489-baa1-44a57c9e0494 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:58.622313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ca515-2e53-4489-baa1-44a57c9e0494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:58.622943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ca515-2e53-4489-baa1-44a57c9e0494 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:58.623883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c360a-5418-4df9-96d6-ec191ae8ab38 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '219abee2f66141b1a8f57d2f4c3ee789', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d77e597d57e47e08182448baae93696', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:58.624719 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c360a-5418-4df9-96d6-ec191ae8ab38 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:58.625028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c360a-5418-4df9-96d6-ec191ae8ab38 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:58.625393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c360a-5418-4df9-96d6-ec191ae8ab38 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] PATH_INFO: `/v3/projects/39f0602475464ea3afefbb2da308288c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:58.626739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c360a-5418-4df9-96d6-ec191ae8ab38 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorizing `identity:delete_project(project_id=39f0602475464ea3afefbb2da308288c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:58.628722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c360a-5418-4df9-96d6-ec191ae8ab38 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:58.633632 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2807/5609] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:38:58.638562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ca515-2e53-4489-baa1-44a57c9e0494 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:58.649659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ca515-2e53-4489-baa1-44a57c9e0494 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:58.654498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c099ee-9d3b-4cdc-b719-873591a662d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:58.655417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c099ee-9d3b-4cdc-b719-873591a662d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:58.655698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c099ee-9d3b-4cdc-b719-873591a662d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:58.655971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c099ee-9d3b-4cdc-b719-873591a662d8 admin admin] PATH_INFO: `/v3/projects/26b971880530401f8bed1bae07ffeed4/users/e64408b8611b42b78618b12b673652ae/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:58.658074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c099ee-9d3b-4cdc-b719-873591a662d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b971880530401f8bed1bae07ffeed4, user_id=e64408b8611b42b78618b12b673652ae, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:58.662856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c099ee-9d3b-4cdc-b719-873591a662d8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:58.677276 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2808/5610] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:38:58 2022] PUT /identity/v3/projects/26b971880530401f8bed1bae07ffeed4/users/e64408b8611b42b78618b12b673652ae/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:38:58.796293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e81c360a-5418-4df9-96d6-ec191ae8ab38 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f0602475464ea3afefbb2da308288c', 'request_id': 'req-e81c360a-5418-4df9-96d6-ec191ae8ab38'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:58.803445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e81c360a-5418-4df9-96d6-ec191ae8ab38 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f0602475464ea3afefbb2da308288c', 'request_id': 'req-e81c360a-5418-4df9-96d6-ec191ae8ab38'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:58.928786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e81c360a-5418-4df9-96d6-ec191ae8ab38 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f0602475464ea3afefbb2da308288c', 'request_id': 'req-e81c360a-5418-4df9-96d6-ec191ae8ab38'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:58.940578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e81c360a-5418-4df9-96d6-ec191ae8ab38 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] The token cache is being invalidate because project 39f0602475464ea3afefbb2da308288c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:38:58.940904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e81c360a-5418-4df9-96d6-ec191ae8ab38 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:58.941610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e81c360a-5418-4df9-96d6-ec191ae8ab38 tempest-TrustsV3TestJSON-454649476 tempest-TrustsV3TestJSON-454649476-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:58.943774 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2803/5611] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:38:58 2022] DELETE /identity/v3/projects/39f0602475464ea3afefbb2da308288c => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:58.949658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c099ee-9d3b-4cdc-b719-873591a662d8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:58.953279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-70c099ee-9d3b-4cdc-b719-873591a662d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:59.023967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c099ee-9d3b-4cdc-b719-873591a662d8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:59.083051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938cbf5-694d-469e-869d-5036fbc1bfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:59.083895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938cbf5-694d-469e-869d-5036fbc1bfad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:59.084183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938cbf5-694d-469e-869d-5036fbc1bfad admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:59.084465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938cbf5-694d-469e-869d-5036fbc1bfad admin admin] PATH_INFO: `/v3/users/a2f248dec25d4fea8a49e6df62a22346` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:59.085704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938cbf5-694d-469e-869d-5036fbc1bfad admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2f248dec25d4fea8a49e6df62a22346)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:59.087623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938cbf5-694d-469e-869d-5036fbc1bfad admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:59.314682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9938cbf5-694d-469e-869d-5036fbc1bfad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2f248dec25d4fea8a49e6df62a22346'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:59.330151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9938cbf5-694d-469e-869d-5036fbc1bfad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2f248dec25d4fea8a49e6df62a22346'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:59.334600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9938cbf5-694d-469e-869d-5036fbc1bfad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2f248dec25d4fea8a49e6df62a22346'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:59.340154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9938cbf5-694d-469e-869d-5036fbc1bfad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2f248dec25d4fea8a49e6df62a22346'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:59.433139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9938cbf5-694d-469e-869d-5036fbc1bfad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2f248dec25d4fea8a49e6df62a22346'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:38:59.439800 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2809/5612] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:38:58 2022] DELETE /identity/v3/users/a2f248dec25d4fea8a49e6df62a22346 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:38:59.445166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c7738-3969-4ef3-a5c8-5c7d0fc0eaae None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:59.445567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c7738-3969-4ef3-a5c8-5c7d0fc0eaae None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:59.445944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c7738-3969-4ef3-a5c8-5c7d0fc0eaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:59.467511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4b1c7738-3969-4ef3-a5c8-5c7d0fc0eaae None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:38:59.468911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4b1c7738-3969-4ef3-a5c8-5c7d0fc0eaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:59.541563 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2804/5613] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:38:59.556397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938cbf5-694d-469e-869d-5036fbc1bfad admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:38:59.558225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9938cbf5-694d-469e-869d-5036fbc1bfad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:38:59.625084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938cbf5-694d-469e-869d-5036fbc1bfad admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:38:59.629215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2e258-fb38-47de-bf5b-eb614e8ad5bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:38:59.629959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2e258-fb38-47de-bf5b-eb614e8ad5bb service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:38:59.630252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2e258-fb38-47de-bf5b-eb614e8ad5bb service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:38:59.630535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2e258-fb38-47de-bf5b-eb614e8ad5bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:38:59.640972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2e258-fb38-47de-bf5b-eb614e8ad5bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:38:59.642514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2e258-fb38-47de-bf5b-eb614e8ad5bb service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:38:59.653109 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2810/5614] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:39:00.327404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c7738-3969-4ef3-a5c8-5c7d0fc0eaae None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:00.329088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4b1c7738-3969-4ef3-a5c8-5c7d0fc0eaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:00.346117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c7738-3969-4ef3-a5c8-5c7d0fc0eaae None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:00.350569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cae16a-fa29-42cc-9d1a-be8369b6e199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:00.351564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cae16a-fa29-42cc-9d1a-be8369b6e199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:00.351864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cae16a-fa29-42cc-9d1a-be8369b6e199 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:00.352146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cae16a-fa29-42cc-9d1a-be8369b6e199 admin admin] PATH_INFO: `/v3/projects/f60f33285618445b94dc15469fe8226c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:00.353997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cae16a-fa29-42cc-9d1a-be8369b6e199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60f33285618445b94dc15469fe8226c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:00.356423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cae16a-fa29-42cc-9d1a-be8369b6e199 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:00.534484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-00cae16a-fa29-42cc-9d1a-be8369b6e199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60f33285618445b94dc15469fe8226c', 'request_id': 'req-00cae16a-fa29-42cc-9d1a-be8369b6e199'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:00.541222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-00cae16a-fa29-42cc-9d1a-be8369b6e199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60f33285618445b94dc15469fe8226c', 'request_id': 'req-00cae16a-fa29-42cc-9d1a-be8369b6e199'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:00.599905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925b40b-2f37-46b4-9636-6edf5fd7c562 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:00.604792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925b40b-2f37-46b4-9636-6edf5fd7c562 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:00.604792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925b40b-2f37-46b4-9636-6edf5fd7c562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:00.630858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-5925b40b-2f37-46b4-9636-6edf5fd7c562 None None] MFA Rules not processed for user `e64408b8611b42b78618b12b673652ae`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:00.632153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5925b40b-2f37-46b4-9636-6edf5fd7c562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:00.672056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-00cae16a-fa29-42cc-9d1a-be8369b6e199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60f33285618445b94dc15469fe8226c', 'request_id': 'req-00cae16a-fa29-42cc-9d1a-be8369b6e199'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:00.684164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-00cae16a-fa29-42cc-9d1a-be8369b6e199 admin admin] The token cache is being invalidate because project f60f33285618445b94dc15469fe8226c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:39:00.684500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-00cae16a-fa29-42cc-9d1a-be8369b6e199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:00.685166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-00cae16a-fa29-42cc-9d1a-be8369b6e199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:00.687015 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2805/5615] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:39:00 2022] DELETE /identity/v3/projects/f60f33285618445b94dc15469fe8226c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:00.690813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cae16a-fa29-42cc-9d1a-be8369b6e199 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:00.692233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-00cae16a-fa29-42cc-9d1a-be8369b6e199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:00.706005 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2811/5616] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:00 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:00.792329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cae16a-fa29-42cc-9d1a-be8369b6e199 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:00.797423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e122b-e2f2-4a80-8634-136576e98eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:00.798322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e122b-e2f2-4a80-8634-136576e98eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:00.798621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e122b-e2f2-4a80-8634-136576e98eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:00.798889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e122b-e2f2-4a80-8634-136576e98eb0 admin admin] PATH_INFO: `/v3/users/219abee2f66141b1a8f57d2f4c3ee789` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:00.800294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e122b-e2f2-4a80-8634-136576e98eb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=219abee2f66141b1a8f57d2f4c3ee789)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:00.802893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e122b-e2f2-4a80-8634-136576e98eb0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:01.063219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-652e122b-e2f2-4a80-8634-136576e98eb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '219abee2f66141b1a8f57d2f4c3ee789'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:01.074738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-652e122b-e2f2-4a80-8634-136576e98eb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '219abee2f66141b1a8f57d2f4c3ee789'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:01.079154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-652e122b-e2f2-4a80-8634-136576e98eb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '219abee2f66141b1a8f57d2f4c3ee789'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:01.082602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-652e122b-e2f2-4a80-8634-136576e98eb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '219abee2f66141b1a8f57d2f4c3ee789'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:01.249851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-652e122b-e2f2-4a80-8634-136576e98eb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '219abee2f66141b1a8f57d2f4c3ee789'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:01.256683 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2806/5617] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:39:00 2022] DELETE /identity/v3/users/219abee2f66141b1a8f57d2f4c3ee789 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:39:01.757207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925b40b-2f37-46b4-9636-6edf5fd7c562 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:01.780172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925b40b-2f37-46b4-9636-6edf5fd7c562 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:01.849537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5252a7-4b21-4d7c-9131-fd4b23d4d3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:01.850712 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5252a7-4b21-4d7c-9131-fd4b23d4d3bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:01.851188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5252a7-4b21-4d7c-9131-fd4b23d4d3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:01.851718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5252a7-4b21-4d7c-9131-fd4b23d4d3bf admin admin] PATH_INFO: `/v3/projects/7d77e597d57e47e08182448baae93696` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:01.853614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5252a7-4b21-4d7c-9131-fd4b23d4d3bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d77e597d57e47e08182448baae93696)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:01.856840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5252a7-4b21-4d7c-9131-fd4b23d4d3bf admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:02.018009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8a5252a7-4b21-4d7c-9131-fd4b23d4d3bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d77e597d57e47e08182448baae93696', 'request_id': 'req-8a5252a7-4b21-4d7c-9131-fd4b23d4d3bf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:02.102072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8a5252a7-4b21-4d7c-9131-fd4b23d4d3bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d77e597d57e47e08182448baae93696', 'request_id': 'req-8a5252a7-4b21-4d7c-9131-fd4b23d4d3bf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:02.112281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8a5252a7-4b21-4d7c-9131-fd4b23d4d3bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d77e597d57e47e08182448baae93696', 'request_id': 'req-8a5252a7-4b21-4d7c-9131-fd4b23d4d3bf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:02.123648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8a5252a7-4b21-4d7c-9131-fd4b23d4d3bf admin admin] The token cache is being invalidate because project 7d77e597d57e47e08182448baae93696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:39:02.123985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8a5252a7-4b21-4d7c-9131-fd4b23d4d3bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:02.124813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8a5252a7-4b21-4d7c-9131-fd4b23d4d3bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:02.126769 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2812/5618] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:39:01 2022] DELETE /identity/v3/projects/7d77e597d57e47e08182448baae93696 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:02.131706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595d490-264b-41e2-888c-4f2ca1b97dfe None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:02.132236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595d490-264b-41e2-888c-4f2ca1b97dfe None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:02.132236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595d490-264b-41e2-888c-4f2ca1b97dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:02.150492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b595d490-264b-41e2-888c-4f2ca1b97dfe None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:02.152100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b595d490-264b-41e2-888c-4f2ca1b97dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:02.213736 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2807/5619] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:02.220869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fd4db-8783-4228-90ae-752489bb27a0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:02.221183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fd4db-8783-4228-90ae-752489bb27a0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:02.221457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fd4db-8783-4228-90ae-752489bb27a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:02.240534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-358fd4db-8783-4228-90ae-752489bb27a0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:02.241791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-358fd4db-8783-4228-90ae-752489bb27a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:02.251008 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2813/5620] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:02.256250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595d490-264b-41e2-888c-4f2ca1b97dfe None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:02.266100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595d490-264b-41e2-888c-4f2ca1b97dfe None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:02.270887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501181b4-34e9-41b8-8293-10a5e6c05f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:02.271579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501181b4-34e9-41b8-8293-10a5e6c05f8b admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:02.271970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501181b4-34e9-41b8-8293-10a5e6c05f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:02.272254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501181b4-34e9-41b8-8293-10a5e6c05f8b admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:02.273015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501181b4-34e9-41b8-8293-10a5e6c05f8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:39:02.273327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501181b4-34e9-41b8-8293-10a5e6c05f8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:02.274931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501181b4-34e9-41b8-8293-10a5e6c05f8b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:02.287025 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2808/5621] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:39:02.291608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fd4db-8783-4228-90ae-752489bb27a0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:02.301768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fd4db-8783-4228-90ae-752489bb27a0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:02.306886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99ae50-0b08-46f4-944b-c1e303429843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:02.307601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99ae50-0b08-46f4-944b-c1e303429843 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:02.307889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99ae50-0b08-46f4-944b-c1e303429843 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:02.308172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99ae50-0b08-46f4-944b-c1e303429843 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:02.308924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99ae50-0b08-46f4-944b-c1e303429843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:02.310871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99ae50-0b08-46f4-944b-c1e303429843 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:02.388864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501181b4-34e9-41b8-8293-10a5e6c05f8b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:02.392791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-501181b4-34e9-41b8-8293-10a5e6c05f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:02.413161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501181b4-34e9-41b8-8293-10a5e6c05f8b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:02.419289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e69a3-77ec-455d-a434-63a22fa13d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:02.420253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e69a3-77ec-455d-a434-63a22fa13d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:02.420626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e69a3-77ec-455d-a434-63a22fa13d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:02.426782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e69a3-77ec-455d-a434-63a22fa13d12 admin admin] PATH_INFO: `/v3/users/e285595874384893b01ec8f993252767` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:02.426782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e69a3-77ec-455d-a434-63a22fa13d12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e285595874384893b01ec8f993252767)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:02.426782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e69a3-77ec-455d-a434-63a22fa13d12 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:02.457572 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2814/5622] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:39:02 2022] POST /identity/v3/projects => generated 369 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:39:02.461622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99ae50-0b08-46f4-944b-c1e303429843 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:02.526352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99ae50-0b08-46f4-944b-c1e303429843 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:02.531509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313f138-1b58-49c3-b9b1-ec30be0285f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:02.532179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313f138-1b58-49c3-b9b1-ec30be0285f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:02.532472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313f138-1b58-49c3-b9b1-ec30be0285f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:02.532790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313f138-1b58-49c3-b9b1-ec30be0285f4 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:02.533515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313f138-1b58-49c3-b9b1-ec30be0285f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:02.535471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313f138-1b58-49c3-b9b1-ec30be0285f4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:02.655614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-392e69a3-77ec-455d-a434-63a22fa13d12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e285595874384893b01ec8f993252767'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:02.676142 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2815/5623] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:39:02 2022] POST /identity/v3/users => generated 285 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:39:02.680034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313f138-1b58-49c3-b9b1-ec30be0285f4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:02.688587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-392e69a3-77ec-455d-a434-63a22fa13d12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e285595874384893b01ec8f993252767'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:02.689392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-392e69a3-77ec-455d-a434-63a22fa13d12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e285595874384893b01ec8f993252767'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:02.690976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313f138-1b58-49c3-b9b1-ec30be0285f4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:02.696273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea926860-42ad-4109-bf82-9f4f1413464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:02.696551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-392e69a3-77ec-455d-a434-63a22fa13d12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e285595874384893b01ec8f993252767'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:02.697012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea926860-42ad-4109-bf82-9f4f1413464e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:02.697279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea926860-42ad-4109-bf82-9f4f1413464e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:02.697561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea926860-42ad-4109-bf82-9f4f1413464e admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:02.698817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea926860-42ad-4109-bf82-9f4f1413464e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:02.700481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea926860-42ad-4109-bf82-9f4f1413464e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:02.710825 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2816/5624] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:39:02.715191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea926860-42ad-4109-bf82-9f4f1413464e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:02.725762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea926860-42ad-4109-bf82-9f4f1413464e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:02.730473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45895269-3896-482f-af29-81431ff51bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:02.731967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45895269-3896-482f-af29-81431ff51bbc admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:02.731967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45895269-3896-482f-af29-81431ff51bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:02.731967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45895269-3896-482f-af29-81431ff51bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:02.732477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45895269-3896-482f-af29-81431ff51bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:02.734082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45895269-3896-482f-af29-81431ff51bbc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:02.745462 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2817/5625] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:02.749366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45895269-3896-482f-af29-81431ff51bbc admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:02.761203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45895269-3896-482f-af29-81431ff51bbc admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:02.770059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7935e-3912-471c-83f6-a050b0ae3df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:02.770973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7935e-3912-471c-83f6-a050b0ae3df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:02.771255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7935e-3912-471c-83f6-a050b0ae3df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:02.771534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7935e-3912-471c-83f6-a050b0ae3df3 admin admin] PATH_INFO: `/v3/projects/23f09cc5999a47148c6edbb2c0dfebd9/users/46faf5a25bf64e0a8c7498250430f019/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:02.791029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7935e-3912-471c-83f6-a050b0ae3df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f09cc5999a47148c6edbb2c0dfebd9, user_id=46faf5a25bf64e0a8c7498250430f019, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:02.793776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7935e-3912-471c-83f6-a050b0ae3df3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:02.808375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-392e69a3-77ec-455d-a434-63a22fa13d12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e285595874384893b01ec8f993252767'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:02.814818 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2809/5626] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:39:02 2022] DELETE /identity/v3/users/e285595874384893b01ec8f993252767 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:39:02.817960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e69a3-77ec-455d-a434-63a22fa13d12 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:02.817960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-392e69a3-77ec-455d-a434-63a22fa13d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:02.891226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e69a3-77ec-455d-a434-63a22fa13d12 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:02.891905 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2818/5627] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:39:02 2022] PUT /identity/v3/projects/23f09cc5999a47148c6edbb2c0dfebd9/users/46faf5a25bf64e0a8c7498250430f019/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:39:02.963332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83825b1-bee0-4cbe-b07f-27e50f6e2d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:02.964851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83825b1-bee0-4cbe-b07f-27e50f6e2d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:02.967535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83825b1-bee0-4cbe-b07f-27e50f6e2d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:02.967535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83825b1-bee0-4cbe-b07f-27e50f6e2d55 admin admin] PATH_INFO: `/v3/users/8c8a5cbbc43e415a85da2b0074a05138` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:02.967535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83825b1-bee0-4cbe-b07f-27e50f6e2d55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c8a5cbbc43e415a85da2b0074a05138)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:02.969697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83825b1-bee0-4cbe-b07f-27e50f6e2d55 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:02.983097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53ff09-64dc-40cb-b14f-a2d99fea1cb7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:02.983391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53ff09-64dc-40cb-b14f-a2d99fea1cb7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:02.983867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53ff09-64dc-40cb-b14f-a2d99fea1cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:03.013681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2c53ff09-64dc-40cb-b14f-a2d99fea1cb7 None None] MFA Rules not processed for user `46faf5a25bf64e0a8c7498250430f019`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:03.015402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2c53ff09-64dc-40cb-b14f-a2d99fea1cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:03.081906 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2819/5628] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:03.086251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53ff09-64dc-40cb-b14f-a2d99fea1cb7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:03.088047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2c53ff09-64dc-40cb-b14f-a2d99fea1cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:03.102827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53ff09-64dc-40cb-b14f-a2d99fea1cb7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:03.107576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc04c6-5ddb-4fc1-84a4-546efd33ec19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:03.108234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc04c6-5ddb-4fc1-84a4-546efd33ec19 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:03.108553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc04c6-5ddb-4fc1-84a4-546efd33ec19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:03.108867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc04c6-5ddb-4fc1-84a4-546efd33ec19 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:03.109556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc04c6-5ddb-4fc1-84a4-546efd33ec19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:03.111499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc04c6-5ddb-4fc1-84a4-546efd33ec19 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:03.304060 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2820/5629] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:39:03 2022] POST /identity/v3/projects => generated 371 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:39:03.308906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc04c6-5ddb-4fc1-84a4-546efd33ec19 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:03.310362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f83825b1-bee0-4cbe-b07f-27e50f6e2d55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c8a5cbbc43e415a85da2b0074a05138'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:03.311737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8dbc04c6-5ddb-4fc1-84a4-546efd33ec19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:03.330538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f83825b1-bee0-4cbe-b07f-27e50f6e2d55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c8a5cbbc43e415a85da2b0074a05138'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:03.334343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f83825b1-bee0-4cbe-b07f-27e50f6e2d55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c8a5cbbc43e415a85da2b0074a05138'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:03.338344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f83825b1-bee0-4cbe-b07f-27e50f6e2d55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c8a5cbbc43e415a85da2b0074a05138'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:03.375519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc04c6-5ddb-4fc1-84a4-546efd33ec19 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:03.380487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a1e50-c8ac-441a-ae89-f32449e407c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:03.381399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a1e50-c8ac-441a-ae89-f32449e407c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:03.381684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a1e50-c8ac-441a-ae89-f32449e407c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:03.381962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a1e50-c8ac-441a-ae89-f32449e407c6 admin admin] PATH_INFO: `/v3/projects/e060caaffb324f08b485555220606f10` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:03.383312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a1e50-c8ac-441a-ae89-f32449e407c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e060caaffb324f08b485555220606f10)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:03.385354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a1e50-c8ac-441a-ae89-f32449e407c6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:03.421779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f83825b1-bee0-4cbe-b07f-27e50f6e2d55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c8a5cbbc43e415a85da2b0074a05138'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:03.428482 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2810/5630] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:39:02 2022] DELETE /identity/v3/users/8c8a5cbbc43e415a85da2b0074a05138 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:03.429367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83825b1-bee0-4cbe-b07f-27e50f6e2d55 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:03.430706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f83825b1-bee0-4cbe-b07f-27e50f6e2d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:03.474262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e33a1e50-c8ac-441a-ae89-f32449e407c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e060caaffb324f08b485555220606f10', 'request_id': 'req-e33a1e50-c8ac-441a-ae89-f32449e407c6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:03.506365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83825b1-bee0-4cbe-b07f-27e50f6e2d55 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:03.530219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e33a1e50-c8ac-441a-ae89-f32449e407c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e060caaffb324f08b485555220606f10', 'request_id': 'req-e33a1e50-c8ac-441a-ae89-f32449e407c6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:03.537921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e33a1e50-c8ac-441a-ae89-f32449e407c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e060caaffb324f08b485555220606f10', 'request_id': 'req-e33a1e50-c8ac-441a-ae89-f32449e407c6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:03.551651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e33a1e50-c8ac-441a-ae89-f32449e407c6 admin admin] The token cache is being invalidate because project e060caaffb324f08b485555220606f10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:39:03.551939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e33a1e50-c8ac-441a-ae89-f32449e407c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:03.555414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e33a1e50-c8ac-441a-ae89-f32449e407c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:03.557871 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2821/5631] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:39:03 2022] DELETE /identity/v3/projects/e060caaffb324f08b485555220606f10 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:03.561782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a1e50-c8ac-441a-ae89-f32449e407c6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:03.563500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e33a1e50-c8ac-441a-ae89-f32449e407c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:03.572945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9ad9a-7e42-41c6-8e97-9ad05a67cca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:03.573950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9ad9a-7e42-41c6-8e97-9ad05a67cca1 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:03.574243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9ad9a-7e42-41c6-8e97-9ad05a67cca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:03.574529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9ad9a-7e42-41c6-8e97-9ad05a67cca1 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:03.575231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9ad9a-7e42-41c6-8e97-9ad05a67cca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:03.577225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9ad9a-7e42-41c6-8e97-9ad05a67cca1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:03.632902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a1e50-c8ac-441a-ae89-f32449e407c6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:03.637668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788e7cf-c58f-4f4d-80dd-cb19f015c858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:03.638569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788e7cf-c58f-4f4d-80dd-cb19f015c858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:03.638849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788e7cf-c58f-4f4d-80dd-cb19f015c858 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:03.639126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788e7cf-c58f-4f4d-80dd-cb19f015c858 admin admin] PATH_INFO: `/v3/users/e64408b8611b42b78618b12b673652ae` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:03.640323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788e7cf-c58f-4f4d-80dd-cb19f015c858 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e64408b8611b42b78618b12b673652ae)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:03.642266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788e7cf-c58f-4f4d-80dd-cb19f015c858 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:03.657534 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2811/5632] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:39:03 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:03.658589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9ad9a-7e42-41c6-8e97-9ad05a67cca1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:03.660276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ddd9ad9a-7e42-41c6-8e97-9ad05a67cca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:03.675970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9ad9a-7e42-41c6-8e97-9ad05a67cca1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:03.680894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760cbaf-186c-4dc1-bdda-e959cf132b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:03.681566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760cbaf-186c-4dc1-bdda-e959cf132b7b admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:03.681855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760cbaf-186c-4dc1-bdda-e959cf132b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:03.682753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760cbaf-186c-4dc1-bdda-e959cf132b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:03.683479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760cbaf-186c-4dc1-bdda-e959cf132b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:03.685125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760cbaf-186c-4dc1-bdda-e959cf132b7b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:03.697831 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2812/5633] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:03.701947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760cbaf-186c-4dc1-bdda-e959cf132b7b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:03.712222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760cbaf-186c-4dc1-bdda-e959cf132b7b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:03.717088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bb469-899d-4019-b3d8-3b16d7b0d562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:03.718244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bb469-899d-4019-b3d8-3b16d7b0d562 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:03.718244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bb469-899d-4019-b3d8-3b16d7b0d562 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:03.718573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bb469-899d-4019-b3d8-3b16d7b0d562 admin admin] PATH_INFO: `/v3/projects/f0adb32f42a3412780192d24fb893ff4/users/b99fb8ad56d14fec9ef29ff533907f7d/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:03.736088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950bb469-899d-4019-b3d8-3b16d7b0d562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0adb32f42a3412780192d24fb893ff4, user_id=b99fb8ad56d14fec9ef29ff533907f7d, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:03.740699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950bb469-899d-4019-b3d8-3b16d7b0d562 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:03.812748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4788e7cf-c58f-4f4d-80dd-cb19f015c858 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e64408b8611b42b78618b12b673652ae'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:03.816097 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2813/5634] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:39:03 2022] PUT /identity/v3/projects/f0adb32f42a3412780192d24fb893ff4/users/b99fb8ad56d14fec9ef29ff533907f7d/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:39:03.816957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bb469-899d-4019-b3d8-3b16d7b0d562 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:03.818529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-950bb469-899d-4019-b3d8-3b16d7b0d562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:03.825061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4788e7cf-c58f-4f4d-80dd-cb19f015c858 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e64408b8611b42b78618b12b673652ae'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:03.825908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4788e7cf-c58f-4f4d-80dd-cb19f015c858 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e64408b8611b42b78618b12b673652ae'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:03.832578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4788e7cf-c58f-4f4d-80dd-cb19f015c858 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e64408b8611b42b78618b12b673652ae'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:03.882240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bb469-899d-4019-b3d8-3b16d7b0d562 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:03.887288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a01e3e-3f70-41b8-9c2a-31edd94642b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:03.889917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a01e3e-3f70-41b8-9c2a-31edd94642b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:03.889917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a01e3e-3f70-41b8-9c2a-31edd94642b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:03.889917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a01e3e-3f70-41b8-9c2a-31edd94642b8 admin admin] PATH_INFO: `/v3/projects/82b6fa2217fa4f648fe978e1c9cca3ba` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:03.890279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a01e3e-3f70-41b8-9c2a-31edd94642b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82b6fa2217fa4f648fe978e1c9cca3ba)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:03.892064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a01e3e-3f70-41b8-9c2a-31edd94642b8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:03.902465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4788e7cf-c58f-4f4d-80dd-cb19f015c858 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e64408b8611b42b78618b12b673652ae'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:03.909008 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2822/5635] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:39:03 2022] DELETE /identity/v3/users/e64408b8611b42b78618b12b673652ae => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:39:03.913210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788e7cf-c58f-4f4d-80dd-cb19f015c858 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:03.913210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4788e7cf-c58f-4f4d-80dd-cb19f015c858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:03.987173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788e7cf-c58f-4f4d-80dd-cb19f015c858 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:03.992349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7e5cb-5613-4710-bf10-d1de35098fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:03.993050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7e5cb-5613-4710-bf10-d1de35098fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:03.993338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7e5cb-5613-4710-bf10-d1de35098fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:03.993622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7e5cb-5613-4710-bf10-d1de35098fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:03.994720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7e5cb-5613-4710-bf10-d1de35098fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:03.996331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7e5cb-5613-4710-bf10-d1de35098fd3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:04.007251 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2823/5636] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:04.011578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7e5cb-5613-4710-bf10-d1de35098fd3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:04.022485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7e5cb-5613-4710-bf10-d1de35098fd3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:04.029122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ccc90-d8da-4ae8-b6ad-c48174454d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:04.030086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ccc90-d8da-4ae8-b6ad-c48174454d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:04.030368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ccc90-d8da-4ae8-b6ad-c48174454d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:04.030644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ccc90-d8da-4ae8-b6ad-c48174454d47 admin admin] PATH_INFO: `/v3/projects/f0adb32f42a3412780192d24fb893ff4/users/b99fb8ad56d14fec9ef29ff533907f7d/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:04.032987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ccc90-d8da-4ae8-b6ad-c48174454d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0adb32f42a3412780192d24fb893ff4, user_id=b99fb8ad56d14fec9ef29ff533907f7d, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:04.035969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ccc90-d8da-4ae8-b6ad-c48174454d47 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:04.042370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-09a01e3e-3f70-41b8-9c2a-31edd94642b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82b6fa2217fa4f648fe978e1c9cca3ba', 'request_id': 'req-09a01e3e-3f70-41b8-9c2a-31edd94642b8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:04.048690 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2824/5637] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:39:04 2022] PUT /identity/v3/projects/f0adb32f42a3412780192d24fb893ff4/users/b99fb8ad56d14fec9ef29ff533907f7d/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:39:04.050335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-09a01e3e-3f70-41b8-9c2a-31edd94642b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82b6fa2217fa4f648fe978e1c9cca3ba', 'request_id': 'req-09a01e3e-3f70-41b8-9c2a-31edd94642b8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:04.057787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42525fe6-e39b-4f18-812f-d23088aeb146 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:04.058192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42525fe6-e39b-4f18-812f-d23088aeb146 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:04.058583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42525fe6-e39b-4f18-812f-d23088aeb146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:04.085573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-42525fe6-e39b-4f18-812f-d23088aeb146 None None] MFA Rules not processed for user `b99fb8ad56d14fec9ef29ff533907f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:04.086857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-42525fe6-e39b-4f18-812f-d23088aeb146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:04.133874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-09a01e3e-3f70-41b8-9c2a-31edd94642b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82b6fa2217fa4f648fe978e1c9cca3ba', 'request_id': 'req-09a01e3e-3f70-41b8-9c2a-31edd94642b8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:04.145836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-09a01e3e-3f70-41b8-9c2a-31edd94642b8 admin admin] The token cache is being invalidate because project 82b6fa2217fa4f648fe978e1c9cca3ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:39:04.146130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-09a01e3e-3f70-41b8-9c2a-31edd94642b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:04.146990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-09a01e3e-3f70-41b8-9c2a-31edd94642b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:04.149313 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2814/5638] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:39:03 2022] DELETE /identity/v3/projects/82b6fa2217fa4f648fe978e1c9cca3ba => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:04.154757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9150984-8734-4447-a104-a8f3934421bc None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:04.155158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9150984-8734-4447-a104-a8f3934421bc None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:04.155728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9150984-8734-4447-a104-a8f3934421bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:04.166207 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2825/5639] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:04 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:04.170027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42525fe6-e39b-4f18-812f-d23088aeb146 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:04.174536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e9150984-8734-4447-a104-a8f3934421bc None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:04.175718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e9150984-8734-4447-a104-a8f3934421bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:04.178987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42525fe6-e39b-4f18-812f-d23088aeb146 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:04.183674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b828af0-abca-4619-8520-47a2eccc94c0 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99fb8ad56d14fec9ef29ff533907f7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0adb32f42a3412780192d24fb893ff4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:04.184340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b828af0-abca-4619-8520-47a2eccc94c0 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:04.184721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b828af0-abca-4619-8520-47a2eccc94c0 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:04.185012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b828af0-abca-4619-8520-47a2eccc94c0 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:04.185728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b828af0-abca-4619-8520-47a2eccc94c0 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:04.187585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b828af0-abca-4619-8520-47a2eccc94c0 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:04.244835 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2815/5640] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:04.249100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9150984-8734-4447-a104-a8f3934421bc None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:04.250536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e9150984-8734-4447-a104-a8f3934421bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:04.264827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9150984-8734-4447-a104-a8f3934421bc None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:04.270027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf675c1-dfe3-4056-87c5-0b04410bf9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:04.270853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf675c1-dfe3-4056-87c5-0b04410bf9e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:04.271173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf675c1-dfe3-4056-87c5-0b04410bf9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:04.271457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf675c1-dfe3-4056-87c5-0b04410bf9e5 admin admin] PATH_INFO: `/v3/projects/26b971880530401f8bed1bae07ffeed4` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:04.273062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf675c1-dfe3-4056-87c5-0b04410bf9e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b971880530401f8bed1bae07ffeed4)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:04.275106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf675c1-dfe3-4056-87c5-0b04410bf9e5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:04.300753 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2826/5641] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:39:04 2022] POST /identity/v3/projects => generated 359 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:39:04.302153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b828af0-abca-4619-8520-47a2eccc94c0 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:04.306613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1b828af0-abca-4619-8520-47a2eccc94c0 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:04.376230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b828af0-abca-4619-8520-47a2eccc94c0 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:04.381010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cc607-1a90-429b-8997-99b2b78ec082 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99fb8ad56d14fec9ef29ff533907f7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0adb32f42a3412780192d24fb893ff4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:04.381685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cc607-1a90-429b-8997-99b2b78ec082 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:04.381970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cc607-1a90-429b-8997-99b2b78ec082 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:04.382249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cc607-1a90-429b-8997-99b2b78ec082 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:04.382941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cc607-1a90-429b-8997-99b2b78ec082 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:04.385000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cc607-1a90-429b-8997-99b2b78ec082 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:04.416230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6bf675c1-dfe3-4056-87c5-0b04410bf9e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b971880530401f8bed1bae07ffeed4', 'request_id': 'req-6bf675c1-dfe3-4056-87c5-0b04410bf9e5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:04.422221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6bf675c1-dfe3-4056-87c5-0b04410bf9e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b971880530401f8bed1bae07ffeed4', 'request_id': 'req-6bf675c1-dfe3-4056-87c5-0b04410bf9e5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:04.526835 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2827/5642] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:39:04 2022] POST /identity/v3/users => generated 371 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:04.528451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32cbd4-9d0b-467d-9c8d-2dcee923250c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:04.528762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32cbd4-9d0b-467d-9c8d-2dcee923250c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:04.529050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32cbd4-9d0b-467d-9c8d-2dcee923250c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:04.547860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9a32cbd4-9d0b-467d-9c8d-2dcee923250c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:04.549792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9a32cbd4-9d0b-467d-9c8d-2dcee923250c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:04.581639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6bf675c1-dfe3-4056-87c5-0b04410bf9e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b971880530401f8bed1bae07ffeed4', 'request_id': 'req-6bf675c1-dfe3-4056-87c5-0b04410bf9e5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:04.592757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6bf675c1-dfe3-4056-87c5-0b04410bf9e5 admin admin] The token cache is being invalidate because project 26b971880530401f8bed1bae07ffeed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:39:04.593119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6bf675c1-dfe3-4056-87c5-0b04410bf9e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:04.593767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6bf675c1-dfe3-4056-87c5-0b04410bf9e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:04.595354 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2816/5643] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:39:04 2022] DELETE /identity/v3/projects/26b971880530401f8bed1bae07ffeed4 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:04.599535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf675c1-dfe3-4056-87c5-0b04410bf9e5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:04.600997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6bf675c1-dfe3-4056-87c5-0b04410bf9e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:04.608826 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2828/5644] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:04.610190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4adfd-8169-4b36-92c9-b4903bc36325 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:04.610505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4adfd-8169-4b36-92c9-b4903bc36325 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:04.610792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4adfd-8169-4b36-92c9-b4903bc36325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:04.629392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-abf4adfd-8169-4b36-92c9-b4903bc36325 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:04.630596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-abf4adfd-8169-4b36-92c9-b4903bc36325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:04.639548 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2829/5645] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:04.640325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4adfd-8169-4b36-92c9-b4903bc36325 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:04.649798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4adfd-8169-4b36-92c9-b4903bc36325 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:04.654551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0bfb4-1092-4e25-94a0-5f1599f831eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:04.655225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0bfb4-1092-4e25-94a0-5f1599f831eb admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:04.655507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0bfb4-1092-4e25-94a0-5f1599f831eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:04.655782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0bfb4-1092-4e25-94a0-5f1599f831eb admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:04.656507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0bfb4-1092-4e25-94a0-5f1599f831eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:39:04.656848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0bfb4-1092-4e25-94a0-5f1599f831eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:04.661624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0bfb4-1092-4e25-94a0-5f1599f831eb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:04.668576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf675c1-dfe3-4056-87c5-0b04410bf9e5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:04.669890 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2830/5646] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:39:04.671063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2346d47-7142-4e25-bbcb-3c5325e432c5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:04.671352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2346d47-7142-4e25-bbcb-3c5325e432c5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:04.671634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2346d47-7142-4e25-bbcb-3c5325e432c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:04.673780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485e696-1b2a-4edf-90b4-a4cc31da03d4 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99fb8ad56d14fec9ef29ff533907f7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0adb32f42a3412780192d24fb893ff4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:04.674304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485e696-1b2a-4edf-90b4-a4cc31da03d4 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:04.674620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485e696-1b2a-4edf-90b4-a4cc31da03d4 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:04.674901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485e696-1b2a-4edf-90b4-a4cc31da03d4 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:04.675778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485e696-1b2a-4edf-90b4-a4cc31da03d4 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:39:04.676367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485e696-1b2a-4edf-90b4-a4cc31da03d4 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:04.678368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485e696-1b2a-4edf-90b4-a4cc31da03d4 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:04.690429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c2346d47-7142-4e25-bbcb-3c5325e432c5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:04.691636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c2346d47-7142-4e25-bbcb-3c5325e432c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:04.701143 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2831/5647] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:04.701143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2346d47-7142-4e25-bbcb-3c5325e432c5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:04.710740 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2817/5648] 10.222.0.16 () {58 vars in 1156 bytes} [Mon May 2 10:39:04 2022] GET /identity/v3/users?domain_id=default => generated 7748 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:04.710952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2346d47-7142-4e25-bbcb-3c5325e432c5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:04.711549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485e696-1b2a-4edf-90b4-a4cc31da03d4 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:04.716502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0d91f-180f-4957-a818-c840e630a11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:04.719122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0d91f-180f-4957-a818-c840e630a11e admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:04.719122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0d91f-180f-4957-a818-c840e630a11e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:04.719122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0d91f-180f-4957-a818-c840e630a11e admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:04.719122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0d91f-180f-4957-a818-c840e630a11e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:04.720836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0d91f-180f-4957-a818-c840e630a11e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:04.722726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485e696-1b2a-4edf-90b4-a4cc31da03d4 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:04.727340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c1707-4a54-4f04-97a3-45fe20a92420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:04.728024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c1707-4a54-4f04-97a3-45fe20a92420 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:04.728312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c1707-4a54-4f04-97a3-45fe20a92420 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:04.728593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c1707-4a54-4f04-97a3-45fe20a92420 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:04.729371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c1707-4a54-4f04-97a3-45fe20a92420 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:39:04.729684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c1707-4a54-4f04-97a3-45fe20a92420 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:04.731306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c1707-4a54-4f04-97a3-45fe20a92420 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:04.743456 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2818/5649] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:39:04.745163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c1707-4a54-4f04-97a3-45fe20a92420 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:04.755431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c1707-4a54-4f04-97a3-45fe20a92420 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:04.760059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cce7e-41d1-4f1d-9e59-1bcc81a396bd tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99fb8ad56d14fec9ef29ff533907f7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0adb32f42a3412780192d24fb893ff4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:04.761566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cce7e-41d1-4f1d-9e59-1bcc81a396bd tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:04.761852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cce7e-41d1-4f1d-9e59-1bcc81a396bd tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:04.762131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cce7e-41d1-4f1d-9e59-1bcc81a396bd tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] PATH_INFO: `/v3/users/a2a48b31d3f74630bda7dad931000b34` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:04.777515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cce7e-41d1-4f1d-9e59-1bcc81a396bd tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] RBAC: Authorizing `identity:update_user(user_id=a2a48b31d3f74630bda7dad931000b34)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:04.778488 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-d88cce7e-41d1-4f1d-9e59-1bcc81a396bd tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:39:04.778488 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:39:04.778488 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:39:04.779704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cce7e-41d1-4f1d-9e59-1bcc81a396bd tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:04.833478 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2832/5650] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:39:04 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:04.833478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0d91f-180f-4957-a818-c840e630a11e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:04.858937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d88cce7e-41d1-4f1d-9e59-1bcc81a396bd tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a2a48b31d3f74630bda7dad931000b34'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:04.894484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0d91f-180f-4957-a818-c840e630a11e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:04.899328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0dce0-c82b-47ca-ad3f-f5fc5721e699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:04.900010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0dce0-c82b-47ca-ad3f-f5fc5721e699 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:04.900303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0dce0-c82b-47ca-ad3f-f5fc5721e699 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:04.900638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0dce0-c82b-47ca-ad3f-f5fc5721e699 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:04.901375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0dce0-c82b-47ca-ad3f-f5fc5721e699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:04.903398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0dce0-c82b-47ca-ad3f-f5fc5721e699 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:04.934492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d88cce7e-41d1-4f1d-9e59-1bcc81a396bd tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Invalidating the token cache because user a2a48b31d3f74630bda7dad931000b34 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:39:04.934796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d88cce7e-41d1-4f1d-9e59-1bcc81a396bd tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:04.935454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d88cce7e-41d1-4f1d-9e59-1bcc81a396bd tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:04.940829 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2819/5651] 10.222.0.16 () {60 vars in 1243 bytes} [Mon May 2 10:39:04 2022] PATCH /identity/v3/users/a2a48b31d3f74630bda7dad931000b34 => generated 485 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:39:04.940829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cce7e-41d1-4f1d-9e59-1bcc81a396bd tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:04.940829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d88cce7e-41d1-4f1d-9e59-1bcc81a396bd tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:04.953731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cce7e-41d1-4f1d-9e59-1bcc81a396bd tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:04.958573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1da70-7d5d-4592-8bc7-c09f7676463e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:04.959230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1da70-7d5d-4592-8bc7-c09f7676463e admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:04.961939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1da70-7d5d-4592-8bc7-c09f7676463e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:04.961939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1da70-7d5d-4592-8bc7-c09f7676463e admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:04.961939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1da70-7d5d-4592-8bc7-c09f7676463e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:04.962479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1da70-7d5d-4592-8bc7-c09f7676463e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:05.021057 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2833/5652] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:39:04 2022] POST /identity/v3/projects => generated 361 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:05.021057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acafb5-a660-4727-94ff-630a0622ced0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:05.021057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acafb5-a660-4727-94ff-630a0622ced0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:05.021057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acafb5-a660-4727-94ff-630a0622ced0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:05.033846 ncdv-master-1 devstack@keystone.service[91118]: WARNING keystone.auth.plugins.core [None req-55acafb5-a660-4727-94ff-630a0622ced0 None None] User is disabled: a2a48b31d3f74630bda7dad931000b34: AssertionError: User is disabled: a2a48b31d3f74630bda7dad931000b34 May 02 10:39:05.051694 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2820/5653] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:39:04 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:05.051694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1da70-7d5d-4592-8bc7-c09f7676463e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:05.058463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b8d1da70-7d5d-4592-8bc7-c09f7676463e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:05.065432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1da70-7d5d-4592-8bc7-c09f7676463e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:05.066868 ncdv-master-1 devstack@keystone.service[91118]: WARNING keystone.server.flask.application [None req-55acafb5-a660-4727-94ff-630a0622ced0 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. May 02 10:39:05.068499 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2834/5654] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:05 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 50 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) May 02 10:39:05.069562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acafb5-a660-4727-94ff-630a0622ced0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:05.123659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95872e92-e29a-4922-a57c-6a3f1f3d1af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:05.124341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95872e92-e29a-4922-a57c-6a3f1f3d1af4 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:05.124653 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95872e92-e29a-4922-a57c-6a3f1f3d1af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:05.124938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95872e92-e29a-4922-a57c-6a3f1f3d1af4 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:05.125624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95872e92-e29a-4922-a57c-6a3f1f3d1af4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:05.127878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95872e92-e29a-4922-a57c-6a3f1f3d1af4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:05.135922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acafb5-a660-4727-94ff-630a0622ced0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:05.140576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8d6ea-296d-41f9-8a83-41679785f432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:05.141303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8d6ea-296d-41f9-8a83-41679785f432 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:05.141590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8d6ea-296d-41f9-8a83-41679785f432 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:05.141897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8d6ea-296d-41f9-8a83-41679785f432 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:05.142626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8d6ea-296d-41f9-8a83-41679785f432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:05.144208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8d6ea-296d-41f9-8a83-41679785f432 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:05.155198 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2835/5655] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:05.156167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8d6ea-296d-41f9-8a83-41679785f432 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:05.157823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a7e8d6ea-296d-41f9-8a83-41679785f432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:05.220853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8d6ea-296d-41f9-8a83-41679785f432 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:05.225473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65778d6b-06b2-4b37-868f-bb3fa850fcc8 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99fb8ad56d14fec9ef29ff533907f7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0adb32f42a3412780192d24fb893ff4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:05.226654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65778d6b-06b2-4b37-868f-bb3fa850fcc8 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:05.226945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65778d6b-06b2-4b37-868f-bb3fa850fcc8 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:05.227223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65778d6b-06b2-4b37-868f-bb3fa850fcc8 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] PATH_INFO: `/v3/users/a2a48b31d3f74630bda7dad931000b34` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:05.240948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65778d6b-06b2-4b37-868f-bb3fa850fcc8 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a2a48b31d3f74630bda7dad931000b34)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:05.242765 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2821/5656] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:39:05 2022] POST /identity/v3/users => generated 281 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:05.242765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95872e92-e29a-4922-a57c-6a3f1f3d1af4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:05.246672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65778d6b-06b2-4b37-868f-bb3fa850fcc8 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:05.254932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95872e92-e29a-4922-a57c-6a3f1f3d1af4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:05.260230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858d2dd-bb5a-4acd-acfc-e206d6f99702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:05.260934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858d2dd-bb5a-4acd-acfc-e206d6f99702 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:05.263771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858d2dd-bb5a-4acd-acfc-e206d6f99702 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:05.263771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858d2dd-bb5a-4acd-acfc-e206d6f99702 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:05.263771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858d2dd-bb5a-4acd-acfc-e206d6f99702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:05.263771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858d2dd-bb5a-4acd-acfc-e206d6f99702 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:05.273910 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2822/5657] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:05.274708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858d2dd-bb5a-4acd-acfc-e206d6f99702 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:05.286664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858d2dd-bb5a-4acd-acfc-e206d6f99702 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:05.289890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363efbdf-8558-48c6-a09a-a81d0419b64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:05.290526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363efbdf-8558-48c6-a09a-a81d0419b64a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:05.290843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363efbdf-8558-48c6-a09a-a81d0419b64a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:05.291124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363efbdf-8558-48c6-a09a-a81d0419b64a admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:05.292447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363efbdf-8558-48c6-a09a-a81d0419b64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:05.294072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363efbdf-8558-48c6-a09a-a81d0419b64a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:05.304430 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2823/5658] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:05.305223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363efbdf-8558-48c6-a09a-a81d0419b64a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:05.314855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363efbdf-8558-48c6-a09a-a81d0419b64a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:05.319515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288a82a-6592-441b-9012-5737069ffa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:05.320364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288a82a-6592-441b-9012-5737069ffa33 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:05.320685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288a82a-6592-441b-9012-5737069ffa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:05.320970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288a82a-6592-441b-9012-5737069ffa33 admin admin] PATH_INFO: `/v3/projects/608974f2bff942b5a36c7b8f748dcf72/users/26723e7d6f3d44a4951432f45c89021a/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:05.334718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288a82a-6592-441b-9012-5737069ffa33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=608974f2bff942b5a36c7b8f748dcf72, user_id=26723e7d6f3d44a4951432f45c89021a, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:05.337402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288a82a-6592-441b-9012-5737069ffa33 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:05.375144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-65778d6b-06b2-4b37-868f-bb3fa850fcc8 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2a48b31d3f74630bda7dad931000b34'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:05.387118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-65778d6b-06b2-4b37-868f-bb3fa850fcc8 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2a48b31d3f74630bda7dad931000b34'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:05.387941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-65778d6b-06b2-4b37-868f-bb3fa850fcc8 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2a48b31d3f74630bda7dad931000b34'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:05.394688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-65778d6b-06b2-4b37-868f-bb3fa850fcc8 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2a48b31d3f74630bda7dad931000b34'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:05.432788 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2824/5659] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:39:05 2022] PUT /identity/v3/projects/608974f2bff942b5a36c7b8f748dcf72/users/26723e7d6f3d44a4951432f45c89021a/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:05.433756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288a82a-6592-441b-9012-5737069ffa33 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:05.472658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-65778d6b-06b2-4b37-868f-bb3fa850fcc8 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2a48b31d3f74630bda7dad931000b34'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:05.479886 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2836/5660] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:39:05 2022] DELETE /identity/v3/users/a2a48b31d3f74630bda7dad931000b34 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:05.483034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d324da-d1d4-4884-a8e4-18e9134cd07d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:05.483034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d324da-d1d4-4884-a8e4-18e9134cd07d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:05.483034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d324da-d1d4-4884-a8e4-18e9134cd07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:05.493754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288a82a-6592-441b-9012-5737069ffa33 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:05.501697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d9d324da-d1d4-4884-a8e4-18e9134cd07d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:05.502920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d9d324da-d1d4-4884-a8e4-18e9134cd07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:05.551377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25f5af-fefd-49ac-99b9-aee7afa045d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:05.551962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25f5af-fefd-49ac-99b9-aee7afa045d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:05.552249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25f5af-fefd-49ac-99b9-aee7afa045d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:05.552526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25f5af-fefd-49ac-99b9-aee7afa045d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:05.553284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25f5af-fefd-49ac-99b9-aee7afa045d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:05.554893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25f5af-fefd-49ac-99b9-aee7afa045d7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:05.561761 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2837/5661] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:05.562801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d324da-d1d4-4884-a8e4-18e9134cd07d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:05.564047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d9d324da-d1d4-4884-a8e4-18e9134cd07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:05.570533 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2825/5662] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:05.571583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25f5af-fefd-49ac-99b9-aee7afa045d7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:05.573381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7f25f5af-fefd-49ac-99b9-aee7afa045d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:05.585934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25f5af-fefd-49ac-99b9-aee7afa045d7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:05.591389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c0cae-f446-4fa6-a488-01ae17e71ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:05.592262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c0cae-f446-4fa6-a488-01ae17e71ba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:05.592543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c0cae-f446-4fa6-a488-01ae17e71ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:05.592867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c0cae-f446-4fa6-a488-01ae17e71ba1 admin admin] PATH_INFO: `/v3/projects/b966b8424fbd467a9bbf41c754440659/users/dee15583ccd24533ad03df793aa9e8dd/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:05.608087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c0cae-f446-4fa6-a488-01ae17e71ba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b966b8424fbd467a9bbf41c754440659, user_id=dee15583ccd24533ad03df793aa9e8dd, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:05.610802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c0cae-f446-4fa6-a488-01ae17e71ba1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:05.628980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d324da-d1d4-4884-a8e4-18e9134cd07d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:05.633680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef249a4a-39fe-4b47-b808-d64ff16f7427 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99fb8ad56d14fec9ef29ff533907f7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0adb32f42a3412780192d24fb893ff4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:05.634594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef249a4a-39fe-4b47-b808-d64ff16f7427 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:05.634883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef249a4a-39fe-4b47-b808-d64ff16f7427 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:05.635735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef249a4a-39fe-4b47-b808-d64ff16f7427 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] PATH_INFO: `/v3/projects/f8167b9eedc3482589f7487f379735b2` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:05.637025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef249a4a-39fe-4b47-b808-d64ff16f7427 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f8167b9eedc3482589f7487f379735b2)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:05.638966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef249a4a-39fe-4b47-b808-d64ff16f7427 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:05.751811 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2826/5663] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:39:05 2022] PUT /identity/v3/projects/b966b8424fbd467a9bbf41c754440659/users/dee15583ccd24533ad03df793aa9e8dd/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:39:05.752814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c0cae-f446-4fa6-a488-01ae17e71ba1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:05.754406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-791c0cae-f446-4fa6-a488-01ae17e71ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:05.782076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ef249a4a-39fe-4b47-b808-d64ff16f7427 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8167b9eedc3482589f7487f379735b2', 'request_id': 'req-ef249a4a-39fe-4b47-b808-d64ff16f7427'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:05.818785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c0cae-f446-4fa6-a488-01ae17e71ba1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:05.872428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ef249a4a-39fe-4b47-b808-d64ff16f7427 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8167b9eedc3482589f7487f379735b2', 'request_id': 'req-ef249a4a-39fe-4b47-b808-d64ff16f7427'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:05.872976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5b2ce-6815-4793-8555-f18de047ebcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:05.872976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5b2ce-6815-4793-8555-f18de047ebcf service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:05.872976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5b2ce-6815-4793-8555-f18de047ebcf service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:05.872976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5b2ce-6815-4793-8555-f18de047ebcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:05.874746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ef249a4a-39fe-4b47-b808-d64ff16f7427 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8167b9eedc3482589f7487f379735b2', 'request_id': 'req-ef249a4a-39fe-4b47-b808-d64ff16f7427'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:05.888246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ef249a4a-39fe-4b47-b808-d64ff16f7427 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] The token cache is being invalidate because project f8167b9eedc3482589f7487f379735b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:39:05.888692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ef249a4a-39fe-4b47-b808-d64ff16f7427 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:05.889467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ef249a4a-39fe-4b47-b808-d64ff16f7427 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:05.891106 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2838/5664] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:39:05 2022] DELETE /identity/v3/projects/f8167b9eedc3482589f7487f379735b2 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:05.895536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fa0d0-d236-42e1-a0d7-68f8e5488d07 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:05.895536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fa0d0-d236-42e1-a0d7-68f8e5488d07 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:05.895536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fa0d0-d236-42e1-a0d7-68f8e5488d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:05.920312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6a9fa0d0-d236-42e1-a0d7-68f8e5488d07 None None] MFA Rules not processed for user `dee15583ccd24533ad03df793aa9e8dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:05.921582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6a9fa0d0-d236-42e1-a0d7-68f8e5488d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:05.936469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5b2ce-6815-4793-8555-f18de047ebcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:05.937959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5b2ce-6815-4793-8555-f18de047ebcf service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:05.948214 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2827/5665] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:39:05.949025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5b2ce-6815-4793-8555-f18de047ebcf service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:05.989141 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2839/5666] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:05.993725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fa0d0-d236-42e1-a0d7-68f8e5488d07 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:05.995595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6a9fa0d0-d236-42e1-a0d7-68f8e5488d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:06.009804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fa0d0-d236-42e1-a0d7-68f8e5488d07 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:06.012710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5b2ce-6815-4793-8555-f18de047ebcf service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:06.015337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007e52a-70e0-486a-a071-10196483a115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:06.015992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007e52a-70e0-486a-a071-10196483a115 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:06.016274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007e52a-70e0-486a-a071-10196483a115 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:06.016624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007e52a-70e0-486a-a071-10196483a115 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:06.017324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007e52a-70e0-486a-a071-10196483a115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:06.017582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6eddb-e2de-462d-82e1-38c74c09cfd1 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99fb8ad56d14fec9ef29ff533907f7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0adb32f42a3412780192d24fb893ff4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:06.018258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6eddb-e2de-462d-82e1-38c74c09cfd1 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:06.018690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6eddb-e2de-462d-82e1-38c74c09cfd1 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:06.018979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6eddb-e2de-462d-82e1-38c74c09cfd1 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:06.019202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007e52a-70e0-486a-a071-10196483a115 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:06.019706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6eddb-e2de-462d-82e1-38c74c09cfd1 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:06.021750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6eddb-e2de-462d-82e1-38c74c09cfd1 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:06.034941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-e6b6eddb-e2de-462d-82e1-38c74c09cfd1 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Could not find domain: 5ba781f27d554f68abc9738712e9eb99.: keystone.exception.DomainNotFound: Could not find domain: 5ba781f27d554f68abc9738712e9eb99. May 02 10:39:06.034941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:39:06.034941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 02 10:39:06.034941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 02 10:39:06.034941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:39:06.034941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:39:06.034941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:39:06.034941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:39:06.034941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 5ba781f27d554f68abc9738712e9eb99. May 02 10:39:06.034941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:39:06.034941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:39:06.034941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:39:06.034941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:39:06.034941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:39:06.034941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:39:06.036410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:39:06.036410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:39:06.036410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:39:06.036410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:39:06.036410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:39:06.036410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:39:06.036410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:39:06.036410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:39:06.036410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 02 10:39:06.036410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 02 10:39:06.036410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:39:06.036410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:39:06.036410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 10:39:06.036410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:39:06.036410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 10:39:06.036410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:39:06.036410 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user May 02 10:39:06.037997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) May 02 10:39:06.037997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:39:06.037997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:39:06.037997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:39:06.037997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:39:06.037997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:39:06.037997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:39:06.037997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:39:06.037997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:39:06.037997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:39:06.037997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:39:06.037997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:39:06.037997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:39:06.037997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:39:06.037997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:39:06.037997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:39:06.037997 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:39:06.039438 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 02 10:39:06.039438 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:39:06.039438 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 5ba781f27d554f68abc9738712e9eb99. May 02 10:39:06.039438 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:39:06.039438 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2828/5667] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:39:05 2022] POST /identity/v3/users => generated 112 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:39:06.042548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6eddb-e2de-462d-82e1-38c74c09cfd1 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:06.044746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e6b6eddb-e2de-462d-82e1-38c74c09cfd1 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:06.059214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6eddb-e2de-462d-82e1-38c74c09cfd1 tempest-UsersNegativeTest-1644927312 tempest-UsersNegativeTest-1644927312-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:06.064157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4699fb-1934-4b24-adf8-fbe072439bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:06.065127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4699fb-1934-4b24-adf8-fbe072439bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:06.065474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4699fb-1934-4b24-adf8-fbe072439bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:06.066064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4699fb-1934-4b24-adf8-fbe072439bc3 admin admin] PATH_INFO: `/v3/users/46faf5a25bf64e0a8c7498250430f019` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:06.067998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4699fb-1934-4b24-adf8-fbe072439bc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46faf5a25bf64e0a8c7498250430f019)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:06.076161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4699fb-1934-4b24-adf8-fbe072439bc3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:06.134977 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2840/5668] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:39:05 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:39:06.136129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007e52a-70e0-486a-a071-10196483a115 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:06.196113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007e52a-70e0-486a-a071-10196483a115 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:06.200788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc0a56-c0e0-4723-917f-b32e4fcf93c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:06.201453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc0a56-c0e0-4723-917f-b32e4fcf93c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:06.201737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc0a56-c0e0-4723-917f-b32e4fcf93c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:06.202013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc0a56-c0e0-4723-917f-b32e4fcf93c8 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:06.202727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc0a56-c0e0-4723-917f-b32e4fcf93c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:06.204646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc0a56-c0e0-4723-917f-b32e4fcf93c8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:06.253791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dc4699fb-1934-4b24-adf8-fbe072439bc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46faf5a25bf64e0a8c7498250430f019'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:06.267355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dc4699fb-1934-4b24-adf8-fbe072439bc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46faf5a25bf64e0a8c7498250430f019'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:06.268090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dc4699fb-1934-4b24-adf8-fbe072439bc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46faf5a25bf64e0a8c7498250430f019'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:06.275094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dc4699fb-1934-4b24-adf8-fbe072439bc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46faf5a25bf64e0a8c7498250430f019'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:06.297988 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2841/5669] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:39:06 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:39:06.301569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc0a56-c0e0-4723-917f-b32e4fcf93c8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:06.311513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc0a56-c0e0-4723-917f-b32e4fcf93c8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:06.316484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10abc55-15f0-431a-94ca-e0a35095b222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:06.317312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10abc55-15f0-431a-94ca-e0a35095b222 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:06.317606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10abc55-15f0-431a-94ca-e0a35095b222 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:06.317886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10abc55-15f0-431a-94ca-e0a35095b222 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:06.318617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10abc55-15f0-431a-94ca-e0a35095b222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:06.320208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10abc55-15f0-431a-94ca-e0a35095b222 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:06.330307 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2842/5670] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:06.334222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10abc55-15f0-431a-94ca-e0a35095b222 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:06.344098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10abc55-15f0-431a-94ca-e0a35095b222 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:06.348996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b1b4f-3c38-4cff-b185-0cebbd380883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:06.349857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b1b4f-3c38-4cff-b185-0cebbd380883 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:06.350146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b1b4f-3c38-4cff-b185-0cebbd380883 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:06.350429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b1b4f-3c38-4cff-b185-0cebbd380883 admin admin] PATH_INFO: `/v3/projects/30609305470944a3807c825dd709a1b2/users/0252c1afca7949d3ba69b5fde4c0d5be/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:06.352845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dc4699fb-1934-4b24-adf8-fbe072439bc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46faf5a25bf64e0a8c7498250430f019'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:06.359978 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2829/5671] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:39:06 2022] DELETE /identity/v3/users/46faf5a25bf64e0a8c7498250430f019 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:39:06.366001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b1b4f-3c38-4cff-b185-0cebbd380883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30609305470944a3807c825dd709a1b2, user_id=0252c1afca7949d3ba69b5fde4c0d5be, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:06.368140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e796530-7b60-40d0-b4df-920b96b40f16 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:06.368432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e796530-7b60-40d0-b4df-920b96b40f16 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:06.368743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e796530-7b60-40d0-b4df-920b96b40f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:06.368889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b1b4f-3c38-4cff-b185-0cebbd380883 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:06.394098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5e796530-7b60-40d0-b4df-920b96b40f16 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:06.394098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5e796530-7b60-40d0-b4df-920b96b40f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:06.449142 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2843/5672] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:39:06 2022] PUT /identity/v3/projects/30609305470944a3807c825dd709a1b2/users/0252c1afca7949d3ba69b5fde4c0d5be/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:39:06.453129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b1b4f-3c38-4cff-b185-0cebbd380883 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:06.454768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2b6b1b4f-3c38-4cff-b185-0cebbd380883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:06.459902 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2830/5673] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:06.471978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e796530-7b60-40d0-b4df-920b96b40f16 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:06.474353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5e796530-7b60-40d0-b4df-920b96b40f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:06.539391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b1b4f-3c38-4cff-b185-0cebbd380883 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:06.543505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e796530-7b60-40d0-b4df-920b96b40f16 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:06.545910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9e9df-2001-43da-b746-ec654f063789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:06.548336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9e9df-2001-43da-b746-ec654f063789 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:06.548336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9e9df-2001-43da-b746-ec654f063789 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:06.548336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9e9df-2001-43da-b746-ec654f063789 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:06.548336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9e9df-2001-43da-b746-ec654f063789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:06.549864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9e9df-2001-43da-b746-ec654f063789 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:06.560787 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2844/5674] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:39:06.564995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9e9df-2001-43da-b746-ec654f063789 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:06.575236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9e9df-2001-43da-b746-ec654f063789 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:06.580046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c97e12-08f7-47fb-aba5-de5890f609df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:06.581016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c97e12-08f7-47fb-aba5-de5890f609df admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:06.581245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c97e12-08f7-47fb-aba5-de5890f609df admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:06.581527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c97e12-08f7-47fb-aba5-de5890f609df admin admin] PATH_INFO: `/v3/projects/30609305470944a3807c825dd709a1b2/users/0252c1afca7949d3ba69b5fde4c0d5be/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:06.583549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c97e12-08f7-47fb-aba5-de5890f609df admin admin] RBAC: Authorizing `identity:create_grant(project_id=30609305470944a3807c825dd709a1b2, user_id=0252c1afca7949d3ba69b5fde4c0d5be, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:06.586587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c97e12-08f7-47fb-aba5-de5890f609df admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:06.592514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cba75c-65ac-412e-a703-2a675760ee15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:06.593370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cba75c-65ac-412e-a703-2a675760ee15 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:06.593674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cba75c-65ac-412e-a703-2a675760ee15 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:06.594232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cba75c-65ac-412e-a703-2a675760ee15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:06.607730 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2845/5675] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:39:06 2022] PUT /identity/v3/projects/30609305470944a3807c825dd709a1b2/users/0252c1afca7949d3ba69b5fde4c0d5be/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:06.607958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cba75c-65ac-412e-a703-2a675760ee15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:06.607958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cba75c-65ac-412e-a703-2a675760ee15 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:06.611864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a6073-2f97-4ff0-bf63-b3f6273b5a88 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:06.611864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a6073-2f97-4ff0-bf63-b3f6273b5a88 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:06.611864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a6073-2f97-4ff0-bf63-b3f6273b5a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:06.618014 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2831/5676] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:39:06.641754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b09a6073-2f97-4ff0-bf63-b3f6273b5a88 None None] MFA Rules not processed for user `0252c1afca7949d3ba69b5fde4c0d5be`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:06.643041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b09a6073-2f97-4ff0-bf63-b3f6273b5a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:06.727339 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2846/5677] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:06.738743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cba75c-65ac-412e-a703-2a675760ee15 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:06.740318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b4cba75c-65ac-412e-a703-2a675760ee15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:06.799280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cba75c-65ac-412e-a703-2a675760ee15 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:06.849180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632ed20-46f1-4f64-a513-7a6e8132f349 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:06.849886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632ed20-46f1-4f64-a513-7a6e8132f349 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:06.851567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632ed20-46f1-4f64-a513-7a6e8132f349 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:06.851567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632ed20-46f1-4f64-a513-7a6e8132f349 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:06.864971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632ed20-46f1-4f64-a513-7a6e8132f349 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:06.866661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632ed20-46f1-4f64-a513-7a6e8132f349 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:06.878898 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2832/5678] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:39:07.085613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a6073-2f97-4ff0-bf63-b3f6273b5a88 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:07.087262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b09a6073-2f97-4ff0-bf63-b3f6273b5a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:07.095933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632ed20-46f1-4f64-a513-7a6e8132f349 service cinder] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:07.118050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632ed20-46f1-4f64-a513-7a6e8132f349 service cinder] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:07.119190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570724df-2794-4ebc-b1a5-ae905d5851f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:07.120959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570724df-2794-4ebc-b1a5-ae905d5851f4 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:07.121322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570724df-2794-4ebc-b1a5-ae905d5851f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:07.121674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570724df-2794-4ebc-b1a5-ae905d5851f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:07.123876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-570724df-2794-4ebc-b1a5-ae905d5851f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:07.185662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a6073-2f97-4ff0-bf63-b3f6273b5a88 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:07.191736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c6291-137f-496e-983a-e9da87c38674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:07.192658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c6291-137f-496e-983a-e9da87c38674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:07.193249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c6291-137f-496e-983a-e9da87c38674 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:07.193549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c6291-137f-496e-983a-e9da87c38674 admin admin] PATH_INFO: `/v3/projects/23f09cc5999a47148c6edbb2c0dfebd9` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:07.194459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570724df-2794-4ebc-b1a5-ae905d5851f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:07.195366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c6291-137f-496e-983a-e9da87c38674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23f09cc5999a47148c6edbb2c0dfebd9)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:07.197087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570724df-2794-4ebc-b1a5-ae905d5851f4 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:07.197249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c6291-137f-496e-983a-e9da87c38674 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:07.207886 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2833/5679] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:39:07.321054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-085c6291-137f-496e-983a-e9da87c38674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23f09cc5999a47148c6edbb2c0dfebd9', 'request_id': 'req-085c6291-137f-496e-983a-e9da87c38674'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:07.431725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-085c6291-137f-496e-983a-e9da87c38674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23f09cc5999a47148c6edbb2c0dfebd9', 'request_id': 'req-085c6291-137f-496e-983a-e9da87c38674'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:07.444319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-085c6291-137f-496e-983a-e9da87c38674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23f09cc5999a47148c6edbb2c0dfebd9', 'request_id': 'req-085c6291-137f-496e-983a-e9da87c38674'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:07.455054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-085c6291-137f-496e-983a-e9da87c38674 admin admin] The token cache is being invalidate because project 23f09cc5999a47148c6edbb2c0dfebd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:39:07.455402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-085c6291-137f-496e-983a-e9da87c38674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:07.456071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-085c6291-137f-496e-983a-e9da87c38674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:07.457710 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2847/5680] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:39:07 2022] DELETE /identity/v3/projects/23f09cc5999a47148c6edbb2c0dfebd9 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:07.462185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570724df-2794-4ebc-b1a5-ae905d5851f4 service cinder] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:07.475501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570724df-2794-4ebc-b1a5-ae905d5851f4 service cinder] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:07.533193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e32951-94de-4dc8-aa86-17a6e9da633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:07.534218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e32951-94de-4dc8-aa86-17a6e9da633d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:07.534508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e32951-94de-4dc8-aa86-17a6e9da633d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:07.534787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e32951-94de-4dc8-aa86-17a6e9da633d admin admin] PATH_INFO: `/v3/users/b99fb8ad56d14fec9ef29ff533907f7d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:07.535990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e32951-94de-4dc8-aa86-17a6e9da633d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b99fb8ad56d14fec9ef29ff533907f7d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:07.538019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e32951-94de-4dc8-aa86-17a6e9da633d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:07.733860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-29e32951-94de-4dc8-aa86-17a6e9da633d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b99fb8ad56d14fec9ef29ff533907f7d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:07.746035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-29e32951-94de-4dc8-aa86-17a6e9da633d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b99fb8ad56d14fec9ef29ff533907f7d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:07.746943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-29e32951-94de-4dc8-aa86-17a6e9da633d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b99fb8ad56d14fec9ef29ff533907f7d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:07.755256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-29e32951-94de-4dc8-aa86-17a6e9da633d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b99fb8ad56d14fec9ef29ff533907f7d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:07.888098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-29e32951-94de-4dc8-aa86-17a6e9da633d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b99fb8ad56d14fec9ef29ff533907f7d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:07.894677 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2834/5681] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:39:07 2022] DELETE /identity/v3/users/b99fb8ad56d14fec9ef29ff533907f7d => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:08.503201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c6291-137f-496e-983a-e9da87c38674 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:08.504677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-085c6291-137f-496e-983a-e9da87c38674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:08.518929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c6291-137f-496e-983a-e9da87c38674 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:08.592723 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8744f4-3d44-4c05-b6dd-31ac67c66e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:08.593653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8744f4-3d44-4c05-b6dd-31ac67c66e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:08.593944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8744f4-3d44-4c05-b6dd-31ac67c66e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:08.594223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8744f4-3d44-4c05-b6dd-31ac67c66e58 admin admin] PATH_INFO: `/v3/projects/f0adb32f42a3412780192d24fb893ff4` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:08.595456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8744f4-3d44-4c05-b6dd-31ac67c66e58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0adb32f42a3412780192d24fb893ff4)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:08.597401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8744f4-3d44-4c05-b6dd-31ac67c66e58 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:08.743679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4b8744f4-3d44-4c05-b6dd-31ac67c66e58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0adb32f42a3412780192d24fb893ff4', 'request_id': 'req-4b8744f4-3d44-4c05-b6dd-31ac67c66e58'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:08.810292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4b8744f4-3d44-4c05-b6dd-31ac67c66e58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0adb32f42a3412780192d24fb893ff4', 'request_id': 'req-4b8744f4-3d44-4c05-b6dd-31ac67c66e58'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:08.817994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4b8744f4-3d44-4c05-b6dd-31ac67c66e58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0adb32f42a3412780192d24fb893ff4', 'request_id': 'req-4b8744f4-3d44-4c05-b6dd-31ac67c66e58'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:08.834824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4b8744f4-3d44-4c05-b6dd-31ac67c66e58 admin admin] The token cache is being invalidate because project f0adb32f42a3412780192d24fb893ff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:39:08.834824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4b8744f4-3d44-4c05-b6dd-31ac67c66e58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:08.834824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4b8744f4-3d44-4c05-b6dd-31ac67c66e58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:08.842961 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2848/5682] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:39:08 2022] DELETE /identity/v3/projects/f0adb32f42a3412780192d24fb893ff4 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:08.843386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea85a87-d449-438f-aa4f-609be3cfcfaa None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:08.843386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea85a87-d449-438f-aa4f-609be3cfcfaa None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:08.843386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea85a87-d449-438f-aa4f-609be3cfcfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:08.862607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0ea85a87-d449-438f-aa4f-609be3cfcfaa None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:08.863896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0ea85a87-d449-438f-aa4f-609be3cfcfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:08.934676 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2835/5683] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:08.944116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3f0aa-d0ac-44d7-8061-36ae57ec1f07 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:08.944469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3f0aa-d0ac-44d7-8061-36ae57ec1f07 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:08.944823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3f0aa-d0ac-44d7-8061-36ae57ec1f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:08.965883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-21a3f0aa-d0ac-44d7-8061-36ae57ec1f07 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:08.967293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-21a3f0aa-d0ac-44d7-8061-36ae57ec1f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:08.978031 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2849/5684] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:08.986457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea85a87-d449-438f-aa4f-609be3cfcfaa None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:08.997224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea85a87-d449-438f-aa4f-609be3cfcfaa None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:09.003329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff987cf-66ed-4186-9643-f9b4997cbcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:09.006585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff987cf-66ed-4186-9643-f9b4997cbcc5 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:09.006585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff987cf-66ed-4186-9643-f9b4997cbcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:09.006585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff987cf-66ed-4186-9643-f9b4997cbcc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:09.006585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff987cf-66ed-4186-9643-f9b4997cbcc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:39:09.006585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff987cf-66ed-4186-9643-f9b4997cbcc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:09.007288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff987cf-66ed-4186-9643-f9b4997cbcc5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:09.025204 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2836/5685] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:39:09.026706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3f0aa-d0ac-44d7-8061-36ae57ec1f07 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:09.037749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3f0aa-d0ac-44d7-8061-36ae57ec1f07 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:09.043118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e2761-9b5f-42cc-89e3-17e0694e4fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:09.043796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e2761-9b5f-42cc-89e3-17e0694e4fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:09.044226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e2761-9b5f-42cc-89e3-17e0694e4fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:09.044674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e2761-9b5f-42cc-89e3-17e0694e4fd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:09.045388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e2761-9b5f-42cc-89e3-17e0694e4fd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:09.047308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e2761-9b5f-42cc-89e3-17e0694e4fd3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:09.169463 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2850/5686] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:39:09 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:09.173667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff987cf-66ed-4186-9643-f9b4997cbcc5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:09.184950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff987cf-66ed-4186-9643-f9b4997cbcc5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:09.250448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b92265-8374-4e41-b275-6e0335a505bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:09.251840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b92265-8374-4e41-b275-6e0335a505bf admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:09.252305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b92265-8374-4e41-b275-6e0335a505bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:09.253009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b92265-8374-4e41-b275-6e0335a505bf admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:09.253437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b92265-8374-4e41-b275-6e0335a505bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:09.255454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b92265-8374-4e41-b275-6e0335a505bf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:09.361986 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2837/5687] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:39:09 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:09.365731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e2761-9b5f-42cc-89e3-17e0694e4fd3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:09.377444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e2761-9b5f-42cc-89e3-17e0694e4fd3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:09.383149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20313e8b-e827-4308-abe5-dce7e5022996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:09.384078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20313e8b-e827-4308-abe5-dce7e5022996 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:09.384443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20313e8b-e827-4308-abe5-dce7e5022996 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:09.385186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20313e8b-e827-4308-abe5-dce7e5022996 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:09.385845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20313e8b-e827-4308-abe5-dce7e5022996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:09.388352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20313e8b-e827-4308-abe5-dce7e5022996 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:09.408702 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2851/5688] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:09.412594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b92265-8374-4e41-b275-6e0335a505bf admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:09.427775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b92265-8374-4e41-b275-6e0335a505bf admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:09.432639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccab92-3caa-44e0-b102-3be14cf05ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:09.434128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccab92-3caa-44e0-b102-3be14cf05ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:09.434644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccab92-3caa-44e0-b102-3be14cf05ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:09.435175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccab92-3caa-44e0-b102-3be14cf05ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:09.435890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbccab92-3caa-44e0-b102-3be14cf05ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:09.438122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbccab92-3caa-44e0-b102-3be14cf05ea5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:09.451751 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2838/5689] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:39:09.455770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20313e8b-e827-4308-abe5-dce7e5022996 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:09.467510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20313e8b-e827-4308-abe5-dce7e5022996 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:09.476547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927ebdc-5909-42b5-82d8-e895346061bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:09.477525 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927ebdc-5909-42b5-82d8-e895346061bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:09.478324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927ebdc-5909-42b5-82d8-e895346061bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:09.478745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927ebdc-5909-42b5-82d8-e895346061bc admin admin] PATH_INFO: `/v3/projects/40afb02c291442b4ab3bd74861435e91/users/db39ac61a9314a4a9372f76586af5bf3/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:09.501398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927ebdc-5909-42b5-82d8-e895346061bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=40afb02c291442b4ab3bd74861435e91, user_id=db39ac61a9314a4a9372f76586af5bf3, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:09.517025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927ebdc-5909-42b5-82d8-e895346061bc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:09.716092 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2852/5690] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:39:09 2022] PUT /identity/v3/projects/40afb02c291442b4ab3bd74861435e91/users/db39ac61a9314a4a9372f76586af5bf3/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:09.718431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebae6a-aa07-4f9d-8e0d-74492ed8b6bc None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:09.718863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebae6a-aa07-4f9d-8e0d-74492ed8b6bc None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:09.719245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebae6a-aa07-4f9d-8e0d-74492ed8b6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:09.780495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e3ebae6a-aa07-4f9d-8e0d-74492ed8b6bc None None] MFA Rules not processed for user `db39ac61a9314a4a9372f76586af5bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:09.782610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e3ebae6a-aa07-4f9d-8e0d-74492ed8b6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:09.913460 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2839/5691] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:09.927134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927ebdc-5909-42b5-82d8-e895346061bc admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:09.929227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9927ebdc-5909-42b5-82d8-e895346061bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:10.015725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927ebdc-5909-42b5-82d8-e895346061bc admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:10.019555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab4c02-b459-47ab-a656-e263c0c8172e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:10.020223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab4c02-b459-47ab-a656-e263c0c8172e service glance] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:10.021066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab4c02-b459-47ab-a656-e263c0c8172e service glance] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:10.021346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab4c02-b459-47ab-a656-e263c0c8172e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:10.031082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab4c02-b459-47ab-a656-e263c0c8172e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:10.032816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab4c02-b459-47ab-a656-e263c0c8172e service glance] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:10.043991 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2853/5692] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:39:10.331435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f10d06-73ae-4130-abed-91ca4acf5f6b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:10.332367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f10d06-73ae-4130-abed-91ca4acf5f6b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:10.332676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f10d06-73ae-4130-abed-91ca4acf5f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:10.360245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-35f10d06-73ae-4130-abed-91ca4acf5f6b None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:10.361856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-35f10d06-73ae-4130-abed-91ca4acf5f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:10.439164 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2840/5693] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:39:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:10.594497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab4c02-b459-47ab-a656-e263c0c8172e service glance] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:10.595961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a3ab4c02-b459-47ab-a656-e263c0c8172e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:10.683906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab4c02-b459-47ab-a656-e263c0c8172e service glance] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:10.689239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b172d-5299-4b52-be68-965114a79b5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:10.689902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b172d-5299-4b52-be68-965114a79b5d service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:10.690501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b172d-5299-4b52-be68-965114a79b5d service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:10.690940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b172d-5299-4b52-be68-965114a79b5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:10.699783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b172d-5299-4b52-be68-965114a79b5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:10.701641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b172d-5299-4b52-be68-965114a79b5d service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:10.711088 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2854/5694] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:39:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:39:11.611865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb65e9-04a6-44f1-9ed2-2dd3285902bb None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:11.612367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb65e9-04a6-44f1-9ed2-2dd3285902bb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:11.612477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb65e9-04a6-44f1-9ed2-2dd3285902bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:11.639371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2abb65e9-04a6-44f1-9ed2-2dd3285902bb None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:11.640507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2abb65e9-04a6-44f1-9ed2-2dd3285902bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:11.649283 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2841/5695] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:39:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:11.666457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b172d-5299-4b52-be68-965114a79b5d service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:11.678644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b172d-5299-4b52-be68-965114a79b5d service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:11.685613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c9c0e-70dc-445c-a9a9-32f5e094fb19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:11.686295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c9c0e-70dc-445c-a9a9-32f5e094fb19 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:11.686792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c9c0e-70dc-445c-a9a9-32f5e094fb19 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:11.686914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c9c0e-70dc-445c-a9a9-32f5e094fb19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:11.697478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c9c0e-70dc-445c-a9a9-32f5e094fb19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:11.699963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c9c0e-70dc-445c-a9a9-32f5e094fb19 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:11.710241 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2855/5696] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:39:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:39:12.293145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb65e9-04a6-44f1-9ed2-2dd3285902bb None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:12.300987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2abb65e9-04a6-44f1-9ed2-2dd3285902bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:12.411096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb65e9-04a6-44f1-9ed2-2dd3285902bb None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:12.422556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2cc8d-5e9d-47f9-b8e3-a07b985a78b0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:12.427561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2cc8d-5e9d-47f9-b8e3-a07b985a78b0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:12.427561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2cc8d-5e9d-47f9-b8e3-a07b985a78b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:12.432541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e3f73-1ca0-4e42-b52a-c30a4c60d08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:12.433898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e3f73-1ca0-4e42-b52a-c30a4c60d08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:12.436850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e3f73-1ca0-4e42-b52a-c30a4c60d08b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:12.437263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e3f73-1ca0-4e42-b52a-c30a4c60d08b admin admin] PATH_INFO: `/v3/users/f70906b656804455a60b4be9f825869d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:12.441523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e3f73-1ca0-4e42-b52a-c30a4c60d08b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f70906b656804455a60b4be9f825869d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:12.444335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e3f73-1ca0-4e42-b52a-c30a4c60d08b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:12.471355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-40b2cc8d-5e9d-47f9-b8e3-a07b985a78b0 None None] MFA Rules not processed for user `26723e7d6f3d44a4951432f45c89021a`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:12.472703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-40b2cc8d-5e9d-47f9-b8e3-a07b985a78b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:12.554680 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2856/5697] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:12.578708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2cc8d-5e9d-47f9-b8e3-a07b985a78b0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:12.580715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-40b2cc8d-5e9d-47f9-b8e3-a07b985a78b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:12.687467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2cc8d-5e9d-47f9-b8e3-a07b985a78b0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:12.693011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee80756-139d-4613-aa44-17a76b56962f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:12.693662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee80756-139d-4613-aa44-17a76b56962f service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:12.693949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee80756-139d-4613-aa44-17a76b56962f service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:12.694228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee80756-139d-4613-aa44-17a76b56962f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:12.702299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee80756-139d-4613-aa44-17a76b56962f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:12.703893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee80756-139d-4613-aa44-17a76b56962f service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:12.714593 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2857/5698] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:39:12.757575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d90e3f73-1ca0-4e42-b52a-c30a4c60d08b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f70906b656804455a60b4be9f825869d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:12.775241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d90e3f73-1ca0-4e42-b52a-c30a4c60d08b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f70906b656804455a60b4be9f825869d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:12.776897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d90e3f73-1ca0-4e42-b52a-c30a4c60d08b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f70906b656804455a60b4be9f825869d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:12.801291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d90e3f73-1ca0-4e42-b52a-c30a4c60d08b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f70906b656804455a60b4be9f825869d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:12.925363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d90e3f73-1ca0-4e42-b52a-c30a4c60d08b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f70906b656804455a60b4be9f825869d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:12.944145 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2842/5699] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:39:12 2022] DELETE /identity/v3/users/f70906b656804455a60b4be9f825869d => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:12.945183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b25f5-b16e-4788-9b7c-89676b9df6f0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:12.945183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b25f5-b16e-4788-9b7c-89676b9df6f0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:12.945183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b25f5-b16e-4788-9b7c-89676b9df6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:12.956800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b4046-c8f7-4b5c-93bc-a1928b619b22 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:12.957100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b4046-c8f7-4b5c-93bc-a1928b619b22 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:12.957400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b4046-c8f7-4b5c-93bc-a1928b619b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:12.961198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-289b25f5-b16e-4788-9b7c-89676b9df6f0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:12.962651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-289b25f5-b16e-4788-9b7c-89676b9df6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:12.977197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-430b4046-c8f7-4b5c-93bc-a1928b619b22 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:12.978530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-430b4046-c8f7-4b5c-93bc-a1928b619b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:13.031516 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2858/5700] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:13.043805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b25f5-b16e-4788-9b7c-89676b9df6f0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:13.045939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-289b25f5-b16e-4788-9b7c-89676b9df6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:13.053263 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2843/5701] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:39:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:13.066945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b4046-c8f7-4b5c-93bc-a1928b619b22 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:13.068945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-430b4046-c8f7-4b5c-93bc-a1928b619b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:13.136806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b25f5-b16e-4788-9b7c-89676b9df6f0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:13.142027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97309ae3-d1f8-470c-8252-30a80342767d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:13.142782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97309ae3-d1f8-470c-8252-30a80342767d service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:13.143071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97309ae3-d1f8-470c-8252-30a80342767d service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:13.143356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97309ae3-d1f8-470c-8252-30a80342767d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:13.149840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b4046-c8f7-4b5c-93bc-a1928b619b22 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:13.156189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4495a-7e66-422e-b803-47015dc1a888 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:13.156930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4495a-7e66-422e-b803-47015dc1a888 service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:13.174910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4495a-7e66-422e-b803-47015dc1a888 service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:13.174910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4495a-7e66-422e-b803-47015dc1a888 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:13.175180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97309ae3-d1f8-470c-8252-30a80342767d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:13.175180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97309ae3-d1f8-470c-8252-30a80342767d service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:13.175374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4495a-7e66-422e-b803-47015dc1a888 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:13.175374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4495a-7e66-422e-b803-47015dc1a888 service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:13.175593 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2859/5702] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:39:13.177540 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2844/5703] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:39:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:39:13.423921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97309ae3-d1f8-470c-8252-30a80342767d service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:13.425634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-97309ae3-d1f8-470c-8252-30a80342767d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:13.443041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97309ae3-d1f8-470c-8252-30a80342767d service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:13.448103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c993cb8-9102-41d1-9bca-463f80ad1ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:13.453443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c993cb8-9102-41d1-9bca-463f80ad1ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:13.453443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c993cb8-9102-41d1-9bca-463f80ad1ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:13.453443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c993cb8-9102-41d1-9bca-463f80ad1ecd admin admin] PATH_INFO: `/v3/projects/56a059bb653d412f81c66dfd5c50806c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:13.453443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c993cb8-9102-41d1-9bca-463f80ad1ecd admin admin] RBAC: Authorizing `identity:delete_project(project_id=56a059bb653d412f81c66dfd5c50806c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:13.453443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c993cb8-9102-41d1-9bca-463f80ad1ecd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:13.594261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1c993cb8-9102-41d1-9bca-463f80ad1ecd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56a059bb653d412f81c66dfd5c50806c', 'request_id': 'req-1c993cb8-9102-41d1-9bca-463f80ad1ecd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:13.601400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1d947-1e9c-4eb6-b6fb-6cb69e02aef6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:13.601770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1d947-1e9c-4eb6-b6fb-6cb69e02aef6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:13.602518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1d947-1e9c-4eb6-b6fb-6cb69e02aef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:13.623385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-43d1d947-1e9c-4eb6-b6fb-6cb69e02aef6 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:13.625076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-43d1d947-1e9c-4eb6-b6fb-6cb69e02aef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:13.678899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1c993cb8-9102-41d1-9bca-463f80ad1ecd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56a059bb653d412f81c66dfd5c50806c', 'request_id': 'req-1c993cb8-9102-41d1-9bca-463f80ad1ecd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:13.687066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1c993cb8-9102-41d1-9bca-463f80ad1ecd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56a059bb653d412f81c66dfd5c50806c', 'request_id': 'req-1c993cb8-9102-41d1-9bca-463f80ad1ecd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:13.696809 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2845/5704] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:39:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:13.699348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1c993cb8-9102-41d1-9bca-463f80ad1ecd admin admin] The token cache is being invalidate because project 56a059bb653d412f81c66dfd5c50806c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:39:13.699864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1c993cb8-9102-41d1-9bca-463f80ad1ecd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:13.700572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1c993cb8-9102-41d1-9bca-463f80ad1ecd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:13.702238 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2860/5705] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:39:13 2022] DELETE /identity/v3/projects/56a059bb653d412f81c66dfd5c50806c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:13.705745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1d947-1e9c-4eb6-b6fb-6cb69e02aef6 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:13.714628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc1235-9a67-4f55-aa4d-0ba48ee965f7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:13.714628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc1235-9a67-4f55-aa4d-0ba48ee965f7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:13.714628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc1235-9a67-4f55-aa4d-0ba48ee965f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:13.729754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-99fc1235-9a67-4f55-aa4d-0ba48ee965f7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:13.731308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-99fc1235-9a67-4f55-aa4d-0ba48ee965f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:13.785290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1d947-1e9c-4eb6-b6fb-6cb69e02aef6 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:13.792796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1becb-ea04-4154-9d2e-0d12a580d8bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:13.793643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1becb-ea04-4154-9d2e-0d12a580d8bb service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:13.794559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1becb-ea04-4154-9d2e-0d12a580d8bb service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:13.795067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1becb-ea04-4154-9d2e-0d12a580d8bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:13.797089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4bd1becb-ea04-4154-9d2e-0d12a580d8bb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:13.809733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1becb-ea04-4154-9d2e-0d12a580d8bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:13.811346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1becb-ea04-4154-9d2e-0d12a580d8bb service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:13.823160 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2846/5706] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:39:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 02 10:39:13.873383 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2861/5707] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:13.881652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca058d3-97de-401f-bd98-c0ce5a7df888 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:13.881846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca058d3-97de-401f-bd98-c0ce5a7df888 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:13.882049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca058d3-97de-401f-bd98-c0ce5a7df888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:13.905536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3ca058d3-97de-401f-bd98-c0ce5a7df888 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:13.906855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3ca058d3-97de-401f-bd98-c0ce5a7df888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:13.916851 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2847/5708] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:13.921624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc1235-9a67-4f55-aa4d-0ba48ee965f7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:13.933590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc1235-9a67-4f55-aa4d-0ba48ee965f7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:13.945437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd731e-44df-4665-a53e-5089ee1ac805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:13.946135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd731e-44df-4665-a53e-5089ee1ac805 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:13.946426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd731e-44df-4665-a53e-5089ee1ac805 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:13.946713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd731e-44df-4665-a53e-5089ee1ac805 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:13.947502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd731e-44df-4665-a53e-5089ee1ac805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:39:13.947808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd731e-44df-4665-a53e-5089ee1ac805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:13.951337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd731e-44df-4665-a53e-5089ee1ac805 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:13.967837 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2862/5709] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:39:13.972183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca058d3-97de-401f-bd98-c0ce5a7df888 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:13.991359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca058d3-97de-401f-bd98-c0ce5a7df888 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:13.999363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4cf29-3775-46cb-8a07-a5a1f1222b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:14.000039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4cf29-3775-46cb-8a07-a5a1f1222b9f admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:14.000322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4cf29-3775-46cb-8a07-a5a1f1222b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:14.000617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4cf29-3775-46cb-8a07-a5a1f1222b9f admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:14.001667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4cf29-3775-46cb-8a07-a5a1f1222b9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:14.003639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4cf29-3775-46cb-8a07-a5a1f1222b9f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:14.178083 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2848/5710] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:39:13 2022] POST /identity/v3/projects => generated 377 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:14.182260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd731e-44df-4665-a53e-5089ee1ac805 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:14.193274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd731e-44df-4665-a53e-5089ee1ac805 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:14.278396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a753c83-f6c2-4a8a-b8d4-47300b6f6c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:14.280548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a753c83-f6c2-4a8a-b8d4-47300b6f6c14 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:14.280548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a753c83-f6c2-4a8a-b8d4-47300b6f6c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:14.280548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a753c83-f6c2-4a8a-b8d4-47300b6f6c14 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:14.281196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a753c83-f6c2-4a8a-b8d4-47300b6f6c14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:14.283114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a753c83-f6c2-4a8a-b8d4-47300b6f6c14 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:14.364502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4cf29-3775-46cb-8a07-a5a1f1222b9f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:14.371115 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2863/5711] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:39:14 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:14.377421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4cf29-3775-46cb-8a07-a5a1f1222b9f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:14.390071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e5365-6059-4ed1-a5de-afb59e802155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:14.390792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e5365-6059-4ed1-a5de-afb59e802155 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:14.391079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e5365-6059-4ed1-a5de-afb59e802155 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:14.391358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e5365-6059-4ed1-a5de-afb59e802155 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:14.392091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e5365-6059-4ed1-a5de-afb59e802155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:14.393840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e5365-6059-4ed1-a5de-afb59e802155 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:14.405593 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2849/5712] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:14.409716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a753c83-f6c2-4a8a-b8d4-47300b6f6c14 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:14.419782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a753c83-f6c2-4a8a-b8d4-47300b6f6c14 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:14.424389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4adb16-e624-4131-a48d-0385810ffb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:14.425151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4adb16-e624-4131-a48d-0385810ffb3d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:14.425536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4adb16-e624-4131-a48d-0385810ffb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:14.425817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4adb16-e624-4131-a48d-0385810ffb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:14.428321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4adb16-e624-4131-a48d-0385810ffb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:14.428321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4adb16-e624-4131-a48d-0385810ffb3d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:14.437939 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2864/5713] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:14.442164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e5365-6059-4ed1-a5de-afb59e802155 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:14.453710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e5365-6059-4ed1-a5de-afb59e802155 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:14.459224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b7bcb-533e-4ef8-b269-d2220bdc972d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:14.460236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b7bcb-533e-4ef8-b269-d2220bdc972d admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:14.460684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b7bcb-533e-4ef8-b269-d2220bdc972d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:14.460973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b7bcb-533e-4ef8-b269-d2220bdc972d admin admin] PATH_INFO: `/v3/projects/6fb3f9dce951489aafe56b0d30841164/users/a6cd9c820ef74b2f9ef7db7846159495/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:14.476866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b7bcb-533e-4ef8-b269-d2220bdc972d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb3f9dce951489aafe56b0d30841164, user_id=a6cd9c820ef74b2f9ef7db7846159495, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:14.479593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b7bcb-533e-4ef8-b269-d2220bdc972d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:14.575836 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2850/5714] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:39:14 2022] PUT /identity/v3/projects/6fb3f9dce951489aafe56b0d30841164/users/a6cd9c820ef74b2f9ef7db7846159495/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:14.587530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cebe4a-ffa6-461d-9ce6-42a683d9c612 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:14.587787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cebe4a-ffa6-461d-9ce6-42a683d9c612 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:14.588991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cebe4a-ffa6-461d-9ce6-42a683d9c612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:14.623789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f93ebe-6e3b-46f9-93e7-27f264a76ac0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:14.624084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f93ebe-6e3b-46f9-93e7-27f264a76ac0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:14.624366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f93ebe-6e3b-46f9-93e7-27f264a76ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:14.633381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b2cebe4a-ffa6-461d-9ce6-42a683d9c612 None None] MFA Rules not processed for user `a6cd9c820ef74b2f9ef7db7846159495`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:14.636593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b2cebe4a-ffa6-461d-9ce6-42a683d9c612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:14.647220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f1f93ebe-6e3b-46f9-93e7-27f264a76ac0 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:14.648781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f1f93ebe-6e3b-46f9-93e7-27f264a76ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:14.734186 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2851/5715] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:39:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:14.743378 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2865/5716] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:14.750449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f93ebe-6e3b-46f9-93e7-27f264a76ac0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:14.753075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f1f93ebe-6e3b-46f9-93e7-27f264a76ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:14.770799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cebe4a-ffa6-461d-9ce6-42a683d9c612 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:14.770799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b2cebe4a-ffa6-461d-9ce6-42a683d9c612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:14.830920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f93ebe-6e3b-46f9-93e7-27f264a76ac0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:14.844645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f9f4c-a60a-4a8b-b635-cc78f0585a05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:14.845193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cebe4a-ffa6-461d-9ce6-42a683d9c612 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:14.845721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f9f4c-a60a-4a8b-b635-cc78f0585a05 service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:14.846015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f9f4c-a60a-4a8b-b635-cc78f0585a05 service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:14.846342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f9f4c-a60a-4a8b-b635-cc78f0585a05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:14.852230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30b9cf-fe98-45e4-884b-a56170f504ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:14.853297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30b9cf-fe98-45e4-884b-a56170f504ff service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:14.854970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30b9cf-fe98-45e4-884b-a56170f504ff service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:14.855484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30b9cf-fe98-45e4-884b-a56170f504ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:14.861757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f9f4c-a60a-4a8b-b635-cc78f0585a05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:14.866993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f9f4c-a60a-4a8b-b635-cc78f0585a05 service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:14.874237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30b9cf-fe98-45e4-884b-a56170f504ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:14.876780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30b9cf-fe98-45e4-884b-a56170f504ff service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:14.887130 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2852/5717] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:39:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:39:14.912251 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2866/5718] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:39:15.301958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f9f4c-a60a-4a8b-b635-cc78f0585a05 service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:15.304418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-102f9f4c-a60a-4a8b-b635-cc78f0585a05 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:15.406099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f9f4c-a60a-4a8b-b635-cc78f0585a05 service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:15.412890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3684001-6076-44a6-8de2-208184944618 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:15.413212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3684001-6076-44a6-8de2-208184944618 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:15.414311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3684001-6076-44a6-8de2-208184944618 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:15.414311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3684001-6076-44a6-8de2-208184944618 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:15.415657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c3684001-6076-44a6-8de2-208184944618 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:15.491645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3684001-6076-44a6-8de2-208184944618 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:15.493311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3684001-6076-44a6-8de2-208184944618 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:15.564218 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2853/5719] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:39:15.671629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc0966-0b19-4576-9458-a457f210ce0c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:15.671933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc0966-0b19-4576-9458-a457f210ce0c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:15.672244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc0966-0b19-4576-9458-a457f210ce0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:15.693068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-68dc0966-0b19-4576-9458-a457f210ce0c None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:15.694377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-68dc0966-0b19-4576-9458-a457f210ce0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:15.717068 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2867/5720] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:39:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:16.067776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3684001-6076-44a6-8de2-208184944618 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:16.067776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3684001-6076-44a6-8de2-208184944618 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:16.067776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d181d7-4d57-4e74-a51d-113366b9dadc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:16.067776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d181d7-4d57-4e74-a51d-113366b9dadc service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:16.074974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d181d7-4d57-4e74-a51d-113366b9dadc service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:16.074974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d181d7-4d57-4e74-a51d-113366b9dadc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:16.074974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d181d7-4d57-4e74-a51d-113366b9dadc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:16.074974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d181d7-4d57-4e74-a51d-113366b9dadc service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:16.074974 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2854/5721] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:39:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:39:16.076777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc0966-0b19-4576-9458-a457f210ce0c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:16.076777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc0966-0b19-4576-9458-a457f210ce0c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:16.076777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ca63f-7826-42ad-a9c4-c346b6356722 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:16.076777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ca63f-7826-42ad-a9c4-c346b6356722 service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:16.078778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ca63f-7826-42ad-a9c4-c346b6356722 service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:16.078778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ca63f-7826-42ad-a9c4-c346b6356722 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:16.078778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-100ca63f-7826-42ad-a9c4-c346b6356722 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:16.179116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ca63f-7826-42ad-a9c4-c346b6356722 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:16.180935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ca63f-7826-42ad-a9c4-c346b6356722 service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:16.202704 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2868/5722] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:39:16.610664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d181d7-4d57-4e74-a51d-113366b9dadc service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:16.612248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c7d181d7-4d57-4e74-a51d-113366b9dadc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:16.626997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9df95-8840-4075-96fc-74b3a6b38ec9 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:16.630349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9df95-8840-4075-96fc-74b3a6b38ec9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:16.630349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9df95-8840-4075-96fc-74b3a6b38ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:16.655014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-97f9df95-8840-4075-96fc-74b3a6b38ec9 None None] MFA Rules not processed for user `26723e7d6f3d44a4951432f45c89021a`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:16.657704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-97f9df95-8840-4075-96fc-74b3a6b38ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:16.731547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d181d7-4d57-4e74-a51d-113366b9dadc service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:16.738463 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2869/5723] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:16.742110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0dcdb-263c-4b45-99e0-63e8b1bbf957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:16.743193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0dcdb-263c-4b45-99e0-63e8b1bbf957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:16.743640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0dcdb-263c-4b45-99e0-63e8b1bbf957 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:16.743990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0dcdb-263c-4b45-99e0-63e8b1bbf957 admin admin] PATH_INFO: `/v3/users/db39ac61a9314a4a9372f76586af5bf3` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:16.745561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0dcdb-263c-4b45-99e0-63e8b1bbf957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db39ac61a9314a4a9372f76586af5bf3)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:16.748129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0dcdb-263c-4b45-99e0-63e8b1bbf957 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:17.013004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b3f0dcdb-263c-4b45-99e0-63e8b1bbf957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db39ac61a9314a4a9372f76586af5bf3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:17.025958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b3f0dcdb-263c-4b45-99e0-63e8b1bbf957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db39ac61a9314a4a9372f76586af5bf3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:17.029093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b3f0dcdb-263c-4b45-99e0-63e8b1bbf957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db39ac61a9314a4a9372f76586af5bf3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:17.039220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b3f0dcdb-263c-4b45-99e0-63e8b1bbf957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db39ac61a9314a4a9372f76586af5bf3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:17.122420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b3f0dcdb-263c-4b45-99e0-63e8b1bbf957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db39ac61a9314a4a9372f76586af5bf3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:17.129128 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2855/5724] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:39:16 2022] DELETE /identity/v3/users/db39ac61a9314a4a9372f76586af5bf3 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:17.133942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643639f-356c-47c3-a7d3-7dd65ab866ba None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:17.134382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643639f-356c-47c3-a7d3-7dd65ab866ba None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:17.134507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643639f-356c-47c3-a7d3-7dd65ab866ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:17.152899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-5643639f-356c-47c3-a7d3-7dd65ab866ba None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:17.154208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5643639f-356c-47c3-a7d3-7dd65ab866ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:17.212420 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2870/5725] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:17.222519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0dcdb-263c-4b45-99e0-63e8b1bbf957 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:17.223950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b3f0dcdb-263c-4b45-99e0-63e8b1bbf957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:17.288591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0dcdb-263c-4b45-99e0-63e8b1bbf957 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:17.293570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55731a7f-28d0-4bdb-866e-2fd10bc9055f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:17.294354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55731a7f-28d0-4bdb-866e-2fd10bc9055f service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:17.294653 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55731a7f-28d0-4bdb-866e-2fd10bc9055f service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:17.294931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55731a7f-28d0-4bdb-866e-2fd10bc9055f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:17.305396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55731a7f-28d0-4bdb-866e-2fd10bc9055f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:17.307622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55731a7f-28d0-4bdb-866e-2fd10bc9055f service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:17.318779 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2856/5726] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:39:17.748464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643639f-356c-47c3-a7d3-7dd65ab866ba None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:17.749929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5643639f-356c-47c3-a7d3-7dd65ab866ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:17.762278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643639f-356c-47c3-a7d3-7dd65ab866ba None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:17.767179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5fa96-2663-4b98-8dc3-5f8a811d5fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:17.768073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5fa96-2663-4b98-8dc3-5f8a811d5fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:17.768335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5fa96-2663-4b98-8dc3-5f8a811d5fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:17.768637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5fa96-2663-4b98-8dc3-5f8a811d5fc7 admin admin] PATH_INFO: `/v3/projects/40afb02c291442b4ab3bd74861435e91` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:17.769835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5fa96-2663-4b98-8dc3-5f8a811d5fc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40afb02c291442b4ab3bd74861435e91)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:17.772517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5fa96-2663-4b98-8dc3-5f8a811d5fc7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:17.877133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fdf5fa96-2663-4b98-8dc3-5f8a811d5fc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40afb02c291442b4ab3bd74861435e91', 'request_id': 'req-fdf5fa96-2663-4b98-8dc3-5f8a811d5fc7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:17.956360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fdf5fa96-2663-4b98-8dc3-5f8a811d5fc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40afb02c291442b4ab3bd74861435e91', 'request_id': 'req-fdf5fa96-2663-4b98-8dc3-5f8a811d5fc7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:17.963404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fdf5fa96-2663-4b98-8dc3-5f8a811d5fc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40afb02c291442b4ab3bd74861435e91', 'request_id': 'req-fdf5fa96-2663-4b98-8dc3-5f8a811d5fc7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:17.973881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fdf5fa96-2663-4b98-8dc3-5f8a811d5fc7 admin admin] The token cache is being invalidate because project 40afb02c291442b4ab3bd74861435e91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:39:17.974177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fdf5fa96-2663-4b98-8dc3-5f8a811d5fc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:17.974824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fdf5fa96-2663-4b98-8dc3-5f8a811d5fc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:17.976398 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2871/5727] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:39:17 2022] DELETE /identity/v3/projects/40afb02c291442b4ab3bd74861435e91 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:17.986972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a3bd0-8df5-46c5-ae37-15fa64c63906 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:17.987333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a3bd0-8df5-46c5-ae37-15fa64c63906 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:17.987664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a3bd0-8df5-46c5-ae37-15fa64c63906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:18.006043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b32a3bd0-8df5-46c5-ae37-15fa64c63906 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:18.007349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b32a3bd0-8df5-46c5-ae37-15fa64c63906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:18.066886 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2857/5728] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:18.078744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9e292-c0bb-4e65-9ca2-58c8b881359d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:18.079052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9e292-c0bb-4e65-9ca2-58c8b881359d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:18.079343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9e292-c0bb-4e65-9ca2-58c8b881359d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:18.098517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9cb9e292-c0bb-4e65-9ca2-58c8b881359d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:18.099754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9cb9e292-c0bb-4e65-9ca2-58c8b881359d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:18.107977 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2872/5729] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:18.112393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a3bd0-8df5-46c5-ae37-15fa64c63906 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:18.122167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a3bd0-8df5-46c5-ae37-15fa64c63906 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:18.127091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5949d81-2428-419a-9fb4-82150f021f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:18.127748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5949d81-2428-419a-9fb4-82150f021f36 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:18.128033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5949d81-2428-419a-9fb4-82150f021f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:18.128314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5949d81-2428-419a-9fb4-82150f021f36 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:18.129071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5949d81-2428-419a-9fb4-82150f021f36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:39:18.129438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5949d81-2428-419a-9fb4-82150f021f36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:18.131047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5949d81-2428-419a-9fb4-82150f021f36 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:18.142948 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2858/5730] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:39:18.146933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9e292-c0bb-4e65-9ca2-58c8b881359d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:18.156953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9e292-c0bb-4e65-9ca2-58c8b881359d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:18.161669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7ae61-e568-430e-ad1b-dd56fdf7a50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:18.162330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7ae61-e568-430e-ad1b-dd56fdf7a50d admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:18.162619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7ae61-e568-430e-ad1b-dd56fdf7a50d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:18.162901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7ae61-e568-430e-ad1b-dd56fdf7a50d admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:18.163621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7ae61-e568-430e-ad1b-dd56fdf7a50d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:18.165572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7ae61-e568-430e-ad1b-dd56fdf7a50d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:18.272045 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2873/5731] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:39:18 2022] POST /identity/v3/projects => generated 363 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:18.276752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5949d81-2428-419a-9fb4-82150f021f36 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:18.286803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5949d81-2428-419a-9fb4-82150f021f36 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:18.349374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4db79-68f6-40fa-b811-4fe6949bcef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:18.349999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4db79-68f6-40fa-b811-4fe6949bcef2 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:18.350285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4db79-68f6-40fa-b811-4fe6949bcef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:18.350568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4db79-68f6-40fa-b811-4fe6949bcef2 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:18.351275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4db79-68f6-40fa-b811-4fe6949bcef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:18.353395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4db79-68f6-40fa-b811-4fe6949bcef2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:18.426441 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2859/5732] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:39:18 2022] POST /identity/v3/users => generated 282 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:18.430674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7ae61-e568-430e-ad1b-dd56fdf7a50d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:18.441622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7ae61-e568-430e-ad1b-dd56fdf7a50d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:18.446432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a94bca-e035-419b-adcf-1049015440a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:18.447721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a94bca-e035-419b-adcf-1049015440a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:18.448015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a94bca-e035-419b-adcf-1049015440a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:18.448309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a94bca-e035-419b-adcf-1049015440a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:18.449073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a94bca-e035-419b-adcf-1049015440a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:18.450673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a94bca-e035-419b-adcf-1049015440a6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:18.461047 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2874/5733] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:18.465096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4db79-68f6-40fa-b811-4fe6949bcef2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:18.475155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4db79-68f6-40fa-b811-4fe6949bcef2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:18.480054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7ea2e-cbb7-4efa-977b-8a0caa7f3fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:18.480749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7ea2e-cbb7-4efa-977b-8a0caa7f3fbc admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:18.481039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7ea2e-cbb7-4efa-977b-8a0caa7f3fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:18.481322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7ea2e-cbb7-4efa-977b-8a0caa7f3fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:18.482048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7ea2e-cbb7-4efa-977b-8a0caa7f3fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:18.483654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7ea2e-cbb7-4efa-977b-8a0caa7f3fbc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:18.493371 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2860/5734] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:18.497859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a94bca-e035-419b-adcf-1049015440a6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:18.507831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a94bca-e035-419b-adcf-1049015440a6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:18.513054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c66c0c-1b2f-410d-933f-e244e4c8c2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:18.513927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c66c0c-1b2f-410d-933f-e244e4c8c2d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:18.514209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c66c0c-1b2f-410d-933f-e244e4c8c2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:18.514484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c66c0c-1b2f-410d-933f-e244e4c8c2d5 admin admin] PATH_INFO: `/v3/projects/931f9a49ea3d417c89723fa4d5ca32e9/users/3fb4e1c100ce4baf91288601ad328f98/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:18.528829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c66c0c-1b2f-410d-933f-e244e4c8c2d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=931f9a49ea3d417c89723fa4d5ca32e9, user_id=3fb4e1c100ce4baf91288601ad328f98, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:18.531479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c66c0c-1b2f-410d-933f-e244e4c8c2d5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:18.627234 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2875/5735] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:39:18 2022] PUT /identity/v3/projects/931f9a49ea3d417c89723fa4d5ca32e9/users/3fb4e1c100ce4baf91288601ad328f98/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:18.639566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafbb3a-c96b-415a-85aa-ae5db0d9b042 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:18.639965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafbb3a-c96b-415a-85aa-ae5db0d9b042 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:18.640352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafbb3a-c96b-415a-85aa-ae5db0d9b042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:18.672591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5eafbb3a-c96b-415a-85aa-ae5db0d9b042 None None] MFA Rules not processed for user `3fb4e1c100ce4baf91288601ad328f98`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:18.673862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5eafbb3a-c96b-415a-85aa-ae5db0d9b042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:18.741378 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2861/5736] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:18 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:18.753651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c66c0c-1b2f-410d-933f-e244e4c8c2d5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:18.755390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-42c66c0c-1b2f-410d-933f-e244e4c8c2d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:18.812181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c66c0c-1b2f-410d-933f-e244e4c8c2d5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:18.816103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338369b4-ab4f-4b92-be5d-87545bf59f07 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:18.816840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338369b4-ab4f-4b92-be5d-87545bf59f07 service glance] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:18.817131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338369b4-ab4f-4b92-be5d-87545bf59f07 service glance] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:18.817415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338369b4-ab4f-4b92-be5d-87545bf59f07 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:18.826034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338369b4-ab4f-4b92-be5d-87545bf59f07 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:18.827613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338369b4-ab4f-4b92-be5d-87545bf59f07 service glance] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:18.836538 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2876/5737] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:18 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:39:19.564089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafbb3a-c96b-415a-85aa-ae5db0d9b042 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:19.626363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafbb3a-c96b-415a-85aa-ae5db0d9b042 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:19.631236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464f789-4367-4347-9b6f-d1428bf3eb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:19.632107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464f789-4367-4347-9b6f-d1428bf3eb37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:19.632394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464f789-4367-4347-9b6f-d1428bf3eb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:19.632709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464f789-4367-4347-9b6f-d1428bf3eb37 admin admin] PATH_INFO: `/v3/users/3fb4e1c100ce4baf91288601ad328f98` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:19.633905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464f789-4367-4347-9b6f-d1428bf3eb37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb4e1c100ce4baf91288601ad328f98)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:19.636393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464f789-4367-4347-9b6f-d1428bf3eb37 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:19.840692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5464f789-4367-4347-9b6f-d1428bf3eb37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb4e1c100ce4baf91288601ad328f98'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:19.852369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5464f789-4367-4347-9b6f-d1428bf3eb37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb4e1c100ce4baf91288601ad328f98'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:19.853077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5464f789-4367-4347-9b6f-d1428bf3eb37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb4e1c100ce4baf91288601ad328f98'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:19.859907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5464f789-4367-4347-9b6f-d1428bf3eb37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb4e1c100ce4baf91288601ad328f98'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:19.964195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5464f789-4367-4347-9b6f-d1428bf3eb37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb4e1c100ce4baf91288601ad328f98'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:19.970540 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2862/5738] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:39:19 2022] DELETE /identity/v3/users/3fb4e1c100ce4baf91288601ad328f98 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:19.975188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3604e5a-82e6-4399-ab2d-1ef2d98ed558 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:19.975668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3604e5a-82e6-4399-ab2d-1ef2d98ed558 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:19.975962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3604e5a-82e6-4399-ab2d-1ef2d98ed558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:19.995672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c3604e5a-82e6-4399-ab2d-1ef2d98ed558 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:19.997452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c3604e5a-82e6-4399-ab2d-1ef2d98ed558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:20.064188 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2877/5739] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:20.075427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464f789-4367-4347-9b6f-d1428bf3eb37 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:20.077012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5464f789-4367-4347-9b6f-d1428bf3eb37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:20.165769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464f789-4367-4347-9b6f-d1428bf3eb37 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:20.169789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cecde-b79e-4e5c-98c2-6dd2286432a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:20.170451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cecde-b79e-4e5c-98c2-6dd2286432a3 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:20.170745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cecde-b79e-4e5c-98c2-6dd2286432a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:20.171055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cecde-b79e-4e5c-98c2-6dd2286432a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:20.184917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cecde-b79e-4e5c-98c2-6dd2286432a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:20.186669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cecde-b79e-4e5c-98c2-6dd2286432a3 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:20.196747 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2863/5740] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:39:20.634917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3604e5a-82e6-4399-ab2d-1ef2d98ed558 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:20.639252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c3604e5a-82e6-4399-ab2d-1ef2d98ed558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:20.650907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3604e5a-82e6-4399-ab2d-1ef2d98ed558 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:20.657423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffa217-e68b-43e3-9590-2c3cba862701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:20.658387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffa217-e68b-43e3-9590-2c3cba862701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:20.662209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffa217-e68b-43e3-9590-2c3cba862701 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:20.662209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffa217-e68b-43e3-9590-2c3cba862701 admin admin] PATH_INFO: `/v3/projects/931f9a49ea3d417c89723fa4d5ca32e9` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:20.662209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ffa217-e68b-43e3-9590-2c3cba862701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=931f9a49ea3d417c89723fa4d5ca32e9)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:20.662769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ffa217-e68b-43e3-9590-2c3cba862701 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:20.789300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-33ffa217-e68b-43e3-9590-2c3cba862701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '931f9a49ea3d417c89723fa4d5ca32e9', 'request_id': 'req-33ffa217-e68b-43e3-9590-2c3cba862701'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:20.921651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-33ffa217-e68b-43e3-9590-2c3cba862701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '931f9a49ea3d417c89723fa4d5ca32e9', 'request_id': 'req-33ffa217-e68b-43e3-9590-2c3cba862701'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:20.929509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-33ffa217-e68b-43e3-9590-2c3cba862701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '931f9a49ea3d417c89723fa4d5ca32e9', 'request_id': 'req-33ffa217-e68b-43e3-9590-2c3cba862701'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:20.949176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-33ffa217-e68b-43e3-9590-2c3cba862701 admin admin] The token cache is being invalidate because project 931f9a49ea3d417c89723fa4d5ca32e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:39:20.949711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-33ffa217-e68b-43e3-9590-2c3cba862701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:20.950408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-33ffa217-e68b-43e3-9590-2c3cba862701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:20.952014 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2878/5741] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:39:20 2022] DELETE /identity/v3/projects/931f9a49ea3d417c89723fa4d5ca32e9 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:20.957138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d9c39-6842-48cb-a883-5187bb69294b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:20.957594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d9c39-6842-48cb-a883-5187bb69294b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:20.957689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d9c39-6842-48cb-a883-5187bb69294b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:20.976448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-606d9c39-6842-48cb-a883-5187bb69294b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:20.977901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-606d9c39-6842-48cb-a883-5187bb69294b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:21.041854 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2864/5742] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:21.049462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8464a97-1636-449b-86ba-17d6187f953c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:21.049943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8464a97-1636-449b-86ba-17d6187f953c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:21.050037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8464a97-1636-449b-86ba-17d6187f953c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:21.068877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c8464a97-1636-449b-86ba-17d6187f953c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:21.070089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c8464a97-1636-449b-86ba-17d6187f953c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:21.079058 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2879/5743] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:21.083104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d9c39-6842-48cb-a883-5187bb69294b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:21.093456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d9c39-6842-48cb-a883-5187bb69294b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:21.098131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf21555-805d-40ee-ad62-baa24fca47e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:21.098795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf21555-805d-40ee-ad62-baa24fca47e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:21.099437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf21555-805d-40ee-ad62-baa24fca47e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:21.099725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf21555-805d-40ee-ad62-baa24fca47e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:21.100453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf21555-805d-40ee-ad62-baa24fca47e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:39:21.100795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf21555-805d-40ee-ad62-baa24fca47e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:21.102877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf21555-805d-40ee-ad62-baa24fca47e5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:21.114698 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2865/5744] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:39:21.119160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8464a97-1636-449b-86ba-17d6187f953c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:21.128631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8464a97-1636-449b-86ba-17d6187f953c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:21.133405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7854cad-1dd5-4b31-baa0-e15dd3a4195f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:21.134065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7854cad-1dd5-4b31-baa0-e15dd3a4195f admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:21.134855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7854cad-1dd5-4b31-baa0-e15dd3a4195f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:21.135144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7854cad-1dd5-4b31-baa0-e15dd3a4195f admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:21.135852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7854cad-1dd5-4b31-baa0-e15dd3a4195f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:21.137791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7854cad-1dd5-4b31-baa0-e15dd3a4195f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:21.237393 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2880/5745] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:39:21 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:21.241322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf21555-805d-40ee-ad62-baa24fca47e5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:21.253464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf21555-805d-40ee-ad62-baa24fca47e5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:21.324445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea470ea-f675-4568-a271-d8872592240f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:21.325218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea470ea-f675-4568-a271-d8872592240f admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:21.325503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea470ea-f675-4568-a271-d8872592240f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:21.325775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea470ea-f675-4568-a271-d8872592240f admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:21.326456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea470ea-f675-4568-a271-d8872592240f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:21.328818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea470ea-f675-4568-a271-d8872592240f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:21.448057 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2866/5746] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:39:21 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:21.449379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7854cad-1dd5-4b31-baa0-e15dd3a4195f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:21.459760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7854cad-1dd5-4b31-baa0-e15dd3a4195f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:21.467823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3ff03-d714-4d46-9d3d-4bbad81a18fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:21.467823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3ff03-d714-4d46-9d3d-4bbad81a18fb admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:21.467823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3ff03-d714-4d46-9d3d-4bbad81a18fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:21.467823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3ff03-d714-4d46-9d3d-4bbad81a18fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:21.468785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3ff03-d714-4d46-9d3d-4bbad81a18fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:21.470397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3ff03-d714-4d46-9d3d-4bbad81a18fb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:21.485872 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2881/5747] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:21.490224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea470ea-f675-4568-a271-d8872592240f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:21.501575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea470ea-f675-4568-a271-d8872592240f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:21.507646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6af389-40be-4688-a6c3-d6834d2ac5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:21.514431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6af389-40be-4688-a6c3-d6834d2ac5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:21.514431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6af389-40be-4688-a6c3-d6834d2ac5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:21.514431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6af389-40be-4688-a6c3-d6834d2ac5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:21.514431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6af389-40be-4688-a6c3-d6834d2ac5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:21.514431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6af389-40be-4688-a6c3-d6834d2ac5d5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:21.522755 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2867/5748] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:21.527087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3ff03-d714-4d46-9d3d-4bbad81a18fb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:21.537024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3ff03-d714-4d46-9d3d-4bbad81a18fb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:21.541611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb72aed-cbee-4c8c-ac18-30aeb120a2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:21.542490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb72aed-cbee-4c8c-ac18-30aeb120a2cb admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:21.542776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb72aed-cbee-4c8c-ac18-30aeb120a2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:21.543054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb72aed-cbee-4c8c-ac18-30aeb120a2cb admin admin] PATH_INFO: `/v3/projects/af40d1bba16444c0b2390e22352e9b05/users/c9c2e4bfc18e4e078818fd0ed64a2457/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:21.701290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb72aed-cbee-4c8c-ac18-30aeb120a2cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=af40d1bba16444c0b2390e22352e9b05, user_id=c9c2e4bfc18e4e078818fd0ed64a2457, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:21.704721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb72aed-cbee-4c8c-ac18-30aeb120a2cb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:21.786228 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2882/5749] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:39:21 2022] PUT /identity/v3/projects/af40d1bba16444c0b2390e22352e9b05/users/c9c2e4bfc18e4e078818fd0ed64a2457/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:39:21.796634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92c3aa-e29a-4e97-be4e-dd4080d84339 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:21.796931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92c3aa-e29a-4e97-be4e-dd4080d84339 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:21.797218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92c3aa-e29a-4e97-be4e-dd4080d84339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:21.846915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ad92c3aa-e29a-4e97-be4e-dd4080d84339 None None] MFA Rules not processed for user `c9c2e4bfc18e4e078818fd0ed64a2457`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:21.848153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ad92c3aa-e29a-4e97-be4e-dd4080d84339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:21.938063 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2868/5750] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:21.957350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb72aed-cbee-4c8c-ac18-30aeb120a2cb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:21.957350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bfb72aed-cbee-4c8c-ac18-30aeb120a2cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:22.032499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb72aed-cbee-4c8c-ac18-30aeb120a2cb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:22.041605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a10a1a-0d37-4d02-ba74-997017b494a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:22.042536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a10a1a-0d37-4d02-ba74-997017b494a9 service glance] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:22.042977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a10a1a-0d37-4d02-ba74-997017b494a9 service glance] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:22.043346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a10a1a-0d37-4d02-ba74-997017b494a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:22.054640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a10a1a-0d37-4d02-ba74-997017b494a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:22.056213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a10a1a-0d37-4d02-ba74-997017b494a9 service glance] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:22.067351 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2883/5751] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:39:22.483808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92c3aa-e29a-4e97-be4e-dd4080d84339 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:22.574999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92c3aa-e29a-4e97-be4e-dd4080d84339 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:22.587530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e8500-bf9f-40cf-bb91-000abd07c9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:22.589953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e8500-bf9f-40cf-bb91-000abd07c9b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:22.590474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e8500-bf9f-40cf-bb91-000abd07c9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:22.591126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e8500-bf9f-40cf-bb91-000abd07c9b2 admin admin] PATH_INFO: `/v3/users/c9c2e4bfc18e4e078818fd0ed64a2457` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:22.593162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e8500-bf9f-40cf-bb91-000abd07c9b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9c2e4bfc18e4e078818fd0ed64a2457)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:22.600682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e8500-bf9f-40cf-bb91-000abd07c9b2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:22.846941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b07e8500-bf9f-40cf-bb91-000abd07c9b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9c2e4bfc18e4e078818fd0ed64a2457'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:22.871746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b07e8500-bf9f-40cf-bb91-000abd07c9b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9c2e4bfc18e4e078818fd0ed64a2457'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:22.872855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b07e8500-bf9f-40cf-bb91-000abd07c9b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9c2e4bfc18e4e078818fd0ed64a2457'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:22.884199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b07e8500-bf9f-40cf-bb91-000abd07c9b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9c2e4bfc18e4e078818fd0ed64a2457'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:23.005593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b07e8500-bf9f-40cf-bb91-000abd07c9b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9c2e4bfc18e4e078818fd0ed64a2457'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:23.015074 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2869/5752] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:39:22 2022] DELETE /identity/v3/users/c9c2e4bfc18e4e078818fd0ed64a2457 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:23.019900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab05976-7c27-413b-bfc3-97be0a9614fb None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:23.020197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab05976-7c27-413b-bfc3-97be0a9614fb None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:23.020530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab05976-7c27-413b-bfc3-97be0a9614fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:23.049148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3ab05976-7c27-413b-bfc3-97be0a9614fb None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:23.050763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3ab05976-7c27-413b-bfc3-97be0a9614fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:23.168124 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2884/5753] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:23.179546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e8500-bf9f-40cf-bb91-000abd07c9b2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:23.182664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b07e8500-bf9f-40cf-bb91-000abd07c9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:23.341590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e8500-bf9f-40cf-bb91-000abd07c9b2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:23.346077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f256538-43d8-4e09-954b-961f77292212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:23.347936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f256538-43d8-4e09-954b-961f77292212 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:23.348290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f256538-43d8-4e09-954b-961f77292212 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:23.349151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f256538-43d8-4e09-954b-961f77292212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:23.369266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f256538-43d8-4e09-954b-961f77292212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:23.371186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f256538-43d8-4e09-954b-961f77292212 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:23.385640 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2870/5754] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:39:23.916787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab05976-7c27-413b-bfc3-97be0a9614fb None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:23.924405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3ab05976-7c27-413b-bfc3-97be0a9614fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:23.950024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab05976-7c27-413b-bfc3-97be0a9614fb None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:23.955812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3812b-24d2-4dc6-80f0-a7fd80e932bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:23.957762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3812b-24d2-4dc6-80f0-a7fd80e932bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:23.958195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3812b-24d2-4dc6-80f0-a7fd80e932bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:23.963305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3812b-24d2-4dc6-80f0-a7fd80e932bd admin admin] PATH_INFO: `/v3/projects/af40d1bba16444c0b2390e22352e9b05` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:23.963305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3812b-24d2-4dc6-80f0-a7fd80e932bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=af40d1bba16444c0b2390e22352e9b05)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:23.963305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3812b-24d2-4dc6-80f0-a7fd80e932bd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:24.108215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-16b3812b-24d2-4dc6-80f0-a7fd80e932bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af40d1bba16444c0b2390e22352e9b05', 'request_id': 'req-16b3812b-24d2-4dc6-80f0-a7fd80e932bd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:24.243961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-16b3812b-24d2-4dc6-80f0-a7fd80e932bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af40d1bba16444c0b2390e22352e9b05', 'request_id': 'req-16b3812b-24d2-4dc6-80f0-a7fd80e932bd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:24.251958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-16b3812b-24d2-4dc6-80f0-a7fd80e932bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af40d1bba16444c0b2390e22352e9b05', 'request_id': 'req-16b3812b-24d2-4dc6-80f0-a7fd80e932bd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:24.263295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-16b3812b-24d2-4dc6-80f0-a7fd80e932bd admin admin] The token cache is being invalidate because project af40d1bba16444c0b2390e22352e9b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:39:24.263594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-16b3812b-24d2-4dc6-80f0-a7fd80e932bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:24.264260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-16b3812b-24d2-4dc6-80f0-a7fd80e932bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:24.265912 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2885/5755] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:39:23 2022] DELETE /identity/v3/projects/af40d1bba16444c0b2390e22352e9b05 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:24.272620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ad39c-3afc-46e5-8b93-3101ec81cf37 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:24.272620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ad39c-3afc-46e5-8b93-3101ec81cf37 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:24.272620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ad39c-3afc-46e5-8b93-3101ec81cf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:24.290626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c01ad39c-3afc-46e5-8b93-3101ec81cf37 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:24.299514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c01ad39c-3afc-46e5-8b93-3101ec81cf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:24.350666 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2871/5756] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:24.359306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6e93c-bcda-4453-8d82-51aa260a3c4e None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:24.359602 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6e93c-bcda-4453-8d82-51aa260a3c4e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:24.359885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6e93c-bcda-4453-8d82-51aa260a3c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:24.380537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0fa6e93c-bcda-4453-8d82-51aa260a3c4e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:24.381771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0fa6e93c-bcda-4453-8d82-51aa260a3c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:24.391565 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2886/5757] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:24.396378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ad39c-3afc-46e5-8b93-3101ec81cf37 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:24.409153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ad39c-3afc-46e5-8b93-3101ec81cf37 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:24.414385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85454094-b92c-436b-bbff-30993c57c15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:24.415162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85454094-b92c-436b-bbff-30993c57c15e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:24.415444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85454094-b92c-436b-bbff-30993c57c15e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:24.418997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85454094-b92c-436b-bbff-30993c57c15e admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:24.418997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85454094-b92c-436b-bbff-30993c57c15e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:39:24.418997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85454094-b92c-436b-bbff-30993c57c15e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:24.418997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85454094-b92c-436b-bbff-30993c57c15e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:24.430342 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2872/5758] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:39:24.435319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6e93c-bcda-4453-8d82-51aa260a3c4e None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:24.444982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6e93c-bcda-4453-8d82-51aa260a3c4e None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:24.450308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6592abb-9325-4ddc-8b9c-b156bd7c64b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:24.450962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6592abb-9325-4ddc-8b9c-b156bd7c64b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:24.451243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6592abb-9325-4ddc-8b9c-b156bd7c64b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:24.453176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6592abb-9325-4ddc-8b9c-b156bd7c64b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:24.453176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6592abb-9325-4ddc-8b9c-b156bd7c64b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:24.454188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6592abb-9325-4ddc-8b9c-b156bd7c64b7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:24.560525 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2887/5759] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:39:24 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:24.560781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85454094-b92c-436b-bbff-30993c57c15e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:24.570015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85454094-b92c-436b-bbff-30993c57c15e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:24.631169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4199f8-39bf-44a5-8350-6eaa7488f08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:24.631874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4199f8-39bf-44a5-8350-6eaa7488f08c admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:24.632154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4199f8-39bf-44a5-8350-6eaa7488f08c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:24.632429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4199f8-39bf-44a5-8350-6eaa7488f08c admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:24.633161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4199f8-39bf-44a5-8350-6eaa7488f08c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:24.635730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4199f8-39bf-44a5-8350-6eaa7488f08c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:24.781251 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2873/5760] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:39:24 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:39:24.786459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6592abb-9325-4ddc-8b9c-b156bd7c64b7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:24.797145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6592abb-9325-4ddc-8b9c-b156bd7c64b7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:24.801697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18fc79-9846-43f4-a472-522785b670d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:24.802357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18fc79-9846-43f4-a472-522785b670d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:24.802643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18fc79-9846-43f4-a472-522785b670d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:24.802920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18fc79-9846-43f4-a472-522785b670d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:24.803936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18fc79-9846-43f4-a472-522785b670d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:24.805441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18fc79-9846-43f4-a472-522785b670d1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:24.816447 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2888/5761] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:24.820180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4199f8-39bf-44a5-8350-6eaa7488f08c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:24.830219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4199f8-39bf-44a5-8350-6eaa7488f08c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:24.834990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3f832-4db9-4038-b1b9-e8e2b196fa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:24.835633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3f832-4db9-4038-b1b9-e8e2b196fa02 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:24.835915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3f832-4db9-4038-b1b9-e8e2b196fa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:24.836192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3f832-4db9-4038-b1b9-e8e2b196fa02 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:24.836975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3f832-4db9-4038-b1b9-e8e2b196fa02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:24.838555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3f832-4db9-4038-b1b9-e8e2b196fa02 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:24.848141 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2874/5762] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:24.852141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18fc79-9846-43f4-a472-522785b670d1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:24.862414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18fc79-9846-43f4-a472-522785b670d1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:24.866918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcd532-3571-4461-b3ad-51b5723ae781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:24.867793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcd532-3571-4461-b3ad-51b5723ae781 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:24.868076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcd532-3571-4461-b3ad-51b5723ae781 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:24.868356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcd532-3571-4461-b3ad-51b5723ae781 admin admin] PATH_INFO: `/v3/projects/a5b5e93a828646ee824459a4fdbb21b0/users/92e2d9e7abaf451b96876170a456cfe7/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:24.884229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcd532-3571-4461-b3ad-51b5723ae781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b5e93a828646ee824459a4fdbb21b0, user_id=92e2d9e7abaf451b96876170a456cfe7, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:24.886952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcd532-3571-4461-b3ad-51b5723ae781 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:25.002650 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2889/5763] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:39:24 2022] PUT /identity/v3/projects/a5b5e93a828646ee824459a4fdbb21b0/users/92e2d9e7abaf451b96876170a456cfe7/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:25.013197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5303e5f-4271-4f46-8955-ecdaa75c2fab None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:25.013616 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5303e5f-4271-4f46-8955-ecdaa75c2fab None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:25.013906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5303e5f-4271-4f46-8955-ecdaa75c2fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:25.041554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e5303e5f-4271-4f46-8955-ecdaa75c2fab None None] MFA Rules not processed for user `92e2d9e7abaf451b96876170a456cfe7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:25.042745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e5303e5f-4271-4f46-8955-ecdaa75c2fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:25.107179 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2875/5764] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:25.111947 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcd532-3571-4461-b3ad-51b5723ae781 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:25.172122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcd532-3571-4461-b3ad-51b5723ae781 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:25.176893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392aa079-4351-4ff2-b179-bbee9c69bdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:25.177579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392aa079-4351-4ff2-b179-bbee9c69bdff admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:25.177865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392aa079-4351-4ff2-b179-bbee9c69bdff admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:25.178145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392aa079-4351-4ff2-b179-bbee9c69bdff admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:25.178834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392aa079-4351-4ff2-b179-bbee9c69bdff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:25.180777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392aa079-4351-4ff2-b179-bbee9c69bdff admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:25.254725 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2890/5765] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:39:25 2022] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:39:25.258940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5303e5f-4271-4f46-8955-ecdaa75c2fab None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:25.271088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5303e5f-4271-4f46-8955-ecdaa75c2fab None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:25.327442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c0c92-8526-4462-8680-ab4a6d00f46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:25.328164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c0c92-8526-4462-8680-ab4a6d00f46c admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:25.328376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c0c92-8526-4462-8680-ab4a6d00f46c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:25.328703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c0c92-8526-4462-8680-ab4a6d00f46c admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:25.329396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c0c92-8526-4462-8680-ab4a6d00f46c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:25.331293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c0c92-8526-4462-8680-ab4a6d00f46c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:25.466484 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2876/5766] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:39:25 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:39:25.470482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392aa079-4351-4ff2-b179-bbee9c69bdff admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:25.482412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392aa079-4351-4ff2-b179-bbee9c69bdff admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:25.487110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37e876-77d6-45ef-aa58-5420c1524206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:25.487786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37e876-77d6-45ef-aa58-5420c1524206 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:25.488072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37e876-77d6-45ef-aa58-5420c1524206 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:25.488357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37e876-77d6-45ef-aa58-5420c1524206 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:25.489245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37e876-77d6-45ef-aa58-5420c1524206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:25.490961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37e876-77d6-45ef-aa58-5420c1524206 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:25.502927 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2891/5767] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:25.507005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c0c92-8526-4462-8680-ab4a6d00f46c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:25.520786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c0c92-8526-4462-8680-ab4a6d00f46c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:25.526692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474464f-93d3-4a5b-b280-a923a00abfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:25.527629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474464f-93d3-4a5b-b280-a923a00abfdc admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:25.527921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474464f-93d3-4a5b-b280-a923a00abfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:25.528298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474464f-93d3-4a5b-b280-a923a00abfdc admin admin] PATH_INFO: `/v3/projects/652d2a0ea0004cc3bdd83d66f115043c/users/6d1d01d743cc46929c817ad2cf9f6f71/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:25.544987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474464f-93d3-4a5b-b280-a923a00abfdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=652d2a0ea0004cc3bdd83d66f115043c, user_id=6d1d01d743cc46929c817ad2cf9f6f71, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:25.547963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474464f-93d3-4a5b-b280-a923a00abfdc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:25.614367 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2877/5768] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:39:25 2022] PUT /identity/v3/projects/652d2a0ea0004cc3bdd83d66f115043c/users/6d1d01d743cc46929c817ad2cf9f6f71/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:25.615767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37e876-77d6-45ef-aa58-5420c1524206 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:25.629177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37e876-77d6-45ef-aa58-5420c1524206 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:25.705359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f089d-b894-43f2-ba04-abc4f2c75c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:25.706330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f089d-b894-43f2-ba04-abc4f2c75c32 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:25.706750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f089d-b894-43f2-ba04-abc4f2c75c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:25.707087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f089d-b894-43f2-ba04-abc4f2c75c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:25.707944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f089d-b894-43f2-ba04-abc4f2c75c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:25.709564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f089d-b894-43f2-ba04-abc4f2c75c32 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:25.730697 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2892/5769] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:25.731905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474464f-93d3-4a5b-b280-a923a00abfdc admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:25.745836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474464f-93d3-4a5b-b280-a923a00abfdc admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:25.757073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9429a8-1cb1-4aab-b248-bba0f0259e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:25.757991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9429a8-1cb1-4aab-b248-bba0f0259e6c admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:25.758272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9429a8-1cb1-4aab-b248-bba0f0259e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:25.758551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9429a8-1cb1-4aab-b248-bba0f0259e6c admin admin] PATH_INFO: `/v3/projects/652d2a0ea0004cc3bdd83d66f115043c/users/6d1d01d743cc46929c817ad2cf9f6f71/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:25.760675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9429a8-1cb1-4aab-b248-bba0f0259e6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=652d2a0ea0004cc3bdd83d66f115043c, user_id=6d1d01d743cc46929c817ad2cf9f6f71, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:25.763447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9429a8-1cb1-4aab-b248-bba0f0259e6c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:25.778803 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2878/5770] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:39:25 2022] PUT /identity/v3/projects/652d2a0ea0004cc3bdd83d66f115043c/users/6d1d01d743cc46929c817ad2cf9f6f71/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:25.789085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b2ed6-b80c-4b2f-a309-969bcfe22862 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:25.789382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b2ed6-b80c-4b2f-a309-969bcfe22862 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:25.789664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b2ed6-b80c-4b2f-a309-969bcfe22862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:25.822304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ed6b2ed6-b80c-4b2f-a309-969bcfe22862 None None] MFA Rules not processed for user `6d1d01d743cc46929c817ad2cf9f6f71`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:25.823528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ed6b2ed6-b80c-4b2f-a309-969bcfe22862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:25.903493 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2893/5771] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:25 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:25.917396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9429a8-1cb1-4aab-b248-bba0f0259e6c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:25.919139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9b9429a8-1cb1-4aab-b248-bba0f0259e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:25.985889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9429a8-1cb1-4aab-b248-bba0f0259e6c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:25.994983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2947dc-5f18-4173-a58f-bfc254829cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:25.995764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2947dc-5f18-4173-a58f-bfc254829cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:25.996148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2947dc-5f18-4173-a58f-bfc254829cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:25.996526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2947dc-5f18-4173-a58f-bfc254829cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:26.007696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2947dc-5f18-4173-a58f-bfc254829cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:26.009715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2947dc-5f18-4173-a58f-bfc254829cf5 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:26.021717 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2879/5772] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:25 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:39:28.879329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b2ed6-b80c-4b2f-a309-969bcfe22862 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:28.880864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ed6b2ed6-b80c-4b2f-a309-969bcfe22862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:28.894255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b2ed6-b80c-4b2f-a309-969bcfe22862 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:28.897863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635c9a1-aef1-421d-9c97-450f80302d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:28.898503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635c9a1-aef1-421d-9c97-450f80302d2d service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:28.898787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635c9a1-aef1-421d-9c97-450f80302d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:28.899066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635c9a1-aef1-421d-9c97-450f80302d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:28.955541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635c9a1-aef1-421d-9c97-450f80302d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:28.957011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635c9a1-aef1-421d-9c97-450f80302d2d service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:28.966300 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2894/5773] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:39:30.206958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2947dc-5f18-4173-a58f-bfc254829cf5 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:30.266681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2947dc-5f18-4173-a58f-bfc254829cf5 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:30.271257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e1137-2b66-45b4-bcb2-7c8f02ad2b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:30.272114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e1137-2b66-45b4-bcb2-7c8f02ad2b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:30.272397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e1137-2b66-45b4-bcb2-7c8f02ad2b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:30.272701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e1137-2b66-45b4-bcb2-7c8f02ad2b12 admin admin] PATH_INFO: `/v3/users/92e2d9e7abaf451b96876170a456cfe7` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:30.273862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e1137-2b66-45b4-bcb2-7c8f02ad2b12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92e2d9e7abaf451b96876170a456cfe7)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:30.275917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e1137-2b66-45b4-bcb2-7c8f02ad2b12 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:30.577001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bd6e1137-2b66-45b4-bcb2-7c8f02ad2b12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92e2d9e7abaf451b96876170a456cfe7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:30.589767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bd6e1137-2b66-45b4-bcb2-7c8f02ad2b12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92e2d9e7abaf451b96876170a456cfe7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:30.590585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bd6e1137-2b66-45b4-bcb2-7c8f02ad2b12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92e2d9e7abaf451b96876170a456cfe7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:30.597945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bd6e1137-2b66-45b4-bcb2-7c8f02ad2b12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92e2d9e7abaf451b96876170a456cfe7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:30.661174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bd6e1137-2b66-45b4-bcb2-7c8f02ad2b12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92e2d9e7abaf451b96876170a456cfe7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:30.668499 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2880/5774] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:39:30 2022] DELETE /identity/v3/users/92e2d9e7abaf451b96876170a456cfe7 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:30.673321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396dab9-0892-43b0-9fe4-d357799f5e1b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:30.673779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396dab9-0892-43b0-9fe4-d357799f5e1b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:30.673883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396dab9-0892-43b0-9fe4-d357799f5e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:30.694378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6396dab9-0892-43b0-9fe4-d357799f5e1b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:30.695691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6396dab9-0892-43b0-9fe4-d357799f5e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:30.755634 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2895/5775] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:30.784247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e1137-2b66-45b4-bcb2-7c8f02ad2b12 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:30.785736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bd6e1137-2b66-45b4-bcb2-7c8f02ad2b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:30.847480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e1137-2b66-45b4-bcb2-7c8f02ad2b12 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:30.851327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ba1a7-c9f5-4197-9997-328cf796b635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:30.851973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ba1a7-c9f5-4197-9997-328cf796b635 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:30.852257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ba1a7-c9f5-4197-9997-328cf796b635 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:30.852534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ba1a7-c9f5-4197-9997-328cf796b635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:30.862455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ba1a7-c9f5-4197-9997-328cf796b635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:30.863897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ba1a7-c9f5-4197-9997-328cf796b635 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:30.874383 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2881/5776] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:39:31.364090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396dab9-0892-43b0-9fe4-d357799f5e1b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:31.365538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6396dab9-0892-43b0-9fe4-d357799f5e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:31.378250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396dab9-0892-43b0-9fe4-d357799f5e1b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:31.386426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4756b-33cf-4df3-b218-49be1241069a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:31.387574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4756b-33cf-4df3-b218-49be1241069a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:31.389106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4756b-33cf-4df3-b218-49be1241069a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:31.389106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4756b-33cf-4df3-b218-49be1241069a admin admin] PATH_INFO: `/v3/projects/a5b5e93a828646ee824459a4fdbb21b0` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:31.389453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4756b-33cf-4df3-b218-49be1241069a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b5e93a828646ee824459a4fdbb21b0)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:31.391612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4756b-33cf-4df3-b218-49be1241069a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:31.499510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1fd4756b-33cf-4df3-b218-49be1241069a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b5e93a828646ee824459a4fdbb21b0', 'request_id': 'req-1fd4756b-33cf-4df3-b218-49be1241069a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:31.580924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1fd4756b-33cf-4df3-b218-49be1241069a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b5e93a828646ee824459a4fdbb21b0', 'request_id': 'req-1fd4756b-33cf-4df3-b218-49be1241069a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:31.588109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1fd4756b-33cf-4df3-b218-49be1241069a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b5e93a828646ee824459a4fdbb21b0', 'request_id': 'req-1fd4756b-33cf-4df3-b218-49be1241069a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:31.598131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1fd4756b-33cf-4df3-b218-49be1241069a admin admin] The token cache is being invalidate because project a5b5e93a828646ee824459a4fdbb21b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:39:31.598416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1fd4756b-33cf-4df3-b218-49be1241069a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:31.599043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1fd4756b-33cf-4df3-b218-49be1241069a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:31.600627 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2896/5777] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:39:31 2022] DELETE /identity/v3/projects/a5b5e93a828646ee824459a4fdbb21b0 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:31.604696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ba1a7-c9f5-4197-9997-328cf796b635 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:31.614265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ba1a7-c9f5-4197-9997-328cf796b635 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:31.670721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ccba6-4bca-4543-95c7-9efe43db17cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:31.671613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ccba6-4bca-4543-95c7-9efe43db17cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:31.671897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ccba6-4bca-4543-95c7-9efe43db17cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:31.672174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ccba6-4bca-4543-95c7-9efe43db17cf admin admin] PATH_INFO: `/v3/users/6d1d01d743cc46929c817ad2cf9f6f71` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:31.673412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ccba6-4bca-4543-95c7-9efe43db17cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d1d01d743cc46929c817ad2cf9f6f71)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:31.675343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ccba6-4bca-4543-95c7-9efe43db17cf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:31.827760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f99ccba6-4bca-4543-95c7-9efe43db17cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d1d01d743cc46929c817ad2cf9f6f71'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:31.841496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f99ccba6-4bca-4543-95c7-9efe43db17cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d1d01d743cc46929c817ad2cf9f6f71'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:31.842364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f99ccba6-4bca-4543-95c7-9efe43db17cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d1d01d743cc46929c817ad2cf9f6f71'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:31.849562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f99ccba6-4bca-4543-95c7-9efe43db17cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d1d01d743cc46929c817ad2cf9f6f71'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:31.962119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f99ccba6-4bca-4543-95c7-9efe43db17cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d1d01d743cc46929c817ad2cf9f6f71'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:31.969068 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2882/5778] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:39:31 2022] DELETE /identity/v3/users/6d1d01d743cc46929c817ad2cf9f6f71 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:32.553859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4756b-33cf-4df3-b218-49be1241069a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:32.556559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1fd4756b-33cf-4df3-b218-49be1241069a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:32.586696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4756b-33cf-4df3-b218-49be1241069a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:32.672682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838d392-b823-49ba-9ba1-89af03f1e700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:32.673571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838d392-b823-49ba-9ba1-89af03f1e700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:32.673891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838d392-b823-49ba-9ba1-89af03f1e700 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:32.684471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838d392-b823-49ba-9ba1-89af03f1e700 admin admin] PATH_INFO: `/v3/projects/652d2a0ea0004cc3bdd83d66f115043c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:32.684471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838d392-b823-49ba-9ba1-89af03f1e700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=652d2a0ea0004cc3bdd83d66f115043c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:32.684471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838d392-b823-49ba-9ba1-89af03f1e700 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:32.830446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a838d392-b823-49ba-9ba1-89af03f1e700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652d2a0ea0004cc3bdd83d66f115043c', 'request_id': 'req-a838d392-b823-49ba-9ba1-89af03f1e700'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:32.878183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a838d392-b823-49ba-9ba1-89af03f1e700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652d2a0ea0004cc3bdd83d66f115043c', 'request_id': 'req-a838d392-b823-49ba-9ba1-89af03f1e700'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:32.884946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a838d392-b823-49ba-9ba1-89af03f1e700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652d2a0ea0004cc3bdd83d66f115043c', 'request_id': 'req-a838d392-b823-49ba-9ba1-89af03f1e700'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:32.895093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a838d392-b823-49ba-9ba1-89af03f1e700 admin admin] The token cache is being invalidate because project 652d2a0ea0004cc3bdd83d66f115043c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:39:32.895372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a838d392-b823-49ba-9ba1-89af03f1e700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:32.896012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a838d392-b823-49ba-9ba1-89af03f1e700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:32.897702 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2897/5779] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:39:32 2022] DELETE /identity/v3/projects/652d2a0ea0004cc3bdd83d66f115043c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:32.903722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fac14-f27d-4df2-9fc5-ff64127717b5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:32.904200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fac14-f27d-4df2-9fc5-ff64127717b5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:32.904329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fac14-f27d-4df2-9fc5-ff64127717b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:32.924338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-930fac14-f27d-4df2-9fc5-ff64127717b5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:32.925657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-930fac14-f27d-4df2-9fc5-ff64127717b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:32.983274 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2883/5780] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:32.991161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a817194-845a-4e27-910f-547f5aebe383 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:32.991478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a817194-845a-4e27-910f-547f5aebe383 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:32.991756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a817194-845a-4e27-910f-547f5aebe383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:33.010932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9a817194-845a-4e27-910f-547f5aebe383 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:33.012125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9a817194-845a-4e27-910f-547f5aebe383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:33.020156 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2898/5781] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:33.026711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fac14-f27d-4df2-9fc5-ff64127717b5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:33.036380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fac14-f27d-4df2-9fc5-ff64127717b5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:33.041202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc46ac-f01a-4ede-9622-d0f5185d6ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:33.041860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc46ac-f01a-4ede-9622-d0f5185d6ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:33.042144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc46ac-f01a-4ede-9622-d0f5185d6ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:33.042417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc46ac-f01a-4ede-9622-d0f5185d6ed8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:33.047448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc46ac-f01a-4ede-9622-d0f5185d6ed8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:39:33.047448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc46ac-f01a-4ede-9622-d0f5185d6ed8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:33.047448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc46ac-f01a-4ede-9622-d0f5185d6ed8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:33.057009 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2884/5782] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:39:33.061475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a817194-845a-4e27-910f-547f5aebe383 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:33.074750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a817194-845a-4e27-910f-547f5aebe383 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:33.080679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624f8b2-fa0f-43bf-adf1-bbbbccb08b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:33.081705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624f8b2-fa0f-43bf-adf1-bbbbccb08b8e admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:33.082000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624f8b2-fa0f-43bf-adf1-bbbbccb08b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:33.082280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624f8b2-fa0f-43bf-adf1-bbbbccb08b8e admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:33.082973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624f8b2-fa0f-43bf-adf1-bbbbccb08b8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:33.085130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624f8b2-fa0f-43bf-adf1-bbbbccb08b8e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:33.187960 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2899/5783] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:39:33 2022] POST /identity/v3/projects => generated 391 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:33.192454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc46ac-f01a-4ede-9622-d0f5185d6ed8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:33.204830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc46ac-f01a-4ede-9622-d0f5185d6ed8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:33.279175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200d186-0fcd-4228-bcd0-3dce2342030b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:33.280120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200d186-0fcd-4228-bcd0-3dce2342030b admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:33.280409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200d186-0fcd-4228-bcd0-3dce2342030b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:33.282640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200d186-0fcd-4228-bcd0-3dce2342030b admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:33.283364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200d186-0fcd-4228-bcd0-3dce2342030b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:33.285561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200d186-0fcd-4228-bcd0-3dce2342030b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:33.387465 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2885/5784] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:39:33 2022] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:39:33.388976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624f8b2-fa0f-43bf-adf1-bbbbccb08b8e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:33.405878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624f8b2-fa0f-43bf-adf1-bbbbccb08b8e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:33.411258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fe707-c2c4-4cc1-9699-80cca2526635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:33.411967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fe707-c2c4-4cc1-9699-80cca2526635 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:33.412258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fe707-c2c4-4cc1-9699-80cca2526635 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:33.412578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fe707-c2c4-4cc1-9699-80cca2526635 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:33.413439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fe707-c2c4-4cc1-9699-80cca2526635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:33.415179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fe707-c2c4-4cc1-9699-80cca2526635 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:33.428712 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2900/5785] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:39:33.441126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200d186-0fcd-4228-bcd0-3dce2342030b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:33.441657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200d186-0fcd-4228-bcd0-3dce2342030b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:33.447437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fa91d-8927-48e1-bec6-a76b02cd1ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:33.448179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fa91d-8927-48e1-bec6-a76b02cd1ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:33.448465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fa91d-8927-48e1-bec6-a76b02cd1ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:33.449564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fa91d-8927-48e1-bec6-a76b02cd1ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:33.450233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fa91d-8927-48e1-bec6-a76b02cd1ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:33.452040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fa91d-8927-48e1-bec6-a76b02cd1ec4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:33.469981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fe707-c2c4-4cc1-9699-80cca2526635 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:33.472862 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2886/5786] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:33.485383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fe707-c2c4-4cc1-9699-80cca2526635 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:33.494223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd699a-9792-458d-b1f3-bda9d758ab17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:33.495482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd699a-9792-458d-b1f3-bda9d758ab17 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:33.497108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd699a-9792-458d-b1f3-bda9d758ab17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:33.497484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd699a-9792-458d-b1f3-bda9d758ab17 admin admin] PATH_INFO: `/v3/projects/4d5d6a8b2fa6447bb532b18e0f83cd23/users/dfc27b8b2b2940f88c90e2e7b69ae8a0/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:33.513408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd699a-9792-458d-b1f3-bda9d758ab17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d5d6a8b2fa6447bb532b18e0f83cd23, user_id=dfc27b8b2b2940f88c90e2e7b69ae8a0, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:33.516089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd699a-9792-458d-b1f3-bda9d758ab17 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:33.653265 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2901/5787] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:39:33 2022] PUT /identity/v3/projects/4d5d6a8b2fa6447bb532b18e0f83cd23/users/dfc27b8b2b2940f88c90e2e7b69ae8a0/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:33.663774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2130285-f334-4bb7-a589-6dd964df70eb None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:33.664300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2130285-f334-4bb7-a589-6dd964df70eb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:33.664761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2130285-f334-4bb7-a589-6dd964df70eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:33.693695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a2130285-f334-4bb7-a589-6dd964df70eb None None] MFA Rules not processed for user `dfc27b8b2b2940f88c90e2e7b69ae8a0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:33.695300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a2130285-f334-4bb7-a589-6dd964df70eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:33.776637 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2887/5788] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:33.780795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd699a-9792-458d-b1f3-bda9d758ab17 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:33.842738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd699a-9792-458d-b1f3-bda9d758ab17 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:33.847831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847c4ac-3422-4c68-b069-c8b9c61d0a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:33.848498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847c4ac-3422-4c68-b069-c8b9c61d0a2b admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:33.848881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847c4ac-3422-4c68-b069-c8b9c61d0a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:33.849168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847c4ac-3422-4c68-b069-c8b9c61d0a2b admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:33.849871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847c4ac-3422-4c68-b069-c8b9c61d0a2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:33.851828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847c4ac-3422-4c68-b069-c8b9c61d0a2b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:33.960448 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2902/5789] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:39:33 2022] POST /identity/v3/projects => generated 393 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:33.964875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2130285-f334-4bb7-a589-6dd964df70eb None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:33.976649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2130285-f334-4bb7-a589-6dd964df70eb None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:34.035517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f9ba0-bc9e-490c-b6e7-d18efaae8345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:34.036231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f9ba0-bc9e-490c-b6e7-d18efaae8345 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:34.036517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f9ba0-bc9e-490c-b6e7-d18efaae8345 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:34.036853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f9ba0-bc9e-490c-b6e7-d18efaae8345 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:34.037549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f9ba0-bc9e-490c-b6e7-d18efaae8345 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:34.039509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f9ba0-bc9e-490c-b6e7-d18efaae8345 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:34.134189 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2888/5790] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:39:33 2022] POST /identity/v3/users => generated 303 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:34.135556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847c4ac-3422-4c68-b069-c8b9c61d0a2b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:34.147183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847c4ac-3422-4c68-b069-c8b9c61d0a2b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:34.153773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe5b86-a4db-4527-a96e-692a5722e780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:34.155268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe5b86-a4db-4527-a96e-692a5722e780 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:34.155794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe5b86-a4db-4527-a96e-692a5722e780 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:34.155899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe5b86-a4db-4527-a96e-692a5722e780 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:34.156640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe5b86-a4db-4527-a96e-692a5722e780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:34.158223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe5b86-a4db-4527-a96e-692a5722e780 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:34.173376 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2903/5791] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:34.177756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f9ba0-bc9e-490c-b6e7-d18efaae8345 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:34.188281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f9ba0-bc9e-490c-b6e7-d18efaae8345 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:34.193004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ce01f-5c87-49ad-8f76-0176c696bbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:34.193864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ce01f-5c87-49ad-8f76-0176c696bbd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:34.194149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ce01f-5c87-49ad-8f76-0176c696bbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:34.194446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ce01f-5c87-49ad-8f76-0176c696bbd7 admin admin] PATH_INFO: `/v3/projects/97b7064a2fc6470896c130d984eb54ec/users/dd543120cec54719b98681dc1c9e8f20/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:34.209082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ce01f-5c87-49ad-8f76-0176c696bbd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b7064a2fc6470896c130d984eb54ec, user_id=dd543120cec54719b98681dc1c9e8f20, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:34.211760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ce01f-5c87-49ad-8f76-0176c696bbd7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:34.284188 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2889/5792] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:39:34 2022] PUT /identity/v3/projects/97b7064a2fc6470896c130d984eb54ec/users/dd543120cec54719b98681dc1c9e8f20/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:39:34.288366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe5b86-a4db-4527-a96e-692a5722e780 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:34.298887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe5b86-a4db-4527-a96e-692a5722e780 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:34.358920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8c59f-08dc-4b6b-aebb-efa06b9a473b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:34.359548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8c59f-08dc-4b6b-aebb-efa06b9a473b admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:34.360254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8c59f-08dc-4b6b-aebb-efa06b9a473b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:34.360254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8c59f-08dc-4b6b-aebb-efa06b9a473b admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:34.361533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8c59f-08dc-4b6b-aebb-efa06b9a473b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:34.368032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8c59f-08dc-4b6b-aebb-efa06b9a473b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:34.390475 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2904/5793] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:34.394347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ce01f-5c87-49ad-8f76-0176c696bbd7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:34.416544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ce01f-5c87-49ad-8f76-0176c696bbd7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:34.425333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb72614-6050-4365-9fe5-11b938807826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:34.433704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb72614-6050-4365-9fe5-11b938807826 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:34.433958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb72614-6050-4365-9fe5-11b938807826 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:34.434237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb72614-6050-4365-9fe5-11b938807826 admin admin] PATH_INFO: `/v3/projects/97b7064a2fc6470896c130d984eb54ec/users/dd543120cec54719b98681dc1c9e8f20/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:34.440072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb72614-6050-4365-9fe5-11b938807826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b7064a2fc6470896c130d984eb54ec, user_id=dd543120cec54719b98681dc1c9e8f20, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:34.442942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb72614-6050-4365-9fe5-11b938807826 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:34.453826 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2890/5794] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:39:34 2022] PUT /identity/v3/projects/97b7064a2fc6470896c130d984eb54ec/users/dd543120cec54719b98681dc1c9e8f20/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:39:34.467236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049c9d9-b458-4e8d-8a4e-27e31eb4b7fb None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:34.467525 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049c9d9-b458-4e8d-8a4e-27e31eb4b7fb None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:34.467836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049c9d9-b458-4e8d-8a4e-27e31eb4b7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:34.491926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb72614-6050-4365-9fe5-11b938807826 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:34.494545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-acb72614-6050-4365-9fe5-11b938807826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:34.503633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1049c9d9-b458-4e8d-8a4e-27e31eb4b7fb None None] MFA Rules not processed for user `dd543120cec54719b98681dc1c9e8f20`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:34.504892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1049c9d9-b458-4e8d-8a4e-27e31eb4b7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:34.572824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb72614-6050-4365-9fe5-11b938807826 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:34.577875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47293ee9-33b4-4b43-ad5d-4544aa640220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:34.578919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47293ee9-33b4-4b43-ad5d-4544aa640220 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:34.578919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47293ee9-33b4-4b43-ad5d-4544aa640220 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:34.579112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47293ee9-33b4-4b43-ad5d-4544aa640220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:34.581126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-47293ee9-33b4-4b43-ad5d-4544aa640220 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:34.617742 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2905/5795] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:34.633505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049c9d9-b458-4e8d-8a4e-27e31eb4b7fb None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:34.656564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049c9d9-b458-4e8d-8a4e-27e31eb4b7fb None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:34.662037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e91e68-5f77-4423-b670-ac5824614214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:34.662706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e91e68-5f77-4423-b670-ac5824614214 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:34.663002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e91e68-5f77-4423-b670-ac5824614214 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:34.664193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e91e68-5f77-4423-b670-ac5824614214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:34.689479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e91e68-5f77-4423-b670-ac5824614214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:34.696401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e91e68-5f77-4423-b670-ac5824614214 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:34.722893 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2906/5796] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:39:34.738672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47293ee9-33b4-4b43-ad5d-4544aa640220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:34.740159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47293ee9-33b4-4b43-ad5d-4544aa640220 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:34.771352 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2891/5797] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:39:39.068510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e91e68-5f77-4423-b670-ac5824614214 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:39.106622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e91e68-5f77-4423-b670-ac5824614214 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:39.111599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517f662-8012-4824-81ed-7f0f5236ff56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:39.112511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517f662-8012-4824-81ed-7f0f5236ff56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:39.112806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517f662-8012-4824-81ed-7f0f5236ff56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:39.117052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517f662-8012-4824-81ed-7f0f5236ff56 admin admin] PATH_INFO: `/v3/users/dfc27b8b2b2940f88c90e2e7b69ae8a0` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:39.118603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517f662-8012-4824-81ed-7f0f5236ff56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfc27b8b2b2940f88c90e2e7b69ae8a0)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:39.120561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517f662-8012-4824-81ed-7f0f5236ff56 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:39.314320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8517f662-8012-4824-81ed-7f0f5236ff56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfc27b8b2b2940f88c90e2e7b69ae8a0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:39.325643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8517f662-8012-4824-81ed-7f0f5236ff56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfc27b8b2b2940f88c90e2e7b69ae8a0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:39.326339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8517f662-8012-4824-81ed-7f0f5236ff56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfc27b8b2b2940f88c90e2e7b69ae8a0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:39.333059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8517f662-8012-4824-81ed-7f0f5236ff56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfc27b8b2b2940f88c90e2e7b69ae8a0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:39.409644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8517f662-8012-4824-81ed-7f0f5236ff56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfc27b8b2b2940f88c90e2e7b69ae8a0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:39.416091 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2907/5798] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:39:39 2022] DELETE /identity/v3/users/dfc27b8b2b2940f88c90e2e7b69ae8a0 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:39.420864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aafdb1-945e-4495-a06b-7aa5c6fdbdbf None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:39.421706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aafdb1-945e-4495-a06b-7aa5c6fdbdbf None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:39.422168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aafdb1-945e-4495-a06b-7aa5c6fdbdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:39.479272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-17aafdb1-945e-4495-a06b-7aa5c6fdbdbf None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:39.481210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-17aafdb1-945e-4495-a06b-7aa5c6fdbdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:39.573610 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2892/5799] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:39.584302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517f662-8012-4824-81ed-7f0f5236ff56 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:39.586285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8517f662-8012-4824-81ed-7f0f5236ff56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:39.671188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517f662-8012-4824-81ed-7f0f5236ff56 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:39.675880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb2e3b-4ef9-4e3b-be8d-42ebc9a33c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:39.676976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb2e3b-4ef9-4e3b-be8d-42ebc9a33c1f service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:39.677264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb2e3b-4ef9-4e3b-be8d-42ebc9a33c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:39.677488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb2e3b-4ef9-4e3b-be8d-42ebc9a33c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:39.689840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb2e3b-4ef9-4e3b-be8d-42ebc9a33c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:39.691394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb2e3b-4ef9-4e3b-be8d-42ebc9a33c1f service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:39.717027 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2908/5800] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:39:40.460716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aafdb1-945e-4495-a06b-7aa5c6fdbdbf None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:40.462335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-17aafdb1-945e-4495-a06b-7aa5c6fdbdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:40.475269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aafdb1-945e-4495-a06b-7aa5c6fdbdbf None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:40.481828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be5e4c-0d45-49ad-8b4d-8e3fdc3c4076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:40.482708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be5e4c-0d45-49ad-8b4d-8e3fdc3c4076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:40.483018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be5e4c-0d45-49ad-8b4d-8e3fdc3c4076 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:40.483296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be5e4c-0d45-49ad-8b4d-8e3fdc3c4076 admin admin] PATH_INFO: `/v3/projects/4d5d6a8b2fa6447bb532b18e0f83cd23` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:40.484573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be5e4c-0d45-49ad-8b4d-8e3fdc3c4076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d5d6a8b2fa6447bb532b18e0f83cd23)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:40.486497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be5e4c-0d45-49ad-8b4d-8e3fdc3c4076 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:40.519630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb2e3b-4ef9-4e3b-be8d-42ebc9a33c1f service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:40.521296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-54fb2e3b-4ef9-4e3b-be8d-42ebc9a33c1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:40.537747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb2e3b-4ef9-4e3b-be8d-42ebc9a33c1f service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:40.544150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad98e9-eebd-437f-8139-dc1041ed0894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:40.545193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad98e9-eebd-437f-8139-dc1041ed0894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:40.545477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad98e9-eebd-437f-8139-dc1041ed0894 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:40.545757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad98e9-eebd-437f-8139-dc1041ed0894 admin admin] PATH_INFO: `/v3/users/aa1943e65db34e1da273b41c8a3d2faf` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:40.546944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad98e9-eebd-437f-8139-dc1041ed0894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa1943e65db34e1da273b41c8a3d2faf)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:40.548877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad98e9-eebd-437f-8139-dc1041ed0894 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:40.624206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-80be5e4c-0d45-49ad-8b4d-8e3fdc3c4076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d5d6a8b2fa6447bb532b18e0f83cd23', 'request_id': 'req-80be5e4c-0d45-49ad-8b4d-8e3fdc3c4076'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:40.630932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-80be5e4c-0d45-49ad-8b4d-8e3fdc3c4076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d5d6a8b2fa6447bb532b18e0f83cd23', 'request_id': 'req-80be5e4c-0d45-49ad-8b4d-8e3fdc3c4076'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:40.752129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-80be5e4c-0d45-49ad-8b4d-8e3fdc3c4076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d5d6a8b2fa6447bb532b18e0f83cd23', 'request_id': 'req-80be5e4c-0d45-49ad-8b4d-8e3fdc3c4076'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:40.764287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-80be5e4c-0d45-49ad-8b4d-8e3fdc3c4076 admin admin] The token cache is being invalidate because project 4d5d6a8b2fa6447bb532b18e0f83cd23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:39:40.764581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-80be5e4c-0d45-49ad-8b4d-8e3fdc3c4076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:40.765285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-80be5e4c-0d45-49ad-8b4d-8e3fdc3c4076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:40.767402 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2893/5801] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:39:40 2022] DELETE /identity/v3/projects/4d5d6a8b2fa6447bb532b18e0f83cd23 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:40.771210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be5e4c-0d45-49ad-8b4d-8e3fdc3c4076 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:40.772534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-80be5e4c-0d45-49ad-8b4d-8e3fdc3c4076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:40.831559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dfad98e9-eebd-437f-8139-dc1041ed0894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa1943e65db34e1da273b41c8a3d2faf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:40.838262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be5e4c-0d45-49ad-8b4d-8e3fdc3c4076 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:40.843750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe9f0d-17f7-42bd-8a1e-1ec0d3ae79ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:40.844858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe9f0d-17f7-42bd-8a1e-1ec0d3ae79ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:40.845157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe9f0d-17f7-42bd-8a1e-1ec0d3ae79ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:40.845441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe9f0d-17f7-42bd-8a1e-1ec0d3ae79ef admin admin] PATH_INFO: `/v3/users/dd543120cec54719b98681dc1c9e8f20` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:40.846702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe9f0d-17f7-42bd-8a1e-1ec0d3ae79ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd543120cec54719b98681dc1c9e8f20)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:40.847915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dfad98e9-eebd-437f-8139-dc1041ed0894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa1943e65db34e1da273b41c8a3d2faf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:40.849434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dfad98e9-eebd-437f-8139-dc1041ed0894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa1943e65db34e1da273b41c8a3d2faf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:40.849703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe9f0d-17f7-42bd-8a1e-1ec0d3ae79ef admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:40.859020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dfad98e9-eebd-437f-8139-dc1041ed0894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa1943e65db34e1da273b41c8a3d2faf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:40.935188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dfad98e9-eebd-437f-8139-dc1041ed0894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa1943e65db34e1da273b41c8a3d2faf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:40.941641 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2909/5802] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:39:40 2022] DELETE /identity/v3/users/aa1943e65db34e1da273b41c8a3d2faf => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:39:41.094029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178b83e-b82f-40b7-8ed4-a18aaece247c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:41.094509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178b83e-b82f-40b7-8ed4-a18aaece247c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:41.095039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178b83e-b82f-40b7-8ed4-a18aaece247c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:41.116263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9afe9f0d-17f7-42bd-8a1e-1ec0d3ae79ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd543120cec54719b98681dc1c9e8f20'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:41.123384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a178b83e-b82f-40b7-8ed4-a18aaece247c None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:41.124689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a178b83e-b82f-40b7-8ed4-a18aaece247c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:41.129156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9afe9f0d-17f7-42bd-8a1e-1ec0d3ae79ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd543120cec54719b98681dc1c9e8f20'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:41.129865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9afe9f0d-17f7-42bd-8a1e-1ec0d3ae79ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd543120cec54719b98681dc1c9e8f20'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:41.136729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9afe9f0d-17f7-42bd-8a1e-1ec0d3ae79ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd543120cec54719b98681dc1c9e8f20'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:41.189751 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2910/5803] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:39:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:41.193880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178b83e-b82f-40b7-8ed4-a18aaece247c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:41.194893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a178b83e-b82f-40b7-8ed4-a18aaece247c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:41.202627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9afe9f0d-17f7-42bd-8a1e-1ec0d3ae79ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd543120cec54719b98681dc1c9e8f20'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:41.216159 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2894/5804] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:39:40 2022] DELETE /identity/v3/users/dd543120cec54719b98681dc1c9e8f20 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:39:41.216159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe9f0d-17f7-42bd-8a1e-1ec0d3ae79ef admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:41.216159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9afe9f0d-17f7-42bd-8a1e-1ec0d3ae79ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:41.279411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178b83e-b82f-40b7-8ed4-a18aaece247c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:41.308732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe9f0d-17f7-42bd-8a1e-1ec0d3ae79ef admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:41.310228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65c4f3-66a4-4221-b0b8-44dd911955b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:41.311269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65c4f3-66a4-4221-b0b8-44dd911955b0 service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:41.311518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65c4f3-66a4-4221-b0b8-44dd911955b0 service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:41.311801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65c4f3-66a4-4221-b0b8-44dd911955b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:41.313852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3f65c4f3-66a4-4221-b0b8-44dd911955b0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:41.360843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727c2fd-46ba-4417-be67-26a84e323d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:41.361907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727c2fd-46ba-4417-be67-26a84e323d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:41.362366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727c2fd-46ba-4417-be67-26a84e323d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:41.363148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727c2fd-46ba-4417-be67-26a84e323d5e admin admin] PATH_INFO: `/v3/projects/849913c996ea4611a4317bb4d0136031` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:41.364439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727c2fd-46ba-4417-be67-26a84e323d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=849913c996ea4611a4317bb4d0136031)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:41.366881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2727c2fd-46ba-4417-be67-26a84e323d5e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:41.381555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65c4f3-66a4-4221-b0b8-44dd911955b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:41.383169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65c4f3-66a4-4221-b0b8-44dd911955b0 service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:41.410819 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2895/5805] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:39:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:39:41.497920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65c4f3-66a4-4221-b0b8-44dd911955b0 service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:41.501334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3f65c4f3-66a4-4221-b0b8-44dd911955b0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:41.520770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65c4f3-66a4-4221-b0b8-44dd911955b0 service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:41.534534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea617d8f-fd31-4f39-8125-73173579c215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:41.534534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea617d8f-fd31-4f39-8125-73173579c215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:41.534534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea617d8f-fd31-4f39-8125-73173579c215 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:41.534534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea617d8f-fd31-4f39-8125-73173579c215 admin admin] PATH_INFO: `/v3/projects/97b7064a2fc6470896c130d984eb54ec` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:41.536386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea617d8f-fd31-4f39-8125-73173579c215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b7064a2fc6470896c130d984eb54ec)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:41.540294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea617d8f-fd31-4f39-8125-73173579c215 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:41.577270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2727c2fd-46ba-4417-be67-26a84e323d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '849913c996ea4611a4317bb4d0136031', 'request_id': 'req-2727c2fd-46ba-4417-be67-26a84e323d5e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:41.638491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2727c2fd-46ba-4417-be67-26a84e323d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '849913c996ea4611a4317bb4d0136031', 'request_id': 'req-2727c2fd-46ba-4417-be67-26a84e323d5e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:41.646178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2727c2fd-46ba-4417-be67-26a84e323d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '849913c996ea4611a4317bb4d0136031', 'request_id': 'req-2727c2fd-46ba-4417-be67-26a84e323d5e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:41.665268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2727c2fd-46ba-4417-be67-26a84e323d5e admin admin] The token cache is being invalidate because project 849913c996ea4611a4317bb4d0136031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:39:41.665880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2727c2fd-46ba-4417-be67-26a84e323d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:41.666790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2727c2fd-46ba-4417-be67-26a84e323d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:41.668768 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2911/5806] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:39:41 2022] DELETE /identity/v3/projects/849913c996ea4611a4317bb4d0136031 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:41.673670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63378bbd-6127-4ad0-a8db-0d5bb24997ba None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:41.674020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63378bbd-6127-4ad0-a8db-0d5bb24997ba None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:41.674311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63378bbd-6127-4ad0-a8db-0d5bb24997ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:41.722210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ea617d8f-fd31-4f39-8125-73173579c215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b7064a2fc6470896c130d984eb54ec', 'request_id': 'req-ea617d8f-fd31-4f39-8125-73173579c215'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:41.740463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-63378bbd-6127-4ad0-a8db-0d5bb24997ba None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:41.742279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-63378bbd-6127-4ad0-a8db-0d5bb24997ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:41.756454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ea617d8f-fd31-4f39-8125-73173579c215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b7064a2fc6470896c130d984eb54ec', 'request_id': 'req-ea617d8f-fd31-4f39-8125-73173579c215'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:41.814760 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2912/5807] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:41.835606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bb59f-c54f-4969-9c33-6bd7068759a7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:41.836407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bb59f-c54f-4969-9c33-6bd7068759a7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:41.837534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bb59f-c54f-4969-9c33-6bd7068759a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:41.860715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-381bb59f-c54f-4969-9c33-6bd7068759a7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:41.867277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-381bb59f-c54f-4969-9c33-6bd7068759a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:41.892524 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2913/5808] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:41.897840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bb59f-c54f-4969-9c33-6bd7068759a7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:41.902404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ea617d8f-fd31-4f39-8125-73173579c215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b7064a2fc6470896c130d984eb54ec', 'request_id': 'req-ea617d8f-fd31-4f39-8125-73173579c215'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:41.909556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bb59f-c54f-4969-9c33-6bd7068759a7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:41.923565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848fd8d-8706-4afa-8a08-625fe28bebde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:41.925109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ea617d8f-fd31-4f39-8125-73173579c215 admin admin] The token cache is being invalidate because project 97b7064a2fc6470896c130d984eb54ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:39:41.925506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ea617d8f-fd31-4f39-8125-73173579c215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:41.926408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ea617d8f-fd31-4f39-8125-73173579c215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:41.927171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848fd8d-8706-4afa-8a08-625fe28bebde admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:41.928549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848fd8d-8706-4afa-8a08-625fe28bebde admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:41.929068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848fd8d-8706-4afa-8a08-625fe28bebde admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:41.930036 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2896/5809] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:39:41 2022] DELETE /identity/v3/projects/97b7064a2fc6470896c130d984eb54ec => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:41.931483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848fd8d-8706-4afa-8a08-625fe28bebde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:39:41.932023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848fd8d-8706-4afa-8a08-625fe28bebde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:41.935802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e4a74-c48b-44f5-8be8-6ce31c9b4599 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:41.942651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e4a74-c48b-44f5-8be8-6ce31c9b4599 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:41.942651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e4a74-c48b-44f5-8be8-6ce31c9b4599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:41.949385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848fd8d-8706-4afa-8a08-625fe28bebde admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:42.006269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-cd0e4a74-c48b-44f5-8be8-6ce31c9b4599 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:42.006269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cd0e4a74-c48b-44f5-8be8-6ce31c9b4599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:42.006611 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2914/5810] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:39:42.006611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848fd8d-8706-4afa-8a08-625fe28bebde admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:42.006762 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2897/5811] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:42.006835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0848fd8d-8706-4afa-8a08-625fe28bebde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:42.006909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a669f-61f9-4bca-ab04-c7113e48ec9b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:42.006909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a669f-61f9-4bca-ab04-c7113e48ec9b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:42.006909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a669f-61f9-4bca-ab04-c7113e48ec9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:42.012006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848fd8d-8706-4afa-8a08-625fe28bebde admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:42.018680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30059cc-6abc-49e6-944d-f048f5924348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:42.019354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30059cc-6abc-49e6-944d-f048f5924348 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:42.019660 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30059cc-6abc-49e6-944d-f048f5924348 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:42.019906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30059cc-6abc-49e6-944d-f048f5924348 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:42.020628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30059cc-6abc-49e6-944d-f048f5924348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:42.022951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30059cc-6abc-49e6-944d-f048f5924348 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:42.030426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6b5a669f-61f9-4bca-ab04-c7113e48ec9b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:42.031730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6b5a669f-61f9-4bca-ab04-c7113e48ec9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:42.040423 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2898/5812] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:42.045148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a669f-61f9-4bca-ab04-c7113e48ec9b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:42.057897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a669f-61f9-4bca-ab04-c7113e48ec9b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:42.063343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebb7cd-a4cd-468f-8a9a-f7209677bc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:42.064121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebb7cd-a4cd-468f-8a9a-f7209677bc85 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:42.064528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebb7cd-a4cd-468f-8a9a-f7209677bc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:42.064843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebb7cd-a4cd-468f-8a9a-f7209677bc85 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:42.065711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebb7cd-a4cd-468f-8a9a-f7209677bc85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:39:42.066035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebb7cd-a4cd-468f-8a9a-f7209677bc85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:42.067743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebb7cd-a4cd-468f-8a9a-f7209677bc85 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:42.105113 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2899/5813] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:39:42.108159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebb7cd-a4cd-468f-8a9a-f7209677bc85 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:42.127797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebb7cd-a4cd-468f-8a9a-f7209677bc85 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:42.131183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca4fb3-8eed-4a01-8405-9eec325d3478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:42.131916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca4fb3-8eed-4a01-8405-9eec325d3478 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:42.132209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca4fb3-8eed-4a01-8405-9eec325d3478 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:42.132492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca4fb3-8eed-4a01-8405-9eec325d3478 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:42.133247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca4fb3-8eed-4a01-8405-9eec325d3478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:42.135888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca4fb3-8eed-4a01-8405-9eec325d3478 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:42.301273 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2915/5814] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:39:41 2022] POST /identity/v3/projects => generated 371 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:39:42.307695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30059cc-6abc-49e6-944d-f048f5924348 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:42.354033 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2900/5815] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:39:42 2022] POST /identity/v3/projects => generated 371 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:42.356935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca4fb3-8eed-4a01-8405-9eec325d3478 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:42.408768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30059cc-6abc-49e6-944d-f048f5924348 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:42.428295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca4fb3-8eed-4a01-8405-9eec325d3478 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:42.433948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f36d6-c070-4d70-b39d-e4bdeff8b8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:42.434871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f36d6-c070-4d70-b39d-e4bdeff8b8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:42.434993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f36d6-c070-4d70-b39d-e4bdeff8b8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:42.435316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f36d6-c070-4d70-b39d-e4bdeff8b8f3 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:42.436012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f36d6-c070-4d70-b39d-e4bdeff8b8f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:42.438175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f36d6-c070-4d70-b39d-e4bdeff8b8f3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:42.488450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7cbed-e0d4-4ad2-8fb3-92c2d5354129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:42.489469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7cbed-e0d4-4ad2-8fb3-92c2d5354129 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:42.489760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7cbed-e0d4-4ad2-8fb3-92c2d5354129 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:42.490038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7cbed-e0d4-4ad2-8fb3-92c2d5354129 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:42.490735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7cbed-e0d4-4ad2-8fb3-92c2d5354129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:42.492751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7cbed-e0d4-4ad2-8fb3-92c2d5354129 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:42.558535 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2901/5816] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:39:42 2022] POST /identity/v3/users => generated 286 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:42.562479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f36d6-c070-4d70-b39d-e4bdeff8b8f3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:42.574315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f36d6-c070-4d70-b39d-e4bdeff8b8f3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:42.579815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9c840-dd0b-4371-bb9e-272754abfbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:42.580638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9c840-dd0b-4371-bb9e-272754abfbfe admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:42.581035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9c840-dd0b-4371-bb9e-272754abfbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:42.581396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9c840-dd0b-4371-bb9e-272754abfbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:42.582191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9c840-dd0b-4371-bb9e-272754abfbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:42.583861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9c840-dd0b-4371-bb9e-272754abfbfe admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:42.597705 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2902/5817] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:39:42.602259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9c840-dd0b-4371-bb9e-272754abfbfe admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:42.610138 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2916/5818] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:39:42 2022] POST /identity/v3/users => generated 286 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:42.611355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7cbed-e0d4-4ad2-8fb3-92c2d5354129 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:42.618055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9c840-dd0b-4371-bb9e-272754abfbfe admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:42.626319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7cbed-e0d4-4ad2-8fb3-92c2d5354129 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:42.629881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba6057-90d1-41a4-8751-4266cac4896d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:42.630670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba6057-90d1-41a4-8751-4266cac4896d admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:42.631066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba6057-90d1-41a4-8751-4266cac4896d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:42.631532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba6057-90d1-41a4-8751-4266cac4896d admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:42.632268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba6057-90d1-41a4-8751-4266cac4896d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:42.632915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b7aec-70d6-4d6b-8fa9-1fe1f9eabee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:42.634422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b7aec-70d6-4d6b-8fa9-1fe1f9eabee5 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:42.634565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba6057-90d1-41a4-8751-4266cac4896d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:42.635036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b7aec-70d6-4d6b-8fa9-1fe1f9eabee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:42.635672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b7aec-70d6-4d6b-8fa9-1fe1f9eabee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:42.638077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b7aec-70d6-4d6b-8fa9-1fe1f9eabee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:42.642117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b7aec-70d6-4d6b-8fa9-1fe1f9eabee5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:42.648449 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2903/5819] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:42.653257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba6057-90d1-41a4-8751-4266cac4896d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:42.657252 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2917/5820] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:42.661614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b7aec-70d6-4d6b-8fa9-1fe1f9eabee5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:42.667437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba6057-90d1-41a4-8751-4266cac4896d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:42.673739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b7aec-70d6-4d6b-8fa9-1fe1f9eabee5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:42.676731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de27d4-9ff5-4b10-ab18-bf512fa650ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:42.676731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de27d4-9ff5-4b10-ab18-bf512fa650ec admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:42.676731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de27d4-9ff5-4b10-ab18-bf512fa650ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:42.676731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de27d4-9ff5-4b10-ab18-bf512fa650ec admin admin] PATH_INFO: `/v3/projects/7982d97be6f049ed8d728ff671798233/users/15782bad224b4997bddbcb97a0f3b80f/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:42.684524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c90091-f334-486f-b136-a21cb914e8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:42.685548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c90091-f334-486f-b136-a21cb914e8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:42.686199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c90091-f334-486f-b136-a21cb914e8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:42.686618 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c90091-f334-486f-b136-a21cb914e8b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:42.687905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c90091-f334-486f-b136-a21cb914e8b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:42.690004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c90091-f334-486f-b136-a21cb914e8b5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:42.694943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de27d4-9ff5-4b10-ab18-bf512fa650ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=7982d97be6f049ed8d728ff671798233, user_id=15782bad224b4997bddbcb97a0f3b80f, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:42.698457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de27d4-9ff5-4b10-ab18-bf512fa650ec admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:42.707755 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2918/5821] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:42.712543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c90091-f334-486f-b136-a21cb914e8b5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:42.726104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c90091-f334-486f-b136-a21cb914e8b5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:42.732691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ae43b-e31d-42ed-8e39-6168fb0226e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:42.732834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ae43b-e31d-42ed-8e39-6168fb0226e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:42.733098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ae43b-e31d-42ed-8e39-6168fb0226e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:42.733493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ae43b-e31d-42ed-8e39-6168fb0226e2 admin admin] PATH_INFO: `/v3/projects/0fdf284867284d8ba704789ac86fd3d3/users/4880b8316a6c4a51b93b3f8557925180/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:42.753582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ae43b-e31d-42ed-8e39-6168fb0226e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fdf284867284d8ba704789ac86fd3d3, user_id=4880b8316a6c4a51b93b3f8557925180, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:42.756543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ae43b-e31d-42ed-8e39-6168fb0226e2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:42.798385 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2904/5822] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:39:42 2022] PUT /identity/v3/projects/7982d97be6f049ed8d728ff671798233/users/15782bad224b4997bddbcb97a0f3b80f/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:42.800226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4efed-ce4b-4c7a-8a4c-a3d4aed7e718 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:42.800743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4efed-ce4b-4c7a-8a4c-a3d4aed7e718 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:42.801618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4efed-ce4b-4c7a-8a4c-a3d4aed7e718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:42.851982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2ba4efed-ce4b-4c7a-8a4c-a3d4aed7e718 None None] MFA Rules not processed for user `15782bad224b4997bddbcb97a0f3b80f`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:42.853530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2ba4efed-ce4b-4c7a-8a4c-a3d4aed7e718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:42.865093 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2919/5823] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:39:42 2022] PUT /identity/v3/projects/0fdf284867284d8ba704789ac86fd3d3/users/4880b8316a6c4a51b93b3f8557925180/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:39:42.869315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b396ac-8754-4c50-8c27-c57465e00b57 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:42.869798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b396ac-8754-4c50-8c27-c57465e00b57 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:42.870083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b396ac-8754-4c50-8c27-c57465e00b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:42.901244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-24b396ac-8754-4c50-8c27-c57465e00b57 None None] MFA Rules not processed for user `4880b8316a6c4a51b93b3f8557925180`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:42.902511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-24b396ac-8754-4c50-8c27-c57465e00b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:42.977853 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2905/5824] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:42.985680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4efed-ce4b-4c7a-8a4c-a3d4aed7e718 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:42.987225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2ba4efed-ce4b-4c7a-8a4c-a3d4aed7e718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:43.037612 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2920/5825] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:43.052059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d1587-c195-4aeb-bc85-f306f2758084 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:43.054298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d1587-c195-4aeb-bc85-f306f2758084 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:43.054298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d1587-c195-4aeb-bc85-f306f2758084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:43.087993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4efed-ce4b-4c7a-8a4c-a3d4aed7e718 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:43.092138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546e22a-f28f-44df-b3fd-56f38129bf56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:43.096530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546e22a-f28f-44df-b3fd-56f38129bf56 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:43.096530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546e22a-f28f-44df-b3fd-56f38129bf56 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:43.096530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546e22a-f28f-44df-b3fd-56f38129bf56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:43.097000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ef6d1587-c195-4aeb-bc85-f306f2758084 None None] MFA Rules not processed for user `4880b8316a6c4a51b93b3f8557925180`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:43.098225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ef6d1587-c195-4aeb-bc85-f306f2758084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:43.104420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546e22a-f28f-44df-b3fd-56f38129bf56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:43.106109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546e22a-f28f-44df-b3fd-56f38129bf56 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:43.112413 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2921/5826] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:43.121141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d1587-c195-4aeb-bc85-f306f2758084 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:43.124011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ef6d1587-c195-4aeb-bc85-f306f2758084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:43.124815 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2906/5827] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:39:43.252176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d1587-c195-4aeb-bc85-f306f2758084 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:43.259038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851699e-7b0e-4b7b-8f7d-38da8c2955b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:43.259869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851699e-7b0e-4b7b-8f7d-38da8c2955b5 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:43.260256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851699e-7b0e-4b7b-8f7d-38da8c2955b5 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:43.260654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851699e-7b0e-4b7b-8f7d-38da8c2955b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:43.269354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851699e-7b0e-4b7b-8f7d-38da8c2955b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:43.271361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851699e-7b0e-4b7b-8f7d-38da8c2955b5 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:43.299925 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2922/5828] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:39:43.796703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab3d04-1dc0-4b3e-9361-31873e657e37 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:43.797190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab3d04-1dc0-4b3e-9361-31873e657e37 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:43.797373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab3d04-1dc0-4b3e-9361-31873e657e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:43.839063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0eab3d04-1dc0-4b3e-9361-31873e657e37 None None] MFA Rules not processed for user `4880b8316a6c4a51b93b3f8557925180`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:43.841560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0eab3d04-1dc0-4b3e-9361-31873e657e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:43.860659 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2907/5829] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:48.231614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851699e-7b0e-4b7b-8f7d-38da8c2955b5 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:48.249153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851699e-7b0e-4b7b-8f7d-38da8c2955b5 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:48.258797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709f4f9-9cb4-420d-ae4d-49a3208490b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:48.259704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709f4f9-9cb4-420d-ae4d-49a3208490b8 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:48.259987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709f4f9-9cb4-420d-ae4d-49a3208490b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:48.260271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709f4f9-9cb4-420d-ae4d-49a3208490b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:48.266944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0709f4f9-9cb4-420d-ae4d-49a3208490b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:48.341005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709f4f9-9cb4-420d-ae4d-49a3208490b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:48.342477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709f4f9-9cb4-420d-ae4d-49a3208490b8 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:48.370858 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2923/5830] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:39:49.570701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab3d04-1dc0-4b3e-9361-31873e657e37 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:49.572052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0eab3d04-1dc0-4b3e-9361-31873e657e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:49.603223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab3d04-1dc0-4b3e-9361-31873e657e37 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:49.607466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d45b80-edc7-4c9b-a999-fff3c44fffbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:49.608301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d45b80-edc7-4c9b-a999-fff3c44fffbe service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:49.608757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d45b80-edc7-4c9b-a999-fff3c44fffbe service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:49.609128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d45b80-edc7-4c9b-a999-fff3c44fffbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:49.611156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e8d45b80-edc7-4c9b-a999-fff3c44fffbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:49.630808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d45b80-edc7-4c9b-a999-fff3c44fffbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:49.632410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d45b80-edc7-4c9b-a999-fff3c44fffbe service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:49.646773 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2908/5831] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:39:55.419626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709f4f9-9cb4-420d-ae4d-49a3208490b8 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:55.421364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0709f4f9-9cb4-420d-ae4d-49a3208490b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:55.501923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709f4f9-9cb4-420d-ae4d-49a3208490b8 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:55.508938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697dc24-d7d6-4e95-96e1-4bd2ca7ea779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:55.510095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697dc24-d7d6-4e95-96e1-4bd2ca7ea779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:55.510456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697dc24-d7d6-4e95-96e1-4bd2ca7ea779 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:55.510841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697dc24-d7d6-4e95-96e1-4bd2ca7ea779 admin admin] PATH_INFO: `/v3/users/dee15583ccd24533ad03df793aa9e8dd` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:55.512271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697dc24-d7d6-4e95-96e1-4bd2ca7ea779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dee15583ccd24533ad03df793aa9e8dd)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:55.514460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697dc24-d7d6-4e95-96e1-4bd2ca7ea779 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:55.729675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7697dc24-d7d6-4e95-96e1-4bd2ca7ea779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dee15583ccd24533ad03df793aa9e8dd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:55.746125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7697dc24-d7d6-4e95-96e1-4bd2ca7ea779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dee15583ccd24533ad03df793aa9e8dd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:55.747072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7697dc24-d7d6-4e95-96e1-4bd2ca7ea779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dee15583ccd24533ad03df793aa9e8dd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:55.757243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7697dc24-d7d6-4e95-96e1-4bd2ca7ea779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dee15583ccd24533ad03df793aa9e8dd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:55.857602 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7697dc24-d7d6-4e95-96e1-4bd2ca7ea779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dee15583ccd24533ad03df793aa9e8dd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:55.865367 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2924/5832] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:39:55 2022] DELETE /identity/v3/users/dee15583ccd24533ad03df793aa9e8dd => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:55.870517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cfdbf-a7c4-45d4-80fa-4d3ecde10a50 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:55.872678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cfdbf-a7c4-45d4-80fa-4d3ecde10a50 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:55.872678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cfdbf-a7c4-45d4-80fa-4d3ecde10a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:55.889480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0f9cfdbf-a7c4-45d4-80fa-4d3ecde10a50 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:55.890689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0f9cfdbf-a7c4-45d4-80fa-4d3ecde10a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:55.962055 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2909/5833] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:55.972891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697dc24-d7d6-4e95-96e1-4bd2ca7ea779 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:55.974433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7697dc24-d7d6-4e95-96e1-4bd2ca7ea779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:56.045250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697dc24-d7d6-4e95-96e1-4bd2ca7ea779 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:56.059148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418ae88-14c7-4eeb-ba6b-0fb7f4751f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:56.059932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418ae88-14c7-4eeb-ba6b-0fb7f4751f2d service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:56.060223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418ae88-14c7-4eeb-ba6b-0fb7f4751f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:56.060497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418ae88-14c7-4eeb-ba6b-0fb7f4751f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:56.073497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418ae88-14c7-4eeb-ba6b-0fb7f4751f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:56.074675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418ae88-14c7-4eeb-ba6b-0fb7f4751f2d service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:56.087087 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2925/5834] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:39:56.481490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cfdbf-a7c4-45d4-80fa-4d3ecde10a50 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:56.483302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0f9cfdbf-a7c4-45d4-80fa-4d3ecde10a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:56.498969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cfdbf-a7c4-45d4-80fa-4d3ecde10a50 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:56.504547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008c932-3988-43be-bb57-0f84debccced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:56.505711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008c932-3988-43be-bb57-0f84debccced admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:56.505995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008c932-3988-43be-bb57-0f84debccced admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:56.510862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008c932-3988-43be-bb57-0f84debccced admin admin] PATH_INFO: `/v3/users/5c80bb9dda7f460dac27aff66ef40947` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:56.510862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008c932-3988-43be-bb57-0f84debccced admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c80bb9dda7f460dac27aff66ef40947)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:56.510862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008c932-3988-43be-bb57-0f84debccced admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:56.782277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418ae88-14c7-4eeb-ba6b-0fb7f4751f2d service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:56.783670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e418ae88-14c7-4eeb-ba6b-0fb7f4751f2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:56.801621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418ae88-14c7-4eeb-ba6b-0fb7f4751f2d service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:56.813632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c008c932-3988-43be-bb57-0f84debccced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c80bb9dda7f460dac27aff66ef40947'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:56.815506 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd4c95-b261-4b5d-8cfb-b5c9400bf775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:56.816430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd4c95-b261-4b5d-8cfb-b5c9400bf775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:56.816893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd4c95-b261-4b5d-8cfb-b5c9400bf775 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:56.817342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd4c95-b261-4b5d-8cfb-b5c9400bf775 admin admin] PATH_INFO: `/v3/projects/b966b8424fbd467a9bbf41c754440659` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:56.819499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd4c95-b261-4b5d-8cfb-b5c9400bf775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b966b8424fbd467a9bbf41c754440659)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:56.822033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd4c95-b261-4b5d-8cfb-b5c9400bf775 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:56.830170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c008c932-3988-43be-bb57-0f84debccced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c80bb9dda7f460dac27aff66ef40947'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:56.831821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c008c932-3988-43be-bb57-0f84debccced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c80bb9dda7f460dac27aff66ef40947'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:56.842953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c008c932-3988-43be-bb57-0f84debccced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c80bb9dda7f460dac27aff66ef40947'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:56.986173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c008c932-3988-43be-bb57-0f84debccced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c80bb9dda7f460dac27aff66ef40947'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:56.993825 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2910/5835] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:39:56 2022] DELETE /identity/v3/users/5c80bb9dda7f460dac27aff66ef40947 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:56.998219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5abcb7-176e-44ee-85d8-ae0e6410ac69 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:56.998514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5abcb7-176e-44ee-85d8-ae0e6410ac69 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:56.998798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5abcb7-176e-44ee-85d8-ae0e6410ac69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:57.017376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8a5abcb7-176e-44ee-85d8-ae0e6410ac69 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:57.018586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8a5abcb7-176e-44ee-85d8-ae0e6410ac69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:57.049608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69bd4c95-b261-4b5d-8cfb-b5c9400bf775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b966b8424fbd467a9bbf41c754440659', 'request_id': 'req-69bd4c95-b261-4b5d-8cfb-b5c9400bf775'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:57.092011 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2911/5836] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:57.111036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5abcb7-176e-44ee-85d8-ae0e6410ac69 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:57.112532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8a5abcb7-176e-44ee-85d8-ae0e6410ac69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:57.152028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69bd4c95-b261-4b5d-8cfb-b5c9400bf775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b966b8424fbd467a9bbf41c754440659', 'request_id': 'req-69bd4c95-b261-4b5d-8cfb-b5c9400bf775'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:57.159459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69bd4c95-b261-4b5d-8cfb-b5c9400bf775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b966b8424fbd467a9bbf41c754440659', 'request_id': 'req-69bd4c95-b261-4b5d-8cfb-b5c9400bf775'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:57.171270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69bd4c95-b261-4b5d-8cfb-b5c9400bf775 admin admin] The token cache is being invalidate because project b966b8424fbd467a9bbf41c754440659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:39:57.171562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69bd4c95-b261-4b5d-8cfb-b5c9400bf775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:57.172422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69bd4c95-b261-4b5d-8cfb-b5c9400bf775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:57.174319 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2926/5837] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:39:56 2022] DELETE /identity/v3/projects/b966b8424fbd467a9bbf41c754440659 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:39:57.178812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd4c95-b261-4b5d-8cfb-b5c9400bf775 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:57.181025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-69bd4c95-b261-4b5d-8cfb-b5c9400bf775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:57.189413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5abcb7-176e-44ee-85d8-ae0e6410ac69 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:57.291182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc19065-2db3-4d4a-8069-5af87ea2fe5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:57.291862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc19065-2db3-4d4a-8069-5af87ea2fe5e service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:57.292148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc19065-2db3-4d4a-8069-5af87ea2fe5e service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:57.292428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc19065-2db3-4d4a-8069-5af87ea2fe5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:57.292904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd4c95-b261-4b5d-8cfb-b5c9400bf775 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:57.294435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0bc19065-2db3-4d4a-8069-5af87ea2fe5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:57.298734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b0b86-bec3-4450-85a5-e53b5fb481c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:57.300277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b0b86-bec3-4450-85a5-e53b5fb481c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:57.301375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b0b86-bec3-4450-85a5-e53b5fb481c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:57.302666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b0b86-bec3-4450-85a5-e53b5fb481c7 admin admin] PATH_INFO: `/v3/users/0252c1afca7949d3ba69b5fde4c0d5be` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:57.304210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b0b86-bec3-4450-85a5-e53b5fb481c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0252c1afca7949d3ba69b5fde4c0d5be)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:57.309882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b0b86-bec3-4450-85a5-e53b5fb481c7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:57.321453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc19065-2db3-4d4a-8069-5af87ea2fe5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:57.323048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc19065-2db3-4d4a-8069-5af87ea2fe5e service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:57.336948 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2912/5838] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:39:57.558359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f29b0b86-bec3-4450-85a5-e53b5fb481c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0252c1afca7949d3ba69b5fde4c0d5be'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:57.573054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f29b0b86-bec3-4450-85a5-e53b5fb481c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0252c1afca7949d3ba69b5fde4c0d5be'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:57.573848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f29b0b86-bec3-4450-85a5-e53b5fb481c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0252c1afca7949d3ba69b5fde4c0d5be'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:57.580852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f29b0b86-bec3-4450-85a5-e53b5fb481c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0252c1afca7949d3ba69b5fde4c0d5be'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:57.660726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f29b0b86-bec3-4450-85a5-e53b5fb481c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0252c1afca7949d3ba69b5fde4c0d5be'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:57.667542 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2927/5839] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:39:57 2022] DELETE /identity/v3/users/0252c1afca7949d3ba69b5fde4c0d5be => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:58.075425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc19065-2db3-4d4a-8069-5af87ea2fe5e service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:58.076938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0bc19065-2db3-4d4a-8069-5af87ea2fe5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:58.090698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc19065-2db3-4d4a-8069-5af87ea2fe5e service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:58.108844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b0b86-bec3-4450-85a5-e53b5fb481c7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:58.108844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f29b0b86-bec3-4450-85a5-e53b5fb481c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:58.203013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a519007-e33b-439c-a8c1-a99164e63463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:58.209182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a519007-e33b-439c-a8c1-a99164e63463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:58.209182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a519007-e33b-439c-a8c1-a99164e63463 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:58.209182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a519007-e33b-439c-a8c1-a99164e63463 admin admin] PATH_INFO: `/v3/projects/24d72c31f7ad4e3e96bdb585f2890f6b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:58.209182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a519007-e33b-439c-a8c1-a99164e63463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d72c31f7ad4e3e96bdb585f2890f6b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:58.214955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a519007-e33b-439c-a8c1-a99164e63463 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:58.221180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b0b86-bec3-4450-85a5-e53b5fb481c7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:58.226053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c02e4-3508-4b80-8b0a-de7179ad3a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:58.227040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c02e4-3508-4b80-8b0a-de7179ad3a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:58.227318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c02e4-3508-4b80-8b0a-de7179ad3a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:58.228019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c02e4-3508-4b80-8b0a-de7179ad3a38 admin admin] PATH_INFO: `/v3/projects/30609305470944a3807c825dd709a1b2` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:58.229286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c02e4-3508-4b80-8b0a-de7179ad3a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30609305470944a3807c825dd709a1b2)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:58.231482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c02e4-3508-4b80-8b0a-de7179ad3a38 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:58.363732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-719c02e4-3508-4b80-8b0a-de7179ad3a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30609305470944a3807c825dd709a1b2', 'request_id': 'req-719c02e4-3508-4b80-8b0a-de7179ad3a38'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:58.368161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5a519007-e33b-439c-a8c1-a99164e63463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d72c31f7ad4e3e96bdb585f2890f6b', 'request_id': 'req-5a519007-e33b-439c-a8c1-a99164e63463'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:58.377711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5a519007-e33b-439c-a8c1-a99164e63463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d72c31f7ad4e3e96bdb585f2890f6b', 'request_id': 'req-5a519007-e33b-439c-a8c1-a99164e63463'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:58.456868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-719c02e4-3508-4b80-8b0a-de7179ad3a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30609305470944a3807c825dd709a1b2', 'request_id': 'req-719c02e4-3508-4b80-8b0a-de7179ad3a38'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:58.466291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-719c02e4-3508-4b80-8b0a-de7179ad3a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30609305470944a3807c825dd709a1b2', 'request_id': 'req-719c02e4-3508-4b80-8b0a-de7179ad3a38'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:58.478383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-719c02e4-3508-4b80-8b0a-de7179ad3a38 admin admin] The token cache is being invalidate because project 30609305470944a3807c825dd709a1b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:39:58.478671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-719c02e4-3508-4b80-8b0a-de7179ad3a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:58.479546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-719c02e4-3508-4b80-8b0a-de7179ad3a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:58.481649 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2928/5840] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:39:58 2022] DELETE /identity/v3/projects/30609305470944a3807c825dd709a1b2 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:58.487653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b297e-7777-4a8f-83e5-6964bf350806 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:58.488181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b297e-7777-4a8f-83e5-6964bf350806 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:58.488713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b297e-7777-4a8f-83e5-6964bf350806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:58.519691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e93b297e-7777-4a8f-83e5-6964bf350806 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:58.522150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e93b297e-7777-4a8f-83e5-6964bf350806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:58.569470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5a519007-e33b-439c-a8c1-a99164e63463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d72c31f7ad4e3e96bdb585f2890f6b', 'request_id': 'req-5a519007-e33b-439c-a8c1-a99164e63463'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:58.587162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5a519007-e33b-439c-a8c1-a99164e63463 admin admin] The token cache is being invalidate because project 24d72c31f7ad4e3e96bdb585f2890f6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:39:58.588692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5a519007-e33b-439c-a8c1-a99164e63463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:58.597984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5a519007-e33b-439c-a8c1-a99164e63463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:39:58.597984 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2913/5841] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:39:58 2022] DELETE /identity/v3/projects/24d72c31f7ad4e3e96bdb585f2890f6b => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:58.600147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200b390-5b6b-44d7-a447-1f13daf6068e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:58.600406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200b390-5b6b-44d7-a447-1f13daf6068e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:58.600716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200b390-5b6b-44d7-a447-1f13daf6068e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:58.640149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c200b390-5b6b-44d7-a447-1f13daf6068e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:58.641585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c200b390-5b6b-44d7-a447-1f13daf6068e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:58.649424 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2929/5842] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:58.653379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97beb8-6cc7-4665-9b62-3311ebadf27f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:58.654089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97beb8-6cc7-4665-9b62-3311ebadf27f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:58.654592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97beb8-6cc7-4665-9b62-3311ebadf27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:58.661345 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2914/5843] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:58.663075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f522160-7a82-4c3c-9e58-1179547875b8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:58.663362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f522160-7a82-4c3c-9e58-1179547875b8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:58.663642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f522160-7a82-4c3c-9e58-1179547875b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:58.676367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-de97beb8-6cc7-4665-9b62-3311ebadf27f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:58.677797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-de97beb8-6cc7-4665-9b62-3311ebadf27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:58.683977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0f522160-7a82-4c3c-9e58-1179547875b8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:58.685277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0f522160-7a82-4c3c-9e58-1179547875b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:58.688648 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2930/5844] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:58.693588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97beb8-6cc7-4665-9b62-3311ebadf27f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:58.694091 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2915/5845] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:39:58.698856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f522160-7a82-4c3c-9e58-1179547875b8 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:58.706155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97beb8-6cc7-4665-9b62-3311ebadf27f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:58.709619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f522160-7a82-4c3c-9e58-1179547875b8 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:58.713927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e796196-446b-4e46-ae2d-51c442c72056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:58.714700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e796196-446b-4e46-ae2d-51c442c72056 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:58.714959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e796196-446b-4e46-ae2d-51c442c72056 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:58.715244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e796196-446b-4e46-ae2d-51c442c72056 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:58.715826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edc344-efad-44cd-aeb8-93d9fca839b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:58.716002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e796196-446b-4e46-ae2d-51c442c72056 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:39:58.716310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e796196-446b-4e46-ae2d-51c442c72056 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:58.716921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edc344-efad-44cd-aeb8-93d9fca839b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:58.717288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edc344-efad-44cd-aeb8-93d9fca839b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:58.717637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edc344-efad-44cd-aeb8-93d9fca839b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:58.718124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e796196-446b-4e46-ae2d-51c442c72056 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:58.718517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edc344-efad-44cd-aeb8-93d9fca839b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:39:58.718898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edc344-efad-44cd-aeb8-93d9fca839b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:58.720920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edc344-efad-44cd-aeb8-93d9fca839b1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:58.730888 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2931/5846] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:39:58.735068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e796196-446b-4e46-ae2d-51c442c72056 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:58.737125 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2916/5847] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:39:58.738914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edc344-efad-44cd-aeb8-93d9fca839b1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:58.746433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e796196-446b-4e46-ae2d-51c442c72056 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:58.753953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bf01c-5b05-4e2e-9417-68922deba511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:58.754816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bf01c-5b05-4e2e-9417-68922deba511 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:58.755116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bf01c-5b05-4e2e-9417-68922deba511 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:58.755399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bf01c-5b05-4e2e-9417-68922deba511 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:58.756420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84bf01c-5b05-4e2e-9417-68922deba511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:58.758339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edc344-efad-44cd-aeb8-93d9fca839b1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:58.760626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84bf01c-5b05-4e2e-9417-68922deba511 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:58.765452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b508c8-67f5-4f16-917c-0667fa173aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:58.767489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b508c8-67f5-4f16-917c-0667fa173aaa admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:58.768169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b508c8-67f5-4f16-917c-0667fa173aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:58.768737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b508c8-67f5-4f16-917c-0667fa173aaa admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:58.769558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b508c8-67f5-4f16-917c-0667fa173aaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:58.771601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b508c8-67f5-4f16-917c-0667fa173aaa admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:58.854639 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2932/5848] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:39:58 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:58.856144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bf01c-5b05-4e2e-9417-68922deba511 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:58.879257 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2917/5849] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:39:58 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:39:58.883715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b508c8-67f5-4f16-917c-0667fa173aaa admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:58.948224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bf01c-5b05-4e2e-9417-68922deba511 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:58.976004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b508c8-67f5-4f16-917c-0667fa173aaa admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:58.981669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077644b-1f0d-43bb-bdbf-1c2d10cc498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:58.982781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077644b-1f0d-43bb-bdbf-1c2d10cc498a admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:58.983074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077644b-1f0d-43bb-bdbf-1c2d10cc498a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:58.983363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077644b-1f0d-43bb-bdbf-1c2d10cc498a admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:58.984229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077644b-1f0d-43bb-bdbf-1c2d10cc498a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:58.986329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077644b-1f0d-43bb-bdbf-1c2d10cc498a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:59.035743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013d14e-671c-4cf8-a9dc-ab1017e3daf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:59.035743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013d14e-671c-4cf8-a9dc-ab1017e3daf4 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:59.036032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013d14e-671c-4cf8-a9dc-ab1017e3daf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:59.036419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013d14e-671c-4cf8-a9dc-ab1017e3daf4 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:59.037268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013d14e-671c-4cf8-a9dc-ab1017e3daf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:59.040111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013d14e-671c-4cf8-a9dc-ab1017e3daf4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:59.058595 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2918/5850] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:39:58 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:59.060178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077644b-1f0d-43bb-bdbf-1c2d10cc498a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:59.079998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077644b-1f0d-43bb-bdbf-1c2d10cc498a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:59.126795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182cb63-f6d5-4cec-9f92-e8ced9f3a54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:59.127949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182cb63-f6d5-4cec-9f92-e8ced9f3a54f admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:59.128392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182cb63-f6d5-4cec-9f92-e8ced9f3a54f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:59.129006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182cb63-f6d5-4cec-9f92-e8ced9f3a54f admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:59.130693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182cb63-f6d5-4cec-9f92-e8ced9f3a54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:59.132516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182cb63-f6d5-4cec-9f92-e8ced9f3a54f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:59.149310 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2919/5851] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:39:59.153536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182cb63-f6d5-4cec-9f92-e8ced9f3a54f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:59.168894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182cb63-f6d5-4cec-9f92-e8ced9f3a54f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:59.171447 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2933/5852] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:39:58 2022] POST /identity/v3/users => generated 284 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:39:59.174474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750a45f-c17f-43f8-ac56-c2443886f2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:59.175513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750a45f-c17f-43f8-ac56-c2443886f2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:59.175780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013d14e-671c-4cf8-a9dc-ab1017e3daf4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:59.175903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750a45f-c17f-43f8-ac56-c2443886f2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:59.176324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750a45f-c17f-43f8-ac56-c2443886f2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:59.177333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750a45f-c17f-43f8-ac56-c2443886f2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:59.179324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750a45f-c17f-43f8-ac56-c2443886f2a1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:59.189209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013d14e-671c-4cf8-a9dc-ab1017e3daf4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:59.197022 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2920/5853] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:39:59.199670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3694b-29ff-4321-bf5a-ddda62f605de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:59.200735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750a45f-c17f-43f8-ac56-c2443886f2a1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:59.201696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3694b-29ff-4321-bf5a-ddda62f605de admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:59.202107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3694b-29ff-4321-bf5a-ddda62f605de admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:59.202506 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3694b-29ff-4321-bf5a-ddda62f605de admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:59.203329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3694b-29ff-4321-bf5a-ddda62f605de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:59.205955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3694b-29ff-4321-bf5a-ddda62f605de admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:59.217223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750a45f-c17f-43f8-ac56-c2443886f2a1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:59.217479 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2934/5854] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:39:59.221656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3694b-29ff-4321-bf5a-ddda62f605de admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:59.223527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376227a-88ce-4e35-9400-79b9e76f2cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:59.224440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376227a-88ce-4e35-9400-79b9e76f2cfa admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:59.224862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376227a-88ce-4e35-9400-79b9e76f2cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:59.225274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376227a-88ce-4e35-9400-79b9e76f2cfa admin admin] PATH_INFO: `/v3/projects/42802f1cc49a47abb61f1aca504c8e4b/users/00901b5b42a84fc9960ab2ba01de97a7/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:59.233869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3694b-29ff-4321-bf5a-ddda62f605de admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:59.241609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ae219-7365-4005-a8b1-14048ec7dc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:59.243218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ae219-7365-4005-a8b1-14048ec7dc38 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:59.243573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ae219-7365-4005-a8b1-14048ec7dc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:59.243925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ae219-7365-4005-a8b1-14048ec7dc38 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:59.244825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ae219-7365-4005-a8b1-14048ec7dc38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:59.245199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376227a-88ce-4e35-9400-79b9e76f2cfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=42802f1cc49a47abb61f1aca504c8e4b, user_id=00901b5b42a84fc9960ab2ba01de97a7, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:59.246888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ae219-7365-4005-a8b1-14048ec7dc38 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:59.249185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376227a-88ce-4e35-9400-79b9e76f2cfa admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:59.266320 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2935/5855] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:39:59.270647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ae219-7365-4005-a8b1-14048ec7dc38 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:59.284038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ae219-7365-4005-a8b1-14048ec7dc38 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:59.290199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83a239-736d-4554-93c8-596451549027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:59.292131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83a239-736d-4554-93c8-596451549027 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:59.292741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83a239-736d-4554-93c8-596451549027 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:59.292741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83a239-736d-4554-93c8-596451549027 admin admin] PATH_INFO: `/v3/projects/96b4dbd89e394f9e8f33e8b9094cdd51/users/5e16ad9f403c4285a9ed8eefe67b1899/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:59.311583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83a239-736d-4554-93c8-596451549027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b4dbd89e394f9e8f33e8b9094cdd51, user_id=5e16ad9f403c4285a9ed8eefe67b1899, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:59.314309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83a239-736d-4554-93c8-596451549027 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:59.360959 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2921/5856] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:39:59 2022] PUT /identity/v3/projects/42802f1cc49a47abb61f1aca504c8e4b/users/00901b5b42a84fc9960ab2ba01de97a7/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:39:59.363300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59032a1b-0737-4370-ac6e-9bc581adf241 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:59.363766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59032a1b-0737-4370-ac6e-9bc581adf241 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:59.364085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59032a1b-0737-4370-ac6e-9bc581adf241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:59.384028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-59032a1b-0737-4370-ac6e-9bc581adf241 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:59.385284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-59032a1b-0737-4370-ac6e-9bc581adf241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:59.404625 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2936/5857] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:39:59 2022] PUT /identity/v3/projects/96b4dbd89e394f9e8f33e8b9094cdd51/users/5e16ad9f403c4285a9ed8eefe67b1899/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:39:59.473722 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2922/5858] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:59.486586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83a239-736d-4554-93c8-596451549027 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:59.490428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2e83a239-736d-4554-93c8-596451549027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:59.507145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b88f8-5998-4341-88d4-f66a26c1e3b8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:59.507397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b88f8-5998-4341-88d4-f66a26c1e3b8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:59.507729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b88f8-5998-4341-88d4-f66a26c1e3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:59.564225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-426b88f8-5998-4341-88d4-f66a26c1e3b8 None None] MFA Rules not processed for user `5e16ad9f403c4285a9ed8eefe67b1899`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:39:59.565520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-426b88f8-5998-4341-88d4-f66a26c1e3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:39:59.587173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83a239-736d-4554-93c8-596451549027 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:59.592461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b69494-f533-40cf-95a4-92d52d349fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:59.593190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b69494-f533-40cf-95a4-92d52d349fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:59.593476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b69494-f533-40cf-95a4-92d52d349fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:59.593753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b69494-f533-40cf-95a4-92d52d349fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:59.705439 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2923/5859] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:39:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:39:59.706883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b88f8-5998-4341-88d4-f66a26c1e3b8 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:59.720584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b69494-f533-40cf-95a4-92d52d349fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:59.722798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b69494-f533-40cf-95a4-92d52d349fb2 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:59.731327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b88f8-5998-4341-88d4-f66a26c1e3b8 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:59.739585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d5a3d-e878-450e-8cca-23645ac4910a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:59.739986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d5a3d-e878-450e-8cca-23645ac4910a admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:59.740280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d5a3d-e878-450e-8cca-23645ac4910a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:59.740555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d5a3d-e878-450e-8cca-23645ac4910a admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:59.741321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d5a3d-e878-450e-8cca-23645ac4910a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:59.745058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d5a3d-e878-450e-8cca-23645ac4910a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:39:59.747128 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2937/5860] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:39:59.870454 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2924/5861] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:39:59 2022] POST /identity/v3/projects => generated 369 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:39:59.874567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b69494-f533-40cf-95a4-92d52d349fb2 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:39:59.888313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b69494-f533-40cf-95a4-92d52d349fb2 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:39:59.992171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e66c2-68db-4f65-97ca-1fa7858dc800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:39:59.992978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e66c2-68db-4f65-97ca-1fa7858dc800 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:39:59.993334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e66c2-68db-4f65-97ca-1fa7858dc800 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:39:59.993824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e66c2-68db-4f65-97ca-1fa7858dc800 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:39:59.994731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e66c2-68db-4f65-97ca-1fa7858dc800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:39:59.996928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e66c2-68db-4f65-97ca-1fa7858dc800 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:00.114122 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2938/5862] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:39:59 2022] POST /identity/v3/users => generated 291 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:40:00.118104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d5a3d-e878-450e-8cca-23645ac4910a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:00.133777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d5a3d-e878-450e-8cca-23645ac4910a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:00.136484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d94781-5a79-41bd-93ba-68f57ec6460e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:00.137271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d94781-5a79-41bd-93ba-68f57ec6460e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:00.137629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d94781-5a79-41bd-93ba-68f57ec6460e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:00.137977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d94781-5a79-41bd-93ba-68f57ec6460e admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:00.138816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d94781-5a79-41bd-93ba-68f57ec6460e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:00.140683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d94781-5a79-41bd-93ba-68f57ec6460e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:00.152778 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2925/5863] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:40:00.157061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e66c2-68db-4f65-97ca-1fa7858dc800 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:00.168159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e66c2-68db-4f65-97ca-1fa7858dc800 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:00.175493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23775a6b-dc1b-4bde-9525-9f221c43c0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:00.177132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23775a6b-dc1b-4bde-9525-9f221c43c0f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:00.177790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23775a6b-dc1b-4bde-9525-9f221c43c0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:00.178335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23775a6b-dc1b-4bde-9525-9f221c43c0f9 admin admin] PATH_INFO: `/v3/projects/4a18e30d19254c0d9ab412deded797a1/users/a676d585eafd4904b48ce5cad0731a97/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:00.193818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23775a6b-dc1b-4bde-9525-9f221c43c0f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a18e30d19254c0d9ab412deded797a1, user_id=a676d585eafd4904b48ce5cad0731a97, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:00.197111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23775a6b-dc1b-4bde-9525-9f221c43c0f9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:00.369758 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2939/5864] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:40:00 2022] PUT /identity/v3/projects/4a18e30d19254c0d9ab412deded797a1/users/a676d585eafd4904b48ce5cad0731a97/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:40:00.370867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d94781-5a79-41bd-93ba-68f57ec6460e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:00.383324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d94781-5a79-41bd-93ba-68f57ec6460e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:00.457945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5443f09-12e8-4964-a771-e695b2423f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:00.460665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5443f09-12e8-4964-a771-e695b2423f94 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:00.460665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5443f09-12e8-4964-a771-e695b2423f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:00.460665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5443f09-12e8-4964-a771-e695b2423f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:00.460665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5443f09-12e8-4964-a771-e695b2423f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:00.462983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5443f09-12e8-4964-a771-e695b2423f94 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:00.477239 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2926/5865] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:40:00.481836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23775a6b-dc1b-4bde-9525-9f221c43c0f9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:00.492939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23775a6b-dc1b-4bde-9525-9f221c43c0f9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:00.498013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245f15a-2fb2-4df8-b759-ef781a4f489d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:00.498974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245f15a-2fb2-4df8-b759-ef781a4f489d admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:00.499285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245f15a-2fb2-4df8-b759-ef781a4f489d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:00.499547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245f15a-2fb2-4df8-b759-ef781a4f489d admin admin] PATH_INFO: `/v3/projects/4a18e30d19254c0d9ab412deded797a1/users/a676d585eafd4904b48ce5cad0731a97/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:00.501882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245f15a-2fb2-4df8-b759-ef781a4f489d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a18e30d19254c0d9ab412deded797a1, user_id=a676d585eafd4904b48ce5cad0731a97, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:00.506097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245f15a-2fb2-4df8-b759-ef781a4f489d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:00.518003 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2940/5866] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:40:00 2022] PUT /identity/v3/projects/4a18e30d19254c0d9ab412deded797a1/users/a676d585eafd4904b48ce5cad0731a97/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:40:00.528988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391b0a5-829e-42d6-90d6-632800969f63 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:00.529285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391b0a5-829e-42d6-90d6-632800969f63 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:00.529748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391b0a5-829e-42d6-90d6-632800969f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:00.561358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9391b0a5-829e-42d6-90d6-632800969f63 None None] MFA Rules not processed for user `a676d585eafd4904b48ce5cad0731a97`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:40:00.562515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9391b0a5-829e-42d6-90d6-632800969f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:00.668736 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2927/5867] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:40:00 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:40:00.671304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245f15a-2fb2-4df8-b759-ef781a4f489d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:00.673171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2245f15a-2fb2-4df8-b759-ef781a4f489d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:00.756238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245f15a-2fb2-4df8-b759-ef781a4f489d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:00.760922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84894766-1914-4bf9-ae54-33cc37e2872c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:00.761873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84894766-1914-4bf9-ae54-33cc37e2872c service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:00.762459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84894766-1914-4bf9-ae54-33cc37e2872c service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:00.762459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84894766-1914-4bf9-ae54-33cc37e2872c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:00.778261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84894766-1914-4bf9-ae54-33cc37e2872c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:00.780482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84894766-1914-4bf9-ae54-33cc37e2872c service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:00.795781 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2941/5868] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:40:00 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:40:00.911800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391b0a5-829e-42d6-90d6-632800969f63 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:00.921403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9391b0a5-829e-42d6-90d6-632800969f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:00.939032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391b0a5-829e-42d6-90d6-632800969f63 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:00.945228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af31d1-0bc4-4552-a4f4-8449064fc1a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:00.946669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af31d1-0bc4-4552-a4f4-8449064fc1a8 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:00.947152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af31d1-0bc4-4552-a4f4-8449064fc1a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:00.947590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af31d1-0bc4-4552-a4f4-8449064fc1a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:01.036268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af31d1-0bc4-4552-a4f4-8449064fc1a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:01.038301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af31d1-0bc4-4552-a4f4-8449064fc1a8 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:01.049861 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2928/5869] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:40:00 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:40:01.573557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd9bf3-7784-49a2-9d04-60318b13ead0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:01.574091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd9bf3-7784-49a2-9d04-60318b13ead0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:01.574091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd9bf3-7784-49a2-9d04-60318b13ead0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:01.599035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d6fd9bf3-7784-49a2-9d04-60318b13ead0 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:40:01.600278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d6fd9bf3-7784-49a2-9d04-60318b13ead0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:01.681629 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2942/5870] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:40:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:40:01.683115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af31d1-0bc4-4552-a4f4-8449064fc1a8 service cinder] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:01.684716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a1af31d1-0bc4-4552-a4f4-8449064fc1a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:01.791315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af31d1-0bc4-4552-a4f4-8449064fc1a8 service cinder] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:01.796822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceafcb40-9d88-4c55-87f2-7eb6af4d75c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:01.797692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafcb40-9d88-4c55-87f2-7eb6af4d75c4 service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:01.798127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafcb40-9d88-4c55-87f2-7eb6af4d75c4 service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:01.798501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafcb40-9d88-4c55-87f2-7eb6af4d75c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:01.810607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceafcb40-9d88-4c55-87f2-7eb6af4d75c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:01.812227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceafcb40-9d88-4c55-87f2-7eb6af4d75c4 service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:01.822050 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2929/5871] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:40:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:40:03.430071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd9bf3-7784-49a2-9d04-60318b13ead0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:03.431661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d6fd9bf3-7784-49a2-9d04-60318b13ead0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:03.640501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd9bf3-7784-49a2-9d04-60318b13ead0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:03.659375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb641a3-9cc9-4d30-9250-760e5a3a9fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:03.660646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb641a3-9cc9-4d30-9250-760e5a3a9fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:03.661296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb641a3-9cc9-4d30-9250-760e5a3a9fec admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:03.661814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb641a3-9cc9-4d30-9250-760e5a3a9fec admin admin] PATH_INFO: `/v3/users/a6cd9c820ef74b2f9ef7db7846159495` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:03.664898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb641a3-9cc9-4d30-9250-760e5a3a9fec admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6cd9c820ef74b2f9ef7db7846159495)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:03.667063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb641a3-9cc9-4d30-9250-760e5a3a9fec admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:03.996220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bbb641a3-9cc9-4d30-9250-760e5a3a9fec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6cd9c820ef74b2f9ef7db7846159495'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:04.048640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bbb641a3-9cc9-4d30-9250-760e5a3a9fec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6cd9c820ef74b2f9ef7db7846159495'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:04.050770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bbb641a3-9cc9-4d30-9250-760e5a3a9fec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6cd9c820ef74b2f9ef7db7846159495'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:04.083009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bbb641a3-9cc9-4d30-9250-760e5a3a9fec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6cd9c820ef74b2f9ef7db7846159495'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:04.196064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bbb641a3-9cc9-4d30-9250-760e5a3a9fec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6cd9c820ef74b2f9ef7db7846159495'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:04.209272 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2943/5872] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:40:03 2022] DELETE /identity/v3/users/a6cd9c820ef74b2f9ef7db7846159495 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:40:04.214006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b60e2c-8aac-47f1-aa0e-a1c65e663e0e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:04.214510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b60e2c-8aac-47f1-aa0e-a1c65e663e0e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:04.215769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b60e2c-8aac-47f1-aa0e-a1c65e663e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:04.272965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c4b60e2c-8aac-47f1-aa0e-a1c65e663e0e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:40:04.274400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c4b60e2c-8aac-47f1-aa0e-a1c65e663e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:04.475835 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2930/5873] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:40:04.492856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb641a3-9cc9-4d30-9250-760e5a3a9fec admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:04.494387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bbb641a3-9cc9-4d30-9250-760e5a3a9fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:04.686023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb641a3-9cc9-4d30-9250-760e5a3a9fec admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:04.705459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de417e41-5c6b-4c9b-a0f9-47f29f5a67f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:04.706147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de417e41-5c6b-4c9b-a0f9-47f29f5a67f3 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:04.706435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de417e41-5c6b-4c9b-a0f9-47f29f5a67f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:04.706734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de417e41-5c6b-4c9b-a0f9-47f29f5a67f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:04.742585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de417e41-5c6b-4c9b-a0f9-47f29f5a67f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:04.744142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de417e41-5c6b-4c9b-a0f9-47f29f5a67f3 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:04.785127 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2944/5874] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:40:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:40:05.943817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b60e2c-8aac-47f1-aa0e-a1c65e663e0e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:05.947353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c4b60e2c-8aac-47f1-aa0e-a1c65e663e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:05.973148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b60e2c-8aac-47f1-aa0e-a1c65e663e0e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:05.989802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8799c-8330-432b-af28-90aa46d26fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:05.991101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8799c-8330-432b-af28-90aa46d26fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:05.991395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8799c-8330-432b-af28-90aa46d26fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:05.992628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8799c-8330-432b-af28-90aa46d26fa4 admin admin] PATH_INFO: `/v3/projects/6fb3f9dce951489aafe56b0d30841164` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:06.006128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8799c-8330-432b-af28-90aa46d26fa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fb3f9dce951489aafe56b0d30841164)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:06.016212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8799c-8330-432b-af28-90aa46d26fa4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:06.220953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-52a8799c-8330-432b-af28-90aa46d26fa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fb3f9dce951489aafe56b0d30841164', 'request_id': 'req-52a8799c-8330-432b-af28-90aa46d26fa4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:06.243690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-52a8799c-8330-432b-af28-90aa46d26fa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fb3f9dce951489aafe56b0d30841164', 'request_id': 'req-52a8799c-8330-432b-af28-90aa46d26fa4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:06.334942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-52a8799c-8330-432b-af28-90aa46d26fa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fb3f9dce951489aafe56b0d30841164', 'request_id': 'req-52a8799c-8330-432b-af28-90aa46d26fa4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:06.361227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-52a8799c-8330-432b-af28-90aa46d26fa4 admin admin] The token cache is being invalidate because project 6fb3f9dce951489aafe56b0d30841164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:40:06.362275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-52a8799c-8330-432b-af28-90aa46d26fa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:06.364450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-52a8799c-8330-432b-af28-90aa46d26fa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:06.368787 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2931/5875] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:40:05 2022] DELETE /identity/v3/projects/6fb3f9dce951489aafe56b0d30841164 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:40:06.379951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f25fd9-c0c6-4a9d-a06c-80bd8a459704 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:06.380748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f25fd9-c0c6-4a9d-a06c-80bd8a459704 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:06.381179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f25fd9-c0c6-4a9d-a06c-80bd8a459704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:06.410663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-05f25fd9-c0c6-4a9d-a06c-80bd8a459704 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:40:06.415612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-05f25fd9-c0c6-4a9d-a06c-80bd8a459704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:06.557546 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2945/5876] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:40:06.564682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0bdfe-a4f9-4479-b01d-eee2e87e62c9 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:06.565617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0bdfe-a4f9-4479-b01d-eee2e87e62c9 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:06.566069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0bdfe-a4f9-4479-b01d-eee2e87e62c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:06.611240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d6a0bdfe-a4f9-4479-b01d-eee2e87e62c9 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:40:06.612937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d6a0bdfe-a4f9-4479-b01d-eee2e87e62c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:06.639627 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2932/5877] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:40:06.640888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f25fd9-c0c6-4a9d-a06c-80bd8a459704 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:06.662343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f25fd9-c0c6-4a9d-a06c-80bd8a459704 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:06.684645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e5b65-f42e-4549-ace8-7d3077e4cfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:06.690798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e5b65-f42e-4549-ace8-7d3077e4cfa3 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:06.693597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e5b65-f42e-4549-ace8-7d3077e4cfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:06.693893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e5b65-f42e-4549-ace8-7d3077e4cfa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:06.697944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e5b65-f42e-4549-ace8-7d3077e4cfa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:40:06.700722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e5b65-f42e-4549-ace8-7d3077e4cfa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:06.707627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e5b65-f42e-4549-ace8-7d3077e4cfa3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:06.769468 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2946/5878] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:40:06.770710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0bdfe-a4f9-4479-b01d-eee2e87e62c9 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:06.787107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0bdfe-a4f9-4479-b01d-eee2e87e62c9 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:06.800262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba9522-f556-47f3-a753-15757bcbeb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:06.801028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba9522-f556-47f3-a753-15757bcbeb97 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:06.801604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba9522-f556-47f3-a753-15757bcbeb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:06.801931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba9522-f556-47f3-a753-15757bcbeb97 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:06.802651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba9522-f556-47f3-a753-15757bcbeb97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:06.809795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba9522-f556-47f3-a753-15757bcbeb97 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:06.980469 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2933/5879] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:40:06 2022] POST /identity/v3/projects => generated 375 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:40:06.984190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e5b65-f42e-4549-ace8-7d3077e4cfa3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:06.999473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e5b65-f42e-4549-ace8-7d3077e4cfa3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:07.197284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6610096-78da-484f-b847-9484f7572821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:07.199629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6610096-78da-484f-b847-9484f7572821 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:07.199922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6610096-78da-484f-b847-9484f7572821 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:07.200208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6610096-78da-484f-b847-9484f7572821 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:07.201001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6610096-78da-484f-b847-9484f7572821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:07.203000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6610096-78da-484f-b847-9484f7572821 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:07.414715 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2947/5880] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:40:06 2022] POST /identity/v3/users => generated 288 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:40:07.415896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba9522-f556-47f3-a753-15757bcbeb97 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:07.461379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba9522-f556-47f3-a753-15757bcbeb97 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:07.499094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3d95a-29a0-4cc3-a750-71314f9973b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:07.500076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3d95a-29a0-4cc3-a750-71314f9973b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:07.500526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3d95a-29a0-4cc3-a750-71314f9973b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:07.521857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3d95a-29a0-4cc3-a750-71314f9973b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:07.521857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3d95a-29a0-4cc3-a750-71314f9973b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:07.521857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3d95a-29a0-4cc3-a750-71314f9973b1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:07.565716 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2934/5881] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:40:07.570943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6610096-78da-484f-b847-9484f7572821 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:07.599562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6610096-78da-484f-b847-9484f7572821 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:07.619608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff2497-ce12-4f4f-a249-f5e4f577a346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:07.620892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff2497-ce12-4f4f-a249-f5e4f577a346 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:07.620892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff2497-ce12-4f4f-a249-f5e4f577a346 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:07.621071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff2497-ce12-4f4f-a249-f5e4f577a346 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:07.621751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff2497-ce12-4f4f-a249-f5e4f577a346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:07.623370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff2497-ce12-4f4f-a249-f5e4f577a346 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:07.692033 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2948/5882] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:40:07.692354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3d95a-29a0-4cc3-a750-71314f9973b1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:07.698008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff2497-ce12-4f4f-a249-f5e4f577a346 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:07.702403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-37ff2497-ce12-4f4f-a249-f5e4f577a346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:07.712298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3d95a-29a0-4cc3-a750-71314f9973b1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:07.718403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc71be-ce82-43e4-b49e-6d90b9dac8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:07.719405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc71be-ce82-43e4-b49e-6d90b9dac8d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:07.719691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc71be-ce82-43e4-b49e-6d90b9dac8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:07.719967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc71be-ce82-43e4-b49e-6d90b9dac8d6 admin admin] PATH_INFO: `/v3/projects/63740057f4374c219d98c8190ccbcfe8/users/3bb0ce3a6ad74cec85da601a746d6fee/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:07.740048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff2497-ce12-4f4f-a249-f5e4f577a346 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:07.759502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742af41-8f44-4a62-bf24-476b11d0d5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:07.760009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc71be-ce82-43e4-b49e-6d90b9dac8d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63740057f4374c219d98c8190ccbcfe8, user_id=3bb0ce3a6ad74cec85da601a746d6fee, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:07.760473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742af41-8f44-4a62-bf24-476b11d0d5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:07.761240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742af41-8f44-4a62-bf24-476b11d0d5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:07.763893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742af41-8f44-4a62-bf24-476b11d0d5b3 admin admin] PATH_INFO: `/v3/users/5e16ad9f403c4285a9ed8eefe67b1899` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:07.763893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742af41-8f44-4a62-bf24-476b11d0d5b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e16ad9f403c4285a9ed8eefe67b1899)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:07.765504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742af41-8f44-4a62-bf24-476b11d0d5b3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:07.768280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc71be-ce82-43e4-b49e-6d90b9dac8d6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:07.934716 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2935/5883] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:40:07 2022] PUT /identity/v3/projects/63740057f4374c219d98c8190ccbcfe8/users/3bb0ce3a6ad74cec85da601a746d6fee/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:40:07.937016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd02e3-92e0-42a3-bac9-e60500e61b2c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:07.941871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd02e3-92e0-42a3-bac9-e60500e61b2c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:07.941871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd02e3-92e0-42a3-bac9-e60500e61b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:08.011561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0acd02e3-92e0-42a3-bac9-e60500e61b2c None None] MFA Rules not processed for user `3bb0ce3a6ad74cec85da601a746d6fee`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:40:08.013972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0acd02e3-92e0-42a3-bac9-e60500e61b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:08.106364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7742af41-8f44-4a62-bf24-476b11d0d5b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e16ad9f403c4285a9ed8eefe67b1899'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:08.125452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7742af41-8f44-4a62-bf24-476b11d0d5b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e16ad9f403c4285a9ed8eefe67b1899'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:08.126916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7742af41-8f44-4a62-bf24-476b11d0d5b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e16ad9f403c4285a9ed8eefe67b1899'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:08.137557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7742af41-8f44-4a62-bf24-476b11d0d5b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e16ad9f403c4285a9ed8eefe67b1899'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:08.173995 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2936/5884] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:40:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:40:08.178288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd02e3-92e0-42a3-bac9-e60500e61b2c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:08.253701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7742af41-8f44-4a62-bf24-476b11d0d5b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e16ad9f403c4285a9ed8eefe67b1899'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:08.262898 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2949/5885] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:40:07 2022] DELETE /identity/v3/users/5e16ad9f403c4285a9ed8eefe67b1899 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:40:08.270746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a604da3-9b86-47e3-aa80-da0a303de263 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:08.271300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a604da3-9b86-47e3-aa80-da0a303de263 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:08.271733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a604da3-9b86-47e3-aa80-da0a303de263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:08.311380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6a604da3-9b86-47e3-aa80-da0a303de263 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:40:08.314288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6a604da3-9b86-47e3-aa80-da0a303de263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:08.361147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd02e3-92e0-42a3-bac9-e60500e61b2c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:08.445778 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2950/5886] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:40:08.487336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a604da3-9b86-47e3-aa80-da0a303de263 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:08.494198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6a604da3-9b86-47e3-aa80-da0a303de263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:08.565484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fafdd6-efdf-4c65-ab4b-5b84d19343fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:08.566166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fafdd6-efdf-4c65-ab4b-5b84d19343fd admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:08.566672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fafdd6-efdf-4c65-ab4b-5b84d19343fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:08.567118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fafdd6-efdf-4c65-ab4b-5b84d19343fd admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:08.567981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fafdd6-efdf-4c65-ab4b-5b84d19343fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:08.570151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fafdd6-efdf-4c65-ab4b-5b84d19343fd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:08.609132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a604da3-9b86-47e3-aa80-da0a303de263 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:08.622706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1d1ba-ae8c-4884-ab61-ba4fb04ff561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:08.623187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1d1ba-ae8c-4884-ab61-ba4fb04ff561 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:08.623655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1d1ba-ae8c-4884-ab61-ba4fb04ff561 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:08.623750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1d1ba-ae8c-4884-ab61-ba4fb04ff561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:08.649259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1d1ba-ae8c-4884-ab61-ba4fb04ff561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:08.650734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1d1ba-ae8c-4884-ab61-ba4fb04ff561 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:08.679954 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2951/5887] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:40:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:40:08.715593 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2937/5888] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:40:08 2022] POST /identity/v3/projects => generated 375 bytes in 538 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:40:08.719866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1d1ba-ae8c-4884-ab61-ba4fb04ff561 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:08.723014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-55c1d1ba-ae8c-4884-ab61-ba4fb04ff561 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:08.747071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1d1ba-ae8c-4884-ab61-ba4fb04ff561 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:08.892017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ccdb8-3ea2-42ec-85f6-23bc71d37225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:08.898590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ccdb8-3ea2-42ec-85f6-23bc71d37225 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:08.898590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ccdb8-3ea2-42ec-85f6-23bc71d37225 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:08.898590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ccdb8-3ea2-42ec-85f6-23bc71d37225 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:08.898590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ccdb8-3ea2-42ec-85f6-23bc71d37225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:08.898946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ccdb8-3ea2-42ec-85f6-23bc71d37225 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:09.033944 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2952/5889] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:40:08 2022] POST /identity/v3/users => generated 294 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:40:09.034951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fafdd6-efdf-4c65-ab4b-5b84d19343fd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:09.065056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fafdd6-efdf-4c65-ab4b-5b84d19343fd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:09.080590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fce939-1aab-42f1-a560-b4eaf088c38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:09.081967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fce939-1aab-42f1-a560-b4eaf088c38c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:09.083573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fce939-1aab-42f1-a560-b4eaf088c38c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:09.084012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fce939-1aab-42f1-a560-b4eaf088c38c admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:09.086436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fce939-1aab-42f1-a560-b4eaf088c38c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:09.091789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fce939-1aab-42f1-a560-b4eaf088c38c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:09.129546 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2938/5890] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:40:09.134405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ccdb8-3ea2-42ec-85f6-23bc71d37225 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:09.149745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ccdb8-3ea2-42ec-85f6-23bc71d37225 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:09.166559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f0c4e-8859-4d6e-baa1-44554e179157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:09.167523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f0c4e-8859-4d6e-baa1-44554e179157 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:09.167812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f0c4e-8859-4d6e-baa1-44554e179157 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:09.168089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f0c4e-8859-4d6e-baa1-44554e179157 admin admin] PATH_INFO: `/v3/projects/20c47e9670d14d4e8f1cab1c4f9b92fe/users/f28da6ead7cf41949d3571d9035c7ff7/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:09.206204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f0c4e-8859-4d6e-baa1-44554e179157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20c47e9670d14d4e8f1cab1c4f9b92fe, user_id=f28da6ead7cf41949d3571d9035c7ff7, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:09.211241 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f0c4e-8859-4d6e-baa1-44554e179157 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:09.343490 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2953/5891] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:40:09 2022] PUT /identity/v3/projects/20c47e9670d14d4e8f1cab1c4f9b92fe/users/f28da6ead7cf41949d3571d9035c7ff7/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:40:09.347716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fce939-1aab-42f1-a560-b4eaf088c38c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:09.372050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fce939-1aab-42f1-a560-b4eaf088c38c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:09.480634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9030a8f-2c35-4552-a71d-d2fca1d2720d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:09.481360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9030a8f-2c35-4552-a71d-d2fca1d2720d admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:09.481649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9030a8f-2c35-4552-a71d-d2fca1d2720d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:09.481981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9030a8f-2c35-4552-a71d-d2fca1d2720d admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:09.482741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9030a8f-2c35-4552-a71d-d2fca1d2720d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:09.486217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9030a8f-2c35-4552-a71d-d2fca1d2720d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:09.507588 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2939/5892] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:40:09.508486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f0c4e-8859-4d6e-baa1-44554e179157 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:09.520689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f0c4e-8859-4d6e-baa1-44554e179157 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:09.529293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82fb71-69ec-4d75-86dc-2b9eb6080ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:09.530271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82fb71-69ec-4d75-86dc-2b9eb6080ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:09.530553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82fb71-69ec-4d75-86dc-2b9eb6080ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:09.532634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82fb71-69ec-4d75-86dc-2b9eb6080ee4 admin admin] PATH_INFO: `/v3/projects/20c47e9670d14d4e8f1cab1c4f9b92fe/users/f28da6ead7cf41949d3571d9035c7ff7/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:09.535190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82fb71-69ec-4d75-86dc-2b9eb6080ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20c47e9670d14d4e8f1cab1c4f9b92fe, user_id=f28da6ead7cf41949d3571d9035c7ff7, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:09.538656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82fb71-69ec-4d75-86dc-2b9eb6080ee4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:09.554007 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2954/5893] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:40:09 2022] PUT /identity/v3/projects/20c47e9670d14d4e8f1cab1c4f9b92fe/users/f28da6ead7cf41949d3571d9035c7ff7/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:40:09.593054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee826ec9-28cf-4912-bc07-107e38612de6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:09.593357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee826ec9-28cf-4912-bc07-107e38612de6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:09.593707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee826ec9-28cf-4912-bc07-107e38612de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:09.620841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ee826ec9-28cf-4912-bc07-107e38612de6 None None] MFA Rules not processed for user `f28da6ead7cf41949d3571d9035c7ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:40:09.622178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ee826ec9-28cf-4912-bc07-107e38612de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:09.718623 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2940/5894] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:40:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:40:09.718907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82fb71-69ec-4d75-86dc-2b9eb6080ee4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:09.718907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6c82fb71-69ec-4d75-86dc-2b9eb6080ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:09.728559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee826ec9-28cf-4912-bc07-107e38612de6 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:09.904051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee826ec9-28cf-4912-bc07-107e38612de6 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:09.915806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82fb71-69ec-4d75-86dc-2b9eb6080ee4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:09.922653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcaf51-4a7f-4d8a-ae0e-faa012312c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:09.923828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcaf51-4a7f-4d8a-ae0e-faa012312c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:09.924334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcaf51-4a7f-4d8a-ae0e-faa012312c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:09.924912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcaf51-4a7f-4d8a-ae0e-faa012312c93 admin admin] PATH_INFO: `/v3/projects/96b4dbd89e394f9e8f33e8b9094cdd51` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:09.925718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81df0a-7a56-4235-bef9-705a7498cf32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:09.926387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81df0a-7a56-4235-bef9-705a7498cf32 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:09.926676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81df0a-7a56-4235-bef9-705a7498cf32 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:09.926956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81df0a-7a56-4235-bef9-705a7498cf32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:09.927380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fcaf51-4a7f-4d8a-ae0e-faa012312c93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96b4dbd89e394f9e8f33e8b9094cdd51)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:09.929739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fcaf51-4a7f-4d8a-ae0e-faa012312c93 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:09.930785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ac81df0a-7a56-4235-bef9-705a7498cf32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:10.110999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-70fcaf51-4a7f-4d8a-ae0e-faa012312c93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96b4dbd89e394f9e8f33e8b9094cdd51', 'request_id': 'req-70fcaf51-4a7f-4d8a-ae0e-faa012312c93'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:10.131096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81df0a-7a56-4235-bef9-705a7498cf32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:10.135985 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81df0a-7a56-4235-bef9-705a7498cf32 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:10.169849 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2941/5895] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:40:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:40:10.209210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-70fcaf51-4a7f-4d8a-ae0e-faa012312c93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96b4dbd89e394f9e8f33e8b9094cdd51', 'request_id': 'req-70fcaf51-4a7f-4d8a-ae0e-faa012312c93'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:10.221786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-70fcaf51-4a7f-4d8a-ae0e-faa012312c93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96b4dbd89e394f9e8f33e8b9094cdd51', 'request_id': 'req-70fcaf51-4a7f-4d8a-ae0e-faa012312c93'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:10.248060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-70fcaf51-4a7f-4d8a-ae0e-faa012312c93 admin admin] The token cache is being invalidate because project 96b4dbd89e394f9e8f33e8b9094cdd51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:40:10.248469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-70fcaf51-4a7f-4d8a-ae0e-faa012312c93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:10.251122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-70fcaf51-4a7f-4d8a-ae0e-faa012312c93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:10.255819 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2955/5896] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:40:09 2022] DELETE /identity/v3/projects/96b4dbd89e394f9e8f33e8b9094cdd51 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:40:10.259432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81df0a-7a56-4235-bef9-705a7498cf32 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:10.273206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81df0a-7a56-4235-bef9-705a7498cf32 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:10.417668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44855f-7044-41a4-b79b-0f2f8490ddf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:10.419843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44855f-7044-41a4-b79b-0f2f8490ddf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:10.420323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44855f-7044-41a4-b79b-0f2f8490ddf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:10.420849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44855f-7044-41a4-b79b-0f2f8490ddf2 admin admin] PATH_INFO: `/v3/users/a676d585eafd4904b48ce5cad0731a97` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:10.422892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44855f-7044-41a4-b79b-0f2f8490ddf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a676d585eafd4904b48ce5cad0731a97)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:10.425523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44855f-7044-41a4-b79b-0f2f8490ddf2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:10.651380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-df44855f-7044-41a4-b79b-0f2f8490ddf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a676d585eafd4904b48ce5cad0731a97'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:10.708050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-df44855f-7044-41a4-b79b-0f2f8490ddf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a676d585eafd4904b48ce5cad0731a97'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:10.711721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-df44855f-7044-41a4-b79b-0f2f8490ddf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a676d585eafd4904b48ce5cad0731a97'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:10.733140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-df44855f-7044-41a4-b79b-0f2f8490ddf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a676d585eafd4904b48ce5cad0731a97'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:10.779586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb48f69-e3ef-47da-a7d1-a14ab19d5b25 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:10.780821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb48f69-e3ef-47da-a7d1-a14ab19d5b25 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:10.781387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb48f69-e3ef-47da-a7d1-a14ab19d5b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:10.817948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-adb48f69-e3ef-47da-a7d1-a14ab19d5b25 None None] MFA Rules not processed for user `00901b5b42a84fc9960ab2ba01de97a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:40:10.820547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-adb48f69-e3ef-47da-a7d1-a14ab19d5b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:10.843160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-df44855f-7044-41a4-b79b-0f2f8490ddf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a676d585eafd4904b48ce5cad0731a97'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:10.850457 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2942/5897] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:40:10 2022] DELETE /identity/v3/users/a676d585eafd4904b48ce5cad0731a97 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:40:10.971519 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2956/5898] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:40:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:40:10.971709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44855f-7044-41a4-b79b-0f2f8490ddf2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:10.973568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-df44855f-7044-41a4-b79b-0f2f8490ddf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:11.175923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44855f-7044-41a4-b79b-0f2f8490ddf2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:11.192320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014eac9-4126-4be3-a894-3fdcff18f903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:11.194292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014eac9-4126-4be3-a894-3fdcff18f903 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:11.194292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014eac9-4126-4be3-a894-3fdcff18f903 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:11.194292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014eac9-4126-4be3-a894-3fdcff18f903 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:11.198128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014eac9-4126-4be3-a894-3fdcff18f903 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:11.198128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014eac9-4126-4be3-a894-3fdcff18f903 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:11.336499 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2943/5899] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:40:10 2022] POST /identity/v3/projects => generated 371 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:40:11.341556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb48f69-e3ef-47da-a7d1-a14ab19d5b25 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:11.357723 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb48f69-e3ef-47da-a7d1-a14ab19d5b25 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:11.534664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772f0bd-0b12-4574-be68-7213af460b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:11.535450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772f0bd-0b12-4574-be68-7213af460b7d admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:11.539729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772f0bd-0b12-4574-be68-7213af460b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:11.540053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772f0bd-0b12-4574-be68-7213af460b7d admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:11.540838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772f0bd-0b12-4574-be68-7213af460b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:11.547247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772f0bd-0b12-4574-be68-7213af460b7d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:11.655642 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2957/5900] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:40:11 2022] POST /identity/v3/users => generated 292 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:40:11.659630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014eac9-4126-4be3-a894-3fdcff18f903 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:11.677694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014eac9-4126-4be3-a894-3fdcff18f903 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:11.687039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f968825-92d2-43dd-ad1b-38fe65b728b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:11.688095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f968825-92d2-43dd-ad1b-38fe65b728b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:11.688706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f968825-92d2-43dd-ad1b-38fe65b728b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:11.689340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f968825-92d2-43dd-ad1b-38fe65b728b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:11.690571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f968825-92d2-43dd-ad1b-38fe65b728b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:11.694269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f968825-92d2-43dd-ad1b-38fe65b728b0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:11.707915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772f0bd-0b12-4574-be68-7213af460b7d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:11.709227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d772f0bd-0b12-4574-be68-7213af460b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:11.730585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772f0bd-0b12-4574-be68-7213af460b7d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:11.748073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cbfbb-63a1-4b81-b3ec-9292ee251783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:11.749481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cbfbb-63a1-4b81-b3ec-9292ee251783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:11.753589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cbfbb-63a1-4b81-b3ec-9292ee251783 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:11.753589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cbfbb-63a1-4b81-b3ec-9292ee251783 admin admin] PATH_INFO: `/v3/projects/4a18e30d19254c0d9ab412deded797a1` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:11.753589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cbfbb-63a1-4b81-b3ec-9292ee251783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a18e30d19254c0d9ab412deded797a1)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:11.753589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cbfbb-63a1-4b81-b3ec-9292ee251783 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:11.762688 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2944/5901] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:40:11.763776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f968825-92d2-43dd-ad1b-38fe65b728b0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:11.791368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f968825-92d2-43dd-ad1b-38fe65b728b0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:11.823163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2943a-0f4f-423e-8d47-7058041b2907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:11.826336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2943a-0f4f-423e-8d47-7058041b2907 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:11.826630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2943a-0f4f-423e-8d47-7058041b2907 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:11.831568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2943a-0f4f-423e-8d47-7058041b2907 admin admin] PATH_INFO: `/v3/projects/64536948cf2a47e484fc56a26247c8ad/users/97056bf137374760a9e9d26a0b78f45b/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:11.892108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2943a-0f4f-423e-8d47-7058041b2907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64536948cf2a47e484fc56a26247c8ad, user_id=97056bf137374760a9e9d26a0b78f45b, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:11.899892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2943a-0f4f-423e-8d47-7058041b2907 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:11.907843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-476cbfbb-63a1-4b81-b3ec-9292ee251783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a18e30d19254c0d9ab412deded797a1', 'request_id': 'req-476cbfbb-63a1-4b81-b3ec-9292ee251783'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:12.020217 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2945/5902] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:40:11 2022] PUT /identity/v3/projects/64536948cf2a47e484fc56a26247c8ad/users/97056bf137374760a9e9d26a0b78f45b/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:40:12.033806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2943a-0f4f-423e-8d47-7058041b2907 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:12.093026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-476cbfbb-63a1-4b81-b3ec-9292ee251783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a18e30d19254c0d9ab412deded797a1', 'request_id': 'req-476cbfbb-63a1-4b81-b3ec-9292ee251783'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:12.107984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-476cbfbb-63a1-4b81-b3ec-9292ee251783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a18e30d19254c0d9ab412deded797a1', 'request_id': 'req-476cbfbb-63a1-4b81-b3ec-9292ee251783'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:12.155553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-476cbfbb-63a1-4b81-b3ec-9292ee251783 admin admin] The token cache is being invalidate because project 4a18e30d19254c0d9ab412deded797a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:40:12.158749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-476cbfbb-63a1-4b81-b3ec-9292ee251783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:12.158749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-476cbfbb-63a1-4b81-b3ec-9292ee251783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:12.161354 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2958/5903] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:40:11 2022] DELETE /identity/v3/projects/4a18e30d19254c0d9ab412deded797a1 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:40:12.168973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767352d1-d350-49fc-94ee-4df54882eaa7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:12.169522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767352d1-d350-49fc-94ee-4df54882eaa7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:12.169960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767352d1-d350-49fc-94ee-4df54882eaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:12.200780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2943a-0f4f-423e-8d47-7058041b2907 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:12.207924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f85975-27f0-49b7-aae2-2cc4a095017e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:12.209083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f85975-27f0-49b7-aae2-2cc4a095017e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:12.209466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f85975-27f0-49b7-aae2-2cc4a095017e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:12.210043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f85975-27f0-49b7-aae2-2cc4a095017e admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:12.210897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f85975-27f0-49b7-aae2-2cc4a095017e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:12.213610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f85975-27f0-49b7-aae2-2cc4a095017e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:12.226365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-767352d1-d350-49fc-94ee-4df54882eaa7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:40:12.228051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-767352d1-d350-49fc-94ee-4df54882eaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:12.238969 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2959/5904] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:40:12.246365 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2946/5905] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:40:12.247593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b45048-2943-494a-aa31-79d814751f86 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:12.247998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b45048-2943-494a-aa31-79d814751f86 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:12.248269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f85975-27f0-49b7-aae2-2cc4a095017e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:12.248553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b45048-2943-494a-aa31-79d814751f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:12.254358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f3f85975-27f0-49b7-aae2-2cc4a095017e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:12.271487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-99b45048-2943-494a-aa31-79d814751f86 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:40:12.272913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-99b45048-2943-494a-aa31-79d814751f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:12.278083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f85975-27f0-49b7-aae2-2cc4a095017e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:12.282885 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2960/5906] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:40:12.284465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafaa56d-1667-4126-bb0a-256537c0653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:12.286319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafaa56d-1667-4126-bb0a-256537c0653c admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:12.286865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafaa56d-1667-4126-bb0a-256537c0653c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:12.287419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafaa56d-1667-4126-bb0a-256537c0653c admin admin] PATH_INFO: `/v3/projects/64536948cf2a47e484fc56a26247c8ad/users/97056bf137374760a9e9d26a0b78f45b/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:12.290470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b45048-2943-494a-aa31-79d814751f86 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:12.294038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafaa56d-1667-4126-bb0a-256537c0653c admin admin] RBAC: Authorizing `identity:create_grant(project_id=64536948cf2a47e484fc56a26247c8ad, user_id=97056bf137374760a9e9d26a0b78f45b, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:12.297051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafaa56d-1667-4126-bb0a-256537c0653c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:12.306711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b45048-2943-494a-aa31-79d814751f86 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:12.318719 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2947/5907] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:40:12 2022] PUT /identity/v3/projects/64536948cf2a47e484fc56a26247c8ad/users/97056bf137374760a9e9d26a0b78f45b/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:40:12.397376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466c93b-4a13-41e7-9f6f-9b148c137e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:12.398401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466c93b-4a13-41e7-9f6f-9b148c137e61 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:12.398526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466c93b-4a13-41e7-9f6f-9b148c137e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:12.398902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466c93b-4a13-41e7-9f6f-9b148c137e61 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:12.399563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466c93b-4a13-41e7-9f6f-9b148c137e61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:40:12.400631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466c93b-4a13-41e7-9f6f-9b148c137e61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:12.402718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466c93b-4a13-41e7-9f6f-9b148c137e61 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:12.424244 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2961/5908] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:40:12.428473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafaa56d-1667-4126-bb0a-256537c0653c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:12.448055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafaa56d-1667-4126-bb0a-256537c0653c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:12.456096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bd8d7-1c73-457d-b509-fcce932d4988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:12.458144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bd8d7-1c73-457d-b509-fcce932d4988 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:12.458752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bd8d7-1c73-457d-b509-fcce932d4988 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:12.459253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bd8d7-1c73-457d-b509-fcce932d4988 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:12.460873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7bd8d7-1c73-457d-b509-fcce932d4988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:12.463493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7bd8d7-1c73-457d-b509-fcce932d4988 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:12.556659 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2948/5909] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:40:12 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:40:12.560414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466c93b-4a13-41e7-9f6f-9b148c137e61 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:12.575146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466c93b-4a13-41e7-9f6f-9b148c137e61 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:12.685776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccf9ad-9dee-4be9-b948-d3051d95c3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:12.685776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccf9ad-9dee-4be9-b948-d3051d95c3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:12.685776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccf9ad-9dee-4be9-b948-d3051d95c3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:12.685776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccf9ad-9dee-4be9-b948-d3051d95c3a6 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:12.686060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccf9ad-9dee-4be9-b948-d3051d95c3a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:12.686060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccf9ad-9dee-4be9-b948-d3051d95c3a6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:12.801393 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2962/5910] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:40:12 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:40:12.802955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bd8d7-1c73-457d-b509-fcce932d4988 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:12.821634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bd8d7-1c73-457d-b509-fcce932d4988 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:12.831534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974b637-3c5a-479a-b82d-7b4a1260e1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:12.832786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974b637-3c5a-479a-b82d-7b4a1260e1aa admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:12.833170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974b637-3c5a-479a-b82d-7b4a1260e1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:12.833463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974b637-3c5a-479a-b82d-7b4a1260e1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:12.834562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974b637-3c5a-479a-b82d-7b4a1260e1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:12.839803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974b637-3c5a-479a-b82d-7b4a1260e1aa admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:12.861130 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2949/5911] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:40:12.862433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccf9ad-9dee-4be9-b948-d3051d95c3a6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:12.896981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccf9ad-9dee-4be9-b948-d3051d95c3a6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:12.916256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d6dcd-026e-4187-8f5d-b85c621eb26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:12.917145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d6dcd-026e-4187-8f5d-b85c621eb26b admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:12.917437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d6dcd-026e-4187-8f5d-b85c621eb26b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:12.917860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d6dcd-026e-4187-8f5d-b85c621eb26b admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:12.919098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d6dcd-026e-4187-8f5d-b85c621eb26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:12.920804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d6dcd-026e-4187-8f5d-b85c621eb26b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:12.952047 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2963/5912] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:40:12.953302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974b637-3c5a-479a-b82d-7b4a1260e1aa admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:12.968296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974b637-3c5a-479a-b82d-7b4a1260e1aa admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:12.980873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc89a92-fa82-4a1f-aae4-99b83aef1d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:12.981795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc89a92-fa82-4a1f-aae4-99b83aef1d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:12.982082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc89a92-fa82-4a1f-aae4-99b83aef1d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:12.982364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc89a92-fa82-4a1f-aae4-99b83aef1d9d admin admin] PATH_INFO: `/v3/projects/9da89947cbda467c9eb7022d9ce8447f/users/427be7d4eed44aeaa994646521a5c7a8/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:13.000528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc89a92-fa82-4a1f-aae4-99b83aef1d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da89947cbda467c9eb7022d9ce8447f, user_id=427be7d4eed44aeaa994646521a5c7a8, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:13.004054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc89a92-fa82-4a1f-aae4-99b83aef1d9d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:13.144760 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2950/5913] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:40:12 2022] PUT /identity/v3/projects/9da89947cbda467c9eb7022d9ce8447f/users/427be7d4eed44aeaa994646521a5c7a8/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:40:13.149756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717f9c3-bf34-4567-8b11-ad794c5f7c5b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:13.149756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717f9c3-bf34-4567-8b11-ad794c5f7c5b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:13.149756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717f9c3-bf34-4567-8b11-ad794c5f7c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:13.214842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a717f9c3-bf34-4567-8b11-ad794c5f7c5b None None] MFA Rules not processed for user `427be7d4eed44aeaa994646521a5c7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:40:13.216110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a717f9c3-bf34-4567-8b11-ad794c5f7c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:13.376196 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2964/5914] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:40:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:40:13.389108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc89a92-fa82-4a1f-aae4-99b83aef1d9d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:13.390954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8fc89a92-fa82-4a1f-aae4-99b83aef1d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:13.497052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc89a92-fa82-4a1f-aae4-99b83aef1d9d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:13.505435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94b934-7c7d-4653-a5d4-ea7c2c500fa4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:13.506119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94b934-7c7d-4653-a5d4-ea7c2c500fa4 service glance] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:13.506404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94b934-7c7d-4653-a5d4-ea7c2c500fa4 service glance] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:13.506696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94b934-7c7d-4653-a5d4-ea7c2c500fa4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:13.528434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94b934-7c7d-4653-a5d4-ea7c2c500fa4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:13.530110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94b934-7c7d-4653-a5d4-ea7c2c500fa4 service glance] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:13.562139 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2951/5915] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:40:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:40:15.219161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717f9c3-bf34-4567-8b11-ad794c5f7c5b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:15.220632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a717f9c3-bf34-4567-8b11-ad794c5f7c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:15.323159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717f9c3-bf34-4567-8b11-ad794c5f7c5b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:15.332248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6aa8db-03ab-4f66-9e7c-bd3387f37a5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:15.357702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6aa8db-03ab-4f66-9e7c-bd3387f37a5b service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:15.359180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6aa8db-03ab-4f66-9e7c-bd3387f37a5b service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:15.359652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6aa8db-03ab-4f66-9e7c-bd3387f37a5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:15.369443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7e6aa8db-03ab-4f66-9e7c-bd3387f37a5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:15.671525 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6aa8db-03ab-4f66-9e7c-bd3387f37a5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:15.673375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6aa8db-03ab-4f66-9e7c-bd3387f37a5b service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:15.742128 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2965/5916] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:40:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:40:16.863917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94b934-7c7d-4653-a5d4-ea7c2c500fa4 service glance] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:16.865543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9a94b934-7c7d-4653-a5d4-ea7c2c500fa4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:16.996933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94b934-7c7d-4653-a5d4-ea7c2c500fa4 service glance] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:17.009110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88804c-79bf-4990-ab32-89d3cdbf6556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:17.018852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88804c-79bf-4990-ab32-89d3cdbf6556 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:17.018852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88804c-79bf-4990-ab32-89d3cdbf6556 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:17.018852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88804c-79bf-4990-ab32-89d3cdbf6556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:17.018852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3f88804c-79bf-4990-ab32-89d3cdbf6556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:17.149431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88804c-79bf-4990-ab32-89d3cdbf6556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:17.153203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88804c-79bf-4990-ab32-89d3cdbf6556 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:17.191893 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2952/5917] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:40:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:40:21.410002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6aa8db-03ab-4f66-9e7c-bd3387f37a5b service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:21.412263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7e6aa8db-03ab-4f66-9e7c-bd3387f37a5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:21.455886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6aa8db-03ab-4f66-9e7c-bd3387f37a5b service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:21.480950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300ad87-f0e4-4ac5-bd15-29900187fbc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:21.490029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300ad87-f0e4-4ac5-bd15-29900187fbc7 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:21.494175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300ad87-f0e4-4ac5-bd15-29900187fbc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:21.496970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300ad87-f0e4-4ac5-bd15-29900187fbc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:21.505540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d300ad87-f0e4-4ac5-bd15-29900187fbc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:21.547885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300ad87-f0e4-4ac5-bd15-29900187fbc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:21.549681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300ad87-f0e4-4ac5-bd15-29900187fbc7 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:21.582650 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2966/5918] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:40:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:40:25.243737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bb486-f43f-4aff-8418-262270eefce4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:25.244324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bb486-f43f-4aff-8418-262270eefce4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:25.244324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bb486-f43f-4aff-8418-262270eefce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:25.296569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8f3bb486-f43f-4aff-8418-262270eefce4 None None] MFA Rules not processed for user `97056bf137374760a9e9d26a0b78f45b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:40:25.300335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8f3bb486-f43f-4aff-8418-262270eefce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:25.543372 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2953/5919] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:40:25 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:40:25.554940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300ad87-f0e4-4ac5-bd15-29900187fbc7 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:25.556401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d300ad87-f0e4-4ac5-bd15-29900187fbc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:25.596868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300ad87-f0e4-4ac5-bd15-29900187fbc7 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:25.611634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7180c-20d0-429c-a969-befb1789a52b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:25.612392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7180c-20d0-429c-a969-befb1789a52b service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:25.613234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7180c-20d0-429c-a969-befb1789a52b service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:25.613530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7180c-20d0-429c-a969-befb1789a52b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:25.617496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1bd7180c-20d0-429c-a969-befb1789a52b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:25.814574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7180c-20d0-429c-a969-befb1789a52b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:25.816231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7180c-20d0-429c-a969-befb1789a52b service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:25.860672 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2967/5920] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:40:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:40:31.556109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e80763-56d4-4537-9b1c-d198d83ef8ce None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:31.556660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e80763-56d4-4537-9b1c-d198d83ef8ce None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:31.556778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e80763-56d4-4537-9b1c-d198d83ef8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:31.619143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d5e80763-56d4-4537-9b1c-d198d83ef8ce None None] MFA Rules not processed for user `00901b5b42a84fc9960ab2ba01de97a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:40:31.621230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d5e80763-56d4-4537-9b1c-d198d83ef8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:31.646192 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2954/5921] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:40:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:40:32.252997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7180c-20d0-429c-a969-befb1789a52b service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:32.269597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7180c-20d0-429c-a969-befb1789a52b service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:32.276943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0b245-58d7-4f13-800e-2522832b196d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:32.282202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0b245-58d7-4f13-800e-2522832b196d service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:32.282622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0b245-58d7-4f13-800e-2522832b196d service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:32.284237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0b245-58d7-4f13-800e-2522832b196d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:32.290956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d5a0b245-58d7-4f13-800e-2522832b196d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:32.311012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0b245-58d7-4f13-800e-2522832b196d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:32.313716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0b245-58d7-4f13-800e-2522832b196d service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:32.341918 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2968/5922] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:40:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:40:32.786864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e80763-56d4-4537-9b1c-d198d83ef8ce None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:32.789313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d5e80763-56d4-4537-9b1c-d198d83ef8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:32.934030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e80763-56d4-4537-9b1c-d198d83ef8ce None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:32.942712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853f0e9-772a-497f-a2ab-f0a7295e577d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:32.944162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853f0e9-772a-497f-a2ab-f0a7295e577d service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:32.944649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853f0e9-772a-497f-a2ab-f0a7295e577d service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:32.945620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853f0e9-772a-497f-a2ab-f0a7295e577d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:32.949279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2853f0e9-772a-497f-a2ab-f0a7295e577d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:32.967774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853f0e9-772a-497f-a2ab-f0a7295e577d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:32.971024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853f0e9-772a-497f-a2ab-f0a7295e577d service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:32.992876 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2955/5923] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:40:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:40:33.622740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1fbfa-89f3-47de-b30d-2b5996f4b7b1 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:33.623572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1fbfa-89f3-47de-b30d-2b5996f4b7b1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:33.624013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1fbfa-89f3-47de-b30d-2b5996f4b7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:33.658805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c5e1fbfa-89f3-47de-b30d-2b5996f4b7b1 None None] MFA Rules not processed for user `3bb0ce3a6ad74cec85da601a746d6fee`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:40:33.658805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c5e1fbfa-89f3-47de-b30d-2b5996f4b7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:33.671983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853f0e9-772a-497f-a2ab-f0a7295e577d service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:33.673571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2853f0e9-772a-497f-a2ab-f0a7295e577d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:33.773757 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2969/5924] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:40:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:40:33.796570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853f0e9-772a-497f-a2ab-f0a7295e577d service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:33.803772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24160a9-70e4-46c8-8eb2-e3c2fa0ec4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:33.803772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24160a9-70e4-46c8-8eb2-e3c2fa0ec4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:33.803772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24160a9-70e4-46c8-8eb2-e3c2fa0ec4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:33.803772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24160a9-70e4-46c8-8eb2-e3c2fa0ec4c1 admin admin] PATH_INFO: `/v3/users/4880b8316a6c4a51b93b3f8557925180` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:33.805111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24160a9-70e4-46c8-8eb2-e3c2fa0ec4c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4880b8316a6c4a51b93b3f8557925180)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:33.807454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24160a9-70e4-46c8-8eb2-e3c2fa0ec4c1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:34.074839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c24160a9-70e4-46c8-8eb2-e3c2fa0ec4c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4880b8316a6c4a51b93b3f8557925180'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:34.120429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c24160a9-70e4-46c8-8eb2-e3c2fa0ec4c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4880b8316a6c4a51b93b3f8557925180'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:34.122598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c24160a9-70e4-46c8-8eb2-e3c2fa0ec4c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4880b8316a6c4a51b93b3f8557925180'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:34.145667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c24160a9-70e4-46c8-8eb2-e3c2fa0ec4c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4880b8316a6c4a51b93b3f8557925180'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:34.221005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c24160a9-70e4-46c8-8eb2-e3c2fa0ec4c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4880b8316a6c4a51b93b3f8557925180'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:34.235753 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2956/5925] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:40:33 2022] DELETE /identity/v3/users/4880b8316a6c4a51b93b3f8557925180 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:40:34.241744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce16a96-8a2e-45ee-850e-c5e27aa6d5fe None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:34.241940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce16a96-8a2e-45ee-850e-c5e27aa6d5fe None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:34.242416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce16a96-8a2e-45ee-850e-c5e27aa6d5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:34.254995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fac6e4-4a54-4e20-ab9f-f507c406f3a3 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:34.254995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fac6e4-4a54-4e20-ab9f-f507c406f3a3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:34.254995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fac6e4-4a54-4e20-ab9f-f507c406f3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:34.270988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4ce16a96-8a2e-45ee-850e-c5e27aa6d5fe None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:40:34.273085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4ce16a96-8a2e-45ee-850e-c5e27aa6d5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:34.310427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-23fac6e4-4a54-4e20-ab9f-f507c406f3a3 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:40:34.315067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-23fac6e4-4a54-4e20-ab9f-f507c406f3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:34.423186 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2970/5926] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:40:34.438038 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2957/5927] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:40:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:40:34.457185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce16a96-8a2e-45ee-850e-c5e27aa6d5fe None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:34.463805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4ce16a96-8a2e-45ee-850e-c5e27aa6d5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:34.480400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fac6e4-4a54-4e20-ab9f-f507c406f3a3 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:34.482819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-23fac6e4-4a54-4e20-ab9f-f507c406f3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:34.605209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fac6e4-4a54-4e20-ab9f-f507c406f3a3 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:34.610757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82659a3-ff97-4735-b6b4-4ee7c4af9d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:34.611817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82659a3-ff97-4735-b6b4-4ee7c4af9d45 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:34.612325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82659a3-ff97-4735-b6b4-4ee7c4af9d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:34.612799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82659a3-ff97-4735-b6b4-4ee7c4af9d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:34.616044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce16a96-8a2e-45ee-850e-c5e27aa6d5fe None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:34.624751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388121e-d8c7-4b59-91aa-7d6aaf4af39a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:34.627423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388121e-d8c7-4b59-91aa-7d6aaf4af39a service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:34.627551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82659a3-ff97-4735-b6b4-4ee7c4af9d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:34.627663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388121e-d8c7-4b59-91aa-7d6aaf4af39a service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:34.628667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388121e-d8c7-4b59-91aa-7d6aaf4af39a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:34.629232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82659a3-ff97-4735-b6b4-4ee7c4af9d45 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:34.644380 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2958/5928] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:40:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:40:34.645478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388121e-d8c7-4b59-91aa-7d6aaf4af39a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:34.647756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388121e-d8c7-4b59-91aa-7d6aaf4af39a service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:34.659012 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2971/5929] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:40:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:40:35.627550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82659a3-ff97-4735-b6b4-4ee7c4af9d45 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:35.629137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c82659a3-ff97-4735-b6b4-4ee7c4af9d45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:35.664965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82659a3-ff97-4735-b6b4-4ee7c4af9d45 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:35.693383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291c80c-6146-4a6c-9b64-3c358f279eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:35.713271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291c80c-6146-4a6c-9b64-3c358f279eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:35.713563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291c80c-6146-4a6c-9b64-3c358f279eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:35.713854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291c80c-6146-4a6c-9b64-3c358f279eb9 admin admin] PATH_INFO: `/v3/projects/0fdf284867284d8ba704789ac86fd3d3` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:35.727017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291c80c-6146-4a6c-9b64-3c358f279eb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fdf284867284d8ba704789ac86fd3d3)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:35.741215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291c80c-6146-4a6c-9b64-3c358f279eb9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:36.070422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7291c80c-6146-4a6c-9b64-3c358f279eb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fdf284867284d8ba704789ac86fd3d3', 'request_id': 'req-7291c80c-6146-4a6c-9b64-3c358f279eb9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:36.087293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7291c80c-6146-4a6c-9b64-3c358f279eb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fdf284867284d8ba704789ac86fd3d3', 'request_id': 'req-7291c80c-6146-4a6c-9b64-3c358f279eb9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:36.211892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7291c80c-6146-4a6c-9b64-3c358f279eb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fdf284867284d8ba704789ac86fd3d3', 'request_id': 'req-7291c80c-6146-4a6c-9b64-3c358f279eb9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:36.234805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7291c80c-6146-4a6c-9b64-3c358f279eb9 admin admin] The token cache is being invalidate because project 0fdf284867284d8ba704789ac86fd3d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:40:36.238519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7291c80c-6146-4a6c-9b64-3c358f279eb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:36.242326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7291c80c-6146-4a6c-9b64-3c358f279eb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:40:36.244815 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2959/5930] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:40:35 2022] DELETE /identity/v3/projects/0fdf284867284d8ba704789ac86fd3d3 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:40:36.249546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b870c14-b94f-4aad-84a2-01567b9598c6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:36.250378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b870c14-b94f-4aad-84a2-01567b9598c6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:36.251081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b870c14-b94f-4aad-84a2-01567b9598c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:36.319407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1b870c14-b94f-4aad-84a2-01567b9598c6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:40:36.326484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1b870c14-b94f-4aad-84a2-01567b9598c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:36.557477 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2972/5931] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:40:36.563990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37343f-533c-40ea-bf14-027f826cf57d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:36.564287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37343f-533c-40ea-bf14-027f826cf57d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:36.564577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37343f-533c-40ea-bf14-027f826cf57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:36.609075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-fa37343f-533c-40ea-bf14-027f826cf57d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:40:36.610942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fa37343f-533c-40ea-bf14-027f826cf57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:36.645193 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2960/5932] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:40:36.650060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b870c14-b94f-4aad-84a2-01567b9598c6 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:36.671898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b870c14-b94f-4aad-84a2-01567b9598c6 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:36.697757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8f49c-83e9-499d-929d-711a613438cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:36.698687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8f49c-83e9-499d-929d-711a613438cd admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:36.701826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8f49c-83e9-499d-929d-711a613438cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:36.701826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8f49c-83e9-499d-929d-711a613438cd admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:36.701826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8f49c-83e9-499d-929d-711a613438cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:40:36.701826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8f49c-83e9-499d-929d-711a613438cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:36.709878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8f49c-83e9-499d-929d-711a613438cd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:36.755615 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2973/5933] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:40:36.759944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37343f-533c-40ea-bf14-027f826cf57d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:36.772422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37343f-533c-40ea-bf14-027f826cf57d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:36.793559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae03a0-0ecf-45ce-918b-698e44ca5ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:36.798353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae03a0-0ecf-45ce-918b-698e44ca5ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:36.798867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae03a0-0ecf-45ce-918b-698e44ca5ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:36.799641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae03a0-0ecf-45ce-918b-698e44ca5ae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:36.804334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae03a0-0ecf-45ce-918b-698e44ca5ae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:36.809159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae03a0-0ecf-45ce-918b-698e44ca5ae0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:37.025980 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2961/5934] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:40:36 2022] POST /identity/v3/projects => generated 371 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:40:37.030833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8f49c-83e9-499d-929d-711a613438cd admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:37.079842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8f49c-83e9-499d-929d-711a613438cd admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:37.367865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f2ff4-f898-4d2b-afb3-0b4d8e9521e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:37.370671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f2ff4-f898-4d2b-afb3-0b4d8e9521e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:37.372567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f2ff4-f898-4d2b-afb3-0b4d8e9521e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:37.373100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f2ff4-f898-4d2b-afb3-0b4d8e9521e4 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:37.374025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f2ff4-f898-4d2b-afb3-0b4d8e9521e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:37.377057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f2ff4-f898-4d2b-afb3-0b4d8e9521e4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:37.542287 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2974/5935] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:40:37 2022] POST /identity/v3/users => generated 286 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:40:37.546518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae03a0-0ecf-45ce-918b-698e44ca5ae0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:37.570716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae03a0-0ecf-45ce-918b-698e44ca5ae0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:37.589229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced2c1f-13e5-433d-8e10-0f98f011a523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:37.590250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced2c1f-13e5-433d-8e10-0f98f011a523 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:37.592537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced2c1f-13e5-433d-8e10-0f98f011a523 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:37.593001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced2c1f-13e5-433d-8e10-0f98f011a523 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:37.593910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced2c1f-13e5-433d-8e10-0f98f011a523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:37.598972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced2c1f-13e5-433d-8e10-0f98f011a523 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:37.639185 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2962/5936] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:40:37.639716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f2ff4-f898-4d2b-afb3-0b4d8e9521e4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:37.668698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f2ff4-f898-4d2b-afb3-0b4d8e9521e4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:37.705537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe91080-d14c-406b-a942-af3ec9e02154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:37.718179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe91080-d14c-406b-a942-af3ec9e02154 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:37.719235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe91080-d14c-406b-a942-af3ec9e02154 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:37.726411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe91080-d14c-406b-a942-af3ec9e02154 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:37.726411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe91080-d14c-406b-a942-af3ec9e02154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:37.739440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe91080-d14c-406b-a942-af3ec9e02154 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:37.789891 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2975/5937] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:40:37.794813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced2c1f-13e5-433d-8e10-0f98f011a523 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:37.821198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced2c1f-13e5-433d-8e10-0f98f011a523 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:37.840425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689d77b-89b8-4fa6-8f94-8c0b4c916df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:37.841404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689d77b-89b8-4fa6-8f94-8c0b4c916df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:37.841694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689d77b-89b8-4fa6-8f94-8c0b4c916df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:37.841979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689d77b-89b8-4fa6-8f94-8c0b4c916df0 admin admin] PATH_INFO: `/v3/projects/d70a0a63b0814218a73cdc0fba0ce7da/users/e149c952f9f940129be1c7382fad887b/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:37.894159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689d77b-89b8-4fa6-8f94-8c0b4c916df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70a0a63b0814218a73cdc0fba0ce7da, user_id=e149c952f9f940129be1c7382fad887b, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:37.900928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689d77b-89b8-4fa6-8f94-8c0b4c916df0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:38.044332 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2963/5938] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:40:37 2022] PUT /identity/v3/projects/d70a0a63b0814218a73cdc0fba0ce7da/users/e149c952f9f940129be1c7382fad887b/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:40:38.046579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39e77e-35a0-4d4a-b4de-39cfd60239d1 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:38.046886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39e77e-35a0-4d4a-b4de-39cfd60239d1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:38.047283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39e77e-35a0-4d4a-b4de-39cfd60239d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:38.156221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fb39e77e-35a0-4d4a-b4de-39cfd60239d1 None None] MFA Rules not processed for user `e149c952f9f940129be1c7382fad887b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:40:38.161733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fb39e77e-35a0-4d4a-b4de-39cfd60239d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:38.326908 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2976/5939] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:40:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:40:38.329664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142f492-0595-4fdc-9475-394af15cfb13 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:38.329779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142f492-0595-4fdc-9475-394af15cfb13 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:38.330055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142f492-0595-4fdc-9475-394af15cfb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:38.367405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3142f492-0595-4fdc-9475-394af15cfb13 None None] MFA Rules not processed for user `e149c952f9f940129be1c7382fad887b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:40:38.368683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3142f492-0595-4fdc-9475-394af15cfb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:38.417913 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2964/5940] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:40:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:40:38.455324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39e77e-35a0-4d4a-b4de-39cfd60239d1 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:38.459114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fb39e77e-35a0-4d4a-b4de-39cfd60239d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:38.708138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39e77e-35a0-4d4a-b4de-39cfd60239d1 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:38.714605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04543177-c1f1-4b6d-93e9-edd78b66ae56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:38.715692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04543177-c1f1-4b6d-93e9-edd78b66ae56 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:38.716170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04543177-c1f1-4b6d-93e9-edd78b66ae56 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:38.716873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04543177-c1f1-4b6d-93e9-edd78b66ae56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:38.741927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04543177-c1f1-4b6d-93e9-edd78b66ae56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:38.744435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04543177-c1f1-4b6d-93e9-edd78b66ae56 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:38.763212 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2977/5941] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:40:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:40:41.789587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142f492-0595-4fdc-9475-394af15cfb13 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:41.794687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3142f492-0595-4fdc-9475-394af15cfb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:42.017594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142f492-0595-4fdc-9475-394af15cfb13 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:42.038111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17234a7-457f-4229-bf5e-2fb06dce65d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:42.040110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17234a7-457f-4229-bf5e-2fb06dce65d0 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:42.050366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17234a7-457f-4229-bf5e-2fb06dce65d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:42.050665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17234a7-457f-4229-bf5e-2fb06dce65d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:42.060767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b17234a7-457f-4229-bf5e-2fb06dce65d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:42.082964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17234a7-457f-4229-bf5e-2fb06dce65d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:42.084406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17234a7-457f-4229-bf5e-2fb06dce65d0 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:42.123209 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2965/5942] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:40:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:40:44.691906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04543177-c1f1-4b6d-93e9-edd78b66ae56 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:44.694568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-04543177-c1f1-4b6d-93e9-edd78b66ae56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:44.747380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04543177-c1f1-4b6d-93e9-edd78b66ae56 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:44.781398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a613a-85ed-4d51-8202-0707370d1e40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:44.785449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a613a-85ed-4d51-8202-0707370d1e40 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:44.785985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a613a-85ed-4d51-8202-0707370d1e40 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:44.786425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a613a-85ed-4d51-8202-0707370d1e40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:44.795753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-407a613a-85ed-4d51-8202-0707370d1e40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:44.862696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a613a-85ed-4d51-8202-0707370d1e40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:44.870588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a613a-85ed-4d51-8202-0707370d1e40 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:44.958044 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2978/5943] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:40:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:40:58.151291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19facd0c-f616-4003-a61b-6339ce2bbfa3 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:58.152112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19facd0c-f616-4003-a61b-6339ce2bbfa3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:58.152541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19facd0c-f616-4003-a61b-6339ce2bbfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:58.174430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-19facd0c-f616-4003-a61b-6339ce2bbfa3 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:40:58.175871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-19facd0c-f616-4003-a61b-6339ce2bbfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:58.258988 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2966/5944] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:40:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:40:58.274521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a613a-85ed-4d51-8202-0707370d1e40 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:58.276560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-407a613a-85ed-4d51-8202-0707370d1e40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:58.381328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19facd0c-f616-4003-a61b-6339ce2bbfa3 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:58.382902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-19facd0c-f616-4003-a61b-6339ce2bbfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:58.389472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a613a-85ed-4d51-8202-0707370d1e40 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:58.398417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19facd0c-f616-4003-a61b-6339ce2bbfa3 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:58.399092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5f6b1-1e8c-43a3-ba90-47a3e33c4df9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:58.399990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5f6b1-1e8c-43a3-ba90-47a3e33c4df9 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:58.400554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5f6b1-1e8c-43a3-ba90-47a3e33c4df9 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:58.401095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5f6b1-1e8c-43a3-ba90-47a3e33c4df9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:58.403069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b19e64-8688-4aff-baa6-7e51ab8f8f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:58.403741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b19e64-8688-4aff-baa6-7e51ab8f8f1e service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:58.404122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b19e64-8688-4aff-baa6-7e51ab8f8f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:58.404782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b19e64-8688-4aff-baa6-7e51ab8f8f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:58.406906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-77b19e64-8688-4aff-baa6-7e51ab8f8f1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:58.415593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5f6b1-1e8c-43a3-ba90-47a3e33c4df9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:58.417322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5f6b1-1e8c-43a3-ba90-47a3e33c4df9 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:58.427505 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2979/5945] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:40:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 02 10:40:58.559493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b19e64-8688-4aff-baa6-7e51ab8f8f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:58.559493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b19e64-8688-4aff-baa6-7e51ab8f8f1e service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:58.568943 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2967/5946] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:40:58 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:40:59.679964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5f6b1-1e8c-43a3-ba90-47a3e33c4df9 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:40:59.698332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5f6b1-1e8c-43a3-ba90-47a3e33c4df9 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:40:59.711920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2a112-219e-482a-b07d-f543af0f8474 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:40:59.712659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2a112-219e-482a-b07d-f543af0f8474 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:40:59.713088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2a112-219e-482a-b07d-f543af0f8474 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:40:59.714382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2a112-219e-482a-b07d-f543af0f8474 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:40:59.720314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-adf2a112-219e-482a-b07d-f543af0f8474 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:40:59.751213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2a112-219e-482a-b07d-f543af0f8474 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:40:59.754242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2a112-219e-482a-b07d-f543af0f8474 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:40:59.793041 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2980/5947] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:40:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:41:01.099468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bda2c-c1d4-423a-8030-b524f5a76404 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:01.100388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bda2c-c1d4-423a-8030-b524f5a76404 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:01.101091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bda2c-c1d4-423a-8030-b524f5a76404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:01.125355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e32bda2c-c1d4-423a-8030-b524f5a76404 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:01.127199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e32bda2c-c1d4-423a-8030-b524f5a76404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:01.150898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2a112-219e-482a-b07d-f543af0f8474 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:01.159684 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2968/5948] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:41:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:01.167017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2a112-219e-482a-b07d-f543af0f8474 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:01.174453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875cd6f-5a25-4f47-8a12-37b63d77baff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:01.175298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875cd6f-5a25-4f47-8a12-37b63d77baff service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:01.175758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875cd6f-5a25-4f47-8a12-37b63d77baff service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:01.176206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875cd6f-5a25-4f47-8a12-37b63d77baff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:01.189597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875cd6f-5a25-4f47-8a12-37b63d77baff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:01.192266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875cd6f-5a25-4f47-8a12-37b63d77baff service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:01.220542 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2981/5949] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:41:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:41:02.451788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3d9b0-4d68-4cdd-bc10-2693ec30960d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:02.452264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3d9b0-4d68-4cdd-bc10-2693ec30960d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:02.453468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3d9b0-4d68-4cdd-bc10-2693ec30960d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:02.480327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-20d3d9b0-4d68-4cdd-bc10-2693ec30960d None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:02.481825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-20d3d9b0-4d68-4cdd-bc10-2693ec30960d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:02.490722 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2969/5950] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:41:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:02.509803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875cd6f-5a25-4f47-8a12-37b63d77baff service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:02.527004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875cd6f-5a25-4f47-8a12-37b63d77baff service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:02.534065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b45d9b-dd14-464e-9699-16973f204a7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:02.534737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b45d9b-dd14-464e-9699-16973f204a7a service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:02.535024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b45d9b-dd14-464e-9699-16973f204a7a service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:02.535306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b45d9b-dd14-464e-9699-16973f204a7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:02.545827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b45d9b-dd14-464e-9699-16973f204a7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:02.548118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b45d9b-dd14-464e-9699-16973f204a7a service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:02.558192 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2982/5951] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:41:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:41:08.849378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fde3d5-1e28-4fab-829f-0347496e2d14 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:08.849872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fde3d5-1e28-4fab-829f-0347496e2d14 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:08.850016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fde3d5-1e28-4fab-829f-0347496e2d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:08.868524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f0fde3d5-1e28-4fab-829f-0347496e2d14 None None] MFA Rules not processed for user `26723e7d6f3d44a4951432f45c89021a`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:08.869417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f0fde3d5-1e28-4fab-829f-0347496e2d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:08.930270 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2970/5952] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:09.320731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b45d9b-dd14-464e-9699-16973f204a7a service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:09.332280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b45d9b-dd14-464e-9699-16973f204a7a service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:09.336087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d941e72-95ea-4277-8067-589d26deb05d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:09.336839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d941e72-95ea-4277-8067-589d26deb05d service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:09.337107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d941e72-95ea-4277-8067-589d26deb05d service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:09.337385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d941e72-95ea-4277-8067-589d26deb05d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:09.339175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9d941e72-95ea-4277-8067-589d26deb05d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:09.350256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d941e72-95ea-4277-8067-589d26deb05d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:09.351666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d941e72-95ea-4277-8067-589d26deb05d service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:09.360856 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2983/5953] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:41:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:41:15.653007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fde3d5-1e28-4fab-829f-0347496e2d14 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:15.656887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f0fde3d5-1e28-4fab-829f-0347496e2d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:15.728854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fde3d5-1e28-4fab-829f-0347496e2d14 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:15.734351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfccfef-8ffc-4597-a8dd-e4712159411a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:15.735248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfccfef-8ffc-4597-a8dd-e4712159411a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:15.735537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfccfef-8ffc-4597-a8dd-e4712159411a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:15.735825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfccfef-8ffc-4597-a8dd-e4712159411a admin admin] PATH_INFO: `/v3/users/427be7d4eed44aeaa994646521a5c7a8` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:15.737163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfccfef-8ffc-4597-a8dd-e4712159411a admin admin] RBAC: Authorizing `identity:delete_user(user_id=427be7d4eed44aeaa994646521a5c7a8)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:15.739186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfccfef-8ffc-4597-a8dd-e4712159411a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:15.965064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dcfccfef-8ffc-4597-a8dd-e4712159411a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '427be7d4eed44aeaa994646521a5c7a8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:15.978668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dcfccfef-8ffc-4597-a8dd-e4712159411a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '427be7d4eed44aeaa994646521a5c7a8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:15.979409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dcfccfef-8ffc-4597-a8dd-e4712159411a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '427be7d4eed44aeaa994646521a5c7a8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:15.987133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dcfccfef-8ffc-4597-a8dd-e4712159411a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '427be7d4eed44aeaa994646521a5c7a8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:16.075075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dcfccfef-8ffc-4597-a8dd-e4712159411a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '427be7d4eed44aeaa994646521a5c7a8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:16.090794 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2971/5954] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:41:15 2022] DELETE /identity/v3/users/427be7d4eed44aeaa994646521a5c7a8 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:16.100281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daeed8-47c5-4671-bebd-e8e3f25f8612 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:16.100896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daeed8-47c5-4671-bebd-e8e3f25f8612 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:16.100896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daeed8-47c5-4671-bebd-e8e3f25f8612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:16.134734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c0daeed8-47c5-4671-bebd-e8e3f25f8612 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:16.135958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c0daeed8-47c5-4671-bebd-e8e3f25f8612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:16.201165 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2984/5955] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:16.210917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfccfef-8ffc-4597-a8dd-e4712159411a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:16.213322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-dcfccfef-8ffc-4597-a8dd-e4712159411a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:16.279666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfccfef-8ffc-4597-a8dd-e4712159411a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:16.283300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d996d-c4aa-42ed-ab11-01183febd362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:16.283982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d996d-c4aa-42ed-ab11-01183febd362 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:16.284263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d996d-c4aa-42ed-ab11-01183febd362 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:16.284573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d996d-c4aa-42ed-ab11-01183febd362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:16.295284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d996d-c4aa-42ed-ab11-01183febd362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:16.296767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d996d-c4aa-42ed-ab11-01183febd362 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:16.307234 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2972/5956] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:41:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:41:16.940040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0daeed8-47c5-4671-bebd-e8e3f25f8612 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:16.942116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c0daeed8-47c5-4671-bebd-e8e3f25f8612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:16.954388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0daeed8-47c5-4671-bebd-e8e3f25f8612 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:16.959495 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e0ca9-8a8e-4ab2-bc50-0cafeb627f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:16.960363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e0ca9-8a8e-4ab2-bc50-0cafeb627f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:16.960851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e0ca9-8a8e-4ab2-bc50-0cafeb627f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:16.963162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e0ca9-8a8e-4ab2-bc50-0cafeb627f61 admin admin] PATH_INFO: `/v3/projects/9da89947cbda467c9eb7022d9ce8447f` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:16.963162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e0ca9-8a8e-4ab2-bc50-0cafeb627f61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da89947cbda467c9eb7022d9ce8447f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:16.964940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e0ca9-8a8e-4ab2-bc50-0cafeb627f61 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:17.128984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-653e0ca9-8a8e-4ab2-bc50-0cafeb627f61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da89947cbda467c9eb7022d9ce8447f', 'request_id': 'req-653e0ca9-8a8e-4ab2-bc50-0cafeb627f61'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:17.219033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-653e0ca9-8a8e-4ab2-bc50-0cafeb627f61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da89947cbda467c9eb7022d9ce8447f', 'request_id': 'req-653e0ca9-8a8e-4ab2-bc50-0cafeb627f61'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:17.226704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-653e0ca9-8a8e-4ab2-bc50-0cafeb627f61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da89947cbda467c9eb7022d9ce8447f', 'request_id': 'req-653e0ca9-8a8e-4ab2-bc50-0cafeb627f61'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:17.239430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-653e0ca9-8a8e-4ab2-bc50-0cafeb627f61 admin admin] The token cache is being invalidate because project 9da89947cbda467c9eb7022d9ce8447f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:41:17.245796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-653e0ca9-8a8e-4ab2-bc50-0cafeb627f61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:17.245796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-653e0ca9-8a8e-4ab2-bc50-0cafeb627f61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:17.245796 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2985/5957] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:41:16 2022] DELETE /identity/v3/projects/9da89947cbda467c9eb7022d9ce8447f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:17.248459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ecd95-cd71-435c-901a-4fc0fb81d4f1 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:17.249447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ecd95-cd71-435c-901a-4fc0fb81d4f1 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:17.249447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ecd95-cd71-435c-901a-4fc0fb81d4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:17.269377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2f1ecd95-cd71-435c-901a-4fc0fb81d4f1 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:17.270783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2f1ecd95-cd71-435c-901a-4fc0fb81d4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:17.350208 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2973/5958] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:41:17.358367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a102591-1aee-4502-8403-5da7068cee4f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:17.358703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a102591-1aee-4502-8403-5da7068cee4f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:17.359003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a102591-1aee-4502-8403-5da7068cee4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:17.381453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1a102591-1aee-4502-8403-5da7068cee4f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:17.382834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1a102591-1aee-4502-8403-5da7068cee4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:17.394305 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2986/5959] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:17.396121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ecd95-cd71-435c-901a-4fc0fb81d4f1 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:17.408571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ecd95-cd71-435c-901a-4fc0fb81d4f1 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:17.412549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43fc8c-1d1f-4342-ac2a-b2089e1b028e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:17.417268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43fc8c-1d1f-4342-ac2a-b2089e1b028e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:17.417677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43fc8c-1d1f-4342-ac2a-b2089e1b028e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:17.418061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43fc8c-1d1f-4342-ac2a-b2089e1b028e admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:17.418887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43fc8c-1d1f-4342-ac2a-b2089e1b028e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:41:17.419269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43fc8c-1d1f-4342-ac2a-b2089e1b028e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:17.421024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43fc8c-1d1f-4342-ac2a-b2089e1b028e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:17.433864 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2974/5960] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:41:17.438433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a102591-1aee-4502-8403-5da7068cee4f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:17.448205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a102591-1aee-4502-8403-5da7068cee4f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:17.453965 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf253c1-9cb8-4e43-aa74-b1efe5b1c5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:17.454996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf253c1-9cb8-4e43-aa74-b1efe5b1c5c7 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:17.455445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf253c1-9cb8-4e43-aa74-b1efe5b1c5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:17.455869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf253c1-9cb8-4e43-aa74-b1efe5b1c5c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:17.456762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf253c1-9cb8-4e43-aa74-b1efe5b1c5c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:17.459842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf253c1-9cb8-4e43-aa74-b1efe5b1c5c7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:17.578611 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2987/5961] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:41:17 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:41:17.580372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43fc8c-1d1f-4342-ac2a-b2089e1b028e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:17.605829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43fc8c-1d1f-4342-ac2a-b2089e1b028e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:17.689375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0014fe2-653a-4834-b712-d652faf86bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:17.692325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0014fe2-653a-4834-b712-d652faf86bdd admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:17.692325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0014fe2-653a-4834-b712-d652faf86bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:17.692325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0014fe2-653a-4834-b712-d652faf86bdd admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:17.692325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0014fe2-653a-4834-b712-d652faf86bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:17.693746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0014fe2-653a-4834-b712-d652faf86bdd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:17.818327 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2975/5962] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:41:17 2022] POST /identity/v3/users => generated 288 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:17.822798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf253c1-9cb8-4e43-aa74-b1efe5b1c5c7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:17.834169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf253c1-9cb8-4e43-aa74-b1efe5b1c5c7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:17.838776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316bc2d-fab5-4d8f-9bce-fe5395ea3444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:17.839443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316bc2d-fab5-4d8f-9bce-fe5395ea3444 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:17.839725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316bc2d-fab5-4d8f-9bce-fe5395ea3444 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:17.840001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316bc2d-fab5-4d8f-9bce-fe5395ea3444 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:17.840804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316bc2d-fab5-4d8f-9bce-fe5395ea3444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:17.843865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316bc2d-fab5-4d8f-9bce-fe5395ea3444 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:17.858434 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2988/5963] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:41:17.859615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0014fe2-653a-4834-b712-d652faf86bdd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:17.871695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0014fe2-653a-4834-b712-d652faf86bdd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:17.876713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de212bbd-ded0-412d-8df3-775d530ced6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:17.877390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de212bbd-ded0-412d-8df3-775d530ced6a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:17.877698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de212bbd-ded0-412d-8df3-775d530ced6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:17.877977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de212bbd-ded0-412d-8df3-775d530ced6a admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:17.878702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de212bbd-ded0-412d-8df3-775d530ced6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:17.881044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de212bbd-ded0-412d-8df3-775d530ced6a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:17.895418 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2976/5964] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:41:17.901427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316bc2d-fab5-4d8f-9bce-fe5395ea3444 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:17.914986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316bc2d-fab5-4d8f-9bce-fe5395ea3444 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:17.922163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2673173-a735-4462-ae8f-fe10858be776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:17.923282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2673173-a735-4462-ae8f-fe10858be776 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:17.924393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2673173-a735-4462-ae8f-fe10858be776 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:17.924870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2673173-a735-4462-ae8f-fe10858be776 admin admin] PATH_INFO: `/v3/projects/23c327323ab84febaef036ab6c72b1e9/users/fe7b70a089c440d98bec17a6f1499a1e/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:17.961432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2673173-a735-4462-ae8f-fe10858be776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c327323ab84febaef036ab6c72b1e9, user_id=fe7b70a089c440d98bec17a6f1499a1e, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:17.965773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2673173-a735-4462-ae8f-fe10858be776 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:18.074502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f4285-5063-4ee6-bf7f-39fa2d2ae418 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:18.075321 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2989/5965] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:41:17 2022] PUT /identity/v3/projects/23c327323ab84febaef036ab6c72b1e9/users/fe7b70a089c440d98bec17a6f1499a1e/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:18.075992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f4285-5063-4ee6-bf7f-39fa2d2ae418 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:18.076433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f4285-5063-4ee6-bf7f-39fa2d2ae418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:18.110465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5c7f4285-5063-4ee6-bf7f-39fa2d2ae418 None None] MFA Rules not processed for user `fe7b70a089c440d98bec17a6f1499a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:18.114578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5c7f4285-5063-4ee6-bf7f-39fa2d2ae418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:18.183194 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2977/5966] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:41:18.195807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2673173-a735-4462-ae8f-fe10858be776 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:18.197736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a2673173-a735-4462-ae8f-fe10858be776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:18.257804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2673173-a735-4462-ae8f-fe10858be776 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:18.261597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca35547-db7a-4417-a04c-c83b307d9763 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:18.266025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca35547-db7a-4417-a04c-c83b307d9763 service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:18.266025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca35547-db7a-4417-a04c-c83b307d9763 service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:18.266025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca35547-db7a-4417-a04c-c83b307d9763 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:18.271379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca35547-db7a-4417-a04c-c83b307d9763 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:18.272935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca35547-db7a-4417-a04c-c83b307d9763 service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:18.281775 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2990/5967] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:41:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:41:21.147528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48f3c2-3d5a-480a-872b-3f46a49c193c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:21.148062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48f3c2-3d5a-480a-872b-3f46a49c193c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:21.148163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48f3c2-3d5a-480a-872b-3f46a49c193c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:21.170738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-dc48f3c2-3d5a-480a-872b-3f46a49c193c None None] MFA Rules not processed for user `fe7b70a089c440d98bec17a6f1499a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:21.170738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-dc48f3c2-3d5a-480a-872b-3f46a49c193c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:21.176980 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2978/5968] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:23.189451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca35547-db7a-4417-a04c-c83b307d9763 service cinder] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:23.190898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4ca35547-db7a-4417-a04c-c83b307d9763 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:23.266901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca35547-db7a-4417-a04c-c83b307d9763 service cinder] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:23.268487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e267647-0b96-4957-848c-53caf2396de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:23.269469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e267647-0b96-4957-848c-53caf2396de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:23.269753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e267647-0b96-4957-848c-53caf2396de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:23.270032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e267647-0b96-4957-848c-53caf2396de4 admin admin] PATH_INFO: `/v3/users/e149c952f9f940129be1c7382fad887b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:23.272941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e267647-0b96-4957-848c-53caf2396de4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e149c952f9f940129be1c7382fad887b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:23.274922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e267647-0b96-4957-848c-53caf2396de4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:23.493307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7e267647-0b96-4957-848c-53caf2396de4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e149c952f9f940129be1c7382fad887b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:23.512582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7e267647-0b96-4957-848c-53caf2396de4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e149c952f9f940129be1c7382fad887b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:23.513672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7e267647-0b96-4957-848c-53caf2396de4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e149c952f9f940129be1c7382fad887b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:23.527128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7e267647-0b96-4957-848c-53caf2396de4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e149c952f9f940129be1c7382fad887b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:23.627993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7e267647-0b96-4957-848c-53caf2396de4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e149c952f9f940129be1c7382fad887b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:23.638151 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2991/5969] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:41:23 2022] DELETE /identity/v3/users/e149c952f9f940129be1c7382fad887b => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:23.639465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52375dd1-dd53-45f1-a5fe-9192b7695a7a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:23.639873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52375dd1-dd53-45f1-a5fe-9192b7695a7a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:23.640040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52375dd1-dd53-45f1-a5fe-9192b7695a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:23.677145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-52375dd1-dd53-45f1-a5fe-9192b7695a7a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:23.678645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-52375dd1-dd53-45f1-a5fe-9192b7695a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:23.744924 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2979/5970] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:41:23.778040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e267647-0b96-4957-848c-53caf2396de4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:23.779403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7e267647-0b96-4957-848c-53caf2396de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:23.839139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e267647-0b96-4957-848c-53caf2396de4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:23.846773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2aaa10-1847-4198-a602-32834bdb0f4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:23.847499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aaa10-1847-4198-a602-32834bdb0f4e service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:23.847789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aaa10-1847-4198-a602-32834bdb0f4e service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:23.848074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aaa10-1847-4198-a602-32834bdb0f4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:23.858287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2aaa10-1847-4198-a602-32834bdb0f4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:23.859723 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2aaa10-1847-4198-a602-32834bdb0f4e service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:23.869769 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2992/5971] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:41:24.598802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52375dd1-dd53-45f1-a5fe-9192b7695a7a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:24.601317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-52375dd1-dd53-45f1-a5fe-9192b7695a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:24.620326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52375dd1-dd53-45f1-a5fe-9192b7695a7a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:24.627633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41dac5-7338-4881-8242-4e82143b98da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:24.629136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41dac5-7338-4881-8242-4e82143b98da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:24.629623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41dac5-7338-4881-8242-4e82143b98da admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:24.630063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41dac5-7338-4881-8242-4e82143b98da admin admin] PATH_INFO: `/v3/projects/d70a0a63b0814218a73cdc0fba0ce7da` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:24.632103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41dac5-7338-4881-8242-4e82143b98da admin admin] RBAC: Authorizing `identity:delete_project(project_id=d70a0a63b0814218a73cdc0fba0ce7da)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:24.635794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41dac5-7338-4881-8242-4e82143b98da admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:24.810315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5a41dac5-7338-4881-8242-4e82143b98da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd70a0a63b0814218a73cdc0fba0ce7da', 'request_id': 'req-5a41dac5-7338-4881-8242-4e82143b98da'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:24.821280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5a41dac5-7338-4881-8242-4e82143b98da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd70a0a63b0814218a73cdc0fba0ce7da', 'request_id': 'req-5a41dac5-7338-4881-8242-4e82143b98da'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:24.900755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5a41dac5-7338-4881-8242-4e82143b98da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd70a0a63b0814218a73cdc0fba0ce7da', 'request_id': 'req-5a41dac5-7338-4881-8242-4e82143b98da'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:24.934242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5a41dac5-7338-4881-8242-4e82143b98da admin admin] The token cache is being invalidate because project d70a0a63b0814218a73cdc0fba0ce7da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:41:24.934602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5a41dac5-7338-4881-8242-4e82143b98da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:24.935181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5a41dac5-7338-4881-8242-4e82143b98da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:24.937001 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2980/5972] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:41:24 2022] DELETE /identity/v3/projects/d70a0a63b0814218a73cdc0fba0ce7da => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:24.943870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bbdde-0eb4-42fb-9240-52763d2da319 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:24.944809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bbdde-0eb4-42fb-9240-52763d2da319 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:24.945276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bbdde-0eb4-42fb-9240-52763d2da319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:24.977810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4f5bbdde-0eb4-42fb-9240-52763d2da319 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:24.979392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4f5bbdde-0eb4-42fb-9240-52763d2da319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:25.114414 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2993/5973] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:25.121225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f5b9a-4fd1-40d8-9b21-5f2c8cc112ae None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:25.121513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f5b9a-4fd1-40d8-9b21-5f2c8cc112ae None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:25.121801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f5b9a-4fd1-40d8-9b21-5f2c8cc112ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:25.148282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-679f5b9a-4fd1-40d8-9b21-5f2c8cc112ae None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:25.149677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-679f5b9a-4fd1-40d8-9b21-5f2c8cc112ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:25.159604 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2981/5974] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:25.163907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bbdde-0eb4-42fb-9240-52763d2da319 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:25.180556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bbdde-0eb4-42fb-9240-52763d2da319 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:25.194052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb21805-b9f7-4ff0-bb0f-e02a8bf0be24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:25.194745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb21805-b9f7-4ff0-bb0f-e02a8bf0be24 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:25.195031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb21805-b9f7-4ff0-bb0f-e02a8bf0be24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:25.195306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb21805-b9f7-4ff0-bb0f-e02a8bf0be24 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:25.196075 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb21805-b9f7-4ff0-bb0f-e02a8bf0be24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:41:25.196354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb21805-b9f7-4ff0-bb0f-e02a8bf0be24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:25.198024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb21805-b9f7-4ff0-bb0f-e02a8bf0be24 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:25.214711 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2994/5975] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:41:25.215981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f5b9a-4fd1-40d8-9b21-5f2c8cc112ae None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:25.228826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f5b9a-4fd1-40d8-9b21-5f2c8cc112ae None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:25.237692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da084d-3247-4435-be4b-09e78a63bb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:25.239059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da084d-3247-4435-be4b-09e78a63bb0f admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:25.239507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da084d-3247-4435-be4b-09e78a63bb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:25.239891 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da084d-3247-4435-be4b-09e78a63bb0f admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:25.240898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da084d-3247-4435-be4b-09e78a63bb0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:25.243115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da084d-3247-4435-be4b-09e78a63bb0f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:25.380552 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2982/5976] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:41:25 2022] POST /identity/v3/projects => generated 367 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:25.384588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb21805-b9f7-4ff0-bb0f-e02a8bf0be24 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:25.395447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb21805-b9f7-4ff0-bb0f-e02a8bf0be24 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:25.470596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453c2a0-d78b-493a-b295-84a336981e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:25.471393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453c2a0-d78b-493a-b295-84a336981e44 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:25.471908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453c2a0-d78b-493a-b295-84a336981e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:25.472808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453c2a0-d78b-493a-b295-84a336981e44 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:25.473590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453c2a0-d78b-493a-b295-84a336981e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:25.477351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453c2a0-d78b-493a-b295-84a336981e44 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:25.629431 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2995/5977] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:41:25 2022] POST /identity/v3/users => generated 284 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:41:25.633541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da084d-3247-4435-be4b-09e78a63bb0f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:25.643998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da084d-3247-4435-be4b-09e78a63bb0f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:25.649444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed537f28-ae95-4c9e-bb29-6e44088eccdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:25.650411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed537f28-ae95-4c9e-bb29-6e44088eccdd admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:25.650942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed537f28-ae95-4c9e-bb29-6e44088eccdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:25.651492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed537f28-ae95-4c9e-bb29-6e44088eccdd admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:25.655559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed537f28-ae95-4c9e-bb29-6e44088eccdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:25.655559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed537f28-ae95-4c9e-bb29-6e44088eccdd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:25.670433 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2983/5978] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:41:25.672007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453c2a0-d78b-493a-b295-84a336981e44 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:25.688564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453c2a0-d78b-493a-b295-84a336981e44 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:25.693958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf4129-67f6-4c34-9637-f97ad2623cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:25.694725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf4129-67f6-4c34-9637-f97ad2623cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:25.695016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf4129-67f6-4c34-9637-f97ad2623cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:25.695300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf4129-67f6-4c34-9637-f97ad2623cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:25.696037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf4129-67f6-4c34-9637-f97ad2623cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:25.697763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf4129-67f6-4c34-9637-f97ad2623cb5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:25.714814 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2996/5979] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:41:25.716042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed537f28-ae95-4c9e-bb29-6e44088eccdd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:25.727664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed537f28-ae95-4c9e-bb29-6e44088eccdd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:25.732553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70459a8-6881-44e2-9eb2-8aec822fd2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:25.733504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70459a8-6881-44e2-9eb2-8aec822fd2ee admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:25.733996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70459a8-6881-44e2-9eb2-8aec822fd2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:25.734284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70459a8-6881-44e2-9eb2-8aec822fd2ee admin admin] PATH_INFO: `/v3/projects/d1304e77e0a04ff0a428010ffba90442/users/2fb34e74dbf5469aa273443d5e3c6be1/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:25.750500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70459a8-6881-44e2-9eb2-8aec822fd2ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1304e77e0a04ff0a428010ffba90442, user_id=2fb34e74dbf5469aa273443d5e3c6be1, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:25.753854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70459a8-6881-44e2-9eb2-8aec822fd2ee admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:25.844898 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2984/5980] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:41:25 2022] PUT /identity/v3/projects/d1304e77e0a04ff0a428010ffba90442/users/2fb34e74dbf5469aa273443d5e3c6be1/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:25.855954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd441dd-1dec-4c8d-9ae8-4c14488b076b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:25.856248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd441dd-1dec-4c8d-9ae8-4c14488b076b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:25.856778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd441dd-1dec-4c8d-9ae8-4c14488b076b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:25.885865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ffd441dd-1dec-4c8d-9ae8-4c14488b076b None None] MFA Rules not processed for user `2fb34e74dbf5469aa273443d5e3c6be1`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:25.887014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ffd441dd-1dec-4c8d-9ae8-4c14488b076b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:25.959900 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2997/5981] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:25.963978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70459a8-6881-44e2-9eb2-8aec822fd2ee admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:26.031385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70459a8-6881-44e2-9eb2-8aec822fd2ee admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:26.038482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294b34d-d68c-4f9d-a195-16d9e463c31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:26.038482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294b34d-d68c-4f9d-a195-16d9e463c31a admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:26.038482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294b34d-d68c-4f9d-a195-16d9e463c31a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:26.039220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294b34d-d68c-4f9d-a195-16d9e463c31a admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:26.039932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294b34d-d68c-4f9d-a195-16d9e463c31a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:26.041892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294b34d-d68c-4f9d-a195-16d9e463c31a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:26.130924 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2985/5982] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:41:25 2022] POST /identity/v3/projects => generated 367 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:26.135031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd441dd-1dec-4c8d-9ae8-4c14488b076b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:26.147422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd441dd-1dec-4c8d-9ae8-4c14488b076b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:26.219590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e81560-f789-4b82-b49f-5baae6801a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:26.220474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e81560-f789-4b82-b49f-5baae6801a78 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:26.220974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e81560-f789-4b82-b49f-5baae6801a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:26.221406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e81560-f789-4b82-b49f-5baae6801a78 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:26.222276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e81560-f789-4b82-b49f-5baae6801a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:26.224274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e81560-f789-4b82-b49f-5baae6801a78 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:26.359055 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2998/5983] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:41:26 2022] POST /identity/v3/users => generated 290 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:41:26.360307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294b34d-d68c-4f9d-a195-16d9e463c31a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:26.371164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294b34d-d68c-4f9d-a195-16d9e463c31a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:26.376209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70ac48-d662-4c1f-88f8-25b56e476a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:26.377073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70ac48-d662-4c1f-88f8-25b56e476a39 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:26.377455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70ac48-d662-4c1f-88f8-25b56e476a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:26.377810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70ac48-d662-4c1f-88f8-25b56e476a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:26.379120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70ac48-d662-4c1f-88f8-25b56e476a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:26.380797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70ac48-d662-4c1f-88f8-25b56e476a39 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:26.400288 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2986/5984] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:41:26.400993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e81560-f789-4b82-b49f-5baae6801a78 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:26.406719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e81560-f789-4b82-b49f-5baae6801a78 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:26.411985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a243dde-f0e8-4fb1-95ad-fe13bf4e6b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:26.412917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a243dde-f0e8-4fb1-95ad-fe13bf4e6b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:26.413206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a243dde-f0e8-4fb1-95ad-fe13bf4e6b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:26.413489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a243dde-f0e8-4fb1-95ad-fe13bf4e6b60 admin admin] PATH_INFO: `/v3/projects/971c6c1edcf149fd87d050c8dd8f8f23/users/ff50b4cda457441e997cd1168727dd99/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:26.431285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a243dde-f0e8-4fb1-95ad-fe13bf4e6b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=971c6c1edcf149fd87d050c8dd8f8f23, user_id=ff50b4cda457441e997cd1168727dd99, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:26.434307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a243dde-f0e8-4fb1-95ad-fe13bf4e6b60 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:26.515709 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 2999/5985] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:41:26 2022] PUT /identity/v3/projects/971c6c1edcf149fd87d050c8dd8f8f23/users/ff50b4cda457441e997cd1168727dd99/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:26.520022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70ac48-d662-4c1f-88f8-25b56e476a39 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:26.542240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70ac48-d662-4c1f-88f8-25b56e476a39 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:26.620994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd25dae-7220-4c1e-9770-77e48e71397a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:26.621832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd25dae-7220-4c1e-9770-77e48e71397a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:26.622129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd25dae-7220-4c1e-9770-77e48e71397a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:26.622415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd25dae-7220-4c1e-9770-77e48e71397a admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:26.623158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd25dae-7220-4c1e-9770-77e48e71397a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:26.625071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd25dae-7220-4c1e-9770-77e48e71397a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:26.640387 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2987/5986] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:41:26.641706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a243dde-f0e8-4fb1-95ad-fe13bf4e6b60 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:26.654017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a243dde-f0e8-4fb1-95ad-fe13bf4e6b60 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:26.659181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361737ff-2550-4694-a27f-b1306bcce20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:26.660444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361737ff-2550-4694-a27f-b1306bcce20a admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:26.660812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361737ff-2550-4694-a27f-b1306bcce20a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:26.664971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361737ff-2550-4694-a27f-b1306bcce20a admin admin] PATH_INFO: `/v3/projects/971c6c1edcf149fd87d050c8dd8f8f23/users/ff50b4cda457441e997cd1168727dd99/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:26.664971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361737ff-2550-4694-a27f-b1306bcce20a admin admin] RBAC: Authorizing `identity:create_grant(project_id=971c6c1edcf149fd87d050c8dd8f8f23, user_id=ff50b4cda457441e997cd1168727dd99, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:26.666876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361737ff-2550-4694-a27f-b1306bcce20a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:26.680242 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3000/5987] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:41:26 2022] PUT /identity/v3/projects/971c6c1edcf149fd87d050c8dd8f8f23/users/ff50b4cda457441e997cd1168727dd99/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:41:26.690384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4fd52-a341-4dbf-829a-1d39c05916df None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:26.693928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4fd52-a341-4dbf-829a-1d39c05916df None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:26.693928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4fd52-a341-4dbf-829a-1d39c05916df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:26.749399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c9e4fd52-a341-4dbf-829a-1d39c05916df None None] MFA Rules not processed for user `ff50b4cda457441e997cd1168727dd99`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:26.750544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c9e4fd52-a341-4dbf-829a-1d39c05916df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:26.846626 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2988/5988] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:26 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:26.850897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361737ff-2550-4694-a27f-b1306bcce20a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:26.865699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361737ff-2550-4694-a27f-b1306bcce20a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:26.871067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fef59-3705-4c4d-8dc4-d698ac4932e4 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:26.872234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fef59-3705-4c4d-8dc4-d698ac4932e4 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:26.873669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fef59-3705-4c4d-8dc4-d698ac4932e4 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:26.873991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94fef59-3705-4c4d-8dc4-d698ac4932e4 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:26.874765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94fef59-3705-4c4d-8dc4-d698ac4932e4 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:26.876742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94fef59-3705-4c4d-8dc4-d698ac4932e4 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:26.965450 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3001/5989] 10.222.0.16 () {60 vars in 1149 bytes} [Mon May 2 10:41:26 2022] POST /identity/v3/domains => generated 275 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:26.969704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4fd52-a341-4dbf-829a-1d39c05916df None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:26.979695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4fd52-a341-4dbf-829a-1d39c05916df None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:27.041746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5c9cf-20ac-4126-b520-a2f6f066d18b tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:27.042588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5c9cf-20ac-4126-b520-a2f6f066d18b tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:27.043158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5c9cf-20ac-4126-b520-a2f6f066d18b tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:27.043355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5c9cf-20ac-4126-b520-a2f6f066d18b tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:27.044277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5c9cf-20ac-4126-b520-a2f6f066d18b tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:27.046113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5c9cf-20ac-4126-b520-a2f6f066d18b tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:27.168624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fef59-3705-4c4d-8dc4-d698ac4932e4 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:27.168809 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2989/5990] 10.222.0.16 () {60 vars in 1149 bytes} [Mon May 2 10:41:26 2022] POST /identity/v3/domains => generated 275 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:27.185156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94fef59-3705-4c4d-8dc4-d698ac4932e4 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:27.250714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c252163-a343-49a6-814b-b020df46d6b8 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:27.251728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c252163-a343-49a6-814b-b020df46d6b8 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:27.252017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c252163-a343-49a6-814b-b020df46d6b8 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:27.252307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c252163-a343-49a6-814b-b020df46d6b8 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:27.253191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c252163-a343-49a6-814b-b020df46d6b8 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:27.256283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c252163-a343-49a6-814b-b020df46d6b8 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:27.362259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5c9cf-20ac-4126-b520-a2f6f066d18b tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:27.376696 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3002/5991] 10.222.0.16 () {60 vars in 1149 bytes} [Mon May 2 10:41:27 2022] POST /identity/v3/domains => generated 277 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:41:27.380129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5c9cf-20ac-4126-b520-a2f6f066d18b tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:27.498873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631694d-f328-4d2a-9101-28483a1504af tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:27.504485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631694d-f328-4d2a-9101-28483a1504af tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:27.504485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631694d-f328-4d2a-9101-28483a1504af tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:27.504485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631694d-f328-4d2a-9101-28483a1504af tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:27.504485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631694d-f328-4d2a-9101-28483a1504af tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:27.504485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631694d-f328-4d2a-9101-28483a1504af tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:27.600614 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2990/5992] 10.222.0.16 () {60 vars in 1149 bytes} [Mon May 2 10:41:27 2022] POST /identity/v3/domains => generated 280 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:27.604760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c252163-a343-49a6-814b-b020df46d6b8 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:27.615515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c252163-a343-49a6-814b-b020df46d6b8 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:27.680129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422e359-127f-43d6-916b-766a3d38e2bb tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:27.680837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422e359-127f-43d6-916b-766a3d38e2bb tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:27.681125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422e359-127f-43d6-916b-766a3d38e2bb tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:27.681404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422e359-127f-43d6-916b-766a3d38e2bb tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains/9cf496880c764b26be16e33d75fe2bf9` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:27.697418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422e359-127f-43d6-916b-766a3d38e2bb tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9cf496880c764b26be16e33d75fe2bf9)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:27.699173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422e359-127f-43d6-916b-766a3d38e2bb tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:27.725601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d422e359-127f-43d6-916b-766a3d38e2bb tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9cf496880c764b26be16e33d75fe2bf9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:27.730215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d422e359-127f-43d6-916b-766a3d38e2bb tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9cf496880c764b26be16e33d75fe2bf9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:27.883647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d422e359-127f-43d6-916b-766a3d38e2bb tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cf496880c764b26be16e33d75fe2bf9', 'request_id': 'req-d422e359-127f-43d6-916b-766a3d38e2bb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:28.056434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d422e359-127f-43d6-916b-766a3d38e2bb tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cf496880c764b26be16e33d75fe2bf9', 'request_id': 'req-d422e359-127f-43d6-916b-766a3d38e2bb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:28.073925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d422e359-127f-43d6-916b-766a3d38e2bb tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cf496880c764b26be16e33d75fe2bf9', 'request_id': 'req-d422e359-127f-43d6-916b-766a3d38e2bb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:28.119793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d422e359-127f-43d6-916b-766a3d38e2bb tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] The token cache is being invalidate because project 9cf496880c764b26be16e33d75fe2bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:41:28.120971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d422e359-127f-43d6-916b-766a3d38e2bb tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:28.122362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d422e359-127f-43d6-916b-766a3d38e2bb tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:28.138876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d422e359-127f-43d6-916b-766a3d38e2bb tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9cf496880c764b26be16e33d75fe2bf9', 'request_id': 'req-d422e359-127f-43d6-916b-766a3d38e2bb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:28.140661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d422e359-127f-43d6-916b-766a3d38e2bb tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9cf496880c764b26be16e33d75fe2bf9', 'request_id': 'req-d422e359-127f-43d6-916b-766a3d38e2bb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:28.146102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d422e359-127f-43d6-916b-766a3d38e2bb tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9cf496880c764b26be16e33d75fe2bf9', 'request_id': 'req-d422e359-127f-43d6-916b-766a3d38e2bb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:28.156570 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3003/5993] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:41:27 2022] DELETE /identity/v3/domains/9cf496880c764b26be16e33d75fe2bf9 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:28.161180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631694d-f328-4d2a-9101-28483a1504af tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:28.163030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e631694d-f328-4d2a-9101-28483a1504af tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:28.179230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631694d-f328-4d2a-9101-28483a1504af tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:28.267742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca786cb1-3eb7-47f1-a0e2-dbd9566fda1a tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:28.268545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca786cb1-3eb7-47f1-a0e2-dbd9566fda1a tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:28.268928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca786cb1-3eb7-47f1-a0e2-dbd9566fda1a tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:28.269369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca786cb1-3eb7-47f1-a0e2-dbd9566fda1a tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:28.270217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca786cb1-3eb7-47f1-a0e2-dbd9566fda1a tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:28.272106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca786cb1-3eb7-47f1-a0e2-dbd9566fda1a tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:28.493896 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2991/5994] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:41:28 2022] POST /identity/v3/domains => generated 248 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:28.497737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422e359-127f-43d6-916b-766a3d38e2bb tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:28.509754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422e359-127f-43d6-916b-766a3d38e2bb tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:28.633817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd058b7-aa54-4fab-9c6f-b38856152f8b tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:28.634695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd058b7-aa54-4fab-9c6f-b38856152f8b tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:28.635176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd058b7-aa54-4fab-9c6f-b38856152f8b tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:28.637184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd058b7-aa54-4fab-9c6f-b38856152f8b tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains/7425a0bb5e494eccb246dc61556fcc4e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:28.655113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd058b7-aa54-4fab-9c6f-b38856152f8b tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7425a0bb5e494eccb246dc61556fcc4e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:28.657652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd058b7-aa54-4fab-9c6f-b38856152f8b tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:28.692927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-efd058b7-aa54-4fab-9c6f-b38856152f8b tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7425a0bb5e494eccb246dc61556fcc4e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:28.693946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-efd058b7-aa54-4fab-9c6f-b38856152f8b tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7425a0bb5e494eccb246dc61556fcc4e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:28.779888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-efd058b7-aa54-4fab-9c6f-b38856152f8b tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7425a0bb5e494eccb246dc61556fcc4e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:28.781098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-efd058b7-aa54-4fab-9c6f-b38856152f8b tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7425a0bb5e494eccb246dc61556fcc4e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:28.783897 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3004/5995] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:41:28 2022] PATCH /identity/v3/domains/7425a0bb5e494eccb246dc61556fcc4e => generated 249 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:41:28.788041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca786cb1-3eb7-47f1-a0e2-dbd9566fda1a tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:28.790055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ca786cb1-3eb7-47f1-a0e2-dbd9566fda1a tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:28.819198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca786cb1-3eb7-47f1-a0e2-dbd9566fda1a tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:28.895498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250db21-af58-4731-9787-1d0208631008 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:28.897061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250db21-af58-4731-9787-1d0208631008 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:28.897424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250db21-af58-4731-9787-1d0208631008 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:28.897832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250db21-af58-4731-9787-1d0208631008 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains/7425a0bb5e494eccb246dc61556fcc4e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:28.912746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250db21-af58-4731-9787-1d0208631008 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7425a0bb5e494eccb246dc61556fcc4e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:28.915613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250db21-af58-4731-9787-1d0208631008 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:28.954854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7250db21-af58-4731-9787-1d0208631008 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7425a0bb5e494eccb246dc61556fcc4e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:28.966157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7250db21-af58-4731-9787-1d0208631008 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7425a0bb5e494eccb246dc61556fcc4e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:29.151514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7250db21-af58-4731-9787-1d0208631008 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7425a0bb5e494eccb246dc61556fcc4e', 'request_id': 'req-7250db21-af58-4731-9787-1d0208631008'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:29.160790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7250db21-af58-4731-9787-1d0208631008 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7425a0bb5e494eccb246dc61556fcc4e', 'request_id': 'req-7250db21-af58-4731-9787-1d0208631008'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:29.245233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7250db21-af58-4731-9787-1d0208631008 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7425a0bb5e494eccb246dc61556fcc4e', 'request_id': 'req-7250db21-af58-4731-9787-1d0208631008'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:29.256216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7250db21-af58-4731-9787-1d0208631008 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] The token cache is being invalidate because project 7425a0bb5e494eccb246dc61556fcc4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:41:29.259746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7250db21-af58-4731-9787-1d0208631008 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:29.259746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7250db21-af58-4731-9787-1d0208631008 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:29.269345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7250db21-af58-4731-9787-1d0208631008 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7425a0bb5e494eccb246dc61556fcc4e', 'request_id': 'req-7250db21-af58-4731-9787-1d0208631008'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:29.273765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7250db21-af58-4731-9787-1d0208631008 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7425a0bb5e494eccb246dc61556fcc4e', 'request_id': 'req-7250db21-af58-4731-9787-1d0208631008'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:29.275821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7250db21-af58-4731-9787-1d0208631008 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7425a0bb5e494eccb246dc61556fcc4e', 'request_id': 'req-7250db21-af58-4731-9787-1d0208631008'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:29.285780 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2992/5996] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:41:28 2022] DELETE /identity/v3/domains/7425a0bb5e494eccb246dc61556fcc4e => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:29.290612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd058b7-aa54-4fab-9c6f-b38856152f8b tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:29.303650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd058b7-aa54-4fab-9c6f-b38856152f8b tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:29.362406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a00d38-369a-4339-97f7-7234f3b5e003 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:29.364013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a00d38-369a-4339-97f7-7234f3b5e003 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:29.364379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a00d38-369a-4339-97f7-7234f3b5e003 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:29.364772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a00d38-369a-4339-97f7-7234f3b5e003 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:29.365605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a00d38-369a-4339-97f7-7234f3b5e003 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:29.367765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a00d38-369a-4339-97f7-7234f3b5e003 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:29.520753 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3005/5997] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:41:29 2022] POST /identity/v3/domains => generated 279 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:29.521979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250db21-af58-4731-9787-1d0208631008 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:29.524420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7250db21-af58-4731-9787-1d0208631008 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:29.539476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250db21-af58-4731-9787-1d0208631008 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:29.594674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191afba-b085-447e-b591-eb9c1e57abcd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:29.595552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191afba-b085-447e-b591-eb9c1e57abcd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:29.595848 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191afba-b085-447e-b591-eb9c1e57abcd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:29.596117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191afba-b085-447e-b591-eb9c1e57abcd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains/c1cbf72e82dc4b86b6c11ed79e603738` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:29.607406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191afba-b085-447e-b591-eb9c1e57abcd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c1cbf72e82dc4b86b6c11ed79e603738)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:29.609072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191afba-b085-447e-b591-eb9c1e57abcd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:29.628377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6191afba-b085-447e-b591-eb9c1e57abcd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c1cbf72e82dc4b86b6c11ed79e603738'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:29.629118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6191afba-b085-447e-b591-eb9c1e57abcd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c1cbf72e82dc4b86b6c11ed79e603738'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:29.763815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6191afba-b085-447e-b591-eb9c1e57abcd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c1cbf72e82dc4b86b6c11ed79e603738'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:29.764476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6191afba-b085-447e-b591-eb9c1e57abcd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c1cbf72e82dc4b86b6c11ed79e603738'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:29.767605 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2993/5998] 10.222.0.16 () {60 vars in 1249 bytes} [Mon May 2 10:41:29 2022] PATCH /identity/v3/domains/c1cbf72e82dc4b86b6c11ed79e603738 => generated 278 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:41:29.773032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a00d38-369a-4339-97f7-7234f3b5e003 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:29.774761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-91a00d38-369a-4339-97f7-7234f3b5e003 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:29.792581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a00d38-369a-4339-97f7-7234f3b5e003 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:29.853201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8864d69-ec14-400e-8c22-ace97d142f8d tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:29.854266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8864d69-ec14-400e-8c22-ace97d142f8d tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:29.854655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8864d69-ec14-400e-8c22-ace97d142f8d tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:29.855010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8864d69-ec14-400e-8c22-ace97d142f8d tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains/c1cbf72e82dc4b86b6c11ed79e603738` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:29.867096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8864d69-ec14-400e-8c22-ace97d142f8d tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=c1cbf72e82dc4b86b6c11ed79e603738)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:29.869185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8864d69-ec14-400e-8c22-ace97d142f8d tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:29.870990 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3006/5999] 10.222.0.16 () {58 vars in 1226 bytes} [Mon May 2 10:41:29 2022] GET /identity/v3/domains/c1cbf72e82dc4b86b6c11ed79e603738 => generated 278 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:41:29.875043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191afba-b085-447e-b591-eb9c1e57abcd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:29.889309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191afba-b085-447e-b591-eb9c1e57abcd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:29.896801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:29.897691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:29.897981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:29.898269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains/c1cbf72e82dc4b86b6c11ed79e603738` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:29.899789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c1cbf72e82dc4b86b6c11ed79e603738)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:29.901475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:29.927837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c1cbf72e82dc4b86b6c11ed79e603738'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:29.939707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c1cbf72e82dc4b86b6c11ed79e603738'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:30.070460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1cbf72e82dc4b86b6c11ed79e603738', 'request_id': 'req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:30.078735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1cbf72e82dc4b86b6c11ed79e603738', 'request_id': 'req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:30.195745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1cbf72e82dc4b86b6c11ed79e603738', 'request_id': 'req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:30.212126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] The token cache is being invalidate because project c1cbf72e82dc4b86b6c11ed79e603738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:41:30.212652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:30.213446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:30.223768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c1cbf72e82dc4b86b6c11ed79e603738', 'request_id': 'req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:30.227070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c1cbf72e82dc4b86b6c11ed79e603738', 'request_id': 'req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:30.228239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c1cbf72e82dc4b86b6c11ed79e603738', 'request_id': 'req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:30.235559 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2994/6000] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:41:29 2022] DELETE /identity/v3/domains/c1cbf72e82dc4b86b6c11ed79e603738 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:30.239806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8864d69-ec14-400e-8c22-ace97d142f8d tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:30.241540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c8864d69-ec14-400e-8c22-ace97d142f8d tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:30.255702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8864d69-ec14-400e-8c22-ace97d142f8d tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:30.315806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97397d66-9f98-422a-b7f2-9f802793afd0 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:30.316466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97397d66-9f98-422a-b7f2-9f802793afd0 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:30.317123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97397d66-9f98-422a-b7f2-9f802793afd0 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:30.317123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97397d66-9f98-422a-b7f2-9f802793afd0 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:30.317986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97397d66-9f98-422a-b7f2-9f802793afd0 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:30.319494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97397d66-9f98-422a-b7f2-9f802793afd0 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:30.337794 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3007/6001] 10.222.0.16 () {58 vars in 1127 bytes} [Mon May 2 10:41:30 2022] GET /identity/v3/domains => generated 1345 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:41:30.338690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:30.352032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5916f8f-9e1c-4f0d-8111-33651ff4ee1e tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:30.356827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74081443-df32-4b7e-bc43-7f1abadf0faf tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:30.357687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74081443-df32-4b7e-bc43-7f1abadf0faf tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:30.357976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74081443-df32-4b7e-bc43-7f1abadf0faf tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:30.358253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74081443-df32-4b7e-bc43-7f1abadf0faf tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains/c1cbf72e82dc4b86b6c11ed79e603738` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:30.365583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74081443-df32-4b7e-bc43-7f1abadf0faf tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:41:30.375484 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-74081443-df32-4b7e-bc43-7f1abadf0faf tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Could not find domain: c1cbf72e82dc4b86b6c11ed79e603738.: keystone.exception.DomainNotFound: Could not find domain: c1cbf72e82dc4b86b6c11ed79e603738. May 02 10:41:30.375484 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:41:30.375484 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 02 10:41:30.375484 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 02 10:41:30.375484 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:41:30.375484 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:41:30.375484 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:41:30.375484 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:41:30.375484 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c1cbf72e82dc4b86b6c11ed79e603738. May 02 10:41:30.375484 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:41:30.375484 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:41:30.375484 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:41:30.375484 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:41:30.375484 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:41:30.375484 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:41:30.375484 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:41:30.376987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:41:30.376987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:41:30.376987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:41:30.376987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:41:30.376987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:41:30.376987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:41:30.376987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:41:30.376987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 02 10:41:30.376987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 02 10:41:30.376987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:41:30.376987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:41:30.376987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:41:30.376987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:41:30.376987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:41:30.376987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:41:30.376987 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:41:30.378278 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:41:30.378278 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:41:30.378278 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:41:30.378278 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:41:30.378278 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:41:30.378278 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:41:30.378278 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:41:30.378278 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:41:30.378278 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:41:30.378278 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:41:30.378278 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:41:30.378278 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:41:30.378278 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:41:30.378278 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 02 10:41:30.378278 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:41:30.378278 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c1cbf72e82dc4b86b6c11ed79e603738. May 02 10:41:30.378278 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:41:30.380216 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2995/6002] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:41:30 2022] PATCH /identity/v3/domains/c1cbf72e82dc4b86b6c11ed79e603738 => generated 112 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 02 10:41:30.381953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97397d66-9f98-422a-b7f2-9f802793afd0 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:30.392746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97397d66-9f98-422a-b7f2-9f802793afd0 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:30.399055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9e7d2-0211-4261-ac09-aeaa6e4599af tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:30.399730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9e7d2-0211-4261-ac09-aeaa6e4599af tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:30.400022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9e7d2-0211-4261-ac09-aeaa6e4599af tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:30.400310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9e7d2-0211-4261-ac09-aeaa6e4599af tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:30.401119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9e7d2-0211-4261-ac09-aeaa6e4599af tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:30.402717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9e7d2-0211-4261-ac09-aeaa6e4599af tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:30.516534 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3008/6003] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:41:30 2022] POST /identity/v3/domains => generated 277 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:41:30.521395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74081443-df32-4b7e-bc43-7f1abadf0faf tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:30.532648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74081443-df32-4b7e-bc43-7f1abadf0faf tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:30.658060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c231d-4f27-4665-abb4-b6c811ac7cff tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:30.658759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c231d-4f27-4665-abb4-b6c811ac7cff tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:30.659071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c231d-4f27-4665-abb4-b6c811ac7cff tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:30.659341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c231d-4f27-4665-abb4-b6c811ac7cff tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:30.660191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c231d-4f27-4665-abb4-b6c811ac7cff tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:30.662347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c231d-4f27-4665-abb4-b6c811ac7cff tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:30.818321 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2996/6004] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:41:30 2022] POST /identity/v3/users => generated 346 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:30.832629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9e7d2-0211-4261-ac09-aeaa6e4599af tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:30.843599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9e7d2-0211-4261-ac09-aeaa6e4599af tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:30.849277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880250c-f163-418a-8bb2-946cbc7c60ef tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:30.849988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880250c-f163-418a-8bb2-946cbc7c60ef tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:30.850278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880250c-f163-418a-8bb2-946cbc7c60ef tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:30.850563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880250c-f163-418a-8bb2-946cbc7c60ef tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/groups` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:30.851322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880250c-f163-418a-8bb2-946cbc7c60ef tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:30.853391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880250c-f163-418a-8bb2-946cbc7c60ef tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:30.966968 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3009/6005] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 2 10:41:30 2022] POST /identity/v3/groups => generated 325 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:30.970874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c231d-4f27-4665-abb4-b6c811ac7cff tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:30.980907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c231d-4f27-4665-abb4-b6c811ac7cff tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:30.986283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188afd1-7871-4144-85e7-a8ddb571e102 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:30.987161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188afd1-7871-4144-85e7-a8ddb571e102 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:30.987451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188afd1-7871-4144-85e7-a8ddb571e102 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:30.988578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188afd1-7871-4144-85e7-a8ddb571e102 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains/3ab7329449044b0fac7dbee5aba043ce` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:30.990076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188afd1-7871-4144-85e7-a8ddb571e102 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3ab7329449044b0fac7dbee5aba043ce)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:30.991720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188afd1-7871-4144-85e7-a8ddb571e102 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:31.012022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b188afd1-7871-4144-85e7-a8ddb571e102 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3ab7329449044b0fac7dbee5aba043ce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:31.012761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b188afd1-7871-4144-85e7-a8ddb571e102 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3ab7329449044b0fac7dbee5aba043ce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:31.116669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b188afd1-7871-4144-85e7-a8ddb571e102 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3ab7329449044b0fac7dbee5aba043ce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:31.117294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b188afd1-7871-4144-85e7-a8ddb571e102 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3ab7329449044b0fac7dbee5aba043ce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:31.119735 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2997/6006] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:41:30 2022] PATCH /identity/v3/domains/3ab7329449044b0fac7dbee5aba043ce => generated 278 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:41:31.123715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880250c-f163-418a-8bb2-946cbc7c60ef tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:31.125686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c880250c-f163-418a-8bb2-946cbc7c60ef tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:31.139347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880250c-f163-418a-8bb2-946cbc7c60ef tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:31.202105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:31.203097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:31.203442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:31.203786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains/3ab7329449044b0fac7dbee5aba043ce` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:31.219270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3ab7329449044b0fac7dbee5aba043ce)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:31.221260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:31.249606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3ab7329449044b0fac7dbee5aba043ce'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:31.256858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3ab7329449044b0fac7dbee5aba043ce'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:31.571378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f2be3f49ff4db7856b6fb4b6309b7e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:31.584709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f2be3f49ff4db7856b6fb4b6309b7e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:31.585471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f2be3f49ff4db7856b6fb4b6309b7e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:31.594940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f2be3f49ff4db7856b6fb4b6309b7e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:31.667952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f2be3f49ff4db7856b6fb4b6309b7e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:31.833405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ab7329449044b0fac7dbee5aba043ce', 'request_id': 'req-583c2b6c-bfa0-4517-93bc-7f46b7e32963'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:31.911370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ab7329449044b0fac7dbee5aba043ce', 'request_id': 'req-583c2b6c-bfa0-4517-93bc-7f46b7e32963'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:31.917819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ab7329449044b0fac7dbee5aba043ce', 'request_id': 'req-583c2b6c-bfa0-4517-93bc-7f46b7e32963'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:31.929254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] The token cache is being invalidate because project 3ab7329449044b0fac7dbee5aba043ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:41:31.929547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:31.930218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:31.943421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3ab7329449044b0fac7dbee5aba043ce', 'request_id': 'req-583c2b6c-bfa0-4517-93bc-7f46b7e32963'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:31.944545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3ab7329449044b0fac7dbee5aba043ce', 'request_id': 'req-583c2b6c-bfa0-4517-93bc-7f46b7e32963'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:31.949409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3ab7329449044b0fac7dbee5aba043ce', 'request_id': 'req-583c2b6c-bfa0-4517-93bc-7f46b7e32963'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:31.959590 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3010/6007] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:41:31 2022] DELETE /identity/v3/domains/3ab7329449044b0fac7dbee5aba043ce => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:31.960855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188afd1-7871-4144-85e7-a8ddb571e102 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:31.971378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188afd1-7871-4144-85e7-a8ddb571e102 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:32.028862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35273e68-e5a0-4d8e-88a1-a26be3e1e7ba tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:32.029736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35273e68-e5a0-4d8e-88a1-a26be3e1e7ba tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:32.030120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35273e68-e5a0-4d8e-88a1-a26be3e1e7ba tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:32.030406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35273e68-e5a0-4d8e-88a1-a26be3e1e7ba tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains/3ab7329449044b0fac7dbee5aba043ce` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:32.037749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35273e68-e5a0-4d8e-88a1-a26be3e1e7ba tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=3ab7329449044b0fac7dbee5aba043ce)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:32.039580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35273e68-e5a0-4d8e-88a1-a26be3e1e7ba tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:32.058495 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-35273e68-e5a0-4d8e-88a1-a26be3e1e7ba tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Could not find domain: 3ab7329449044b0fac7dbee5aba043ce.: keystone.exception.DomainNotFound: Could not find domain: 3ab7329449044b0fac7dbee5aba043ce. May 02 10:41:32.058495 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:41:32.058495 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 02 10:41:32.058495 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 02 10:41:32.058495 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:41:32.058495 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:41:32.058495 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:41:32.058495 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:41:32.058495 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3ab7329449044b0fac7dbee5aba043ce. May 02 10:41:32.058495 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:41:32.058495 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:41:32.058495 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:41:32.058495 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:41:32.058495 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:41:32.058495 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:41:32.058495 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:41:32.072815 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:41:32.072815 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:41:32.072815 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:41:32.072815 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:41:32.072815 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:41:32.072815 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:41:32.072815 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:41:32.072815 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 02 10:41:32.072815 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 02 10:41:32.072815 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 02 10:41:32.072815 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 02 10:41:32.072815 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:41:32.072815 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:41:32.072815 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:41:32.072815 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:41:32.072815 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:41:32.072815 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:41:32.074119 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:41:32.074119 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:41:32.074119 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:41:32.074119 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:41:32.074119 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:41:32.074119 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:41:32.074119 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:41:32.074119 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:41:32.074119 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:41:32.074119 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:41:32.074119 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 02 10:41:32.074119 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:41:32.074119 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3ab7329449044b0fac7dbee5aba043ce. May 02 10:41:32.074119 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:41:32.074119 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2998/6008] 10.222.0.16 () {58 vars in 1226 bytes} [Mon May 2 10:41:31 2022] GET /identity/v3/domains/3ab7329449044b0fac7dbee5aba043ce => generated 112 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:41:32.075207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:32.075207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:32.082315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c2b6c-bfa0-4517-93bc-7f46b7e32963 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:32.087964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86362b0-6423-48d5-a491-c6efe5e8a8df tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:32.088911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86362b0-6423-48d5-a491-c6efe5e8a8df tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:32.089196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86362b0-6423-48d5-a491-c6efe5e8a8df tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:32.089471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86362b0-6423-48d5-a491-c6efe5e8a8df tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/users/a5f2be3f49ff4db7856b6fb4b6309b7e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:32.098781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86362b0-6423-48d5-a491-c6efe5e8a8df tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:get_user(user_id=a5f2be3f49ff4db7856b6fb4b6309b7e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:32.101064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86362b0-6423-48d5-a491-c6efe5e8a8df tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:32.133677 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-f86362b0-6423-48d5-a491-c6efe5e8a8df tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Could not find user: a5f2be3f49ff4db7856b6fb4b6309b7e.: keystone.exception.UserNotFound: Could not find user: a5f2be3f49ff4db7856b6fb4b6309b7e. May 02 10:41:32.133677 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:41:32.133677 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:41:32.133677 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:41:32.133677 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:41:32.133677 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:41:32.133677 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:41:32.133677 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:41:32.133677 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:41:32.133677 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:41:32.133677 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:41:32.133677 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:41:32.133677 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 02 10:41:32.133677 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_user(user_id) May 02 10:41:32.134699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 02 10:41:32.134699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 02 10:41:32.134699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:41:32.134699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:41:32.134699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 10:41:32.134699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:41:32.134699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 10:41:32.134699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:41:32.134699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:41:32.134699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:41:32.134699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:41:32.134699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:41:32.134699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:41:32.134699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:41:32.134699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:41:32.134699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:41:32.134699 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:41:32.135700 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:41:32.135700 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:41:32.135700 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:41:32.135700 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:41:32.135700 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:41:32.135700 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 10:41:32.135700 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 10:41:32.135700 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 10:41:32.135700 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 10:41:32.135700 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 10:41:32.135700 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 10:41:32.135700 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: a5f2be3f49ff4db7856b6fb4b6309b7e. May 02 10:41:32.135700 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:41:32.135700 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3011/6009] 10.222.0.16 () {58 vars in 1220 bytes} [Mon May 2 10:41:32 2022] GET /identity/v3/users/a5f2be3f49ff4db7856b6fb4b6309b7e => generated 110 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:41:32.139405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35273e68-e5a0-4d8e-88a1-a26be3e1e7ba tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:32.150207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35273e68-e5a0-4d8e-88a1-a26be3e1e7ba tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:32.155442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c586de-a791-42a1-ba4e-2e4eb0d934ac tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:32.156443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c586de-a791-42a1-ba4e-2e4eb0d934ac tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:32.156645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c586de-a791-42a1-ba4e-2e4eb0d934ac tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:32.157013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c586de-a791-42a1-ba4e-2e4eb0d934ac tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/groups/26fda88bf4fa44e1b771cce025dbd64b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:32.163978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c586de-a791-42a1-ba4e-2e4eb0d934ac tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:get_group(group_id=26fda88bf4fa44e1b771cce025dbd64b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:32.165133 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-a6c586de-a791-42a1-ba4e-2e4eb0d934ac tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:41:32.165133 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:41:32.165133 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:41:32.166444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c586de-a791-42a1-ba4e-2e4eb0d934ac tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:32.193598 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-a6c586de-a791-42a1-ba4e-2e4eb0d934ac tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Could not find group: 26fda88bf4fa44e1b771cce025dbd64b.: keystone.exception.GroupNotFound: Could not find group: 26fda88bf4fa44e1b771cce025dbd64b. May 02 10:41:32.193598 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:41:32.193598 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:41:32.193598 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:41:32.193598 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:41:32.193598 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:41:32.193598 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:41:32.193598 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:41:32.193598 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:41:32.193598 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:41:32.193598 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:41:32.193598 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:41:32.193598 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get May 02 10:41:32.193598 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_group(group_id) May 02 10:41:32.194731 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group May 02 10:41:32.194731 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) May 02 10:41:32.194731 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:41:32.194731 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:41:32.194731 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 10:41:32.194731 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:41:32.194731 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 10:41:32.194731 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:41:32.194731 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:41:32.194731 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:41:32.194731 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:41:32.194731 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:41:32.194731 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:41:32.194731 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:41:32.194731 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:41:32.194731 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:41:32.194731 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:41:32.195853 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:41:32.195853 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:41:32.195853 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:41:32.195853 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:41:32.195853 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:41:32.195853 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group May 02 10:41:32.195853 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) May 02 10:41:32.195853 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group May 02 10:41:32.195853 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() May 02 10:41:32.195853 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group May 02 10:41:32.195853 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) May 02 10:41:32.195853 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 26fda88bf4fa44e1b771cce025dbd64b. May 02 10:41:32.195853 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:41:32.199101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86362b0-6423-48d5-a491-c6efe5e8a8df tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:32.199542 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 2999/6010] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:41:32 2022] GET /identity/v3/groups/26fda88bf4fa44e1b771cce025dbd64b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:41:32.212302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86362b0-6423-48d5-a491-c6efe5e8a8df tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:32.217282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de16f2-5093-45f5-8c7a-49845a4985c6 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:32.218348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de16f2-5093-45f5-8c7a-49845a4985c6 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:32.218568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de16f2-5093-45f5-8c7a-49845a4985c6 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:32.219119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de16f2-5093-45f5-8c7a-49845a4985c6 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/groups/26fda88bf4fa44e1b771cce025dbd64b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:32.224501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de16f2-5093-45f5-8c7a-49845a4985c6 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:41:32.237339 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-d8de16f2-5093-45f5-8c7a-49845a4985c6 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Could not find group: 26fda88bf4fa44e1b771cce025dbd64b.: keystone.exception.GroupNotFound: Could not find group: 26fda88bf4fa44e1b771cce025dbd64b. May 02 10:41:32.237339 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:41:32.237339 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:41:32.237339 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:41:32.237339 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:41:32.237339 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:41:32.237339 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:41:32.237339 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:41:32.237339 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:41:32.237339 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:41:32.237339 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:41:32.237339 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:41:32.237339 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete May 02 10:41:32.237339 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') May 02 10:41:32.238915 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:41:32.238915 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:41:32.238915 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:41:32.238915 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:41:32.238915 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:41:32.238915 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:41:32.238915 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 10:41:32.238915 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:41:32.238915 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 10:41:32.238915 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:41:32.238915 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:41:32.238915 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:41:32.238915 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:41:32.238915 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:41:32.238915 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:41:32.238915 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:41:32.238915 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:41:32.239812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:41:32.239812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:41:32.239812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:41:32.239812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:41:32.239812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:41:32.239812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:41:32.239812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:41:32.239812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group May 02 10:41:32.239812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) May 02 10:41:32.239812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group May 02 10:41:32.239812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() May 02 10:41:32.239812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group May 02 10:41:32.239812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) May 02 10:41:32.239812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 26fda88bf4fa44e1b771cce025dbd64b. May 02 10:41:32.239812 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:41:32.239812 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3012/6011] 10.222.0.16 () {58 vars in 1226 bytes} [Mon May 2 10:41:32 2022] DELETE /identity/v3/groups/26fda88bf4fa44e1b771cce025dbd64b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:41:32.241081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c586de-a791-42a1-ba4e-2e4eb0d934ac tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:32.251183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c586de-a791-42a1-ba4e-2e4eb0d934ac tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:32.256082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd6a60-c21c-49cd-99d2-8c7b73135605 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:32.260802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd6a60-c21c-49cd-99d2-8c7b73135605 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:32.260802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd6a60-c21c-49cd-99d2-8c7b73135605 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:32.260802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd6a60-c21c-49cd-99d2-8c7b73135605 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/users/a5f2be3f49ff4db7856b6fb4b6309b7e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:32.265739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd6a60-c21c-49cd-99d2-8c7b73135605 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a5f2be3f49ff4db7856b6fb4b6309b7e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:32.267590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd6a60-c21c-49cd-99d2-8c7b73135605 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:32.283901 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-86fd6a60-c21c-49cd-99d2-8c7b73135605 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Could not find user: a5f2be3f49ff4db7856b6fb4b6309b7e.: keystone.exception.UserNotFound: Could not find user: a5f2be3f49ff4db7856b6fb4b6309b7e. May 02 10:41:32.283901 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:41:32.283901 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:41:32.283901 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:41:32.283901 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:41:32.283901 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:41:32.283901 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:41:32.283901 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:41:32.283901 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:41:32.283901 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:41:32.283901 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:41:32.283901 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:41:32.283901 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 02 10:41:32.283901 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) May 02 10:41:32.292289 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:41:32.292289 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:41:32.292289 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 10:41:32.292289 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:41:32.292289 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 10:41:32.292289 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:41:32.292289 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 02 10:41:32.292289 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 02 10:41:32.292289 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:41:32.292289 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:41:32.292289 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 10:41:32.292289 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:41:32.292289 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 02 10:41:32.292289 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:41:32.292289 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:41:32.292289 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:41:32.292289 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:41:32.292289 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:41:32.293511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:41:32.293511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:41:32.293511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:41:32.293511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:41:32.293511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:41:32.293511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:41:32.293511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:41:32.293511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:41:32.293511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:41:32.293511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:41:32.293511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 02 10:41:32.293511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 02 10:41:32.293511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 02 10:41:32.293511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 02 10:41:32.293511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 02 10:41:32.293511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 02 10:41:32.293511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: a5f2be3f49ff4db7856b6fb4b6309b7e. May 02 10:41:32.293511 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:41:32.294671 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3000/6012] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:41:32 2022] DELETE /identity/v3/users/a5f2be3f49ff4db7856b6fb4b6309b7e => generated 110 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:41:32.294742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de16f2-5093-45f5-8c7a-49845a4985c6 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:32.299596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de16f2-5093-45f5-8c7a-49845a4985c6 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:32.304844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf23302-d10a-4c7a-a00c-40be88da56dc tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:32.305694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf23302-d10a-4c7a-a00c-40be88da56dc tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:32.305982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf23302-d10a-4c7a-a00c-40be88da56dc tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:32.313719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf23302-d10a-4c7a-a00c-40be88da56dc tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains/3ab7329449044b0fac7dbee5aba043ce` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:32.313896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf23302-d10a-4c7a-a00c-40be88da56dc tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:41:32.324840 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-5cf23302-d10a-4c7a-a00c-40be88da56dc tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Could not find domain: 3ab7329449044b0fac7dbee5aba043ce.: keystone.exception.DomainNotFound: Could not find domain: 3ab7329449044b0fac7dbee5aba043ce. May 02 10:41:32.324840 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:41:32.324840 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 02 10:41:32.324840 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 02 10:41:32.324840 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:41:32.324840 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:41:32.324840 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:41:32.324840 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:41:32.324840 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3ab7329449044b0fac7dbee5aba043ce. May 02 10:41:32.324840 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:41:32.324840 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:41:32.324840 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:41:32.324840 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:41:32.324840 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:41:32.324840 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:41:32.324840 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:41:32.325988 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:41:32.325988 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:41:32.325988 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:41:32.325988 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:41:32.325988 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:41:32.325988 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:41:32.325988 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:41:32.325988 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 02 10:41:32.325988 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 02 10:41:32.325988 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:41:32.325988 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:41:32.325988 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:41:32.325988 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:41:32.325988 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:41:32.325988 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:41:32.325988 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:41:32.326863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:41:32.326863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:41:32.326863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:41:32.326863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:41:32.326863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:41:32.326863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:41:32.326863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:41:32.326863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:41:32.326863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:41:32.326863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:41:32.326863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:41:32.326863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:41:32.326863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:41:32.326863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 02 10:41:32.326863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:41:32.326863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3ab7329449044b0fac7dbee5aba043ce. May 02 10:41:32.326863 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:41:32.327754 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3013/6013] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:41:32 2022] PATCH /identity/v3/domains/3ab7329449044b0fac7dbee5aba043ce => generated 112 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:41:32.331745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd6a60-c21c-49cd-99d2-8c7b73135605 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:32.342655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd6a60-c21c-49cd-99d2-8c7b73135605 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:32.348129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4000ab-eb34-4637-b01b-b9faa925445c tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:32.348942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4000ab-eb34-4637-b01b-b9faa925445c tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:32.349230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4000ab-eb34-4637-b01b-b9faa925445c tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:32.349536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4000ab-eb34-4637-b01b-b9faa925445c tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:32.350230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4000ab-eb34-4637-b01b-b9faa925445c tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:32.351801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4000ab-eb34-4637-b01b-b9faa925445c tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:32.366066 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3001/6014] 10.222.0.16 () {58 vars in 1127 bytes} [Mon May 2 10:41:32 2022] GET /identity/v3/domains => generated 1345 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:41:32.370689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf23302-d10a-4c7a-a00c-40be88da56dc tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:32.382270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf23302-d10a-4c7a-a00c-40be88da56dc tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:32.389858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd256a-edcb-48fb-a21d-45703a845e0d tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:32.390567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd256a-edcb-48fb-a21d-45703a845e0d tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:32.390801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd256a-edcb-48fb-a21d-45703a845e0d tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:32.391135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd256a-edcb-48fb-a21d-45703a845e0d tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:32.391907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd256a-edcb-48fb-a21d-45703a845e0d tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:41:32.392705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd256a-edcb-48fb-a21d-45703a845e0d tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:32.394380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd256a-edcb-48fb-a21d-45703a845e0d tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:32.426183 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3014/6015] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:41:32 2022] GET /identity/v3/domains?enabled=True => generated 1092 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:41:32.427889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4000ab-eb34-4637-b01b-b9faa925445c tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:32.457697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4000ab-eb34-4637-b01b-b9faa925445c tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:32.477281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de759c82-2c57-48fd-af39-bd7775ca26cd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:32.478110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de759c82-2c57-48fd-af39-bd7775ca26cd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:32.478499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de759c82-2c57-48fd-af39-bd7775ca26cd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:32.478887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de759c82-2c57-48fd-af39-bd7775ca26cd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:32.479742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de759c82-2c57-48fd-af39-bd7775ca26cd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-1621280111) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:41:32.480162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de759c82-2c57-48fd-af39-bd7775ca26cd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:32.482108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de759c82-2c57-48fd-af39-bd7775ca26cd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:32.495390 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3002/6016] 10.222.0.16 () {58 vars in 1198 bytes} [Mon May 2 10:41:32 2022] GET /identity/v3/domains?name=tempest-test_domain-1621280111 => generated 407 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:41:32.500107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd256a-edcb-48fb-a21d-45703a845e0d tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:32.512092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd256a-edcb-48fb-a21d-45703a845e0d tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:32.521220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ef817-6aa2-48fe-a65c-e04522caae50 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:32.522294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ef817-6aa2-48fe-a65c-e04522caae50 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:32.522771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ef817-6aa2-48fe-a65c-e04522caae50 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:32.523090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ef817-6aa2-48fe-a65c-e04522caae50 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains/3ab7329449044b0fac7dbee5aba043ce` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:32.531612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ef817-6aa2-48fe-a65c-e04522caae50 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:41:32.542374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-b41ef817-6aa2-48fe-a65c-e04522caae50 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Could not find domain: 3ab7329449044b0fac7dbee5aba043ce.: keystone.exception.DomainNotFound: Could not find domain: 3ab7329449044b0fac7dbee5aba043ce. May 02 10:41:32.542374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:41:32.542374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 02 10:41:32.542374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 02 10:41:32.542374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:41:32.542374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:41:32.542374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:41:32.542374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:41:32.542374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3ab7329449044b0fac7dbee5aba043ce. May 02 10:41:32.542374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:41:32.542374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:41:32.542374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:41:32.542374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:41:32.542374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:41:32.542374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:41:32.542374 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:41:32.546312 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:41:32.546312 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:41:32.546312 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:41:32.546312 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:41:32.546312 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:41:32.546312 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:41:32.546312 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:41:32.546312 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 02 10:41:32.546312 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 02 10:41:32.546312 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:41:32.546312 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:41:32.546312 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:41:32.546312 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:41:32.546312 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:41:32.546312 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:41:32.546312 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:41:32.547385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:41:32.547385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:41:32.547385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:41:32.547385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:41:32.547385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:41:32.547385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:41:32.547385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:41:32.547385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:41:32.547385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:41:32.547385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:41:32.547385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:41:32.547385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:41:32.547385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:41:32.547385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 02 10:41:32.547385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:41:32.547385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3ab7329449044b0fac7dbee5aba043ce. May 02 10:41:32.547385 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:41:32.548850 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3015/6017] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:41:32 2022] PATCH /identity/v3/domains/3ab7329449044b0fac7dbee5aba043ce => generated 112 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:41:32.549476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de759c82-2c57-48fd-af39-bd7775ca26cd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:32.563114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de759c82-2c57-48fd-af39-bd7775ca26cd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:32.570954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624ae21-d2ac-4d58-9641-b168edcb68b4 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:32.574767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624ae21-d2ac-4d58-9641-b168edcb68b4 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:32.574767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624ae21-d2ac-4d58-9641-b168edcb68b4 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:32.574767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624ae21-d2ac-4d58-9641-b168edcb68b4 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains/eb8bd337f33e4066a71593bc0e1ca438` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:32.592205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624ae21-d2ac-4d58-9641-b168edcb68b4 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=eb8bd337f33e4066a71593bc0e1ca438)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:32.594207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624ae21-d2ac-4d58-9641-b168edcb68b4 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:32.639249 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3003/6018] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:41:32 2022] PATCH /identity/v3/domains/eb8bd337f33e4066a71593bc0e1ca438 => generated 277 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:41:32.643369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ef817-6aa2-48fe-a65c-e04522caae50 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:32.658999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ef817-6aa2-48fe-a65c-e04522caae50 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:32.672052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:32.673190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:32.673533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:32.677787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains/eb8bd337f33e4066a71593bc0e1ca438` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:32.688048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=eb8bd337f33e4066a71593bc0e1ca438)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:32.689697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:32.713702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'eb8bd337f33e4066a71593bc0e1ca438'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:32.717061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'eb8bd337f33e4066a71593bc0e1ca438'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:32.819279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb8bd337f33e4066a71593bc0e1ca438', 'request_id': 'req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:32.937231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb8bd337f33e4066a71593bc0e1ca438', 'request_id': 'req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:32.945953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb8bd337f33e4066a71593bc0e1ca438', 'request_id': 'req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:32.958408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] The token cache is being invalidate because project eb8bd337f33e4066a71593bc0e1ca438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:41:32.958706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:32.959706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:32.969831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'eb8bd337f33e4066a71593bc0e1ca438', 'request_id': 'req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:32.971134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'eb8bd337f33e4066a71593bc0e1ca438', 'request_id': 'req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:32.974944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'eb8bd337f33e4066a71593bc0e1ca438', 'request_id': 'req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:32.985321 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3016/6019] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:41:32 2022] DELETE /identity/v3/domains/eb8bd337f33e4066a71593bc0e1ca438 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:41:32.986525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624ae21-d2ac-4d58-9641-b168edcb68b4 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:32.988670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6624ae21-d2ac-4d58-9641-b168edcb68b4 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:33.002365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624ae21-d2ac-4d58-9641-b168edcb68b4 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:33.075139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b4a52-675b-4ddc-b613-ccff0cc78df3 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:33.076136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b4a52-675b-4ddc-b613-ccff0cc78df3 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:33.076777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b4a52-675b-4ddc-b613-ccff0cc78df3 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:33.077354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b4a52-675b-4ddc-b613-ccff0cc78df3 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains/e77c77a7a6ef4d66bbbb1f007ab0ba8b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:33.105287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b4a52-675b-4ddc-b613-ccff0cc78df3 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e77c77a7a6ef4d66bbbb1f007ab0ba8b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:33.107460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b4a52-675b-4ddc-b613-ccff0cc78df3 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:33.153975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e65b4a52-675b-4ddc-b613-ccff0cc78df3 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e77c77a7a6ef4d66bbbb1f007ab0ba8b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:33.155980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e65b4a52-675b-4ddc-b613-ccff0cc78df3 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e77c77a7a6ef4d66bbbb1f007ab0ba8b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:33.282196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e65b4a52-675b-4ddc-b613-ccff0cc78df3 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e77c77a7a6ef4d66bbbb1f007ab0ba8b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:33.283099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e65b4a52-675b-4ddc-b613-ccff0cc78df3 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e77c77a7a6ef4d66bbbb1f007ab0ba8b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:33.285861 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3004/6020] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:41:32 2022] PATCH /identity/v3/domains/e77c77a7a6ef4d66bbbb1f007ab0ba8b => generated 276 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:41:33.291274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:33.308347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbb5e8-f544-41a2-a5d8-0f59396f6fe7 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:33.381328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a79bc-a974-4991-9ffc-08791675ea66 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:33.382908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a79bc-a974-4991-9ffc-08791675ea66 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:33.383325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a79bc-a974-4991-9ffc-08791675ea66 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:33.383717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a79bc-a974-4991-9ffc-08791675ea66 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains/e77c77a7a6ef4d66bbbb1f007ab0ba8b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:33.399646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a79bc-a974-4991-9ffc-08791675ea66 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e77c77a7a6ef4d66bbbb1f007ab0ba8b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:33.401450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a79bc-a974-4991-9ffc-08791675ea66 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:33.425794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e48a79bc-a974-4991-9ffc-08791675ea66 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e77c77a7a6ef4d66bbbb1f007ab0ba8b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:33.428802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e48a79bc-a974-4991-9ffc-08791675ea66 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e77c77a7a6ef4d66bbbb1f007ab0ba8b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:33.579924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e48a79bc-a974-4991-9ffc-08791675ea66 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e77c77a7a6ef4d66bbbb1f007ab0ba8b', 'request_id': 'req-e48a79bc-a974-4991-9ffc-08791675ea66'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:33.677100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e48a79bc-a974-4991-9ffc-08791675ea66 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e77c77a7a6ef4d66bbbb1f007ab0ba8b', 'request_id': 'req-e48a79bc-a974-4991-9ffc-08791675ea66'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:33.685244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e48a79bc-a974-4991-9ffc-08791675ea66 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e77c77a7a6ef4d66bbbb1f007ab0ba8b', 'request_id': 'req-e48a79bc-a974-4991-9ffc-08791675ea66'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:33.697318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e48a79bc-a974-4991-9ffc-08791675ea66 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] The token cache is being invalidate because project e77c77a7a6ef4d66bbbb1f007ab0ba8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:41:33.697607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e48a79bc-a974-4991-9ffc-08791675ea66 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:33.705517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e48a79bc-a974-4991-9ffc-08791675ea66 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:33.727077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e48a79bc-a974-4991-9ffc-08791675ea66 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e77c77a7a6ef4d66bbbb1f007ab0ba8b', 'request_id': 'req-e48a79bc-a974-4991-9ffc-08791675ea66'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:33.731492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e48a79bc-a974-4991-9ffc-08791675ea66 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e77c77a7a6ef4d66bbbb1f007ab0ba8b', 'request_id': 'req-e48a79bc-a974-4991-9ffc-08791675ea66'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:33.735294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e48a79bc-a974-4991-9ffc-08791675ea66 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e77c77a7a6ef4d66bbbb1f007ab0ba8b', 'request_id': 'req-e48a79bc-a974-4991-9ffc-08791675ea66'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:33.748952 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3017/6021] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:41:33 2022] DELETE /identity/v3/domains/e77c77a7a6ef4d66bbbb1f007ab0ba8b => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:33.753279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b4a52-675b-4ddc-b613-ccff0cc78df3 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:33.770287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e65b4a52-675b-4ddc-b613-ccff0cc78df3 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:33.793448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b4a52-675b-4ddc-b613-ccff0cc78df3 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:33.910348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dafb22-5adb-4289-bfe4-6b8bb2e5b4dd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:33.911269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dafb22-5adb-4289-bfe4-6b8bb2e5b4dd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:33.911558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dafb22-5adb-4289-bfe4-6b8bb2e5b4dd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:33.911838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dafb22-5adb-4289-bfe4-6b8bb2e5b4dd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains/85b9bc99621d4e5c9742e8a9ca711fea` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:33.930302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dafb22-5adb-4289-bfe4-6b8bb2e5b4dd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=85b9bc99621d4e5c9742e8a9ca711fea)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:33.931996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dafb22-5adb-4289-bfe4-6b8bb2e5b4dd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:33.958344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-42dafb22-5adb-4289-bfe4-6b8bb2e5b4dd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '85b9bc99621d4e5c9742e8a9ca711fea'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:33.959084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-42dafb22-5adb-4289-bfe4-6b8bb2e5b4dd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '85b9bc99621d4e5c9742e8a9ca711fea'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:34.057479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-42dafb22-5adb-4289-bfe4-6b8bb2e5b4dd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '85b9bc99621d4e5c9742e8a9ca711fea'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:34.058173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-42dafb22-5adb-4289-bfe4-6b8bb2e5b4dd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '85b9bc99621d4e5c9742e8a9ca711fea'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:34.060783 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3005/6022] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:41:33 2022] PATCH /identity/v3/domains/85b9bc99621d4e5c9742e8a9ca711fea => generated 276 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:41:34.064847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a79bc-a974-4991-9ffc-08791675ea66 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:34.066398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e48a79bc-a974-4991-9ffc-08791675ea66 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:34.079427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a79bc-a974-4991-9ffc-08791675ea66 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:34.145115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73ef92-915f-4ee8-9e67-b1143bba7a32 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff50b4cda457441e997cd1168727dd99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '971c6c1edcf149fd87d050c8dd8f8f23', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:34.146345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73ef92-915f-4ee8-9e67-b1143bba7a32 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:34.146639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73ef92-915f-4ee8-9e67-b1143bba7a32 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:34.146916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73ef92-915f-4ee8-9e67-b1143bba7a32 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] PATH_INFO: `/v3/domains/85b9bc99621d4e5c9742e8a9ca711fea` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:34.158704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73ef92-915f-4ee8-9e67-b1143bba7a32 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=85b9bc99621d4e5c9742e8a9ca711fea)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:34.161080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73ef92-915f-4ee8-9e67-b1143bba7a32 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:34.191373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5d73ef92-915f-4ee8-9e67-b1143bba7a32 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '85b9bc99621d4e5c9742e8a9ca711fea'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:34.195205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5d73ef92-915f-4ee8-9e67-b1143bba7a32 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '85b9bc99621d4e5c9742e8a9ca711fea'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:34.312686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5d73ef92-915f-4ee8-9e67-b1143bba7a32 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b9bc99621d4e5c9742e8a9ca711fea', 'request_id': 'req-5d73ef92-915f-4ee8-9e67-b1143bba7a32'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:34.412967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5d73ef92-915f-4ee8-9e67-b1143bba7a32 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b9bc99621d4e5c9742e8a9ca711fea', 'request_id': 'req-5d73ef92-915f-4ee8-9e67-b1143bba7a32'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:34.420385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5d73ef92-915f-4ee8-9e67-b1143bba7a32 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b9bc99621d4e5c9742e8a9ca711fea', 'request_id': 'req-5d73ef92-915f-4ee8-9e67-b1143bba7a32'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:34.432027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5d73ef92-915f-4ee8-9e67-b1143bba7a32 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] The token cache is being invalidate because project 85b9bc99621d4e5c9742e8a9ca711fea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:41:34.432459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5d73ef92-915f-4ee8-9e67-b1143bba7a32 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:34.433344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5d73ef92-915f-4ee8-9e67-b1143bba7a32 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:34.443022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5d73ef92-915f-4ee8-9e67-b1143bba7a32 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '85b9bc99621d4e5c9742e8a9ca711fea', 'request_id': 'req-5d73ef92-915f-4ee8-9e67-b1143bba7a32'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:34.443751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5d73ef92-915f-4ee8-9e67-b1143bba7a32 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '85b9bc99621d4e5c9742e8a9ca711fea', 'request_id': 'req-5d73ef92-915f-4ee8-9e67-b1143bba7a32'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:34.447237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5d73ef92-915f-4ee8-9e67-b1143bba7a32 tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '85b9bc99621d4e5c9742e8a9ca711fea', 'request_id': 'req-5d73ef92-915f-4ee8-9e67-b1143bba7a32'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:34.454503 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3018/6023] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:41:34 2022] DELETE /identity/v3/domains/85b9bc99621d4e5c9742e8a9ca711fea => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:34.458981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dafb22-5adb-4289-bfe4-6b8bb2e5b4dd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:34.461331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-42dafb22-5adb-4289-bfe4-6b8bb2e5b4dd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:34.559328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dafb22-5adb-4289-bfe4-6b8bb2e5b4dd tempest-DomainsTestJSON-1413695164 tempest-DomainsTestJSON-1413695164-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:34.633103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6463cc-566f-46c8-895c-c38cac287941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:34.633993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6463cc-566f-46c8-895c-c38cac287941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:34.634278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6463cc-566f-46c8-895c-c38cac287941 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:34.634563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6463cc-566f-46c8-895c-c38cac287941 admin admin] PATH_INFO: `/v3/users/2fb34e74dbf5469aa273443d5e3c6be1` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:34.635807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6463cc-566f-46c8-895c-c38cac287941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fb34e74dbf5469aa273443d5e3c6be1)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:34.637846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6463cc-566f-46c8-895c-c38cac287941 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:34.855525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ba6463cc-566f-46c8-895c-c38cac287941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fb34e74dbf5469aa273443d5e3c6be1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:34.876133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ba6463cc-566f-46c8-895c-c38cac287941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fb34e74dbf5469aa273443d5e3c6be1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:34.877080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ba6463cc-566f-46c8-895c-c38cac287941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fb34e74dbf5469aa273443d5e3c6be1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:34.885596 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ba6463cc-566f-46c8-895c-c38cac287941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fb34e74dbf5469aa273443d5e3c6be1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:34.961391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ba6463cc-566f-46c8-895c-c38cac287941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fb34e74dbf5469aa273443d5e3c6be1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:34.975201 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3006/6024] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:41:34 2022] DELETE /identity/v3/users/2fb34e74dbf5469aa273443d5e3c6be1 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:34.976747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3647b8-5bac-4a70-bb0e-bb64cd7bdbf4 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:34.977886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3647b8-5bac-4a70-bb0e-bb64cd7bdbf4 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:34.978169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3647b8-5bac-4a70-bb0e-bb64cd7bdbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:35.002956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ef3647b8-5bac-4a70-bb0e-bb64cd7bdbf4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:35.005266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ef3647b8-5bac-4a70-bb0e-bb64cd7bdbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:35.110877 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3019/6025] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:35.121921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6463cc-566f-46c8-895c-c38cac287941 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:35.123739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ba6463cc-566f-46c8-895c-c38cac287941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:35.209027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6463cc-566f-46c8-895c-c38cac287941 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:35.214963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85898563-084b-4062-a37f-5581b24cc1b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:35.216817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85898563-084b-4062-a37f-5581b24cc1b7 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:35.217416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85898563-084b-4062-a37f-5581b24cc1b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:35.217704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85898563-084b-4062-a37f-5581b24cc1b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:35.230564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85898563-084b-4062-a37f-5581b24cc1b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:35.233315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85898563-084b-4062-a37f-5581b24cc1b7 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:35.258088 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3007/6026] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:41:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:41:36.046539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3647b8-5bac-4a70-bb0e-bb64cd7bdbf4 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:36.048046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ef3647b8-5bac-4a70-bb0e-bb64cd7bdbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:36.061435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3647b8-5bac-4a70-bb0e-bb64cd7bdbf4 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:36.067179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10b087-dc99-405f-8e4b-e462ceef0214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:36.068128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10b087-dc99-405f-8e4b-e462ceef0214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:36.068823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10b087-dc99-405f-8e4b-e462ceef0214 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:36.069117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10b087-dc99-405f-8e4b-e462ceef0214 admin admin] PATH_INFO: `/v3/projects/d1304e77e0a04ff0a428010ffba90442` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:36.070473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10b087-dc99-405f-8e4b-e462ceef0214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1304e77e0a04ff0a428010ffba90442)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:36.072630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10b087-dc99-405f-8e4b-e462ceef0214 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:36.217602 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ec10b087-dc99-405f-8e4b-e462ceef0214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1304e77e0a04ff0a428010ffba90442', 'request_id': 'req-ec10b087-dc99-405f-8e4b-e462ceef0214'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:36.295967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ec10b087-dc99-405f-8e4b-e462ceef0214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1304e77e0a04ff0a428010ffba90442', 'request_id': 'req-ec10b087-dc99-405f-8e4b-e462ceef0214'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:36.303215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ec10b087-dc99-405f-8e4b-e462ceef0214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1304e77e0a04ff0a428010ffba90442', 'request_id': 'req-ec10b087-dc99-405f-8e4b-e462ceef0214'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:36.315163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ec10b087-dc99-405f-8e4b-e462ceef0214 admin admin] The token cache is being invalidate because project d1304e77e0a04ff0a428010ffba90442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:41:36.316195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ec10b087-dc99-405f-8e4b-e462ceef0214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:36.317724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ec10b087-dc99-405f-8e4b-e462ceef0214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:36.319229 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3020/6027] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:41:36 2022] DELETE /identity/v3/projects/d1304e77e0a04ff0a428010ffba90442 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:36.323536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85898563-084b-4062-a37f-5581b24cc1b7 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:36.334907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85898563-084b-4062-a37f-5581b24cc1b7 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:36.421913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0e09d-488a-40ac-8695-df565c98f284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:36.423151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0e09d-488a-40ac-8695-df565c98f284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:36.423588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0e09d-488a-40ac-8695-df565c98f284 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:36.424076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0e09d-488a-40ac-8695-df565c98f284 admin admin] PATH_INFO: `/v3/users/ff50b4cda457441e997cd1168727dd99` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:36.427343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0e09d-488a-40ac-8695-df565c98f284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff50b4cda457441e997cd1168727dd99)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:36.430304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0e09d-488a-40ac-8695-df565c98f284 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:36.673116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-76f0e09d-488a-40ac-8695-df565c98f284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff50b4cda457441e997cd1168727dd99'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:36.688838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-76f0e09d-488a-40ac-8695-df565c98f284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff50b4cda457441e997cd1168727dd99'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:36.689787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-76f0e09d-488a-40ac-8695-df565c98f284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff50b4cda457441e997cd1168727dd99'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:36.696494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-76f0e09d-488a-40ac-8695-df565c98f284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff50b4cda457441e997cd1168727dd99'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:36.790128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-76f0e09d-488a-40ac-8695-df565c98f284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff50b4cda457441e997cd1168727dd99'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:36.797215 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3008/6028] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:41:36 2022] DELETE /identity/v3/users/ff50b4cda457441e997cd1168727dd99 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:37.915396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93475a7-58d2-4901-a8f5-000cad6c1261 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:37.915869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93475a7-58d2-4901-a8f5-000cad6c1261 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:37.915988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93475a7-58d2-4901-a8f5-000cad6c1261 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:37.917492 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3021/6029] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:41:37.923065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248d08e-aceb-4eae-9e97-ac42dbd36430 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:37.923510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248d08e-aceb-4eae-9e97-ac42dbd36430 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:37.923636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248d08e-aceb-4eae-9e97-ac42dbd36430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:37.973839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93475a7-58d2-4901-a8f5-000cad6c1261 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:37.975801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a93475a7-58d2-4901-a8f5-000cad6c1261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:38.041147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3248d08e-aceb-4eae-9e97-ac42dbd36430 None None] MFA Rules not processed for user `4cd9fe10f94f43aeb3eb10009ee96ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:38.042950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3248d08e-aceb-4eae-9e97-ac42dbd36430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:38.127752 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3009/6030] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:41:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:38.136516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93475a7-58d2-4901-a8f5-000cad6c1261 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:38.142643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248d08e-aceb-4eae-9e97-ac42dbd36430 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:38.148126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3248d08e-aceb-4eae-9e97-ac42dbd36430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:38.161820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3d293-797e-4312-b7c0-793fe1638fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:38.163048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3d293-797e-4312-b7c0-793fe1638fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:38.165217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3d293-797e-4312-b7c0-793fe1638fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:38.165641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3d293-797e-4312-b7c0-793fe1638fd1 admin admin] PATH_INFO: `/v3/projects/971c6c1edcf149fd87d050c8dd8f8f23` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:38.167922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3d293-797e-4312-b7c0-793fe1638fd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=971c6c1edcf149fd87d050c8dd8f8f23)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:38.169541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248d08e-aceb-4eae-9e97-ac42dbd36430 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:38.173366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3d293-797e-4312-b7c0-793fe1638fd1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:38.175373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174606d9-adb6-4513-9adb-65ba0205787f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:38.176558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174606d9-adb6-4513-9adb-65ba0205787f service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:38.177269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174606d9-adb6-4513-9adb-65ba0205787f service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:38.178212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174606d9-adb6-4513-9adb-65ba0205787f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:38.189463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174606d9-adb6-4513-9adb-65ba0205787f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:38.192049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174606d9-adb6-4513-9adb-65ba0205787f service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:38.204697 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3010/6031] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:41:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:41:38.404777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6fb3d293-797e-4312-b7c0-793fe1638fd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '971c6c1edcf149fd87d050c8dd8f8f23', 'request_id': 'req-6fb3d293-797e-4312-b7c0-793fe1638fd1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:38.482161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6fb3d293-797e-4312-b7c0-793fe1638fd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '971c6c1edcf149fd87d050c8dd8f8f23', 'request_id': 'req-6fb3d293-797e-4312-b7c0-793fe1638fd1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:38.491512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6fb3d293-797e-4312-b7c0-793fe1638fd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '971c6c1edcf149fd87d050c8dd8f8f23', 'request_id': 'req-6fb3d293-797e-4312-b7c0-793fe1638fd1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:38.508029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6fb3d293-797e-4312-b7c0-793fe1638fd1 admin admin] The token cache is being invalidate because project 971c6c1edcf149fd87d050c8dd8f8f23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:41:38.508324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6fb3d293-797e-4312-b7c0-793fe1638fd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:38.510157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6fb3d293-797e-4312-b7c0-793fe1638fd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:38.513452 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3022/6032] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:41:37 2022] DELETE /identity/v3/projects/971c6c1edcf149fd87d050c8dd8f8f23 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:38.518486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e15a0-6f14-4adc-b70a-7c6c93da3878 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:38.519205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e15a0-6f14-4adc-b70a-7c6c93da3878 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:38.519665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e15a0-6f14-4adc-b70a-7c6c93da3878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:38.574092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-371e15a0-6f14-4adc-b70a-7c6c93da3878 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:38.575359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-371e15a0-6f14-4adc-b70a-7c6c93da3878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:38.745595 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3011/6033] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:38.764008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ba840-41ad-4a86-9601-ef47ed6d5f55 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:38.764008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ba840-41ad-4a86-9601-ef47ed6d5f55 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:38.764008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ba840-41ad-4a86-9601-ef47ed6d5f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:38.787700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-917ba840-41ad-4a86-9601-ef47ed6d5f55 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:38.790591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-917ba840-41ad-4a86-9601-ef47ed6d5f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:38.808435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e15a0-6f14-4adc-b70a-7c6c93da3878 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:38.810357 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3023/6034] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:38.824656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e15a0-6f14-4adc-b70a-7c6c93da3878 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:38.832259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af11e7-ad15-493d-b596-e98d4fa6323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:38.834154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af11e7-ad15-493d-b596-e98d4fa6323d admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:38.834569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af11e7-ad15-493d-b596-e98d4fa6323d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:38.834997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af11e7-ad15-493d-b596-e98d4fa6323d admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:38.836298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af11e7-ad15-493d-b596-e98d4fa6323d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:41:38.837306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af11e7-ad15-493d-b596-e98d4fa6323d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:38.855965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af11e7-ad15-493d-b596-e98d4fa6323d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:38.880344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ba840-41ad-4a86-9601-ef47ed6d5f55 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:38.887535 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3012/6035] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:41:38.894817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ba840-41ad-4a86-9601-ef47ed6d5f55 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:38.904163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a115a-8247-4262-9730-b33c2d29b58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:38.905568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a115a-8247-4262-9730-b33c2d29b58d admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:38.906039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a115a-8247-4262-9730-b33c2d29b58d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:38.906472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a115a-8247-4262-9730-b33c2d29b58d admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:38.907518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a115a-8247-4262-9730-b33c2d29b58d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:38.910254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a115a-8247-4262-9730-b33c2d29b58d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:39.012784 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3024/6036] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:41:38 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:41:39.017748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af11e7-ad15-493d-b596-e98d4fa6323d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:39.030707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af11e7-ad15-493d-b596-e98d4fa6323d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:39.176381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206c317-2f39-408f-aa5e-bb3865be7146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:39.177526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206c317-2f39-408f-aa5e-bb3865be7146 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:39.178024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206c317-2f39-408f-aa5e-bb3865be7146 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:39.178515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206c317-2f39-408f-aa5e-bb3865be7146 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:39.179580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206c317-2f39-408f-aa5e-bb3865be7146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:39.182020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206c317-2f39-408f-aa5e-bb3865be7146 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:39.298701 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3013/6037] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:41:39 2022] POST /identity/v3/users => generated 287 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:39.302952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a115a-8247-4262-9730-b33c2d29b58d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:39.328147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a115a-8247-4262-9730-b33c2d29b58d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:39.336084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6921f77-4439-44b4-9705-6bea10383f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:39.336480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6921f77-4439-44b4-9705-6bea10383f2a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:39.337046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6921f77-4439-44b4-9705-6bea10383f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:39.337501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6921f77-4439-44b4-9705-6bea10383f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:39.338461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6921f77-4439-44b4-9705-6bea10383f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:39.341531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6921f77-4439-44b4-9705-6bea10383f2a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:39.359212 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3025/6038] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:41:39.364522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206c317-2f39-408f-aa5e-bb3865be7146 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:39.390290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206c317-2f39-408f-aa5e-bb3865be7146 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:39.402446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397c2f2-db9f-4115-88ae-859520625d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:39.403515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397c2f2-db9f-4115-88ae-859520625d9b admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:39.407247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397c2f2-db9f-4115-88ae-859520625d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:39.407247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397c2f2-db9f-4115-88ae-859520625d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:39.407247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397c2f2-db9f-4115-88ae-859520625d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:39.407626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397c2f2-db9f-4115-88ae-859520625d9b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:39.421057 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3014/6039] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:41:39.426571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6921f77-4439-44b4-9705-6bea10383f2a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:39.445672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6921f77-4439-44b4-9705-6bea10383f2a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:39.451229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9443c-3188-4684-bed6-27dc2de5b2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:39.452179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9443c-3188-4684-bed6-27dc2de5b2e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:39.452619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9443c-3188-4684-bed6-27dc2de5b2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:39.452958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9443c-3188-4684-bed6-27dc2de5b2e1 admin admin] PATH_INFO: `/v3/projects/ee3d6d4d167a4efab1248c2b282dac0e/users/82cc9bad99b646bda797e087fdf15d6f/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:39.477193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9443c-3188-4684-bed6-27dc2de5b2e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3d6d4d167a4efab1248c2b282dac0e, user_id=82cc9bad99b646bda797e087fdf15d6f, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:39.481321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9443c-3188-4684-bed6-27dc2de5b2e1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:39.580194 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3026/6040] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:41:39 2022] PUT /identity/v3/projects/ee3d6d4d167a4efab1248c2b282dac0e/users/82cc9bad99b646bda797e087fdf15d6f/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:41:39.591038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ca967-3bdb-4a63-8c7e-6a66bb49f7b1 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:39.591351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ca967-3bdb-4a63-8c7e-6a66bb49f7b1 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:39.591632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ca967-3bdb-4a63-8c7e-6a66bb49f7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:39.619408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f39ca967-3bdb-4a63-8c7e-6a66bb49f7b1 None None] MFA Rules not processed for user `82cc9bad99b646bda797e087fdf15d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:39.620455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f39ca967-3bdb-4a63-8c7e-6a66bb49f7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:39.685549 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3015/6041] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:39.689798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9443c-3188-4684-bed6-27dc2de5b2e1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:39.780121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9443c-3188-4684-bed6-27dc2de5b2e1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:39.787704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f5922-ac4e-4ad6-be67-ce4cd539eab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:39.788488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f5922-ac4e-4ad6-be67-ce4cd539eab8 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:39.788862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f5922-ac4e-4ad6-be67-ce4cd539eab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:39.789107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f5922-ac4e-4ad6-be67-ce4cd539eab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:39.789999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f5922-ac4e-4ad6-be67-ce4cd539eab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:39.791933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f5922-ac4e-4ad6-be67-ce4cd539eab8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:39.919978 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3027/6042] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:41:39 2022] POST /identity/v3/projects => generated 371 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:41:39.930075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ca967-3bdb-4a63-8c7e-6a66bb49f7b1 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:39.974593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ca967-3bdb-4a63-8c7e-6a66bb49f7b1 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:40.090934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf288b-17f4-4706-8e78-d0e316fd8b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:40.091744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf288b-17f4-4706-8e78-d0e316fd8b25 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:40.092066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf288b-17f4-4706-8e78-d0e316fd8b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:40.092427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf288b-17f4-4706-8e78-d0e316fd8b25 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:40.098614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf288b-17f4-4706-8e78-d0e316fd8b25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:40.098614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf288b-17f4-4706-8e78-d0e316fd8b25 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:40.211870 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3016/6043] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:41:39 2022] POST /identity/v3/users => generated 292 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:40.217986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f5922-ac4e-4ad6-be67-ce4cd539eab8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:40.234609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f5922-ac4e-4ad6-be67-ce4cd539eab8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:40.241019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b5c7c-9d12-492d-9caa-7aa3ccc4e506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:40.242150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b5c7c-9d12-492d-9caa-7aa3ccc4e506 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:40.242680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b5c7c-9d12-492d-9caa-7aa3ccc4e506 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:40.243558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b5c7c-9d12-492d-9caa-7aa3ccc4e506 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:40.245417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b5c7c-9d12-492d-9caa-7aa3ccc4e506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:40.247972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b5c7c-9d12-492d-9caa-7aa3ccc4e506 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:40.271574 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3028/6044] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:41:40.275813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf288b-17f4-4706-8e78-d0e316fd8b25 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:40.290549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf288b-17f4-4706-8e78-d0e316fd8b25 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:40.304037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09eb941-3431-4a55-93c8-1179847bd013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:40.305497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eb941-3431-4a55-93c8-1179847bd013 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:40.306010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eb941-3431-4a55-93c8-1179847bd013 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:40.306500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eb941-3431-4a55-93c8-1179847bd013 admin admin] PATH_INFO: `/v3/projects/1196f913aaa942dbb42d2131a1258f22/users/d2aa06e6346d4c88b2b6364dae5da884/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:40.342198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09eb941-3431-4a55-93c8-1179847bd013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1196f913aaa942dbb42d2131a1258f22, user_id=d2aa06e6346d4c88b2b6364dae5da884, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:40.345204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09eb941-3431-4a55-93c8-1179847bd013 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:40.445722 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3017/6045] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:41:40 2022] PUT /identity/v3/projects/1196f913aaa942dbb42d2131a1258f22/users/d2aa06e6346d4c88b2b6364dae5da884/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:40.453123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b5c7c-9d12-492d-9caa-7aa3ccc4e506 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:40.468418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b5c7c-9d12-492d-9caa-7aa3ccc4e506 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:40.555423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01c757-b739-4b57-ba9a-1dcc6d75af03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:40.556728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01c757-b739-4b57-ba9a-1dcc6d75af03 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:40.558553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01c757-b739-4b57-ba9a-1dcc6d75af03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:40.558553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01c757-b739-4b57-ba9a-1dcc6d75af03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:40.558553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01c757-b739-4b57-ba9a-1dcc6d75af03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:40.560115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01c757-b739-4b57-ba9a-1dcc6d75af03 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:40.581783 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3029/6046] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:41:40.582433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09eb941-3431-4a55-93c8-1179847bd013 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:40.599018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09eb941-3431-4a55-93c8-1179847bd013 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:40.607752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156e70b-6669-437a-b8fa-0c136ba4e010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:40.609109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156e70b-6669-437a-b8fa-0c136ba4e010 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:40.609666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156e70b-6669-437a-b8fa-0c136ba4e010 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:40.611078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156e70b-6669-437a-b8fa-0c136ba4e010 admin admin] PATH_INFO: `/v3/projects/1196f913aaa942dbb42d2131a1258f22/users/d2aa06e6346d4c88b2b6364dae5da884/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:40.614543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156e70b-6669-437a-b8fa-0c136ba4e010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1196f913aaa942dbb42d2131a1258f22, user_id=d2aa06e6346d4c88b2b6364dae5da884, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:40.618578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156e70b-6669-437a-b8fa-0c136ba4e010 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:40.631903 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3018/6047] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:41:40 2022] PUT /identity/v3/projects/1196f913aaa942dbb42d2131a1258f22/users/d2aa06e6346d4c88b2b6364dae5da884/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:40.642669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d374c-6d19-48c0-87f2-91f47076f220 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:40.642669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d374c-6d19-48c0-87f2-91f47076f220 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:40.642951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d374c-6d19-48c0-87f2-91f47076f220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:40.693414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c85d374c-6d19-48c0-87f2-91f47076f220 None None] MFA Rules not processed for user `d2aa06e6346d4c88b2b6364dae5da884`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:40.695334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c85d374c-6d19-48c0-87f2-91f47076f220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:40.820916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156e70b-6669-437a-b8fa-0c136ba4e010 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:40.830097 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3030/6048] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:40 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:40.836258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156e70b-6669-437a-b8fa-0c136ba4e010 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:40.848155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e2a1d-5788-4552-8917-026f45cadbef tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2aa06e6346d4c88b2b6364dae5da884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1196f913aaa942dbb42d2131a1258f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:40.848155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e2a1d-5788-4552-8917-026f45cadbef tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:40.848155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e2a1d-5788-4552-8917-026f45cadbef tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:40.848477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e2a1d-5788-4552-8917-026f45cadbef tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:40.848477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e2a1d-5788-4552-8917-026f45cadbef tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:40.851625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e2a1d-5788-4552-8917-026f45cadbef tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:40.958466 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3019/6049] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:41:40 2022] POST /identity/v3/services => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:40.963451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d374c-6d19-48c0-87f2-91f47076f220 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:40.974858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d374c-6d19-48c0-87f2-91f47076f220 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:40.991350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e21f5-c8ed-47d2-9054-f2d0be319625 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2aa06e6346d4c88b2b6364dae5da884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1196f913aaa942dbb42d2131a1258f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:40.992008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e21f5-c8ed-47d2-9054-f2d0be319625 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:40.992296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e21f5-c8ed-47d2-9054-f2d0be319625 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:40.992830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e21f5-c8ed-47d2-9054-f2d0be319625 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:40.993582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e21f5-c8ed-47d2-9054-f2d0be319625 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:41.013854 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-546e21f5-c8ed-47d2-9054-f2d0be319625 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:41:41.013854 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:41:41.013854 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:41:41.015263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e21f5-c8ed-47d2-9054-f2d0be319625 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:41.145731 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3031/6050] 10.222.0.16 () {60 vars in 1212 bytes} [Mon May 2 10:41:40 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:41.151470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e2a1d-5788-4552-8917-026f45cadbef tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:41.171150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e2a1d-5788-4552-8917-026f45cadbef tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:41.182137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f692d4-1d35-44d7-b56d-6a11c7cc4b8f tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2aa06e6346d4c88b2b6364dae5da884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1196f913aaa942dbb42d2131a1258f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:41.182137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f692d4-1d35-44d7-b56d-6a11c7cc4b8f tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:41.182137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f692d4-1d35-44d7-b56d-6a11c7cc4b8f tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:41.182897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f692d4-1d35-44d7-b56d-6a11c7cc4b8f tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:41.184022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f692d4-1d35-44d7-b56d-6a11c7cc4b8f tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:41.186747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f692d4-1d35-44d7-b56d-6a11c7cc4b8f tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:41.337891 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3020/6051] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:41:41 2022] POST /identity/v3/services => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:41.348807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e21f5-c8ed-47d2-9054-f2d0be319625 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:41.395209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e21f5-c8ed-47d2-9054-f2d0be319625 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:41.427216 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db96c4b-c32a-44b2-904c-0aef2fbd365d tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2aa06e6346d4c88b2b6364dae5da884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1196f913aaa942dbb42d2131a1258f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:41.432829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db96c4b-c32a-44b2-904c-0aef2fbd365d tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:41.432829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db96c4b-c32a-44b2-904c-0aef2fbd365d tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:41.433611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db96c4b-c32a-44b2-904c-0aef2fbd365d tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:41.434674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db96c4b-c32a-44b2-904c-0aef2fbd365d tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:41.436680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db96c4b-c32a-44b2-904c-0aef2fbd365d tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:41.604210 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3032/6052] 10.222.0.16 () {60 vars in 1212 bytes} [Mon May 2 10:41:41 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:41.608285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f692d4-1d35-44d7-b56d-6a11c7cc4b8f tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:41.621553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f692d4-1d35-44d7-b56d-6a11c7cc4b8f tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:41.627812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eeb599-2795-4d69-bb43-d9e032c72128 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2aa06e6346d4c88b2b6364dae5da884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1196f913aaa942dbb42d2131a1258f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:41.628593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeb599-2795-4d69-bb43-d9e032c72128 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:41.629038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeb599-2795-4d69-bb43-d9e032c72128 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:41.630152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeb599-2795-4d69-bb43-d9e032c72128 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:41.631068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eeb599-2795-4d69-bb43-d9e032c72128 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:41.632280 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-a5eeb599-2795-4d69-bb43-d9e032c72128 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:41:41.632280 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:41:41.632280 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:41:41.633759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eeb599-2795-4d69-bb43-d9e032c72128 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:41.642107 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3021/6053] 10.222.0.16 () {58 vars in 1190 bytes} [Mon May 2 10:41:41 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 765 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:41:41.647498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db96c4b-c32a-44b2-904c-0aef2fbd365d tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:41.661647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db96c4b-c32a-44b2-904c-0aef2fbd365d tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:41.669858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486453b-8b33-4d85-9cb8-b5e4ae7f3c41 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2aa06e6346d4c88b2b6364dae5da884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1196f913aaa942dbb42d2131a1258f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:41.670826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486453b-8b33-4d85-9cb8-b5e4ae7f3c41 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:41.671236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486453b-8b33-4d85-9cb8-b5e4ae7f3c41 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:41.671600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486453b-8b33-4d85-9cb8-b5e4ae7f3c41 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/18a07dd5f63f4b64b18093fc3526c57c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:41.672283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486453b-8b33-4d85-9cb8-b5e4ae7f3c41 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=18a07dd5f63f4b64b18093fc3526c57c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:41.683878 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-7486453b-8b33-4d85-9cb8-b5e4ae7f3c41 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:41:41.683878 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:41:41.683878 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:41:41.684997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486453b-8b33-4d85-9cb8-b5e4ae7f3c41 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:41.693035 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3033/6054] 10.222.0.16 () {58 vars in 1289 bytes} [Mon May 2 10:41:41 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/18a07dd5f63f4b64b18093fc3526c57c => generated 333 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:41:41.697602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eeb599-2795-4d69-bb43-d9e032c72128 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:41.709043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eeb599-2795-4d69-bb43-d9e032c72128 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:41.715084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c22632-813b-4b08-b331-005d87393548 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2aa06e6346d4c88b2b6364dae5da884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1196f913aaa942dbb42d2131a1258f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:41.719896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c22632-813b-4b08-b331-005d87393548 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:41.720215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c22632-813b-4b08-b331-005d87393548 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:41.720710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c22632-813b-4b08-b331-005d87393548 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/18a07dd5f63f4b64b18093fc3526c57c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:41.721408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c22632-813b-4b08-b331-005d87393548 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=18a07dd5f63f4b64b18093fc3526c57c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:41.723172 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-41c22632-813b-4b08-b331-005d87393548 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:41:41.723172 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:41:41.723172 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:41:41.724092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c22632-813b-4b08-b331-005d87393548 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:41.731639 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3022/6055] 10.222.0.16 () {58 vars in 1290 bytes} [Mon May 2 10:41:41 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/18a07dd5f63f4b64b18093fc3526c57c => generated 0 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) May 02 10:41:41.735902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486453b-8b33-4d85-9cb8-b5e4ae7f3c41 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:41.750063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486453b-8b33-4d85-9cb8-b5e4ae7f3c41 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:41.767452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95681450-1ab3-4493-832c-e7684be04f2d tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2aa06e6346d4c88b2b6364dae5da884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1196f913aaa942dbb42d2131a1258f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:41.769149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95681450-1ab3-4493-832c-e7684be04f2d tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:41.769508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95681450-1ab3-4493-832c-e7684be04f2d tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:41.770054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95681450-1ab3-4493-832c-e7684be04f2d tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/18a07dd5f63f4b64b18093fc3526c57c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:41.771373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95681450-1ab3-4493-832c-e7684be04f2d tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=18a07dd5f63f4b64b18093fc3526c57c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:41.772635 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-95681450-1ab3-4493-832c-e7684be04f2d tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:41:41.772635 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:41:41.772635 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:41:41.773990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95681450-1ab3-4493-832c-e7684be04f2d tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:41.891065 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3034/6056] 10.222.0.16 () {58 vars in 1292 bytes} [Mon May 2 10:41:41 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/18a07dd5f63f4b64b18093fc3526c57c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:41.896049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c22632-813b-4b08-b331-005d87393548 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:41.907498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c22632-813b-4b08-b331-005d87393548 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:41.914062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba8cde-41d3-4889-89fe-07ea8a499859 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2aa06e6346d4c88b2b6364dae5da884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1196f913aaa942dbb42d2131a1258f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:41.914763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba8cde-41d3-4889-89fe-07ea8a499859 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:41.915236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba8cde-41d3-4889-89fe-07ea8a499859 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:41.915526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba8cde-41d3-4889-89fe-07ea8a499859 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:41.916231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba8cde-41d3-4889-89fe-07ea8a499859 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:41.917951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba8cde-41d3-4889-89fe-07ea8a499859 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:41.924820 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3023/6057] 10.222.0.16 () {58 vars in 1190 bytes} [Mon May 2 10:41:41 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 451 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:41:41.928862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95681450-1ab3-4493-832c-e7684be04f2d tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:41.941814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95681450-1ab3-4493-832c-e7684be04f2d tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:41.947453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8f01e-8262-4fbe-8285-2bff5fe3b574 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2aa06e6346d4c88b2b6364dae5da884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1196f913aaa942dbb42d2131a1258f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:41.948318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8f01e-8262-4fbe-8285-2bff5fe3b574 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:41.948629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8f01e-8262-4fbe-8285-2bff5fe3b574 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:41.948929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8f01e-8262-4fbe-8285-2bff5fe3b574 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/18a07dd5f63f4b64b18093fc3526c57c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:41.949606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8f01e-8262-4fbe-8285-2bff5fe3b574 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=18a07dd5f63f4b64b18093fc3526c57c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:41.951374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8f01e-8262-4fbe-8285-2bff5fe3b574 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:41.968449 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-bfb8f01e-8262-4fbe-8285-2bff5fe3b574 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Could not find Endpoint Group: 18a07dd5f63f4b64b18093fc3526c57c.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 18a07dd5f63f4b64b18093fc3526c57c. May 02 10:41:41.968449 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:41:41.968449 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:41:41.968449 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:41:41.968449 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:41:41.968449 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:41:41.968449 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:41:41.968449 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:41:41.968449 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:41:41.968449 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:41:41.968449 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:41:41.968449 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:41:41.968449 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete May 02 10:41:41.968449 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), May 02 10:41:41.974443 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group May 02 10:41:41.974443 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, May 02 10:41:41.974443 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group May 02 10:41:41.974443 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( May 02 10:41:41.974443 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 18a07dd5f63f4b64b18093fc3526c57c. May 02 10:41:41.974443 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:41:41.974443 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3035/6058] 10.222.0.16 () {58 vars in 1292 bytes} [Mon May 2 10:41:41 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/18a07dd5f63f4b64b18093fc3526c57c => generated 120 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 02 10:41:41.974944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba8cde-41d3-4889-89fe-07ea8a499859 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:41.984830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba8cde-41d3-4889-89fe-07ea8a499859 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:41.989520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b77c7b-19f5-4d96-b647-5683aa4c2ce3 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2aa06e6346d4c88b2b6364dae5da884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1196f913aaa942dbb42d2131a1258f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:41.990364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b77c7b-19f5-4d96-b647-5683aa4c2ce3 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:41.990655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b77c7b-19f5-4d96-b647-5683aa4c2ce3 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:41.990938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b77c7b-19f5-4d96-b647-5683aa4c2ce3 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] PATH_INFO: `/v3/services/d09f8c9ea9e248519adf117931c59e19` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:41.992183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b77c7b-19f5-4d96-b647-5683aa4c2ce3 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d09f8c9ea9e248519adf117931c59e19)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:41.993824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b77c7b-19f5-4d96-b647-5683aa4c2ce3 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:42.138884 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3024/6059] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:41:41 2022] DELETE /identity/v3/services/d09f8c9ea9e248519adf117931c59e19 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:42.144223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8f01e-8262-4fbe-8285-2bff5fe3b574 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:42.155889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8f01e-8262-4fbe-8285-2bff5fe3b574 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:42.173878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034432e-c2fe-40e0-8520-f930e93ffb16 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2aa06e6346d4c88b2b6364dae5da884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1196f913aaa942dbb42d2131a1258f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:42.174535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034432e-c2fe-40e0-8520-f930e93ffb16 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:42.175385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034432e-c2fe-40e0-8520-f930e93ffb16 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:42.177143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034432e-c2fe-40e0-8520-f930e93ffb16 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:42.177143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034432e-c2fe-40e0-8520-f930e93ffb16 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:42.178050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034432e-c2fe-40e0-8520-f930e93ffb16 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:42.316645 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3036/6060] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:41:42 2022] POST /identity/v3/services => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:42.319088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b77c7b-19f5-4d96-b647-5683aa4c2ce3 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:42.332031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b77c7b-19f5-4d96-b647-5683aa4c2ce3 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:42.348253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a29df-939d-4745-b1e5-54d2b80a9d78 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2aa06e6346d4c88b2b6364dae5da884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1196f913aaa942dbb42d2131a1258f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:42.349098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a29df-939d-4745-b1e5-54d2b80a9d78 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:42.349463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a29df-939d-4745-b1e5-54d2b80a9d78 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:42.349806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a29df-939d-4745-b1e5-54d2b80a9d78 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:42.350674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a29df-939d-4745-b1e5-54d2b80a9d78 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:42.351849 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-008a29df-939d-4745-b1e5-54d2b80a9d78 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:41:42.351849 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:41:42.351849 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:41:42.353071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a29df-939d-4745-b1e5-54d2b80a9d78 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:42.882255 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3025/6061] 10.222.0.16 () {60 vars in 1212 bytes} [Mon May 2 10:41:42 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 562 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:42.884344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034432e-c2fe-40e0-8520-f930e93ffb16 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:42.897600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034432e-c2fe-40e0-8520-f930e93ffb16 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:42.903248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1c169-f8c3-41d9-b1cd-d4d92b9b2699 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2aa06e6346d4c88b2b6364dae5da884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1196f913aaa942dbb42d2131a1258f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:42.905083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1c169-f8c3-41d9-b1cd-d4d92b9b2699 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:42.905083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1c169-f8c3-41d9-b1cd-d4d92b9b2699 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:42.905083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1c169-f8c3-41d9-b1cd-d4d92b9b2699 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:42.906027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1c169-f8c3-41d9-b1cd-d4d92b9b2699 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:42.907669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1c169-f8c3-41d9-b1cd-d4d92b9b2699 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:43.056061 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3037/6062] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:41:42 2022] POST /identity/v3/services => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:43.060516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a29df-939d-4745-b1e5-54d2b80a9d78 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:43.115202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a29df-939d-4745-b1e5-54d2b80a9d78 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:43.145836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc85031-b3e5-424d-91a3-a53c2494a67e tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2aa06e6346d4c88b2b6364dae5da884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1196f913aaa942dbb42d2131a1258f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:43.152296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc85031-b3e5-424d-91a3-a53c2494a67e tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:43.152296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc85031-b3e5-424d-91a3-a53c2494a67e tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:43.152296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc85031-b3e5-424d-91a3-a53c2494a67e tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/e483c50b126048b4ab71be8dac036dd0` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:43.152296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc85031-b3e5-424d-91a3-a53c2494a67e tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=e483c50b126048b4ab71be8dac036dd0)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:43.153302 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-cdc85031-b3e5-424d-91a3-a53c2494a67e tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:41:43.153302 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:41:43.153302 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:41:43.153302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc85031-b3e5-424d-91a3-a53c2494a67e tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:43.316279 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3026/6063] 10.222.0.16 () {60 vars in 1312 bytes} [Mon May 2 10:41:43 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/e483c50b126048b4ab71be8dac036dd0 => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:41:43.321476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1c169-f8c3-41d9-b1cd-d4d92b9b2699 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:43.334995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1c169-f8c3-41d9-b1cd-d4d92b9b2699 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:43.340952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe4924-32e7-4f00-b2b1-665f6ead7138 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2aa06e6346d4c88b2b6364dae5da884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1196f913aaa942dbb42d2131a1258f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:43.342750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe4924-32e7-4f00-b2b1-665f6ead7138 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:43.343270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe4924-32e7-4f00-b2b1-665f6ead7138 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:43.343920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe4924-32e7-4f00-b2b1-665f6ead7138 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] PATH_INFO: `/v3/services/f677019fea2e487d8ee8796eadfd9c24` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:43.345277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe4924-32e7-4f00-b2b1-665f6ead7138 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f677019fea2e487d8ee8796eadfd9c24)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:43.349040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe4924-32e7-4f00-b2b1-665f6ead7138 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:43.443715 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3038/6064] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:41:43 2022] DELETE /identity/v3/services/f677019fea2e487d8ee8796eadfd9c24 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:43.448125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc85031-b3e5-424d-91a3-a53c2494a67e tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:43.459069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc85031-b3e5-424d-91a3-a53c2494a67e tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:43.475142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac454c-e2f3-4c35-b4e3-5c5dcad45975 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2aa06e6346d4c88b2b6364dae5da884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1196f913aaa942dbb42d2131a1258f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:43.475931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac454c-e2f3-4c35-b4e3-5c5dcad45975 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:43.476223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac454c-e2f3-4c35-b4e3-5c5dcad45975 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:43.476509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac454c-e2f3-4c35-b4e3-5c5dcad45975 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/e483c50b126048b4ab71be8dac036dd0` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:43.477251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac454c-e2f3-4c35-b4e3-5c5dcad45975 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=e483c50b126048b4ab71be8dac036dd0)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:43.478301 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-ccac454c-e2f3-4c35-b4e3-5c5dcad45975 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:41:43.478301 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:41:43.478301 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:41:43.479953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac454c-e2f3-4c35-b4e3-5c5dcad45975 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:43.499142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7717ce-5279-4c3e-b211-31c782e8bc5c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:43.499443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7717ce-5279-4c3e-b211-31c782e8bc5c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:43.499711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7717ce-5279-4c3e-b211-31c782e8bc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:43.522852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0b7717ce-5279-4c3e-b211-31c782e8bc5c None None] MFA Rules not processed for user `3bb0ce3a6ad74cec85da601a746d6fee`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:43.524722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0b7717ce-5279-4c3e-b211-31c782e8bc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:43.582012 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3027/6065] 10.222.0.16 () {58 vars in 1292 bytes} [Mon May 2 10:41:43 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/e483c50b126048b4ab71be8dac036dd0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:43.586255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac454c-e2f3-4c35-b4e3-5c5dcad45975 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:43.600537 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3039/6066] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:43 2022] POST /identity/v3/auth/tokens => generated 3508 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:43.601885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac454c-e2f3-4c35-b4e3-5c5dcad45975 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:43.612762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9fdec-cd65-40f1-9230-9c69e89af985 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2aa06e6346d4c88b2b6364dae5da884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1196f913aaa942dbb42d2131a1258f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:43.613636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9fdec-cd65-40f1-9230-9c69e89af985 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:43.613965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9fdec-cd65-40f1-9230-9c69e89af985 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:43.614417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9fdec-cd65-40f1-9230-9c69e89af985 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] PATH_INFO: `/v3/services/c64f7f4fdf6b4172b893d3edbfb340c6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:43.615127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b9fdec-cd65-40f1-9230-9c69e89af985 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c64f7f4fdf6b4172b893d3edbfb340c6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:43.616769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b9fdec-cd65-40f1-9230-9c69e89af985 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:43.729963 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3028/6067] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:41:43 2022] DELETE /identity/v3/services/c64f7f4fdf6b4172b893d3edbfb340c6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:43.735024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7717ce-5279-4c3e-b211-31c782e8bc5c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:43.752672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7717ce-5279-4c3e-b211-31c782e8bc5c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:43.780660 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4eb7e-007f-44b3-9f34-b7d5940cc176 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2aa06e6346d4c88b2b6364dae5da884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1196f913aaa942dbb42d2131a1258f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:43.782270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4eb7e-007f-44b3-9f34-b7d5940cc176 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:43.782780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4eb7e-007f-44b3-9f34-b7d5940cc176 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:43.783320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4eb7e-007f-44b3-9f34-b7d5940cc176 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/d16c415277d14996b3fda7f1d17c1e13` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:43.784728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4eb7e-007f-44b3-9f34-b7d5940cc176 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=d16c415277d14996b3fda7f1d17c1e13)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:43.789445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4eb7e-007f-44b3-9f34-b7d5940cc176 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:43.907225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c07d74-13a6-4225-843e-3e2d3a63a6a7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:43.907608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c07d74-13a6-4225-843e-3e2d3a63a6a7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:43.907908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c07d74-13a6-4225-843e-3e2d3a63a6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:43.916930 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3040/6068] 10.222.0.16 () {58 vars in 1292 bytes} [Mon May 2 10:41:43 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/d16c415277d14996b3fda7f1d17c1e13 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:43.923633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4eb7e-007f-44b3-9f34-b7d5940cc176 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:43.940823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4eb7e-007f-44b3-9f34-b7d5940cc176 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:43.947775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a9c07d74-13a6-4225-843e-3e2d3a63a6a7 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:43.947905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca81e4d-c5dc-4657-a251-e8209dbe8559 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2aa06e6346d4c88b2b6364dae5da884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1196f913aaa942dbb42d2131a1258f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:43.948390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a9c07d74-13a6-4225-843e-3e2d3a63a6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:43.948835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca81e4d-c5dc-4657-a251-e8209dbe8559 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:43.949328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca81e4d-c5dc-4657-a251-e8209dbe8559 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:43.949798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca81e4d-c5dc-4657-a251-e8209dbe8559 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] PATH_INFO: `/v3/services/cd95d1824bc644c0ad02bf95228927da` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:43.950468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca81e4d-c5dc-4657-a251-e8209dbe8559 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorizing `identity:delete_service(service_id=cd95d1824bc644c0ad02bf95228927da)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:43.952074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca81e4d-c5dc-4657-a251-e8209dbe8559 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:44.053212 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3041/6069] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:41:43 2022] DELETE /identity/v3/services/cd95d1824bc644c0ad02bf95228927da => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:44.057952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca81e4d-c5dc-4657-a251-e8209dbe8559 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:44.064379 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3029/6070] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:41:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:41:44.114071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c07d74-13a6-4225-843e-3e2d3a63a6a7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:44.115787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a9c07d74-13a6-4225-843e-3e2d3a63a6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:44.254991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca81e4d-c5dc-4657-a251-e8209dbe8559 tempest-EndPointGroupsTest-768748584 tempest-EndPointGroupsTest-768748584-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:44.261362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573e440-6220-46f4-acc4-6aa49d5d858a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:44.262388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573e440-6220-46f4-acc4-6aa49d5d858a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:44.262767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573e440-6220-46f4-acc4-6aa49d5d858a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:44.263058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573e440-6220-46f4-acc4-6aa49d5d858a admin admin] PATH_INFO: `/v3/users/82cc9bad99b646bda797e087fdf15d6f` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:44.264521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573e440-6220-46f4-acc4-6aa49d5d858a admin admin] RBAC: Authorizing `identity:delete_user(user_id=82cc9bad99b646bda797e087fdf15d6f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:44.266906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573e440-6220-46f4-acc4-6aa49d5d858a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:44.306908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c07d74-13a6-4225-843e-3e2d3a63a6a7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:44.341886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aeeb6b-d14d-4bc4-9ec7-865c06021f32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:44.343549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aeeb6b-d14d-4bc4-9ec7-865c06021f32 service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:44.344055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aeeb6b-d14d-4bc4-9ec7-865c06021f32 service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:44.344571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aeeb6b-d14d-4bc4-9ec7-865c06021f32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:44.361859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aeeb6b-d14d-4bc4-9ec7-865c06021f32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:44.365679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aeeb6b-d14d-4bc4-9ec7-865c06021f32 service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:44.391194 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3030/6071] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:41:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 02 10:41:44.393701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aeeb6b-d14d-4bc4-9ec7-865c06021f32 service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:44.396202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e0aeeb6b-d14d-4bc4-9ec7-865c06021f32 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:44.538565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aeeb6b-d14d-4bc4-9ec7-865c06021f32 service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:44.548131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2d02f-ebe8-4194-af5a-938c74ba3ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:44.548292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2d02f-ebe8-4194-af5a-938c74ba3ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:44.548674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2d02f-ebe8-4194-af5a-938c74ba3ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:44.549059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2d02f-ebe8-4194-af5a-938c74ba3ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:44.557416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8eb2d02f-ebe8-4194-af5a-938c74ba3ac8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:44.571556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2d02f-ebe8-4194-af5a-938c74ba3ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:44.573243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2d02f-ebe8-4194-af5a-938c74ba3ac8 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:44.592691 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3031/6072] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:41:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:41:44.622074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d573e440-6220-46f4-acc4-6aa49d5d858a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82cc9bad99b646bda797e087fdf15d6f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:44.653339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d573e440-6220-46f4-acc4-6aa49d5d858a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82cc9bad99b646bda797e087fdf15d6f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:44.654335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d573e440-6220-46f4-acc4-6aa49d5d858a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82cc9bad99b646bda797e087fdf15d6f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:44.665848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d573e440-6220-46f4-acc4-6aa49d5d858a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82cc9bad99b646bda797e087fdf15d6f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:44.732946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d573e440-6220-46f4-acc4-6aa49d5d858a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82cc9bad99b646bda797e087fdf15d6f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:44.741359 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3042/6073] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:41:44 2022] DELETE /identity/v3/users/82cc9bad99b646bda797e087fdf15d6f => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:41:44.745753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024b2c7-152a-4ec1-a659-76f3aa4df4d5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:44.746234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024b2c7-152a-4ec1-a659-76f3aa4df4d5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:44.746668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024b2c7-152a-4ec1-a659-76f3aa4df4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:44.769292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f024b2c7-152a-4ec1-a659-76f3aa4df4d5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:44.771451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f024b2c7-152a-4ec1-a659-76f3aa4df4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:44.880877 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3032/6074] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:44.916313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573e440-6220-46f4-acc4-6aa49d5d858a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:44.917895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d573e440-6220-46f4-acc4-6aa49d5d858a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:45.016800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573e440-6220-46f4-acc4-6aa49d5d858a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:45.022203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47faeae5-5001-4eac-b06d-ff9efeaec93a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:45.022892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47faeae5-5001-4eac-b06d-ff9efeaec93a service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:45.023190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47faeae5-5001-4eac-b06d-ff9efeaec93a service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:45.023525 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47faeae5-5001-4eac-b06d-ff9efeaec93a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:45.036138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47faeae5-5001-4eac-b06d-ff9efeaec93a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:45.037642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47faeae5-5001-4eac-b06d-ff9efeaec93a service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:45.054916 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3043/6075] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:41:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:41:45.599993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65332e6a-653b-4c7d-b6c8-4ff97ab41e02 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:45.600560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65332e6a-653b-4c7d-b6c8-4ff97ab41e02 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:45.600560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65332e6a-653b-4c7d-b6c8-4ff97ab41e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:45.681950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-65332e6a-653b-4c7d-b6c8-4ff97ab41e02 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:45.685402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-65332e6a-653b-4c7d-b6c8-4ff97ab41e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:45.877664 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3033/6076] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:41:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:45.905142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47faeae5-5001-4eac-b06d-ff9efeaec93a service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:45.907037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-47faeae5-5001-4eac-b06d-ff9efeaec93a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:46.042748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47faeae5-5001-4eac-b06d-ff9efeaec93a service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:46.049068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911e2e7-ef20-42f1-8d47-e214d1532ae5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:46.050172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911e2e7-ef20-42f1-8d47-e214d1532ae5 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:46.050536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911e2e7-ef20-42f1-8d47-e214d1532ae5 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:46.050889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911e2e7-ef20-42f1-8d47-e214d1532ae5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:46.068786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911e2e7-ef20-42f1-8d47-e214d1532ae5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:46.071499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911e2e7-ef20-42f1-8d47-e214d1532ae5 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:46.084176 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3044/6077] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:41:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:41:46.479177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65332e6a-653b-4c7d-b6c8-4ff97ab41e02 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:46.480944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-65332e6a-653b-4c7d-b6c8-4ff97ab41e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:46.509600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65332e6a-653b-4c7d-b6c8-4ff97ab41e02 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:46.527753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b5cd4-e820-4961-870b-a50c0af837f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:46.528717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b5cd4-e820-4961-870b-a50c0af837f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:46.529008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b5cd4-e820-4961-870b-a50c0af837f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:46.529415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b5cd4-e820-4961-870b-a50c0af837f2 admin admin] PATH_INFO: `/v3/projects/ee3d6d4d167a4efab1248c2b282dac0e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:46.531201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b5cd4-e820-4961-870b-a50c0af837f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee3d6d4d167a4efab1248c2b282dac0e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:46.533348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b5cd4-e820-4961-870b-a50c0af837f2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:46.697608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5c0b5cd4-e820-4961-870b-a50c0af837f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee3d6d4d167a4efab1248c2b282dac0e', 'request_id': 'req-5c0b5cd4-e820-4961-870b-a50c0af837f2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:46.708039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5c0b5cd4-e820-4961-870b-a50c0af837f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee3d6d4d167a4efab1248c2b282dac0e', 'request_id': 'req-5c0b5cd4-e820-4961-870b-a50c0af837f2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:46.790120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5c0b5cd4-e820-4961-870b-a50c0af837f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee3d6d4d167a4efab1248c2b282dac0e', 'request_id': 'req-5c0b5cd4-e820-4961-870b-a50c0af837f2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:46.831484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5c0b5cd4-e820-4961-870b-a50c0af837f2 admin admin] The token cache is being invalidate because project ee3d6d4d167a4efab1248c2b282dac0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:41:46.831924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5c0b5cd4-e820-4961-870b-a50c0af837f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:46.834701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5c0b5cd4-e820-4961-870b-a50c0af837f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:46.843495 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3034/6078] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:41:46 2022] DELETE /identity/v3/projects/ee3d6d4d167a4efab1248c2b282dac0e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:46.847774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911e2e7-ef20-42f1-8d47-e214d1532ae5 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:46.862643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a95b9-152d-4a8d-bc36-58916d444a97 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:46.862937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a95b9-152d-4a8d-bc36-58916d444a97 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:46.863222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a95b9-152d-4a8d-bc36-58916d444a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:46.865726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911e2e7-ef20-42f1-8d47-e214d1532ae5 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:46.925290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5b0a95b9-152d-4a8d-bc36-58916d444a97 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:46.926770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5b0a95b9-152d-4a8d-bc36-58916d444a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:46.968032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a78e5-d9c6-4c30-b282-5bc12e03e861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:46.969379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a78e5-d9c6-4c30-b282-5bc12e03e861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:46.969748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a78e5-d9c6-4c30-b282-5bc12e03e861 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:46.970094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a78e5-d9c6-4c30-b282-5bc12e03e861 admin admin] PATH_INFO: `/v3/users/d2aa06e6346d4c88b2b6364dae5da884` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:46.972711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a78e5-d9c6-4c30-b282-5bc12e03e861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2aa06e6346d4c88b2b6364dae5da884)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:46.981344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a78e5-d9c6-4c30-b282-5bc12e03e861 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:47.052672 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3035/6079] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:41:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:41:47.069598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a95b9-152d-4a8d-bc36-58916d444a97 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:47.071135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5b0a95b9-152d-4a8d-bc36-58916d444a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:47.157068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a95b9-152d-4a8d-bc36-58916d444a97 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:47.163980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae790f-81d3-49ac-8621-83609b3cae8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:47.164765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae790f-81d3-49ac-8621-83609b3cae8d service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:47.165153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae790f-81d3-49ac-8621-83609b3cae8d service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:47.165500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae790f-81d3-49ac-8621-83609b3cae8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:47.177511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae790f-81d3-49ac-8621-83609b3cae8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:47.179412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae790f-81d3-49ac-8621-83609b3cae8d service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:47.201116 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3036/6080] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:41:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:41:47.290910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-828a78e5-d9c6-4c30-b282-5bc12e03e861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2aa06e6346d4c88b2b6364dae5da884'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:47.309608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-828a78e5-d9c6-4c30-b282-5bc12e03e861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2aa06e6346d4c88b2b6364dae5da884'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:47.310604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-828a78e5-d9c6-4c30-b282-5bc12e03e861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2aa06e6346d4c88b2b6364dae5da884'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:47.318109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-828a78e5-d9c6-4c30-b282-5bc12e03e861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2aa06e6346d4c88b2b6364dae5da884'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:47.413384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-828a78e5-d9c6-4c30-b282-5bc12e03e861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2aa06e6346d4c88b2b6364dae5da884'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:47.428539 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3045/6081] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:41:46 2022] DELETE /identity/v3/users/d2aa06e6346d4c88b2b6364dae5da884 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:47.951908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7ed92-b9b9-4d20-bd7e-dc057685026f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:47.952363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7ed92-b9b9-4d20-bd7e-dc057685026f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:47.952494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7ed92-b9b9-4d20-bd7e-dc057685026f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:47.974741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-eff7ed92-b9b9-4d20-bd7e-dc057685026f None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:47.976279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-eff7ed92-b9b9-4d20-bd7e-dc057685026f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:48.067370 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3037/6082] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:41:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:48.083432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a78e5-d9c6-4c30-b282-5bc12e03e861 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:48.085112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-828a78e5-d9c6-4c30-b282-5bc12e03e861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:48.204898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a78e5-d9c6-4c30-b282-5bc12e03e861 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:48.212744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd00d5-8043-4bbb-a04b-17042913d194 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:48.214093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd00d5-8043-4bbb-a04b-17042913d194 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:48.214556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd00d5-8043-4bbb-a04b-17042913d194 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:48.214997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd00d5-8043-4bbb-a04b-17042913d194 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:48.225680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd00d5-8043-4bbb-a04b-17042913d194 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:48.228005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd00d5-8043-4bbb-a04b-17042913d194 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:48.264583 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3046/6083] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:41:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:41:48.434871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7ed92-b9b9-4d20-bd7e-dc057685026f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:48.436546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-eff7ed92-b9b9-4d20-bd7e-dc057685026f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:48.559856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7ed92-b9b9-4d20-bd7e-dc057685026f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:48.569910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817db6e3-0c61-4dc4-b665-ec261878de96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:48.571064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817db6e3-0c61-4dc4-b665-ec261878de96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:48.571352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817db6e3-0c61-4dc4-b665-ec261878de96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:48.571627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817db6e3-0c61-4dc4-b665-ec261878de96 admin admin] PATH_INFO: `/v3/projects/1196f913aaa942dbb42d2131a1258f22` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:48.573437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817db6e3-0c61-4dc4-b665-ec261878de96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1196f913aaa942dbb42d2131a1258f22)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:48.575040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817db6e3-0c61-4dc4-b665-ec261878de96 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:48.727729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-817db6e3-0c61-4dc4-b665-ec261878de96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1196f913aaa942dbb42d2131a1258f22', 'request_id': 'req-817db6e3-0c61-4dc4-b665-ec261878de96'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:48.734473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-817db6e3-0c61-4dc4-b665-ec261878de96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1196f913aaa942dbb42d2131a1258f22', 'request_id': 'req-817db6e3-0c61-4dc4-b665-ec261878de96'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:48.839170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-817db6e3-0c61-4dc4-b665-ec261878de96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1196f913aaa942dbb42d2131a1258f22', 'request_id': 'req-817db6e3-0c61-4dc4-b665-ec261878de96'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:48.866847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-817db6e3-0c61-4dc4-b665-ec261878de96 admin admin] The token cache is being invalidate because project 1196f913aaa942dbb42d2131a1258f22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:41:48.868059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-817db6e3-0c61-4dc4-b665-ec261878de96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:48.868828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-817db6e3-0c61-4dc4-b665-ec261878de96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:48.870959 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3038/6084] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:41:48 2022] DELETE /identity/v3/projects/1196f913aaa942dbb42d2131a1258f22 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:48.876240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900429b2-e2c7-4911-b9e7-953a7d90849b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:48.877200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900429b2-e2c7-4911-b9e7-953a7d90849b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:48.878227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900429b2-e2c7-4911-b9e7-953a7d90849b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:48.904422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-900429b2-e2c7-4911-b9e7-953a7d90849b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:48.905701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-900429b2-e2c7-4911-b9e7-953a7d90849b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:49.013681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a701a-9543-4813-8e7a-1b3221ef9a46 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:49.014147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a701a-9543-4813-8e7a-1b3221ef9a46 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:49.021217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a701a-9543-4813-8e7a-1b3221ef9a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:49.021683 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3047/6085] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:49.043738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a66a701a-9543-4813-8e7a-1b3221ef9a46 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:49.045010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a66a701a-9543-4813-8e7a-1b3221ef9a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:49.060659 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3039/6086] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:49.063761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900429b2-e2c7-4911-b9e7-953a7d90849b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:49.087573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900429b2-e2c7-4911-b9e7-953a7d90849b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:49.110299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15d18c-f77c-4b83-bd4c-933247cc5e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:49.111251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15d18c-f77c-4b83-bd4c-933247cc5e13 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:49.111633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15d18c-f77c-4b83-bd4c-933247cc5e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:49.112337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15d18c-f77c-4b83-bd4c-933247cc5e13 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:49.114668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15d18c-f77c-4b83-bd4c-933247cc5e13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:41:49.115379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15d18c-f77c-4b83-bd4c-933247cc5e13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:49.118741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15d18c-f77c-4b83-bd4c-933247cc5e13 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:49.141117 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3048/6087] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:41:49.141315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a701a-9543-4813-8e7a-1b3221ef9a46 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:49.154817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a701a-9543-4813-8e7a-1b3221ef9a46 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:49.162131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cabce-12d6-40ee-8faf-548415f9a72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:49.163207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cabce-12d6-40ee-8faf-548415f9a72d admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:49.164034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cabce-12d6-40ee-8faf-548415f9a72d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:49.164513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cabce-12d6-40ee-8faf-548415f9a72d admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:49.165479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cabce-12d6-40ee-8faf-548415f9a72d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:49.167834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cabce-12d6-40ee-8faf-548415f9a72d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:49.301789 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3040/6088] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:41:49 2022] POST /identity/v3/projects => generated 369 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:49.305747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15d18c-f77c-4b83-bd4c-933247cc5e13 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:49.317060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15d18c-f77c-4b83-bd4c-933247cc5e13 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:49.459011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e02df0-a764-4477-9eba-3cd97758230f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:49.460834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e02df0-a764-4477-9eba-3cd97758230f admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:49.461285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e02df0-a764-4477-9eba-3cd97758230f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:49.461771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e02df0-a764-4477-9eba-3cd97758230f admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:49.478581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e02df0-a764-4477-9eba-3cd97758230f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:49.482486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e02df0-a764-4477-9eba-3cd97758230f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:49.580426 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3049/6089] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:41:49 2022] POST /identity/v3/users => generated 285 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:49.581993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cabce-12d6-40ee-8faf-548415f9a72d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:49.593209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cabce-12d6-40ee-8faf-548415f9a72d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:49.600019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143a973-e98f-470d-a358-fafd239b93ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:49.601043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143a973-e98f-470d-a358-fafd239b93ab admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:49.601502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143a973-e98f-470d-a358-fafd239b93ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:49.601965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143a973-e98f-470d-a358-fafd239b93ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:49.607590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143a973-e98f-470d-a358-fafd239b93ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:49.607590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143a973-e98f-470d-a358-fafd239b93ab admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:49.618820 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3041/6090] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:41:49.622876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e02df0-a764-4477-9eba-3cd97758230f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:49.646627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e02df0-a764-4477-9eba-3cd97758230f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:49.652313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee0b29-937e-418c-82b0-6cbb2abb7ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:49.653159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee0b29-937e-418c-82b0-6cbb2abb7ecc admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:49.653570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee0b29-937e-418c-82b0-6cbb2abb7ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:49.654037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee0b29-937e-418c-82b0-6cbb2abb7ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:49.654990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee0b29-937e-418c-82b0-6cbb2abb7ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:49.656971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee0b29-937e-418c-82b0-6cbb2abb7ecc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:49.669858 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3050/6091] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:41:49.675305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143a973-e98f-470d-a358-fafd239b93ab admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:49.686846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143a973-e98f-470d-a358-fafd239b93ab admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:49.694553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c82a0-b657-40ce-9e95-3d9ae31e46ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:49.696391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c82a0-b657-40ce-9e95-3d9ae31e46ee admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:49.696921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c82a0-b657-40ce-9e95-3d9ae31e46ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:49.697421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c82a0-b657-40ce-9e95-3d9ae31e46ee admin admin] PATH_INFO: `/v3/projects/e88c96fad7e9420fba6420a910194224/users/77e560ed869842ea8cc9a89515cb1b27/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:49.730096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c82a0-b657-40ce-9e95-3d9ae31e46ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e88c96fad7e9420fba6420a910194224, user_id=77e560ed869842ea8cc9a89515cb1b27, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:49.733360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c82a0-b657-40ce-9e95-3d9ae31e46ee admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:49.839782 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3042/6092] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:41:49 2022] PUT /identity/v3/projects/e88c96fad7e9420fba6420a910194224/users/77e560ed869842ea8cc9a89515cb1b27/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:49.851859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637a4c5-ffe6-474e-bcaf-b2cca621fa0d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:49.852401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637a4c5-ffe6-474e-bcaf-b2cca621fa0d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:49.853259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637a4c5-ffe6-474e-bcaf-b2cca621fa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:49.905111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8637a4c5-ffe6-474e-bcaf-b2cca621fa0d None None] MFA Rules not processed for user `77e560ed869842ea8cc9a89515cb1b27`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:49.906386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8637a4c5-ffe6-474e-bcaf-b2cca621fa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:50.032959 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3051/6093] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:49 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:41:50.034644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c82a0-b657-40ce-9e95-3d9ae31e46ee admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:50.179256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c82a0-b657-40ce-9e95-3d9ae31e46ee admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:50.194978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bca9f6-7523-427d-961d-fca2e3ebf21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:50.196012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bca9f6-7523-427d-961d-fca2e3ebf21b admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:50.196320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bca9f6-7523-427d-961d-fca2e3ebf21b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:50.196898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bca9f6-7523-427d-961d-fca2e3ebf21b admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:50.202461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bca9f6-7523-427d-961d-fca2e3ebf21b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:50.202461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bca9f6-7523-427d-961d-fca2e3ebf21b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:50.386041 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3043/6094] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:41:50 2022] POST /identity/v3/projects => generated 369 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:50.390208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637a4c5-ffe6-474e-bcaf-b2cca621fa0d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:50.404477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637a4c5-ffe6-474e-bcaf-b2cca621fa0d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:50.522711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df912b1-c2bd-4cad-aea7-492ee0c474a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:50.537937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df912b1-c2bd-4cad-aea7-492ee0c474a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:50.539881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df912b1-c2bd-4cad-aea7-492ee0c474a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:50.540487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df912b1-c2bd-4cad-aea7-492ee0c474a2 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:50.541514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df912b1-c2bd-4cad-aea7-492ee0c474a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:50.549000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df912b1-c2bd-4cad-aea7-492ee0c474a2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:50.687667 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3052/6095] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:41:50 2022] POST /identity/v3/users => generated 291 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:50.691772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bca9f6-7523-427d-961d-fca2e3ebf21b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:50.713400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bca9f6-7523-427d-961d-fca2e3ebf21b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:50.732373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5f5ec-6d3a-4d15-8a5c-7d9b0d3f49b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:50.734180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5f5ec-6d3a-4d15-8a5c-7d9b0d3f49b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:50.734695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5f5ec-6d3a-4d15-8a5c-7d9b0d3f49b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:50.735220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5f5ec-6d3a-4d15-8a5c-7d9b0d3f49b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:50.736245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5f5ec-6d3a-4d15-8a5c-7d9b0d3f49b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:50.741607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5f5ec-6d3a-4d15-8a5c-7d9b0d3f49b2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:50.759383 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3044/6096] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:41:50.763585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df912b1-c2bd-4cad-aea7-492ee0c474a2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:50.783783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df912b1-c2bd-4cad-aea7-492ee0c474a2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:50.793589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481cad0c-af7a-4fa9-9ca3-8c2e900724be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:50.795728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cad0c-af7a-4fa9-9ca3-8c2e900724be admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:50.797011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cad0c-af7a-4fa9-9ca3-8c2e900724be admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:50.797821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cad0c-af7a-4fa9-9ca3-8c2e900724be admin admin] PATH_INFO: `/v3/projects/6e4cf00aaf6748898564a431b61d0b1f/users/d8e8c961ee1c4a8b8cbd0574739de58e/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:50.825331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481cad0c-af7a-4fa9-9ca3-8c2e900724be admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4cf00aaf6748898564a431b61d0b1f, user_id=d8e8c961ee1c4a8b8cbd0574739de58e, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:50.835385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481cad0c-af7a-4fa9-9ca3-8c2e900724be admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:50.933241 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3053/6097] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:41:50 2022] PUT /identity/v3/projects/6e4cf00aaf6748898564a431b61d0b1f/users/d8e8c961ee1c4a8b8cbd0574739de58e/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:50.937129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5f5ec-6d3a-4d15-8a5c-7d9b0d3f49b2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:50.949925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5f5ec-6d3a-4d15-8a5c-7d9b0d3f49b2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:51.036664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafb87d-e2fd-4e80-85dd-634a060ad8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:51.038029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafb87d-e2fd-4e80-85dd-634a060ad8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:51.038316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafb87d-e2fd-4e80-85dd-634a060ad8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:51.039417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafb87d-e2fd-4e80-85dd-634a060ad8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:51.041129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafb87d-e2fd-4e80-85dd-634a060ad8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:51.043803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafb87d-e2fd-4e80-85dd-634a060ad8b1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:51.057222 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3045/6098] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:41:51.061458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481cad0c-af7a-4fa9-9ca3-8c2e900724be admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:51.079061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481cad0c-af7a-4fa9-9ca3-8c2e900724be admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:51.108032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef45138-a79f-4f12-99a3-3a9bdaa3fece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:51.109653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef45138-a79f-4f12-99a3-3a9bdaa3fece admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:51.110324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef45138-a79f-4f12-99a3-3a9bdaa3fece admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:51.110324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef45138-a79f-4f12-99a3-3a9bdaa3fece admin admin] PATH_INFO: `/v3/projects/6e4cf00aaf6748898564a431b61d0b1f/users/d8e8c961ee1c4a8b8cbd0574739de58e/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:51.114673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef45138-a79f-4f12-99a3-3a9bdaa3fece admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4cf00aaf6748898564a431b61d0b1f, user_id=d8e8c961ee1c4a8b8cbd0574739de58e, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:51.118424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef45138-a79f-4f12-99a3-3a9bdaa3fece admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:51.142692 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3054/6099] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:41:51 2022] PUT /identity/v3/projects/6e4cf00aaf6748898564a431b61d0b1f/users/d8e8c961ee1c4a8b8cbd0574739de58e/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:51.160019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f2a9f-4316-4bab-a0f4-7bfe6a3c7211 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:51.160645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f2a9f-4316-4bab-a0f4-7bfe6a3c7211 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:51.161633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f2a9f-4316-4bab-a0f4-7bfe6a3c7211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:51.194601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-443f2a9f-4316-4bab-a0f4-7bfe6a3c7211 None None] MFA Rules not processed for user `d8e8c961ee1c4a8b8cbd0574739de58e`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:51.196175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-443f2a9f-4316-4bab-a0f4-7bfe6a3c7211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:51.288750 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3046/6100] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:51 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:51.304908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef45138-a79f-4f12-99a3-3a9bdaa3fece admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:51.307708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef45138-a79f-4f12-99a3-3a9bdaa3fece admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:51.325305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105f32a-63c8-40c2-ae86-97304a6e5a5e tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8e8c961ee1c4a8b8cbd0574739de58e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e4cf00aaf6748898564a431b61d0b1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:51.330106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105f32a-63c8-40c2-ae86-97304a6e5a5e tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:51.330106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105f32a-63c8-40c2-ae86-97304a6e5a5e tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:51.330106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105f32a-63c8-40c2-ae86-97304a6e5a5e tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] PATH_INFO: `/v3/policies` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:51.330106 ncdv-master-1 devstack@keystone.service[91118]: WARNING oslo_log.versionutils [None req-a105f32a-63c8-40c2-ae86-97304a6e5a5e tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. May 02 10:41:51.337172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105f32a-63c8-40c2-ae86-97304a6e5a5e tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:51.337753 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-a105f32a-63c8-40c2-ae86-97304a6e5a5e tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:41:51.337753 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:41:51.337753 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:41:51.343265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105f32a-63c8-40c2-ae86-97304a6e5a5e tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:51.474257 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3055/6101] 10.222.0.16 () {60 vars in 1151 bytes} [Mon May 2 10:41:51 2022] POST /identity/v3/policies => generated 230 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:41:51.475652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f2a9f-4316-4bab-a0f4-7bfe6a3c7211 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:51.485693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f2a9f-4316-4bab-a0f4-7bfe6a3c7211 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:51.494983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9e682-f28a-4f8b-aada-53b12d48b9ca tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8e8c961ee1c4a8b8cbd0574739de58e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e4cf00aaf6748898564a431b61d0b1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:51.496132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9e682-f28a-4f8b-aada-53b12d48b9ca tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:51.496568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9e682-f28a-4f8b-aada-53b12d48b9ca tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:51.497070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9e682-f28a-4f8b-aada-53b12d48b9ca tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] PATH_INFO: `/v3/policies/747cb7063dd84541be4b96ccae5cdeab` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:51.498258 ncdv-master-1 devstack@keystone.service[91119]: WARNING oslo_log.versionutils [None req-19b9e682-f28a-4f8b-aada-53b12d48b9ca tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. May 02 10:41:51.499693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9e682-f28a-4f8b-aada-53b12d48b9ca tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=747cb7063dd84541be4b96ccae5cdeab)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:51.504506 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-19b9e682-f28a-4f8b-aada-53b12d48b9ca tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:41:51.504506 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:41:51.504506 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:41:51.506608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9e682-f28a-4f8b-aada-53b12d48b9ca tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:51.625367 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3047/6102] 10.222.0.16 () {60 vars in 1251 bytes} [Mon May 2 10:41:51 2022] PATCH /identity/v3/policies/747cb7063dd84541be4b96ccae5cdeab => generated 236 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:41:51.631899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105f32a-63c8-40c2-ae86-97304a6e5a5e tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:51.651622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105f32a-63c8-40c2-ae86-97304a6e5a5e tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:51.671728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4cdd2-0c26-48d8-a35e-1e964c5c2655 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8e8c961ee1c4a8b8cbd0574739de58e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e4cf00aaf6748898564a431b61d0b1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:51.672747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4cdd2-0c26-48d8-a35e-1e964c5c2655 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:51.673114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4cdd2-0c26-48d8-a35e-1e964c5c2655 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:51.673762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4cdd2-0c26-48d8-a35e-1e964c5c2655 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] PATH_INFO: `/v3/policies/747cb7063dd84541be4b96ccae5cdeab` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:51.675542 ncdv-master-1 devstack@keystone.service[91118]: WARNING oslo_log.versionutils [None req-b0b4cdd2-0c26-48d8-a35e-1e964c5c2655 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. May 02 10:41:51.676802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4cdd2-0c26-48d8-a35e-1e964c5c2655 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=747cb7063dd84541be4b96ccae5cdeab)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:51.678430 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-b0b4cdd2-0c26-48d8-a35e-1e964c5c2655 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:41:51.678430 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:41:51.678430 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:41:51.681422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4cdd2-0c26-48d8-a35e-1e964c5c2655 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:51.708403 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3056/6103] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:41:51 2022] GET /identity/v3/policies/747cb7063dd84541be4b96ccae5cdeab => generated 236 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:41:51.712694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9e682-f28a-4f8b-aada-53b12d48b9ca tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:51.728885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9e682-f28a-4f8b-aada-53b12d48b9ca tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:51.751951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5b8db-afc4-4d97-9755-7dc6397c80c9 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8e8c961ee1c4a8b8cbd0574739de58e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e4cf00aaf6748898564a431b61d0b1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:51.753959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5b8db-afc4-4d97-9755-7dc6397c80c9 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:51.754472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5b8db-afc4-4d97-9755-7dc6397c80c9 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:51.754994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5b8db-afc4-4d97-9755-7dc6397c80c9 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] PATH_INFO: `/v3/policies/747cb7063dd84541be4b96ccae5cdeab` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:51.756405 ncdv-master-1 devstack@keystone.service[91119]: WARNING oslo_log.versionutils [None req-f2b5b8db-afc4-4d97-9755-7dc6397c80c9 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. May 02 10:41:51.757607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5b8db-afc4-4d97-9755-7dc6397c80c9 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=747cb7063dd84541be4b96ccae5cdeab)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:51.759124 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-f2b5b8db-afc4-4d97-9755-7dc6397c80c9 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:41:51.759124 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:41:51.759124 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:41:51.760407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5b8db-afc4-4d97-9755-7dc6397c80c9 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:51.861497 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3048/6104] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:41:51 2022] DELETE /identity/v3/policies/747cb7063dd84541be4b96ccae5cdeab => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:51.867381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4cdd2-0c26-48d8-a35e-1e964c5c2655 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:51.879664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4cdd2-0c26-48d8-a35e-1e964c5c2655 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:51.898440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae180399-9f10-4ae6-8ce1-1e3ce24b6946 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8e8c961ee1c4a8b8cbd0574739de58e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e4cf00aaf6748898564a431b61d0b1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:51.902069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae180399-9f10-4ae6-8ce1-1e3ce24b6946 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:51.902069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae180399-9f10-4ae6-8ce1-1e3ce24b6946 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:51.902639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae180399-9f10-4ae6-8ce1-1e3ce24b6946 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] PATH_INFO: `/v3/policies` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:51.906550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae180399-9f10-4ae6-8ce1-1e3ce24b6946 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:51.910320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae180399-9f10-4ae6-8ce1-1e3ce24b6946 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:52.063426 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3057/6105] 10.222.0.16 () {60 vars in 1151 bytes} [Mon May 2 10:41:51 2022] POST /identity/v3/policies => generated 229 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:41:52.068100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5b8db-afc4-4d97-9755-7dc6397c80c9 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:52.089641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5b8db-afc4-4d97-9755-7dc6397c80c9 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:52.111337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec337fc-62d6-4c9c-9496-a52f87404508 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8e8c961ee1c4a8b8cbd0574739de58e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e4cf00aaf6748898564a431b61d0b1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:52.112896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec337fc-62d6-4c9c-9496-a52f87404508 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:52.113763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec337fc-62d6-4c9c-9496-a52f87404508 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:52.114232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec337fc-62d6-4c9c-9496-a52f87404508 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] PATH_INFO: `/v3/policies` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:52.115394 ncdv-master-1 devstack@keystone.service[91119]: WARNING oslo_log.versionutils [None req-aec337fc-62d6-4c9c-9496-a52f87404508 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. May 02 10:41:52.116095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec337fc-62d6-4c9c-9496-a52f87404508 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:52.117693 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-aec337fc-62d6-4c9c-9496-a52f87404508 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:41:52.117693 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:41:52.117693 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:41:52.118947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec337fc-62d6-4c9c-9496-a52f87404508 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:52.236069 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3049/6106] 10.222.0.16 () {60 vars in 1151 bytes} [Mon May 2 10:41:52 2022] POST /identity/v3/policies => generated 229 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:52.241752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae180399-9f10-4ae6-8ce1-1e3ce24b6946 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:52.257843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae180399-9f10-4ae6-8ce1-1e3ce24b6946 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:52.282701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f495e-8f33-4351-b651-70fe15843db2 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8e8c961ee1c4a8b8cbd0574739de58e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e4cf00aaf6748898564a431b61d0b1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:52.284027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f495e-8f33-4351-b651-70fe15843db2 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:52.284387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f495e-8f33-4351-b651-70fe15843db2 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:52.284811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f495e-8f33-4351-b651-70fe15843db2 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] PATH_INFO: `/v3/policies` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:52.286468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f495e-8f33-4351-b651-70fe15843db2 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:52.288371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f495e-8f33-4351-b651-70fe15843db2 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:52.392742 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3058/6107] 10.222.0.16 () {60 vars in 1151 bytes} [Mon May 2 10:41:52 2022] POST /identity/v3/policies => generated 229 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:52.394821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec337fc-62d6-4c9c-9496-a52f87404508 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:52.414221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec337fc-62d6-4c9c-9496-a52f87404508 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:52.420899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389bfcd-e010-4488-b0cf-b82894d54499 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8e8c961ee1c4a8b8cbd0574739de58e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e4cf00aaf6748898564a431b61d0b1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:52.422377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389bfcd-e010-4488-b0cf-b82894d54499 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:52.422770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389bfcd-e010-4488-b0cf-b82894d54499 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:52.423090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389bfcd-e010-4488-b0cf-b82894d54499 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] PATH_INFO: `/v3/policies` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:52.423894 ncdv-master-1 devstack@keystone.service[91119]: WARNING oslo_log.versionutils [None req-e389bfcd-e010-4488-b0cf-b82894d54499 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. May 02 10:41:52.425276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389bfcd-e010-4488-b0cf-b82894d54499 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:52.427776 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-e389bfcd-e010-4488-b0cf-b82894d54499 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:41:52.427776 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:41:52.427776 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:41:52.430672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389bfcd-e010-4488-b0cf-b82894d54499 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:52.445727 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3050/6108] 10.222.0.16 () {58 vars in 1130 bytes} [Mon May 2 10:41:52 2022] GET /identity/v3/policies => generated 763 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:41:52.450146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f495e-8f33-4351-b651-70fe15843db2 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:52.461341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f495e-8f33-4351-b651-70fe15843db2 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:52.497678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c5b1d-a31c-49c9-8d8d-2d728c4d4ab9 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8e8c961ee1c4a8b8cbd0574739de58e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e4cf00aaf6748898564a431b61d0b1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:52.497678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c5b1d-a31c-49c9-8d8d-2d728c4d4ab9 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:52.497678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c5b1d-a31c-49c9-8d8d-2d728c4d4ab9 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:52.498252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c5b1d-a31c-49c9-8d8d-2d728c4d4ab9 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] PATH_INFO: `/v3/policies/2e143fa58baa4297ae912168abf76513` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:52.499514 ncdv-master-1 devstack@keystone.service[91118]: WARNING oslo_log.versionutils [None req-5b2c5b1d-a31c-49c9-8d8d-2d728c4d4ab9 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. May 02 10:41:52.500362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c5b1d-a31c-49c9-8d8d-2d728c4d4ab9 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=2e143fa58baa4297ae912168abf76513)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:52.502866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e0e56-5ea6-409f-baa5-4a2f3bfaf90c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:52.503295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e0e56-5ea6-409f-baa5-4a2f3bfaf90c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:52.503679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e0e56-5ea6-409f-baa5-4a2f3bfaf90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:52.519539 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-5b2c5b1d-a31c-49c9-8d8d-2d728c4d4ab9 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:41:52.519539 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:41:52.519539 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:41:52.525561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c5b1d-a31c-49c9-8d8d-2d728c4d4ab9 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:52.538529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-bf3e0e56-5ea6-409f-baa5-4a2f3bfaf90c None None] MFA Rules not processed for user `26723e7d6f3d44a4951432f45c89021a`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:52.540334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bf3e0e56-5ea6-409f-baa5-4a2f3bfaf90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:52.610392 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3059/6109] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:41:52 2022] DELETE /identity/v3/policies/2e143fa58baa4297ae912168abf76513 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:52.615420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c5b1d-a31c-49c9-8d8d-2d728c4d4ab9 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:52.646244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c5b1d-a31c-49c9-8d8d-2d728c4d4ab9 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:52.647703 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3051/6110] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:41:52.655771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97251f61-5b2f-4dda-be23-247a039c7f47 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8e8c961ee1c4a8b8cbd0574739de58e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e4cf00aaf6748898564a431b61d0b1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:52.656932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97251f61-5b2f-4dda-be23-247a039c7f47 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:52.657431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97251f61-5b2f-4dda-be23-247a039c7f47 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:52.657874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97251f61-5b2f-4dda-be23-247a039c7f47 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] PATH_INFO: `/v3/policies/a4d474c54181409eace595bd917bbd95` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:52.659958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97251f61-5b2f-4dda-be23-247a039c7f47 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=a4d474c54181409eace595bd917bbd95)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:52.668552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97251f61-5b2f-4dda-be23-247a039c7f47 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:52.757550 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3060/6111] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:41:52 2022] DELETE /identity/v3/policies/a4d474c54181409eace595bd917bbd95 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:52.761851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e0e56-5ea6-409f-baa5-4a2f3bfaf90c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:52.775457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e0e56-5ea6-409f-baa5-4a2f3bfaf90c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:52.792083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad6ea0-d157-4a8b-8b2f-2290f3f28f6f tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8e8c961ee1c4a8b8cbd0574739de58e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e4cf00aaf6748898564a431b61d0b1f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:52.793015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad6ea0-d157-4a8b-8b2f-2290f3f28f6f tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:52.793303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad6ea0-d157-4a8b-8b2f-2290f3f28f6f tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:52.793806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad6ea0-d157-4a8b-8b2f-2290f3f28f6f tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] PATH_INFO: `/v3/policies/78baa459a5224ec9a917b2e79e3ae479` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:52.795059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad6ea0-d157-4a8b-8b2f-2290f3f28f6f tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=78baa459a5224ec9a917b2e79e3ae479)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:52.798460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad6ea0-d157-4a8b-8b2f-2290f3f28f6f tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:52.905330 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3052/6112] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:41:52 2022] DELETE /identity/v3/policies/78baa459a5224ec9a917b2e79e3ae479 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:52.911520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97251f61-5b2f-4dda-be23-247a039c7f47 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:52.984985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97251f61-5b2f-4dda-be23-247a039c7f47 tempest-PoliciesTestJSON-1054210180 tempest-PoliciesTestJSON-1054210180-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:52.989729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ff683-74f4-4a44-ac44-80145c8d9edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:52.990631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ff683-74f4-4a44-ac44-80145c8d9edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:52.990920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ff683-74f4-4a44-ac44-80145c8d9edd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:52.991201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ff683-74f4-4a44-ac44-80145c8d9edd admin admin] PATH_INFO: `/v3/users/77e560ed869842ea8cc9a89515cb1b27` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:52.992665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ff683-74f4-4a44-ac44-80145c8d9edd admin admin] RBAC: Authorizing `identity:delete_user(user_id=77e560ed869842ea8cc9a89515cb1b27)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:52.994713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ff683-74f4-4a44-ac44-80145c8d9edd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:53.340515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b84ff683-74f4-4a44-ac44-80145c8d9edd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77e560ed869842ea8cc9a89515cb1b27'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:53.375232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b84ff683-74f4-4a44-ac44-80145c8d9edd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77e560ed869842ea8cc9a89515cb1b27'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:53.379947 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b84ff683-74f4-4a44-ac44-80145c8d9edd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77e560ed869842ea8cc9a89515cb1b27'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:53.398168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b84ff683-74f4-4a44-ac44-80145c8d9edd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77e560ed869842ea8cc9a89515cb1b27'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:53.506959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b84ff683-74f4-4a44-ac44-80145c8d9edd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77e560ed869842ea8cc9a89515cb1b27'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:53.513735 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3061/6113] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:41:52 2022] DELETE /identity/v3/users/77e560ed869842ea8cc9a89515cb1b27 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:53.518922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05226b80-cc2c-4b03-a899-c4179fcb3f0c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:53.519759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05226b80-cc2c-4b03-a899-c4179fcb3f0c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:53.520048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05226b80-cc2c-4b03-a899-c4179fcb3f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:53.544268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-05226b80-cc2c-4b03-a899-c4179fcb3f0c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:53.546006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-05226b80-cc2c-4b03-a899-c4179fcb3f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:53.642222 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3053/6114] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:53.656911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ff683-74f4-4a44-ac44-80145c8d9edd admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:53.659310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b84ff683-74f4-4a44-ac44-80145c8d9edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:53.749557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ff683-74f4-4a44-ac44-80145c8d9edd admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:53.754228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9c97d-7080-4e33-8ea0-49b809979894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:53.754959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9c97d-7080-4e33-8ea0-49b809979894 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:53.755267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9c97d-7080-4e33-8ea0-49b809979894 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:53.755452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9c97d-7080-4e33-8ea0-49b809979894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:53.767135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9c97d-7080-4e33-8ea0-49b809979894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:53.769264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9c97d-7080-4e33-8ea0-49b809979894 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:53.779717 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3062/6115] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:41:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:41:54.346371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05226b80-cc2c-4b03-a899-c4179fcb3f0c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:54.348460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-05226b80-cc2c-4b03-a899-c4179fcb3f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:54.364191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05226b80-cc2c-4b03-a899-c4179fcb3f0c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:54.370748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e651e4-a7ed-44e3-81ed-0d53460e7921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:54.371923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e651e4-a7ed-44e3-81ed-0d53460e7921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:54.372449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e651e4-a7ed-44e3-81ed-0d53460e7921 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:54.372986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e651e4-a7ed-44e3-81ed-0d53460e7921 admin admin] PATH_INFO: `/v3/projects/e88c96fad7e9420fba6420a910194224` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:54.374459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e651e4-a7ed-44e3-81ed-0d53460e7921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e88c96fad7e9420fba6420a910194224)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:54.376825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e651e4-a7ed-44e3-81ed-0d53460e7921 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:54.519100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-70e651e4-a7ed-44e3-81ed-0d53460e7921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e88c96fad7e9420fba6420a910194224', 'request_id': 'req-70e651e4-a7ed-44e3-81ed-0d53460e7921'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:54.529601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-70e651e4-a7ed-44e3-81ed-0d53460e7921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e88c96fad7e9420fba6420a910194224', 'request_id': 'req-70e651e4-a7ed-44e3-81ed-0d53460e7921'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:54.613917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-70e651e4-a7ed-44e3-81ed-0d53460e7921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e88c96fad7e9420fba6420a910194224', 'request_id': 'req-70e651e4-a7ed-44e3-81ed-0d53460e7921'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:54.638587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-70e651e4-a7ed-44e3-81ed-0d53460e7921 admin admin] The token cache is being invalidate because project e88c96fad7e9420fba6420a910194224 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:41:54.638889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-70e651e4-a7ed-44e3-81ed-0d53460e7921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:54.639903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-70e651e4-a7ed-44e3-81ed-0d53460e7921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:54.645923 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3054/6116] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:41:54 2022] DELETE /identity/v3/projects/e88c96fad7e9420fba6420a910194224 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:54.650839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9c97d-7080-4e33-8ea0-49b809979894 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:54.664975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9c97d-7080-4e33-8ea0-49b809979894 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:54.744335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183b78a-de11-4ace-add9-51a8378f7523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:54.747109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183b78a-de11-4ace-add9-51a8378f7523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:54.747927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183b78a-de11-4ace-add9-51a8378f7523 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:54.748281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183b78a-de11-4ace-add9-51a8378f7523 admin admin] PATH_INFO: `/v3/users/d8e8c961ee1c4a8b8cbd0574739de58e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:54.750727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183b78a-de11-4ace-add9-51a8378f7523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8e8c961ee1c4a8b8cbd0574739de58e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:54.753712 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183b78a-de11-4ace-add9-51a8378f7523 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:55.023063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5183b78a-de11-4ace-add9-51a8378f7523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8e8c961ee1c4a8b8cbd0574739de58e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:55.037427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5183b78a-de11-4ace-add9-51a8378f7523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8e8c961ee1c4a8b8cbd0574739de58e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:55.038339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5183b78a-de11-4ace-add9-51a8378f7523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8e8c961ee1c4a8b8cbd0574739de58e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:55.050629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5183b78a-de11-4ace-add9-51a8378f7523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8e8c961ee1c4a8b8cbd0574739de58e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:55.136180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5183b78a-de11-4ace-add9-51a8378f7523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8e8c961ee1c4a8b8cbd0574739de58e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:55.145433 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3063/6117] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:41:54 2022] DELETE /identity/v3/users/d8e8c961ee1c4a8b8cbd0574739de58e => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:55.647247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e651e4-a7ed-44e3-81ed-0d53460e7921 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:55.652839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-70e651e4-a7ed-44e3-81ed-0d53460e7921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:55.665703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e651e4-a7ed-44e3-81ed-0d53460e7921 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:55.768858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc0711-377d-41d6-a35d-ffffcea10fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:55.769893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc0711-377d-41d6-a35d-ffffcea10fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:55.770185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc0711-377d-41d6-a35d-ffffcea10fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:55.770461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc0711-377d-41d6-a35d-ffffcea10fe1 admin admin] PATH_INFO: `/v3/projects/6e4cf00aaf6748898564a431b61d0b1f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:55.771709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc0711-377d-41d6-a35d-ffffcea10fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e4cf00aaf6748898564a431b61d0b1f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:55.773763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc0711-377d-41d6-a35d-ffffcea10fe1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:55.986371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b5fc0711-377d-41d6-a35d-ffffcea10fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e4cf00aaf6748898564a431b61d0b1f', 'request_id': 'req-b5fc0711-377d-41d6-a35d-ffffcea10fe1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:55.995829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b5fc0711-377d-41d6-a35d-ffffcea10fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e4cf00aaf6748898564a431b61d0b1f', 'request_id': 'req-b5fc0711-377d-41d6-a35d-ffffcea10fe1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:56.145460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b5fc0711-377d-41d6-a35d-ffffcea10fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e4cf00aaf6748898564a431b61d0b1f', 'request_id': 'req-b5fc0711-377d-41d6-a35d-ffffcea10fe1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:56.175610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b5fc0711-377d-41d6-a35d-ffffcea10fe1 admin admin] The token cache is being invalidate because project 6e4cf00aaf6748898564a431b61d0b1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:41:56.175983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b5fc0711-377d-41d6-a35d-ffffcea10fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:56.176953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b5fc0711-377d-41d6-a35d-ffffcea10fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:56.183450 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3055/6118] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:41:55 2022] DELETE /identity/v3/projects/6e4cf00aaf6748898564a431b61d0b1f => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:56.184452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc87c7-6360-42bd-a74e-6f340409e824 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:56.184967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc87c7-6360-42bd-a74e-6f340409e824 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:56.185131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc87c7-6360-42bd-a74e-6f340409e824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:56.225446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-03dc87c7-6360-42bd-a74e-6f340409e824 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:56.229555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-03dc87c7-6360-42bd-a74e-6f340409e824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:56.308005 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3064/6119] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:56.318025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6947e-67b2-486c-9f34-f053043ee01a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:56.318570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6947e-67b2-486c-9f34-f053043ee01a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:56.318849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6947e-67b2-486c-9f34-f053043ee01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:56.338729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-75f6947e-67b2-486c-9f34-f053043ee01a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:56.339949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-75f6947e-67b2-486c-9f34-f053043ee01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:56.351423 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3056/6120] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:56.355717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc87c7-6360-42bd-a74e-6f340409e824 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:56.365886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc87c7-6360-42bd-a74e-6f340409e824 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:56.371176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952fb30-ed45-43c0-9c01-5a0839c8c270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:56.372069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952fb30-ed45-43c0-9c01-5a0839c8c270 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:56.373057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952fb30-ed45-43c0-9c01-5a0839c8c270 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:56.373464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952fb30-ed45-43c0-9c01-5a0839c8c270 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:56.374862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952fb30-ed45-43c0-9c01-5a0839c8c270 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:41:56.375210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952fb30-ed45-43c0-9c01-5a0839c8c270 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:56.377867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952fb30-ed45-43c0-9c01-5a0839c8c270 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:56.402019 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3065/6121] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:41:56.406545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6947e-67b2-486c-9f34-f053043ee01a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:56.425851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6947e-67b2-486c-9f34-f053043ee01a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:56.432473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79d872-1cb8-407c-906a-43cf7bb9d01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:56.433577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79d872-1cb8-407c-906a-43cf7bb9d01a admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:56.434080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79d872-1cb8-407c-906a-43cf7bb9d01a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:56.436726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79d872-1cb8-407c-906a-43cf7bb9d01a admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:56.436726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79d872-1cb8-407c-906a-43cf7bb9d01a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:56.437554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79d872-1cb8-407c-906a-43cf7bb9d01a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:56.575110 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3057/6122] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:41:56 2022] POST /identity/v3/projects => generated 365 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:56.576741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952fb30-ed45-43c0-9c01-5a0839c8c270 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:56.587352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952fb30-ed45-43c0-9c01-5a0839c8c270 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:56.661372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500b333-126d-44d2-abaa-5872eb9ee20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:56.662459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500b333-126d-44d2-abaa-5872eb9ee20e admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:56.662942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500b333-126d-44d2-abaa-5872eb9ee20e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:56.663372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500b333-126d-44d2-abaa-5872eb9ee20e admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:56.664285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500b333-126d-44d2-abaa-5872eb9ee20e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:56.666587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500b333-126d-44d2-abaa-5872eb9ee20e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:56.761018 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3066/6123] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:41:56 2022] POST /identity/v3/users => generated 283 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:56.761214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79d872-1cb8-407c-906a-43cf7bb9d01a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:56.770912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79d872-1cb8-407c-906a-43cf7bb9d01a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:56.785991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6469-46ef-429a-81cc-6dd94215203e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:56.786940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6469-46ef-429a-81cc-6dd94215203e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:56.787231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6469-46ef-429a-81cc-6dd94215203e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:56.787496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6469-46ef-429a-81cc-6dd94215203e admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:56.788260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab6469-46ef-429a-81cc-6dd94215203e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:56.789917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab6469-46ef-429a-81cc-6dd94215203e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:56.805418 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3058/6124] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:41:56.806747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500b333-126d-44d2-abaa-5872eb9ee20e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:56.820069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500b333-126d-44d2-abaa-5872eb9ee20e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:56.829728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a97ee7-9445-4b54-9304-437c4188b5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:56.831020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a97ee7-9445-4b54-9304-437c4188b5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:56.831337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a97ee7-9445-4b54-9304-437c4188b5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:56.831656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a97ee7-9445-4b54-9304-437c4188b5f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:56.832370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a97ee7-9445-4b54-9304-437c4188b5f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:56.834017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a97ee7-9445-4b54-9304-437c4188b5f8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:56.848665 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3067/6125] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:41:56.851275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6469-46ef-429a-81cc-6dd94215203e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:56.862850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6469-46ef-429a-81cc-6dd94215203e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:56.870939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5189e3-af22-4fb4-a2e4-da818ecdf4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:56.871889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5189e3-af22-4fb4-a2e4-da818ecdf4db admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:56.872174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5189e3-af22-4fb4-a2e4-da818ecdf4db admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:56.872459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5189e3-af22-4fb4-a2e4-da818ecdf4db admin admin] PATH_INFO: `/v3/projects/ceb346b9485f4466beedfa010534d71a/users/ffbd616e93bf49bb9ce6f37106782799/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:56.901022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5189e3-af22-4fb4-a2e4-da818ecdf4db admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb346b9485f4466beedfa010534d71a, user_id=ffbd616e93bf49bb9ce6f37106782799, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:56.909029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5189e3-af22-4fb4-a2e4-da818ecdf4db admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:57.003913 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3059/6126] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:41:56 2022] PUT /identity/v3/projects/ceb346b9485f4466beedfa010534d71a/users/ffbd616e93bf49bb9ce6f37106782799/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:41:57.014273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76f250-e3f7-490f-ab84-43d0da8f28e8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:57.014695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76f250-e3f7-490f-ab84-43d0da8f28e8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:57.015769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76f250-e3f7-490f-ab84-43d0da8f28e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:57.079388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-dc76f250-e3f7-490f-ab84-43d0da8f28e8 None None] MFA Rules not processed for user `ffbd616e93bf49bb9ce6f37106782799`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:57.081594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dc76f250-e3f7-490f-ab84-43d0da8f28e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:57.213002 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3068/6127] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:57.217233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5189e3-af22-4fb4-a2e4-da818ecdf4db admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:57.339963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5189e3-af22-4fb4-a2e4-da818ecdf4db admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:57.347011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261db3d1-bba0-43a0-929a-239c097b0fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:57.350330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261db3d1-bba0-43a0-929a-239c097b0fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:57.350783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261db3d1-bba0-43a0-929a-239c097b0fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:57.351077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261db3d1-bba0-43a0-929a-239c097b0fd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:57.351966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261db3d1-bba0-43a0-929a-239c097b0fd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:57.354053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261db3d1-bba0-43a0-929a-239c097b0fd9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:57.452307 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3060/6128] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:41:57 2022] POST /identity/v3/projects => generated 365 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:57.457002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76f250-e3f7-490f-ab84-43d0da8f28e8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:57.472481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76f250-e3f7-490f-ab84-43d0da8f28e8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:57.591754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f2936-d120-4070-84b3-c5a5322489c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:57.592784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f2936-d120-4070-84b3-c5a5322489c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:57.593243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f2936-d120-4070-84b3-c5a5322489c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:57.593690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f2936-d120-4070-84b3-c5a5322489c2 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:57.594671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f2936-d120-4070-84b3-c5a5322489c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:57.596991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f2936-d120-4070-84b3-c5a5322489c2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:57.731655 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3069/6129] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:41:57 2022] POST /identity/v3/users => generated 289 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:57.735383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261db3d1-bba0-43a0-929a-239c097b0fd9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:57.747909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261db3d1-bba0-43a0-929a-239c097b0fd9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:57.764447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c7644-df97-4fd2-a406-70d2e80c65e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:57.765188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c7644-df97-4fd2-a406-70d2e80c65e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:57.765483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c7644-df97-4fd2-a406-70d2e80c65e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:57.765947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c7644-df97-4fd2-a406-70d2e80c65e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:57.766856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c7644-df97-4fd2-a406-70d2e80c65e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:57.774366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c7644-df97-4fd2-a406-70d2e80c65e8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:57.804728 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3061/6130] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:41:57.809120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f2936-d120-4070-84b3-c5a5322489c2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:57.823323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f2936-d120-4070-84b3-c5a5322489c2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:57.828332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f035a-f3e3-4847-99c7-0a6e17b49059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:57.829515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f035a-f3e3-4847-99c7-0a6e17b49059 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:57.829956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f035a-f3e3-4847-99c7-0a6e17b49059 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:57.831011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f035a-f3e3-4847-99c7-0a6e17b49059 admin admin] PATH_INFO: `/v3/projects/b293d2ff0bea4cee97dd2c27267dd2e7/users/d77d5f6cd50140aabc28df507cba8b22/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:57.853086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f035a-f3e3-4847-99c7-0a6e17b49059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b293d2ff0bea4cee97dd2c27267dd2e7, user_id=d77d5f6cd50140aabc28df507cba8b22, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:57.856578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f035a-f3e3-4847-99c7-0a6e17b49059 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:57.926117 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3070/6131] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:41:57 2022] PUT /identity/v3/projects/b293d2ff0bea4cee97dd2c27267dd2e7/users/d77d5f6cd50140aabc28df507cba8b22/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:41:57.930762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c7644-df97-4fd2-a406-70d2e80c65e8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:57.952372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c7644-df97-4fd2-a406-70d2e80c65e8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:58.038481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15656a4-589a-4af0-9885-4bb846040f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:58.039410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15656a4-589a-4af0-9885-4bb846040f7e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:58.039747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15656a4-589a-4af0-9885-4bb846040f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:58.040032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15656a4-589a-4af0-9885-4bb846040f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:58.042293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15656a4-589a-4af0-9885-4bb846040f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:58.042898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15656a4-589a-4af0-9885-4bb846040f7e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:58.060172 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3062/6132] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:41:58.061658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f035a-f3e3-4847-99c7-0a6e17b49059 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:58.091675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f035a-f3e3-4847-99c7-0a6e17b49059 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:58.108742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53afea1-fc24-490f-9f6c-1c0220c8a7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:58.110037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53afea1-fc24-490f-9f6c-1c0220c8a7d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:58.120208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53afea1-fc24-490f-9f6c-1c0220c8a7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:58.120208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53afea1-fc24-490f-9f6c-1c0220c8a7d2 admin admin] PATH_INFO: `/v3/projects/b293d2ff0bea4cee97dd2c27267dd2e7/users/d77d5f6cd50140aabc28df507cba8b22/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:58.120532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53afea1-fc24-490f-9f6c-1c0220c8a7d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b293d2ff0bea4cee97dd2c27267dd2e7, user_id=d77d5f6cd50140aabc28df507cba8b22, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:58.124273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53afea1-fc24-490f-9f6c-1c0220c8a7d2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:58.145819 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3071/6133] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:41:58 2022] PUT /identity/v3/projects/b293d2ff0bea4cee97dd2c27267dd2e7/users/d77d5f6cd50140aabc28df507cba8b22/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:41:58.159152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8fa26-7a43-4d87-96c4-56e96df8e69c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:58.159443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8fa26-7a43-4d87-96c4-56e96df8e69c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:58.159748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8fa26-7a43-4d87-96c4-56e96df8e69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:58.206830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-24f8fa26-7a43-4d87-96c4-56e96df8e69c None None] MFA Rules not processed for user `d77d5f6cd50140aabc28df507cba8b22`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:41:58.209456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-24f8fa26-7a43-4d87-96c4-56e96df8e69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:58.340717 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3063/6134] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:41:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:41:58.346914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53afea1-fc24-490f-9f6c-1c0220c8a7d2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:58.379276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53afea1-fc24-490f-9f6c-1c0220c8a7d2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:58.402003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98d88e-a11e-422d-ad34-95110ce069a8 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:58.404024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98d88e-a11e-422d-ad34-95110ce069a8 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:58.404480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98d88e-a11e-422d-ad34-95110ce069a8 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:58.404966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98d88e-a11e-422d-ad34-95110ce069a8 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:58.405853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98d88e-a11e-422d-ad34-95110ce069a8 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:58.408034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98d88e-a11e-422d-ad34-95110ce069a8 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:58.597116 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3072/6135] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:41:58 2022] POST /identity/v3/projects => generated 358 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:58.602369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8fa26-7a43-4d87-96c4-56e96df8e69c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:58.621522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8fa26-7a43-4d87-96c4-56e96df8e69c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:58.734644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d6887-5678-4329-a5e7-d9060c30820a tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:58.736344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d6887-5678-4329-a5e7-d9060c30820a tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:58.737281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d6887-5678-4329-a5e7-d9060c30820a tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:58.737883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d6887-5678-4329-a5e7-d9060c30820a tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:58.740006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d6887-5678-4329-a5e7-d9060c30820a tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:58.742369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d6887-5678-4329-a5e7-d9060c30820a tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:58.908844 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3064/6136] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:41:58 2022] POST /identity/v3/users => generated 373 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:41:58.911561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98d88e-a11e-422d-ad34-95110ce069a8 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:58.949223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98d88e-a11e-422d-ad34-95110ce069a8 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:58.969115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d910d-ea02-4674-a0db-0d9e40a88987 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:58.969115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d910d-ea02-4674-a0db-0d9e40a88987 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:58.969115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d910d-ea02-4674-a0db-0d9e40a88987 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:58.969480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d910d-ea02-4674-a0db-0d9e40a88987 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/users/0eb89f84fba446e38894cddbc83a2dbd` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:59.012529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d910d-ea02-4674-a0db-0d9e40a88987 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:get_user(user_id=0eb89f84fba446e38894cddbc83a2dbd)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:59.015280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d910d-ea02-4674-a0db-0d9e40a88987 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:59.025865 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3073/6137] 10.222.0.16 () {58 vars in 1220 bytes} [Mon May 2 10:41:58 2022] GET /identity/v3/users/0eb89f84fba446e38894cddbc83a2dbd => generated 373 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:41:59.030774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d6887-5678-4329-a5e7-d9060c30820a tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:59.053879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d6887-5678-4329-a5e7-d9060c30820a tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:59.071261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d3053-870e-4779-a860-6bc74863f14b tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:59.072441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d3053-870e-4779-a860-6bc74863f14b tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:59.074417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d3053-870e-4779-a860-6bc74863f14b tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:59.074954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d3053-870e-4779-a860-6bc74863f14b tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/users/0eb89f84fba446e38894cddbc83a2dbd` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:59.077983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d3053-870e-4779-a860-6bc74863f14b tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0eb89f84fba446e38894cddbc83a2dbd)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:59.083585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d3053-870e-4779-a860-6bc74863f14b tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:59.282461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4b5d3053-870e-4779-a860-6bc74863f14b tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eb89f84fba446e38894cddbc83a2dbd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:59.304527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4b5d3053-870e-4779-a860-6bc74863f14b tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eb89f84fba446e38894cddbc83a2dbd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:59.305790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4b5d3053-870e-4779-a860-6bc74863f14b tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eb89f84fba446e38894cddbc83a2dbd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:59.315317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4b5d3053-870e-4779-a860-6bc74863f14b tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eb89f84fba446e38894cddbc83a2dbd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:59.394194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4b5d3053-870e-4779-a860-6bc74863f14b tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eb89f84fba446e38894cddbc83a2dbd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:59.402983 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3065/6138] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:41:59 2022] DELETE /identity/v3/users/0eb89f84fba446e38894cddbc83a2dbd => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:41:59.407341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d910d-ea02-4674-a0db-0d9e40a88987 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:59.409561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6a8d910d-ea02-4674-a0db-0d9e40a88987 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:41:59.426023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d910d-ea02-4674-a0db-0d9e40a88987 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:59.529332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9457471-6a69-4e13-ae9c-3ced2e42a62c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:59.531352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9457471-6a69-4e13-ae9c-3ced2e42a62c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:59.533376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9457471-6a69-4e13-ae9c-3ced2e42a62c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:59.536413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9457471-6a69-4e13-ae9c-3ced2e42a62c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/projects/2e59ba95efa046b99731cdf85d1b75dc` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:59.536413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9457471-6a69-4e13-ae9c-3ced2e42a62c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2e59ba95efa046b99731cdf85d1b75dc)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:59.537203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9457471-6a69-4e13-ae9c-3ced2e42a62c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:41:59.686885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f9457471-6a69-4e13-ae9c-3ced2e42a62c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e59ba95efa046b99731cdf85d1b75dc', 'request_id': 'req-f9457471-6a69-4e13-ae9c-3ced2e42a62c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:59.785961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f9457471-6a69-4e13-ae9c-3ced2e42a62c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e59ba95efa046b99731cdf85d1b75dc', 'request_id': 'req-f9457471-6a69-4e13-ae9c-3ced2e42a62c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:59.793671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f9457471-6a69-4e13-ae9c-3ced2e42a62c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e59ba95efa046b99731cdf85d1b75dc', 'request_id': 'req-f9457471-6a69-4e13-ae9c-3ced2e42a62c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:59.808142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f9457471-6a69-4e13-ae9c-3ced2e42a62c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] The token cache is being invalidate because project 2e59ba95efa046b99731cdf85d1b75dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:41:59.808793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f9457471-6a69-4e13-ae9c-3ced2e42a62c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:59.818033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f9457471-6a69-4e13-ae9c-3ced2e42a62c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:41:59.818033 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3074/6139] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:41:59 2022] DELETE /identity/v3/projects/2e59ba95efa046b99731cdf85d1b75dc => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:41:59.818354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d3053-870e-4779-a860-6bc74863f14b tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:41:59.832284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d3053-870e-4779-a860-6bc74863f14b tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:41:59.912234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbee65e-7ae4-46a5-8970-2b7e20b87290 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:41:59.916120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbee65e-7ae4-46a5-8970-2b7e20b87290 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:41:59.916527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbee65e-7ae4-46a5-8970-2b7e20b87290 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:41:59.922067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbee65e-7ae4-46a5-8970-2b7e20b87290 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:41:59.922067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbee65e-7ae4-46a5-8970-2b7e20b87290 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:41:59.922067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbee65e-7ae4-46a5-8970-2b7e20b87290 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:00.058277 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3066/6140] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:41:59 2022] POST /identity/v3/projects => generated 359 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:42:00.059355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9457471-6a69-4e13-ae9c-3ced2e42a62c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:00.060781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f9457471-6a69-4e13-ae9c-3ced2e42a62c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:00.073866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9457471-6a69-4e13-ae9c-3ced2e42a62c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:00.147410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c08ad2-91a0-4021-8f63-1023107f6f0f tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:00.148137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c08ad2-91a0-4021-8f63-1023107f6f0f tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:00.148430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c08ad2-91a0-4021-8f63-1023107f6f0f tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:00.148750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c08ad2-91a0-4021-8f63-1023107f6f0f tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:00.149498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c08ad2-91a0-4021-8f63-1023107f6f0f tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:00.151359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c08ad2-91a0-4021-8f63-1023107f6f0f tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:00.206871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbee65e-7ae4-46a5-8970-2b7e20b87290 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:00.209052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-edbee65e-7ae4-46a5-8970-2b7e20b87290 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:00.272203 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3075/6141] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:42:00 2022] POST /identity/v3/users => generated 417 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:42:00.276572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c08ad2-91a0-4021-8f63-1023107f6f0f tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:00.287915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c08ad2-91a0-4021-8f63-1023107f6f0f tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:00.294185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf33ec-ae2c-4236-a204-3ff1562d44cb tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:00.294887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf33ec-ae2c-4236-a204-3ff1562d44cb tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:00.295180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf33ec-ae2c-4236-a204-3ff1562d44cb tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:00.295473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf33ec-ae2c-4236-a204-3ff1562d44cb tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:00.296229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf33ec-ae2c-4236-a204-3ff1562d44cb tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:00.298335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf33ec-ae2c-4236-a204-3ff1562d44cb tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:00.330884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbee65e-7ae4-46a5-8970-2b7e20b87290 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:00.337541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0099da-1db4-4f61-890e-5b8e06e78ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:00.338602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0099da-1db4-4f61-890e-5b8e06e78ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:00.338954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0099da-1db4-4f61-890e-5b8e06e78ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:00.339300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0099da-1db4-4f61-890e-5b8e06e78ca1 admin admin] PATH_INFO: `/v3/users/fe7b70a089c440d98bec17a6f1499a1e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:00.340654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0099da-1db4-4f61-890e-5b8e06e78ca1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe7b70a089c440d98bec17a6f1499a1e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:00.343386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0099da-1db4-4f61-890e-5b8e06e78ca1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:00.423201 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3076/6142] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:42:00 2022] POST /identity/v3/roles => generated 240 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:42:00.428852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf33ec-ae2c-4236-a204-3ff1562d44cb tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:00.438819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf33ec-ae2c-4236-a204-3ff1562d44cb tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:00.443889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9b7a2-ead4-4c69-ad1a-62c18bcfa4f4 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:00.444810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9b7a2-ead4-4c69-ad1a-62c18bcfa4f4 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:00.445125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9b7a2-ead4-4c69-ad1a-62c18bcfa4f4 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:00.445693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9b7a2-ead4-4c69-ad1a-62c18bcfa4f4 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/users/ed74a4fadb1942da9e89d3a689bbd8df` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:00.464838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9b7a2-ead4-4c69-ad1a-62c18bcfa4f4 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:get_user(user_id=ed74a4fadb1942da9e89d3a689bbd8df)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:00.467142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9b7a2-ead4-4c69-ad1a-62c18bcfa4f4 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:00.469154 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3077/6143] 10.222.0.16 () {58 vars in 1220 bytes} [Mon May 2 10:42:00 2022] GET /identity/v3/users/ed74a4fadb1942da9e89d3a689bbd8df => generated 417 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:42:00.473449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9b7a2-ead4-4c69-ad1a-62c18bcfa4f4 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:00.485665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9b7a2-ead4-4c69-ad1a-62c18bcfa4f4 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:00.492984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eddc62-d718-454c-9f28-03df978588d5 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:00.494380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eddc62-d718-454c-9f28-03df978588d5 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:00.494832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eddc62-d718-454c-9f28-03df978588d5 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:00.495436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eddc62-d718-454c-9f28-03df978588d5 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/roles/31d2d723b4b14af3a013ac3e5bcc6b40` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:00.497438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eddc62-d718-454c-9f28-03df978588d5 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:get_role(role_id=31d2d723b4b14af3a013ac3e5bcc6b40)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:00.498454 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-08eddc62-d718-454c-9f28-03df978588d5 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:42:00.498454 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:42:00.498454 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:42:00.499373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eddc62-d718-454c-9f28-03df978588d5 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:00.508445 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3078/6144] 10.222.0.16 () {58 vars in 1220 bytes} [Mon May 2 10:42:00 2022] GET /identity/v3/roles/31d2d723b4b14af3a013ac3e5bcc6b40 => generated 240 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:42:00.509619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eddc62-d718-454c-9f28-03df978588d5 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:00.521774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eddc62-d718-454c-9f28-03df978588d5 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:00.535567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b88e30-3d13-4a43-87ba-3f18f8d7cd00 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:00.535567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b88e30-3d13-4a43-87ba-3f18f8d7cd00 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:00.535567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b88e30-3d13-4a43-87ba-3f18f8d7cd00 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:00.535864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b88e30-3d13-4a43-87ba-3f18f8d7cd00 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:00.536197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b88e30-3d13-4a43-87ba-3f18f8d7cd00 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:00.538366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b88e30-3d13-4a43-87ba-3f18f8d7cd00 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:00.577984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ce0099da-1db4-4f61-890e-5b8e06e78ca1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe7b70a089c440d98bec17a6f1499a1e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:00.592084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ce0099da-1db4-4f61-890e-5b8e06e78ca1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe7b70a089c440d98bec17a6f1499a1e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:00.592988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ce0099da-1db4-4f61-890e-5b8e06e78ca1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe7b70a089c440d98bec17a6f1499a1e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:00.603500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ce0099da-1db4-4f61-890e-5b8e06e78ca1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe7b70a089c440d98bec17a6f1499a1e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:00.654676 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3079/6145] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:42:00 2022] POST /identity/v3/projects => generated 360 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:42:00.656112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b88e30-3d13-4a43-87ba-3f18f8d7cd00 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:00.687420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ce0099da-1db4-4f61-890e-5b8e06e78ca1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe7b70a089c440d98bec17a6f1499a1e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:00.695616 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3067/6146] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:42:00 2022] DELETE /identity/v3/users/fe7b70a089c440d98bec17a6f1499a1e => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:00.700074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1409b-601d-4c83-960a-e9cc36d6627e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:00.700445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1409b-601d-4c83-960a-e9cc36d6627e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:00.700856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1409b-601d-4c83-960a-e9cc36d6627e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:00.722924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9ef1409b-601d-4c83-960a-e9cc36d6627e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:00.724349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9ef1409b-601d-4c83-960a-e9cc36d6627e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:00.758141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b88e30-3d13-4a43-87ba-3f18f8d7cd00 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:00.796267 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3068/6147] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:00.807231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1409b-601d-4c83-960a-e9cc36d6627e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:00.808669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9ef1409b-601d-4c83-960a-e9cc36d6627e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:00.827122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e0a11-a502-4216-8d1b-801973ed1290 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:00.827122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e0a11-a502-4216-8d1b-801973ed1290 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:00.827122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e0a11-a502-4216-8d1b-801973ed1290 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:00.827551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e0a11-a502-4216-8d1b-801973ed1290 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/projects/06a895504e5f4c5c83e0bc006e0f6634` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:00.827551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e0a11-a502-4216-8d1b-801973ed1290 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:get_project(project_id=06a895504e5f4c5c83e0bc006e0f6634)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:00.827551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e0a11-a502-4216-8d1b-801973ed1290 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:00.832850 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3080/6148] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:42:00 2022] GET /identity/v3/projects/06a895504e5f4c5c83e0bc006e0f6634 => generated 360 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:42:00.837503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e0a11-a502-4216-8d1b-801973ed1290 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:00.839502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9d1e0a11-a502-4216-8d1b-801973ed1290 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:00.858192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e0a11-a502-4216-8d1b-801973ed1290 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:00.864434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40340abd-ca2e-422b-bcc4-7818cff09e45 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:00.865556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40340abd-ca2e-422b-bcc4-7818cff09e45 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:00.865845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40340abd-ca2e-422b-bcc4-7818cff09e45 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:00.866128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40340abd-ca2e-422b-bcc4-7818cff09e45 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/projects/06a895504e5f4c5c83e0bc006e0f6634/users/ed74a4fadb1942da9e89d3a689bbd8df/roles/31d2d723b4b14af3a013ac3e5bcc6b40` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:00.868741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40340abd-ca2e-422b-bcc4-7818cff09e45 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:create_grant(project_id=06a895504e5f4c5c83e0bc006e0f6634, user_id=ed74a4fadb1942da9e89d3a689bbd8df, role_id=31d2d723b4b14af3a013ac3e5bcc6b40)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:00.871576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40340abd-ca2e-422b-bcc4-7818cff09e45 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:00.873817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1409b-601d-4c83-960a-e9cc36d6627e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:00.895164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70872a8e-36ef-4079-a077-fb61d3104076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:00.895848 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70872a8e-36ef-4079-a077-fb61d3104076 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:00.896190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70872a8e-36ef-4079-a077-fb61d3104076 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:00.896473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70872a8e-36ef-4079-a077-fb61d3104076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:00.907211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70872a8e-36ef-4079-a077-fb61d3104076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:00.909145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70872a8e-36ef-4079-a077-fb61d3104076 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:00.920047 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3069/6149] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:42:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:42:00.972453 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3081/6150] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:42:00 2022] PUT /identity/v3/projects/06a895504e5f4c5c83e0bc006e0f6634/users/ed74a4fadb1942da9e89d3a689bbd8df/roles/31d2d723b4b14af3a013ac3e5bcc6b40 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:00.975774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70872a8e-36ef-4079-a077-fb61d3104076 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:00.987083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70872a8e-36ef-4079-a077-fb61d3104076 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:01.056908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d8937-47bf-4388-9687-4899db3a4169 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:01.057893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d8937-47bf-4388-9687-4899db3a4169 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:01.058433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d8937-47bf-4388-9687-4899db3a4169 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:01.058912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d8937-47bf-4388-9687-4899db3a4169 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:01.059818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d8937-47bf-4388-9687-4899db3a4169 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:01.061931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d8937-47bf-4388-9687-4899db3a4169 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:01.204450 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3070/6151] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:42:00 2022] POST /identity/v3/projects => generated 360 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:42:01.206302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40340abd-ca2e-422b-bcc4-7818cff09e45 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:01.219389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40340abd-ca2e-422b-bcc4-7818cff09e45 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:01.316774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11e80f-0714-48c5-8eb5-c9f834f1c017 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:01.316774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11e80f-0714-48c5-8eb5-c9f834f1c017 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:01.316774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11e80f-0714-48c5-8eb5-c9f834f1c017 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:01.317238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11e80f-0714-48c5-8eb5-c9f834f1c017 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/projects/2c690e0c865f482cbc0bd0eec3aab6d2` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:01.317238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11e80f-0714-48c5-8eb5-c9f834f1c017 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:get_project(project_id=2c690e0c865f482cbc0bd0eec3aab6d2)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:01.317238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11e80f-0714-48c5-8eb5-c9f834f1c017 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:01.317238 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3082/6152] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:42:01 2022] GET /identity/v3/projects/2c690e0c865f482cbc0bd0eec3aab6d2 => generated 360 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:42:01.320353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d8937-47bf-4388-9687-4899db3a4169 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:01.341063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d8937-47bf-4388-9687-4899db3a4169 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:01.343192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11e80f-0714-48c5-8eb5-c9f834f1c017 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:01.345496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ac11e80f-0714-48c5-8eb5-c9f834f1c017 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:01.347762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfc714-8442-479e-b640-1ca18720e33d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:01.348983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfc714-8442-479e-b640-1ca18720e33d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:01.349828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfc714-8442-479e-b640-1ca18720e33d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:01.350311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfc714-8442-479e-b640-1ca18720e33d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/projects/2c690e0c865f482cbc0bd0eec3aab6d2/users/ed74a4fadb1942da9e89d3a689bbd8df/roles/31d2d723b4b14af3a013ac3e5bcc6b40` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:01.353456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dfc714-8442-479e-b640-1ca18720e33d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2c690e0c865f482cbc0bd0eec3aab6d2, user_id=ed74a4fadb1942da9e89d3a689bbd8df, role_id=31d2d723b4b14af3a013ac3e5bcc6b40)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:01.357454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dfc714-8442-479e-b640-1ca18720e33d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:01.428694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11e80f-0714-48c5-8eb5-c9f834f1c017 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:01.434811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812d32e-a996-4b2d-8dfe-a8b049b7c658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:01.435791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812d32e-a996-4b2d-8dfe-a8b049b7c658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:01.436149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812d32e-a996-4b2d-8dfe-a8b049b7c658 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:01.436502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812d32e-a996-4b2d-8dfe-a8b049b7c658 admin admin] PATH_INFO: `/v3/projects/23c327323ab84febaef036ab6c72b1e9` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:01.438083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812d32e-a996-4b2d-8dfe-a8b049b7c658 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23c327323ab84febaef036ab6c72b1e9)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:01.440212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812d32e-a996-4b2d-8dfe-a8b049b7c658 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:01.448141 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3071/6153] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:42:01 2022] PUT /identity/v3/projects/2c690e0c865f482cbc0bd0eec3aab6d2/users/ed74a4fadb1942da9e89d3a689bbd8df/roles/31d2d723b4b14af3a013ac3e5bcc6b40 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:01.461681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfc714-8442-479e-b640-1ca18720e33d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:01.537135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfc714-8442-479e-b640-1ca18720e33d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:01.542070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21889cc-5f52-4bed-b5ff-85332d2005b3 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:01.542904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21889cc-5f52-4bed-b5ff-85332d2005b3 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:01.543332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21889cc-5f52-4bed-b5ff-85332d2005b3 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:01.546443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21889cc-5f52-4bed-b5ff-85332d2005b3 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/users/ed74a4fadb1942da9e89d3a689bbd8df/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:01.546443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21889cc-5f52-4bed-b5ff-85332d2005b3 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=ed74a4fadb1942da9e89d3a689bbd8df)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:01.547371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21889cc-5f52-4bed-b5ff-85332d2005b3 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:01.568813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2812d32e-a996-4b2d-8dfe-a8b049b7c658 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23c327323ab84febaef036ab6c72b1e9', 'request_id': 'req-2812d32e-a996-4b2d-8dfe-a8b049b7c658'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:01.599440 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3072/6154] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 2 10:42:01 2022] GET /identity/v3/users/ed74a4fadb1942da9e89d3a689bbd8df/projects => generated 844 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:42:01.603337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21889cc-5f52-4bed-b5ff-85332d2005b3 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:01.613879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21889cc-5f52-4bed-b5ff-85332d2005b3 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:01.658281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2812d32e-a996-4b2d-8dfe-a8b049b7c658 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23c327323ab84febaef036ab6c72b1e9', 'request_id': 'req-2812d32e-a996-4b2d-8dfe-a8b049b7c658'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:01.665783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2812d32e-a996-4b2d-8dfe-a8b049b7c658 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23c327323ab84febaef036ab6c72b1e9', 'request_id': 'req-2812d32e-a996-4b2d-8dfe-a8b049b7c658'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:01.674634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0517b91-48a4-4d0e-8f15-ace7959103da tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:01.675519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0517b91-48a4-4d0e-8f15-ace7959103da tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:01.675807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0517b91-48a4-4d0e-8f15-ace7959103da tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:01.676086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0517b91-48a4-4d0e-8f15-ace7959103da tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/projects/2c690e0c865f482cbc0bd0eec3aab6d2` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:01.677362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0517b91-48a4-4d0e-8f15-ace7959103da tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2c690e0c865f482cbc0bd0eec3aab6d2)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:01.678469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2812d32e-a996-4b2d-8dfe-a8b049b7c658 admin admin] The token cache is being invalidate because project 23c327323ab84febaef036ab6c72b1e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:42:01.678918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2812d32e-a996-4b2d-8dfe-a8b049b7c658 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:01.679304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0517b91-48a4-4d0e-8f15-ace7959103da tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:01.680044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2812d32e-a996-4b2d-8dfe-a8b049b7c658 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:01.692641 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3083/6155] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:42:01 2022] DELETE /identity/v3/projects/23c327323ab84febaef036ab6c72b1e9 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:01.937132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e0517b91-48a4-4d0e-8f15-ace7959103da tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c690e0c865f482cbc0bd0eec3aab6d2', 'request_id': 'req-e0517b91-48a4-4d0e-8f15-ace7959103da'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:01.945445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e0517b91-48a4-4d0e-8f15-ace7959103da tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c690e0c865f482cbc0bd0eec3aab6d2', 'request_id': 'req-e0517b91-48a4-4d0e-8f15-ace7959103da'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:02.021015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e0517b91-48a4-4d0e-8f15-ace7959103da tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c690e0c865f482cbc0bd0eec3aab6d2', 'request_id': 'req-e0517b91-48a4-4d0e-8f15-ace7959103da'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:02.034927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e0517b91-48a4-4d0e-8f15-ace7959103da tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] The token cache is being invalidate because project 2c690e0c865f482cbc0bd0eec3aab6d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:42:02.035481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e0517b91-48a4-4d0e-8f15-ace7959103da tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:02.038200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e0517b91-48a4-4d0e-8f15-ace7959103da tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:02.055471 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3073/6156] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:42:01 2022] DELETE /identity/v3/projects/2c690e0c865f482cbc0bd0eec3aab6d2 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:02.059390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812d32e-a996-4b2d-8dfe-a8b049b7c658 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:02.062460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2812d32e-a996-4b2d-8dfe-a8b049b7c658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:02.085360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812d32e-a996-4b2d-8dfe-a8b049b7c658 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:02.189876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c8285-51ae-4c74-9098-6d8735b82f7d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:02.191012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c8285-51ae-4c74-9098-6d8735b82f7d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:02.191379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c8285-51ae-4c74-9098-6d8735b82f7d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:02.191737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c8285-51ae-4c74-9098-6d8735b82f7d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/projects/06a895504e5f4c5c83e0bc006e0f6634` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:02.193719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c8285-51ae-4c74-9098-6d8735b82f7d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:delete_project(project_id=06a895504e5f4c5c83e0bc006e0f6634)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:02.196783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c8285-51ae-4c74-9098-6d8735b82f7d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:02.470198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b91c8285-51ae-4c74-9098-6d8735b82f7d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a895504e5f4c5c83e0bc006e0f6634', 'request_id': 'req-b91c8285-51ae-4c74-9098-6d8735b82f7d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:02.549756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b91c8285-51ae-4c74-9098-6d8735b82f7d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a895504e5f4c5c83e0bc006e0f6634', 'request_id': 'req-b91c8285-51ae-4c74-9098-6d8735b82f7d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:02.563503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b91c8285-51ae-4c74-9098-6d8735b82f7d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a895504e5f4c5c83e0bc006e0f6634', 'request_id': 'req-b91c8285-51ae-4c74-9098-6d8735b82f7d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:02.594631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b91c8285-51ae-4c74-9098-6d8735b82f7d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] The token cache is being invalidate because project 06a895504e5f4c5c83e0bc006e0f6634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:42:02.595037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b91c8285-51ae-4c74-9098-6d8735b82f7d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:02.596481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b91c8285-51ae-4c74-9098-6d8735b82f7d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:02.602171 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3084/6157] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:42:02 2022] DELETE /identity/v3/projects/06a895504e5f4c5c83e0bc006e0f6634 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:02.603076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0517b91-48a4-4d0e-8f15-ace7959103da tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:02.604776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e0517b91-48a4-4d0e-8f15-ace7959103da tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:02.626676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0517b91-48a4-4d0e-8f15-ace7959103da tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:02.701013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f80b6-ee6e-4cbf-8658-93dd8dba7e3c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:02.702824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f80b6-ee6e-4cbf-8658-93dd8dba7e3c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:02.703147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f80b6-ee6e-4cbf-8658-93dd8dba7e3c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:02.703432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f80b6-ee6e-4cbf-8658-93dd8dba7e3c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/roles/31d2d723b4b14af3a013ac3e5bcc6b40` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:02.705251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f80b6-ee6e-4cbf-8658-93dd8dba7e3c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:delete_role(role_id=31d2d723b4b14af3a013ac3e5bcc6b40)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:02.706766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f80b6-ee6e-4cbf-8658-93dd8dba7e3c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:02.839154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a93f80b6-ee6e-4cbf-8658-93dd8dba7e3c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invalidating the token cache because role 31d2d723b4b14af3a013ac3e5bcc6b40 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:42:02.839396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a93f80b6-ee6e-4cbf-8658-93dd8dba7e3c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:02.840159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a93f80b6-ee6e-4cbf-8658-93dd8dba7e3c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:02.849956 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3074/6158] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:42:02 2022] DELETE /identity/v3/roles/31d2d723b4b14af3a013ac3e5bcc6b40 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:02.851879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c8285-51ae-4c74-9098-6d8735b82f7d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:02.856435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b91c8285-51ae-4c74-9098-6d8735b82f7d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:02.883266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c8285-51ae-4c74-9098-6d8735b82f7d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:03.015665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7808b-c8d9-4098-8084-47a985779fb2 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:03.016945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7808b-c8d9-4098-8084-47a985779fb2 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:03.017315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7808b-c8d9-4098-8084-47a985779fb2 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:03.018474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7808b-c8d9-4098-8084-47a985779fb2 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/users/ed74a4fadb1942da9e89d3a689bbd8df` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:03.027044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7808b-c8d9-4098-8084-47a985779fb2 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ed74a4fadb1942da9e89d3a689bbd8df)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:03.029733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7808b-c8d9-4098-8084-47a985779fb2 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:03.170365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74a7808b-c8d9-4098-8084-47a985779fb2 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed74a4fadb1942da9e89d3a689bbd8df'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:03.186254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74a7808b-c8d9-4098-8084-47a985779fb2 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed74a4fadb1942da9e89d3a689bbd8df'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:03.187067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74a7808b-c8d9-4098-8084-47a985779fb2 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed74a4fadb1942da9e89d3a689bbd8df'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:03.200684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74a7808b-c8d9-4098-8084-47a985779fb2 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed74a4fadb1942da9e89d3a689bbd8df'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:03.301918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74a7808b-c8d9-4098-8084-47a985779fb2 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed74a4fadb1942da9e89d3a689bbd8df'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:03.314392 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3085/6159] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:42:02 2022] DELETE /identity/v3/users/ed74a4fadb1942da9e89d3a689bbd8df => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:03.316320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f80b6-ee6e-4cbf-8658-93dd8dba7e3c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:03.319085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a93f80b6-ee6e-4cbf-8658-93dd8dba7e3c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:03.350556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f80b6-ee6e-4cbf-8658-93dd8dba7e3c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:03.468973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289eeee-7611-41f7-8b64-37856fdd9261 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:03.470173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289eeee-7611-41f7-8b64-37856fdd9261 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:03.471594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289eeee-7611-41f7-8b64-37856fdd9261 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:03.472109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289eeee-7611-41f7-8b64-37856fdd9261 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/projects/8a66433b0f9940bbb479cb40d806d242` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:03.473806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289eeee-7611-41f7-8b64-37856fdd9261 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8a66433b0f9940bbb479cb40d806d242)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:03.480243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289eeee-7611-41f7-8b64-37856fdd9261 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:03.636542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4289eeee-7611-41f7-8b64-37856fdd9261 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a66433b0f9940bbb479cb40d806d242', 'request_id': 'req-4289eeee-7611-41f7-8b64-37856fdd9261'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:03.648216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4289eeee-7611-41f7-8b64-37856fdd9261 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a66433b0f9940bbb479cb40d806d242', 'request_id': 'req-4289eeee-7611-41f7-8b64-37856fdd9261'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:03.726490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4289eeee-7611-41f7-8b64-37856fdd9261 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a66433b0f9940bbb479cb40d806d242', 'request_id': 'req-4289eeee-7611-41f7-8b64-37856fdd9261'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:03.739742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4289eeee-7611-41f7-8b64-37856fdd9261 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] The token cache is being invalidate because project 8a66433b0f9940bbb479cb40d806d242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:42:03.740195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4289eeee-7611-41f7-8b64-37856fdd9261 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:03.741286 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4289eeee-7611-41f7-8b64-37856fdd9261 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:03.743566 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3075/6160] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:42:03 2022] DELETE /identity/v3/projects/8a66433b0f9940bbb479cb40d806d242 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:03.752527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7808b-c8d9-4098-8084-47a985779fb2 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:03.754476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-74a7808b-c8d9-4098-8084-47a985779fb2 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:03.772654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7808b-c8d9-4098-8084-47a985779fb2 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:03.844157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7558d-87bb-4b90-82c8-ec604d65be41 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:03.845097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7558d-87bb-4b90-82c8-ec604d65be41 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:03.846634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7558d-87bb-4b90-82c8-ec604d65be41 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:03.846836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7558d-87bb-4b90-82c8-ec604d65be41 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/users/ffbd616e93bf49bb9ce6f37106782799` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:03.850266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7558d-87bb-4b90-82c8-ec604d65be41 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:update_user(user_id=ffbd616e93bf49bb9ce6f37106782799)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:03.851360 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-07f7558d-87bb-4b90-82c8-ec604d65be41 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:42:03.851360 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:42:03.851360 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:42:03.852808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7558d-87bb-4b90-82c8-ec604d65be41 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:04.018974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-07f7558d-87bb-4b90-82c8-ec604d65be41 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ffbd616e93bf49bb9ce6f37106782799'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:04.110648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-07f7558d-87bb-4b90-82c8-ec604d65be41 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invalidating the token cache because user ffbd616e93bf49bb9ce6f37106782799 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:42:04.112287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-07f7558d-87bb-4b90-82c8-ec604d65be41 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:04.114829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-07f7558d-87bb-4b90-82c8-ec604d65be41 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:04.118891 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3086/6161] 10.222.0.16 () {60 vars in 1242 bytes} [Mon May 2 10:42:03 2022] PATCH /identity/v3/users/ffbd616e93bf49bb9ce6f37106782799 => generated 296 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:42:04.128395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e572f-ef6e-4ea0-9860-172f4d60a2ba None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:04.128799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e572f-ef6e-4ea0-9860-172f4d60a2ba None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:04.129112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e572f-ef6e-4ea0-9860-172f4d60a2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:04.175231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f46e572f-ef6e-4ea0-9860-172f4d60a2ba None None] MFA Rules not processed for user `ffbd616e93bf49bb9ce6f37106782799`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:04.176521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f46e572f-ef6e-4ea0-9860-172f4d60a2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:04.184216 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3076/6162] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:04 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 10:42:04.188007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7558d-87bb-4b90-82c8-ec604d65be41 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:04.189929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-07f7558d-87bb-4b90-82c8-ec604d65be41 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:04.203955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7558d-87bb-4b90-82c8-ec604d65be41 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:04.209336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cb292-b39e-40d5-a866-0eca86706f66 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:04.210458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cb292-b39e-40d5-a866-0eca86706f66 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:04.210729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cb292-b39e-40d5-a866-0eca86706f66 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:04.211019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cb292-b39e-40d5-a866-0eca86706f66 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/users/ffbd616e93bf49bb9ce6f37106782799` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:04.212375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2cb292-b39e-40d5-a866-0eca86706f66 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:update_user(user_id=ffbd616e93bf49bb9ce6f37106782799)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:04.214417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2cb292-b39e-40d5-a866-0eca86706f66 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:04.336735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3a2cb292-b39e-40d5-a866-0eca86706f66 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ffbd616e93bf49bb9ce6f37106782799'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:04.433018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3a2cb292-b39e-40d5-a866-0eca86706f66 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invalidating the token cache because user ffbd616e93bf49bb9ce6f37106782799 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:42:04.433391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3a2cb292-b39e-40d5-a866-0eca86706f66 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:04.434527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3a2cb292-b39e-40d5-a866-0eca86706f66 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:04.437099 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3087/6163] 10.222.0.16 () {60 vars in 1242 bytes} [Mon May 2 10:42:04 2022] PATCH /identity/v3/users/ffbd616e93bf49bb9ce6f37106782799 => generated 296 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:42:04.442119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e572f-ef6e-4ea0-9860-172f4d60a2ba None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:04.455946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e572f-ef6e-4ea0-9860-172f4d60a2ba None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:04.464037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62458d-db1a-450b-9e08-601f90e74757 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:04.465146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62458d-db1a-450b-9e08-601f90e74757 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:04.465539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62458d-db1a-450b-9e08-601f90e74757 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:04.465896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62458d-db1a-450b-9e08-601f90e74757 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/users/ffbd616e93bf49bb9ce6f37106782799` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:04.486663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62458d-db1a-450b-9e08-601f90e74757 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:update_user(user_id=ffbd616e93bf49bb9ce6f37106782799)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:04.488949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62458d-db1a-450b-9e08-601f90e74757 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:04.647819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eb62458d-db1a-450b-9e08-601f90e74757 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ffbd616e93bf49bb9ce6f37106782799'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:04.758190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eb62458d-db1a-450b-9e08-601f90e74757 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invalidating the token cache because user ffbd616e93bf49bb9ce6f37106782799 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:42:04.758645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eb62458d-db1a-450b-9e08-601f90e74757 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:04.759281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eb62458d-db1a-450b-9e08-601f90e74757 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:04.763939 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3077/6164] 10.222.0.16 () {60 vars in 1242 bytes} [Mon May 2 10:42:04 2022] PATCH /identity/v3/users/ffbd616e93bf49bb9ce6f37106782799 => generated 296 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:42:04.767699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cd034-4384-48f8-b6a4-8d4a54337a86 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:04.767699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cd034-4384-48f8-b6a4-8d4a54337a86 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:04.767699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cd034-4384-48f8-b6a4-8d4a54337a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:04.828587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e57cd034-4384-48f8-b6a4-8d4a54337a86 None None] MFA Rules not processed for user `ffbd616e93bf49bb9ce6f37106782799`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:04.829442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e57cd034-4384-48f8-b6a4-8d4a54337a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:04.846279 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3088/6165] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:04 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 10:42:04.846955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62458d-db1a-450b-9e08-601f90e74757 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:04.848480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-eb62458d-db1a-450b-9e08-601f90e74757 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:04.873322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62458d-db1a-450b-9e08-601f90e74757 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:04.889508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceec30c-760f-49db-b4d5-825bf7daf207 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:04.890791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceec30c-760f-49db-b4d5-825bf7daf207 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:04.890791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceec30c-760f-49db-b4d5-825bf7daf207 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:04.891088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceec30c-760f-49db-b4d5-825bf7daf207 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/users/ffbd616e93bf49bb9ce6f37106782799` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:04.892637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceec30c-760f-49db-b4d5-825bf7daf207 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:update_user(user_id=ffbd616e93bf49bb9ce6f37106782799)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:04.894605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceec30c-760f-49db-b4d5-825bf7daf207 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:05.028412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fceec30c-760f-49db-b4d5-825bf7daf207 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ffbd616e93bf49bb9ce6f37106782799'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:05.160843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fceec30c-760f-49db-b4d5-825bf7daf207 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invalidating the token cache because user ffbd616e93bf49bb9ce6f37106782799 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:42:05.161274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fceec30c-760f-49db-b4d5-825bf7daf207 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:05.162298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fceec30c-760f-49db-b4d5-825bf7daf207 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:05.171083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cd034-4384-48f8-b6a4-8d4a54337a86 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:05.171913 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3078/6166] 10.222.0.16 () {60 vars in 1242 bytes} [Mon May 2 10:42:04 2022] PATCH /identity/v3/users/ffbd616e93bf49bb9ce6f37106782799 => generated 296 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:42:05.191794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cd034-4384-48f8-b6a4-8d4a54337a86 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:05.198213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba34ada-0f9c-41f4-98b1-aa761e403b6e tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:05.199151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba34ada-0f9c-41f4-98b1-aa761e403b6e tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:05.199663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba34ada-0f9c-41f4-98b1-aa761e403b6e tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:05.200141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba34ada-0f9c-41f4-98b1-aa761e403b6e tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:05.201103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba34ada-0f9c-41f4-98b1-aa761e403b6e tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:05.203785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba34ada-0f9c-41f4-98b1-aa761e403b6e tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:05.331507 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3089/6167] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:42:05 2022] POST /identity/v3/users => generated 264 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:42:05.335840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceec30c-760f-49db-b4d5-825bf7daf207 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:05.338677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fceec30c-760f-49db-b4d5-825bf7daf207 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:05.359876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceec30c-760f-49db-b4d5-825bf7daf207 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:05.374195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3f7f9-88b1-41e2-83ce-b2d894eab565 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:05.375182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3f7f9-88b1-41e2-83ce-b2d894eab565 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:05.375558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3f7f9-88b1-41e2-83ce-b2d894eab565 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:05.376146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3f7f9-88b1-41e2-83ce-b2d894eab565 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/users/603aad802578433caa51101cac6124f3/password` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:05.561486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-acd3f7f9-88b1-41e2-83ce-b2d894eab565 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '603aad802578433caa51101cac6124f3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:05.647572 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3079/6168] 10.222.0.16 () {60 vars in 1268 bytes} [Mon May 2 10:42:05 2022] POST /identity/v3/users/603aad802578433caa51101cac6124f3/password => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:06.652702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abdbc5-e539-458a-8d01-7fd02518f765 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:06.653751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abdbc5-e539-458a-8d01-7fd02518f765 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:06.660667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abdbc5-e539-458a-8d01-7fd02518f765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:06.685427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f7abdbc5-e539-458a-8d01-7fd02518f765 None None] MFA Rules not processed for user `603aad802578433caa51101cac6124f3`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:06.687570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f7abdbc5-e539-458a-8d01-7fd02518f765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:06.696893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3f7f9-88b1-41e2-83ce-b2d894eab565 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:06.698502 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3090/6169] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:06 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 10:42:06.710475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3f7f9-88b1-41e2-83ce-b2d894eab565 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:06.716481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28e22d-1811-4a89-8531-795f143d96df tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:06.717465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28e22d-1811-4a89-8531-795f143d96df tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:06.717872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28e22d-1811-4a89-8531-795f143d96df tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:06.718249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28e22d-1811-4a89-8531-795f143d96df tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:06.726497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28e22d-1811-4a89-8531-795f143d96df tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:06.728936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28e22d-1811-4a89-8531-795f143d96df tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:06.737077 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3080/6170] 10.222.0.16 () {56 vars in 1262 bytes} [Mon May 2 10:42:06 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 10:42:06.741613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7abdbc5-e539-458a-8d01-7fd02518f765 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:06.758123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7abdbc5-e539-458a-8d01-7fd02518f765 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:06.764637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa2396-a74c-4cf6-b940-302ccb84dc1c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:06.765967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa2396-a74c-4cf6-b940-302ccb84dc1c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:06.766263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa2396-a74c-4cf6-b940-302ccb84dc1c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:06.766552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa2396-a74c-4cf6-b940-302ccb84dc1c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/users/603aad802578433caa51101cac6124f3` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:06.769228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa2396-a74c-4cf6-b940-302ccb84dc1c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:delete_user(user_id=603aad802578433caa51101cac6124f3)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:06.771638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa2396-a74c-4cf6-b940-302ccb84dc1c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:07.046038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dfaa2396-a74c-4cf6-b940-302ccb84dc1c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '603aad802578433caa51101cac6124f3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:07.074276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dfaa2396-a74c-4cf6-b940-302ccb84dc1c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '603aad802578433caa51101cac6124f3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:07.075063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dfaa2396-a74c-4cf6-b940-302ccb84dc1c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '603aad802578433caa51101cac6124f3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:07.101238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dfaa2396-a74c-4cf6-b940-302ccb84dc1c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '603aad802578433caa51101cac6124f3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:07.255181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dfaa2396-a74c-4cf6-b940-302ccb84dc1c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '603aad802578433caa51101cac6124f3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:07.263406 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3091/6171] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:42:06 2022] DELETE /identity/v3/users/603aad802578433caa51101cac6124f3 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:07.268927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28e22d-1811-4a89-8531-795f143d96df tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:07.280421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28e22d-1811-4a89-8531-795f143d96df tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:07.348507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2637536-19db-42b2-9418-67136b61e99d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:07.349243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2637536-19db-42b2-9418-67136b61e99d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:07.349535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2637536-19db-42b2-9418-67136b61e99d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:07.349826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2637536-19db-42b2-9418-67136b61e99d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:07.350541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2637536-19db-42b2-9418-67136b61e99d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:07.352576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2637536-19db-42b2-9418-67136b61e99d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:07.449262 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3081/6172] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:42:07 2022] POST /identity/v3/users => generated 367 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:42:07.453442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa2396-a74c-4cf6-b940-302ccb84dc1c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:07.454998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dfaa2396-a74c-4cf6-b940-302ccb84dc1c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:07.469712 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa2396-a74c-4cf6-b940-302ccb84dc1c tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:07.474954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b46778-17ad-4b56-aff8-c6552ab8e9ba tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:07.475632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b46778-17ad-4b56-aff8-c6552ab8e9ba tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:07.475925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b46778-17ad-4b56-aff8-c6552ab8e9ba tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:07.476208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b46778-17ad-4b56-aff8-c6552ab8e9ba tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:07.477029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b46778-17ad-4b56-aff8-c6552ab8e9ba tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:07.478961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b46778-17ad-4b56-aff8-c6552ab8e9ba tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:07.610318 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3092/6173] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:42:07 2022] POST /identity/v3/projects => generated 359 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:42:07.612267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2637536-19db-42b2-9418-67136b61e99d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:07.641750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2637536-19db-42b2-9418-67136b61e99d tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:07.730772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cc5f7-4bfe-4450-a880-9aedddcac597 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:07.732989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cc5f7-4bfe-4450-a880-9aedddcac597 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:07.740856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cc5f7-4bfe-4450-a880-9aedddcac597 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:07.740856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cc5f7-4bfe-4450-a880-9aedddcac597 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/users/0c2acd1d259242cc80f4bbecd5a3a6c8` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:07.757066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4cc5f7-4bfe-4450-a880-9aedddcac597 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:update_user(user_id=0c2acd1d259242cc80f4bbecd5a3a6c8)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:07.760618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4cc5f7-4bfe-4450-a880-9aedddcac597 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:07.930494 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3082/6174] 10.222.0.16 () {60 vars in 1243 bytes} [Mon May 2 10:42:07 2022] PATCH /identity/v3/users/0c2acd1d259242cc80f4bbecd5a3a6c8 => generated 522 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:42:07.934981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b46778-17ad-4b56-aff8-c6552ab8e9ba tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:07.946541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b46778-17ad-4b56-aff8-c6552ab8e9ba tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:07.961469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d098d7-1d70-4fad-8b6b-43e66a287b2f tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:07.961469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d098d7-1d70-4fad-8b6b-43e66a287b2f tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:07.961469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d098d7-1d70-4fad-8b6b-43e66a287b2f tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:07.961713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d098d7-1d70-4fad-8b6b-43e66a287b2f tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/users/0c2acd1d259242cc80f4bbecd5a3a6c8` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:07.971549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d098d7-1d70-4fad-8b6b-43e66a287b2f tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:get_user(user_id=0c2acd1d259242cc80f4bbecd5a3a6c8)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:07.973933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d098d7-1d70-4fad-8b6b-43e66a287b2f tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:07.976250 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3093/6175] 10.222.0.16 () {58 vars in 1220 bytes} [Mon May 2 10:42:07 2022] GET /identity/v3/users/0c2acd1d259242cc80f4bbecd5a3a6c8 => generated 389 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:42:07.980445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cc5f7-4bfe-4450-a880-9aedddcac597 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:08.000560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cc5f7-4bfe-4450-a880-9aedddcac597 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:08.007436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5065ac6-a7c6-4958-81bf-3b96ad0c820a tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:08.008535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5065ac6-a7c6-4958-81bf-3b96ad0c820a tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:08.009169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5065ac6-a7c6-4958-81bf-3b96ad0c820a tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:08.009440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5065ac6-a7c6-4958-81bf-3b96ad0c820a tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/projects/2a316fb68d8943a49e94d19392fa01d4` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:08.010716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5065ac6-a7c6-4958-81bf-3b96ad0c820a tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2a316fb68d8943a49e94d19392fa01d4)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:08.012869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5065ac6-a7c6-4958-81bf-3b96ad0c820a tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:08.128455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a5065ac6-a7c6-4958-81bf-3b96ad0c820a tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a316fb68d8943a49e94d19392fa01d4', 'request_id': 'req-a5065ac6-a7c6-4958-81bf-3b96ad0c820a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:08.135700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a5065ac6-a7c6-4958-81bf-3b96ad0c820a tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a316fb68d8943a49e94d19392fa01d4', 'request_id': 'req-a5065ac6-a7c6-4958-81bf-3b96ad0c820a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:08.243368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a5065ac6-a7c6-4958-81bf-3b96ad0c820a tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a316fb68d8943a49e94d19392fa01d4', 'request_id': 'req-a5065ac6-a7c6-4958-81bf-3b96ad0c820a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:08.257595 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a5065ac6-a7c6-4958-81bf-3b96ad0c820a tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] The token cache is being invalidate because project 2a316fb68d8943a49e94d19392fa01d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:42:08.258226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a5065ac6-a7c6-4958-81bf-3b96ad0c820a tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:08.259237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a5065ac6-a7c6-4958-81bf-3b96ad0c820a tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:08.264529 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3083/6176] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:42:07 2022] DELETE /identity/v3/projects/2a316fb68d8943a49e94d19392fa01d4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:08.265468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d098d7-1d70-4fad-8b6b-43e66a287b2f tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:08.267919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-93d098d7-1d70-4fad-8b6b-43e66a287b2f tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:08.285957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d098d7-1d70-4fad-8b6b-43e66a287b2f tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:08.360638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdddd4d7-cb1e-45ee-8515-a680ef4f4f28 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd77d5f6cd50140aabc28df507cba8b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:08.362671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddd4d7-cb1e-45ee-8515-a680ef4f4f28 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:08.362671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddd4d7-cb1e-45ee-8515-a680ef4f4f28 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:08.362908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddd4d7-cb1e-45ee-8515-a680ef4f4f28 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] PATH_INFO: `/v3/users/0c2acd1d259242cc80f4bbecd5a3a6c8` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:08.364231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdddd4d7-cb1e-45ee-8515-a680ef4f4f28 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0c2acd1d259242cc80f4bbecd5a3a6c8)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:08.367296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdddd4d7-cb1e-45ee-8515-a680ef4f4f28 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:08.480798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fdddd4d7-cb1e-45ee-8515-a680ef4f4f28 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c2acd1d259242cc80f4bbecd5a3a6c8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:08.517378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fdddd4d7-cb1e-45ee-8515-a680ef4f4f28 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c2acd1d259242cc80f4bbecd5a3a6c8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:08.518747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fdddd4d7-cb1e-45ee-8515-a680ef4f4f28 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c2acd1d259242cc80f4bbecd5a3a6c8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:08.539917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fdddd4d7-cb1e-45ee-8515-a680ef4f4f28 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c2acd1d259242cc80f4bbecd5a3a6c8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:08.641070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fdddd4d7-cb1e-45ee-8515-a680ef4f4f28 tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c2acd1d259242cc80f4bbecd5a3a6c8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:08.655999 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3094/6177] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:42:08 2022] DELETE /identity/v3/users/0c2acd1d259242cc80f4bbecd5a3a6c8 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:08.661792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5065ac6-a7c6-4958-81bf-3b96ad0c820a tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:08.663675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a5065ac6-a7c6-4958-81bf-3b96ad0c820a tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:08.740889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5065ac6-a7c6-4958-81bf-3b96ad0c820a tempest-UsersV3TestJSON-395718084 tempest-UsersV3TestJSON-395718084-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:08.805992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52343aab-8ecf-48ca-b2cf-1e4494d96c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:08.806932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52343aab-8ecf-48ca-b2cf-1e4494d96c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:08.807282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52343aab-8ecf-48ca-b2cf-1e4494d96c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:08.810283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52343aab-8ecf-48ca-b2cf-1e4494d96c4b admin admin] PATH_INFO: `/v3/users/ffbd616e93bf49bb9ce6f37106782799` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:08.829468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52343aab-8ecf-48ca-b2cf-1e4494d96c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffbd616e93bf49bb9ce6f37106782799)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:08.831633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52343aab-8ecf-48ca-b2cf-1e4494d96c4b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:09.038123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-52343aab-8ecf-48ca-b2cf-1e4494d96c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffbd616e93bf49bb9ce6f37106782799'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:09.051204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-52343aab-8ecf-48ca-b2cf-1e4494d96c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffbd616e93bf49bb9ce6f37106782799'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:09.055566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-52343aab-8ecf-48ca-b2cf-1e4494d96c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffbd616e93bf49bb9ce6f37106782799'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:09.060686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-52343aab-8ecf-48ca-b2cf-1e4494d96c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffbd616e93bf49bb9ce6f37106782799'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:09.126375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-52343aab-8ecf-48ca-b2cf-1e4494d96c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffbd616e93bf49bb9ce6f37106782799'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:09.134209 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3084/6178] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:42:08 2022] DELETE /identity/v3/users/ffbd616e93bf49bb9ce6f37106782799 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:09.144135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e5c6a-5184-4dfe-86ca-0d91917d901c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:09.144656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e5c6a-5184-4dfe-86ca-0d91917d901c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:09.144955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e5c6a-5184-4dfe-86ca-0d91917d901c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:09.164298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9f8e5c6a-5184-4dfe-86ca-0d91917d901c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:09.169444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9f8e5c6a-5184-4dfe-86ca-0d91917d901c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:09.224269 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3095/6179] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:09.236706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52343aab-8ecf-48ca-b2cf-1e4494d96c4b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:09.238173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-52343aab-8ecf-48ca-b2cf-1e4494d96c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:09.297595 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52343aab-8ecf-48ca-b2cf-1e4494d96c4b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:09.301809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e29038-5925-42db-b885-0fea20411ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:09.302528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e29038-5925-42db-b885-0fea20411ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:09.302818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e29038-5925-42db-b885-0fea20411ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:09.303100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e29038-5925-42db-b885-0fea20411ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:09.313750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e29038-5925-42db-b885-0fea20411ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:09.315755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e29038-5925-42db-b885-0fea20411ed3 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:09.325737 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3085/6180] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:42:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:42:09.758001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e5c6a-5184-4dfe-86ca-0d91917d901c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:09.759855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9f8e5c6a-5184-4dfe-86ca-0d91917d901c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:09.779053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e5c6a-5184-4dfe-86ca-0d91917d901c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:09.784418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ad587-f7cf-4e31-acc1-f2a999b47dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:09.785653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ad587-f7cf-4e31-acc1-f2a999b47dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:09.786720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ad587-f7cf-4e31-acc1-f2a999b47dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:09.786890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ad587-f7cf-4e31-acc1-f2a999b47dc2 admin admin] PATH_INFO: `/v3/projects/ceb346b9485f4466beedfa010534d71a` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:09.789461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ad587-f7cf-4e31-acc1-f2a999b47dc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceb346b9485f4466beedfa010534d71a)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:09.791442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ad587-f7cf-4e31-acc1-f2a999b47dc2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:09.887641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e28ad587-f7cf-4e31-acc1-f2a999b47dc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceb346b9485f4466beedfa010534d71a', 'request_id': 'req-e28ad587-f7cf-4e31-acc1-f2a999b47dc2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:09.943210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e28ad587-f7cf-4e31-acc1-f2a999b47dc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceb346b9485f4466beedfa010534d71a', 'request_id': 'req-e28ad587-f7cf-4e31-acc1-f2a999b47dc2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:09.952527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e28ad587-f7cf-4e31-acc1-f2a999b47dc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceb346b9485f4466beedfa010534d71a', 'request_id': 'req-e28ad587-f7cf-4e31-acc1-f2a999b47dc2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:09.965497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e28ad587-f7cf-4e31-acc1-f2a999b47dc2 admin admin] The token cache is being invalidate because project ceb346b9485f4466beedfa010534d71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:42:09.965913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e28ad587-f7cf-4e31-acc1-f2a999b47dc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:09.966778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e28ad587-f7cf-4e31-acc1-f2a999b47dc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:09.968417 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3096/6181] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:42:09 2022] DELETE /identity/v3/projects/ceb346b9485f4466beedfa010534d71a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:09.983062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e29038-5925-42db-b885-0fea20411ed3 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:09.991280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e29038-5925-42db-b885-0fea20411ed3 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:10.048061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457e3d2-98dc-4bf3-9fd8-cd7988e62d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:10.049717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457e3d2-98dc-4bf3-9fd8-cd7988e62d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:10.050008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457e3d2-98dc-4bf3-9fd8-cd7988e62d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:10.050502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457e3d2-98dc-4bf3-9fd8-cd7988e62d1a admin admin] PATH_INFO: `/v3/users/d77d5f6cd50140aabc28df507cba8b22` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:10.051684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7457e3d2-98dc-4bf3-9fd8-cd7988e62d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d77d5f6cd50140aabc28df507cba8b22)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:10.054084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7457e3d2-98dc-4bf3-9fd8-cd7988e62d1a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:10.246417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7457e3d2-98dc-4bf3-9fd8-cd7988e62d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd77d5f6cd50140aabc28df507cba8b22'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:10.258834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7457e3d2-98dc-4bf3-9fd8-cd7988e62d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd77d5f6cd50140aabc28df507cba8b22'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:10.259607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7457e3d2-98dc-4bf3-9fd8-cd7988e62d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd77d5f6cd50140aabc28df507cba8b22'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:10.267712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7457e3d2-98dc-4bf3-9fd8-cd7988e62d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd77d5f6cd50140aabc28df507cba8b22'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:10.323700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7457e3d2-98dc-4bf3-9fd8-cd7988e62d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd77d5f6cd50140aabc28df507cba8b22'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:10.331296 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3086/6182] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:42:09 2022] DELETE /identity/v3/users/d77d5f6cd50140aabc28df507cba8b22 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:10.765126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ad587-f7cf-4e31-acc1-f2a999b47dc2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:10.766576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e28ad587-f7cf-4e31-acc1-f2a999b47dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:10.782796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ad587-f7cf-4e31-acc1-f2a999b47dc2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:10.810038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457e3d2-98dc-4bf3-9fd8-cd7988e62d1a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:10.811796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7457e3d2-98dc-4bf3-9fd8-cd7988e62d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:10.853362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4fa81-1401-418b-a3bd-b25dd2f227bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:10.854380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4fa81-1401-418b-a3bd-b25dd2f227bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:10.854745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4fa81-1401-418b-a3bd-b25dd2f227bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:10.855103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4fa81-1401-418b-a3bd-b25dd2f227bc admin admin] PATH_INFO: `/v3/projects/b293d2ff0bea4cee97dd2c27267dd2e7` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:10.856387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4fa81-1401-418b-a3bd-b25dd2f227bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b293d2ff0bea4cee97dd2c27267dd2e7)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:10.858440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4fa81-1401-418b-a3bd-b25dd2f227bc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:10.879811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457e3d2-98dc-4bf3-9fd8-cd7988e62d1a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:10.884759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b44bab-7687-4828-be22-e5cfb6d3fdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:10.885637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b44bab-7687-4828-be22-e5cfb6d3fdef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:10.885948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b44bab-7687-4828-be22-e5cfb6d3fdef admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:10.886240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b44bab-7687-4828-be22-e5cfb6d3fdef admin admin] PATH_INFO: `/v3/users/15782bad224b4997bddbcb97a0f3b80f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:10.887441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b44bab-7687-4828-be22-e5cfb6d3fdef admin admin] RBAC: Authorizing `identity:delete_user(user_id=15782bad224b4997bddbcb97a0f3b80f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:10.889418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b44bab-7687-4828-be22-e5cfb6d3fdef admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:11.054482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-cba4fa81-1401-418b-a3bd-b25dd2f227bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'request_id': 'req-cba4fa81-1401-418b-a3bd-b25dd2f227bc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:11.160859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-cba4fa81-1401-418b-a3bd-b25dd2f227bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'request_id': 'req-cba4fa81-1401-418b-a3bd-b25dd2f227bc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:11.167702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-cba4fa81-1401-418b-a3bd-b25dd2f227bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b293d2ff0bea4cee97dd2c27267dd2e7', 'request_id': 'req-cba4fa81-1401-418b-a3bd-b25dd2f227bc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:11.178212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-cba4fa81-1401-418b-a3bd-b25dd2f227bc admin admin] The token cache is being invalidate because project b293d2ff0bea4cee97dd2c27267dd2e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:42:11.178501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-cba4fa81-1401-418b-a3bd-b25dd2f227bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:11.179135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-cba4fa81-1401-418b-a3bd-b25dd2f227bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:11.180720 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3097/6183] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:42:10 2022] DELETE /identity/v3/projects/b293d2ff0bea4cee97dd2c27267dd2e7 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:11.185548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405c06f-ef30-49d4-931e-590ef7623a4c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:11.185856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405c06f-ef30-49d4-931e-590ef7623a4c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:11.186159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405c06f-ef30-49d4-931e-590ef7623a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:11.197519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d7b44bab-7687-4828-be22-e5cfb6d3fdef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15782bad224b4997bddbcb97a0f3b80f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:11.204428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9405c06f-ef30-49d4-931e-590ef7623a4c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:11.205664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9405c06f-ef30-49d4-931e-590ef7623a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:11.209468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d7b44bab-7687-4828-be22-e5cfb6d3fdef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15782bad224b4997bddbcb97a0f3b80f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:11.210149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d7b44bab-7687-4828-be22-e5cfb6d3fdef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15782bad224b4997bddbcb97a0f3b80f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:11.217035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d7b44bab-7687-4828-be22-e5cfb6d3fdef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15782bad224b4997bddbcb97a0f3b80f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:11.264784 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3098/6184] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:42:11.272413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81acac-8c5c-4b3d-990f-c011c77b26f1 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:11.272749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81acac-8c5c-4b3d-990f-c011c77b26f1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:11.273053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81acac-8c5c-4b3d-990f-c011c77b26f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:11.290115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-dd81acac-8c5c-4b3d-990f-c011c77b26f1 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:11.291301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dd81acac-8c5c-4b3d-990f-c011c77b26f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:11.299664 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3099/6185] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:42:11.303666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81acac-8c5c-4b3d-990f-c011c77b26f1 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:11.312371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d7b44bab-7687-4828-be22-e5cfb6d3fdef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15782bad224b4997bddbcb97a0f3b80f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:11.312528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81acac-8c5c-4b3d-990f-c011c77b26f1 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:11.318152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c8045-6ea6-4740-a929-a2fc79285f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:11.318803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c8045-6ea6-4740-a929-a2fc79285f3e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:11.319090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c8045-6ea6-4740-a929-a2fc79285f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:11.319364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c8045-6ea6-4740-a929-a2fc79285f3e admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:11.322435 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3087/6186] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:42:10 2022] DELETE /identity/v3/users/15782bad224b4997bddbcb97a0f3b80f => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:11.322541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c8045-6ea6-4740-a929-a2fc79285f3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:42:11.322541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c8045-6ea6-4740-a929-a2fc79285f3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:11.322541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c8045-6ea6-4740-a929-a2fc79285f3e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:11.325600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b6ab2-b50e-441d-9e4b-36f1d76c7474 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:11.325877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b6ab2-b50e-441d-9e4b-36f1d76c7474 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:11.326180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b6ab2-b50e-441d-9e4b-36f1d76c7474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:11.334131 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3100/6187] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:42:11.338267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c8045-6ea6-4740-a929-a2fc79285f3e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:11.339932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e08c8045-6ea6-4740-a929-a2fc79285f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:11.343578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-502b6ab2-b50e-441d-9e4b-36f1d76c7474 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:11.344824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-502b6ab2-b50e-441d-9e4b-36f1d76c7474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:11.352628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c8045-6ea6-4740-a929-a2fc79285f3e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:11.405312 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3088/6188] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:42:11.415541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b6ab2-b50e-441d-9e4b-36f1d76c7474 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:11.415708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa8561-6860-42eb-bddf-050a80a6db35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:11.416375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa8561-6860-42eb-bddf-050a80a6db35 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:11.416758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa8561-6860-42eb-bddf-050a80a6db35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:11.416922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-502b6ab2-b50e-441d-9e4b-36f1d76c7474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:11.417047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa8561-6860-42eb-bddf-050a80a6db35 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:11.417769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa8561-6860-42eb-bddf-050a80a6db35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:11.419686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa8561-6860-42eb-bddf-050a80a6db35 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:11.472996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b6ab2-b50e-441d-9e4b-36f1d76c7474 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:11.476780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce9cfe-1f55-4ee3-805e-c55d5e24a00c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:11.477435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce9cfe-1f55-4ee3-805e-c55d5e24a00c service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:11.477724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce9cfe-1f55-4ee3-805e-c55d5e24a00c service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:11.478132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce9cfe-1f55-4ee3-805e-c55d5e24a00c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:11.488488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce9cfe-1f55-4ee3-805e-c55d5e24a00c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:11.490035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce9cfe-1f55-4ee3-805e-c55d5e24a00c service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:11.499308 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3089/6189] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:42:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:42:11.539468 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3101/6190] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:42:11 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:42:11.543526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce9cfe-1f55-4ee3-805e-c55d5e24a00c service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:11.554291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce9cfe-1f55-4ee3-805e-c55d5e24a00c service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:11.609760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc02ff-7cf3-449a-8b35-ae7738ec7120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:11.610499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc02ff-7cf3-449a-8b35-ae7738ec7120 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:11.611445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc02ff-7cf3-449a-8b35-ae7738ec7120 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:11.611737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc02ff-7cf3-449a-8b35-ae7738ec7120 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:11.612477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc02ff-7cf3-449a-8b35-ae7738ec7120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:11.614598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc02ff-7cf3-449a-8b35-ae7738ec7120 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:11.723992 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3090/6191] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:42:11 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:42:11.728310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa8561-6860-42eb-bddf-050a80a6db35 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:11.739309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa8561-6860-42eb-bddf-050a80a6db35 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:11.744128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c65d1-d9c4-48e0-9a75-2a8bdcf0e1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:11.744830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c65d1-d9c4-48e0-9a75-2a8bdcf0e1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:11.745146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c65d1-d9c4-48e0-9a75-2a8bdcf0e1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:11.745430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c65d1-d9c4-48e0-9a75-2a8bdcf0e1d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:11.746167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c65d1-d9c4-48e0-9a75-2a8bdcf0e1d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:11.747889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c65d1-d9c4-48e0-9a75-2a8bdcf0e1d3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:11.755483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc02ff-7cf3-449a-8b35-ae7738ec7120 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:11.758242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-53bc02ff-7cf3-449a-8b35-ae7738ec7120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:11.768462 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3102/6192] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:42:11.769971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c65d1-d9c4-48e0-9a75-2a8bdcf0e1d3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:11.772789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc02ff-7cf3-449a-8b35-ae7738ec7120 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:11.778691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0691b-34fe-435a-b2e4-9de0a50e5b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:11.781123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0691b-34fe-435a-b2e4-9de0a50e5b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:11.781413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0691b-34fe-435a-b2e4-9de0a50e5b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:11.781751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0691b-34fe-435a-b2e4-9de0a50e5b41 admin admin] PATH_INFO: `/v3/projects/7982d97be6f049ed8d728ff671798233` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:11.783464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0691b-34fe-435a-b2e4-9de0a50e5b41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7982d97be6f049ed8d728ff671798233)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:11.785439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0691b-34fe-435a-b2e4-9de0a50e5b41 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:11.788941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c65d1-d9c4-48e0-9a75-2a8bdcf0e1d3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:11.793923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a20d1-7559-4608-8ced-7de6d691924b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:11.794620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a20d1-7559-4608-8ced-7de6d691924b admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:11.794909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a20d1-7559-4608-8ced-7de6d691924b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:11.795332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a20d1-7559-4608-8ced-7de6d691924b admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:11.796097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a20d1-7559-4608-8ced-7de6d691924b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:11.797906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a20d1-7559-4608-8ced-7de6d691924b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:11.809751 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3103/6193] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:42:11.813138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a20d1-7559-4608-8ced-7de6d691924b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:11.822802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a20d1-7559-4608-8ced-7de6d691924b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:11.827417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cbcfa-1af7-411a-9825-0bc71880fb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:11.828285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cbcfa-1af7-411a-9825-0bc71880fb2a admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:11.828575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cbcfa-1af7-411a-9825-0bc71880fb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:11.828899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cbcfa-1af7-411a-9825-0bc71880fb2a admin admin] PATH_INFO: `/v3/projects/63bf588175de48b8814e5d57aef02124/users/7f2f671a95864d1caacc1b6be0dd7884/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:11.843613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cbcfa-1af7-411a-9825-0bc71880fb2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=63bf588175de48b8814e5d57aef02124, user_id=7f2f671a95864d1caacc1b6be0dd7884, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:11.846957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cbcfa-1af7-411a-9825-0bc71880fb2a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:11.983230 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3104/6194] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:42:11 2022] PUT /identity/v3/projects/63bf588175de48b8814e5d57aef02124/users/7f2f671a95864d1caacc1b6be0dd7884/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:11.991590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c3d0691b-34fe-435a-b2e4-9de0a50e5b41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7982d97be6f049ed8d728ff671798233', 'request_id': 'req-c3d0691b-34fe-435a-b2e4-9de0a50e5b41'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:11.993647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ced88a-ca7c-49e5-be68-dba4f6a9d069 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:11.993938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ced88a-ca7c-49e5-be68-dba4f6a9d069 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:11.994221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ced88a-ca7c-49e5-be68-dba4f6a9d069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:11.998974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c3d0691b-34fe-435a-b2e4-9de0a50e5b41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7982d97be6f049ed8d728ff671798233', 'request_id': 'req-c3d0691b-34fe-435a-b2e4-9de0a50e5b41'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:12.020963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-74ced88a-ca7c-49e5-be68-dba4f6a9d069 None None] MFA Rules not processed for user `7f2f671a95864d1caacc1b6be0dd7884`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:12.022175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-74ced88a-ca7c-49e5-be68-dba4f6a9d069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:12.055095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c3d0691b-34fe-435a-b2e4-9de0a50e5b41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7982d97be6f049ed8d728ff671798233', 'request_id': 'req-c3d0691b-34fe-435a-b2e4-9de0a50e5b41'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:12.067686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c3d0691b-34fe-435a-b2e4-9de0a50e5b41 admin admin] The token cache is being invalidate because project 7982d97be6f049ed8d728ff671798233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:42:12.068112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c3d0691b-34fe-435a-b2e4-9de0a50e5b41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:12.069217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c3d0691b-34fe-435a-b2e4-9de0a50e5b41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:12.071113 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3091/6195] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:42:11 2022] DELETE /identity/v3/projects/7982d97be6f049ed8d728ff671798233 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:12.075993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491431d-491e-4454-b2ad-208bc909bbf0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:12.076586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491431d-491e-4454-b2ad-208bc909bbf0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:12.076898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491431d-491e-4454-b2ad-208bc909bbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:12.091197 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3105/6196] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:42:12.097845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9491431d-491e-4454-b2ad-208bc909bbf0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:12.099096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9491431d-491e-4454-b2ad-208bc909bbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:12.102690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ced88a-ca7c-49e5-be68-dba4f6a9d069 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:12.112374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ced88a-ca7c-49e5-be68-dba4f6a9d069 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:12.116817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d16e8-7c56-4a24-a3d3-7dbe5c0d877b tempest-DefaultDomainTestJSON-548730825 tempest-DefaultDomainTestJSON-548730825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f2f671a95864d1caacc1b6be0dd7884', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63bf588175de48b8814e5d57aef02124', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:12.117634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d16e8-7c56-4a24-a3d3-7dbe5c0d877b tempest-DefaultDomainTestJSON-548730825 tempest-DefaultDomainTestJSON-548730825-project] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:12.117925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d16e8-7c56-4a24-a3d3-7dbe5c0d877b tempest-DefaultDomainTestJSON-548730825 tempest-DefaultDomainTestJSON-548730825-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:12.118209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d16e8-7c56-4a24-a3d3-7dbe5c0d877b tempest-DefaultDomainTestJSON-548730825 tempest-DefaultDomainTestJSON-548730825-project] PATH_INFO: `/v3/domains/default` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:12.119401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d16e8-7c56-4a24-a3d3-7dbe5c0d877b tempest-DefaultDomainTestJSON-548730825 tempest-DefaultDomainTestJSON-548730825-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:12.121128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d16e8-7c56-4a24-a3d3-7dbe5c0d877b tempest-DefaultDomainTestJSON-548730825 tempest-DefaultDomainTestJSON-548730825-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:12.122880 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3106/6197] 10.222.0.16 () {58 vars in 1151 bytes} [Mon May 2 10:42:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:42:12.128096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d16e8-7c56-4a24-a3d3-7dbe5c0d877b tempest-DefaultDomainTestJSON-548730825 tempest-DefaultDomainTestJSON-548730825-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:12.129769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-414d16e8-7c56-4a24-a3d3-7dbe5c0d877b tempest-DefaultDomainTestJSON-548730825 tempest-DefaultDomainTestJSON-548730825-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:12.164258 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3092/6198] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:12.172160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e482c-557b-418e-b110-f7f4805d171a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:12.172458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e482c-557b-418e-b110-f7f4805d171a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:12.172785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e482c-557b-418e-b110-f7f4805d171a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:12.191028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ca3e482c-557b-418e-b110-f7f4805d171a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:12.192219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ca3e482c-557b-418e-b110-f7f4805d171a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:12.193204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d16e8-7c56-4a24-a3d3-7dbe5c0d877b tempest-DefaultDomainTestJSON-548730825 tempest-DefaultDomainTestJSON-548730825-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:12.197873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f846d1-e7fe-4fa4-a681-fe59eb2410e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:12.198741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f846d1-e7fe-4fa4-a681-fe59eb2410e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:12.199020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f846d1-e7fe-4fa4-a681-fe59eb2410e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:12.199295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f846d1-e7fe-4fa4-a681-fe59eb2410e5 admin admin] PATH_INFO: `/v3/users/7f2f671a95864d1caacc1b6be0dd7884` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:12.200448 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3093/6199] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:42:12.201062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f846d1-e7fe-4fa4-a681-fe59eb2410e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f2f671a95864d1caacc1b6be0dd7884)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:12.202608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f846d1-e7fe-4fa4-a681-fe59eb2410e5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:12.204569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e482c-557b-418e-b110-f7f4805d171a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:12.214157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e482c-557b-418e-b110-f7f4805d171a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:12.219029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768037d-8261-4c77-bd08-8ea4158880d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:12.219986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768037d-8261-4c77-bd08-8ea4158880d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:12.219986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768037d-8261-4c77-bd08-8ea4158880d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:12.220251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768037d-8261-4c77-bd08-8ea4158880d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:12.221117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768037d-8261-4c77-bd08-8ea4158880d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:42:12.221432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768037d-8261-4c77-bd08-8ea4158880d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:12.223029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768037d-8261-4c77-bd08-8ea4158880d4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:12.238466 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3094/6200] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:42:12.239152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768037d-8261-4c77-bd08-8ea4158880d4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:12.248721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768037d-8261-4c77-bd08-8ea4158880d4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:12.254118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f29d0-c183-4597-8581-a84be2da4001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:12.254740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f29d0-c183-4597-8581-a84be2da4001 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:12.255033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f29d0-c183-4597-8581-a84be2da4001 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:12.255340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f29d0-c183-4597-8581-a84be2da4001 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:12.256010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f29d0-c183-4597-8581-a84be2da4001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:12.257944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f29d0-c183-4597-8581-a84be2da4001 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:12.351454 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3095/6201] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:42:12 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:42:12.355499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f29d0-c183-4597-8581-a84be2da4001 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:12.416160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f29d0-c183-4597-8581-a84be2da4001 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:12.420950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a858425-1f05-4134-b70c-ff665cfb600d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:12.421668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a858425-1f05-4134-b70c-ff665cfb600d admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:12.421956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a858425-1f05-4134-b70c-ff665cfb600d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:12.422241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a858425-1f05-4134-b70c-ff665cfb600d admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:12.422932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a858425-1f05-4134-b70c-ff665cfb600d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:12.424924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a858425-1f05-4134-b70c-ff665cfb600d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:12.428592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e3f846d1-e7fe-4fa4-a681-fe59eb2410e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f2f671a95864d1caacc1b6be0dd7884'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:12.441836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e3f846d1-e7fe-4fa4-a681-fe59eb2410e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f2f671a95864d1caacc1b6be0dd7884'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:12.442582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e3f846d1-e7fe-4fa4-a681-fe59eb2410e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f2f671a95864d1caacc1b6be0dd7884'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:12.449542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e3f846d1-e7fe-4fa4-a681-fe59eb2410e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f2f671a95864d1caacc1b6be0dd7884'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:12.493588 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3096/6202] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:42:12 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:42:12.497492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a858425-1f05-4134-b70c-ff665cfb600d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:12.508284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a858425-1f05-4134-b70c-ff665cfb600d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:12.513175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e701f8-e7ec-4548-b3df-0cb749e38468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:12.518147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e701f8-e7ec-4548-b3df-0cb749e38468 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:12.518147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e701f8-e7ec-4548-b3df-0cb749e38468 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:12.518147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e701f8-e7ec-4548-b3df-0cb749e38468 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:12.518147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e701f8-e7ec-4548-b3df-0cb749e38468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:12.518147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e701f8-e7ec-4548-b3df-0cb749e38468 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:12.519916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e3f846d1-e7fe-4fa4-a681-fe59eb2410e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f2f671a95864d1caacc1b6be0dd7884'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:12.527297 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3107/6203] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:42:12 2022] DELETE /identity/v3/users/7f2f671a95864d1caacc1b6be0dd7884 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:12.528884 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3097/6204] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:42:12.532675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e701f8-e7ec-4548-b3df-0cb749e38468 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:12.533039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d3d17-594e-4814-aa05-59a4040d261f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:12.533519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d3d17-594e-4814-aa05-59a4040d261f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:12.533862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d3d17-594e-4814-aa05-59a4040d261f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:12.535188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-08e701f8-e7ec-4548-b3df-0cb749e38468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:12.547856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e701f8-e7ec-4548-b3df-0cb749e38468 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:12.552899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-472d3d17-594e-4814-aa05-59a4040d261f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:12.554095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-472d3d17-594e-4814-aa05-59a4040d261f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:12.604993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df3327-7dd9-428d-824c-bd36212ac243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:12.605960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df3327-7dd9-428d-824c-bd36212ac243 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:12.606416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df3327-7dd9-428d-824c-bd36212ac243 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:12.606855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df3327-7dd9-428d-824c-bd36212ac243 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:12.607696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df3327-7dd9-428d-824c-bd36212ac243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:12.609331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df3327-7dd9-428d-824c-bd36212ac243 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:12.613288 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3108/6205] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:12.620826 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3098/6206] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:42:12.624131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d3d17-594e-4814-aa05-59a4040d261f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:12.625569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-472d3d17-594e-4814-aa05-59a4040d261f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:12.625755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df3327-7dd9-428d-824c-bd36212ac243 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:12.637873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df3327-7dd9-428d-824c-bd36212ac243 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:12.642850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869f40c-e7cf-431d-bc6e-8c1eccf4cf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:12.643733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869f40c-e7cf-431d-bc6e-8c1eccf4cf26 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:12.645914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869f40c-e7cf-431d-bc6e-8c1eccf4cf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:12.645914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869f40c-e7cf-431d-bc6e-8c1eccf4cf26 admin admin] PATH_INFO: `/v3/projects/65a6b304e9524cc4bd38f4a65d38c496/users/19d11ec9bab64c36b8de2bddb20348e7/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:12.659216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0869f40c-e7cf-431d-bc6e-8c1eccf4cf26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a6b304e9524cc4bd38f4a65d38c496, user_id=19d11ec9bab64c36b8de2bddb20348e7, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:12.662016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0869f40c-e7cf-431d-bc6e-8c1eccf4cf26 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:12.682995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d3d17-594e-4814-aa05-59a4040d261f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:12.686650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4afac-42fe-4772-850d-7b200ece82c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:12.687293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4afac-42fe-4772-850d-7b200ece82c0 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:12.687577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4afac-42fe-4772-850d-7b200ece82c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:12.687852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4afac-42fe-4772-850d-7b200ece82c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:12.697563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4afac-42fe-4772-850d-7b200ece82c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:12.698978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4afac-42fe-4772-850d-7b200ece82c0 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:12.709021 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3109/6207] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:42:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:42:12.732088 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3099/6208] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:42:12 2022] PUT /identity/v3/projects/65a6b304e9524cc4bd38f4a65d38c496/users/19d11ec9bab64c36b8de2bddb20348e7/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:12.743846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e56bf-4d6c-4714-afc7-e587b1119058 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:12.744201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e56bf-4d6c-4714-afc7-e587b1119058 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:12.744494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e56bf-4d6c-4714-afc7-e587b1119058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:12.772703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3f2e56bf-4d6c-4714-afc7-e587b1119058 None None] MFA Rules not processed for user `19d11ec9bab64c36b8de2bddb20348e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:12.773931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3f2e56bf-4d6c-4714-afc7-e587b1119058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:12.838068 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3110/6209] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:12.848723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869f40c-e7cf-431d-bc6e-8c1eccf4cf26 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:12.850589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0869f40c-e7cf-431d-bc6e-8c1eccf4cf26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:12.912968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869f40c-e7cf-431d-bc6e-8c1eccf4cf26 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:12.918755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb06e89-3756-4069-9067-4b0b5f71436f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:12.918755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb06e89-3756-4069-9067-4b0b5f71436f service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:12.918755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb06e89-3756-4069-9067-4b0b5f71436f service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:12.918755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb06e89-3756-4069-9067-4b0b5f71436f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:12.929279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb06e89-3756-4069-9067-4b0b5f71436f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:12.930731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb06e89-3756-4069-9067-4b0b5f71436f service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:12.939916 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3100/6210] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:42:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:42:13.172069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e56bf-4d6c-4714-afc7-e587b1119058 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:13.174082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3f2e56bf-4d6c-4714-afc7-e587b1119058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:13.246255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e56bf-4d6c-4714-afc7-e587b1119058 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:13.251383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe567ba3-8f59-4a6e-a1a5-d6296b00df58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:13.252228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe567ba3-8f59-4a6e-a1a5-d6296b00df58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:13.252576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe567ba3-8f59-4a6e-a1a5-d6296b00df58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:13.253037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe567ba3-8f59-4a6e-a1a5-d6296b00df58 admin admin] PATH_INFO: `/v3/projects/63bf588175de48b8814e5d57aef02124` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:13.254335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe567ba3-8f59-4a6e-a1a5-d6296b00df58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63bf588175de48b8814e5d57aef02124)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:13.256325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe567ba3-8f59-4a6e-a1a5-d6296b00df58 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:13.264179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb06e89-3756-4069-9067-4b0b5f71436f service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:13.276347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb06e89-3756-4069-9067-4b0b5f71436f service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:13.280965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefb60f-e3fb-4c08-888f-e2e09681379d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:13.281859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefb60f-e3fb-4c08-888f-e2e09681379d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:13.282144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefb60f-e3fb-4c08-888f-e2e09681379d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:13.282420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefb60f-e3fb-4c08-888f-e2e09681379d admin admin] PATH_INFO: `/v3/users/19d11ec9bab64c36b8de2bddb20348e7` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:13.284184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefb60f-e3fb-4c08-888f-e2e09681379d admin admin] RBAC: Authorizing `identity:delete_user(user_id=19d11ec9bab64c36b8de2bddb20348e7)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:13.286173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefb60f-e3fb-4c08-888f-e2e09681379d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:13.679651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fe567ba3-8f59-4a6e-a1a5-d6296b00df58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63bf588175de48b8814e5d57aef02124', 'request_id': 'req-fe567ba3-8f59-4a6e-a1a5-d6296b00df58'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:13.894900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fe567ba3-8f59-4a6e-a1a5-d6296b00df58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63bf588175de48b8814e5d57aef02124', 'request_id': 'req-fe567ba3-8f59-4a6e-a1a5-d6296b00df58'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:13.901851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fe567ba3-8f59-4a6e-a1a5-d6296b00df58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63bf588175de48b8814e5d57aef02124', 'request_id': 'req-fe567ba3-8f59-4a6e-a1a5-d6296b00df58'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:13.908122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bfefb60f-e3fb-4c08-888f-e2e09681379d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19d11ec9bab64c36b8de2bddb20348e7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:13.912357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fe567ba3-8f59-4a6e-a1a5-d6296b00df58 admin admin] The token cache is being invalidate because project 63bf588175de48b8814e5d57aef02124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:42:13.912674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fe567ba3-8f59-4a6e-a1a5-d6296b00df58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:13.913314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fe567ba3-8f59-4a6e-a1a5-d6296b00df58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:13.914862 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3111/6211] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:42:13 2022] DELETE /identity/v3/projects/63bf588175de48b8814e5d57aef02124 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:13.919476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041f490-8201-4208-9d58-4f2c52ab6681 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:13.919764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041f490-8201-4208-9d58-4f2c52ab6681 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:13.919871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bfefb60f-e3fb-4c08-888f-e2e09681379d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19d11ec9bab64c36b8de2bddb20348e7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:13.920049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041f490-8201-4208-9d58-4f2c52ab6681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:13.920576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bfefb60f-e3fb-4c08-888f-e2e09681379d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19d11ec9bab64c36b8de2bddb20348e7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:13.927744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bfefb60f-e3fb-4c08-888f-e2e09681379d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19d11ec9bab64c36b8de2bddb20348e7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:13.938197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9041f490-8201-4208-9d58-4f2c52ab6681 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:13.939925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9041f490-8201-4208-9d58-4f2c52ab6681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:13.997390 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3112/6212] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:42:14.080949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a36eb2-d0ca-4cd1-a949-5e4c2ed3b87a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:14.081242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a36eb2-d0ca-4cd1-a949-5e4c2ed3b87a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:14.081526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a36eb2-d0ca-4cd1-a949-5e4c2ed3b87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:14.107158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-86a36eb2-d0ca-4cd1-a949-5e4c2ed3b87a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:14.107158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-86a36eb2-d0ca-4cd1-a949-5e4c2ed3b87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:14.114381 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3113/6213] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:42:14.118804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a36eb2-d0ca-4cd1-a949-5e4c2ed3b87a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:14.125636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bfefb60f-e3fb-4c08-888f-e2e09681379d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19d11ec9bab64c36b8de2bddb20348e7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:14.130234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a36eb2-d0ca-4cd1-a949-5e4c2ed3b87a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:14.133173 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3101/6214] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:42:13 2022] DELETE /identity/v3/users/19d11ec9bab64c36b8de2bddb20348e7 => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:14.134045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c8126-235b-4676-998a-55ef8798b26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:14.134707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c8126-235b-4676-998a-55ef8798b26b admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:14.134995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c8126-235b-4676-998a-55ef8798b26b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:14.135282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c8126-235b-4676-998a-55ef8798b26b admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:14.136135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c8126-235b-4676-998a-55ef8798b26b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:42:14.136452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c8126-235b-4676-998a-55ef8798b26b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:14.137662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebb05f-4c57-48a3-ba7e-dcb8ea93c7fe None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:14.138025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebb05f-4c57-48a3-ba7e-dcb8ea93c7fe None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:14.138150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c8126-235b-4676-998a-55ef8798b26b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:14.138432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebb05f-4c57-48a3-ba7e-dcb8ea93c7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:14.153845 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3114/6215] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:42:14.157392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c8126-235b-4676-998a-55ef8798b26b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:14.158999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-92ebb05f-4c57-48a3-ba7e-dcb8ea93c7fe None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:14.159147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-851c8126-235b-4676-998a-55ef8798b26b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:14.160321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-92ebb05f-4c57-48a3-ba7e-dcb8ea93c7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:14.173681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c8126-235b-4676-998a-55ef8798b26b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:14.225442 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3102/6216] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:42:14.233471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c857d-e854-4bc1-b4a4-7c3f459aefa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:14.234254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c857d-e854-4bc1-b4a4-7c3f459aefa2 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:14.234551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c857d-e854-4bc1-b4a4-7c3f459aefa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:14.234840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c857d-e854-4bc1-b4a4-7c3f459aefa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:14.236135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c857d-e854-4bc1-b4a4-7c3f459aefa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:14.237558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebb05f-4c57-48a3-ba7e-dcb8ea93c7fe None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:14.238107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c857d-e854-4bc1-b4a4-7c3f459aefa2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:14.239271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-92ebb05f-4c57-48a3-ba7e-dcb8ea93c7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:14.294852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebb05f-4c57-48a3-ba7e-dcb8ea93c7fe None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:14.299174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f65dd3-4931-4a04-9d1e-eba949cab22f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:14.299820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f65dd3-4931-4a04-9d1e-eba949cab22f service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:14.300099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f65dd3-4931-4a04-9d1e-eba949cab22f service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:14.300369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f65dd3-4931-4a04-9d1e-eba949cab22f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:14.309536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f65dd3-4931-4a04-9d1e-eba949cab22f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:14.311028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f65dd3-4931-4a04-9d1e-eba949cab22f service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:14.321673 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3103/6217] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:42:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:42:14.342755 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3115/6218] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:42:14 2022] POST /identity/v3/projects => generated 375 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:42:14.347084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f65dd3-4931-4a04-9d1e-eba949cab22f service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:14.357133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f65dd3-4931-4a04-9d1e-eba949cab22f service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:14.414958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25069422-54bc-4afd-8cd7-06b0e0444c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:14.415641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25069422-54bc-4afd-8cd7-06b0e0444c45 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:14.415931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25069422-54bc-4afd-8cd7-06b0e0444c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:14.416212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25069422-54bc-4afd-8cd7-06b0e0444c45 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:14.416950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25069422-54bc-4afd-8cd7-06b0e0444c45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:14.418882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25069422-54bc-4afd-8cd7-06b0e0444c45 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:14.511168 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3104/6219] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:42:14 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:42:14.512670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c857d-e854-4bc1-b4a4-7c3f459aefa2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:14.525246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c857d-e854-4bc1-b4a4-7c3f459aefa2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:14.531997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedb79f-0ea4-43d5-aba4-de4c8251ae2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:14.533295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedb79f-0ea4-43d5-aba4-de4c8251ae2a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:14.533646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedb79f-0ea4-43d5-aba4-de4c8251ae2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:14.533983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedb79f-0ea4-43d5-aba4-de4c8251ae2a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:14.534671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bedb79f-0ea4-43d5-aba4-de4c8251ae2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:14.536268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bedb79f-0ea4-43d5-aba4-de4c8251ae2a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:14.551399 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3116/6220] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:42:14.555117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25069422-54bc-4afd-8cd7-06b0e0444c45 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:14.565789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25069422-54bc-4afd-8cd7-06b0e0444c45 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:14.571689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6d960-572b-426b-93b4-a7f7c0d0d874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:14.572385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6d960-572b-426b-93b4-a7f7c0d0d874 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:14.572699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6d960-572b-426b-93b4-a7f7c0d0d874 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:14.572988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6d960-572b-426b-93b4-a7f7c0d0d874 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:14.573796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6d960-572b-426b-93b4-a7f7c0d0d874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:14.575469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6d960-572b-426b-93b4-a7f7c0d0d874 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:14.588675 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3105/6221] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:42:14.590503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedb79f-0ea4-43d5-aba4-de4c8251ae2a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:14.601787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedb79f-0ea4-43d5-aba4-de4c8251ae2a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:14.606578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf068cb-5295-4c30-bdb5-20ae3766588a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:14.607774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf068cb-5295-4c30-bdb5-20ae3766588a admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:14.608184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf068cb-5295-4c30-bdb5-20ae3766588a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:14.608469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf068cb-5295-4c30-bdb5-20ae3766588a admin admin] PATH_INFO: `/v3/projects/0b45451f7a284ed4aa65658747b32248/users/dff39b1cfd3d4f65a9fa9646d6f021e1/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:14.623892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf068cb-5295-4c30-bdb5-20ae3766588a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b45451f7a284ed4aa65658747b32248, user_id=dff39b1cfd3d4f65a9fa9646d6f021e1, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:14.627037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf068cb-5295-4c30-bdb5-20ae3766588a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:14.714505 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3117/6222] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:42:14 2022] PUT /identity/v3/projects/0b45451f7a284ed4aa65658747b32248/users/dff39b1cfd3d4f65a9fa9646d6f021e1/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:14.725190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb884be-24c3-4bf9-9d38-c3ca43366e1a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:14.726609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb884be-24c3-4bf9-9d38-c3ca43366e1a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:14.726609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb884be-24c3-4bf9-9d38-c3ca43366e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:14.748111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf068cb-5295-4c30-bdb5-20ae3766588a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:14.750039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bcf068cb-5295-4c30-bdb5-20ae3766588a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:14.755447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-bbb884be-24c3-4bf9-9d38-c3ca43366e1a None None] MFA Rules not processed for user `dff39b1cfd3d4f65a9fa9646d6f021e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:14.757089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bbb884be-24c3-4bf9-9d38-c3ca43366e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:14.818500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf068cb-5295-4c30-bdb5-20ae3766588a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:14.823694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203853a1-10bb-4417-8c31-ca9f36d67b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:14.824342 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3106/6223] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:14.824765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203853a1-10bb-4417-8c31-ca9f36d67b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:14.825167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203853a1-10bb-4417-8c31-ca9f36d67b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:14.825514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203853a1-10bb-4417-8c31-ca9f36d67b4d admin admin] PATH_INFO: `/v3/projects/65a6b304e9524cc4bd38f4a65d38c496` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:14.826825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203853a1-10bb-4417-8c31-ca9f36d67b4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=65a6b304e9524cc4bd38f4a65d38c496)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:14.829231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203853a1-10bb-4417-8c31-ca9f36d67b4d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:14.829926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb884be-24c3-4bf9-9d38-c3ca43366e1a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:14.838372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb884be-24c3-4bf9-9d38-c3ca43366e1a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:14.842821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e50e0-36a0-4541-af10-9fbbc049fd52 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff39b1cfd3d4f65a9fa9646d6f021e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b45451f7a284ed4aa65658747b32248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:14.843711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e50e0-36a0-4541-af10-9fbbc049fd52 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:14.843997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e50e0-36a0-4541-af10-9fbbc049fd52 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:14.844276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e50e0-36a0-4541-af10-9fbbc049fd52 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] PATH_INFO: `/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1/password` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:14.934057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-203853a1-10bb-4417-8c31-ca9f36d67b4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65a6b304e9524cc4bd38f4a65d38c496', 'request_id': 'req-203853a1-10bb-4417-8c31-ca9f36d67b4d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:14.944923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-908e50e0-36a0-4541-af10-9fbbc049fd52 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dff39b1cfd3d4f65a9fa9646d6f021e1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:15.022786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-203853a1-10bb-4417-8c31-ca9f36d67b4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65a6b304e9524cc4bd38f4a65d38c496', 'request_id': 'req-203853a1-10bb-4417-8c31-ca9f36d67b4d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:15.029700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-203853a1-10bb-4417-8c31-ca9f36d67b4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65a6b304e9524cc4bd38f4a65d38c496', 'request_id': 'req-203853a1-10bb-4417-8c31-ca9f36d67b4d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:15.040721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-203853a1-10bb-4417-8c31-ca9f36d67b4d admin admin] The token cache is being invalidate because project 65a6b304e9524cc4bd38f4a65d38c496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:42:15.041015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-203853a1-10bb-4417-8c31-ca9f36d67b4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:15.041676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-203853a1-10bb-4417-8c31-ca9f36d67b4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:15.043265 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3118/6224] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:42:14 2022] DELETE /identity/v3/projects/65a6b304e9524cc4bd38f4a65d38c496 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:15.048243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba791bc1-8e1e-4b74-a3b3-495823137eef None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:15.048539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba791bc1-8e1e-4b74-a3b3-495823137eef None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:15.048860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba791bc1-8e1e-4b74-a3b3-495823137eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:15.067890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ba791bc1-8e1e-4b74-a3b3-495823137eef None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:15.069136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ba791bc1-8e1e-4b74-a3b3-495823137eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:15.081504 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3107/6225] 10.222.0.16 () {60 vars in 1268 bytes} [Mon May 2 10:42:14 2022] POST /identity/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1/password => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:15.128303 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3119/6226] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:42:15.136401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02e05a-9389-47a6-8d2e-8cc68eab4548 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:15.137949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02e05a-9389-47a6-8d2e-8cc68eab4548 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:15.137949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02e05a-9389-47a6-8d2e-8cc68eab4548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:15.154938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-bf02e05a-9389-47a6-8d2e-8cc68eab4548 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:15.156138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bf02e05a-9389-47a6-8d2e-8cc68eab4548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:15.164331 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3108/6227] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:15.168549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba791bc1-8e1e-4b74-a3b3-495823137eef None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:15.178301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba791bc1-8e1e-4b74-a3b3-495823137eef None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:15.182935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccf8ff-601f-4373-bf4e-b5b9e0364a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:15.183589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccf8ff-601f-4373-bf4e-b5b9e0364a33 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:15.183875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccf8ff-601f-4373-bf4e-b5b9e0364a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:15.184157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccf8ff-601f-4373-bf4e-b5b9e0364a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:15.184996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccf8ff-601f-4373-bf4e-b5b9e0364a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:42:15.185280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccf8ff-601f-4373-bf4e-b5b9e0364a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:15.186870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccf8ff-601f-4373-bf4e-b5b9e0364a33 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:15.198889 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3120/6228] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:42:15.203269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02e05a-9389-47a6-8d2e-8cc68eab4548 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:15.212994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02e05a-9389-47a6-8d2e-8cc68eab4548 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:15.217568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e59eff-ca4a-40c6-b742-26fe81d793b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:15.227025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e59eff-ca4a-40c6-b742-26fe81d793b8 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:15.227025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e59eff-ca4a-40c6-b742-26fe81d793b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:15.227025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e59eff-ca4a-40c6-b742-26fe81d793b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:15.227025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e59eff-ca4a-40c6-b742-26fe81d793b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:15.227025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e59eff-ca4a-40c6-b742-26fe81d793b8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:15.325054 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3109/6229] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:42:15 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:42:15.329167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccf8ff-601f-4373-bf4e-b5b9e0364a33 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:15.339541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccf8ff-601f-4373-bf4e-b5b9e0364a33 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:15.395544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ae93d-c15d-427d-8ef7-f87890be5bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:15.396216 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ae93d-c15d-427d-8ef7-f87890be5bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:15.396505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ae93d-c15d-427d-8ef7-f87890be5bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:15.396815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ae93d-c15d-427d-8ef7-f87890be5bd7 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:15.397518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ae93d-c15d-427d-8ef7-f87890be5bd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:15.399464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ae93d-c15d-427d-8ef7-f87890be5bd7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:15.461150 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3121/6230] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:42:15 2022] POST /identity/v3/users => generated 291 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:42:15.465243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e59eff-ca4a-40c6-b742-26fe81d793b8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:15.475631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e59eff-ca4a-40c6-b742-26fe81d793b8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:15.480422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bca187-41b8-474d-a106-eefae8bef184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:15.481135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bca187-41b8-474d-a106-eefae8bef184 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:15.481407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bca187-41b8-474d-a106-eefae8bef184 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:15.481688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bca187-41b8-474d-a106-eefae8bef184 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:15.482489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bca187-41b8-474d-a106-eefae8bef184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:15.484107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bca187-41b8-474d-a106-eefae8bef184 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:15.494554 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3110/6231] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:42:15.498551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ae93d-c15d-427d-8ef7-f87890be5bd7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:15.509693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ae93d-c15d-427d-8ef7-f87890be5bd7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:15.514724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef2c59-a0bd-4962-abe6-0763c745b880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:15.515411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef2c59-a0bd-4962-abe6-0763c745b880 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:15.515693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef2c59-a0bd-4962-abe6-0763c745b880 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:15.515969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef2c59-a0bd-4962-abe6-0763c745b880 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:15.516787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef2c59-a0bd-4962-abe6-0763c745b880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:15.523266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef2c59-a0bd-4962-abe6-0763c745b880 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:15.528246 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3122/6232] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:42:15.533036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bca187-41b8-474d-a106-eefae8bef184 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:15.542922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bca187-41b8-474d-a106-eefae8bef184 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:15.547573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c90d81-e3ed-45dc-b362-8d7415204cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:15.548992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c90d81-e3ed-45dc-b362-8d7415204cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:15.553473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c90d81-e3ed-45dc-b362-8d7415204cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:15.553473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c90d81-e3ed-45dc-b362-8d7415204cc9 admin admin] PATH_INFO: `/v3/projects/03cbe7924e22488b92979871106a3ece/users/5ced847d8ea7448aab8de7a3bbc72c83/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:15.564727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c90d81-e3ed-45dc-b362-8d7415204cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03cbe7924e22488b92979871106a3ece, user_id=5ced847d8ea7448aab8de7a3bbc72c83, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:15.567370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c90d81-e3ed-45dc-b362-8d7415204cc9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:15.634219 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3111/6233] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:42:15 2022] PUT /identity/v3/projects/03cbe7924e22488b92979871106a3ece/users/5ced847d8ea7448aab8de7a3bbc72c83/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:15.644735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42824860-f9d3-45b5-939a-9ee3ec5bdbe3 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:15.645027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42824860-f9d3-45b5-939a-9ee3ec5bdbe3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:15.645351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42824860-f9d3-45b5-939a-9ee3ec5bdbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:15.671328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-42824860-f9d3-45b5-939a-9ee3ec5bdbe3 None None] MFA Rules not processed for user `5ced847d8ea7448aab8de7a3bbc72c83`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:15.672560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-42824860-f9d3-45b5-939a-9ee3ec5bdbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:15.735438 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3123/6234] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:15.740508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c90d81-e3ed-45dc-b362-8d7415204cc9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:15.800814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c90d81-e3ed-45dc-b362-8d7415204cc9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:15.805608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c24c0-ce11-4d8e-a66f-7ced8178dbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:15.806274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c24c0-ce11-4d8e-a66f-7ced8178dbaa admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:15.806557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c24c0-ce11-4d8e-a66f-7ced8178dbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:15.806830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c24c0-ce11-4d8e-a66f-7ced8178dbaa admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:15.807542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c24c0-ce11-4d8e-a66f-7ced8178dbaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:15.809650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c24c0-ce11-4d8e-a66f-7ced8178dbaa admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:15.893315 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3112/6235] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:42:15 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:42:15.897564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42824860-f9d3-45b5-939a-9ee3ec5bdbe3 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:15.908880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42824860-f9d3-45b5-939a-9ee3ec5bdbe3 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:15.964348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a3e61-9fa3-4b2e-b483-65e6e37f3937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:15.965032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a3e61-9fa3-4b2e-b483-65e6e37f3937 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:15.965322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a3e61-9fa3-4b2e-b483-65e6e37f3937 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:15.965597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a3e61-9fa3-4b2e-b483-65e6e37f3937 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:15.966290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a3e61-9fa3-4b2e-b483-65e6e37f3937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:15.968201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a3e61-9fa3-4b2e-b483-65e6e37f3937 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:16.052710 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3124/6236] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:42:15 2022] POST /identity/v3/users => generated 296 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:42:16.056802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c24c0-ce11-4d8e-a66f-7ced8178dbaa admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:16.067268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c24c0-ce11-4d8e-a66f-7ced8178dbaa admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:16.072278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf78cd4-46af-4cad-8acb-a08764a2cb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:16.072975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf78cd4-46af-4cad-8acb-a08764a2cb49 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:16.073290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf78cd4-46af-4cad-8acb-a08764a2cb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:16.073587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf78cd4-46af-4cad-8acb-a08764a2cb49 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:16.074336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf78cd4-46af-4cad-8acb-a08764a2cb49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:16.076004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf78cd4-46af-4cad-8acb-a08764a2cb49 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:16.086656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64911e-a727-4f5c-ad02-674d6d10c985 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:16.086958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64911e-a727-4f5c-ad02-674d6d10c985 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:16.087268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64911e-a727-4f5c-ad02-674d6d10c985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:16.088117 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3113/6237] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:42:16.092174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf78cd4-46af-4cad-8acb-a08764a2cb49 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:16.106713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ed64911e-a727-4f5c-ad02-674d6d10c985 None None] MFA Rules not processed for user `dff39b1cfd3d4f65a9fa9646d6f021e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:16.108576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ed64911e-a727-4f5c-ad02-674d6d10c985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:16.109506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf78cd4-46af-4cad-8acb-a08764a2cb49 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:16.112511 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3125/6238] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:16 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 10:42:16.114937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6face64d-85b6-4a8c-8eb8-854cb25181d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:16.116095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6face64d-85b6-4a8c-8eb8-854cb25181d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:16.116381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6face64d-85b6-4a8c-8eb8-854cb25181d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:16.116692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6face64d-85b6-4a8c-8eb8-854cb25181d6 admin admin] PATH_INFO: `/v3/projects/0827d6376fc44d75b5dc075535afa7bc/users/a169920c79bf45e7bd7982bea65ef52b/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:16.117038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8c8dc-f542-482e-afe6-1c5ec80a6939 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:16.117336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8c8dc-f542-482e-afe6-1c5ec80a6939 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:16.117628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8c8dc-f542-482e-afe6-1c5ec80a6939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:16.131989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6face64d-85b6-4a8c-8eb8-854cb25181d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0827d6376fc44d75b5dc075535afa7bc, user_id=a169920c79bf45e7bd7982bea65ef52b, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:16.136213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6face64d-85b6-4a8c-8eb8-854cb25181d6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:16.140175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-aca8c8dc-f542-482e-afe6-1c5ec80a6939 None None] MFA Rules not processed for user `dff39b1cfd3d4f65a9fa9646d6f021e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:16.141417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-aca8c8dc-f542-482e-afe6-1c5ec80a6939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:16.194661 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3126/6239] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:16.198597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8c8dc-f542-482e-afe6-1c5ec80a6939 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:16.206697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8c8dc-f542-482e-afe6-1c5ec80a6939 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:16.211083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a4de7-7bc7-4137-b0ba-67b3923407e1 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff39b1cfd3d4f65a9fa9646d6f021e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b45451f7a284ed4aa65658747b32248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:16.215489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a4de7-7bc7-4137-b0ba-67b3923407e1 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:16.215489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a4de7-7bc7-4137-b0ba-67b3923407e1 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:16.215489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a4de7-7bc7-4137-b0ba-67b3923407e1 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] PATH_INFO: `/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1/password` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:16.240967 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3114/6240] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:42:16 2022] PUT /identity/v3/projects/0827d6376fc44d75b5dc075535afa7bc/users/a169920c79bf45e7bd7982bea65ef52b/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:16.244924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6face64d-85b6-4a8c-8eb8-854cb25181d6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:16.266688 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-382a4de7-7bc7-4137-b0ba-67b3923407e1 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. May 02 10:42:16.266688 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:42:16.266688 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:42:16.266688 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:42:16.266688 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:42:16.266688 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:42:16.266688 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:42:16.266688 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:42:16.266688 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:42:16.266688 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:42:16.266688 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:42:16.266688 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:42:16.266688 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper May 02 10:42:16.268096 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(*args, **kwargs) May 02 10:42:16.268096 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post May 02 10:42:16.268096 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( May 02 10:42:16.268096 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:42:16.268096 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:42:16.268096 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 10:42:16.268096 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:42:16.268096 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password May 02 10:42:16.268096 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) May 02 10:42:16.268096 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password May 02 10:42:16.268096 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) May 02 10:42:16.268096 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history May 02 10:42:16.268096 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( May 02 10:42:16.268096 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. May 02 10:42:16.268096 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:42:16.269138 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3127/6241] 10.222.0.16 () {60 vars in 1268 bytes} [Mon May 2 10:42:16 2022] POST /identity/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1/password => generated 188 bytes in 70 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) May 02 10:42:16.273645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a4de7-7bc7-4137-b0ba-67b3923407e1 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:16.283449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a4de7-7bc7-4137-b0ba-67b3923407e1 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:16.305594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6face64d-85b6-4a8c-8eb8-854cb25181d6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:16.313539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c0a5c-7bfa-4776-9325-6b1fe2e47b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:16.313539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c0a5c-7bfa-4776-9325-6b1fe2e47b31 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:16.313539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c0a5c-7bfa-4776-9325-6b1fe2e47b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:16.313539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c0a5c-7bfa-4776-9325-6b1fe2e47b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:16.313988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c0a5c-7bfa-4776-9325-6b1fe2e47b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:16.314089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c0a5c-7bfa-4776-9325-6b1fe2e47b31 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:16.324552 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3115/6242] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:42:16.328816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c0a5c-7bfa-4776-9325-6b1fe2e47b31 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:16.339502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c0a5c-7bfa-4776-9325-6b1fe2e47b31 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:16.344559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c89de-4dcd-4a61-8e09-b7428d71890e tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff39b1cfd3d4f65a9fa9646d6f021e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b45451f7a284ed4aa65658747b32248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:16.344916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba37441-2b8f-4448-b6c3-ae2ed5d97433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:16.346093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c89de-4dcd-4a61-8e09-b7428d71890e tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:16.346854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba37441-2b8f-4448-b6c3-ae2ed5d97433 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:16.346982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c89de-4dcd-4a61-8e09-b7428d71890e tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:16.347074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba37441-2b8f-4448-b6c3-ae2ed5d97433 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:16.347159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c89de-4dcd-4a61-8e09-b7428d71890e tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] PATH_INFO: `/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1/password` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:16.347241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba37441-2b8f-4448-b6c3-ae2ed5d97433 admin admin] PATH_INFO: `/v3/projects/0827d6376fc44d75b5dc075535afa7bc/users/a169920c79bf45e7bd7982bea65ef52b/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:16.348916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba37441-2b8f-4448-b6c3-ae2ed5d97433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0827d6376fc44d75b5dc075535afa7bc, user_id=a169920c79bf45e7bd7982bea65ef52b, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:16.351704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba37441-2b8f-4448-b6c3-ae2ed5d97433 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:16.363422 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3116/6243] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:42:16 2022] PUT /identity/v3/projects/0827d6376fc44d75b5dc075535afa7bc/users/a169920c79bf45e7bd7982bea65ef52b/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:16.375146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a59dc8-aab3-475d-b6bf-510901e58f3e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:16.377204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a59dc8-aab3-475d-b6bf-510901e58f3e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:16.377473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a59dc8-aab3-475d-b6bf-510901e58f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:16.396245 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-e60c89de-4dcd-4a61-8e09-b7428d71890e tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. May 02 10:42:16.396245 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:42:16.396245 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:42:16.396245 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:42:16.396245 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:42:16.396245 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:42:16.396245 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:42:16.396245 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:42:16.396245 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:42:16.396245 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:42:16.396245 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:42:16.396245 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:42:16.396245 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper May 02 10:42:16.397345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(*args, **kwargs) May 02 10:42:16.397345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post May 02 10:42:16.397345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( May 02 10:42:16.397345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:42:16.397345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:42:16.397345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 02 10:42:16.397345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 02 10:42:16.397345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password May 02 10:42:16.397345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) May 02 10:42:16.397345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password May 02 10:42:16.397345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) May 02 10:42:16.397345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history May 02 10:42:16.397345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( May 02 10:42:16.397345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. May 02 10:42:16.397345 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:42:16.398416 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3128/6244] 10.222.0.16 () {60 vars in 1268 bytes} [Mon May 2 10:42:16 2022] POST /identity/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1/password => generated 188 bytes in 124 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 02 10:42:16.401463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c89de-4dcd-4a61-8e09-b7428d71890e tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:16.407998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a6a59dc8-aab3-475d-b6bf-510901e58f3e None None] MFA Rules not processed for user `a169920c79bf45e7bd7982bea65ef52b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:16.409235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a6a59dc8-aab3-475d-b6bf-510901e58f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:16.411427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c89de-4dcd-4a61-8e09-b7428d71890e tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:16.462680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b3cca-46a6-43a1-90fe-ae43db74107a tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff39b1cfd3d4f65a9fa9646d6f021e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b45451f7a284ed4aa65658747b32248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:16.463533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b3cca-46a6-43a1-90fe-ae43db74107a tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:16.463821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b3cca-46a6-43a1-90fe-ae43db74107a tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:16.464100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b3cca-46a6-43a1-90fe-ae43db74107a tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] PATH_INFO: `/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1/password` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:16.477545 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3117/6245] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:42:16.490830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a59dc8-aab3-475d-b6bf-510901e58f3e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:16.494609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a6a59dc8-aab3-475d-b6bf-510901e58f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:16.560667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a59dc8-aab3-475d-b6bf-510901e58f3e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:16.564382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59541a1-0360-45fc-be12-2e273a94abbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:16.565055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59541a1-0360-45fc-be12-2e273a94abbe service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:16.565346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59541a1-0360-45fc-be12-2e273a94abbe service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:16.565630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59541a1-0360-45fc-be12-2e273a94abbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:16.573700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-388b3cca-46a6-43a1-90fe-ae43db74107a tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dff39b1cfd3d4f65a9fa9646d6f021e1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:16.574961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59541a1-0360-45fc-be12-2e273a94abbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:16.576510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59541a1-0360-45fc-be12-2e273a94abbe service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:16.586780 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3118/6246] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:42:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:42:16.650233 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3129/6247] 10.222.0.16 () {60 vars in 1268 bytes} [Mon May 2 10:42:16 2022] POST /identity/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1/password => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:16.815891 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59541a1-0360-45fc-be12-2e273a94abbe service cinder] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:16.825770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59541a1-0360-45fc-be12-2e273a94abbe service cinder] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:16.829517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83c74c-f846-4df4-927d-abd0eb8f0d83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:16.830772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83c74c-f846-4df4-927d-abd0eb8f0d83 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:16.831057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83c74c-f846-4df4-927d-abd0eb8f0d83 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:16.831336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83c74c-f846-4df4-927d-abd0eb8f0d83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:16.886389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83c74c-f846-4df4-927d-abd0eb8f0d83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:16.887858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83c74c-f846-4df4-927d-abd0eb8f0d83 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:16.897741 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3119/6248] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:42:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:42:17.655755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7918b-0b56-45e4-8a62-aa3beb6a5f1c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:17.656282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7918b-0b56-45e4-8a62-aa3beb6a5f1c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:17.656379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7918b-0b56-45e4-8a62-aa3beb6a5f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:17.674641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f1b7918b-0b56-45e4-8a62-aa3beb6a5f1c None None] MFA Rules not processed for user `dff39b1cfd3d4f65a9fa9646d6f021e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:17.675848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f1b7918b-0b56-45e4-8a62-aa3beb6a5f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:17.679038 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3130/6249] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:17 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 10:42:17.684057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb9fb5-32ab-49dc-99de-10381c1f33e2 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:17.684550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb9fb5-32ab-49dc-99de-10381c1f33e2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:17.684724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb9fb5-32ab-49dc-99de-10381c1f33e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:17.703020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-12bb9fb5-32ab-49dc-99de-10381c1f33e2 None None] MFA Rules not processed for user `dff39b1cfd3d4f65a9fa9646d6f021e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:17.704211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-12bb9fb5-32ab-49dc-99de-10381c1f33e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:17.711656 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3120/6250] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:17.715741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7918b-0b56-45e4-8a62-aa3beb6a5f1c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:17.727522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7918b-0b56-45e4-8a62-aa3beb6a5f1c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:17.731713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e45c24-fdf4-47a7-a8ef-5416f8d01060 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff39b1cfd3d4f65a9fa9646d6f021e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b45451f7a284ed4aa65658747b32248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:17.732581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e45c24-fdf4-47a7-a8ef-5416f8d01060 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:17.732892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e45c24-fdf4-47a7-a8ef-5416f8d01060 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:17.733172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e45c24-fdf4-47a7-a8ef-5416f8d01060 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] PATH_INFO: `/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1/password` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:17.850665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-86e45c24-fdf4-47a7-a8ef-5416f8d01060 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dff39b1cfd3d4f65a9fa9646d6f021e1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:17.938711 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3131/6251] 10.222.0.16 () {60 vars in 1268 bytes} [Mon May 2 10:42:17 2022] POST /identity/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1/password => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:18.944320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dca49-94b9-4e56-a5ac-530c4822d96b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:18.944837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dca49-94b9-4e56-a5ac-530c4822d96b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:18.944837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dca49-94b9-4e56-a5ac-530c4822d96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:18.961735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-db9dca49-94b9-4e56-a5ac-530c4822d96b None None] MFA Rules not processed for user `dff39b1cfd3d4f65a9fa9646d6f021e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:18.962914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-db9dca49-94b9-4e56-a5ac-530c4822d96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:18.966005 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3121/6252] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:18 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 10:42:18.971119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ec593-0ec7-4315-8602-59dd05548ab7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:18.975852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ec593-0ec7-4315-8602-59dd05548ab7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:18.975852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ec593-0ec7-4315-8602-59dd05548ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:18.990417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-491ec593-0ec7-4315-8602-59dd05548ab7 None None] MFA Rules not processed for user `dff39b1cfd3d4f65a9fa9646d6f021e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:18.991618 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-491ec593-0ec7-4315-8602-59dd05548ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:18.999204 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3132/6253] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:19.003694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dca49-94b9-4e56-a5ac-530c4822d96b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:19.016057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dca49-94b9-4e56-a5ac-530c4822d96b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:19.022840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843c9fd-2dc0-464c-b04d-34e344ba781c tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff39b1cfd3d4f65a9fa9646d6f021e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b45451f7a284ed4aa65658747b32248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:19.022840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843c9fd-2dc0-464c-b04d-34e344ba781c tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:19.022840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843c9fd-2dc0-464c-b04d-34e344ba781c tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:19.023174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843c9fd-2dc0-464c-b04d-34e344ba781c tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] PATH_INFO: `/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1/password` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:19.139392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4843c9fd-2dc0-464c-b04d-34e344ba781c tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dff39b1cfd3d4f65a9fa9646d6f021e1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:19.221709 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3122/6254] 10.222.0.16 () {60 vars in 1268 bytes} [Mon May 2 10:42:19 2022] POST /identity/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1/password => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:20.226367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c1247-f5d2-42e7-b9df-a89c7472ebcc None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:20.226838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c1247-f5d2-42e7-b9df-a89c7472ebcc None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:20.227201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c1247-f5d2-42e7-b9df-a89c7472ebcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:20.245542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-da6c1247-f5d2-42e7-b9df-a89c7472ebcc None None] MFA Rules not processed for user `dff39b1cfd3d4f65a9fa9646d6f021e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:20.246273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-da6c1247-f5d2-42e7-b9df-a89c7472ebcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:20.249679 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3133/6255] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:20 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 10:42:20.255334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a152cae-3c00-4fef-83a6-5fc3be68c60a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:20.255828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a152cae-3c00-4fef-83a6-5fc3be68c60a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:20.255987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a152cae-3c00-4fef-83a6-5fc3be68c60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:20.275556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0a152cae-3c00-4fef-83a6-5fc3be68c60a None None] MFA Rules not processed for user `dff39b1cfd3d4f65a9fa9646d6f021e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:20.276800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0a152cae-3c00-4fef-83a6-5fc3be68c60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:20.284085 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3123/6256] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:20.288754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c1247-f5d2-42e7-b9df-a89c7472ebcc None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:20.300140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c1247-f5d2-42e7-b9df-a89c7472ebcc None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:20.304270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf9d7f-ae28-4c00-ae3d-20b325d89f22 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff39b1cfd3d4f65a9fa9646d6f021e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b45451f7a284ed4aa65658747b32248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:20.307115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf9d7f-ae28-4c00-ae3d-20b325d89f22 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:20.307115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf9d7f-ae28-4c00-ae3d-20b325d89f22 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:20.307115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf9d7f-ae28-4c00-ae3d-20b325d89f22 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] PATH_INFO: `/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1/password` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:20.510626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-55cf9d7f-ae28-4c00-ae3d-20b325d89f22 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dff39b1cfd3d4f65a9fa9646d6f021e1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:20.615570 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3134/6257] 10.222.0.16 () {60 vars in 1268 bytes} [Mon May 2 10:42:20 2022] POST /identity/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1/password => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:21.620865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a765cdb-491c-4cf8-86b1-19774c6e9ded None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:21.621448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a765cdb-491c-4cf8-86b1-19774c6e9ded None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:21.621549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a765cdb-491c-4cf8-86b1-19774c6e9ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:21.638724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0a765cdb-491c-4cf8-86b1-19774c6e9ded None None] MFA Rules not processed for user `dff39b1cfd3d4f65a9fa9646d6f021e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:21.639904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0a765cdb-491c-4cf8-86b1-19774c6e9ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:21.642980 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3124/6258] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:21 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 10:42:22.649494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9a2cf-a2fe-456c-ad10-e64a654276c2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:22.650028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9a2cf-a2fe-456c-ad10-e64a654276c2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:22.650140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9a2cf-a2fe-456c-ad10-e64a654276c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:22.668550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-eda9a2cf-a2fe-456c-ad10-e64a654276c2 None None] MFA Rules not processed for user `dff39b1cfd3d4f65a9fa9646d6f021e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:22.670886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-eda9a2cf-a2fe-456c-ad10-e64a654276c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:22.677419 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3135/6259] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:42:22.683687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b61f1a-ffd0-4e34-9a2c-0086fb6e7db8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:22.684161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b61f1a-ffd0-4e34-9a2c-0086fb6e7db8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:22.684256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b61f1a-ffd0-4e34-9a2c-0086fb6e7db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:22.702215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-38b61f1a-ffd0-4e34-9a2c-0086fb6e7db8 None None] MFA Rules not processed for user `dff39b1cfd3d4f65a9fa9646d6f021e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:22.704965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-38b61f1a-ffd0-4e34-9a2c-0086fb6e7db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:22.706564 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3125/6260] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:22 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 10:42:22.711070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a80bd-a8ca-458d-890b-bab0155a1a05 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:22.711362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a80bd-a8ca-458d-890b-bab0155a1a05 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:22.711647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a80bd-a8ca-458d-890b-bab0155a1a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:22.854520 ncdv-master-1 devstack@keystone.service[91118]: WARNING keystone.server.flask.application [None req-307a80bd-a8ca-458d-890b-bab0155a1a05 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. May 02 10:42:22.856181 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3136/6261] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:22 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 146 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) May 02 10:42:22.860804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91638a-b18f-4bb1-b449-270c7b2d4c38 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:22.861093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91638a-b18f-4bb1-b449-270c7b2d4c38 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:22.861375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91638a-b18f-4bb1-b449-270c7b2d4c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:22.973760 ncdv-master-1 devstack@keystone.service[91119]: WARNING keystone.server.flask.application [None req-3f91638a-b18f-4bb1-b449-270c7b2d4c38 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. May 02 10:42:22.975299 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3126/6262] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:22 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 116 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) May 02 10:42:22.984221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e4d90-46ab-45bc-a553-ec0eb5691f9a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:22.984716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e4d90-46ab-45bc-a553-ec0eb5691f9a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:22.984833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e4d90-46ab-45bc-a553-ec0eb5691f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:23.007756 ncdv-master-1 devstack@keystone.service[91118]: WARNING keystone.server.flask.application [None req-171e4d90-46ab-45bc-a553-ec0eb5691f9a None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. May 02 10:42:23.018634 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3137/6263] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:22 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 26 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) May 02 10:42:34.033255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643212aa-a9d4-4f15-a316-f9606863a659 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:34.033800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643212aa-a9d4-4f15-a316-f9606863a659 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:34.033895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643212aa-a9d4-4f15-a316-f9606863a659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:34.154331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-643212aa-a9d4-4f15-a316-f9606863a659 None None] MFA Rules not processed for user `dff39b1cfd3d4f65a9fa9646d6f021e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:34.155557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-643212aa-a9d4-4f15-a316-f9606863a659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:34.158755 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3127/6264] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:34 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 10:42:34.164977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e4d90-46ab-45bc-a553-ec0eb5691f9a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:34.177187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e4d90-46ab-45bc-a553-ec0eb5691f9a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:34.181659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d7d2a-a04a-4802-8733-ba260d5e562b tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff39b1cfd3d4f65a9fa9646d6f021e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b45451f7a284ed4aa65658747b32248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:34.182771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d7d2a-a04a-4802-8733-ba260d5e562b tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:34.192213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d7d2a-a04a-4802-8733-ba260d5e562b tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:34.192508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d7d2a-a04a-4802-8733-ba260d5e562b tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] PATH_INFO: `/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1/password` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:34.299643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3d9d7d2a-a04a-4802-8733-ba260d5e562b tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dff39b1cfd3d4f65a9fa9646d6f021e1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:34.389962 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3138/6265] 10.222.0.16 () {60 vars in 1268 bytes} [Mon May 2 10:42:34 2022] POST /identity/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1/password => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:35.395271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26352b-1a34-462b-8811-f48e210bdf78 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:35.395726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26352b-1a34-462b-8811-f48e210bdf78 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:35.395917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26352b-1a34-462b-8811-f48e210bdf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:35.415029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3e26352b-1a34-462b-8811-f48e210bdf78 None None] MFA Rules not processed for user `dff39b1cfd3d4f65a9fa9646d6f021e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:35.416763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3e26352b-1a34-462b-8811-f48e210bdf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:35.420662 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3128/6266] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:35 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 10:42:35.429566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2a61f-ddba-4541-8477-55b67164f2f1 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:35.430082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2a61f-ddba-4541-8477-55b67164f2f1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:35.430202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2a61f-ddba-4541-8477-55b67164f2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:35.476655 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-a4b2a61f-ddba-4541-8477-55b67164f2f1 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token May 02 10:42:35.476655 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:42:35.476655 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:42:35.476655 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:42:35.476655 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:42:35.476655 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:42:35.476655 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:42:35.476655 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:42:35.476655 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:42:35.476655 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:42:35.476655 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:42:35.476655 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:42:35.476655 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper May 02 10:42:35.476655 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return f(*args, **kwargs) May 02 10:42:35.476655 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post May 02 10:42:35.476655 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) May 02 10:42:35.477952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token May 02 10:42:35.477952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) May 02 10:42:35.477952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate May 02 10:42:35.477952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) May 02 10:42:35.477952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate May 02 10:42:35.477952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) May 02 10:42:35.477952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref May 02 10:42:35.477952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) May 02 10:42:35.477952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:42:35.477952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:42:35.477952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token May 02 10:42:35.477952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) May 02 10:42:35.477952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token May 02 10:42:35.477952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self.check_revocation(token) May 02 10:42:35.477952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:42:35.477952 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:42:35.479117 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation May 02 10:42:35.479117 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) May 02 10:42:35.479117 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:42:35.479117 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:42:35.479117 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 May 02 10:42:35.479117 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) May 02 10:42:35.479117 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:42:35.479117 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:42:35.479117 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token May 02 10:42:35.479117 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) May 02 10:42:35.479117 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token May 02 10:42:35.479117 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:42:35.479117 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3139/6267] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:35 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:42:35.482405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be9c25-0099-4517-98bc-6ac4d492d815 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:35.482783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be9c25-0099-4517-98bc-6ac4d492d815 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:35.483134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be9c25-0099-4517-98bc-6ac4d492d815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:35.590918 ncdv-master-1 devstack@keystone.service[91119]: WARNING keystone.server.flask.application [None req-93be9c25-0099-4517-98bc-6ac4d492d815 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. May 02 10:42:35.592498 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3129/6268] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:35 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 111 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) May 02 10:42:35.597108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa3a46-3910-47fd-8d9e-497163d9afdd None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:35.597391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa3a46-3910-47fd-8d9e-497163d9afdd None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:35.597676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa3a46-3910-47fd-8d9e-497163d9afdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:35.734855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-10fa3a46-3910-47fd-8d9e-497163d9afdd None None] MFA Rules not processed for user `dff39b1cfd3d4f65a9fa9646d6f021e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:35.737077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-10fa3a46-3910-47fd-8d9e-497163d9afdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:35.743792 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3140/6269] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:35.747925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be9c25-0099-4517-98bc-6ac4d492d815 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:35.759755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be9c25-0099-4517-98bc-6ac4d492d815 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:35.763810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77602be2-74e2-45df-b4a3-f9f6affdc05e tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff39b1cfd3d4f65a9fa9646d6f021e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b45451f7a284ed4aa65658747b32248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:35.764687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77602be2-74e2-45df-b4a3-f9f6affdc05e tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:35.764972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77602be2-74e2-45df-b4a3-f9f6affdc05e tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:35.765249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77602be2-74e2-45df-b4a3-f9f6affdc05e tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] PATH_INFO: `/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1/password` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:35.906938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-77602be2-74e2-45df-b4a3-f9f6affdc05e tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dff39b1cfd3d4f65a9fa9646d6f021e1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:35.994897 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3130/6270] 10.222.0.16 () {60 vars in 1268 bytes} [Mon May 2 10:42:35 2022] POST /identity/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1/password => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:36.999844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772576b3-c3ca-47f1-aa0b-e4038059ec4f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:37.000381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772576b3-c3ca-47f1-aa0b-e4038059ec4f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:37.000477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772576b3-c3ca-47f1-aa0b-e4038059ec4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:37.021610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-772576b3-c3ca-47f1-aa0b-e4038059ec4f None None] MFA Rules not processed for user `dff39b1cfd3d4f65a9fa9646d6f021e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:37.023145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-772576b3-c3ca-47f1-aa0b-e4038059ec4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:37.026586 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3141/6271] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:36 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 10:42:37.031543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36485c1c-22db-4ca2-80e8-592b5780085e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:37.031998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36485c1c-22db-4ca2-80e8-592b5780085e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:37.032112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36485c1c-22db-4ca2-80e8-592b5780085e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:37.050621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-36485c1c-22db-4ca2-80e8-592b5780085e None None] MFA Rules not processed for user `dff39b1cfd3d4f65a9fa9646d6f021e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:37.051850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-36485c1c-22db-4ca2-80e8-592b5780085e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:37.059596 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3131/6272] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:37.063487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772576b3-c3ca-47f1-aa0b-e4038059ec4f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:37.076013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772576b3-c3ca-47f1-aa0b-e4038059ec4f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:37.080636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c6209-bd30-483e-b5af-09a5ab400cba tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff39b1cfd3d4f65a9fa9646d6f021e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b45451f7a284ed4aa65658747b32248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:37.081904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c6209-bd30-483e-b5af-09a5ab400cba tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:37.093584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c6209-bd30-483e-b5af-09a5ab400cba tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:37.093584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c6209-bd30-483e-b5af-09a5ab400cba tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] PATH_INFO: `/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1/password` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:37.253233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b99c6209-bd30-483e-b5af-09a5ab400cba tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dff39b1cfd3d4f65a9fa9646d6f021e1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:37.349106 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3142/6273] 10.222.0.16 () {60 vars in 1268 bytes} [Mon May 2 10:42:37 2022] POST /identity/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1/password => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:37.659704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36485c1c-22db-4ca2-80e8-592b5780085e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:37.661625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-36485c1c-22db-4ca2-80e8-592b5780085e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:37.740494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36485c1c-22db-4ca2-80e8-592b5780085e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:37.745585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ae12d-9088-4fa8-8045-61fa5386ec2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:37.746228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ae12d-9088-4fa8-8045-61fa5386ec2d service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:37.746517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ae12d-9088-4fa8-8045-61fa5386ec2d service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:37.746795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ae12d-9088-4fa8-8045-61fa5386ec2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:37.748585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-921ae12d-9088-4fa8-8045-61fa5386ec2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:37.761921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ae12d-9088-4fa8-8045-61fa5386ec2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:37.763510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ae12d-9088-4fa8-8045-61fa5386ec2d service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:37.775154 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3132/6274] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:42:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:42:38.355121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e49d6-5468-4574-b3a5-3bd257129062 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:38.355660 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e49d6-5468-4574-b3a5-3bd257129062 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:38.355743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e49d6-5468-4574-b3a5-3bd257129062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:38.374129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-349e49d6-5468-4574-b3a5-3bd257129062 None None] MFA Rules not processed for user `dff39b1cfd3d4f65a9fa9646d6f021e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:38.375335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-349e49d6-5468-4574-b3a5-3bd257129062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:38.378820 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3143/6275] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:38 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 10:42:38.384092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d6601-f650-4a08-bd68-543446626d5b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:38.384583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d6601-f650-4a08-bd68-543446626d5b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:38.388488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d6601-f650-4a08-bd68-543446626d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:38.403455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d09d6601-f650-4a08-bd68-543446626d5b None None] MFA Rules not processed for user `dff39b1cfd3d4f65a9fa9646d6f021e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:38.404805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d09d6601-f650-4a08-bd68-543446626d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:38.411784 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3133/6276] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:38.416831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e49d6-5468-4574-b3a5-3bd257129062 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:38.427755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e49d6-5468-4574-b3a5-3bd257129062 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:38.431866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e074d-a104-49cd-a13c-33984e2c7001 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff39b1cfd3d4f65a9fa9646d6f021e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b45451f7a284ed4aa65658747b32248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:38.432720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e074d-a104-49cd-a13c-33984e2c7001 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:38.433006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e074d-a104-49cd-a13c-33984e2c7001 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:38.433281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e074d-a104-49cd-a13c-33984e2c7001 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] PATH_INFO: `/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1/password` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:38.570550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d24e074d-a104-49cd-a13c-33984e2c7001 tempest-IdentityV3UsersTest-1979666197 tempest-IdentityV3UsersTest-1979666197-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dff39b1cfd3d4f65a9fa9646d6f021e1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:38.712934 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3144/6277] 10.222.0.16 () {60 vars in 1268 bytes} [Mon May 2 10:42:38 2022] POST /identity/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1/password => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:39.004260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d6601-f650-4a08-bd68-543446626d5b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:39.005660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d09d6601-f650-4a08-bd68-543446626d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:39.023127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d6601-f650-4a08-bd68-543446626d5b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:39.028816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a8e29-73e1-444e-9097-8801b12f91fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:39.029477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a8e29-73e1-444e-9097-8801b12f91fa service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:39.029764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a8e29-73e1-444e-9097-8801b12f91fa service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:39.030079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a8e29-73e1-444e-9097-8801b12f91fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:39.031804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8b2a8e29-73e1-444e-9097-8801b12f91fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:39.045426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a8e29-73e1-444e-9097-8801b12f91fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:39.047076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a8e29-73e1-444e-9097-8801b12f91fa service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:39.058984 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3134/6278] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:42:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:42:39.718324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b947268-a870-49cb-992b-ad1a49c1d31d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:39.718933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b947268-a870-49cb-992b-ad1a49c1d31d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:39.718933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b947268-a870-49cb-992b-ad1a49c1d31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:39.736418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4b947268-a870-49cb-992b-ad1a49c1d31d None None] MFA Rules not processed for user `dff39b1cfd3d4f65a9fa9646d6f021e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:39.737738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4b947268-a870-49cb-992b-ad1a49c1d31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:39.740928 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3145/6279] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:39 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 10:42:40.746932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52991a71-cb12-4b66-83c8-d4f529eb01f2 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:40.747837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52991a71-cb12-4b66-83c8-d4f529eb01f2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:40.749573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52991a71-cb12-4b66-83c8-d4f529eb01f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:40.766693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-52991a71-cb12-4b66-83c8-d4f529eb01f2 None None] MFA Rules not processed for user `dff39b1cfd3d4f65a9fa9646d6f021e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:40.768348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-52991a71-cb12-4b66-83c8-d4f529eb01f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:40.775971 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3135/6280] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:40.781771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b947268-a870-49cb-992b-ad1a49c1d31d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:40.783432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4b947268-a870-49cb-992b-ad1a49c1d31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:40.887486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b947268-a870-49cb-992b-ad1a49c1d31d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:40.893357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85e965-aeb4-467f-9465-0dda0c317121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:40.896394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85e965-aeb4-467f-9465-0dda0c317121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:40.897023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85e965-aeb4-467f-9465-0dda0c317121 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:40.899098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85e965-aeb4-467f-9465-0dda0c317121 admin admin] PATH_INFO: `/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:40.901149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85e965-aeb4-467f-9465-0dda0c317121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dff39b1cfd3d4f65a9fa9646d6f021e1)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:40.905594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85e965-aeb4-467f-9465-0dda0c317121 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:41.109686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3c85e965-aeb4-467f-9465-0dda0c317121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dff39b1cfd3d4f65a9fa9646d6f021e1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:41.135324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3c85e965-aeb4-467f-9465-0dda0c317121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dff39b1cfd3d4f65a9fa9646d6f021e1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:41.136353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3c85e965-aeb4-467f-9465-0dda0c317121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dff39b1cfd3d4f65a9fa9646d6f021e1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:41.145426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3c85e965-aeb4-467f-9465-0dda0c317121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dff39b1cfd3d4f65a9fa9646d6f021e1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:41.260173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3c85e965-aeb4-467f-9465-0dda0c317121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dff39b1cfd3d4f65a9fa9646d6f021e1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:41.266679 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3146/6281] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:42:40 2022] DELETE /identity/v3/users/dff39b1cfd3d4f65a9fa9646d6f021e1 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:41.271305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937c09d-c243-4a37-96db-5a1d9a3ff089 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:41.271687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937c09d-c243-4a37-96db-5a1d9a3ff089 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:41.272170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937c09d-c243-4a37-96db-5a1d9a3ff089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:41.292841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0937c09d-c243-4a37-96db-5a1d9a3ff089 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:41.294497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0937c09d-c243-4a37-96db-5a1d9a3ff089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:41.396721 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3136/6282] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:42:41.407748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85e965-aeb4-467f-9465-0dda0c317121 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:41.409707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3c85e965-aeb4-467f-9465-0dda0c317121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:41.515418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85e965-aeb4-467f-9465-0dda0c317121 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:41.520456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb7d01-ae88-4f14-9a15-7ff0b558b4b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:41.521221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb7d01-ae88-4f14-9a15-7ff0b558b4b6 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:41.521585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb7d01-ae88-4f14-9a15-7ff0b558b4b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:41.521951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb7d01-ae88-4f14-9a15-7ff0b558b4b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:41.533208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb7d01-ae88-4f14-9a15-7ff0b558b4b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:41.534860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb7d01-ae88-4f14-9a15-7ff0b558b4b6 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:41.548801 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3147/6283] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:42:42.220272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937c09d-c243-4a37-96db-5a1d9a3ff089 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:42.220272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0937c09d-c243-4a37-96db-5a1d9a3ff089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:42.230954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937c09d-c243-4a37-96db-5a1d9a3ff089 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:42.253021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc307fc-3a19-4415-9677-f1934e3e67fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:42.255104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc307fc-3a19-4415-9677-f1934e3e67fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:42.255410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc307fc-3a19-4415-9677-f1934e3e67fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:42.255902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc307fc-3a19-4415-9677-f1934e3e67fd admin admin] PATH_INFO: `/v3/projects/0b45451f7a284ed4aa65658747b32248` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:42.258329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc307fc-3a19-4415-9677-f1934e3e67fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b45451f7a284ed4aa65658747b32248)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:42.262093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc307fc-3a19-4415-9677-f1934e3e67fd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:42.429307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bcc307fc-3a19-4415-9677-f1934e3e67fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b45451f7a284ed4aa65658747b32248', 'request_id': 'req-bcc307fc-3a19-4415-9677-f1934e3e67fd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:42.435794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bcc307fc-3a19-4415-9677-f1934e3e67fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b45451f7a284ed4aa65658747b32248', 'request_id': 'req-bcc307fc-3a19-4415-9677-f1934e3e67fd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:42.669760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bcc307fc-3a19-4415-9677-f1934e3e67fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b45451f7a284ed4aa65658747b32248', 'request_id': 'req-bcc307fc-3a19-4415-9677-f1934e3e67fd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:42.683244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bcc307fc-3a19-4415-9677-f1934e3e67fd admin admin] The token cache is being invalidate because project 0b45451f7a284ed4aa65658747b32248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:42:42.683539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bcc307fc-3a19-4415-9677-f1934e3e67fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:42.684208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bcc307fc-3a19-4415-9677-f1934e3e67fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:42.695139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a7f8d-9276-46d1-99ec-f2166cca627b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:42.698048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a7f8d-9276-46d1-99ec-f2166cca627b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:42.698048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a7f8d-9276-46d1-99ec-f2166cca627b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:42.699853 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3137/6284] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:42:42 2022] DELETE /identity/v3/projects/0b45451f7a284ed4aa65658747b32248 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:42.721641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-7d8a7f8d-9276-46d1-99ec-f2166cca627b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:42.722935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7d8a7f8d-9276-46d1-99ec-f2166cca627b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:42.794553 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3148/6285] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:42.802414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b62aa-c7dd-4bdc-83cb-4b83a76a6576 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:42.802720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b62aa-c7dd-4bdc-83cb-4b83a76a6576 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:42.803007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b62aa-c7dd-4bdc-83cb-4b83a76a6576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:42.823991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-502b62aa-c7dd-4bdc-83cb-4b83a76a6576 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:42.825301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-502b62aa-c7dd-4bdc-83cb-4b83a76a6576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:42.834842 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3138/6286] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:42:42.838996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a7f8d-9276-46d1-99ec-f2166cca627b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:42.853127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a7f8d-9276-46d1-99ec-f2166cca627b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:42.869366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22da16f-9bc9-47a4-a43f-380f26ea5657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:42.870037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22da16f-9bc9-47a4-a43f-380f26ea5657 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:42.870390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22da16f-9bc9-47a4-a43f-380f26ea5657 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:42.870741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22da16f-9bc9-47a4-a43f-380f26ea5657 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:42.871573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22da16f-9bc9-47a4-a43f-380f26ea5657 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:42:42.871993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22da16f-9bc9-47a4-a43f-380f26ea5657 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:42.876095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22da16f-9bc9-47a4-a43f-380f26ea5657 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:42.889587 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3149/6287] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:42:42.896469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b62aa-c7dd-4bdc-83cb-4b83a76a6576 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:42.909997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b62aa-c7dd-4bdc-83cb-4b83a76a6576 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:42.920310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a358e-2dbf-4ee3-a047-c6aed61cdef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:42.920310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a358e-2dbf-4ee3-a047-c6aed61cdef2 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:42.920310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a358e-2dbf-4ee3-a047-c6aed61cdef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:42.920310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a358e-2dbf-4ee3-a047-c6aed61cdef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:42.921200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a358e-2dbf-4ee3-a047-c6aed61cdef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:42.921831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a358e-2dbf-4ee3-a047-c6aed61cdef2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:43.053259 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3139/6288] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:42:42 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:42:43.055114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22da16f-9bc9-47a4-a43f-380f26ea5657 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:43.065349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22da16f-9bc9-47a4-a43f-380f26ea5657 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:43.148405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4cedc-6d0b-42e1-a100-333d82fd5919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:43.149463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4cedc-6d0b-42e1-a100-333d82fd5919 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:43.149968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4cedc-6d0b-42e1-a100-333d82fd5919 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:43.150505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4cedc-6d0b-42e1-a100-333d82fd5919 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:43.151446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4cedc-6d0b-42e1-a100-333d82fd5919 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:43.153398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4cedc-6d0b-42e1-a100-333d82fd5919 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:43.232966 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3150/6289] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:42:43 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:42:43.237061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a358e-2dbf-4ee3-a047-c6aed61cdef2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:43.248403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a358e-2dbf-4ee3-a047-c6aed61cdef2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:43.253465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86654e3d-a853-4b2d-b96f-a6960eadb605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:43.254216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86654e3d-a853-4b2d-b96f-a6960eadb605 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:43.254484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86654e3d-a853-4b2d-b96f-a6960eadb605 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:43.254969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86654e3d-a853-4b2d-b96f-a6960eadb605 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:43.259366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86654e3d-a853-4b2d-b96f-a6960eadb605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:43.259366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86654e3d-a853-4b2d-b96f-a6960eadb605 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:43.268776 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3140/6290] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:42:43.273561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4cedc-6d0b-42e1-a100-333d82fd5919 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:43.284375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4cedc-6d0b-42e1-a100-333d82fd5919 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:43.290356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f4ea7-6fc7-4158-b382-5dba563b04ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:43.291085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f4ea7-6fc7-4158-b382-5dba563b04ca admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:43.299155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f4ea7-6fc7-4158-b382-5dba563b04ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:43.299155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f4ea7-6fc7-4158-b382-5dba563b04ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:43.299155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f4ea7-6fc7-4158-b382-5dba563b04ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:43.299155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f4ea7-6fc7-4158-b382-5dba563b04ca admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:43.317454 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3151/6291] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:42:43.318131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86654e3d-a853-4b2d-b96f-a6960eadb605 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:43.338694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86654e3d-a853-4b2d-b96f-a6960eadb605 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:43.349470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45c93c-31c5-4407-94ff-834437ed838e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:43.351030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45c93c-31c5-4407-94ff-834437ed838e admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:43.351320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45c93c-31c5-4407-94ff-834437ed838e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:43.351596 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45c93c-31c5-4407-94ff-834437ed838e admin admin] PATH_INFO: `/v3/projects/94922f5e383f4200aedf5b854445958b/users/15ab8e35505d4d489f967ebcd296b9c4/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:43.375516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45c93c-31c5-4407-94ff-834437ed838e admin admin] RBAC: Authorizing `identity:create_grant(project_id=94922f5e383f4200aedf5b854445958b, user_id=15ab8e35505d4d489f967ebcd296b9c4, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:43.378534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45c93c-31c5-4407-94ff-834437ed838e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:43.508121 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3141/6292] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:42:43 2022] PUT /identity/v3/projects/94922f5e383f4200aedf5b854445958b/users/15ab8e35505d4d489f967ebcd296b9c4/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:43.509080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf8bac-759e-4b2b-ba47-60cf3b1e774f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:43.509378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf8bac-759e-4b2b-ba47-60cf3b1e774f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:43.509664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf8bac-759e-4b2b-ba47-60cf3b1e774f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:43.553735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8daf8bac-759e-4b2b-ba47-60cf3b1e774f None None] MFA Rules not processed for user `15ab8e35505d4d489f967ebcd296b9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:43.554972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8daf8bac-759e-4b2b-ba47-60cf3b1e774f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:43.651185 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3152/6293] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:43.655032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45c93c-31c5-4407-94ff-834437ed838e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:43.719122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45c93c-31c5-4407-94ff-834437ed838e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:43.724254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee946cc-22d3-4d80-9219-4b17d241fbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:43.725070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee946cc-22d3-4d80-9219-4b17d241fbdc admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:43.725410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee946cc-22d3-4d80-9219-4b17d241fbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:43.725670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee946cc-22d3-4d80-9219-4b17d241fbdc admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:43.726370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee946cc-22d3-4d80-9219-4b17d241fbdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:43.728456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee946cc-22d3-4d80-9219-4b17d241fbdc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:43.924254 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3142/6294] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:42:43 2022] POST /identity/v3/projects => generated 375 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:42:43.925499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf8bac-759e-4b2b-ba47-60cf3b1e774f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:43.937543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf8bac-759e-4b2b-ba47-60cf3b1e774f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:44.010864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacae41-5330-4766-9304-5f5bc7b39dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:44.011604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacae41-5330-4766-9304-5f5bc7b39dcd admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:44.011911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacae41-5330-4766-9304-5f5bc7b39dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:44.012188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacae41-5330-4766-9304-5f5bc7b39dcd admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:44.012916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacae41-5330-4766-9304-5f5bc7b39dcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:44.015082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacae41-5330-4766-9304-5f5bc7b39dcd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:44.154876 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3153/6295] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:42:43 2022] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:42:44.158941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee946cc-22d3-4d80-9219-4b17d241fbdc admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:44.169440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee946cc-22d3-4d80-9219-4b17d241fbdc admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:44.174071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d04a3-815a-419f-be7f-8395152079f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:44.174791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d04a3-815a-419f-be7f-8395152079f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:44.175029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d04a3-815a-419f-be7f-8395152079f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:44.175308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d04a3-815a-419f-be7f-8395152079f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:44.176035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d04a3-815a-419f-be7f-8395152079f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:44.177689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d04a3-815a-419f-be7f-8395152079f7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:44.188758 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3143/6296] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:42:44.192786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacae41-5330-4766-9304-5f5bc7b39dcd admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:44.204620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacae41-5330-4766-9304-5f5bc7b39dcd admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:44.209314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b58be-c608-4931-a22f-de220ced396a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:44.209986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b58be-c608-4931-a22f-de220ced396a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:44.210273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b58be-c608-4931-a22f-de220ced396a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:44.210554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b58be-c608-4931-a22f-de220ced396a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:44.211290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b58be-c608-4931-a22f-de220ced396a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:44.212932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b58be-c608-4931-a22f-de220ced396a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:44.223682 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3154/6297] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:42:44.228346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d04a3-815a-419f-be7f-8395152079f7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:44.238992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d04a3-815a-419f-be7f-8395152079f7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:44.244763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf603b-515a-423f-911c-4be59caf5d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:44.245663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf603b-515a-423f-911c-4be59caf5d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:44.246395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf603b-515a-423f-911c-4be59caf5d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:44.246395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf603b-515a-423f-911c-4be59caf5d55 admin admin] PATH_INFO: `/v3/projects/bec8c2212aaa48fc8e0aa86ac02ba0e4/users/801991c645d0455fa80fde87bf67e665/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:44.263207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf603b-515a-423f-911c-4be59caf5d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec8c2212aaa48fc8e0aa86ac02ba0e4, user_id=801991c645d0455fa80fde87bf67e665, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:44.265985 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf603b-515a-423f-911c-4be59caf5d55 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:44.466243 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3144/6298] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:42:44 2022] PUT /identity/v3/projects/bec8c2212aaa48fc8e0aa86ac02ba0e4/users/801991c645d0455fa80fde87bf67e665/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:44.477336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed708c-7256-4366-8490-568de1ea6d24 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:44.477632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed708c-7256-4366-8490-568de1ea6d24 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:44.477913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed708c-7256-4366-8490-568de1ea6d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:44.520188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-5eed708c-7256-4366-8490-568de1ea6d24 None None] MFA Rules not processed for user `801991c645d0455fa80fde87bf67e665`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:44.520852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5eed708c-7256-4366-8490-568de1ea6d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:44.620789 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3155/6299] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:44.635079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf603b-515a-423f-911c-4be59caf5d55 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:44.637750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d2cf603b-515a-423f-911c-4be59caf5d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:44.736967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf603b-515a-423f-911c-4be59caf5d55 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:44.741899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003fc832-124d-48ef-bd7a-229174f01455 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:44.743532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003fc832-124d-48ef-bd7a-229174f01455 service glance] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:44.743532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003fc832-124d-48ef-bd7a-229174f01455 service glance] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:44.743532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003fc832-124d-48ef-bd7a-229174f01455 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:44.809574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003fc832-124d-48ef-bd7a-229174f01455 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:44.811716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003fc832-124d-48ef-bd7a-229174f01455 service glance] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:44.822706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed708c-7256-4366-8490-568de1ea6d24 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:44.824004 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3145/6300] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:42:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:42:44.825145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5eed708c-7256-4366-8490-568de1ea6d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:44.899295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed708c-7256-4366-8490-568de1ea6d24 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:44.904057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1065fb5-bc6c-4956-b7c5-73b868494636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:44.905612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1065fb5-bc6c-4956-b7c5-73b868494636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:44.905901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1065fb5-bc6c-4956-b7c5-73b868494636 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:44.906211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1065fb5-bc6c-4956-b7c5-73b868494636 admin admin] PATH_INFO: `/v3/users/5ced847d8ea7448aab8de7a3bbc72c83` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:44.907435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1065fb5-bc6c-4956-b7c5-73b868494636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ced847d8ea7448aab8de7a3bbc72c83)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:44.909425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1065fb5-bc6c-4956-b7c5-73b868494636 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:45.066219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b445d7-53fe-40b8-973b-04c97f9c9f2a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:45.068747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b445d7-53fe-40b8-973b-04c97f9c9f2a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:45.068747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b445d7-53fe-40b8-973b-04c97f9c9f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:45.120554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b9b445d7-53fe-40b8-973b-04c97f9c9f2a None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:45.121962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b9b445d7-53fe-40b8-973b-04c97f9c9f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:45.137481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c1065fb5-bc6c-4956-b7c5-73b868494636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ced847d8ea7448aab8de7a3bbc72c83'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:45.153114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c1065fb5-bc6c-4956-b7c5-73b868494636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ced847d8ea7448aab8de7a3bbc72c83'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:45.153865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c1065fb5-bc6c-4956-b7c5-73b868494636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ced847d8ea7448aab8de7a3bbc72c83'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:45.161538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c1065fb5-bc6c-4956-b7c5-73b868494636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ced847d8ea7448aab8de7a3bbc72c83'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:45.191191 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3146/6301] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:42:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:45.218894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b445d7-53fe-40b8-973b-04c97f9c9f2a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:45.221375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b9b445d7-53fe-40b8-973b-04c97f9c9f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:45.229578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c1065fb5-bc6c-4956-b7c5-73b868494636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ced847d8ea7448aab8de7a3bbc72c83'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:45.238860 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3156/6302] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:42:44 2022] DELETE /identity/v3/users/5ced847d8ea7448aab8de7a3bbc72c83 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:45.241849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ddde6-3c8a-42a1-a8fa-7ce7a2852b08 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:45.242144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ddde6-3c8a-42a1-a8fa-7ce7a2852b08 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:45.242427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ddde6-3c8a-42a1-a8fa-7ce7a2852b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:45.269597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c65ddde6-3c8a-42a1-a8fa-7ce7a2852b08 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:45.270836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c65ddde6-3c8a-42a1-a8fa-7ce7a2852b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:45.335916 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3157/6303] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:42:45.339325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b445d7-53fe-40b8-973b-04c97f9c9f2a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:45.350850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ddde6-3c8a-42a1-a8fa-7ce7a2852b08 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:45.353655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c65ddde6-3c8a-42a1-a8fa-7ce7a2852b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:45.414069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9a318-dee9-45bc-8637-9fe7472f7857 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:45.417252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9a318-dee9-45bc-8637-9fe7472f7857 service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:45.417252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9a318-dee9-45bc-8637-9fe7472f7857 service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:45.417252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9a318-dee9-45bc-8637-9fe7472f7857 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:45.418851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9ac9a318-dee9-45bc-8637-9fe7472f7857 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:45.421537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ddde6-3c8a-42a1-a8fa-7ce7a2852b08 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:45.426573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200a5f5-5a3e-45f1-a161-dd1b98a594fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:45.427573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200a5f5-5a3e-45f1-a161-dd1b98a594fc service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:45.427864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200a5f5-5a3e-45f1-a161-dd1b98a594fc service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:45.428268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200a5f5-5a3e-45f1-a161-dd1b98a594fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:45.438787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200a5f5-5a3e-45f1-a161-dd1b98a594fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:45.440315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200a5f5-5a3e-45f1-a161-dd1b98a594fc service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:45.451009 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3158/6304] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:42:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:42:45.483551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9a318-dee9-45bc-8637-9fe7472f7857 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:45.485408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9a318-dee9-45bc-8637-9fe7472f7857 service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:45.496004 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3147/6305] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:42:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:42:46.059372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200a5f5-5a3e-45f1-a161-dd1b98a594fc service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:46.061341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d200a5f5-5a3e-45f1-a161-dd1b98a594fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:46.221979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200a5f5-5a3e-45f1-a161-dd1b98a594fc service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:46.228586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b0004-71ca-4379-a0ea-94ec698103b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:46.231640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b0004-71ca-4379-a0ea-94ec698103b8 service glance] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:46.231640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b0004-71ca-4379-a0ea-94ec698103b8 service glance] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:46.231640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b0004-71ca-4379-a0ea-94ec698103b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:46.233470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-510b0004-71ca-4379-a0ea-94ec698103b8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:46.316302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b0004-71ca-4379-a0ea-94ec698103b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:46.318352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b0004-71ca-4379-a0ea-94ec698103b8 service glance] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:46.329796 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3159/6306] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:42:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:42:46.386526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9a318-dee9-45bc-8637-9fe7472f7857 service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:46.386526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9ac9a318-dee9-45bc-8637-9fe7472f7857 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:46.439939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9a318-dee9-45bc-8637-9fe7472f7857 service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:46.455160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41873dc4-90b5-4641-9b6d-c4fdd3eb8a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:46.456144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41873dc4-90b5-4641-9b6d-c4fdd3eb8a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:46.456530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41873dc4-90b5-4641-9b6d-c4fdd3eb8a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:46.456934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41873dc4-90b5-4641-9b6d-c4fdd3eb8a10 admin admin] PATH_INFO: `/v3/projects/03cbe7924e22488b92979871106a3ece` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:46.458967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41873dc4-90b5-4641-9b6d-c4fdd3eb8a10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03cbe7924e22488b92979871106a3ece)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:46.464115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41873dc4-90b5-4641-9b6d-c4fdd3eb8a10 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:46.465695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954222d-577b-4027-9101-03ed16917796 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:46.465987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954222d-577b-4027-9101-03ed16917796 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:46.466270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954222d-577b-4027-9101-03ed16917796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:46.495691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1954222d-577b-4027-9101-03ed16917796 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:46.497466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1954222d-577b-4027-9101-03ed16917796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:46.520402 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3160/6307] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:42:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:46.531326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954222d-577b-4027-9101-03ed16917796 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:46.533366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1954222d-577b-4027-9101-03ed16917796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:46.552781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954222d-577b-4027-9101-03ed16917796 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:46.560323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee52f6-d350-464e-81aa-1323c4eafb55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:46.561040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee52f6-d350-464e-81aa-1323c4eafb55 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:46.561336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee52f6-d350-464e-81aa-1323c4eafb55 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:46.561606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee52f6-d350-464e-81aa-1323c4eafb55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:46.571807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee52f6-d350-464e-81aa-1323c4eafb55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:46.573504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee52f6-d350-464e-81aa-1323c4eafb55 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:46.583363 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3161/6308] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:42:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 02 10:42:46.624489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-41873dc4-90b5-4641-9b6d-c4fdd3eb8a10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03cbe7924e22488b92979871106a3ece', 'request_id': 'req-41873dc4-90b5-4641-9b6d-c4fdd3eb8a10'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:46.634659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-41873dc4-90b5-4641-9b6d-c4fdd3eb8a10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03cbe7924e22488b92979871106a3ece', 'request_id': 'req-41873dc4-90b5-4641-9b6d-c4fdd3eb8a10'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:46.783377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-41873dc4-90b5-4641-9b6d-c4fdd3eb8a10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03cbe7924e22488b92979871106a3ece', 'request_id': 'req-41873dc4-90b5-4641-9b6d-c4fdd3eb8a10'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:46.805809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-41873dc4-90b5-4641-9b6d-c4fdd3eb8a10 admin admin] The token cache is being invalidate because project 03cbe7924e22488b92979871106a3ece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:42:46.806098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-41873dc4-90b5-4641-9b6d-c4fdd3eb8a10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:46.807193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-41873dc4-90b5-4641-9b6d-c4fdd3eb8a10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:46.809740 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3148/6309] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:42:46 2022] DELETE /identity/v3/projects/03cbe7924e22488b92979871106a3ece => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:46.813835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee52f6-d350-464e-81aa-1323c4eafb55 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:46.826665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee52f6-d350-464e-81aa-1323c4eafb55 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:46.897782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398395e8-777d-49ce-9045-b43c62dda2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:46.898893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398395e8-777d-49ce-9045-b43c62dda2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:46.899317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398395e8-777d-49ce-9045-b43c62dda2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:46.899607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398395e8-777d-49ce-9045-b43c62dda2b6 admin admin] PATH_INFO: `/v3/users/a169920c79bf45e7bd7982bea65ef52b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:46.901024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398395e8-777d-49ce-9045-b43c62dda2b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a169920c79bf45e7bd7982bea65ef52b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:46.903484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398395e8-777d-49ce-9045-b43c62dda2b6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:47.098052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-398395e8-777d-49ce-9045-b43c62dda2b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a169920c79bf45e7bd7982bea65ef52b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:47.112320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-398395e8-777d-49ce-9045-b43c62dda2b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a169920c79bf45e7bd7982bea65ef52b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:47.113087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-398395e8-777d-49ce-9045-b43c62dda2b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a169920c79bf45e7bd7982bea65ef52b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:47.120157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-398395e8-777d-49ce-9045-b43c62dda2b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a169920c79bf45e7bd7982bea65ef52b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:47.150606 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41873dc4-90b5-4641-9b6d-c4fdd3eb8a10 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:47.152027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-41873dc4-90b5-4641-9b6d-c4fdd3eb8a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:47.171127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41873dc4-90b5-4641-9b6d-c4fdd3eb8a10 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:47.175841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e4707-4908-421c-acc7-bb6850ea7c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:47.176750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e4707-4908-421c-acc7-bb6850ea7c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:47.177035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e4707-4908-421c-acc7-bb6850ea7c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:47.177311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e4707-4908-421c-acc7-bb6850ea7c79 admin admin] PATH_INFO: `/v3/users/15ab8e35505d4d489f967ebcd296b9c4` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:47.179152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e4707-4908-421c-acc7-bb6850ea7c79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ab8e35505d4d489f967ebcd296b9c4)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:47.181311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e4707-4908-421c-acc7-bb6850ea7c79 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:47.214535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-398395e8-777d-49ce-9045-b43c62dda2b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a169920c79bf45e7bd7982bea65ef52b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:47.222477 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3162/6310] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:42:46 2022] DELETE /identity/v3/users/a169920c79bf45e7bd7982bea65ef52b => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:47.454282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-235e4707-4908-421c-acc7-bb6850ea7c79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ab8e35505d4d489f967ebcd296b9c4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:47.467531 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-235e4707-4908-421c-acc7-bb6850ea7c79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ab8e35505d4d489f967ebcd296b9c4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:47.468532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-235e4707-4908-421c-acc7-bb6850ea7c79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ab8e35505d4d489f967ebcd296b9c4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:47.478467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-235e4707-4908-421c-acc7-bb6850ea7c79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ab8e35505d4d489f967ebcd296b9c4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:47.626982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-235e4707-4908-421c-acc7-bb6850ea7c79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ab8e35505d4d489f967ebcd296b9c4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:47.626982 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3149/6311] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:42:47 2022] DELETE /identity/v3/users/15ab8e35505d4d489f967ebcd296b9c4 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:47.630885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f60ef-effc-4913-b828-be0eabdd0546 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:47.631333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f60ef-effc-4913-b828-be0eabdd0546 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:47.631848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f60ef-effc-4913-b828-be0eabdd0546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:47.652163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-514f60ef-effc-4913-b828-be0eabdd0546 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:47.653434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-514f60ef-effc-4913-b828-be0eabdd0546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:47.721928 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3163/6312] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:47.732761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e4707-4908-421c-acc7-bb6850ea7c79 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:47.734259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-235e4707-4908-421c-acc7-bb6850ea7c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:47.803327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e4707-4908-421c-acc7-bb6850ea7c79 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:47.807406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3539b-f5c9-40ec-a49b-2e00e4de508b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:47.808807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3539b-f5c9-40ec-a49b-2e00e4de508b service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:47.808807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3539b-f5c9-40ec-a49b-2e00e4de508b service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:47.808807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3539b-f5c9-40ec-a49b-2e00e4de508b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:47.813606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f60ef-effc-4913-b828-be0eabdd0546 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:47.815260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-514f60ef-effc-4913-b828-be0eabdd0546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:47.822644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3539b-f5c9-40ec-a49b-2e00e4de508b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:47.824119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3539b-f5c9-40ec-a49b-2e00e4de508b service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:47.831829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f60ef-effc-4913-b828-be0eabdd0546 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:47.836370 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3150/6313] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:42:47.853813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e157b8f-1020-462c-b022-2e580d0ebef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:47.855068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e157b8f-1020-462c-b022-2e580d0ebef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:47.855302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e157b8f-1020-462c-b022-2e580d0ebef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:47.860658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e157b8f-1020-462c-b022-2e580d0ebef4 admin admin] PATH_INFO: `/v3/projects/0827d6376fc44d75b5dc075535afa7bc` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:47.860658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e157b8f-1020-462c-b022-2e580d0ebef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0827d6376fc44d75b5dc075535afa7bc)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:47.860658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e157b8f-1020-462c-b022-2e580d0ebef4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:48.055585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2e157b8f-1020-462c-b022-2e580d0ebef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0827d6376fc44d75b5dc075535afa7bc', 'request_id': 'req-2e157b8f-1020-462c-b022-2e580d0ebef4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:48.163527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2e157b8f-1020-462c-b022-2e580d0ebef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0827d6376fc44d75b5dc075535afa7bc', 'request_id': 'req-2e157b8f-1020-462c-b022-2e580d0ebef4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:48.177770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2e157b8f-1020-462c-b022-2e580d0ebef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0827d6376fc44d75b5dc075535afa7bc', 'request_id': 'req-2e157b8f-1020-462c-b022-2e580d0ebef4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:48.190516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2e157b8f-1020-462c-b022-2e580d0ebef4 admin admin] The token cache is being invalidate because project 0827d6376fc44d75b5dc075535afa7bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:42:48.191203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2e157b8f-1020-462c-b022-2e580d0ebef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:48.192508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2e157b8f-1020-462c-b022-2e580d0ebef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:48.197073 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3164/6314] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:42:47 2022] DELETE /identity/v3/projects/0827d6376fc44d75b5dc075535afa7bc => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:48.201489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e654af-9e9e-456c-bc7f-d1a1a1539665 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:48.201489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e654af-9e9e-456c-bc7f-d1a1a1539665 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:48.201489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e654af-9e9e-456c-bc7f-d1a1a1539665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:48.246959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f2e654af-9e9e-456c-bc7f-d1a1a1539665 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:48.248427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f2e654af-9e9e-456c-bc7f-d1a1a1539665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:48.339726 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3151/6315] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:48.351195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b447643-1661-4378-ac19-747cdb2b4fab None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:48.357858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b447643-1661-4378-ac19-747cdb2b4fab None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:48.357858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b447643-1661-4378-ac19-747cdb2b4fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:48.377424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2b447643-1661-4378-ac19-747cdb2b4fab None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:48.383788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2b447643-1661-4378-ac19-747cdb2b4fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:48.394399 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3165/6316] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:48.395267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e654af-9e9e-456c-bc7f-d1a1a1539665 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:48.408371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e654af-9e9e-456c-bc7f-d1a1a1539665 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:48.419838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54017cea-7aaa-48b4-a984-dc1c56d6f6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:48.421045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54017cea-7aaa-48b4-a984-dc1c56d6f6cd admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:48.421488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54017cea-7aaa-48b4-a984-dc1c56d6f6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:48.421921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54017cea-7aaa-48b4-a984-dc1c56d6f6cd admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:48.422960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54017cea-7aaa-48b4-a984-dc1c56d6f6cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:42:48.424037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54017cea-7aaa-48b4-a984-dc1c56d6f6cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:48.425722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54017cea-7aaa-48b4-a984-dc1c56d6f6cd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:48.441857 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3152/6317] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:42:48.445931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b447643-1661-4378-ac19-747cdb2b4fab None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:48.455834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b447643-1661-4378-ac19-747cdb2b4fab None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:48.462624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24d02b-0fb5-4b63-9df1-c7f9816bbca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:48.463374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24d02b-0fb5-4b63-9df1-c7f9816bbca2 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:48.463665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24d02b-0fb5-4b63-9df1-c7f9816bbca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:48.463950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24d02b-0fb5-4b63-9df1-c7f9816bbca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:48.465971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24d02b-0fb5-4b63-9df1-c7f9816bbca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:48.468437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24d02b-0fb5-4b63-9df1-c7f9816bbca2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:48.596903 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3166/6318] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:42:48 2022] POST /identity/v3/projects => generated 357 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:42:48.597612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54017cea-7aaa-48b4-a984-dc1c56d6f6cd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:48.616393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54017cea-7aaa-48b4-a984-dc1c56d6f6cd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:48.773932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474a915-c038-42bb-b1cc-834d366bb4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:48.778738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474a915-c038-42bb-b1cc-834d366bb4cc admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:48.779415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474a915-c038-42bb-b1cc-834d366bb4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:48.779892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474a915-c038-42bb-b1cc-834d366bb4cc admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:48.781193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474a915-c038-42bb-b1cc-834d366bb4cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:48.783452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474a915-c038-42bb-b1cc-834d366bb4cc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:48.827666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24d02b-0fb5-4b63-9df1-c7f9816bbca2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:48.827666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5b24d02b-0fb5-4b63-9df1-c7f9816bbca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:48.839683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24d02b-0fb5-4b63-9df1-c7f9816bbca2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:48.851754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d82ba-9153-41a7-98d6-e9cdfc41d6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:48.852937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d82ba-9153-41a7-98d6-e9cdfc41d6be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:48.853228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d82ba-9153-41a7-98d6-e9cdfc41d6be admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:48.853511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d82ba-9153-41a7-98d6-e9cdfc41d6be admin admin] PATH_INFO: `/v3/projects/94922f5e383f4200aedf5b854445958b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:48.855837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d82ba-9153-41a7-98d6-e9cdfc41d6be admin admin] RBAC: Authorizing `identity:delete_project(project_id=94922f5e383f4200aedf5b854445958b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:48.863131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d82ba-9153-41a7-98d6-e9cdfc41d6be admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:48.943108 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3153/6319] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:42:48 2022] POST /identity/v3/users => generated 279 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:42:48.947651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474a915-c038-42bb-b1cc-834d366bb4cc admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:48.961213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474a915-c038-42bb-b1cc-834d366bb4cc admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:48.972706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba7712-1ada-406f-9690-eda8940d26ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:48.973402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba7712-1ada-406f-9690-eda8940d26ea admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:48.973687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba7712-1ada-406f-9690-eda8940d26ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:48.974276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba7712-1ada-406f-9690-eda8940d26ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:48.983096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba7712-1ada-406f-9690-eda8940d26ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:48.986128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba7712-1ada-406f-9690-eda8940d26ea admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:49.005652 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3154/6320] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:42:49.008456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba7712-1ada-406f-9690-eda8940d26ea admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:49.027389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba7712-1ada-406f-9690-eda8940d26ea admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:49.076650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-920d82ba-9153-41a7-98d6-e9cdfc41d6be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94922f5e383f4200aedf5b854445958b', 'request_id': 'req-920d82ba-9153-41a7-98d6-e9cdfc41d6be'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:49.137042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d015edc-6cd4-4541-861f-1fcb11867f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:49.137800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d015edc-6cd4-4541-861f-1fcb11867f10 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:49.138096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d015edc-6cd4-4541-861f-1fcb11867f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:49.139416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d015edc-6cd4-4541-861f-1fcb11867f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:49.140187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d015edc-6cd4-4541-861f-1fcb11867f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:49.143579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d015edc-6cd4-4541-861f-1fcb11867f10 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:49.160174 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3155/6321] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:42:49.162068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d015edc-6cd4-4541-861f-1fcb11867f10 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:49.174333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d015edc-6cd4-4541-861f-1fcb11867f10 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:49.176349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-920d82ba-9153-41a7-98d6-e9cdfc41d6be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94922f5e383f4200aedf5b854445958b', 'request_id': 'req-920d82ba-9153-41a7-98d6-e9cdfc41d6be'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:49.182600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e1ac8-d621-46b6-999a-11fca2fd7c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:49.183900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e1ac8-d621-46b6-999a-11fca2fd7c6e admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:49.184449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e1ac8-d621-46b6-999a-11fca2fd7c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:49.185003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e1ac8-d621-46b6-999a-11fca2fd7c6e admin admin] PATH_INFO: `/v3/projects/40050853f73b4da6a3720799307dded5/users/9e063a35d92e45a5808790d6eb4f33dc/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:49.185134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-920d82ba-9153-41a7-98d6-e9cdfc41d6be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94922f5e383f4200aedf5b854445958b', 'request_id': 'req-920d82ba-9153-41a7-98d6-e9cdfc41d6be'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:49.196741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-920d82ba-9153-41a7-98d6-e9cdfc41d6be admin admin] The token cache is being invalidate because project 94922f5e383f4200aedf5b854445958b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:42:49.197356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-920d82ba-9153-41a7-98d6-e9cdfc41d6be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:49.198259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-920d82ba-9153-41a7-98d6-e9cdfc41d6be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:49.199969 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3167/6322] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:42:48 2022] DELETE /identity/v3/projects/94922f5e383f4200aedf5b854445958b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:49.202671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e1ac8-d621-46b6-999a-11fca2fd7c6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=40050853f73b4da6a3720799307dded5, user_id=9e063a35d92e45a5808790d6eb4f33dc, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:49.204642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d82ba-9153-41a7-98d6-e9cdfc41d6be admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:49.208165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e1ac8-d621-46b6-999a-11fca2fd7c6e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:49.208284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-920d82ba-9153-41a7-98d6-e9cdfc41d6be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:49.224962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d82ba-9153-41a7-98d6-e9cdfc41d6be admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:49.230131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbc51a-0d8c-4720-b6e8-91da97dc91b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:49.231194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbc51a-0d8c-4720-b6e8-91da97dc91b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:49.231306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbc51a-0d8c-4720-b6e8-91da97dc91b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:49.231562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbc51a-0d8c-4720-b6e8-91da97dc91b1 admin admin] PATH_INFO: `/v3/users/801991c645d0455fa80fde87bf67e665` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:49.232913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbc51a-0d8c-4720-b6e8-91da97dc91b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=801991c645d0455fa80fde87bf67e665)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:49.234907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbc51a-0d8c-4720-b6e8-91da97dc91b1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:49.336515 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3156/6323] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:42:49 2022] PUT /identity/v3/projects/40050853f73b4da6a3720799307dded5/users/9e063a35d92e45a5808790d6eb4f33dc/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:49.351936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adf0a9-f4e4-4dce-b9d0-e3633678af43 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:49.362759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adf0a9-f4e4-4dce-b9d0-e3633678af43 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:49.362759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adf0a9-f4e4-4dce-b9d0-e3633678af43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:49.411585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a4adf0a9-f4e4-4dce-b9d0-e3633678af43 None None] MFA Rules not processed for user `9e063a35d92e45a5808790d6eb4f33dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:49.414064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a4adf0a9-f4e4-4dce-b9d0-e3633678af43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:49.508877 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3157/6324] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:49 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:49.519285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adf0a9-f4e4-4dce-b9d0-e3633678af43 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:49.520833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a4adf0a9-f4e4-4dce-b9d0-e3633678af43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:49.586702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-04cbc51a-0d8c-4720-b6e8-91da97dc91b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '801991c645d0455fa80fde87bf67e665'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:49.625597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-04cbc51a-0d8c-4720-b6e8-91da97dc91b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '801991c645d0455fa80fde87bf67e665'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:49.625597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-04cbc51a-0d8c-4720-b6e8-91da97dc91b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '801991c645d0455fa80fde87bf67e665'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:49.650836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-04cbc51a-0d8c-4720-b6e8-91da97dc91b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '801991c645d0455fa80fde87bf67e665'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:49.734489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adf0a9-f4e4-4dce-b9d0-e3633678af43 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:49.744488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cf0e9-9cf5-4c45-ba4e-18dfcf6196ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:49.745582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cf0e9-9cf5-4c45-ba4e-18dfcf6196ed admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:49.746819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cf0e9-9cf5-4c45-ba4e-18dfcf6196ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:49.748199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cf0e9-9cf5-4c45-ba4e-18dfcf6196ed admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:49.750552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cf0e9-9cf5-4c45-ba4e-18dfcf6196ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:49.755518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cf0e9-9cf5-4c45-ba4e-18dfcf6196ed admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:49.756064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-04cbc51a-0d8c-4720-b6e8-91da97dc91b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '801991c645d0455fa80fde87bf67e665'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:49.804436 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3168/6325] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:42:49 2022] DELETE /identity/v3/users/801991c645d0455fa80fde87bf67e665 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:49.944344 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3158/6326] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:42:49 2022] POST /identity/v3/projects => generated 355 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:42:49.945588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbc51a-0d8c-4720-b6e8-91da97dc91b1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:49.948462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-04cbc51a-0d8c-4720-b6e8-91da97dc91b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:50.051664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbc51a-0d8c-4720-b6e8-91da97dc91b1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:50.145933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505433bb-2dbd-4aa5-8761-28b58a0a90e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:50.147155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505433bb-2dbd-4aa5-8761-28b58a0a90e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:50.147661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505433bb-2dbd-4aa5-8761-28b58a0a90e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:50.148119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505433bb-2dbd-4aa5-8761-28b58a0a90e9 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:50.150243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505433bb-2dbd-4aa5-8761-28b58a0a90e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:50.152393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505433bb-2dbd-4aa5-8761-28b58a0a90e9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:50.289041 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3169/6327] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:42:49 2022] POST /identity/v3/users => generated 284 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:42:50.290940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cf0e9-9cf5-4c45-ba4e-18dfcf6196ed admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:50.304856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cf0e9-9cf5-4c45-ba4e-18dfcf6196ed admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:50.309882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b72ba0-1116-4183-a28c-db17dbd78b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:50.311404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b72ba0-1116-4183-a28c-db17dbd78b50 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:50.312117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b72ba0-1116-4183-a28c-db17dbd78b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:50.312117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b72ba0-1116-4183-a28c-db17dbd78b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:50.313448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b72ba0-1116-4183-a28c-db17dbd78b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:50.315683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b72ba0-1116-4183-a28c-db17dbd78b50 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:50.332645 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3159/6328] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:42:50.334677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505433bb-2dbd-4aa5-8761-28b58a0a90e9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:50.347536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505433bb-2dbd-4aa5-8761-28b58a0a90e9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:50.353203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6ec67-17af-438d-b45a-3250dbff772b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:50.354100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6ec67-17af-438d-b45a-3250dbff772b admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:50.354432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6ec67-17af-438d-b45a-3250dbff772b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:50.354698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6ec67-17af-438d-b45a-3250dbff772b admin admin] PATH_INFO: `/v3/projects/b054ddfd37204cd08734adcf05d4a153/users/2529343a03254787bbfcf182a8f9ca03/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:50.370880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6ec67-17af-438d-b45a-3250dbff772b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b054ddfd37204cd08734adcf05d4a153, user_id=2529343a03254787bbfcf182a8f9ca03, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:50.373676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6ec67-17af-438d-b45a-3250dbff772b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:50.474223 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3170/6329] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:42:50 2022] PUT /identity/v3/projects/b054ddfd37204cd08734adcf05d4a153/users/2529343a03254787bbfcf182a8f9ca03/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:50.478383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b72ba0-1116-4183-a28c-db17dbd78b50 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:50.489841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b72ba0-1116-4183-a28c-db17dbd78b50 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:50.520821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6ec67-17af-438d-b45a-3250dbff772b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:50.523802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-80b6ec67-17af-438d-b45a-3250dbff772b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:50.659904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49c5b9-982c-4a51-af54-85d5d481d5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:50.660822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49c5b9-982c-4a51-af54-85d5d481d5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:50.661339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49c5b9-982c-4a51-af54-85d5d481d5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:50.662030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49c5b9-982c-4a51-af54-85d5d481d5b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:50.663645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49c5b9-982c-4a51-af54-85d5d481d5b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:50.667669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49c5b9-982c-4a51-af54-85d5d481d5b6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:50.681303 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3160/6330] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:42:50.687047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49c5b9-982c-4a51-af54-85d5d481d5b6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:50.714618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49c5b9-982c-4a51-af54-85d5d481d5b6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:50.714796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6ec67-17af-438d-b45a-3250dbff772b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:50.724481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb15f03-218c-49ce-8e4f-7353d6459e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:50.724851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f2964-0561-4efd-a4ba-565d7484553c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:50.726388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb15f03-218c-49ce-8e4f-7353d6459e85 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:50.727315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f2964-0561-4efd-a4ba-565d7484553c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:50.727671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb15f03-218c-49ce-8e4f-7353d6459e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:50.728024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f2964-0561-4efd-a4ba-565d7484553c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:50.728540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb15f03-218c-49ce-8e4f-7353d6459e85 admin admin] PATH_INFO: `/v3/projects/b054ddfd37204cd08734adcf05d4a153/users/2529343a03254787bbfcf182a8f9ca03/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:50.729059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f2964-0561-4efd-a4ba-565d7484553c admin admin] PATH_INFO: `/v3/projects/bec8c2212aaa48fc8e0aa86ac02ba0e4` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:50.732377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f2964-0561-4efd-a4ba-565d7484553c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec8c2212aaa48fc8e0aa86ac02ba0e4)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:50.733405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb15f03-218c-49ce-8e4f-7353d6459e85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b054ddfd37204cd08734adcf05d4a153, user_id=2529343a03254787bbfcf182a8f9ca03, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:50.736760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f2964-0561-4efd-a4ba-565d7484553c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:50.740457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb15f03-218c-49ce-8e4f-7353d6459e85 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:50.760489 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3161/6331] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:42:50 2022] PUT /identity/v3/projects/b054ddfd37204cd08734adcf05d4a153/users/2529343a03254787bbfcf182a8f9ca03/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:50.783627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e1f64-9c23-4573-9d43-cefaadd28b71 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:50.783627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e1f64-9c23-4573-9d43-cefaadd28b71 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:50.783627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e1f64-9c23-4573-9d43-cefaadd28b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:50.824273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b71e1f64-9c23-4573-9d43-cefaadd28b71 None None] MFA Rules not processed for user `2529343a03254787bbfcf182a8f9ca03`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:50.828188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b71e1f64-9c23-4573-9d43-cefaadd28b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:50.955120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-171f2964-0561-4efd-a4ba-565d7484553c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec8c2212aaa48fc8e0aa86ac02ba0e4', 'request_id': 'req-171f2964-0561-4efd-a4ba-565d7484553c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:50.992798 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3162/6332] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:50 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:42:50.999713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e1f64-9c23-4573-9d43-cefaadd28b71 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:51.002293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b71e1f64-9c23-4573-9d43-cefaadd28b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:51.046064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-171f2964-0561-4efd-a4ba-565d7484553c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec8c2212aaa48fc8e0aa86ac02ba0e4', 'request_id': 'req-171f2964-0561-4efd-a4ba-565d7484553c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:51.056041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-171f2964-0561-4efd-a4ba-565d7484553c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec8c2212aaa48fc8e0aa86ac02ba0e4', 'request_id': 'req-171f2964-0561-4efd-a4ba-565d7484553c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:51.078986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-171f2964-0561-4efd-a4ba-565d7484553c admin admin] The token cache is being invalidate because project bec8c2212aaa48fc8e0aa86ac02ba0e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:42:51.084780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-171f2964-0561-4efd-a4ba-565d7484553c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:51.084780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-171f2964-0561-4efd-a4ba-565d7484553c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:51.084780 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3171/6333] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:42:50 2022] DELETE /identity/v3/projects/bec8c2212aaa48fc8e0aa86ac02ba0e4 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:51.087411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e1f64-9c23-4573-9d43-cefaadd28b71 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:51.088218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a8c8b-570b-4f43-9abe-f0fbd43241d8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:51.088579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a8c8b-570b-4f43-9abe-f0fbd43241d8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:51.089041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a8c8b-570b-4f43-9abe-f0fbd43241d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:51.132000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3a8a8c8b-570b-4f43-9abe-f0fbd43241d8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:51.133472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3a8a8c8b-570b-4f43-9abe-f0fbd43241d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:51.181691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae395b25-9320-41be-9a15-849f1fe55f2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:51.184701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae395b25-9320-41be-9a15-849f1fe55f2d service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:51.184701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae395b25-9320-41be-9a15-849f1fe55f2d service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:51.184701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae395b25-9320-41be-9a15-849f1fe55f2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:51.185416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ae395b25-9320-41be-9a15-849f1fe55f2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:51.234253 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3172/6334] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:51.244786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d3cf0-44aa-47e4-887e-fec85f2e72fe None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:51.245447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d3cf0-44aa-47e4-887e-fec85f2e72fe None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:51.245582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d3cf0-44aa-47e4-887e-fec85f2e72fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:51.271430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae395b25-9320-41be-9a15-849f1fe55f2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:51.273499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae395b25-9320-41be-9a15-849f1fe55f2d service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:51.277419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-610d3cf0-44aa-47e4-887e-fec85f2e72fe None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:51.282653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-610d3cf0-44aa-47e4-887e-fec85f2e72fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:51.297180 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3163/6335] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:42:50 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:42:51.297989 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3173/6336] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:42:51.298346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae395b25-9320-41be-9a15-849f1fe55f2d service cinder] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:51.318092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae395b25-9320-41be-9a15-849f1fe55f2d service cinder] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:51.323234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6933e-f171-4b16-b2cc-1ac384c293b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:51.323926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6933e-f171-4b16-b2cc-1ac384c293b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:51.324486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6933e-f171-4b16-b2cc-1ac384c293b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:51.324808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6933e-f171-4b16-b2cc-1ac384c293b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:51.325603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6933e-f171-4b16-b2cc-1ac384c293b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:42:51.325915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6933e-f171-4b16-b2cc-1ac384c293b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:51.327639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6933e-f171-4b16-b2cc-1ac384c293b8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:51.347493 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3164/6337] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:42:51.348947 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d3cf0-44aa-47e4-887e-fec85f2e72fe None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:51.362549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d3cf0-44aa-47e4-887e-fec85f2e72fe None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:51.368783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330e054-4d22-4153-a0b0-df370dd8ab44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:51.370220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330e054-4d22-4153-a0b0-df370dd8ab44 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:51.370735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330e054-4d22-4153-a0b0-df370dd8ab44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:51.371235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330e054-4d22-4153-a0b0-df370dd8ab44 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:51.372327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330e054-4d22-4153-a0b0-df370dd8ab44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:51.374949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330e054-4d22-4153-a0b0-df370dd8ab44 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:51.503781 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3174/6338] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:42:51 2022] POST /identity/v3/projects => generated 361 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:42:51.507749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6933e-f171-4b16-b2cc-1ac384c293b8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:51.520368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6933e-f171-4b16-b2cc-1ac384c293b8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:51.581964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330e054-4d22-4153-a0b0-df370dd8ab44 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:51.585060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3330e054-4d22-4153-a0b0-df370dd8ab44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:51.648234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25eee2-b758-4ebc-81d7-eec5fe96d40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:51.649371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25eee2-b758-4ebc-81d7-eec5fe96d40b admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:51.650050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25eee2-b758-4ebc-81d7-eec5fe96d40b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:51.650539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25eee2-b758-4ebc-81d7-eec5fe96d40b admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:51.651489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25eee2-b758-4ebc-81d7-eec5fe96d40b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:51.656889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25eee2-b758-4ebc-81d7-eec5fe96d40b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:51.744735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330e054-4d22-4153-a0b0-df370dd8ab44 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:51.762273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf3583-26ff-417c-a722-3cf324804600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:51.762974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf3583-26ff-417c-a722-3cf324804600 service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:51.764728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf3583-26ff-417c-a722-3cf324804600 service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:51.765046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf3583-26ff-417c-a722-3cf324804600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:51.768781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2fcf3583-26ff-417c-a722-3cf324804600 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:51.831111 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3165/6339] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:42:51 2022] POST /identity/v3/users => generated 281 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:42:51.833394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25eee2-b758-4ebc-81d7-eec5fe96d40b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:51.868191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf3583-26ff-417c-a722-3cf324804600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:51.868444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25eee2-b758-4ebc-81d7-eec5fe96d40b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:51.870904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf3583-26ff-417c-a722-3cf324804600 service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:51.884962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6881e-5f39-485d-90f3-e966e1c56084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:51.885575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6881e-5f39-485d-90f3-e966e1c56084 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:51.885909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6881e-5f39-485d-90f3-e966e1c56084 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:51.886363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6881e-5f39-485d-90f3-e966e1c56084 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:51.888214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6881e-5f39-485d-90f3-e966e1c56084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:51.890595 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6881e-5f39-485d-90f3-e966e1c56084 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:51.915149 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3166/6340] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:42:51.922022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6881e-5f39-485d-90f3-e966e1c56084 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:51.948196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6881e-5f39-485d-90f3-e966e1c56084 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:51.955468 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3175/6341] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:42:51 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:42:51.963265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fea00d-56b7-4089-9477-82390a3dce99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:51.968638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fea00d-56b7-4089-9477-82390a3dce99 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:51.968638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fea00d-56b7-4089-9477-82390a3dce99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:51.970422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fea00d-56b7-4089-9477-82390a3dce99 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:51.972217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fea00d-56b7-4089-9477-82390a3dce99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:51.976996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fea00d-56b7-4089-9477-82390a3dce99 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:52.012694 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3167/6342] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:42:52.014590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf3583-26ff-417c-a722-3cf324804600 service cinder] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:52.041966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf3583-26ff-417c-a722-3cf324804600 service cinder] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:52.061807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9eb7c-ff3d-41bb-a3de-4e0b35bd0f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:52.070058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9eb7c-ff3d-41bb-a3de-4e0b35bd0f68 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:52.070349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9eb7c-ff3d-41bb-a3de-4e0b35bd0f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:52.070640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9eb7c-ff3d-41bb-a3de-4e0b35bd0f68 admin admin] PATH_INFO: `/v3/projects/814d27f337164439a301bfa60f9e2a84/users/621a0b4b2d21410b95fc6704bbefb3ed/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:52.113512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9eb7c-ff3d-41bb-a3de-4e0b35bd0f68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=814d27f337164439a301bfa60f9e2a84, user_id=621a0b4b2d21410b95fc6704bbefb3ed, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:52.122331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9eb7c-ff3d-41bb-a3de-4e0b35bd0f68 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:52.346741 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3176/6343] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:42:52 2022] PUT /identity/v3/projects/814d27f337164439a301bfa60f9e2a84/users/621a0b4b2d21410b95fc6704bbefb3ed/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:52.348625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f7896-d580-42d4-9893-e0c5dd96f0d2 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:52.348625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f7896-d580-42d4-9893-e0c5dd96f0d2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:52.348625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f7896-d580-42d4-9893-e0c5dd96f0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:52.385372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d12f7896-d580-42d4-9893-e0c5dd96f0d2 None None] MFA Rules not processed for user `621a0b4b2d21410b95fc6704bbefb3ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:52.386630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d12f7896-d580-42d4-9893-e0c5dd96f0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:52.546132 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3168/6344] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:52.561650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9eb7c-ff3d-41bb-a3de-4e0b35bd0f68 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:52.797865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9eb7c-ff3d-41bb-a3de-4e0b35bd0f68 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:52.809722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e7053-5ef0-441f-a8f5-9b6c3c76fc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:52.810625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e7053-5ef0-441f-a8f5-9b6c3c76fc94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:52.810911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e7053-5ef0-441f-a8f5-9b6c3c76fc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:52.811191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e7053-5ef0-441f-a8f5-9b6c3c76fc94 admin admin] PATH_INFO: `/v3/users/621a0b4b2d21410b95fc6704bbefb3ed` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:52.813089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e7053-5ef0-441f-a8f5-9b6c3c76fc94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=621a0b4b2d21410b95fc6704bbefb3ed)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:52.815022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e7053-5ef0-441f-a8f5-9b6c3c76fc94 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:53.044902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f91e7053-5ef0-441f-a8f5-9b6c3c76fc94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '621a0b4b2d21410b95fc6704bbefb3ed'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:53.061907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f91e7053-5ef0-441f-a8f5-9b6c3c76fc94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '621a0b4b2d21410b95fc6704bbefb3ed'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:53.062921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f91e7053-5ef0-441f-a8f5-9b6c3c76fc94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '621a0b4b2d21410b95fc6704bbefb3ed'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:53.071550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f91e7053-5ef0-441f-a8f5-9b6c3c76fc94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '621a0b4b2d21410b95fc6704bbefb3ed'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:53.178924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f91e7053-5ef0-441f-a8f5-9b6c3c76fc94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '621a0b4b2d21410b95fc6704bbefb3ed'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:53.188767 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3177/6345] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:42:52 2022] DELETE /identity/v3/users/621a0b4b2d21410b95fc6704bbefb3ed => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:53.194366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a4cdc-ab0e-4ca9-aaa4-3978b0439908 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:53.194878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a4cdc-ab0e-4ca9-aaa4-3978b0439908 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:53.194970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a4cdc-ab0e-4ca9-aaa4-3978b0439908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:53.220840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d45a4cdc-ab0e-4ca9-aaa4-3978b0439908 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:53.222502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d45a4cdc-ab0e-4ca9-aaa4-3978b0439908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:53.359097 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3169/6346] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:53.363770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e7053-5ef0-441f-a8f5-9b6c3c76fc94 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:53.367182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f91e7053-5ef0-441f-a8f5-9b6c3c76fc94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:53.451209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e7053-5ef0-441f-a8f5-9b6c3c76fc94 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:53.457393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b57854-0f8f-4147-a6a5-29b20f72ab5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:53.459029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b57854-0f8f-4147-a6a5-29b20f72ab5e service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:53.459571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b57854-0f8f-4147-a6a5-29b20f72ab5e service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:53.460078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b57854-0f8f-4147-a6a5-29b20f72ab5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:53.472984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b57854-0f8f-4147-a6a5-29b20f72ab5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:53.475636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b57854-0f8f-4147-a6a5-29b20f72ab5e service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:53.487698 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3178/6347] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:42:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:42:54.301018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a4cdc-ab0e-4ca9-aaa4-3978b0439908 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:54.302493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d45a4cdc-ab0e-4ca9-aaa4-3978b0439908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:54.324914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a4cdc-ab0e-4ca9-aaa4-3978b0439908 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:54.352265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bb1d4-279c-424a-b7ae-e63269125580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:54.353419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bb1d4-279c-424a-b7ae-e63269125580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:54.353881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bb1d4-279c-424a-b7ae-e63269125580 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:54.355112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bb1d4-279c-424a-b7ae-e63269125580 admin admin] PATH_INFO: `/v3/projects/814d27f337164439a301bfa60f9e2a84` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:54.360028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bb1d4-279c-424a-b7ae-e63269125580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=814d27f337164439a301bfa60f9e2a84)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:54.377232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bb1d4-279c-424a-b7ae-e63269125580 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:54.626065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9d2bb1d4-279c-424a-b7ae-e63269125580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '814d27f337164439a301bfa60f9e2a84', 'request_id': 'req-9d2bb1d4-279c-424a-b7ae-e63269125580'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:54.650968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9d2bb1d4-279c-424a-b7ae-e63269125580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '814d27f337164439a301bfa60f9e2a84', 'request_id': 'req-9d2bb1d4-279c-424a-b7ae-e63269125580'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:54.759116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9d2bb1d4-279c-424a-b7ae-e63269125580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '814d27f337164439a301bfa60f9e2a84', 'request_id': 'req-9d2bb1d4-279c-424a-b7ae-e63269125580'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:54.777614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9d2bb1d4-279c-424a-b7ae-e63269125580 admin admin] The token cache is being invalidate because project 814d27f337164439a301bfa60f9e2a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:42:54.778629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9d2bb1d4-279c-424a-b7ae-e63269125580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:54.780297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9d2bb1d4-279c-424a-b7ae-e63269125580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:42:54.782586 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3170/6348] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:42:54 2022] DELETE /identity/v3/projects/814d27f337164439a301bfa60f9e2a84 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:54.793495 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca3892-251d-476f-898f-d33b2367d68a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:54.793883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca3892-251d-476f-898f-d33b2367d68a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:54.794094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca3892-251d-476f-898f-d33b2367d68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:54.838993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b8ca3892-251d-476f-898f-d33b2367d68a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:54.841166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b8ca3892-251d-476f-898f-d33b2367d68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:54.994280 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3179/6349] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:54.996139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8941a-a246-4e74-90b7-3fda933192e7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:54.996431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8941a-a246-4e74-90b7-3fda933192e7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:54.996743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8941a-a246-4e74-90b7-3fda933192e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:55.034860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3eb8941a-a246-4e74-90b7-3fda933192e7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:55.036532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3eb8941a-a246-4e74-90b7-3fda933192e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:55.058009 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3171/6350] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:55.063239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca3892-251d-476f-898f-d33b2367d68a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:55.076495 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca3892-251d-476f-898f-d33b2367d68a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:55.085623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab19d54-f2e8-4fb2-a4d1-4be37a0af345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:55.086406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab19d54-f2e8-4fb2-a4d1-4be37a0af345 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:55.086845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab19d54-f2e8-4fb2-a4d1-4be37a0af345 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:55.087509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab19d54-f2e8-4fb2-a4d1-4be37a0af345 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:55.088747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab19d54-f2e8-4fb2-a4d1-4be37a0af345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:42:55.089242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab19d54-f2e8-4fb2-a4d1-4be37a0af345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:55.094404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab19d54-f2e8-4fb2-a4d1-4be37a0af345 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:55.122773 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3180/6351] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:42:55.129335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8941a-a246-4e74-90b7-3fda933192e7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:55.140519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8941a-a246-4e74-90b7-3fda933192e7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:55.146217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c30fe-ee29-4992-9917-b5dcd1455aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:55.147162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c30fe-ee29-4992-9917-b5dcd1455aca admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:55.147452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c30fe-ee29-4992-9917-b5dcd1455aca admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:55.147905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c30fe-ee29-4992-9917-b5dcd1455aca admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:55.148696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c30fe-ee29-4992-9917-b5dcd1455aca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:55.150839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c30fe-ee29-4992-9917-b5dcd1455aca admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:55.250047 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3172/6352] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:42:55 2022] POST /identity/v3/projects => generated 409 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:42:55.254676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab19d54-f2e8-4fb2-a4d1-4be37a0af345 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:55.267011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab19d54-f2e8-4fb2-a4d1-4be37a0af345 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:55.401784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6086843-be7b-4ad8-8a66-cfe454ac745d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:55.403545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6086843-be7b-4ad8-8a66-cfe454ac745d admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:55.405858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6086843-be7b-4ad8-8a66-cfe454ac745d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:55.406313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6086843-be7b-4ad8-8a66-cfe454ac745d admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:55.407207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6086843-be7b-4ad8-8a66-cfe454ac745d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:55.418131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6086843-be7b-4ad8-8a66-cfe454ac745d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:55.524432 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3181/6353] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:42:55 2022] POST /identity/v3/users => generated 305 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:42:55.528246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c30fe-ee29-4992-9917-b5dcd1455aca admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:55.540138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c30fe-ee29-4992-9917-b5dcd1455aca admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:55.548294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a49a0-89f0-4be7-94fa-f6c72e85bfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:55.551655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a49a0-89f0-4be7-94fa-f6c72e85bfdd admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:55.551655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a49a0-89f0-4be7-94fa-f6c72e85bfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:55.551655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a49a0-89f0-4be7-94fa-f6c72e85bfdd admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:55.551655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a49a0-89f0-4be7-94fa-f6c72e85bfdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:55.552421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a49a0-89f0-4be7-94fa-f6c72e85bfdd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:55.572887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6086843-be7b-4ad8-8a66-cfe454ac745d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:55.575026 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3173/6354] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:42:55.596543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6086843-be7b-4ad8-8a66-cfe454ac745d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:55.608157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93259d2c-ddd6-4eae-9557-baeab6d8ed23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:55.611125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93259d2c-ddd6-4eae-9557-baeab6d8ed23 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:55.611622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93259d2c-ddd6-4eae-9557-baeab6d8ed23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:55.612188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93259d2c-ddd6-4eae-9557-baeab6d8ed23 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:55.613167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93259d2c-ddd6-4eae-9557-baeab6d8ed23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:55.614982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93259d2c-ddd6-4eae-9557-baeab6d8ed23 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:55.640016 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3182/6355] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:42:55.645829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a49a0-89f0-4be7-94fa-f6c72e85bfdd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:55.662122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a49a0-89f0-4be7-94fa-f6c72e85bfdd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:55.669269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dda92-9a15-4f5c-8dc3-ee2a7182715b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:55.670554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dda92-9a15-4f5c-8dc3-ee2a7182715b admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:55.671117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dda92-9a15-4f5c-8dc3-ee2a7182715b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:55.671633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dda92-9a15-4f5c-8dc3-ee2a7182715b admin admin] PATH_INFO: `/v3/projects/78eae8ae058b406c92923d2754bdbfb6/users/fd1263d7bec94327802aa7ad56a5bae9/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:55.701820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071dda92-9a15-4f5c-8dc3-ee2a7182715b admin admin] RBAC: Authorizing `identity:create_grant(project_id=78eae8ae058b406c92923d2754bdbfb6, user_id=fd1263d7bec94327802aa7ad56a5bae9, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:55.705592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071dda92-9a15-4f5c-8dc3-ee2a7182715b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:55.855467 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3174/6356] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:42:55 2022] PUT /identity/v3/projects/78eae8ae058b406c92923d2754bdbfb6/users/fd1263d7bec94327802aa7ad56a5bae9/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:55.860145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e5a41-7e0d-4b87-ad04-d4ebbbfb472a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:55.860730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e5a41-7e0d-4b87-ad04-d4ebbbfb472a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:55.860830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e5a41-7e0d-4b87-ad04-d4ebbbfb472a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:55.922386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e71e5a41-7e0d-4b87-ad04-d4ebbbfb472a None None] MFA Rules not processed for user `fd1263d7bec94327802aa7ad56a5bae9`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:55.925464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e71e5a41-7e0d-4b87-ad04-d4ebbbfb472a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:56.109318 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3183/6357] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:55 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:56.110418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dda92-9a15-4f5c-8dc3-ee2a7182715b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:56.208301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dda92-9a15-4f5c-8dc3-ee2a7182715b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:56.214512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fafe48-b55a-43b8-9868-3d2c0cde0936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:56.220538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fafe48-b55a-43b8-9868-3d2c0cde0936 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:56.220538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fafe48-b55a-43b8-9868-3d2c0cde0936 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:56.220538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fafe48-b55a-43b8-9868-3d2c0cde0936 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:56.220538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fafe48-b55a-43b8-9868-3d2c0cde0936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:56.220538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fafe48-b55a-43b8-9868-3d2c0cde0936 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:56.376959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e5a41-7e0d-4b87-ad04-d4ebbbfb472a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:56.380515 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3175/6358] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:42:56 2022] POST /identity/v3/projects => generated 409 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:42:56.391124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e5a41-7e0d-4b87-ad04-d4ebbbfb472a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:56.503637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36711b86-b81d-4d76-a41c-e7ff08c115b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:56.506684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36711b86-b81d-4d76-a41c-e7ff08c115b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:56.507172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36711b86-b81d-4d76-a41c-e7ff08c115b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:56.507505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36711b86-b81d-4d76-a41c-e7ff08c115b4 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:56.508368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36711b86-b81d-4d76-a41c-e7ff08c115b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:56.512016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36711b86-b81d-4d76-a41c-e7ff08c115b4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:56.689852 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3184/6359] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:42:56 2022] POST /identity/v3/users => generated 311 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:42:56.695436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fafe48-b55a-43b8-9868-3d2c0cde0936 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:56.706160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fafe48-b55a-43b8-9868-3d2c0cde0936 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:56.714218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1682f83-36f9-4155-880a-9e8f712e0e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:56.715778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1682f83-36f9-4155-880a-9e8f712e0e4b admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:56.715778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1682f83-36f9-4155-880a-9e8f712e0e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:56.715778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1682f83-36f9-4155-880a-9e8f712e0e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:56.716952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1682f83-36f9-4155-880a-9e8f712e0e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:56.719252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1682f83-36f9-4155-880a-9e8f712e0e4b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:56.736082 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3176/6360] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:42:56.736408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36711b86-b81d-4d76-a41c-e7ff08c115b4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:56.747523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36711b86-b81d-4d76-a41c-e7ff08c115b4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:56.756135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5b443-89e8-4cb6-917f-8541e1b5f5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:56.757004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5b443-89e8-4cb6-917f-8541e1b5f5e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:56.757512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5b443-89e8-4cb6-917f-8541e1b5f5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:56.757996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5b443-89e8-4cb6-917f-8541e1b5f5e5 admin admin] PATH_INFO: `/v3/projects/c7c24006c76a4faa80941e963fed5169/users/1aa239ba68304ac49d8ff44a5ae21ecb/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:56.775718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5b443-89e8-4cb6-917f-8541e1b5f5e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7c24006c76a4faa80941e963fed5169, user_id=1aa239ba68304ac49d8ff44a5ae21ecb, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:56.778486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5b443-89e8-4cb6-917f-8541e1b5f5e5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:56.919606 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3185/6361] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:42:56 2022] PUT /identity/v3/projects/c7c24006c76a4faa80941e963fed5169/users/1aa239ba68304ac49d8ff44a5ae21ecb/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:42:56.923805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1682f83-36f9-4155-880a-9e8f712e0e4b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:56.938020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1682f83-36f9-4155-880a-9e8f712e0e4b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:56.994076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1224434-cc67-4647-831d-b43e54c3378e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:56.994752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1224434-cc67-4647-831d-b43e54c3378e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:56.995188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1224434-cc67-4647-831d-b43e54c3378e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:56.995314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1224434-cc67-4647-831d-b43e54c3378e admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:56.996003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1224434-cc67-4647-831d-b43e54c3378e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:56.997651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1224434-cc67-4647-831d-b43e54c3378e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:57.012511 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3177/6362] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:42:57.013718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5b443-89e8-4cb6-917f-8541e1b5f5e5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:57.025487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5b443-89e8-4cb6-917f-8541e1b5f5e5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:57.030314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ebb4e-1bdc-47ca-9678-51f3a1169429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:57.031327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ebb4e-1bdc-47ca-9678-51f3a1169429 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:57.031612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ebb4e-1bdc-47ca-9678-51f3a1169429 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:57.032743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ebb4e-1bdc-47ca-9678-51f3a1169429 admin admin] PATH_INFO: `/v3/projects/c7c24006c76a4faa80941e963fed5169/users/1aa239ba68304ac49d8ff44a5ae21ecb/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:57.035344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ebb4e-1bdc-47ca-9678-51f3a1169429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7c24006c76a4faa80941e963fed5169, user_id=1aa239ba68304ac49d8ff44a5ae21ecb, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:57.038184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ebb4e-1bdc-47ca-9678-51f3a1169429 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:57.052826 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3186/6363] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:42:57 2022] PUT /identity/v3/projects/c7c24006c76a4faa80941e963fed5169/users/1aa239ba68304ac49d8ff44a5ae21ecb/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:42:57.061778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824cb44-6977-45e5-a86c-375e8bced11c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:57.062076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824cb44-6977-45e5-a86c-375e8bced11c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:57.062401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824cb44-6977-45e5-a86c-375e8bced11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:57.104818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2824cb44-6977-45e5-a86c-375e8bced11c None None] MFA Rules not processed for user `1aa239ba68304ac49d8ff44a5ae21ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:57.104818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2824cb44-6977-45e5-a86c-375e8bced11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:57.161275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1aab39-e839-4635-a8b0-6595d4667c07 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:57.161564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1aab39-e839-4635-a8b0-6595d4667c07 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:57.161916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1aab39-e839-4635-a8b0-6595d4667c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:57.180064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-de1aab39-e839-4635-a8b0-6595d4667c07 None None] MFA Rules not processed for user `3bb0ce3a6ad74cec85da601a746d6fee`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:42:57.181277 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3178/6364] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:42:57.181838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-de1aab39-e839-4635-a8b0-6595d4667c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:57.192703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824cb44-6977-45e5-a86c-375e8bced11c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:42:57.194768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2824cb44-6977-45e5-a86c-375e8bced11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:42:57.251369 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3187/6365] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:42:57.259117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824cb44-6977-45e5-a86c-375e8bced11c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:42:57.263056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf676ee-2ca0-4c4f-afcb-7437e32a6268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:42:57.263750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf676ee-2ca0-4c4f-afcb-7437e32a6268 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:42:57.264035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf676ee-2ca0-4c4f-afcb-7437e32a6268 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:42:57.264317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf676ee-2ca0-4c4f-afcb-7437e32a6268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:42:57.274532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf676ee-2ca0-4c4f-afcb-7437e32a6268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:42:57.276033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf676ee-2ca0-4c4f-afcb-7437e32a6268 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:42:57.296801 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3179/6366] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:42:57 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:43:00.438533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1aab39-e839-4635-a8b0-6595d4667c07 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:00.525443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1aab39-e839-4635-a8b0-6595d4667c07 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:00.533217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79519766-ec58-4bd1-b4fb-f42e712d73b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:00.534109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79519766-ec58-4bd1-b4fb-f42e712d73b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:00.535022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79519766-ec58-4bd1-b4fb-f42e712d73b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:00.535318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79519766-ec58-4bd1-b4fb-f42e712d73b9 admin admin] PATH_INFO: `/v3/users/fd1263d7bec94327802aa7ad56a5bae9` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:00.536664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79519766-ec58-4bd1-b4fb-f42e712d73b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd1263d7bec94327802aa7ad56a5bae9)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:00.539212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79519766-ec58-4bd1-b4fb-f42e712d73b9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:00.706335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-79519766-ec58-4bd1-b4fb-f42e712d73b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd1263d7bec94327802aa7ad56a5bae9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:00.720139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-79519766-ec58-4bd1-b4fb-f42e712d73b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd1263d7bec94327802aa7ad56a5bae9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:00.720912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-79519766-ec58-4bd1-b4fb-f42e712d73b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd1263d7bec94327802aa7ad56a5bae9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:00.729350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-79519766-ec58-4bd1-b4fb-f42e712d73b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd1263d7bec94327802aa7ad56a5bae9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:00.782790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-79519766-ec58-4bd1-b4fb-f42e712d73b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd1263d7bec94327802aa7ad56a5bae9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:00.790226 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3188/6367] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:43:00 2022] DELETE /identity/v3/users/fd1263d7bec94327802aa7ad56a5bae9 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:00.794982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170cad1-ea5b-47f8-b9ee-f27b6fda4b51 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:00.795475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170cad1-ea5b-47f8-b9ee-f27b6fda4b51 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:00.795573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170cad1-ea5b-47f8-b9ee-f27b6fda4b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:00.824088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b170cad1-ea5b-47f8-b9ee-f27b6fda4b51 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:00.825373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b170cad1-ea5b-47f8-b9ee-f27b6fda4b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:00.891191 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3180/6368] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:00.901321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79519766-ec58-4bd1-b4fb-f42e712d73b9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:00.902847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-79519766-ec58-4bd1-b4fb-f42e712d73b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:00.966415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79519766-ec58-4bd1-b4fb-f42e712d73b9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:00.970349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae9f1e-e630-4bd9-8ed2-a2cdddcbcace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:00.971002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae9f1e-e630-4bd9-8ed2-a2cdddcbcace service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:00.971288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae9f1e-e630-4bd9-8ed2-a2cdddcbcace service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:00.971566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae9f1e-e630-4bd9-8ed2-a2cdddcbcace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:00.981798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae9f1e-e630-4bd9-8ed2-a2cdddcbcace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:00.983230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae9f1e-e630-4bd9-8ed2-a2cdddcbcace service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:00.995154 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3189/6369] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:43:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:43:01.454738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170cad1-ea5b-47f8-b9ee-f27b6fda4b51 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:01.456861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b170cad1-ea5b-47f8-b9ee-f27b6fda4b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:01.480453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170cad1-ea5b-47f8-b9ee-f27b6fda4b51 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:01.485914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc76c2c-cc78-42b6-96aa-7cf764cf1bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:01.487581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc76c2c-cc78-42b6-96aa-7cf764cf1bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:01.487835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc76c2c-cc78-42b6-96aa-7cf764cf1bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:01.488187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc76c2c-cc78-42b6-96aa-7cf764cf1bd3 admin admin] PATH_INFO: `/v3/projects/78eae8ae058b406c92923d2754bdbfb6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:01.492039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc76c2c-cc78-42b6-96aa-7cf764cf1bd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78eae8ae058b406c92923d2754bdbfb6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:01.494116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc76c2c-cc78-42b6-96aa-7cf764cf1bd3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:01.636923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0dc76c2c-cc78-42b6-96aa-7cf764cf1bd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78eae8ae058b406c92923d2754bdbfb6', 'request_id': 'req-0dc76c2c-cc78-42b6-96aa-7cf764cf1bd3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:01.643254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0dc76c2c-cc78-42b6-96aa-7cf764cf1bd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78eae8ae058b406c92923d2754bdbfb6', 'request_id': 'req-0dc76c2c-cc78-42b6-96aa-7cf764cf1bd3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:01.768883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0dc76c2c-cc78-42b6-96aa-7cf764cf1bd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78eae8ae058b406c92923d2754bdbfb6', 'request_id': 'req-0dc76c2c-cc78-42b6-96aa-7cf764cf1bd3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:01.792168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0dc76c2c-cc78-42b6-96aa-7cf764cf1bd3 admin admin] The token cache is being invalidate because project 78eae8ae058b406c92923d2754bdbfb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:43:01.792468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0dc76c2c-cc78-42b6-96aa-7cf764cf1bd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:01.795475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0dc76c2c-cc78-42b6-96aa-7cf764cf1bd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:01.801371 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3181/6370] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:43:01 2022] DELETE /identity/v3/projects/78eae8ae058b406c92923d2754bdbfb6 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:01.809576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae9f1e-e630-4bd9-8ed2-a2cdddcbcace service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:01.827139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae9f1e-e630-4bd9-8ed2-a2cdddcbcace service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:01.904566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798f6e7-3707-40ac-a621-5aeb750c7dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:01.905501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798f6e7-3707-40ac-a621-5aeb750c7dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:01.905793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798f6e7-3707-40ac-a621-5aeb750c7dff admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:01.906235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798f6e7-3707-40ac-a621-5aeb750c7dff admin admin] PATH_INFO: `/v3/users/1aa239ba68304ac49d8ff44a5ae21ecb` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:01.909097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798f6e7-3707-40ac-a621-5aeb750c7dff admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa239ba68304ac49d8ff44a5ae21ecb)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:01.911457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798f6e7-3707-40ac-a621-5aeb750c7dff admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:02.116400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7798f6e7-3707-40ac-a621-5aeb750c7dff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa239ba68304ac49d8ff44a5ae21ecb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:02.129743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7798f6e7-3707-40ac-a621-5aeb750c7dff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa239ba68304ac49d8ff44a5ae21ecb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:02.130482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7798f6e7-3707-40ac-a621-5aeb750c7dff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa239ba68304ac49d8ff44a5ae21ecb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:02.137425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7798f6e7-3707-40ac-a621-5aeb750c7dff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa239ba68304ac49d8ff44a5ae21ecb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:02.231163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7798f6e7-3707-40ac-a621-5aeb750c7dff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa239ba68304ac49d8ff44a5ae21ecb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:02.245789 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3190/6371] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:43:01 2022] DELETE /identity/v3/users/1aa239ba68304ac49d8ff44a5ae21ecb => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:02.503303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc76c2c-cc78-42b6-96aa-7cf764cf1bd3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:02.508208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0dc76c2c-cc78-42b6-96aa-7cf764cf1bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:02.540383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc76c2c-cc78-42b6-96aa-7cf764cf1bd3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:02.623078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803e43d-98e6-4b06-948c-e4debd277169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:02.624262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803e43d-98e6-4b06-948c-e4debd277169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:02.624550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803e43d-98e6-4b06-948c-e4debd277169 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:02.624939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803e43d-98e6-4b06-948c-e4debd277169 admin admin] PATH_INFO: `/v3/projects/c7c24006c76a4faa80941e963fed5169` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:02.626709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803e43d-98e6-4b06-948c-e4debd277169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7c24006c76a4faa80941e963fed5169)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:02.628933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803e43d-98e6-4b06-948c-e4debd277169 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:02.755112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4803e43d-98e6-4b06-948c-e4debd277169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7c24006c76a4faa80941e963fed5169', 'request_id': 'req-4803e43d-98e6-4b06-948c-e4debd277169'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:02.763525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4803e43d-98e6-4b06-948c-e4debd277169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7c24006c76a4faa80941e963fed5169', 'request_id': 'req-4803e43d-98e6-4b06-948c-e4debd277169'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:02.916634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4803e43d-98e6-4b06-948c-e4debd277169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7c24006c76a4faa80941e963fed5169', 'request_id': 'req-4803e43d-98e6-4b06-948c-e4debd277169'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:02.929630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4803e43d-98e6-4b06-948c-e4debd277169 admin admin] The token cache is being invalidate because project c7c24006c76a4faa80941e963fed5169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:43:02.930209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4803e43d-98e6-4b06-948c-e4debd277169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:02.931226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4803e43d-98e6-4b06-948c-e4debd277169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:02.936960 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3182/6372] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:43:02 2022] DELETE /identity/v3/projects/c7c24006c76a4faa80941e963fed5169 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:02.938288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04219e6a-b702-49af-82d0-2c8f9d209777 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:02.938784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04219e6a-b702-49af-82d0-2c8f9d209777 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:02.938895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04219e6a-b702-49af-82d0-2c8f9d209777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:02.969664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-04219e6a-b702-49af-82d0-2c8f9d209777 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:02.973417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-04219e6a-b702-49af-82d0-2c8f9d209777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:03.047604 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3191/6373] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:03.056706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a4f75-3d1e-4985-9fe0-6e1235a4a333 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:03.057078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a4f75-3d1e-4985-9fe0-6e1235a4a333 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:03.064386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a4f75-3d1e-4985-9fe0-6e1235a4a333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:03.076395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b66a4f75-3d1e-4985-9fe0-6e1235a4a333 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:03.077893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b66a4f75-3d1e-4985-9fe0-6e1235a4a333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:03.088034 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3183/6374] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:03.093836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04219e6a-b702-49af-82d0-2c8f9d209777 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:03.107773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04219e6a-b702-49af-82d0-2c8f9d209777 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:03.114365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af844a-b4c8-458b-a912-364c9bfc2110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:03.116021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af844a-b4c8-458b-a912-364c9bfc2110 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:03.116549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af844a-b4c8-458b-a912-364c9bfc2110 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:03.116939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af844a-b4c8-458b-a912-364c9bfc2110 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:03.117833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af844a-b4c8-458b-a912-364c9bfc2110 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:43:03.118242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af844a-b4c8-458b-a912-364c9bfc2110 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:03.119913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af844a-b4c8-458b-a912-364c9bfc2110 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:03.137693 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3192/6375] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:43:03.142519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a4f75-3d1e-4985-9fe0-6e1235a4a333 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:03.161127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a4f75-3d1e-4985-9fe0-6e1235a4a333 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:03.166944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef1284-26b5-4d05-bd7e-395c85bb616e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:03.167617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef1284-26b5-4d05-bd7e-395c85bb616e admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:03.167902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef1284-26b5-4d05-bd7e-395c85bb616e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:03.168181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef1284-26b5-4d05-bd7e-395c85bb616e admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:03.169035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef1284-26b5-4d05-bd7e-395c85bb616e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:03.171210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef1284-26b5-4d05-bd7e-395c85bb616e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:03.328234 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3184/6376] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:43:03 2022] POST /identity/v3/projects => generated 367 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:43:03.332138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af844a-b4c8-458b-a912-364c9bfc2110 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:03.348153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af844a-b4c8-458b-a912-364c9bfc2110 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:03.437198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee8b2f-b767-4d5c-907b-49026034554f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:03.438192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee8b2f-b767-4d5c-907b-49026034554f admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:03.438481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee8b2f-b767-4d5c-907b-49026034554f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:03.438757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee8b2f-b767-4d5c-907b-49026034554f admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:03.442394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee8b2f-b767-4d5c-907b-49026034554f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:03.442394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee8b2f-b767-4d5c-907b-49026034554f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:03.522480 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3193/6377] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:43:03 2022] POST /identity/v3/users => generated 284 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:43:03.529371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef1284-26b5-4d05-bd7e-395c85bb616e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:03.542151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef1284-26b5-4d05-bd7e-395c85bb616e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:03.547656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced9bd7-0346-49a3-8b77-2164f538e392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:03.551669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced9bd7-0346-49a3-8b77-2164f538e392 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:03.551669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced9bd7-0346-49a3-8b77-2164f538e392 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:03.551669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced9bd7-0346-49a3-8b77-2164f538e392 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:03.551669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced9bd7-0346-49a3-8b77-2164f538e392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:03.552832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced9bd7-0346-49a3-8b77-2164f538e392 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:03.565440 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3185/6378] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:43:03.577805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee8b2f-b767-4d5c-907b-49026034554f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:03.599282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee8b2f-b767-4d5c-907b-49026034554f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:03.606163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a314db-f089-4670-93b7-e9116d08ffe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:03.607120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a314db-f089-4670-93b7-e9116d08ffe4 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:03.607615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a314db-f089-4670-93b7-e9116d08ffe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:03.608126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a314db-f089-4670-93b7-e9116d08ffe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:03.609264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a314db-f089-4670-93b7-e9116d08ffe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:03.611219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a314db-f089-4670-93b7-e9116d08ffe4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:03.622956 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3194/6379] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:43:03.627605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced9bd7-0346-49a3-8b77-2164f538e392 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:03.644338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced9bd7-0346-49a3-8b77-2164f538e392 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:03.655657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f7ffb-a014-42fb-9646-9f06bd1a916e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:03.656814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f7ffb-a014-42fb-9646-9f06bd1a916e admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:03.657524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f7ffb-a014-42fb-9646-9f06bd1a916e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:03.657980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f7ffb-a014-42fb-9646-9f06bd1a916e admin admin] PATH_INFO: `/v3/projects/19077737776d49c9b5182329ed3b51b3/users/c720087e38bb4b328dc894df25385e36/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:03.705006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f7ffb-a014-42fb-9646-9f06bd1a916e admin admin] RBAC: Authorizing `identity:create_grant(project_id=19077737776d49c9b5182329ed3b51b3, user_id=c720087e38bb4b328dc894df25385e36, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:03.708533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f7ffb-a014-42fb-9646-9f06bd1a916e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:03.850758 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3186/6380] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:43:03 2022] PUT /identity/v3/projects/19077737776d49c9b5182329ed3b51b3/users/c720087e38bb4b328dc894df25385e36/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:43:03.863505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82955cd6-d3f6-4bcb-a165-e8cf9e43c976 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:03.863931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82955cd6-d3f6-4bcb-a165-e8cf9e43c976 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:03.866976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82955cd6-d3f6-4bcb-a165-e8cf9e43c976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:03.920671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-82955cd6-d3f6-4bcb-a165-e8cf9e43c976 None None] MFA Rules not processed for user `c720087e38bb4b328dc894df25385e36`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:03.922272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-82955cd6-d3f6-4bcb-a165-e8cf9e43c976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:04.012184 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3195/6381] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:04.013453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f7ffb-a014-42fb-9646-9f06bd1a916e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:04.111559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f7ffb-a014-42fb-9646-9f06bd1a916e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:04.118235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc9e50-fce1-4a4e-97f9-25cf321e846b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:04.124657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc9e50-fce1-4a4e-97f9-25cf321e846b admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:04.124657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc9e50-fce1-4a4e-97f9-25cf321e846b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:04.124657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc9e50-fce1-4a4e-97f9-25cf321e846b admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:04.124657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc9e50-fce1-4a4e-97f9-25cf321e846b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:04.124657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc9e50-fce1-4a4e-97f9-25cf321e846b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:04.235336 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3187/6382] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:43:04 2022] POST /identity/v3/projects => generated 369 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:43:04.239396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82955cd6-d3f6-4bcb-a165-e8cf9e43c976 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:04.251593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82955cd6-d3f6-4bcb-a165-e8cf9e43c976 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:04.321986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c283b-5e21-45f3-897d-e768119026eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:04.322499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c283b-5e21-45f3-897d-e768119026eb admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:04.322976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c283b-5e21-45f3-897d-e768119026eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:04.323322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c283b-5e21-45f3-897d-e768119026eb admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:04.324036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c283b-5e21-45f3-897d-e768119026eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:04.326064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c283b-5e21-45f3-897d-e768119026eb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:04.409389 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3196/6383] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:43:04 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:43:04.413189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc9e50-fce1-4a4e-97f9-25cf321e846b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:04.428743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc9e50-fce1-4a4e-97f9-25cf321e846b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:04.437707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3015be-8d0b-4f9b-85d0-cf3e850aacd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:04.438399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3015be-8d0b-4f9b-85d0-cf3e850aacd3 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:04.438682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3015be-8d0b-4f9b-85d0-cf3e850aacd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:04.439118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3015be-8d0b-4f9b-85d0-cf3e850aacd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:04.440019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3015be-8d0b-4f9b-85d0-cf3e850aacd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:04.441676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3015be-8d0b-4f9b-85d0-cf3e850aacd3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:04.456094 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3188/6384] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:43:04.457435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c283b-5e21-45f3-897d-e768119026eb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:04.468181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c283b-5e21-45f3-897d-e768119026eb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:04.473880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de239c8f-2d16-4923-ad71-6a400545cf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:04.475624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de239c8f-2d16-4923-ad71-6a400545cf2e admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:04.475955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de239c8f-2d16-4923-ad71-6a400545cf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:04.476236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de239c8f-2d16-4923-ad71-6a400545cf2e admin admin] PATH_INFO: `/v3/projects/c8994e2e85c64989b6406f5036c4e88f/users/b8aecf5760bd4e9c89552adc43512e3b/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:04.494875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de239c8f-2d16-4923-ad71-6a400545cf2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8994e2e85c64989b6406f5036c4e88f, user_id=b8aecf5760bd4e9c89552adc43512e3b, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:04.497679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de239c8f-2d16-4923-ad71-6a400545cf2e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:04.621598 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3197/6385] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:43:04 2022] PUT /identity/v3/projects/c8994e2e85c64989b6406f5036c4e88f/users/b8aecf5760bd4e9c89552adc43512e3b/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:04.622898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3015be-8d0b-4f9b-85d0-cf3e850aacd3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:04.636736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3015be-8d0b-4f9b-85d0-cf3e850aacd3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:04.701614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f4d2f-93de-45a8-b0b6-622642fe9234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:04.702282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f4d2f-93de-45a8-b0b6-622642fe9234 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:04.702566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f4d2f-93de-45a8-b0b6-622642fe9234 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:04.702845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f4d2f-93de-45a8-b0b6-622642fe9234 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:04.703778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f4d2f-93de-45a8-b0b6-622642fe9234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:04.705388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f4d2f-93de-45a8-b0b6-622642fe9234 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:04.715936 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3189/6386] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:43:04.720335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de239c8f-2d16-4923-ad71-6a400545cf2e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:04.732061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de239c8f-2d16-4923-ad71-6a400545cf2e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:04.740923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4f07d-f499-4491-b9dc-30071bfb86f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:04.741955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4f07d-f499-4491-b9dc-30071bfb86f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:04.742301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4f07d-f499-4491-b9dc-30071bfb86f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:04.742645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4f07d-f499-4491-b9dc-30071bfb86f9 admin admin] PATH_INFO: `/v3/projects/c8994e2e85c64989b6406f5036c4e88f/users/b8aecf5760bd4e9c89552adc43512e3b/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:04.744983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4f07d-f499-4491-b9dc-30071bfb86f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8994e2e85c64989b6406f5036c4e88f, user_id=b8aecf5760bd4e9c89552adc43512e3b, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:04.747750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4f07d-f499-4491-b9dc-30071bfb86f9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:04.758922 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3198/6387] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:43:04 2022] PUT /identity/v3/projects/c8994e2e85c64989b6406f5036c4e88f/users/b8aecf5760bd4e9c89552adc43512e3b/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:04.769724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d026d7-0ba1-475b-8369-0da1920d77af None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:04.770099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d026d7-0ba1-475b-8369-0da1920d77af None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:04.770387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d026d7-0ba1-475b-8369-0da1920d77af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:04.798681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-10d026d7-0ba1-475b-8369-0da1920d77af None None] MFA Rules not processed for user `b8aecf5760bd4e9c89552adc43512e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:04.799882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-10d026d7-0ba1-475b-8369-0da1920d77af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:04.879722 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3190/6388] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:04 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:04.889888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4f07d-f499-4491-b9dc-30071bfb86f9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:04.891649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-35b4f07d-f499-4491-b9dc-30071bfb86f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:04.954031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4f07d-f499-4491-b9dc-30071bfb86f9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:04.958185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7d09e-a0c3-4bb1-b8b0-2c6b7d5a3678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:04.959447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7d09e-a0c3-4bb1-b8b0-2c6b7d5a3678 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:04.959732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7d09e-a0c3-4bb1-b8b0-2c6b7d5a3678 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:04.960009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7d09e-a0c3-4bb1-b8b0-2c6b7d5a3678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:04.969635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7d09e-a0c3-4bb1-b8b0-2c6b7d5a3678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:04.971057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7d09e-a0c3-4bb1-b8b0-2c6b7d5a3678 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:04.981641 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3199/6389] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:43:04 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:43:07.902616 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d026d7-0ba1-475b-8369-0da1920d77af None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:07.985906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d026d7-0ba1-475b-8369-0da1920d77af None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:07.997305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e130c31-8947-4493-809b-75b1ef73d5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:07.999518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e130c31-8947-4493-809b-75b1ef73d5cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:07.999818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e130c31-8947-4493-809b-75b1ef73d5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:08.000213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e130c31-8947-4493-809b-75b1ef73d5cf admin admin] PATH_INFO: `/v3/users/c720087e38bb4b328dc894df25385e36` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:08.001966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e130c31-8947-4493-809b-75b1ef73d5cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c720087e38bb4b328dc894df25385e36)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:08.003968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e130c31-8947-4493-809b-75b1ef73d5cf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:08.252852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6e130c31-8947-4493-809b-75b1ef73d5cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c720087e38bb4b328dc894df25385e36'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:08.266048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6e130c31-8947-4493-809b-75b1ef73d5cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c720087e38bb4b328dc894df25385e36'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:08.266856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6e130c31-8947-4493-809b-75b1ef73d5cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c720087e38bb4b328dc894df25385e36'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:08.274066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6e130c31-8947-4493-809b-75b1ef73d5cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c720087e38bb4b328dc894df25385e36'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:08.348034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6e130c31-8947-4493-809b-75b1ef73d5cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c720087e38bb4b328dc894df25385e36'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:08.355028 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3191/6390] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:43:07 2022] DELETE /identity/v3/users/c720087e38bb4b328dc894df25385e36 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:08.359455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb187b-493a-4d31-8d28-8e6d6482e891 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:08.359948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb187b-493a-4d31-8d28-8e6d6482e891 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:08.360042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb187b-493a-4d31-8d28-8e6d6482e891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:08.379323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a9fb187b-493a-4d31-8d28-8e6d6482e891 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:08.380533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a9fb187b-493a-4d31-8d28-8e6d6482e891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:08.439747 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3200/6391] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:08.449623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e130c31-8947-4493-809b-75b1ef73d5cf admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:08.451091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6e130c31-8947-4493-809b-75b1ef73d5cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:08.513475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e130c31-8947-4493-809b-75b1ef73d5cf admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:08.517442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae2614-d0e4-431f-85e4-8b8563798ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:08.518196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae2614-d0e4-431f-85e4-8b8563798ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:08.518379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae2614-d0e4-431f-85e4-8b8563798ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:08.518658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae2614-d0e4-431f-85e4-8b8563798ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:08.528585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae2614-d0e4-431f-85e4-8b8563798ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:08.530076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae2614-d0e4-431f-85e4-8b8563798ae4 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:08.541338 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3192/6392] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:43:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:43:08.931914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb187b-493a-4d31-8d28-8e6d6482e891 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:08.933358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a9fb187b-493a-4d31-8d28-8e6d6482e891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:08.946677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb187b-493a-4d31-8d28-8e6d6482e891 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:08.951410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162b959-023a-4566-99fd-d0686e6991b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:08.952278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162b959-023a-4566-99fd-d0686e6991b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:08.952563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162b959-023a-4566-99fd-d0686e6991b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:08.952876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162b959-023a-4566-99fd-d0686e6991b5 admin admin] PATH_INFO: `/v3/projects/19077737776d49c9b5182329ed3b51b3` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:08.954095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162b959-023a-4566-99fd-d0686e6991b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19077737776d49c9b5182329ed3b51b3)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:08.956248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162b959-023a-4566-99fd-d0686e6991b5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:09.076979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5162b959-023a-4566-99fd-d0686e6991b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19077737776d49c9b5182329ed3b51b3', 'request_id': 'req-5162b959-023a-4566-99fd-d0686e6991b5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:09.170307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5162b959-023a-4566-99fd-d0686e6991b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19077737776d49c9b5182329ed3b51b3', 'request_id': 'req-5162b959-023a-4566-99fd-d0686e6991b5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:09.177092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5162b959-023a-4566-99fd-d0686e6991b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19077737776d49c9b5182329ed3b51b3', 'request_id': 'req-5162b959-023a-4566-99fd-d0686e6991b5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:09.187623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5162b959-023a-4566-99fd-d0686e6991b5 admin admin] The token cache is being invalidate because project 19077737776d49c9b5182329ed3b51b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:43:09.187913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5162b959-023a-4566-99fd-d0686e6991b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:09.188580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5162b959-023a-4566-99fd-d0686e6991b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:09.190162 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3201/6393] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:43:08 2022] DELETE /identity/v3/projects/19077737776d49c9b5182329ed3b51b3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:09.199592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae2614-d0e4-431f-85e4-8b8563798ae4 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:09.210053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae2614-d0e4-431f-85e4-8b8563798ae4 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:09.266515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939dc4e0-fa43-41d0-8be6-bdf1ffe03a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:09.267398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dc4e0-fa43-41d0-8be6-bdf1ffe03a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:09.267713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dc4e0-fa43-41d0-8be6-bdf1ffe03a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:09.267995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dc4e0-fa43-41d0-8be6-bdf1ffe03a60 admin admin] PATH_INFO: `/v3/users/b8aecf5760bd4e9c89552adc43512e3b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:09.269216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939dc4e0-fa43-41d0-8be6-bdf1ffe03a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8aecf5760bd4e9c89552adc43512e3b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:09.271859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939dc4e0-fa43-41d0-8be6-bdf1ffe03a60 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:09.624642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-939dc4e0-fa43-41d0-8be6-bdf1ffe03a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8aecf5760bd4e9c89552adc43512e3b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:09.643302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-939dc4e0-fa43-41d0-8be6-bdf1ffe03a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8aecf5760bd4e9c89552adc43512e3b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:09.644076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-939dc4e0-fa43-41d0-8be6-bdf1ffe03a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8aecf5760bd4e9c89552adc43512e3b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:09.651260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-939dc4e0-fa43-41d0-8be6-bdf1ffe03a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8aecf5760bd4e9c89552adc43512e3b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:09.753392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-939dc4e0-fa43-41d0-8be6-bdf1ffe03a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8aecf5760bd4e9c89552adc43512e3b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:09.762316 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3193/6394] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:43:09 2022] DELETE /identity/v3/users/b8aecf5760bd4e9c89552adc43512e3b => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:43:10.335801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162b959-023a-4566-99fd-d0686e6991b5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:10.337371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5162b959-023a-4566-99fd-d0686e6991b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:10.351613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162b959-023a-4566-99fd-d0686e6991b5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:10.419176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f157c70-b46a-4214-a698-91f3f08ac23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:10.420146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f157c70-b46a-4214-a698-91f3f08ac23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:10.420332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f157c70-b46a-4214-a698-91f3f08ac23f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:10.420642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f157c70-b46a-4214-a698-91f3f08ac23f admin admin] PATH_INFO: `/v3/projects/c8994e2e85c64989b6406f5036c4e88f` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:10.421933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f157c70-b46a-4214-a698-91f3f08ac23f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8994e2e85c64989b6406f5036c4e88f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:10.423850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f157c70-b46a-4214-a698-91f3f08ac23f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:10.510014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6f157c70-b46a-4214-a698-91f3f08ac23f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8994e2e85c64989b6406f5036c4e88f', 'request_id': 'req-6f157c70-b46a-4214-a698-91f3f08ac23f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:10.585062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6f157c70-b46a-4214-a698-91f3f08ac23f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8994e2e85c64989b6406f5036c4e88f', 'request_id': 'req-6f157c70-b46a-4214-a698-91f3f08ac23f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:10.591652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6f157c70-b46a-4214-a698-91f3f08ac23f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8994e2e85c64989b6406f5036c4e88f', 'request_id': 'req-6f157c70-b46a-4214-a698-91f3f08ac23f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:10.603178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6f157c70-b46a-4214-a698-91f3f08ac23f admin admin] The token cache is being invalidate because project c8994e2e85c64989b6406f5036c4e88f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:43:10.603478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6f157c70-b46a-4214-a698-91f3f08ac23f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:10.604152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6f157c70-b46a-4214-a698-91f3f08ac23f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:10.606153 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3202/6395] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:43:10 2022] DELETE /identity/v3/projects/c8994e2e85c64989b6406f5036c4e88f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:10.610870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788cf60-6627-4483-8f0f-0cffec58dfbe None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:10.611740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788cf60-6627-4483-8f0f-0cffec58dfbe None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:10.612028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788cf60-6627-4483-8f0f-0cffec58dfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:10.632210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9788cf60-6627-4483-8f0f-0cffec58dfbe None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:10.633717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9788cf60-6627-4483-8f0f-0cffec58dfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:10.693673 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3194/6396] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:10.701466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf185a54-958a-4d51-85a2-a2c32bed66f0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:10.701936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf185a54-958a-4d51-85a2-a2c32bed66f0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:10.702297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf185a54-958a-4d51-85a2-a2c32bed66f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:10.721623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-bf185a54-958a-4d51-85a2-a2c32bed66f0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:10.722941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bf185a54-958a-4d51-85a2-a2c32bed66f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:10.732041 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3203/6397] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:10.736027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788cf60-6627-4483-8f0f-0cffec58dfbe None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:10.746712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788cf60-6627-4483-8f0f-0cffec58dfbe None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:10.752191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e73b47-935b-420a-bb97-a5dd25b385d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:10.752900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e73b47-935b-420a-bb97-a5dd25b385d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:10.753243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e73b47-935b-420a-bb97-a5dd25b385d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:10.753504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e73b47-935b-420a-bb97-a5dd25b385d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:10.754294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e73b47-935b-420a-bb97-a5dd25b385d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:43:10.755746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e73b47-935b-420a-bb97-a5dd25b385d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:10.757628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e73b47-935b-420a-bb97-a5dd25b385d9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:10.769586 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3195/6398] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:43:10.773962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf185a54-958a-4d51-85a2-a2c32bed66f0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:10.783272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf185a54-958a-4d51-85a2-a2c32bed66f0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:10.788375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2922fc1-734d-4eb6-95f6-ad02bd794119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:10.789131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2922fc1-734d-4eb6-95f6-ad02bd794119 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:10.789408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2922fc1-734d-4eb6-95f6-ad02bd794119 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:10.789709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2922fc1-734d-4eb6-95f6-ad02bd794119 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:10.790409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2922fc1-734d-4eb6-95f6-ad02bd794119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:10.792335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2922fc1-734d-4eb6-95f6-ad02bd794119 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:10.900842 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3204/6399] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:43:10 2022] POST /identity/v3/projects => generated 367 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:43:10.905128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e73b47-935b-420a-bb97-a5dd25b385d9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:10.916262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e73b47-935b-420a-bb97-a5dd25b385d9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:10.978902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4defb4dc-8731-44e4-9ae0-1ada5fe0e4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:10.979707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defb4dc-8731-44e4-9ae0-1ada5fe0e4d7 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:10.979998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defb4dc-8731-44e4-9ae0-1ada5fe0e4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:10.980277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defb4dc-8731-44e4-9ae0-1ada5fe0e4d7 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:10.981020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4defb4dc-8731-44e4-9ae0-1ada5fe0e4d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:10.983384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4defb4dc-8731-44e4-9ae0-1ada5fe0e4d7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:11.139667 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3196/6400] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:43:10 2022] POST /identity/v3/users => generated 284 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:43:11.141093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2922fc1-734d-4eb6-95f6-ad02bd794119 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:11.152360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2922fc1-734d-4eb6-95f6-ad02bd794119 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:11.157351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0f71c-68d7-4720-b11e-2b771fa4f888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:11.158011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0f71c-68d7-4720-b11e-2b771fa4f888 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:11.158361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0f71c-68d7-4720-b11e-2b771fa4f888 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:11.158721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0f71c-68d7-4720-b11e-2b771fa4f888 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:11.159527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0f71c-68d7-4720-b11e-2b771fa4f888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:11.161270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0f71c-68d7-4720-b11e-2b771fa4f888 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:11.172898 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3205/6401] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:43:11.177208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4defb4dc-8731-44e4-9ae0-1ada5fe0e4d7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:11.190927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4defb4dc-8731-44e4-9ae0-1ada5fe0e4d7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:11.196755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df4da9-ae5c-4fd0-a74f-54271050652a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:11.197619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df4da9-ae5c-4fd0-a74f-54271050652a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:11.198079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df4da9-ae5c-4fd0-a74f-54271050652a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:11.198373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df4da9-ae5c-4fd0-a74f-54271050652a admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:11.199135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df4da9-ae5c-4fd0-a74f-54271050652a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:11.201034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df4da9-ae5c-4fd0-a74f-54271050652a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:11.216032 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3197/6402] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:43:11.217533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0f71c-68d7-4720-b11e-2b771fa4f888 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:11.228056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0f71c-68d7-4720-b11e-2b771fa4f888 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:11.233195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab621f16-65d4-45c0-a847-b67276e8722c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:11.235584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab621f16-65d4-45c0-a847-b67276e8722c admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:11.235584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab621f16-65d4-45c0-a847-b67276e8722c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:11.235584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab621f16-65d4-45c0-a847-b67276e8722c admin admin] PATH_INFO: `/v3/projects/708a81360bb349a1b0ac3f5d20b6133d/users/b6620a5792c048c6a6e9bbe13663a3ed/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:11.250604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab621f16-65d4-45c0-a847-b67276e8722c admin admin] RBAC: Authorizing `identity:create_grant(project_id=708a81360bb349a1b0ac3f5d20b6133d, user_id=b6620a5792c048c6a6e9bbe13663a3ed, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:11.253707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab621f16-65d4-45c0-a847-b67276e8722c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:11.324570 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3206/6403] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:43:11 2022] PUT /identity/v3/projects/708a81360bb349a1b0ac3f5d20b6133d/users/b6620a5792c048c6a6e9bbe13663a3ed/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:11.336948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a405b36-86cf-4d92-86b0-de929cb1ee4e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:11.337243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a405b36-86cf-4d92-86b0-de929cb1ee4e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:11.342617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a405b36-86cf-4d92-86b0-de929cb1ee4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:11.369896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2a405b36-86cf-4d92-86b0-de929cb1ee4e None None] MFA Rules not processed for user `b6620a5792c048c6a6e9bbe13663a3ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:11.371149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2a405b36-86cf-4d92-86b0-de929cb1ee4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:11.437873 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3198/6404] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:11.443467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab621f16-65d4-45c0-a847-b67276e8722c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:11.508516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab621f16-65d4-45c0-a847-b67276e8722c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:11.513271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd620278-e7fc-4984-a1ff-c001e40d7b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:11.513966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd620278-e7fc-4984-a1ff-c001e40d7b55 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:11.514252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd620278-e7fc-4984-a1ff-c001e40d7b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:11.514554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd620278-e7fc-4984-a1ff-c001e40d7b55 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:11.515275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd620278-e7fc-4984-a1ff-c001e40d7b55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:11.517263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd620278-e7fc-4984-a1ff-c001e40d7b55 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:11.635450 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3207/6405] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:43:11 2022] POST /identity/v3/projects => generated 369 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:43:11.639623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a405b36-86cf-4d92-86b0-de929cb1ee4e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:11.650478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a405b36-86cf-4d92-86b0-de929cb1ee4e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:11.706597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797996e-6ea2-4acb-afa0-15972a4c7e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:11.707271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797996e-6ea2-4acb-afa0-15972a4c7e63 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:11.707557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797996e-6ea2-4acb-afa0-15972a4c7e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:11.707845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797996e-6ea2-4acb-afa0-15972a4c7e63 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:11.708526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797996e-6ea2-4acb-afa0-15972a4c7e63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:11.710489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797996e-6ea2-4acb-afa0-15972a4c7e63 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:11.833727 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3199/6406] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:43:11 2022] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:43:11.837435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd620278-e7fc-4984-a1ff-c001e40d7b55 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:11.847637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd620278-e7fc-4984-a1ff-c001e40d7b55 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:11.852623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3460c-93d6-4399-99b1-43693fb4ab28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:11.853287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3460c-93d6-4399-99b1-43693fb4ab28 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:11.853572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3460c-93d6-4399-99b1-43693fb4ab28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:11.853845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3460c-93d6-4399-99b1-43693fb4ab28 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:11.855280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3460c-93d6-4399-99b1-43693fb4ab28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:11.857089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3460c-93d6-4399-99b1-43693fb4ab28 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:11.872030 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3208/6407] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:43:11.873505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797996e-6ea2-4acb-afa0-15972a4c7e63 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:11.891423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797996e-6ea2-4acb-afa0-15972a4c7e63 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:11.896939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40f52d-5fc5-498d-979c-aaaa332b3c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:11.897855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40f52d-5fc5-498d-979c-aaaa332b3c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:11.898143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40f52d-5fc5-498d-979c-aaaa332b3c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:11.898428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40f52d-5fc5-498d-979c-aaaa332b3c30 admin admin] PATH_INFO: `/v3/projects/b03f02d687d24a6493bc2d150cef4242/users/2c2d33243ac64bb98285dc5cff7ba555/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:11.913802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40f52d-5fc5-498d-979c-aaaa332b3c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b03f02d687d24a6493bc2d150cef4242, user_id=2c2d33243ac64bb98285dc5cff7ba555, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:11.916594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40f52d-5fc5-498d-979c-aaaa332b3c30 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:12.008324 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3200/6408] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:43:11 2022] PUT /identity/v3/projects/b03f02d687d24a6493bc2d150cef4242/users/2c2d33243ac64bb98285dc5cff7ba555/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:43:12.012327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3460c-93d6-4399-99b1-43693fb4ab28 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:12.022647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3460c-93d6-4399-99b1-43693fb4ab28 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:12.086936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14829673-8778-4cd9-a7d9-a5e52eb02471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:12.087800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14829673-8778-4cd9-a7d9-a5e52eb02471 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:12.087970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14829673-8778-4cd9-a7d9-a5e52eb02471 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:12.088255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14829673-8778-4cd9-a7d9-a5e52eb02471 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:12.089021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14829673-8778-4cd9-a7d9-a5e52eb02471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:12.090822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14829673-8778-4cd9-a7d9-a5e52eb02471 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:12.101687 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3209/6409] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:43:12.106019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40f52d-5fc5-498d-979c-aaaa332b3c30 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:12.142336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40f52d-5fc5-498d-979c-aaaa332b3c30 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:12.142336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afb1cd-f432-4c43-ab33-b26be75ef19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:12.142336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afb1cd-f432-4c43-ab33-b26be75ef19c admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:12.142336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afb1cd-f432-4c43-ab33-b26be75ef19c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:12.142707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afb1cd-f432-4c43-ab33-b26be75ef19c admin admin] PATH_INFO: `/v3/projects/b03f02d687d24a6493bc2d150cef4242/users/2c2d33243ac64bb98285dc5cff7ba555/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:12.142707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afb1cd-f432-4c43-ab33-b26be75ef19c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b03f02d687d24a6493bc2d150cef4242, user_id=2c2d33243ac64bb98285dc5cff7ba555, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:12.142707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afb1cd-f432-4c43-ab33-b26be75ef19c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:12.154966 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3201/6410] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:43:12 2022] PUT /identity/v3/projects/b03f02d687d24a6493bc2d150cef4242/users/2c2d33243ac64bb98285dc5cff7ba555/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:12.156655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e856b2e-ec64-4b50-8518-8433cecd13d9 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:12.156863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e856b2e-ec64-4b50-8518-8433cecd13d9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:12.157148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e856b2e-ec64-4b50-8518-8433cecd13d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:12.190617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2e856b2e-ec64-4b50-8518-8433cecd13d9 None None] MFA Rules not processed for user `2c2d33243ac64bb98285dc5cff7ba555`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:12.192256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2e856b2e-ec64-4b50-8518-8433cecd13d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:12.274373 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3210/6411] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:12 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:12.282837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afb1cd-f432-4c43-ab33-b26be75ef19c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:12.284557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-87afb1cd-f432-4c43-ab33-b26be75ef19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:12.343300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afb1cd-f432-4c43-ab33-b26be75ef19c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:12.352902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e9e3d-1d48-47b1-8971-cddd41162686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:12.353627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e9e3d-1d48-47b1-8971-cddd41162686 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:12.354187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e9e3d-1d48-47b1-8971-cddd41162686 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:12.354502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e9e3d-1d48-47b1-8971-cddd41162686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:12.365769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e9e3d-1d48-47b1-8971-cddd41162686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:12.367451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e9e3d-1d48-47b1-8971-cddd41162686 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:12.381103 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3202/6412] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:43:12 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:43:20.264527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e856b2e-ec64-4b50-8518-8433cecd13d9 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:20.275775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e856b2e-ec64-4b50-8518-8433cecd13d9 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:20.280352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d2f2a-e958-4f04-a601-54ce08e3d2a0 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c2d33243ac64bb98285dc5cff7ba555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b03f02d687d24a6493bc2d150cef4242', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:20.281214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d2f2a-e958-4f04-a601-54ce08e3d2a0 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:20.281508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d2f2a-e958-4f04-a601-54ce08e3d2a0 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:20.281793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d2f2a-e958-4f04-a601-54ce08e3d2a0 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:20.282540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d2f2a-e958-4f04-a601-54ce08e3d2a0 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:43:20.282859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d2f2a-e958-4f04-a601-54ce08e3d2a0 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:20.284461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d2f2a-e958-4f04-a601-54ce08e3d2a0 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:20.296549 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3211/6413] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:43:20.300829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e9e3d-1d48-47b1-8971-cddd41162686 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:20.310032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e9e3d-1d48-47b1-8971-cddd41162686 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:20.315555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcbfb1-6521-4200-951f-4108c3672bb2 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c2d33243ac64bb98285dc5cff7ba555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b03f02d687d24a6493bc2d150cef4242', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:20.316240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcbfb1-6521-4200-951f-4108c3672bb2 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:20.316951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcbfb1-6521-4200-951f-4108c3672bb2 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:20.317397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcbfb1-6521-4200-951f-4108c3672bb2 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:20.318880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcbfb1-6521-4200-951f-4108c3672bb2 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:20.330694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcbfb1-6521-4200-951f-4108c3672bb2 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:20.457856 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3203/6414] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:43:20 2022] POST /identity/v3/projects => generated 348 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:43:20.460003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d2f2a-e958-4f04-a601-54ce08e3d2a0 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:20.470165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d2f2a-e958-4f04-a601-54ce08e3d2a0 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:20.526103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90296c2c-538b-45e5-b0e3-7ff0be85349d tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c2d33243ac64bb98285dc5cff7ba555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b03f02d687d24a6493bc2d150cef4242', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:20.526810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90296c2c-538b-45e5-b0e3-7ff0be85349d tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:20.527110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90296c2c-538b-45e5-b0e3-7ff0be85349d tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:20.527410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90296c2c-538b-45e5-b0e3-7ff0be85349d tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:20.528250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90296c2c-538b-45e5-b0e3-7ff0be85349d tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:43:20.528647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90296c2c-538b-45e5-b0e3-7ff0be85349d tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:20.530236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90296c2c-538b-45e5-b0e3-7ff0be85349d tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:20.542490 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3212/6415] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:43:21.256869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcbfb1-6521-4200-951f-4108c3672bb2 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:21.267370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcbfb1-6521-4200-951f-4108c3672bb2 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:21.272485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16aa76-edac-4a95-b80b-99b80c908917 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c2d33243ac64bb98285dc5cff7ba555', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b03f02d687d24a6493bc2d150cef4242', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:21.273463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16aa76-edac-4a95-b80b-99b80c908917 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:21.273781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16aa76-edac-4a95-b80b-99b80c908917 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:21.274094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16aa76-edac-4a95-b80b-99b80c908917 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] PATH_INFO: `/v3/projects/9528f5f086a74dada902f139d97d657f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:21.275281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16aa76-edac-4a95-b80b-99b80c908917 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9528f5f086a74dada902f139d97d657f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:21.277319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16aa76-edac-4a95-b80b-99b80c908917 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:21.368941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0c16aa76-edac-4a95-b80b-99b80c908917 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9528f5f086a74dada902f139d97d657f', 'request_id': 'req-0c16aa76-edac-4a95-b80b-99b80c908917'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:21.374933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0c16aa76-edac-4a95-b80b-99b80c908917 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9528f5f086a74dada902f139d97d657f', 'request_id': 'req-0c16aa76-edac-4a95-b80b-99b80c908917'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:21.459318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0c16aa76-edac-4a95-b80b-99b80c908917 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9528f5f086a74dada902f139d97d657f', 'request_id': 'req-0c16aa76-edac-4a95-b80b-99b80c908917'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:21.470541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0c16aa76-edac-4a95-b80b-99b80c908917 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] The token cache is being invalidate because project 9528f5f086a74dada902f139d97d657f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:43:21.470839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0c16aa76-edac-4a95-b80b-99b80c908917 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:21.471577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0c16aa76-edac-4a95-b80b-99b80c908917 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:21.473193 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3204/6416] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:43:21 2022] DELETE /identity/v3/projects/9528f5f086a74dada902f139d97d657f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:21.484331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90296c2c-538b-45e5-b0e3-7ff0be85349d tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:21.486062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-90296c2c-538b-45e5-b0e3-7ff0be85349d tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:21.542225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90296c2c-538b-45e5-b0e3-7ff0be85349d tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:21.589284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f0759-0efc-4516-b5d7-e47bdf281b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:21.589932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f0759-0efc-4516-b5d7-e47bdf281b42 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:21.590221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f0759-0efc-4516-b5d7-e47bdf281b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:21.590523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f0759-0efc-4516-b5d7-e47bdf281b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:21.592279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8d4f0759-0efc-4516-b5d7-e47bdf281b42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:21.648356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f0759-0efc-4516-b5d7-e47bdf281b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:21.649832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f0759-0efc-4516-b5d7-e47bdf281b42 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:21.658543 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3213/6417] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:43:21 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:43:39.070061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16aa76-edac-4a95-b80b-99b80c908917 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:39.082536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16aa76-edac-4a95-b80b-99b80c908917 tempest-RoutersAdminTest-1182585436 tempest-RoutersAdminTest-1182585436-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:39.087084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554ac78-0c2c-4089-b8a8-1fc0b8e78465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:39.087841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554ac78-0c2c-4089-b8a8-1fc0b8e78465 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:39.088196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554ac78-0c2c-4089-b8a8-1fc0b8e78465 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:39.088547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554ac78-0c2c-4089-b8a8-1fc0b8e78465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:39.090621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d554ac78-0c2c-4089-b8a8-1fc0b8e78465 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:39.173235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554ac78-0c2c-4089-b8a8-1fc0b8e78465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:39.175679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554ac78-0c2c-4089-b8a8-1fc0b8e78465 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:39.188482 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3205/6418] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:43:40.139034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f0759-0efc-4516-b5d7-e47bdf281b42 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:40.140482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8d4f0759-0efc-4516-b5d7-e47bdf281b42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:40.155013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f0759-0efc-4516-b5d7-e47bdf281b42 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:40.159710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa70a1-d386-4350-a0a0-04f6ba3e5462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:40.160580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa70a1-d386-4350-a0a0-04f6ba3e5462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:40.160955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa70a1-d386-4350-a0a0-04f6ba3e5462 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:40.161576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa70a1-d386-4350-a0a0-04f6ba3e5462 admin admin] PATH_INFO: `/v3/users/9e063a35d92e45a5808790d6eb4f33dc` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:40.163361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa70a1-d386-4350-a0a0-04f6ba3e5462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e063a35d92e45a5808790d6eb4f33dc)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:40.165314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa70a1-d386-4350-a0a0-04f6ba3e5462 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:40.402886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-93fa70a1-d386-4350-a0a0-04f6ba3e5462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e063a35d92e45a5808790d6eb4f33dc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:40.420299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-93fa70a1-d386-4350-a0a0-04f6ba3e5462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e063a35d92e45a5808790d6eb4f33dc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:40.421493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-93fa70a1-d386-4350-a0a0-04f6ba3e5462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e063a35d92e45a5808790d6eb4f33dc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:40.430710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-93fa70a1-d386-4350-a0a0-04f6ba3e5462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e063a35d92e45a5808790d6eb4f33dc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:40.524383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-93fa70a1-d386-4350-a0a0-04f6ba3e5462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e063a35d92e45a5808790d6eb4f33dc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:40.531187 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3214/6419] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:43:40 2022] DELETE /identity/v3/users/9e063a35d92e45a5808790d6eb4f33dc => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:40.535945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e1739-4971-42bf-a12a-ef81f82e3e5e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:40.541844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e1739-4971-42bf-a12a-ef81f82e3e5e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:40.541844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e1739-4971-42bf-a12a-ef81f82e3e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:40.554943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-043e1739-4971-42bf-a12a-ef81f82e3e5e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:40.556308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-043e1739-4971-42bf-a12a-ef81f82e3e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:40.665008 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3206/6420] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:40.674735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa70a1-d386-4350-a0a0-04f6ba3e5462 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:40.676269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-93fa70a1-d386-4350-a0a0-04f6ba3e5462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:40.750386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa70a1-d386-4350-a0a0-04f6ba3e5462 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:40.754497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc48232-de1f-413f-ba72-5c32e92311fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:40.755266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc48232-de1f-413f-ba72-5c32e92311fd service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:40.755618 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc48232-de1f-413f-ba72-5c32e92311fd service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:40.755968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc48232-de1f-413f-ba72-5c32e92311fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:40.766097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc48232-de1f-413f-ba72-5c32e92311fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:40.775803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc48232-de1f-413f-ba72-5c32e92311fd service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:40.779781 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3215/6421] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:43:41.700347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e1739-4971-42bf-a12a-ef81f82e3e5e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:41.701929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-043e1739-4971-42bf-a12a-ef81f82e3e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:41.718488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e1739-4971-42bf-a12a-ef81f82e3e5e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:41.734888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d178730-cfd8-44f7-a581-76ffb5921c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:41.736169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d178730-cfd8-44f7-a581-76ffb5921c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:41.736762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d178730-cfd8-44f7-a581-76ffb5921c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:41.737256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d178730-cfd8-44f7-a581-76ffb5921c8d admin admin] PATH_INFO: `/v3/projects/40050853f73b4da6a3720799307dded5` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:41.739076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d178730-cfd8-44f7-a581-76ffb5921c8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=40050853f73b4da6a3720799307dded5)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:41.744080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d178730-cfd8-44f7-a581-76ffb5921c8d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:41.891010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2d178730-cfd8-44f7-a581-76ffb5921c8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40050853f73b4da6a3720799307dded5', 'request_id': 'req-2d178730-cfd8-44f7-a581-76ffb5921c8d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:41.898185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2d178730-cfd8-44f7-a581-76ffb5921c8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40050853f73b4da6a3720799307dded5', 'request_id': 'req-2d178730-cfd8-44f7-a581-76ffb5921c8d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:41.981488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2d178730-cfd8-44f7-a581-76ffb5921c8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40050853f73b4da6a3720799307dded5', 'request_id': 'req-2d178730-cfd8-44f7-a581-76ffb5921c8d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:41.997348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2d178730-cfd8-44f7-a581-76ffb5921c8d admin admin] The token cache is being invalidate because project 40050853f73b4da6a3720799307dded5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:43:41.997781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2d178730-cfd8-44f7-a581-76ffb5921c8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:41.998902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2d178730-cfd8-44f7-a581-76ffb5921c8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:42.007399 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3207/6422] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:43:41 2022] DELETE /identity/v3/projects/40050853f73b4da6a3720799307dded5 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:42.008554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc48232-de1f-413f-ba72-5c32e92311fd service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:42.024558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc48232-de1f-413f-ba72-5c32e92311fd service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:42.162983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40204f05-6bda-4f2b-987e-426ffdeaf31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:42.164958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40204f05-6bda-4f2b-987e-426ffdeaf31f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:42.165445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40204f05-6bda-4f2b-987e-426ffdeaf31f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:42.165887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40204f05-6bda-4f2b-987e-426ffdeaf31f admin admin] PATH_INFO: `/v3/users/2529343a03254787bbfcf182a8f9ca03` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:42.168091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40204f05-6bda-4f2b-987e-426ffdeaf31f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2529343a03254787bbfcf182a8f9ca03)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:42.172922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40204f05-6bda-4f2b-987e-426ffdeaf31f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:42.428808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-40204f05-6bda-4f2b-987e-426ffdeaf31f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2529343a03254787bbfcf182a8f9ca03'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:42.446922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-40204f05-6bda-4f2b-987e-426ffdeaf31f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2529343a03254787bbfcf182a8f9ca03'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:42.448788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-40204f05-6bda-4f2b-987e-426ffdeaf31f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2529343a03254787bbfcf182a8f9ca03'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:42.460925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-40204f05-6bda-4f2b-987e-426ffdeaf31f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2529343a03254787bbfcf182a8f9ca03'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:42.532328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-40204f05-6bda-4f2b-987e-426ffdeaf31f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2529343a03254787bbfcf182a8f9ca03'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:42.543253 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3216/6423] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:43:42 2022] DELETE /identity/v3/users/2529343a03254787bbfcf182a8f9ca03 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:43.787325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d178730-cfd8-44f7-a581-76ffb5921c8d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:43.789048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2d178730-cfd8-44f7-a581-76ffb5921c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:43.834543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d178730-cfd8-44f7-a581-76ffb5921c8d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:43.923652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0d4c8-6b6d-4563-b246-c90c60a0ffcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:43.924891 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0d4c8-6b6d-4563-b246-c90c60a0ffcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:43.925396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0d4c8-6b6d-4563-b246-c90c60a0ffcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:43.925979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0d4c8-6b6d-4563-b246-c90c60a0ffcd admin admin] PATH_INFO: `/v3/projects/b054ddfd37204cd08734adcf05d4a153` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:43.927655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0d4c8-6b6d-4563-b246-c90c60a0ffcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b054ddfd37204cd08734adcf05d4a153)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:43.932815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0d4c8-6b6d-4563-b246-c90c60a0ffcd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:44.135788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d4f0d4c8-6b6d-4563-b246-c90c60a0ffcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b054ddfd37204cd08734adcf05d4a153', 'request_id': 'req-d4f0d4c8-6b6d-4563-b246-c90c60a0ffcd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:44.147023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d4f0d4c8-6b6d-4563-b246-c90c60a0ffcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b054ddfd37204cd08734adcf05d4a153', 'request_id': 'req-d4f0d4c8-6b6d-4563-b246-c90c60a0ffcd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:44.196423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d4f0d4c8-6b6d-4563-b246-c90c60a0ffcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b054ddfd37204cd08734adcf05d4a153', 'request_id': 'req-d4f0d4c8-6b6d-4563-b246-c90c60a0ffcd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:44.210424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d4f0d4c8-6b6d-4563-b246-c90c60a0ffcd admin admin] The token cache is being invalidate because project b054ddfd37204cd08734adcf05d4a153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:43:44.211156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d4f0d4c8-6b6d-4563-b246-c90c60a0ffcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:44.212104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d4f0d4c8-6b6d-4563-b246-c90c60a0ffcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:44.218528 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3208/6424] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:43:43 2022] DELETE /identity/v3/projects/b054ddfd37204cd08734adcf05d4a153 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:44.220348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdd648-52c2-423d-bd0d-54347accf706 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:44.220872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdd648-52c2-423d-bd0d-54347accf706 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:44.221096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdd648-52c2-423d-bd0d-54347accf706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:44.253268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-35bdd648-52c2-423d-bd0d-54347accf706 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:44.259340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-35bdd648-52c2-423d-bd0d-54347accf706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:44.399773 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3217/6425] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:44.409840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4fdd7-6866-4b73-bcf5-4438efce01f6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:44.410142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4fdd7-6866-4b73-bcf5-4438efce01f6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:44.410425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4fdd7-6866-4b73-bcf5-4438efce01f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:44.440856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-50a4fdd7-6866-4b73-bcf5-4438efce01f6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:44.440856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-50a4fdd7-6866-4b73-bcf5-4438efce01f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:44.451332 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3209/6426] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:44.452425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdd648-52c2-423d-bd0d-54347accf706 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:44.463980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdd648-52c2-423d-bd0d-54347accf706 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:44.470952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d612f-cc07-41ee-bead-6c521fa7bc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:44.472080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d612f-cc07-41ee-bead-6c521fa7bc0c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:44.472638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d612f-cc07-41ee-bead-6c521fa7bc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:44.473131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d612f-cc07-41ee-bead-6c521fa7bc0c admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:44.474180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d612f-cc07-41ee-bead-6c521fa7bc0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:43:44.475811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d612f-cc07-41ee-bead-6c521fa7bc0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:44.477707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d612f-cc07-41ee-bead-6c521fa7bc0c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:44.503758 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3218/6427] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:43:44.509071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4fdd7-6866-4b73-bcf5-4438efce01f6 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:44.526794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4fdd7-6866-4b73-bcf5-4438efce01f6 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:44.532961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6395e-6efa-4e23-8167-421ede9196b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:44.534298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6395e-6efa-4e23-8167-421ede9196b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:44.534689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6395e-6efa-4e23-8167-421ede9196b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:44.535046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6395e-6efa-4e23-8167-421ede9196b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:44.536041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6395e-6efa-4e23-8167-421ede9196b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:44.538456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6395e-6efa-4e23-8167-421ede9196b4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:44.639677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d612f-cc07-41ee-bead-6c521fa7bc0c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:44.640239 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3210/6428] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:43:44 2022] POST /identity/v3/projects => generated 363 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:43:44.659072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d612f-cc07-41ee-bead-6c521fa7bc0c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:44.753529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25314196-5d5d-46c6-9647-b5491f383b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:44.754223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25314196-5d5d-46c6-9647-b5491f383b61 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:44.754511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25314196-5d5d-46c6-9647-b5491f383b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:44.754907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25314196-5d5d-46c6-9647-b5491f383b61 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:44.755724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25314196-5d5d-46c6-9647-b5491f383b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:44.757957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25314196-5d5d-46c6-9647-b5491f383b61 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:44.884394 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3219/6429] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:43:44 2022] POST /identity/v3/users => generated 282 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:43:44.888688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6395e-6efa-4e23-8167-421ede9196b4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:44.900136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6395e-6efa-4e23-8167-421ede9196b4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:44.906976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477180c7-4bc7-4c8e-b942-e6cd5e4e2731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:44.907960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477180c7-4bc7-4c8e-b942-e6cd5e4e2731 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:44.908988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477180c7-4bc7-4c8e-b942-e6cd5e4e2731 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:44.909438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477180c7-4bc7-4c8e-b942-e6cd5e4e2731 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:44.910359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477180c7-4bc7-4c8e-b942-e6cd5e4e2731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:44.913746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477180c7-4bc7-4c8e-b942-e6cd5e4e2731 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:44.951557 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3211/6430] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:43:44.955655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25314196-5d5d-46c6-9647-b5491f383b61 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:44.966748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25314196-5d5d-46c6-9647-b5491f383b61 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:44.979199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96512578-cd45-4c65-8850-daad9e245b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:44.979199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96512578-cd45-4c65-8850-daad9e245b0a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:44.979199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96512578-cd45-4c65-8850-daad9e245b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:44.979199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96512578-cd45-4c65-8850-daad9e245b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:44.979771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96512578-cd45-4c65-8850-daad9e245b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:44.979771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96512578-cd45-4c65-8850-daad9e245b0a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:44.994591 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3220/6431] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:43:44.996244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477180c7-4bc7-4c8e-b942-e6cd5e4e2731 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:45.012846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477180c7-4bc7-4c8e-b942-e6cd5e4e2731 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:45.019473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314007d-4bb7-4ac4-bb4b-399113f60070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:45.020992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314007d-4bb7-4ac4-bb4b-399113f60070 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:45.021530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314007d-4bb7-4ac4-bb4b-399113f60070 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:45.022537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314007d-4bb7-4ac4-bb4b-399113f60070 admin admin] PATH_INFO: `/v3/projects/702537f018764473aab43d6c4e66b764/users/ec9a3aecb3ee456d9831df8f7c8bbead/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:45.055872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8314007d-4bb7-4ac4-bb4b-399113f60070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=702537f018764473aab43d6c4e66b764, user_id=ec9a3aecb3ee456d9831df8f7c8bbead, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:45.074644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8314007d-4bb7-4ac4-bb4b-399113f60070 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:45.182225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd385333-55b2-48fd-9c2c-83a5baf96a36 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:45.182450 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3212/6432] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:43:44 2022] PUT /identity/v3/projects/702537f018764473aab43d6c4e66b764/users/ec9a3aecb3ee456d9831df8f7c8bbead/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:45.182966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd385333-55b2-48fd-9c2c-83a5baf96a36 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:45.183256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd385333-55b2-48fd-9c2c-83a5baf96a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:45.218085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-bd385333-55b2-48fd-9c2c-83a5baf96a36 None None] MFA Rules not processed for user `ec9a3aecb3ee456d9831df8f7c8bbead`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:45.219956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bd385333-55b2-48fd-9c2c-83a5baf96a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:45.328471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314007d-4bb7-4ac4-bb4b-399113f60070 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:45.329747 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3221/6433] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:45 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:45.490010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314007d-4bb7-4ac4-bb4b-399113f60070 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:45.512296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd401095-8876-401d-b5e5-05c5af1ee68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:45.512296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd401095-8876-401d-b5e5-05c5af1ee68d admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:45.512296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd401095-8876-401d-b5e5-05c5af1ee68d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:45.512296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd401095-8876-401d-b5e5-05c5af1ee68d admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:45.512896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd401095-8876-401d-b5e5-05c5af1ee68d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:45.517215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd401095-8876-401d-b5e5-05c5af1ee68d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:45.651565 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3213/6434] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:43:45 2022] POST /identity/v3/projects => generated 363 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:43:45.655488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd385333-55b2-48fd-9c2c-83a5baf96a36 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:45.685702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd385333-55b2-48fd-9c2c-83a5baf96a36 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:45.783328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb94e72-5cc9-4a56-9ef4-cab05781d31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:45.784026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb94e72-5cc9-4a56-9ef4-cab05781d31d admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:45.784315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb94e72-5cc9-4a56-9ef4-cab05781d31d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:45.784587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb94e72-5cc9-4a56-9ef4-cab05781d31d admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:45.785324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb94e72-5cc9-4a56-9ef4-cab05781d31d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:45.789919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb94e72-5cc9-4a56-9ef4-cab05781d31d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:45.897138 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3222/6435] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:43:45 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:43:45.903913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd401095-8876-401d-b5e5-05c5af1ee68d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:45.919529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd401095-8876-401d-b5e5-05c5af1ee68d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:45.935805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7baf4bb-1a9b-4c49-8023-1ae9cc53ad39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:45.939467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7baf4bb-1a9b-4c49-8023-1ae9cc53ad39 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:45.939929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7baf4bb-1a9b-4c49-8023-1ae9cc53ad39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:45.940382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7baf4bb-1a9b-4c49-8023-1ae9cc53ad39 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:45.941411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7baf4bb-1a9b-4c49-8023-1ae9cc53ad39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:45.944756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7baf4bb-1a9b-4c49-8023-1ae9cc53ad39 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:45.963222 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3214/6436] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:43:45.966317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb94e72-5cc9-4a56-9ef4-cab05781d31d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:45.986707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb94e72-5cc9-4a56-9ef4-cab05781d31d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:45.997221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ec8f0-9406-4a67-9663-c456c3d0218a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:46.001122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ec8f0-9406-4a67-9663-c456c3d0218a admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:46.001696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ec8f0-9406-4a67-9663-c456c3d0218a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:46.002069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ec8f0-9406-4a67-9663-c456c3d0218a admin admin] PATH_INFO: `/v3/projects/b7d975b6d21848f8a6cbb95a960b9002/users/3575953dc5834d43a22d844346ec188c/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:46.038189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ec8f0-9406-4a67-9663-c456c3d0218a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d975b6d21848f8a6cbb95a960b9002, user_id=3575953dc5834d43a22d844346ec188c, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:46.042543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ec8f0-9406-4a67-9663-c456c3d0218a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:46.242087 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3223/6437] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:43:45 2022] PUT /identity/v3/projects/b7d975b6d21848f8a6cbb95a960b9002/users/3575953dc5834d43a22d844346ec188c/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:46.246513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7baf4bb-1a9b-4c49-8023-1ae9cc53ad39 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:46.257908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7baf4bb-1a9b-4c49-8023-1ae9cc53ad39 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:46.328804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce33145-5803-4464-974b-0d10f0001d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:46.329715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce33145-5803-4464-974b-0d10f0001d37 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:46.330125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce33145-5803-4464-974b-0d10f0001d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:46.330480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce33145-5803-4464-974b-0d10f0001d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:46.331338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce33145-5803-4464-974b-0d10f0001d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:46.333153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce33145-5803-4464-974b-0d10f0001d37 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:46.345270 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3215/6438] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:43:46.350987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ec8f0-9406-4a67-9663-c456c3d0218a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:46.362356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ec8f0-9406-4a67-9663-c456c3d0218a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:46.368199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1e3b6-90c3-4c59-b0b2-4f03094ffead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:46.369166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1e3b6-90c3-4c59-b0b2-4f03094ffead admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:46.369610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1e3b6-90c3-4c59-b0b2-4f03094ffead admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:46.369901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1e3b6-90c3-4c59-b0b2-4f03094ffead admin admin] PATH_INFO: `/v3/projects/b7d975b6d21848f8a6cbb95a960b9002/users/3575953dc5834d43a22d844346ec188c/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:46.372476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1e3b6-90c3-4c59-b0b2-4f03094ffead admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d975b6d21848f8a6cbb95a960b9002, user_id=3575953dc5834d43a22d844346ec188c, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:46.375557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1e3b6-90c3-4c59-b0b2-4f03094ffead admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:46.387773 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3224/6439] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:43:46 2022] PUT /identity/v3/projects/b7d975b6d21848f8a6cbb95a960b9002/users/3575953dc5834d43a22d844346ec188c/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:46.400160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a726e-5ba8-455c-b108-271141ef6254 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:46.400765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a726e-5ba8-455c-b108-271141ef6254 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:46.401061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a726e-5ba8-455c-b108-271141ef6254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:46.435448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-871a726e-5ba8-455c-b108-271141ef6254 None None] MFA Rules not processed for user `3575953dc5834d43a22d844346ec188c`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:46.437570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-871a726e-5ba8-455c-b108-271141ef6254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:46.535591 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3216/6440] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:46 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:46.547010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1e3b6-90c3-4c59-b0b2-4f03094ffead admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:46.548964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8dc1e3b6-90c3-4c59-b0b2-4f03094ffead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:46.697545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1e3b6-90c3-4c59-b0b2-4f03094ffead admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:46.704530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5eb4f3-69da-47ac-ae5d-857bf2e16cdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:46.706484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5eb4f3-69da-47ac-ae5d-857bf2e16cdf service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:46.706484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5eb4f3-69da-47ac-ae5d-857bf2e16cdf service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:46.706484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5eb4f3-69da-47ac-ae5d-857bf2e16cdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:46.719263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5eb4f3-69da-47ac-ae5d-857bf2e16cdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:46.721877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5eb4f3-69da-47ac-ae5d-857bf2e16cdf service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:46.733679 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3225/6441] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:43:46 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:43:46.971834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a726e-5ba8-455c-b108-271141ef6254 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:47.030180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a726e-5ba8-455c-b108-271141ef6254 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:47.048926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1f502-3ed6-43a1-ace4-3d34cf3d1177 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:47.048926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1f502-3ed6-43a1-ace4-3d34cf3d1177 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:47.048926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1f502-3ed6-43a1-ace4-3d34cf3d1177 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:47.048926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1f502-3ed6-43a1-ace4-3d34cf3d1177 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:47.066816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c703f97-8e94-4813-9ed6-14a623a3289b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:47.067110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c703f97-8e94-4813-9ed6-14a623a3289b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:47.067397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c703f97-8e94-4813-9ed6-14a623a3289b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:47.087496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-7c703f97-8e94-4813-9ed6-14a623a3289b None None] MFA Rules not processed for user `26723e7d6f3d44a4951432f45c89021a`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:47.088767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7c703f97-8e94-4813-9ed6-14a623a3289b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:47.116923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1f502-3ed6-43a1-ace4-3d34cf3d1177 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:47.119207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1f502-3ed6-43a1-ace4-3d34cf3d1177 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:47.129169 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3217/6442] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:43:46 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:43:47.169582 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3226/6443] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:43:51.102227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1f502-3ed6-43a1-ace4-3d34cf3d1177 service cinder] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:51.275641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1f502-3ed6-43a1-ace4-3d34cf3d1177 service cinder] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:51.287890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce95af-0d65-434c-a13a-741cc25eace0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:51.295151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce95af-0d65-434c-a13a-741cc25eace0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:51.295481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce95af-0d65-434c-a13a-741cc25eace0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:51.295771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce95af-0d65-434c-a13a-741cc25eace0 admin admin] PATH_INFO: `/v3/users/ec9a3aecb3ee456d9831df8f7c8bbead` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:51.298437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce95af-0d65-434c-a13a-741cc25eace0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec9a3aecb3ee456d9831df8f7c8bbead)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:51.300648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce95af-0d65-434c-a13a-741cc25eace0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:51.551397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-15ce95af-0d65-434c-a13a-741cc25eace0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec9a3aecb3ee456d9831df8f7c8bbead'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:51.584896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-15ce95af-0d65-434c-a13a-741cc25eace0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec9a3aecb3ee456d9831df8f7c8bbead'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:51.586811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-15ce95af-0d65-434c-a13a-741cc25eace0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec9a3aecb3ee456d9831df8f7c8bbead'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:51.605136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-15ce95af-0d65-434c-a13a-741cc25eace0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec9a3aecb3ee456d9831df8f7c8bbead'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:51.752826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-15ce95af-0d65-434c-a13a-741cc25eace0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec9a3aecb3ee456d9831df8f7c8bbead'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:51.766607 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3218/6444] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:43:51 2022] DELETE /identity/v3/users/ec9a3aecb3ee456d9831df8f7c8bbead => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:51.768338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864a184-724c-460a-a50e-b8a096c179a9 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:51.768833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864a184-724c-460a-a50e-b8a096c179a9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:51.768962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864a184-724c-460a-a50e-b8a096c179a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:51.788347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0864a184-724c-460a-a50e-b8a096c179a9 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:51.789709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0864a184-724c-460a-a50e-b8a096c179a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:51.865732 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3227/6445] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:51.887560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce95af-0d65-434c-a13a-741cc25eace0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:51.889143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-15ce95af-0d65-434c-a13a-741cc25eace0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:51.976826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce95af-0d65-434c-a13a-741cc25eace0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:51.986529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632775b-df66-4f7a-8ecf-c3a1dc3c5c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:51.987800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632775b-df66-4f7a-8ecf-c3a1dc3c5c7b service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:51.988190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632775b-df66-4f7a-8ecf-c3a1dc3c5c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:51.988577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632775b-df66-4f7a-8ecf-c3a1dc3c5c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:52.008780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632775b-df66-4f7a-8ecf-c3a1dc3c5c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:52.013923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632775b-df66-4f7a-8ecf-c3a1dc3c5c7b service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:52.026766 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3219/6446] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:43:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:43:53.314253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864a184-724c-460a-a50e-b8a096c179a9 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:53.315725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0864a184-724c-460a-a50e-b8a096c179a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:53.327985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864a184-724c-460a-a50e-b8a096c179a9 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:53.334042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2155c-04ce-4840-a7fd-0070b472c5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:53.335451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2155c-04ce-4840-a7fd-0070b472c5c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:53.335909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2155c-04ce-4840-a7fd-0070b472c5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:53.336193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2155c-04ce-4840-a7fd-0070b472c5c7 admin admin] PATH_INFO: `/v3/projects/702537f018764473aab43d6c4e66b764` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:53.341510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2155c-04ce-4840-a7fd-0070b472c5c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=702537f018764473aab43d6c4e66b764)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:53.343397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2155c-04ce-4840-a7fd-0070b472c5c7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:53.508269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-20a2155c-04ce-4840-a7fd-0070b472c5c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '702537f018764473aab43d6c4e66b764', 'request_id': 'req-20a2155c-04ce-4840-a7fd-0070b472c5c7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:53.593113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-20a2155c-04ce-4840-a7fd-0070b472c5c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '702537f018764473aab43d6c4e66b764', 'request_id': 'req-20a2155c-04ce-4840-a7fd-0070b472c5c7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:53.601487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-20a2155c-04ce-4840-a7fd-0070b472c5c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '702537f018764473aab43d6c4e66b764', 'request_id': 'req-20a2155c-04ce-4840-a7fd-0070b472c5c7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:53.615593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-20a2155c-04ce-4840-a7fd-0070b472c5c7 admin admin] The token cache is being invalidate because project 702537f018764473aab43d6c4e66b764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:43:53.615984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-20a2155c-04ce-4840-a7fd-0070b472c5c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:53.616630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-20a2155c-04ce-4840-a7fd-0070b472c5c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:53.621502 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3228/6447] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:43:53 2022] DELETE /identity/v3/projects/702537f018764473aab43d6c4e66b764 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:53.622966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632775b-df66-4f7a-8ecf-c3a1dc3c5c7b service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:53.635627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632775b-df66-4f7a-8ecf-c3a1dc3c5c7b service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:53.702126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f89c5-e7a1-40cf-b319-a748eebef4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:53.703118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f89c5-e7a1-40cf-b319-a748eebef4d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:53.703405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f89c5-e7a1-40cf-b319-a748eebef4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:53.703934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f89c5-e7a1-40cf-b319-a748eebef4d2 admin admin] PATH_INFO: `/v3/users/3575953dc5834d43a22d844346ec188c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:53.705205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f89c5-e7a1-40cf-b319-a748eebef4d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3575953dc5834d43a22d844346ec188c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:53.707192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f89c5-e7a1-40cf-b319-a748eebef4d2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:53.870066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2f6f89c5-e7a1-40cf-b319-a748eebef4d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3575953dc5834d43a22d844346ec188c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:53.884792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2f6f89c5-e7a1-40cf-b319-a748eebef4d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3575953dc5834d43a22d844346ec188c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:53.894226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2f6f89c5-e7a1-40cf-b319-a748eebef4d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3575953dc5834d43a22d844346ec188c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:53.894226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2f6f89c5-e7a1-40cf-b319-a748eebef4d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3575953dc5834d43a22d844346ec188c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:54.003487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2f6f89c5-e7a1-40cf-b319-a748eebef4d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3575953dc5834d43a22d844346ec188c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:54.008752 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3220/6448] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:43:53 2022] DELETE /identity/v3/users/3575953dc5834d43a22d844346ec188c => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:54.999599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2155c-04ce-4840-a7fd-0070b472c5c7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:55.002337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-20a2155c-04ce-4840-a7fd-0070b472c5c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:55.028377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2155c-04ce-4840-a7fd-0070b472c5c7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:55.169718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5463f-4e09-4787-8cdf-84de90058d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:55.176097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5463f-4e09-4787-8cdf-84de90058d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:55.176097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5463f-4e09-4787-8cdf-84de90058d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:55.176097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5463f-4e09-4787-8cdf-84de90058d7a admin admin] PATH_INFO: `/v3/projects/b7d975b6d21848f8a6cbb95a960b9002` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:55.179335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5463f-4e09-4787-8cdf-84de90058d7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7d975b6d21848f8a6cbb95a960b9002)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:55.183281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5463f-4e09-4787-8cdf-84de90058d7a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:55.327533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dbe5463f-4e09-4787-8cdf-84de90058d7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7d975b6d21848f8a6cbb95a960b9002', 'request_id': 'req-dbe5463f-4e09-4787-8cdf-84de90058d7a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:55.458029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dbe5463f-4e09-4787-8cdf-84de90058d7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7d975b6d21848f8a6cbb95a960b9002', 'request_id': 'req-dbe5463f-4e09-4787-8cdf-84de90058d7a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:55.475272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dbe5463f-4e09-4787-8cdf-84de90058d7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7d975b6d21848f8a6cbb95a960b9002', 'request_id': 'req-dbe5463f-4e09-4787-8cdf-84de90058d7a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:55.522203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dbe5463f-4e09-4787-8cdf-84de90058d7a admin admin] The token cache is being invalidate because project b7d975b6d21848f8a6cbb95a960b9002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:43:55.522694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dbe5463f-4e09-4787-8cdf-84de90058d7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:55.523629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dbe5463f-4e09-4787-8cdf-84de90058d7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:55.525896 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3229/6449] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:43:54 2022] DELETE /identity/v3/projects/b7d975b6d21848f8a6cbb95a960b9002 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:55.537673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db38704-69e0-4d98-a5fa-746215c46fb8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:55.538513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db38704-69e0-4d98-a5fa-746215c46fb8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:55.539047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db38704-69e0-4d98-a5fa-746215c46fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:55.564549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-1db38704-69e0-4d98-a5fa-746215c46fb8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:55.565999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1db38704-69e0-4d98-a5fa-746215c46fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:55.636745 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3221/6450] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:55.736736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9141419-4c85-4461-8945-747d1f04b752 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:55.737313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9141419-4c85-4461-8945-747d1f04b752 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:55.737770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9141419-4c85-4461-8945-747d1f04b752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:55.759104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f9141419-4c85-4461-8945-747d1f04b752 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:55.760689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f9141419-4c85-4461-8945-747d1f04b752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:55.770129 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3230/6451] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:55.775116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db38704-69e0-4d98-a5fa-746215c46fb8 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:55.785061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db38704-69e0-4d98-a5fa-746215c46fb8 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:55.792889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7accd1-10b3-47ff-af54-7a36f4c97021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:55.794339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7accd1-10b3-47ff-af54-7a36f4c97021 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:55.794860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7accd1-10b3-47ff-af54-7a36f4c97021 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:55.795500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7accd1-10b3-47ff-af54-7a36f4c97021 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:55.797262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7accd1-10b3-47ff-af54-7a36f4c97021 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:43:55.797802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7accd1-10b3-47ff-af54-7a36f4c97021 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:55.800405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7accd1-10b3-47ff-af54-7a36f4c97021 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:55.819694 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3222/6452] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:43:55.824070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9141419-4c85-4461-8945-747d1f04b752 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:55.834936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9141419-4c85-4461-8945-747d1f04b752 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:55.839924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fde55-c8cb-4e31-b107-4b075f2a5479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:55.840841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fde55-c8cb-4e31-b107-4b075f2a5479 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:55.846295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fde55-c8cb-4e31-b107-4b075f2a5479 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:55.846295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fde55-c8cb-4e31-b107-4b075f2a5479 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:55.846295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fde55-c8cb-4e31-b107-4b075f2a5479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:55.846786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fde55-c8cb-4e31-b107-4b075f2a5479 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:55.889289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7accd1-10b3-47ff-af54-7a36f4c97021 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:55.891939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cc7accd1-10b3-47ff-af54-7a36f4c97021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:55.912071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7accd1-10b3-47ff-af54-7a36f4c97021 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:55.920271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985a2cd-722a-4518-8e77-9d50ebbb8b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:55.923021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985a2cd-722a-4518-8e77-9d50ebbb8b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:55.923510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985a2cd-722a-4518-8e77-9d50ebbb8b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:55.924166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985a2cd-722a-4518-8e77-9d50ebbb8b14 admin admin] PATH_INFO: `/v3/users/c337647f0fa340949df8761bceb1bafc` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:55.934866 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3231/6453] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:43:55 2022] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:43:55.936342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fde55-c8cb-4e31-b107-4b075f2a5479 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:55.941864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985a2cd-722a-4518-8e77-9d50ebbb8b14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c337647f0fa340949df8761bceb1bafc)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:55.944772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985a2cd-722a-4518-8e77-9d50ebbb8b14 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:56.030345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fde55-c8cb-4e31-b107-4b075f2a5479 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:56.040288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0a4ae-953b-41bb-8e21-dad1a31b2e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:56.041021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0a4ae-953b-41bb-8e21-dad1a31b2e8b admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:56.041310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0a4ae-953b-41bb-8e21-dad1a31b2e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:56.041590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0a4ae-953b-41bb-8e21-dad1a31b2e8b admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:56.042295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0a4ae-953b-41bb-8e21-dad1a31b2e8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:56.044231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0a4ae-953b-41bb-8e21-dad1a31b2e8b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:56.178634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3985a2cd-722a-4518-8e77-9d50ebbb8b14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c337647f0fa340949df8761bceb1bafc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:56.194898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3985a2cd-722a-4518-8e77-9d50ebbb8b14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c337647f0fa340949df8761bceb1bafc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:56.195112 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3232/6454] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:43:55 2022] POST /identity/v3/users => generated 295 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:43:56.199459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0a4ae-953b-41bb-8e21-dad1a31b2e8b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:56.199824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3985a2cd-722a-4518-8e77-9d50ebbb8b14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c337647f0fa340949df8761bceb1bafc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:56.209636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3985a2cd-722a-4518-8e77-9d50ebbb8b14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c337647f0fa340949df8761bceb1bafc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:56.216338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0a4ae-953b-41bb-8e21-dad1a31b2e8b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:56.226682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47585804-4e30-4c60-a955-494866b31873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:56.227408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47585804-4e30-4c60-a955-494866b31873 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:56.227776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47585804-4e30-4c60-a955-494866b31873 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:56.228173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47585804-4e30-4c60-a955-494866b31873 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:56.229335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47585804-4e30-4c60-a955-494866b31873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:56.231160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47585804-4e30-4c60-a955-494866b31873 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:56.246960 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3233/6455] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:43:56.247672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47585804-4e30-4c60-a955-494866b31873 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:56.259230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47585804-4e30-4c60-a955-494866b31873 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:56.264519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028618a-2c1d-4eb5-add9-7c51d15a1e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:56.264908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028618a-2c1d-4eb5-add9-7c51d15a1e94 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:56.265245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028618a-2c1d-4eb5-add9-7c51d15a1e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:56.265537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028618a-2c1d-4eb5-add9-7c51d15a1e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:56.266278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028618a-2c1d-4eb5-add9-7c51d15a1e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:56.268079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028618a-2c1d-4eb5-add9-7c51d15a1e94 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:56.280242 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3234/6456] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:43:56.284516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028618a-2c1d-4eb5-add9-7c51d15a1e94 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:56.311041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028618a-2c1d-4eb5-add9-7c51d15a1e94 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:56.316047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bf1c6-396b-4263-9569-9dc026f9aae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:56.316994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bf1c6-396b-4263-9569-9dc026f9aae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:56.317282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bf1c6-396b-4263-9569-9dc026f9aae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:56.317570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bf1c6-396b-4263-9569-9dc026f9aae4 admin admin] PATH_INFO: `/v3/projects/79432fd538be43cea5a25b1480fe644d/users/729a1502b64b45b1ad95196f18d61dca/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:56.326645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3985a2cd-722a-4518-8e77-9d50ebbb8b14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c337647f0fa340949df8761bceb1bafc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:56.334820 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3223/6457] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:43:55 2022] DELETE /identity/v3/users/c337647f0fa340949df8761bceb1bafc => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:43:56.353790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36bf1c6-396b-4263-9569-9dc026f9aae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79432fd538be43cea5a25b1480fe644d, user_id=729a1502b64b45b1ad95196f18d61dca, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:56.357784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36bf1c6-396b-4263-9569-9dc026f9aae4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:56.467703 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3235/6458] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:43:56 2022] PUT /identity/v3/projects/79432fd538be43cea5a25b1480fe644d/users/729a1502b64b45b1ad95196f18d61dca/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:43:56.478561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f9f4b-cc76-4f21-9a01-2ecb96e50492 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:56.478864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f9f4b-cc76-4f21-9a01-2ecb96e50492 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:56.479146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f9f4b-cc76-4f21-9a01-2ecb96e50492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:56.515375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6d3f9f4b-cc76-4f21-9a01-2ecb96e50492 None None] MFA Rules not processed for user `729a1502b64b45b1ad95196f18d61dca`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:56.517249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6d3f9f4b-cc76-4f21-9a01-2ecb96e50492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:56.602367 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3224/6459] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:56.607700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bf1c6-396b-4263-9569-9dc026f9aae4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:56.609505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d36bf1c6-396b-4263-9569-9dc026f9aae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:56.732891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bf1c6-396b-4263-9569-9dc026f9aae4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:56.743896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b330bc-cbcd-49db-b953-31de553b2b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:56.743896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b330bc-cbcd-49db-b953-31de553b2b65 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:56.743896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b330bc-cbcd-49db-b953-31de553b2b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:56.743896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b330bc-cbcd-49db-b953-31de553b2b65 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:56.745659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b330bc-cbcd-49db-b953-31de553b2b65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:56.748067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b330bc-cbcd-49db-b953-31de553b2b65 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:56.887248 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3236/6460] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:43:56 2022] POST /identity/v3/projects => generated 389 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:43:56.888464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f9f4b-cc76-4f21-9a01-2ecb96e50492 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:56.908669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f9f4b-cc76-4f21-9a01-2ecb96e50492 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:56.997010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7251a1e-4ae7-44e3-b59a-6498473fc7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:56.997624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7251a1e-4ae7-44e3-b59a-6498473fc7fe admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:56.997915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7251a1e-4ae7-44e3-b59a-6498473fc7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:56.998320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7251a1e-4ae7-44e3-b59a-6498473fc7fe admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:56.999022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7251a1e-4ae7-44e3-b59a-6498473fc7fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:57.001267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7251a1e-4ae7-44e3-b59a-6498473fc7fe admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:57.148055 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3225/6461] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:43:56 2022] POST /identity/v3/users => generated 301 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:43:57.152096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b330bc-cbcd-49db-b953-31de553b2b65 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:57.167168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7251a1e-4ae7-44e3-b59a-6498473fc7fe admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:57.169996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a7251a1e-4ae7-44e3-b59a-6498473fc7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:57.171406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b330bc-cbcd-49db-b953-31de553b2b65 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:57.192382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7251a1e-4ae7-44e3-b59a-6498473fc7fe admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:57.195562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a57368-71d2-4bae-9e1a-21bca006be92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:57.196259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a57368-71d2-4bae-9e1a-21bca006be92 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:57.196797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a57368-71d2-4bae-9e1a-21bca006be92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:57.197258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a57368-71d2-4bae-9e1a-21bca006be92 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:57.198176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a57368-71d2-4bae-9e1a-21bca006be92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:57.199841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a57368-71d2-4bae-9e1a-21bca006be92 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:57.210860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ac6c7-c5d6-45e4-a8bd-b7422b073018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:57.212063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ac6c7-c5d6-45e4-a8bd-b7422b073018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:57.212422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ac6c7-c5d6-45e4-a8bd-b7422b073018 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:57.212814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ac6c7-c5d6-45e4-a8bd-b7422b073018 admin admin] PATH_INFO: `/v3/projects/4159f5ce4fb544c2bae494d5bcd6f3e0` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:57.223191 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3237/6462] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:43:57.227719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a57368-71d2-4bae-9e1a-21bca006be92 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:57.246044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ac6c7-c5d6-45e4-a8bd-b7422b073018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4159f5ce4fb544c2bae494d5bcd6f3e0)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:57.249026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ac6c7-c5d6-45e4-a8bd-b7422b073018 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:57.249948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a57368-71d2-4bae-9e1a-21bca006be92 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:57.260960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd39bd5-d507-4ddb-8deb-9e370ee667a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:57.263288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd39bd5-d507-4ddb-8deb-9e370ee667a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:57.264225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd39bd5-d507-4ddb-8deb-9e370ee667a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:57.264520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd39bd5-d507-4ddb-8deb-9e370ee667a7 admin admin] PATH_INFO: `/v3/projects/ca4eeb8359da4f2ca32497e267016c9a/users/94da4cc17b82467e8b012e4b5bc28906/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:57.302657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd39bd5-d507-4ddb-8deb-9e370ee667a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4eeb8359da4f2ca32497e267016c9a, user_id=94da4cc17b82467e8b012e4b5bc28906, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:57.308340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd39bd5-d507-4ddb-8deb-9e370ee667a7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:57.434379 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3238/6463] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:43:57 2022] PUT /identity/v3/projects/ca4eeb8359da4f2ca32497e267016c9a/users/94da4cc17b82467e8b012e4b5bc28906/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:57.438160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd39bd5-d507-4ddb-8deb-9e370ee667a7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:57.440911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-647ac6c7-c5d6-45e4-a8bd-b7422b073018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4159f5ce4fb544c2bae494d5bcd6f3e0', 'request_id': 'req-647ac6c7-c5d6-45e4-a8bd-b7422b073018'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:57.449484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-647ac6c7-c5d6-45e4-a8bd-b7422b073018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4159f5ce4fb544c2bae494d5bcd6f3e0', 'request_id': 'req-647ac6c7-c5d6-45e4-a8bd-b7422b073018'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:57.527079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd39bd5-d507-4ddb-8deb-9e370ee667a7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:57.529575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-647ac6c7-c5d6-45e4-a8bd-b7422b073018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4159f5ce4fb544c2bae494d5bcd6f3e0', 'request_id': 'req-647ac6c7-c5d6-45e4-a8bd-b7422b073018'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:57.544271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-647ac6c7-c5d6-45e4-a8bd-b7422b073018 admin admin] The token cache is being invalidate because project 4159f5ce4fb544c2bae494d5bcd6f3e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:43:57.545438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-647ac6c7-c5d6-45e4-a8bd-b7422b073018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:57.546372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-647ac6c7-c5d6-45e4-a8bd-b7422b073018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:57.548750 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3226/6464] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:43:57 2022] DELETE /identity/v3/projects/4159f5ce4fb544c2bae494d5bcd6f3e0 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:43:57.553907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ac6c7-c5d6-45e4-a8bd-b7422b073018 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:57.555814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-647ac6c7-c5d6-45e4-a8bd-b7422b073018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:57.608512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28e261-4837-447d-8387-ff239ec17c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:57.609542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28e261-4837-447d-8387-ff239ec17c06 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:57.610717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28e261-4837-447d-8387-ff239ec17c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:57.611197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28e261-4837-447d-8387-ff239ec17c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:57.612730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28e261-4837-447d-8387-ff239ec17c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:57.616794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28e261-4837-447d-8387-ff239ec17c06 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:57.630280 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3239/6465] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:43:57.634855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28e261-4837-447d-8387-ff239ec17c06 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:57.638088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7d28e261-4837-447d-8387-ff239ec17c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:57.643284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ac6c7-c5d6-45e4-a8bd-b7422b073018 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:57.649166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac61d27-bf47-4a6a-a4ae-861898db84dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:57.650779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac61d27-bf47-4a6a-a4ae-861898db84dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:57.651269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac61d27-bf47-4a6a-a4ae-861898db84dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:57.651846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac61d27-bf47-4a6a-a4ae-861898db84dd admin admin] PATH_INFO: `/v3/users/b6a971cadf2444c0bc39e4edfb1887f3` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:57.653126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28e261-4837-447d-8387-ff239ec17c06 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:57.659729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f9d55-edc5-42c8-a697-b5112c996f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:57.660855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f9d55-edc5-42c8-a697-b5112c996f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:57.661249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f9d55-edc5-42c8-a697-b5112c996f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:57.662205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f9d55-edc5-42c8-a697-b5112c996f0a admin admin] PATH_INFO: `/v3/projects/ca4eeb8359da4f2ca32497e267016c9a/users/94da4cc17b82467e8b012e4b5bc28906/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:57.665607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f9d55-edc5-42c8-a697-b5112c996f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4eeb8359da4f2ca32497e267016c9a, user_id=94da4cc17b82467e8b012e4b5bc28906, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:57.670924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f9d55-edc5-42c8-a697-b5112c996f0a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:57.674340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac61d27-bf47-4a6a-a4ae-861898db84dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6a971cadf2444c0bc39e4edfb1887f3)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:57.677011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac61d27-bf47-4a6a-a4ae-861898db84dd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:57.708259 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3240/6466] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:43:57 2022] PUT /identity/v3/projects/ca4eeb8359da4f2ca32497e267016c9a/users/94da4cc17b82467e8b012e4b5bc28906/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:57.710828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948ad0a-5649-4977-bb50-02220c3f5a14 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:57.711190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948ad0a-5649-4977-bb50-02220c3f5a14 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:57.711422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948ad0a-5649-4977-bb50-02220c3f5a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:57.744660 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-7948ad0a-5649-4977-bb50-02220c3f5a14 None None] MFA Rules not processed for user `94da4cc17b82467e8b012e4b5bc28906`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:57.746238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7948ad0a-5649-4977-bb50-02220c3f5a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:57.822470 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3241/6467] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:57 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:57.833770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948ad0a-5649-4977-bb50-02220c3f5a14 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:57.835790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7948ad0a-5649-4977-bb50-02220c3f5a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:57.906128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948ad0a-5649-4977-bb50-02220c3f5a14 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:57.920069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bfc24-9053-4a76-9b84-9aabffb9940c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:57.920069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bfc24-9053-4a76-9b84-9aabffb9940c service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:57.920069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bfc24-9053-4a76-9b84-9aabffb9940c service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:57.920069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bfc24-9053-4a76-9b84-9aabffb9940c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:57.935381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7ac61d27-bf47-4a6a-a4ae-861898db84dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6a971cadf2444c0bc39e4edfb1887f3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:57.935568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bfc24-9053-4a76-9b84-9aabffb9940c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:57.936948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bfc24-9053-4a76-9b84-9aabffb9940c service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:57.950033 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3242/6468] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:43:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:43:57.956380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7ac61d27-bf47-4a6a-a4ae-861898db84dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6a971cadf2444c0bc39e4edfb1887f3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:57.956825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7ac61d27-bf47-4a6a-a4ae-861898db84dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6a971cadf2444c0bc39e4edfb1887f3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:57.965019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7ac61d27-bf47-4a6a-a4ae-861898db84dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6a971cadf2444c0bc39e4edfb1887f3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:58.043824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7ac61d27-bf47-4a6a-a4ae-861898db84dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6a971cadf2444c0bc39e4edfb1887f3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:58.051308 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3227/6469] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:43:57 2022] DELETE /identity/v3/users/b6a971cadf2444c0bc39e4edfb1887f3 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:43:58.112554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bfc24-9053-4a76-9b84-9aabffb9940c service cinder] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:58.185467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bfc24-9053-4a76-9b84-9aabffb9940c service cinder] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:58.257317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07734c2d-1a5c-432f-be0a-c6520fcece35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:58.258361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07734c2d-1a5c-432f-be0a-c6520fcece35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:58.258612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07734c2d-1a5c-432f-be0a-c6520fcece35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:58.258893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07734c2d-1a5c-432f-be0a-c6520fcece35 admin admin] PATH_INFO: `/v3/users/729a1502b64b45b1ad95196f18d61dca` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:58.260315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07734c2d-1a5c-432f-be0a-c6520fcece35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=729a1502b64b45b1ad95196f18d61dca)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:58.262282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07734c2d-1a5c-432f-be0a-c6520fcece35 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:58.341732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac61d27-bf47-4a6a-a4ae-861898db84dd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:58.342663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7ac61d27-bf47-4a6a-a4ae-861898db84dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:58.382667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac61d27-bf47-4a6a-a4ae-861898db84dd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:58.387833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da9bd9-fd1d-4322-8dde-260a26000dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:58.388724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da9bd9-fd1d-4322-8dde-260a26000dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:58.389008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da9bd9-fd1d-4322-8dde-260a26000dce admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:58.389472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da9bd9-fd1d-4322-8dde-260a26000dce admin admin] PATH_INFO: `/v3/projects/b5527890307e49edad96eaf0fa0051c2` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:58.401706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da9bd9-fd1d-4322-8dde-260a26000dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5527890307e49edad96eaf0fa0051c2)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:58.403684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da9bd9-fd1d-4322-8dde-260a26000dce admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:58.464056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-07734c2d-1a5c-432f-be0a-c6520fcece35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '729a1502b64b45b1ad95196f18d61dca'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:58.476027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-07734c2d-1a5c-432f-be0a-c6520fcece35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '729a1502b64b45b1ad95196f18d61dca'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:58.476928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-07734c2d-1a5c-432f-be0a-c6520fcece35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '729a1502b64b45b1ad95196f18d61dca'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:58.483847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-07734c2d-1a5c-432f-be0a-c6520fcece35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '729a1502b64b45b1ad95196f18d61dca'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:58.556042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c0da9bd9-fd1d-4322-8dde-260a26000dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5527890307e49edad96eaf0fa0051c2', 'request_id': 'req-c0da9bd9-fd1d-4322-8dde-260a26000dce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:58.560336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-07734c2d-1a5c-432f-be0a-c6520fcece35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '729a1502b64b45b1ad95196f18d61dca'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:58.563423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c0da9bd9-fd1d-4322-8dde-260a26000dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5527890307e49edad96eaf0fa0051c2', 'request_id': 'req-c0da9bd9-fd1d-4322-8dde-260a26000dce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:58.573716 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3243/6470] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:43:58 2022] DELETE /identity/v3/users/729a1502b64b45b1ad95196f18d61dca => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:58.576221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9303cf-0027-40c1-a412-1bba2128389a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:58.576530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9303cf-0027-40c1-a412-1bba2128389a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:58.576886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9303cf-0027-40c1-a412-1bba2128389a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:58.615950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fb9303cf-0027-40c1-a412-1bba2128389a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:58.618143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fb9303cf-0027-40c1-a412-1bba2128389a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:58.702158 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3244/6471] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:58.712302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c0da9bd9-fd1d-4322-8dde-260a26000dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5527890307e49edad96eaf0fa0051c2', 'request_id': 'req-c0da9bd9-fd1d-4322-8dde-260a26000dce'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:58.728675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c0da9bd9-fd1d-4322-8dde-260a26000dce admin admin] The token cache is being invalidate because project b5527890307e49edad96eaf0fa0051c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:43:58.729363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c0da9bd9-fd1d-4322-8dde-260a26000dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:58.730242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c0da9bd9-fd1d-4322-8dde-260a26000dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:58.732106 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3228/6472] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:43:58 2022] DELETE /identity/v3/projects/b5527890307e49edad96eaf0fa0051c2 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:43:58.737231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edd2f4-a2d3-47fc-84e0-82e5983635a3 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:58.737525 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edd2f4-a2d3-47fc-84e0-82e5983635a3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:58.737810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edd2f4-a2d3-47fc-84e0-82e5983635a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:58.760574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da9bd9-fd1d-4322-8dde-260a26000dce admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:58.762146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c0da9bd9-fd1d-4322-8dde-260a26000dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:58.765196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-89edd2f4-a2d3-47fc-84e0-82e5983635a3 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:58.766148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-89edd2f4-a2d3-47fc-84e0-82e5983635a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:58.801690 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3245/6473] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:58.810429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f9f6d-7de3-4ffb-900d-a7dfacc817d7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:58.810429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f9f6d-7de3-4ffb-900d-a7dfacc817d7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:58.810429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f9f6d-7de3-4ffb-900d-a7dfacc817d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:58.833945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e79f9f6d-7de3-4ffb-900d-a7dfacc817d7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:58.836369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e79f9f6d-7de3-4ffb-900d-a7dfacc817d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:58.846512 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3246/6474] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:58.851569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f9f6d-7de3-4ffb-900d-a7dfacc817d7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:58.865505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f9f6d-7de3-4ffb-900d-a7dfacc817d7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:58.875621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc39f25-d653-4f8c-943a-3fca595c96d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:58.876745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc39f25-d653-4f8c-943a-3fca595c96d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:58.877032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc39f25-d653-4f8c-943a-3fca595c96d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:58.877305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc39f25-d653-4f8c-943a-3fca595c96d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:58.878474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc39f25-d653-4f8c-943a-3fca595c96d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:43:58.878966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc39f25-d653-4f8c-943a-3fca595c96d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:58.881195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc39f25-d653-4f8c-943a-3fca595c96d5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:58.905345 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3247/6475] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:43:58.906271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc39f25-d653-4f8c-943a-3fca595c96d5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:58.913063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da9bd9-fd1d-4322-8dde-260a26000dce admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:58.917346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc39f25-d653-4f8c-943a-3fca595c96d5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:58.924025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888d480-b78e-46bf-a82c-06879e02e409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:58.925109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888d480-b78e-46bf-a82c-06879e02e409 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:58.925393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888d480-b78e-46bf-a82c-06879e02e409 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:58.925676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888d480-b78e-46bf-a82c-06879e02e409 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:58.926378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888d480-b78e-46bf-a82c-06879e02e409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:58.929030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888d480-b78e-46bf-a82c-06879e02e409 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:58.964401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eff154-2fd4-4075-9177-ab2ef0dd455c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:58.965201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eff154-2fd4-4075-9177-ab2ef0dd455c service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:58.967884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eff154-2fd4-4075-9177-ab2ef0dd455c service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:58.968180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eff154-2fd4-4075-9177-ab2ef0dd455c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:58.970134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-77eff154-2fd4-4075-9177-ab2ef0dd455c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:58.984663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eff154-2fd4-4075-9177-ab2ef0dd455c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:58.987310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eff154-2fd4-4075-9177-ab2ef0dd455c service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:59.000305 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3229/6476] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:43:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:43:59.046894 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3248/6477] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:43:58 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:43:59.051136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eff154-2fd4-4075-9177-ab2ef0dd455c service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:59.062694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eff154-2fd4-4075-9177-ab2ef0dd455c service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:59.130286 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4727f-3667-45a8-945c-4144c08d941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:59.131662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4727f-3667-45a8-945c-4144c08d941f admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:59.131953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4727f-3667-45a8-945c-4144c08d941f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:59.132241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4727f-3667-45a8-945c-4144c08d941f admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:59.132966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4727f-3667-45a8-945c-4144c08d941f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:59.135027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4727f-3667-45a8-945c-4144c08d941f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:59.312050 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3230/6478] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:43:59 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:43:59.313477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888d480-b78e-46bf-a82c-06879e02e409 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:59.326012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888d480-b78e-46bf-a82c-06879e02e409 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:59.336218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88cdde6-86e0-44bf-a312-f957182fb3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:59.336218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88cdde6-86e0-44bf-a312-f957182fb3dd admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:59.336218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88cdde6-86e0-44bf-a312-f957182fb3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:59.336218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88cdde6-86e0-44bf-a312-f957182fb3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:59.336554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88cdde6-86e0-44bf-a312-f957182fb3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:59.336554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88cdde6-86e0-44bf-a312-f957182fb3dd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:59.346695 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3249/6479] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:43:59.351181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4727f-3667-45a8-945c-4144c08d941f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:59.361587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4727f-3667-45a8-945c-4144c08d941f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:59.367784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c404c-1f45-4bca-a860-deb03f9106dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:59.368557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c404c-1f45-4bca-a860-deb03f9106dd admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:59.369019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c404c-1f45-4bca-a860-deb03f9106dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:59.369306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c404c-1f45-4bca-a860-deb03f9106dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:59.370069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c404c-1f45-4bca-a860-deb03f9106dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:59.371670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c404c-1f45-4bca-a860-deb03f9106dd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:59.385329 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3231/6480] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:43:59.386597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88cdde6-86e0-44bf-a312-f957182fb3dd admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:59.398430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88cdde6-86e0-44bf-a312-f957182fb3dd admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:59.404785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5071eb9-62e4-4d44-9f52-2bddfeec83d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:59.406412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5071eb9-62e4-4d44-9f52-2bddfeec83d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:59.406412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5071eb9-62e4-4d44-9f52-2bddfeec83d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:59.406621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5071eb9-62e4-4d44-9f52-2bddfeec83d5 admin admin] PATH_INFO: `/v3/projects/cfa0b24c632c4b3795e5bf28209734f1/users/6f188dd7eec041549953dc4d730b4d65/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:59.426602 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5071eb9-62e4-4d44-9f52-2bddfeec83d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa0b24c632c4b3795e5bf28209734f1, user_id=6f188dd7eec041549953dc4d730b4d65, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:59.434432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5071eb9-62e4-4d44-9f52-2bddfeec83d5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:59.507035 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3250/6481] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:43:59 2022] PUT /identity/v3/projects/cfa0b24c632c4b3795e5bf28209734f1/users/6f188dd7eec041549953dc4d730b4d65/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:43:59.512365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81532c-5c07-4998-af13-e0d7a6686eb7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:59.512783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81532c-5c07-4998-af13-e0d7a6686eb7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:59.513182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81532c-5c07-4998-af13-e0d7a6686eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:59.538446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8e81532c-5c07-4998-af13-e0d7a6686eb7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:43:59.538446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8e81532c-5c07-4998-af13-e0d7a6686eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:59.616028 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3232/6482] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:43:59.633012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5071eb9-62e4-4d44-9f52-2bddfeec83d5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:59.711577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5071eb9-62e4-4d44-9f52-2bddfeec83d5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:59.717063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92769c4b-ac7f-44fd-95cb-e80c76d3bd9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:59.717935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92769c4b-ac7f-44fd-95cb-e80c76d3bd9c service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:59.718057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92769c4b-ac7f-44fd-95cb-e80c76d3bd9c service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:59.718302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92769c4b-ac7f-44fd-95cb-e80c76d3bd9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:59.733825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92769c4b-ac7f-44fd-95cb-e80c76d3bd9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:59.735360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92769c4b-ac7f-44fd-95cb-e80c76d3bd9c service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:59.751841 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3251/6483] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:43:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:43:59.784255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81532c-5c07-4998-af13-e0d7a6686eb7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:43:59.792029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8e81532c-5c07-4998-af13-e0d7a6686eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:43:59.818813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81532c-5c07-4998-af13-e0d7a6686eb7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:43:59.825618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa41adc-98a4-4362-9525-ccbe1ac54c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:43:59.826502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa41adc-98a4-4362-9525-ccbe1ac54c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:43:59.826864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa41adc-98a4-4362-9525-ccbe1ac54c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:43:59.827148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa41adc-98a4-4362-9525-ccbe1ac54c93 admin admin] PATH_INFO: `/v3/projects/79432fd538be43cea5a25b1480fe644d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:43:59.829047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa41adc-98a4-4362-9525-ccbe1ac54c93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79432fd538be43cea5a25b1480fe644d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:43:59.831269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa41adc-98a4-4362-9525-ccbe1ac54c93 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:43:59.961836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7aa41adc-98a4-4362-9525-ccbe1ac54c93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79432fd538be43cea5a25b1480fe644d', 'request_id': 'req-7aa41adc-98a4-4362-9525-ccbe1ac54c93'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:43:59.970153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7aa41adc-98a4-4362-9525-ccbe1ac54c93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79432fd538be43cea5a25b1480fe644d', 'request_id': 'req-7aa41adc-98a4-4362-9525-ccbe1ac54c93'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:00.157083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7aa41adc-98a4-4362-9525-ccbe1ac54c93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79432fd538be43cea5a25b1480fe644d', 'request_id': 'req-7aa41adc-98a4-4362-9525-ccbe1ac54c93'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:00.184254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7aa41adc-98a4-4362-9525-ccbe1ac54c93 admin admin] The token cache is being invalidate because project 79432fd538be43cea5a25b1480fe644d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:44:00.184800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7aa41adc-98a4-4362-9525-ccbe1ac54c93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:00.190805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7aa41adc-98a4-4362-9525-ccbe1ac54c93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:00.194189 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3233/6484] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:43:59 2022] DELETE /identity/v3/projects/79432fd538be43cea5a25b1480fe644d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:00.200178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92769c4b-ac7f-44fd-95cb-e80c76d3bd9c service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:00.215043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92769c4b-ac7f-44fd-95cb-e80c76d3bd9c service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:00.340364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6ad38-d34f-49f1-af23-d62d2d701934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:00.343679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6ad38-d34f-49f1-af23-d62d2d701934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:00.343679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6ad38-d34f-49f1-af23-d62d2d701934 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:00.343679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6ad38-d34f-49f1-af23-d62d2d701934 admin admin] PATH_INFO: `/v3/users/94da4cc17b82467e8b012e4b5bc28906` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:00.345150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6ad38-d34f-49f1-af23-d62d2d701934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94da4cc17b82467e8b012e4b5bc28906)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:00.347363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6ad38-d34f-49f1-af23-d62d2d701934 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:00.686838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-36e6ad38-d34f-49f1-af23-d62d2d701934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94da4cc17b82467e8b012e4b5bc28906'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:00.699548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-36e6ad38-d34f-49f1-af23-d62d2d701934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94da4cc17b82467e8b012e4b5bc28906'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:00.700555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-36e6ad38-d34f-49f1-af23-d62d2d701934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94da4cc17b82467e8b012e4b5bc28906'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:00.707691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-36e6ad38-d34f-49f1-af23-d62d2d701934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94da4cc17b82467e8b012e4b5bc28906'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:00.795958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-36e6ad38-d34f-49f1-af23-d62d2d701934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94da4cc17b82467e8b012e4b5bc28906'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:00.806161 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3252/6485] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:44:00 2022] DELETE /identity/v3/users/94da4cc17b82467e8b012e4b5bc28906 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:01.938301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa41adc-98a4-4362-9525-ccbe1ac54c93 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:01.943434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7aa41adc-98a4-4362-9525-ccbe1ac54c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:01.975377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa41adc-98a4-4362-9525-ccbe1ac54c93 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:02.068337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac75d3-d11d-4046-9ef4-5165f91515ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:02.071192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac75d3-d11d-4046-9ef4-5165f91515ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:02.071750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac75d3-d11d-4046-9ef4-5165f91515ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:02.072190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac75d3-d11d-4046-9ef4-5165f91515ba admin admin] PATH_INFO: `/v3/projects/ca4eeb8359da4f2ca32497e267016c9a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:02.074163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac75d3-d11d-4046-9ef4-5165f91515ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca4eeb8359da4f2ca32497e267016c9a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:02.076651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac75d3-d11d-4046-9ef4-5165f91515ba admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:02.192561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f60ab-40fd-4abe-b039-7b2e6038b599 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:02.193457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f60ab-40fd-4abe-b039-7b2e6038b599 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:02.193925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f60ab-40fd-4abe-b039-7b2e6038b599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:02.215567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c3ac75d3-d11d-4046-9ef4-5165f91515ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca4eeb8359da4f2ca32497e267016c9a', 'request_id': 'req-c3ac75d3-d11d-4046-9ef4-5165f91515ba'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:02.225773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-518f60ab-40fd-4abe-b039-7b2e6038b599 None None] MFA Rules not processed for user `6f188dd7eec041549953dc4d730b4d65`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:02.227276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-518f60ab-40fd-4abe-b039-7b2e6038b599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:02.237769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c3ac75d3-d11d-4046-9ef4-5165f91515ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca4eeb8359da4f2ca32497e267016c9a', 'request_id': 'req-c3ac75d3-d11d-4046-9ef4-5165f91515ba'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:02.311784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c3ac75d3-d11d-4046-9ef4-5165f91515ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca4eeb8359da4f2ca32497e267016c9a', 'request_id': 'req-c3ac75d3-d11d-4046-9ef4-5165f91515ba'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:02.327836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c3ac75d3-d11d-4046-9ef4-5165f91515ba admin admin] The token cache is being invalidate because project ca4eeb8359da4f2ca32497e267016c9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:44:02.328042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c3ac75d3-d11d-4046-9ef4-5165f91515ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:02.328757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c3ac75d3-d11d-4046-9ef4-5165f91515ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:02.343465 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3234/6486] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:44:01 2022] DELETE /identity/v3/projects/ca4eeb8359da4f2ca32497e267016c9a => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:02.351777 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3253/6487] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:02.351980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97353be-1eac-4d31-a3cf-2de3e89bcde0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:02.351980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97353be-1eac-4d31-a3cf-2de3e89bcde0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:02.351980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97353be-1eac-4d31-a3cf-2de3e89bcde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:02.360772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f47a0-2974-462e-988f-483b895530a5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:02.361050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f47a0-2974-462e-988f-483b895530a5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:02.361384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f47a0-2974-462e-988f-483b895530a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:02.398389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c97353be-1eac-4d31-a3cf-2de3e89bcde0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:02.400311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ec1f47a0-2974-462e-988f-483b895530a5 None None] MFA Rules not processed for user `6f188dd7eec041549953dc4d730b4d65`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:02.402527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ec1f47a0-2974-462e-988f-483b895530a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:02.406939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c97353be-1eac-4d31-a3cf-2de3e89bcde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:02.430285 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3254/6488] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:02.437663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f47a0-2974-462e-988f-483b895530a5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:02.439182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ec1f47a0-2974-462e-988f-483b895530a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:02.540159 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3235/6489] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:44:02.549718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91695f-87a0-4ac6-90f2-f50af0ba2897 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:02.550011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91695f-87a0-4ac6-90f2-f50af0ba2897 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:02.550292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91695f-87a0-4ac6-90f2-f50af0ba2897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:02.589243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9f91695f-87a0-4ac6-90f2-f50af0ba2897 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:02.590504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9f91695f-87a0-4ac6-90f2-f50af0ba2897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:02.614997 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3236/6490] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:02.615960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91695f-87a0-4ac6-90f2-f50af0ba2897 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:02.627370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f47a0-2974-462e-988f-483b895530a5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:02.631603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91695f-87a0-4ac6-90f2-f50af0ba2897 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:02.642355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb39b95-70b0-4904-91a9-8d1dac6f8d17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:02.642858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb39b95-70b0-4904-91a9-8d1dac6f8d17 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:02.643227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb39b95-70b0-4904-91a9-8d1dac6f8d17 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:02.643599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb39b95-70b0-4904-91a9-8d1dac6f8d17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:02.647061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9fb39b95-70b0-4904-91a9-8d1dac6f8d17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:02.650573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c793cc-51f4-4541-b210-a37312d1ba1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:02.651266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c793cc-51f4-4541-b210-a37312d1ba1a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:02.651639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c793cc-51f4-4541-b210-a37312d1ba1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:02.651802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c793cc-51f4-4541-b210-a37312d1ba1a admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:02.656807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c793cc-51f4-4541-b210-a37312d1ba1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:44:02.657139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c793cc-51f4-4541-b210-a37312d1ba1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:02.659993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c793cc-51f4-4541-b210-a37312d1ba1a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:02.680564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb39b95-70b0-4904-91a9-8d1dac6f8d17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:02.682216 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb39b95-70b0-4904-91a9-8d1dac6f8d17 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:02.706583 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3255/6491] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:44:02.718524 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3237/6492] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:44:02.722846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb39b95-70b0-4904-91a9-8d1dac6f8d17 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:02.740042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb39b95-70b0-4904-91a9-8d1dac6f8d17 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:02.753032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b07bdd-f5f8-4840-9e8a-153e6b7c72cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:02.753785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b07bdd-f5f8-4840-9e8a-153e6b7c72cb admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:02.758508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b07bdd-f5f8-4840-9e8a-153e6b7c72cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:02.758508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b07bdd-f5f8-4840-9e8a-153e6b7c72cb admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:02.758508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b07bdd-f5f8-4840-9e8a-153e6b7c72cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:02.758508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b07bdd-f5f8-4840-9e8a-153e6b7c72cb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:02.915590 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3256/6493] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:44:02 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:44:02.916590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c793cc-51f4-4541-b210-a37312d1ba1a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:02.932159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c793cc-51f4-4541-b210-a37312d1ba1a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:03.005783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f562f-6746-4497-bc13-3b0fa9dfce8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:03.006486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f562f-6746-4497-bc13-3b0fa9dfce8a admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:03.006761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f562f-6746-4497-bc13-3b0fa9dfce8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:03.007031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f562f-6746-4497-bc13-3b0fa9dfce8a admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:03.008252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f562f-6746-4497-bc13-3b0fa9dfce8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:03.010013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f562f-6746-4497-bc13-3b0fa9dfce8a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:03.136772 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3238/6494] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:44:02 2022] POST /identity/v3/users => generated 287 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:44:03.137077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b07bdd-f5f8-4840-9e8a-153e6b7c72cb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:03.148342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b07bdd-f5f8-4840-9e8a-153e6b7c72cb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:03.153992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5a69a-db82-4c97-8a0c-f283f67b0359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:03.154586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5a69a-db82-4c97-8a0c-f283f67b0359 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:03.154883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5a69a-db82-4c97-8a0c-f283f67b0359 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:03.155162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5a69a-db82-4c97-8a0c-f283f67b0359 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:03.155895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5a69a-db82-4c97-8a0c-f283f67b0359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:03.157544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5a69a-db82-4c97-8a0c-f283f67b0359 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:03.173902 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3257/6495] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:44:03.174250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f562f-6746-4497-bc13-3b0fa9dfce8a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:03.185221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f562f-6746-4497-bc13-3b0fa9dfce8a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:03.191134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5aae3f-3e27-47a5-83a2-3478bdcc3e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:03.191940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5aae3f-3e27-47a5-83a2-3478bdcc3e21 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:03.192231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5aae3f-3e27-47a5-83a2-3478bdcc3e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:03.193035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5aae3f-3e27-47a5-83a2-3478bdcc3e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:03.193902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5aae3f-3e27-47a5-83a2-3478bdcc3e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:03.196099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5aae3f-3e27-47a5-83a2-3478bdcc3e21 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:03.213731 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3239/6496] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:44:03.214994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5a69a-db82-4c97-8a0c-f283f67b0359 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:03.229599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5a69a-db82-4c97-8a0c-f283f67b0359 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:03.237517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76dd53-f4bb-436a-863b-48575217c46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:03.240231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76dd53-f4bb-436a-863b-48575217c46c admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:03.240727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76dd53-f4bb-436a-863b-48575217c46c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:03.241409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76dd53-f4bb-436a-863b-48575217c46c admin admin] PATH_INFO: `/v3/projects/92c0683d241045e5bbd52bc4f8fe82d8/users/94ca71f1e7f3431fa99e7f964e183c71/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:03.265209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76dd53-f4bb-436a-863b-48575217c46c admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c0683d241045e5bbd52bc4f8fe82d8, user_id=94ca71f1e7f3431fa99e7f964e183c71, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:03.268704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76dd53-f4bb-436a-863b-48575217c46c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:03.481952 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3258/6497] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:44:03 2022] PUT /identity/v3/projects/92c0683d241045e5bbd52bc4f8fe82d8/users/94ca71f1e7f3431fa99e7f964e183c71/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:03.482231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad5fdd-a08f-4601-ab87-5454faa0d456 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:03.486132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad5fdd-a08f-4601-ab87-5454faa0d456 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:03.486446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad5fdd-a08f-4601-ab87-5454faa0d456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:03.508292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b7ad5fdd-a08f-4601-ab87-5454faa0d456 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:03.509580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b7ad5fdd-a08f-4601-ab87-5454faa0d456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:03.597034 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3240/6498] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:44:03.604136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76dd53-f4bb-436a-863b-48575217c46c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:03.606043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5e76dd53-f4bb-436a-863b-48575217c46c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:03.699999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76dd53-f4bb-436a-863b-48575217c46c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:03.704377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913214df-9e45-49d4-8e82-3e402d4c68a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:03.705257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913214df-9e45-49d4-8e82-3e402d4c68a9 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:03.705614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913214df-9e45-49d4-8e82-3e402d4c68a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:03.705967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913214df-9e45-49d4-8e82-3e402d4c68a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:03.716585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913214df-9e45-49d4-8e82-3e402d4c68a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:03.718220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913214df-9e45-49d4-8e82-3e402d4c68a9 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:03.735725 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3259/6499] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:44:04.136978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad5fdd-a08f-4601-ab87-5454faa0d456 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:04.143148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b7ad5fdd-a08f-4601-ab87-5454faa0d456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:04.164296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad5fdd-a08f-4601-ab87-5454faa0d456 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:04.169778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7b46e-c480-4c2b-8703-6eeb8c37663a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:04.170893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7b46e-c480-4c2b-8703-6eeb8c37663a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:04.171180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7b46e-c480-4c2b-8703-6eeb8c37663a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:04.171466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7b46e-c480-4c2b-8703-6eeb8c37663a admin admin] PATH_INFO: `/v3/users/b6620a5792c048c6a6e9bbe13663a3ed` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:04.172757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7b46e-c480-4c2b-8703-6eeb8c37663a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6620a5792c048c6a6e9bbe13663a3ed)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:04.174737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad7b46e-c480-4c2b-8703-6eeb8c37663a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:04.423992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-aad7b46e-c480-4c2b-8703-6eeb8c37663a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6620a5792c048c6a6e9bbe13663a3ed'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:04.437921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-aad7b46e-c480-4c2b-8703-6eeb8c37663a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6620a5792c048c6a6e9bbe13663a3ed'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:04.439193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-aad7b46e-c480-4c2b-8703-6eeb8c37663a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6620a5792c048c6a6e9bbe13663a3ed'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:04.447283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-aad7b46e-c480-4c2b-8703-6eeb8c37663a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6620a5792c048c6a6e9bbe13663a3ed'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:04.515292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913214df-9e45-49d4-8e82-3e402d4c68a9 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:04.518354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-913214df-9e45-49d4-8e82-3e402d4c68a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:04.541114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-aad7b46e-c480-4c2b-8703-6eeb8c37663a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6620a5792c048c6a6e9bbe13663a3ed'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:04.542870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913214df-9e45-49d4-8e82-3e402d4c68a9 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:04.553005 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3241/6500] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:44:04 2022] DELETE /identity/v3/users/b6620a5792c048c6a6e9bbe13663a3ed => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:04.553005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd176b-e567-459d-8547-a782c713a72e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:04.553005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd176b-e567-459d-8547-a782c713a72e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:04.553257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd176b-e567-459d-8547-a782c713a72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:04.553876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da49cf-9947-4213-9c38-d1fe3c0f9c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:04.556129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da49cf-9947-4213-9c38-d1fe3c0f9c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:04.556625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da49cf-9947-4213-9c38-d1fe3c0f9c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:04.557060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da49cf-9947-4213-9c38-d1fe3c0f9c51 admin admin] PATH_INFO: `/v3/users/3bb0ce3a6ad74cec85da601a746d6fee` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:04.558887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da49cf-9947-4213-9c38-d1fe3c0f9c51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bb0ce3a6ad74cec85da601a746d6fee)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:04.561348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da49cf-9947-4213-9c38-d1fe3c0f9c51 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:04.578589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2acd176b-e567-459d-8547-a782c713a72e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:04.579873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2acd176b-e567-459d-8547-a782c713a72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:04.680674 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3242/6501] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:44:04.690462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd176b-e567-459d-8547-a782c713a72e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:04.691845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2acd176b-e567-459d-8547-a782c713a72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:04.762891 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd176b-e567-459d-8547-a782c713a72e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:04.766997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c28e48-c700-4e19-95df-1f135c3eb2bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:04.767798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c28e48-c700-4e19-95df-1f135c3eb2bb service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:04.768123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c28e48-c700-4e19-95df-1f135c3eb2bb service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:04.768408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c28e48-c700-4e19-95df-1f135c3eb2bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:04.778855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c28e48-c700-4e19-95df-1f135c3eb2bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:04.780394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c28e48-c700-4e19-95df-1f135c3eb2bb service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:04.790613 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3243/6502] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:44:04.838347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-22da49cf-9947-4213-9c38-d1fe3c0f9c51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bb0ce3a6ad74cec85da601a746d6fee'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:04.852529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-22da49cf-9947-4213-9c38-d1fe3c0f9c51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bb0ce3a6ad74cec85da601a746d6fee'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:04.853496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-22da49cf-9947-4213-9c38-d1fe3c0f9c51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bb0ce3a6ad74cec85da601a746d6fee'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:04.860923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-22da49cf-9947-4213-9c38-d1fe3c0f9c51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bb0ce3a6ad74cec85da601a746d6fee'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:04.935496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-22da49cf-9947-4213-9c38-d1fe3c0f9c51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bb0ce3a6ad74cec85da601a746d6fee'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:04.947805 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3260/6503] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:44:04 2022] DELETE /identity/v3/users/3bb0ce3a6ad74cec85da601a746d6fee => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:44:04.952573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e0164-42fa-4d5f-a233-47c10ec40903 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:04.952893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e0164-42fa-4d5f-a233-47c10ec40903 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:04.953174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e0164-42fa-4d5f-a233-47c10ec40903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:04.983544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2e7e0164-42fa-4d5f-a233-47c10ec40903 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:04.984999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2e7e0164-42fa-4d5f-a233-47c10ec40903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:05.054187 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3244/6504] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:05.063827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da49cf-9947-4213-9c38-d1fe3c0f9c51 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:05.066057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-22da49cf-9947-4213-9c38-d1fe3c0f9c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:05.126471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da49cf-9947-4213-9c38-d1fe3c0f9c51 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:05.131314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60b8fe-153d-4449-81fb-4274235ca73b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:05.131977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60b8fe-153d-4449-81fb-4274235ca73b service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:05.132263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60b8fe-153d-4449-81fb-4274235ca73b service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:05.132545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60b8fe-153d-4449-81fb-4274235ca73b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:05.142218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60b8fe-153d-4449-81fb-4274235ca73b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:05.143651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60b8fe-153d-4449-81fb-4274235ca73b service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:05.155118 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3261/6505] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:44:05.428169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e0164-42fa-4d5f-a233-47c10ec40903 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:05.429691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2e7e0164-42fa-4d5f-a233-47c10ec40903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:05.441722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e0164-42fa-4d5f-a233-47c10ec40903 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:05.446503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2648d1b-f31a-419f-a366-2c7a453e98dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:05.447416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2648d1b-f31a-419f-a366-2c7a453e98dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:05.447971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2648d1b-f31a-419f-a366-2c7a453e98dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:05.448341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2648d1b-f31a-419f-a366-2c7a453e98dd admin admin] PATH_INFO: `/v3/projects/708a81360bb349a1b0ac3f5d20b6133d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:05.449609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2648d1b-f31a-419f-a366-2c7a453e98dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=708a81360bb349a1b0ac3f5d20b6133d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:05.451648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2648d1b-f31a-419f-a366-2c7a453e98dd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:05.500029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60b8fe-153d-4449-81fb-4274235ca73b service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:05.502418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2f60b8fe-153d-4449-81fb-4274235ca73b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:05.518606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60b8fe-153d-4449-81fb-4274235ca73b service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:05.522781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf01062-0ed1-43fb-8c2f-abcd638546f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:05.523650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf01062-0ed1-43fb-8c2f-abcd638546f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:05.523939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf01062-0ed1-43fb-8c2f-abcd638546f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:05.524219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf01062-0ed1-43fb-8c2f-abcd638546f7 admin admin] PATH_INFO: `/v3/projects/63740057f4374c219d98c8190ccbcfe8` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:05.525487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf01062-0ed1-43fb-8c2f-abcd638546f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63740057f4374c219d98c8190ccbcfe8)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:05.527399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf01062-0ed1-43fb-8c2f-abcd638546f7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:05.622640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f2648d1b-f31a-419f-a366-2c7a453e98dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '708a81360bb349a1b0ac3f5d20b6133d', 'request_id': 'req-f2648d1b-f31a-419f-a366-2c7a453e98dd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:05.629355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f2648d1b-f31a-419f-a366-2c7a453e98dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '708a81360bb349a1b0ac3f5d20b6133d', 'request_id': 'req-f2648d1b-f31a-419f-a366-2c7a453e98dd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:05.672866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bbf01062-0ed1-43fb-8c2f-abcd638546f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63740057f4374c219d98c8190ccbcfe8', 'request_id': 'req-bbf01062-0ed1-43fb-8c2f-abcd638546f7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:05.741774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f2648d1b-f31a-419f-a366-2c7a453e98dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '708a81360bb349a1b0ac3f5d20b6133d', 'request_id': 'req-f2648d1b-f31a-419f-a366-2c7a453e98dd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:05.754458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f2648d1b-f31a-419f-a366-2c7a453e98dd admin admin] The token cache is being invalidate because project 708a81360bb349a1b0ac3f5d20b6133d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:44:05.754758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f2648d1b-f31a-419f-a366-2c7a453e98dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:05.755448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f2648d1b-f31a-419f-a366-2c7a453e98dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:05.757339 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3245/6506] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:44:05 2022] DELETE /identity/v3/projects/708a81360bb349a1b0ac3f5d20b6133d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:05.758428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118cad9-33b5-4178-9bdc-713b9fad25ed None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:05.758718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118cad9-33b5-4178-9bdc-713b9fad25ed None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:05.759029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118cad9-33b5-4178-9bdc-713b9fad25ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:05.785943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a118cad9-33b5-4178-9bdc-713b9fad25ed None None] MFA Rules not processed for user `94ca71f1e7f3431fa99e7f964e183c71`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:05.787750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a118cad9-33b5-4178-9bdc-713b9fad25ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:05.832750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bbf01062-0ed1-43fb-8c2f-abcd638546f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63740057f4374c219d98c8190ccbcfe8', 'request_id': 'req-bbf01062-0ed1-43fb-8c2f-abcd638546f7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:05.842002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bbf01062-0ed1-43fb-8c2f-abcd638546f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63740057f4374c219d98c8190ccbcfe8', 'request_id': 'req-bbf01062-0ed1-43fb-8c2f-abcd638546f7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:05.866114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bbf01062-0ed1-43fb-8c2f-abcd638546f7 admin admin] The token cache is being invalidate because project 63740057f4374c219d98c8190ccbcfe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:44:05.866114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bbf01062-0ed1-43fb-8c2f-abcd638546f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:05.866114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bbf01062-0ed1-43fb-8c2f-abcd638546f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:05.866114 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3262/6507] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:44:05 2022] DELETE /identity/v3/projects/63740057f4374c219d98c8190ccbcfe8 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:44:05.866114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf01062-0ed1-43fb-8c2f-abcd638546f7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:05.866557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bbf01062-0ed1-43fb-8c2f-abcd638546f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:05.866648 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3246/6508] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:05.866648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118cad9-33b5-4178-9bdc-713b9fad25ed None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:05.866648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a118cad9-33b5-4178-9bdc-713b9fad25ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:05.937387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118cad9-33b5-4178-9bdc-713b9fad25ed None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:05.943383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52f98e-37b3-484f-b1bf-c322e91006f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:05.944326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52f98e-37b3-484f-b1bf-c322e91006f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:05.944590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52f98e-37b3-484f-b1bf-c322e91006f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:05.944892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52f98e-37b3-484f-b1bf-c322e91006f0 admin admin] PATH_INFO: `/v3/users/f28da6ead7cf41949d3571d9035c7ff7` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:05.946117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52f98e-37b3-484f-b1bf-c322e91006f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f28da6ead7cf41949d3571d9035c7ff7)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:05.946362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf01062-0ed1-43fb-8c2f-abcd638546f7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:05.948080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52f98e-37b3-484f-b1bf-c322e91006f0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:05.951276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae28743-d026-4851-bbe3-7a4968ef9e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:05.952291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae28743-d026-4851-bbe3-7a4968ef9e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:05.952578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae28743-d026-4851-bbe3-7a4968ef9e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:05.952886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae28743-d026-4851-bbe3-7a4968ef9e06 admin admin] PATH_INFO: `/v3/users/2c2d33243ac64bb98285dc5cff7ba555` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:05.954146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae28743-d026-4851-bbe3-7a4968ef9e06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c2d33243ac64bb98285dc5cff7ba555)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:05.956046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae28743-d026-4851-bbe3-7a4968ef9e06 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:06.206521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bf52f98e-37b3-484f-b1bf-c322e91006f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f28da6ead7cf41949d3571d9035c7ff7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:06.219242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bf52f98e-37b3-484f-b1bf-c322e91006f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f28da6ead7cf41949d3571d9035c7ff7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:06.219942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bf52f98e-37b3-484f-b1bf-c322e91006f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f28da6ead7cf41949d3571d9035c7ff7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:06.227069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bf52f98e-37b3-484f-b1bf-c322e91006f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f28da6ead7cf41949d3571d9035c7ff7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:06.230483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2ae28743-d026-4851-bbe3-7a4968ef9e06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c2d33243ac64bb98285dc5cff7ba555'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:06.242810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2ae28743-d026-4851-bbe3-7a4968ef9e06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c2d33243ac64bb98285dc5cff7ba555'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:06.243701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2ae28743-d026-4851-bbe3-7a4968ef9e06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c2d33243ac64bb98285dc5cff7ba555'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:06.250292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2ae28743-d026-4851-bbe3-7a4968ef9e06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c2d33243ac64bb98285dc5cff7ba555'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:06.306672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bf52f98e-37b3-484f-b1bf-c322e91006f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f28da6ead7cf41949d3571d9035c7ff7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:06.312773 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3247/6509] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:44:05 2022] DELETE /identity/v3/users/f28da6ead7cf41949d3571d9035c7ff7 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:06.315758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52f98e-37b3-484f-b1bf-c322e91006f0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:06.315758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bf52f98e-37b3-484f-b1bf-c322e91006f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:06.388957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52f98e-37b3-484f-b1bf-c322e91006f0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:06.395059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb1338-bb0d-432d-b45c-ec281a54b6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:06.395267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2ae28743-d026-4851-bbe3-7a4968ef9e06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c2d33243ac64bb98285dc5cff7ba555'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:06.395739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb1338-bb0d-432d-b45c-ec281a54b6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:06.396030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb1338-bb0d-432d-b45c-ec281a54b6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:06.396320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb1338-bb0d-432d-b45c-ec281a54b6d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:06.397225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb1338-bb0d-432d-b45c-ec281a54b6d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:06.399435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb1338-bb0d-432d-b45c-ec281a54b6d8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:06.403215 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3263/6510] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:44:05 2022] DELETE /identity/v3/users/2c2d33243ac64bb98285dc5cff7ba555 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:06.531023 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3248/6511] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:44:06 2022] POST /identity/v3/projects => generated 373 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:44:06.535727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae28743-d026-4851-bbe3-7a4968ef9e06 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:06.537290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2ae28743-d026-4851-bbe3-7a4968ef9e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:06.633109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae28743-d026-4851-bbe3-7a4968ef9e06 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:06.713614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eadff6-83aa-4ab7-b027-041ef9a230db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:06.714319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eadff6-83aa-4ab7-b027-041ef9a230db admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:06.714605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eadff6-83aa-4ab7-b027-041ef9a230db admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:06.714890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eadff6-83aa-4ab7-b027-041ef9a230db admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:06.716293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eadff6-83aa-4ab7-b027-041ef9a230db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:06.718473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eadff6-83aa-4ab7-b027-041ef9a230db admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:06.820404 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3264/6512] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:44:06 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:44:06.824774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb1338-bb0d-432d-b45c-ec281a54b6d8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:06.862993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb1338-bb0d-432d-b45c-ec281a54b6d8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:06.877036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f6838-ac22-4e67-a27f-5188b568f31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:06.877947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f6838-ac22-4e67-a27f-5188b568f31d admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:06.878826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f6838-ac22-4e67-a27f-5188b568f31d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:06.879270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f6838-ac22-4e67-a27f-5188b568f31d admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:06.880208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f6838-ac22-4e67-a27f-5188b568f31d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:06.896503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f6838-ac22-4e67-a27f-5188b568f31d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:06.917460 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3249/6513] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:44:06.918837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eadff6-83aa-4ab7-b027-041ef9a230db admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:06.933546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eadff6-83aa-4ab7-b027-041ef9a230db admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:06.943599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f6838-ac22-4e67-a27f-5188b568f31d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:06.946757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-264f6838-ac22-4e67-a27f-5188b568f31d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:06.951869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f3e4d-cf6d-4edd-9b93-eb92e940548d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:06.953020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f3e4d-cf6d-4edd-9b93-eb92e940548d admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:06.953313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f3e4d-cf6d-4edd-9b93-eb92e940548d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:06.953596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f3e4d-cf6d-4edd-9b93-eb92e940548d admin admin] PATH_INFO: `/v3/projects/99f6e3a430b848d9b8803b59505a2c43/users/25a16d9a46824f52b882c44031f96948/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:06.971639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f6838-ac22-4e67-a27f-5188b568f31d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:06.984656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2f5b4-5fb2-4a7e-9f7f-325a448a1daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:06.986068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2f5b4-5fb2-4a7e-9f7f-325a448a1daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:06.986551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2f5b4-5fb2-4a7e-9f7f-325a448a1daf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:06.987644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2f5b4-5fb2-4a7e-9f7f-325a448a1daf admin admin] PATH_INFO: `/v3/projects/b03f02d687d24a6493bc2d150cef4242` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:06.990637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2f5b4-5fb2-4a7e-9f7f-325a448a1daf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b03f02d687d24a6493bc2d150cef4242)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:06.996190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2f5b4-5fb2-4a7e-9f7f-325a448a1daf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:07.007239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f3e4d-cf6d-4edd-9b93-eb92e940548d admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f6e3a430b848d9b8803b59505a2c43, user_id=25a16d9a46824f52b882c44031f96948, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:07.013448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f3e4d-cf6d-4edd-9b93-eb92e940548d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:07.179524 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3265/6514] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:44:06 2022] PUT /identity/v3/projects/99f6e3a430b848d9b8803b59505a2c43/users/25a16d9a46824f52b882c44031f96948/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:07.184033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f3e4d-cf6d-4edd-9b93-eb92e940548d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:07.219678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b5b2f5b4-5fb2-4a7e-9f7f-325a448a1daf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b03f02d687d24a6493bc2d150cef4242', 'request_id': 'req-b5b2f5b4-5fb2-4a7e-9f7f-325a448a1daf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:07.238581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b5b2f5b4-5fb2-4a7e-9f7f-325a448a1daf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b03f02d687d24a6493bc2d150cef4242', 'request_id': 'req-b5b2f5b4-5fb2-4a7e-9f7f-325a448a1daf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:07.297459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f3e4d-cf6d-4edd-9b93-eb92e940548d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:07.320647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b5b2f5b4-5fb2-4a7e-9f7f-325a448a1daf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b03f02d687d24a6493bc2d150cef4242', 'request_id': 'req-b5b2f5b4-5fb2-4a7e-9f7f-325a448a1daf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:07.335864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b5b2f5b4-5fb2-4a7e-9f7f-325a448a1daf admin admin] The token cache is being invalidate because project b03f02d687d24a6493bc2d150cef4242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:44:07.336168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b5b2f5b4-5fb2-4a7e-9f7f-325a448a1daf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:07.346097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b5b2f5b4-5fb2-4a7e-9f7f-325a448a1daf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:07.346097 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3250/6515] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:44:06 2022] DELETE /identity/v3/projects/b03f02d687d24a6493bc2d150cef4242 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:07.346969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2f5b4-5fb2-4a7e-9f7f-325a448a1daf admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:07.353521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b5b2f5b4-5fb2-4a7e-9f7f-325a448a1daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:07.377774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25d96d-0892-46f7-a941-aeb80baf7cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:07.378914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25d96d-0892-46f7-a941-aeb80baf7cfb admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:07.379536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25d96d-0892-46f7-a941-aeb80baf7cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:07.380528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25d96d-0892-46f7-a941-aeb80baf7cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:07.381586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25d96d-0892-46f7-a941-aeb80baf7cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:07.383806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25d96d-0892-46f7-a941-aeb80baf7cfb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:07.405216 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3266/6516] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:44:07.407292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad34208-b480-4fee-9b6f-b608d36e1d7c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:07.407778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad34208-b480-4fee-9b6f-b608d36e1d7c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:07.408328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad34208-b480-4fee-9b6f-b608d36e1d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:07.437390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2f5b4-5fb2-4a7e-9f7f-325a448a1daf admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:07.438309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1ad34208-b480-4fee-9b6f-b608d36e1d7c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:07.439954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1ad34208-b480-4fee-9b6f-b608d36e1d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:07.444881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ffb49-ef3c-4e89-b80d-e234214805b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:07.446015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ffb49-ef3c-4e89-b80d-e234214805b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:07.446493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ffb49-ef3c-4e89-b80d-e234214805b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:07.447024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ffb49-ef3c-4e89-b80d-e234214805b6 admin admin] PATH_INFO: `/v3/projects/20c47e9670d14d4e8f1cab1c4f9b92fe` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:07.448828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ffb49-ef3c-4e89-b80d-e234214805b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20c47e9670d14d4e8f1cab1c4f9b92fe)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:07.452027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ffb49-ef3c-4e89-b80d-e234214805b6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:07.456672 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3267/6517] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:07.457852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad34208-b480-4fee-9b6f-b608d36e1d7c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:07.464761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1ad34208-b480-4fee-9b6f-b608d36e1d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:07.479428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad34208-b480-4fee-9b6f-b608d36e1d7c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:07.484717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d952b5-9156-46eb-baa6-8bcf3fac7c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:07.485668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d952b5-9156-46eb-baa6-8bcf3fac7c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:07.485973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d952b5-9156-46eb-baa6-8bcf3fac7c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:07.486368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d952b5-9156-46eb-baa6-8bcf3fac7c1f admin admin] PATH_INFO: `/v3/projects/99f6e3a430b848d9b8803b59505a2c43/users/25a16d9a46824f52b882c44031f96948/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:07.488857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d952b5-9156-46eb-baa6-8bcf3fac7c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f6e3a430b848d9b8803b59505a2c43, user_id=25a16d9a46824f52b882c44031f96948, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:07.491615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d952b5-9156-46eb-baa6-8bcf3fac7c1f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:07.508633 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3268/6518] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:44:07 2022] PUT /identity/v3/projects/99f6e3a430b848d9b8803b59505a2c43/users/25a16d9a46824f52b882c44031f96948/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:07.508633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a148e-1718-4cba-a756-772bc864bfb2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:07.508633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a148e-1718-4cba-a756-772bc864bfb2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:07.508633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a148e-1718-4cba-a756-772bc864bfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:07.527128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fd8a148e-1718-4cba-a756-772bc864bfb2 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:07.528650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fd8a148e-1718-4cba-a756-772bc864bfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:07.593017 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3269/6519] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:07.593952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a148e-1718-4cba-a756-772bc864bfb2 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:07.603227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a148e-1718-4cba-a756-772bc864bfb2 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:07.613874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d74ffb49-ef3c-4e89-b80d-e234214805b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20c47e9670d14d4e8f1cab1c4f9b92fe', 'request_id': 'req-d74ffb49-ef3c-4e89-b80d-e234214805b6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:07.621280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d74ffb49-ef3c-4e89-b80d-e234214805b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20c47e9670d14d4e8f1cab1c4f9b92fe', 'request_id': 'req-d74ffb49-ef3c-4e89-b80d-e234214805b6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:07.663049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ff051-ebd0-4ccc-96f1-80f38a4ca646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:07.663765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ff051-ebd0-4ccc-96f1-80f38a4ca646 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:07.664018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ff051-ebd0-4ccc-96f1-80f38a4ca646 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:07.664300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ff051-ebd0-4ccc-96f1-80f38a4ca646 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:07.665072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ff051-ebd0-4ccc-96f1-80f38a4ca646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:44:07.665383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ff051-ebd0-4ccc-96f1-80f38a4ca646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:07.666988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ff051-ebd0-4ccc-96f1-80f38a4ca646 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:07.686418 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3270/6520] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:44:07.687532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ff051-ebd0-4ccc-96f1-80f38a4ca646 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:07.698264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ff051-ebd0-4ccc-96f1-80f38a4ca646 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:07.700472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d74ffb49-ef3c-4e89-b80d-e234214805b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20c47e9670d14d4e8f1cab1c4f9b92fe', 'request_id': 'req-d74ffb49-ef3c-4e89-b80d-e234214805b6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:07.704402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acc918-a6f8-480d-b044-e5ae0d32773c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:07.705145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acc918-a6f8-480d-b044-e5ae0d32773c admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:07.705400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acc918-a6f8-480d-b044-e5ae0d32773c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:07.705661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acc918-a6f8-480d-b044-e5ae0d32773c admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:07.706362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acc918-a6f8-480d-b044-e5ae0d32773c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:07.709122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acc918-a6f8-480d-b044-e5ae0d32773c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:07.712859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d74ffb49-ef3c-4e89-b80d-e234214805b6 admin admin] The token cache is being invalidate because project 20c47e9670d14d4e8f1cab1c4f9b92fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:44:07.713225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d74ffb49-ef3c-4e89-b80d-e234214805b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:07.714454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d74ffb49-ef3c-4e89-b80d-e234214805b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:07.716483 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3251/6521] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:44:07 2022] DELETE /identity/v3/projects/20c47e9670d14d4e8f1cab1c4f9b92fe => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:07.721661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab132d3b-29eb-420f-9df3-3a264759b77f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:07.722183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab132d3b-29eb-420f-9df3-3a264759b77f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:07.722574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab132d3b-29eb-420f-9df3-3a264759b77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:07.741866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ab132d3b-29eb-420f-9df3-3a264759b77f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:07.743180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ab132d3b-29eb-420f-9df3-3a264759b77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:07.752372 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3252/6522] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:07.761503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd34ebc-e86f-4e9b-9319-0f87e9ebcffb None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:07.762080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd34ebc-e86f-4e9b-9319-0f87e9ebcffb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:07.762928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd34ebc-e86f-4e9b-9319-0f87e9ebcffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:07.783307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0fd34ebc-e86f-4e9b-9319-0f87e9ebcffb None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:07.784479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0fd34ebc-e86f-4e9b-9319-0f87e9ebcffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:07.796166 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3253/6523] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:07.797255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd34ebc-e86f-4e9b-9319-0f87e9ebcffb None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:07.808328 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3271/6524] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:44:07 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:44:07.808523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd34ebc-e86f-4e9b-9319-0f87e9ebcffb None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:07.809776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acc918-a6f8-480d-b044-e5ae0d32773c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:07.811478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e7acc918-a6f8-480d-b044-e5ae0d32773c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:07.869918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73994b-6a96-44a1-a0dd-50e4bcff839f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:07.870694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73994b-6a96-44a1-a0dd-50e4bcff839f admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:07.871584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73994b-6a96-44a1-a0dd-50e4bcff839f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:07.871882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73994b-6a96-44a1-a0dd-50e4bcff839f admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:07.872653 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73994b-6a96-44a1-a0dd-50e4bcff839f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:44:07.873028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73994b-6a96-44a1-a0dd-50e4bcff839f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:07.874670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73994b-6a96-44a1-a0dd-50e4bcff839f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:07.886722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acc918-a6f8-480d-b044-e5ae0d32773c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:07.893205 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3254/6525] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:44:07.894691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73994b-6a96-44a1-a0dd-50e4bcff839f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:07.895582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b53e2-3934-4ee5-8440-c5ee906736a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:07.897231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b53e2-3934-4ee5-8440-c5ee906736a8 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:07.899018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b53e2-3934-4ee5-8440-c5ee906736a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:07.899367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b53e2-3934-4ee5-8440-c5ee906736a8 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:07.900153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b53e2-3934-4ee5-8440-c5ee906736a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:07.902944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b53e2-3934-4ee5-8440-c5ee906736a8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:07.906981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73994b-6a96-44a1-a0dd-50e4bcff839f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:07.921372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52702a-48fb-47bb-b289-c08a8f6a7326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:07.922352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52702a-48fb-47bb-b289-c08a8f6a7326 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:07.922697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52702a-48fb-47bb-b289-c08a8f6a7326 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:07.923045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52702a-48fb-47bb-b289-c08a8f6a7326 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:07.923863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52702a-48fb-47bb-b289-c08a8f6a7326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:07.926149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52702a-48fb-47bb-b289-c08a8f6a7326 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:08.038271 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3272/6526] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:44:07 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:44:08.039150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b53e2-3934-4ee5-8440-c5ee906736a8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:08.050224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b53e2-3934-4ee5-8440-c5ee906736a8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:08.056371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2292a-e4da-45a3-9fbd-7233da25a1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:08.057410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2292a-e4da-45a3-9fbd-7233da25a1bd admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:08.057763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2292a-e4da-45a3-9fbd-7233da25a1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:08.058119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2292a-e4da-45a3-9fbd-7233da25a1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:08.058932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2292a-e4da-45a3-9fbd-7233da25a1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:08.060627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a2292a-e4da-45a3-9fbd-7233da25a1bd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:08.075158 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3273/6527] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:44:08.076363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2292a-e4da-45a3-9fbd-7233da25a1bd admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:08.088269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2292a-e4da-45a3-9fbd-7233da25a1bd admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:08.098453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e091c-8d7f-43e4-8c56-f04523b92aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:08.099313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e091c-8d7f-43e4-8c56-f04523b92aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:08.102296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e091c-8d7f-43e4-8c56-f04523b92aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:08.102296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e091c-8d7f-43e4-8c56-f04523b92aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:08.102296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e091c-8d7f-43e4-8c56-f04523b92aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:08.102866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e091c-8d7f-43e4-8c56-f04523b92aa7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:08.125415 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3255/6528] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:44:07 2022] POST /identity/v3/projects => generated 385 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:44:08.125613 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3274/6529] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:44:08.125715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cceba7-8b77-4c93-a48b-3dd83cb86fd6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:08.125715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cceba7-8b77-4c93-a48b-3dd83cb86fd6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:08.125715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cceba7-8b77-4c93-a48b-3dd83cb86fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:08.126503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e091c-8d7f-43e4-8c56-f04523b92aa7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:08.138520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e091c-8d7f-43e4-8c56-f04523b92aa7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:08.148284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-68cceba7-8b77-4c93-a48b-3dd83cb86fd6 None None] MFA Rules not processed for user `26723e7d6f3d44a4951432f45c89021a`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:08.149866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-68cceba7-8b77-4c93-a48b-3dd83cb86fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:08.208349 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3256/6530] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:08.209696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cceba7-8b77-4c93-a48b-3dd83cb86fd6 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:08.216936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9b010-38da-41c4-a79c-ee50c83a4eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:08.218083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9b010-38da-41c4-a79c-ee50c83a4eaf admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:08.218343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9b010-38da-41c4-a79c-ee50c83a4eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:08.218717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9b010-38da-41c4-a79c-ee50c83a4eaf admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:08.219498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9b010-38da-41c4-a79c-ee50c83a4eaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:08.221885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9b010-38da-41c4-a79c-ee50c83a4eaf admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:08.290625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cceba7-8b77-4c93-a48b-3dd83cb86fd6 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:08.297887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9ce61-e563-48b3-b570-ff98868d2ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:08.299342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9ce61-e563-48b3-b570-ff98868d2ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:08.299730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9ce61-e563-48b3-b570-ff98868d2ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:08.300202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9ce61-e563-48b3-b570-ff98868d2ee4 admin admin] PATH_INFO: `/v3/projects/e291c6cb91954054afb0f31d5d08ec32/users/710bec9b0fbb4c029009e0381e04499e/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:08.320356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9ce61-e563-48b3-b570-ff98868d2ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e291c6cb91954054afb0f31d5d08ec32, user_id=710bec9b0fbb4c029009e0381e04499e, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:08.323554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9ce61-e563-48b3-b570-ff98868d2ee4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:08.364893 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3275/6531] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:44:08 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:44:08.369026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9b010-38da-41c4-a79c-ee50c83a4eaf admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:08.379540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9b010-38da-41c4-a79c-ee50c83a4eaf admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:08.384735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec423f-50ca-43a5-94e4-8221790c4069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:08.385404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec423f-50ca-43a5-94e4-8221790c4069 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:08.385689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec423f-50ca-43a5-94e4-8221790c4069 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:08.385965 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec423f-50ca-43a5-94e4-8221790c4069 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:08.386691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec423f-50ca-43a5-94e4-8221790c4069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:08.388287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec423f-50ca-43a5-94e4-8221790c4069 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:08.398689 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3276/6532] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:44:08.402462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec423f-50ca-43a5-94e4-8221790c4069 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:08.413490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec423f-50ca-43a5-94e4-8221790c4069 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:08.419119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73b464-67df-4e9e-888c-393cca4436b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:08.420254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73b464-67df-4e9e-888c-393cca4436b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:08.420515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73b464-67df-4e9e-888c-393cca4436b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:08.433670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73b464-67df-4e9e-888c-393cca4436b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:08.433670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73b464-67df-4e9e-888c-393cca4436b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:08.433670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73b464-67df-4e9e-888c-393cca4436b6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:08.434104 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3257/6533] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:44:08 2022] PUT /identity/v3/projects/e291c6cb91954054afb0f31d5d08ec32/users/710bec9b0fbb4c029009e0381e04499e/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:08.437661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85e347-6ed4-468d-9005-61d813c32607 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:08.437960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85e347-6ed4-468d-9005-61d813c32607 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:08.438297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85e347-6ed4-468d-9005-61d813c32607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:08.456013 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3277/6534] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:44:08.458733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73b464-67df-4e9e-888c-393cca4436b6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:08.474977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73b464-67df-4e9e-888c-393cca4436b6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:08.480633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4b85e347-6ed4-468d-9005-61d813c32607 None None] MFA Rules not processed for user `710bec9b0fbb4c029009e0381e04499e`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:08.481934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4b85e347-6ed4-468d-9005-61d813c32607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:08.568958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887e6f0-ac9d-47bb-9cab-66320886b640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:08.570166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887e6f0-ac9d-47bb-9cab-66320886b640 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:08.570456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887e6f0-ac9d-47bb-9cab-66320886b640 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:08.570742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887e6f0-ac9d-47bb-9cab-66320886b640 admin admin] PATH_INFO: `/v3/projects/d733f6e5a1034ab7a4f7a0302ccacbf7/users/2ccaed476c6b44baa2c9fc2227123598/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:08.574790 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3258/6535] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:08.575559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85e347-6ed4-468d-9005-61d813c32607 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:08.588456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85e347-6ed4-468d-9005-61d813c32607 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:08.590799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887e6f0-ac9d-47bb-9cab-66320886b640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d733f6e5a1034ab7a4f7a0302ccacbf7, user_id=2ccaed476c6b44baa2c9fc2227123598, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:08.593763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887e6f0-ac9d-47bb-9cab-66320886b640 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:08.595104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776340db-e551-4249-b63a-666d670ee16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:08.595781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776340db-e551-4249-b63a-666d670ee16f admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:08.596065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776340db-e551-4249-b63a-666d670ee16f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:08.596509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776340db-e551-4249-b63a-666d670ee16f admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:08.597479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776340db-e551-4249-b63a-666d670ee16f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:08.600003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776340db-e551-4249-b63a-666d670ee16f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:08.683875 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3278/6536] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:44:08 2022] PUT /identity/v3/projects/d733f6e5a1034ab7a4f7a0302ccacbf7/users/2ccaed476c6b44baa2c9fc2227123598/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:44:08.694928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541b420-536b-49e9-b667-7d458d38192d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:08.695358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541b420-536b-49e9-b667-7d458d38192d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:08.695735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541b420-536b-49e9-b667-7d458d38192d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:08.724785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-7541b420-536b-49e9-b667-7d458d38192d None None] MFA Rules not processed for user `2ccaed476c6b44baa2c9fc2227123598`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:08.726026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7541b420-536b-49e9-b667-7d458d38192d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:08.796736 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3259/6537] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:44:08 2022] POST /identity/v3/projects => generated 383 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:44:08.800342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776340db-e551-4249-b63a-666d670ee16f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:08.815601 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3279/6538] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:44:08.816862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541b420-536b-49e9-b667-7d458d38192d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:08.881810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776340db-e551-4249-b63a-666d670ee16f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:08.886828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e45bd7-1a8f-4432-8326-d135eda53f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:08.887584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e45bd7-1a8f-4432-8326-d135eda53f8d admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:08.887942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e45bd7-1a8f-4432-8326-d135eda53f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:08.888360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e45bd7-1a8f-4432-8326-d135eda53f8d admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:08.889103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e45bd7-1a8f-4432-8326-d135eda53f8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:08.891090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e45bd7-1a8f-4432-8326-d135eda53f8d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:08.900350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541b420-536b-49e9-b667-7d458d38192d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:08.905317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbed7d3-3ac1-4ed4-86c6-a5aa91f434da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:08.906126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbed7d3-3ac1-4ed4-86c6-a5aa91f434da admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:08.906418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbed7d3-3ac1-4ed4-86c6-a5aa91f434da admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:08.906711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbed7d3-3ac1-4ed4-86c6-a5aa91f434da admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:08.907391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbed7d3-3ac1-4ed4-86c6-a5aa91f434da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:08.909319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbed7d3-3ac1-4ed4-86c6-a5aa91f434da admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:09.049758 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3260/6539] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:44:08 2022] POST /identity/v3/users => generated 298 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:44:09.055043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e45bd7-1a8f-4432-8326-d135eda53f8d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:09.067532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e45bd7-1a8f-4432-8326-d135eda53f8d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:09.072067 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3280/6540] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:44:08 2022] POST /identity/v3/projects => generated 385 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:44:09.075546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bd993-92f2-450a-a72a-df566c631872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:09.076249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbed7d3-3ac1-4ed4-86c6-a5aa91f434da admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:09.076435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bd993-92f2-450a-a72a-df566c631872 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:09.076864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bd993-92f2-450a-a72a-df566c631872 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:09.077948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bd993-92f2-450a-a72a-df566c631872 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:09.078897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bd993-92f2-450a-a72a-df566c631872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:09.081341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bd993-92f2-450a-a72a-df566c631872 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:09.095791 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3261/6541] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:44:09.101755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bd993-92f2-450a-a72a-df566c631872 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:09.113764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bd993-92f2-450a-a72a-df566c631872 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:09.197275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbed7d3-3ac1-4ed4-86c6-a5aa91f434da admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:09.202960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab83f0-8f93-42c0-9e76-7f57f4c7245e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:09.203694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab83f0-8f93-42c0-9e76-7f57f4c7245e admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:09.203983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab83f0-8f93-42c0-9e76-7f57f4c7245e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:09.204265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab83f0-8f93-42c0-9e76-7f57f4c7245e admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:09.205274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab83f0-8f93-42c0-9e76-7f57f4c7245e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:09.207191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab83f0-8f93-42c0-9e76-7f57f4c7245e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:09.230145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68e9cb-875e-4010-8e5e-b7d8aa81808a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:09.235632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68e9cb-875e-4010-8e5e-b7d8aa81808a admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:09.235997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68e9cb-875e-4010-8e5e-b7d8aa81808a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:09.236356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68e9cb-875e-4010-8e5e-b7d8aa81808a admin admin] PATH_INFO: `/v3/projects/af0761144a474d759a23d543fc8ef528/users/15e158910ca04db598f8482d5b6621b7/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:09.254187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68e9cb-875e-4010-8e5e-b7d8aa81808a admin admin] RBAC: Authorizing `identity:create_grant(project_id=af0761144a474d759a23d543fc8ef528, user_id=15e158910ca04db598f8482d5b6621b7, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:09.257851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68e9cb-875e-4010-8e5e-b7d8aa81808a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:09.323696 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3281/6542] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:44:09 2022] POST /identity/v3/users => generated 300 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:44:09.327572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab83f0-8f93-42c0-9e76-7f57f4c7245e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:09.351677 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3262/6543] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:44:09 2022] PUT /identity/v3/projects/af0761144a474d759a23d543fc8ef528/users/15e158910ca04db598f8482d5b6621b7/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:09.355521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68e9cb-875e-4010-8e5e-b7d8aa81808a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:09.357018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab83f0-8f93-42c0-9e76-7f57f4c7245e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:09.449790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153def1c-ce16-4ff5-a58e-a47aa5aa0812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:09.450870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153def1c-ce16-4ff5-a58e-a47aa5aa0812 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:09.451330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153def1c-ce16-4ff5-a58e-a47aa5aa0812 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:09.451727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153def1c-ce16-4ff5-a58e-a47aa5aa0812 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:09.452644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153def1c-ce16-4ff5-a58e-a47aa5aa0812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:09.454530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153def1c-ce16-4ff5-a58e-a47aa5aa0812 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:09.465219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68e9cb-875e-4010-8e5e-b7d8aa81808a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:09.469803 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3282/6544] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:44:09.473483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153def1c-ce16-4ff5-a58e-a47aa5aa0812 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:09.480438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc7211-d707-48d8-976f-2fb7966e01f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:09.481176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc7211-d707-48d8-976f-2fb7966e01f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:09.481469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc7211-d707-48d8-976f-2fb7966e01f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:09.481751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc7211-d707-48d8-976f-2fb7966e01f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:09.482494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc7211-d707-48d8-976f-2fb7966e01f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:09.484121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc7211-d707-48d8-976f-2fb7966e01f9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:09.485281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153def1c-ce16-4ff5-a58e-a47aa5aa0812 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:09.498922 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3263/6545] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:44:09.499534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62bdae-355c-4196-8b47-e17ea0ec7587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:09.501444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62bdae-355c-4196-8b47-e17ea0ec7587 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:09.501737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62bdae-355c-4196-8b47-e17ea0ec7587 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:09.502544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62bdae-355c-4196-8b47-e17ea0ec7587 admin admin] PATH_INFO: `/v3/projects/502245b54c364a719c373cc3793722ec/users/79aca7875fa849bf9577b3b7c1808c61/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:09.503475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc7211-d707-48d8-976f-2fb7966e01f9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:09.523671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62bdae-355c-4196-8b47-e17ea0ec7587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=502245b54c364a719c373cc3793722ec, user_id=79aca7875fa849bf9577b3b7c1808c61, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:09.527186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62bdae-355c-4196-8b47-e17ea0ec7587 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:09.541288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc7211-d707-48d8-976f-2fb7966e01f9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:09.546395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf3cce-697c-4e95-9db2-c91e8af4e7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:09.547380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf3cce-697c-4e95-9db2-c91e8af4e7eb admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:09.547779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf3cce-697c-4e95-9db2-c91e8af4e7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:09.547999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf3cce-697c-4e95-9db2-c91e8af4e7eb admin admin] PATH_INFO: `/v3/projects/af0761144a474d759a23d543fc8ef528/users/15e158910ca04db598f8482d5b6621b7/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:09.550068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf3cce-697c-4e95-9db2-c91e8af4e7eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=af0761144a474d759a23d543fc8ef528, user_id=15e158910ca04db598f8482d5b6621b7, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:09.553509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf3cce-697c-4e95-9db2-c91e8af4e7eb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:09.567943 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3264/6546] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:44:09 2022] PUT /identity/v3/projects/af0761144a474d759a23d543fc8ef528/users/15e158910ca04db598f8482d5b6621b7/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:09.578333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284721d-3f5a-492d-b0ce-c817d43b4261 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:09.578743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284721d-3f5a-492d-b0ce-c817d43b4261 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:09.579118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284721d-3f5a-492d-b0ce-c817d43b4261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:09.608343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6284721d-3f5a-492d-b0ce-c817d43b4261 None None] MFA Rules not processed for user `15e158910ca04db598f8482d5b6621b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:09.609630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6284721d-3f5a-492d-b0ce-c817d43b4261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:09.653896 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3283/6547] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:44:09 2022] PUT /identity/v3/projects/502245b54c364a719c373cc3793722ec/users/79aca7875fa849bf9577b3b7c1808c61/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:09.666720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013423a7-2407-47b1-833d-830efd014973 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:09.667207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013423a7-2407-47b1-833d-830efd014973 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:09.667497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013423a7-2407-47b1-833d-830efd014973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:09.709517 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3265/6548] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:44:09.717064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-013423a7-2407-47b1-833d-830efd014973 None None] MFA Rules not processed for user `79aca7875fa849bf9577b3b7c1808c61`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:09.718745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-013423a7-2407-47b1-833d-830efd014973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:09.720472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284721d-3f5a-492d-b0ce-c817d43b4261 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:09.722812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6284721d-3f5a-492d-b0ce-c817d43b4261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:09.799969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284721d-3f5a-492d-b0ce-c817d43b4261 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:09.824349 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3284/6549] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:09 2022] POST /identity/v3/auth/tokens => generated 3259 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:09.866584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae3e18-003f-4e08-b150-2c8cb6fd1bc7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:09.866905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae3e18-003f-4e08-b150-2c8cb6fd1bc7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:09.867161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae3e18-003f-4e08-b150-2c8cb6fd1bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:09.917425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07efbea-bfbf-4237-b105-a95e91c253d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:09.918736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07efbea-bfbf-4237-b105-a95e91c253d5 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:09.919296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07efbea-bfbf-4237-b105-a95e91c253d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:09.920351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07efbea-bfbf-4237-b105-a95e91c253d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:09.923483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-89ae3e18-003f-4e08-b150-2c8cb6fd1bc7 None None] MFA Rules not processed for user `25a16d9a46824f52b882c44031f96948`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:09.925365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-89ae3e18-003f-4e08-b150-2c8cb6fd1bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:09.997060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07efbea-bfbf-4237-b105-a95e91c253d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:09.999738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07efbea-bfbf-4237-b105-a95e91c253d5 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:10.012879 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3285/6550] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:10.012879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae3e18-003f-4e08-b150-2c8cb6fd1bc7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:10.012879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-89ae3e18-003f-4e08-b150-2c8cb6fd1bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:10.019206 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3266/6551] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:44:10.021675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a3d85-65af-49a9-9897-801d8a094d52 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:10.022085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a3d85-65af-49a9-9897-801d8a094d52 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:10.022527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a3d85-65af-49a9-9897-801d8a094d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:10.043330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8d5a3d85-65af-49a9-9897-801d8a094d52 None None] MFA Rules not processed for user `94ca71f1e7f3431fa99e7f964e183c71`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:10.044170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8d5a3d85-65af-49a9-9897-801d8a094d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:10.091415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae3e18-003f-4e08-b150-2c8cb6fd1bc7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:10.096955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a09b1b-a020-45fb-953f-b3198bfcb111 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:10.097687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a09b1b-a020-45fb-953f-b3198bfcb111 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:10.098050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a09b1b-a020-45fb-953f-b3198bfcb111 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:10.098424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a09b1b-a020-45fb-953f-b3198bfcb111 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:10.117719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a09b1b-a020-45fb-953f-b3198bfcb111 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:10.120054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a09b1b-a020-45fb-953f-b3198bfcb111 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:10.150563 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3286/6552] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:44:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:44:10.275960 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3267/6553] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:10.287607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a09b1b-a020-45fb-953f-b3198bfcb111 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:10.289217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a6a09b1b-a020-45fb-953f-b3198bfcb111 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:10.407895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a09b1b-a020-45fb-953f-b3198bfcb111 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:10.413738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d894afe-dc1a-4469-8827-64ddf620c614 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:10.414401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d894afe-dc1a-4469-8827-64ddf620c614 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:10.414684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d894afe-dc1a-4469-8827-64ddf620c614 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:10.414964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d894afe-dc1a-4469-8827-64ddf620c614 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:10.416921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7d894afe-dc1a-4469-8827-64ddf620c614 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:10.428047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d894afe-dc1a-4469-8827-64ddf620c614 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:10.429577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d894afe-dc1a-4469-8827-64ddf620c614 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:10.441568 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3287/6554] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:44:12.545646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a3d85-65af-49a9-9897-801d8a094d52 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:12.547482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8d5a3d85-65af-49a9-9897-801d8a094d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:12.603379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a3d85-65af-49a9-9897-801d8a094d52 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:12.619069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30651080-cdd5-4f62-bd3f-80d5c41e082a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:12.620098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30651080-cdd5-4f62-bd3f-80d5c41e082a service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:12.620624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30651080-cdd5-4f62-bd3f-80d5c41e082a service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:12.621055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30651080-cdd5-4f62-bd3f-80d5c41e082a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:12.626168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-30651080-cdd5-4f62-bd3f-80d5c41e082a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:12.747346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30651080-cdd5-4f62-bd3f-80d5c41e082a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:12.749280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30651080-cdd5-4f62-bd3f-80d5c41e082a service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:12.770017 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3268/6555] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:44:13.598943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d894afe-dc1a-4469-8827-64ddf620c614 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:13.727217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d894afe-dc1a-4469-8827-64ddf620c614 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:13.740959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cacf0-80c2-4199-8242-8535a436e29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:13.742109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cacf0-80c2-4199-8242-8535a436e29b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:13.742699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cacf0-80c2-4199-8242-8535a436e29b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:13.743294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cacf0-80c2-4199-8242-8535a436e29b admin admin] PATH_INFO: `/v3/users/2ccaed476c6b44baa2c9fc2227123598` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:13.764060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cacf0-80c2-4199-8242-8535a436e29b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ccaed476c6b44baa2c9fc2227123598)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:13.768866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cacf0-80c2-4199-8242-8535a436e29b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:14.040470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9d5cacf0-80c2-4199-8242-8535a436e29b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ccaed476c6b44baa2c9fc2227123598'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:14.066055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9d5cacf0-80c2-4199-8242-8535a436e29b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ccaed476c6b44baa2c9fc2227123598'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:14.069110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9d5cacf0-80c2-4199-8242-8535a436e29b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ccaed476c6b44baa2c9fc2227123598'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:14.086342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9d5cacf0-80c2-4199-8242-8535a436e29b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ccaed476c6b44baa2c9fc2227123598'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:14.173728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30651080-cdd5-4f62-bd3f-80d5c41e082a service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:14.185576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30651080-cdd5-4f62-bd3f-80d5c41e082a service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:14.189689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9d5cacf0-80c2-4199-8242-8535a436e29b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ccaed476c6b44baa2c9fc2227123598'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:14.191314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbcfc6-eede-42a8-9b82-fc4e91bae225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:14.192514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbcfc6-eede-42a8-9b82-fc4e91bae225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:14.193122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbcfc6-eede-42a8-9b82-fc4e91bae225 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:14.193555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbcfc6-eede-42a8-9b82-fc4e91bae225 admin admin] PATH_INFO: `/v3/users/710bec9b0fbb4c029009e0381e04499e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:14.194990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbcfc6-eede-42a8-9b82-fc4e91bae225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=710bec9b0fbb4c029009e0381e04499e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:14.197031 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3288/6556] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:44:13 2022] DELETE /identity/v3/users/2ccaed476c6b44baa2c9fc2227123598 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:14.197329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbcfc6-eede-42a8-9b82-fc4e91bae225 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:14.203257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3fd8e-a42e-4ea2-a441-d9ccde35495a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:14.204778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3fd8e-a42e-4ea2-a441-d9ccde35495a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:14.205159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3fd8e-a42e-4ea2-a441-d9ccde35495a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:14.227206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-12a3fd8e-a42e-4ea2-a441-d9ccde35495a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:14.231007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-12a3fd8e-a42e-4ea2-a441-d9ccde35495a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:14.299205 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3289/6557] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:14.309990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3fd8e-a42e-4ea2-a441-d9ccde35495a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:14.311577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-12a3fd8e-a42e-4ea2-a441-d9ccde35495a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:14.382771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3fd8e-a42e-4ea2-a441-d9ccde35495a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:14.386869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a8de90-215f-473e-adb6-4a67b0faa28e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:14.387866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8de90-215f-473e-adb6-4a67b0faa28e service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:14.388163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8de90-215f-473e-adb6-4a67b0faa28e service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:14.388491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8de90-215f-473e-adb6-4a67b0faa28e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:14.399919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a8de90-215f-473e-adb6-4a67b0faa28e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:14.401397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a8de90-215f-473e-adb6-4a67b0faa28e service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:14.412871 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3290/6558] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:44:14.414877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c1cbcfc6-eede-42a8-9b82-fc4e91bae225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '710bec9b0fbb4c029009e0381e04499e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:14.431233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c1cbcfc6-eede-42a8-9b82-fc4e91bae225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '710bec9b0fbb4c029009e0381e04499e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:14.432128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c1cbcfc6-eede-42a8-9b82-fc4e91bae225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '710bec9b0fbb4c029009e0381e04499e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:14.446028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c1cbcfc6-eede-42a8-9b82-fc4e91bae225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '710bec9b0fbb4c029009e0381e04499e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:14.559970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c1cbcfc6-eede-42a8-9b82-fc4e91bae225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '710bec9b0fbb4c029009e0381e04499e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:14.567045 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3269/6559] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:44:14 2022] DELETE /identity/v3/users/710bec9b0fbb4c029009e0381e04499e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:44:14.571620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0359bd3-41ea-4439-b5fb-c5b2a6963aab None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:14.571910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0359bd3-41ea-4439-b5fb-c5b2a6963aab None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:14.572192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0359bd3-41ea-4439-b5fb-c5b2a6963aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:14.590236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c0359bd3-41ea-4439-b5fb-c5b2a6963aab None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:14.591452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c0359bd3-41ea-4439-b5fb-c5b2a6963aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:14.666761 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3291/6560] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:14.693003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbcfc6-eede-42a8-9b82-fc4e91bae225 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:14.694621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c1cbcfc6-eede-42a8-9b82-fc4e91bae225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:14.781105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbcfc6-eede-42a8-9b82-fc4e91bae225 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:14.785582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4018a8-077c-4135-b716-17c439af1371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:14.787446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4018a8-077c-4135-b716-17c439af1371 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:14.787961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4018a8-077c-4135-b716-17c439af1371 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:14.788463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4018a8-077c-4135-b716-17c439af1371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:14.804243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4018a8-077c-4135-b716-17c439af1371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:14.812989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4018a8-077c-4135-b716-17c439af1371 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:14.827587 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3270/6561] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:44:14.965358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0359bd3-41ea-4439-b5fb-c5b2a6963aab None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:14.966829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c0359bd3-41ea-4439-b5fb-c5b2a6963aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:14.983396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0359bd3-41ea-4439-b5fb-c5b2a6963aab None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:14.990110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a0a67-2bf7-41c8-95bc-a4b82bb2731c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:14.991138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a0a67-2bf7-41c8-95bc-a4b82bb2731c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:14.991426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a0a67-2bf7-41c8-95bc-a4b82bb2731c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:14.991778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a0a67-2bf7-41c8-95bc-a4b82bb2731c admin admin] PATH_INFO: `/v3/projects/d733f6e5a1034ab7a4f7a0302ccacbf7` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:14.993574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a0a67-2bf7-41c8-95bc-a4b82bb2731c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d733f6e5a1034ab7a4f7a0302ccacbf7)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:14.996647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a0a67-2bf7-41c8-95bc-a4b82bb2731c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:15.111431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b33a0a67-2bf7-41c8-95bc-a4b82bb2731c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd733f6e5a1034ab7a4f7a0302ccacbf7', 'request_id': 'req-b33a0a67-2bf7-41c8-95bc-a4b82bb2731c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:15.200573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b33a0a67-2bf7-41c8-95bc-a4b82bb2731c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd733f6e5a1034ab7a4f7a0302ccacbf7', 'request_id': 'req-b33a0a67-2bf7-41c8-95bc-a4b82bb2731c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:15.207431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b33a0a67-2bf7-41c8-95bc-a4b82bb2731c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd733f6e5a1034ab7a4f7a0302ccacbf7', 'request_id': 'req-b33a0a67-2bf7-41c8-95bc-a4b82bb2731c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:15.218678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b33a0a67-2bf7-41c8-95bc-a4b82bb2731c admin admin] The token cache is being invalidate because project d733f6e5a1034ab7a4f7a0302ccacbf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:44:15.219168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b33a0a67-2bf7-41c8-95bc-a4b82bb2731c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:15.219825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b33a0a67-2bf7-41c8-95bc-a4b82bb2731c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:15.224277 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3292/6562] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:44:14 2022] DELETE /identity/v3/projects/d733f6e5a1034ab7a4f7a0302ccacbf7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:15.225733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4018a8-077c-4135-b716-17c439af1371 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:15.235738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4018a8-077c-4135-b716-17c439af1371 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:15.292498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ddf00-6b1c-48ce-b6c2-7f6a255a5331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:15.293525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ddf00-6b1c-48ce-b6c2-7f6a255a5331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:15.294099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ddf00-6b1c-48ce-b6c2-7f6a255a5331 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:15.294542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ddf00-6b1c-48ce-b6c2-7f6a255a5331 admin admin] PATH_INFO: `/v3/users/79aca7875fa849bf9577b3b7c1808c61` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:15.296563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ddf00-6b1c-48ce-b6c2-7f6a255a5331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79aca7875fa849bf9577b3b7c1808c61)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:15.299180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ddf00-6b1c-48ce-b6c2-7f6a255a5331 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:15.496743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a0a67-2bf7-41c8-95bc-a4b82bb2731c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:15.498530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b33a0a67-2bf7-41c8-95bc-a4b82bb2731c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:15.516020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a0a67-2bf7-41c8-95bc-a4b82bb2731c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:15.521367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd5a4e-cf05-4821-910b-6d5e6f3631fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:15.522311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd5a4e-cf05-4821-910b-6d5e6f3631fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:15.527445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd5a4e-cf05-4821-910b-6d5e6f3631fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:15.527445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd5a4e-cf05-4821-910b-6d5e6f3631fd admin admin] PATH_INFO: `/v3/projects/e291c6cb91954054afb0f31d5d08ec32` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:15.527445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd5a4e-cf05-4821-910b-6d5e6f3631fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e291c6cb91954054afb0f31d5d08ec32)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:15.527445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd5a4e-cf05-4821-910b-6d5e6f3631fd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:15.603392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9b9ddf00-6b1c-48ce-b6c2-7f6a255a5331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79aca7875fa849bf9577b3b7c1808c61'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:15.622694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9b9ddf00-6b1c-48ce-b6c2-7f6a255a5331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79aca7875fa849bf9577b3b7c1808c61'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:15.623696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9b9ddf00-6b1c-48ce-b6c2-7f6a255a5331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79aca7875fa849bf9577b3b7c1808c61'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:15.631821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9b9ddf00-6b1c-48ce-b6c2-7f6a255a5331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79aca7875fa849bf9577b3b7c1808c61'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:15.691698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9cbd5a4e-cf05-4821-910b-6d5e6f3631fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e291c6cb91954054afb0f31d5d08ec32', 'request_id': 'req-9cbd5a4e-cf05-4821-910b-6d5e6f3631fd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:15.726055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9b9ddf00-6b1c-48ce-b6c2-7f6a255a5331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79aca7875fa849bf9577b3b7c1808c61'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:15.733469 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3271/6563] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:44:15 2022] DELETE /identity/v3/users/79aca7875fa849bf9577b3b7c1808c61 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:44:15.834128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9cbd5a4e-cf05-4821-910b-6d5e6f3631fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e291c6cb91954054afb0f31d5d08ec32', 'request_id': 'req-9cbd5a4e-cf05-4821-910b-6d5e6f3631fd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:15.843184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9cbd5a4e-cf05-4821-910b-6d5e6f3631fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e291c6cb91954054afb0f31d5d08ec32', 'request_id': 'req-9cbd5a4e-cf05-4821-910b-6d5e6f3631fd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:15.858631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9cbd5a4e-cf05-4821-910b-6d5e6f3631fd admin admin] The token cache is being invalidate because project e291c6cb91954054afb0f31d5d08ec32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:44:15.858844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9cbd5a4e-cf05-4821-910b-6d5e6f3631fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:15.859628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9cbd5a4e-cf05-4821-910b-6d5e6f3631fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:15.861722 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3293/6564] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:44:15 2022] DELETE /identity/v3/projects/e291c6cb91954054afb0f31d5d08ec32 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:44:15.866916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ddf00-6b1c-48ce-b6c2-7f6a255a5331 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:15.868622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9b9ddf00-6b1c-48ce-b6c2-7f6a255a5331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:15.954734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ddf00-6b1c-48ce-b6c2-7f6a255a5331 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:15.981847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fdee04-c5fd-4920-b5f8-ba07dc48be6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:15.982765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdee04-c5fd-4920-b5f8-ba07dc48be6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:15.983056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdee04-c5fd-4920-b5f8-ba07dc48be6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:15.983489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdee04-c5fd-4920-b5f8-ba07dc48be6c admin admin] PATH_INFO: `/v3/users/15e158910ca04db598f8482d5b6621b7` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:15.984859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdee04-c5fd-4920-b5f8-ba07dc48be6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e158910ca04db598f8482d5b6621b7)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:15.987047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdee04-c5fd-4920-b5f8-ba07dc48be6c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:16.244818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-56fdee04-c5fd-4920-b5f8-ba07dc48be6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e158910ca04db598f8482d5b6621b7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:16.263861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-56fdee04-c5fd-4920-b5f8-ba07dc48be6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e158910ca04db598f8482d5b6621b7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:16.265416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-56fdee04-c5fd-4920-b5f8-ba07dc48be6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e158910ca04db598f8482d5b6621b7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:16.273779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-56fdee04-c5fd-4920-b5f8-ba07dc48be6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e158910ca04db598f8482d5b6621b7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:16.372434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-56fdee04-c5fd-4920-b5f8-ba07dc48be6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e158910ca04db598f8482d5b6621b7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:16.381528 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3272/6565] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:44:15 2022] DELETE /identity/v3/users/15e158910ca04db598f8482d5b6621b7 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:16.415816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd5a4e-cf05-4821-910b-6d5e6f3631fd admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:16.417951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9cbd5a4e-cf05-4821-910b-6d5e6f3631fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:16.502650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd5a4e-cf05-4821-910b-6d5e6f3631fd admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:16.558994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934eea4-b838-4a47-a337-fc4eb0bcd27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:16.560209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934eea4-b838-4a47-a337-fc4eb0bcd27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:16.560768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934eea4-b838-4a47-a337-fc4eb0bcd27d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:16.560990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934eea4-b838-4a47-a337-fc4eb0bcd27d admin admin] PATH_INFO: `/v3/projects/502245b54c364a719c373cc3793722ec` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:16.562213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934eea4-b838-4a47-a337-fc4eb0bcd27d admin admin] RBAC: Authorizing `identity:delete_project(project_id=502245b54c364a719c373cc3793722ec)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:16.564361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934eea4-b838-4a47-a337-fc4eb0bcd27d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:16.645550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fdee04-c5fd-4920-b5f8-ba07dc48be6c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:16.647041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-56fdee04-c5fd-4920-b5f8-ba07dc48be6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:16.664210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fdee04-c5fd-4920-b5f8-ba07dc48be6c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:16.684210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0934eea4-b838-4a47-a337-fc4eb0bcd27d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '502245b54c364a719c373cc3793722ec', 'request_id': 'req-0934eea4-b838-4a47-a337-fc4eb0bcd27d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:16.740092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a578da-e881-4e88-83c0-27bdcdf010cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:16.741764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a578da-e881-4e88-83c0-27bdcdf010cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:16.742049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a578da-e881-4e88-83c0-27bdcdf010cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:16.742362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a578da-e881-4e88-83c0-27bdcdf010cb admin admin] PATH_INFO: `/v3/projects/af0761144a474d759a23d543fc8ef528` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:16.743644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a578da-e881-4e88-83c0-27bdcdf010cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=af0761144a474d759a23d543fc8ef528)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:16.745631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a578da-e881-4e88-83c0-27bdcdf010cb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:16.921953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0934eea4-b838-4a47-a337-fc4eb0bcd27d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '502245b54c364a719c373cc3793722ec', 'request_id': 'req-0934eea4-b838-4a47-a337-fc4eb0bcd27d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:16.921953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0934eea4-b838-4a47-a337-fc4eb0bcd27d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '502245b54c364a719c373cc3793722ec', 'request_id': 'req-0934eea4-b838-4a47-a337-fc4eb0bcd27d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:16.921953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0934eea4-b838-4a47-a337-fc4eb0bcd27d admin admin] The token cache is being invalidate because project 502245b54c364a719c373cc3793722ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:44:16.921953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0934eea4-b838-4a47-a337-fc4eb0bcd27d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:16.922875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0934eea4-b838-4a47-a337-fc4eb0bcd27d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:16.922875 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3294/6566] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:44:16 2022] DELETE /identity/v3/projects/502245b54c364a719c373cc3793722ec => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:17.062637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53a578da-e881-4e88-83c0-27bdcdf010cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af0761144a474d759a23d543fc8ef528', 'request_id': 'req-53a578da-e881-4e88-83c0-27bdcdf010cb'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:17.070239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53a578da-e881-4e88-83c0-27bdcdf010cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af0761144a474d759a23d543fc8ef528', 'request_id': 'req-53a578da-e881-4e88-83c0-27bdcdf010cb'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:17.201151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53a578da-e881-4e88-83c0-27bdcdf010cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af0761144a474d759a23d543fc8ef528', 'request_id': 'req-53a578da-e881-4e88-83c0-27bdcdf010cb'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:17.216522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53a578da-e881-4e88-83c0-27bdcdf010cb admin admin] The token cache is being invalidate because project af0761144a474d759a23d543fc8ef528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:44:17.217388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53a578da-e881-4e88-83c0-27bdcdf010cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:17.219995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53a578da-e881-4e88-83c0-27bdcdf010cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:17.228168 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3273/6567] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:44:16 2022] DELETE /identity/v3/projects/af0761144a474d759a23d543fc8ef528 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:17.233594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c17e3-ef01-468e-b32e-977e32117dd8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:17.234276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c17e3-ef01-468e-b32e-977e32117dd8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:17.234829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c17e3-ef01-468e-b32e-977e32117dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:17.264748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-229c17e3-ef01-468e-b32e-977e32117dd8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:17.266739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-229c17e3-ef01-468e-b32e-977e32117dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:17.378525 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3295/6568] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:17.393734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066f7fe-8da1-4a60-8d55-ebf8afb6adf2 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:17.394752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066f7fe-8da1-4a60-8d55-ebf8afb6adf2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:17.395904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066f7fe-8da1-4a60-8d55-ebf8afb6adf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:17.441514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b066f7fe-8da1-4a60-8d55-ebf8afb6adf2 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:17.443376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b066f7fe-8da1-4a60-8d55-ebf8afb6adf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:17.452337 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3274/6569] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:17.463633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c17e3-ef01-468e-b32e-977e32117dd8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:17.475418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c17e3-ef01-468e-b32e-977e32117dd8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:17.480466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0014791-5d76-485a-82e2-5cb68c15aa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:17.481187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0014791-5d76-485a-82e2-5cb68c15aa1b admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:17.481528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0014791-5d76-485a-82e2-5cb68c15aa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:17.481815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0014791-5d76-485a-82e2-5cb68c15aa1b admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:17.482553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0014791-5d76-485a-82e2-5cb68c15aa1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:44:17.482865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0014791-5d76-485a-82e2-5cb68c15aa1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:17.484651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0014791-5d76-485a-82e2-5cb68c15aa1b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:17.500681 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3296/6570] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:44:17.502262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066f7fe-8da1-4a60-8d55-ebf8afb6adf2 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:17.512270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066f7fe-8da1-4a60-8d55-ebf8afb6adf2 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:17.521691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf4377-a2b9-4b4a-a996-6eaebd6edf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:17.522477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf4377-a2b9-4b4a-a996-6eaebd6edf14 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:17.522763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf4377-a2b9-4b4a-a996-6eaebd6edf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:17.523044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf4377-a2b9-4b4a-a996-6eaebd6edf14 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:17.523896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf4377-a2b9-4b4a-a996-6eaebd6edf14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:17.525939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf4377-a2b9-4b4a-a996-6eaebd6edf14 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:17.631478 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3275/6571] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:44:17 2022] POST /identity/v3/projects => generated 391 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:44:17.635869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0014791-5d76-485a-82e2-5cb68c15aa1b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:17.646252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0014791-5d76-485a-82e2-5cb68c15aa1b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:17.708742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8c1e2-760d-4bb1-98ca-2c6c6d98d192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:17.709326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8c1e2-760d-4bb1-98ca-2c6c6d98d192 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:17.709609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8c1e2-760d-4bb1-98ca-2c6c6d98d192 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:17.709885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8c1e2-760d-4bb1-98ca-2c6c6d98d192 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:17.710589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8c1e2-760d-4bb1-98ca-2c6c6d98d192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:17.712510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8c1e2-760d-4bb1-98ca-2c6c6d98d192 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:17.834375 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3297/6572] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:44:17 2022] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:44:17.834515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf4377-a2b9-4b4a-a996-6eaebd6edf14 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:17.845316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf4377-a2b9-4b4a-a996-6eaebd6edf14 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:17.852061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec4f6b-0cec-4584-9862-659b9701463c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:17.856419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec4f6b-0cec-4584-9862-659b9701463c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:17.856419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec4f6b-0cec-4584-9862-659b9701463c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:17.856419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec4f6b-0cec-4584-9862-659b9701463c admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:17.856419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec4f6b-0cec-4584-9862-659b9701463c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:17.856419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec4f6b-0cec-4584-9862-659b9701463c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:17.869874 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3276/6573] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:44:17.873882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8c1e2-760d-4bb1-98ca-2c6c6d98d192 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:17.885029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8c1e2-760d-4bb1-98ca-2c6c6d98d192 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:17.890508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993e031-7241-437f-b78b-36bd273479cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:17.890676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993e031-7241-437f-b78b-36bd273479cd admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:17.890916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993e031-7241-437f-b78b-36bd273479cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:17.891195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993e031-7241-437f-b78b-36bd273479cd admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:17.891923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993e031-7241-437f-b78b-36bd273479cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:17.893564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993e031-7241-437f-b78b-36bd273479cd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:17.903652 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3298/6574] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:44:17.911915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec4f6b-0cec-4584-9862-659b9701463c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:17.922123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec4f6b-0cec-4584-9862-659b9701463c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:17.928143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5f601-6284-4aea-866d-3d4dd9d41fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:17.929281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5f601-6284-4aea-866d-3d4dd9d41fba admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:17.929581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5f601-6284-4aea-866d-3d4dd9d41fba admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:17.929771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5f601-6284-4aea-866d-3d4dd9d41fba admin admin] PATH_INFO: `/v3/projects/797df8f4984f40b5bc39c8c77283c4ae/users/61a80f1994f3460bad7205ddb558e6b4/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:17.945333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5f601-6284-4aea-866d-3d4dd9d41fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=797df8f4984f40b5bc39c8c77283c4ae, user_id=61a80f1994f3460bad7205ddb558e6b4, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:17.948036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5f601-6284-4aea-866d-3d4dd9d41fba admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:18.058773 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3277/6575] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:44:17 2022] PUT /identity/v3/projects/797df8f4984f40b5bc39c8c77283c4ae/users/61a80f1994f3460bad7205ddb558e6b4/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:18.069452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dfe17-99f9-496a-8e1c-245a22a545fc None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:18.070059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dfe17-99f9-496a-8e1c-245a22a545fc None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:18.070059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dfe17-99f9-496a-8e1c-245a22a545fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:18.106492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b21dfe17-99f9-496a-8e1c-245a22a545fc None None] MFA Rules not processed for user `61a80f1994f3460bad7205ddb558e6b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:18.110925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b21dfe17-99f9-496a-8e1c-245a22a545fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:18.173677 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3299/6576] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:18.184992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5f601-6284-4aea-866d-3d4dd9d41fba admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:18.186795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ecd5f601-6284-4aea-866d-3d4dd9d41fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:18.246111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5f601-6284-4aea-866d-3d4dd9d41fba admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:18.249715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9259b-b7d6-4333-b90b-524983458073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:18.250355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9259b-b7d6-4333-b90b-524983458073 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:18.250638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9259b-b7d6-4333-b90b-524983458073 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:18.251170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9259b-b7d6-4333-b90b-524983458073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:18.260138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9259b-b7d6-4333-b90b-524983458073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:18.261776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9259b-b7d6-4333-b90b-524983458073 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:18.272891 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3278/6577] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:44:18.312492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dfe17-99f9-496a-8e1c-245a22a545fc None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:18.374486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dfe17-99f9-496a-8e1c-245a22a545fc None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:18.379470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacfd76-5078-4650-a1ee-18b0a97bca44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:18.380342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacfd76-5078-4650-a1ee-18b0a97bca44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:18.380647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacfd76-5078-4650-a1ee-18b0a97bca44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:18.380925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacfd76-5078-4650-a1ee-18b0a97bca44 admin admin] PATH_INFO: `/v3/users/61a80f1994f3460bad7205ddb558e6b4` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:18.382213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacfd76-5078-4650-a1ee-18b0a97bca44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61a80f1994f3460bad7205ddb558e6b4)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:18.384065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacfd76-5078-4650-a1ee-18b0a97bca44 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:18.619617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5bacfd76-5078-4650-a1ee-18b0a97bca44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61a80f1994f3460bad7205ddb558e6b4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:18.635967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5bacfd76-5078-4650-a1ee-18b0a97bca44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61a80f1994f3460bad7205ddb558e6b4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:18.637118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5bacfd76-5078-4650-a1ee-18b0a97bca44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61a80f1994f3460bad7205ddb558e6b4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:18.659488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5bacfd76-5078-4650-a1ee-18b0a97bca44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61a80f1994f3460bad7205ddb558e6b4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:18.719876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5bacfd76-5078-4650-a1ee-18b0a97bca44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61a80f1994f3460bad7205ddb558e6b4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:18.726783 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3300/6578] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:44:18 2022] DELETE /identity/v3/users/61a80f1994f3460bad7205ddb558e6b4 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:18.731601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8959e-5b3e-422b-9f7c-13484aaab4eb None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:18.735422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8959e-5b3e-422b-9f7c-13484aaab4eb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:18.735422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8959e-5b3e-422b-9f7c-13484aaab4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:18.751269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-72c8959e-5b3e-422b-9f7c-13484aaab4eb None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:18.752567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-72c8959e-5b3e-422b-9f7c-13484aaab4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:18.814439 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3279/6579] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:44:18.823995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacfd76-5078-4650-a1ee-18b0a97bca44 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:18.825528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5bacfd76-5078-4650-a1ee-18b0a97bca44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:18.884705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacfd76-5078-4650-a1ee-18b0a97bca44 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:18.888347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3edae-cc1c-454e-b209-fabe46e658a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:18.888957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3edae-cc1c-454e-b209-fabe46e658a3 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:18.889242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3edae-cc1c-454e-b209-fabe46e658a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:18.889525 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3edae-cc1c-454e-b209-fabe46e658a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:18.898820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3edae-cc1c-454e-b209-fabe46e658a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:18.900270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf3edae-cc1c-454e-b209-fabe46e658a3 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:18.909780 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3301/6580] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:44:19.130349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8959e-5b3e-422b-9f7c-13484aaab4eb None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:19.142355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8959e-5b3e-422b-9f7c-13484aaab4eb None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:19.146503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90d061-b159-4d42-80a2-e16e8a2c35a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:19.147205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90d061-b159-4d42-80a2-e16e8a2c35a2 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:19.147481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90d061-b159-4d42-80a2-e16e8a2c35a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:19.147764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90d061-b159-4d42-80a2-e16e8a2c35a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:19.149715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8c90d061-b159-4d42-80a2-e16e8a2c35a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:19.163699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90d061-b159-4d42-80a2-e16e8a2c35a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:19.165319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90d061-b159-4d42-80a2-e16e8a2c35a2 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:19.177605 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3280/6581] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:44:19.324935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3edae-cc1c-454e-b209-fabe46e658a3 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:19.326518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9cf3edae-cc1c-454e-b209-fabe46e658a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:19.342353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3edae-cc1c-454e-b209-fabe46e658a3 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:19.346430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64918759-9204-4f9b-a1c3-6a0383e1299c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:19.347337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64918759-9204-4f9b-a1c3-6a0383e1299c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:19.347760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64918759-9204-4f9b-a1c3-6a0383e1299c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:19.348046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64918759-9204-4f9b-a1c3-6a0383e1299c admin admin] PATH_INFO: `/v3/projects/797df8f4984f40b5bc39c8c77283c4ae` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:19.349970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64918759-9204-4f9b-a1c3-6a0383e1299c admin admin] RBAC: Authorizing `identity:delete_project(project_id=797df8f4984f40b5bc39c8c77283c4ae)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:19.352844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64918759-9204-4f9b-a1c3-6a0383e1299c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:19.465091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-64918759-9204-4f9b-a1c3-6a0383e1299c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '797df8f4984f40b5bc39c8c77283c4ae', 'request_id': 'req-64918759-9204-4f9b-a1c3-6a0383e1299c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:19.535365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-64918759-9204-4f9b-a1c3-6a0383e1299c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '797df8f4984f40b5bc39c8c77283c4ae', 'request_id': 'req-64918759-9204-4f9b-a1c3-6a0383e1299c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:19.542459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-64918759-9204-4f9b-a1c3-6a0383e1299c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '797df8f4984f40b5bc39c8c77283c4ae', 'request_id': 'req-64918759-9204-4f9b-a1c3-6a0383e1299c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:19.554902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-64918759-9204-4f9b-a1c3-6a0383e1299c admin admin] The token cache is being invalidate because project 797df8f4984f40b5bc39c8c77283c4ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:44:19.556039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-64918759-9204-4f9b-a1c3-6a0383e1299c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:19.557985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-64918759-9204-4f9b-a1c3-6a0383e1299c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:19.559813 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3302/6582] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:44:19 2022] DELETE /identity/v3/projects/797df8f4984f40b5bc39c8c77283c4ae => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:19.564806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f6866-7e90-4b62-977b-b8ecbccd2fc4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:19.567410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f6866-7e90-4b62-977b-b8ecbccd2fc4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:19.567410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f6866-7e90-4b62-977b-b8ecbccd2fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:19.590262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c14f6866-7e90-4b62-977b-b8ecbccd2fc4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:19.590262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c14f6866-7e90-4b62-977b-b8ecbccd2fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:19.654022 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3281/6583] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:19.661704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ffa56-b263-4a7b-bd9a-d71a1a5901aa None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:19.662162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ffa56-b263-4a7b-bd9a-d71a1a5901aa None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:19.662812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ffa56-b263-4a7b-bd9a-d71a1a5901aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:19.717553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1b4ffa56-b263-4a7b-bd9a-d71a1a5901aa None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:19.719925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1b4ffa56-b263-4a7b-bd9a-d71a1a5901aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:19.733647 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3303/6584] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:44:19.738054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f6866-7e90-4b62-977b-b8ecbccd2fc4 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:19.748943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f6866-7e90-4b62-977b-b8ecbccd2fc4 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:19.756019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294e16c-1c9a-4a8b-bdfc-e9a8b10020cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:19.757414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294e16c-1c9a-4a8b-bdfc-e9a8b10020cd admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:19.760535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294e16c-1c9a-4a8b-bdfc-e9a8b10020cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:19.760535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294e16c-1c9a-4a8b-bdfc-e9a8b10020cd admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:19.760535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294e16c-1c9a-4a8b-bdfc-e9a8b10020cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:44:19.760535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294e16c-1c9a-4a8b-bdfc-e9a8b10020cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:19.760916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294e16c-1c9a-4a8b-bdfc-e9a8b10020cd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:19.773263 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3282/6585] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:44:19.777779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ffa56-b263-4a7b-bd9a-d71a1a5901aa None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:19.788702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ffa56-b263-4a7b-bd9a-d71a1a5901aa None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:19.794528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e880b22-7cb7-41b8-a7d7-274c4c59158c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:19.795526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e880b22-7cb7-41b8-a7d7-274c4c59158c admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:19.795983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e880b22-7cb7-41b8-a7d7-274c4c59158c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:19.796467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e880b22-7cb7-41b8-a7d7-274c4c59158c admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:19.797383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e880b22-7cb7-41b8-a7d7-274c4c59158c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:19.799581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e880b22-7cb7-41b8-a7d7-274c4c59158c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:19.924836 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3304/6586] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:44:19 2022] POST /identity/v3/projects => generated 389 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:44:19.929513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294e16c-1c9a-4a8b-bdfc-e9a8b10020cd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:19.945968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294e16c-1c9a-4a8b-bdfc-e9a8b10020cd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:20.022001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae04e2a-a04a-4d6b-be71-052887bc536e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:20.022807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae04e2a-a04a-4d6b-be71-052887bc536e admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:20.023163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae04e2a-a04a-4d6b-be71-052887bc536e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:20.023626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae04e2a-a04a-4d6b-be71-052887bc536e admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:20.024450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae04e2a-a04a-4d6b-be71-052887bc536e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:20.026558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae04e2a-a04a-4d6b-be71-052887bc536e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:20.135168 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3283/6587] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:44:19 2022] POST /identity/v3/users => generated 295 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:44:20.136356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e880b22-7cb7-41b8-a7d7-274c4c59158c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:20.149151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e880b22-7cb7-41b8-a7d7-274c4c59158c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:20.160137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c10367-217d-4f3a-b9f6-b427c3f37477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:20.161406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c10367-217d-4f3a-b9f6-b427c3f37477 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:20.161701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c10367-217d-4f3a-b9f6-b427c3f37477 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:20.161988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c10367-217d-4f3a-b9f6-b427c3f37477 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:20.162732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c10367-217d-4f3a-b9f6-b427c3f37477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:20.164381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c10367-217d-4f3a-b9f6-b427c3f37477 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:20.199648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae04e2a-a04a-4d6b-be71-052887bc536e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:20.200105 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3305/6588] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:44:20.215765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae04e2a-a04a-4d6b-be71-052887bc536e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:20.231581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d963f3d-c4c5-4a74-b555-d9f8917f45e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:20.232438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d963f3d-c4c5-4a74-b555-d9f8917f45e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:20.232906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d963f3d-c4c5-4a74-b555-d9f8917f45e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:20.233285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d963f3d-c4c5-4a74-b555-d9f8917f45e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:20.234442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d963f3d-c4c5-4a74-b555-d9f8917f45e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:20.236210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d963f3d-c4c5-4a74-b555-d9f8917f45e9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:20.253078 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3284/6589] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:44:20.255836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c10367-217d-4f3a-b9f6-b427c3f37477 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:20.267658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c10367-217d-4f3a-b9f6-b427c3f37477 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:20.273252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ced95-1564-494a-a52c-5e90e09955db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:20.274172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ced95-1564-494a-a52c-5e90e09955db admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:20.274456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ced95-1564-494a-a52c-5e90e09955db admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:20.274737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ced95-1564-494a-a52c-5e90e09955db admin admin] PATH_INFO: `/v3/projects/1e5c1591f8f941079885134a3bebc983/users/40684afcbf8a4778aea041be27a89c56/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:20.294193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ced95-1564-494a-a52c-5e90e09955db admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e5c1591f8f941079885134a3bebc983, user_id=40684afcbf8a4778aea041be27a89c56, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:20.298871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ced95-1564-494a-a52c-5e90e09955db admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:20.372172 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3306/6590] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:44:20 2022] PUT /identity/v3/projects/1e5c1591f8f941079885134a3bebc983/users/40684afcbf8a4778aea041be27a89c56/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:44:20.385703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ddc4d-9f25-48ee-8599-e7c50e7d81a6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:20.385929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ddc4d-9f25-48ee-8599-e7c50e7d81a6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:20.386210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ddc4d-9f25-48ee-8599-e7c50e7d81a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:20.417722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4b8ddc4d-9f25-48ee-8599-e7c50e7d81a6 None None] MFA Rules not processed for user `40684afcbf8a4778aea041be27a89c56`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:20.419241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4b8ddc4d-9f25-48ee-8599-e7c50e7d81a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:20.484167 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3285/6591] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:20.494640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ced95-1564-494a-a52c-5e90e09955db admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:20.496398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fb6ced95-1564-494a-a52c-5e90e09955db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:20.560265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ced95-1564-494a-a52c-5e90e09955db admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:20.564173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d76b0-82d4-4932-8cab-0f97ebc6b1d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:20.564928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d76b0-82d4-4932-8cab-0f97ebc6b1d9 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:20.565225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d76b0-82d4-4932-8cab-0f97ebc6b1d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:20.565503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d76b0-82d4-4932-8cab-0f97ebc6b1d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:20.574673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d76b0-82d4-4932-8cab-0f97ebc6b1d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:20.576308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d76b0-82d4-4932-8cab-0f97ebc6b1d9 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:20.587235 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3307/6592] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:44:28.445560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ddc4d-9f25-48ee-8599-e7c50e7d81a6 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:28.448409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4b8ddc4d-9f25-48ee-8599-e7c50e7d81a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:28.542618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ddc4d-9f25-48ee-8599-e7c50e7d81a6 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:28.547398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a4275-2608-4976-8026-d8353316042f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:28.548346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a4275-2608-4976-8026-d8353316042f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:28.550129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a4275-2608-4976-8026-d8353316042f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:28.550129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a4275-2608-4976-8026-d8353316042f admin admin] PATH_INFO: `/v3/users/6f188dd7eec041549953dc4d730b4d65` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:28.550129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a4275-2608-4976-8026-d8353316042f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f188dd7eec041549953dc4d730b4d65)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:28.552648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a4275-2608-4976-8026-d8353316042f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:28.750091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ae2a4275-2608-4976-8026-d8353316042f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f188dd7eec041549953dc4d730b4d65'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:28.764914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ae2a4275-2608-4976-8026-d8353316042f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f188dd7eec041549953dc4d730b4d65'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:28.765839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ae2a4275-2608-4976-8026-d8353316042f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f188dd7eec041549953dc4d730b4d65'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:28.775869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ae2a4275-2608-4976-8026-d8353316042f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f188dd7eec041549953dc4d730b4d65'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:28.855249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ae2a4275-2608-4976-8026-d8353316042f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f188dd7eec041549953dc4d730b4d65'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:28.867909 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3286/6593] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:44:28 2022] DELETE /identity/v3/users/6f188dd7eec041549953dc4d730b4d65 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:29.337475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c59fb-caeb-4fd7-b13a-766c09d0ede6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:29.338339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c59fb-caeb-4fd7-b13a-766c09d0ede6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:29.338832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c59fb-caeb-4fd7-b13a-766c09d0ede6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:29.360869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-055c59fb-caeb-4fd7-b13a-766c09d0ede6 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:29.362224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-055c59fb-caeb-4fd7-b13a-766c09d0ede6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:29.424924 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3308/6594] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:44:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:29.454751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a4275-2608-4976-8026-d8353316042f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:29.456222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ae2a4275-2608-4976-8026-d8353316042f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:29.542673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a4275-2608-4976-8026-d8353316042f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:29.547577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b0b93-c577-45c8-86f8-a5b29a4f277e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:29.548567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b0b93-c577-45c8-86f8-a5b29a4f277e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:29.549131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b0b93-c577-45c8-86f8-a5b29a4f277e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:29.549638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b0b93-c577-45c8-86f8-a5b29a4f277e admin admin] PATH_INFO: `/v3/projects/cfa0b24c632c4b3795e5bf28209734f1` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:29.551662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b0b93-c577-45c8-86f8-a5b29a4f277e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa0b24c632c4b3795e5bf28209734f1)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:29.554045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b0b93-c577-45c8-86f8-a5b29a4f277e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:29.611007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c59fb-caeb-4fd7-b13a-766c09d0ede6 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:29.612729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-055c59fb-caeb-4fd7-b13a-766c09d0ede6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:29.686034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-675b0b93-c577-45c8-86f8-a5b29a4f277e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa0b24c632c4b3795e5bf28209734f1', 'request_id': 'req-675b0b93-c577-45c8-86f8-a5b29a4f277e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:29.698336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-675b0b93-c577-45c8-86f8-a5b29a4f277e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa0b24c632c4b3795e5bf28209734f1', 'request_id': 'req-675b0b93-c577-45c8-86f8-a5b29a4f277e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:29.713359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c59fb-caeb-4fd7-b13a-766c09d0ede6 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:29.792409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ddb3b-5718-4f6b-8402-902cd44608c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:29.792890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ddb3b-5718-4f6b-8402-902cd44608c1 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:29.793544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ddb3b-5718-4f6b-8402-902cd44608c1 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:29.793544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ddb3b-5718-4f6b-8402-902cd44608c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:29.817386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-675b0b93-c577-45c8-86f8-a5b29a4f277e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa0b24c632c4b3795e5bf28209734f1', 'request_id': 'req-675b0b93-c577-45c8-86f8-a5b29a4f277e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:29.831154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-675b0b93-c577-45c8-86f8-a5b29a4f277e admin admin] The token cache is being invalidate because project cfa0b24c632c4b3795e5bf28209734f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:44:29.831902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-675b0b93-c577-45c8-86f8-a5b29a4f277e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:29.832916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-675b0b93-c577-45c8-86f8-a5b29a4f277e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:29.838997 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3287/6595] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:44:29 2022] DELETE /identity/v3/projects/cfa0b24c632c4b3795e5bf28209734f1 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:29.841230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29092e36-6d21-4b9e-b706-57384508fc45 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:29.841603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29092e36-6d21-4b9e-b706-57384508fc45 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:29.842074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29092e36-6d21-4b9e-b706-57384508fc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:29.856318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ddb3b-5718-4f6b-8402-902cd44608c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:29.857826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ddb3b-5718-4f6b-8402-902cd44608c1 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:29.867642 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3309/6596] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:44:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 02 10:44:29.870997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-29092e36-6d21-4b9e-b706-57384508fc45 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:29.877717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-29092e36-6d21-4b9e-b706-57384508fc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:29.994411 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3288/6597] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:30.009431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7c333-b7d3-40ab-a4be-be761e69e054 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:30.009431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7c333-b7d3-40ab-a4be-be761e69e054 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:30.009431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7c333-b7d3-40ab-a4be-be761e69e054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:30.033902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-92b7c333-b7d3-40ab-a4be-be761e69e054 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:30.035671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-92b7c333-b7d3-40ab-a4be-be761e69e054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:30.081760 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3310/6598] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:30.085629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29092e36-6d21-4b9e-b706-57384508fc45 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:30.104883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29092e36-6d21-4b9e-b706-57384508fc45 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:30.119065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73590910-45f9-4641-9504-09b288900ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:30.119759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73590910-45f9-4641-9504-09b288900ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:30.120037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73590910-45f9-4641-9504-09b288900ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:30.120310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73590910-45f9-4641-9504-09b288900ab9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:30.121738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73590910-45f9-4641-9504-09b288900ab9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:44:30.122005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73590910-45f9-4641-9504-09b288900ab9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:30.123621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73590910-45f9-4641-9504-09b288900ab9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:30.156160 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3289/6599] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:44:30.157862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7c333-b7d3-40ab-a4be-be761e69e054 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:30.184051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7c333-b7d3-40ab-a4be-be761e69e054 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:30.194649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652942f4-ed6c-4752-937f-de84bc438ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:30.197083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652942f4-ed6c-4752-937f-de84bc438ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:30.198668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652942f4-ed6c-4752-937f-de84bc438ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:30.198984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652942f4-ed6c-4752-937f-de84bc438ad0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:30.199790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652942f4-ed6c-4752-937f-de84bc438ad0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:30.202627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652942f4-ed6c-4752-937f-de84bc438ad0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:30.335552 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3311/6600] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:44:30 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:44:30.340003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73590910-45f9-4641-9504-09b288900ab9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:30.364022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73590910-45f9-4641-9504-09b288900ab9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:30.477454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652942f4-ed6c-4752-937f-de84bc438ad0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:30.479712 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-652942f4-ed6c-4752-937f-de84bc438ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:30.534514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ea102-da30-436d-b8c5-0ab0beec9396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:30.536113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ea102-da30-436d-b8c5-0ab0beec9396 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:30.545537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ea102-da30-436d-b8c5-0ab0beec9396 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:30.546326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ea102-da30-436d-b8c5-0ab0beec9396 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:30.547310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ea102-da30-436d-b8c5-0ab0beec9396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:30.549613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ea102-da30-436d-b8c5-0ab0beec9396 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:30.612530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652942f4-ed6c-4752-937f-de84bc438ad0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:30.621386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18e705-e2ee-44ad-9bac-4a0885965686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:30.623279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18e705-e2ee-44ad-9bac-4a0885965686 service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:30.623804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18e705-e2ee-44ad-9bac-4a0885965686 service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:30.624311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18e705-e2ee-44ad-9bac-4a0885965686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:30.631877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5a18e705-e2ee-44ad-9bac-4a0885965686 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:30.672992 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3290/6601] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:44:30 2022] POST /identity/v3/users => generated 289 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:44:30.674317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ea102-da30-436d-b8c5-0ab0beec9396 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:30.694834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ea102-da30-436d-b8c5-0ab0beec9396 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:30.712772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa73c39-7a63-4899-98be-8f056ba1856d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:30.713708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa73c39-7a63-4899-98be-8f056ba1856d admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:30.714536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa73c39-7a63-4899-98be-8f056ba1856d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:30.716092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa73c39-7a63-4899-98be-8f056ba1856d admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:30.717076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa73c39-7a63-4899-98be-8f056ba1856d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:30.721383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa73c39-7a63-4899-98be-8f056ba1856d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:30.744577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18e705-e2ee-44ad-9bac-4a0885965686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:30.746863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18e705-e2ee-44ad-9bac-4a0885965686 service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:30.751485 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3291/6602] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:44:30.754389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa73c39-7a63-4899-98be-8f056ba1856d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:30.777088 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3312/6603] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:44:30.784330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa73c39-7a63-4899-98be-8f056ba1856d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:30.797640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c69d1-61dc-45a5-9260-f66c7bbe0791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:30.802033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c69d1-61dc-45a5-9260-f66c7bbe0791 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:30.802612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c69d1-61dc-45a5-9260-f66c7bbe0791 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:30.803145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c69d1-61dc-45a5-9260-f66c7bbe0791 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:30.803979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c69d1-61dc-45a5-9260-f66c7bbe0791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:30.806048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c69d1-61dc-45a5-9260-f66c7bbe0791 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:30.834864 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3292/6604] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:44:30.839261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18e705-e2ee-44ad-9bac-4a0885965686 service cinder] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:30.855366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18e705-e2ee-44ad-9bac-4a0885965686 service cinder] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:30.870515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbb61d-1f10-4b6d-ba43-08aa9f66e49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:30.871909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbb61d-1f10-4b6d-ba43-08aa9f66e49c admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:30.872377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbb61d-1f10-4b6d-ba43-08aa9f66e49c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:30.873016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbb61d-1f10-4b6d-ba43-08aa9f66e49c admin admin] PATH_INFO: `/v3/projects/12d09909b1aa4bc598c6a38777a6597c/users/a72a0ae378174dd1b9296783bbf95d28/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:30.897204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcbb61d-1f10-4b6d-ba43-08aa9f66e49c admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d09909b1aa4bc598c6a38777a6597c, user_id=a72a0ae378174dd1b9296783bbf95d28, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:30.900512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcbb61d-1f10-4b6d-ba43-08aa9f66e49c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:30.960103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c69d1-61dc-45a5-9260-f66c7bbe0791 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:30.962950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c29c69d1-61dc-45a5-9260-f66c7bbe0791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:30.988780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c69d1-61dc-45a5-9260-f66c7bbe0791 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:30.997031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30915198-6be6-476e-b596-37102ed10f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:30.999280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30915198-6be6-476e-b596-37102ed10f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:30.999890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30915198-6be6-476e-b596-37102ed10f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:31.000329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30915198-6be6-476e-b596-37102ed10f4a admin admin] PATH_INFO: `/v3/users/11570d45e8de428fa751c85b80b673e4` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:31.028635 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3313/6605] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:44:30 2022] PUT /identity/v3/projects/12d09909b1aa4bc598c6a38777a6597c/users/a72a0ae378174dd1b9296783bbf95d28/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:31.030476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30915198-6be6-476e-b596-37102ed10f4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=11570d45e8de428fa751c85b80b673e4)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:31.033040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30915198-6be6-476e-b596-37102ed10f4a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:31.040691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39193ffe-49d5-4c9d-99c6-aae3f302e372 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:31.043248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39193ffe-49d5-4c9d-99c6-aae3f302e372 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:31.043248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39193ffe-49d5-4c9d-99c6-aae3f302e372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:31.092457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-39193ffe-49d5-4c9d-99c6-aae3f302e372 None None] MFA Rules not processed for user `a72a0ae378174dd1b9296783bbf95d28`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:31.094479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-39193ffe-49d5-4c9d-99c6-aae3f302e372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:31.271152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30915198-6be6-476e-b596-37102ed10f4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11570d45e8de428fa751c85b80b673e4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:31.287202 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3314/6606] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:31.293864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e48507-1f8d-4cc5-8e4c-58de08a82edf None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:31.294158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e48507-1f8d-4cc5-8e4c-58de08a82edf None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:31.294505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e48507-1f8d-4cc5-8e4c-58de08a82edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:31.299686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30915198-6be6-476e-b596-37102ed10f4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11570d45e8de428fa751c85b80b673e4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:31.300469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30915198-6be6-476e-b596-37102ed10f4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11570d45e8de428fa751c85b80b673e4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:31.319131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30915198-6be6-476e-b596-37102ed10f4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11570d45e8de428fa751c85b80b673e4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:31.326157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e1e48507-1f8d-4cc5-8e4c-58de08a82edf None None] MFA Rules not processed for user `a72a0ae378174dd1b9296783bbf95d28`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:31.328966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e1e48507-1f8d-4cc5-8e4c-58de08a82edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:31.339082 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3315/6607] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:31.353342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e48507-1f8d-4cc5-8e4c-58de08a82edf None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:31.354863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e1e48507-1f8d-4cc5-8e4c-58de08a82edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:31.420429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30915198-6be6-476e-b596-37102ed10f4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11570d45e8de428fa751c85b80b673e4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:31.429034 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3293/6608] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:44:30 2022] DELETE /identity/v3/users/11570d45e8de428fa751c85b80b673e4 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:31.525351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e48507-1f8d-4cc5-8e4c-58de08a82edf None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:31.642247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1e27c-fd87-45c5-bcfa-32eb7a95da3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:31.648841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1e27c-fd87-45c5-bcfa-32eb7a95da3c service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:31.649493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1e27c-fd87-45c5-bcfa-32eb7a95da3c service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:31.649935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1e27c-fd87-45c5-bcfa-32eb7a95da3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:31.652226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-24e1e27c-fd87-45c5-bcfa-32eb7a95da3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:31.771658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1e27c-fd87-45c5-bcfa-32eb7a95da3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:31.776309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1e27c-fd87-45c5-bcfa-32eb7a95da3c service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:31.791263 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3316/6609] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:44:31.799781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30915198-6be6-476e-b596-37102ed10f4a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:31.801893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-30915198-6be6-476e-b596-37102ed10f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:32.018231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30915198-6be6-476e-b596-37102ed10f4a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:32.032484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea5460-cd8f-4ffe-bd48-a2a54789d456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:32.033613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea5460-cd8f-4ffe-bd48-a2a54789d456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:32.033969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea5460-cd8f-4ffe-bd48-a2a54789d456 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:32.034441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea5460-cd8f-4ffe-bd48-a2a54789d456 admin admin] PATH_INFO: `/v3/projects/00e2e106852b47f7a8e76aab24c5e883` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:32.069874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea5460-cd8f-4ffe-bd48-a2a54789d456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00e2e106852b47f7a8e76aab24c5e883)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:32.072166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea5460-cd8f-4ffe-bd48-a2a54789d456 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:32.203143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-baea5460-cd8f-4ffe-bd48-a2a54789d456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e2e106852b47f7a8e76aab24c5e883', 'request_id': 'req-baea5460-cd8f-4ffe-bd48-a2a54789d456'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:32.214647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-baea5460-cd8f-4ffe-bd48-a2a54789d456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e2e106852b47f7a8e76aab24c5e883', 'request_id': 'req-baea5460-cd8f-4ffe-bd48-a2a54789d456'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:32.286237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-baea5460-cd8f-4ffe-bd48-a2a54789d456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e2e106852b47f7a8e76aab24c5e883', 'request_id': 'req-baea5460-cd8f-4ffe-bd48-a2a54789d456'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:32.303060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-baea5460-cd8f-4ffe-bd48-a2a54789d456 admin admin] The token cache is being invalidate because project 00e2e106852b47f7a8e76aab24c5e883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:44:32.303569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-baea5460-cd8f-4ffe-bd48-a2a54789d456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:32.304412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-baea5460-cd8f-4ffe-bd48-a2a54789d456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:32.306552 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3294/6610] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:44:31 2022] DELETE /identity/v3/projects/00e2e106852b47f7a8e76aab24c5e883 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:32.310528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1e27c-fd87-45c5-bcfa-32eb7a95da3c service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:32.327826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1e27c-fd87-45c5-bcfa-32eb7a95da3c service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:32.455386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b111c3-242e-4dbf-8eff-cc72027db6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:32.456426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b111c3-242e-4dbf-8eff-cc72027db6db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:32.456788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b111c3-242e-4dbf-8eff-cc72027db6db admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:32.457198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b111c3-242e-4dbf-8eff-cc72027db6db admin admin] PATH_INFO: `/v3/users/f409d644bbd64f22b01cdd3ecb71ace1` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:32.458954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b111c3-242e-4dbf-8eff-cc72027db6db admin admin] RBAC: Authorizing `identity:delete_user(user_id=f409d644bbd64f22b01cdd3ecb71ace1)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:32.461698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b111c3-242e-4dbf-8eff-cc72027db6db admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:32.696028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-85b111c3-242e-4dbf-8eff-cc72027db6db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f409d644bbd64f22b01cdd3ecb71ace1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:32.716419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-85b111c3-242e-4dbf-8eff-cc72027db6db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f409d644bbd64f22b01cdd3ecb71ace1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:32.717759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-85b111c3-242e-4dbf-8eff-cc72027db6db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f409d644bbd64f22b01cdd3ecb71ace1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:32.728541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-85b111c3-242e-4dbf-8eff-cc72027db6db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f409d644bbd64f22b01cdd3ecb71ace1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:32.816304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-85b111c3-242e-4dbf-8eff-cc72027db6db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f409d644bbd64f22b01cdd3ecb71ace1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:32.827162 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3317/6611] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:44:32 2022] DELETE /identity/v3/users/f409d644bbd64f22b01cdd3ecb71ace1 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:33.309774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea5460-cd8f-4ffe-bd48-a2a54789d456 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:33.311430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-baea5460-cd8f-4ffe-bd48-a2a54789d456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:33.335097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea5460-cd8f-4ffe-bd48-a2a54789d456 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:33.431057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9b808-6aa6-437d-b934-4c96ee37d9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:33.432213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9b808-6aa6-437d-b934-4c96ee37d9ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:33.432647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9b808-6aa6-437d-b934-4c96ee37d9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:33.433067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9b808-6aa6-437d-b934-4c96ee37d9ee admin admin] PATH_INFO: `/v3/projects/839c485fea7940d1aad426fd7fc19dfc` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:33.435448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9b808-6aa6-437d-b934-4c96ee37d9ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=839c485fea7940d1aad426fd7fc19dfc)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:33.437807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9b808-6aa6-437d-b934-4c96ee37d9ee admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:33.637301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ddb9b808-6aa6-437d-b934-4c96ee37d9ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '839c485fea7940d1aad426fd7fc19dfc', 'request_id': 'req-ddb9b808-6aa6-437d-b934-4c96ee37d9ee'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:33.648492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ddb9b808-6aa6-437d-b934-4c96ee37d9ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '839c485fea7940d1aad426fd7fc19dfc', 'request_id': 'req-ddb9b808-6aa6-437d-b934-4c96ee37d9ee'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:33.780732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ddb9b808-6aa6-437d-b934-4c96ee37d9ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '839c485fea7940d1aad426fd7fc19dfc', 'request_id': 'req-ddb9b808-6aa6-437d-b934-4c96ee37d9ee'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:33.804754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ddb9b808-6aa6-437d-b934-4c96ee37d9ee admin admin] The token cache is being invalidate because project 839c485fea7940d1aad426fd7fc19dfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:44:33.805112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ddb9b808-6aa6-437d-b934-4c96ee37d9ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:33.806410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ddb9b808-6aa6-437d-b934-4c96ee37d9ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:33.808983 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3295/6612] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:44:33 2022] DELETE /identity/v3/projects/839c485fea7940d1aad426fd7fc19dfc => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:33.813678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85c284-71ab-4194-90f9-8db5fa91c104 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:33.814210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85c284-71ab-4194-90f9-8db5fa91c104 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:33.814311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85c284-71ab-4194-90f9-8db5fa91c104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:33.841747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0d85c284-71ab-4194-90f9-8db5fa91c104 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:33.843001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0d85c284-71ab-4194-90f9-8db5fa91c104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:33.976443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1d24c-d5f8-4eb1-a0d9-6a9acf3ad881 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:33.976763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1d24c-d5f8-4eb1-a0d9-6a9acf3ad881 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:33.977049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1d24c-d5f8-4eb1-a0d9-6a9acf3ad881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:33.980740 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3318/6613] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:34.018682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-51c1d24c-d5f8-4eb1-a0d9-6a9acf3ad881 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:34.021565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-51c1d24c-d5f8-4eb1-a0d9-6a9acf3ad881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:34.031220 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3296/6614] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:34.038854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85c284-71ab-4194-90f9-8db5fa91c104 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:34.057843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85c284-71ab-4194-90f9-8db5fa91c104 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:34.064072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7e90a-6b9d-454f-bf74-0d635aef189b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:34.065670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7e90a-6b9d-454f-bf74-0d635aef189b admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:34.066738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7e90a-6b9d-454f-bf74-0d635aef189b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:34.092702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7e90a-6b9d-454f-bf74-0d635aef189b admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:34.092702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7e90a-6b9d-454f-bf74-0d635aef189b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:44:34.092702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7e90a-6b9d-454f-bf74-0d635aef189b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:34.092702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7e90a-6b9d-454f-bf74-0d635aef189b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:34.092702 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3319/6615] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:44:34.095393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1d24c-d5f8-4eb1-a0d9-6a9acf3ad881 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:34.114043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1d24c-d5f8-4eb1-a0d9-6a9acf3ad881 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:34.128208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab521c35-41a8-47fa-aed5-893e55e7c329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:34.129803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab521c35-41a8-47fa-aed5-893e55e7c329 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:34.130310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab521c35-41a8-47fa-aed5-893e55e7c329 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:34.130799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab521c35-41a8-47fa-aed5-893e55e7c329 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:34.131726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab521c35-41a8-47fa-aed5-893e55e7c329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:34.134095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab521c35-41a8-47fa-aed5-893e55e7c329 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:34.282978 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3297/6616] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:44:34 2022] POST /identity/v3/projects => generated 397 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:44:34.287122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7e90a-6b9d-454f-bf74-0d635aef189b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:34.303581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7e90a-6b9d-454f-bf74-0d635aef189b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:34.432293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0fed6-f2b2-4536-a7e6-e5d737e549bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:34.433105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0fed6-f2b2-4536-a7e6-e5d737e549bb admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:34.433642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0fed6-f2b2-4536-a7e6-e5d737e549bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:34.434024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0fed6-f2b2-4536-a7e6-e5d737e549bb admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:34.434891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0fed6-f2b2-4536-a7e6-e5d737e549bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:34.436970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0fed6-f2b2-4536-a7e6-e5d737e549bb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:34.555449 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3320/6617] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:44:34 2022] POST /identity/v3/users => generated 299 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:44:34.560665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab521c35-41a8-47fa-aed5-893e55e7c329 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:34.572077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab521c35-41a8-47fa-aed5-893e55e7c329 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:34.577865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258ef76-4ae1-4721-9531-ff4da006372c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:34.578142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258ef76-4ae1-4721-9531-ff4da006372c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:34.578401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258ef76-4ae1-4721-9531-ff4da006372c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:34.578699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258ef76-4ae1-4721-9531-ff4da006372c admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:34.579450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258ef76-4ae1-4721-9531-ff4da006372c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:34.581252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258ef76-4ae1-4721-9531-ff4da006372c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:34.596114 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3298/6618] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:44:34.598205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0fed6-f2b2-4536-a7e6-e5d737e549bb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:34.614233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0fed6-f2b2-4536-a7e6-e5d737e549bb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:34.618281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebe70d-0b76-4852-b8b9-a735306eebed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:34.618986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebe70d-0b76-4852-b8b9-a735306eebed admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:34.619274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebe70d-0b76-4852-b8b9-a735306eebed admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:34.619605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebe70d-0b76-4852-b8b9-a735306eebed admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:34.621711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebe70d-0b76-4852-b8b9-a735306eebed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:34.622636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebe70d-0b76-4852-b8b9-a735306eebed admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:34.638056 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3321/6619] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:44:34.639458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258ef76-4ae1-4721-9531-ff4da006372c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:34.650671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258ef76-4ae1-4721-9531-ff4da006372c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:34.656799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a66a2-0847-430c-9eb3-3835751fddc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:34.657883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a66a2-0847-430c-9eb3-3835751fddc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:34.658172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a66a2-0847-430c-9eb3-3835751fddc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:34.658449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a66a2-0847-430c-9eb3-3835751fddc1 admin admin] PATH_INFO: `/v3/projects/357c7586006d4c5080ac407259724c65/users/de203f1388b942d298e65de9cd8460b9/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:34.674835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a66a2-0847-430c-9eb3-3835751fddc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=357c7586006d4c5080ac407259724c65, user_id=de203f1388b942d298e65de9cd8460b9, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:34.677599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a66a2-0847-430c-9eb3-3835751fddc1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:35.014917 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3299/6620] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:44:34 2022] PUT /identity/v3/projects/357c7586006d4c5080ac407259724c65/users/de203f1388b942d298e65de9cd8460b9/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:35.018497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6cbdf-3fd5-48bd-9569-47715f35ecb3 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:35.019017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6cbdf-3fd5-48bd-9569-47715f35ecb3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:35.019146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6cbdf-3fd5-48bd-9569-47715f35ecb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:35.037597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ebc6cbdf-3fd5-48bd-9569-47715f35ecb3 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:35.038985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ebc6cbdf-3fd5-48bd-9569-47715f35ecb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:35.124052 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3322/6621] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:35.138548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a66a2-0847-430c-9eb3-3835751fddc1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:35.140576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b90a66a2-0847-430c-9eb3-3835751fddc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:35.208528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a66a2-0847-430c-9eb3-3835751fddc1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:35.213406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a1a28-bc78-45d7-ad50-7a0cea3e4504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:35.214837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a1a28-bc78-45d7-ad50-7a0cea3e4504 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:35.215312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a1a28-bc78-45d7-ad50-7a0cea3e4504 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:35.215798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a1a28-bc78-45d7-ad50-7a0cea3e4504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:35.232086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a1a28-bc78-45d7-ad50-7a0cea3e4504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:35.233874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a1a28-bc78-45d7-ad50-7a0cea3e4504 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:35.250507 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3300/6622] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:44:37.181062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a315372-1f17-44ea-b272-6cdf4c89fc48 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:37.181761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a315372-1f17-44ea-b272-6cdf4c89fc48 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:37.181761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a315372-1f17-44ea-b272-6cdf4c89fc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:37.233711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6a315372-1f17-44ea-b272-6cdf4c89fc48 None None] MFA Rules not processed for user `de203f1388b942d298e65de9cd8460b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:37.234946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6a315372-1f17-44ea-b272-6cdf4c89fc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:37.365704 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3323/6623] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:37.378258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e463191-b0cf-40d6-bdbd-6a40ba878760 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:37.379361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e463191-b0cf-40d6-bdbd-6a40ba878760 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:37.379361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e463191-b0cf-40d6-bdbd-6a40ba878760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:37.400171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4e463191-b0cf-40d6-bdbd-6a40ba878760 None None] MFA Rules not processed for user `de203f1388b942d298e65de9cd8460b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:37.401509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4e463191-b0cf-40d6-bdbd-6a40ba878760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:37.419111 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3301/6624] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:37.430032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a315372-1f17-44ea-b272-6cdf4c89fc48 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:37.434599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6a315372-1f17-44ea-b272-6cdf4c89fc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:37.603266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a315372-1f17-44ea-b272-6cdf4c89fc48 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:37.618353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6ef5a-544b-4d13-ad7c-d765a3b0af7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:37.619030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6ef5a-544b-4d13-ad7c-d765a3b0af7d service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:37.619324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6ef5a-544b-4d13-ad7c-d765a3b0af7d service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:37.619605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6ef5a-544b-4d13-ad7c-d765a3b0af7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:37.630494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6ef5a-544b-4d13-ad7c-d765a3b0af7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:37.632199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6ef5a-544b-4d13-ad7c-d765a3b0af7d service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:37.644153 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3324/6625] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:44:43.638311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e463191-b0cf-40d6-bdbd-6a40ba878760 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:43.639746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4e463191-b0cf-40d6-bdbd-6a40ba878760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:43.674333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e463191-b0cf-40d6-bdbd-6a40ba878760 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:43.697335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7c0cf-3182-461b-9361-ed8dd83ede91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:43.698417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7c0cf-3182-461b-9361-ed8dd83ede91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:43.699343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7c0cf-3182-461b-9361-ed8dd83ede91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:43.700452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7c0cf-3182-461b-9361-ed8dd83ede91 admin admin] PATH_INFO: `/v3/users/40684afcbf8a4778aea041be27a89c56` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:43.703214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7c0cf-3182-461b-9361-ed8dd83ede91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40684afcbf8a4778aea041be27a89c56)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:43.705428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7c0cf-3182-461b-9361-ed8dd83ede91 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:43.987555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c9c7c0cf-3182-461b-9361-ed8dd83ede91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40684afcbf8a4778aea041be27a89c56'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:43.999411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c9c7c0cf-3182-461b-9361-ed8dd83ede91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40684afcbf8a4778aea041be27a89c56'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:44.000152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c9c7c0cf-3182-461b-9361-ed8dd83ede91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40684afcbf8a4778aea041be27a89c56'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:44.010061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c9c7c0cf-3182-461b-9361-ed8dd83ede91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40684afcbf8a4778aea041be27a89c56'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:44.131069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c9c7c0cf-3182-461b-9361-ed8dd83ede91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40684afcbf8a4778aea041be27a89c56'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:44.138022 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3302/6626] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:44:43 2022] DELETE /identity/v3/users/40684afcbf8a4778aea041be27a89c56 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:44.144380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f57ac-cce2-4eb2-ba6d-4ee8a11ee003 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:44.144987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f57ac-cce2-4eb2-ba6d-4ee8a11ee003 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:44.145554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f57ac-cce2-4eb2-ba6d-4ee8a11ee003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:44.170004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f22f57ac-cce2-4eb2-ba6d-4ee8a11ee003 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:44.171609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f22f57ac-cce2-4eb2-ba6d-4ee8a11ee003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:44.241238 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3325/6627] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:44.251330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7c0cf-3182-461b-9361-ed8dd83ede91 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:44.254036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c9c7c0cf-3182-461b-9361-ed8dd83ede91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:44.330764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7c0cf-3182-461b-9361-ed8dd83ede91 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:44.335567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f0f3a-936c-49ff-aa54-18803de89aa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:44.336204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f0f3a-936c-49ff-aa54-18803de89aa1 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:44.336519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f0f3a-936c-49ff-aa54-18803de89aa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:44.336819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f0f3a-936c-49ff-aa54-18803de89aa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:44.347517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f0f3a-936c-49ff-aa54-18803de89aa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:44.348996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f0f3a-936c-49ff-aa54-18803de89aa1 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:44.364797 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3303/6628] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:44:44.730964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f57ac-cce2-4eb2-ba6d-4ee8a11ee003 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:44.732451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f22f57ac-cce2-4eb2-ba6d-4ee8a11ee003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:44.746129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f57ac-cce2-4eb2-ba6d-4ee8a11ee003 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:44.752092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43c59e-4e3b-4615-9420-21e3b20a8e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:44.755530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43c59e-4e3b-4615-9420-21e3b20a8e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:44.755530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43c59e-4e3b-4615-9420-21e3b20a8e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:44.755530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43c59e-4e3b-4615-9420-21e3b20a8e02 admin admin] PATH_INFO: `/v3/projects/1e5c1591f8f941079885134a3bebc983` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:44.756265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43c59e-4e3b-4615-9420-21e3b20a8e02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e5c1591f8f941079885134a3bebc983)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:44.758552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43c59e-4e3b-4615-9420-21e3b20a8e02 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:44.941623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f0f3a-936c-49ff-aa54-18803de89aa1 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:44.943053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1d7f0f3a-936c-49ff-aa54-18803de89aa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:44.948565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9f43c59e-4e3b-4615-9420-21e3b20a8e02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e5c1591f8f941079885134a3bebc983', 'request_id': 'req-9f43c59e-4e3b-4615-9420-21e3b20a8e02'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:44.957174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f0f3a-936c-49ff-aa54-18803de89aa1 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:45.015247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfe7f2-4226-4052-a6cc-452a6a705814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:45.016059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfe7f2-4226-4052-a6cc-452a6a705814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:45.016346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfe7f2-4226-4052-a6cc-452a6a705814 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:45.016656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfe7f2-4226-4052-a6cc-452a6a705814 admin admin] PATH_INFO: `/v3/users/a72a0ae378174dd1b9296783bbf95d28` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:45.018076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfe7f2-4226-4052-a6cc-452a6a705814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a72a0ae378174dd1b9296783bbf95d28)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:45.020704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfe7f2-4226-4052-a6cc-452a6a705814 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:45.062510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9f43c59e-4e3b-4615-9420-21e3b20a8e02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e5c1591f8f941079885134a3bebc983', 'request_id': 'req-9f43c59e-4e3b-4615-9420-21e3b20a8e02'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:45.070495 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9f43c59e-4e3b-4615-9420-21e3b20a8e02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e5c1591f8f941079885134a3bebc983', 'request_id': 'req-9f43c59e-4e3b-4615-9420-21e3b20a8e02'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:45.082435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9f43c59e-4e3b-4615-9420-21e3b20a8e02 admin admin] The token cache is being invalidate because project 1e5c1591f8f941079885134a3bebc983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:44:45.082738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9f43c59e-4e3b-4615-9420-21e3b20a8e02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:45.083691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9f43c59e-4e3b-4615-9420-21e3b20a8e02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:45.085255 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3326/6629] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:44:44 2022] DELETE /identity/v3/projects/1e5c1591f8f941079885134a3bebc983 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:45.090205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2eebee-d2a3-4c99-a4d4-ccc48825e628 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:45.090570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2eebee-d2a3-4c99-a4d4-ccc48825e628 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:45.090809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2eebee-d2a3-4c99-a4d4-ccc48825e628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:45.117265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ed2eebee-d2a3-4c99-a4d4-ccc48825e628 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:45.118467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ed2eebee-d2a3-4c99-a4d4-ccc48825e628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:45.127105 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3327/6630] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:45.135521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753edac7-864f-4353-930d-c7bae520631e None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:45.135846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753edac7-864f-4353-930d-c7bae520631e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:45.136130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753edac7-864f-4353-930d-c7bae520631e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:45.155482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-753edac7-864f-4353-930d-c7bae520631e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:45.156759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-753edac7-864f-4353-930d-c7bae520631e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:45.165366 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3328/6631] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:44:45.169429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753edac7-864f-4353-930d-c7bae520631e None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:45.178926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753edac7-864f-4353-930d-c7bae520631e None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:45.183853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311edee-bd27-4511-885e-ca3662be259b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:45.184539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311edee-bd27-4511-885e-ca3662be259b admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:45.184864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311edee-bd27-4511-885e-ca3662be259b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:45.185148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311edee-bd27-4511-885e-ca3662be259b admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:45.188401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311edee-bd27-4511-885e-ca3662be259b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:44:45.188401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311edee-bd27-4511-885e-ca3662be259b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:45.188401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311edee-bd27-4511-885e-ca3662be259b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:45.204335 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3329/6632] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:44:45.205401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311edee-bd27-4511-885e-ca3662be259b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:45.216574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311edee-bd27-4511-885e-ca3662be259b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:45.223426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515312c8-4d11-45a4-a835-2565638016b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:45.224470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515312c8-4d11-45a4-a835-2565638016b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:45.225094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515312c8-4d11-45a4-a835-2565638016b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:45.225212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515312c8-4d11-45a4-a835-2565638016b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:45.226125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515312c8-4d11-45a4-a835-2565638016b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:45.228381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515312c8-4d11-45a4-a835-2565638016b1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:45.318808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d0cfe7f2-4226-4052-a6cc-452a6a705814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a72a0ae378174dd1b9296783bbf95d28'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:45.334441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d0cfe7f2-4226-4052-a6cc-452a6a705814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a72a0ae378174dd1b9296783bbf95d28'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:45.335337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d0cfe7f2-4226-4052-a6cc-452a6a705814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a72a0ae378174dd1b9296783bbf95d28'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:45.342608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d0cfe7f2-4226-4052-a6cc-452a6a705814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a72a0ae378174dd1b9296783bbf95d28'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:45.361889 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3330/6633] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:44:45 2022] POST /identity/v3/projects => generated 391 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:44:45.367467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515312c8-4d11-45a4-a835-2565638016b1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:45.424405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d0cfe7f2-4226-4052-a6cc-452a6a705814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a72a0ae378174dd1b9296783bbf95d28'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:45.433638 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3304/6634] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:44:44 2022] DELETE /identity/v3/users/a72a0ae378174dd1b9296783bbf95d28 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:45.439889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae68ac-4644-4542-8b51-9499025dfa14 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:45.440290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae68ac-4644-4542-8b51-9499025dfa14 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:45.441321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515312c8-4d11-45a4-a835-2565638016b1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:45.442430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae68ac-4644-4542-8b51-9499025dfa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:45.462185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-09ae68ac-4644-4542-8b51-9499025dfa14 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:45.463767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-09ae68ac-4644-4542-8b51-9499025dfa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:45.505907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9c3bd-fb51-4055-b5a5-5cae61e8fb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:45.506959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9c3bd-fb51-4055-b5a5-5cae61e8fb35 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:45.507253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9c3bd-fb51-4055-b5a5-5cae61e8fb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:45.507866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9c3bd-fb51-4055-b5a5-5cae61e8fb35 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:45.508908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9c3bd-fb51-4055-b5a5-5cae61e8fb35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:45.512078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9c3bd-fb51-4055-b5a5-5cae61e8fb35 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:45.524372 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3305/6635] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:45.534285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae68ac-4644-4542-8b51-9499025dfa14 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:45.535876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-09ae68ac-4644-4542-8b51-9499025dfa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:45.595683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae68ac-4644-4542-8b51-9499025dfa14 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:45.599908 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3331/6636] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:44:45 2022] POST /identity/v3/users => generated 296 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:44:45.601076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9c3bd-fb51-4055-b5a5-5cae61e8fb35 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:45.602779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-74e9c3bd-fb51-4055-b5a5-5cae61e8fb35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:45.603922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d90fa-fc2e-4bca-bd41-956449d26a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:45.604838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d90fa-fc2e-4bca-bd41-956449d26a1f service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:45.605123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d90fa-fc2e-4bca-bd41-956449d26a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:45.605398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d90fa-fc2e-4bca-bd41-956449d26a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:45.616394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9c3bd-fb51-4055-b5a5-5cae61e8fb35 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:45.617637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d90fa-fc2e-4bca-bd41-956449d26a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:45.619094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d90fa-fc2e-4bca-bd41-956449d26a1f service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:45.621022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84ae3c-a72f-4d98-bf85-0cc3cbf4746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:45.621923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84ae3c-a72f-4d98-bf85-0cc3cbf4746a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:45.622284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84ae3c-a72f-4d98-bf85-0cc3cbf4746a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:45.622634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84ae3c-a72f-4d98-bf85-0cc3cbf4746a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:45.623693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84ae3c-a72f-4d98-bf85-0cc3cbf4746a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:45.625136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84ae3c-a72f-4d98-bf85-0cc3cbf4746a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:45.640211 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3332/6637] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:44:45.641616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84ae3c-a72f-4d98-bf85-0cc3cbf4746a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:45.642651 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3306/6638] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:44:45.658125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84ae3c-a72f-4d98-bf85-0cc3cbf4746a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:45.673690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28929faf-d453-4eaf-8c89-3abab73e3abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:45.674388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28929faf-d453-4eaf-8c89-3abab73e3abb admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:45.674680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28929faf-d453-4eaf-8c89-3abab73e3abb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:45.675026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28929faf-d453-4eaf-8c89-3abab73e3abb admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:45.676279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28929faf-d453-4eaf-8c89-3abab73e3abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:45.678106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28929faf-d453-4eaf-8c89-3abab73e3abb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:45.690441 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3333/6639] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:44:45.694492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d90fa-fc2e-4bca-bd41-956449d26a1f service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:45.707366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d90fa-fc2e-4bca-bd41-956449d26a1f service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:45.714001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7081f-b52b-4a38-a8c3-ff08c17dee42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:45.715410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7081f-b52b-4a38-a8c3-ff08c17dee42 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:45.715878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7081f-b52b-4a38-a8c3-ff08c17dee42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:45.716167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7081f-b52b-4a38-a8c3-ff08c17dee42 admin admin] PATH_INFO: `/v3/projects/5e4513887095430d9daab49e6ce69d21/users/0dce77d81d114c6183660b086ec8edad/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:45.734863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7081f-b52b-4a38-a8c3-ff08c17dee42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e4513887095430d9daab49e6ce69d21, user_id=0dce77d81d114c6183660b086ec8edad, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:45.738382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7081f-b52b-4a38-a8c3-ff08c17dee42 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:45.832351 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3307/6640] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:44:45 2022] PUT /identity/v3/projects/5e4513887095430d9daab49e6ce69d21/users/0dce77d81d114c6183660b086ec8edad/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:45.842871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bd6e1-da4a-400e-82e0-c498c7e87b29 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:45.843165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bd6e1-da4a-400e-82e0-c498c7e87b29 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:45.843455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bd6e1-da4a-400e-82e0-c498c7e87b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:45.886704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-642bd6e1-da4a-400e-82e0-c498c7e87b29 None None] MFA Rules not processed for user `0dce77d81d114c6183660b086ec8edad`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:45.887989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-642bd6e1-da4a-400e-82e0-c498c7e87b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:45.990805 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3334/6641] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:46.008384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7081f-b52b-4a38-a8c3-ff08c17dee42 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:46.081983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7081f-b52b-4a38-a8c3-ff08c17dee42 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:46.086255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc089fe2-4a1d-45dd-8917-a020afdfda68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:46.087148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc089fe2-4a1d-45dd-8917-a020afdfda68 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:46.087437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc089fe2-4a1d-45dd-8917-a020afdfda68 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:46.087715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc089fe2-4a1d-45dd-8917-a020afdfda68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:46.097647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc089fe2-4a1d-45dd-8917-a020afdfda68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:46.099099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc089fe2-4a1d-45dd-8917-a020afdfda68 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:46.123594 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3308/6642] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:44:46.201603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bd6e1-da4a-400e-82e0-c498c7e87b29 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:46.203673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-642bd6e1-da4a-400e-82e0-c498c7e87b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:46.302525 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bd6e1-da4a-400e-82e0-c498c7e87b29 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:46.309414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b6a38-cfc1-49e1-91d2-51f01b42dfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:46.310363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b6a38-cfc1-49e1-91d2-51f01b42dfd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:46.311084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b6a38-cfc1-49e1-91d2-51f01b42dfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:46.311710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b6a38-cfc1-49e1-91d2-51f01b42dfd4 admin admin] PATH_INFO: `/v3/projects/12d09909b1aa4bc598c6a38777a6597c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:46.316263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b6a38-cfc1-49e1-91d2-51f01b42dfd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12d09909b1aa4bc598c6a38777a6597c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:46.318273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b6a38-cfc1-49e1-91d2-51f01b42dfd4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:46.462740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1f8b6a38-cfc1-49e1-91d2-51f01b42dfd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12d09909b1aa4bc598c6a38777a6597c', 'request_id': 'req-1f8b6a38-cfc1-49e1-91d2-51f01b42dfd4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:46.551050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1f8b6a38-cfc1-49e1-91d2-51f01b42dfd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12d09909b1aa4bc598c6a38777a6597c', 'request_id': 'req-1f8b6a38-cfc1-49e1-91d2-51f01b42dfd4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:46.559356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1f8b6a38-cfc1-49e1-91d2-51f01b42dfd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12d09909b1aa4bc598c6a38777a6597c', 'request_id': 'req-1f8b6a38-cfc1-49e1-91d2-51f01b42dfd4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:46.570979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1f8b6a38-cfc1-49e1-91d2-51f01b42dfd4 admin admin] The token cache is being invalidate because project 12d09909b1aa4bc598c6a38777a6597c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:44:46.571301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1f8b6a38-cfc1-49e1-91d2-51f01b42dfd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:46.571972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1f8b6a38-cfc1-49e1-91d2-51f01b42dfd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:46.573693 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3335/6643] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:44:46 2022] DELETE /identity/v3/projects/12d09909b1aa4bc598c6a38777a6597c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:46.579132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e34e4-c4da-41cf-93eb-d94c364fabe0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:46.579132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e34e4-c4da-41cf-93eb-d94c364fabe0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:46.579132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e34e4-c4da-41cf-93eb-d94c364fabe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:46.598808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-904e34e4-c4da-41cf-93eb-d94c364fabe0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:46.600143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-904e34e4-c4da-41cf-93eb-d94c364fabe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:46.712747 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3309/6644] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:46.714061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdefb38-07fe-4bfa-ba60-03c966a0c329 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:46.714061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdefb38-07fe-4bfa-ba60-03c966a0c329 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:46.714061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdefb38-07fe-4bfa-ba60-03c966a0c329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:46.746462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-abdefb38-07fe-4bfa-ba60-03c966a0c329 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:46.746462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-abdefb38-07fe-4bfa-ba60-03c966a0c329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:46.755392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e34e4-c4da-41cf-93eb-d94c364fabe0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:46.757914 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3336/6645] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:46.766553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e34e4-c4da-41cf-93eb-d94c364fabe0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:46.773066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ecbae-5e5e-4e43-9fc3-0dd74d05f383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:46.774059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ecbae-5e5e-4e43-9fc3-0dd74d05f383 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:46.774526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ecbae-5e5e-4e43-9fc3-0dd74d05f383 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:46.775070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ecbae-5e5e-4e43-9fc3-0dd74d05f383 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:46.776193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ecbae-5e5e-4e43-9fc3-0dd74d05f383 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:44:46.776769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ecbae-5e5e-4e43-9fc3-0dd74d05f383 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:46.778874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ecbae-5e5e-4e43-9fc3-0dd74d05f383 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:46.798084 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3310/6646] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:44:46.798902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdefb38-07fe-4bfa-ba60-03c966a0c329 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:46.811446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdefb38-07fe-4bfa-ba60-03c966a0c329 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:46.818260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33682e06-6867-4cfb-a88f-9078e2413589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:46.820043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33682e06-6867-4cfb-a88f-9078e2413589 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:46.820436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33682e06-6867-4cfb-a88f-9078e2413589 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:46.820912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33682e06-6867-4cfb-a88f-9078e2413589 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:46.821784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33682e06-6867-4cfb-a88f-9078e2413589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:46.824171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33682e06-6867-4cfb-a88f-9078e2413589 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:46.915708 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3337/6647] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:44:46 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:44:46.916868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ecbae-5e5e-4e43-9fc3-0dd74d05f383 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:46.932150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ecbae-5e5e-4e43-9fc3-0dd74d05f383 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:47.030050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477335cd-46a4-428a-8d41-1e876a7e6ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:47.030746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477335cd-46a4-428a-8d41-1e876a7e6ffe admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:47.031197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477335cd-46a4-428a-8d41-1e876a7e6ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:47.031635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477335cd-46a4-428a-8d41-1e876a7e6ffe admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:47.033225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477335cd-46a4-428a-8d41-1e876a7e6ffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:47.038150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477335cd-46a4-428a-8d41-1e876a7e6ffe admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:47.161273 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3311/6648] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:44:46 2022] POST /identity/v3/users => generated 292 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:44:47.163386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33682e06-6867-4cfb-a88f-9078e2413589 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:47.178939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33682e06-6867-4cfb-a88f-9078e2413589 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:47.200138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8108d-6c34-4262-82f0-39618f48f947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:47.205023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8108d-6c34-4262-82f0-39618f48f947 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:47.205023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8108d-6c34-4262-82f0-39618f48f947 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:47.205023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8108d-6c34-4262-82f0-39618f48f947 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:47.208353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8108d-6c34-4262-82f0-39618f48f947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:47.210419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8108d-6c34-4262-82f0-39618f48f947 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:47.225863 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3338/6649] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:44:47.236691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477335cd-46a4-428a-8d41-1e876a7e6ffe admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:47.249939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477335cd-46a4-428a-8d41-1e876a7e6ffe admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:47.257796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743b34e-48c3-49bc-9b9e-ba5eb15b0e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:47.262380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743b34e-48c3-49bc-9b9e-ba5eb15b0e7b admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:47.262380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743b34e-48c3-49bc-9b9e-ba5eb15b0e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:47.262380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743b34e-48c3-49bc-9b9e-ba5eb15b0e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:47.262380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743b34e-48c3-49bc-9b9e-ba5eb15b0e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:47.264240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743b34e-48c3-49bc-9b9e-ba5eb15b0e7b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:47.287939 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3312/6650] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:44:47.293388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8108d-6c34-4262-82f0-39618f48f947 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:47.324552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8108d-6c34-4262-82f0-39618f48f947 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:47.342030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d59d4-2a3e-4693-b76a-ac667cb57adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:47.344092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d59d4-2a3e-4693-b76a-ac667cb57adb admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:47.347636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d59d4-2a3e-4693-b76a-ac667cb57adb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:47.347930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d59d4-2a3e-4693-b76a-ac667cb57adb admin admin] PATH_INFO: `/v3/projects/01e2e69b7631432bb08d4a9fb4adf359/users/606bca47c4ed44ce9ca1f234a128193e/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:47.375736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d59d4-2a3e-4693-b76a-ac667cb57adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e2e69b7631432bb08d4a9fb4adf359, user_id=606bca47c4ed44ce9ca1f234a128193e, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:47.379114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d59d4-2a3e-4693-b76a-ac667cb57adb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:47.459671 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3339/6651] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:44:47 2022] PUT /identity/v3/projects/01e2e69b7631432bb08d4a9fb4adf359/users/606bca47c4ed44ce9ca1f234a128193e/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:47.462274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3f70-73b9-487a-ba10-f5ee17ba1c7e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:47.462844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3f70-73b9-487a-ba10-f5ee17ba1c7e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:47.463405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3f70-73b9-487a-ba10-f5ee17ba1c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:47.488180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3fbe3f70-73b9-487a-ba10-f5ee17ba1c7e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:47.490301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3fbe3f70-73b9-487a-ba10-f5ee17ba1c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:47.561251 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3313/6652] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:44:47.592453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d59d4-2a3e-4693-b76a-ac667cb57adb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:47.595717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dc9d59d4-2a3e-4693-b76a-ac667cb57adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:47.670894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d59d4-2a3e-4693-b76a-ac667cb57adb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:47.681309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9fbd7-160f-4abf-9a07-14b7bd962b8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:47.683634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9fbd7-160f-4abf-9a07-14b7bd962b8d service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:47.683923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9fbd7-160f-4abf-9a07-14b7bd962b8d service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:47.684328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9fbd7-160f-4abf-9a07-14b7bd962b8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:47.739062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9fbd7-160f-4abf-9a07-14b7bd962b8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:47.739062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9fbd7-160f-4abf-9a07-14b7bd962b8d service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:47.739062 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3340/6653] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:44:48.978959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe3f70-73b9-487a-ba10-f5ee17ba1c7e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:48.980506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3fbe3f70-73b9-487a-ba10-f5ee17ba1c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:49.002297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe3f70-73b9-487a-ba10-f5ee17ba1c7e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:49.007752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbf590-5326-4a5a-bcc3-713c168667c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:49.010717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbf590-5326-4a5a-bcc3-713c168667c5 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:49.010717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbf590-5326-4a5a-bcc3-713c168667c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:49.010717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbf590-5326-4a5a-bcc3-713c168667c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:49.011098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-12bbf590-5326-4a5a-bcc3-713c168667c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:49.103053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbf590-5326-4a5a-bcc3-713c168667c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:49.106605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbf590-5326-4a5a-bcc3-713c168667c5 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:49.125328 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3314/6654] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:44:49.975039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ada96-2455-463e-b168-39342819b9d4 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:49.975572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ada96-2455-463e-b168-39342819b9d4 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:49.975674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ada96-2455-463e-b168-39342819b9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:50.010610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a17ada96-2455-463e-b168-39342819b9d4 None None] MFA Rules not processed for user `606bca47c4ed44ce9ca1f234a128193e`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:50.012244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a17ada96-2455-463e-b168-39342819b9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:50.123766 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3341/6655] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:50.141113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b990f-f2b3-4eae-be0d-b24029d94114 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:50.141113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b990f-f2b3-4eae-be0d-b24029d94114 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:50.141113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b990f-f2b3-4eae-be0d-b24029d94114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:50.179425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0b1b990f-f2b3-4eae-be0d-b24029d94114 None None] MFA Rules not processed for user `606bca47c4ed44ce9ca1f234a128193e`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:50.181413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0b1b990f-f2b3-4eae-be0d-b24029d94114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:50.198841 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3315/6656] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:50.218323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ada96-2455-463e-b168-39342819b9d4 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:50.223123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a17ada96-2455-463e-b168-39342819b9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:50.243992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ada96-2455-463e-b168-39342819b9d4 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:50.256526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871be7d-5731-4325-ae36-530600f95d62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:50.257708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871be7d-5731-4325-ae36-530600f95d62 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:50.258190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871be7d-5731-4325-ae36-530600f95d62 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:50.258848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871be7d-5731-4325-ae36-530600f95d62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:50.270169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f871be7d-5731-4325-ae36-530600f95d62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:50.273462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f871be7d-5731-4325-ae36-530600f95d62 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:50.292719 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3342/6657] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:44:50.332422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b990f-f2b3-4eae-be0d-b24029d94114 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:50.338386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0b1b990f-f2b3-4eae-be0d-b24029d94114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:50.457002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b990f-f2b3-4eae-be0d-b24029d94114 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:50.460809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb63ce-ea6d-4b51-8492-4feea0de9180 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:50.461477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb63ce-ea6d-4b51-8492-4feea0de9180 service glance] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:50.461759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb63ce-ea6d-4b51-8492-4feea0de9180 service glance] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:50.462037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb63ce-ea6d-4b51-8492-4feea0de9180 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:50.463849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-08fb63ce-ea6d-4b51-8492-4feea0de9180 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:50.485151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb63ce-ea6d-4b51-8492-4feea0de9180 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:50.487147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb63ce-ea6d-4b51-8492-4feea0de9180 service glance] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:50.506746 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3316/6658] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:44:54.638002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871be7d-5731-4325-ae36-530600f95d62 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:54.639469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f871be7d-5731-4325-ae36-530600f95d62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:54.670008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871be7d-5731-4325-ae36-530600f95d62 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:54.677076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f80211-72e3-40d1-8cc7-59c56d8c0fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:54.678095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f80211-72e3-40d1-8cc7-59c56d8c0fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:54.678469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f80211-72e3-40d1-8cc7-59c56d8c0fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:54.678925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f80211-72e3-40d1-8cc7-59c56d8c0fcd admin admin] PATH_INFO: `/v3/users/0dce77d81d114c6183660b086ec8edad` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:54.680353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f80211-72e3-40d1-8cc7-59c56d8c0fcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dce77d81d114c6183660b086ec8edad)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:54.682637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f80211-72e3-40d1-8cc7-59c56d8c0fcd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:54.918605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a5f80211-72e3-40d1-8cc7-59c56d8c0fcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dce77d81d114c6183660b086ec8edad'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:54.933530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a5f80211-72e3-40d1-8cc7-59c56d8c0fcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dce77d81d114c6183660b086ec8edad'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:54.935448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a5f80211-72e3-40d1-8cc7-59c56d8c0fcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dce77d81d114c6183660b086ec8edad'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:54.941955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a5f80211-72e3-40d1-8cc7-59c56d8c0fcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dce77d81d114c6183660b086ec8edad'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:55.020366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a5f80211-72e3-40d1-8cc7-59c56d8c0fcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dce77d81d114c6183660b086ec8edad'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:55.027781 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3343/6659] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:44:54 2022] DELETE /identity/v3/users/0dce77d81d114c6183660b086ec8edad => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:55.037626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde7f17-094f-4b68-817b-319b8c03987d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:55.038698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde7f17-094f-4b68-817b-319b8c03987d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:55.039147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde7f17-094f-4b68-817b-319b8c03987d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:55.062055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2cde7f17-094f-4b68-817b-319b8c03987d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:55.063423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2cde7f17-094f-4b68-817b-319b8c03987d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:55.135129 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3317/6660] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:55.145328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f80211-72e3-40d1-8cc7-59c56d8c0fcd admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:55.147950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a5f80211-72e3-40d1-8cc7-59c56d8c0fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:55.210511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f80211-72e3-40d1-8cc7-59c56d8c0fcd admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:55.214254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828ee8d-7ae1-457d-afe5-c33e3df13a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:55.214934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828ee8d-7ae1-457d-afe5-c33e3df13a92 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:55.215225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828ee8d-7ae1-457d-afe5-c33e3df13a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:55.215501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828ee8d-7ae1-457d-afe5-c33e3df13a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:55.227062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828ee8d-7ae1-457d-afe5-c33e3df13a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:55.228583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828ee8d-7ae1-457d-afe5-c33e3df13a92 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:55.240275 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3344/6661] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:44:55.498815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde7f17-094f-4b68-817b-319b8c03987d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:55.500438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2cde7f17-094f-4b68-817b-319b8c03987d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:55.516982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde7f17-094f-4b68-817b-319b8c03987d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:55.523621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce34c78-5b43-46fe-8fbc-e81491678a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:55.524704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce34c78-5b43-46fe-8fbc-e81491678a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:55.525132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce34c78-5b43-46fe-8fbc-e81491678a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:55.525530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce34c78-5b43-46fe-8fbc-e81491678a5e admin admin] PATH_INFO: `/v3/projects/5e4513887095430d9daab49e6ce69d21` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:55.526860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce34c78-5b43-46fe-8fbc-e81491678a5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e4513887095430d9daab49e6ce69d21)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:55.529016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce34c78-5b43-46fe-8fbc-e81491678a5e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:55.654259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5ce34c78-5b43-46fe-8fbc-e81491678a5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e4513887095430d9daab49e6ce69d21', 'request_id': 'req-5ce34c78-5b43-46fe-8fbc-e81491678a5e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:55.660341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5ce34c78-5b43-46fe-8fbc-e81491678a5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e4513887095430d9daab49e6ce69d21', 'request_id': 'req-5ce34c78-5b43-46fe-8fbc-e81491678a5e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:55.736322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5ce34c78-5b43-46fe-8fbc-e81491678a5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e4513887095430d9daab49e6ce69d21', 'request_id': 'req-5ce34c78-5b43-46fe-8fbc-e81491678a5e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:55.747566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5ce34c78-5b43-46fe-8fbc-e81491678a5e admin admin] The token cache is being invalidate because project 5e4513887095430d9daab49e6ce69d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:44:55.747863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5ce34c78-5b43-46fe-8fbc-e81491678a5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:55.748501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5ce34c78-5b43-46fe-8fbc-e81491678a5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:55.750107 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3318/6662] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:44:55 2022] DELETE /identity/v3/projects/5e4513887095430d9daab49e6ce69d21 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:55.759659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c787f-71aa-4027-af8e-6745bd3d38e1 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:55.760153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c787f-71aa-4027-af8e-6745bd3d38e1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:55.760272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c787f-71aa-4027-af8e-6745bd3d38e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:55.779377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e91c787f-71aa-4027-af8e-6745bd3d38e1 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:55.780683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e91c787f-71aa-4027-af8e-6745bd3d38e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:55.850928 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3345/6663] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:55.852738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046e678-1400-416f-ae7a-0f3fa051ca6e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:55.853100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046e678-1400-416f-ae7a-0f3fa051ca6e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:55.853448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046e678-1400-416f-ae7a-0f3fa051ca6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:55.915190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2046e678-1400-416f-ae7a-0f3fa051ca6e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:55.916426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2046e678-1400-416f-ae7a-0f3fa051ca6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:55.932746 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3319/6664] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:55.935045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c787f-71aa-4027-af8e-6745bd3d38e1 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:55.946852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c787f-71aa-4027-af8e-6745bd3d38e1 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:55.952246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074315a6-501f-4e8b-8cad-a93ebc8d6f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:55.952856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074315a6-501f-4e8b-8cad-a93ebc8d6f74 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:55.953146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074315a6-501f-4e8b-8cad-a93ebc8d6f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:55.953428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074315a6-501f-4e8b-8cad-a93ebc8d6f74 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:55.954201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074315a6-501f-4e8b-8cad-a93ebc8d6f74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:44:55.954514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074315a6-501f-4e8b-8cad-a93ebc8d6f74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:55.956190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074315a6-501f-4e8b-8cad-a93ebc8d6f74 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:55.968668 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3346/6665] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:44:55.972966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046e678-1400-416f-ae7a-0f3fa051ca6e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:55.983152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046e678-1400-416f-ae7a-0f3fa051ca6e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:55.988670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870a69c-05ed-440e-83ef-9b8f0f5aaa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:55.989351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870a69c-05ed-440e-83ef-9b8f0f5aaa81 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:55.989657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870a69c-05ed-440e-83ef-9b8f0f5aaa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:55.989938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870a69c-05ed-440e-83ef-9b8f0f5aaa81 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:55.990629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870a69c-05ed-440e-83ef-9b8f0f5aaa81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:55.992538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870a69c-05ed-440e-83ef-9b8f0f5aaa81 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:56.075613 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3320/6666] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:44:55 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:44:56.079835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074315a6-501f-4e8b-8cad-a93ebc8d6f74 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:56.090451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074315a6-501f-4e8b-8cad-a93ebc8d6f74 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:56.173877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3366b8-257f-4459-8c63-1f40aa78f426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:56.175178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3366b8-257f-4459-8c63-1f40aa78f426 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:56.175471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3366b8-257f-4459-8c63-1f40aa78f426 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:56.175752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3366b8-257f-4459-8c63-1f40aa78f426 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:56.176451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3366b8-257f-4459-8c63-1f40aa78f426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:56.178637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3366b8-257f-4459-8c63-1f40aa78f426 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:56.261925 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3347/6667] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:44:56 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:44:56.266178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870a69c-05ed-440e-83ef-9b8f0f5aaa81 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:56.276984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870a69c-05ed-440e-83ef-9b8f0f5aaa81 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:56.285967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacc00d-854d-4b55-b283-717776d3573c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:56.286868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacc00d-854d-4b55-b283-717776d3573c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:56.287259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacc00d-854d-4b55-b283-717776d3573c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:56.288789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacc00d-854d-4b55-b283-717776d3573c admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:56.289644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacc00d-854d-4b55-b283-717776d3573c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:56.294346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacc00d-854d-4b55-b283-717776d3573c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:56.309240 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3321/6668] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:44:56.313405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3366b8-257f-4459-8c63-1f40aa78f426 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:56.325550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3366b8-257f-4459-8c63-1f40aa78f426 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:56.331434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da0501-9adf-49ab-816d-a780e37a8801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:56.332123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da0501-9adf-49ab-816d-a780e37a8801 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:56.332413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da0501-9adf-49ab-816d-a780e37a8801 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:56.332863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da0501-9adf-49ab-816d-a780e37a8801 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:56.334028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da0501-9adf-49ab-816d-a780e37a8801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:56.336148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da0501-9adf-49ab-816d-a780e37a8801 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:56.348303 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3348/6669] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:44:56.352102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacc00d-854d-4b55-b283-717776d3573c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:56.364208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacc00d-854d-4b55-b283-717776d3573c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:56.369120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f12c7-75eb-4e01-ab51-771dab196e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:56.370086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f12c7-75eb-4e01-ab51-771dab196e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:56.370378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f12c7-75eb-4e01-ab51-771dab196e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:56.370663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f12c7-75eb-4e01-ab51-771dab196e7f admin admin] PATH_INFO: `/v3/projects/d05de35a41ec42a18fe2b13d8a5f28ff/users/b99cdbed88664d8eb70a57988393cc8f/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:56.387933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f12c7-75eb-4e01-ab51-771dab196e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d05de35a41ec42a18fe2b13d8a5f28ff, user_id=b99cdbed88664d8eb70a57988393cc8f, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:56.390656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f12c7-75eb-4e01-ab51-771dab196e7f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:56.484278 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3322/6670] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:44:56 2022] PUT /identity/v3/projects/d05de35a41ec42a18fe2b13d8a5f28ff/users/b99cdbed88664d8eb70a57988393cc8f/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:44:56.495742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6ff09-506b-4f71-93d0-c920e9e5b431 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:56.496282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6ff09-506b-4f71-93d0-c920e9e5b431 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:56.496986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6ff09-506b-4f71-93d0-c920e9e5b431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:56.526169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-07f6ff09-506b-4f71-93d0-c920e9e5b431 None None] MFA Rules not processed for user `b99cdbed88664d8eb70a57988393cc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:44:56.527399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-07f6ff09-506b-4f71-93d0-c920e9e5b431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:56.594050 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3349/6671] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:44:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:44:56.606327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f12c7-75eb-4e01-ab51-771dab196e7f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:56.608377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d73f12c7-75eb-4e01-ab51-771dab196e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:56.671844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f12c7-75eb-4e01-ab51-771dab196e7f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:56.675886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3402f-7788-4d87-9460-2f294c720a49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:56.676577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3402f-7788-4d87-9460-2f294c720a49 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:56.676908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3402f-7788-4d87-9460-2f294c720a49 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:56.677182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3402f-7788-4d87-9460-2f294c720a49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:56.685939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3402f-7788-4d87-9460-2f294c720a49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:56.687372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3402f-7788-4d87-9460-2f294c720a49 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:56.696713 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3323/6672] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:44:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:44:59.281145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6ff09-506b-4f71-93d0-c920e9e5b431 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:44:59.282876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-07f6ff09-506b-4f71-93d0-c920e9e5b431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:44:59.350386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6ff09-506b-4f71-93d0-c920e9e5b431 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:44:59.354998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adbb20-9022-4e4a-9f70-d413ddf57fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:44:59.358220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adbb20-9022-4e4a-9f70-d413ddf57fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:44:59.358220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adbb20-9022-4e4a-9f70-d413ddf57fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:44:59.358220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adbb20-9022-4e4a-9f70-d413ddf57fd7 admin admin] PATH_INFO: `/v3/users/de203f1388b942d298e65de9cd8460b9` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:44:59.358220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2adbb20-9022-4e4a-9f70-d413ddf57fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de203f1388b942d298e65de9cd8460b9)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:44:59.359576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2adbb20-9022-4e4a-9f70-d413ddf57fd7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:44:59.551574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e2adbb20-9022-4e4a-9f70-d413ddf57fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de203f1388b942d298e65de9cd8460b9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:59.561833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e2adbb20-9022-4e4a-9f70-d413ddf57fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de203f1388b942d298e65de9cd8460b9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:59.562853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e2adbb20-9022-4e4a-9f70-d413ddf57fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de203f1388b942d298e65de9cd8460b9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:59.569434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e2adbb20-9022-4e4a-9f70-d413ddf57fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de203f1388b942d298e65de9cd8460b9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:59.633268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e2adbb20-9022-4e4a-9f70-d413ddf57fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de203f1388b942d298e65de9cd8460b9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:44:59.639769 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3350/6673] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:44:59 2022] DELETE /identity/v3/users/de203f1388b942d298e65de9cd8460b9 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:44:59.993549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3402f-7788-4d87-9460-2f294c720a49 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:00.014692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3402f-7788-4d87-9460-2f294c720a49 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:00.078754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300c4c7-49c1-4486-9a2b-c5cee135b1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:00.079607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300c4c7-49c1-4486-9a2b-c5cee135b1ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:00.079889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300c4c7-49c1-4486-9a2b-c5cee135b1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:00.080166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300c4c7-49c1-4486-9a2b-c5cee135b1ea admin admin] PATH_INFO: `/v3/projects/357c7586006d4c5080ac407259724c65` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:00.082218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300c4c7-49c1-4486-9a2b-c5cee135b1ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=357c7586006d4c5080ac407259724c65)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:00.084125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300c4c7-49c1-4486-9a2b-c5cee135b1ea admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:00.245583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d300c4c7-49c1-4486-9a2b-c5cee135b1ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '357c7586006d4c5080ac407259724c65', 'request_id': 'req-d300c4c7-49c1-4486-9a2b-c5cee135b1ea'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:00.252019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d300c4c7-49c1-4486-9a2b-c5cee135b1ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '357c7586006d4c5080ac407259724c65', 'request_id': 'req-d300c4c7-49c1-4486-9a2b-c5cee135b1ea'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:00.324844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d300c4c7-49c1-4486-9a2b-c5cee135b1ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '357c7586006d4c5080ac407259724c65', 'request_id': 'req-d300c4c7-49c1-4486-9a2b-c5cee135b1ea'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:00.337752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d300c4c7-49c1-4486-9a2b-c5cee135b1ea admin admin] The token cache is being invalidate because project 357c7586006d4c5080ac407259724c65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:45:00.338062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d300c4c7-49c1-4486-9a2b-c5cee135b1ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:00.338772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d300c4c7-49c1-4486-9a2b-c5cee135b1ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:00.340361 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3324/6674] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:44:59 2022] DELETE /identity/v3/projects/357c7586006d4c5080ac407259724c65 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:00.348546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c59a2-98c3-46db-9240-57d424c2c4c7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:00.349229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c59a2-98c3-46db-9240-57d424c2c4c7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:00.349229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c59a2-98c3-46db-9240-57d424c2c4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:00.369572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-df6c59a2-98c3-46db-9240-57d424c2c4c7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:00.370928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-df6c59a2-98c3-46db-9240-57d424c2c4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:00.438674 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3351/6675] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:45:00.446330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82190fd8-61b3-4866-ac47-cf4b6b784c91 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:00.447714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82190fd8-61b3-4866-ac47-cf4b6b784c91 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:00.447714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82190fd8-61b3-4866-ac47-cf4b6b784c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:00.470489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-82190fd8-61b3-4866-ac47-cf4b6b784c91 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:00.472285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-82190fd8-61b3-4866-ac47-cf4b6b784c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:00.485000 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3325/6676] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:00.486239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c59a2-98c3-46db-9240-57d424c2c4c7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:00.497663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c59a2-98c3-46db-9240-57d424c2c4c7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:00.502798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d010a-0f83-44a6-a20e-38bcd1d365a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:00.503651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d010a-0f83-44a6-a20e-38bcd1d365a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:00.503933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d010a-0f83-44a6-a20e-38bcd1d365a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:00.504202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d010a-0f83-44a6-a20e-38bcd1d365a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:00.505335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d010a-0f83-44a6-a20e-38bcd1d365a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:45:00.505645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d010a-0f83-44a6-a20e-38bcd1d365a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:00.507476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d010a-0f83-44a6-a20e-38bcd1d365a6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:00.523438 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3352/6677] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:45:00.525862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82190fd8-61b3-4866-ac47-cf4b6b784c91 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:00.540033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82190fd8-61b3-4866-ac47-cf4b6b784c91 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:00.546407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d32ea-8ca6-4d94-b83a-0023ab214e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:00.548689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d32ea-8ca6-4d94-b83a-0023ab214e75 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:00.548689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d32ea-8ca6-4d94-b83a-0023ab214e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:00.548689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d32ea-8ca6-4d94-b83a-0023ab214e75 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:00.548689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d32ea-8ca6-4d94-b83a-0023ab214e75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:00.555963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d32ea-8ca6-4d94-b83a-0023ab214e75 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:00.632349 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3326/6678] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:45:00 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:45:00.636875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d010a-0f83-44a6-a20e-38bcd1d365a6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:00.647813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d010a-0f83-44a6-a20e-38bcd1d365a6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:00.718708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06a0ff-15a5-4b02-b45d-7223042b1dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:00.719307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06a0ff-15a5-4b02-b45d-7223042b1dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:00.719594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06a0ff-15a5-4b02-b45d-7223042b1dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:00.719877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06a0ff-15a5-4b02-b45d-7223042b1dc8 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:00.720575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06a0ff-15a5-4b02-b45d-7223042b1dc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:00.722590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06a0ff-15a5-4b02-b45d-7223042b1dc8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:00.828228 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3353/6679] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:45:00 2022] POST /identity/v3/users => generated 284 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:45:00.832217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d32ea-8ca6-4d94-b83a-0023ab214e75 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:00.842479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d32ea-8ca6-4d94-b83a-0023ab214e75 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:00.847258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d084a-52d7-4f48-872b-1ac47d545b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:00.847906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d084a-52d7-4f48-872b-1ac47d545b1a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:00.849928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d084a-52d7-4f48-872b-1ac47d545b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:00.849928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d084a-52d7-4f48-872b-1ac47d545b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:00.849928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d084a-52d7-4f48-872b-1ac47d545b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:00.850950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d084a-52d7-4f48-872b-1ac47d545b1a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:00.860983 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3327/6680] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:45:00.864920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06a0ff-15a5-4b02-b45d-7223042b1dc8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:00.875553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06a0ff-15a5-4b02-b45d-7223042b1dc8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:00.881298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ef7a0-18e9-4b2f-adb7-20721c21e41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:00.882026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef7a0-18e9-4b2f-adb7-20721c21e41f admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:00.882314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef7a0-18e9-4b2f-adb7-20721c21e41f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:00.882588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef7a0-18e9-4b2f-adb7-20721c21e41f admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:00.883316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ef7a0-18e9-4b2f-adb7-20721c21e41f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:00.885048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ef7a0-18e9-4b2f-adb7-20721c21e41f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:00.896785 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3354/6681] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:45:00.901750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d084a-52d7-4f48-872b-1ac47d545b1a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:00.911908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d084a-52d7-4f48-872b-1ac47d545b1a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:00.916503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6265dc-4822-439f-8727-50a6d8aeda15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:00.917410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6265dc-4822-439f-8727-50a6d8aeda15 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:00.917688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6265dc-4822-439f-8727-50a6d8aeda15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:00.917958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6265dc-4822-439f-8727-50a6d8aeda15 admin admin] PATH_INFO: `/v3/projects/d7e965673511439386e8a383fd25d8ee/users/1e60d246f1ea48bf884ef8fb32d2511c/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:00.934564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6265dc-4822-439f-8727-50a6d8aeda15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e965673511439386e8a383fd25d8ee, user_id=1e60d246f1ea48bf884ef8fb32d2511c, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:00.936689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6265dc-4822-439f-8727-50a6d8aeda15 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:01.026356 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3328/6682] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:45:00 2022] PUT /identity/v3/projects/d7e965673511439386e8a383fd25d8ee/users/1e60d246f1ea48bf884ef8fb32d2511c/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:01.034632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fe1e5-defb-4147-9b07-118fe61f28f1 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:01.039525 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fe1e5-defb-4147-9b07-118fe61f28f1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:01.039525 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fe1e5-defb-4147-9b07-118fe61f28f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:01.054766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-253fe1e5-defb-4147-9b07-118fe61f28f1 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:01.055790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-253fe1e5-defb-4147-9b07-118fe61f28f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:01.122670 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3355/6683] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:01.133252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6265dc-4822-439f-8727-50a6d8aeda15 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:01.135106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0f6265dc-4822-439f-8727-50a6d8aeda15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:01.193812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6265dc-4822-439f-8727-50a6d8aeda15 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:01.197575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c46c9f-ac11-4f26-91a3-f8cf7f45a92c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:01.198230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c46c9f-ac11-4f26-91a3-f8cf7f45a92c service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:01.198539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c46c9f-ac11-4f26-91a3-f8cf7f45a92c service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:01.198860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c46c9f-ac11-4f26-91a3-f8cf7f45a92c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:01.207845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c46c9f-ac11-4f26-91a3-f8cf7f45a92c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:01.212778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c46c9f-ac11-4f26-91a3-f8cf7f45a92c service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:01.219168 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3329/6684] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:45:02.714664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffd133-dc88-43f3-bf50-c9707c997a21 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:02.715158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffd133-dc88-43f3-bf50-c9707c997a21 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:02.715254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffd133-dc88-43f3-bf50-c9707c997a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:02.795384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3cffd133-dc88-43f3-bf50-c9707c997a21 None None] MFA Rules not processed for user `1e60d246f1ea48bf884ef8fb32d2511c`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:02.797480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3cffd133-dc88-43f3-bf50-c9707c997a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:02.929614 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3356/6685] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:02.941909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46555c4d-9eef-43a6-a306-f8b8624520ab None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:02.942466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46555c4d-9eef-43a6-a306-f8b8624520ab None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:02.942843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46555c4d-9eef-43a6-a306-f8b8624520ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:02.967288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-46555c4d-9eef-43a6-a306-f8b8624520ab None None] MFA Rules not processed for user `1e60d246f1ea48bf884ef8fb32d2511c`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:02.968622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-46555c4d-9eef-43a6-a306-f8b8624520ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:02.977821 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3330/6686] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:02.990214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffd133-dc88-43f3-bf50-c9707c997a21 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:02.991859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3cffd133-dc88-43f3-bf50-c9707c997a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:03.079877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffd133-dc88-43f3-bf50-c9707c997a21 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:03.087512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86191bf7-52af-40be-a4df-351ead1995b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:03.088208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86191bf7-52af-40be-a4df-351ead1995b9 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:03.089735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86191bf7-52af-40be-a4df-351ead1995b9 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:03.090038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86191bf7-52af-40be-a4df-351ead1995b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:03.109418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86191bf7-52af-40be-a4df-351ead1995b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:03.111264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86191bf7-52af-40be-a4df-351ead1995b9 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:03.126880 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3357/6687] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:02 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:45:11.172426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46555c4d-9eef-43a6-a306-f8b8624520ab None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:11.174465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-46555c4d-9eef-43a6-a306-f8b8624520ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:11.195885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46555c4d-9eef-43a6-a306-f8b8624520ab None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:11.203264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751ec58-7168-4f06-ae69-7c03f8cd9e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:11.204706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751ec58-7168-4f06-ae69-7c03f8cd9e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:11.205559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751ec58-7168-4f06-ae69-7c03f8cd9e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:11.206025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751ec58-7168-4f06-ae69-7c03f8cd9e6a admin admin] PATH_INFO: `/v3/users/606bca47c4ed44ce9ca1f234a128193e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:11.207924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751ec58-7168-4f06-ae69-7c03f8cd9e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=606bca47c4ed44ce9ca1f234a128193e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:11.211064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751ec58-7168-4f06-ae69-7c03f8cd9e6a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:11.399686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5751ec58-7168-4f06-ae69-7c03f8cd9e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '606bca47c4ed44ce9ca1f234a128193e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:11.417425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5751ec58-7168-4f06-ae69-7c03f8cd9e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '606bca47c4ed44ce9ca1f234a128193e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:11.418315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5751ec58-7168-4f06-ae69-7c03f8cd9e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '606bca47c4ed44ce9ca1f234a128193e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:11.427101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5751ec58-7168-4f06-ae69-7c03f8cd9e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '606bca47c4ed44ce9ca1f234a128193e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:11.547485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5751ec58-7168-4f06-ae69-7c03f8cd9e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '606bca47c4ed44ce9ca1f234a128193e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:11.554709 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3331/6688] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:45:11 2022] DELETE /identity/v3/users/606bca47c4ed44ce9ca1f234a128193e => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:11.826338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86191bf7-52af-40be-a4df-351ead1995b9 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:11.851630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86191bf7-52af-40be-a4df-351ead1995b9 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:11.921972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0e0b5-4582-405c-9994-7dbe361d121c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:11.922860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0e0b5-4582-405c-9994-7dbe361d121c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:11.923144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0e0b5-4582-405c-9994-7dbe361d121c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:11.923421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0e0b5-4582-405c-9994-7dbe361d121c admin admin] PATH_INFO: `/v3/projects/01e2e69b7631432bb08d4a9fb4adf359` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:11.925617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0e0b5-4582-405c-9994-7dbe361d121c admin admin] RBAC: Authorizing `identity:delete_project(project_id=01e2e69b7631432bb08d4a9fb4adf359)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:11.927442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0e0b5-4582-405c-9994-7dbe361d121c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:12.067272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-12d0e0b5-4582-405c-9994-7dbe361d121c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e2e69b7631432bb08d4a9fb4adf359', 'request_id': 'req-12d0e0b5-4582-405c-9994-7dbe361d121c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:12.198426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-12d0e0b5-4582-405c-9994-7dbe361d121c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e2e69b7631432bb08d4a9fb4adf359', 'request_id': 'req-12d0e0b5-4582-405c-9994-7dbe361d121c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:12.205183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-12d0e0b5-4582-405c-9994-7dbe361d121c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e2e69b7631432bb08d4a9fb4adf359', 'request_id': 'req-12d0e0b5-4582-405c-9994-7dbe361d121c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:12.215557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-12d0e0b5-4582-405c-9994-7dbe361d121c admin admin] The token cache is being invalidate because project 01e2e69b7631432bb08d4a9fb4adf359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:45:12.215857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-12d0e0b5-4582-405c-9994-7dbe361d121c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:12.216536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-12d0e0b5-4582-405c-9994-7dbe361d121c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:12.218468 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3358/6689] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:45:11 2022] DELETE /identity/v3/projects/01e2e69b7631432bb08d4a9fb4adf359 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:12.223769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc93d1-102b-44b0-b5bf-c921bc93b534 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:12.224258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc93d1-102b-44b0-b5bf-c921bc93b534 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:12.224358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc93d1-102b-44b0-b5bf-c921bc93b534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:12.244726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4adc93d1-102b-44b0-b5bf-c921bc93b534 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:12.245982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4adc93d1-102b-44b0-b5bf-c921bc93b534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:12.313286 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3332/6690] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:12.316180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7345a-f3e5-454d-95e7-06cecbd2fcfb None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:12.316713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7345a-f3e5-454d-95e7-06cecbd2fcfb None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:12.317107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7345a-f3e5-454d-95e7-06cecbd2fcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:12.337571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-66d7345a-f3e5-454d-95e7-06cecbd2fcfb None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:12.338920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-66d7345a-f3e5-454d-95e7-06cecbd2fcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:12.350270 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3359/6691] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:12.354847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc93d1-102b-44b0-b5bf-c921bc93b534 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:12.371693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc93d1-102b-44b0-b5bf-c921bc93b534 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:12.378876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8c234-5c6a-4a49-92a5-354080a65917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:12.382670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8c234-5c6a-4a49-92a5-354080a65917 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:12.382670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8c234-5c6a-4a49-92a5-354080a65917 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:12.382670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8c234-5c6a-4a49-92a5-354080a65917 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:12.382670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8c234-5c6a-4a49-92a5-354080a65917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:45:12.382670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8c234-5c6a-4a49-92a5-354080a65917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:12.383446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8c234-5c6a-4a49-92a5-354080a65917 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:12.396419 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3333/6692] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:45:12.400686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7345a-f3e5-454d-95e7-06cecbd2fcfb None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:12.413854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7345a-f3e5-454d-95e7-06cecbd2fcfb None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:12.419031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811ea4d-aae1-4c61-904a-284b9a31a789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:12.419710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811ea4d-aae1-4c61-904a-284b9a31a789 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:12.420002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811ea4d-aae1-4c61-904a-284b9a31a789 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:12.420282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811ea4d-aae1-4c61-904a-284b9a31a789 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:12.421172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811ea4d-aae1-4c61-904a-284b9a31a789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:12.423124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811ea4d-aae1-4c61-904a-284b9a31a789 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:12.518439 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3360/6693] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:45:12 2022] POST /identity/v3/projects => generated 397 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:45:12.520313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8c234-5c6a-4a49-92a5-354080a65917 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:12.532898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8c234-5c6a-4a49-92a5-354080a65917 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:12.608379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2dd0fb-af2a-4666-aa90-b4c63322e742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:12.608379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dd0fb-af2a-4666-aa90-b4c63322e742 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:12.608379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dd0fb-af2a-4666-aa90-b4c63322e742 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:12.608379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dd0fb-af2a-4666-aa90-b4c63322e742 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:12.608940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2dd0fb-af2a-4666-aa90-b4c63322e742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:12.608940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2dd0fb-af2a-4666-aa90-b4c63322e742 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:12.702048 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3334/6694] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:45:12 2022] POST /identity/v3/users => generated 299 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:45:12.706523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811ea4d-aae1-4c61-904a-284b9a31a789 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:12.717308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811ea4d-aae1-4c61-904a-284b9a31a789 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:12.723175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d3e1f-cd9e-41e1-a22f-f17a984dfb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:12.723794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d3e1f-cd9e-41e1-a22f-f17a984dfb92 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:12.730731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d3e1f-cd9e-41e1-a22f-f17a984dfb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:12.730731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d3e1f-cd9e-41e1-a22f-f17a984dfb92 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:12.730731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d3e1f-cd9e-41e1-a22f-f17a984dfb92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:12.730731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d3e1f-cd9e-41e1-a22f-f17a984dfb92 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:12.737694 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3361/6695] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:45:12.741696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2dd0fb-af2a-4666-aa90-b4c63322e742 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:12.753840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2dd0fb-af2a-4666-aa90-b4c63322e742 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:12.761259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30939103-15d7-4ee8-9bb0-7d72bfb6a257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:12.761259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30939103-15d7-4ee8-9bb0-7d72bfb6a257 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:12.761259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30939103-15d7-4ee8-9bb0-7d72bfb6a257 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:12.761259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30939103-15d7-4ee8-9bb0-7d72bfb6a257 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:12.761658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30939103-15d7-4ee8-9bb0-7d72bfb6a257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:12.762410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30939103-15d7-4ee8-9bb0-7d72bfb6a257 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:12.774877 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3335/6696] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:45:12.793026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d3e1f-cd9e-41e1-a22f-f17a984dfb92 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:12.804846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d3e1f-cd9e-41e1-a22f-f17a984dfb92 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:12.810383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb04cb6-42db-448d-90aa-87120b364229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:12.811273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb04cb6-42db-448d-90aa-87120b364229 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:12.811555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb04cb6-42db-448d-90aa-87120b364229 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:12.811865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb04cb6-42db-448d-90aa-87120b364229 admin admin] PATH_INFO: `/v3/projects/180087b75c3743b7acc32b0aa9bee8b5/users/289b1a8d2b7d4c309a9f187c20d6a561/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:12.829559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb04cb6-42db-448d-90aa-87120b364229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=180087b75c3743b7acc32b0aa9bee8b5, user_id=289b1a8d2b7d4c309a9f187c20d6a561, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:12.832857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb04cb6-42db-448d-90aa-87120b364229 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:12.904876 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3362/6697] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:45:12 2022] PUT /identity/v3/projects/180087b75c3743b7acc32b0aa9bee8b5/users/289b1a8d2b7d4c309a9f187c20d6a561/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:12.907990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496e7e8-e0e9-42fe-9f0e-363bd3c75651 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:12.908418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496e7e8-e0e9-42fe-9f0e-363bd3c75651 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:12.908800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496e7e8-e0e9-42fe-9f0e-363bd3c75651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:12.952226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5496e7e8-e0e9-42fe-9f0e-363bd3c75651 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:12.956652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5496e7e8-e0e9-42fe-9f0e-363bd3c75651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:13.068158 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3336/6698] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:13.098825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb04cb6-42db-448d-90aa-87120b364229 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:13.101690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bfb04cb6-42db-448d-90aa-87120b364229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:13.201328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb04cb6-42db-448d-90aa-87120b364229 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:13.206507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6ba5a-e9a4-4be9-af3e-64659db6d9ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:13.209092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6ba5a-e9a4-4be9-af3e-64659db6d9ef service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:13.209568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6ba5a-e9a4-4be9-af3e-64659db6d9ef service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:13.210014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6ba5a-e9a4-4be9-af3e-64659db6d9ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:13.237482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6ba5a-e9a4-4be9-af3e-64659db6d9ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:13.238959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6ba5a-e9a4-4be9-af3e-64659db6d9ef service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:13.255131 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3363/6699] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:45:14.676209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02115ffd-4f9f-4dc4-ae6d-a02e88a51d9f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:14.676775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02115ffd-4f9f-4dc4-ae6d-a02e88a51d9f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:14.676775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02115ffd-4f9f-4dc4-ae6d-a02e88a51d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:14.722076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-02115ffd-4f9f-4dc4-ae6d-a02e88a51d9f None None] MFA Rules not processed for user `289b1a8d2b7d4c309a9f187c20d6a561`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:14.723576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-02115ffd-4f9f-4dc4-ae6d-a02e88a51d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:14.804648 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3337/6700] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:45:14.811152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7dd7a-9833-48df-9a3e-8de49469151a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:14.812738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7dd7a-9833-48df-9a3e-8de49469151a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:14.812738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7dd7a-9833-48df-9a3e-8de49469151a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:14.832753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-32a7dd7a-9833-48df-9a3e-8de49469151a None None] MFA Rules not processed for user `289b1a8d2b7d4c309a9f187c20d6a561`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:14.834363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-32a7dd7a-9833-48df-9a3e-8de49469151a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:14.842417 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3364/6701] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:14.853759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02115ffd-4f9f-4dc4-ae6d-a02e88a51d9f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:14.855413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-02115ffd-4f9f-4dc4-ae6d-a02e88a51d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:14.896955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065030f-a4c4-484a-b79a-0ec4f754a2b3 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:14.896955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065030f-a4c4-484a-b79a-0ec4f754a2b3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:14.896955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065030f-a4c4-484a-b79a-0ec4f754a2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:14.909032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0065030f-a4c4-484a-b79a-0ec4f754a2b3 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:14.910449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0065030f-a4c4-484a-b79a-0ec4f754a2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:14.946313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02115ffd-4f9f-4dc4-ae6d-a02e88a51d9f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:14.952537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0f9b5-dddb-4d87-ab02-dc0c40ffc684 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:14.953245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0f9b5-dddb-4d87-ab02-dc0c40ffc684 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:14.953528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0f9b5-dddb-4d87-ab02-dc0c40ffc684 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:14.953832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0f9b5-dddb-4d87-ab02-dc0c40ffc684 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:14.962598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0f9b5-dddb-4d87-ab02-dc0c40ffc684 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:14.964192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0f9b5-dddb-4d87-ab02-dc0c40ffc684 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:14.974134 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3338/6702] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:45:14.974295 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3365/6703] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:45:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:45:14.987159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0f9b5-dddb-4d87-ab02-dc0c40ffc684 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:14.988694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-20f0f9b5-dddb-4d87-ab02-dc0c40ffc684 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:15.064964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0f9b5-dddb-4d87-ab02-dc0c40ffc684 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:15.070152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b650b9-daed-4c56-8bce-09206bb69f0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:15.070806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b650b9-daed-4c56-8bce-09206bb69f0f service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:15.071216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b650b9-daed-4c56-8bce-09206bb69f0f service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:15.071505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b650b9-daed-4c56-8bce-09206bb69f0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:15.080818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b650b9-daed-4c56-8bce-09206bb69f0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:15.082660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b650b9-daed-4c56-8bce-09206bb69f0f service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:15.091977 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3339/6704] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:45:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:45:17.485543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065030f-a4c4-484a-b79a-0ec4f754a2b3 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:17.487538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0065030f-a4c4-484a-b79a-0ec4f754a2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:17.586449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065030f-a4c4-484a-b79a-0ec4f754a2b3 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:17.592581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985d6ae-0de7-44f1-90a5-bf52932fd3c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:17.593287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985d6ae-0de7-44f1-90a5-bf52932fd3c4 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:17.593713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985d6ae-0de7-44f1-90a5-bf52932fd3c4 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:17.593999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985d6ae-0de7-44f1-90a5-bf52932fd3c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:17.596936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7985d6ae-0de7-44f1-90a5-bf52932fd3c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:17.613979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985d6ae-0de7-44f1-90a5-bf52932fd3c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:17.616033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985d6ae-0de7-44f1-90a5-bf52932fd3c4 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:17.630809 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3366/6705] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:45:18.419670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941f2f0-9701-44e2-bd98-35efea24aa54 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:18.420819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941f2f0-9701-44e2-bd98-35efea24aa54 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:18.421398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941f2f0-9701-44e2-bd98-35efea24aa54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:18.445008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c941f2f0-9701-44e2-bd98-35efea24aa54 None None] MFA Rules not processed for user `1e60d246f1ea48bf884ef8fb32d2511c`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:18.446837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c941f2f0-9701-44e2-bd98-35efea24aa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:18.532805 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3340/6706] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:19.632492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985d6ae-0de7-44f1-90a5-bf52932fd3c4 service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:19.646611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985d6ae-0de7-44f1-90a5-bf52932fd3c4 service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:19.652687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3ac51-7651-4358-80ac-ca7885e46dce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:19.653352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3ac51-7651-4358-80ac-ca7885e46dce service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:19.653635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3ac51-7651-4358-80ac-ca7885e46dce service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:19.653919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3ac51-7651-4358-80ac-ca7885e46dce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:19.656475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-cfa3ac51-7651-4358-80ac-ca7885e46dce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:19.673755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3ac51-7651-4358-80ac-ca7885e46dce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:19.676008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3ac51-7651-4358-80ac-ca7885e46dce service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:19.687942 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3367/6707] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:45:19.842975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e956e0b-9c5c-4919-a240-099ea036e532 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:19.843521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e956e0b-9c5c-4919-a240-099ea036e532 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:19.843521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e956e0b-9c5c-4919-a240-099ea036e532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:19.873347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6e956e0b-9c5c-4919-a240-099ea036e532 None None] MFA Rules not processed for user `1e60d246f1ea48bf884ef8fb32d2511c`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:19.875017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6e956e0b-9c5c-4919-a240-099ea036e532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:19.889695 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3341/6708] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:19.964493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3ac51-7651-4358-80ac-ca7885e46dce service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:19.977245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3ac51-7651-4358-80ac-ca7885e46dce service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:19.983983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8b5bc-c737-4079-9998-aafaede731d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:19.984682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8b5bc-c737-4079-9998-aafaede731d9 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:19.984974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8b5bc-c737-4079-9998-aafaede731d9 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:19.985259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8b5bc-c737-4079-9998-aafaede731d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:19.987502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a2d8b5bc-c737-4079-9998-aafaede731d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:20.002293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8b5bc-c737-4079-9998-aafaede731d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:20.003887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8b5bc-c737-4079-9998-aafaede731d9 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:20.015912 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3368/6709] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:45:22.534936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e956e0b-9c5c-4919-a240-099ea036e532 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:22.537052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6e956e0b-9c5c-4919-a240-099ea036e532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:22.556331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e956e0b-9c5c-4919-a240-099ea036e532 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:22.559980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3276ac5-5fbd-44a9-9795-6e0c08adab1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:22.560783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3276ac5-5fbd-44a9-9795-6e0c08adab1f service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:22.561165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3276ac5-5fbd-44a9-9795-6e0c08adab1f service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:22.562096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3276ac5-5fbd-44a9-9795-6e0c08adab1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:22.563971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f3276ac5-5fbd-44a9-9795-6e0c08adab1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:22.578034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3276ac5-5fbd-44a9-9795-6e0c08adab1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:22.580342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3276ac5-5fbd-44a9-9795-6e0c08adab1f service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:22.592925 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3342/6710] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:45:26.702830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8b5bc-c737-4079-9998-aafaede731d9 service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:26.707210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a2d8b5bc-c737-4079-9998-aafaede731d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:26.712758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3276ac5-5fbd-44a9-9795-6e0c08adab1f service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:26.714717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f3276ac5-5fbd-44a9-9795-6e0c08adab1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:26.744632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3276ac5-5fbd-44a9-9795-6e0c08adab1f service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:26.750197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8b5bc-c737-4079-9998-aafaede731d9 service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:26.753157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17bd19-e572-49b0-b8c2-f991f60ede69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:26.754707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17bd19-e572-49b0-b8c2-f991f60ede69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:26.755208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17bd19-e572-49b0-b8c2-f991f60ede69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:26.755662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17bd19-e572-49b0-b8c2-f991f60ede69 admin admin] PATH_INFO: `/v3/users/94ca71f1e7f3431fa99e7f964e183c71` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:26.757269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17bd19-e572-49b0-b8c2-f991f60ede69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94ca71f1e7f3431fa99e7f964e183c71)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:26.758073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f786ca-1108-4672-a1ba-3bd689a2af52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:26.759046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f786ca-1108-4672-a1ba-3bd689a2af52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:26.759674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f786ca-1108-4672-a1ba-3bd689a2af52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:26.760172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f786ca-1108-4672-a1ba-3bd689a2af52 admin admin] PATH_INFO: `/v3/users/b99cdbed88664d8eb70a57988393cc8f` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:26.760927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17bd19-e572-49b0-b8c2-f991f60ede69 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:26.761817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f786ca-1108-4672-a1ba-3bd689a2af52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b99cdbed88664d8eb70a57988393cc8f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:26.765482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f786ca-1108-4672-a1ba-3bd689a2af52 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:26.963738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1b17bd19-e572-49b0-b8c2-f991f60ede69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94ca71f1e7f3431fa99e7f964e183c71'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:26.975880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1b17bd19-e572-49b0-b8c2-f991f60ede69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94ca71f1e7f3431fa99e7f964e183c71'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:26.976867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1b17bd19-e572-49b0-b8c2-f991f60ede69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94ca71f1e7f3431fa99e7f964e183c71'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:26.984162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1b17bd19-e572-49b0-b8c2-f991f60ede69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94ca71f1e7f3431fa99e7f964e183c71'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:27.031324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a1f786ca-1108-4672-a1ba-3bd689a2af52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b99cdbed88664d8eb70a57988393cc8f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:27.045585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a1f786ca-1108-4672-a1ba-3bd689a2af52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b99cdbed88664d8eb70a57988393cc8f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:27.046540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a1f786ca-1108-4672-a1ba-3bd689a2af52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b99cdbed88664d8eb70a57988393cc8f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:27.057482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a1f786ca-1108-4672-a1ba-3bd689a2af52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b99cdbed88664d8eb70a57988393cc8f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:27.084373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1b17bd19-e572-49b0-b8c2-f991f60ede69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94ca71f1e7f3431fa99e7f964e183c71'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:27.091545 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3343/6711] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:45:26 2022] DELETE /identity/v3/users/94ca71f1e7f3431fa99e7f964e183c71 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:27.207411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a1f786ca-1108-4672-a1ba-3bd689a2af52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b99cdbed88664d8eb70a57988393cc8f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:27.216197 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3369/6712] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:45:26 2022] DELETE /identity/v3/users/b99cdbed88664d8eb70a57988393cc8f => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:27.221560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ac82d-049e-46d9-8c5f-2885fe65ca35 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:27.221772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ac82d-049e-46d9-8c5f-2885fe65ca35 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:27.222086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ac82d-049e-46d9-8c5f-2885fe65ca35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:27.243389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8a3ac82d-049e-46d9-8c5f-2885fe65ca35 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:27.245029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8a3ac82d-049e-46d9-8c5f-2885fe65ca35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:27.328741 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3344/6713] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:27.336833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f786ca-1108-4672-a1ba-3bd689a2af52 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:27.338483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a1f786ca-1108-4672-a1ba-3bd689a2af52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:27.410255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ac82d-049e-46d9-8c5f-2885fe65ca35 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:27.411722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f786ca-1108-4672-a1ba-3bd689a2af52 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:27.412242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8a3ac82d-049e-46d9-8c5f-2885fe65ca35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:27.424334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b285d-a9b4-4384-9c1e-e2dd7813667f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:27.424334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b285d-a9b4-4384-9c1e-e2dd7813667f service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:27.425358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b285d-a9b4-4384-9c1e-e2dd7813667f service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:27.425494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b285d-a9b4-4384-9c1e-e2dd7813667f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:27.435521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ac82d-049e-46d9-8c5f-2885fe65ca35 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:27.441101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc2ca5-1ade-4f42-ae33-104724d48d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:27.442367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc2ca5-1ade-4f42-ae33-104724d48d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:27.443681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc2ca5-1ade-4f42-ae33-104724d48d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:27.443681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc2ca5-1ade-4f42-ae33-104724d48d70 admin admin] PATH_INFO: `/v3/projects/92c0683d241045e5bbd52bc4f8fe82d8` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:27.444310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc2ca5-1ade-4f42-ae33-104724d48d70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92c0683d241045e5bbd52bc4f8fe82d8)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:27.446366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc2ca5-1ade-4f42-ae33-104724d48d70 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:27.446992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b285d-a9b4-4384-9c1e-e2dd7813667f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:27.448692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b285d-a9b4-4384-9c1e-e2dd7813667f service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:27.460849 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3370/6714] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:45:27.551896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-21cc2ca5-1ade-4f42-ae33-104724d48d70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92c0683d241045e5bbd52bc4f8fe82d8', 'request_id': 'req-21cc2ca5-1ade-4f42-ae33-104724d48d70'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:27.559102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-21cc2ca5-1ade-4f42-ae33-104724d48d70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92c0683d241045e5bbd52bc4f8fe82d8', 'request_id': 'req-21cc2ca5-1ade-4f42-ae33-104724d48d70'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:27.627426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-21cc2ca5-1ade-4f42-ae33-104724d48d70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92c0683d241045e5bbd52bc4f8fe82d8', 'request_id': 'req-21cc2ca5-1ade-4f42-ae33-104724d48d70'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:27.638564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-21cc2ca5-1ade-4f42-ae33-104724d48d70 admin admin] The token cache is being invalidate because project 92c0683d241045e5bbd52bc4f8fe82d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:45:27.638758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-21cc2ca5-1ade-4f42-ae33-104724d48d70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:27.639421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-21cc2ca5-1ade-4f42-ae33-104724d48d70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:27.641264 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3345/6715] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:45:27 2022] DELETE /identity/v3/projects/92c0683d241045e5bbd52bc4f8fe82d8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:27.645783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b285d-a9b4-4384-9c1e-e2dd7813667f service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:27.655619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b285d-a9b4-4384-9c1e-e2dd7813667f service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:27.710739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a9ded-2889-44e6-bca3-6e1232a4ac99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:27.711680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a9ded-2889-44e6-bca3-6e1232a4ac99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:27.711965 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a9ded-2889-44e6-bca3-6e1232a4ac99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:27.712249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a9ded-2889-44e6-bca3-6e1232a4ac99 admin admin] PATH_INFO: `/v3/users/25a16d9a46824f52b882c44031f96948` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:27.713473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a9ded-2889-44e6-bca3-6e1232a4ac99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25a16d9a46824f52b882c44031f96948)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:27.715381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a9ded-2889-44e6-bca3-6e1232a4ac99 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:27.731414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc2ca5-1ade-4f42-ae33-104724d48d70 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:27.733614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-21cc2ca5-1ade-4f42-ae33-104724d48d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:27.752979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc2ca5-1ade-4f42-ae33-104724d48d70 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:27.758434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbeb037-74ca-45d4-9a58-d6096fc3f057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:27.759450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeb037-74ca-45d4-9a58-d6096fc3f057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:27.759832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeb037-74ca-45d4-9a58-d6096fc3f057 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:27.760278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeb037-74ca-45d4-9a58-d6096fc3f057 admin admin] PATH_INFO: `/v3/projects/d05de35a41ec42a18fe2b13d8a5f28ff` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:27.761612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbeb037-74ca-45d4-9a58-d6096fc3f057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d05de35a41ec42a18fe2b13d8a5f28ff)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:27.763570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbeb037-74ca-45d4-9a58-d6096fc3f057 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:27.915885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0a0a9ded-2889-44e6-bca3-6e1232a4ac99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25a16d9a46824f52b882c44031f96948'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:27.920908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bcbeb037-74ca-45d4-9a58-d6096fc3f057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd05de35a41ec42a18fe2b13d8a5f28ff', 'request_id': 'req-bcbeb037-74ca-45d4-9a58-d6096fc3f057'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:27.928495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bcbeb037-74ca-45d4-9a58-d6096fc3f057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd05de35a41ec42a18fe2b13d8a5f28ff', 'request_id': 'req-bcbeb037-74ca-45d4-9a58-d6096fc3f057'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:27.931436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0a0a9ded-2889-44e6-bca3-6e1232a4ac99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25a16d9a46824f52b882c44031f96948'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:27.932546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0a0a9ded-2889-44e6-bca3-6e1232a4ac99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25a16d9a46824f52b882c44031f96948'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:27.939566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0a0a9ded-2889-44e6-bca3-6e1232a4ac99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25a16d9a46824f52b882c44031f96948'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:28.036092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bcbeb037-74ca-45d4-9a58-d6096fc3f057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd05de35a41ec42a18fe2b13d8a5f28ff', 'request_id': 'req-bcbeb037-74ca-45d4-9a58-d6096fc3f057'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:28.049820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bcbeb037-74ca-45d4-9a58-d6096fc3f057 admin admin] The token cache is being invalidate because project d05de35a41ec42a18fe2b13d8a5f28ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:45:28.050118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bcbeb037-74ca-45d4-9a58-d6096fc3f057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:28.050796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bcbeb037-74ca-45d4-9a58-d6096fc3f057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:28.052357 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3346/6716] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:45:27 2022] DELETE /identity/v3/projects/d05de35a41ec42a18fe2b13d8a5f28ff => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:28.057216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc13471-f1ba-4ee0-a8c2-7432ba706273 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:28.057399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc13471-f1ba-4ee0-a8c2-7432ba706273 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:28.057681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc13471-f1ba-4ee0-a8c2-7432ba706273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:28.076965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3cc13471-f1ba-4ee0-a8c2-7432ba706273 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:28.078188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3cc13471-f1ba-4ee0-a8c2-7432ba706273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:28.144714 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3347/6717] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:45:28.152374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aac128-f71d-42c5-8d4d-b553fed7fc1b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:28.152696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aac128-f71d-42c5-8d4d-b553fed7fc1b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:28.152977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aac128-f71d-42c5-8d4d-b553fed7fc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:28.153118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0a0a9ded-2889-44e6-bca3-6e1232a4ac99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25a16d9a46824f52b882c44031f96948'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:28.161465 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3371/6718] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:45:27 2022] DELETE /identity/v3/users/25a16d9a46824f52b882c44031f96948 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:28.179144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-94aac128-f71d-42c5-8d4d-b553fed7fc1b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:28.180378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-94aac128-f71d-42c5-8d4d-b553fed7fc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:28.259435 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3348/6719] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:45:28.263869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a9ded-2889-44e6-bca3-6e1232a4ac99 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:28.275173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a9ded-2889-44e6-bca3-6e1232a4ac99 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:28.280883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053baba5-5a4e-41a5-ac56-4c154647d1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:28.281559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053baba5-5a4e-41a5-ac56-4c154647d1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:28.283164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053baba5-5a4e-41a5-ac56-4c154647d1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:28.283164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053baba5-5a4e-41a5-ac56-4c154647d1b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:28.283164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053baba5-5a4e-41a5-ac56-4c154647d1b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:45:28.283571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053baba5-5a4e-41a5-ac56-4c154647d1b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:28.284900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053baba5-5a4e-41a5-ac56-4c154647d1b9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:28.300954 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3372/6720] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:45:28.302258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aac128-f71d-42c5-8d4d-b553fed7fc1b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:28.311565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aac128-f71d-42c5-8d4d-b553fed7fc1b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:28.317055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444573a-c456-47e6-91b6-fa86ed55b1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:28.317679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444573a-c456-47e6-91b6-fa86ed55b1aa admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:28.317966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444573a-c456-47e6-91b6-fa86ed55b1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:28.318252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444573a-c456-47e6-91b6-fa86ed55b1aa admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:28.318961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444573a-c456-47e6-91b6-fa86ed55b1aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:28.320922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444573a-c456-47e6-91b6-fa86ed55b1aa admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:28.411585 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3349/6721] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:45:28 2022] POST /identity/v3/projects => generated 363 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:45:28.415880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053baba5-5a4e-41a5-ac56-4c154647d1b9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:28.428374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053baba5-5a4e-41a5-ac56-4c154647d1b9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:28.452579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444573a-c456-47e6-91b6-fa86ed55b1aa admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:28.454638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2444573a-c456-47e6-91b6-fa86ed55b1aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:28.523461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f949377-1f51-468c-b0db-5efa813405d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:28.524228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f949377-1f51-468c-b0db-5efa813405d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:28.524917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f949377-1f51-468c-b0db-5efa813405d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:28.525276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f949377-1f51-468c-b0db-5efa813405d5 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:28.526101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f949377-1f51-468c-b0db-5efa813405d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:28.528455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f949377-1f51-468c-b0db-5efa813405d5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:28.545461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444573a-c456-47e6-91b6-fa86ed55b1aa admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:28.550945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32160f-40cd-41d3-851b-2aa29c608fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:28.551805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32160f-40cd-41d3-851b-2aa29c608fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:28.552093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32160f-40cd-41d3-851b-2aa29c608fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:28.552373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32160f-40cd-41d3-851b-2aa29c608fa3 admin admin] PATH_INFO: `/v3/projects/99f6e3a430b848d9b8803b59505a2c43` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:28.553627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32160f-40cd-41d3-851b-2aa29c608fa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99f6e3a430b848d9b8803b59505a2c43)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:28.555542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32160f-40cd-41d3-851b-2aa29c608fa3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:28.603841 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3373/6722] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:45:28 2022] POST /identity/v3/users => generated 282 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:45:28.607600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f949377-1f51-468c-b0db-5efa813405d5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:28.617956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f949377-1f51-468c-b0db-5efa813405d5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:28.622582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefda318-9e06-46d8-a3d8-dc6d59700661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:28.623222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefda318-9e06-46d8-a3d8-dc6d59700661 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:28.623508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefda318-9e06-46d8-a3d8-dc6d59700661 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:28.626267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefda318-9e06-46d8-a3d8-dc6d59700661 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:28.626267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefda318-9e06-46d8-a3d8-dc6d59700661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:28.626469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefda318-9e06-46d8-a3d8-dc6d59700661 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:28.637288 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3374/6723] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:45:28.640715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefda318-9e06-46d8-a3d8-dc6d59700661 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:28.651685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefda318-9e06-46d8-a3d8-dc6d59700661 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:28.656575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe67630-d9a9-4115-9298-f6c038528d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:28.657769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe67630-d9a9-4115-9298-f6c038528d73 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:28.658061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe67630-d9a9-4115-9298-f6c038528d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:28.658347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe67630-d9a9-4115-9298-f6c038528d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:28.659081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe67630-d9a9-4115-9298-f6c038528d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:28.660748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe67630-d9a9-4115-9298-f6c038528d73 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:28.671222 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3375/6724] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:45:28.675948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe67630-d9a9-4115-9298-f6c038528d73 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:28.685938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe67630-d9a9-4115-9298-f6c038528d73 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:28.691394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8a32160f-40cd-41d3-851b-2aa29c608fa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99f6e3a430b848d9b8803b59505a2c43', 'request_id': 'req-8a32160f-40cd-41d3-851b-2aa29c608fa3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:28.699180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8a32160f-40cd-41d3-851b-2aa29c608fa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99f6e3a430b848d9b8803b59505a2c43', 'request_id': 'req-8a32160f-40cd-41d3-851b-2aa29c608fa3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:28.744856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f3e90-e779-446f-a4bd-30b382926845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:28.745960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f3e90-e779-446f-a4bd-30b382926845 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:28.746518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f3e90-e779-446f-a4bd-30b382926845 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:28.746906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f3e90-e779-446f-a4bd-30b382926845 admin admin] PATH_INFO: `/v3/projects/c6bfb18208ab47b4873cb564c5d7c24e/users/7884384594ce4d329206873fc8c346bd/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:28.765060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f3e90-e779-446f-a4bd-30b382926845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6bfb18208ab47b4873cb564c5d7c24e, user_id=7884384594ce4d329206873fc8c346bd, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:28.768421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f3e90-e779-446f-a4bd-30b382926845 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:28.784839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8a32160f-40cd-41d3-851b-2aa29c608fa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99f6e3a430b848d9b8803b59505a2c43', 'request_id': 'req-8a32160f-40cd-41d3-851b-2aa29c608fa3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:28.796776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8a32160f-40cd-41d3-851b-2aa29c608fa3 admin admin] The token cache is being invalidate because project 99f6e3a430b848d9b8803b59505a2c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:45:28.797139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8a32160f-40cd-41d3-851b-2aa29c608fa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:28.797905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8a32160f-40cd-41d3-851b-2aa29c608fa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:28.799656 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3350/6725] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:45:28 2022] DELETE /identity/v3/projects/99f6e3a430b848d9b8803b59505a2c43 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:28.804436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86847399-814c-435b-86e8-cd4bac51062e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:28.804858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86847399-814c-435b-86e8-cd4bac51062e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:28.805246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86847399-814c-435b-86e8-cd4bac51062e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:28.823590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-86847399-814c-435b-86e8-cd4bac51062e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:28.831058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-86847399-814c-435b-86e8-cd4bac51062e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:28.833702 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3351/6726] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:45:28.841412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0497c-9ad7-436f-a313-276144a5653e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:28.841704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0497c-9ad7-436f-a313-276144a5653e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:28.841986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0497c-9ad7-436f-a313-276144a5653e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:28.859884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c7a0497c-9ad7-436f-a313-276144a5653e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:28.861154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c7a0497c-9ad7-436f-a313-276144a5653e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:28.868995 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3352/6727] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:45:28.873060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0497c-9ad7-436f-a313-276144a5653e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:28.882290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0497c-9ad7-436f-a313-276144a5653e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:28.896737 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3376/6728] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:45:28 2022] PUT /identity/v3/projects/c6bfb18208ab47b4873cb564c5d7c24e/users/7884384594ce4d329206873fc8c346bd/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:45:28.905851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f940b86-f1d3-43c6-9e89-c477908d864d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:28.906240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f940b86-f1d3-43c6-9e89-c477908d864d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:28.906633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f940b86-f1d3-43c6-9e89-c477908d864d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:28.943252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49f8a2-666f-436e-9177-e8e60a852317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:28.944196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49f8a2-666f-436e-9177-e8e60a852317 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:28.944485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49f8a2-666f-436e-9177-e8e60a852317 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:28.944806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49f8a2-666f-436e-9177-e8e60a852317 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:28.945535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49f8a2-666f-436e-9177-e8e60a852317 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:45:28.945850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49f8a2-666f-436e-9177-e8e60a852317 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:28.946470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6f940b86-f1d3-43c6-9e89-c477908d864d None None] MFA Rules not processed for user `7884384594ce4d329206873fc8c346bd`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:28.947565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49f8a2-666f-436e-9177-e8e60a852317 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:28.947981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6f940b86-f1d3-43c6-9e89-c477908d864d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:28.961028 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3353/6729] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:45:28.966171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49f8a2-666f-436e-9177-e8e60a852317 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:28.979056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49f8a2-666f-436e-9177-e8e60a852317 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:28.985454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dec73f-0ce6-4c04-b538-62e93b734601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:28.986128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dec73f-0ce6-4c04-b538-62e93b734601 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:28.986421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dec73f-0ce6-4c04-b538-62e93b734601 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:28.987447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dec73f-0ce6-4c04-b538-62e93b734601 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:28.987447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dec73f-0ce6-4c04-b538-62e93b734601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:28.989364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dec73f-0ce6-4c04-b538-62e93b734601 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:29.024942 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3377/6730] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:29.037747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f940b86-f1d3-43c6-9e89-c477908d864d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:29.039187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6f940b86-f1d3-43c6-9e89-c477908d864d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:29.087327 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3354/6731] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:45:28 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:45:29.091675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dec73f-0ce6-4c04-b538-62e93b734601 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:29.125386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f940b86-f1d3-43c6-9e89-c477908d864d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:29.197316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dec73f-0ce6-4c04-b538-62e93b734601 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:29.202685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733c9e8-f728-497e-b259-d150c9e45b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:29.203207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27840b-bd89-4a5d-ad9c-c509859195a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:29.203369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733c9e8-f728-497e-b259-d150c9e45b77 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:29.203651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733c9e8-f728-497e-b259-d150c9e45b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:29.203936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733c9e8-f728-497e-b259-d150c9e45b77 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:29.204101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27840b-bd89-4a5d-ad9c-c509859195a1 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:29.204427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27840b-bd89-4a5d-ad9c-c509859195a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:29.204704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733c9e8-f728-497e-b259-d150c9e45b77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:29.204828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27840b-bd89-4a5d-ad9c-c509859195a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:29.207045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733c9e8-f728-497e-b259-d150c9e45b77 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:29.266726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27840b-bd89-4a5d-ad9c-c509859195a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:29.268157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27840b-bd89-4a5d-ad9c-c509859195a1 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:29.277071 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3378/6732] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:29 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:45:29.296254 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3355/6733] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:45:29 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:45:29.301104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27840b-bd89-4a5d-ad9c-c509859195a1 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:29.311512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27840b-bd89-4a5d-ad9c-c509859195a1 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:29.316125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8e182-f9bd-493d-a205-3d4562894991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:29.316851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8e182-f9bd-493d-a205-3d4562894991 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:29.317132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8e182-f9bd-493d-a205-3d4562894991 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:29.317411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8e182-f9bd-493d-a205-3d4562894991 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:29.318162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8e182-f9bd-493d-a205-3d4562894991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:29.319748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8e182-f9bd-493d-a205-3d4562894991 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:29.330028 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3379/6734] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:45:29.334091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733c9e8-f728-497e-b259-d150c9e45b77 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:29.344111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733c9e8-f728-497e-b259-d150c9e45b77 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:29.349288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4e088-c1b4-4315-a9e1-84c755f6a9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:29.353933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4e088-c1b4-4315-a9e1-84c755f6a9bc admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:29.353933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4e088-c1b4-4315-a9e1-84c755f6a9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:29.353933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4e088-c1b4-4315-a9e1-84c755f6a9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:29.353933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4e088-c1b4-4315-a9e1-84c755f6a9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:29.353933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4e088-c1b4-4315-a9e1-84c755f6a9bc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:29.363119 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3356/6735] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:45:29.367057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8e182-f9bd-493d-a205-3d4562894991 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:29.377304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8e182-f9bd-493d-a205-3d4562894991 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:29.382418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3459c5-2e58-43a9-bc34-425586cff708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:29.383412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3459c5-2e58-43a9-bc34-425586cff708 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:29.383695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3459c5-2e58-43a9-bc34-425586cff708 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:29.383976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3459c5-2e58-43a9-bc34-425586cff708 admin admin] PATH_INFO: `/v3/projects/abadeabaf9af452daaec8d910cea1398/users/12a96c4a1c4e4cd6acc4b53c51368ae7/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:29.398868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3459c5-2e58-43a9-bc34-425586cff708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abadeabaf9af452daaec8d910cea1398, user_id=12a96c4a1c4e4cd6acc4b53c51368ae7, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:29.401728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3459c5-2e58-43a9-bc34-425586cff708 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:29.505717 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3380/6736] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:45:29 2022] PUT /identity/v3/projects/abadeabaf9af452daaec8d910cea1398/users/12a96c4a1c4e4cd6acc4b53c51368ae7/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:29.515784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea5298-dc04-4ccf-94d0-67e5d18d6a25 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:29.516075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea5298-dc04-4ccf-94d0-67e5d18d6a25 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:29.516361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea5298-dc04-4ccf-94d0-67e5d18d6a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:29.554713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-bdea5298-dc04-4ccf-94d0-67e5d18d6a25 None None] MFA Rules not processed for user `12a96c4a1c4e4cd6acc4b53c51368ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:29.557144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bdea5298-dc04-4ccf-94d0-67e5d18d6a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:29.647066 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3357/6737] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:29.659222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3459c5-2e58-43a9-bc34-425586cff708 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:29.661336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8b3459c5-2e58-43a9-bc34-425586cff708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:29.722153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3459c5-2e58-43a9-bc34-425586cff708 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:29.726895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7bb54-6f9b-4144-a0db-ce2ef8abfce6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:29.727781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7bb54-6f9b-4144-a0db-ce2ef8abfce6 service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:29.728191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7bb54-6f9b-4144-a0db-ce2ef8abfce6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:29.728576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7bb54-6f9b-4144-a0db-ce2ef8abfce6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:29.738709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7bb54-6f9b-4144-a0db-ce2ef8abfce6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:29.740516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7bb54-6f9b-4144-a0db-ce2ef8abfce6 service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:29.750786 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3381/6738] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:45:29.772941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea5298-dc04-4ccf-94d0-67e5d18d6a25 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:29.862139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea5298-dc04-4ccf-94d0-67e5d18d6a25 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:29.871878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0dcf7a-3172-429e-be49-383d6d26fe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:29.873264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dcf7a-3172-429e-be49-383d6d26fe3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:29.873655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dcf7a-3172-429e-be49-383d6d26fe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:29.874104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dcf7a-3172-429e-be49-383d6d26fe3c admin admin] PATH_INFO: `/v3/users/12a96c4a1c4e4cd6acc4b53c51368ae7` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:29.885807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0dcf7a-3172-429e-be49-383d6d26fe3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=12a96c4a1c4e4cd6acc4b53c51368ae7)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:29.888360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0dcf7a-3172-429e-be49-383d6d26fe3c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:30.151975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0f0dcf7a-3172-429e-be49-383d6d26fe3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12a96c4a1c4e4cd6acc4b53c51368ae7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:30.177603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0f0dcf7a-3172-429e-be49-383d6d26fe3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12a96c4a1c4e4cd6acc4b53c51368ae7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:30.179054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0f0dcf7a-3172-429e-be49-383d6d26fe3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12a96c4a1c4e4cd6acc4b53c51368ae7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:30.193613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0f0dcf7a-3172-429e-be49-383d6d26fe3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12a96c4a1c4e4cd6acc4b53c51368ae7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:30.324739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0f0dcf7a-3172-429e-be49-383d6d26fe3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12a96c4a1c4e4cd6acc4b53c51368ae7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:30.343451 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3358/6739] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:45:29 2022] DELETE /identity/v3/users/12a96c4a1c4e4cd6acc4b53c51368ae7 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:30.344537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bf843-1b58-44bb-ae37-c32e60807482 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:30.344903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bf843-1b58-44bb-ae37-c32e60807482 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:30.345382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2bf843-1b58-44bb-ae37-c32e60807482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:30.367332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ce2bf843-1b58-44bb-ae37-c32e60807482 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:30.368819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ce2bf843-1b58-44bb-ae37-c32e60807482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:30.453745 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3382/6740] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:45:30.474782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0dcf7a-3172-429e-be49-383d6d26fe3c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:30.476808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0f0dcf7a-3172-429e-be49-383d6d26fe3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:30.565889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0dcf7a-3172-429e-be49-383d6d26fe3c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:30.570524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b22e05-a3b3-4f3f-a36f-b805026278da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:30.571408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b22e05-a3b3-4f3f-a36f-b805026278da service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:30.571977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b22e05-a3b3-4f3f-a36f-b805026278da service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:30.572442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b22e05-a3b3-4f3f-a36f-b805026278da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:30.587812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b22e05-a3b3-4f3f-a36f-b805026278da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:30.589967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b22e05-a3b3-4f3f-a36f-b805026278da service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:30.605615 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3359/6741] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:45:31.242363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bf843-1b58-44bb-ae37-c32e60807482 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:31.244982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ce2bf843-1b58-44bb-ae37-c32e60807482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:31.264032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2bf843-1b58-44bb-ae37-c32e60807482 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:31.270132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8eb5b-9f0c-4a4f-8922-bc4f50b001f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:31.271066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8eb5b-9f0c-4a4f-8922-bc4f50b001f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:31.271345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8eb5b-9f0c-4a4f-8922-bc4f50b001f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:31.271810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8eb5b-9f0c-4a4f-8922-bc4f50b001f7 admin admin] PATH_INFO: `/v3/projects/abadeabaf9af452daaec8d910cea1398` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:31.273574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8eb5b-9f0c-4a4f-8922-bc4f50b001f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abadeabaf9af452daaec8d910cea1398)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:31.275663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8eb5b-9f0c-4a4f-8922-bc4f50b001f7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:31.397814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-17c8eb5b-9f0c-4a4f-8922-bc4f50b001f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abadeabaf9af452daaec8d910cea1398', 'request_id': 'req-17c8eb5b-9f0c-4a4f-8922-bc4f50b001f7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:31.504804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-17c8eb5b-9f0c-4a4f-8922-bc4f50b001f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abadeabaf9af452daaec8d910cea1398', 'request_id': 'req-17c8eb5b-9f0c-4a4f-8922-bc4f50b001f7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:31.514301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-17c8eb5b-9f0c-4a4f-8922-bc4f50b001f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abadeabaf9af452daaec8d910cea1398', 'request_id': 'req-17c8eb5b-9f0c-4a4f-8922-bc4f50b001f7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:31.528593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-17c8eb5b-9f0c-4a4f-8922-bc4f50b001f7 admin admin] The token cache is being invalidate because project abadeabaf9af452daaec8d910cea1398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:45:31.529118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-17c8eb5b-9f0c-4a4f-8922-bc4f50b001f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:31.529855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-17c8eb5b-9f0c-4a4f-8922-bc4f50b001f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:31.531733 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3383/6742] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:45:31 2022] DELETE /identity/v3/projects/abadeabaf9af452daaec8d910cea1398 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:31.537556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca5228-fa65-4e09-8820-14f02ab8a1c1 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:31.538053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca5228-fa65-4e09-8820-14f02ab8a1c1 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:31.538159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca5228-fa65-4e09-8820-14f02ab8a1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:31.558681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-91ca5228-fa65-4e09-8820-14f02ab8a1c1 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:31.560785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-91ca5228-fa65-4e09-8820-14f02ab8a1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:31.624440 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3360/6743] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:45:31.635892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf592c-be26-44b0-b603-3f0603780c5c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:31.635892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf592c-be26-44b0-b603-3f0603780c5c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:31.635892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf592c-be26-44b0-b603-3f0603780c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:31.652245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-09bf592c-be26-44b0-b603-3f0603780c5c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:31.653503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-09bf592c-be26-44b0-b603-3f0603780c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:31.664171 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3384/6744] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:31.668594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca5228-fa65-4e09-8820-14f02ab8a1c1 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:31.679299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca5228-fa65-4e09-8820-14f02ab8a1c1 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:31.684162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963ff6d-05b6-435a-914c-f0c40864466e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:31.685055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963ff6d-05b6-435a-914c-f0c40864466e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:31.685437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963ff6d-05b6-435a-914c-f0c40864466e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:31.685789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963ff6d-05b6-435a-914c-f0c40864466e admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:31.686781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963ff6d-05b6-435a-914c-f0c40864466e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:45:31.687115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963ff6d-05b6-435a-914c-f0c40864466e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:31.688874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963ff6d-05b6-435a-914c-f0c40864466e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:31.704792 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3361/6745] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:45:31.706143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf592c-be26-44b0-b603-3f0603780c5c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:31.716120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf592c-be26-44b0-b603-3f0603780c5c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:31.721486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c2ba1-c46c-45c6-b318-24d44a169087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:31.722189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c2ba1-c46c-45c6-b318-24d44a169087 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:31.722437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c2ba1-c46c-45c6-b318-24d44a169087 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:31.722719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c2ba1-c46c-45c6-b318-24d44a169087 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:31.723418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c2ba1-c46c-45c6-b318-24d44a169087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:31.725399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c2ba1-c46c-45c6-b318-24d44a169087 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:31.867714 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3385/6746] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:45:31 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:45:31.872637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963ff6d-05b6-435a-914c-f0c40864466e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:31.894713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963ff6d-05b6-435a-914c-f0c40864466e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:31.978491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d20af1-e56b-4a44-b357-fc3b11c77ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:31.979181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d20af1-e56b-4a44-b357-fc3b11c77ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:31.979536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d20af1-e56b-4a44-b357-fc3b11c77ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:31.979825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d20af1-e56b-4a44-b357-fc3b11c77ef6 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:31.980523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d20af1-e56b-4a44-b357-fc3b11c77ef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:31.982580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d20af1-e56b-4a44-b357-fc3b11c77ef6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:32.082761 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3362/6747] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:45:31 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:45:32.086982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c2ba1-c46c-45c6-b318-24d44a169087 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:32.098239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c2ba1-c46c-45c6-b318-24d44a169087 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:32.103687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f95c6-7813-4704-9d3d-87aa3c1905d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:32.105081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f95c6-7813-4704-9d3d-87aa3c1905d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:32.105413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f95c6-7813-4704-9d3d-87aa3c1905d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:32.106236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f95c6-7813-4704-9d3d-87aa3c1905d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:32.106979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f95c6-7813-4704-9d3d-87aa3c1905d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:32.109085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f95c6-7813-4704-9d3d-87aa3c1905d6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:32.122075 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3386/6748] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:45:32.126596 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d20af1-e56b-4a44-b357-fc3b11c77ef6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:32.137065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d20af1-e56b-4a44-b357-fc3b11c77ef6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:32.142558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74395150-3ccb-45d8-8a80-b6bb106e3b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:32.143412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74395150-3ccb-45d8-8a80-b6bb106e3b8a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:32.143756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74395150-3ccb-45d8-8a80-b6bb106e3b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:32.144100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74395150-3ccb-45d8-8a80-b6bb106e3b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:32.144862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74395150-3ccb-45d8-8a80-b6bb106e3b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:32.149214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74395150-3ccb-45d8-8a80-b6bb106e3b8a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:32.159451 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3363/6749] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:45:32.161305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f95c6-7813-4704-9d3d-87aa3c1905d6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:32.175623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f95c6-7813-4704-9d3d-87aa3c1905d6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:32.178178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55508ace-94ae-4e89-a0d9-080ca7ab7c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:32.178546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55508ace-94ae-4e89-a0d9-080ca7ab7c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:32.178931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55508ace-94ae-4e89-a0d9-080ca7ab7c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:32.179677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55508ace-94ae-4e89-a0d9-080ca7ab7c4b admin admin] PATH_INFO: `/v3/projects/561e89131f06493c86bc50726a607921/users/53f725648a464c35bd318808ac58d2d1/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:32.196646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55508ace-94ae-4e89-a0d9-080ca7ab7c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=561e89131f06493c86bc50726a607921, user_id=53f725648a464c35bd318808ac58d2d1, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:32.199998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55508ace-94ae-4e89-a0d9-080ca7ab7c4b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:32.354578 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3387/6750] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:45:32 2022] PUT /identity/v3/projects/561e89131f06493c86bc50726a607921/users/53f725648a464c35bd318808ac58d2d1/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:32.365886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33192e12-0af8-462a-919a-2a8651484efb None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:32.366662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33192e12-0af8-462a-919a-2a8651484efb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:32.366953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33192e12-0af8-462a-919a-2a8651484efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:32.397849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-33192e12-0af8-462a-919a-2a8651484efb None None] MFA Rules not processed for user `53f725648a464c35bd318808ac58d2d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:32.399267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-33192e12-0af8-462a-919a-2a8651484efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:32.465965 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3364/6751] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:45:32.477118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55508ace-94ae-4e89-a0d9-080ca7ab7c4b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:32.478892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-55508ace-94ae-4e89-a0d9-080ca7ab7c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:32.539734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55508ace-94ae-4e89-a0d9-080ca7ab7c4b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:32.544023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d874d-6f9c-4c65-8bb1-0cfab0124faf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:32.544881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d874d-6f9c-4c65-8bb1-0cfab0124faf service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:32.553489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d874d-6f9c-4c65-8bb1-0cfab0124faf service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:32.553489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d874d-6f9c-4c65-8bb1-0cfab0124faf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:32.555145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d874d-6f9c-4c65-8bb1-0cfab0124faf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:32.556637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d874d-6f9c-4c65-8bb1-0cfab0124faf service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:32.566667 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3388/6752] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:45:36.355168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33192e12-0af8-462a-919a-2a8651484efb None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:36.358992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-33192e12-0af8-462a-919a-2a8651484efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:36.478398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33192e12-0af8-462a-919a-2a8651484efb None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:36.483398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7018fb0-4133-4215-aa30-874e866ba94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:36.484506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7018fb0-4133-4215-aa30-874e866ba94f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:36.484882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7018fb0-4133-4215-aa30-874e866ba94f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:36.485811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7018fb0-4133-4215-aa30-874e866ba94f admin admin] PATH_INFO: `/v3/users/289b1a8d2b7d4c309a9f187c20d6a561` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:36.487711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7018fb0-4133-4215-aa30-874e866ba94f admin admin] RBAC: Authorizing `identity:delete_user(user_id=289b1a8d2b7d4c309a9f187c20d6a561)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:36.489790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7018fb0-4133-4215-aa30-874e866ba94f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:36.725073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f7018fb0-4133-4215-aa30-874e866ba94f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '289b1a8d2b7d4c309a9f187c20d6a561'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:36.740117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f7018fb0-4133-4215-aa30-874e866ba94f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '289b1a8d2b7d4c309a9f187c20d6a561'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:36.740887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f7018fb0-4133-4215-aa30-874e866ba94f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '289b1a8d2b7d4c309a9f187c20d6a561'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:36.751631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f7018fb0-4133-4215-aa30-874e866ba94f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '289b1a8d2b7d4c309a9f187c20d6a561'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:36.887449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f7018fb0-4133-4215-aa30-874e866ba94f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '289b1a8d2b7d4c309a9f187c20d6a561'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:36.898660 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3365/6753] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:45:36 2022] DELETE /identity/v3/users/289b1a8d2b7d4c309a9f187c20d6a561 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:37.297591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d874d-6f9c-4c65-8bb1-0cfab0124faf service cinder] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:37.318461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d874d-6f9c-4c65-8bb1-0cfab0124faf service cinder] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:37.403145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c6a20-83c7-428b-a69a-df5d2c84837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:37.404024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c6a20-83c7-428b-a69a-df5d2c84837d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:37.404312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c6a20-83c7-428b-a69a-df5d2c84837d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:37.404767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c6a20-83c7-428b-a69a-df5d2c84837d admin admin] PATH_INFO: `/v3/projects/180087b75c3743b7acc32b0aa9bee8b5` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:37.406011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c6a20-83c7-428b-a69a-df5d2c84837d admin admin] RBAC: Authorizing `identity:delete_project(project_id=180087b75c3743b7acc32b0aa9bee8b5)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:37.408079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c6a20-83c7-428b-a69a-df5d2c84837d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:37.613856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fc6c6a20-83c7-428b-a69a-df5d2c84837d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '180087b75c3743b7acc32b0aa9bee8b5', 'request_id': 'req-fc6c6a20-83c7-428b-a69a-df5d2c84837d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:37.741186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fc6c6a20-83c7-428b-a69a-df5d2c84837d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '180087b75c3743b7acc32b0aa9bee8b5', 'request_id': 'req-fc6c6a20-83c7-428b-a69a-df5d2c84837d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:37.749290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fc6c6a20-83c7-428b-a69a-df5d2c84837d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '180087b75c3743b7acc32b0aa9bee8b5', 'request_id': 'req-fc6c6a20-83c7-428b-a69a-df5d2c84837d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:37.767937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fc6c6a20-83c7-428b-a69a-df5d2c84837d admin admin] The token cache is being invalidate because project 180087b75c3743b7acc32b0aa9bee8b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:45:37.768578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fc6c6a20-83c7-428b-a69a-df5d2c84837d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:37.769777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fc6c6a20-83c7-428b-a69a-df5d2c84837d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:37.777999 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3389/6754] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:45:37 2022] DELETE /identity/v3/projects/180087b75c3743b7acc32b0aa9bee8b5 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:37.780371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474cea5-0dbb-4886-b3ca-ec83637b9ccd None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:37.781423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474cea5-0dbb-4886-b3ca-ec83637b9ccd None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:37.781920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474cea5-0dbb-4886-b3ca-ec83637b9ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:37.832536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5474cea5-0dbb-4886-b3ca-ec83637b9ccd None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:37.836854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5474cea5-0dbb-4886-b3ca-ec83637b9ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:37.976673 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3366/6755] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:37.982608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69609f-7d9a-481e-9c9d-e390e4b5b674 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:37.982903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69609f-7d9a-481e-9c9d-e390e4b5b674 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:37.983190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69609f-7d9a-481e-9c9d-e390e4b5b674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:38.007162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8d69609f-7d9a-481e-9c9d-e390e4b5b674 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:38.008652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8d69609f-7d9a-481e-9c9d-e390e4b5b674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:38.023536 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3390/6756] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:38.027784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474cea5-0dbb-4886-b3ca-ec83637b9ccd None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:38.043240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474cea5-0dbb-4886-b3ca-ec83637b9ccd None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:38.051376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854616e-8694-4a07-8e5d-4681dee3aadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:38.052190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854616e-8694-4a07-8e5d-4681dee3aadf admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:38.052549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854616e-8694-4a07-8e5d-4681dee3aadf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:38.052942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854616e-8694-4a07-8e5d-4681dee3aadf admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:38.053757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854616e-8694-4a07-8e5d-4681dee3aadf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:45:38.054143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854616e-8694-4a07-8e5d-4681dee3aadf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:38.056325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854616e-8694-4a07-8e5d-4681dee3aadf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:38.072324 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3367/6757] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:45:38.076491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69609f-7d9a-481e-9c9d-e390e4b5b674 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:38.087448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69609f-7d9a-481e-9c9d-e390e4b5b674 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:38.094485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35c806-5140-4719-92df-9f323dd462df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:38.095674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35c806-5140-4719-92df-9f323dd462df admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:38.096069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35c806-5140-4719-92df-9f323dd462df admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:38.097045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35c806-5140-4719-92df-9f323dd462df admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:38.097328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35c806-5140-4719-92df-9f323dd462df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:38.099384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35c806-5140-4719-92df-9f323dd462df admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:38.208789 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3391/6758] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:45:38 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:45:38.212551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854616e-8694-4a07-8e5d-4681dee3aadf admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:38.226591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854616e-8694-4a07-8e5d-4681dee3aadf admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:38.328291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b6723-4fa4-4217-b2b9-67eb83592905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:38.329214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b6723-4fa4-4217-b2b9-67eb83592905 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:38.329712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b6723-4fa4-4217-b2b9-67eb83592905 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:38.330055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b6723-4fa4-4217-b2b9-67eb83592905 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:38.330844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b6723-4fa4-4217-b2b9-67eb83592905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:38.333154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b6723-4fa4-4217-b2b9-67eb83592905 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:38.463628 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3368/6759] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:45:38 2022] POST /identity/v3/users => generated 288 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:45:38.467234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35c806-5140-4719-92df-9f323dd462df admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:38.479991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35c806-5140-4719-92df-9f323dd462df admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:38.491590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b21b5-84f5-4b03-b3ba-98a09edeb9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:38.492549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b21b5-84f5-4b03-b3ba-98a09edeb9be admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:38.493097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b21b5-84f5-4b03-b3ba-98a09edeb9be admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:38.493604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b21b5-84f5-4b03-b3ba-98a09edeb9be admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:38.494559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b21b5-84f5-4b03-b3ba-98a09edeb9be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:38.496119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b21b5-84f5-4b03-b3ba-98a09edeb9be admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:38.508702 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3392/6760] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:45:38.512923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b6723-4fa4-4217-b2b9-67eb83592905 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:38.527810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b6723-4fa4-4217-b2b9-67eb83592905 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:38.542232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e0cef-7654-437e-ab3d-d1528b05197e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:38.543050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e0cef-7654-437e-ab3d-d1528b05197e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:38.543364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e0cef-7654-437e-ab3d-d1528b05197e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:38.543607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e0cef-7654-437e-ab3d-d1528b05197e admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:38.544374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e0cef-7654-437e-ab3d-d1528b05197e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:38.546109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e0cef-7654-437e-ab3d-d1528b05197e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:38.561951 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3369/6761] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:45:38.565150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b21b5-84f5-4b03-b3ba-98a09edeb9be admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:38.580096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b21b5-84f5-4b03-b3ba-98a09edeb9be admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:38.590783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dd430-446a-46d7-9ca0-e7daf7588ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:38.591843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dd430-446a-46d7-9ca0-e7daf7588ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:38.592747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dd430-446a-46d7-9ca0-e7daf7588ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:38.593359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dd430-446a-46d7-9ca0-e7daf7588ca9 admin admin] PATH_INFO: `/v3/projects/c66af7b914fd46dbb25e62d4e3522759/users/1326669005334b5095c1dc40a52720b5/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:38.615137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1dd430-446a-46d7-9ca0-e7daf7588ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c66af7b914fd46dbb25e62d4e3522759, user_id=1326669005334b5095c1dc40a52720b5, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:38.618268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1dd430-446a-46d7-9ca0-e7daf7588ca9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:38.713935 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3393/6762] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:45:38 2022] PUT /identity/v3/projects/c66af7b914fd46dbb25e62d4e3522759/users/1326669005334b5095c1dc40a52720b5/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:38.719035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61345499-dec6-49f1-89c0-1e7682cb4373 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:38.719551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61345499-dec6-49f1-89c0-1e7682cb4373 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:38.719917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61345499-dec6-49f1-89c0-1e7682cb4373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:38.747558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-61345499-dec6-49f1-89c0-1e7682cb4373 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:38.749205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-61345499-dec6-49f1-89c0-1e7682cb4373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:38.840001 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3370/6763] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:38.850838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dd430-446a-46d7-9ca0-e7daf7588ca9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:38.853409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ee1dd430-446a-46d7-9ca0-e7daf7588ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:38.930328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dd430-446a-46d7-9ca0-e7daf7588ca9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:38.934485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1862ff-be5e-4895-85b5-cff388a0667e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:38.936135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1862ff-be5e-4895-85b5-cff388a0667e service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:38.936412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1862ff-be5e-4895-85b5-cff388a0667e service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:38.937190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1862ff-be5e-4895-85b5-cff388a0667e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:38.951582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1862ff-be5e-4895-85b5-cff388a0667e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:38.955620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1862ff-be5e-4895-85b5-cff388a0667e service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:38.970733 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3394/6764] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:45:40.448619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61345499-dec6-49f1-89c0-1e7682cb4373 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:40.450951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-61345499-dec6-49f1-89c0-1e7682cb4373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:40.468147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61345499-dec6-49f1-89c0-1e7682cb4373 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:40.472862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94497df-c53c-4687-ab1a-9b46e0249456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:40.473832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94497df-c53c-4687-ab1a-9b46e0249456 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:40.474349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94497df-c53c-4687-ab1a-9b46e0249456 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:40.474734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94497df-c53c-4687-ab1a-9b46e0249456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:40.478910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f94497df-c53c-4687-ab1a-9b46e0249456 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:40.495946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94497df-c53c-4687-ab1a-9b46e0249456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:40.497582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94497df-c53c-4687-ab1a-9b46e0249456 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:40.511127 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3371/6765] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:45:40.556896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf551e3-8386-4d6a-8d92-e00575b76f7a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:40.557369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf551e3-8386-4d6a-8d92-e00575b76f7a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:40.557613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf551e3-8386-4d6a-8d92-e00575b76f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:40.579952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-abf551e3-8386-4d6a-8d92-e00575b76f7a None None] MFA Rules not processed for user `1e60d246f1ea48bf884ef8fb32d2511c`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:40.582116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-abf551e3-8386-4d6a-8d92-e00575b76f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:40.669636 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3395/6766] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:41.225014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94497df-c53c-4687-ab1a-9b46e0249456 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:41.228947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f94497df-c53c-4687-ab1a-9b46e0249456 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:41.241966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94497df-c53c-4687-ab1a-9b46e0249456 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:41.247324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70273239-e61e-4e30-982d-b691b68877d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:41.251782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70273239-e61e-4e30-982d-b691b68877d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:41.251782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70273239-e61e-4e30-982d-b691b68877d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:41.251782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70273239-e61e-4e30-982d-b691b68877d9 admin admin] PATH_INFO: `/v3/users/53f725648a464c35bd318808ac58d2d1` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:41.252439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70273239-e61e-4e30-982d-b691b68877d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53f725648a464c35bd318808ac58d2d1)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:41.268154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70273239-e61e-4e30-982d-b691b68877d9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:41.454282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-70273239-e61e-4e30-982d-b691b68877d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53f725648a464c35bd318808ac58d2d1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:41.471203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-70273239-e61e-4e30-982d-b691b68877d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53f725648a464c35bd318808ac58d2d1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:41.472023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-70273239-e61e-4e30-982d-b691b68877d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53f725648a464c35bd318808ac58d2d1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:41.479555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-70273239-e61e-4e30-982d-b691b68877d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53f725648a464c35bd318808ac58d2d1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:41.538580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-70273239-e61e-4e30-982d-b691b68877d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53f725648a464c35bd318808ac58d2d1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:41.545917 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3372/6767] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:45:41 2022] DELETE /identity/v3/users/53f725648a464c35bd318808ac58d2d1 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:41.551133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caee4d-65c5-434b-921d-928503fc6102 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:41.551611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caee4d-65c5-434b-921d-928503fc6102 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:41.551900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caee4d-65c5-434b-921d-928503fc6102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:41.573748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-17caee4d-65c5-434b-921d-928503fc6102 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:41.575208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-17caee4d-65c5-434b-921d-928503fc6102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:41.649631 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3396/6768] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:41.665541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70273239-e61e-4e30-982d-b691b68877d9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:41.667061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-70273239-e61e-4e30-982d-b691b68877d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:41.732874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70273239-e61e-4e30-982d-b691b68877d9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:41.739379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58e5fe-ce31-482e-a7ef-7f0e9af067c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:41.740396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58e5fe-ce31-482e-a7ef-7f0e9af067c6 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:41.740728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58e5fe-ce31-482e-a7ef-7f0e9af067c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:41.741486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58e5fe-ce31-482e-a7ef-7f0e9af067c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:41.762651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58e5fe-ce31-482e-a7ef-7f0e9af067c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:41.764166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58e5fe-ce31-482e-a7ef-7f0e9af067c6 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:41.775050 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3373/6769] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:45:42.464825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17caee4d-65c5-434b-921d-928503fc6102 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:42.467626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-17caee4d-65c5-434b-921d-928503fc6102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:42.545448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17caee4d-65c5-434b-921d-928503fc6102 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:42.551475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568f5a9-ff76-47c5-a999-ec4aaa86f56e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:42.552146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568f5a9-ff76-47c5-a999-ec4aaa86f56e service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:42.552435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568f5a9-ff76-47c5-a999-ec4aaa86f56e service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:42.552764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568f5a9-ff76-47c5-a999-ec4aaa86f56e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:42.554583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9568f5a9-ff76-47c5-a999-ec4aaa86f56e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:42.570469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568f5a9-ff76-47c5-a999-ec4aaa86f56e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:42.572301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568f5a9-ff76-47c5-a999-ec4aaa86f56e service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:42.585587 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3397/6770] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:45:42.605702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58e5fe-ce31-482e-a7ef-7f0e9af067c6 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:42.607470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1d58e5fe-ce31-482e-a7ef-7f0e9af067c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:42.622357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58e5fe-ce31-482e-a7ef-7f0e9af067c6 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:42.637475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db7c97-d7ea-4905-911a-7b1442a9970d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:42.640769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db7c97-d7ea-4905-911a-7b1442a9970d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:42.651016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db7c97-d7ea-4905-911a-7b1442a9970d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:42.652371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db7c97-d7ea-4905-911a-7b1442a9970d admin admin] PATH_INFO: `/v3/projects/561e89131f06493c86bc50726a607921` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:42.655953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db7c97-d7ea-4905-911a-7b1442a9970d admin admin] RBAC: Authorizing `identity:delete_project(project_id=561e89131f06493c86bc50726a607921)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:42.661419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db7c97-d7ea-4905-911a-7b1442a9970d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:42.842956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f6db7c97-d7ea-4905-911a-7b1442a9970d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561e89131f06493c86bc50726a607921', 'request_id': 'req-f6db7c97-d7ea-4905-911a-7b1442a9970d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:42.858518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f6db7c97-d7ea-4905-911a-7b1442a9970d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561e89131f06493c86bc50726a607921', 'request_id': 'req-f6db7c97-d7ea-4905-911a-7b1442a9970d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:42.964026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f6db7c97-d7ea-4905-911a-7b1442a9970d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561e89131f06493c86bc50726a607921', 'request_id': 'req-f6db7c97-d7ea-4905-911a-7b1442a9970d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:42.973427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568f5a9-ff76-47c5-a999-ec4aaa86f56e service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:42.975098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9568f5a9-ff76-47c5-a999-ec4aaa86f56e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:42.980334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f6db7c97-d7ea-4905-911a-7b1442a9970d admin admin] The token cache is being invalidate because project 561e89131f06493c86bc50726a607921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:45:42.981633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f6db7c97-d7ea-4905-911a-7b1442a9970d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:42.983332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f6db7c97-d7ea-4905-911a-7b1442a9970d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:42.986776 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3374/6771] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:45:42 2022] DELETE /identity/v3/projects/561e89131f06493c86bc50726a607921 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:42.996479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be87261-c2b6-4264-ad41-f3511f01f709 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:42.996479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be87261-c2b6-4264-ad41-f3511f01f709 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:42.996479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be87261-c2b6-4264-ad41-f3511f01f709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:43.043564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2be87261-c2b6-4264-ad41-f3511f01f709 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:43.044846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2be87261-c2b6-4264-ad41-f3511f01f709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:43.162725 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3375/6772] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:43.164303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b859c-1987-4f00-9bf0-6e1bfbf8f595 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:43.164930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b859c-1987-4f00-9bf0-6e1bfbf8f595 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:43.165369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b859c-1987-4f00-9bf0-6e1bfbf8f595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:43.193768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568f5a9-ff76-47c5-a999-ec4aaa86f56e service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:43.213924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-bc7b859c-1987-4f00-9bf0-6e1bfbf8f595 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:43.215161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bc7b859c-1987-4f00-9bf0-6e1bfbf8f595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:43.224306 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3376/6773] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:43.229010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b859c-1987-4f00-9bf0-6e1bfbf8f595 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:43.239049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b859c-1987-4f00-9bf0-6e1bfbf8f595 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:43.243926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3336cc-41e7-4973-9d4e-76528031379c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:43.244593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3336cc-41e7-4973-9d4e-76528031379c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:43.244919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3336cc-41e7-4973-9d4e-76528031379c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:43.247557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3336cc-41e7-4973-9d4e-76528031379c admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:43.247557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3336cc-41e7-4973-9d4e-76528031379c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:45:43.247557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3336cc-41e7-4973-9d4e-76528031379c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:43.247851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3336cc-41e7-4973-9d4e-76528031379c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:43.261101 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3377/6774] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:45:43.266714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3336cc-41e7-4973-9d4e-76528031379c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:43.289097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3336cc-41e7-4973-9d4e-76528031379c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:43.296705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7485a-c6c5-4914-b947-d274b87a1277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:43.298708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7485a-c6c5-4914-b947-d274b87a1277 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:43.299205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7485a-c6c5-4914-b947-d274b87a1277 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:43.299686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7485a-c6c5-4914-b947-d274b87a1277 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:43.300567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7485a-c6c5-4914-b947-d274b87a1277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:43.303911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7485a-c6c5-4914-b947-d274b87a1277 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:43.352699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6611c3-0b9d-4e85-aff7-9e679468027d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:43.352699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6611c3-0b9d-4e85-aff7-9e679468027d service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:43.352699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6611c3-0b9d-4e85-aff7-9e679468027d service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:43.354381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6611c3-0b9d-4e85-aff7-9e679468027d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:43.358245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4d6611c3-0b9d-4e85-aff7-9e679468027d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:43.441388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6611c3-0b9d-4e85-aff7-9e679468027d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:43.444943 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3378/6775] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:45:43 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:45:43.446097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7485a-c6c5-4914-b947-d274b87a1277 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:43.447161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6611c3-0b9d-4e85-aff7-9e679468027d service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:43.493498 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3398/6776] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:45:43.627813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7485a-c6c5-4914-b947-d274b87a1277 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:43.648328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cfbfe-9ed1-414d-aba0-acbf9d689d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:43.649067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cfbfe-9ed1-414d-aba0-acbf9d689d91 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:43.649538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cfbfe-9ed1-414d-aba0-acbf9d689d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:43.650158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cfbfe-9ed1-414d-aba0-acbf9d689d91 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:43.651028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0cfbfe-9ed1-414d-aba0-acbf9d689d91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:43.653451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0cfbfe-9ed1-414d-aba0-acbf9d689d91 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:43.745864 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3379/6777] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:45:43 2022] POST /identity/v3/users => generated 291 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:45:43.750355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6611c3-0b9d-4e85-aff7-9e679468027d service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:43.766476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6611c3-0b9d-4e85-aff7-9e679468027d service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:43.772310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e2387-ace2-4f2f-b251-f6574e6ca766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:43.773186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e2387-ace2-4f2f-b251-f6574e6ca766 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:43.773546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e2387-ace2-4f2f-b251-f6574e6ca766 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:43.774027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e2387-ace2-4f2f-b251-f6574e6ca766 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:43.775321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e2387-ace2-4f2f-b251-f6574e6ca766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:43.777424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e2387-ace2-4f2f-b251-f6574e6ca766 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:43.798767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cfbfe-9ed1-414d-aba0-acbf9d689d91 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:43.811350 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3399/6778] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:45:43.821338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cfbfe-9ed1-414d-aba0-acbf9d689d91 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:43.828084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf9cf4-216e-4ee1-831d-f51d8b74cd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:43.829401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf9cf4-216e-4ee1-831d-f51d8b74cd0c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:43.829688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf9cf4-216e-4ee1-831d-f51d8b74cd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:43.830011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf9cf4-216e-4ee1-831d-f51d8b74cd0c admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:43.830750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf9cf4-216e-4ee1-831d-f51d8b74cd0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:43.832931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf9cf4-216e-4ee1-831d-f51d8b74cd0c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:43.850602 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3380/6779] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:45:43.854702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e2387-ace2-4f2f-b251-f6574e6ca766 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:43.868171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e2387-ace2-4f2f-b251-f6574e6ca766 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:43.882244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef2a85-c717-4002-b7b7-1ee389692220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:43.885272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef2a85-c717-4002-b7b7-1ee389692220 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:43.886457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef2a85-c717-4002-b7b7-1ee389692220 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:43.886961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef2a85-c717-4002-b7b7-1ee389692220 admin admin] PATH_INFO: `/v3/projects/23dc31c03ada4eba97ae47aab53487d9/users/f58c631280fb4cdb917abc34660e3325/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:43.943583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef2a85-c717-4002-b7b7-1ee389692220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23dc31c03ada4eba97ae47aab53487d9, user_id=f58c631280fb4cdb917abc34660e3325, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:43.947566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef2a85-c717-4002-b7b7-1ee389692220 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:44.051597 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3400/6780] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:45:43 2022] PUT /identity/v3/projects/23dc31c03ada4eba97ae47aab53487d9/users/f58c631280fb4cdb917abc34660e3325/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:44.056723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23ae91-8f68-4e7c-8f0c-8e360ec5db88 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:44.057011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23ae91-8f68-4e7c-8f0c-8e360ec5db88 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:44.057324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23ae91-8f68-4e7c-8f0c-8e360ec5db88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:44.090703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-bc23ae91-8f68-4e7c-8f0c-8e360ec5db88 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:44.091571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bc23ae91-8f68-4e7c-8f0c-8e360ec5db88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:44.178491 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3381/6781] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:44.215237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef2a85-c717-4002-b7b7-1ee389692220 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:44.217077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d0ef2a85-c717-4002-b7b7-1ee389692220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:44.296028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef2a85-c717-4002-b7b7-1ee389692220 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:44.311126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044a5a4-6cc9-4226-a5bb-1d0c10682d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:44.312039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044a5a4-6cc9-4226-a5bb-1d0c10682d4c service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:44.312039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044a5a4-6cc9-4226-a5bb-1d0c10682d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:44.312350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044a5a4-6cc9-4226-a5bb-1d0c10682d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:44.339947 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044a5a4-6cc9-4226-a5bb-1d0c10682d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:44.341470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044a5a4-6cc9-4226-a5bb-1d0c10682d4c service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:44.362267 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3401/6782] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:45:47.796366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbdd87-4a0e-44fa-9bac-b21f229188e5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:47.797975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbdd87-4a0e-44fa-9bac-b21f229188e5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:47.798449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbdd87-4a0e-44fa-9bac-b21f229188e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:47.890373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5abbdd87-4a0e-44fa-9bac-b21f229188e5 None None] MFA Rules not processed for user `f58c631280fb4cdb917abc34660e3325`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:47.891664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5abbdd87-4a0e-44fa-9bac-b21f229188e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:48.053321 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3382/6783] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:48.065913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044a5a4-6cc9-4226-a5bb-1d0c10682d4c service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:48.070513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9044a5a4-6cc9-4226-a5bb-1d0c10682d4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:48.186085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044a5a4-6cc9-4226-a5bb-1d0c10682d4c service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:48.190694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc1a30-04bc-40fd-bed1-1ee20181dea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:48.191392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc1a30-04bc-40fd-bed1-1ee20181dea2 service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:48.191858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc1a30-04bc-40fd-bed1-1ee20181dea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:48.192133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc1a30-04bc-40fd-bed1-1ee20181dea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:48.209569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc1a30-04bc-40fd-bed1-1ee20181dea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:48.214197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc1a30-04bc-40fd-bed1-1ee20181dea2 service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:48.234369 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3402/6784] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:45:48.841170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbdd87-4a0e-44fa-9bac-b21f229188e5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:48.843138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5abbdd87-4a0e-44fa-9bac-b21f229188e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:48.876188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbdd87-4a0e-44fa-9bac-b21f229188e5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:48.907899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91663bd7-9a2a-4393-ac42-f07cb1558833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:48.908828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91663bd7-9a2a-4393-ac42-f07cb1558833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:48.909185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91663bd7-9a2a-4393-ac42-f07cb1558833 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:48.909464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91663bd7-9a2a-4393-ac42-f07cb1558833 admin admin] PATH_INFO: `/v3/users/26723e7d6f3d44a4951432f45c89021a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:48.911845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91663bd7-9a2a-4393-ac42-f07cb1558833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26723e7d6f3d44a4951432f45c89021a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:48.913841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91663bd7-9a2a-4393-ac42-f07cb1558833 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:49.264213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-91663bd7-9a2a-4393-ac42-f07cb1558833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26723e7d6f3d44a4951432f45c89021a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:49.299138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-91663bd7-9a2a-4393-ac42-f07cb1558833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26723e7d6f3d44a4951432f45c89021a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:49.305553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-91663bd7-9a2a-4393-ac42-f07cb1558833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26723e7d6f3d44a4951432f45c89021a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:49.333727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-91663bd7-9a2a-4393-ac42-f07cb1558833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26723e7d6f3d44a4951432f45c89021a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:49.409375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-91663bd7-9a2a-4393-ac42-f07cb1558833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26723e7d6f3d44a4951432f45c89021a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:49.416395 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3383/6785] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:45:48 2022] DELETE /identity/v3/users/26723e7d6f3d44a4951432f45c89021a => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:50.127342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fb2aa-af36-4b46-83a0-1a24124600fa None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:50.127872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fb2aa-af36-4b46-83a0-1a24124600fa None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:50.127980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fb2aa-af36-4b46-83a0-1a24124600fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:50.203508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b94fb2aa-af36-4b46-83a0-1a24124600fa None None] MFA Rules not processed for user `1326669005334b5095c1dc40a52720b5`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:50.206033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b94fb2aa-af36-4b46-83a0-1a24124600fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:50.220904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91663bd7-9a2a-4393-ac42-f07cb1558833 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:50.222846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-91663bd7-9a2a-4393-ac42-f07cb1558833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:50.309724 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3403/6786] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:50.322301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286d405-0943-4980-86bb-79dedf4c93d9 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:50.322997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286d405-0943-4980-86bb-79dedf4c93d9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:50.323675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286d405-0943-4980-86bb-79dedf4c93d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:50.379567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-5286d405-0943-4980-86bb-79dedf4c93d9 None None] MFA Rules not processed for user `1326669005334b5095c1dc40a52720b5`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:50.383235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5286d405-0943-4980-86bb-79dedf4c93d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:50.417947 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3404/6787] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:50.420035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91663bd7-9a2a-4393-ac42-f07cb1558833 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:50.430377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286d405-0943-4980-86bb-79dedf4c93d9 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:50.432688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5286d405-0943-4980-86bb-79dedf4c93d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:50.436173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5310b-9f55-45ad-a2d5-c1b5197b16b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:50.441692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5310b-9f55-45ad-a2d5-c1b5197b16b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:50.441946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5310b-9f55-45ad-a2d5-c1b5197b16b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:50.444980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5310b-9f55-45ad-a2d5-c1b5197b16b9 admin admin] PATH_INFO: `/v3/projects/608974f2bff942b5a36c7b8f748dcf72` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:50.450403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5310b-9f55-45ad-a2d5-c1b5197b16b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=608974f2bff942b5a36c7b8f748dcf72)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:50.452831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5310b-9f55-45ad-a2d5-c1b5197b16b9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:50.618154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286d405-0943-4980-86bb-79dedf4c93d9 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:50.636810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e10862-93b0-4233-8e33-c03bbbfa2a94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:50.638522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e10862-93b0-4233-8e33-c03bbbfa2a94 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:50.638522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e10862-93b0-4233-8e33-c03bbbfa2a94 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:50.638522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e10862-93b0-4233-8e33-c03bbbfa2a94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:50.662984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3c5310b-9f55-45ad-a2d5-c1b5197b16b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '608974f2bff942b5a36c7b8f748dcf72', 'request_id': 'req-d3c5310b-9f55-45ad-a2d5-c1b5197b16b9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:50.677599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e10862-93b0-4233-8e33-c03bbbfa2a94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:50.679019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3c5310b-9f55-45ad-a2d5-c1b5197b16b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '608974f2bff942b5a36c7b8f748dcf72', 'request_id': 'req-d3c5310b-9f55-45ad-a2d5-c1b5197b16b9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:50.680986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e10862-93b0-4233-8e33-c03bbbfa2a94 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:50.696550 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3405/6788] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:45:50.778779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3c5310b-9f55-45ad-a2d5-c1b5197b16b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '608974f2bff942b5a36c7b8f748dcf72', 'request_id': 'req-d3c5310b-9f55-45ad-a2d5-c1b5197b16b9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:50.798082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3c5310b-9f55-45ad-a2d5-c1b5197b16b9 admin admin] The token cache is being invalidate because project 608974f2bff942b5a36c7b8f748dcf72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:45:50.799015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3c5310b-9f55-45ad-a2d5-c1b5197b16b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:50.807322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3c5310b-9f55-45ad-a2d5-c1b5197b16b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:45:50.807322 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3384/6789] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:45:50 2022] DELETE /identity/v3/projects/608974f2bff942b5a36c7b8f748dcf72 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:50.811549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713b80e-a4d0-47ce-89f0-7f71885ef3ee None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:50.811857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713b80e-a4d0-47ce-89f0-7f71885ef3ee None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:50.812181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713b80e-a4d0-47ce-89f0-7f71885ef3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:50.855853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-5713b80e-a4d0-47ce-89f0-7f71885ef3ee None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:50.858752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5713b80e-a4d0-47ce-89f0-7f71885ef3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:50.951153 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3406/6790] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:50.958766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2cd7f-1ff4-47c6-bad0-ede80df0128b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:50.959094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2cd7f-1ff4-47c6-bad0-ede80df0128b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:50.959345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2cd7f-1ff4-47c6-bad0-ede80df0128b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:50.988843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-cee2cd7f-1ff4-47c6-bad0-ede80df0128b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:50.988843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cee2cd7f-1ff4-47c6-bad0-ede80df0128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:50.994355 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3385/6791] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:50.998261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713b80e-a4d0-47ce-89f0-7f71885ef3ee None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:51.029576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713b80e-a4d0-47ce-89f0-7f71885ef3ee None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:51.049118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc730cf-1de9-4506-bbab-41e424cd80f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:51.049939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc730cf-1de9-4506-bbab-41e424cd80f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:51.051289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc730cf-1de9-4506-bbab-41e424cd80f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:51.053386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc730cf-1de9-4506-bbab-41e424cd80f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:51.054264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc730cf-1de9-4506-bbab-41e424cd80f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:45:51.055857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc730cf-1de9-4506-bbab-41e424cd80f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:51.061553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc730cf-1de9-4506-bbab-41e424cd80f5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:51.097248 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3407/6792] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:45:51.098250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2cd7f-1ff4-47c6-bad0-ede80df0128b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:51.110315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2cd7f-1ff4-47c6-bad0-ede80df0128b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:51.119103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b84c8-d0df-42f9-845d-69cc7194670d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:51.119894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b84c8-d0df-42f9-845d-69cc7194670d admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:51.120230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b84c8-d0df-42f9-845d-69cc7194670d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:51.120561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b84c8-d0df-42f9-845d-69cc7194670d admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:51.121333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b84c8-d0df-42f9-845d-69cc7194670d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:51.123391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b84c8-d0df-42f9-845d-69cc7194670d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:51.260146 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3386/6793] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:45:51 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:45:51.262688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc730cf-1de9-4506-bbab-41e424cd80f5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:51.279039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc730cf-1de9-4506-bbab-41e424cd80f5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:51.434505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ec7fc-d5dc-4d85-aa75-d49ec02c5dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:51.435546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ec7fc-d5dc-4d85-aa75-d49ec02c5dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:51.436004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ec7fc-d5dc-4d85-aa75-d49ec02c5dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:51.436467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ec7fc-d5dc-4d85-aa75-d49ec02c5dd3 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:51.437386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ec7fc-d5dc-4d85-aa75-d49ec02c5dd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:51.439496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ec7fc-d5dc-4d85-aa75-d49ec02c5dd3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:51.579141 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3408/6794] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:45:51 2022] POST /identity/v3/users => generated 287 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:45:51.581097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b84c8-d0df-42f9-845d-69cc7194670d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:51.593189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b84c8-d0df-42f9-845d-69cc7194670d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:51.599660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f972b-50ea-4295-931d-dc956d9cbc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:51.600343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f972b-50ea-4295-931d-dc956d9cbc95 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:51.600883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f972b-50ea-4295-931d-dc956d9cbc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:51.601800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f972b-50ea-4295-931d-dc956d9cbc95 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:51.608160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f972b-50ea-4295-931d-dc956d9cbc95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:51.608160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f972b-50ea-4295-931d-dc956d9cbc95 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:51.624793 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3387/6795] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:45:51.629484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ec7fc-d5dc-4d85-aa75-d49ec02c5dd3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:51.644896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ec7fc-d5dc-4d85-aa75-d49ec02c5dd3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:51.655780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6329da-8d69-4108-bd16-9ee0ad4ceaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:51.656270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6329da-8d69-4108-bd16-9ee0ad4ceaa4 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:51.656744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6329da-8d69-4108-bd16-9ee0ad4ceaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:51.657629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6329da-8d69-4108-bd16-9ee0ad4ceaa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:51.658395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6329da-8d69-4108-bd16-9ee0ad4ceaa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:51.660062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6329da-8d69-4108-bd16-9ee0ad4ceaa4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:51.676560 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3409/6796] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:45:51.679293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f972b-50ea-4295-931d-dc956d9cbc95 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:51.696802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f972b-50ea-4295-931d-dc956d9cbc95 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:51.709999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d276b-fcc3-42ef-a3de-b1644c09c8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:51.711158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d276b-fcc3-42ef-a3de-b1644c09c8a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:51.711789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d276b-fcc3-42ef-a3de-b1644c09c8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:51.712194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d276b-fcc3-42ef-a3de-b1644c09c8a6 admin admin] PATH_INFO: `/v3/projects/5c9766e517ac48c3a053e35e300d65e9/users/c158610b12db4133b79403d30a1381bf/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:51.752719 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d276b-fcc3-42ef-a3de-b1644c09c8a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c9766e517ac48c3a053e35e300d65e9, user_id=c158610b12db4133b79403d30a1381bf, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:51.760020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d276b-fcc3-42ef-a3de-b1644c09c8a6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:51.900817 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3388/6797] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:45:51 2022] PUT /identity/v3/projects/5c9766e517ac48c3a053e35e300d65e9/users/c158610b12db4133b79403d30a1381bf/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:45:51.902704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849e6a3-820b-40a9-a049-2a1776d436f9 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:51.903089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849e6a3-820b-40a9-a049-2a1776d436f9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:51.903397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849e6a3-820b-40a9-a049-2a1776d436f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:51.937791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e849e6a3-820b-40a9-a049-2a1776d436f9 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:51.951610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e849e6a3-820b-40a9-a049-2a1776d436f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:52.131219 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3410/6798] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:52.150681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d276b-fcc3-42ef-a3de-b1644c09c8a6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:52.152526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-153d276b-fcc3-42ef-a3de-b1644c09c8a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:52.289537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d276b-fcc3-42ef-a3de-b1644c09c8a6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:52.294454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c7f2f-6987-4a45-a060-4a2768208c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:52.295137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c7f2f-6987-4a45-a060-4a2768208c6c service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:52.295421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c7f2f-6987-4a45-a060-4a2768208c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:52.295696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c7f2f-6987-4a45-a060-4a2768208c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:52.322859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c7f2f-6987-4a45-a060-4a2768208c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:52.327471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c7f2f-6987-4a45-a060-4a2768208c6c service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:52.339375 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3389/6799] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:45:54.372962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849e6a3-820b-40a9-a049-2a1776d436f9 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:54.389416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849e6a3-820b-40a9-a049-2a1776d436f9 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:54.394146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d10ad-27e4-4ea8-a3e9-9ba38d3bc6f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:54.395492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d10ad-27e4-4ea8-a3e9-9ba38d3bc6f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:54.396442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d10ad-27e4-4ea8-a3e9-9ba38d3bc6f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:54.396920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d10ad-27e4-4ea8-a3e9-9ba38d3bc6f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:54.403328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c43d10ad-27e4-4ea8-a3e9-9ba38d3bc6f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:54.418044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d10ad-27e4-4ea8-a3e9-9ba38d3bc6f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:54.419794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d10ad-27e4-4ea8-a3e9-9ba38d3bc6f5 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:54.431995 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3411/6800] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:45:54.759504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfffde5-e37d-466c-8398-db1b3e9c4d9c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:54.760579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfffde5-e37d-466c-8398-db1b3e9c4d9c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:54.761150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfffde5-e37d-466c-8398-db1b3e9c4d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:54.831713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8dfffde5-e37d-466c-8398-db1b3e9c4d9c None None] MFA Rules not processed for user `c158610b12db4133b79403d30a1381bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:54.833130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8dfffde5-e37d-466c-8398-db1b3e9c4d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:54.912501 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3390/6801] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:54.925066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d10ad-27e4-4ea8-a3e9-9ba38d3bc6f5 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:54.926923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c43d10ad-27e4-4ea8-a3e9-9ba38d3bc6f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:55.031852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d10ad-27e4-4ea8-a3e9-9ba38d3bc6f5 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:55.040807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c57924-2a1d-4767-918c-bfb30f3f395e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:55.041480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c57924-2a1d-4767-918c-bfb30f3f395e service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:55.041765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c57924-2a1d-4767-918c-bfb30f3f395e service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:55.042049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c57924-2a1d-4767-918c-bfb30f3f395e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:55.051300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c57924-2a1d-4767-918c-bfb30f3f395e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:55.053808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c57924-2a1d-4767-918c-bfb30f3f395e service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:55.072693 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3412/6802] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:45:56.460081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfffde5-e37d-466c-8398-db1b3e9c4d9c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:56.461923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8dfffde5-e37d-466c-8398-db1b3e9c4d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:56.477408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfffde5-e37d-466c-8398-db1b3e9c4d9c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:56.481619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217b237-592b-4624-bd81-10073740d325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:56.482532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217b237-592b-4624-bd81-10073740d325 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:56.482813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217b237-592b-4624-bd81-10073740d325 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:56.483091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217b237-592b-4624-bd81-10073740d325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:56.485526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f217b237-592b-4624-bd81-10073740d325 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:56.498365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217b237-592b-4624-bd81-10073740d325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:56.503885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217b237-592b-4624-bd81-10073740d325 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:56.511518 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3391/6803] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:45:56.743257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6a901-c2da-47ce-ae87-25d8ad120078 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:56.743804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6a901-c2da-47ce-ae87-25d8ad120078 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:56.744054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6a901-c2da-47ce-ae87-25d8ad120078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:56.790489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-bbb6a901-c2da-47ce-ae87-25d8ad120078 None None] MFA Rules not processed for user `c158610b12db4133b79403d30a1381bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:45:56.792483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bbb6a901-c2da-47ce-ae87-25d8ad120078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:56.818561 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3413/6804] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:45:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:45:58.792673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217b237-592b-4624-bd81-10073740d325 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:45:58.814130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217b237-592b-4624-bd81-10073740d325 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:45:58.833461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45bb1d-886b-4a73-8774-183056a73d1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:45:58.834230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45bb1d-886b-4a73-8774-183056a73d1f service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:45:58.834592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45bb1d-886b-4a73-8774-183056a73d1f service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:45:58.835256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45bb1d-886b-4a73-8774-183056a73d1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:45:58.842511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-de45bb1d-886b-4a73-8774-183056a73d1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:45:58.877440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45bb1d-886b-4a73-8774-183056a73d1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:45:58.879354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45bb1d-886b-4a73-8774-183056a73d1f service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:45:58.897285 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3392/6805] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:45:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:46:04.746915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6a901-c2da-47ce-ae87-25d8ad120078 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:04.772359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6a901-c2da-47ce-ae87-25d8ad120078 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:04.781497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f65e7-1d0b-4f74-bc67-51c288f2667d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:04.782237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f65e7-1d0b-4f74-bc67-51c288f2667d service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:04.782484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f65e7-1d0b-4f74-bc67-51c288f2667d service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:04.782768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f65e7-1d0b-4f74-bc67-51c288f2667d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:04.786255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d44f65e7-1d0b-4f74-bc67-51c288f2667d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:04.815629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f65e7-1d0b-4f74-bc67-51c288f2667d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:04.826029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f65e7-1d0b-4f74-bc67-51c288f2667d service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:04.857102 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3414/6806] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:46:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:46:06.697634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeffbe6-e767-4315-883f-257417416841 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:06.698276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeffbe6-e767-4315-883f-257417416841 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:06.698276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeffbe6-e767-4315-883f-257417416841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:06.720350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9eeffbe6-e767-4315-883f-257417416841 None None] MFA Rules not processed for user `1e60d246f1ea48bf884ef8fb32d2511c`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:46:06.720350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9eeffbe6-e767-4315-883f-257417416841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:06.778001 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3393/6807] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:46:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:46:07.393729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f65e7-1d0b-4f74-bc67-51c288f2667d service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:07.397672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d44f65e7-1d0b-4f74-bc67-51c288f2667d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:07.438765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f65e7-1d0b-4f74-bc67-51c288f2667d service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:07.457231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89bbb3-0ddb-4d02-b148-b5030626e161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:07.458496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89bbb3-0ddb-4d02-b148-b5030626e161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:07.458993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89bbb3-0ddb-4d02-b148-b5030626e161 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:07.459430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89bbb3-0ddb-4d02-b148-b5030626e161 admin admin] PATH_INFO: `/v3/users/00901b5b42a84fc9960ab2ba01de97a7` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:07.460893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89bbb3-0ddb-4d02-b148-b5030626e161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00901b5b42a84fc9960ab2ba01de97a7)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:07.463144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89bbb3-0ddb-4d02-b148-b5030626e161 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:07.705833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ac89bbb3-0ddb-4d02-b148-b5030626e161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00901b5b42a84fc9960ab2ba01de97a7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:07.754025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ac89bbb3-0ddb-4d02-b148-b5030626e161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00901b5b42a84fc9960ab2ba01de97a7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:07.754991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ac89bbb3-0ddb-4d02-b148-b5030626e161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00901b5b42a84fc9960ab2ba01de97a7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:07.767693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ac89bbb3-0ddb-4d02-b148-b5030626e161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00901b5b42a84fc9960ab2ba01de97a7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:07.843105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ac89bbb3-0ddb-4d02-b148-b5030626e161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00901b5b42a84fc9960ab2ba01de97a7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:07.858285 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3415/6808] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:46:07 2022] DELETE /identity/v3/users/00901b5b42a84fc9960ab2ba01de97a7 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:46:08.565531 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeffbe6-e767-4315-883f-257417416841 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:08.586380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeffbe6-e767-4315-883f-257417416841 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:08.677610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af9a42-e11c-41f3-ae0d-776b0bf230e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:08.678677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af9a42-e11c-41f3-ae0d-776b0bf230e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:08.678993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af9a42-e11c-41f3-ae0d-776b0bf230e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:08.679274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af9a42-e11c-41f3-ae0d-776b0bf230e3 admin admin] PATH_INFO: `/v3/projects/42802f1cc49a47abb61f1aca504c8e4b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:08.680791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af9a42-e11c-41f3-ae0d-776b0bf230e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42802f1cc49a47abb61f1aca504c8e4b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:08.682882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af9a42-e11c-41f3-ae0d-776b0bf230e3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:08.898618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-52af9a42-e11c-41f3-ae0d-776b0bf230e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42802f1cc49a47abb61f1aca504c8e4b', 'request_id': 'req-52af9a42-e11c-41f3-ae0d-776b0bf230e3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:08.911332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-52af9a42-e11c-41f3-ae0d-776b0bf230e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42802f1cc49a47abb61f1aca504c8e4b', 'request_id': 'req-52af9a42-e11c-41f3-ae0d-776b0bf230e3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:09.025811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-52af9a42-e11c-41f3-ae0d-776b0bf230e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42802f1cc49a47abb61f1aca504c8e4b', 'request_id': 'req-52af9a42-e11c-41f3-ae0d-776b0bf230e3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:09.044874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-52af9a42-e11c-41f3-ae0d-776b0bf230e3 admin admin] The token cache is being invalidate because project 42802f1cc49a47abb61f1aca504c8e4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:46:09.050304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-52af9a42-e11c-41f3-ae0d-776b0bf230e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:09.050304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-52af9a42-e11c-41f3-ae0d-776b0bf230e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:09.050756 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3394/6809] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:46:08 2022] DELETE /identity/v3/projects/42802f1cc49a47abb61f1aca504c8e4b => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:46:09.056263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89bbb3-0ddb-4d02-b148-b5030626e161 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:09.062684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ac89bbb3-0ddb-4d02-b148-b5030626e161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:09.113461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89bbb3-0ddb-4d02-b148-b5030626e161 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:09.238812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfde4a-02cb-40d7-a9df-17edbb218c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:09.239718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfde4a-02cb-40d7-a9df-17edbb218c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:09.240009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfde4a-02cb-40d7-a9df-17edbb218c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:09.240355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfde4a-02cb-40d7-a9df-17edbb218c29 admin admin] PATH_INFO: `/v3/users/97056bf137374760a9e9d26a0b78f45b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:09.241744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfde4a-02cb-40d7-a9df-17edbb218c29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97056bf137374760a9e9d26a0b78f45b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:09.243860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfde4a-02cb-40d7-a9df-17edbb218c29 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:09.518263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ccfde4a-02cb-40d7-a9df-17edbb218c29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97056bf137374760a9e9d26a0b78f45b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:09.536050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ccfde4a-02cb-40d7-a9df-17edbb218c29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97056bf137374760a9e9d26a0b78f45b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:09.537513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ccfde4a-02cb-40d7-a9df-17edbb218c29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97056bf137374760a9e9d26a0b78f45b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:09.546942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ccfde4a-02cb-40d7-a9df-17edbb218c29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97056bf137374760a9e9d26a0b78f45b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:09.620874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ccfde4a-02cb-40d7-a9df-17edbb218c29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97056bf137374760a9e9d26a0b78f45b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:09.630670 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3416/6810] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:46:09 2022] DELETE /identity/v3/users/97056bf137374760a9e9d26a0b78f45b => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:46:10.027625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af9a42-e11c-41f3-ae0d-776b0bf230e3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:10.031666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-52af9a42-e11c-41f3-ae0d-776b0bf230e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:10.053323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af9a42-e11c-41f3-ae0d-776b0bf230e3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:10.113785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4cc0d-f928-405b-9354-c1bc0a8c9890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:10.114667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4cc0d-f928-405b-9354-c1bc0a8c9890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:10.115211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4cc0d-f928-405b-9354-c1bc0a8c9890 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:10.115785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4cc0d-f928-405b-9354-c1bc0a8c9890 admin admin] PATH_INFO: `/v3/projects/64536948cf2a47e484fc56a26247c8ad` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:10.117502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4cc0d-f928-405b-9354-c1bc0a8c9890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64536948cf2a47e484fc56a26247c8ad)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:10.119759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4cc0d-f928-405b-9354-c1bc0a8c9890 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:10.255322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-52a4cc0d-f928-405b-9354-c1bc0a8c9890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64536948cf2a47e484fc56a26247c8ad', 'request_id': 'req-52a4cc0d-f928-405b-9354-c1bc0a8c9890'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:10.262578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-52a4cc0d-f928-405b-9354-c1bc0a8c9890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64536948cf2a47e484fc56a26247c8ad', 'request_id': 'req-52a4cc0d-f928-405b-9354-c1bc0a8c9890'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:10.358086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-52a4cc0d-f928-405b-9354-c1bc0a8c9890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64536948cf2a47e484fc56a26247c8ad', 'request_id': 'req-52a4cc0d-f928-405b-9354-c1bc0a8c9890'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:10.373497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-52a4cc0d-f928-405b-9354-c1bc0a8c9890 admin admin] The token cache is being invalidate because project 64536948cf2a47e484fc56a26247c8ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:46:10.376654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-52a4cc0d-f928-405b-9354-c1bc0a8c9890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:10.377665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-52a4cc0d-f928-405b-9354-c1bc0a8c9890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:10.385526 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3395/6811] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:46:10 2022] DELETE /identity/v3/projects/64536948cf2a47e484fc56a26247c8ad => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:46:10.397703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fb934-d6f4-4839-a9c0-0649c3ba81a5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:10.398471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fb934-d6f4-4839-a9c0-0649c3ba81a5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:10.398676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fb934-d6f4-4839-a9c0-0649c3ba81a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:10.435113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ee6fb934-d6f4-4839-a9c0-0649c3ba81a5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:46:10.437740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ee6fb934-d6f4-4839-a9c0-0649c3ba81a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:10.561298 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3417/6812] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:46:10.569087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743fecd-300b-4ca9-a099-0887301e29a4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:10.569552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743fecd-300b-4ca9-a099-0887301e29a4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:10.570011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743fecd-300b-4ca9-a099-0887301e29a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:10.631723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0743fecd-300b-4ca9-a099-0887301e29a4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:46:10.631723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0743fecd-300b-4ca9-a099-0887301e29a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:10.640322 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3396/6813] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:46:10.644677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fb934-d6f4-4839-a9c0-0649c3ba81a5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:10.656114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fb934-d6f4-4839-a9c0-0649c3ba81a5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:10.662820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bf597-6648-41a8-acce-21bb11978d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:10.663519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bf597-6648-41a8-acce-21bb11978d19 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:10.664211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bf597-6648-41a8-acce-21bb11978d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:10.664540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bf597-6648-41a8-acce-21bb11978d19 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:10.667109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bf597-6648-41a8-acce-21bb11978d19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:46:10.667429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bf597-6648-41a8-acce-21bb11978d19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:10.669232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bf597-6648-41a8-acce-21bb11978d19 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:10.683837 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3418/6814] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:46:10.689155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743fecd-300b-4ca9-a099-0887301e29a4 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:10.710037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743fecd-300b-4ca9-a099-0887301e29a4 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:10.728550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21211c58-a789-4381-bfe8-02311d0394ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:10.728550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21211c58-a789-4381-bfe8-02311d0394ac admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:10.728550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21211c58-a789-4381-bfe8-02311d0394ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:10.728550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21211c58-a789-4381-bfe8-02311d0394ac admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:10.729281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21211c58-a789-4381-bfe8-02311d0394ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:10.729281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21211c58-a789-4381-bfe8-02311d0394ac admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:10.860204 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3397/6815] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:46:10 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:46:10.864791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bf597-6648-41a8-acce-21bb11978d19 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:10.876571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bf597-6648-41a8-acce-21bb11978d19 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:11.001099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab107119-8fb1-46e6-ae4e-6752a5a39a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:11.002608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab107119-8fb1-46e6-ae4e-6752a5a39a51 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:11.003214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab107119-8fb1-46e6-ae4e-6752a5a39a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:11.003744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab107119-8fb1-46e6-ae4e-6752a5a39a51 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:11.004628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab107119-8fb1-46e6-ae4e-6752a5a39a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:11.006790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab107119-8fb1-46e6-ae4e-6752a5a39a51 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:11.165779 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3419/6816] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:46:10 2022] POST /identity/v3/users => generated 288 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:46:11.169750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21211c58-a789-4381-bfe8-02311d0394ac admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:11.184879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21211c58-a789-4381-bfe8-02311d0394ac admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:11.190900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f67aab-ebf7-416c-8608-25933c077fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:11.191904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f67aab-ebf7-416c-8608-25933c077fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:11.192408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f67aab-ebf7-416c-8608-25933c077fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:11.192924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f67aab-ebf7-416c-8608-25933c077fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:11.194524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f67aab-ebf7-416c-8608-25933c077fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:11.196370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f67aab-ebf7-416c-8608-25933c077fb3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:11.210809 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3398/6817] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:46:11.214501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab107119-8fb1-46e6-ae4e-6752a5a39a51 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:11.240294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab107119-8fb1-46e6-ae4e-6752a5a39a51 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:11.265122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25865dc-708c-447f-b5bc-d4dbcda32700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:11.265820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25865dc-708c-447f-b5bc-d4dbcda32700 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:11.266111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25865dc-708c-447f-b5bc-d4dbcda32700 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:11.266581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25865dc-708c-447f-b5bc-d4dbcda32700 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:11.268283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25865dc-708c-447f-b5bc-d4dbcda32700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:11.270437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25865dc-708c-447f-b5bc-d4dbcda32700 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:11.289900 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3420/6818] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:46:11.293878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f67aab-ebf7-416c-8608-25933c077fb3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:11.309423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f67aab-ebf7-416c-8608-25933c077fb3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:11.314011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1980896-a495-4d78-91e7-3e5bdacca0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:11.314984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1980896-a495-4d78-91e7-3e5bdacca0cb admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:11.315337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1980896-a495-4d78-91e7-3e5bdacca0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:11.315758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1980896-a495-4d78-91e7-3e5bdacca0cb admin admin] PATH_INFO: `/v3/projects/9bb1182b7372418e9f1952d8066ab81c/users/ec43147c4e93496eb9d54486b312f08f/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:11.334160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1980896-a495-4d78-91e7-3e5bdacca0cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb1182b7372418e9f1952d8066ab81c, user_id=ec43147c4e93496eb9d54486b312f08f, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:11.338840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1980896-a495-4d78-91e7-3e5bdacca0cb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:11.419622 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3399/6819] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:46:11 2022] PUT /identity/v3/projects/9bb1182b7372418e9f1952d8066ab81c/users/ec43147c4e93496eb9d54486b312f08f/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:46:11.424472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e2059-3c92-4e87-acf6-a3eb27fae11e None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:11.425497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e2059-3c92-4e87-acf6-a3eb27fae11e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:11.426001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e2059-3c92-4e87-acf6-a3eb27fae11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:11.455275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-558e2059-3c92-4e87-acf6-a3eb27fae11e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:46:11.457454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-558e2059-3c92-4e87-acf6-a3eb27fae11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:11.570857 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3421/6820] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:46:11.587798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1980896-a495-4d78-91e7-3e5bdacca0cb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:11.589745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f1980896-a495-4d78-91e7-3e5bdacca0cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:11.665513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1980896-a495-4d78-91e7-3e5bdacca0cb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:11.670334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8002e1-a3f9-414f-bce6-8c622440cb17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:11.671709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8002e1-a3f9-414f-bce6-8c622440cb17 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:11.671997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8002e1-a3f9-414f-bce6-8c622440cb17 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:11.672272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8002e1-a3f9-414f-bce6-8c622440cb17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:11.684042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8002e1-a3f9-414f-bce6-8c622440cb17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:11.692771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8002e1-a3f9-414f-bce6-8c622440cb17 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:11.697443 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3400/6821] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:46:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:46:20.668158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea642831-76a8-469d-aa10-f2577c0b5d0e None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:20.668775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea642831-76a8-469d-aa10-f2577c0b5d0e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:20.668775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea642831-76a8-469d-aa10-f2577c0b5d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:20.699511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ea642831-76a8-469d-aa10-f2577c0b5d0e None None] MFA Rules not processed for user `ec43147c4e93496eb9d54486b312f08f`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:46:20.701098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ea642831-76a8-469d-aa10-f2577c0b5d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:20.802015 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3422/6822] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:46:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:46:20.803483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8002e1-a3f9-414f-bce6-8c622440cb17 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:20.828440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8002e1-a3f9-414f-bce6-8c622440cb17 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:20.834181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3d185-7147-42e3-8458-748fdba7b524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:20.834937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3d185-7147-42e3-8458-748fdba7b524 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:20.835323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3d185-7147-42e3-8458-748fdba7b524 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:20.837950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3d185-7147-42e3-8458-748fdba7b524 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:20.838959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3d185-7147-42e3-8458-748fdba7b524 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:20.841723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3d185-7147-42e3-8458-748fdba7b524 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:20.961490 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3401/6823] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:46:20 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:46:20.962616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea642831-76a8-469d-aa10-f2577c0b5d0e None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:20.975634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea642831-76a8-469d-aa10-f2577c0b5d0e None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:21.082780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2dcb85-87b9-4355-a0a8-f4165d3c7292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:21.082780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dcb85-87b9-4355-a0a8-f4165d3c7292 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:21.082780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dcb85-87b9-4355-a0a8-f4165d3c7292 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:21.083664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dcb85-87b9-4355-a0a8-f4165d3c7292 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:21.084566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2dcb85-87b9-4355-a0a8-f4165d3c7292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:21.086819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2dcb85-87b9-4355-a0a8-f4165d3c7292 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:21.198225 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3423/6824] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:46:20 2022] POST /identity/v3/users => generated 294 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:46:21.204063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3d185-7147-42e3-8458-748fdba7b524 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:21.219165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3d185-7147-42e3-8458-748fdba7b524 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:21.224303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc0ec8-c193-4c57-808a-465c2d7222ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:21.226448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc0ec8-c193-4c57-808a-465c2d7222ad admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:21.226740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc0ec8-c193-4c57-808a-465c2d7222ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:21.227158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc0ec8-c193-4c57-808a-465c2d7222ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:21.227958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc0ec8-c193-4c57-808a-465c2d7222ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:21.229682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc0ec8-c193-4c57-808a-465c2d7222ad admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:21.240956 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3402/6825] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:46:21.245251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2dcb85-87b9-4355-a0a8-f4165d3c7292 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:21.257259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2dcb85-87b9-4355-a0a8-f4165d3c7292 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:21.265303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a5bf9-8b2b-4711-bb15-f2473191df86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:21.266535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a5bf9-8b2b-4711-bb15-f2473191df86 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:21.266979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a5bf9-8b2b-4711-bb15-f2473191df86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:21.267438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a5bf9-8b2b-4711-bb15-f2473191df86 admin admin] PATH_INFO: `/v3/projects/0e746d3c0de04bea8911b8b5be49dc70/users/adc012144d2d4ea391e21d638fd2878c/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:21.290649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a5bf9-8b2b-4711-bb15-f2473191df86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e746d3c0de04bea8911b8b5be49dc70, user_id=adc012144d2d4ea391e21d638fd2878c, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:21.294468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a5bf9-8b2b-4711-bb15-f2473191df86 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:21.325515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc0ec8-c193-4c57-808a-465c2d7222ad admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:21.327849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8dcc0ec8-c193-4c57-808a-465c2d7222ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:21.347106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc0ec8-c193-4c57-808a-465c2d7222ad admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:21.358830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f43fe-6b08-4d96-87db-3cd9f4235e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:21.359734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f43fe-6b08-4d96-87db-3cd9f4235e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:21.360025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f43fe-6b08-4d96-87db-3cd9f4235e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:21.360306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f43fe-6b08-4d96-87db-3cd9f4235e08 admin admin] PATH_INFO: `/v3/users/c158610b12db4133b79403d30a1381bf` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:21.362013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f43fe-6b08-4d96-87db-3cd9f4235e08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c158610b12db4133b79403d30a1381bf)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:21.368905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f43fe-6b08-4d96-87db-3cd9f4235e08 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:21.389536 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3424/6826] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:46:21 2022] PUT /identity/v3/projects/0e746d3c0de04bea8911b8b5be49dc70/users/adc012144d2d4ea391e21d638fd2878c/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:46:21.393384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a5bf9-8b2b-4711-bb15-f2473191df86 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:21.471340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a5bf9-8b2b-4711-bb15-f2473191df86 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:21.481950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f2f78-88f6-455d-8750-7db613f5213e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:21.483512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f2f78-88f6-455d-8750-7db613f5213e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:21.484011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f2f78-88f6-455d-8750-7db613f5213e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:21.484454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f2f78-88f6-455d-8750-7db613f5213e admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:21.485601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f2f78-88f6-455d-8750-7db613f5213e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:21.487497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f2f78-88f6-455d-8750-7db613f5213e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:21.501852 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3425/6827] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:46:21.506247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f2f78-88f6-455d-8750-7db613f5213e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:21.517632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f2f78-88f6-455d-8750-7db613f5213e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:21.523353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e142904-37f0-4b9f-a6e5-f0c5aead8fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:21.524513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e142904-37f0-4b9f-a6e5-f0c5aead8fe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:21.525096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e142904-37f0-4b9f-a6e5-f0c5aead8fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:21.525746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e142904-37f0-4b9f-a6e5-f0c5aead8fe6 admin admin] PATH_INFO: `/v3/projects/0e746d3c0de04bea8911b8b5be49dc70/users/adc012144d2d4ea391e21d638fd2878c/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:21.528522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e142904-37f0-4b9f-a6e5-f0c5aead8fe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e746d3c0de04bea8911b8b5be49dc70, user_id=adc012144d2d4ea391e21d638fd2878c, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:21.533639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e142904-37f0-4b9f-a6e5-f0c5aead8fe6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:21.556850 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3426/6828] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:46:21 2022] PUT /identity/v3/projects/0e746d3c0de04bea8911b8b5be49dc70/users/adc012144d2d4ea391e21d638fd2878c/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:46:21.611058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-596f43fe-6b08-4d96-87db-3cd9f4235e08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c158610b12db4133b79403d30a1381bf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:21.632032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-596f43fe-6b08-4d96-87db-3cd9f4235e08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c158610b12db4133b79403d30a1381bf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:21.632836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-596f43fe-6b08-4d96-87db-3cd9f4235e08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c158610b12db4133b79403d30a1381bf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:21.641878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-596f43fe-6b08-4d96-87db-3cd9f4235e08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c158610b12db4133b79403d30a1381bf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:21.743919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-596f43fe-6b08-4d96-87db-3cd9f4235e08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c158610b12db4133b79403d30a1381bf'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:21.751469 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3403/6829] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:46:21 2022] DELETE /identity/v3/users/c158610b12db4133b79403d30a1381bf => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:46:22.122837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e142904-37f0-4b9f-a6e5-f0c5aead8fe6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:22.126397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7e142904-37f0-4b9f-a6e5-f0c5aead8fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:22.224154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e142904-37f0-4b9f-a6e5-f0c5aead8fe6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:22.317428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54ec21-1c6f-473e-9434-7003a1697beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:22.318400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54ec21-1c6f-473e-9434-7003a1697beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:22.318692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54ec21-1c6f-473e-9434-7003a1697beb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:22.318978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54ec21-1c6f-473e-9434-7003a1697beb admin admin] PATH_INFO: `/v3/projects/5c9766e517ac48c3a053e35e300d65e9` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:22.321511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54ec21-1c6f-473e-9434-7003a1697beb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c9766e517ac48c3a053e35e300d65e9)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:22.323784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54ec21-1c6f-473e-9434-7003a1697beb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:22.465551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6f54ec21-1c6f-473e-9434-7003a1697beb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c9766e517ac48c3a053e35e300d65e9', 'request_id': 'req-6f54ec21-1c6f-473e-9434-7003a1697beb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:22.585161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6f54ec21-1c6f-473e-9434-7003a1697beb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c9766e517ac48c3a053e35e300d65e9', 'request_id': 'req-6f54ec21-1c6f-473e-9434-7003a1697beb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:22.590483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6f54ec21-1c6f-473e-9434-7003a1697beb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c9766e517ac48c3a053e35e300d65e9', 'request_id': 'req-6f54ec21-1c6f-473e-9434-7003a1697beb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:22.603587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6f54ec21-1c6f-473e-9434-7003a1697beb admin admin] The token cache is being invalidate because project 5c9766e517ac48c3a053e35e300d65e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:46:22.603587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6f54ec21-1c6f-473e-9434-7003a1697beb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:22.603901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6f54ec21-1c6f-473e-9434-7003a1697beb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:22.605527 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3427/6830] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:46:22 2022] DELETE /identity/v3/projects/5c9766e517ac48c3a053e35e300d65e9 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:46:22.612968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38138c3-927c-4535-acda-39c29928e325 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:22.623470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38138c3-927c-4535-acda-39c29928e325 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:22.623470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38138c3-927c-4535-acda-39c29928e325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:22.634270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b38138c3-927c-4535-acda-39c29928e325 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:46:22.635604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b38138c3-927c-4535-acda-39c29928e325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:22.720523 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3404/6831] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:46:22.721501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b2f71-44b6-451d-bdbb-36d1f8c6ee84 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:22.721997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b2f71-44b6-451d-bdbb-36d1f8c6ee84 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:22.722453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b2f71-44b6-451d-bdbb-36d1f8c6ee84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:22.766006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4f6b2f71-44b6-451d-bdbb-36d1f8c6ee84 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:46:22.773803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4f6b2f71-44b6-451d-bdbb-36d1f8c6ee84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:22.792006 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3428/6832] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:46:22.796185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38138c3-927c-4535-acda-39c29928e325 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:22.816644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38138c3-927c-4535-acda-39c29928e325 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:22.827825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681446f-453d-442a-a966-2e16809ad527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:22.828435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681446f-453d-442a-a966-2e16809ad527 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:22.828788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681446f-453d-442a-a966-2e16809ad527 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:22.829071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681446f-453d-442a-a966-2e16809ad527 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:22.829808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681446f-453d-442a-a966-2e16809ad527 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:46:22.830125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681446f-453d-442a-a966-2e16809ad527 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:22.831765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681446f-453d-442a-a966-2e16809ad527 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:22.873143 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3405/6833] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:46:22.883761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b2f71-44b6-451d-bdbb-36d1f8c6ee84 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:22.906312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b2f71-44b6-451d-bdbb-36d1f8c6ee84 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:22.917069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988aefe-e4b7-4b8e-9f65-e6fbd783a0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:22.922299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988aefe-e4b7-4b8e-9f65-e6fbd783a0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:22.922299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988aefe-e4b7-4b8e-9f65-e6fbd783a0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:22.923713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988aefe-e4b7-4b8e-9f65-e6fbd783a0c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:22.924342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988aefe-e4b7-4b8e-9f65-e6fbd783a0c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:22.926336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988aefe-e4b7-4b8e-9f65-e6fbd783a0c5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:23.100378 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3429/6834] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:46:22 2022] POST /identity/v3/projects => generated 373 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:46:23.102202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681446f-453d-442a-a966-2e16809ad527 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:23.157119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681446f-453d-442a-a966-2e16809ad527 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:23.182763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aba994-0289-49c0-a563-a3ee9d42dae0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:23.183354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aba994-0289-49c0-a563-a3ee9d42dae0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:23.183354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aba994-0289-49c0-a563-a3ee9d42dae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:23.227367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-74aba994-0289-49c0-a563-a3ee9d42dae0 None None] MFA Rules not processed for user `1e60d246f1ea48bf884ef8fb32d2511c`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:46:23.228634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-74aba994-0289-49c0-a563-a3ee9d42dae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:23.313395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc207a-3bb5-4cb0-b179-d857d5c0f221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:23.314446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc207a-3bb5-4cb0-b179-d857d5c0f221 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:23.314984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc207a-3bb5-4cb0-b179-d857d5c0f221 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:23.315482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc207a-3bb5-4cb0-b179-d857d5c0f221 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:23.316583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc207a-3bb5-4cb0-b179-d857d5c0f221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:23.320247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc207a-3bb5-4cb0-b179-d857d5c0f221 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:23.362361 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3430/6835] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:46:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:46:23.459011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aba994-0289-49c0-a563-a3ee9d42dae0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:23.459833 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3406/6836] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:46:23 2022] POST /identity/v3/users => generated 287 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:46:23.473948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aba994-0289-49c0-a563-a3ee9d42dae0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:23.495644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9024e-54a6-4d4a-be7c-cb2527d749ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:23.496750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9024e-54a6-4d4a-be7c-cb2527d749ed admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:23.497254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9024e-54a6-4d4a-be7c-cb2527d749ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:23.508411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9024e-54a6-4d4a-be7c-cb2527d749ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:23.514904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9024e-54a6-4d4a-be7c-cb2527d749ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:23.514904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9024e-54a6-4d4a-be7c-cb2527d749ed admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:23.523269 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3431/6837] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:46:23.527220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc207a-3bb5-4cb0-b179-d857d5c0f221 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:23.544455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc207a-3bb5-4cb0-b179-d857d5c0f221 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:23.551611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f2532-0fbe-4ed3-9043-1b42dba33570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:23.552782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f2532-0fbe-4ed3-9043-1b42dba33570 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:23.553214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f2532-0fbe-4ed3-9043-1b42dba33570 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:23.553551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f2532-0fbe-4ed3-9043-1b42dba33570 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:23.554297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f2532-0fbe-4ed3-9043-1b42dba33570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:23.556488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f2532-0fbe-4ed3-9043-1b42dba33570 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:23.570663 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3407/6838] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:46:23.575844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9024e-54a6-4d4a-be7c-cb2527d749ed admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:23.607277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9024e-54a6-4d4a-be7c-cb2527d749ed admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:23.622202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560d06e-48da-4886-a410-941df98fa197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:23.631495 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560d06e-48da-4886-a410-941df98fa197 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:23.631495 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560d06e-48da-4886-a410-941df98fa197 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:23.631495 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560d06e-48da-4886-a410-941df98fa197 admin admin] PATH_INFO: `/v3/projects/79118199b95541a78984876b0ddee799/users/269b81dfa59a48628383cab30e0f5fd1/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:23.643750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560d06e-48da-4886-a410-941df98fa197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79118199b95541a78984876b0ddee799, user_id=269b81dfa59a48628383cab30e0f5fd1, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:23.646976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560d06e-48da-4886-a410-941df98fa197 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:23.748032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f2532-0fbe-4ed3-9043-1b42dba33570 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:23.751364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ef6f2532-0fbe-4ed3-9043-1b42dba33570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:23.808696 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3432/6839] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:46:23 2022] PUT /identity/v3/projects/79118199b95541a78984876b0ddee799/users/269b81dfa59a48628383cab30e0f5fd1/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:46:23.814467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dce6f-7fdf-418b-97be-813da8896947 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:23.814772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dce6f-7fdf-418b-97be-813da8896947 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:23.815195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dce6f-7fdf-418b-97be-813da8896947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:23.830462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f2532-0fbe-4ed3-9043-1b42dba33570 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:23.833409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-dd5dce6f-7fdf-418b-97be-813da8896947 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:46:23.834801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dd5dce6f-7fdf-418b-97be-813da8896947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:23.887818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e58fa-f187-40d6-8273-64457056973d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:23.888724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e58fa-f187-40d6-8273-64457056973d service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:23.889331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e58fa-f187-40d6-8273-64457056973d service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:23.889745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e58fa-f187-40d6-8273-64457056973d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:23.891995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a15e58fa-f187-40d6-8273-64457056973d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:23.903791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e58fa-f187-40d6-8273-64457056973d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:23.906120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e58fa-f187-40d6-8273-64457056973d service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:23.922045 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3408/6840] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:46:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:46:23.925875 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3433/6841] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:46:23.936229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e58fa-f187-40d6-8273-64457056973d service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:23.938101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a15e58fa-f187-40d6-8273-64457056973d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:23.952452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e58fa-f187-40d6-8273-64457056973d service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:23.957267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983aa36d-cc06-4e90-a590-4c644fc52110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:23.958199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983aa36d-cc06-4e90-a590-4c644fc52110 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:23.958692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983aa36d-cc06-4e90-a590-4c644fc52110 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:23.959264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983aa36d-cc06-4e90-a590-4c644fc52110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:23.972497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983aa36d-cc06-4e90-a590-4c644fc52110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:23.974279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983aa36d-cc06-4e90-a590-4c644fc52110 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:23.986926 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3409/6842] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:46:26.419986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1c834-bf83-4df6-a6a7-6d2016670df1 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:26.419986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1c834-bf83-4df6-a6a7-6d2016670df1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:26.419986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1c834-bf83-4df6-a6a7-6d2016670df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:26.474992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1cd1c834-bf83-4df6-a6a7-6d2016670df1 None None] MFA Rules not processed for user `269b81dfa59a48628383cab30e0f5fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:46:26.489997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1cd1c834-bf83-4df6-a6a7-6d2016670df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:26.626355 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3434/6843] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:46:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:46:26.637319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144433ef-773b-44cd-b5cf-bbc16b14f0d3 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:26.637854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144433ef-773b-44cd-b5cf-bbc16b14f0d3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:26.638205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144433ef-773b-44cd-b5cf-bbc16b14f0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:26.667205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-144433ef-773b-44cd-b5cf-bbc16b14f0d3 None None] MFA Rules not processed for user `269b81dfa59a48628383cab30e0f5fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:46:26.668638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-144433ef-773b-44cd-b5cf-bbc16b14f0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:26.675969 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3410/6844] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:46:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:46:26.687801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1c834-bf83-4df6-a6a7-6d2016670df1 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:26.689432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1cd1c834-bf83-4df6-a6a7-6d2016670df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:26.868945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1c834-bf83-4df6-a6a7-6d2016670df1 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:26.900357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae538cb-9351-4f05-b574-f0efbffe16c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:26.901835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae538cb-9351-4f05-b574-f0efbffe16c9 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:26.905376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae538cb-9351-4f05-b574-f0efbffe16c9 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:26.905796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae538cb-9351-4f05-b574-f0efbffe16c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:26.946213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae538cb-9351-4f05-b574-f0efbffe16c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:26.951178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae538cb-9351-4f05-b574-f0efbffe16c9 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:26.989867 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3435/6845] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:46:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:46:32.285034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655ffd5-e3e8-4276-a805-ddd114f782ea None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:32.285034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655ffd5-e3e8-4276-a805-ddd114f782ea None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:32.285034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655ffd5-e3e8-4276-a805-ddd114f782ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:32.335728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-1655ffd5-e3e8-4276-a805-ddd114f782ea None None] MFA Rules not processed for user `adc012144d2d4ea391e21d638fd2878c`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:46:32.337153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1655ffd5-e3e8-4276-a805-ddd114f782ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:32.440873 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3411/6846] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:46:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:46:32.458196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae538cb-9351-4f05-b574-f0efbffe16c9 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:32.481801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae538cb-9351-4f05-b574-f0efbffe16c9 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:32.490255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a2e4f-44b5-4056-9b52-09ceaf57d302 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:32.490794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a2e4f-44b5-4056-9b52-09ceaf57d302 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:32.491099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a2e4f-44b5-4056-9b52-09ceaf57d302 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:32.491414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a2e4f-44b5-4056-9b52-09ceaf57d302 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:32.504714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a2e4f-44b5-4056-9b52-09ceaf57d302 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:32.506635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a2e4f-44b5-4056-9b52-09ceaf57d302 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:32.522934 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3436/6847] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:46:32 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:46:32.614905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11763e16-40f1-4aa7-a963-e87e8ffb32e1 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:32.615491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11763e16-40f1-4aa7-a963-e87e8ffb32e1 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:32.615942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11763e16-40f1-4aa7-a963-e87e8ffb32e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:32.638462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-11763e16-40f1-4aa7-a963-e87e8ffb32e1 None None] MFA Rules not processed for user `ec43147c4e93496eb9d54486b312f08f`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:46:32.639911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-11763e16-40f1-4aa7-a963-e87e8ffb32e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:32.818629 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3412/6848] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:46:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:46:37.169521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e9697-cfb7-4568-ab28-9a0244cfc860 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:37.170481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e9697-cfb7-4568-ab28-9a0244cfc860 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:37.171444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e9697-cfb7-4568-ab28-9a0244cfc860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:37.192622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ec8e9697-cfb7-4568-ab28-9a0244cfc860 None None] MFA Rules not processed for user `1326669005334b5095c1dc40a52720b5`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:46:37.194858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ec8e9697-cfb7-4568-ab28-9a0244cfc860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:37.328172 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3437/6849] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:46:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:46:40.886344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11763e16-40f1-4aa7-a963-e87e8ffb32e1 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:40.887833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-11763e16-40f1-4aa7-a963-e87e8ffb32e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:40.911949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11763e16-40f1-4aa7-a963-e87e8ffb32e1 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:40.918048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c0a2c-d8d9-4bca-86ee-13166ca139ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:40.919146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c0a2c-d8d9-4bca-86ee-13166ca139ba service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:40.920180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c0a2c-d8d9-4bca-86ee-13166ca139ba service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:40.921131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c0a2c-d8d9-4bca-86ee-13166ca139ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:40.923163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-911c0a2c-d8d9-4bca-86ee-13166ca139ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:40.942809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c0a2c-d8d9-4bca-86ee-13166ca139ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:40.942809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c0a2c-d8d9-4bca-86ee-13166ca139ba service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:40.957933 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3413/6850] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:46:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:46:50.091669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822a2c3-566f-4ef0-a233-d9178a8661bd None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:50.092832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822a2c3-566f-4ef0-a233-d9178a8661bd None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:50.093331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822a2c3-566f-4ef0-a233-d9178a8661bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:50.117661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a822a2c3-566f-4ef0-a233-d9178a8661bd None None] MFA Rules not processed for user `ec43147c4e93496eb9d54486b312f08f`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:46:50.119331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a822a2c3-566f-4ef0-a233-d9178a8661bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:50.132855 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3438/6851] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:46:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:46:50.957960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c0a2c-d8d9-4bca-86ee-13166ca139ba service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:50.984052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c0a2c-d8d9-4bca-86ee-13166ca139ba service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:50.990170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24309013-e996-4896-990e-70db79db47d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:50.991082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24309013-e996-4896-990e-70db79db47d2 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:50.991372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24309013-e996-4896-990e-70db79db47d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:50.991656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24309013-e996-4896-990e-70db79db47d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:50.994052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-24309013-e996-4896-990e-70db79db47d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:51.011197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24309013-e996-4896-990e-70db79db47d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:51.012954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24309013-e996-4896-990e-70db79db47d2 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:51.033800 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3414/6852] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:46:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:46:54.213014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201369e-1f80-401f-9fdc-bc033c62a644 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:54.214729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201369e-1f80-401f-9fdc-bc033c62a644 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:54.215243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201369e-1f80-401f-9fdc-bc033c62a644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:54.257582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-7201369e-1f80-401f-9fdc-bc033c62a644 None None] MFA Rules not processed for user `1e60d246f1ea48bf884ef8fb32d2511c`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:46:54.259533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7201369e-1f80-401f-9fdc-bc033c62a644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:54.327780 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3439/6853] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:46:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:46:56.101262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24309013-e996-4896-990e-70db79db47d2 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:56.121109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24309013-e996-4896-990e-70db79db47d2 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:56.139178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ca504-052b-4e6f-90e1-5d6879a28e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:56.139178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ca504-052b-4e6f-90e1-5d6879a28e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:56.139178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ca504-052b-4e6f-90e1-5d6879a28e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:56.139178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ca504-052b-4e6f-90e1-5d6879a28e08 admin admin] PATH_INFO: `/v3/users/269b81dfa59a48628383cab30e0f5fd1` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:56.139837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ca504-052b-4e6f-90e1-5d6879a28e08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=269b81dfa59a48628383cab30e0f5fd1)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:56.142047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ca504-052b-4e6f-90e1-5d6879a28e08 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:56.410517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cc8ca504-052b-4e6f-90e1-5d6879a28e08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '269b81dfa59a48628383cab30e0f5fd1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:56.442743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cc8ca504-052b-4e6f-90e1-5d6879a28e08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '269b81dfa59a48628383cab30e0f5fd1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:56.443623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cc8ca504-052b-4e6f-90e1-5d6879a28e08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '269b81dfa59a48628383cab30e0f5fd1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:56.451700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cc8ca504-052b-4e6f-90e1-5d6879a28e08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '269b81dfa59a48628383cab30e0f5fd1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:56.515715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cc8ca504-052b-4e6f-90e1-5d6879a28e08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '269b81dfa59a48628383cab30e0f5fd1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:56.525918 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3415/6854] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:46:56 2022] DELETE /identity/v3/users/269b81dfa59a48628383cab30e0f5fd1 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:46:57.051808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201369e-1f80-401f-9fdc-bc033c62a644 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:57.085061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201369e-1f80-401f-9fdc-bc033c62a644 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:57.221813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764da5f-8112-4f50-b18a-0dfca3f262a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:57.223187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764da5f-8112-4f50-b18a-0dfca3f262a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:57.223738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764da5f-8112-4f50-b18a-0dfca3f262a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:57.224027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764da5f-8112-4f50-b18a-0dfca3f262a1 admin admin] PATH_INFO: `/v3/projects/79118199b95541a78984876b0ddee799` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:57.225529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764da5f-8112-4f50-b18a-0dfca3f262a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79118199b95541a78984876b0ddee799)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:57.227694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764da5f-8112-4f50-b18a-0dfca3f262a1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:57.419520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1764da5f-8112-4f50-b18a-0dfca3f262a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79118199b95541a78984876b0ddee799', 'request_id': 'req-1764da5f-8112-4f50-b18a-0dfca3f262a1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:57.557838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1764da5f-8112-4f50-b18a-0dfca3f262a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79118199b95541a78984876b0ddee799', 'request_id': 'req-1764da5f-8112-4f50-b18a-0dfca3f262a1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:57.578138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1764da5f-8112-4f50-b18a-0dfca3f262a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79118199b95541a78984876b0ddee799', 'request_id': 'req-1764da5f-8112-4f50-b18a-0dfca3f262a1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:57.590884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1764da5f-8112-4f50-b18a-0dfca3f262a1 admin admin] The token cache is being invalidate because project 79118199b95541a78984876b0ddee799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:46:57.593068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1764da5f-8112-4f50-b18a-0dfca3f262a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:57.593068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1764da5f-8112-4f50-b18a-0dfca3f262a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:46:57.595342 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3440/6855] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:46:57 2022] DELETE /identity/v3/projects/79118199b95541a78984876b0ddee799 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:46:57.600506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca2c95-1b54-4b6d-9edb-321806ea1815 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:57.601587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca2c95-1b54-4b6d-9edb-321806ea1815 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:57.602118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca2c95-1b54-4b6d-9edb-321806ea1815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:57.631559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6eca2c95-1b54-4b6d-9edb-321806ea1815 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:46:57.633264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6eca2c95-1b54-4b6d-9edb-321806ea1815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:57.708745 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3416/6856] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:46:57.713745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496664ed-a8d1-4db0-9276-393c991f23c9 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:57.714262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496664ed-a8d1-4db0-9276-393c991f23c9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:57.716834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496664ed-a8d1-4db0-9276-393c991f23c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:57.742424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-496664ed-a8d1-4db0-9276-393c991f23c9 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:46:57.744062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-496664ed-a8d1-4db0-9276-393c991f23c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:57.756916 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3441/6857] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:46:57.758812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca2c95-1b54-4b6d-9edb-321806ea1815 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:57.778975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca2c95-1b54-4b6d-9edb-321806ea1815 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:57.787136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f0a24-a20a-4fd3-8382-30019b18c859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:57.788081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f0a24-a20a-4fd3-8382-30019b18c859 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:57.788539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f0a24-a20a-4fd3-8382-30019b18c859 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:57.788852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f0a24-a20a-4fd3-8382-30019b18c859 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:57.789840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f0a24-a20a-4fd3-8382-30019b18c859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:46:57.790173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f0a24-a20a-4fd3-8382-30019b18c859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:57.792649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f0a24-a20a-4fd3-8382-30019b18c859 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:57.809991 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3417/6858] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:46:57.811215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496664ed-a8d1-4db0-9276-393c991f23c9 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:57.827100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496664ed-a8d1-4db0-9276-393c991f23c9 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:57.834998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7477fb5-92f1-4476-86e6-e025f29ee2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:57.835689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7477fb5-92f1-4476-86e6-e025f29ee2ec admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:57.838955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7477fb5-92f1-4476-86e6-e025f29ee2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:57.848744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7477fb5-92f1-4476-86e6-e025f29ee2ec admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:57.849921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7477fb5-92f1-4476-86e6-e025f29ee2ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:57.852194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7477fb5-92f1-4476-86e6-e025f29ee2ec admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:57.984382 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3442/6859] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:46:57 2022] POST /identity/v3/projects => generated 389 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:46:57.986290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f0a24-a20a-4fd3-8382-30019b18c859 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:57.996781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f0a24-a20a-4fd3-8382-30019b18c859 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:58.085380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d393c-c22a-4023-a0f6-32274aad0d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:58.086348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d393c-c22a-4023-a0f6-32274aad0d9e admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:58.086720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d393c-c22a-4023-a0f6-32274aad0d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:58.087071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d393c-c22a-4023-a0f6-32274aad0d9e admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:58.087935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d393c-c22a-4023-a0f6-32274aad0d9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:58.090079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d393c-c22a-4023-a0f6-32274aad0d9e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:58.237385 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3418/6860] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:46:57 2022] POST /identity/v3/users => generated 295 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:46:58.241562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7477fb5-92f1-4476-86e6-e025f29ee2ec admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:58.266825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7477fb5-92f1-4476-86e6-e025f29ee2ec admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:58.272657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e38e57-f7bb-4787-8989-bf9cabe16b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:58.273426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e38e57-f7bb-4787-8989-bf9cabe16b41 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:58.273815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e38e57-f7bb-4787-8989-bf9cabe16b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:58.274156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e38e57-f7bb-4787-8989-bf9cabe16b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:58.275705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e38e57-f7bb-4787-8989-bf9cabe16b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:58.277670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e38e57-f7bb-4787-8989-bf9cabe16b41 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:58.289076 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3443/6861] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:46:58.292791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d393c-c22a-4023-a0f6-32274aad0d9e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:58.306660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d393c-c22a-4023-a0f6-32274aad0d9e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:58.313814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213660e-68b7-4a7d-8539-919fc81e6d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:58.314010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213660e-68b7-4a7d-8539-919fc81e6d10 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:58.314372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213660e-68b7-4a7d-8539-919fc81e6d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:58.314572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213660e-68b7-4a7d-8539-919fc81e6d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:58.315296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213660e-68b7-4a7d-8539-919fc81e6d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:58.317018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213660e-68b7-4a7d-8539-919fc81e6d10 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:58.335945 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3419/6862] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:46:58.339686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e38e57-f7bb-4787-8989-bf9cabe16b41 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:58.352873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e38e57-f7bb-4787-8989-bf9cabe16b41 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:58.360712 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa7947-2fa1-4556-9bb8-6919888defc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:58.361984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa7947-2fa1-4556-9bb8-6919888defc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:58.362465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa7947-2fa1-4556-9bb8-6919888defc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:58.363659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa7947-2fa1-4556-9bb8-6919888defc8 admin admin] PATH_INFO: `/v3/projects/014235b8daef456e97692382aac97d1e/users/1ca6e4cc7551419a9c5104419cd4b015/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:58.395133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa7947-2fa1-4556-9bb8-6919888defc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=014235b8daef456e97692382aac97d1e, user_id=1ca6e4cc7551419a9c5104419cd4b015, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:58.399146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa7947-2fa1-4556-9bb8-6919888defc8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:58.540417 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3444/6863] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:46:58 2022] PUT /identity/v3/projects/014235b8daef456e97692382aac97d1e/users/1ca6e4cc7551419a9c5104419cd4b015/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:46:58.541984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71c0d7-0415-4efa-a83a-4305b28fc4d5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:58.542292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71c0d7-0415-4efa-a83a-4305b28fc4d5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:58.542578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71c0d7-0415-4efa-a83a-4305b28fc4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:58.570077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ed71c0d7-0415-4efa-a83a-4305b28fc4d5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:46:58.571332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ed71c0d7-0415-4efa-a83a-4305b28fc4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:58.645412 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3420/6864] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:46:58.670680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa7947-2fa1-4556-9bb8-6919888defc8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:46:58.672638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f1aa7947-2fa1-4556-9bb8-6919888defc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:46:58.770732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa7947-2fa1-4556-9bb8-6919888defc8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:46:58.794699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3c500-5776-4732-a09b-1633241df7e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:46:58.799727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3c500-5776-4732-a09b-1633241df7e2 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:46:58.799727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3c500-5776-4732-a09b-1633241df7e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:46:58.799727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3c500-5776-4732-a09b-1633241df7e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:46:58.813670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3c500-5776-4732-a09b-1633241df7e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:46:58.815776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3c500-5776-4732-a09b-1633241df7e2 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:46:58.832913 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3445/6865] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:46:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:47:07.918497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cd89e-44ab-44ce-a853-13fbee91119c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:07.918497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cd89e-44ab-44ce-a853-13fbee91119c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:07.918497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cd89e-44ab-44ce-a853-13fbee91119c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:07.946436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7e9cd89e-44ab-44ce-a853-13fbee91119c None None] MFA Rules not processed for user `1ca6e4cc7551419a9c5104419cd4b015`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:07.947707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7e9cd89e-44ab-44ce-a853-13fbee91119c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:08.036892 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3421/6866] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:47:08.054991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3c500-5776-4732-a09b-1633241df7e2 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:08.067548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-74b3c500-5776-4732-a09b-1633241df7e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:08.201811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3c500-5776-4732-a09b-1633241df7e2 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:08.210718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991cc30-9c9b-4874-a18a-653d32c9b853 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:08.211810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991cc30-9c9b-4874-a18a-653d32c9b853 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:08.212516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991cc30-9c9b-4874-a18a-653d32c9b853 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:08.213254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991cc30-9c9b-4874-a18a-653d32c9b853 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:08.240343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991cc30-9c9b-4874-a18a-653d32c9b853 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:08.242291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991cc30-9c9b-4874-a18a-653d32c9b853 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:08.269049 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3446/6867] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:47:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:47:12.899256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ab3a5-a6f4-47a5-bedd-1a916ba62c9c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:12.900877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ab3a5-a6f4-47a5-bedd-1a916ba62c9c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:12.901362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ab3a5-a6f4-47a5-bedd-1a916ba62c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:12.956009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ae0ab3a5-a6f4-47a5-bedd-1a916ba62c9c None None] MFA Rules not processed for user `1ca6e4cc7551419a9c5104419cd4b015`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:12.956009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ae0ab3a5-a6f4-47a5-bedd-1a916ba62c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:12.993694 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3422/6868] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:47:14.026703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991cc30-9c9b-4874-a18a-653d32c9b853 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:14.030916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a991cc30-9c9b-4874-a18a-653d32c9b853 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:14.045532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991cc30-9c9b-4874-a18a-653d32c9b853 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:14.050342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca5f92-80dd-426f-84d5-7cab2c81d974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:14.051345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca5f92-80dd-426f-84d5-7cab2c81d974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:14.051629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca5f92-80dd-426f-84d5-7cab2c81d974 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:14.051907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca5f92-80dd-426f-84d5-7cab2c81d974 admin admin] PATH_INFO: `/v3/users/7884384594ce4d329206873fc8c346bd` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:14.053130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca5f92-80dd-426f-84d5-7cab2c81d974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7884384594ce4d329206873fc8c346bd)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:14.055174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca5f92-80dd-426f-84d5-7cab2c81d974 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:14.336588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-18ca5f92-80dd-426f-84d5-7cab2c81d974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7884384594ce4d329206873fc8c346bd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:14.357272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-18ca5f92-80dd-426f-84d5-7cab2c81d974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7884384594ce4d329206873fc8c346bd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:14.357272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-18ca5f92-80dd-426f-84d5-7cab2c81d974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7884384594ce4d329206873fc8c346bd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:14.362399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-18ca5f92-80dd-426f-84d5-7cab2c81d974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7884384594ce4d329206873fc8c346bd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:14.434635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-18ca5f92-80dd-426f-84d5-7cab2c81d974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7884384594ce4d329206873fc8c346bd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:14.443618 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3447/6869] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:47:14 2022] DELETE /identity/v3/users/7884384594ce4d329206873fc8c346bd => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:47:14.447873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cc5ee-96c3-4454-953b-12ac1b1a8d49 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:14.448373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cc5ee-96c3-4454-953b-12ac1b1a8d49 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:14.448472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cc5ee-96c3-4454-953b-12ac1b1a8d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:14.466898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-640cc5ee-96c3-4454-953b-12ac1b1a8d49 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:14.468043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-640cc5ee-96c3-4454-953b-12ac1b1a8d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:14.525410 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3423/6870] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:47:14.535656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca5f92-80dd-426f-84d5-7cab2c81d974 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:14.537140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-18ca5f92-80dd-426f-84d5-7cab2c81d974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:14.599127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca5f92-80dd-426f-84d5-7cab2c81d974 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:14.602913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a84021-3597-42fd-a9a4-d48aaf72cf25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:14.603800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a84021-3597-42fd-a9a4-d48aaf72cf25 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:14.604268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a84021-3597-42fd-a9a4-d48aaf72cf25 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:14.604956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a84021-3597-42fd-a9a4-d48aaf72cf25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:14.614726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a84021-3597-42fd-a9a4-d48aaf72cf25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:14.616179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a84021-3597-42fd-a9a4-d48aaf72cf25 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:14.626147 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3448/6871] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:47:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:47:15.320889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cc5ee-96c3-4454-953b-12ac1b1a8d49 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:15.322397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-640cc5ee-96c3-4454-953b-12ac1b1a8d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:15.335844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cc5ee-96c3-4454-953b-12ac1b1a8d49 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:15.341277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e03cb3-b17f-4501-9c1c-9f1473182e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:15.342437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e03cb3-b17f-4501-9c1c-9f1473182e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:15.343158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e03cb3-b17f-4501-9c1c-9f1473182e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:15.343596 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e03cb3-b17f-4501-9c1c-9f1473182e68 admin admin] PATH_INFO: `/v3/projects/c6bfb18208ab47b4873cb564c5d7c24e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:15.345038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e03cb3-b17f-4501-9c1c-9f1473182e68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6bfb18208ab47b4873cb564c5d7c24e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:15.347228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e03cb3-b17f-4501-9c1c-9f1473182e68 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:15.485137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-14e03cb3-b17f-4501-9c1c-9f1473182e68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6bfb18208ab47b4873cb564c5d7c24e', 'request_id': 'req-14e03cb3-b17f-4501-9c1c-9f1473182e68'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:15.495558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-14e03cb3-b17f-4501-9c1c-9f1473182e68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6bfb18208ab47b4873cb564c5d7c24e', 'request_id': 'req-14e03cb3-b17f-4501-9c1c-9f1473182e68'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:15.593651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-14e03cb3-b17f-4501-9c1c-9f1473182e68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6bfb18208ab47b4873cb564c5d7c24e', 'request_id': 'req-14e03cb3-b17f-4501-9c1c-9f1473182e68'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:15.606976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-14e03cb3-b17f-4501-9c1c-9f1473182e68 admin admin] The token cache is being invalidate because project c6bfb18208ab47b4873cb564c5d7c24e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:47:15.607571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-14e03cb3-b17f-4501-9c1c-9f1473182e68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:15.608293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-14e03cb3-b17f-4501-9c1c-9f1473182e68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:15.610239 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3424/6872] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:47:15 2022] DELETE /identity/v3/projects/c6bfb18208ab47b4873cb564c5d7c24e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:47:15.618634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f4ff5-668e-4c8e-bb49-113057d31ee2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:15.619230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f4ff5-668e-4c8e-bb49-113057d31ee2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:15.619230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f4ff5-668e-4c8e-bb49-113057d31ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:15.646715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1e0f4ff5-668e-4c8e-bb49-113057d31ee2 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:15.647938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1e0f4ff5-668e-4c8e-bb49-113057d31ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:15.712859 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3449/6873] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:47:15.721490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5aba9-4351-42ac-bf2f-5a6f6478cc46 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:15.721810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5aba9-4351-42ac-bf2f-5a6f6478cc46 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:15.722096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5aba9-4351-42ac-bf2f-5a6f6478cc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:15.741952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-59f5aba9-4351-42ac-bf2f-5a6f6478cc46 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:15.747040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-59f5aba9-4351-42ac-bf2f-5a6f6478cc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:15.758702 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3425/6874] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:47:15.763174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f4ff5-668e-4c8e-bb49-113057d31ee2 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:15.773563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f4ff5-668e-4c8e-bb49-113057d31ee2 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:15.780981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6c504-00e2-4131-a643-2cc912b30b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:15.781787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6c504-00e2-4131-a643-2cc912b30b70 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:15.782489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6c504-00e2-4131-a643-2cc912b30b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:15.783003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6c504-00e2-4131-a643-2cc912b30b70 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:15.783910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6c504-00e2-4131-a643-2cc912b30b70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:47:15.784401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6c504-00e2-4131-a643-2cc912b30b70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:15.786197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6c504-00e2-4131-a643-2cc912b30b70 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:15.800219 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3450/6875] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:47:15.804946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5aba9-4351-42ac-bf2f-5a6f6478cc46 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:15.824974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5aba9-4351-42ac-bf2f-5a6f6478cc46 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:15.830799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dab305-9ca1-4b03-9608-f2e0dcc3a7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:15.832041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dab305-9ca1-4b03-9608-f2e0dcc3a7be admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:15.832322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dab305-9ca1-4b03-9608-f2e0dcc3a7be admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:15.832628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dab305-9ca1-4b03-9608-f2e0dcc3a7be admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:15.833352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dab305-9ca1-4b03-9608-f2e0dcc3a7be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:15.835453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dab305-9ca1-4b03-9608-f2e0dcc3a7be admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:15.990029 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3426/6876] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:47:15 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:47:15.992279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6c504-00e2-4131-a643-2cc912b30b70 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:16.014954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6c504-00e2-4131-a643-2cc912b30b70 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:16.085806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15a77f-33c4-4524-9044-8021f487a22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:16.086439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15a77f-33c4-4524-9044-8021f487a22f admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:16.086725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15a77f-33c4-4524-9044-8021f487a22f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:16.087003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15a77f-33c4-4524-9044-8021f487a22f admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:16.087709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15a77f-33c4-4524-9044-8021f487a22f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:16.090277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15a77f-33c4-4524-9044-8021f487a22f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:16.227278 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3451/6877] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:47:15 2022] POST /identity/v3/users => generated 287 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:47:16.228468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dab305-9ca1-4b03-9608-f2e0dcc3a7be admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:16.244226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dab305-9ca1-4b03-9608-f2e0dcc3a7be admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:16.250389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288b929-d9f3-4edb-8549-badf7c3b4f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:16.251486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288b929-d9f3-4edb-8549-badf7c3b4f3c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:16.251993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288b929-d9f3-4edb-8549-badf7c3b4f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:16.252519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288b929-d9f3-4edb-8549-badf7c3b4f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:16.254317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288b929-d9f3-4edb-8549-badf7c3b4f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:16.262097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288b929-d9f3-4edb-8549-badf7c3b4f3c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:16.273036 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3427/6878] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:47:16.278822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15a77f-33c4-4524-9044-8021f487a22f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:16.305349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15a77f-33c4-4524-9044-8021f487a22f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:16.310946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239b036-43b9-4186-9c16-cb398da6fed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:16.311866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239b036-43b9-4186-9c16-cb398da6fed5 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:16.312309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239b036-43b9-4186-9c16-cb398da6fed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:16.312921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239b036-43b9-4186-9c16-cb398da6fed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:16.314397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239b036-43b9-4186-9c16-cb398da6fed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:16.316300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239b036-43b9-4186-9c16-cb398da6fed5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:16.344901 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3452/6879] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:47:16.348895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288b929-d9f3-4edb-8549-badf7c3b4f3c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:16.362098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288b929-d9f3-4edb-8549-badf7c3b4f3c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:16.368829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e92a4b-0e8b-4c0c-b859-389b61ffe30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:16.369987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e92a4b-0e8b-4c0c-b859-389b61ffe30b admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:16.372494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e92a4b-0e8b-4c0c-b859-389b61ffe30b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:16.372943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e92a4b-0e8b-4c0c-b859-389b61ffe30b admin admin] PATH_INFO: `/v3/projects/4c40d12cac074c0d9a5ea4f0cab6530f/users/843cc8e832804843866bd0e48f107269/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:16.394575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e92a4b-0e8b-4c0c-b859-389b61ffe30b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c40d12cac074c0d9a5ea4f0cab6530f, user_id=843cc8e832804843866bd0e48f107269, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:16.397724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e92a4b-0e8b-4c0c-b859-389b61ffe30b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:16.584560 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3428/6880] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:47:16 2022] PUT /identity/v3/projects/4c40d12cac074c0d9a5ea4f0cab6530f/users/843cc8e832804843866bd0e48f107269/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:47:16.596506 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9cc43-6438-4506-8d68-8e2b61fb373d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:16.596738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9cc43-6438-4506-8d68-8e2b61fb373d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:16.597055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9cc43-6438-4506-8d68-8e2b61fb373d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:16.646086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b1d9cc43-6438-4506-8d68-8e2b61fb373d None None] MFA Rules not processed for user `843cc8e832804843866bd0e48f107269`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:16.648345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b1d9cc43-6438-4506-8d68-8e2b61fb373d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:16.749377 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3453/6881] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:47:16.759618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e92a4b-0e8b-4c0c-b859-389b61ffe30b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:16.762468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-05e92a4b-0e8b-4c0c-b859-389b61ffe30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:16.828693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e92a4b-0e8b-4c0c-b859-389b61ffe30b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:16.832869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4cc87-fc5b-4911-856d-e580eabe3f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:16.833542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4cc87-fc5b-4911-856d-e580eabe3f38 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:16.833819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4cc87-fc5b-4911-856d-e580eabe3f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:16.834098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4cc87-fc5b-4911-856d-e580eabe3f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:16.845083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4cc87-fc5b-4911-856d-e580eabe3f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:16.865379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4cc87-fc5b-4911-856d-e580eabe3f38 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:16.865379 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3429/6882] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:47:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:47:18.270178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bee4da-ddfb-41a8-b2d0-395f4ea2c5cb None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:18.270704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bee4da-ddfb-41a8-b2d0-395f4ea2c5cb None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:18.270704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bee4da-ddfb-41a8-b2d0-395f4ea2c5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:18.296557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-79bee4da-ddfb-41a8-b2d0-395f4ea2c5cb None None] MFA Rules not processed for user `1e60d246f1ea48bf884ef8fb32d2511c`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:18.297841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-79bee4da-ddfb-41a8-b2d0-395f4ea2c5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:18.379649 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3454/6883] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:47:33.174268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4cc87-fc5b-4911-856d-e580eabe3f38 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:33.177774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8be4cc87-fc5b-4911-856d-e580eabe3f38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:33.265269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4cc87-fc5b-4911-856d-e580eabe3f38 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:33.270853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8ed40-0590-4b9b-94ef-f024161f033b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:33.272057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8ed40-0590-4b9b-94ef-f024161f033b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:33.272362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8ed40-0590-4b9b-94ef-f024161f033b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:33.272846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8ed40-0590-4b9b-94ef-f024161f033b admin admin] PATH_INFO: `/v3/users/ec43147c4e93496eb9d54486b312f08f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:33.274100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8ed40-0590-4b9b-94ef-f024161f033b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec43147c4e93496eb9d54486b312f08f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:33.276046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8ed40-0590-4b9b-94ef-f024161f033b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:33.471268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8be8ed40-0590-4b9b-94ef-f024161f033b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec43147c4e93496eb9d54486b312f08f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:33.484086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8be8ed40-0590-4b9b-94ef-f024161f033b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec43147c4e93496eb9d54486b312f08f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:33.492537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8be8ed40-0590-4b9b-94ef-f024161f033b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec43147c4e93496eb9d54486b312f08f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:33.500476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8be8ed40-0590-4b9b-94ef-f024161f033b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec43147c4e93496eb9d54486b312f08f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:33.790031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8be8ed40-0590-4b9b-94ef-f024161f033b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec43147c4e93496eb9d54486b312f08f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:33.790031 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3430/6884] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:47:33 2022] DELETE /identity/v3/users/ec43147c4e93496eb9d54486b312f08f => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:47:34.347042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bee4da-ddfb-41a8-b2d0-395f4ea2c5cb None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:34.367290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bee4da-ddfb-41a8-b2d0-395f4ea2c5cb None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:34.462146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6544d4-76eb-4052-aaf3-971410af4e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:34.463033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6544d4-76eb-4052-aaf3-971410af4e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:34.463566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6544d4-76eb-4052-aaf3-971410af4e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:34.464622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6544d4-76eb-4052-aaf3-971410af4e22 admin admin] PATH_INFO: `/v3/projects/9bb1182b7372418e9f1952d8066ab81c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:34.465936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6544d4-76eb-4052-aaf3-971410af4e22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb1182b7372418e9f1952d8066ab81c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:34.469187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6544d4-76eb-4052-aaf3-971410af4e22 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:34.609660 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e6544d4-76eb-4052-aaf3-971410af4e22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb1182b7372418e9f1952d8066ab81c', 'request_id': 'req-3e6544d4-76eb-4052-aaf3-971410af4e22'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:34.686802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e6544d4-76eb-4052-aaf3-971410af4e22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb1182b7372418e9f1952d8066ab81c', 'request_id': 'req-3e6544d4-76eb-4052-aaf3-971410af4e22'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:34.695139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e6544d4-76eb-4052-aaf3-971410af4e22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb1182b7372418e9f1952d8066ab81c', 'request_id': 'req-3e6544d4-76eb-4052-aaf3-971410af4e22'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:34.710216 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e6544d4-76eb-4052-aaf3-971410af4e22 admin admin] The token cache is being invalidate because project 9bb1182b7372418e9f1952d8066ab81c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:47:34.710846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e6544d4-76eb-4052-aaf3-971410af4e22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:34.711535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e6544d4-76eb-4052-aaf3-971410af4e22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:34.713425 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3455/6885] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:47:34 2022] DELETE /identity/v3/projects/9bb1182b7372418e9f1952d8066ab81c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:47:34.717535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8ed40-0590-4b9b-94ef-f024161f033b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:34.726792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8be8ed40-0590-4b9b-94ef-f024161f033b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:34.732511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8ed40-0590-4b9b-94ef-f024161f033b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:34.808127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a07df-4eba-4bf4-aece-2c54e8da4d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:34.809064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a07df-4eba-4bf4-aece-2c54e8da4d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:34.809349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a07df-4eba-4bf4-aece-2c54e8da4d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:34.809936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a07df-4eba-4bf4-aece-2c54e8da4d6a admin admin] PATH_INFO: `/v3/users/adc012144d2d4ea391e21d638fd2878c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:34.811193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a07df-4eba-4bf4-aece-2c54e8da4d6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=adc012144d2d4ea391e21d638fd2878c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:34.813194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a07df-4eba-4bf4-aece-2c54e8da4d6a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:35.019400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b11a07df-4eba-4bf4-aece-2c54e8da4d6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adc012144d2d4ea391e21d638fd2878c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:35.042566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b11a07df-4eba-4bf4-aece-2c54e8da4d6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adc012144d2d4ea391e21d638fd2878c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:35.043756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b11a07df-4eba-4bf4-aece-2c54e8da4d6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adc012144d2d4ea391e21d638fd2878c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:35.054678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b11a07df-4eba-4bf4-aece-2c54e8da4d6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adc012144d2d4ea391e21d638fd2878c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:35.212070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b11a07df-4eba-4bf4-aece-2c54e8da4d6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adc012144d2d4ea391e21d638fd2878c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:35.220854 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3431/6886] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:47:34 2022] DELETE /identity/v3/users/adc012144d2d4ea391e21d638fd2878c => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:47:35.871324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6544d4-76eb-4052-aaf3-971410af4e22 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:35.872870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3e6544d4-76eb-4052-aaf3-971410af4e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:35.895026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6544d4-76eb-4052-aaf3-971410af4e22 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:35.968792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc67ce-2988-42d0-a062-d45b05fe8f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:35.969674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc67ce-2988-42d0-a062-d45b05fe8f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:35.969957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc67ce-2988-42d0-a062-d45b05fe8f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:35.970231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc67ce-2988-42d0-a062-d45b05fe8f18 admin admin] PATH_INFO: `/v3/projects/0e746d3c0de04bea8911b8b5be49dc70` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:35.971442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc67ce-2988-42d0-a062-d45b05fe8f18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e746d3c0de04bea8911b8b5be49dc70)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:35.973381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc67ce-2988-42d0-a062-d45b05fe8f18 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:36.116360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-78dc67ce-2988-42d0-a062-d45b05fe8f18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e746d3c0de04bea8911b8b5be49dc70', 'request_id': 'req-78dc67ce-2988-42d0-a062-d45b05fe8f18'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:36.194855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-78dc67ce-2988-42d0-a062-d45b05fe8f18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e746d3c0de04bea8911b8b5be49dc70', 'request_id': 'req-78dc67ce-2988-42d0-a062-d45b05fe8f18'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:36.202122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-78dc67ce-2988-42d0-a062-d45b05fe8f18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e746d3c0de04bea8911b8b5be49dc70', 'request_id': 'req-78dc67ce-2988-42d0-a062-d45b05fe8f18'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:36.212428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-78dc67ce-2988-42d0-a062-d45b05fe8f18 admin admin] The token cache is being invalidate because project 0e746d3c0de04bea8911b8b5be49dc70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:47:36.212747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-78dc67ce-2988-42d0-a062-d45b05fe8f18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:36.213402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-78dc67ce-2988-42d0-a062-d45b05fe8f18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:36.215477 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3456/6887] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:47:35 2022] DELETE /identity/v3/projects/0e746d3c0de04bea8911b8b5be49dc70 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:47:36.220569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d42a6-6316-4759-9ce6-6dc1530420c3 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:36.221627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d42a6-6316-4759-9ce6-6dc1530420c3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:36.221627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d42a6-6316-4759-9ce6-6dc1530420c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:36.240677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4b0d42a6-6316-4759-9ce6-6dc1530420c3 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:36.244699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4b0d42a6-6316-4759-9ce6-6dc1530420c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:36.309794 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3432/6888] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:47:36.311489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c73186-c2ad-4936-8661-954ab5215a83 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:36.311783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c73186-c2ad-4936-8661-954ab5215a83 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:36.312078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c73186-c2ad-4936-8661-954ab5215a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:36.332329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-87c73186-c2ad-4936-8661-954ab5215a83 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:36.333594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-87c73186-c2ad-4936-8661-954ab5215a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:36.344021 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3457/6889] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:47:36.348201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d42a6-6316-4759-9ce6-6dc1530420c3 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:36.359591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d42a6-6316-4759-9ce6-6dc1530420c3 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:36.364556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915ae18-e0cb-4522-ac8a-957313a4b821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:36.371354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915ae18-e0cb-4522-ac8a-957313a4b821 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:36.371879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915ae18-e0cb-4522-ac8a-957313a4b821 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:36.372332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915ae18-e0cb-4522-ac8a-957313a4b821 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:36.373319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915ae18-e0cb-4522-ac8a-957313a4b821 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:47:36.376566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915ae18-e0cb-4522-ac8a-957313a4b821 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:36.376566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915ae18-e0cb-4522-ac8a-957313a4b821 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:36.392990 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3433/6890] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:47:36.394180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c73186-c2ad-4936-8661-954ab5215a83 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:36.405016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c73186-c2ad-4936-8661-954ab5215a83 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:36.410524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f9f7a-1ebf-4b9a-b659-dec564336399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:36.411257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f9f7a-1ebf-4b9a-b659-dec564336399 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:36.411532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f9f7a-1ebf-4b9a-b659-dec564336399 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:36.412014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f9f7a-1ebf-4b9a-b659-dec564336399 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:36.412950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f9f7a-1ebf-4b9a-b659-dec564336399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:36.415073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f9f7a-1ebf-4b9a-b659-dec564336399 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:36.519511 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3458/6891] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:47:36 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:47:36.523724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915ae18-e0cb-4522-ac8a-957313a4b821 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:36.535664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915ae18-e0cb-4522-ac8a-957313a4b821 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:36.595228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245635c-0009-4c40-9ec4-2f796c970b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:36.595931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245635c-0009-4c40-9ec4-2f796c970b47 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:36.596236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245635c-0009-4c40-9ec4-2f796c970b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:36.596563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245635c-0009-4c40-9ec4-2f796c970b47 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:36.597288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245635c-0009-4c40-9ec4-2f796c970b47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:36.599321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245635c-0009-4c40-9ec4-2f796c970b47 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:36.702663 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3434/6892] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:47:36 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:47:36.706960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f9f7a-1ebf-4b9a-b659-dec564336399 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:36.717432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f9f7a-1ebf-4b9a-b659-dec564336399 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:36.722180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d454a47-b7e7-4cb0-9a73-f2ac78018900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:36.722855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d454a47-b7e7-4cb0-9a73-f2ac78018900 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:36.723144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d454a47-b7e7-4cb0-9a73-f2ac78018900 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:36.723426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d454a47-b7e7-4cb0-9a73-f2ac78018900 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:36.724154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d454a47-b7e7-4cb0-9a73-f2ac78018900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:36.725787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d454a47-b7e7-4cb0-9a73-f2ac78018900 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:36.736228 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3459/6893] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:47:36.740648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245635c-0009-4c40-9ec4-2f796c970b47 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:36.751870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245635c-0009-4c40-9ec4-2f796c970b47 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:36.756762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621e6fc-8873-4111-8a14-23e4ab94e3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:36.757435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621e6fc-8873-4111-8a14-23e4ab94e3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:36.757728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621e6fc-8873-4111-8a14-23e4ab94e3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:36.758014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621e6fc-8873-4111-8a14-23e4ab94e3c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:36.758754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621e6fc-8873-4111-8a14-23e4ab94e3c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:36.761523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621e6fc-8873-4111-8a14-23e4ab94e3c8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:36.773074 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3435/6894] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:47:36.777323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d454a47-b7e7-4cb0-9a73-f2ac78018900 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:36.791144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d454a47-b7e7-4cb0-9a73-f2ac78018900 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:36.796913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa5405-821f-4eb4-b951-49fb71a3f64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:36.797484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa5405-821f-4eb4-b951-49fb71a3f64c admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:36.797777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa5405-821f-4eb4-b951-49fb71a3f64c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:36.798065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa5405-821f-4eb4-b951-49fb71a3f64c admin admin] PATH_INFO: `/v3/projects/24a92939abc5401d88f4cdc0f1b109f5/users/bad5953b4fbf4fe2a30a2b4208714631/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:36.819649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa5405-821f-4eb4-b951-49fb71a3f64c admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a92939abc5401d88f4cdc0f1b109f5, user_id=bad5953b4fbf4fe2a30a2b4208714631, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:36.820294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa5405-821f-4eb4-b951-49fb71a3f64c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:36.939895 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3460/6895] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:47:36 2022] PUT /identity/v3/projects/24a92939abc5401d88f4cdc0f1b109f5/users/bad5953b4fbf4fe2a30a2b4208714631/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:47:36.946582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a08d47-27c9-4faf-8328-47458c8a2ab6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:36.946903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a08d47-27c9-4faf-8328-47458c8a2ab6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:36.947187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a08d47-27c9-4faf-8328-47458c8a2ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:36.973777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d8a08d47-27c9-4faf-8328-47458c8a2ab6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:36.975023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d8a08d47-27c9-4faf-8328-47458c8a2ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:37.044502 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3436/6896] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:47:37.054813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa5405-821f-4eb4-b951-49fb71a3f64c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:37.058090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-79fa5405-821f-4eb4-b951-49fb71a3f64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:37.139749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa5405-821f-4eb4-b951-49fb71a3f64c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:37.143700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9394b-c32a-443d-9748-4caa96d066b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:37.144403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9394b-c32a-443d-9748-4caa96d066b8 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:37.144907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9394b-c32a-443d-9748-4caa96d066b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:37.145208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9394b-c32a-443d-9748-4caa96d066b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:37.157165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9394b-c32a-443d-9748-4caa96d066b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:37.160177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9394b-c32a-443d-9748-4caa96d066b8 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:37.172152 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3461/6897] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:47:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:47:41.763497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a08d47-27c9-4faf-8328-47458c8a2ab6 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:41.765553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d8a08d47-27c9-4faf-8328-47458c8a2ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:41.893412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a08d47-27c9-4faf-8328-47458c8a2ab6 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:41.901703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424f59e-12d3-4dc3-8b48-3de1e8f12110 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:41.902627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424f59e-12d3-4dc3-8b48-3de1e8f12110 service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:41.903457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424f59e-12d3-4dc3-8b48-3de1e8f12110 service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:41.903637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424f59e-12d3-4dc3-8b48-3de1e8f12110 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:41.906129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4424f59e-12d3-4dc3-8b48-3de1e8f12110 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:41.928215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424f59e-12d3-4dc3-8b48-3de1e8f12110 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:41.929976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424f59e-12d3-4dc3-8b48-3de1e8f12110 service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:41.951948 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3437/6898] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:47:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:47:43.070178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9394b-c32a-443d-9748-4caa96d066b8 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:43.071710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e1f9394b-c32a-443d-9748-4caa96d066b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:43.087989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9394b-c32a-443d-9748-4caa96d066b8 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:43.093209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ea79b-f1d0-4b5b-b356-5d9c941e5744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:43.094318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ea79b-f1d0-4b5b-b356-5d9c941e5744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:43.094781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ea79b-f1d0-4b5b-b356-5d9c941e5744 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:43.095232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ea79b-f1d0-4b5b-b356-5d9c941e5744 admin admin] PATH_INFO: `/v3/users/843cc8e832804843866bd0e48f107269` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:43.096860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ea79b-f1d0-4b5b-b356-5d9c941e5744 admin admin] RBAC: Authorizing `identity:delete_user(user_id=843cc8e832804843866bd0e48f107269)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:43.099474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ea79b-f1d0-4b5b-b356-5d9c941e5744 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:43.321100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f85ea79b-f1d0-4b5b-b356-5d9c941e5744 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '843cc8e832804843866bd0e48f107269'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:43.334027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f85ea79b-f1d0-4b5b-b356-5d9c941e5744 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '843cc8e832804843866bd0e48f107269'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:43.335631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f85ea79b-f1d0-4b5b-b356-5d9c941e5744 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '843cc8e832804843866bd0e48f107269'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:43.344939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f85ea79b-f1d0-4b5b-b356-5d9c941e5744 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '843cc8e832804843866bd0e48f107269'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:43.400534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f85ea79b-f1d0-4b5b-b356-5d9c941e5744 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '843cc8e832804843866bd0e48f107269'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:43.408085 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3462/6899] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:47:43 2022] DELETE /identity/v3/users/843cc8e832804843866bd0e48f107269 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:47:43.412839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b03a38-2d72-4ad6-a569-96ec44062f71 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:43.413415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b03a38-2d72-4ad6-a569-96ec44062f71 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:43.413523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b03a38-2d72-4ad6-a569-96ec44062f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:43.442058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-50b03a38-2d72-4ad6-a569-96ec44062f71 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:43.443572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-50b03a38-2d72-4ad6-a569-96ec44062f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:43.511691 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3438/6900] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:47:43.522194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ea79b-f1d0-4b5b-b356-5d9c941e5744 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:43.523828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f85ea79b-f1d0-4b5b-b356-5d9c941e5744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:43.607482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ea79b-f1d0-4b5b-b356-5d9c941e5744 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:43.611522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92881140-8e15-462a-99ae-28f827b09159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:43.612192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92881140-8e15-462a-99ae-28f827b09159 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:43.612485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92881140-8e15-462a-99ae-28f827b09159 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:43.612803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92881140-8e15-462a-99ae-28f827b09159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:43.629929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92881140-8e15-462a-99ae-28f827b09159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:43.631752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92881140-8e15-462a-99ae-28f827b09159 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:43.645097 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3463/6901] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:47:44.011196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b03a38-2d72-4ad6-a569-96ec44062f71 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:44.012736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-50b03a38-2d72-4ad6-a569-96ec44062f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:44.123190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b03a38-2d72-4ad6-a569-96ec44062f71 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:44.128982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79461be-03d1-4511-8eed-1ccf90992fcb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:44.129649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79461be-03d1-4511-8eed-1ccf90992fcb service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:44.129934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79461be-03d1-4511-8eed-1ccf90992fcb service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:44.134688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79461be-03d1-4511-8eed-1ccf90992fcb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:44.136881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a79461be-03d1-4511-8eed-1ccf90992fcb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:44.169627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92881140-8e15-462a-99ae-28f827b09159 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:44.176348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-92881140-8e15-462a-99ae-28f827b09159 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:44.176516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79461be-03d1-4511-8eed-1ccf90992fcb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:44.176516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79461be-03d1-4511-8eed-1ccf90992fcb service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:44.189052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92881140-8e15-462a-99ae-28f827b09159 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:44.200248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed025e-882b-48f0-8d37-9478387be57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:44.200248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed025e-882b-48f0-8d37-9478387be57f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:44.201140 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3439/6902] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:47:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:47:44.215690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed025e-882b-48f0-8d37-9478387be57f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:44.216253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed025e-882b-48f0-8d37-9478387be57f admin admin] PATH_INFO: `/v3/projects/4c40d12cac074c0d9a5ea4f0cab6530f` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:44.218133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed025e-882b-48f0-8d37-9478387be57f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c40d12cac074c0d9a5ea4f0cab6530f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:44.222834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed025e-882b-48f0-8d37-9478387be57f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:44.381051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a4ed025e-882b-48f0-8d37-9478387be57f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c40d12cac074c0d9a5ea4f0cab6530f', 'request_id': 'req-a4ed025e-882b-48f0-8d37-9478387be57f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:44.567680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a4ed025e-882b-48f0-8d37-9478387be57f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c40d12cac074c0d9a5ea4f0cab6530f', 'request_id': 'req-a4ed025e-882b-48f0-8d37-9478387be57f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:44.572280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a4ed025e-882b-48f0-8d37-9478387be57f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c40d12cac074c0d9a5ea4f0cab6530f', 'request_id': 'req-a4ed025e-882b-48f0-8d37-9478387be57f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:44.590029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a4ed025e-882b-48f0-8d37-9478387be57f admin admin] The token cache is being invalidate because project 4c40d12cac074c0d9a5ea4f0cab6530f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:47:44.590929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a4ed025e-882b-48f0-8d37-9478387be57f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:44.591578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a4ed025e-882b-48f0-8d37-9478387be57f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:44.594265 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3464/6903] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:47:44 2022] DELETE /identity/v3/projects/4c40d12cac074c0d9a5ea4f0cab6530f => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:47:44.599259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cfaa1-612b-4dc1-beec-e0895d3548d3 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:44.599744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cfaa1-612b-4dc1-beec-e0895d3548d3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:44.599880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cfaa1-612b-4dc1-beec-e0895d3548d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:44.631304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8d7cfaa1-612b-4dc1-beec-e0895d3548d3 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:44.634165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8d7cfaa1-612b-4dc1-beec-e0895d3548d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:44.718934 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3440/6904] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:47:44.727608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf45727-f5b2-4ac7-bdb0-8fa327f412c0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:44.727933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf45727-f5b2-4ac7-bdb0-8fa327f412c0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:44.728221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf45727-f5b2-4ac7-bdb0-8fa327f412c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:44.753544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3bf45727-f5b2-4ac7-bdb0-8fa327f412c0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:44.756856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3bf45727-f5b2-4ac7-bdb0-8fa327f412c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:44.768195 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3465/6905] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:47:44.772846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7cfaa1-612b-4dc1-beec-e0895d3548d3 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:44.792419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7cfaa1-612b-4dc1-beec-e0895d3548d3 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:44.805077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad31a7-88c1-417a-90b1-d2db92855343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:44.805373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad31a7-88c1-417a-90b1-d2db92855343 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:44.805663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad31a7-88c1-417a-90b1-d2db92855343 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:44.805948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad31a7-88c1-417a-90b1-d2db92855343 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:44.806770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad31a7-88c1-417a-90b1-d2db92855343 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:47:44.807685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad31a7-88c1-417a-90b1-d2db92855343 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:44.809845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad31a7-88c1-417a-90b1-d2db92855343 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:44.851365 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3441/6906] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:47:44.852941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf45727-f5b2-4ac7-bdb0-8fa327f412c0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:44.868861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf45727-f5b2-4ac7-bdb0-8fa327f412c0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:44.902040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6aaa9d-e238-4ce1-8853-02edeeb689e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:44.902840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6aaa9d-e238-4ce1-8853-02edeeb689e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:44.908898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6aaa9d-e238-4ce1-8853-02edeeb689e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:44.909255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6aaa9d-e238-4ce1-8853-02edeeb689e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:44.911972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6aaa9d-e238-4ce1-8853-02edeeb689e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:44.921385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6aaa9d-e238-4ce1-8853-02edeeb689e1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:45.073923 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3466/6907] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:47:44 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:47:45.075100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad31a7-88c1-417a-90b1-d2db92855343 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:45.098916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad31a7-88c1-417a-90b1-d2db92855343 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:45.175475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853a9d4-6d48-47b7-bbfc-403e0362b52f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:45.175962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853a9d4-6d48-47b7-bbfc-403e0362b52f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:45.176055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853a9d4-6d48-47b7-bbfc-403e0362b52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:45.197682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520186b-a059-4a63-996f-03130b81e9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:45.197682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520186b-a059-4a63-996f-03130b81e9b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:45.197682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520186b-a059-4a63-996f-03130b81e9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:45.198781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520186b-a059-4a63-996f-03130b81e9b3 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:45.199744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520186b-a059-4a63-996f-03130b81e9b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:45.202609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520186b-a059-4a63-996f-03130b81e9b3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:45.212086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8853a9d4-6d48-47b7-bbfc-403e0362b52f None None] MFA Rules not processed for user `bad5953b4fbf4fe2a30a2b4208714631`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:45.214162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8853a9d4-6d48-47b7-bbfc-403e0362b52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:45.310496 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3442/6908] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:47:45 2022] POST /identity/v3/users => generated 289 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:47:45.315516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520186b-a059-4a63-996f-03130b81e9b3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:45.324650 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3467/6909] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:47:45.328236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520186b-a059-4a63-996f-03130b81e9b3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:45.328740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853a9d4-6d48-47b7-bbfc-403e0362b52f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:45.330117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8853a9d4-6d48-47b7-bbfc-403e0362b52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:45.333540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5c0b5-35d8-4c71-91f6-b7795437f5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:45.334315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5c0b5-35d8-4c71-91f6-b7795437f5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:45.334701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5c0b5-35d8-4c71-91f6-b7795437f5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:45.335131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5c0b5-35d8-4c71-91f6-b7795437f5a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:45.336050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5c0b5-35d8-4c71-91f6-b7795437f5a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:45.337833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5c0b5-35d8-4c71-91f6-b7795437f5a6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:45.350111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853a9d4-6d48-47b7-bbfc-403e0362b52f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:45.351383 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3443/6910] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:47:45.355109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5c0b5-35d8-4c71-91f6-b7795437f5a6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:45.355337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25b47f-8a4f-4d40-a0e2-c68ed69adcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:45.356018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25b47f-8a4f-4d40-a0e2-c68ed69adcdf admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:45.356449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25b47f-8a4f-4d40-a0e2-c68ed69adcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:45.356805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25b47f-8a4f-4d40-a0e2-c68ed69adcdf admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:45.357576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f25b47f-8a4f-4d40-a0e2-c68ed69adcdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:45.360036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f25b47f-8a4f-4d40-a0e2-c68ed69adcdf admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:45.366900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5c0b5-35d8-4c71-91f6-b7795437f5a6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:45.372554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4ec55-3ac6-4ea3-85f4-bb32f9ae0630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:45.373335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4ec55-3ac6-4ea3-85f4-bb32f9ae0630 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:45.373738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4ec55-3ac6-4ea3-85f4-bb32f9ae0630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:45.374537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4ec55-3ac6-4ea3-85f4-bb32f9ae0630 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:45.374992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4ec55-3ac6-4ea3-85f4-bb32f9ae0630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:45.377091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4ec55-3ac6-4ea3-85f4-bb32f9ae0630 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:45.390152 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3444/6911] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:47:45.438843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4ec55-3ac6-4ea3-85f4-bb32f9ae0630 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:45.451252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4ec55-3ac6-4ea3-85f4-bb32f9ae0630 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:45.458011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3e0bc-d60e-400f-a88e-4481c9826fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:45.461993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3e0bc-d60e-400f-a88e-4481c9826fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:45.461993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3e0bc-d60e-400f-a88e-4481c9826fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:45.461993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3e0bc-d60e-400f-a88e-4481c9826fe7 admin admin] PATH_INFO: `/v3/projects/edf468ac018c429abc352f3eaf6bbb7c/users/6652a3df52b24051a4a76deebcf59805/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:45.477862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3e0bc-d60e-400f-a88e-4481c9826fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edf468ac018c429abc352f3eaf6bbb7c, user_id=6652a3df52b24051a4a76deebcf59805, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:45.480855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3e0bc-d60e-400f-a88e-4481c9826fe7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:45.520049 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3468/6912] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:47:45 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:47:45.525042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25b47f-8a4f-4d40-a0e2-c68ed69adcdf admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:45.577614 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3445/6913] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:47:45 2022] PUT /identity/v3/projects/edf468ac018c429abc352f3eaf6bbb7c/users/6652a3df52b24051a4a76deebcf59805/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:47:45.588100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e52650-24cf-4015-9308-ec466bd9d84a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:45.589550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e52650-24cf-4015-9308-ec466bd9d84a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:45.590058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e52650-24cf-4015-9308-ec466bd9d84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:45.649376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-59e52650-24cf-4015-9308-ec466bd9d84a None None] MFA Rules not processed for user `6652a3df52b24051a4a76deebcf59805`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:45.652776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-59e52650-24cf-4015-9308-ec466bd9d84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:45.660289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25b47f-8a4f-4d40-a0e2-c68ed69adcdf admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:45.747679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859981e-35a6-43b7-88f0-67302358d282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:45.748366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859981e-35a6-43b7-88f0-67302358d282 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:45.748728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859981e-35a6-43b7-88f0-67302358d282 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:45.749290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859981e-35a6-43b7-88f0-67302358d282 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:45.750422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859981e-35a6-43b7-88f0-67302358d282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:45.757103 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3446/6914] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:47:45.764739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859981e-35a6-43b7-88f0-67302358d282 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:45.799091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e52650-24cf-4015-9308-ec466bd9d84a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:45.800585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-59e52650-24cf-4015-9308-ec466bd9d84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:45.884413 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3469/6915] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:47:45 2022] POST /identity/v3/users => generated 296 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:47:45.888999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859981e-35a6-43b7-88f0-67302358d282 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:45.909742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859981e-35a6-43b7-88f0-67302358d282 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:45.921952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e52650-24cf-4015-9308-ec466bd9d84a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:45.927031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f326181-ea39-4b3d-8e08-8d8991a1c674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:45.927635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51605a08-09d0-4f1a-8ea0-64e843f25971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:45.928360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f326181-ea39-4b3d-8e08-8d8991a1c674 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:45.928469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51605a08-09d0-4f1a-8ea0-64e843f25971 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:45.928566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f326181-ea39-4b3d-8e08-8d8991a1c674 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:45.928879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51605a08-09d0-4f1a-8ea0-64e843f25971 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:45.929005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f326181-ea39-4b3d-8e08-8d8991a1c674 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:45.929163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51605a08-09d0-4f1a-8ea0-64e843f25971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:45.929749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f326181-ea39-4b3d-8e08-8d8991a1c674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:45.932959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f326181-ea39-4b3d-8e08-8d8991a1c674 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:45.954369 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3470/6916] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:47:45.955344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f326181-ea39-4b3d-8e08-8d8991a1c674 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:45.966713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51605a08-09d0-4f1a-8ea0-64e843f25971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:45.968991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51605a08-09d0-4f1a-8ea0-64e843f25971 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:45.974682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f326181-ea39-4b3d-8e08-8d8991a1c674 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:45.981113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e5505-fba6-4986-8124-6908e6331839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:45.982403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e5505-fba6-4986-8124-6908e6331839 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:45.982823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e5505-fba6-4986-8124-6908e6331839 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:45.983206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e5505-fba6-4986-8124-6908e6331839 admin admin] PATH_INFO: `/v3/projects/93dbad165604400cb3b3bfb2cc90529a/users/fbe9eb56384842fc94e28404714e66ca/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:45.995840 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3447/6917] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:47:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:47:46.002244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e5505-fba6-4986-8124-6908e6331839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93dbad165604400cb3b3bfb2cc90529a, user_id=fbe9eb56384842fc94e28404714e66ca, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:46.005387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e5505-fba6-4986-8124-6908e6331839 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:46.043711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51605a08-09d0-4f1a-8ea0-64e843f25971 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:46.055309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51605a08-09d0-4f1a-8ea0-64e843f25971 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:46.061043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4780f8-4c27-44f8-a545-0c76afcf999e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:46.062056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4780f8-4c27-44f8-a545-0c76afcf999e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:46.062475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4780f8-4c27-44f8-a545-0c76afcf999e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:46.062997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4780f8-4c27-44f8-a545-0c76afcf999e admin admin] PATH_INFO: `/v3/users/6652a3df52b24051a4a76deebcf59805` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:46.064445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4780f8-4c27-44f8-a545-0c76afcf999e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6652a3df52b24051a4a76deebcf59805)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:46.066604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4780f8-4c27-44f8-a545-0c76afcf999e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:46.145035 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3471/6918] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:47:45 2022] PUT /identity/v3/projects/93dbad165604400cb3b3bfb2cc90529a/users/fbe9eb56384842fc94e28404714e66ca/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:47:46.149344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e5505-fba6-4986-8124-6908e6331839 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:46.237421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e5505-fba6-4986-8124-6908e6331839 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:46.249405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d07791-5f37-4f6e-8a53-a0488027d1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:46.250356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d07791-5f37-4f6e-8a53-a0488027d1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:46.251341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d07791-5f37-4f6e-8a53-a0488027d1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:46.251341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d07791-5f37-4f6e-8a53-a0488027d1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:46.252190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d07791-5f37-4f6e-8a53-a0488027d1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:46.256561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d07791-5f37-4f6e-8a53-a0488027d1d0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:46.272133 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3472/6919] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:47:46.304463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d07791-5f37-4f6e-8a53-a0488027d1d0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:46.316882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d07791-5f37-4f6e-8a53-a0488027d1d0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:46.323838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae33c9-f6a5-420b-ab12-98eda77b1623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:46.325818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae33c9-f6a5-420b-ab12-98eda77b1623 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:46.326286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae33c9-f6a5-420b-ab12-98eda77b1623 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:46.326729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae33c9-f6a5-420b-ab12-98eda77b1623 admin admin] PATH_INFO: `/v3/projects/93dbad165604400cb3b3bfb2cc90529a/users/fbe9eb56384842fc94e28404714e66ca/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:46.329276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae33c9-f6a5-420b-ab12-98eda77b1623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93dbad165604400cb3b3bfb2cc90529a, user_id=fbe9eb56384842fc94e28404714e66ca, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:46.332733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae33c9-f6a5-420b-ab12-98eda77b1623 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:46.351346 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3473/6920] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:47:46 2022] PUT /identity/v3/projects/93dbad165604400cb3b3bfb2cc90529a/users/fbe9eb56384842fc94e28404714e66ca/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:47:46.353005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189134d-1407-41bd-b454-9b70331ca631 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:46.353405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189134d-1407-41bd-b454-9b70331ca631 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:46.353911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189134d-1407-41bd-b454-9b70331ca631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:46.401833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f189134d-1407-41bd-b454-9b70331ca631 None None] MFA Rules not processed for user `f58c631280fb4cdb917abc34660e3325`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:46.403883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f189134d-1407-41bd-b454-9b70331ca631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:46.423357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8b4780f8-4c27-44f8-a545-0c76afcf999e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6652a3df52b24051a4a76deebcf59805'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:46.470028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8b4780f8-4c27-44f8-a545-0c76afcf999e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6652a3df52b24051a4a76deebcf59805'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:46.473084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8b4780f8-4c27-44f8-a545-0c76afcf999e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6652a3df52b24051a4a76deebcf59805'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:46.488948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8b4780f8-4c27-44f8-a545-0c76afcf999e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6652a3df52b24051a4a76deebcf59805'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:46.503378 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3474/6921] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:47:46.558974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8b4780f8-4c27-44f8-a545-0c76afcf999e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6652a3df52b24051a4a76deebcf59805'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:46.567443 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3448/6922] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:47:46 2022] DELETE /identity/v3/users/6652a3df52b24051a4a76deebcf59805 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:47:46.573312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb516ea6-b0cc-4dcc-8f93-c10255a599fa None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:46.573615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb516ea6-b0cc-4dcc-8f93-c10255a599fa None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:46.573902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb516ea6-b0cc-4dcc-8f93-c10255a599fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:46.601706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-cb516ea6-b0cc-4dcc-8f93-c10255a599fa None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:46.603019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-cb516ea6-b0cc-4dcc-8f93-c10255a599fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:46.690347 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3475/6923] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:47:46.721829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4780f8-4c27-44f8-a545-0c76afcf999e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:46.724150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8b4780f8-4c27-44f8-a545-0c76afcf999e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:46.813789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4780f8-4c27-44f8-a545-0c76afcf999e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:46.823466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb01fb-b2c2-4e81-a69a-d17ea818df9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:46.835125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb01fb-b2c2-4e81-a69a-d17ea818df9c service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:46.835777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb01fb-b2c2-4e81-a69a-d17ea818df9c service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:46.836280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb01fb-b2c2-4e81-a69a-d17ea818df9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:46.866198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb01fb-b2c2-4e81-a69a-d17ea818df9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:46.868660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb01fb-b2c2-4e81-a69a-d17ea818df9c service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:46.898907 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3449/6924] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:47:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:47:48.179281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb516ea6-b0cc-4dcc-8f93-c10255a599fa None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:48.181946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-cb516ea6-b0cc-4dcc-8f93-c10255a599fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:48.211809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb516ea6-b0cc-4dcc-8f93-c10255a599fa None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:48.223566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe82b20-ece4-4428-92ea-4c7b1d95ee8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:48.224689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe82b20-ece4-4428-92ea-4c7b1d95ee8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:48.225069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe82b20-ece4-4428-92ea-4c7b1d95ee8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:48.225457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe82b20-ece4-4428-92ea-4c7b1d95ee8c admin admin] PATH_INFO: `/v3/projects/edf468ac018c429abc352f3eaf6bbb7c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:48.226941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe82b20-ece4-4428-92ea-4c7b1d95ee8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=edf468ac018c429abc352f3eaf6bbb7c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:48.229899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe82b20-ece4-4428-92ea-4c7b1d95ee8c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:48.385992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ffe82b20-ece4-4428-92ea-4c7b1d95ee8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edf468ac018c429abc352f3eaf6bbb7c', 'request_id': 'req-ffe82b20-ece4-4428-92ea-4c7b1d95ee8c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:48.475054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ffe82b20-ece4-4428-92ea-4c7b1d95ee8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edf468ac018c429abc352f3eaf6bbb7c', 'request_id': 'req-ffe82b20-ece4-4428-92ea-4c7b1d95ee8c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:48.495061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ffe82b20-ece4-4428-92ea-4c7b1d95ee8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edf468ac018c429abc352f3eaf6bbb7c', 'request_id': 'req-ffe82b20-ece4-4428-92ea-4c7b1d95ee8c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:48.525420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ffe82b20-ece4-4428-92ea-4c7b1d95ee8c admin admin] The token cache is being invalidate because project edf468ac018c429abc352f3eaf6bbb7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:47:48.525745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ffe82b20-ece4-4428-92ea-4c7b1d95ee8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:48.529565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ffe82b20-ece4-4428-92ea-4c7b1d95ee8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:48.538194 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3476/6925] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:47:48 2022] DELETE /identity/v3/projects/edf468ac018c429abc352f3eaf6bbb7c => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:47:48.542704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455675f2-d22e-4949-b274-1a496064aaca None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:48.543208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455675f2-d22e-4949-b274-1a496064aaca None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:48.543322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455675f2-d22e-4949-b274-1a496064aaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:48.589011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-455675f2-d22e-4949-b274-1a496064aaca None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:48.594876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-455675f2-d22e-4949-b274-1a496064aaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:48.776193 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3450/6926] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:47:48.783917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a171346-4323-4b81-973f-14d10a2ef18b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:48.784219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a171346-4323-4b81-973f-14d10a2ef18b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:48.784504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a171346-4323-4b81-973f-14d10a2ef18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:48.815170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6a171346-4323-4b81-973f-14d10a2ef18b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:48.816705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6a171346-4323-4b81-973f-14d10a2ef18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:48.829262 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3477/6927] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:47:48.830673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455675f2-d22e-4949-b274-1a496064aaca None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:48.842375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455675f2-d22e-4949-b274-1a496064aaca None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:48.854638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8057ec6-e49c-4ae0-ab30-33211d6a25df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:48.857230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8057ec6-e49c-4ae0-ab30-33211d6a25df admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:48.857765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8057ec6-e49c-4ae0-ab30-33211d6a25df admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:48.859817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8057ec6-e49c-4ae0-ab30-33211d6a25df admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:48.860845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8057ec6-e49c-4ae0-ab30-33211d6a25df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:47:48.863972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8057ec6-e49c-4ae0-ab30-33211d6a25df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:48.866187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8057ec6-e49c-4ae0-ab30-33211d6a25df admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:48.886178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a171346-4323-4b81-973f-14d10a2ef18b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:48.893377 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3451/6928] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:47:48.898906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a171346-4323-4b81-973f-14d10a2ef18b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:48.904401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b2168-343d-457e-b836-79203778f104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:48.905730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b2168-343d-457e-b836-79203778f104 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:48.905730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b2168-343d-457e-b836-79203778f104 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:48.906150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b2168-343d-457e-b836-79203778f104 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:48.906912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b2168-343d-457e-b836-79203778f104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:48.909725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b2168-343d-457e-b836-79203778f104 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:49.007993 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3478/6929] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:47:48 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:47:49.012912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8057ec6-e49c-4ae0-ab30-33211d6a25df admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:49.024355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8057ec6-e49c-4ae0-ab30-33211d6a25df admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:49.107582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c425fd-19ad-4f7e-b077-d3c875869e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:49.112158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c425fd-19ad-4f7e-b077-d3c875869e2e admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:49.112158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c425fd-19ad-4f7e-b077-d3c875869e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:49.112158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c425fd-19ad-4f7e-b077-d3c875869e2e admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:49.122714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c425fd-19ad-4f7e-b077-d3c875869e2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:49.122714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c425fd-19ad-4f7e-b077-d3c875869e2e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:49.277766 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3452/6930] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:47:49 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:47:49.282257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b2168-343d-457e-b836-79203778f104 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:49.301611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b2168-343d-457e-b836-79203778f104 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:49.308871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527eee5-3589-4133-9cdf-84165a30b179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:49.308871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527eee5-3589-4133-9cdf-84165a30b179 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:49.309367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527eee5-3589-4133-9cdf-84165a30b179 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:49.310035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527eee5-3589-4133-9cdf-84165a30b179 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:49.310850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527eee5-3589-4133-9cdf-84165a30b179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:49.312550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527eee5-3589-4133-9cdf-84165a30b179 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:49.326219 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3479/6931] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:47:49.332128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c425fd-19ad-4f7e-b077-d3c875869e2e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:49.359322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c425fd-19ad-4f7e-b077-d3c875869e2e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:49.365255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ded54e-b05b-4d97-aaa6-901cb59019d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:49.367081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ded54e-b05b-4d97-aaa6-901cb59019d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:49.367081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ded54e-b05b-4d97-aaa6-901cb59019d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:49.367081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ded54e-b05b-4d97-aaa6-901cb59019d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:49.367855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ded54e-b05b-4d97-aaa6-901cb59019d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:49.370561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ded54e-b05b-4d97-aaa6-901cb59019d0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:49.383531 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3453/6932] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:47:49.387738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527eee5-3589-4133-9cdf-84165a30b179 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:49.409497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527eee5-3589-4133-9cdf-84165a30b179 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:49.417556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4efde-e6fb-4bad-9491-627340aaf0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:49.418603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4efde-e6fb-4bad-9491-627340aaf0b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:49.418987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4efde-e6fb-4bad-9491-627340aaf0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:49.419541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4efde-e6fb-4bad-9491-627340aaf0b1 admin admin] PATH_INFO: `/v3/projects/c197dec70ede42cea499386f26da34b3/users/88360efcaac7437da89004995e392caa/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:49.438482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4efde-e6fb-4bad-9491-627340aaf0b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c197dec70ede42cea499386f26da34b3, user_id=88360efcaac7437da89004995e392caa, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:49.442675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4efde-e6fb-4bad-9491-627340aaf0b1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:49.545211 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3480/6933] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:47:49 2022] PUT /identity/v3/projects/c197dec70ede42cea499386f26da34b3/users/88360efcaac7437da89004995e392caa/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:47:49.557764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df4c9f-90ad-490e-8f9c-168387ca33a0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:49.558572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df4c9f-90ad-490e-8f9c-168387ca33a0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:49.559124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df4c9f-90ad-490e-8f9c-168387ca33a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:49.614500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-36df4c9f-90ad-490e-8f9c-168387ca33a0 None None] MFA Rules not processed for user `88360efcaac7437da89004995e392caa`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:49.616590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-36df4c9f-90ad-490e-8f9c-168387ca33a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:49.710872 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3454/6934] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:47:49.715922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4efde-e6fb-4bad-9491-627340aaf0b1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:49.798582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df4c9f-90ad-490e-8f9c-168387ca33a0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:49.800914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-36df4c9f-90ad-490e-8f9c-168387ca33a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:49.814764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4efde-e6fb-4bad-9491-627340aaf0b1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:49.816462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df4c9f-90ad-490e-8f9c-168387ca33a0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:49.823207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccece01-934b-4148-8409-6782c0a0f37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:49.824424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccece01-934b-4148-8409-6782c0a0f37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:49.824966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccece01-934b-4148-8409-6782c0a0f37c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:49.825570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccece01-934b-4148-8409-6782c0a0f37c admin admin] PATH_INFO: `/v3/users/1326669005334b5095c1dc40a52720b5` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:49.827586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccece01-934b-4148-8409-6782c0a0f37c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1326669005334b5095c1dc40a52720b5)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:49.829981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccece01-934b-4148-8409-6782c0a0f37c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:49.848826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3429db-2ff8-41cd-b43b-abb2ca336719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:49.849527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3429db-2ff8-41cd-b43b-abb2ca336719 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:49.849816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3429db-2ff8-41cd-b43b-abb2ca336719 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:49.850099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3429db-2ff8-41cd-b43b-abb2ca336719 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:49.850818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3429db-2ff8-41cd-b43b-abb2ca336719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:49.858211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3429db-2ff8-41cd-b43b-abb2ca336719 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:50.005486 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3481/6935] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:47:49 2022] POST /identity/v3/projects => generated 385 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:47:50.009422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3429db-2ff8-41cd-b43b-abb2ca336719 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:50.095004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3429db-2ff8-41cd-b43b-abb2ca336719 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:50.099340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc210eb3-a199-42b6-8ba0-d0767944f139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:50.100155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc210eb3-a199-42b6-8ba0-d0767944f139 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:50.100478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc210eb3-a199-42b6-8ba0-d0767944f139 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:50.100852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc210eb3-a199-42b6-8ba0-d0767944f139 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:50.102265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc210eb3-a199-42b6-8ba0-d0767944f139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:50.105441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc210eb3-a199-42b6-8ba0-d0767944f139 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:50.132856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eccece01-934b-4148-8409-6782c0a0f37c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1326669005334b5095c1dc40a52720b5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:50.159525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eccece01-934b-4148-8409-6782c0a0f37c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1326669005334b5095c1dc40a52720b5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:50.160965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eccece01-934b-4148-8409-6782c0a0f37c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1326669005334b5095c1dc40a52720b5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:50.213384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eccece01-934b-4148-8409-6782c0a0f37c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1326669005334b5095c1dc40a52720b5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:50.218357 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3482/6936] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:47:50 2022] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:47:50.224062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc210eb3-a199-42b6-8ba0-d0767944f139 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:50.252131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc210eb3-a199-42b6-8ba0-d0767944f139 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:50.275774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb84633-e1bc-465c-aa19-4c7989729349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:50.276635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb84633-e1bc-465c-aa19-4c7989729349 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:50.276799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb84633-e1bc-465c-aa19-4c7989729349 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:50.277078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb84633-e1bc-465c-aa19-4c7989729349 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:50.277796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb84633-e1bc-465c-aa19-4c7989729349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:50.279448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb84633-e1bc-465c-aa19-4c7989729349 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:50.298473 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3483/6937] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:47:50.302888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb84633-e1bc-465c-aa19-4c7989729349 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:50.309731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eccece01-934b-4148-8409-6782c0a0f37c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1326669005334b5095c1dc40a52720b5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:50.317628 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3455/6938] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:47:49 2022] DELETE /identity/v3/users/1326669005334b5095c1dc40a52720b5 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:47:50.319459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb84633-e1bc-465c-aa19-4c7989729349 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:50.438735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bc6a6-221f-4216-8c5d-d455d81cd366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:50.439671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bc6a6-221f-4216-8c5d-d455d81cd366 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:50.439958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bc6a6-221f-4216-8c5d-d455d81cd366 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:50.443793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bc6a6-221f-4216-8c5d-d455d81cd366 admin admin] PATH_INFO: `/v3/projects/809e00b1c5ed41119841f22f7f028251/users/9bb1836170dc4d1185c4718cd06d8f29/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:50.466542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bc6a6-221f-4216-8c5d-d455d81cd366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=809e00b1c5ed41119841f22f7f028251, user_id=9bb1836170dc4d1185c4718cd06d8f29, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:50.470498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bc6a6-221f-4216-8c5d-d455d81cd366 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:50.570538 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3484/6939] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:47:50 2022] PUT /identity/v3/projects/809e00b1c5ed41119841f22f7f028251/users/9bb1836170dc4d1185c4718cd06d8f29/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:47:50.576219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccece01-934b-4148-8409-6782c0a0f37c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:50.577758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-eccece01-934b-4148-8409-6782c0a0f37c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:50.595334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccece01-934b-4148-8409-6782c0a0f37c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:50.708965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df596678-87db-4a12-a3f2-79cefde386b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:50.709896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df596678-87db-4a12-a3f2-79cefde386b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:50.710357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df596678-87db-4a12-a3f2-79cefde386b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:50.710836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df596678-87db-4a12-a3f2-79cefde386b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:50.711577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df596678-87db-4a12-a3f2-79cefde386b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:50.713345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df596678-87db-4a12-a3f2-79cefde386b5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:50.730013 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3456/6940] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:47:50.735072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bc6a6-221f-4216-8c5d-d455d81cd366 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:50.748286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bc6a6-221f-4216-8c5d-d455d81cd366 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:50.754953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a29c9-1270-46d5-88a5-5314290a7d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:50.761509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a29c9-1270-46d5-88a5-5314290a7d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:50.761509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a29c9-1270-46d5-88a5-5314290a7d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:50.761509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a29c9-1270-46d5-88a5-5314290a7d4e admin admin] PATH_INFO: `/v3/projects/809e00b1c5ed41119841f22f7f028251/users/9bb1836170dc4d1185c4718cd06d8f29/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:50.761509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a29c9-1270-46d5-88a5-5314290a7d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=809e00b1c5ed41119841f22f7f028251, user_id=9bb1836170dc4d1185c4718cd06d8f29, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:50.761934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a29c9-1270-46d5-88a5-5314290a7d4e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:50.786791 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3485/6941] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:47:50 2022] PUT /identity/v3/projects/809e00b1c5ed41119841f22f7f028251/users/9bb1836170dc4d1185c4718cd06d8f29/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:47:50.786977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277d93d-38f6-41a8-af42-7b1676d862d7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:50.787232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277d93d-38f6-41a8-af42-7b1676d862d7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:50.787537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277d93d-38f6-41a8-af42-7b1676d862d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:50.867735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0277d93d-38f6-41a8-af42-7b1676d862d7 None None] MFA Rules not processed for user `9bb1836170dc4d1185c4718cd06d8f29`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:50.870150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0277d93d-38f6-41a8-af42-7b1676d862d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:50.908326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a29c9-1270-46d5-88a5-5314290a7d4e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:50.912083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7b4a29c9-1270-46d5-88a5-5314290a7d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:51.035510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a29c9-1270-46d5-88a5-5314290a7d4e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:51.041146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8b2ac-d946-412a-861a-3ea89d6f64d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:51.042673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8b2ac-d946-412a-861a-3ea89d6f64d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:51.043155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8b2ac-d946-412a-861a-3ea89d6f64d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:51.043616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8b2ac-d946-412a-861a-3ea89d6f64d5 admin admin] PATH_INFO: `/v3/projects/c66af7b914fd46dbb25e62d4e3522759` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:51.045190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8b2ac-d946-412a-861a-3ea89d6f64d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c66af7b914fd46dbb25e62d4e3522759)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:51.047710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8b2ac-d946-412a-861a-3ea89d6f64d5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:51.119511 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3457/6942] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:47:51.135923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277d93d-38f6-41a8-af42-7b1676d862d7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:51.142277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0277d93d-38f6-41a8-af42-7b1676d862d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:51.254334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8be8b2ac-d946-412a-861a-3ea89d6f64d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c66af7b914fd46dbb25e62d4e3522759', 'request_id': 'req-8be8b2ac-d946-412a-861a-3ea89d6f64d5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:51.272083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277d93d-38f6-41a8-af42-7b1676d862d7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:51.324667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8be8b2ac-d946-412a-861a-3ea89d6f64d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c66af7b914fd46dbb25e62d4e3522759', 'request_id': 'req-8be8b2ac-d946-412a-861a-3ea89d6f64d5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:51.340070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8be8b2ac-d946-412a-861a-3ea89d6f64d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c66af7b914fd46dbb25e62d4e3522759', 'request_id': 'req-8be8b2ac-d946-412a-861a-3ea89d6f64d5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:51.348427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db0000-455d-4812-bcaa-7fe26de2f09f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:51.349134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db0000-455d-4812-bcaa-7fe26de2f09f service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:51.349418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db0000-455d-4812-bcaa-7fe26de2f09f service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:51.349725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db0000-455d-4812-bcaa-7fe26de2f09f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:51.351616 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b4db0000-455d-4812-bcaa-7fe26de2f09f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:51.364241 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8be8b2ac-d946-412a-861a-3ea89d6f64d5 admin admin] The token cache is being invalidate because project c66af7b914fd46dbb25e62d4e3522759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:47:51.368206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8be8b2ac-d946-412a-861a-3ea89d6f64d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:51.372337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8be8b2ac-d946-412a-861a-3ea89d6f64d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:47:51.375706 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3486/6943] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:47:50 2022] DELETE /identity/v3/projects/c66af7b914fd46dbb25e62d4e3522759 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:47:51.381010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ff2d0-48e8-4fd6-b55c-a23654290a10 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:51.381562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ff2d0-48e8-4fd6-b55c-a23654290a10 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:51.382038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ff2d0-48e8-4fd6-b55c-a23654290a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:51.421576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-732ff2d0-48e8-4fd6-b55c-a23654290a10 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:51.422827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-732ff2d0-48e8-4fd6-b55c-a23654290a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:51.481929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db0000-455d-4812-bcaa-7fe26de2f09f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:51.483570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db0000-455d-4812-bcaa-7fe26de2f09f service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:51.501138 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3458/6944] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:47:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:47:51.509026 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3487/6945] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:47:51.517656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2bfab-5675-428b-ad0f-a4c922f0d269 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:51.517961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2bfab-5675-428b-ad0f-a4c922f0d269 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:51.518251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2bfab-5675-428b-ad0f-a4c922f0d269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:51.556503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-46e2bfab-5675-428b-ad0f-a4c922f0d269 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:51.557907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-46e2bfab-5675-428b-ad0f-a4c922f0d269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:51.577597 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3459/6946] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:47:51.582016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ff2d0-48e8-4fd6-b55c-a23654290a10 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:51.595639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ff2d0-48e8-4fd6-b55c-a23654290a10 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:51.609513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231adf54-a4a6-46a1-b6ff-efb4c65a2d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:51.610456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231adf54-a4a6-46a1-b6ff-efb4c65a2d9b admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:51.610950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231adf54-a4a6-46a1-b6ff-efb4c65a2d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:51.611412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231adf54-a4a6-46a1-b6ff-efb4c65a2d9b admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:51.615948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231adf54-a4a6-46a1-b6ff-efb4c65a2d9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:47:51.616453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231adf54-a4a6-46a1-b6ff-efb4c65a2d9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:51.618267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231adf54-a4a6-46a1-b6ff-efb4c65a2d9b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:51.651447 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3488/6947] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:47:51.656152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2bfab-5675-428b-ad0f-a4c922f0d269 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:51.667614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2bfab-5675-428b-ad0f-a4c922f0d269 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:51.673432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f732955-c6b5-4b71-9004-a4e75912ceeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:51.674672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f732955-c6b5-4b71-9004-a4e75912ceeb admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:51.675160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f732955-c6b5-4b71-9004-a4e75912ceeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:51.675541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f732955-c6b5-4b71-9004-a4e75912ceeb admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:51.677278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f732955-c6b5-4b71-9004-a4e75912ceeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:51.679558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f732955-c6b5-4b71-9004-a4e75912ceeb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:51.824398 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3460/6948] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:47:51 2022] POST /identity/v3/projects => generated 405 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:47:51.829500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231adf54-a4a6-46a1-b6ff-efb4c65a2d9b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:51.847584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231adf54-a4a6-46a1-b6ff-efb4c65a2d9b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:51.927878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83475fd9-2050-4270-b852-2e0c61f1ccc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:51.928732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83475fd9-2050-4270-b852-2e0c61f1ccc6 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:51.929023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83475fd9-2050-4270-b852-2e0c61f1ccc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:51.929357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83475fd9-2050-4270-b852-2e0c61f1ccc6 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:51.930105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83475fd9-2050-4270-b852-2e0c61f1ccc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:51.932934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83475fd9-2050-4270-b852-2e0c61f1ccc6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:52.054128 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3489/6949] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:47:51 2022] POST /identity/v3/users => generated 303 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:47:52.058764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f732955-c6b5-4b71-9004-a4e75912ceeb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:52.071343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f732955-c6b5-4b71-9004-a4e75912ceeb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:52.078897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ed972-b96c-455d-b473-3be8799a68aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:52.080310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ed972-b96c-455d-b473-3be8799a68aa admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:52.080862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ed972-b96c-455d-b473-3be8799a68aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:52.081371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ed972-b96c-455d-b473-3be8799a68aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:52.082221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ed972-b96c-455d-b473-3be8799a68aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:52.084369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ed972-b96c-455d-b473-3be8799a68aa admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:52.113463 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3461/6950] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:47:52.116619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83475fd9-2050-4270-b852-2e0c61f1ccc6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:52.318934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83475fd9-2050-4270-b852-2e0c61f1ccc6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:52.318934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392d3e0-7123-4175-8fe6-3270d3b6fcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:52.318934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392d3e0-7123-4175-8fe6-3270d3b6fcb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:52.318934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392d3e0-7123-4175-8fe6-3270d3b6fcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:52.419122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392d3e0-7123-4175-8fe6-3270d3b6fcb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:52.419122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392d3e0-7123-4175-8fe6-3270d3b6fcb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:52.419122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392d3e0-7123-4175-8fe6-3270d3b6fcb1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:52.419122 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3490/6951] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:47:52.419589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ed972-b96c-455d-b473-3be8799a68aa admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:52.419589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ed972-b96c-455d-b473-3be8799a68aa admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:52.419589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e6be2-ef67-448a-aed9-c50acd9e1fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:52.419589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e6be2-ef67-448a-aed9-c50acd9e1fdd admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:52.419960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e6be2-ef67-448a-aed9-c50acd9e1fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:52.419960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e6be2-ef67-448a-aed9-c50acd9e1fdd admin admin] PATH_INFO: `/v3/projects/4f0992eaa55c41c7b559208fa200a822/users/44a4647d87ca4f47a6aaeb8cb6312097/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:52.419960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e6be2-ef67-448a-aed9-c50acd9e1fdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0992eaa55c41c7b559208fa200a822, user_id=44a4647d87ca4f47a6aaeb8cb6312097, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:52.419960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e6be2-ef67-448a-aed9-c50acd9e1fdd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:52.419960 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3462/6952] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:47:52 2022] PUT /identity/v3/projects/4f0992eaa55c41c7b559208fa200a822/users/44a4647d87ca4f47a6aaeb8cb6312097/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:47:52.420402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3d3ba-7cca-499d-91a7-c6b6b4356855 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:52.420402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3d3ba-7cca-499d-91a7-c6b6b4356855 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:52.420402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3d3ba-7cca-499d-91a7-c6b6b4356855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:52.459911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-73a3d3ba-7cca-499d-91a7-c6b6b4356855 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:52.461120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-73a3d3ba-7cca-499d-91a7-c6b6b4356855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:52.534155 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3491/6953] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:47:52.561082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e6be2-ef67-448a-aed9-c50acd9e1fdd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:52.562858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9d0e6be2-ef67-448a-aed9-c50acd9e1fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:52.641612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e6be2-ef67-448a-aed9-c50acd9e1fdd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:52.646034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595301f2-0912-40d3-a6f3-e104d87f2033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:52.646415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595301f2-0912-40d3-a6f3-e104d87f2033 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:52.646783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595301f2-0912-40d3-a6f3-e104d87f2033 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:52.647462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595301f2-0912-40d3-a6f3-e104d87f2033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:52.659464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595301f2-0912-40d3-a6f3-e104d87f2033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:52.661339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595301f2-0912-40d3-a6f3-e104d87f2033 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:52.685231 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3463/6954] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:47:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:47:55.185686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd88514-d917-409b-af3a-c90b102d0c36 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:55.186172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd88514-d917-409b-af3a-c90b102d0c36 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:55.187011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd88514-d917-409b-af3a-c90b102d0c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:55.242944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ccd88514-d917-409b-af3a-c90b102d0c36 None None] MFA Rules not processed for user `44a4647d87ca4f47a6aaeb8cb6312097`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:55.250053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ccd88514-d917-409b-af3a-c90b102d0c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:55.303542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd868010-e8e4-4f11-b198-1ee059861d63 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:55.304006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd868010-e8e4-4f11-b198-1ee059861d63 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:55.304126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd868010-e8e4-4f11-b198-1ee059861d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:55.330632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-fd868010-e8e4-4f11-b198-1ee059861d63 None None] MFA Rules not processed for user `fbe9eb56384842fc94e28404714e66ca`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:55.331847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fd868010-e8e4-4f11-b198-1ee059861d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:55.344080 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3492/6955] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:55 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:47:55.348575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd88514-d917-409b-af3a-c90b102d0c36 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:55.362265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd88514-d917-409b-af3a-c90b102d0c36 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:55.367342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818affc2-a4cd-44d9-9b30-1a362fc26e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:55.368173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818affc2-a4cd-44d9-9b30-1a362fc26e83 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:55.368759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818affc2-a4cd-44d9-9b30-1a362fc26e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:55.369095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818affc2-a4cd-44d9-9b30-1a362fc26e83 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:55.370364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818affc2-a4cd-44d9-9b30-1a362fc26e83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:55.372494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818affc2-a4cd-44d9-9b30-1a362fc26e83 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:55.408164 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3464/6956] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:47:55.429613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd868010-e8e4-4f11-b198-1ee059861d63 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:55.431265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fd868010-e8e4-4f11-b198-1ee059861d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:55.440112 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3493/6957] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:47:55 2022] POST /identity/v3/projects => generated 401 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:47:55.441214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818affc2-a4cd-44d9-9b30-1a362fc26e83 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:55.510270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd868010-e8e4-4f11-b198-1ee059861d63 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:55.521022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818affc2-a4cd-44d9-9b30-1a362fc26e83 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:55.529769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8defbe6-670d-4f11-bb03-258c3a692bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:55.530531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8defbe6-670d-4f11-bb03-258c3a692bff admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:55.530898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8defbe6-670d-4f11-bb03-258c3a692bff admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:55.531256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8defbe6-670d-4f11-bb03-258c3a692bff admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:55.532025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8defbe6-670d-4f11-bb03-258c3a692bff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:55.534480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8defbe6-670d-4f11-bb03-258c3a692bff admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:55.560718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b228a-d2db-4df3-b697-0d6f0dd19bd1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:55.561447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b228a-d2db-4df3-b697-0d6f0dd19bd1 service glance] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:55.568738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b228a-d2db-4df3-b697-0d6f0dd19bd1 service glance] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:55.568738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b228a-d2db-4df3-b697-0d6f0dd19bd1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:55.568738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1c6b228a-d2db-4df3-b697-0d6f0dd19bd1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:55.629622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b228a-d2db-4df3-b697-0d6f0dd19bd1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:55.631605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b228a-d2db-4df3-b697-0d6f0dd19bd1 service glance] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:55.658735 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3494/6958] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:47:55 2022] POST /identity/v3/users => generated 301 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:47:55.658735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8defbe6-670d-4f11-bb03-258c3a692bff admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:55.661074 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3465/6959] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:47:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:47:55.667358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8defbe6-670d-4f11-bb03-258c3a692bff admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:55.673551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646b423-180f-40be-a09b-c98009a07cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:55.674551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646b423-180f-40be-a09b-c98009a07cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:55.675186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646b423-180f-40be-a09b-c98009a07cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:55.675644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646b423-180f-40be-a09b-c98009a07cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:55.676557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646b423-180f-40be-a09b-c98009a07cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:55.678393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646b423-180f-40be-a09b-c98009a07cd4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:55.702613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b228a-d2db-4df3-b697-0d6f0dd19bd1 service glance] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:55.713315 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3495/6960] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:47:55.718950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b228a-d2db-4df3-b697-0d6f0dd19bd1 service glance] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:55.732915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c24fcd-dac0-4671-a1e7-d816b56b6016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:55.733611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c24fcd-dac0-4671-a1e7-d816b56b6016 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:55.733929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c24fcd-dac0-4671-a1e7-d816b56b6016 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:55.734217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c24fcd-dac0-4671-a1e7-d816b56b6016 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:55.735193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c24fcd-dac0-4671-a1e7-d816b56b6016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:55.737434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c24fcd-dac0-4671-a1e7-d816b56b6016 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:55.749390 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3466/6961] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:47:55.753552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646b423-180f-40be-a09b-c98009a07cd4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:55.765188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646b423-180f-40be-a09b-c98009a07cd4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:55.770398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9acf60-d2c4-4176-be07-48956f04ec64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:55.772015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9acf60-d2c4-4176-be07-48956f04ec64 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:55.772424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9acf60-d2c4-4176-be07-48956f04ec64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:55.772891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9acf60-d2c4-4176-be07-48956f04ec64 admin admin] PATH_INFO: `/v3/projects/6bd05308a4524be2a0e82288e790ce70/users/e963b7f66b5d4272844eb76b01518c2a/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:55.793056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9acf60-d2c4-4176-be07-48956f04ec64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd05308a4524be2a0e82288e790ce70, user_id=e963b7f66b5d4272844eb76b01518c2a, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:55.795723 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9acf60-d2c4-4176-be07-48956f04ec64 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:55.862629 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3496/6962] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:47:55 2022] PUT /identity/v3/projects/6bd05308a4524be2a0e82288e790ce70/users/e963b7f66b5d4272844eb76b01518c2a/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:47:57.381422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d17d4d-eed5-4226-86f1-a8b70b35a631 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:57.382334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d17d4d-eed5-4226-86f1-a8b70b35a631 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:57.382795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d17d4d-eed5-4226-86f1-a8b70b35a631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:57.449763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e7d17d4d-eed5-4226-86f1-a8b70b35a631 None None] MFA Rules not processed for user `e963b7f66b5d4272844eb76b01518c2a`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:57.450976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e7d17d4d-eed5-4226-86f1-a8b70b35a631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:57.566235 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3467/6963] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:47:57.568925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d0155-fdc1-4c1e-959c-29e6b0113c1b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:57.569444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d0155-fdc1-4c1e-959c-29e6b0113c1b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:57.569444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d0155-fdc1-4c1e-959c-29e6b0113c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:57.589247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a35d0155-fdc1-4c1e-959c-29e6b0113c1b None None] MFA Rules not processed for user `44a4647d87ca4f47a6aaeb8cb6312097`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:47:57.590407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a35d0155-fdc1-4c1e-959c-29e6b0113c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:57.671009 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3497/6964] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:47:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:47:57.687231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d17d4d-eed5-4226-86f1-a8b70b35a631 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:57.689048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e7d17d4d-eed5-4226-86f1-a8b70b35a631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:57.844564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d17d4d-eed5-4226-86f1-a8b70b35a631 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:57.850459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01406d-dba9-4f96-a165-5bbdb8cadac6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:57.851487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01406d-dba9-4f96-a165-5bbdb8cadac6 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:57.852103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01406d-dba9-4f96-a165-5bbdb8cadac6 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:57.852385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01406d-dba9-4f96-a165-5bbdb8cadac6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:57.863216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01406d-dba9-4f96-a165-5bbdb8cadac6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:57.865096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01406d-dba9-4f96-a165-5bbdb8cadac6 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:57.876111 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3468/6965] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:47:57 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:47:58.343583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d0155-fdc1-4c1e-959c-29e6b0113c1b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:47:58.345052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a35d0155-fdc1-4c1e-959c-29e6b0113c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:58.413982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d0155-fdc1-4c1e-959c-29e6b0113c1b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:47:58.419037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cf80f-5d60-4db9-bc54-70138f144d49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:47:58.419772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cf80f-5d60-4db9-bc54-70138f144d49 service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:47:58.420059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cf80f-5d60-4db9-bc54-70138f144d49 service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:47:58.420339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cf80f-5d60-4db9-bc54-70138f144d49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:47:58.422188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-882cf80f-5d60-4db9-bc54-70138f144d49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:47:58.488727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cf80f-5d60-4db9-bc54-70138f144d49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:47:58.490172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cf80f-5d60-4db9-bc54-70138f144d49 service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:47:58.502132 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3498/6966] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:47:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:48:10.281942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72ce2d-475b-4972-b0c1-ae29b1c97a43 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:10.282582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72ce2d-475b-4972-b0c1-ae29b1c97a43 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:10.282582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72ce2d-475b-4972-b0c1-ae29b1c97a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:10.301308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ed72ce2d-475b-4972-b0c1-ae29b1c97a43 None None] MFA Rules not processed for user `bad5953b4fbf4fe2a30a2b4208714631`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:10.302515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ed72ce2d-475b-4972-b0c1-ae29b1c97a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:10.375518 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3469/6967] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:12.016885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cf80f-5d60-4db9-bc54-70138f144d49 service cinder] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:12.018821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-882cf80f-5d60-4db9-bc54-70138f144d49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:12.037397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cf80f-5d60-4db9-bc54-70138f144d49 service cinder] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:12.043070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba7bd5-5e81-4ff5-a958-603eab907a35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:12.043713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba7bd5-5e81-4ff5-a958-603eab907a35 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:12.044080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba7bd5-5e81-4ff5-a958-603eab907a35 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:12.044362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba7bd5-5e81-4ff5-a958-603eab907a35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:12.052833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba7bd5-5e81-4ff5-a958-603eab907a35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:12.054436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba7bd5-5e81-4ff5-a958-603eab907a35 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:12.064122 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3499/6968] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:48:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:48:13.127082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72ce2d-475b-4972-b0c1-ae29b1c97a43 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:13.128623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ed72ce2d-475b-4972-b0c1-ae29b1c97a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:13.195481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72ce2d-475b-4972-b0c1-ae29b1c97a43 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:13.200159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb84265-b61a-48c8-98c4-2c521ef233d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:13.201070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb84265-b61a-48c8-98c4-2c521ef233d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:13.201350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb84265-b61a-48c8-98c4-2c521ef233d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:13.201629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb84265-b61a-48c8-98c4-2c521ef233d8 admin admin] PATH_INFO: `/v3/users/1e60d246f1ea48bf884ef8fb32d2511c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:13.203347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb84265-b61a-48c8-98c4-2c521ef233d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e60d246f1ea48bf884ef8fb32d2511c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:13.205551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb84265-b61a-48c8-98c4-2c521ef233d8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:13.373568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9bb84265-b61a-48c8-98c4-2c521ef233d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e60d246f1ea48bf884ef8fb32d2511c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:13.385612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9bb84265-b61a-48c8-98c4-2c521ef233d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e60d246f1ea48bf884ef8fb32d2511c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:13.386272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9bb84265-b61a-48c8-98c4-2c521ef233d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e60d246f1ea48bf884ef8fb32d2511c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:13.393424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9bb84265-b61a-48c8-98c4-2c521ef233d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e60d246f1ea48bf884ef8fb32d2511c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:13.485013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9bb84265-b61a-48c8-98c4-2c521ef233d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e60d246f1ea48bf884ef8fb32d2511c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:13.491128 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3470/6969] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:48:13 2022] DELETE /identity/v3/users/1e60d246f1ea48bf884ef8fb32d2511c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:13.784184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba7bd5-5e81-4ff5-a958-603eab907a35 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:13.800921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba7bd5-5e81-4ff5-a958-603eab907a35 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:13.865139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891d8ea-148f-4b41-9a31-3180c0995322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:13.866011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891d8ea-148f-4b41-9a31-3180c0995322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:13.866318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891d8ea-148f-4b41-9a31-3180c0995322 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:13.866594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891d8ea-148f-4b41-9a31-3180c0995322 admin admin] PATH_INFO: `/v3/projects/d7e965673511439386e8a383fd25d8ee` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:13.867844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891d8ea-148f-4b41-9a31-3180c0995322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7e965673511439386e8a383fd25d8ee)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:13.869803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891d8ea-148f-4b41-9a31-3180c0995322 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:13.997694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7891d8ea-148f-4b41-9a31-3180c0995322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7e965673511439386e8a383fd25d8ee', 'request_id': 'req-7891d8ea-148f-4b41-9a31-3180c0995322'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:14.080313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7891d8ea-148f-4b41-9a31-3180c0995322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7e965673511439386e8a383fd25d8ee', 'request_id': 'req-7891d8ea-148f-4b41-9a31-3180c0995322'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:14.089187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7891d8ea-148f-4b41-9a31-3180c0995322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7e965673511439386e8a383fd25d8ee', 'request_id': 'req-7891d8ea-148f-4b41-9a31-3180c0995322'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:14.103530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7891d8ea-148f-4b41-9a31-3180c0995322 admin admin] The token cache is being invalidate because project d7e965673511439386e8a383fd25d8ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:48:14.104163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7891d8ea-148f-4b41-9a31-3180c0995322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:14.105147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7891d8ea-148f-4b41-9a31-3180c0995322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:14.112635 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3500/6970] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:48:13 2022] DELETE /identity/v3/projects/d7e965673511439386e8a383fd25d8ee => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:14.117438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec62ff-382e-4a6e-b8e4-c74df0655f78 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:14.119451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec62ff-382e-4a6e-b8e4-c74df0655f78 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:14.119451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec62ff-382e-4a6e-b8e4-c74df0655f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:14.150409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7aec62ff-382e-4a6e-b8e4-c74df0655f78 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:14.152320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7aec62ff-382e-4a6e-b8e4-c74df0655f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:14.229648 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3471/6971] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:14.237935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502983cd-bfe9-4df4-aaca-a9d8eff089ab None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:14.238421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502983cd-bfe9-4df4-aaca-a9d8eff089ab None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:14.238785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502983cd-bfe9-4df4-aaca-a9d8eff089ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:14.262881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-502983cd-bfe9-4df4-aaca-a9d8eff089ab None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:14.264120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-502983cd-bfe9-4df4-aaca-a9d8eff089ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:14.277061 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3501/6972] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:48:14.278500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec62ff-382e-4a6e-b8e4-c74df0655f78 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:14.292311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec62ff-382e-4a6e-b8e4-c74df0655f78 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:14.312322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa59ba-f42b-49fe-a59f-445caa30ec77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:14.313365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa59ba-f42b-49fe-a59f-445caa30ec77 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:14.313816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa59ba-f42b-49fe-a59f-445caa30ec77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:14.314255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa59ba-f42b-49fe-a59f-445caa30ec77 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:14.315705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa59ba-f42b-49fe-a59f-445caa30ec77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:48:14.316239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa59ba-f42b-49fe-a59f-445caa30ec77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:14.317953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa59ba-f42b-49fe-a59f-445caa30ec77 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:14.331134 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3472/6973] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:48:14.335386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502983cd-bfe9-4df4-aaca-a9d8eff089ab None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:14.348126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502983cd-bfe9-4df4-aaca-a9d8eff089ab None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:14.353482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b3025-16bb-4307-98c1-e09f4768448c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:14.354177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b3025-16bb-4307-98c1-e09f4768448c admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:14.354463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b3025-16bb-4307-98c1-e09f4768448c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:14.354740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b3025-16bb-4307-98c1-e09f4768448c admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:14.355453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b3025-16bb-4307-98c1-e09f4768448c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:14.357456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b3025-16bb-4307-98c1-e09f4768448c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:14.435953 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3502/6974] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:48:14 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:48:14.440350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa59ba-f42b-49fe-a59f-445caa30ec77 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:14.451835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa59ba-f42b-49fe-a59f-445caa30ec77 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:14.512530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97125455-b853-474a-98f6-6128526bd135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:14.513236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97125455-b853-474a-98f6-6128526bd135 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:14.513522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97125455-b853-474a-98f6-6128526bd135 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:14.513801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97125455-b853-474a-98f6-6128526bd135 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:14.514508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97125455-b853-474a-98f6-6128526bd135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:14.517169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97125455-b853-474a-98f6-6128526bd135 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:14.614614 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3473/6975] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:48:14 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:48:14.615820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b3025-16bb-4307-98c1-e09f4768448c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:14.626223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b3025-16bb-4307-98c1-e09f4768448c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:14.631125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f0f15-be15-4f2a-9052-ffbe150bcf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:14.631774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f0f15-be15-4f2a-9052-ffbe150bcf3b admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:14.632061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f0f15-be15-4f2a-9052-ffbe150bcf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:14.632343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f0f15-be15-4f2a-9052-ffbe150bcf3b admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:14.633125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f0f15-be15-4f2a-9052-ffbe150bcf3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:14.634714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f0f15-be15-4f2a-9052-ffbe150bcf3b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:14.647324 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3503/6976] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:48:14.651882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97125455-b853-474a-98f6-6128526bd135 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:14.665469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97125455-b853-474a-98f6-6128526bd135 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:14.670663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dde2a-5e82-47ae-b63e-b89a0e0687e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:14.671454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dde2a-5e82-47ae-b63e-b89a0e0687e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:14.671816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dde2a-5e82-47ae-b63e-b89a0e0687e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:14.672404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dde2a-5e82-47ae-b63e-b89a0e0687e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:14.673277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995dde2a-5e82-47ae-b63e-b89a0e0687e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:14.675778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995dde2a-5e82-47ae-b63e-b89a0e0687e4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:14.693365 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3474/6977] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:48:14.697664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f0f15-be15-4f2a-9052-ffbe150bcf3b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:14.712866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f0f15-be15-4f2a-9052-ffbe150bcf3b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:14.720221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6baddc0-7c9d-49be-b780-c57ddd08d880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:14.721463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6baddc0-7c9d-49be-b780-c57ddd08d880 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:14.721597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6baddc0-7c9d-49be-b780-c57ddd08d880 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:14.721912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6baddc0-7c9d-49be-b780-c57ddd08d880 admin admin] PATH_INFO: `/v3/projects/9d23c207841e43e6b2a24451ce21101e/users/b8c3679aa7284584b4052dcfe911c32a/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:14.739917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6baddc0-7c9d-49be-b780-c57ddd08d880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d23c207841e43e6b2a24451ce21101e, user_id=b8c3679aa7284584b4052dcfe911c32a, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:14.744156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6baddc0-7c9d-49be-b780-c57ddd08d880 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:14.822714 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3504/6978] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:48:14 2022] PUT /identity/v3/projects/9d23c207841e43e6b2a24451ce21101e/users/b8c3679aa7284584b4052dcfe911c32a/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:14.833629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f90161-2ac2-41c5-8fe6-5aeb37df322b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:14.834006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f90161-2ac2-41c5-8fe6-5aeb37df322b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:14.834369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f90161-2ac2-41c5-8fe6-5aeb37df322b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:14.862522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-58f90161-2ac2-41c5-8fe6-5aeb37df322b None None] MFA Rules not processed for user `b8c3679aa7284584b4052dcfe911c32a`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:14.863831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-58f90161-2ac2-41c5-8fe6-5aeb37df322b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:14.948216 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3475/6979] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:14.961490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6baddc0-7c9d-49be-b780-c57ddd08d880 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:14.963687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d6baddc0-7c9d-49be-b780-c57ddd08d880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:15.049851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6baddc0-7c9d-49be-b780-c57ddd08d880 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:15.057338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480a8a2-3dc8-447f-a35a-9bf537ed01fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:15.058309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480a8a2-3dc8-447f-a35a-9bf537ed01fd service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:15.059729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480a8a2-3dc8-447f-a35a-9bf537ed01fd service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:15.060203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480a8a2-3dc8-447f-a35a-9bf537ed01fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:15.071385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480a8a2-3dc8-447f-a35a-9bf537ed01fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:15.073030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480a8a2-3dc8-447f-a35a-9bf537ed01fd service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:15.089607 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3505/6980] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:48:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:48:15.135686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f90161-2ac2-41c5-8fe6-5aeb37df322b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:15.214669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f90161-2ac2-41c5-8fe6-5aeb37df322b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:15.220830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c7a09-b952-4771-b448-ecb336bd19f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:15.244854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c7a09-b952-4771-b448-ecb336bd19f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:15.247917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c7a09-b952-4771-b448-ecb336bd19f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:15.250616 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c7a09-b952-4771-b448-ecb336bd19f9 admin admin] PATH_INFO: `/v3/users/b8c3679aa7284584b4052dcfe911c32a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:15.253376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c7a09-b952-4771-b448-ecb336bd19f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8c3679aa7284584b4052dcfe911c32a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:15.261628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c7a09-b952-4771-b448-ecb336bd19f9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:15.528061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0d7c7a09-b952-4771-b448-ecb336bd19f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8c3679aa7284584b4052dcfe911c32a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:15.542387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0d7c7a09-b952-4771-b448-ecb336bd19f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8c3679aa7284584b4052dcfe911c32a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:15.551087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0d7c7a09-b952-4771-b448-ecb336bd19f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8c3679aa7284584b4052dcfe911c32a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:15.557835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0d7c7a09-b952-4771-b448-ecb336bd19f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8c3679aa7284584b4052dcfe911c32a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:15.622844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0d7c7a09-b952-4771-b448-ecb336bd19f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8c3679aa7284584b4052dcfe911c32a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:15.633784 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3476/6981] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:48:15 2022] DELETE /identity/v3/users/b8c3679aa7284584b4052dcfe911c32a => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:15.636529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c3dd0-cd04-4f1f-b294-48a61087df2b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:15.636878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c3dd0-cd04-4f1f-b294-48a61087df2b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:15.637200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c3dd0-cd04-4f1f-b294-48a61087df2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:15.654874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-eb5c3dd0-cd04-4f1f-b294-48a61087df2b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:15.660291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-eb5c3dd0-cd04-4f1f-b294-48a61087df2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:15.732661 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3506/6982] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:15.739857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c7a09-b952-4771-b448-ecb336bd19f9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:15.741603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0d7c7a09-b952-4771-b448-ecb336bd19f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:15.845472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c7a09-b952-4771-b448-ecb336bd19f9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:15.849366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5fc42-d778-4045-b739-9e73d0becf1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:15.850213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5fc42-d778-4045-b739-9e73d0becf1e service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:15.850610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5fc42-d778-4045-b739-9e73d0becf1e service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:15.850989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5fc42-d778-4045-b739-9e73d0becf1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:15.864052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5fc42-d778-4045-b739-9e73d0becf1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:15.864829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5fc42-d778-4045-b739-9e73d0becf1e service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:15.878834 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3477/6983] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:48:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:48:16.351202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c3dd0-cd04-4f1f-b294-48a61087df2b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:16.352818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-eb5c3dd0-cd04-4f1f-b294-48a61087df2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:16.378340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c3dd0-cd04-4f1f-b294-48a61087df2b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:16.385593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced28afb-69a6-4ebf-a393-98f488df5dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:16.386261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced28afb-69a6-4ebf-a393-98f488df5dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:16.386762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced28afb-69a6-4ebf-a393-98f488df5dce admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:16.387250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced28afb-69a6-4ebf-a393-98f488df5dce admin admin] PATH_INFO: `/v3/projects/9d23c207841e43e6b2a24451ce21101e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:16.389351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced28afb-69a6-4ebf-a393-98f488df5dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d23c207841e43e6b2a24451ce21101e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:16.393029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced28afb-69a6-4ebf-a393-98f488df5dce admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:16.537325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ced28afb-69a6-4ebf-a393-98f488df5dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d23c207841e43e6b2a24451ce21101e', 'request_id': 'req-ced28afb-69a6-4ebf-a393-98f488df5dce'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:16.617534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ced28afb-69a6-4ebf-a393-98f488df5dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d23c207841e43e6b2a24451ce21101e', 'request_id': 'req-ced28afb-69a6-4ebf-a393-98f488df5dce'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:16.629285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ced28afb-69a6-4ebf-a393-98f488df5dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d23c207841e43e6b2a24451ce21101e', 'request_id': 'req-ced28afb-69a6-4ebf-a393-98f488df5dce'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:16.659440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ced28afb-69a6-4ebf-a393-98f488df5dce admin admin] The token cache is being invalidate because project 9d23c207841e43e6b2a24451ce21101e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:48:16.660186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ced28afb-69a6-4ebf-a393-98f488df5dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:16.661118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ced28afb-69a6-4ebf-a393-98f488df5dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:16.663675 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3507/6984] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:48:16 2022] DELETE /identity/v3/projects/9d23c207841e43e6b2a24451ce21101e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:16.668343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a341e-1daa-4a77-93cf-95e324ebe350 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:16.668909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a341e-1daa-4a77-93cf-95e324ebe350 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:16.669132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a341e-1daa-4a77-93cf-95e324ebe350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:16.700182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8d3a341e-1daa-4a77-93cf-95e324ebe350 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:16.702569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8d3a341e-1daa-4a77-93cf-95e324ebe350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:16.866599 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3478/6985] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:16.875144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56a8e7-7e3c-4502-800d-92759b380c30 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:16.875431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56a8e7-7e3c-4502-800d-92759b380c30 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:16.875874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56a8e7-7e3c-4502-800d-92759b380c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:16.901068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ff56a8e7-7e3c-4502-800d-92759b380c30 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:16.902049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ff56a8e7-7e3c-4502-800d-92759b380c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:16.918595 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3508/6986] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:16.920529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a341e-1daa-4a77-93cf-95e324ebe350 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:16.932661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a341e-1daa-4a77-93cf-95e324ebe350 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:16.939777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6314a8-77ec-431a-b85d-50a29f24f61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:16.939777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6314a8-77ec-431a-b85d-50a29f24f61b admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:16.940073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6314a8-77ec-431a-b85d-50a29f24f61b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:16.940352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6314a8-77ec-431a-b85d-50a29f24f61b admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:16.941126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6314a8-77ec-431a-b85d-50a29f24f61b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:48:16.941433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6314a8-77ec-431a-b85d-50a29f24f61b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:16.943032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6314a8-77ec-431a-b85d-50a29f24f61b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:16.959140 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3479/6987] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:48:16.963614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56a8e7-7e3c-4502-800d-92759b380c30 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:16.970785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56a8e7-7e3c-4502-800d-92759b380c30 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:16.975427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c396d1-7fcf-4c16-9ce5-fae5fb040223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:16.976073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c396d1-7fcf-4c16-9ce5-fae5fb040223 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:16.976358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c396d1-7fcf-4c16-9ce5-fae5fb040223 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:16.976660 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c396d1-7fcf-4c16-9ce5-fae5fb040223 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:16.977362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c396d1-7fcf-4c16-9ce5-fae5fb040223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:16.979253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c396d1-7fcf-4c16-9ce5-fae5fb040223 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:17.146947 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3509/6988] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:48:16 2022] POST /identity/v3/projects => generated 365 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:48:17.148321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6314a8-77ec-431a-b85d-50a29f24f61b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:17.166256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6314a8-77ec-431a-b85d-50a29f24f61b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:17.266460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afde16-c705-4633-98f4-74ebabaa1aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:17.267302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afde16-c705-4633-98f4-74ebabaa1aab admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:17.267696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afde16-c705-4633-98f4-74ebabaa1aab admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:17.268155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afde16-c705-4633-98f4-74ebabaa1aab admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:17.269188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afde16-c705-4633-98f4-74ebabaa1aab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:17.271665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afde16-c705-4633-98f4-74ebabaa1aab admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:17.403125 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3480/6989] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:48:17 2022] POST /identity/v3/users => generated 283 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:48:17.403374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c396d1-7fcf-4c16-9ce5-fae5fb040223 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:17.412843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c396d1-7fcf-4c16-9ce5-fae5fb040223 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:17.419619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f87f3b-e5cb-46ee-abeb-12f81a8f9bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:17.420423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f87f3b-e5cb-46ee-abeb-12f81a8f9bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:17.420846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f87f3b-e5cb-46ee-abeb-12f81a8f9bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:17.421388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f87f3b-e5cb-46ee-abeb-12f81a8f9bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:17.422377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f87f3b-e5cb-46ee-abeb-12f81a8f9bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:17.424333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f87f3b-e5cb-46ee-abeb-12f81a8f9bd9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:17.439254 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3510/6990] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:48:17.442874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afde16-c705-4633-98f4-74ebabaa1aab admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:17.454285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afde16-c705-4633-98f4-74ebabaa1aab admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:17.461727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b534b21-645e-4eb9-a7ae-59f63affb71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:17.462434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b534b21-645e-4eb9-a7ae-59f63affb71b admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:17.462725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b534b21-645e-4eb9-a7ae-59f63affb71b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:17.463010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b534b21-645e-4eb9-a7ae-59f63affb71b admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:17.463765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b534b21-645e-4eb9-a7ae-59f63affb71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:17.467260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b534b21-645e-4eb9-a7ae-59f63affb71b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:17.488182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f87f3b-e5cb-46ee-abeb-12f81a8f9bd9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:17.488443 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3481/6991] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:48:17.499716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f87f3b-e5cb-46ee-abeb-12f81a8f9bd9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:17.505297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da9f1a-ba33-4910-8b09-d4a97a9fff71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:17.506358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da9f1a-ba33-4910-8b09-d4a97a9fff71 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:17.507448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da9f1a-ba33-4910-8b09-d4a97a9fff71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:17.507741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da9f1a-ba33-4910-8b09-d4a97a9fff71 admin admin] PATH_INFO: `/v3/projects/d0321a2271824734aa5388b0a228d7ed/users/54550e87b6f4438ca56732af4d5d8e7d/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:17.524099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da9f1a-ba33-4910-8b09-d4a97a9fff71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0321a2271824734aa5388b0a228d7ed, user_id=54550e87b6f4438ca56732af4d5d8e7d, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:17.527507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da9f1a-ba33-4910-8b09-d4a97a9fff71 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:17.642279 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3511/6992] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:48:17 2022] PUT /identity/v3/projects/d0321a2271824734aa5388b0a228d7ed/users/54550e87b6f4438ca56732af4d5d8e7d/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:48:17.653306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaa7c0-1c40-4427-b552-c5701fe60ce3 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:17.653645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaa7c0-1c40-4427-b552-c5701fe60ce3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:17.653968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaa7c0-1c40-4427-b552-c5701fe60ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:17.685711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9cfaa7c0-1c40-4427-b552-c5701fe60ce3 None None] MFA Rules not processed for user `54550e87b6f4438ca56732af4d5d8e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:17.686958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9cfaa7c0-1c40-4427-b552-c5701fe60ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:17.764737 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3482/6993] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:17.774191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da9f1a-ba33-4910-8b09-d4a97a9fff71 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:17.776585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-67da9f1a-ba33-4910-8b09-d4a97a9fff71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:17.870031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da9f1a-ba33-4910-8b09-d4a97a9fff71 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:17.877124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d63e98-4f8c-4c0b-bf49-31650b8c46e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:17.877791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d63e98-4f8c-4c0b-bf49-31650b8c46e7 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:17.878074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d63e98-4f8c-4c0b-bf49-31650b8c46e7 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:17.878350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d63e98-4f8c-4c0b-bf49-31650b8c46e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:17.887761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d63e98-4f8c-4c0b-bf49-31650b8c46e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:17.888726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d63e98-4f8c-4c0b-bf49-31650b8c46e7 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:17.899021 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3512/6994] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:48:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:48:17.913324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d235034-af6e-4db7-98cd-f95fae85659e None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:17.913617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d235034-af6e-4db7-98cd-f95fae85659e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:17.914058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d235034-af6e-4db7-98cd-f95fae85659e None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:17.915407 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3483/6995] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:48:17.920240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d63e98-4f8c-4c0b-bf49-31650b8c46e7 service nova] Authenticating service token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:48:17.934134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d63e98-4f8c-4c0b-bf49-31650b8c46e7 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:17.942960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d63e98-4f8c-4c0b-bf49-31650b8c46e7 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:17.947298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc604002-0c5c-41f7-8309-d7926bbdbd90 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54550e87b6f4438ca56732af4d5d8e7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0321a2271824734aa5388b0a228d7ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:17.948158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc604002-0c5c-41f7-8309-d7926bbdbd90 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:17.948444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc604002-0c5c-41f7-8309-d7926bbdbd90 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:17.948783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc604002-0c5c-41f7-8309-d7926bbdbd90 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] PATH_INFO: `/v3/projects/d0321a2271824734aa5388b0a228d7ed` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:17.949981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc604002-0c5c-41f7-8309-d7926bbdbd90 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] RBAC: Authorizing `identity:get_project(project_id=d0321a2271824734aa5388b0a228d7ed)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:17.951751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc604002-0c5c-41f7-8309-d7926bbdbd90 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:17.954675 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3513/6996] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:48:17 2022] GET /identity/v3/projects/d0321a2271824734aa5388b0a228d7ed => generated 365 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:48:18.143353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885de1ce-eb21-414c-b2ae-02f08c3f766c None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:18.143353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885de1ce-eb21-414c-b2ae-02f08c3f766c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:18.143353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885de1ce-eb21-414c-b2ae-02f08c3f766c None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:18.145120 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3484/6997] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:48:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:48:18.160896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc604002-0c5c-41f7-8309-d7926bbdbd90 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] Authenticating service token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:48:18.177017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc604002-0c5c-41f7-8309-d7926bbdbd90 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:18.185415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc604002-0c5c-41f7-8309-d7926bbdbd90 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:18.190718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a0b70-4caa-44ac-a374-1e93dbc04296 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54550e87b6f4438ca56732af4d5d8e7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0321a2271824734aa5388b0a228d7ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:18.192778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a0b70-4caa-44ac-a374-1e93dbc04296 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:18.192778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a0b70-4caa-44ac-a374-1e93dbc04296 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:18.192778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a0b70-4caa-44ac-a374-1e93dbc04296 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] PATH_INFO: `/v3/projects/d0321a2271824734aa5388b0a228d7ed` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:18.193423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a0b70-4caa-44ac-a374-1e93dbc04296 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] RBAC: Authorizing `identity:get_project(project_id=d0321a2271824734aa5388b0a228d7ed)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:18.195210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a0b70-4caa-44ac-a374-1e93dbc04296 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:18.197024 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3514/6998] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:48:18 2022] GET /identity/v3/projects/d0321a2271824734aa5388b0a228d7ed => generated 365 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:48:18.238435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfd0af-f6f7-4159-8702-168118b51503 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:18.238731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfd0af-f6f7-4159-8702-168118b51503 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:18.239019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfd0af-f6f7-4159-8702-168118b51503 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:18.240493 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3485/6999] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:48:18.245355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a0b70-4caa-44ac-a374-1e93dbc04296 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] Authenticating service token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:48:18.247108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1e1a0b70-4caa-44ac-a374-1e93dbc04296 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:18.266511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a0b70-4caa-44ac-a374-1e93dbc04296 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:18.275710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a0b70-4caa-44ac-a374-1e93dbc04296 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:18.280202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5407738-892c-4cbe-b907-4002bf0324cb tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54550e87b6f4438ca56732af4d5d8e7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0321a2271824734aa5388b0a228d7ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:18.281179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5407738-892c-4cbe-b907-4002bf0324cb tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:18.281655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5407738-892c-4cbe-b907-4002bf0324cb tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:18.281957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5407738-892c-4cbe-b907-4002bf0324cb tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] PATH_INFO: `/v3/projects/d0321a2271824734aa5388b0a228d7ed` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:18.283195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5407738-892c-4cbe-b907-4002bf0324cb tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] RBAC: Authorizing `identity:get_project(project_id=d0321a2271824734aa5388b0a228d7ed)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:18.285051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5407738-892c-4cbe-b907-4002bf0324cb tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:18.286908 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3515/7000] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:48:18 2022] GET /identity/v3/projects/d0321a2271824734aa5388b0a228d7ed => generated 365 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:48:18.325805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ca022-e46b-4dec-951d-83868fa9f00a None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:18.326105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ca022-e46b-4dec-951d-83868fa9f00a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:18.326393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ca022-e46b-4dec-951d-83868fa9f00a None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:18.327960 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3486/7001] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:48:18.332803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5407738-892c-4cbe-b907-4002bf0324cb tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] Authenticating service token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:48:18.348026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5407738-892c-4cbe-b907-4002bf0324cb tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:18.356913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5407738-892c-4cbe-b907-4002bf0324cb tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:18.361728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27343665-16a3-4bc1-9a87-bb36e39b4c25 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54550e87b6f4438ca56732af4d5d8e7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0321a2271824734aa5388b0a228d7ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:18.362591 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27343665-16a3-4bc1-9a87-bb36e39b4c25 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:18.362886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27343665-16a3-4bc1-9a87-bb36e39b4c25 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:18.363175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27343665-16a3-4bc1-9a87-bb36e39b4c25 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] PATH_INFO: `/v3/projects/d0321a2271824734aa5388b0a228d7ed` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:18.364419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27343665-16a3-4bc1-9a87-bb36e39b4c25 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] RBAC: Authorizing `identity:get_project(project_id=d0321a2271824734aa5388b0a228d7ed)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:18.366271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27343665-16a3-4bc1-9a87-bb36e39b4c25 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:18.368006 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3516/7002] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:48:18 2022] GET /identity/v3/projects/d0321a2271824734aa5388b0a228d7ed => generated 365 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:48:18.402970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc182cd0-0150-403a-9801-a8eb7baafa42 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:18.403353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc182cd0-0150-403a-9801-a8eb7baafa42 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:18.403727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc182cd0-0150-403a-9801-a8eb7baafa42 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:18.405330 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3487/7003] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:48:18.410208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27343665-16a3-4bc1-9a87-bb36e39b4c25 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] Authenticating service token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 10:48:18.425739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27343665-16a3-4bc1-9a87-bb36e39b4c25 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:18.434029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27343665-16a3-4bc1-9a87-bb36e39b4c25 tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:18.438797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172f1db-9fef-4e65-a83e-c8a68bf07e7d tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54550e87b6f4438ca56732af4d5d8e7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0321a2271824734aa5388b0a228d7ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:18.439659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172f1db-9fef-4e65-a83e-c8a68bf07e7d tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:18.439948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172f1db-9fef-4e65-a83e-c8a68bf07e7d tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:18.440233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172f1db-9fef-4e65-a83e-c8a68bf07e7d tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] PATH_INFO: `/v3/projects/d0321a2271824734aa5388b0a228d7ed` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:18.441492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172f1db-9fef-4e65-a83e-c8a68bf07e7d tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] RBAC: Authorizing `identity:get_project(project_id=d0321a2271824734aa5388b0a228d7ed)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:18.443262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172f1db-9fef-4e65-a83e-c8a68bf07e7d tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:18.445157 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3517/7004] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 10:48:18 2022] GET /identity/v3/projects/d0321a2271824734aa5388b0a228d7ed => generated 365 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:48:18.476106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc182cd0-0150-403a-9801-a8eb7baafa42 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:18.549882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc182cd0-0150-403a-9801-a8eb7baafa42 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:18.555171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fb7d3-6058-4bb5-b6df-23de454c0aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:18.560035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fb7d3-6058-4bb5-b6df-23de454c0aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:18.560035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fb7d3-6058-4bb5-b6df-23de454c0aca admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:18.560035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fb7d3-6058-4bb5-b6df-23de454c0aca admin admin] PATH_INFO: `/v3/users/54550e87b6f4438ca56732af4d5d8e7d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:18.560035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fb7d3-6058-4bb5-b6df-23de454c0aca admin admin] RBAC: Authorizing `identity:delete_user(user_id=54550e87b6f4438ca56732af4d5d8e7d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:18.560461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fb7d3-6058-4bb5-b6df-23de454c0aca admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:18.651589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172f1db-9fef-4e65-a83e-c8a68bf07e7d tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:18.653563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8172f1db-9fef-4e65-a83e-c8a68bf07e7d tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:18.669371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172f1db-9fef-4e65-a83e-c8a68bf07e7d tempest-QuotasTestJSON-2040926069 tempest-QuotasTestJSON-2040926069-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:18.674840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126928e8-0a70-404a-b0bf-c0688fc824ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:18.675719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126928e8-0a70-404a-b0bf-c0688fc824ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:18.676034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126928e8-0a70-404a-b0bf-c0688fc824ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:18.676342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126928e8-0a70-404a-b0bf-c0688fc824ce admin admin] PATH_INFO: `/v3/users/44a4647d87ca4f47a6aaeb8cb6312097` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:18.677592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126928e8-0a70-404a-b0bf-c0688fc824ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=44a4647d87ca4f47a6aaeb8cb6312097)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:18.679548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126928e8-0a70-404a-b0bf-c0688fc824ce admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:18.721854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-045fb7d3-6058-4bb5-b6df-23de454c0aca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54550e87b6f4438ca56732af4d5d8e7d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:18.734711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-045fb7d3-6058-4bb5-b6df-23de454c0aca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54550e87b6f4438ca56732af4d5d8e7d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:18.735669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-045fb7d3-6058-4bb5-b6df-23de454c0aca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54550e87b6f4438ca56732af4d5d8e7d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:18.745515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-045fb7d3-6058-4bb5-b6df-23de454c0aca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54550e87b6f4438ca56732af4d5d8e7d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:18.845648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-045fb7d3-6058-4bb5-b6df-23de454c0aca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54550e87b6f4438ca56732af4d5d8e7d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:18.852470 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3488/7005] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:48:18 2022] DELETE /identity/v3/users/54550e87b6f4438ca56732af4d5d8e7d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:18.856929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0aaf8-1f24-4469-81f8-a4ad050d351e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:18.857224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0aaf8-1f24-4469-81f8-a4ad050d351e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:18.857508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0aaf8-1f24-4469-81f8-a4ad050d351e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:18.875505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-94f0aaf8-1f24-4469-81f8-a4ad050d351e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:18.877102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-94f0aaf8-1f24-4469-81f8-a4ad050d351e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:18.910703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-126928e8-0a70-404a-b0bf-c0688fc824ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44a4647d87ca4f47a6aaeb8cb6312097'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:18.923163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-126928e8-0a70-404a-b0bf-c0688fc824ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44a4647d87ca4f47a6aaeb8cb6312097'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:18.924568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-126928e8-0a70-404a-b0bf-c0688fc824ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44a4647d87ca4f47a6aaeb8cb6312097'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:18.933872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-126928e8-0a70-404a-b0bf-c0688fc824ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44a4647d87ca4f47a6aaeb8cb6312097'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:18.940105 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3489/7006] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:48:18.959504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0aaf8-1f24-4469-81f8-a4ad050d351e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:18.960884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-94f0aaf8-1f24-4469-81f8-a4ad050d351e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:19.017568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-126928e8-0a70-404a-b0bf-c0688fc824ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44a4647d87ca4f47a6aaeb8cb6312097'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:19.018565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0aaf8-1f24-4469-81f8-a4ad050d351e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:19.022371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18913480-1323-476c-8a1a-88521d516d0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:19.023027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18913480-1323-476c-8a1a-88521d516d0d service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:19.023315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18913480-1323-476c-8a1a-88521d516d0d service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:19.023598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18913480-1323-476c-8a1a-88521d516d0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:19.024638 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3518/7007] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:48:18 2022] DELETE /identity/v3/users/44a4647d87ca4f47a6aaeb8cb6312097 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:48:19.028507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-18913480-1323-476c-8a1a-88521d516d0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:19.044537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18913480-1323-476c-8a1a-88521d516d0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:19.044537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18913480-1323-476c-8a1a-88521d516d0d service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:19.053601 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3490/7008] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:48:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:48:19.407811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126928e8-0a70-404a-b0bf-c0688fc824ce admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:19.409475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-126928e8-0a70-404a-b0bf-c0688fc824ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:19.479827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126928e8-0a70-404a-b0bf-c0688fc824ce admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:19.484817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377b629-21f5-4e19-ade3-12f2ffc23616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:19.485710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377b629-21f5-4e19-ade3-12f2ffc23616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:19.485994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377b629-21f5-4e19-ade3-12f2ffc23616 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:19.486273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377b629-21f5-4e19-ade3-12f2ffc23616 admin admin] PATH_INFO: `/v3/projects/4f0992eaa55c41c7b559208fa200a822` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:19.487447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377b629-21f5-4e19-ade3-12f2ffc23616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f0992eaa55c41c7b559208fa200a822)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:19.489430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377b629-21f5-4e19-ade3-12f2ffc23616 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:19.602142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18913480-1323-476c-8a1a-88521d516d0d service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:19.604206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-18913480-1323-476c-8a1a-88521d516d0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:19.619149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18913480-1323-476c-8a1a-88521d516d0d service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:19.624011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c8c87-755e-4764-93db-ba6a83e8d610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:19.625617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c8c87-755e-4764-93db-ba6a83e8d610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:19.625908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c8c87-755e-4764-93db-ba6a83e8d610 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:19.626193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c8c87-755e-4764-93db-ba6a83e8d610 admin admin] PATH_INFO: `/v3/projects/d0321a2271824734aa5388b0a228d7ed` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:19.627713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c8c87-755e-4764-93db-ba6a83e8d610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0321a2271824734aa5388b0a228d7ed)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:19.629742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c8c87-755e-4764-93db-ba6a83e8d610 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:19.642252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e377b629-21f5-4e19-ade3-12f2ffc23616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0992eaa55c41c7b559208fa200a822', 'request_id': 'req-e377b629-21f5-4e19-ade3-12f2ffc23616'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:19.736927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e377b629-21f5-4e19-ade3-12f2ffc23616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0992eaa55c41c7b559208fa200a822', 'request_id': 'req-e377b629-21f5-4e19-ade3-12f2ffc23616'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:19.743798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e377b629-21f5-4e19-ade3-12f2ffc23616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0992eaa55c41c7b559208fa200a822', 'request_id': 'req-e377b629-21f5-4e19-ade3-12f2ffc23616'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:19.758350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e377b629-21f5-4e19-ade3-12f2ffc23616 admin admin] The token cache is being invalidate because project 4f0992eaa55c41c7b559208fa200a822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:48:19.764725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e377b629-21f5-4e19-ade3-12f2ffc23616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:19.764725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e377b629-21f5-4e19-ade3-12f2ffc23616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:19.764725 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3519/7009] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:48:19 2022] DELETE /identity/v3/projects/4f0992eaa55c41c7b559208fa200a822 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:19.765730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377b629-21f5-4e19-ade3-12f2ffc23616 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:19.767208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e377b629-21f5-4e19-ade3-12f2ffc23616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:19.807733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1a2c8c87-755e-4764-93db-ba6a83e8d610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0321a2271824734aa5388b0a228d7ed', 'request_id': 'req-1a2c8c87-755e-4764-93db-ba6a83e8d610'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:19.815872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1a2c8c87-755e-4764-93db-ba6a83e8d610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0321a2271824734aa5388b0a228d7ed', 'request_id': 'req-1a2c8c87-755e-4764-93db-ba6a83e8d610'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:19.842720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377b629-21f5-4e19-ade3-12f2ffc23616 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:19.873060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1a2c8c87-755e-4764-93db-ba6a83e8d610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0321a2271824734aa5388b0a228d7ed', 'request_id': 'req-1a2c8c87-755e-4764-93db-ba6a83e8d610'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:19.885224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1a2c8c87-755e-4764-93db-ba6a83e8d610 admin admin] The token cache is being invalidate because project d0321a2271824734aa5388b0a228d7ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:48:19.885657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1a2c8c87-755e-4764-93db-ba6a83e8d610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:19.886418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1a2c8c87-755e-4764-93db-ba6a83e8d610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:19.888077 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3491/7010] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:48:19 2022] DELETE /identity/v3/projects/d0321a2271824734aa5388b0a228d7ed => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:48:19.895505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152196ea-6549-4fed-93f6-8475de06aa9c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:19.896114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152196ea-6549-4fed-93f6-8475de06aa9c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:19.896634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152196ea-6549-4fed-93f6-8475de06aa9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:19.914149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e1e7a-8056-44a8-9f4c-e8f6bb0bca34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:19.915754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e1e7a-8056-44a8-9f4c-e8f6bb0bca34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:19.916191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e1e7a-8056-44a8-9f4c-e8f6bb0bca34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:19.916352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-152196ea-6549-4fed-93f6-8475de06aa9c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:19.916910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e1e7a-8056-44a8-9f4c-e8f6bb0bca34 admin admin] PATH_INFO: `/v3/users/e963b7f66b5d4272844eb76b01518c2a` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:19.917621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-152196ea-6549-4fed-93f6-8475de06aa9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:19.918860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e1e7a-8056-44a8-9f4c-e8f6bb0bca34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e963b7f66b5d4272844eb76b01518c2a)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:19.921108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e1e7a-8056-44a8-9f4c-e8f6bb0bca34 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:19.926583 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3492/7011] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:48:19.935003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f3ca1-6ce3-4221-a8cc-1f0b9c2e65d4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:19.935299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f3ca1-6ce3-4221-a8cc-1f0b9c2e65d4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:19.935578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f3ca1-6ce3-4221-a8cc-1f0b9c2e65d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:19.957949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a38f3ca1-6ce3-4221-a8cc-1f0b9c2e65d4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:19.957949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a38f3ca1-6ce3-4221-a8cc-1f0b9c2e65d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:19.967470 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3493/7012] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:48:19.972501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f3ca1-6ce3-4221-a8cc-1f0b9c2e65d4 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:19.982169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f3ca1-6ce3-4221-a8cc-1f0b9c2e65d4 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:19.987486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0f0cc-b900-45be-8208-0ae8a176e044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:19.988139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0f0cc-b900-45be-8208-0ae8a176e044 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:19.988425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0f0cc-b900-45be-8208-0ae8a176e044 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:19.988739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0f0cc-b900-45be-8208-0ae8a176e044 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:19.989470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0f0cc-b900-45be-8208-0ae8a176e044 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:48:19.989780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0f0cc-b900-45be-8208-0ae8a176e044 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:19.991395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0f0cc-b900-45be-8208-0ae8a176e044 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:20.003473 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3494/7013] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:48:20.007910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0f0cc-b900-45be-8208-0ae8a176e044 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:20.017628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0f0cc-b900-45be-8208-0ae8a176e044 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:20.022634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb4833-d0dd-4d7e-8bc2-cd5de51a5d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:20.027568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb4833-d0dd-4d7e-8bc2-cd5de51a5d8e admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:20.027568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb4833-d0dd-4d7e-8bc2-cd5de51a5d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:20.027568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb4833-d0dd-4d7e-8bc2-cd5de51a5d8e admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:20.027568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb4833-d0dd-4d7e-8bc2-cd5de51a5d8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:20.027568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb4833-d0dd-4d7e-8bc2-cd5de51a5d8e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:20.121651 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3495/7014] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:48:20 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:48:20.128447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb4833-d0dd-4d7e-8bc2-cd5de51a5d8e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:20.167719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1b9e1e7a-8056-44a8-9f4c-e8f6bb0bca34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e963b7f66b5d4272844eb76b01518c2a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:20.204064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb4833-d0dd-4d7e-8bc2-cd5de51a5d8e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:20.204350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1b9e1e7a-8056-44a8-9f4c-e8f6bb0bca34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e963b7f66b5d4272844eb76b01518c2a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:20.205444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1b9e1e7a-8056-44a8-9f4c-e8f6bb0bca34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e963b7f66b5d4272844eb76b01518c2a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:20.209836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3300e2e-6012-49ec-9dcf-8800f1bf6231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:20.210448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3300e2e-6012-49ec-9dcf-8800f1bf6231 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:20.210729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3300e2e-6012-49ec-9dcf-8800f1bf6231 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:20.211006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3300e2e-6012-49ec-9dcf-8800f1bf6231 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:20.211691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3300e2e-6012-49ec-9dcf-8800f1bf6231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:20.212924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1b9e1e7a-8056-44a8-9f4c-e8f6bb0bca34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e963b7f66b5d4272844eb76b01518c2a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:20.218939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3300e2e-6012-49ec-9dcf-8800f1bf6231 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:20.284063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1b9e1e7a-8056-44a8-9f4c-e8f6bb0bca34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e963b7f66b5d4272844eb76b01518c2a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:20.290856 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3520/7015] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:48:19 2022] DELETE /identity/v3/users/e963b7f66b5d4272844eb76b01518c2a => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:48:20.322694 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3496/7016] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:48:20 2022] POST /identity/v3/users => generated 294 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:48:20.326501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e1e7a-8056-44a8-9f4c-e8f6bb0bca34 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:20.328115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1b9e1e7a-8056-44a8-9f4c-e8f6bb0bca34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:20.451471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e1e7a-8056-44a8-9f4c-e8f6bb0bca34 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:20.457755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f414915-b51e-4772-8fbd-2cfeacfd00a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:20.459594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f414915-b51e-4772-8fbd-2cfeacfd00a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:20.460117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f414915-b51e-4772-8fbd-2cfeacfd00a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:20.460586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f414915-b51e-4772-8fbd-2cfeacfd00a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:20.462014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f414915-b51e-4772-8fbd-2cfeacfd00a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:20.464058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f414915-b51e-4772-8fbd-2cfeacfd00a2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:20.481983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3300e2e-6012-49ec-9dcf-8800f1bf6231 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:20.489620 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3521/7017] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:48:20.494527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3300e2e-6012-49ec-9dcf-8800f1bf6231 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:20.500139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331b355-868d-4199-a8d0-43dfc19efe02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:20.501103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331b355-868d-4199-a8d0-43dfc19efe02 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:20.501977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331b355-868d-4199-a8d0-43dfc19efe02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:20.502759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331b355-868d-4199-a8d0-43dfc19efe02 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:20.503672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331b355-868d-4199-a8d0-43dfc19efe02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:20.506025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331b355-868d-4199-a8d0-43dfc19efe02 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:20.524279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f414915-b51e-4772-8fbd-2cfeacfd00a2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:20.535520 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3497/7018] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:48:20.537462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f414915-b51e-4772-8fbd-2cfeacfd00a2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:20.554138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ac75d-0004-4d77-b683-c64eb02531a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:20.555508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ac75d-0004-4d77-b683-c64eb02531a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:20.564015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ac75d-0004-4d77-b683-c64eb02531a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:20.564015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ac75d-0004-4d77-b683-c64eb02531a1 admin admin] PATH_INFO: `/v3/projects/d9ecf7ac6e6d49cb9a8bcc1e1fd52c70/users/e6453b094ecf4541bba721b02855f4fc/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:20.575607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ac75d-0004-4d77-b683-c64eb02531a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ecf7ac6e6d49cb9a8bcc1e1fd52c70, user_id=e6453b094ecf4541bba721b02855f4fc, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:20.579523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ac75d-0004-4d77-b683-c64eb02531a1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:20.651318 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3522/7019] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:48:20 2022] PUT /identity/v3/projects/d9ecf7ac6e6d49cb9a8bcc1e1fd52c70/users/e6453b094ecf4541bba721b02855f4fc/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:20.664324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4240498-e4e2-482c-9464-0059b44acbb7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:20.664324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4240498-e4e2-482c-9464-0059b44acbb7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:20.664324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4240498-e4e2-482c-9464-0059b44acbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:20.679239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f4240498-e4e2-482c-9464-0059b44acbb7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:20.680444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f4240498-e4e2-482c-9464-0059b44acbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:20.741355 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3498/7020] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:20.741544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ac75d-0004-4d77-b683-c64eb02531a1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:20.741544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-955ac75d-0004-4d77-b683-c64eb02531a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:20.747849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4240498-e4e2-482c-9464-0059b44acbb7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:20.749252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f4240498-e4e2-482c-9464-0059b44acbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:20.755080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ac75d-0004-4d77-b683-c64eb02531a1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:20.782483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2a1c9-c7c5-4b23-8e24-239acd5d82c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:20.783371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2a1c9-c7c5-4b23-8e24-239acd5d82c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:20.784734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2a1c9-c7c5-4b23-8e24-239acd5d82c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:20.785046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2a1c9-c7c5-4b23-8e24-239acd5d82c1 admin admin] PATH_INFO: `/v3/projects/6bd05308a4524be2a0e82288e790ce70` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:20.788179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2a1c9-c7c5-4b23-8e24-239acd5d82c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd05308a4524be2a0e82288e790ce70)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:20.790149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2a1c9-c7c5-4b23-8e24-239acd5d82c1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:20.819246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4240498-e4e2-482c-9464-0059b44acbb7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:20.823120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38998941-2c3d-4628-9751-ea7c2bbbde56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:20.823768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38998941-2c3d-4628-9751-ea7c2bbbde56 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:20.824065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38998941-2c3d-4628-9751-ea7c2bbbde56 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:20.824337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38998941-2c3d-4628-9751-ea7c2bbbde56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:20.834300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38998941-2c3d-4628-9751-ea7c2bbbde56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:20.835737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38998941-2c3d-4628-9751-ea7c2bbbde56 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:20.845268 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3499/7021] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:48:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:48:20.938016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75e2a1c9-c7c5-4b23-8e24-239acd5d82c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd05308a4524be2a0e82288e790ce70', 'request_id': 'req-75e2a1c9-c7c5-4b23-8e24-239acd5d82c1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:21.011264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75e2a1c9-c7c5-4b23-8e24-239acd5d82c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd05308a4524be2a0e82288e790ce70', 'request_id': 'req-75e2a1c9-c7c5-4b23-8e24-239acd5d82c1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:21.026489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75e2a1c9-c7c5-4b23-8e24-239acd5d82c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd05308a4524be2a0e82288e790ce70', 'request_id': 'req-75e2a1c9-c7c5-4b23-8e24-239acd5d82c1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:21.028759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75e2a1c9-c7c5-4b23-8e24-239acd5d82c1 admin admin] The token cache is being invalidate because project 6bd05308a4524be2a0e82288e790ce70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:48:21.029054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75e2a1c9-c7c5-4b23-8e24-239acd5d82c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:21.029730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75e2a1c9-c7c5-4b23-8e24-239acd5d82c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:21.031397 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3523/7022] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:48:20 2022] DELETE /identity/v3/projects/6bd05308a4524be2a0e82288e790ce70 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:48:21.036582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77745e7e-5b33-4268-9582-ec67c7a36a30 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:21.036897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77745e7e-5b33-4268-9582-ec67c7a36a30 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:21.037243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77745e7e-5b33-4268-9582-ec67c7a36a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:21.055126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-77745e7e-5b33-4268-9582-ec67c7a36a30 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:21.056352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-77745e7e-5b33-4268-9582-ec67c7a36a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:21.123243 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3500/7023] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:21.132237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034c2d1-c2b9-4b6a-be47-6555a044283e None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:21.132535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034c2d1-c2b9-4b6a-be47-6555a044283e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:21.132854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034c2d1-c2b9-4b6a-be47-6555a044283e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:21.151354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a034c2d1-c2b9-4b6a-be47-6555a044283e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:21.152663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a034c2d1-c2b9-4b6a-be47-6555a044283e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:21.161392 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3524/7024] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:48:21.165720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77745e7e-5b33-4268-9582-ec67c7a36a30 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:21.176840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77745e7e-5b33-4268-9582-ec67c7a36a30 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:21.182297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05095b0e-c101-49ab-be67-2b3d99a404a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:21.182972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05095b0e-c101-49ab-be67-2b3d99a404a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:21.183253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05095b0e-c101-49ab-be67-2b3d99a404a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:21.184649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05095b0e-c101-49ab-be67-2b3d99a404a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:21.184649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05095b0e-c101-49ab-be67-2b3d99a404a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:48:21.184649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05095b0e-c101-49ab-be67-2b3d99a404a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:21.186429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05095b0e-c101-49ab-be67-2b3d99a404a8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:21.203098 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3501/7025] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:48:21.207599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034c2d1-c2b9-4b6a-be47-6555a044283e None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:21.218212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034c2d1-c2b9-4b6a-be47-6555a044283e None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:21.225372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e4a50-3987-4e12-9a45-3389a31badd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:21.225372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e4a50-3987-4e12-9a45-3389a31badd0 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:21.225372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e4a50-3987-4e12-9a45-3389a31badd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:21.226071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e4a50-3987-4e12-9a45-3389a31badd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:21.226416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e4a50-3987-4e12-9a45-3389a31badd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:21.228471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e4a50-3987-4e12-9a45-3389a31badd0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:21.340184 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3525/7026] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:48:21 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:48:21.342992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05095b0e-c101-49ab-be67-2b3d99a404a8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:21.353180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05095b0e-c101-49ab-be67-2b3d99a404a8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:21.415105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50a73b-e013-48b5-bd48-2ffbd9c652aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:21.416334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50a73b-e013-48b5-bd48-2ffbd9c652aa admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:21.416334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50a73b-e013-48b5-bd48-2ffbd9c652aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:21.416572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50a73b-e013-48b5-bd48-2ffbd9c652aa admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:21.417096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50a73b-e013-48b5-bd48-2ffbd9c652aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:21.419024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50a73b-e013-48b5-bd48-2ffbd9c652aa admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:21.477655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a305a9-ea88-444b-837a-ac7b3fee30c7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:21.477953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a305a9-ea88-444b-837a-ac7b3fee30c7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:21.478242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a305a9-ea88-444b-837a-ac7b3fee30c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:21.495059 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3502/7027] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:48:21 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:48:21.499140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50a73b-e013-48b5-bd48-2ffbd9c652aa admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:21.511448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50a73b-e013-48b5-bd48-2ffbd9c652aa admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:21.516868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15407cf3-6e3a-4601-99a0-f532345f31f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:21.517566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15407cf3-6e3a-4601-99a0-f532345f31f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:21.521975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15407cf3-6e3a-4601-99a0-f532345f31f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:21.521975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15407cf3-6e3a-4601-99a0-f532345f31f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:21.521975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15407cf3-6e3a-4601-99a0-f532345f31f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:21.521975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15407cf3-6e3a-4601-99a0-f532345f31f5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:21.522398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-42a305a9-ea88-444b-837a-ac7b3fee30c7 None None] MFA Rules not processed for user `e6453b094ecf4541bba721b02855f4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:21.523408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-42a305a9-ea88-444b-837a-ac7b3fee30c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:21.531913 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3503/7028] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:48:21.535571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15407cf3-6e3a-4601-99a0-f532345f31f5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:21.546335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15407cf3-6e3a-4601-99a0-f532345f31f5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:21.551797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7354b-977c-433f-9101-711a52044f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:21.552485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7354b-977c-433f-9101-711a52044f49 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:21.552821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7354b-977c-433f-9101-711a52044f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:21.553248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7354b-977c-433f-9101-711a52044f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:21.554003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7354b-977c-433f-9101-711a52044f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:21.555604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7354b-977c-433f-9101-711a52044f49 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:21.567323 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3504/7029] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:48:21.571178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7354b-977c-433f-9101-711a52044f49 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:21.581485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7354b-977c-433f-9101-711a52044f49 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:21.587374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee532dd-7b1f-4b7c-b4f0-5bd505de4733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:21.587374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee532dd-7b1f-4b7c-b4f0-5bd505de4733 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:21.587374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee532dd-7b1f-4b7c-b4f0-5bd505de4733 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:21.587714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee532dd-7b1f-4b7c-b4f0-5bd505de4733 admin admin] PATH_INFO: `/v3/projects/ad8045ed60794216be781bda3c42b614/users/c4f23489acf14e5b941be884d1b24797/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:21.597967 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3526/7030] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:48:21.605306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee532dd-7b1f-4b7c-b4f0-5bd505de4733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad8045ed60794216be781bda3c42b614, user_id=c4f23489acf14e5b941be884d1b24797, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:21.608346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee532dd-7b1f-4b7c-b4f0-5bd505de4733 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:21.608867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd163fb-6b2f-4f82-a880-da721c0220f5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:21.609650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd163fb-6b2f-4f82-a880-da721c0220f5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:21.609928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd163fb-6b2f-4f82-a880-da721c0220f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:21.628877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2cd163fb-6b2f-4f82-a880-da721c0220f5 None None] MFA Rules not processed for user `e6453b094ecf4541bba721b02855f4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:21.630084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2cd163fb-6b2f-4f82-a880-da721c0220f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:21.637321 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3527/7031] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:48:21.650067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd163fb-6b2f-4f82-a880-da721c0220f5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:21.651447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2cd163fb-6b2f-4f82-a880-da721c0220f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:21.711628 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3505/7032] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:48:21 2022] PUT /identity/v3/projects/ad8045ed60794216be781bda3c42b614/users/c4f23489acf14e5b941be884d1b24797/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:48:21.721970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4f4df-c2e0-4dd6-bbe7-03f37ff81866 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:21.730472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4f4df-c2e0-4dd6-bbe7-03f37ff81866 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:21.730809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4f4df-c2e0-4dd6-bbe7-03f37ff81866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:21.744018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd163fb-6b2f-4f82-a880-da721c0220f5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:21.761317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-62a4f4df-c2e0-4dd6-bbe7-03f37ff81866 None None] MFA Rules not processed for user `c4f23489acf14e5b941be884d1b24797`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:21.762748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-62a4f4df-c2e0-4dd6-bbe7-03f37ff81866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:21.825865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d6684-87f9-4c9c-973a-1d6006afd614 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:21.826524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d6684-87f9-4c9c-973a-1d6006afd614 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:21.826806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d6684-87f9-4c9c-973a-1d6006afd614 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:21.827091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d6684-87f9-4c9c-973a-1d6006afd614 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:21.840696 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3506/7033] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:48:21.887680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d6684-87f9-4c9c-973a-1d6006afd614 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:21.889361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d6684-87f9-4c9c-973a-1d6006afd614 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:21.899059 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3528/7034] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:48:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:48:21.967000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4f4df-c2e0-4dd6-bbe7-03f37ff81866 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:21.969201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-62a4f4df-c2e0-4dd6-bbe7-03f37ff81866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:21.986750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4f4df-c2e0-4dd6-bbe7-03f37ff81866 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:21.992457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132188a-01bd-497d-9a8e-ec6bb3071c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:21.993135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132188a-01bd-497d-9a8e-ec6bb3071c98 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:21.993422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132188a-01bd-497d-9a8e-ec6bb3071c98 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:21.993703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132188a-01bd-497d-9a8e-ec6bb3071c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:22.002112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132188a-01bd-497d-9a8e-ec6bb3071c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:22.003746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132188a-01bd-497d-9a8e-ec6bb3071c98 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:22.012885 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3507/7035] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:48:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:48:22.833034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d6684-87f9-4c9c-973a-1d6006afd614 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:22.835054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-356d6684-87f9-4c9c-973a-1d6006afd614 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:22.934622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d6684-87f9-4c9c-973a-1d6006afd614 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:22.945383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55990dcc-a2cb-4d82-8d83-ad5988235498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:22.946341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55990dcc-a2cb-4d82-8d83-ad5988235498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:22.946646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55990dcc-a2cb-4d82-8d83-ad5988235498 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:22.947146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55990dcc-a2cb-4d82-8d83-ad5988235498 admin admin] PATH_INFO: `/v3/users/e6453b094ecf4541bba721b02855f4fc` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:22.948647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55990dcc-a2cb-4d82-8d83-ad5988235498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6453b094ecf4541bba721b02855f4fc)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:22.950590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55990dcc-a2cb-4d82-8d83-ad5988235498 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:23.185023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-55990dcc-a2cb-4d82-8d83-ad5988235498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6453b094ecf4541bba721b02855f4fc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:23.196295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-55990dcc-a2cb-4d82-8d83-ad5988235498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6453b094ecf4541bba721b02855f4fc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:23.197034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-55990dcc-a2cb-4d82-8d83-ad5988235498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6453b094ecf4541bba721b02855f4fc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:23.203746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-55990dcc-a2cb-4d82-8d83-ad5988235498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6453b094ecf4541bba721b02855f4fc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:23.286794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-55990dcc-a2cb-4d82-8d83-ad5988235498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6453b094ecf4541bba721b02855f4fc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:23.304815 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3529/7036] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:48:22 2022] DELETE /identity/v3/users/e6453b094ecf4541bba721b02855f4fc => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:23.573343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132188a-01bd-497d-9a8e-ec6bb3071c98 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:23.585828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132188a-01bd-497d-9a8e-ec6bb3071c98 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:23.648061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09d309-e597-41c8-b539-cf9021358702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:23.648962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09d309-e597-41c8-b539-cf9021358702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:23.649250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09d309-e597-41c8-b539-cf9021358702 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:23.649558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09d309-e597-41c8-b539-cf9021358702 admin admin] PATH_INFO: `/v3/projects/d9ecf7ac6e6d49cb9a8bcc1e1fd52c70` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:23.650755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09d309-e597-41c8-b539-cf9021358702 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9ecf7ac6e6d49cb9a8bcc1e1fd52c70)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:23.652788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09d309-e597-41c8-b539-cf9021358702 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:23.784361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7c09d309-e597-41c8-b539-cf9021358702 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9ecf7ac6e6d49cb9a8bcc1e1fd52c70', 'request_id': 'req-7c09d309-e597-41c8-b539-cf9021358702'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:23.790652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7c09d309-e597-41c8-b539-cf9021358702 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9ecf7ac6e6d49cb9a8bcc1e1fd52c70', 'request_id': 'req-7c09d309-e597-41c8-b539-cf9021358702'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:23.813815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55990dcc-a2cb-4d82-8d83-ad5988235498 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:23.815315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-55990dcc-a2cb-4d82-8d83-ad5988235498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:23.829029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55990dcc-a2cb-4d82-8d83-ad5988235498 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:23.878924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7c09d309-e597-41c8-b539-cf9021358702 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9ecf7ac6e6d49cb9a8bcc1e1fd52c70', 'request_id': 'req-7c09d309-e597-41c8-b539-cf9021358702'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:23.885220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39245caf-8474-4ad5-9d74-01252e2d905c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:23.886114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39245caf-8474-4ad5-9d74-01252e2d905c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:23.886402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39245caf-8474-4ad5-9d74-01252e2d905c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:23.886683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39245caf-8474-4ad5-9d74-01252e2d905c admin admin] PATH_INFO: `/v3/users/88360efcaac7437da89004995e392caa` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:23.887906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39245caf-8474-4ad5-9d74-01252e2d905c admin admin] RBAC: Authorizing `identity:delete_user(user_id=88360efcaac7437da89004995e392caa)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:23.889962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39245caf-8474-4ad5-9d74-01252e2d905c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:23.895984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7c09d309-e597-41c8-b539-cf9021358702 admin admin] The token cache is being invalidate because project d9ecf7ac6e6d49cb9a8bcc1e1fd52c70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:48:23.896402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7c09d309-e597-41c8-b539-cf9021358702 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:23.901464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7c09d309-e597-41c8-b539-cf9021358702 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:23.907801 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3508/7037] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:48:23 2022] DELETE /identity/v3/projects/d9ecf7ac6e6d49cb9a8bcc1e1fd52c70 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:23.913208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883f17e-c228-430b-b518-23f3feb262f8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:23.913568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883f17e-c228-430b-b518-23f3feb262f8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:23.913856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883f17e-c228-430b-b518-23f3feb262f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:23.933766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d883f17e-c228-430b-b518-23f3feb262f8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:23.934972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d883f17e-c228-430b-b518-23f3feb262f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:23.943727 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3509/7038] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:23.950927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e23535-91fd-4db9-9f30-3d083ac53b45 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:23.951215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e23535-91fd-4db9-9f30-3d083ac53b45 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:23.951493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e23535-91fd-4db9-9f30-3d083ac53b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:23.970532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-69e23535-91fd-4db9-9f30-3d083ac53b45 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:23.971719 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-69e23535-91fd-4db9-9f30-3d083ac53b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:23.979902 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3510/7039] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:48:23.984134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e23535-91fd-4db9-9f30-3d083ac53b45 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:23.993746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e23535-91fd-4db9-9f30-3d083ac53b45 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:23.998840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ccaad-43da-4ee0-99a2-96c56088fbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:24.000244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ccaad-43da-4ee0-99a2-96c56088fbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:24.000530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ccaad-43da-4ee0-99a2-96c56088fbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:24.000834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ccaad-43da-4ee0-99a2-96c56088fbb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:24.001562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ccaad-43da-4ee0-99a2-96c56088fbb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:48:24.002131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ccaad-43da-4ee0-99a2-96c56088fbb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:24.003815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ccaad-43da-4ee0-99a2-96c56088fbb3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:24.016629 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3511/7040] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:48:24.021004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ccaad-43da-4ee0-99a2-96c56088fbb3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:24.031888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ccaad-43da-4ee0-99a2-96c56088fbb3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:24.037539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ba2c0-ba70-4264-b723-47c7ccc44b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:24.038439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ba2c0-ba70-4264-b723-47c7ccc44b45 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:24.038683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ba2c0-ba70-4264-b723-47c7ccc44b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:24.038956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ba2c0-ba70-4264-b723-47c7ccc44b45 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:24.039650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ba2c0-ba70-4264-b723-47c7ccc44b45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:24.041780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ba2c0-ba70-4264-b723-47c7ccc44b45 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:24.093470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-39245caf-8474-4ad5-9d74-01252e2d905c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88360efcaac7437da89004995e392caa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:24.112095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-39245caf-8474-4ad5-9d74-01252e2d905c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88360efcaac7437da89004995e392caa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:24.112977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-39245caf-8474-4ad5-9d74-01252e2d905c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88360efcaac7437da89004995e392caa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:24.119654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-39245caf-8474-4ad5-9d74-01252e2d905c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88360efcaac7437da89004995e392caa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:24.189472 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3512/7041] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:48:24 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:48:24.190530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ba2c0-ba70-4264-b723-47c7ccc44b45 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:24.222844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-39245caf-8474-4ad5-9d74-01252e2d905c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88360efcaac7437da89004995e392caa'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:24.230119 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3530/7042] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:48:23 2022] DELETE /identity/v3/users/88360efcaac7437da89004995e392caa => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:48:24.235310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc022c1-47c2-4c83-9c00-5a4c6e78337c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:24.235850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc022c1-47c2-4c83-9c00-5a4c6e78337c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:24.236361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc022c1-47c2-4c83-9c00-5a4c6e78337c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:24.261630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ba2c0-ba70-4264-b723-47c7ccc44b45 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:24.263385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3cc022c1-47c2-4c83-9c00-5a4c6e78337c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:24.264816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3cc022c1-47c2-4c83-9c00-5a4c6e78337c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:24.331288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5bab4-b4a5-4443-8ed4-38a423d4c27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:24.332576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5bab4-b4a5-4443-8ed4-38a423d4c27c admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:24.332945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5bab4-b4a5-4443-8ed4-38a423d4c27c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:24.333240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5bab4-b4a5-4443-8ed4-38a423d4c27c admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:24.333934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5bab4-b4a5-4443-8ed4-38a423d4c27c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:24.336646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5bab4-b4a5-4443-8ed4-38a423d4c27c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:24.341904 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3531/7043] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:24.352063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc022c1-47c2-4c83-9c00-5a4c6e78337c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:24.353503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3cc022c1-47c2-4c83-9c00-5a4c6e78337c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:24.403453 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3513/7044] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:48:24 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:48:24.404504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5bab4-b4a5-4443-8ed4-38a423d4c27c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:24.406180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a6a5bab4-b4a5-4443-8ed4-38a423d4c27c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:24.411550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc022c1-47c2-4c83-9c00-5a4c6e78337c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:24.415288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51d88e-6acf-4949-9d7f-69c2f095ecb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:24.416034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51d88e-6acf-4949-9d7f-69c2f095ecb5 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:24.416262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51d88e-6acf-4949-9d7f-69c2f095ecb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:24.416722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51d88e-6acf-4949-9d7f-69c2f095ecb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:24.418494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5bab4-b4a5-4443-8ed4-38a423d4c27c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:24.423836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa433e-6f88-41fb-8cae-d12c0371cafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:24.424495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa433e-6f88-41fb-8cae-d12c0371cafc admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:24.424810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa433e-6f88-41fb-8cae-d12c0371cafc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:24.425091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa433e-6f88-41fb-8cae-d12c0371cafc admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:24.425872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa433e-6f88-41fb-8cae-d12c0371cafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:24.427081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51d88e-6acf-4949-9d7f-69c2f095ecb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:24.427442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa433e-6f88-41fb-8cae-d12c0371cafc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:24.428518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51d88e-6acf-4949-9d7f-69c2f095ecb5 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:24.438330 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3514/7045] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:48:24.439093 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3532/7046] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:48:24.442102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa433e-6f88-41fb-8cae-d12c0371cafc admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:24.451807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa433e-6f88-41fb-8cae-d12c0371cafc admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:24.456642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802549b-fd23-4f91-b776-b54fce08e779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:24.457413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802549b-fd23-4f91-b776-b54fce08e779 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:24.457700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802549b-fd23-4f91-b776-b54fce08e779 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:24.457977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802549b-fd23-4f91-b776-b54fce08e779 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:24.458806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802549b-fd23-4f91-b776-b54fce08e779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:24.461013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802549b-fd23-4f91-b776-b54fce08e779 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:24.472177 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3515/7047] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:48:24.476672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51d88e-6acf-4949-9d7f-69c2f095ecb5 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:24.487061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51d88e-6acf-4949-9d7f-69c2f095ecb5 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:24.492149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d67229-06e9-4d6b-8e13-090cc3b20cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:24.493087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d67229-06e9-4d6b-8e13-090cc3b20cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:24.493378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d67229-06e9-4d6b-8e13-090cc3b20cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:24.493662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d67229-06e9-4d6b-8e13-090cc3b20cd1 admin admin] PATH_INFO: `/v3/projects/2257323c692e4608b9a5468b7aa57846/users/bb25448d45ac488797f59e828cafdb22/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:24.509832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d67229-06e9-4d6b-8e13-090cc3b20cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2257323c692e4608b9a5468b7aa57846, user_id=bb25448d45ac488797f59e828cafdb22, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:24.512710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d67229-06e9-4d6b-8e13-090cc3b20cd1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:24.609693 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3533/7048] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:48:24 2022] PUT /identity/v3/projects/2257323c692e4608b9a5468b7aa57846/users/bb25448d45ac488797f59e828cafdb22/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:24.614889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bc2f4-f260-4de8-9eb0-9ac308e5807b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:24.615362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bc2f4-f260-4de8-9eb0-9ac308e5807b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:24.615596 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bc2f4-f260-4de8-9eb0-9ac308e5807b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:24.633510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a49bc2f4-f260-4de8-9eb0-9ac308e5807b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:24.634953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a49bc2f4-f260-4de8-9eb0-9ac308e5807b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:24.698277 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3516/7049] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:24.708786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d67229-06e9-4d6b-8e13-090cc3b20cd1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:24.710648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c1d67229-06e9-4d6b-8e13-090cc3b20cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:24.769326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d67229-06e9-4d6b-8e13-090cc3b20cd1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:24.772997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d360f06-147c-4d9b-aaba-a647189c2c18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:24.773645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d360f06-147c-4d9b-aaba-a647189c2c18 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:24.773975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d360f06-147c-4d9b-aaba-a647189c2c18 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:24.774253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d360f06-147c-4d9b-aaba-a647189c2c18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:24.783625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d360f06-147c-4d9b-aaba-a647189c2c18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:24.785163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d360f06-147c-4d9b-aaba-a647189c2c18 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:24.794887 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3534/7050] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:48:24.865620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bc2f4-f260-4de8-9eb0-9ac308e5807b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:24.867267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a49bc2f4-f260-4de8-9eb0-9ac308e5807b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:24.881449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bc2f4-f260-4de8-9eb0-9ac308e5807b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:24.886546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae755c4-02e4-4d3d-b6c0-0e52f78da3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:24.887537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae755c4-02e4-4d3d-b6c0-0e52f78da3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:24.887822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae755c4-02e4-4d3d-b6c0-0e52f78da3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:24.888098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae755c4-02e4-4d3d-b6c0-0e52f78da3ba admin admin] PATH_INFO: `/v3/projects/c197dec70ede42cea499386f26da34b3` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:24.889342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae755c4-02e4-4d3d-b6c0-0e52f78da3ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=c197dec70ede42cea499386f26da34b3)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:24.892048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae755c4-02e4-4d3d-b6c0-0e52f78da3ba admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:25.004548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cae755c4-02e4-4d3d-b6c0-0e52f78da3ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c197dec70ede42cea499386f26da34b3', 'request_id': 'req-cae755c4-02e4-4d3d-b6c0-0e52f78da3ba'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:25.011451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cae755c4-02e4-4d3d-b6c0-0e52f78da3ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c197dec70ede42cea499386f26da34b3', 'request_id': 'req-cae755c4-02e4-4d3d-b6c0-0e52f78da3ba'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:25.106846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cae755c4-02e4-4d3d-b6c0-0e52f78da3ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c197dec70ede42cea499386f26da34b3', 'request_id': 'req-cae755c4-02e4-4d3d-b6c0-0e52f78da3ba'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:25.117127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cae755c4-02e4-4d3d-b6c0-0e52f78da3ba admin admin] The token cache is being invalidate because project c197dec70ede42cea499386f26da34b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:48:25.117422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cae755c4-02e4-4d3d-b6c0-0e52f78da3ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:25.118078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cae755c4-02e4-4d3d-b6c0-0e52f78da3ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:25.119700 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3517/7051] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:48:24 2022] DELETE /identity/v3/projects/c197dec70ede42cea499386f26da34b3 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:25.123649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d360f06-147c-4d9b-aaba-a647189c2c18 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:25.136295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d360f06-147c-4d9b-aaba-a647189c2c18 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:25.198617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7287b6-1727-4637-bfc6-1ef8b4db5341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:25.199862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7287b6-1727-4637-bfc6-1ef8b4db5341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:25.200416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7287b6-1727-4637-bfc6-1ef8b4db5341 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:25.200748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7287b6-1727-4637-bfc6-1ef8b4db5341 admin admin] PATH_INFO: `/v3/users/9bb1836170dc4d1185c4718cd06d8f29` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:25.208594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7287b6-1727-4637-bfc6-1ef8b4db5341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bb1836170dc4d1185c4718cd06d8f29)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:25.210621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7287b6-1727-4637-bfc6-1ef8b4db5341 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:25.446786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a7287b6-1727-4637-bfc6-1ef8b4db5341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bb1836170dc4d1185c4718cd06d8f29'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:25.470203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a7287b6-1727-4637-bfc6-1ef8b4db5341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bb1836170dc4d1185c4718cd06d8f29'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:25.471255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a7287b6-1727-4637-bfc6-1ef8b4db5341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bb1836170dc4d1185c4718cd06d8f29'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:25.479392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a7287b6-1727-4637-bfc6-1ef8b4db5341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bb1836170dc4d1185c4718cd06d8f29'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:25.592977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5a7287b6-1727-4637-bfc6-1ef8b4db5341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bb1836170dc4d1185c4718cd06d8f29'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:25.605272 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3535/7052] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:48:25 2022] DELETE /identity/v3/users/9bb1836170dc4d1185c4718cd06d8f29 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:48:26.061244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae755c4-02e4-4d3d-b6c0-0e52f78da3ba admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:26.061244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cae755c4-02e4-4d3d-b6c0-0e52f78da3ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:26.070729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae755c4-02e4-4d3d-b6c0-0e52f78da3ba admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:26.142278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce6a98-d0da-4ac8-b810-8ce633f282af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:26.143142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce6a98-d0da-4ac8-b810-8ce633f282af admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:26.143424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce6a98-d0da-4ac8-b810-8ce633f282af admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:26.143703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce6a98-d0da-4ac8-b810-8ce633f282af admin admin] PATH_INFO: `/v3/projects/809e00b1c5ed41119841f22f7f028251` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:26.144986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce6a98-d0da-4ac8-b810-8ce633f282af admin admin] RBAC: Authorizing `identity:delete_project(project_id=809e00b1c5ed41119841f22f7f028251)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:26.146992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce6a98-d0da-4ac8-b810-8ce633f282af admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:26.304049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0dce6a98-d0da-4ac8-b810-8ce633f282af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '809e00b1c5ed41119841f22f7f028251', 'request_id': 'req-0dce6a98-d0da-4ac8-b810-8ce633f282af'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:26.310185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0dce6a98-d0da-4ac8-b810-8ce633f282af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '809e00b1c5ed41119841f22f7f028251', 'request_id': 'req-0dce6a98-d0da-4ac8-b810-8ce633f282af'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:26.393936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0dce6a98-d0da-4ac8-b810-8ce633f282af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '809e00b1c5ed41119841f22f7f028251', 'request_id': 'req-0dce6a98-d0da-4ac8-b810-8ce633f282af'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:26.407289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0dce6a98-d0da-4ac8-b810-8ce633f282af admin admin] The token cache is being invalidate because project 809e00b1c5ed41119841f22f7f028251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:48:26.407587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0dce6a98-d0da-4ac8-b810-8ce633f282af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:26.408274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0dce6a98-d0da-4ac8-b810-8ce633f282af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:26.409951 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3518/7053] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:48:26 2022] DELETE /identity/v3/projects/809e00b1c5ed41119841f22f7f028251 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:26.416647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643600af-7e6f-4510-b3f8-3621816a0b7c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:26.417111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643600af-7e6f-4510-b3f8-3621816a0b7c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:26.417111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643600af-7e6f-4510-b3f8-3621816a0b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:26.441963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-643600af-7e6f-4510-b3f8-3621816a0b7c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:26.446680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-643600af-7e6f-4510-b3f8-3621816a0b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:26.524810 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3536/7054] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:48:26.532056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ee4cc-aabc-44d4-a1b0-171a83ca4fe8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:26.532290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ee4cc-aabc-44d4-a1b0-171a83ca4fe8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:26.534183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ee4cc-aabc-44d4-a1b0-171a83ca4fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:26.572271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e72ee4cc-aabc-44d4-a1b0-171a83ca4fe8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:26.572271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e72ee4cc-aabc-44d4-a1b0-171a83ca4fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:26.572271 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3519/7055] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:26.577105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643600af-7e6f-4510-b3f8-3621816a0b7c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:26.588572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643600af-7e6f-4510-b3f8-3621816a0b7c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:26.593813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486b82d-9748-4419-84d7-eb5d540d0766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:26.594862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486b82d-9748-4419-84d7-eb5d540d0766 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:26.595157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486b82d-9748-4419-84d7-eb5d540d0766 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:26.595442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486b82d-9748-4419-84d7-eb5d540d0766 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:26.596199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486b82d-9748-4419-84d7-eb5d540d0766 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:48:26.596557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486b82d-9748-4419-84d7-eb5d540d0766 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:26.601603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486b82d-9748-4419-84d7-eb5d540d0766 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:26.612409 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3537/7056] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:48:26.616555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ee4cc-aabc-44d4-a1b0-171a83ca4fe8 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:26.628886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ee4cc-aabc-44d4-a1b0-171a83ca4fe8 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:26.634854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dc15b-535c-41d8-bdd7-2a381e45ebfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:26.635883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dc15b-535c-41d8-bdd7-2a381e45ebfc admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:26.636343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dc15b-535c-41d8-bdd7-2a381e45ebfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:26.636843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dc15b-535c-41d8-bdd7-2a381e45ebfc admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:26.637929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636dc15b-535c-41d8-bdd7-2a381e45ebfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:26.641766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636dc15b-535c-41d8-bdd7-2a381e45ebfc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:26.793971 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3520/7057] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:48:26 2022] POST /identity/v3/projects => generated 359 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:48:26.795614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486b82d-9748-4419-84d7-eb5d540d0766 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:26.814821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486b82d-9748-4419-84d7-eb5d540d0766 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:26.896362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e9a52-5ea8-493c-b07f-efa638c1dc21 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:26.896688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e9a52-5ea8-493c-b07f-efa638c1dc21 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:26.897761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e9a52-5ea8-493c-b07f-efa638c1dc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:26.928828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b39885-3220-4086-b0cf-5e84cee2845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:26.929676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b39885-3220-4086-b0cf-5e84cee2845d admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:26.929970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b39885-3220-4086-b0cf-5e84cee2845d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:26.930288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b39885-3220-4086-b0cf-5e84cee2845d admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:26.931131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b39885-3220-4086-b0cf-5e84cee2845d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:26.933367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b39885-3220-4086-b0cf-5e84cee2845d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:26.934654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3a2e9a52-5ea8-493c-b07f-efa638c1dc21 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:26.938104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3a2e9a52-5ea8-493c-b07f-efa638c1dc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:27.006293 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3521/7058] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:48:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:48:27.052570 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3538/7059] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:48:26 2022] POST /identity/v3/users => generated 280 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:48:27.056237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e9a52-5ea8-493c-b07f-efa638c1dc21 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:27.072422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e9a52-5ea8-493c-b07f-efa638c1dc21 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:27.079863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaae8d-e36a-45de-8955-11ea4efb9079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:27.080734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaae8d-e36a-45de-8955-11ea4efb9079 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:27.081090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaae8d-e36a-45de-8955-11ea4efb9079 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:27.081441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaae8d-e36a-45de-8955-11ea4efb9079 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:27.082339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eaae8d-e36a-45de-8955-11ea4efb9079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:27.085803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eaae8d-e36a-45de-8955-11ea4efb9079 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:27.098674 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3522/7060] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:48:27.102594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b39885-3220-4086-b0cf-5e84cee2845d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:27.114436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b39885-3220-4086-b0cf-5e84cee2845d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:27.120404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad72fea-aa8d-4c3c-862c-d492701f30a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:27.121315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad72fea-aa8d-4c3c-862c-d492701f30a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:27.123727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad72fea-aa8d-4c3c-862c-d492701f30a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:27.123727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad72fea-aa8d-4c3c-862c-d492701f30a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:27.123727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad72fea-aa8d-4c3c-862c-d492701f30a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:27.125573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad72fea-aa8d-4c3c-862c-d492701f30a7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:27.138466 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3539/7061] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:48:27.143393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaae8d-e36a-45de-8955-11ea4efb9079 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:27.158045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaae8d-e36a-45de-8955-11ea4efb9079 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:27.164348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca078d4-b6eb-4c95-9894-865b5a2c346a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:27.169414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca078d4-b6eb-4c95-9894-865b5a2c346a admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:27.169414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca078d4-b6eb-4c95-9894-865b5a2c346a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:27.169414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca078d4-b6eb-4c95-9894-865b5a2c346a admin admin] PATH_INFO: `/v3/projects/74e04dc112024be59ad712eeb59f0002/users/03221ffc4dad4aa68c5d05c1dd8b4d34/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:27.184461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca078d4-b6eb-4c95-9894-865b5a2c346a admin admin] RBAC: Authorizing `identity:create_grant(project_id=74e04dc112024be59ad712eeb59f0002, user_id=03221ffc4dad4aa68c5d05c1dd8b4d34, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:27.197704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca078d4-b6eb-4c95-9894-865b5a2c346a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:27.206245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad72fea-aa8d-4c3c-862c-d492701f30a7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:27.208114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0ad72fea-aa8d-4c3c-862c-d492701f30a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:27.292679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad72fea-aa8d-4c3c-862c-d492701f30a7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:27.300715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a49e7-ff7c-4bca-a69b-7ef0d0c8057a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:27.301494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a49e7-ff7c-4bca-a69b-7ef0d0c8057a service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:27.301878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a49e7-ff7c-4bca-a69b-7ef0d0c8057a service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:27.302284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a49e7-ff7c-4bca-a69b-7ef0d0c8057a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:27.313664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a49e7-ff7c-4bca-a69b-7ef0d0c8057a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:27.315766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a49e7-ff7c-4bca-a69b-7ef0d0c8057a service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:27.325008 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3540/7062] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:48:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 02 10:48:27.373468 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3523/7063] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:48:27 2022] PUT /identity/v3/projects/74e04dc112024be59ad712eeb59f0002/users/03221ffc4dad4aa68c5d05c1dd8b4d34/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:48:27.376343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00567c1d-d7b5-46de-84e6-2030b4316dec None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:27.376684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00567c1d-d7b5-46de-84e6-2030b4316dec None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:27.377494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00567c1d-d7b5-46de-84e6-2030b4316dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:27.414316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-00567c1d-d7b5-46de-84e6-2030b4316dec None None] MFA Rules not processed for user `03221ffc4dad4aa68c5d05c1dd8b4d34`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:27.415859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-00567c1d-d7b5-46de-84e6-2030b4316dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:27.506674 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3541/7064] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:27 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:27.538635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca078d4-b6eb-4c95-9894-865b5a2c346a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:27.540705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2ca078d4-b6eb-4c95-9894-865b5a2c346a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:27.664695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca078d4-b6eb-4c95-9894-865b5a2c346a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:27.677263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c7673-1ac2-4c04-9db5-00b08d0ad3cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:27.678028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c7673-1ac2-4c04-9db5-00b08d0ad3cd service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:27.678462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c7673-1ac2-4c04-9db5-00b08d0ad3cd service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:27.678817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c7673-1ac2-4c04-9db5-00b08d0ad3cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:27.710932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c7673-1ac2-4c04-9db5-00b08d0ad3cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:27.713093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c7673-1ac2-4c04-9db5-00b08d0ad3cd service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:27.735239 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3524/7065] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:48:27 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:48:27.749691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00567c1d-d7b5-46de-84e6-2030b4316dec None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:27.977494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00567c1d-d7b5-46de-84e6-2030b4316dec None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:27.982933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16ed2e-d842-4b1f-9234-8d5de06e61ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:27.984094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16ed2e-d842-4b1f-9234-8d5de06e61ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:27.984560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16ed2e-d842-4b1f-9234-8d5de06e61ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:27.985062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16ed2e-d842-4b1f-9234-8d5de06e61ae admin admin] PATH_INFO: `/v3/users/03221ffc4dad4aa68c5d05c1dd8b4d34` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:27.986601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16ed2e-d842-4b1f-9234-8d5de06e61ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=03221ffc4dad4aa68c5d05c1dd8b4d34)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:27.988932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16ed2e-d842-4b1f-9234-8d5de06e61ae admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:28.231738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6b16ed2e-d842-4b1f-9234-8d5de06e61ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03221ffc4dad4aa68c5d05c1dd8b4d34'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:28.266682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6b16ed2e-d842-4b1f-9234-8d5de06e61ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03221ffc4dad4aa68c5d05c1dd8b4d34'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:28.267791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6b16ed2e-d842-4b1f-9234-8d5de06e61ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03221ffc4dad4aa68c5d05c1dd8b4d34'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:28.276742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6b16ed2e-d842-4b1f-9234-8d5de06e61ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03221ffc4dad4aa68c5d05c1dd8b4d34'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:28.434651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6b16ed2e-d842-4b1f-9234-8d5de06e61ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03221ffc4dad4aa68c5d05c1dd8b4d34'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:28.442143 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3542/7066] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:48:27 2022] DELETE /identity/v3/users/03221ffc4dad4aa68c5d05c1dd8b4d34 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:28.446792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0b67c-98c1-4b8a-9f9e-a5e046c12fe9 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:28.447295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0b67c-98c1-4b8a-9f9e-a5e046c12fe9 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:28.447390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0b67c-98c1-4b8a-9f9e-a5e046c12fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:28.475740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-13a0b67c-98c1-4b8a-9f9e-a5e046c12fe9 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:28.477749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-13a0b67c-98c1-4b8a-9f9e-a5e046c12fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:28.565431 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3525/7067] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:28.577177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16ed2e-d842-4b1f-9234-8d5de06e61ae admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:28.580427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6b16ed2e-d842-4b1f-9234-8d5de06e61ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:28.796094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16ed2e-d842-4b1f-9234-8d5de06e61ae admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:28.821067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709595b-7588-4fcd-8567-565d1208af24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:28.821818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709595b-7588-4fcd-8567-565d1208af24 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:28.822123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709595b-7588-4fcd-8567-565d1208af24 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:28.822407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709595b-7588-4fcd-8567-565d1208af24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:28.845275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709595b-7588-4fcd-8567-565d1208af24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:28.847339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709595b-7588-4fcd-8567-565d1208af24 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:28.886374 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3543/7068] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:48:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:48:29.749470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0b67c-98c1-4b8a-9f9e-a5e046c12fe9 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:29.756734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-13a0b67c-98c1-4b8a-9f9e-a5e046c12fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:29.778056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0b67c-98c1-4b8a-9f9e-a5e046c12fe9 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:29.806582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ba573-2051-429f-b621-1e684f5b8a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:29.807709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ba573-2051-429f-b621-1e684f5b8a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:29.809128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ba573-2051-429f-b621-1e684f5b8a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:29.809626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ba573-2051-429f-b621-1e684f5b8a67 admin admin] PATH_INFO: `/v3/projects/74e04dc112024be59ad712eeb59f0002` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:29.813888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ba573-2051-429f-b621-1e684f5b8a67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74e04dc112024be59ad712eeb59f0002)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:29.817469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ba573-2051-429f-b621-1e684f5b8a67 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:29.948647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-994ba573-2051-429f-b621-1e684f5b8a67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74e04dc112024be59ad712eeb59f0002', 'request_id': 'req-994ba573-2051-429f-b621-1e684f5b8a67'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:29.959989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-994ba573-2051-429f-b621-1e684f5b8a67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74e04dc112024be59ad712eeb59f0002', 'request_id': 'req-994ba573-2051-429f-b621-1e684f5b8a67'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:30.023634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-994ba573-2051-429f-b621-1e684f5b8a67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74e04dc112024be59ad712eeb59f0002', 'request_id': 'req-994ba573-2051-429f-b621-1e684f5b8a67'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:30.051728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-994ba573-2051-429f-b621-1e684f5b8a67 admin admin] The token cache is being invalidate because project 74e04dc112024be59ad712eeb59f0002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:48:30.051728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-994ba573-2051-429f-b621-1e684f5b8a67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:30.052240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-994ba573-2051-429f-b621-1e684f5b8a67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:30.054237 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3526/7069] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:48:29 2022] DELETE /identity/v3/projects/74e04dc112024be59ad712eeb59f0002 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:30.059539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b2aa9-f176-4e83-9c07-432df299594d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:30.060361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b2aa9-f176-4e83-9c07-432df299594d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:30.060921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b2aa9-f176-4e83-9c07-432df299594d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:30.090955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0c6b2aa9-f176-4e83-9c07-432df299594d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:30.093081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0c6b2aa9-f176-4e83-9c07-432df299594d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:30.219068 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3544/7070] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:30.229258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e44ae-abb3-4be5-8265-314c24b44a9f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:30.229707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e44ae-abb3-4be5-8265-314c24b44a9f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:30.230152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e44ae-abb3-4be5-8265-314c24b44a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:30.259345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-529e44ae-abb3-4be5-8265-314c24b44a9f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:30.261489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-529e44ae-abb3-4be5-8265-314c24b44a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:30.273390 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3527/7071] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:30.276735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b2aa9-f176-4e83-9c07-432df299594d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:30.295717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b2aa9-f176-4e83-9c07-432df299594d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:30.304123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95144b28-a432-4495-acca-6ee1f1cba9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:30.304851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95144b28-a432-4495-acca-6ee1f1cba9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:30.305281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95144b28-a432-4495-acca-6ee1f1cba9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:30.305756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95144b28-a432-4495-acca-6ee1f1cba9f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:30.306484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95144b28-a432-4495-acca-6ee1f1cba9f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:48:30.307100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95144b28-a432-4495-acca-6ee1f1cba9f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:30.310450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95144b28-a432-4495-acca-6ee1f1cba9f8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:30.327292 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3545/7072] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:48:30.332183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e44ae-abb3-4be5-8265-314c24b44a9f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:30.351646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e44ae-abb3-4be5-8265-314c24b44a9f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:30.357963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cfe05-4880-40e3-9631-60bc3806e7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:30.359677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cfe05-4880-40e3-9631-60bc3806e7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:30.360176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cfe05-4880-40e3-9631-60bc3806e7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:30.360649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cfe05-4880-40e3-9631-60bc3806e7d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:30.361568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976cfe05-4880-40e3-9631-60bc3806e7d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:30.364422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976cfe05-4880-40e3-9631-60bc3806e7d2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:30.476759 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3528/7073] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:48:30 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:48:30.481697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95144b28-a432-4495-acca-6ee1f1cba9f8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:30.497637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95144b28-a432-4495-acca-6ee1f1cba9f8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:30.607945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f681bd5-9fb5-43e9-a71c-5f9ed896aa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:30.609943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f681bd5-9fb5-43e9-a71c-5f9ed896aa92 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:30.610443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f681bd5-9fb5-43e9-a71c-5f9ed896aa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:30.611013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f681bd5-9fb5-43e9-a71c-5f9ed896aa92 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:30.612117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f681bd5-9fb5-43e9-a71c-5f9ed896aa92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:30.614707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f681bd5-9fb5-43e9-a71c-5f9ed896aa92 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:30.736176 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3546/7074] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:48:30 2022] POST /identity/v3/users => generated 288 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:48:30.737965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cfe05-4880-40e3-9631-60bc3806e7d2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:30.755265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cfe05-4880-40e3-9631-60bc3806e7d2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:30.773420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac1f71-6428-45b8-9bc1-5d7e17cf47de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:30.775164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac1f71-6428-45b8-9bc1-5d7e17cf47de admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:30.775164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac1f71-6428-45b8-9bc1-5d7e17cf47de admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:30.775164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac1f71-6428-45b8-9bc1-5d7e17cf47de admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:30.776020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac1f71-6428-45b8-9bc1-5d7e17cf47de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:30.777716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac1f71-6428-45b8-9bc1-5d7e17cf47de admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:30.817231 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3529/7075] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:48:30.821298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f681bd5-9fb5-43e9-a71c-5f9ed896aa92 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:30.838062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f681bd5-9fb5-43e9-a71c-5f9ed896aa92 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:30.852096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752eb60-0814-4c1d-a380-be808314ea99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:30.854252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752eb60-0814-4c1d-a380-be808314ea99 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:30.855172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752eb60-0814-4c1d-a380-be808314ea99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:30.856256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752eb60-0814-4c1d-a380-be808314ea99 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:30.858283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752eb60-0814-4c1d-a380-be808314ea99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:30.864783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752eb60-0814-4c1d-a380-be808314ea99 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:30.896733 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3547/7076] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:48:30.900764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac1f71-6428-45b8-9bc1-5d7e17cf47de admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:30.932190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac1f71-6428-45b8-9bc1-5d7e17cf47de admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:30.948091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5d71f-1022-429c-b20a-6ed340e5ee38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:30.950467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5d71f-1022-429c-b20a-6ed340e5ee38 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:30.951976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5d71f-1022-429c-b20a-6ed340e5ee38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:30.952444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5d71f-1022-429c-b20a-6ed340e5ee38 admin admin] PATH_INFO: `/v3/projects/be09b901a0dc40b3bc697abab301fd99/users/b17ff6122c8244d0a5c88ce5b041150d/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:30.973528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5d71f-1022-429c-b20a-6ed340e5ee38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be09b901a0dc40b3bc697abab301fd99, user_id=b17ff6122c8244d0a5c88ce5b041150d, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:30.982991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5d71f-1022-429c-b20a-6ed340e5ee38 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:31.096043 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3530/7077] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:48:30 2022] PUT /identity/v3/projects/be09b901a0dc40b3bc697abab301fd99/users/b17ff6122c8244d0a5c88ce5b041150d/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:31.106638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e6931-5419-47a8-afc7-0292d746b003 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:31.107522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e6931-5419-47a8-afc7-0292d746b003 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:31.107812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e6931-5419-47a8-afc7-0292d746b003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:31.184836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2f8e6931-5419-47a8-afc7-0292d746b003 None None] MFA Rules not processed for user `b17ff6122c8244d0a5c88ce5b041150d`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:31.186474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2f8e6931-5419-47a8-afc7-0292d746b003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:31.388048 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3548/7078] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:48:31.397519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5d71f-1022-429c-b20a-6ed340e5ee38 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:31.520568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5d71f-1022-429c-b20a-6ed340e5ee38 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:31.529100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d9172-a92c-474c-a879-35d291ab0b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:31.529948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d9172-a92c-474c-a879-35d291ab0b83 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:31.530304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d9172-a92c-474c-a879-35d291ab0b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:31.530659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d9172-a92c-474c-a879-35d291ab0b83 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:31.531477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d9172-a92c-474c-a879-35d291ab0b83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:31.533569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d9172-a92c-474c-a879-35d291ab0b83 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:31.641632 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3531/7079] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:48:31 2022] POST /identity/v3/projects => generated 377 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:48:31.646090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e6931-5419-47a8-afc7-0292d746b003 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:31.672995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e6931-5419-47a8-afc7-0292d746b003 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:31.826246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a712bf-89ae-4952-9179-6d9d34e84e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:31.826957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a712bf-89ae-4952-9179-6d9d34e84e78 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:31.827244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a712bf-89ae-4952-9179-6d9d34e84e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:31.827528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a712bf-89ae-4952-9179-6d9d34e84e78 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:31.828272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a712bf-89ae-4952-9179-6d9d34e84e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:31.831890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a712bf-89ae-4952-9179-6d9d34e84e78 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:31.946564 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3549/7080] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:48:31 2022] POST /identity/v3/users => generated 289 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:48:31.950305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d9172-a92c-474c-a879-35d291ab0b83 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:31.969996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d9172-a92c-474c-a879-35d291ab0b83 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:31.984939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafcd2f-114b-4401-9da7-75ce5aa20be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:31.986485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafcd2f-114b-4401-9da7-75ce5aa20be0 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:31.986927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafcd2f-114b-4401-9da7-75ce5aa20be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:32.001189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafcd2f-114b-4401-9da7-75ce5aa20be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:32.006028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafcd2f-114b-4401-9da7-75ce5aa20be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:32.010979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafcd2f-114b-4401-9da7-75ce5aa20be0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:32.039448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a712bf-89ae-4952-9179-6d9d34e84e78 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:32.042625 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3532/7081] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:48:32.074297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a712bf-89ae-4952-9179-6d9d34e84e78 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:32.087129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04aa1d-0d81-413e-b0ea-2f99f2547882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:32.089622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04aa1d-0d81-413e-b0ea-2f99f2547882 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:32.091089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04aa1d-0d81-413e-b0ea-2f99f2547882 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:32.091586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04aa1d-0d81-413e-b0ea-2f99f2547882 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:32.118278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04aa1d-0d81-413e-b0ea-2f99f2547882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:32.120679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04aa1d-0d81-413e-b0ea-2f99f2547882 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:32.135323 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3550/7082] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:48:32.143633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafcd2f-114b-4401-9da7-75ce5aa20be0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:32.163747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafcd2f-114b-4401-9da7-75ce5aa20be0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:32.182880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc12dc-9230-4e02-8446-8b5a751ee52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:32.189389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc12dc-9230-4e02-8446-8b5a751ee52e admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:32.189966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc12dc-9230-4e02-8446-8b5a751ee52e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:32.190805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc12dc-9230-4e02-8446-8b5a751ee52e admin admin] PATH_INFO: `/v3/projects/a8a579a63da346908015abd18b2eb105/users/b49f84ef3c32421dac58698210717022/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:32.257229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc12dc-9230-4e02-8446-8b5a751ee52e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8a579a63da346908015abd18b2eb105, user_id=b49f84ef3c32421dac58698210717022, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:32.262389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc12dc-9230-4e02-8446-8b5a751ee52e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:32.389070 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3533/7083] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:48:32 2022] PUT /identity/v3/projects/a8a579a63da346908015abd18b2eb105/users/b49f84ef3c32421dac58698210717022/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:32.401826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d618228-6ba3-40aa-a8ba-dcc097d638e2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:32.402118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d618228-6ba3-40aa-a8ba-dcc097d638e2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:32.402633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d618228-6ba3-40aa-a8ba-dcc097d638e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:32.481810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-5d618228-6ba3-40aa-a8ba-dcc097d638e2 None None] MFA Rules not processed for user `b49f84ef3c32421dac58698210717022`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:32.483487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5d618228-6ba3-40aa-a8ba-dcc097d638e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:32.600871 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3551/7084] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:32.601992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc12dc-9230-4e02-8446-8b5a751ee52e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:32.734312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc12dc-9230-4e02-8446-8b5a751ee52e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:32.745672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb70bf-a8b5-4913-9cd0-85a6ad87f9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:32.746365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb70bf-a8b5-4913-9cd0-85a6ad87f9aa admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:32.746659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb70bf-a8b5-4913-9cd0-85a6ad87f9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:32.747297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb70bf-a8b5-4913-9cd0-85a6ad87f9aa admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:32.747644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb70bf-a8b5-4913-9cd0-85a6ad87f9aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:32.760184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb70bf-a8b5-4913-9cd0-85a6ad87f9aa admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:32.883012 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3534/7085] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:48:32 2022] POST /identity/v3/projects => generated 375 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:48:32.886714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d618228-6ba3-40aa-a8ba-dcc097d638e2 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:32.899508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d618228-6ba3-40aa-a8ba-dcc097d638e2 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:32.994379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e245e-56ec-406a-9a83-a497f19d3c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:32.995190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e245e-56ec-406a-9a83-a497f19d3c71 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:32.995481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e245e-56ec-406a-9a83-a497f19d3c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:32.995763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e245e-56ec-406a-9a83-a497f19d3c71 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:32.996513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e245e-56ec-406a-9a83-a497f19d3c71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:33.000687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e245e-56ec-406a-9a83-a497f19d3c71 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:33.354163 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3552/7086] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:48:32 2022] POST /identity/v3/users => generated 294 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:48:33.361965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb70bf-a8b5-4913-9cd0-85a6ad87f9aa admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:33.380388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb70bf-a8b5-4913-9cd0-85a6ad87f9aa admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:33.391736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6887d7d-0892-49cf-8374-7026e7538c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:33.392709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6887d7d-0892-49cf-8374-7026e7538c65 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:33.393200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6887d7d-0892-49cf-8374-7026e7538c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:33.393653 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6887d7d-0892-49cf-8374-7026e7538c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:33.394579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6887d7d-0892-49cf-8374-7026e7538c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:33.399853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6887d7d-0892-49cf-8374-7026e7538c65 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:33.423842 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3535/7087] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:48:33.427598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e245e-56ec-406a-9a83-a497f19d3c71 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:33.438835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e245e-56ec-406a-9a83-a497f19d3c71 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:33.458197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a9861-77d5-4877-a541-5ab1c56224dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:33.460093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a9861-77d5-4877-a541-5ab1c56224dd admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:33.460718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a9861-77d5-4877-a541-5ab1c56224dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:33.461408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a9861-77d5-4877-a541-5ab1c56224dd admin admin] PATH_INFO: `/v3/projects/5f3788bbc3d144808d84aaeac43d550c/users/c6a6911023c44a45a031fc4e30e79a98/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:33.488767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1e2cf-feee-4739-aecd-2465e2b7806f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:33.489139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1e2cf-feee-4739-aecd-2465e2b7806f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:33.489503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1e2cf-feee-4739-aecd-2465e2b7806f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:33.515944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a9861-77d5-4877-a541-5ab1c56224dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3788bbc3d144808d84aaeac43d550c, user_id=c6a6911023c44a45a031fc4e30e79a98, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:33.525761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-dcd1e2cf-feee-4739-aecd-2465e2b7806f None None] MFA Rules not processed for user `bb25448d45ac488797f59e828cafdb22`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:33.527123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-dcd1e2cf-feee-4739-aecd-2465e2b7806f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:33.545138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a9861-77d5-4877-a541-5ab1c56224dd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:33.615134 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3553/7088] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:48:33 2022] PUT /identity/v3/projects/5f3788bbc3d144808d84aaeac43d550c/users/c6a6911023c44a45a031fc4e30e79a98/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:33.619073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a9861-77d5-4877-a541-5ab1c56224dd admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:33.675607 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3536/7089] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:48:33.697289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1e2cf-feee-4739-aecd-2465e2b7806f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:33.699463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-dcd1e2cf-feee-4739-aecd-2465e2b7806f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:33.742577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a9861-77d5-4877-a541-5ab1c56224dd admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:33.764697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd1272-212e-4705-b953-00af30702f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:33.770364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd1272-212e-4705-b953-00af30702f1f admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:33.770772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd1272-212e-4705-b953-00af30702f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:33.771119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd1272-212e-4705-b953-00af30702f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:33.771941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd1272-212e-4705-b953-00af30702f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:33.774425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd1272-212e-4705-b953-00af30702f1f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:33.804763 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3554/7090] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:48:33.805739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd1272-212e-4705-b953-00af30702f1f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:33.817366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1e2cf-feee-4739-aecd-2465e2b7806f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:33.823178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd1272-212e-4705-b953-00af30702f1f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:33.838351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac78ca-693a-4dbe-9b8f-0086c4eb80a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:33.840292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac78ca-693a-4dbe-9b8f-0086c4eb80a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:33.840882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac78ca-693a-4dbe-9b8f-0086c4eb80a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:33.841345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac78ca-693a-4dbe-9b8f-0086c4eb80a0 admin admin] PATH_INFO: `/v3/projects/5f3788bbc3d144808d84aaeac43d550c/users/c6a6911023c44a45a031fc4e30e79a98/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:33.850507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac78ca-693a-4dbe-9b8f-0086c4eb80a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3788bbc3d144808d84aaeac43d550c, user_id=c6a6911023c44a45a031fc4e30e79a98, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:33.856841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac78ca-693a-4dbe-9b8f-0086c4eb80a0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:33.882941 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3555/7091] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:48:33 2022] PUT /identity/v3/projects/5f3788bbc3d144808d84aaeac43d550c/users/c6a6911023c44a45a031fc4e30e79a98/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:33.896276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597523ff-0d74-4f30-a65e-0e83852d2439 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:33.896613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597523ff-0d74-4f30-a65e-0e83852d2439 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:33.899416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597523ff-0d74-4f30-a65e-0e83852d2439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:33.955383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-597523ff-0d74-4f30-a65e-0e83852d2439 None None] MFA Rules not processed for user `c6a6911023c44a45a031fc4e30e79a98`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:33.960332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-597523ff-0d74-4f30-a65e-0e83852d2439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:33.978143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce320f52-e84e-41ee-8ec1-084f2e0d4e90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:33.978819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce320f52-e84e-41ee-8ec1-084f2e0d4e90 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:33.979256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce320f52-e84e-41ee-8ec1-084f2e0d4e90 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:33.979916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce320f52-e84e-41ee-8ec1-084f2e0d4e90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:34.131651 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3556/7092] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:34.142332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597523ff-0d74-4f30-a65e-0e83852d2439 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:34.145745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-597523ff-0d74-4f30-a65e-0e83852d2439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:34.150881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce320f52-e84e-41ee-8ec1-084f2e0d4e90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:34.158360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce320f52-e84e-41ee-8ec1-084f2e0d4e90 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:34.184820 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3537/7093] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:48:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:48:34.272090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597523ff-0d74-4f30-a65e-0e83852d2439 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:34.278496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c490c4-31e9-4832-8ad8-67a951629f79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:34.278691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c490c4-31e9-4832-8ad8-67a951629f79 service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:34.278951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c490c4-31e9-4832-8ad8-67a951629f79 service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:34.279142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c490c4-31e9-4832-8ad8-67a951629f79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:34.414617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c490c4-31e9-4832-8ad8-67a951629f79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:34.416920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c490c4-31e9-4832-8ad8-67a951629f79 service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:34.438924 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3557/7094] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:48:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:48:38.757336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30a1f0-9873-43eb-81d5-437a5b896696 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:38.757933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30a1f0-9873-43eb-81d5-437a5b896696 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:38.757933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30a1f0-9873-43eb-81d5-437a5b896696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:38.779813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2c30a1f0-9873-43eb-81d5-437a5b896696 None None] MFA Rules not processed for user `bb25448d45ac488797f59e828cafdb22`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:38.782877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2c30a1f0-9873-43eb-81d5-437a5b896696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:38.877068 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3538/7095] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:39.019723 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c490c4-31e9-4832-8ad8-67a951629f79 service cinder] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:39.021188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-66c490c4-31e9-4832-8ad8-67a951629f79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:39.053327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c490c4-31e9-4832-8ad8-67a951629f79 service cinder] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:39.061406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb6509-1ba7-46ff-8022-f0d1b50fb3be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:39.062800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb6509-1ba7-46ff-8022-f0d1b50fb3be service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:39.063307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb6509-1ba7-46ff-8022-f0d1b50fb3be service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:39.064250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb6509-1ba7-46ff-8022-f0d1b50fb3be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:39.182696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb6509-1ba7-46ff-8022-f0d1b50fb3be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:39.184779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb6509-1ba7-46ff-8022-f0d1b50fb3be service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:39.195647 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3558/7096] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:48:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:48:41.043800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30a1f0-9873-43eb-81d5-437a5b896696 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:41.058079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30a1f0-9873-43eb-81d5-437a5b896696 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:41.062080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4028a5-53d8-4a25-b316-1ee004813526 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:41.062769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4028a5-53d8-4a25-b316-1ee004813526 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:41.063078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4028a5-53d8-4a25-b316-1ee004813526 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:41.063581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4028a5-53d8-4a25-b316-1ee004813526 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:41.075934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4028a5-53d8-4a25-b316-1ee004813526 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:41.077785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4028a5-53d8-4a25-b316-1ee004813526 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:41.089207 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3539/7097] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:48:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:48:45.168856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb6509-1ba7-46ff-8022-f0d1b50fb3be service cinder] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:45.170422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d3bb6509-1ba7-46ff-8022-f0d1b50fb3be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:45.246449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb6509-1ba7-46ff-8022-f0d1b50fb3be service cinder] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:45.253573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb7191-bc47-4f0b-a2bf-c9890038425d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:45.254634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb7191-bc47-4f0b-a2bf-c9890038425d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:45.254913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb7191-bc47-4f0b-a2bf-c9890038425d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:45.255187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb7191-bc47-4f0b-a2bf-c9890038425d admin admin] PATH_INFO: `/v3/users/c4f23489acf14e5b941be884d1b24797` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:45.256486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb7191-bc47-4f0b-a2bf-c9890038425d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4f23489acf14e5b941be884d1b24797)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:45.258438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb7191-bc47-4f0b-a2bf-c9890038425d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:45.457429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a6fb7191-bc47-4f0b-a2bf-c9890038425d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4f23489acf14e5b941be884d1b24797'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:45.474027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a6fb7191-bc47-4f0b-a2bf-c9890038425d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4f23489acf14e5b941be884d1b24797'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:45.475183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a6fb7191-bc47-4f0b-a2bf-c9890038425d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4f23489acf14e5b941be884d1b24797'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:45.482693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a6fb7191-bc47-4f0b-a2bf-c9890038425d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4f23489acf14e5b941be884d1b24797'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:45.554645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a6fb7191-bc47-4f0b-a2bf-c9890038425d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4f23489acf14e5b941be884d1b24797'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:45.565402 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3559/7098] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:48:45 2022] DELETE /identity/v3/users/c4f23489acf14e5b941be884d1b24797 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:45.569183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeb749-5b22-4351-9ea4-09e60bdd02a3 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:45.570072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeb749-5b22-4351-9ea4-09e60bdd02a3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:45.570759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeb749-5b22-4351-9ea4-09e60bdd02a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:45.597421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0eaeb749-5b22-4351-9ea4-09e60bdd02a3 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:45.598677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0eaeb749-5b22-4351-9ea4-09e60bdd02a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:45.710407 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3540/7099] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:48:45.719913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb7191-bc47-4f0b-a2bf-c9890038425d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:45.722701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a6fb7191-bc47-4f0b-a2bf-c9890038425d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:45.846717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb7191-bc47-4f0b-a2bf-c9890038425d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:45.854267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a84c68-6ed3-429c-93ff-b6c9f1f596cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:45.856040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a84c68-6ed3-429c-93ff-b6c9f1f596cf service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:45.857184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a84c68-6ed3-429c-93ff-b6c9f1f596cf service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:45.857691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a84c68-6ed3-429c-93ff-b6c9f1f596cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:45.871298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a84c68-6ed3-429c-93ff-b6c9f1f596cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:45.873663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a84c68-6ed3-429c-93ff-b6c9f1f596cf service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:45.897861 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3560/7100] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:48:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:48:46.395420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaeb749-5b22-4351-9ea4-09e60bdd02a3 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:46.397639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0eaeb749-5b22-4351-9ea4-09e60bdd02a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:46.411322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaeb749-5b22-4351-9ea4-09e60bdd02a3 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:46.416332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f45a23-233f-43cb-8590-daf3f1595ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:46.417480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f45a23-233f-43cb-8590-daf3f1595ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:46.417763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f45a23-233f-43cb-8590-daf3f1595ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:46.418042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f45a23-233f-43cb-8590-daf3f1595ed5 admin admin] PATH_INFO: `/v3/projects/ad8045ed60794216be781bda3c42b614` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:46.419668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f45a23-233f-43cb-8590-daf3f1595ed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad8045ed60794216be781bda3c42b614)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:46.422149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f45a23-233f-43cb-8590-daf3f1595ed5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:46.526446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a2f45a23-233f-43cb-8590-daf3f1595ed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad8045ed60794216be781bda3c42b614', 'request_id': 'req-a2f45a23-233f-43cb-8590-daf3f1595ed5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:46.534696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a2f45a23-233f-43cb-8590-daf3f1595ed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad8045ed60794216be781bda3c42b614', 'request_id': 'req-a2f45a23-233f-43cb-8590-daf3f1595ed5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:46.612451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a2f45a23-233f-43cb-8590-daf3f1595ed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad8045ed60794216be781bda3c42b614', 'request_id': 'req-a2f45a23-233f-43cb-8590-daf3f1595ed5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:46.624507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a2f45a23-233f-43cb-8590-daf3f1595ed5 admin admin] The token cache is being invalidate because project ad8045ed60794216be781bda3c42b614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:48:46.624833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a2f45a23-233f-43cb-8590-daf3f1595ed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:46.626039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a2f45a23-233f-43cb-8590-daf3f1595ed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:46.627880 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3541/7101] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:48:46 2022] DELETE /identity/v3/projects/ad8045ed60794216be781bda3c42b614 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:46.634996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ef096-1436-493b-a8ef-cb0ed838b6ba None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:46.635467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ef096-1436-493b-a8ef-cb0ed838b6ba None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:46.635580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ef096-1436-493b-a8ef-cb0ed838b6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:46.654326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-421ef096-1436-493b-a8ef-cb0ed838b6ba None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:46.655543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-421ef096-1436-493b-a8ef-cb0ed838b6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:46.717530 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3561/7102] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:46.725701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e12ce2-ee19-47e7-bac8-3e82a3afaed9 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:46.725993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e12ce2-ee19-47e7-bac8-3e82a3afaed9 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:46.726275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e12ce2-ee19-47e7-bac8-3e82a3afaed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:46.746217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-71e12ce2-ee19-47e7-bac8-3e82a3afaed9 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:46.747405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-71e12ce2-ee19-47e7-bac8-3e82a3afaed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:46.761019 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3542/7103] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:48:46.762098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ef096-1436-493b-a8ef-cb0ed838b6ba None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:46.776097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ef096-1436-493b-a8ef-cb0ed838b6ba None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:46.780885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899a5a3-1019-4199-b36d-edde09f4e443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:46.781609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899a5a3-1019-4199-b36d-edde09f4e443 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:46.784556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899a5a3-1019-4199-b36d-edde09f4e443 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:46.784979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899a5a3-1019-4199-b36d-edde09f4e443 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:46.785629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899a5a3-1019-4199-b36d-edde09f4e443 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:48:46.785942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899a5a3-1019-4199-b36d-edde09f4e443 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:46.787769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899a5a3-1019-4199-b36d-edde09f4e443 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:46.809547 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3562/7104] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:48:46.814249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e12ce2-ee19-47e7-bac8-3e82a3afaed9 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:46.828526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e12ce2-ee19-47e7-bac8-3e82a3afaed9 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:46.836950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac3875-a798-4c7c-bd28-7aa45e521fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:46.838059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac3875-a798-4c7c-bd28-7aa45e521fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:46.842061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac3875-a798-4c7c-bd28-7aa45e521fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:46.842061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac3875-a798-4c7c-bd28-7aa45e521fa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:46.842061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac3875-a798-4c7c-bd28-7aa45e521fa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:46.842061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac3875-a798-4c7c-bd28-7aa45e521fa9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:46.936780 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3543/7105] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:48:46 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:48:46.940764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899a5a3-1019-4199-b36d-edde09f4e443 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:46.954248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899a5a3-1019-4199-b36d-edde09f4e443 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:47.020656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b42e1d-094f-4f63-9025-12c6aea91257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:47.021376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b42e1d-094f-4f63-9025-12c6aea91257 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:47.021661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b42e1d-094f-4f63-9025-12c6aea91257 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:47.021938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b42e1d-094f-4f63-9025-12c6aea91257 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:47.022622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b42e1d-094f-4f63-9025-12c6aea91257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:47.024558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b42e1d-094f-4f63-9025-12c6aea91257 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:47.111535 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3563/7106] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:48:46 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:48:47.115775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac3875-a798-4c7c-bd28-7aa45e521fa9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:47.126557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac3875-a798-4c7c-bd28-7aa45e521fa9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:47.131761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfaf3b3-3807-4729-906d-118b6b9ac3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:47.132434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaf3b3-3807-4729-906d-118b6b9ac3ba admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:47.132771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaf3b3-3807-4729-906d-118b6b9ac3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:47.133058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfaf3b3-3807-4729-906d-118b6b9ac3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:47.133786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfaf3b3-3807-4729-906d-118b6b9ac3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:47.135434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfaf3b3-3807-4729-906d-118b6b9ac3ba admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:47.146308 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3544/7107] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:48:47.150604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b42e1d-094f-4f63-9025-12c6aea91257 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:47.161208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b42e1d-094f-4f63-9025-12c6aea91257 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:47.165913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ff214-470b-470d-9f47-2ced2fd78cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:47.166569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ff214-470b-470d-9f47-2ced2fd78cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:47.166857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ff214-470b-470d-9f47-2ced2fd78cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:47.167141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ff214-470b-470d-9f47-2ced2fd78cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:47.167867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ff214-470b-470d-9f47-2ced2fd78cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:47.169495 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ff214-470b-470d-9f47-2ced2fd78cf1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:47.180173 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3564/7108] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:48:47.184460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfaf3b3-3807-4729-906d-118b6b9ac3ba admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:47.194524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfaf3b3-3807-4729-906d-118b6b9ac3ba admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:47.199350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01851a-05fa-40e0-b10f-f69d4688f24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:47.200240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01851a-05fa-40e0-b10f-f69d4688f24e admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:47.200668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01851a-05fa-40e0-b10f-f69d4688f24e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:47.200950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01851a-05fa-40e0-b10f-f69d4688f24e admin admin] PATH_INFO: `/v3/projects/95f90f5a43f849da9b0f38406b203c88/users/69c12c1e7a3142aaad5ab08ec4c16d96/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:47.215667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01851a-05fa-40e0-b10f-f69d4688f24e admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f90f5a43f849da9b0f38406b203c88, user_id=69c12c1e7a3142aaad5ab08ec4c16d96, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:47.218425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01851a-05fa-40e0-b10f-f69d4688f24e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:47.309552 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3545/7109] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:48:47 2022] PUT /identity/v3/projects/95f90f5a43f849da9b0f38406b203c88/users/69c12c1e7a3142aaad5ab08ec4c16d96/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:47.319721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca024170-adc8-4dda-8dcf-bcc6c30c6423 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:47.319926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca024170-adc8-4dda-8dcf-bcc6c30c6423 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:47.320210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca024170-adc8-4dda-8dcf-bcc6c30c6423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:47.347733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ca024170-adc8-4dda-8dcf-bcc6c30c6423 None None] MFA Rules not processed for user `69c12c1e7a3142aaad5ab08ec4c16d96`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:47.349104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ca024170-adc8-4dda-8dcf-bcc6c30c6423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:47.418437 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3565/7110] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:47.422997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01851a-05fa-40e0-b10f-f69d4688f24e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:47.486658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01851a-05fa-40e0-b10f-f69d4688f24e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:47.491637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb0043-e25c-4353-9d87-e59c8e416c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:47.492306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb0043-e25c-4353-9d87-e59c8e416c59 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:47.493240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb0043-e25c-4353-9d87-e59c8e416c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:47.493240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb0043-e25c-4353-9d87-e59c8e416c59 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:47.493806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb0043-e25c-4353-9d87-e59c8e416c59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:47.495916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb0043-e25c-4353-9d87-e59c8e416c59 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:47.597150 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3546/7111] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:48:47 2022] POST /identity/v3/projects => generated 375 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:48:47.600931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca024170-adc8-4dda-8dcf-bcc6c30c6423 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:47.612718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca024170-adc8-4dda-8dcf-bcc6c30c6423 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:47.674771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cad1ae-a141-46b1-bfbe-8b18a14f6c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:47.675461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cad1ae-a141-46b1-bfbe-8b18a14f6c09 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:47.675750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cad1ae-a141-46b1-bfbe-8b18a14f6c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:47.676032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cad1ae-a141-46b1-bfbe-8b18a14f6c09 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:47.676815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cad1ae-a141-46b1-bfbe-8b18a14f6c09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:47.679924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cad1ae-a141-46b1-bfbe-8b18a14f6c09 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:47.783014 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3566/7112] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:48:47 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:48:47.787346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb0043-e25c-4353-9d87-e59c8e416c59 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:47.811954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb0043-e25c-4353-9d87-e59c8e416c59 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:47.811954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a07318-4bfd-4044-a7b6-73af7b49d01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:47.812347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a07318-4bfd-4044-a7b6-73af7b49d01a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:47.812668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a07318-4bfd-4044-a7b6-73af7b49d01a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:47.813447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a07318-4bfd-4044-a7b6-73af7b49d01a admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:47.814179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a07318-4bfd-4044-a7b6-73af7b49d01a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:47.815835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a07318-4bfd-4044-a7b6-73af7b49d01a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:47.828387 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3547/7113] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:48:47.836924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cad1ae-a141-46b1-bfbe-8b18a14f6c09 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:47.844125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cad1ae-a141-46b1-bfbe-8b18a14f6c09 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:47.849098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97667f17-7337-4725-8684-0e09bc898925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:47.849979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97667f17-7337-4725-8684-0e09bc898925 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:47.850468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97667f17-7337-4725-8684-0e09bc898925 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:47.850813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97667f17-7337-4725-8684-0e09bc898925 admin admin] PATH_INFO: `/v3/projects/6c89a5d525fa4e9194ef7ef6a73f45e2/users/4fcfdebd22764ceda754e2282dbbe6bf/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:47.871167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97667f17-7337-4725-8684-0e09bc898925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c89a5d525fa4e9194ef7ef6a73f45e2, user_id=4fcfdebd22764ceda754e2282dbbe6bf, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:47.873973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97667f17-7337-4725-8684-0e09bc898925 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:47.993553 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3567/7114] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:48:47 2022] PUT /identity/v3/projects/6c89a5d525fa4e9194ef7ef6a73f45e2/users/4fcfdebd22764ceda754e2282dbbe6bf/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:48:47.999914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a07318-4bfd-4044-a7b6-73af7b49d01a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:48.010754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a07318-4bfd-4044-a7b6-73af7b49d01a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:48.093479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4875064-0b18-4147-9783-db0ebaf28776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:48.094289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4875064-0b18-4147-9783-db0ebaf28776 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:48.094572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4875064-0b18-4147-9783-db0ebaf28776 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:48.094853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4875064-0b18-4147-9783-db0ebaf28776 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:48.095712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4875064-0b18-4147-9783-db0ebaf28776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:48.097577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4875064-0b18-4147-9783-db0ebaf28776 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:48.112019 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3548/7115] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:48:48.120010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97667f17-7337-4725-8684-0e09bc898925 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:48.139655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97667f17-7337-4725-8684-0e09bc898925 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:48.145158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421990b-9599-4b11-9f9c-34adbe7f3799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:48.146261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421990b-9599-4b11-9f9c-34adbe7f3799 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:48.146619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421990b-9599-4b11-9f9c-34adbe7f3799 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:48.147016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421990b-9599-4b11-9f9c-34adbe7f3799 admin admin] PATH_INFO: `/v3/projects/6c89a5d525fa4e9194ef7ef6a73f45e2/users/4fcfdebd22764ceda754e2282dbbe6bf/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:48.149625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421990b-9599-4b11-9f9c-34adbe7f3799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c89a5d525fa4e9194ef7ef6a73f45e2, user_id=4fcfdebd22764ceda754e2282dbbe6bf, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:48.152583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421990b-9599-4b11-9f9c-34adbe7f3799 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:48.175754 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3568/7116] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:48:48 2022] PUT /identity/v3/projects/6c89a5d525fa4e9194ef7ef6a73f45e2/users/4fcfdebd22764ceda754e2282dbbe6bf/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:48.187116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ea393-dfde-474d-9cb3-5553e9cdab57 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:48.187318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ea393-dfde-474d-9cb3-5553e9cdab57 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:48.187603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ea393-dfde-474d-9cb3-5553e9cdab57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:48.215201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e18ea393-dfde-474d-9cb3-5553e9cdab57 None None] MFA Rules not processed for user `4fcfdebd22764ceda754e2282dbbe6bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:48.216798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e18ea393-dfde-474d-9cb3-5553e9cdab57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:48.293227 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3549/7117] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:48.298292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421990b-9599-4b11-9f9c-34adbe7f3799 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:48.311934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421990b-9599-4b11-9f9c-34adbe7f3799 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:48.318329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37537573-c96b-4d38-9a97-dabe79505506 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fcfdebd22764ceda754e2282dbbe6bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c89a5d525fa4e9194ef7ef6a73f45e2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:48.319099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37537573-c96b-4d38-9a97-dabe79505506 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:48.319391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37537573-c96b-4d38-9a97-dabe79505506 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:48.319825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37537573-c96b-4d38-9a97-dabe79505506 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:48.320594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37537573-c96b-4d38-9a97-dabe79505506 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:48.322517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37537573-c96b-4d38-9a97-dabe79505506 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:48.411541 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3569/7118] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:48:48 2022] POST /identity/v3/projects => generated 350 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:48:48.415451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ea393-dfde-474d-9cb3-5553e9cdab57 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:48.426103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ea393-dfde-474d-9cb3-5553e9cdab57 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:48.484018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26872075-01ef-4dfd-8d12-113e4a9a8b09 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fcfdebd22764ceda754e2282dbbe6bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c89a5d525fa4e9194ef7ef6a73f45e2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:48.484787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26872075-01ef-4dfd-8d12-113e4a9a8b09 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:48.485805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26872075-01ef-4dfd-8d12-113e4a9a8b09 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:48.486071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26872075-01ef-4dfd-8d12-113e4a9a8b09 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:48.486749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26872075-01ef-4dfd-8d12-113e4a9a8b09 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:48.488627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26872075-01ef-4dfd-8d12-113e4a9a8b09 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:48.600537 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3550/7119] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:48:48 2022] POST /identity/v3/projects => generated 350 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:48:48.603827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37537573-c96b-4d38-9a97-dabe79505506 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:48.615819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37537573-c96b-4d38-9a97-dabe79505506 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:48.682764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c964f0-7227-4aae-b189-1ff0574518a4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fcfdebd22764ceda754e2282dbbe6bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c89a5d525fa4e9194ef7ef6a73f45e2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:48.683816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c964f0-7227-4aae-b189-1ff0574518a4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:48.684161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c964f0-7227-4aae-b189-1ff0574518a4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:48.684448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c964f0-7227-4aae-b189-1ff0574518a4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] PATH_INFO: `/v3/users/69c12c1e7a3142aaad5ab08ec4c16d96` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:48.688822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c964f0-7227-4aae-b189-1ff0574518a4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorizing `identity:get_user(user_id=69c12c1e7a3142aaad5ab08ec4c16d96)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:48.688822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c964f0-7227-4aae-b189-1ff0574518a4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:48.689737 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3570/7120] 10.222.0.16 () {58 vars in 1220 bytes} [Mon May 2 10:48:48 2022] GET /identity/v3/users/69c12c1e7a3142aaad5ab08ec4c16d96 => generated 288 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:48:48.694309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26872075-01ef-4dfd-8d12-113e4a9a8b09 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:48.705109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26872075-01ef-4dfd-8d12-113e4a9a8b09 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:48.709858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994074b-8476-4576-b075-898767aebdbd tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fcfdebd22764ceda754e2282dbbe6bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c89a5d525fa4e9194ef7ef6a73f45e2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:48.710504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994074b-8476-4576-b075-898767aebdbd tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:48.710788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994074b-8476-4576-b075-898767aebdbd tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:48.711068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994074b-8476-4576-b075-898767aebdbd tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:48.711773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994074b-8476-4576-b075-898767aebdbd tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:48.713695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994074b-8476-4576-b075-898767aebdbd tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:48.821404 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3551/7121] 10.222.0.16 () {60 vars in 1161 bytes} [Mon May 2 10:48:48 2022] POST /identity/v3/credentials => generated 429 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:48:48.825676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c964f0-7227-4aae-b189-1ff0574518a4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:48.837446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c964f0-7227-4aae-b189-1ff0574518a4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:48.842440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d38dad-3b55-416b-a61b-9980d16c4ee7 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fcfdebd22764ceda754e2282dbbe6bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c89a5d525fa4e9194ef7ef6a73f45e2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:48.843420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d38dad-3b55-416b-a61b-9980d16c4ee7 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:48.844949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d38dad-3b55-416b-a61b-9980d16c4ee7 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:48.844949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d38dad-3b55-416b-a61b-9980d16c4ee7 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] PATH_INFO: `/v3/credentials/23563807484784db5fd12d1a8e24c11142612b368de80c5cb80aaf28afb2e0bd` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:48.847235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d38dad-3b55-416b-a61b-9980d16c4ee7 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=23563807484784db5fd12d1a8e24c11142612b368de80c5cb80aaf28afb2e0bd)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:48.849031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d38dad-3b55-416b-a61b-9980d16c4ee7 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:48.850818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d38dad-3b55-416b-a61b-9980d16c4ee7 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=23563807484784db5fd12d1a8e24c11142612b368de80c5cb80aaf28afb2e0bd)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:48.852397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d38dad-3b55-416b-a61b-9980d16c4ee7 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:48.964541 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3571/7122] 10.222.0.16 () {60 vars in 1357 bytes} [Mon May 2 10:48:48 2022] PATCH /identity/v3/credentials/23563807484784db5fd12d1a8e24c11142612b368de80c5cb80aaf28afb2e0bd => generated 437 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:48:48.968900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994074b-8476-4576-b075-898767aebdbd tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:48.987969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994074b-8476-4576-b075-898767aebdbd tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:49.003352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701c4f2-bb67-495d-b49c-0e632a383a61 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fcfdebd22764ceda754e2282dbbe6bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c89a5d525fa4e9194ef7ef6a73f45e2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:49.003352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701c4f2-bb67-495d-b49c-0e632a383a61 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:49.004947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701c4f2-bb67-495d-b49c-0e632a383a61 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:49.005356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701c4f2-bb67-495d-b49c-0e632a383a61 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] PATH_INFO: `/v3/credentials/23563807484784db5fd12d1a8e24c11142612b368de80c5cb80aaf28afb2e0bd` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:49.010690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b701c4f2-bb67-495d-b49c-0e632a383a61 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=23563807484784db5fd12d1a8e24c11142612b368de80c5cb80aaf28afb2e0bd)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:49.015904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b701c4f2-bb67-495d-b49c-0e632a383a61 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:49.022415 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3552/7123] 10.222.0.16 () {58 vars in 1334 bytes} [Mon May 2 10:48:48 2022] GET /identity/v3/credentials/23563807484784db5fd12d1a8e24c11142612b368de80c5cb80aaf28afb2e0bd => generated 437 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:48:49.024470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d38dad-3b55-416b-a61b-9980d16c4ee7 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:49.039487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d38dad-3b55-416b-a61b-9980d16c4ee7 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:49.047780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826983b9-23a3-41de-806f-d813b31d5bb8 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fcfdebd22764ceda754e2282dbbe6bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c89a5d525fa4e9194ef7ef6a73f45e2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:49.048755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826983b9-23a3-41de-806f-d813b31d5bb8 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:49.049200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826983b9-23a3-41de-806f-d813b31d5bb8 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:49.049872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826983b9-23a3-41de-806f-d813b31d5bb8 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] PATH_INFO: `/v3/credentials/23563807484784db5fd12d1a8e24c11142612b368de80c5cb80aaf28afb2e0bd` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:49.052163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826983b9-23a3-41de-806f-d813b31d5bb8 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=23563807484784db5fd12d1a8e24c11142612b368de80c5cb80aaf28afb2e0bd)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:49.054425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826983b9-23a3-41de-806f-d813b31d5bb8 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:49.251180 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3572/7124] 10.222.0.16 () {58 vars in 1337 bytes} [Mon May 2 10:48:49 2022] DELETE /identity/v3/credentials/23563807484784db5fd12d1a8e24c11142612b368de80c5cb80aaf28afb2e0bd => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:49.254888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701c4f2-bb67-495d-b49c-0e632a383a61 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:49.264752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701c4f2-bb67-495d-b49c-0e632a383a61 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:49.270431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1150ae-f845-4ddd-95db-57934117a5c0 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fcfdebd22764ceda754e2282dbbe6bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c89a5d525fa4e9194ef7ef6a73f45e2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:49.271077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1150ae-f845-4ddd-95db-57934117a5c0 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:49.271361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1150ae-f845-4ddd-95db-57934117a5c0 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:49.271641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1150ae-f845-4ddd-95db-57934117a5c0 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:49.272352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1150ae-f845-4ddd-95db-57934117a5c0 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:49.274158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1150ae-f845-4ddd-95db-57934117a5c0 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:49.404039 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3553/7125] 10.222.0.16 () {60 vars in 1161 bytes} [Mon May 2 10:48:49 2022] POST /identity/v3/credentials => generated 431 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:48:49.407731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826983b9-23a3-41de-806f-d813b31d5bb8 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:49.418599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826983b9-23a3-41de-806f-d813b31d5bb8 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:49.423338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232e401-0ad7-4e3e-ad1d-377cbcd27011 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fcfdebd22764ceda754e2282dbbe6bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c89a5d525fa4e9194ef7ef6a73f45e2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:49.424009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232e401-0ad7-4e3e-ad1d-377cbcd27011 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:49.424290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232e401-0ad7-4e3e-ad1d-377cbcd27011 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:49.424574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232e401-0ad7-4e3e-ad1d-377cbcd27011 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:49.425306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232e401-0ad7-4e3e-ad1d-377cbcd27011 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:49.427096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232e401-0ad7-4e3e-ad1d-377cbcd27011 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:49.507103 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3573/7126] 10.222.0.16 () {60 vars in 1161 bytes} [Mon May 2 10:48:49 2022] POST /identity/v3/credentials => generated 430 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:48:49.515385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1150ae-f845-4ddd-95db-57934117a5c0 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:49.531382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1150ae-f845-4ddd-95db-57934117a5c0 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:49.539596 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3160631-8769-4822-8377-aadd1df9c398 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fcfdebd22764ceda754e2282dbbe6bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c89a5d525fa4e9194ef7ef6a73f45e2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:49.542042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3160631-8769-4822-8377-aadd1df9c398 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:49.542042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3160631-8769-4822-8377-aadd1df9c398 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:49.542042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3160631-8769-4822-8377-aadd1df9c398 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:49.542916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3160631-8769-4822-8377-aadd1df9c398 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:49.545170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3160631-8769-4822-8377-aadd1df9c398 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:49.554096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3160631-8769-4822-8377-aadd1df9c398 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:49.555883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3160631-8769-4822-8377-aadd1df9c398 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:49.557227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3160631-8769-4822-8377-aadd1df9c398 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:49.559228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3160631-8769-4822-8377-aadd1df9c398 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:49.565010 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3554/7127] 10.222.0.16 () {58 vars in 1139 bytes} [Mon May 2 10:48:49 2022] GET /identity/v3/credentials => generated 946 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:48:49.566438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232e401-0ad7-4e3e-ad1d-377cbcd27011 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:49.576896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232e401-0ad7-4e3e-ad1d-377cbcd27011 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:49.582157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1dd69-1503-4887-a15f-4f9dd94946d4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fcfdebd22764ceda754e2282dbbe6bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c89a5d525fa4e9194ef7ef6a73f45e2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:49.583248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1dd69-1503-4887-a15f-4f9dd94946d4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:49.583540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1dd69-1503-4887-a15f-4f9dd94946d4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:49.583822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1dd69-1503-4887-a15f-4f9dd94946d4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] PATH_INFO: `/v3/credentials/e89508b6f03e33f26aa0ccf6d082f4017f17805989de6450db7cb7da1a2b0c38` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:49.585884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1dd69-1503-4887-a15f-4f9dd94946d4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=e89508b6f03e33f26aa0ccf6d082f4017f17805989de6450db7cb7da1a2b0c38)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:49.587759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1dd69-1503-4887-a15f-4f9dd94946d4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:49.680535 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3574/7128] 10.222.0.16 () {58 vars in 1337 bytes} [Mon May 2 10:48:49 2022] DELETE /identity/v3/credentials/e89508b6f03e33f26aa0ccf6d082f4017f17805989de6450db7cb7da1a2b0c38 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:49.693589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3160631-8769-4822-8377-aadd1df9c398 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:49.695373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3160631-8769-4822-8377-aadd1df9c398 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:49.700919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b6a2b-5620-42e6-98f4-1ee9bdac37f4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fcfdebd22764ceda754e2282dbbe6bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c89a5d525fa4e9194ef7ef6a73f45e2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:49.702129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b6a2b-5620-42e6-98f4-1ee9bdac37f4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:49.702129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b6a2b-5620-42e6-98f4-1ee9bdac37f4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:49.702520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b6a2b-5620-42e6-98f4-1ee9bdac37f4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] PATH_INFO: `/v3/credentials/29b7154abf16289a1e4498c5281196453774e767e05f62751612618aa58fbb28` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:49.704566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b6a2b-5620-42e6-98f4-1ee9bdac37f4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=29b7154abf16289a1e4498c5281196453774e767e05f62751612618aa58fbb28)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:49.706547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b6a2b-5620-42e6-98f4-1ee9bdac37f4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:49.803900 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3555/7129] 10.222.0.16 () {58 vars in 1337 bytes} [Mon May 2 10:48:49 2022] DELETE /identity/v3/credentials/29b7154abf16289a1e4498c5281196453774e767e05f62751612618aa58fbb28 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:49.805433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1dd69-1503-4887-a15f-4f9dd94946d4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:49.824569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1dd69-1503-4887-a15f-4f9dd94946d4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:49.824569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f37982-b958-4fe7-a29d-42fbee163b22 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fcfdebd22764ceda754e2282dbbe6bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c89a5d525fa4e9194ef7ef6a73f45e2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:49.825435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f37982-b958-4fe7-a29d-42fbee163b22 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:49.825725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f37982-b958-4fe7-a29d-42fbee163b22 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:49.826008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f37982-b958-4fe7-a29d-42fbee163b22 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] PATH_INFO: `/v3/projects/8f6021f6c97f4477b6941471083b0b94` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:49.827390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f37982-b958-4fe7-a29d-42fbee163b22 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8f6021f6c97f4477b6941471083b0b94)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:49.829752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f37982-b958-4fe7-a29d-42fbee163b22 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:49.907405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b6a2b-5620-42e6-98f4-1ee9bdac37f4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:49.916859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0f5b6a2b-5620-42e6-98f4-1ee9bdac37f4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:49.958003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-50f37982-b958-4fe7-a29d-42fbee163b22 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f6021f6c97f4477b6941471083b0b94', 'request_id': 'req-50f37982-b958-4fe7-a29d-42fbee163b22'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:49.978305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b6a2b-5620-42e6-98f4-1ee9bdac37f4 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:50.030863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029f208-6600-4add-92cb-9f31f15b54c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:50.032415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029f208-6600-4add-92cb-9f31f15b54c8 service glance] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:50.032875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029f208-6600-4add-92cb-9f31f15b54c8 service glance] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:50.033169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029f208-6600-4add-92cb-9f31f15b54c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:50.035292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1029f208-6600-4add-92cb-9f31f15b54c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:50.045895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-50f37982-b958-4fe7-a29d-42fbee163b22 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f6021f6c97f4477b6941471083b0b94', 'request_id': 'req-50f37982-b958-4fe7-a29d-42fbee163b22'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:50.057041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-50f37982-b958-4fe7-a29d-42fbee163b22 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f6021f6c97f4477b6941471083b0b94', 'request_id': 'req-50f37982-b958-4fe7-a29d-42fbee163b22'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:50.073728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-50f37982-b958-4fe7-a29d-42fbee163b22 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] The token cache is being invalidate because project 8f6021f6c97f4477b6941471083b0b94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:48:50.073924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-50f37982-b958-4fe7-a29d-42fbee163b22 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:50.074647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-50f37982-b958-4fe7-a29d-42fbee163b22 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:50.076622 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3575/7130] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:48:49 2022] DELETE /identity/v3/projects/8f6021f6c97f4477b6941471083b0b94 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:50.080964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f37982-b958-4fe7-a29d-42fbee163b22 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:50.082551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-50f37982-b958-4fe7-a29d-42fbee163b22 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:50.133372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029f208-6600-4add-92cb-9f31f15b54c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:50.134829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029f208-6600-4add-92cb-9f31f15b54c8 service glance] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:50.148316 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3556/7131] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:48:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:48:50.153236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f37982-b958-4fe7-a29d-42fbee163b22 tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:50.164068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377818b-437f-46ee-bc01-77af9600f9dc tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fcfdebd22764ceda754e2282dbbe6bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c89a5d525fa4e9194ef7ef6a73f45e2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:50.165019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377818b-437f-46ee-bc01-77af9600f9dc tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:50.165314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377818b-437f-46ee-bc01-77af9600f9dc tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:50.165601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377818b-437f-46ee-bc01-77af9600f9dc tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] PATH_INFO: `/v3/projects/59e562fde1f54b55a07b63ad5546c01b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:50.166840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6377818b-437f-46ee-bc01-77af9600f9dc tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorizing `identity:delete_project(project_id=59e562fde1f54b55a07b63ad5546c01b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:50.168796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6377818b-437f-46ee-bc01-77af9600f9dc tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:50.293150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6377818b-437f-46ee-bc01-77af9600f9dc tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59e562fde1f54b55a07b63ad5546c01b', 'request_id': 'req-6377818b-437f-46ee-bc01-77af9600f9dc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:50.365618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029f208-6600-4add-92cb-9f31f15b54c8 service glance] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:50.367087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1029f208-6600-4add-92cb-9f31f15b54c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:50.426189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029f208-6600-4add-92cb-9f31f15b54c8 service glance] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:50.435063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6377818b-437f-46ee-bc01-77af9600f9dc tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59e562fde1f54b55a07b63ad5546c01b', 'request_id': 'req-6377818b-437f-46ee-bc01-77af9600f9dc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:50.443692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6377818b-437f-46ee-bc01-77af9600f9dc tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59e562fde1f54b55a07b63ad5546c01b', 'request_id': 'req-6377818b-437f-46ee-bc01-77af9600f9dc'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:50.454656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6377818b-437f-46ee-bc01-77af9600f9dc tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] The token cache is being invalidate because project 59e562fde1f54b55a07b63ad5546c01b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:48:50.454970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6377818b-437f-46ee-bc01-77af9600f9dc tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:50.455435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6377818b-437f-46ee-bc01-77af9600f9dc tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:50.457659 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3576/7132] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:48:50 2022] DELETE /identity/v3/projects/59e562fde1f54b55a07b63ad5546c01b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:50.461623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377818b-437f-46ee-bc01-77af9600f9dc tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:50.462981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6377818b-437f-46ee-bc01-77af9600f9dc tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:50.478564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad6aee-725f-4666-b747-d1e7a0d4f326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:50.479241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad6aee-725f-4666-b747-d1e7a0d4f326 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:50.479524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad6aee-725f-4666-b747-d1e7a0d4f326 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:50.479801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad6aee-725f-4666-b747-d1e7a0d4f326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:50.481586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1aad6aee-725f-4666-b747-d1e7a0d4f326 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:50.494013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad6aee-725f-4666-b747-d1e7a0d4f326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:50.495555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad6aee-725f-4666-b747-d1e7a0d4f326 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:50.506362 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3557/7133] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:48:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:48:50.528516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377818b-437f-46ee-bc01-77af9600f9dc tempest-CredentialsTestJSON-1792883823 tempest-CredentialsTestJSON-1792883823-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:50.535243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4d8d3-4c52-49b9-9ba2-42890e51e2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:50.535243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4d8d3-4c52-49b9-9ba2-42890e51e2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:50.535243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4d8d3-4c52-49b9-9ba2-42890e51e2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:50.535243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4d8d3-4c52-49b9-9ba2-42890e51e2c6 admin admin] PATH_INFO: `/v3/users/69c12c1e7a3142aaad5ab08ec4c16d96` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:50.536297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4d8d3-4c52-49b9-9ba2-42890e51e2c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c12c1e7a3142aaad5ab08ec4c16d96)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:50.538380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4d8d3-4c52-49b9-9ba2-42890e51e2c6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:50.592420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad6aee-725f-4666-b747-d1e7a0d4f326 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:50.592420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1aad6aee-725f-4666-b747-d1e7a0d4f326 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:50.602519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad6aee-725f-4666-b747-d1e7a0d4f326 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:50.606309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e696368-6e7a-4a21-8e9a-42a4c43a2285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:50.606958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e696368-6e7a-4a21-8e9a-42a4c43a2285 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:50.607271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e696368-6e7a-4a21-8e9a-42a4c43a2285 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:50.607550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e696368-6e7a-4a21-8e9a-42a4c43a2285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:50.609487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1e696368-6e7a-4a21-8e9a-42a4c43a2285 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:50.680582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e696368-6e7a-4a21-8e9a-42a4c43a2285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:50.682072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e696368-6e7a-4a21-8e9a-42a4c43a2285 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:50.695202 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3558/7134] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:48:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:48:50.783866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dfa4d8d3-4c52-49b9-9ba2-42890e51e2c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c12c1e7a3142aaad5ab08ec4c16d96'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:50.795676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dfa4d8d3-4c52-49b9-9ba2-42890e51e2c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c12c1e7a3142aaad5ab08ec4c16d96'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:50.796356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dfa4d8d3-4c52-49b9-9ba2-42890e51e2c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c12c1e7a3142aaad5ab08ec4c16d96'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:50.804025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dfa4d8d3-4c52-49b9-9ba2-42890e51e2c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c12c1e7a3142aaad5ab08ec4c16d96'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:50.890970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dfa4d8d3-4c52-49b9-9ba2-42890e51e2c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c12c1e7a3142aaad5ab08ec4c16d96'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:50.900721 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3577/7135] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:48:50 2022] DELETE /identity/v3/users/69c12c1e7a3142aaad5ab08ec4c16d96 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:48:50.906490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbe831-a8d4-47d5-ac22-be8155cfda9e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:50.907259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbe831-a8d4-47d5-ac22-be8155cfda9e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:50.907538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbe831-a8d4-47d5-ac22-be8155cfda9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:50.926364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a4fbe831-a8d4-47d5-ac22-be8155cfda9e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:50.927643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a4fbe831-a8d4-47d5-ac22-be8155cfda9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:51.003567 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3559/7136] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:51.013465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4d8d3-4c52-49b9-9ba2-42890e51e2c6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:51.015509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dfa4d8d3-4c52-49b9-9ba2-42890e51e2c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:51.106522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4d8d3-4c52-49b9-9ba2-42890e51e2c6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:51.110849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a227b11-102a-4a38-bf10-0549d4af30a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:51.111540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a227b11-102a-4a38-bf10-0549d4af30a6 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:51.111827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a227b11-102a-4a38-bf10-0549d4af30a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:51.112106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a227b11-102a-4a38-bf10-0549d4af30a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:51.122957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a227b11-102a-4a38-bf10-0549d4af30a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:51.124781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a227b11-102a-4a38-bf10-0549d4af30a6 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:51.138839 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3578/7137] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:48:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:48:51.619447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fbe831-a8d4-47d5-ac22-be8155cfda9e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:51.620645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a4fbe831-a8d4-47d5-ac22-be8155cfda9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:51.644874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fbe831-a8d4-47d5-ac22-be8155cfda9e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:51.649801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba023b-66fd-4195-8212-5a219fbbe062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:51.650669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba023b-66fd-4195-8212-5a219fbbe062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:51.650956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba023b-66fd-4195-8212-5a219fbbe062 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:51.651233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba023b-66fd-4195-8212-5a219fbbe062 admin admin] PATH_INFO: `/v3/projects/95f90f5a43f849da9b0f38406b203c88` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:51.652416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba023b-66fd-4195-8212-5a219fbbe062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95f90f5a43f849da9b0f38406b203c88)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:51.654481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba023b-66fd-4195-8212-5a219fbbe062 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:51.795866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-69ba023b-66fd-4195-8212-5a219fbbe062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f90f5a43f849da9b0f38406b203c88', 'request_id': 'req-69ba023b-66fd-4195-8212-5a219fbbe062'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:51.804169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-69ba023b-66fd-4195-8212-5a219fbbe062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f90f5a43f849da9b0f38406b203c88', 'request_id': 'req-69ba023b-66fd-4195-8212-5a219fbbe062'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:51.879961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-69ba023b-66fd-4195-8212-5a219fbbe062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f90f5a43f849da9b0f38406b203c88', 'request_id': 'req-69ba023b-66fd-4195-8212-5a219fbbe062'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:51.892322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-69ba023b-66fd-4195-8212-5a219fbbe062 admin admin] The token cache is being invalidate because project 95f90f5a43f849da9b0f38406b203c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:48:51.893090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-69ba023b-66fd-4195-8212-5a219fbbe062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:51.893789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-69ba023b-66fd-4195-8212-5a219fbbe062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:51.895434 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3560/7138] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:48:51 2022] DELETE /identity/v3/projects/95f90f5a43f849da9b0f38406b203c88 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:51.899683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a227b11-102a-4a38-bf10-0549d4af30a6 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:51.909501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a227b11-102a-4a38-bf10-0549d4af30a6 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:51.972960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42a95d-726e-4127-bf88-3ef9e54cd0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:51.973870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42a95d-726e-4127-bf88-3ef9e54cd0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:51.974237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42a95d-726e-4127-bf88-3ef9e54cd0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:51.974404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42a95d-726e-4127-bf88-3ef9e54cd0d1 admin admin] PATH_INFO: `/v3/users/4fcfdebd22764ceda754e2282dbbe6bf` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:51.975610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42a95d-726e-4127-bf88-3ef9e54cd0d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fcfdebd22764ceda754e2282dbbe6bf)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:51.977818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42a95d-726e-4127-bf88-3ef9e54cd0d1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:52.177676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9b42a95d-726e-4127-bf88-3ef9e54cd0d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fcfdebd22764ceda754e2282dbbe6bf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:52.192154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9b42a95d-726e-4127-bf88-3ef9e54cd0d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fcfdebd22764ceda754e2282dbbe6bf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:52.193492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9b42a95d-726e-4127-bf88-3ef9e54cd0d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fcfdebd22764ceda754e2282dbbe6bf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:52.199843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9b42a95d-726e-4127-bf88-3ef9e54cd0d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fcfdebd22764ceda754e2282dbbe6bf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:52.270402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9b42a95d-726e-4127-bf88-3ef9e54cd0d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fcfdebd22764ceda754e2282dbbe6bf'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:52.278395 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3579/7139] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:48:51 2022] DELETE /identity/v3/users/4fcfdebd22764ceda754e2282dbbe6bf => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:52.802709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba023b-66fd-4195-8212-5a219fbbe062 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:52.805337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-69ba023b-66fd-4195-8212-5a219fbbe062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:52.824187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba023b-66fd-4195-8212-5a219fbbe062 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:52.888417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebba10f-b301-4928-aaea-f667bcff17aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:52.889341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebba10f-b301-4928-aaea-f667bcff17aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:52.889631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebba10f-b301-4928-aaea-f667bcff17aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:52.889910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebba10f-b301-4928-aaea-f667bcff17aa admin admin] PATH_INFO: `/v3/projects/6c89a5d525fa4e9194ef7ef6a73f45e2` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:52.891655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebba10f-b301-4928-aaea-f667bcff17aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c89a5d525fa4e9194ef7ef6a73f45e2)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:52.893701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebba10f-b301-4928-aaea-f667bcff17aa admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:53.000121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cebba10f-b301-4928-aaea-f667bcff17aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c89a5d525fa4e9194ef7ef6a73f45e2', 'request_id': 'req-cebba10f-b301-4928-aaea-f667bcff17aa'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:53.007089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cebba10f-b301-4928-aaea-f667bcff17aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c89a5d525fa4e9194ef7ef6a73f45e2', 'request_id': 'req-cebba10f-b301-4928-aaea-f667bcff17aa'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:53.085037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cebba10f-b301-4928-aaea-f667bcff17aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c89a5d525fa4e9194ef7ef6a73f45e2', 'request_id': 'req-cebba10f-b301-4928-aaea-f667bcff17aa'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:53.096979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cebba10f-b301-4928-aaea-f667bcff17aa admin admin] The token cache is being invalidate because project 6c89a5d525fa4e9194ef7ef6a73f45e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:48:53.097271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cebba10f-b301-4928-aaea-f667bcff17aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:53.098011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cebba10f-b301-4928-aaea-f667bcff17aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:53.099955 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3561/7140] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:48:52 2022] DELETE /identity/v3/projects/6c89a5d525fa4e9194ef7ef6a73f45e2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:53.104841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0321053-d34f-4a46-b09c-6a74f26c94b0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:53.105299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0321053-d34f-4a46-b09c-6a74f26c94b0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:53.105407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0321053-d34f-4a46-b09c-6a74f26c94b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:53.124229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d0321053-d34f-4a46-b09c-6a74f26c94b0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:53.126032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d0321053-d34f-4a46-b09c-6a74f26c94b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:53.185131 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3580/7141] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:53.193517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a0ebb-aff3-408d-9a3f-52b4aa205a6b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:53.193822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a0ebb-aff3-408d-9a3f-52b4aa205a6b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:53.194107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a0ebb-aff3-408d-9a3f-52b4aa205a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:53.213317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-973a0ebb-aff3-408d-9a3f-52b4aa205a6b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:53.214521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-973a0ebb-aff3-408d-9a3f-52b4aa205a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:53.222518 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3562/7142] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:53.226720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0321053-d34f-4a46-b09c-6a74f26c94b0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:53.236494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0321053-d34f-4a46-b09c-6a74f26c94b0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:53.242282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0b8e2-771c-4158-973e-8e310da00151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:53.242282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0b8e2-771c-4158-973e-8e310da00151 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:53.242282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0b8e2-771c-4158-973e-8e310da00151 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:53.242762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0b8e2-771c-4158-973e-8e310da00151 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:53.243258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0b8e2-771c-4158-973e-8e310da00151 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:48:53.243574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0b8e2-771c-4158-973e-8e310da00151 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:53.245219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0b8e2-771c-4158-973e-8e310da00151 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:53.261200 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3581/7143] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:48:53.265922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a0ebb-aff3-408d-9a3f-52b4aa205a6b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:53.276484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a0ebb-aff3-408d-9a3f-52b4aa205a6b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:53.282579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aaa64f-31e3-43dc-a99c-1dd10024cbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:53.283238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaa64f-31e3-43dc-a99c-1dd10024cbb3 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:53.283524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaa64f-31e3-43dc-a99c-1dd10024cbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:53.283804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaa64f-31e3-43dc-a99c-1dd10024cbb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:53.284624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aaa64f-31e3-43dc-a99c-1dd10024cbb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:53.288062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aaa64f-31e3-43dc-a99c-1dd10024cbb3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:53.415576 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3563/7144] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:48:53 2022] POST /identity/v3/projects => generated 389 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:48:53.416848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0b8e2-771c-4158-973e-8e310da00151 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:53.428199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0b8e2-771c-4158-973e-8e310da00151 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:53.493630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57d33a-1192-4d04-ab0a-6bae05745919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:53.494233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57d33a-1192-4d04-ab0a-6bae05745919 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:53.494522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57d33a-1192-4d04-ab0a-6bae05745919 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:53.494806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57d33a-1192-4d04-ab0a-6bae05745919 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:53.495579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57d33a-1192-4d04-ab0a-6bae05745919 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:53.497690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57d33a-1192-4d04-ab0a-6bae05745919 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:53.607030 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3582/7145] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:48:53 2022] POST /identity/v3/users => generated 295 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:48:53.611616 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aaa64f-31e3-43dc-a99c-1dd10024cbb3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:53.623900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aaa64f-31e3-43dc-a99c-1dd10024cbb3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:53.629861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb30d91-869c-40fe-8314-939f15e47c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:53.630542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb30d91-869c-40fe-8314-939f15e47c40 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:53.630834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb30d91-869c-40fe-8314-939f15e47c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:53.631119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb30d91-869c-40fe-8314-939f15e47c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:53.631854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb30d91-869c-40fe-8314-939f15e47c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:53.633528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb30d91-869c-40fe-8314-939f15e47c40 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:53.646319 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3564/7146] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:48:53.650117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57d33a-1192-4d04-ab0a-6bae05745919 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:53.662722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57d33a-1192-4d04-ab0a-6bae05745919 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:53.668853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269b091-1424-45fa-baa9-f6c7780fb0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:53.669776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269b091-1424-45fa-baa9-f6c7780fb0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:53.670239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269b091-1424-45fa-baa9-f6c7780fb0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:53.670599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269b091-1424-45fa-baa9-f6c7780fb0a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:53.671512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269b091-1424-45fa-baa9-f6c7780fb0a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:53.673812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269b091-1424-45fa-baa9-f6c7780fb0a4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:53.685046 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3583/7147] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:48:53.697155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb30d91-869c-40fe-8314-939f15e47c40 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:53.709422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb30d91-869c-40fe-8314-939f15e47c40 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:53.714168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930d8f8-b218-45ed-afc0-fb3b8dd0ce0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:53.715059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930d8f8-b218-45ed-afc0-fb3b8dd0ce0e admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:53.715348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930d8f8-b218-45ed-afc0-fb3b8dd0ce0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:53.715633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930d8f8-b218-45ed-afc0-fb3b8dd0ce0e admin admin] PATH_INFO: `/v3/projects/34a8ce2bf72d411784b2fb912d09f27c/users/a24e8e338e3b47bcae62413f25935ed2/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:53.732001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930d8f8-b218-45ed-afc0-fb3b8dd0ce0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a8ce2bf72d411784b2fb912d09f27c, user_id=a24e8e338e3b47bcae62413f25935ed2, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:53.734731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930d8f8-b218-45ed-afc0-fb3b8dd0ce0e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:53.812572 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3565/7148] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:48:53 2022] PUT /identity/v3/projects/34a8ce2bf72d411784b2fb912d09f27c/users/a24e8e338e3b47bcae62413f25935ed2/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:53.824867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d35155-d956-4fc7-aa63-1151413e2248 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:53.825515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d35155-d956-4fc7-aa63-1151413e2248 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:53.825984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d35155-d956-4fc7-aa63-1151413e2248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:53.859224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-02d35155-d956-4fc7-aa63-1151413e2248 None None] MFA Rules not processed for user `a24e8e338e3b47bcae62413f25935ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:53.861231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-02d35155-d956-4fc7-aa63-1151413e2248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:53.932944 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3584/7149] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:53.944966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930d8f8-b218-45ed-afc0-fb3b8dd0ce0e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:54.026029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930d8f8-b218-45ed-afc0-fb3b8dd0ce0e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:54.031166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f2b53-9268-4371-b412-bb4316790082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:54.032674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f2b53-9268-4371-b412-bb4316790082 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:54.033288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f2b53-9268-4371-b412-bb4316790082 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:54.033669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f2b53-9268-4371-b412-bb4316790082 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:54.034523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f2b53-9268-4371-b412-bb4316790082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:54.036529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f2b53-9268-4371-b412-bb4316790082 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:54.163723 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3566/7150] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:48:53 2022] POST /identity/v3/projects => generated 389 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:48:54.167784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d35155-d956-4fc7-aa63-1151413e2248 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:54.179134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d35155-d956-4fc7-aa63-1151413e2248 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:54.235925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0766d4-b1d8-42b4-8511-16b3b1da88b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:54.236653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0766d4-b1d8-42b4-8511-16b3b1da88b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:54.236906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0766d4-b1d8-42b4-8511-16b3b1da88b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:54.237189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0766d4-b1d8-42b4-8511-16b3b1da88b9 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:54.237890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0766d4-b1d8-42b4-8511-16b3b1da88b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:54.239820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0766d4-b1d8-42b4-8511-16b3b1da88b9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:54.365441 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3585/7151] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:48:54 2022] POST /identity/v3/users => generated 301 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:48:54.365920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f2b53-9268-4371-b412-bb4316790082 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:54.380929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f2b53-9268-4371-b412-bb4316790082 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:54.388098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89b317-f775-440e-a80b-ad319a6aba80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:54.388833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89b317-f775-440e-a80b-ad319a6aba80 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:54.389179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89b317-f775-440e-a80b-ad319a6aba80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:54.394236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89b317-f775-440e-a80b-ad319a6aba80 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:54.394236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89b317-f775-440e-a80b-ad319a6aba80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:54.394236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89b317-f775-440e-a80b-ad319a6aba80 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:54.405352 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3567/7152] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:48:54.410564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0766d4-b1d8-42b4-8511-16b3b1da88b9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:54.422561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0766d4-b1d8-42b4-8511-16b3b1da88b9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:54.427687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5484f6-1c96-4143-b088-3cd32b4665dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:54.428584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5484f6-1c96-4143-b088-3cd32b4665dc admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:54.428908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5484f6-1c96-4143-b088-3cd32b4665dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:54.429198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5484f6-1c96-4143-b088-3cd32b4665dc admin admin] PATH_INFO: `/v3/projects/112074bbe18342bdae7e7da43304a04d/users/8880e6019cb9422596fe004886c300b4/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:54.444160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5484f6-1c96-4143-b088-3cd32b4665dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=112074bbe18342bdae7e7da43304a04d, user_id=8880e6019cb9422596fe004886c300b4, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:54.446898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5484f6-1c96-4143-b088-3cd32b4665dc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:54.532367 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3586/7153] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:48:54 2022] PUT /identity/v3/projects/112074bbe18342bdae7e7da43304a04d/users/8880e6019cb9422596fe004886c300b4/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:54.536409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89b317-f775-440e-a80b-ad319a6aba80 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:54.547353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89b317-f775-440e-a80b-ad319a6aba80 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:54.605548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8d39b-b9c5-4ff0-a20b-577d5ae54b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:54.606236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8d39b-b9c5-4ff0-a20b-577d5ae54b64 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:54.606527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8d39b-b9c5-4ff0-a20b-577d5ae54b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:54.606809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8d39b-b9c5-4ff0-a20b-577d5ae54b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:54.607535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8d39b-b9c5-4ff0-a20b-577d5ae54b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:54.609316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8d39b-b9c5-4ff0-a20b-577d5ae54b64 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:54.619649 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3568/7154] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:48:54.624103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5484f6-1c96-4143-b088-3cd32b4665dc admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:54.635738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5484f6-1c96-4143-b088-3cd32b4665dc admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:54.640768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a237a-2bad-4941-8f3f-6c32f0145217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:54.642350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a237a-2bad-4941-8f3f-6c32f0145217 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:54.642666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a237a-2bad-4941-8f3f-6c32f0145217 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:54.642946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a237a-2bad-4941-8f3f-6c32f0145217 admin admin] PATH_INFO: `/v3/projects/112074bbe18342bdae7e7da43304a04d/users/8880e6019cb9422596fe004886c300b4/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:54.644991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a237a-2bad-4941-8f3f-6c32f0145217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=112074bbe18342bdae7e7da43304a04d, user_id=8880e6019cb9422596fe004886c300b4, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:54.647679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a237a-2bad-4941-8f3f-6c32f0145217 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:54.658106 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3587/7155] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:48:54 2022] PUT /identity/v3/projects/112074bbe18342bdae7e7da43304a04d/users/8880e6019cb9422596fe004886c300b4/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:54.669815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c97663-e53d-4001-b55e-a37d95f822f2 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:54.670111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c97663-e53d-4001-b55e-a37d95f822f2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:54.670997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c97663-e53d-4001-b55e-a37d95f822f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:54.699407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-05c97663-e53d-4001-b55e-a37d95f822f2 None None] MFA Rules not processed for user `8880e6019cb9422596fe004886c300b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:54.700665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-05c97663-e53d-4001-b55e-a37d95f822f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:54.779415 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3569/7156] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:54 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:54.785698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a237a-2bad-4941-8f3f-6c32f0145217 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:54.795315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a237a-2bad-4941-8f3f-6c32f0145217 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:54.800159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc810087-c24c-4ee5-8348-76088414676d tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8880e6019cb9422596fe004886c300b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112074bbe18342bdae7e7da43304a04d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:54.801102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc810087-c24c-4ee5-8348-76088414676d tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:54.801396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc810087-c24c-4ee5-8348-76088414676d tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:54.801680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc810087-c24c-4ee5-8348-76088414676d tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] PATH_INFO: `/v3/projects/34a8ce2bf72d411784b2fb912d09f27c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:54.803852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc810087-c24c-4ee5-8348-76088414676d tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorizing `identity:get_project(project_id=34a8ce2bf72d411784b2fb912d09f27c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:54.806093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc810087-c24c-4ee5-8348-76088414676d tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:54.809104 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3588/7157] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:48:54 2022] GET /identity/v3/projects/34a8ce2bf72d411784b2fb912d09f27c => generated 389 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:48:54.817539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c97663-e53d-4001-b55e-a37d95f822f2 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:54.828510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c97663-e53d-4001-b55e-a37d95f822f2 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:54.837342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c96e3-fbf8-46e5-9498-5322e4b55b40 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8880e6019cb9422596fe004886c300b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112074bbe18342bdae7e7da43304a04d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:54.839058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c96e3-fbf8-46e5-9498-5322e4b55b40 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:54.839667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c96e3-fbf8-46e5-9498-5322e4b55b40 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:54.840020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c96e3-fbf8-46e5-9498-5322e4b55b40 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:54.841658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c96e3-fbf8-46e5-9498-5322e4b55b40 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:54.845230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c96e3-fbf8-46e5-9498-5322e4b55b40 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:54.956438 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3570/7158] 10.222.0.16 () {60 vars in 1151 bytes} [Mon May 2 10:48:54 2022] POST /identity/v3/projects => generated 339 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:48:54.961303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc810087-c24c-4ee5-8348-76088414676d tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:54.971662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc810087-c24c-4ee5-8348-76088414676d tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:55.033703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150a3c6-3ad3-4b8a-b611-f599c511ed2f tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8880e6019cb9422596fe004886c300b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112074bbe18342bdae7e7da43304a04d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:55.034389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150a3c6-3ad3-4b8a-b611-f599c511ed2f tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:55.034681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150a3c6-3ad3-4b8a-b611-f599c511ed2f tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:55.035148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150a3c6-3ad3-4b8a-b611-f599c511ed2f tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:55.036153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150a3c6-3ad3-4b8a-b611-f599c511ed2f tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:55.038178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150a3c6-3ad3-4b8a-b611-f599c511ed2f tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:55.060337 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3589/7159] 10.222.0.16 () {58 vars in 1130 bytes} [Mon May 2 10:48:54 2022] GET /identity/v3/projects => generated 6568 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:48:55.062486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c96e3-fbf8-46e5-9498-5322e4b55b40 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:55.073631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c96e3-fbf8-46e5-9498-5322e4b55b40 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:55.078535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8af96-6d58-4f5b-b114-08ccb1fb92cd tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8880e6019cb9422596fe004886c300b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112074bbe18342bdae7e7da43304a04d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:55.079533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8af96-6d58-4f5b-b114-08ccb1fb92cd tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:55.079830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8af96-6d58-4f5b-b114-08ccb1fb92cd tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:55.080113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8af96-6d58-4f5b-b114-08ccb1fb92cd tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] PATH_INFO: `/v3/projects/34a8ce2bf72d411784b2fb912d09f27c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:55.081383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8af96-6d58-4f5b-b114-08ccb1fb92cd tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorizing `identity:get_project(project_id=34a8ce2bf72d411784b2fb912d09f27c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:55.083460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8af96-6d58-4f5b-b114-08ccb1fb92cd tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:55.085264 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3571/7160] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:48:55 2022] GET /identity/v3/projects/34a8ce2bf72d411784b2fb912d09f27c => generated 389 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:48:55.089326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150a3c6-3ad3-4b8a-b611-f599c511ed2f tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:55.099235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150a3c6-3ad3-4b8a-b611-f599c511ed2f tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:55.107069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608dd32-0e62-47d9-bf1e-183b7d927a73 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8880e6019cb9422596fe004886c300b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112074bbe18342bdae7e7da43304a04d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:55.108006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608dd32-0e62-47d9-bf1e-183b7d927a73 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:55.108456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608dd32-0e62-47d9-bf1e-183b7d927a73 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:55.108793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608dd32-0e62-47d9-bf1e-183b7d927a73 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] PATH_INFO: `/v3/projects/2126d96823824a6680b33205cc7bba59` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:55.111139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608dd32-0e62-47d9-bf1e-183b7d927a73 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorizing `identity:get_project(project_id=2126d96823824a6680b33205cc7bba59)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:55.112915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608dd32-0e62-47d9-bf1e-183b7d927a73 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:55.118812 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3590/7161] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:48:55 2022] GET /identity/v3/projects/2126d96823824a6680b33205cc7bba59 => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:48:55.120038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8af96-6d58-4f5b-b114-08ccb1fb92cd tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:55.131868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8af96-6d58-4f5b-b114-08ccb1fb92cd tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:55.138068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878938f-71a2-4296-afbd-1591e320aeec tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8880e6019cb9422596fe004886c300b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112074bbe18342bdae7e7da43304a04d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:55.138068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878938f-71a2-4296-afbd-1591e320aeec tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:55.138068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878938f-71a2-4296-afbd-1591e320aeec tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:55.138441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878938f-71a2-4296-afbd-1591e320aeec tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:55.138769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878938f-71a2-4296-afbd-1591e320aeec tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:55.140659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878938f-71a2-4296-afbd-1591e320aeec tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:55.160266 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3572/7162] 10.222.0.16 () {58 vars in 1130 bytes} [Mon May 2 10:48:55 2022] GET /identity/v3/projects => generated 6568 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:48:55.165333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608dd32-0e62-47d9-bf1e-183b7d927a73 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:55.176465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608dd32-0e62-47d9-bf1e-183b7d927a73 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:55.181494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eef912-1ec3-4743-a1c8-2cf6e1a032e0 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8880e6019cb9422596fe004886c300b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112074bbe18342bdae7e7da43304a04d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:55.182157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eef912-1ec3-4743-a1c8-2cf6e1a032e0 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:55.182449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eef912-1ec3-4743-a1c8-2cf6e1a032e0 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:55.182733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eef912-1ec3-4743-a1c8-2cf6e1a032e0 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:55.183533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eef912-1ec3-4743-a1c8-2cf6e1a032e0 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:48:55.183991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eef912-1ec3-4743-a1c8-2cf6e1a032e0 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:55.185901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eef912-1ec3-4743-a1c8-2cf6e1a032e0 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:55.212780 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3591/7163] 10.222.0.16 () {58 vars in 1165 bytes} [Mon May 2 10:48:55 2022] GET /identity/v3/projects?domain_id=default => generated 6237 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:48:55.214912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878938f-71a2-4296-afbd-1591e320aeec tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:55.225763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878938f-71a2-4296-afbd-1591e320aeec tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:55.230392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd102c92-8a9d-4dd6-abc7-e26c1ed4b7e4 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8880e6019cb9422596fe004886c300b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112074bbe18342bdae7e7da43304a04d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:55.231039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd102c92-8a9d-4dd6-abc7-e26c1ed4b7e4 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:55.231322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd102c92-8a9d-4dd6-abc7-e26c1ed4b7e4 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:55.231599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd102c92-8a9d-4dd6-abc7-e26c1ed4b7e4 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:55.232321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd102c92-8a9d-4dd6-abc7-e26c1ed4b7e4 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:55.235507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd102c92-8a9d-4dd6-abc7-e26c1ed4b7e4 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:55.254192 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3573/7164] 10.222.0.16 () {58 vars in 1130 bytes} [Mon May 2 10:48:55 2022] GET /identity/v3/projects => generated 6568 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:48:55.259275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eef912-1ec3-4743-a1c8-2cf6e1a032e0 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:55.269422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eef912-1ec3-4743-a1c8-2cf6e1a032e0 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:55.274668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8113f-5239-4d66-848a-4635e0f4a1d5 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8880e6019cb9422596fe004886c300b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112074bbe18342bdae7e7da43304a04d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:55.275473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8113f-5239-4d66-848a-4635e0f4a1d5 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:55.275777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8113f-5239-4d66-848a-4635e0f4a1d5 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:55.276190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8113f-5239-4d66-848a-4635e0f4a1d5 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:55.277003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8113f-5239-4d66-848a-4635e0f4a1d5 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:48:55.282251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8113f-5239-4d66-848a-4635e0f4a1d5 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:55.282251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8113f-5239-4d66-848a-4635e0f4a1d5 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:55.310169 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3592/7165] 10.222.0.16 () {58 vars in 1165 bytes} [Mon May 2 10:48:55 2022] GET /identity/v3/projects?domain_id=default => generated 6237 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:48:55.311403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd102c92-8a9d-4dd6-abc7-e26c1ed4b7e4 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:55.321312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd102c92-8a9d-4dd6-abc7-e26c1ed4b7e4 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:55.325973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405edd5c-1941-45ab-b3b5-82f9b0c27be6 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8880e6019cb9422596fe004886c300b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112074bbe18342bdae7e7da43304a04d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:55.326631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405edd5c-1941-45ab-b3b5-82f9b0c27be6 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:55.326920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405edd5c-1941-45ab-b3b5-82f9b0c27be6 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:55.327201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405edd5c-1941-45ab-b3b5-82f9b0c27be6 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:55.327935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405edd5c-1941-45ab-b3b5-82f9b0c27be6 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:55.329890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405edd5c-1941-45ab-b3b5-82f9b0c27be6 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:55.352575 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3574/7166] 10.222.0.16 () {58 vars in 1130 bytes} [Mon May 2 10:48:55 2022] GET /identity/v3/projects => generated 6568 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:48:55.353842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8113f-5239-4d66-848a-4635e0f4a1d5 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:55.364544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8113f-5239-4d66-848a-4635e0f4a1d5 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:55.370061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c7a8a-ad6b-4e31-b308-c348761d7f7a tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8880e6019cb9422596fe004886c300b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112074bbe18342bdae7e7da43304a04d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:55.370848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c7a8a-ad6b-4e31-b308-c348761d7f7a tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:55.372306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c7a8a-ad6b-4e31-b308-c348761d7f7a tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:55.372306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c7a8a-ad6b-4e31-b308-c348761d7f7a tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:55.372306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c7a8a-ad6b-4e31-b308-c348761d7f7a tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-2039004331) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:48:55.372788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c7a8a-ad6b-4e31-b308-c348761d7f7a tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:55.374965 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c7a8a-ad6b-4e31-b308-c348761d7f7a tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:55.398922 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3593/7167] 10.222.0.16 () {58 vars in 1231 bytes} [Mon May 2 10:48:55 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-2039004331 => generated 537 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:48:55.400360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405edd5c-1941-45ab-b3b5-82f9b0c27be6 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:55.418415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405edd5c-1941-45ab-b3b5-82f9b0c27be6 tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:55.436629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddff15f-ba42-4ef0-8f56-09844f62231e tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8880e6019cb9422596fe004886c300b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '112074bbe18342bdae7e7da43304a04d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:55.436629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddff15f-ba42-4ef0-8f56-09844f62231e tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:55.436629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddff15f-ba42-4ef0-8f56-09844f62231e tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:55.437415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddff15f-ba42-4ef0-8f56-09844f62231e tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] PATH_INFO: `/v3/projects/2126d96823824a6680b33205cc7bba59` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:55.437415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddff15f-ba42-4ef0-8f56-09844f62231e tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2126d96823824a6680b33205cc7bba59)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:55.437415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddff15f-ba42-4ef0-8f56-09844f62231e tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:55.519845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c5d0d-36e7-4a48-b252-60a344274c30 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:55.520795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c5d0d-36e7-4a48-b252-60a344274c30 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:55.520795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c5d0d-36e7-4a48-b252-60a344274c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:55.542190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-876c5d0d-36e7-4a48-b252-60a344274c30 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:55.543365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-876c5d0d-36e7-4a48-b252-60a344274c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:55.567041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dddff15f-ba42-4ef0-8f56-09844f62231e tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2126d96823824a6680b33205cc7bba59', 'request_id': 'req-dddff15f-ba42-4ef0-8f56-09844f62231e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:55.574059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dddff15f-ba42-4ef0-8f56-09844f62231e tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2126d96823824a6680b33205cc7bba59', 'request_id': 'req-dddff15f-ba42-4ef0-8f56-09844f62231e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:55.610656 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3594/7168] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:48:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:48:55.625830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c5d0d-36e7-4a48-b252-60a344274c30 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:55.627358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-876c5d0d-36e7-4a48-b252-60a344274c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:55.668161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dddff15f-ba42-4ef0-8f56-09844f62231e tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2126d96823824a6680b33205cc7bba59', 'request_id': 'req-dddff15f-ba42-4ef0-8f56-09844f62231e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:55.685627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dddff15f-ba42-4ef0-8f56-09844f62231e tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] The token cache is being invalidate because project 2126d96823824a6680b33205cc7bba59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:48:55.686017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dddff15f-ba42-4ef0-8f56-09844f62231e tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:55.687432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dddff15f-ba42-4ef0-8f56-09844f62231e tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:55.689449 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3575/7169] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:48:55 2022] DELETE /identity/v3/projects/2126d96823824a6680b33205cc7bba59 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:55.693513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddff15f-ba42-4ef0-8f56-09844f62231e tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:55.695538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-dddff15f-ba42-4ef0-8f56-09844f62231e tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:55.737940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c5d0d-36e7-4a48-b252-60a344274c30 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:55.792352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddff15f-ba42-4ef0-8f56-09844f62231e tempest-ListProjectsStaticTestJSON-1113263694 tempest-ListProjectsStaticTestJSON-1113263694-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:55.800837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f24e56-e8d3-4c36-bbc9-9162ea656e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:55.801733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f24e56-e8d3-4c36-bbc9-9162ea656e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:55.802017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f24e56-e8d3-4c36-bbc9-9162ea656e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:55.802296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f24e56-e8d3-4c36-bbc9-9162ea656e15 admin admin] PATH_INFO: `/v3/users/a24e8e338e3b47bcae62413f25935ed2` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:55.804170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f24e56-e8d3-4c36-bbc9-9162ea656e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a24e8e338e3b47bcae62413f25935ed2)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:55.806427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f24e56-e8d3-4c36-bbc9-9162ea656e15 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:55.830842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e40758-4746-4ead-901f-61873b8884dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:55.831501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e40758-4746-4ead-901f-61873b8884dd service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:55.831790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e40758-4746-4ead-901f-61873b8884dd service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:55.832063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e40758-4746-4ead-901f-61873b8884dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:55.835415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b9e40758-4746-4ead-901f-61873b8884dd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:55.907623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e40758-4746-4ead-901f-61873b8884dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:55.909570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e40758-4746-4ead-901f-61873b8884dd service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:55.935144 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3595/7170] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:48:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 02 10:48:56.048725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d4f24e56-e8d3-4c36-bbc9-9162ea656e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a24e8e338e3b47bcae62413f25935ed2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:56.067320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d4f24e56-e8d3-4c36-bbc9-9162ea656e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a24e8e338e3b47bcae62413f25935ed2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:56.068517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d4f24e56-e8d3-4c36-bbc9-9162ea656e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a24e8e338e3b47bcae62413f25935ed2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:56.076718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d4f24e56-e8d3-4c36-bbc9-9162ea656e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a24e8e338e3b47bcae62413f25935ed2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:56.154824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d4f24e56-e8d3-4c36-bbc9-9162ea656e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a24e8e338e3b47bcae62413f25935ed2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:56.164833 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3576/7171] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:48:55 2022] DELETE /identity/v3/users/a24e8e338e3b47bcae62413f25935ed2 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:56.169758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b18c2-0f2c-42a2-b5aa-87a186b4c4fe None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:56.170236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b18c2-0f2c-42a2-b5aa-87a186b4c4fe None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:56.170677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b18c2-0f2c-42a2-b5aa-87a186b4c4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:56.190893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ab7b18c2-0f2c-42a2-b5aa-87a186b4c4fe None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:56.192937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ab7b18c2-0f2c-42a2-b5aa-87a186b4c4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:56.292914 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3596/7172] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:56.302000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f24e56-e8d3-4c36-bbc9-9162ea656e15 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:56.303063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d4f24e56-e8d3-4c36-bbc9-9162ea656e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:56.401600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f24e56-e8d3-4c36-bbc9-9162ea656e15 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:56.417304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940495b-550e-4a12-86bb-086229398a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:56.418485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940495b-550e-4a12-86bb-086229398a01 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:56.418945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940495b-550e-4a12-86bb-086229398a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:56.419412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940495b-550e-4a12-86bb-086229398a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:56.443774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940495b-550e-4a12-86bb-086229398a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:56.446568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940495b-550e-4a12-86bb-086229398a01 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:56.473667 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3577/7173] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:48:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:48:57.151747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b18c2-0f2c-42a2-b5aa-87a186b4c4fe None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:57.153638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ab7b18c2-0f2c-42a2-b5aa-87a186b4c4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:57.171293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b18c2-0f2c-42a2-b5aa-87a186b4c4fe None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:57.178190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365c852-8638-4b8a-b4b7-2b0660868f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:57.179123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365c852-8638-4b8a-b4b7-2b0660868f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:57.179460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365c852-8638-4b8a-b4b7-2b0660868f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:57.179983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365c852-8638-4b8a-b4b7-2b0660868f95 admin admin] PATH_INFO: `/v3/projects/34a8ce2bf72d411784b2fb912d09f27c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:57.181041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365c852-8638-4b8a-b4b7-2b0660868f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34a8ce2bf72d411784b2fb912d09f27c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:57.191785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365c852-8638-4b8a-b4b7-2b0660868f95 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:57.323242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8365c852-8638-4b8a-b4b7-2b0660868f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34a8ce2bf72d411784b2fb912d09f27c', 'request_id': 'req-8365c852-8638-4b8a-b4b7-2b0660868f95'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:57.405682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8365c852-8638-4b8a-b4b7-2b0660868f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34a8ce2bf72d411784b2fb912d09f27c', 'request_id': 'req-8365c852-8638-4b8a-b4b7-2b0660868f95'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:57.415275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8365c852-8638-4b8a-b4b7-2b0660868f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34a8ce2bf72d411784b2fb912d09f27c', 'request_id': 'req-8365c852-8638-4b8a-b4b7-2b0660868f95'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:57.427011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8365c852-8638-4b8a-b4b7-2b0660868f95 admin admin] The token cache is being invalidate because project 34a8ce2bf72d411784b2fb912d09f27c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:48:57.427368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8365c852-8638-4b8a-b4b7-2b0660868f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:57.428227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8365c852-8638-4b8a-b4b7-2b0660868f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:57.430159 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3597/7174] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:48:57 2022] DELETE /identity/v3/projects/34a8ce2bf72d411784b2fb912d09f27c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:57.441870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940495b-550e-4a12-86bb-086229398a01 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:57.454407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940495b-550e-4a12-86bb-086229398a01 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:57.538999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e221a2-9c00-4cb9-8af4-aecf94d1bb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:57.540399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e221a2-9c00-4cb9-8af4-aecf94d1bb92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:57.540849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e221a2-9c00-4cb9-8af4-aecf94d1bb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:57.541426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e221a2-9c00-4cb9-8af4-aecf94d1bb92 admin admin] PATH_INFO: `/v3/users/8880e6019cb9422596fe004886c300b4` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:57.542978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e221a2-9c00-4cb9-8af4-aecf94d1bb92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8880e6019cb9422596fe004886c300b4)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:57.545236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e221a2-9c00-4cb9-8af4-aecf94d1bb92 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:57.756465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e7e221a2-9c00-4cb9-8af4-aecf94d1bb92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8880e6019cb9422596fe004886c300b4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:57.771986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e7e221a2-9c00-4cb9-8af4-aecf94d1bb92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8880e6019cb9422596fe004886c300b4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:57.773080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e7e221a2-9c00-4cb9-8af4-aecf94d1bb92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8880e6019cb9422596fe004886c300b4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:57.782739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e7e221a2-9c00-4cb9-8af4-aecf94d1bb92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8880e6019cb9422596fe004886c300b4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:57.873708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e7e221a2-9c00-4cb9-8af4-aecf94d1bb92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8880e6019cb9422596fe004886c300b4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:57.882329 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3578/7175] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:48:57 2022] DELETE /identity/v3/users/8880e6019cb9422596fe004886c300b4 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:58.938942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365c852-8638-4b8a-b4b7-2b0660868f95 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:58.940761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8365c852-8638-4b8a-b4b7-2b0660868f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:58.978438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365c852-8638-4b8a-b4b7-2b0660868f95 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:59.068124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462f9aa-f5be-4220-a8f3-e88b2542a656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:59.069233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462f9aa-f5be-4220-a8f3-e88b2542a656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:59.069668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462f9aa-f5be-4220-a8f3-e88b2542a656 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:59.069874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462f9aa-f5be-4220-a8f3-e88b2542a656 admin admin] PATH_INFO: `/v3/projects/112074bbe18342bdae7e7da43304a04d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:59.071146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462f9aa-f5be-4220-a8f3-e88b2542a656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=112074bbe18342bdae7e7da43304a04d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:59.073645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462f9aa-f5be-4220-a8f3-e88b2542a656 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:59.271839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d462f9aa-f5be-4220-a8f3-e88b2542a656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '112074bbe18342bdae7e7da43304a04d', 'request_id': 'req-d462f9aa-f5be-4220-a8f3-e88b2542a656'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:59.651543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d462f9aa-f5be-4220-a8f3-e88b2542a656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '112074bbe18342bdae7e7da43304a04d', 'request_id': 'req-d462f9aa-f5be-4220-a8f3-e88b2542a656'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:59.658251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d462f9aa-f5be-4220-a8f3-e88b2542a656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '112074bbe18342bdae7e7da43304a04d', 'request_id': 'req-d462f9aa-f5be-4220-a8f3-e88b2542a656'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:59.668722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d462f9aa-f5be-4220-a8f3-e88b2542a656 admin admin] The token cache is being invalidate because project 112074bbe18342bdae7e7da43304a04d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:48:59.669004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d462f9aa-f5be-4220-a8f3-e88b2542a656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:59.669672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d462f9aa-f5be-4220-a8f3-e88b2542a656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:48:59.671322 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3598/7176] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:48:58 2022] DELETE /identity/v3/projects/112074bbe18342bdae7e7da43304a04d => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:48:59.676896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020c84e-ff19-4b64-ba73-ad29b08b2b33 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:59.677511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020c84e-ff19-4b64-ba73-ad29b08b2b33 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:59.677511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020c84e-ff19-4b64-ba73-ad29b08b2b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:59.697640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0020c84e-ff19-4b64-ba73-ad29b08b2b33 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:59.698946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0020c84e-ff19-4b64-ba73-ad29b08b2b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:59.774918 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3579/7177] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:59.778185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db455c78-3cf5-422c-866c-832637445402 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:59.780487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db455c78-3cf5-422c-866c-832637445402 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:59.780487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db455c78-3cf5-422c-866c-832637445402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:59.801613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-db455c78-3cf5-422c-866c-832637445402 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:48:59.802364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-db455c78-3cf5-422c-866c-832637445402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:48:59.811589 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3599/7178] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:48:59.816366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020c84e-ff19-4b64-ba73-ad29b08b2b33 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:59.831647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020c84e-ff19-4b64-ba73-ad29b08b2b33 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:59.836664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7499b-6191-476e-a9eb-ca556ca028db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:59.837831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7499b-6191-476e-a9eb-ca556ca028db admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:59.837831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7499b-6191-476e-a9eb-ca556ca028db admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:59.838040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7499b-6191-476e-a9eb-ca556ca028db admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:59.838810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7499b-6191-476e-a9eb-ca556ca028db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:48:59.839127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7499b-6191-476e-a9eb-ca556ca028db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:59.840785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b7499b-6191-476e-a9eb-ca556ca028db admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:48:59.854549 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3580/7179] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:48:59.861910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db455c78-3cf5-422c-866c-832637445402 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:48:59.873932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db455c78-3cf5-422c-866c-832637445402 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:48:59.879190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910377a5-77c4-44dd-8e8d-06ef71c4aa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:48:59.879867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910377a5-77c4-44dd-8e8d-06ef71c4aa27 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:48:59.880157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910377a5-77c4-44dd-8e8d-06ef71c4aa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:48:59.880441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910377a5-77c4-44dd-8e8d-06ef71c4aa27 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:48:59.881202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910377a5-77c4-44dd-8e8d-06ef71c4aa27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:48:59.883130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910377a5-77c4-44dd-8e8d-06ef71c4aa27 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:00.010118 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3600/7180] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:48:59 2022] POST /identity/v3/projects => generated 395 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:00.014147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7499b-6191-476e-a9eb-ca556ca028db admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:00.027637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b7499b-6191-476e-a9eb-ca556ca028db admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:00.090194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484b007-aadd-44ae-9992-e842ce2e19a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:00.091533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484b007-aadd-44ae-9992-e842ce2e19a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:00.092165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484b007-aadd-44ae-9992-e842ce2e19a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:00.092775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484b007-aadd-44ae-9992-e842ce2e19a9 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:00.093926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484b007-aadd-44ae-9992-e842ce2e19a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:00.097038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484b007-aadd-44ae-9992-e842ce2e19a9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:00.184760 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3581/7181] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:49:00 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:49:00.189316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910377a5-77c4-44dd-8e8d-06ef71c4aa27 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:00.200764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910377a5-77c4-44dd-8e8d-06ef71c4aa27 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:00.207332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b10fc-399f-447c-bf80-11dc11916b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:00.208049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b10fc-399f-447c-bf80-11dc11916b8e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:00.208542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b10fc-399f-447c-bf80-11dc11916b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:00.209006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b10fc-399f-447c-bf80-11dc11916b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:00.209760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b10fc-399f-447c-bf80-11dc11916b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:00.211592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b10fc-399f-447c-bf80-11dc11916b8e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:00.225388 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3601/7182] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:49:00.228844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484b007-aadd-44ae-9992-e842ce2e19a9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:00.244934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484b007-aadd-44ae-9992-e842ce2e19a9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:00.277428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49093c72-a5c7-4397-8f6d-2fa33359f6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:00.277428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49093c72-a5c7-4397-8f6d-2fa33359f6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:00.277428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49093c72-a5c7-4397-8f6d-2fa33359f6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:00.277428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49093c72-a5c7-4397-8f6d-2fa33359f6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:00.277825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49093c72-a5c7-4397-8f6d-2fa33359f6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:00.277825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49093c72-a5c7-4397-8f6d-2fa33359f6a1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:00.286891 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3582/7183] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:49:00.290575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b10fc-399f-447c-bf80-11dc11916b8e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:00.301498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b10fc-399f-447c-bf80-11dc11916b8e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:00.306834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ee000-4743-45cd-8ae1-187643eb3263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:00.307744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ee000-4743-45cd-8ae1-187643eb3263 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:00.308043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ee000-4743-45cd-8ae1-187643eb3263 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:00.308322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ee000-4743-45cd-8ae1-187643eb3263 admin admin] PATH_INFO: `/v3/projects/0de1624a580746b6800dbf35ce9abc9b/users/59af55e570a9477db2f80817882b8e26/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:00.333494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ee000-4743-45cd-8ae1-187643eb3263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0de1624a580746b6800dbf35ce9abc9b, user_id=59af55e570a9477db2f80817882b8e26, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:00.345661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ee000-4743-45cd-8ae1-187643eb3263 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:00.463828 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3602/7184] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:00 2022] PUT /identity/v3/projects/0de1624a580746b6800dbf35ce9abc9b/users/59af55e570a9477db2f80817882b8e26/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:00.475280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ddb38-cde0-4d8f-a575-4738f3ea77ec None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:00.476834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ddb38-cde0-4d8f-a575-4738f3ea77ec None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:00.476834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ddb38-cde0-4d8f-a575-4738f3ea77ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:00.515068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-113ddb38-cde0-4d8f-a575-4738f3ea77ec None None] MFA Rules not processed for user `59af55e570a9477db2f80817882b8e26`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:00.516823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-113ddb38-cde0-4d8f-a575-4738f3ea77ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:00.606811 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3583/7185] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:00.611176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ee000-4743-45cd-8ae1-187643eb3263 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:00.696547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ee000-4743-45cd-8ae1-187643eb3263 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:00.702680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c496a19-f3e0-4ba7-93e8-acce1bc78a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:00.704360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c496a19-f3e0-4ba7-93e8-acce1bc78a0a admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:00.704939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c496a19-f3e0-4ba7-93e8-acce1bc78a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:00.705472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c496a19-f3e0-4ba7-93e8-acce1bc78a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:00.706432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c496a19-f3e0-4ba7-93e8-acce1bc78a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:00.708632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c496a19-f3e0-4ba7-93e8-acce1bc78a0a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:00.796194 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3603/7186] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:49:00 2022] POST /identity/v3/projects => generated 395 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:49:00.797358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ddb38-cde0-4d8f-a575-4738f3ea77ec None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:00.809388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ddb38-cde0-4d8f-a575-4738f3ea77ec None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:00.887317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339e0fd-5f44-43cb-95c0-dc607747a813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:00.888005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339e0fd-5f44-43cb-95c0-dc607747a813 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:00.888297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339e0fd-5f44-43cb-95c0-dc607747a813 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:00.888577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339e0fd-5f44-43cb-95c0-dc607747a813 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:00.889342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339e0fd-5f44-43cb-95c0-dc607747a813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:00.891489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339e0fd-5f44-43cb-95c0-dc607747a813 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:00.970197 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3584/7187] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:49:00 2022] POST /identity/v3/users => generated 304 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:49:00.973058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c496a19-f3e0-4ba7-93e8-acce1bc78a0a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:00.996438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c496a19-f3e0-4ba7-93e8-acce1bc78a0a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:01.003007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004485a0-36c4-435f-8ed8-b4b50a0c5bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:01.004860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004485a0-36c4-435f-8ed8-b4b50a0c5bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:01.005769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004485a0-36c4-435f-8ed8-b4b50a0c5bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:01.006082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004485a0-36c4-435f-8ed8-b4b50a0c5bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:01.006840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004485a0-36c4-435f-8ed8-b4b50a0c5bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:01.008745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004485a0-36c4-435f-8ed8-b4b50a0c5bf0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:01.026248 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3604/7188] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:49:01.031506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339e0fd-5f44-43cb-95c0-dc607747a813 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:01.042302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339e0fd-5f44-43cb-95c0-dc607747a813 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:01.057846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962a1df-bf1c-45af-8999-90f7bbc3773f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:01.057846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962a1df-bf1c-45af-8999-90f7bbc3773f admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:01.057846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962a1df-bf1c-45af-8999-90f7bbc3773f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:01.057846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962a1df-bf1c-45af-8999-90f7bbc3773f admin admin] PATH_INFO: `/v3/projects/b83a6b19c78c4ca0825e1af7da0e8a4e/users/aa0e1e2456fa4e82b6bff844829bac3a/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:01.081399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962a1df-bf1c-45af-8999-90f7bbc3773f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b83a6b19c78c4ca0825e1af7da0e8a4e, user_id=aa0e1e2456fa4e82b6bff844829bac3a, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:01.089348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962a1df-bf1c-45af-8999-90f7bbc3773f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:01.225030 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3585/7189] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:01 2022] PUT /identity/v3/projects/b83a6b19c78c4ca0825e1af7da0e8a4e/users/aa0e1e2456fa4e82b6bff844829bac3a/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:01.229262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004485a0-36c4-435f-8ed8-b4b50a0c5bf0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:01.240444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004485a0-36c4-435f-8ed8-b4b50a0c5bf0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:01.363354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fcdd4-d997-4174-8231-c4aee1ef159f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:01.366535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fcdd4-d997-4174-8231-c4aee1ef159f admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:01.366844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fcdd4-d997-4174-8231-c4aee1ef159f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:01.367131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fcdd4-d997-4174-8231-c4aee1ef159f admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:01.368939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fcdd4-d997-4174-8231-c4aee1ef159f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:01.372046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fcdd4-d997-4174-8231-c4aee1ef159f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:01.397027 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3605/7190] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:49:01.397516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962a1df-bf1c-45af-8999-90f7bbc3773f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:01.412242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962a1df-bf1c-45af-8999-90f7bbc3773f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:01.425233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a9861-8d44-4d0e-b99b-5574fe4675f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:01.425233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a9861-8d44-4d0e-b99b-5574fe4675f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:01.425680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a9861-8d44-4d0e-b99b-5574fe4675f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:01.425900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a9861-8d44-4d0e-b99b-5574fe4675f3 admin admin] PATH_INFO: `/v3/projects/b83a6b19c78c4ca0825e1af7da0e8a4e/users/aa0e1e2456fa4e82b6bff844829bac3a/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:01.434640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a9861-8d44-4d0e-b99b-5574fe4675f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b83a6b19c78c4ca0825e1af7da0e8a4e, user_id=aa0e1e2456fa4e82b6bff844829bac3a, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:01.438780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a9861-8d44-4d0e-b99b-5574fe4675f3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:01.444365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fcdd4-d997-4174-8231-c4aee1ef159f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:01.446940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0e8fcdd4-d997-4174-8231-c4aee1ef159f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:01.481290 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3586/7191] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:01 2022] PUT /identity/v3/projects/b83a6b19c78c4ca0825e1af7da0e8a4e/users/aa0e1e2456fa4e82b6bff844829bac3a/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:49:01.483003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fcdd4-d997-4174-8231-c4aee1ef159f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:01.487069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ffae7-04e7-4fba-9404-6b98292660d3 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:01.487343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ffae7-04e7-4fba-9404-6b98292660d3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:01.487820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ffae7-04e7-4fba-9404-6b98292660d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:01.556265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-173ffae7-04e7-4fba-9404-6b98292660d3 None None] MFA Rules not processed for user `aa0e1e2456fa4e82b6bff844829bac3a`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:01.559136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-173ffae7-04e7-4fba-9404-6b98292660d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:01.638008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402dcdc-2162-4cfc-863f-adc9cf83ecdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:01.639686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402dcdc-2162-4cfc-863f-adc9cf83ecdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:01.640003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402dcdc-2162-4cfc-863f-adc9cf83ecdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:01.640247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402dcdc-2162-4cfc-863f-adc9cf83ecdb admin admin] PATH_INFO: `/v3/users/b17ff6122c8244d0a5c88ce5b041150d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:01.642351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402dcdc-2162-4cfc-863f-adc9cf83ecdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b17ff6122c8244d0a5c88ce5b041150d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:01.648555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402dcdc-2162-4cfc-863f-adc9cf83ecdb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:01.681676 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3587/7192] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:49:01.684054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ffae7-04e7-4fba-9404-6b98292660d3 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:01.817653 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ffae7-04e7-4fba-9404-6b98292660d3 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:01.823267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de1bee-15f9-42da-9996-b1f862989425 tempest-ProjectsNegativeStaticTestJSON-485392294 tempest-ProjectsNegativeStaticTestJSON-485392294-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59af55e570a9477db2f80817882b8e26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0de1624a580746b6800dbf35ce9abc9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:01.827647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de1bee-15f9-42da-9996-b1f862989425 tempest-ProjectsNegativeStaticTestJSON-485392294 tempest-ProjectsNegativeStaticTestJSON-485392294-project] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:01.829571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de1bee-15f9-42da-9996-b1f862989425 tempest-ProjectsNegativeStaticTestJSON-485392294 tempest-ProjectsNegativeStaticTestJSON-485392294-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:01.830096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de1bee-15f9-42da-9996-b1f862989425 tempest-ProjectsNegativeStaticTestJSON-485392294 tempest-ProjectsNegativeStaticTestJSON-485392294-project] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:01.831111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de1bee-15f9-42da-9996-b1f862989425 tempest-ProjectsNegativeStaticTestJSON-485392294 tempest-ProjectsNegativeStaticTestJSON-485392294-project] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:01.837497 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-d8de1bee-15f9-42da-9996-b1f862989425 tempest-ProjectsNegativeStaticTestJSON-485392294 tempest-ProjectsNegativeStaticTestJSON-485392294-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. May 02 10:49:01.837497 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:49:01.837497 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:49:01.837497 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:49:01.837497 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:49:01.837497 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:49:01.837497 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:49:01.837497 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:49:01.837497 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:49:01.837497 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:49:01.837497 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:49:01.837497 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:49:01.837497 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post May 02 10:49:01.837497 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call( May 02 10:49:01.838734 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call May 02 10:49:01.838734 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application enforcer_obj._enforce( May 02 10:49:01.838734 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce May 02 10:49:01.838734 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application result = self._enforcer.enforce( May 02 10:49:01.838734 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 02 10:49:01.838734 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) May 02 10:49:01.838734 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. May 02 10:49:01.838734 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:01.839412 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3588/7193] 10.222.0.16 () {60 vars in 1151 bytes} [Mon May 2 10:49:01 2022] POST /identity/v3/projects => generated 136 bytes in 157 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) May 02 10:49:01.845261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de1bee-15f9-42da-9996-b1f862989425 tempest-ProjectsNegativeStaticTestJSON-485392294 tempest-ProjectsNegativeStaticTestJSON-485392294-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:01.860939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de1bee-15f9-42da-9996-b1f862989425 tempest-ProjectsNegativeStaticTestJSON-485392294 tempest-ProjectsNegativeStaticTestJSON-485392294-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:01.868261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d8c13-d9ae-4de2-b59d-d8fbcf49c395 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0e1e2456fa4e82b6bff844829bac3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b83a6b19c78c4ca0825e1af7da0e8a4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:01.877449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d8c13-d9ae-4de2-b59d-d8fbcf49c395 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:01.877449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d8c13-d9ae-4de2-b59d-d8fbcf49c395 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:01.877449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d8c13-d9ae-4de2-b59d-d8fbcf49c395 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:01.877449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d8c13-d9ae-4de2-b59d-d8fbcf49c395 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:01.878538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d8c13-d9ae-4de2-b59d-d8fbcf49c395 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:01.878538 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-0a5d8c13-d9ae-4de2-b59d-d8fbcf49c395 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Invalid input for field 'name': '' is too short May 02 10:49:01.878538 ncdv-master-1 devstack@keystone.service[91119]: Failed validating 'minLength' in schema['properties']['name']: May 02 10:49:01.878538 ncdv-master-1 devstack@keystone.service[91119]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 02 10:49:01.878538 ncdv-master-1 devstack@keystone.service[91119]: On instance['name']: May 02 10:49:01.878538 ncdv-master-1 devstack@keystone.service[91119]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short May 02 10:49:01.878538 ncdv-master-1 devstack@keystone.service[91119]: Failed validating 'minLength' in schema['properties']['name']: May 02 10:49:01.878538 ncdv-master-1 devstack@keystone.service[91119]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 02 10:49:01.878538 ncdv-master-1 devstack@keystone.service[91119]: On instance['name']: May 02 10:49:01.878538 ncdv-master-1 devstack@keystone.service[91119]: '' May 02 10:49:01.878538 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:49:01.878538 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 02 10:49:01.878538 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 02 10:49:01.878538 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 02 10:49:01.878538 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise error May 02 10:49:01.878538 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short May 02 10:49:01.878538 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:01.878538 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: May 02 10:49:01.880336 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 02 10:49:01.880336 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:01.880336 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application On instance['name']: May 02 10:49:01.880336 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application '' May 02 10:49:01.880336 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:01.880336 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:49:01.880336 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:01.880336 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:49:01.880336 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:49:01.880336 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:49:01.880336 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:49:01.880336 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:49:01.880336 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:49:01.880336 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:49:01.880336 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:49:01.880336 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:49:01.880336 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:49:01.880336 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:49:01.880336 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post May 02 10:49:01.881936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) May 02 10:49:01.881936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 02 10:49:01.881936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 02 10:49:01.881936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 02 10:49:01.881936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 02 10:49:01.881936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short May 02 10:49:01.881936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:01.881936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: May 02 10:49:01.881936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 02 10:49:01.881936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:01.881936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application On instance['name']: May 02 10:49:01.881936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application '' May 02 10:49:01.881936 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:01.881936 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3589/7194] 10.222.0.16 () {60 vars in 1151 bytes} [Mon May 2 10:49:01 2022] POST /identity/v3/projects => generated 283 bytes in 35 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) May 02 10:49:01.885826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d8c13-d9ae-4de2-b59d-d8fbcf49c395 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:01.903608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d8c13-d9ae-4de2-b59d-d8fbcf49c395 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:01.908709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4da9f-34ac-49a6-bda8-b9bcdb9fcbde tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0e1e2456fa4e82b6bff844829bac3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b83a6b19c78c4ca0825e1af7da0e8a4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:01.909345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4da9f-34ac-49a6-bda8-b9bcdb9fcbde tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:01.909695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4da9f-34ac-49a6-bda8-b9bcdb9fcbde tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:01.910099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4da9f-34ac-49a6-bda8-b9bcdb9fcbde tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:01.910658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4da9f-34ac-49a6-bda8-b9bcdb9fcbde tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:01.912686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4da9f-34ac-49a6-bda8-b9bcdb9fcbde tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:01.919609 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-37f4da9f-34ac-49a6-bda8-b9bcdb9fcbde tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 02 10:49:01.919609 ncdv-master-1 devstack@keystone.service[91119]: Failed validating 'maxLength' in schema['properties']['name']: May 02 10:49:01.919609 ncdv-master-1 devstack@keystone.service[91119]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 02 10:49:01.919609 ncdv-master-1 devstack@keystone.service[91119]: On instance['name']: May 02 10:49:01.919609 ncdv-master-1 devstack@keystone.service[91119]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 02 10:49:01.919609 ncdv-master-1 devstack@keystone.service[91119]: Failed validating 'maxLength' in schema['properties']['name']: May 02 10:49:01.919609 ncdv-master-1 devstack@keystone.service[91119]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 02 10:49:01.919609 ncdv-master-1 devstack@keystone.service[91119]: On instance['name']: May 02 10:49:01.919609 ncdv-master-1 devstack@keystone.service[91119]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 02 10:49:01.919609 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:49:01.919609 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 02 10:49:01.919609 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 02 10:49:01.919609 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 02 10:49:01.919609 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise error May 02 10:49:01.919609 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 02 10:49:01.919609 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:01.919609 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: May 02 10:49:01.919609 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 02 10:49:01.925095 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:01.925095 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application On instance['name']: May 02 10:49:01.925095 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 02 10:49:01.925095 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:01.925095 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:49:01.925095 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:01.925095 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:49:01.925095 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:49:01.925095 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:49:01.925095 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:49:01.925095 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:49:01.925095 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:49:01.925095 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:49:01.925095 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:49:01.925095 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:49:01.925095 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:49:01.925095 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:49:01.925095 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post May 02 10:49:01.926549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) May 02 10:49:01.926549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 02 10:49:01.926549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 02 10:49:01.926549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 02 10:49:01.926549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 02 10:49:01.926549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 02 10:49:01.926549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:01.926549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: May 02 10:49:01.926549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 02 10:49:01.926549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:01.926549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application On instance['name']: May 02 10:49:01.926549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 02 10:49:01.926549 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:01.926549 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3590/7195] 10.222.0.16 () {60 vars in 1151 bytes} [Mon May 2 10:49:01 2022] POST /identity/v3/projects => generated 412 bytes in 37 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 02 10:49:01.928163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4da9f-34ac-49a6-bda8-b9bcdb9fcbde tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:01.940361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4da9f-34ac-49a6-bda8-b9bcdb9fcbde tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:01.950865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe45b96-77d9-4664-a409-027abf3e4ad7 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0e1e2456fa4e82b6bff844829bac3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b83a6b19c78c4ca0825e1af7da0e8a4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:01.952481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe45b96-77d9-4664-a409-027abf3e4ad7 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:01.952481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe45b96-77d9-4664-a409-027abf3e4ad7 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:01.952481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe45b96-77d9-4664-a409-027abf3e4ad7 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] PATH_INFO: `/v3/projects/721cb2d98c044650998cd02866d4878a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:01.961421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe45b96-77d9-4664-a409-027abf3e4ad7 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] RBAC: Authorizing `identity:delete_project(project_id=721cb2d98c044650998cd02866d4878a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:01.963636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe45b96-77d9-4664-a409-027abf3e4ad7 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:01.967735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e402dcdc-2162-4cfc-863f-adc9cf83ecdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b17ff6122c8244d0a5c88ce5b041150d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:01.994284 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-cfe45b96-77d9-4664-a409-027abf3e4ad7 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Could not find project: 721cb2d98c044650998cd02866d4878a.: keystone.exception.ProjectNotFound: Could not find project: 721cb2d98c044650998cd02866d4878a. May 02 10:49:01.994284 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:49:01.994284 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:49:01.994284 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:49:01.994284 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:49:01.994284 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:49:01.994284 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:49:01.994284 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:49:01.994284 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:49:01.994284 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:49:01.994284 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:49:01.994284 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:49:01.994284 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete May 02 10:49:01.994284 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( May 02 10:49:01.995486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:49:01.995486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:49:01.995486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project May 02 10:49:01.995486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) May 02 10:49:01.995486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:49:01.995486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:49:01.995486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:49:01.995486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:49:01.995486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 721cb2d98c044650998cd02866d4878a. May 02 10:49:01.995486 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:01.996319 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3591/7196] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:01 2022] DELETE /identity/v3/projects/721cb2d98c044650998cd02866d4878a => generated 113 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 02 10:49:01.997881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e402dcdc-2162-4cfc-863f-adc9cf83ecdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b17ff6122c8244d0a5c88ce5b041150d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:01.999724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e402dcdc-2162-4cfc-863f-adc9cf83ecdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b17ff6122c8244d0a5c88ce5b041150d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:02.001777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe45b96-77d9-4664-a409-027abf3e4ad7 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:02.016907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe45b96-77d9-4664-a409-027abf3e4ad7 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:02.021163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e402dcdc-2162-4cfc-863f-adc9cf83ecdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b17ff6122c8244d0a5c88ce5b041150d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:02.023477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369efe0e-5c82-4367-9f89-b7a724b035f9 tempest-ProjectsNegativeStaticTestJSON-485392294 tempest-ProjectsNegativeStaticTestJSON-485392294-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59af55e570a9477db2f80817882b8e26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0de1624a580746b6800dbf35ce9abc9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:02.024662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369efe0e-5c82-4367-9f89-b7a724b035f9 tempest-ProjectsNegativeStaticTestJSON-485392294 tempest-ProjectsNegativeStaticTestJSON-485392294-project] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:02.025147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369efe0e-5c82-4367-9f89-b7a724b035f9 tempest-ProjectsNegativeStaticTestJSON-485392294 tempest-ProjectsNegativeStaticTestJSON-485392294-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:02.025641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369efe0e-5c82-4367-9f89-b7a724b035f9 tempest-ProjectsNegativeStaticTestJSON-485392294 tempest-ProjectsNegativeStaticTestJSON-485392294-project] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:02.027146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369efe0e-5c82-4367-9f89-b7a724b035f9 tempest-ProjectsNegativeStaticTestJSON-485392294 tempest-ProjectsNegativeStaticTestJSON-485392294-project] RBAC: Authorizing `identity:list_projects()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:02.037063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-369efe0e-5c82-4367-9f89-b7a724b035f9 tempest-ProjectsNegativeStaticTestJSON-485392294 tempest-ProjectsNegativeStaticTestJSON-485392294-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. May 02 10:49:02.037063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:49:02.037063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:49:02.037063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:49:02.037063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:49:02.037063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:49:02.037063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:49:02.037063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:49:02.037063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:49:02.037063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:49:02.037063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:49:02.037063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:49:02.037063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get May 02 10:49:02.037063 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._list_projects() May 02 10:49:02.038265 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects May 02 10:49:02.038265 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', May 02 10:49:02.038265 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call May 02 10:49:02.038265 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application enforcer_obj._enforce( May 02 10:49:02.038265 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce May 02 10:49:02.038265 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application result = self._enforcer.enforce( May 02 10:49:02.038265 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 02 10:49:02.038265 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) May 02 10:49:02.038265 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. May 02 10:49:02.038265 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:02.039372 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3592/7197] 10.222.0.16 () {58 vars in 1130 bytes} [Mon May 2 10:49:02 2022] GET /identity/v3/projects => generated 135 bytes in 39 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) May 02 10:49:02.044439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369efe0e-5c82-4367-9f89-b7a724b035f9 tempest-ProjectsNegativeStaticTestJSON-485392294 tempest-ProjectsNegativeStaticTestJSON-485392294-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:02.057244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369efe0e-5c82-4367-9f89-b7a724b035f9 tempest-ProjectsNegativeStaticTestJSON-485392294 tempest-ProjectsNegativeStaticTestJSON-485392294-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:02.064076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f41e1-cbfa-419a-99a0-6bf064c5aa71 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0e1e2456fa4e82b6bff844829bac3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b83a6b19c78c4ca0825e1af7da0e8a4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:02.065074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f41e1-cbfa-419a-99a0-6bf064c5aa71 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:02.065460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f41e1-cbfa-419a-99a0-6bf064c5aa71 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:02.065728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f41e1-cbfa-419a-99a0-6bf064c5aa71 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:02.066592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f41e1-cbfa-419a-99a0-6bf064c5aa71 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:02.070258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f41e1-cbfa-419a-99a0-6bf064c5aa71 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:02.093623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e402dcdc-2162-4cfc-863f-adc9cf83ecdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b17ff6122c8244d0a5c88ce5b041150d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:02.108281 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3606/7198] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:49:01 2022] DELETE /identity/v3/users/b17ff6122c8244d0a5c88ce5b041150d => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:02.109212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaab165-3fb0-4702-bc82-b5d70065346d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:02.109641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaab165-3fb0-4702-bc82-b5d70065346d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:02.110052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaab165-3fb0-4702-bc82-b5d70065346d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:02.136869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-7eaab165-3fb0-4702-bc82-b5d70065346d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:02.138350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7eaab165-3fb0-4702-bc82-b5d70065346d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:02.171023 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3593/7199] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:49:02 2022] POST /identity/v3/projects => generated 357 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:49:02.177239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f41e1-cbfa-419a-99a0-6bf064c5aa71 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:02.184029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-897f41e1-cbfa-419a-99a0-6bf064c5aa71 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:02.260305 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3607/7200] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:49:02.274090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaab165-3fb0-4702-bc82-b5d70065346d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:02.275557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7eaab165-3fb0-4702-bc82-b5d70065346d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:02.299564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f41e1-cbfa-419a-99a0-6bf064c5aa71 tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:02.330687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6ae2b-9a24-436f-a090-380f64ca15ab tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0e1e2456fa4e82b6bff844829bac3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b83a6b19c78c4ca0825e1af7da0e8a4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:02.332254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6ae2b-9a24-436f-a090-380f64ca15ab tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:02.339357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6ae2b-9a24-436f-a090-380f64ca15ab tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:02.345047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6ae2b-9a24-436f-a090-380f64ca15ab tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:02.345047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6ae2b-9a24-436f-a090-380f64ca15ab tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:02.345508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6ae2b-9a24-436f-a090-380f64ca15ab tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:02.400262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaab165-3fb0-4702-bc82-b5d70065346d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:02.415804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.sql.core [None req-0af6ae2b-9a24-436f-a090-380f64ca15ab tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-438360504' for key 'project.ixu_project_name_domain_id'") May 02 10:49:02.415804 ncdv-master-1 devstack@keystone.service[91119]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 02 10:49:02.415804 ncdv-master-1 devstack@keystone.service[91119]: [parameters: {'id': '01a97f91687b42ebbd28ca6abbbebbaf', 'name': 'tempest-project-dup-438360504', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 02 10:49:02.415804 ncdv-master-1 devstack@keystone.service[91119]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91119) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 02 10:49:02.453173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-0af6ae2b-9a24-436f-a090-380f64ca15ab tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-438360504, project id 01a97f91687b42ebbd28ca6abbbebbaf.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-438360504, project id 01a97f91687b42ebbd28ca6abbbebbaf. May 02 10:49:02.453173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:49:02.453173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 02 10:49:02.453173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.dialect.do_execute( May 02 10:49:02.453173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 02 10:49:02.453173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 02 10:49:02.453173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 02 10:49:02.453173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application result = self._query(query) May 02 10:49:02.453173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 02 10:49:02.453173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application conn.query(q) May 02 10:49:02.453173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 02 10:49:02.453173 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 02 10:49:02.454949 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 02 10:49:02.454949 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application result.read() May 02 10:49:02.454949 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 02 10:49:02.454949 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 02 10:49:02.454949 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 02 10:49:02.454949 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application packet.raise_for_error() May 02 10:49:02.454949 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 02 10:49:02.454949 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 02 10:49:02.454949 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 02 10:49:02.454949 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 02 10:49:02.454949 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-438360504' for key 'project.ixu_project_name_domain_id'") May 02 10:49:02.454949 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:02.454949 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 02 10:49:02.454949 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:02.454949 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:49:02.454949 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 02 10:49:02.454949 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 02 10:49:02.456228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 02 10:49:02.456228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return project_ref.to_dict() May 02 10:49:02.456228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 02 10:49:02.456228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application next(self.gen) May 02 10:49:02.456228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 02 10:49:02.456228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application yield resource May 02 10:49:02.456228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 02 10:49:02.456228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application next(self.gen) May 02 10:49:02.456228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 02 10:49:02.456228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.session.rollback() May 02 10:49:02.456228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 02 10:49:02.456228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.force_reraise() May 02 10:49:02.456228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 02 10:49:02.456228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise self.value May 02 10:49:02.456228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 02 10:49:02.456228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 02 10:49:02.456228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 02 10:49:02.456228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application session.commit() May 02 10:49:02.460467 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 02 10:49:02.460467 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 02 10:49:02.460467 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 02 10:49:02.460467 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._prepare_impl() May 02 10:49:02.460467 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 02 10:49:02.460467 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.session.flush() May 02 10:49:02.460467 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 02 10:49:02.460467 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._flush(objects) May 02 10:49:02.460467 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 02 10:49:02.460467 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 02 10:49:02.460467 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 02 10:49:02.460467 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application compat.raise_( May 02 10:49:02.460467 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 02 10:49:02.460467 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception May 02 10:49:02.460467 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 02 10:49:02.460467 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application flush_context.execute() May 02 10:49:02.460467 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 02 10:49:02.464969 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rec.execute(self) May 02 10:49:02.464969 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 02 10:49:02.464969 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 02 10:49:02.464969 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 02 10:49:02.464969 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application _emit_insert_statements( May 02 10:49:02.464969 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 02 10:49:02.464969 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application c = connection._execute_20( May 02 10:49:02.464969 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 02 10:49:02.464969 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 02 10:49:02.464969 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 02 10:49:02.464969 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 02 10:49:02.464969 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 02 10:49:02.464969 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ret = self._execute_context( May 02 10:49:02.464969 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 02 10:49:02.464969 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 02 10:49:02.464969 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 02 10:49:02.467070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 02 10:49:02.467070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 02 10:49:02.467070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception May 02 10:49:02.467070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 02 10:49:02.467070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.dialect.do_execute( May 02 10:49:02.467070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 02 10:49:02.467070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 02 10:49:02.467070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 02 10:49:02.467070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application result = self._query(query) May 02 10:49:02.467070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 02 10:49:02.467070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application conn.query(q) May 02 10:49:02.467070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 02 10:49:02.467070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 02 10:49:02.467070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 02 10:49:02.467070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application result.read() May 02 10:49:02.467070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 02 10:49:02.467070 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 02 10:49:02.471244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 02 10:49:02.471244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application packet.raise_for_error() May 02 10:49:02.471244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 02 10:49:02.471244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 02 10:49:02.471244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 02 10:49:02.471244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 02 10:49:02.471244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-438360504' for key 'project.ixu_project_name_domain_id'") May 02 10:49:02.471244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 02 10:49:02.471244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [parameters: {'id': '01a97f91687b42ebbd28ca6abbbebbaf', 'name': 'tempest-project-dup-438360504', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 02 10:49:02.471244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 02 10:49:02.471244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:02.471244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:49:02.471244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:02.471244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:49:02.471244 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 02 10:49:02.474182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 02 10:49:02.474182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 02 10:49:02.474182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 02 10:49:02.474182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-438360504 at domain ID default. May 02 10:49:02.474182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:02.474182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:49:02.474182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:02.474182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:49:02.474182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:49:02.474182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:49:02.474182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:49:02.474182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:49:02.474182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:49:02.474182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:49:02.474182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:49:02.474182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:49:02.474182 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:49:02.475830 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:49:02.475830 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 02 10:49:02.475830 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 02 10:49:02.475830 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:49:02.475830 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:49:02.475830 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 02 10:49:02.475830 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.Conflict( May 02 10:49:02.475830 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-438360504, project id 01a97f91687b42ebbd28ca6abbbebbaf. May 02 10:49:02.475830 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:02.475830 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3594/7201] 10.222.0.16 () {60 vars in 1151 bytes} [Mon May 2 10:49:02 2022] POST /identity/v3/projects => generated 284 bytes in 280 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 02 10:49:02.475830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6ae2b-9a24-436f-a090-380f64ca15ab tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:02.494407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6ae2b-9a24-436f-a090-380f64ca15ab tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:02.508700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c199b-1e71-4397-85ee-0b2688f3f12e tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa0e1e2456fa4e82b6bff844829bac3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b83a6b19c78c4ca0825e1af7da0e8a4e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:02.510964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c199b-1e71-4397-85ee-0b2688f3f12e tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:02.511487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c199b-1e71-4397-85ee-0b2688f3f12e tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:02.512315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c199b-1e71-4397-85ee-0b2688f3f12e tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] PATH_INFO: `/v3/projects/bb78d254f6be40a6b63a4fc4326a7fac` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:02.514386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c199b-1e71-4397-85ee-0b2688f3f12e tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bb78d254f6be40a6b63a4fc4326a7fac)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:02.518713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c199b-1e71-4397-85ee-0b2688f3f12e tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:02.531545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c04743-f808-4fb4-bd4f-d8aa35f695a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:02.532833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c04743-f808-4fb4-bd4f-d8aa35f695a8 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:02.534881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c04743-f808-4fb4-bd4f-d8aa35f695a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:02.534881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c04743-f808-4fb4-bd4f-d8aa35f695a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:02.642208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c04743-f808-4fb4-bd4f-d8aa35f695a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:02.644065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c04743-f808-4fb4-bd4f-d8aa35f695a8 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:02.655010 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3608/7202] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:49:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:49:02.699447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-723c199b-1e71-4397-85ee-0b2688f3f12e tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb78d254f6be40a6b63a4fc4326a7fac', 'request_id': 'req-723c199b-1e71-4397-85ee-0b2688f3f12e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:02.706791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-723c199b-1e71-4397-85ee-0b2688f3f12e tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb78d254f6be40a6b63a4fc4326a7fac', 'request_id': 'req-723c199b-1e71-4397-85ee-0b2688f3f12e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:02.809194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-723c199b-1e71-4397-85ee-0b2688f3f12e tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb78d254f6be40a6b63a4fc4326a7fac', 'request_id': 'req-723c199b-1e71-4397-85ee-0b2688f3f12e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:02.827422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-723c199b-1e71-4397-85ee-0b2688f3f12e tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] The token cache is being invalidate because project bb78d254f6be40a6b63a4fc4326a7fac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:02.828108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-723c199b-1e71-4397-85ee-0b2688f3f12e tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:02.828729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-723c199b-1e71-4397-85ee-0b2688f3f12e tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:02.835860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c04743-f808-4fb4-bd4f-d8aa35f695a8 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:02.838417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-69c04743-f808-4fb4-bd4f-d8aa35f695a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:02.852727 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3595/7203] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:02 2022] DELETE /identity/v3/projects/bb78d254f6be40a6b63a4fc4326a7fac => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:02.862117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c04743-f808-4fb4-bd4f-d8aa35f695a8 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:02.988696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f20bc-8c11-4c41-ade7-d59813027a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:02.989890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f20bc-8c11-4c41-ade7-d59813027a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:02.990249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f20bc-8c11-4c41-ade7-d59813027a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:02.990650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f20bc-8c11-4c41-ade7-d59813027a0b admin admin] PATH_INFO: `/v3/users/59af55e570a9477db2f80817882b8e26` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:02.992065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f20bc-8c11-4c41-ade7-d59813027a0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=59af55e570a9477db2f80817882b8e26)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:02.994221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f20bc-8c11-4c41-ade7-d59813027a0b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:03.227621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-701f20bc-8c11-4c41-ade7-d59813027a0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59af55e570a9477db2f80817882b8e26'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:03.263548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-701f20bc-8c11-4c41-ade7-d59813027a0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59af55e570a9477db2f80817882b8e26'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:03.264301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-701f20bc-8c11-4c41-ade7-d59813027a0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59af55e570a9477db2f80817882b8e26'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:03.274306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-701f20bc-8c11-4c41-ade7-d59813027a0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59af55e570a9477db2f80817882b8e26'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:03.330942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c199b-1e71-4397-85ee-0b2688f3f12e tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:03.332825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-723c199b-1e71-4397-85ee-0b2688f3f12e tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:03.344440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-701f20bc-8c11-4c41-ade7-d59813027a0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59af55e570a9477db2f80817882b8e26'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:03.355110 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3609/7204] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:49:02 2022] DELETE /identity/v3/users/59af55e570a9477db2f80817882b8e26 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:03.362975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c199b-1e71-4397-85ee-0b2688f3f12e tempest-ProjectsNegativeStaticTestJSON-665152658 tempest-ProjectsNegativeStaticTestJSON-665152658-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:03.381858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3a50f-190c-4023-8d6d-7e2ccc7aa278 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:03.381858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3a50f-190c-4023-8d6d-7e2ccc7aa278 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:03.381858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3a50f-190c-4023-8d6d-7e2ccc7aa278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:03.415190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-94f3a50f-190c-4023-8d6d-7e2ccc7aa278 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:03.417158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-94f3a50f-190c-4023-8d6d-7e2ccc7aa278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:03.438770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa6f5c-7847-4792-a169-9e358fc95b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:03.438770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa6f5c-7847-4792-a169-9e358fc95b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:03.438770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa6f5c-7847-4792-a169-9e358fc95b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:03.438770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa6f5c-7847-4792-a169-9e358fc95b09 admin admin] PATH_INFO: `/v3/projects/be09b901a0dc40b3bc697abab301fd99` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:03.440010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa6f5c-7847-4792-a169-9e358fc95b09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be09b901a0dc40b3bc697abab301fd99)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:03.440010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa6f5c-7847-4792-a169-9e358fc95b09 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:03.519142 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3610/7205] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:49:03.533695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3a50f-190c-4023-8d6d-7e2ccc7aa278 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:03.541791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-94f3a50f-190c-4023-8d6d-7e2ccc7aa278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:03.553035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fcfa6f5c-7847-4792-a169-9e358fc95b09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be09b901a0dc40b3bc697abab301fd99', 'request_id': 'req-fcfa6f5c-7847-4792-a169-9e358fc95b09'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:03.560628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fcfa6f5c-7847-4792-a169-9e358fc95b09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be09b901a0dc40b3bc697abab301fd99', 'request_id': 'req-fcfa6f5c-7847-4792-a169-9e358fc95b09'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:03.629955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fcfa6f5c-7847-4792-a169-9e358fc95b09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be09b901a0dc40b3bc697abab301fd99', 'request_id': 'req-fcfa6f5c-7847-4792-a169-9e358fc95b09'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:03.652262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fcfa6f5c-7847-4792-a169-9e358fc95b09 admin admin] The token cache is being invalidate because project be09b901a0dc40b3bc697abab301fd99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:03.655587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fcfa6f5c-7847-4792-a169-9e358fc95b09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:03.655587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fcfa6f5c-7847-4792-a169-9e358fc95b09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:03.656782 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3596/7206] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:03 2022] DELETE /identity/v3/projects/be09b901a0dc40b3bc697abab301fd99 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:49:03.659242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3a50f-190c-4023-8d6d-7e2ccc7aa278 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:03.661948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa6f5c-7847-4792-a169-9e358fc95b09 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:03.667731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fcfa6f5c-7847-4792-a169-9e358fc95b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:03.757556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93511e-46c3-4a8b-a219-f7fea69d12ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:03.758229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93511e-46c3-4a8b-a219-f7fea69d12ec service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:03.759245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93511e-46c3-4a8b-a219-f7fea69d12ec service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:03.759245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93511e-46c3-4a8b-a219-f7fea69d12ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:03.762035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-af93511e-46c3-4a8b-a219-f7fea69d12ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:03.909145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa6f5c-7847-4792-a169-9e358fc95b09 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:03.909145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f23f36-a5fd-489f-8a9e-a92554e98ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:03.909145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f23f36-a5fd-489f-8a9e-a92554e98ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:03.909145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f23f36-a5fd-489f-8a9e-a92554e98ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:03.910338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f23f36-a5fd-489f-8a9e-a92554e98ee0 admin admin] PATH_INFO: `/v3/users/b49f84ef3c32421dac58698210717022` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:03.910338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f23f36-a5fd-489f-8a9e-a92554e98ee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b49f84ef3c32421dac58698210717022)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:03.910338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f23f36-a5fd-489f-8a9e-a92554e98ee0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:03.910671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93511e-46c3-4a8b-a219-f7fea69d12ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:03.910671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93511e-46c3-4a8b-a219-f7fea69d12ec service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:03.910671 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3611/7207] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:49:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:49:04.342532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-63f23f36-a5fd-489f-8a9e-a92554e98ee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b49f84ef3c32421dac58698210717022'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:04.356014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-63f23f36-a5fd-489f-8a9e-a92554e98ee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b49f84ef3c32421dac58698210717022'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:04.357313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-63f23f36-a5fd-489f-8a9e-a92554e98ee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b49f84ef3c32421dac58698210717022'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:04.365384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-63f23f36-a5fd-489f-8a9e-a92554e98ee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b49f84ef3c32421dac58698210717022'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:04.423622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-63f23f36-a5fd-489f-8a9e-a92554e98ee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b49f84ef3c32421dac58698210717022'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:04.437152 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3597/7208] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:49:03 2022] DELETE /identity/v3/users/b49f84ef3c32421dac58698210717022 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:04.648938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93511e-46c3-4a8b-a219-f7fea69d12ec service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:04.651637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-af93511e-46c3-4a8b-a219-f7fea69d12ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:04.668021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93511e-46c3-4a8b-a219-f7fea69d12ec service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:04.808118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc2738-310e-438b-a791-35fec2125b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:04.811699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc2738-310e-438b-a791-35fec2125b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:04.811699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc2738-310e-438b-a791-35fec2125b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:04.811699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc2738-310e-438b-a791-35fec2125b50 admin admin] PATH_INFO: `/v3/projects/0de1624a580746b6800dbf35ce9abc9b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:04.811699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc2738-310e-438b-a791-35fec2125b50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0de1624a580746b6800dbf35ce9abc9b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:04.814745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc2738-310e-438b-a791-35fec2125b50 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:05.137813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-27dc2738-310e-438b-a791-35fec2125b50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0de1624a580746b6800dbf35ce9abc9b', 'request_id': 'req-27dc2738-310e-438b-a791-35fec2125b50'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:05.151437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f23f36-a5fd-489f-8a9e-a92554e98ee0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:05.153018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-63f23f36-a5fd-489f-8a9e-a92554e98ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:05.166913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f23f36-a5fd-489f-8a9e-a92554e98ee0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:05.217442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-27dc2738-310e-438b-a791-35fec2125b50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0de1624a580746b6800dbf35ce9abc9b', 'request_id': 'req-27dc2738-310e-438b-a791-35fec2125b50'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:05.224224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-27dc2738-310e-438b-a791-35fec2125b50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0de1624a580746b6800dbf35ce9abc9b', 'request_id': 'req-27dc2738-310e-438b-a791-35fec2125b50'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:05.224391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689588a-a148-46a1-9ecb-6d8a398ab0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:05.225150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689588a-a148-46a1-9ecb-6d8a398ab0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:05.225440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689588a-a148-46a1-9ecb-6d8a398ab0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:05.225720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689588a-a148-46a1-9ecb-6d8a398ab0a2 admin admin] PATH_INFO: `/v3/projects/a8a579a63da346908015abd18b2eb105` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:05.226934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689588a-a148-46a1-9ecb-6d8a398ab0a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8a579a63da346908015abd18b2eb105)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:05.228916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689588a-a148-46a1-9ecb-6d8a398ab0a2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:05.234846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-27dc2738-310e-438b-a791-35fec2125b50 admin admin] The token cache is being invalidate because project 0de1624a580746b6800dbf35ce9abc9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:05.235694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-27dc2738-310e-438b-a791-35fec2125b50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:05.236152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-27dc2738-310e-438b-a791-35fec2125b50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:05.237907 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3612/7209] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:04 2022] DELETE /identity/v3/projects/0de1624a580746b6800dbf35ce9abc9b => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:05.241772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc2738-310e-438b-a791-35fec2125b50 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:05.243131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-27dc2738-310e-438b-a791-35fec2125b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:05.256513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc2738-310e-438b-a791-35fec2125b50 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:05.261218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ad2c5-f2b7-46ff-906a-86cf48064218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:05.262196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ad2c5-f2b7-46ff-906a-86cf48064218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:05.262486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ad2c5-f2b7-46ff-906a-86cf48064218 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:05.262765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ad2c5-f2b7-46ff-906a-86cf48064218 admin admin] PATH_INFO: `/v3/users/aa0e1e2456fa4e82b6bff844829bac3a` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:05.264002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ad2c5-f2b7-46ff-906a-86cf48064218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa0e1e2456fa4e82b6bff844829bac3a)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:05.266541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ad2c5-f2b7-46ff-906a-86cf48064218 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:05.325864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f689588a-a148-46a1-9ecb-6d8a398ab0a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8a579a63da346908015abd18b2eb105', 'request_id': 'req-f689588a-a148-46a1-9ecb-6d8a398ab0a2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:05.333165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f689588a-a148-46a1-9ecb-6d8a398ab0a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8a579a63da346908015abd18b2eb105', 'request_id': 'req-f689588a-a148-46a1-9ecb-6d8a398ab0a2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:05.400032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f689588a-a148-46a1-9ecb-6d8a398ab0a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8a579a63da346908015abd18b2eb105', 'request_id': 'req-f689588a-a148-46a1-9ecb-6d8a398ab0a2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:05.410723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f689588a-a148-46a1-9ecb-6d8a398ab0a2 admin admin] The token cache is being invalidate because project a8a579a63da346908015abd18b2eb105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:05.411006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f689588a-a148-46a1-9ecb-6d8a398ab0a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:05.411654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f689588a-a148-46a1-9ecb-6d8a398ab0a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:05.413299 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3598/7210] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:05 2022] DELETE /identity/v3/projects/a8a579a63da346908015abd18b2eb105 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:49:05.417373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689588a-a148-46a1-9ecb-6d8a398ab0a2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:05.419111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f689588a-a148-46a1-9ecb-6d8a398ab0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:05.419824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0e1ad2c5-f2b7-46ff-906a-86cf48064218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa0e1e2456fa4e82b6bff844829bac3a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:05.433155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0e1ad2c5-f2b7-46ff-906a-86cf48064218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa0e1e2456fa4e82b6bff844829bac3a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:05.433860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0e1ad2c5-f2b7-46ff-906a-86cf48064218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa0e1e2456fa4e82b6bff844829bac3a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:05.443292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0e1ad2c5-f2b7-46ff-906a-86cf48064218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa0e1e2456fa4e82b6bff844829bac3a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:05.483277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689588a-a148-46a1-9ecb-6d8a398ab0a2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:05.488829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b908d7-2120-4835-9652-da6088d6f5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:05.489710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b908d7-2120-4835-9652-da6088d6f5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:05.490062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b908d7-2120-4835-9652-da6088d6f5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:05.490343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b908d7-2120-4835-9652-da6088d6f5f8 admin admin] PATH_INFO: `/v3/users/c6a6911023c44a45a031fc4e30e79a98` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:05.491564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b908d7-2120-4835-9652-da6088d6f5f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6a6911023c44a45a031fc4e30e79a98)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:05.493562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b908d7-2120-4835-9652-da6088d6f5f8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:05.508798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0e1ad2c5-f2b7-46ff-906a-86cf48064218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa0e1e2456fa4e82b6bff844829bac3a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:05.515379 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3613/7211] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:49:05 2022] DELETE /identity/v3/users/aa0e1e2456fa4e82b6bff844829bac3a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:49:05.694131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e9b908d7-2120-4835-9652-da6088d6f5f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6a6911023c44a45a031fc4e30e79a98'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:05.706494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e9b908d7-2120-4835-9652-da6088d6f5f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6a6911023c44a45a031fc4e30e79a98'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:05.707284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e9b908d7-2120-4835-9652-da6088d6f5f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6a6911023c44a45a031fc4e30e79a98'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:05.714177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e9b908d7-2120-4835-9652-da6088d6f5f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6a6911023c44a45a031fc4e30e79a98'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:05.778149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e9b908d7-2120-4835-9652-da6088d6f5f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6a6911023c44a45a031fc4e30e79a98'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:05.785395 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3599/7212] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:49:05 2022] DELETE /identity/v3/users/c6a6911023c44a45a031fc4e30e79a98 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:49:06.069924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ad2c5-f2b7-46ff-906a-86cf48064218 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:06.071463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0e1ad2c5-f2b7-46ff-906a-86cf48064218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:06.154286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ad2c5-f2b7-46ff-906a-86cf48064218 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:06.211667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368101b-61bb-4774-8382-2f919357dbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:06.212730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368101b-61bb-4774-8382-2f919357dbc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:06.213084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368101b-61bb-4774-8382-2f919357dbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:06.213447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368101b-61bb-4774-8382-2f919357dbc6 admin admin] PATH_INFO: `/v3/projects/b83a6b19c78c4ca0825e1af7da0e8a4e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:06.214740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368101b-61bb-4774-8382-2f919357dbc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b83a6b19c78c4ca0825e1af7da0e8a4e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:06.216754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368101b-61bb-4774-8382-2f919357dbc6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:06.328157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b908d7-2120-4835-9652-da6088d6f5f8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:06.330412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e9b908d7-2120-4835-9652-da6088d6f5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:06.344998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b908d7-2120-4835-9652-da6088d6f5f8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:06.349714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334edb37-688e-4920-9083-6a08dc727ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:06.350574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334edb37-688e-4920-9083-6a08dc727ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:06.350866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334edb37-688e-4920-9083-6a08dc727ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:06.351146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334edb37-688e-4920-9083-6a08dc727ec6 admin admin] PATH_INFO: `/v3/projects/5f3788bbc3d144808d84aaeac43d550c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:06.357099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334edb37-688e-4920-9083-6a08dc727ec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f3788bbc3d144808d84aaeac43d550c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:06.357099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334edb37-688e-4920-9083-6a08dc727ec6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:06.371359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6368101b-61bb-4774-8382-2f919357dbc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b83a6b19c78c4ca0825e1af7da0e8a4e', 'request_id': 'req-6368101b-61bb-4774-8382-2f919357dbc6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:06.444590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6368101b-61bb-4774-8382-2f919357dbc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b83a6b19c78c4ca0825e1af7da0e8a4e', 'request_id': 'req-6368101b-61bb-4774-8382-2f919357dbc6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:06.451099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6368101b-61bb-4774-8382-2f919357dbc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b83a6b19c78c4ca0825e1af7da0e8a4e', 'request_id': 'req-6368101b-61bb-4774-8382-2f919357dbc6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:06.461815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6368101b-61bb-4774-8382-2f919357dbc6 admin admin] The token cache is being invalidate because project b83a6b19c78c4ca0825e1af7da0e8a4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:06.462050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6368101b-61bb-4774-8382-2f919357dbc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:06.462679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6368101b-61bb-4774-8382-2f919357dbc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:06.464356 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3614/7213] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:06 2022] DELETE /identity/v3/projects/b83a6b19c78c4ca0825e1af7da0e8a4e => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:06.469701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1337078-27ff-4e04-9262-abcfeca54417 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:06.470016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1337078-27ff-4e04-9262-abcfeca54417 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:06.470308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1337078-27ff-4e04-9262-abcfeca54417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:06.473769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-334edb37-688e-4920-9083-6a08dc727ec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f3788bbc3d144808d84aaeac43d550c', 'request_id': 'req-334edb37-688e-4920-9083-6a08dc727ec6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:06.480204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-334edb37-688e-4920-9083-6a08dc727ec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f3788bbc3d144808d84aaeac43d550c', 'request_id': 'req-334edb37-688e-4920-9083-6a08dc727ec6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:06.491816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a1337078-27ff-4e04-9262-abcfeca54417 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:06.493073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a1337078-27ff-4e04-9262-abcfeca54417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:06.550756 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3615/7214] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:49:06.558322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988e616-dab7-4167-8922-c3f20f1671d2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:06.558638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988e616-dab7-4167-8922-c3f20f1671d2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:06.558964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988e616-dab7-4167-8922-c3f20f1671d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:06.560674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-334edb37-688e-4920-9083-6a08dc727ec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f3788bbc3d144808d84aaeac43d550c', 'request_id': 'req-334edb37-688e-4920-9083-6a08dc727ec6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:06.572324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-334edb37-688e-4920-9083-6a08dc727ec6 admin admin] The token cache is being invalidate because project 5f3788bbc3d144808d84aaeac43d550c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:06.572639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-334edb37-688e-4920-9083-6a08dc727ec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:06.573325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-334edb37-688e-4920-9083-6a08dc727ec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:06.574887 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3600/7215] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:06 2022] DELETE /identity/v3/projects/5f3788bbc3d144808d84aaeac43d550c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:49:06.579172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4988e616-dab7-4167-8922-c3f20f1671d2 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:06.579359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4988e616-dab7-4167-8922-c3f20f1671d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:06.580705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e6bb1-e232-41f4-8080-d22cbf2ab533 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:06.581367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e6bb1-e232-41f4-8080-d22cbf2ab533 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:06.581727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e6bb1-e232-41f4-8080-d22cbf2ab533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:06.587906 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3616/7216] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:49:06.591693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988e616-dab7-4167-8922-c3f20f1671d2 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:06.601045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988e616-dab7-4167-8922-c3f20f1671d2 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:06.601690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7a2e6bb1-e232-41f4-8080-d22cbf2ab533 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:06.602936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7a2e6bb1-e232-41f4-8080-d22cbf2ab533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:06.607187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac0618-340e-49e2-ae91-4fd48bbe4e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:06.608448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac0618-340e-49e2-ae91-4fd48bbe4e8d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:06.608448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac0618-340e-49e2-ae91-4fd48bbe4e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:06.608448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac0618-340e-49e2-ae91-4fd48bbe4e8d admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:06.609217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac0618-340e-49e2-ae91-4fd48bbe4e8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:49:06.609502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac0618-340e-49e2-ae91-4fd48bbe4e8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:06.611877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac0618-340e-49e2-ae91-4fd48bbe4e8d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:06.618374 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3601/7217] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:49:06.621519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f8398-2506-49fe-9d7d-86fd902cba2f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:06.621832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f8398-2506-49fe-9d7d-86fd902cba2f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:06.622119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f8398-2506-49fe-9d7d-86fd902cba2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:06.627620 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3617/7218] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:49:06.636494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac0618-340e-49e2-ae91-4fd48bbe4e8d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:06.648994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac0618-340e-49e2-ae91-4fd48bbe4e8d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:06.655431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36043bb2-18c7-4242-9fa9-e2c3d4f36ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:06.656108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36043bb2-18c7-4242-9fa9-e2c3d4f36ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:06.656449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36043bb2-18c7-4242-9fa9-e2c3d4f36ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:06.656748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36043bb2-18c7-4242-9fa9-e2c3d4f36ec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:06.657189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e39f8398-2506-49fe-9d7d-86fd902cba2f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:06.657457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36043bb2-18c7-4242-9fa9-e2c3d4f36ec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:06.658569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e39f8398-2506-49fe-9d7d-86fd902cba2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:06.659381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36043bb2-18c7-4242-9fa9-e2c3d4f36ec7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:06.668777 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3602/7219] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:06.672461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f8398-2506-49fe-9d7d-86fd902cba2f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:06.681555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f8398-2506-49fe-9d7d-86fd902cba2f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:06.686264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f28b0d-929a-430a-803c-2163ae9a127a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:06.686925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f28b0d-929a-430a-803c-2163ae9a127a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:06.687231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f28b0d-929a-430a-803c-2163ae9a127a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:06.687489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f28b0d-929a-430a-803c-2163ae9a127a admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:06.688795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f28b0d-929a-430a-803c-2163ae9a127a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:49:06.689107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f28b0d-929a-430a-803c-2163ae9a127a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:06.690713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f28b0d-929a-430a-803c-2163ae9a127a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:06.709228 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3603/7220] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:49:06.711648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f28b0d-929a-430a-803c-2163ae9a127a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:06.722492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f28b0d-929a-430a-803c-2163ae9a127a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:06.727527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef9d9c-7515-409e-82b1-d018fc6fb3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:06.730414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef9d9c-7515-409e-82b1-d018fc6fb3ac admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:06.730414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef9d9c-7515-409e-82b1-d018fc6fb3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:06.730414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef9d9c-7515-409e-82b1-d018fc6fb3ac admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:06.730414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef9d9c-7515-409e-82b1-d018fc6fb3ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:06.731320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef9d9c-7515-409e-82b1-d018fc6fb3ac admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:06.763714 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3618/7221] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:49:06 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:06.768262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36043bb2-18c7-4242-9fa9-e2c3d4f36ec7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:06.826947 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3604/7222] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:49:06 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:49:06.829499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef9d9c-7515-409e-82b1-d018fc6fb3ac admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:06.831544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36043bb2-18c7-4242-9fa9-e2c3d4f36ec7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:06.889661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00edf88-1cdd-475e-a692-41a394d3c2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:06.890349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00edf88-1cdd-475e-a692-41a394d3c2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:06.890847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00edf88-1cdd-475e-a692-41a394d3c2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:06.890962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00edf88-1cdd-475e-a692-41a394d3c2a4 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:06.891644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00edf88-1cdd-475e-a692-41a394d3c2a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:06.893639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00edf88-1cdd-475e-a692-41a394d3c2a4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:06.895166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef9d9c-7515-409e-82b1-d018fc6fb3ac admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:06.900171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fa7f3-1d12-4029-a05b-8dbb696db684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:06.900967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fa7f3-1d12-4029-a05b-8dbb696db684 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:06.901324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fa7f3-1d12-4029-a05b-8dbb696db684 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:06.901607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fa7f3-1d12-4029-a05b-8dbb696db684 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:06.902365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fa7f3-1d12-4029-a05b-8dbb696db684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:06.904425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fa7f3-1d12-4029-a05b-8dbb696db684 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:06.973193 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3619/7223] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:49:06 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:49:06.976930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00edf88-1cdd-475e-a692-41a394d3c2a4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:06.987297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00edf88-1cdd-475e-a692-41a394d3c2a4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:06.992051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5794fa-b558-4378-8667-7fa630ec3341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:06.992766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5794fa-b558-4378-8667-7fa630ec3341 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:06.993056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5794fa-b558-4378-8667-7fa630ec3341 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:06.993338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5794fa-b558-4378-8667-7fa630ec3341 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:06.994061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5794fa-b558-4378-8667-7fa630ec3341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:06.995700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5794fa-b558-4378-8667-7fa630ec3341 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:07.009723 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3620/7224] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:49:07.015839 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3605/7225] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:49:06 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:07.015993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5794fa-b558-4378-8667-7fa630ec3341 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:07.016110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fa7f3-1d12-4029-a05b-8dbb696db684 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:07.020510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5794fa-b558-4378-8667-7fa630ec3341 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:07.021187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fa7f3-1d12-4029-a05b-8dbb696db684 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:07.025246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b7d2e-2c1e-4417-aa12-55bce876d93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:07.025902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b7d2e-2c1e-4417-aa12-55bce876d93b admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:07.026159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f7c54-da21-4dfd-89c0-c9be1f9e4625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:07.026317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b7d2e-2c1e-4417-aa12-55bce876d93b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:07.026474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b7d2e-2c1e-4417-aa12-55bce876d93b admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:07.026821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f7c54-da21-4dfd-89c0-c9be1f9e4625 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:07.027156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f7c54-da21-4dfd-89c0-c9be1f9e4625 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:07.027283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b7d2e-2c1e-4417-aa12-55bce876d93b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:07.027507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f7c54-da21-4dfd-89c0-c9be1f9e4625 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:07.028235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f7c54-da21-4dfd-89c0-c9be1f9e4625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:07.028811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b7d2e-2c1e-4417-aa12-55bce876d93b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:07.029875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f7c54-da21-4dfd-89c0-c9be1f9e4625 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:07.038731 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3621/7226] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:49:07.042616 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3606/7227] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:49:07.044527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b7d2e-2c1e-4417-aa12-55bce876d93b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:07.044714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f7c54-da21-4dfd-89c0-c9be1f9e4625 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:07.054086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b7d2e-2c1e-4417-aa12-55bce876d93b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:07.054268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f7c54-da21-4dfd-89c0-c9be1f9e4625 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:07.059101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bccf6-64bb-4e4c-a838-e41b4be71219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:07.059764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bccf6-64bb-4e4c-a838-e41b4be71219 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:07.060057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bccf6-64bb-4e4c-a838-e41b4be71219 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:07.060337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bccf6-64bb-4e4c-a838-e41b4be71219 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:07.060768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7161c-847d-4715-9d57-9f853aa30598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:07.061087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bccf6-64bb-4e4c-a838-e41b4be71219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:07.062126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7161c-847d-4715-9d57-9f853aa30598 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:07.062590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7161c-847d-4715-9d57-9f853aa30598 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:07.063480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bccf6-64bb-4e4c-a838-e41b4be71219 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:07.063799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7161c-847d-4715-9d57-9f853aa30598 admin admin] PATH_INFO: `/v3/projects/24ade2b43b08466e99f56852e45a0743/users/bca356264d674f3a84a658cf508265d1/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:07.078424 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3607/7228] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:49:07.082492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bccf6-64bb-4e4c-a838-e41b4be71219 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:07.082753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7161c-847d-4715-9d57-9f853aa30598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24ade2b43b08466e99f56852e45a0743, user_id=bca356264d674f3a84a658cf508265d1, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:07.085501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7161c-847d-4715-9d57-9f853aa30598 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:07.092286 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bccf6-64bb-4e4c-a838-e41b4be71219 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:07.097309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ec3f2-fea9-4572-b817-eef00744a0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:07.102061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ec3f2-fea9-4572-b817-eef00744a0a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:07.102061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ec3f2-fea9-4572-b817-eef00744a0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:07.102061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ec3f2-fea9-4572-b817-eef00744a0a8 admin admin] PATH_INFO: `/v3/projects/25b31684bd0f406085f00c4d8c7ded50/users/4a6aea2df67c4cea8c2a784926b499c2/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:07.114666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ec3f2-fea9-4572-b817-eef00744a0a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b31684bd0f406085f00c4d8c7ded50, user_id=4a6aea2df67c4cea8c2a784926b499c2, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:07.117459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ec3f2-fea9-4572-b817-eef00744a0a8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:07.155057 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3622/7229] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:07 2022] PUT /identity/v3/projects/24ade2b43b08466e99f56852e45a0743/users/bca356264d674f3a84a658cf508265d1/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:49:07.166651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b73fc-afb4-4361-8ca6-b4ced533808c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:07.166943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b73fc-afb4-4361-8ca6-b4ced533808c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:07.167228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b73fc-afb4-4361-8ca6-b4ced533808c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:07.193949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ad8b73fc-afb4-4361-8ca6-b4ced533808c None None] MFA Rules not processed for user `bca356264d674f3a84a658cf508265d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:07.195185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ad8b73fc-afb4-4361-8ca6-b4ced533808c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:07.229380 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3608/7230] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:07 2022] PUT /identity/v3/projects/25b31684bd0f406085f00c4d8c7ded50/users/4a6aea2df67c4cea8c2a784926b499c2/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:07.234315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c6895-aedd-4f8d-a8c6-7ac7cdf5c15c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:07.235312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c6895-aedd-4f8d-a8c6-7ac7cdf5c15c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:07.235634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c6895-aedd-4f8d-a8c6-7ac7cdf5c15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:07.252709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-485c6895-aedd-4f8d-a8c6-7ac7cdf5c15c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:07.254185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-485c6895-aedd-4f8d-a8c6-7ac7cdf5c15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:07.259902 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3623/7231] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:49:07.264281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b73fc-afb4-4361-8ca6-b4ced533808c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:07.312639 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3609/7232] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:49:07.322277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c6895-aedd-4f8d-a8c6-7ac7cdf5c15c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:07.323597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-485c6895-aedd-4f8d-a8c6-7ac7cdf5c15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:07.325531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b73fc-afb4-4361-8ca6-b4ced533808c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:07.330292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b29bf4-80fd-4f5c-8554-56f7b6ba4cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:07.331041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b29bf4-80fd-4f5c-8554-56f7b6ba4cfe admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:07.331327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b29bf4-80fd-4f5c-8554-56f7b6ba4cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:07.331606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b29bf4-80fd-4f5c-8554-56f7b6ba4cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:07.332427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b29bf4-80fd-4f5c-8554-56f7b6ba4cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:07.334417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b29bf4-80fd-4f5c-8554-56f7b6ba4cfe admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:07.381230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c6895-aedd-4f8d-a8c6-7ac7cdf5c15c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:07.385040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ec3d5-c446-4b16-a2f6-4ca2327f3ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:07.385684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ec3d5-c446-4b16-a2f6-4ca2327f3ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:07.386019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ec3d5-c446-4b16-a2f6-4ca2327f3ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:07.386285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ec3d5-c446-4b16-a2f6-4ca2327f3ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:07.396313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ec3d5-c446-4b16-a2f6-4ca2327f3ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:07.397788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ec3d5-c446-4b16-a2f6-4ca2327f3ad8 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:07.409277 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3624/7233] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:49:07 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:49:07.411385 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3610/7234] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:49:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:49:07.411938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ec3d5-c446-4b16-a2f6-4ca2327f3ad8 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:07.421509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ec3d5-c446-4b16-a2f6-4ca2327f3ad8 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:07.476479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c7fde-a7ce-488e-9a4e-b00cc50f89b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:07.477180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c7fde-a7ce-488e-9a4e-b00cc50f89b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:07.477496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c7fde-a7ce-488e-9a4e-b00cc50f89b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:07.477782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c7fde-a7ce-488e-9a4e-b00cc50f89b5 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:07.478490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c7fde-a7ce-488e-9a4e-b00cc50f89b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:07.483473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c7fde-a7ce-488e-9a4e-b00cc50f89b5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:07.584011 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3611/7235] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:49:07 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:49:07.588099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b29bf4-80fd-4f5c-8554-56f7b6ba4cfe admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:07.599548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b29bf4-80fd-4f5c-8554-56f7b6ba4cfe admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:07.604296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3c741-0b0e-4800-b2b2-424a4ced37dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:07.605038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3c741-0b0e-4800-b2b2-424a4ced37dd admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:07.605320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3c741-0b0e-4800-b2b2-424a4ced37dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:07.605597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3c741-0b0e-4800-b2b2-424a4ced37dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:07.606328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3c741-0b0e-4800-b2b2-424a4ced37dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:07.607910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3c741-0b0e-4800-b2b2-424a4ced37dd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:07.619295 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3625/7236] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:49:07.623473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c7fde-a7ce-488e-9a4e-b00cc50f89b5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:07.634030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c7fde-a7ce-488e-9a4e-b00cc50f89b5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:07.638659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a564ede-1120-4c47-ac18-c487e865d86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:07.639535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a564ede-1120-4c47-ac18-c487e865d86e admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:07.639819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a564ede-1120-4c47-ac18-c487e865d86e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:07.640096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a564ede-1120-4c47-ac18-c487e865d86e admin admin] PATH_INFO: `/v3/projects/8307afb873d6491d84926e92c39f42b1/users/0627c60731b14a8897acc6fad084114e/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:07.654953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a564ede-1120-4c47-ac18-c487e865d86e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8307afb873d6491d84926e92c39f42b1, user_id=0627c60731b14a8897acc6fad084114e, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:07.658518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a564ede-1120-4c47-ac18-c487e865d86e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:07.731528 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3612/7237] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:07 2022] PUT /identity/v3/projects/8307afb873d6491d84926e92c39f42b1/users/0627c60731b14a8897acc6fad084114e/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:07.735674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3c741-0b0e-4800-b2b2-424a4ced37dd admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:07.746156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3c741-0b0e-4800-b2b2-424a4ced37dd admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:07.805779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9725af2-55bf-4e03-90c7-52ae4e49741c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:07.806509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9725af2-55bf-4e03-90c7-52ae4e49741c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:07.806794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9725af2-55bf-4e03-90c7-52ae4e49741c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:07.807102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9725af2-55bf-4e03-90c7-52ae4e49741c admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:07.807830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9725af2-55bf-4e03-90c7-52ae4e49741c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:07.809585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9725af2-55bf-4e03-90c7-52ae4e49741c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:07.819804 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3626/7238] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:49:07.823812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a564ede-1120-4c47-ac18-c487e865d86e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:07.835307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a564ede-1120-4c47-ac18-c487e865d86e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:07.840027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828aa3c-73d7-4a96-b198-57545c574365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:07.840945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828aa3c-73d7-4a96-b198-57545c574365 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:07.841228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828aa3c-73d7-4a96-b198-57545c574365 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:07.841504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828aa3c-73d7-4a96-b198-57545c574365 admin admin] PATH_INFO: `/v3/projects/8307afb873d6491d84926e92c39f42b1/users/0627c60731b14a8897acc6fad084114e/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:07.843524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828aa3c-73d7-4a96-b198-57545c574365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8307afb873d6491d84926e92c39f42b1, user_id=0627c60731b14a8897acc6fad084114e, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:07.846836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828aa3c-73d7-4a96-b198-57545c574365 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:07.858715 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3613/7239] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:07 2022] PUT /identity/v3/projects/8307afb873d6491d84926e92c39f42b1/users/0627c60731b14a8897acc6fad084114e/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:49:07.869382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780501a-e4f6-4105-875b-c56b1545be12 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:07.869674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780501a-e4f6-4105-875b-c56b1545be12 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:07.869954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780501a-e4f6-4105-875b-c56b1545be12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:07.901881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8780501a-e4f6-4105-875b-c56b1545be12 None None] MFA Rules not processed for user `0627c60731b14a8897acc6fad084114e`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:07.903709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8780501a-e4f6-4105-875b-c56b1545be12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:08.001334 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3627/7240] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:08.017551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828aa3c-73d7-4a96-b198-57545c574365 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:08.028520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828aa3c-73d7-4a96-b198-57545c574365 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:08.033752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d8f6e-e3dd-4db4-a809-0f06adf79d11 tempest-ProjectsNegativeTestJSON-2111845387 tempest-ProjectsNegativeTestJSON-2111845387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0627c60731b14a8897acc6fad084114e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8307afb873d6491d84926e92c39f42b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:08.034447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d8f6e-e3dd-4db4-a809-0f06adf79d11 tempest-ProjectsNegativeTestJSON-2111845387 tempest-ProjectsNegativeTestJSON-2111845387-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:08.034733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d8f6e-e3dd-4db4-a809-0f06adf79d11 tempest-ProjectsNegativeTestJSON-2111845387 tempest-ProjectsNegativeTestJSON-2111845387-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:08.035012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d8f6e-e3dd-4db4-a809-0f06adf79d11 tempest-ProjectsNegativeTestJSON-2111845387 tempest-ProjectsNegativeTestJSON-2111845387-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:08.035697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d8f6e-e3dd-4db4-a809-0f06adf79d11 tempest-ProjectsNegativeTestJSON-2111845387 tempest-ProjectsNegativeTestJSON-2111845387-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:08.037614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d8f6e-e3dd-4db4-a809-0f06adf79d11 tempest-ProjectsNegativeTestJSON-2111845387 tempest-ProjectsNegativeTestJSON-2111845387-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:08.165201 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3614/7241] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:49:08 2022] POST /identity/v3/projects => generated 359 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:49:08.169881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780501a-e4f6-4105-875b-c56b1545be12 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:08.230899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780501a-e4f6-4105-875b-c56b1545be12 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:08.288653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270eed89-1ebf-456e-83aa-5368e161834c tempest-ProjectsNegativeTestJSON-1054283341 tempest-ProjectsNegativeTestJSON-1054283341-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca356264d674f3a84a658cf508265d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24ade2b43b08466e99f56852e45a0743', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:08.289459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270eed89-1ebf-456e-83aa-5368e161834c tempest-ProjectsNegativeTestJSON-1054283341 tempest-ProjectsNegativeTestJSON-1054283341-project] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:08.289748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270eed89-1ebf-456e-83aa-5368e161834c tempest-ProjectsNegativeTestJSON-1054283341 tempest-ProjectsNegativeTestJSON-1054283341-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:08.290035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270eed89-1ebf-456e-83aa-5368e161834c tempest-ProjectsNegativeTestJSON-1054283341 tempest-ProjectsNegativeTestJSON-1054283341-project] PATH_INFO: `/v3/projects/b8321e4c0e744a97a37af35f907e0670` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:08.291246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270eed89-1ebf-456e-83aa-5368e161834c tempest-ProjectsNegativeTestJSON-1054283341 tempest-ProjectsNegativeTestJSON-1054283341-project] RBAC: Authorizing `identity:delete_project(project_id=b8321e4c0e744a97a37af35f907e0670)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:08.302335 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-270eed89-1ebf-456e-83aa-5368e161834c tempest-ProjectsNegativeTestJSON-1054283341 tempest-ProjectsNegativeTestJSON-1054283341-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. May 02 10:49:08.302335 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:49:08.302335 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:49:08.302335 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:49:08.302335 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:49:08.302335 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:49:08.302335 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:49:08.302335 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:49:08.302335 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:49:08.302335 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:49:08.302335 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:49:08.302335 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:49:08.302335 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete May 02 10:49:08.302335 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call( May 02 10:49:08.303590 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call May 02 10:49:08.303590 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application enforcer_obj._enforce( May 02 10:49:08.303590 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce May 02 10:49:08.303590 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application result = self._enforcer.enforce( May 02 10:49:08.303590 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 02 10:49:08.303590 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) May 02 10:49:08.303590 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. May 02 10:49:08.303590 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:49:08.303590 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3628/7242] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:08 2022] DELETE /identity/v3/projects/b8321e4c0e744a97a37af35f907e0670 => generated 136 bytes in 134 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) May 02 10:49:08.307934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d8f6e-e3dd-4db4-a809-0f06adf79d11 tempest-ProjectsNegativeTestJSON-2111845387 tempest-ProjectsNegativeTestJSON-2111845387-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:08.376541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d8f6e-e3dd-4db4-a809-0f06adf79d11 tempest-ProjectsNegativeTestJSON-2111845387 tempest-ProjectsNegativeTestJSON-2111845387-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:08.381931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30cb4ce-eebf-4276-9937-2cdb1bfc0838 tempest-ProjectsNegativeTestJSON-2111845387 tempest-ProjectsNegativeTestJSON-2111845387-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0627c60731b14a8897acc6fad084114e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8307afb873d6491d84926e92c39f42b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:08.382796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cb4ce-eebf-4276-9937-2cdb1bfc0838 tempest-ProjectsNegativeTestJSON-2111845387 tempest-ProjectsNegativeTestJSON-2111845387-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:08.383086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cb4ce-eebf-4276-9937-2cdb1bfc0838 tempest-ProjectsNegativeTestJSON-2111845387 tempest-ProjectsNegativeTestJSON-2111845387-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:08.383373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cb4ce-eebf-4276-9937-2cdb1bfc0838 tempest-ProjectsNegativeTestJSON-2111845387 tempest-ProjectsNegativeTestJSON-2111845387-project-admin] PATH_INFO: `/v3/projects/b8321e4c0e744a97a37af35f907e0670` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:08.384584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30cb4ce-eebf-4276-9937-2cdb1bfc0838 tempest-ProjectsNegativeTestJSON-2111845387 tempest-ProjectsNegativeTestJSON-2111845387-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b8321e4c0e744a97a37af35f907e0670)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:08.386784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30cb4ce-eebf-4276-9937-2cdb1bfc0838 tempest-ProjectsNegativeTestJSON-2111845387 tempest-ProjectsNegativeTestJSON-2111845387-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:08.531658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b30cb4ce-eebf-4276-9937-2cdb1bfc0838 tempest-ProjectsNegativeTestJSON-2111845387 tempest-ProjectsNegativeTestJSON-2111845387-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8321e4c0e744a97a37af35f907e0670', 'request_id': 'req-b30cb4ce-eebf-4276-9937-2cdb1bfc0838'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:08.537755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b30cb4ce-eebf-4276-9937-2cdb1bfc0838 tempest-ProjectsNegativeTestJSON-2111845387 tempest-ProjectsNegativeTestJSON-2111845387-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8321e4c0e744a97a37af35f907e0670', 'request_id': 'req-b30cb4ce-eebf-4276-9937-2cdb1bfc0838'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:08.646360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b30cb4ce-eebf-4276-9937-2cdb1bfc0838 tempest-ProjectsNegativeTestJSON-2111845387 tempest-ProjectsNegativeTestJSON-2111845387-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8321e4c0e744a97a37af35f907e0670', 'request_id': 'req-b30cb4ce-eebf-4276-9937-2cdb1bfc0838'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:08.657522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b30cb4ce-eebf-4276-9937-2cdb1bfc0838 tempest-ProjectsNegativeTestJSON-2111845387 tempest-ProjectsNegativeTestJSON-2111845387-project-admin] The token cache is being invalidate because project b8321e4c0e744a97a37af35f907e0670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:08.657816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b30cb4ce-eebf-4276-9937-2cdb1bfc0838 tempest-ProjectsNegativeTestJSON-2111845387 tempest-ProjectsNegativeTestJSON-2111845387-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:08.658611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b30cb4ce-eebf-4276-9937-2cdb1bfc0838 tempest-ProjectsNegativeTestJSON-2111845387 tempest-ProjectsNegativeTestJSON-2111845387-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:08.663939 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3615/7243] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:08 2022] DELETE /identity/v3/projects/b8321e4c0e744a97a37af35f907e0670 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:08.665067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270eed89-1ebf-456e-83aa-5368e161834c tempest-ProjectsNegativeTestJSON-1054283341 tempest-ProjectsNegativeTestJSON-1054283341-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:08.666824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-270eed89-1ebf-456e-83aa-5368e161834c tempest-ProjectsNegativeTestJSON-1054283341 tempest-ProjectsNegativeTestJSON-1054283341-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:08.743808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270eed89-1ebf-456e-83aa-5368e161834c tempest-ProjectsNegativeTestJSON-1054283341 tempest-ProjectsNegativeTestJSON-1054283341-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:08.801607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44306d4c-3e26-402d-912b-e040f1793b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:08.802708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44306d4c-3e26-402d-912b-e040f1793b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:08.803122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44306d4c-3e26-402d-912b-e040f1793b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:08.803563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44306d4c-3e26-402d-912b-e040f1793b49 admin admin] PATH_INFO: `/v3/users/bca356264d674f3a84a658cf508265d1` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:08.804949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44306d4c-3e26-402d-912b-e040f1793b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bca356264d674f3a84a658cf508265d1)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:08.807009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44306d4c-3e26-402d-912b-e040f1793b49 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:08.939382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4297fe9-a4d2-429e-b7da-da3709e3a247 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:08.939669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4297fe9-a4d2-429e-b7da-da3709e3a247 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:08.939992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4297fe9-a4d2-429e-b7da-da3709e3a247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:08.959484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f4297fe9-a4d2-429e-b7da-da3709e3a247 None None] MFA Rules not processed for user `bad5953b4fbf4fe2a30a2b4208714631`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:08.961264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f4297fe9-a4d2-429e-b7da-da3709e3a247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:08.969698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-44306d4c-3e26-402d-912b-e040f1793b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bca356264d674f3a84a658cf508265d1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:08.984285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-44306d4c-3e26-402d-912b-e040f1793b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bca356264d674f3a84a658cf508265d1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:08.985848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-44306d4c-3e26-402d-912b-e040f1793b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bca356264d674f3a84a658cf508265d1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:08.993823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-44306d4c-3e26-402d-912b-e040f1793b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bca356264d674f3a84a658cf508265d1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:09.023445 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3616/7244] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:49:09.079077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-44306d4c-3e26-402d-912b-e040f1793b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bca356264d674f3a84a658cf508265d1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:09.083488 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3629/7245] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:49:08 2022] DELETE /identity/v3/users/bca356264d674f3a84a658cf508265d1 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:49:09.088783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598affdf-49e9-4077-946f-3a56f68d806b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:09.089158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598affdf-49e9-4077-946f-3a56f68d806b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:09.089519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598affdf-49e9-4077-946f-3a56f68d806b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:09.131115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-598affdf-49e9-4077-946f-3a56f68d806b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:09.131115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-598affdf-49e9-4077-946f-3a56f68d806b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:09.205961 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3617/7246] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:09.221827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44306d4c-3e26-402d-912b-e040f1793b49 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:09.227752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-44306d4c-3e26-402d-912b-e040f1793b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:09.295058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44306d4c-3e26-402d-912b-e040f1793b49 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:09.299453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e9644-cce6-469d-9844-b1e0acf7ed96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:09.299914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e9644-cce6-469d-9844-b1e0acf7ed96 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:09.300194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e9644-cce6-469d-9844-b1e0acf7ed96 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:09.300483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e9644-cce6-469d-9844-b1e0acf7ed96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:09.311761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e9644-cce6-469d-9844-b1e0acf7ed96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:09.313467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e9644-cce6-469d-9844-b1e0acf7ed96 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:09.323995 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3630/7247] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:49:09.842647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598affdf-49e9-4077-946f-3a56f68d806b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:09.844411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-598affdf-49e9-4077-946f-3a56f68d806b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:09.857954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598affdf-49e9-4077-946f-3a56f68d806b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:09.876917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568791ea-c0c9-4b2e-90da-ba85c4ec1738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:09.879291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568791ea-c0c9-4b2e-90da-ba85c4ec1738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:09.879773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568791ea-c0c9-4b2e-90da-ba85c4ec1738 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:09.880179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568791ea-c0c9-4b2e-90da-ba85c4ec1738 admin admin] PATH_INFO: `/v3/projects/24ade2b43b08466e99f56852e45a0743` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:09.883545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568791ea-c0c9-4b2e-90da-ba85c4ec1738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24ade2b43b08466e99f56852e45a0743)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:09.886416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568791ea-c0c9-4b2e-90da-ba85c4ec1738 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:10.438330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-568791ea-c0c9-4b2e-90da-ba85c4ec1738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24ade2b43b08466e99f56852e45a0743', 'request_id': 'req-568791ea-c0c9-4b2e-90da-ba85c4ec1738'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:10.445490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-568791ea-c0c9-4b2e-90da-ba85c4ec1738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24ade2b43b08466e99f56852e45a0743', 'request_id': 'req-568791ea-c0c9-4b2e-90da-ba85c4ec1738'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:10.537046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-568791ea-c0c9-4b2e-90da-ba85c4ec1738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24ade2b43b08466e99f56852e45a0743', 'request_id': 'req-568791ea-c0c9-4b2e-90da-ba85c4ec1738'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:10.559527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-568791ea-c0c9-4b2e-90da-ba85c4ec1738 admin admin] The token cache is being invalidate because project 24ade2b43b08466e99f56852e45a0743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:10.559961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-568791ea-c0c9-4b2e-90da-ba85c4ec1738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:10.560730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-568791ea-c0c9-4b2e-90da-ba85c4ec1738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:10.562362 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3618/7248] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:09 2022] DELETE /identity/v3/projects/24ade2b43b08466e99f56852e45a0743 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:10.567436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e9644-cce6-469d-9844-b1e0acf7ed96 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:10.579829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e9644-cce6-469d-9844-b1e0acf7ed96 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:10.656109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0ae82-f368-46ac-9e17-68c977a99e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:10.657229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0ae82-f368-46ac-9e17-68c977a99e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:10.657724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0ae82-f368-46ac-9e17-68c977a99e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:10.658081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0ae82-f368-46ac-9e17-68c977a99e18 admin admin] PATH_INFO: `/v3/users/0627c60731b14a8897acc6fad084114e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:10.659378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0ae82-f368-46ac-9e17-68c977a99e18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0627c60731b14a8897acc6fad084114e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:10.661442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0ae82-f368-46ac-9e17-68c977a99e18 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:10.895932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-38b0ae82-f368-46ac-9e17-68c977a99e18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0627c60731b14a8897acc6fad084114e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:10.920574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-38b0ae82-f368-46ac-9e17-68c977a99e18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0627c60731b14a8897acc6fad084114e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:10.925041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-38b0ae82-f368-46ac-9e17-68c977a99e18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0627c60731b14a8897acc6fad084114e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:10.960734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-38b0ae82-f368-46ac-9e17-68c977a99e18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0627c60731b14a8897acc6fad084114e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:11.058552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-38b0ae82-f368-46ac-9e17-68c977a99e18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0627c60731b14a8897acc6fad084114e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:11.066375 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3631/7249] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:49:10 2022] DELETE /identity/v3/users/0627c60731b14a8897acc6fad084114e => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:11.520319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568791ea-c0c9-4b2e-90da-ba85c4ec1738 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:11.522515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-568791ea-c0c9-4b2e-90da-ba85c4ec1738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:11.557670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568791ea-c0c9-4b2e-90da-ba85c4ec1738 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:11.662780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e518c91-2b5f-41f2-8700-fe22dc2347f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:11.663651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e518c91-2b5f-41f2-8700-fe22dc2347f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:11.663940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e518c91-2b5f-41f2-8700-fe22dc2347f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:11.664216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e518c91-2b5f-41f2-8700-fe22dc2347f6 admin admin] PATH_INFO: `/v3/projects/8307afb873d6491d84926e92c39f42b1` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:11.665601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e518c91-2b5f-41f2-8700-fe22dc2347f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8307afb873d6491d84926e92c39f42b1)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:11.669805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e518c91-2b5f-41f2-8700-fe22dc2347f6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:11.767111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5e518c91-2b5f-41f2-8700-fe22dc2347f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8307afb873d6491d84926e92c39f42b1', 'request_id': 'req-5e518c91-2b5f-41f2-8700-fe22dc2347f6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:11.774716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5e518c91-2b5f-41f2-8700-fe22dc2347f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8307afb873d6491d84926e92c39f42b1', 'request_id': 'req-5e518c91-2b5f-41f2-8700-fe22dc2347f6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:11.862996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5e518c91-2b5f-41f2-8700-fe22dc2347f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8307afb873d6491d84926e92c39f42b1', 'request_id': 'req-5e518c91-2b5f-41f2-8700-fe22dc2347f6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:11.874938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5e518c91-2b5f-41f2-8700-fe22dc2347f6 admin admin] The token cache is being invalidate because project 8307afb873d6491d84926e92c39f42b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:11.875750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5e518c91-2b5f-41f2-8700-fe22dc2347f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:11.876421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5e518c91-2b5f-41f2-8700-fe22dc2347f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:11.881958 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3619/7250] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:11 2022] DELETE /identity/v3/projects/8307afb873d6491d84926e92c39f42b1 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:11.883759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06693e0f-63d4-4b81-802e-af307eb5ac42 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:11.884263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06693e0f-63d4-4b81-802e-af307eb5ac42 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:11.884384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06693e0f-63d4-4b81-802e-af307eb5ac42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:11.919447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-06693e0f-63d4-4b81-802e-af307eb5ac42 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:11.920720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-06693e0f-63d4-4b81-802e-af307eb5ac42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:12.002500 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3632/7251] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:12.010312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad494-a184-4f8b-be60-d7aa95b20b7b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:12.010601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad494-a184-4f8b-be60-d7aa95b20b7b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:12.010892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad494-a184-4f8b-be60-d7aa95b20b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:12.034736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-69cad494-a184-4f8b-be60-d7aa95b20b7b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:12.036407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-69cad494-a184-4f8b-be60-d7aa95b20b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:12.051302 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3620/7252] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:49:12.055769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06693e0f-63d4-4b81-802e-af307eb5ac42 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:12.071220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06693e0f-63d4-4b81-802e-af307eb5ac42 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:12.075449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8878f-9528-4eb8-b4dc-7abbc01d256c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:12.076876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8878f-9528-4eb8-b4dc-7abbc01d256c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:12.077409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8878f-9528-4eb8-b4dc-7abbc01d256c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:12.077912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8878f-9528-4eb8-b4dc-7abbc01d256c admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:12.079998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8878f-9528-4eb8-b4dc-7abbc01d256c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:49:12.080689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8878f-9528-4eb8-b4dc-7abbc01d256c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:12.082919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8878f-9528-4eb8-b4dc-7abbc01d256c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:12.097910 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3633/7253] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:49:12.103032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cad494-a184-4f8b-be60-d7aa95b20b7b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:12.114753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cad494-a184-4f8b-be60-d7aa95b20b7b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:12.119736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3abb12-6a1a-4542-8781-0e205f65303b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:12.123316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3abb12-6a1a-4542-8781-0e205f65303b admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:12.123316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3abb12-6a1a-4542-8781-0e205f65303b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:12.123316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3abb12-6a1a-4542-8781-0e205f65303b admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:12.123316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3abb12-6a1a-4542-8781-0e205f65303b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:12.124012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3abb12-6a1a-4542-8781-0e205f65303b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:12.218039 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3621/7254] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:49:12 2022] POST /identity/v3/projects => generated 367 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:12.219365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8878f-9528-4eb8-b4dc-7abbc01d256c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:12.236545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8878f-9528-4eb8-b4dc-7abbc01d256c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:12.315775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d87e7-2bb3-4a5b-887d-feb5519876e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:12.316670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d87e7-2bb3-4a5b-887d-feb5519876e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:12.317177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d87e7-2bb3-4a5b-887d-feb5519876e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:12.317879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d87e7-2bb3-4a5b-887d-feb5519876e9 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:12.318949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d87e7-2bb3-4a5b-887d-feb5519876e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:12.321546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d87e7-2bb3-4a5b-887d-feb5519876e9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:12.418182 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3634/7255] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:49:12 2022] POST /identity/v3/users => generated 284 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:12.422863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3abb12-6a1a-4542-8781-0e205f65303b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:12.437346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3abb12-6a1a-4542-8781-0e205f65303b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:12.444171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8892017-70dc-44c8-b067-e414b67b6ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:12.455120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8892017-70dc-44c8-b067-e414b67b6ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:12.456353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8892017-70dc-44c8-b067-e414b67b6ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:12.456677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8892017-70dc-44c8-b067-e414b67b6ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:12.457529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8892017-70dc-44c8-b067-e414b67b6ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:12.459913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8892017-70dc-44c8-b067-e414b67b6ae1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:12.475317 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3622/7256] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:49:12.479903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d87e7-2bb3-4a5b-887d-feb5519876e9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:12.490996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d87e7-2bb3-4a5b-887d-feb5519876e9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:12.496552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b215c75-766d-4daa-be48-cb13ab22e10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:12.497964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b215c75-766d-4daa-be48-cb13ab22e10c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:12.498310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b215c75-766d-4daa-be48-cb13ab22e10c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:12.498666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b215c75-766d-4daa-be48-cb13ab22e10c admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:12.499451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b215c75-766d-4daa-be48-cb13ab22e10c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:12.501168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b215c75-766d-4daa-be48-cb13ab22e10c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:12.512650 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3635/7257] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:49:12.519036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8892017-70dc-44c8-b067-e414b67b6ae1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:12.526409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8892017-70dc-44c8-b067-e414b67b6ae1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:12.530959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2559c8-59e5-47e6-a34d-e060bda98fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:12.532363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2559c8-59e5-47e6-a34d-e060bda98fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:12.532675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2559c8-59e5-47e6-a34d-e060bda98fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:12.532955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2559c8-59e5-47e6-a34d-e060bda98fdb admin admin] PATH_INFO: `/v3/projects/daa310593c854e8f90aa5b1302dcbdda/users/967368dba4664fb486b7e890375f8448/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:12.549305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2559c8-59e5-47e6-a34d-e060bda98fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa310593c854e8f90aa5b1302dcbdda, user_id=967368dba4664fb486b7e890375f8448, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:12.552263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2559c8-59e5-47e6-a34d-e060bda98fdb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:12.682377 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3623/7258] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:12 2022] PUT /identity/v3/projects/daa310593c854e8f90aa5b1302dcbdda/users/967368dba4664fb486b7e890375f8448/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:12.683193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76766934-5313-4cb5-8983-d739a474f6bc None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:12.683496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76766934-5313-4cb5-8983-d739a474f6bc None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:12.683780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76766934-5313-4cb5-8983-d739a474f6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:12.719332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-76766934-5313-4cb5-8983-d739a474f6bc None None] MFA Rules not processed for user `967368dba4664fb486b7e890375f8448`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:12.720593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-76766934-5313-4cb5-8983-d739a474f6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:12.838466 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3636/7259] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:12.843098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2559c8-59e5-47e6-a34d-e060bda98fdb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:12.956335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2559c8-59e5-47e6-a34d-e060bda98fdb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:12.964158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fa9d2-47e7-40c4-8521-cd599d5bf9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:12.965270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fa9d2-47e7-40c4-8521-cd599d5bf9a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:12.965951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fa9d2-47e7-40c4-8521-cd599d5bf9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:12.966441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fa9d2-47e7-40c4-8521-cd599d5bf9a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:12.967713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fa9d2-47e7-40c4-8521-cd599d5bf9a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:12.973353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fa9d2-47e7-40c4-8521-cd599d5bf9a3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:13.089448 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3624/7260] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:49:12 2022] POST /identity/v3/projects => generated 369 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:13.093498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76766934-5313-4cb5-8983-d739a474f6bc None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:13.116278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76766934-5313-4cb5-8983-d739a474f6bc None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:13.255972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997ca45-5787-4b9d-8bda-7c017b6b8dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:13.257016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997ca45-5787-4b9d-8bda-7c017b6b8dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:13.257474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997ca45-5787-4b9d-8bda-7c017b6b8dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:13.258409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997ca45-5787-4b9d-8bda-7c017b6b8dc7 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:13.259313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997ca45-5787-4b9d-8bda-7c017b6b8dc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:13.274301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997ca45-5787-4b9d-8bda-7c017b6b8dc7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:13.368583 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3637/7261] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:49:13 2022] POST /identity/v3/users => generated 291 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:13.372490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fa9d2-47e7-40c4-8521-cd599d5bf9a3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:13.396359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fa9d2-47e7-40c4-8521-cd599d5bf9a3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:13.410579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36626fba-e7cb-44a8-a840-86547a7a3c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:13.411662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36626fba-e7cb-44a8-a840-86547a7a3c08 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:13.412202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36626fba-e7cb-44a8-a840-86547a7a3c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:13.413136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36626fba-e7cb-44a8-a840-86547a7a3c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:13.414108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36626fba-e7cb-44a8-a840-86547a7a3c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:13.415951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36626fba-e7cb-44a8-a840-86547a7a3c08 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:13.430008 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3625/7262] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:49:13.434333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997ca45-5787-4b9d-8bda-7c017b6b8dc7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:13.451033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997ca45-5787-4b9d-8bda-7c017b6b8dc7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:13.456522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931638ec-67a3-414d-bf46-9397f11fd8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:13.457645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931638ec-67a3-414d-bf46-9397f11fd8f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:13.458083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931638ec-67a3-414d-bf46-9397f11fd8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:13.458470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931638ec-67a3-414d-bf46-9397f11fd8f8 admin admin] PATH_INFO: `/v3/projects/0506bf8122224b85b3f36f04f29e1b78/users/15d9247cd5b1442eb09f7618c0156f45/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:13.492557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931638ec-67a3-414d-bf46-9397f11fd8f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0506bf8122224b85b3f36f04f29e1b78, user_id=15d9247cd5b1442eb09f7618c0156f45, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:13.496658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931638ec-67a3-414d-bf46-9397f11fd8f8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:13.588138 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3638/7263] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:13 2022] PUT /identity/v3/projects/0506bf8122224b85b3f36f04f29e1b78/users/15d9247cd5b1442eb09f7618c0156f45/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:49:13.588978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36626fba-e7cb-44a8-a840-86547a7a3c08 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:13.605832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36626fba-e7cb-44a8-a840-86547a7a3c08 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:13.748707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7caa868-79ad-4847-a3e0-1bf8350bd86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:13.749824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7caa868-79ad-4847-a3e0-1bf8350bd86b admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:13.750888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7caa868-79ad-4847-a3e0-1bf8350bd86b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:13.751405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7caa868-79ad-4847-a3e0-1bf8350bd86b admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:13.752332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7caa868-79ad-4847-a3e0-1bf8350bd86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:13.757242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7caa868-79ad-4847-a3e0-1bf8350bd86b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:13.781966 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3626/7264] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:49:13.786522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931638ec-67a3-414d-bf46-9397f11fd8f8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:13.801941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931638ec-67a3-414d-bf46-9397f11fd8f8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:13.825212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3bc9d-73a0-4a2d-8bfd-6c096c79fd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:13.826219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3bc9d-73a0-4a2d-8bfd-6c096c79fd06 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:13.826510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3bc9d-73a0-4a2d-8bfd-6c096c79fd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:13.826792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3bc9d-73a0-4a2d-8bfd-6c096c79fd06 admin admin] PATH_INFO: `/v3/projects/0506bf8122224b85b3f36f04f29e1b78/users/15d9247cd5b1442eb09f7618c0156f45/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:13.831627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3bc9d-73a0-4a2d-8bfd-6c096c79fd06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0506bf8122224b85b3f36f04f29e1b78, user_id=15d9247cd5b1442eb09f7618c0156f45, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:13.836517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3bc9d-73a0-4a2d-8bfd-6c096c79fd06 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:13.886874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63cc5-532e-41ad-a082-f707246f51c3 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:13.887302 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3639/7265] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:13 2022] PUT /identity/v3/projects/0506bf8122224b85b3f36f04f29e1b78/users/15d9247cd5b1442eb09f7618c0156f45/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:13.887731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63cc5-532e-41ad-a082-f707246f51c3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:13.888238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63cc5-532e-41ad-a082-f707246f51c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:13.948065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b6b63cc5-532e-41ad-a082-f707246f51c3 None None] MFA Rules not processed for user `15d9247cd5b1442eb09f7618c0156f45`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:13.949774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b6b63cc5-532e-41ad-a082-f707246f51c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:14.089004 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3627/7266] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:13 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:14.090245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3bc9d-73a0-4a2d-8bfd-6c096c79fd06 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:14.187087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3bc9d-73a0-4a2d-8bfd-6c096c79fd06 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:14.193780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcc33d-19a0-447a-9832-06b938b3e2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:14.194980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcc33d-19a0-447a-9832-06b938b3e2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:14.195528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcc33d-19a0-447a-9832-06b938b3e2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:14.196056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcc33d-19a0-447a-9832-06b938b3e2c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:14.197060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcc33d-19a0-447a-9832-06b938b3e2c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:14.200060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcc33d-19a0-447a-9832-06b938b3e2c9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:14.317221 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3640/7267] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:49:14 2022] POST /identity/v3/projects => generated 365 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:14.335912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b63cc5-532e-41ad-a082-f707246f51c3 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:14.348755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b63cc5-532e-41ad-a082-f707246f51c3 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:14.488496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78877d4f-a906-4189-85e8-8b3b882d8f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:14.489660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78877d4f-a906-4189-85e8-8b3b882d8f82 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:14.490084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78877d4f-a906-4189-85e8-8b3b882d8f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:14.490592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78877d4f-a906-4189-85e8-8b3b882d8f82 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:14.491520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78877d4f-a906-4189-85e8-8b3b882d8f82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:14.496208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78877d4f-a906-4189-85e8-8b3b882d8f82 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:14.583420 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3628/7268] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:49:14 2022] POST /identity/v3/users => generated 283 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:14.584560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcc33d-19a0-447a-9832-06b938b3e2c9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:14.596431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcc33d-19a0-447a-9832-06b938b3e2c9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:14.601743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f563e-934c-44ce-b073-ea911e797dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:14.602559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f563e-934c-44ce-b073-ea911e797dca admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:14.602913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f563e-934c-44ce-b073-ea911e797dca admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:14.603375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f563e-934c-44ce-b073-ea911e797dca admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:14.604160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f563e-934c-44ce-b073-ea911e797dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:14.606565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f563e-934c-44ce-b073-ea911e797dca admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:14.621475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78877d4f-a906-4189-85e8-8b3b882d8f82 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:14.628446 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3641/7269] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:49:14.637194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78877d4f-a906-4189-85e8-8b3b882d8f82 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:14.644022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6e089-2f73-4890-9ae6-c5e6ee5fe600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:14.644812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6e089-2f73-4890-9ae6-c5e6ee5fe600 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:14.645103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6e089-2f73-4890-9ae6-c5e6ee5fe600 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:14.645381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6e089-2f73-4890-9ae6-c5e6ee5fe600 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:14.646156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6e089-2f73-4890-9ae6-c5e6ee5fe600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:14.647798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6e089-2f73-4890-9ae6-c5e6ee5fe600 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:14.660127 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3629/7270] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:49:14.666128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f563e-934c-44ce-b073-ea911e797dca admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:14.678177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f563e-934c-44ce-b073-ea911e797dca admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:14.683188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4a796-a7d5-4f8d-9059-366953cd0109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:14.684156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4a796-a7d5-4f8d-9059-366953cd0109 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:14.684440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4a796-a7d5-4f8d-9059-366953cd0109 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:14.684761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4a796-a7d5-4f8d-9059-366953cd0109 admin admin] PATH_INFO: `/v3/projects/1c441b239c0243bfbf09dd85d17556f7/users/2966dcef3f4d4b0981a2523db5e90afd/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:14.707990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4a796-a7d5-4f8d-9059-366953cd0109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c441b239c0243bfbf09dd85d17556f7, user_id=2966dcef3f4d4b0981a2523db5e90afd, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:14.707990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4a796-a7d5-4f8d-9059-366953cd0109 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:14.801494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd3292-d223-4949-9956-405fcec0aeec None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:14.801802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd3292-d223-4949-9956-405fcec0aeec None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:14.802094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd3292-d223-4949-9956-405fcec0aeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:14.816763 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3642/7271] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:14 2022] PUT /identity/v3/projects/1c441b239c0243bfbf09dd85d17556f7/users/2966dcef3f4d4b0981a2523db5e90afd/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:14.830331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6a8e3-b4c7-4b15-9275-57dd83b601a0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:14.830689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6a8e3-b4c7-4b15-9275-57dd83b601a0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:14.831048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6a8e3-b4c7-4b15-9275-57dd83b601a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:14.854105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ebcd3292-d223-4949-9956-405fcec0aeec None None] MFA Rules not processed for user `4a6aea2df67c4cea8c2a784926b499c2`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:14.855362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ebcd3292-d223-4949-9956-405fcec0aeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:14.873500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-7fd6a8e3-b4c7-4b15-9275-57dd83b601a0 None None] MFA Rules not processed for user `2966dcef3f4d4b0981a2523db5e90afd`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:14.876179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7fd6a8e3-b4c7-4b15-9275-57dd83b601a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:14.981908 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3643/7272] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:49:14.986851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6a8e3-b4c7-4b15-9275-57dd83b601a0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:14.991804 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3630/7273] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:15.001245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd3292-d223-4949-9956-405fcec0aeec None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:15.003216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ebcd3292-d223-4949-9956-405fcec0aeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:15.118492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd3292-d223-4949-9956-405fcec0aeec None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:15.123932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f602b44-06cb-45f6-90ad-3794834aec08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:15.124953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f602b44-06cb-45f6-90ad-3794834aec08 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:15.126023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f602b44-06cb-45f6-90ad-3794834aec08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:15.126481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f602b44-06cb-45f6-90ad-3794834aec08 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:15.127204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6a8e3-b4c7-4b15-9275-57dd83b601a0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:15.127400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f602b44-06cb-45f6-90ad-3794834aec08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:15.129712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f602b44-06cb-45f6-90ad-3794834aec08 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:15.135444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21c3ce-9bea-4092-870e-1e107eb88689 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:15.136506 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21c3ce-9bea-4092-870e-1e107eb88689 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:15.137188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21c3ce-9bea-4092-870e-1e107eb88689 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:15.138243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21c3ce-9bea-4092-870e-1e107eb88689 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:15.139477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21c3ce-9bea-4092-870e-1e107eb88689 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:15.142249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21c3ce-9bea-4092-870e-1e107eb88689 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:15.277225 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3644/7274] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:49:14 2022] POST /identity/v3/domains => generated 275 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:49:15.282442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21c3ce-9bea-4092-870e-1e107eb88689 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:15.295062 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3631/7275] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:49:14 2022] POST /identity/v3/projects => generated 381 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:15.298749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f602b44-06cb-45f6-90ad-3794834aec08 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:15.440030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21c3ce-9bea-4092-870e-1e107eb88689 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:15.440475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f602b44-06cb-45f6-90ad-3794834aec08 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:15.451094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0e7ab-d69b-416b-9834-004afdcc9134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:15.451813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0e7ab-d69b-416b-9834-004afdcc9134 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:15.452195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0e7ab-d69b-416b-9834-004afdcc9134 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:15.452488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0e7ab-d69b-416b-9834-004afdcc9134 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:15.454047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0e7ab-d69b-416b-9834-004afdcc9134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:15.456390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0e7ab-d69b-416b-9834-004afdcc9134 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:15.544716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7539f4-3927-4180-a61f-c195afc266e5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:15.545943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7539f4-3927-4180-a61f-c195afc266e5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:15.546411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7539f4-3927-4180-a61f-c195afc266e5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:15.546878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7539f4-3927-4180-a61f-c195afc266e5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:15.547882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7539f4-3927-4180-a61f-c195afc266e5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:15.549858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7539f4-3927-4180-a61f-c195afc266e5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:15.555744 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3632/7276] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:49:15 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:49:15.557071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0e7ab-d69b-416b-9834-004afdcc9134 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:15.571433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0e7ab-d69b-416b-9834-004afdcc9134 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:15.579427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3a714-7d60-4a82-9db3-b6180a532fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:15.580534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3a714-7d60-4a82-9db3-b6180a532fba admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:15.581033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3a714-7d60-4a82-9db3-b6180a532fba admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:15.581527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3a714-7d60-4a82-9db3-b6180a532fba admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:15.583026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3a714-7d60-4a82-9db3-b6180a532fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:15.587092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3a714-7d60-4a82-9db3-b6180a532fba admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:15.610289 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3633/7277] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:49:15.611478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3a714-7d60-4a82-9db3-b6180a532fba admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:15.639679 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3645/7278] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:49:15 2022] POST /identity/v3/roles => generated 240 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:15.645373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7539f4-3927-4180-a61f-c195afc266e5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:15.649373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3a714-7d60-4a82-9db3-b6180a532fba admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:15.658656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7b67c-1d0c-40d8-8cb4-3aca462cb30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:15.661927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7b67c-1d0c-40d8-8cb4-3aca462cb30d admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:15.661927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7b67c-1d0c-40d8-8cb4-3aca462cb30d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:15.661927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7b67c-1d0c-40d8-8cb4-3aca462cb30d admin admin] PATH_INFO: `/v3/projects/73a4921ab6904eb88bfe9f5c629cff14/users/e88accb1ff214b8eb38aed45f99dacb6/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:15.670930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7539f4-3927-4180-a61f-c195afc266e5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:15.679539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b52da-2a17-4261-b7a4-3b37c42d6f5d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:15.684938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b52da-2a17-4261-b7a4-3b37c42d6f5d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:15.684938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b52da-2a17-4261-b7a4-3b37c42d6f5d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:15.684938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b52da-2a17-4261-b7a4-3b37c42d6f5d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains/f59e892b469c4017bb9193a57eecc459/users/2966dcef3f4d4b0981a2523db5e90afd/roles/fbcd8ad9fabb472399d00f1fff0829df` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:15.688278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7b67c-1d0c-40d8-8cb4-3aca462cb30d admin admin] RBAC: Authorizing `identity:create_grant(project_id=73a4921ab6904eb88bfe9f5c629cff14, user_id=e88accb1ff214b8eb38aed45f99dacb6, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:15.699599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7b67c-1d0c-40d8-8cb4-3aca462cb30d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:15.710084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b52da-2a17-4261-b7a4-3b37c42d6f5d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f59e892b469c4017bb9193a57eecc459, user_id=2966dcef3f4d4b0981a2523db5e90afd, role_id=fbcd8ad9fabb472399d00f1fff0829df)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:15.715149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b52da-2a17-4261-b7a4-3b37c42d6f5d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:15.808331 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3634/7279] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:15 2022] PUT /identity/v3/projects/73a4921ab6904eb88bfe9f5c629cff14/users/e88accb1ff214b8eb38aed45f99dacb6/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:15.814151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7b67c-1d0c-40d8-8cb4-3aca462cb30d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:15.823427 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3646/7280] 10.222.0.16 () {60 vars in 1479 bytes} [Mon May 2 10:49:15 2022] PUT /identity/v3/domains/f59e892b469c4017bb9193a57eecc459/users/2966dcef3f4d4b0981a2523db5e90afd/roles/fbcd8ad9fabb472399d00f1fff0829df => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:15.824705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b52da-2a17-4261-b7a4-3b37c42d6f5d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:15.904644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7b67c-1d0c-40d8-8cb4-3aca462cb30d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:15.928716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b52da-2a17-4261-b7a4-3b37c42d6f5d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:15.935213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788906c9-6b98-498c-b492-778f37ff0fd5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:15.935988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788906c9-6b98-498c-b492-778f37ff0fd5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:15.936348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788906c9-6b98-498c-b492-778f37ff0fd5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:15.936720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788906c9-6b98-498c-b492-778f37ff0fd5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:15.937492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788906c9-6b98-498c-b492-778f37ff0fd5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:15.939456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788906c9-6b98-498c-b492-778f37ff0fd5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:15.979690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be0ab1-e587-4615-a30d-1e1be50b0cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:15.980377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be0ab1-e587-4615-a30d-1e1be50b0cbd admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:15.980698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be0ab1-e587-4615-a30d-1e1be50b0cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:15.980981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be0ab1-e587-4615-a30d-1e1be50b0cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:15.981721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be0ab1-e587-4615-a30d-1e1be50b0cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:15.983336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be0ab1-e587-4615-a30d-1e1be50b0cbd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:15.997396 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3635/7281] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:15 2022] GET /identity/v3/roles => generated 1651 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:49:15.997984 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3647/7282] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:49:15 2022] POST /identity/v3/domains => generated 276 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:16.002032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788906c9-6b98-498c-b492-778f37ff0fd5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:16.003030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be0ab1-e587-4615-a30d-1e1be50b0cbd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:16.015130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be0ab1-e587-4615-a30d-1e1be50b0cbd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:16.070593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788906c9-6b98-498c-b492-778f37ff0fd5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:16.073633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce74499-5887-4969-bf67-ccdc4dacfaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:16.074542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce74499-5887-4969-bf67-ccdc4dacfaa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:16.075023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce74499-5887-4969-bf67-ccdc4dacfaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:16.075305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce74499-5887-4969-bf67-ccdc4dacfaa4 admin admin] PATH_INFO: `/v3/projects/73a4921ab6904eb88bfe9f5c629cff14/users/e88accb1ff214b8eb38aed45f99dacb6/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:16.075904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93148550-9cb8-41d7-bc90-20e4981d0e69 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:16.076683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93148550-9cb8-41d7-bc90-20e4981d0e69 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:16.077122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93148550-9cb8-41d7-bc90-20e4981d0e69 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:16.077349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce74499-5887-4969-bf67-ccdc4dacfaa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73a4921ab6904eb88bfe9f5c629cff14, user_id=e88accb1ff214b8eb38aed45f99dacb6, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:16.077625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93148550-9cb8-41d7-bc90-20e4981d0e69 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:16.078884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93148550-9cb8-41d7-bc90-20e4981d0e69 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:16.085374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93148550-9cb8-41d7-bc90-20e4981d0e69 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:16.085555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce74499-5887-4969-bf67-ccdc4dacfaa4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:16.092026 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3636/7283] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:16 2022] PUT /identity/v3/projects/73a4921ab6904eb88bfe9f5c629cff14/users/e88accb1ff214b8eb38aed45f99dacb6/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:16.171240 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3648/7284] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:49:16 2022] POST /identity/v3/roles => generated 240 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:16.173581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93148550-9cb8-41d7-bc90-20e4981d0e69 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:16.173723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd103b59-1c76-4033-8a19-772c12ab93f4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:16.174002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd103b59-1c76-4033-8a19-772c12ab93f4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:16.174295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd103b59-1c76-4033-8a19-772c12ab93f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:16.185949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93148550-9cb8-41d7-bc90-20e4981d0e69 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:16.201265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-cd103b59-1c76-4033-8a19-772c12ab93f4 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:16.202529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cd103b59-1c76-4033-8a19-772c12ab93f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:16.276643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd8952-59e4-4c00-8557-2d6a9b3dcb52 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:16.279431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd8952-59e4-4c00-8557-2d6a9b3dcb52 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:16.280038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd8952-59e4-4c00-8557-2d6a9b3dcb52 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:16.280199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd8952-59e4-4c00-8557-2d6a9b3dcb52 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/groups` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:16.283011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd8952-59e4-4c00-8557-2d6a9b3dcb52 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:16.286330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd8952-59e4-4c00-8557-2d6a9b3dcb52 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:16.351857 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3637/7285] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:49:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:16.368857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd103b59-1c76-4033-8a19-772c12ab93f4 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:16.368857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cd103b59-1c76-4033-8a19-772c12ab93f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:16.400212 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3649/7286] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 2 10:49:16 2022] POST /identity/v3/groups => generated 326 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:16.414937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd8952-59e4-4c00-8557-2d6a9b3dcb52 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:16.425997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd8952-59e4-4c00-8557-2d6a9b3dcb52 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:16.431258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403d455-b084-4ed4-b362-f8617864985e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:16.432494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403d455-b084-4ed4-b362-f8617864985e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:16.432937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403d455-b084-4ed4-b362-f8617864985e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:16.433453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403d455-b084-4ed4-b362-f8617864985e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/groups/dcff837f5dbb48bdb8fbfe25bd9ba671/users/2966dcef3f4d4b0981a2523db5e90afd` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:16.440694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403d455-b084-4ed4-b362-f8617864985e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=dcff837f5dbb48bdb8fbfe25bd9ba671, user_id=2966dcef3f4d4b0981a2523db5e90afd)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:16.443035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403d455-b084-4ed4-b362-f8617864985e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:16.455212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd103b59-1c76-4033-8a19-772c12ab93f4 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:16.460445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79909924-b04e-455a-97b1-0a7c8f142faf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:16.461136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79909924-b04e-455a-97b1-0a7c8f142faf service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:16.461423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79909924-b04e-455a-97b1-0a7c8f142faf service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:16.461753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79909924-b04e-455a-97b1-0a7c8f142faf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:16.471186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79909924-b04e-455a-97b1-0a7c8f142faf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:16.472922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79909924-b04e-455a-97b1-0a7c8f142faf service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:16.482221 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3638/7287] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:49:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 02 10:49:16.563627 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3650/7288] 10.222.0.16 () {60 vars in 1359 bytes} [Mon May 2 10:49:16 2022] PUT /identity/v3/groups/dcff837f5dbb48bdb8fbfe25bd9ba671/users/2966dcef3f4d4b0981a2523db5e90afd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:16.568549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79909924-b04e-455a-97b1-0a7c8f142faf service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:16.582715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79909924-b04e-455a-97b1-0a7c8f142faf service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:16.682285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb19b0-1505-49f4-8495-73e8f4be81bb tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:16.684112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb19b0-1505-49f4-8495-73e8f4be81bb tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:16.684576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb19b0-1505-49f4-8495-73e8f4be81bb tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:16.685092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb19b0-1505-49f4-8495-73e8f4be81bb tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains/94e35cb6c64c42269950dc290cede909/groups/dcff837f5dbb48bdb8fbfe25bd9ba671/roles/f1c5aae2ab7a438d92df33096bb42cdb` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:16.688687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb19b0-1505-49f4-8495-73e8f4be81bb tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=94e35cb6c64c42269950dc290cede909, group_id=dcff837f5dbb48bdb8fbfe25bd9ba671, role_id=f1c5aae2ab7a438d92df33096bb42cdb)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:16.693790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb19b0-1505-49f4-8495-73e8f4be81bb tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:16.762962 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3639/7289] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:16 2022] PUT /identity/v3/domains/94e35cb6c64c42269950dc290cede909/groups/dcff837f5dbb48bdb8fbfe25bd9ba671/roles/f1c5aae2ab7a438d92df33096bb42cdb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:16.767583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403d455-b084-4ed4-b362-f8617864985e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:16.780255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403d455-b084-4ed4-b362-f8617864985e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:16.947605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e650ab-3664-46d8-b87f-83fb600d8263 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:16.948468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e650ab-3664-46d8-b87f-83fb600d8263 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:16.948748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e650ab-3664-46d8-b87f-83fb600d8263 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:16.948843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e650ab-3664-46d8-b87f-83fb600d8263 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:16.949593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e650ab-3664-46d8-b87f-83fb600d8263 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:16.951210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e650ab-3664-46d8-b87f-83fb600d8263 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:17.041478 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3651/7290] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:49:16 2022] POST /identity/v3/domains => generated 277 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:17.045097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb19b0-1505-49f4-8495-73e8f4be81bb tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:17.058706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb19b0-1505-49f4-8495-73e8f4be81bb tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:17.216957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe288e9-fffe-4843-b9e4-0b86e93ee874 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:17.218174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe288e9-fffe-4843-b9e4-0b86e93ee874 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:17.219543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe288e9-fffe-4843-b9e4-0b86e93ee874 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:17.221416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe288e9-fffe-4843-b9e4-0b86e93ee874 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:17.222887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe288e9-fffe-4843-b9e4-0b86e93ee874 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:17.226239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe288e9-fffe-4843-b9e4-0b86e93ee874 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:17.300973 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3640/7291] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:49:17 2022] POST /identity/v3/roles => generated 240 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:17.305488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e650ab-3664-46d8-b87f-83fb600d8263 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:17.322080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e650ab-3664-46d8-b87f-83fb600d8263 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:17.336754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6931be-3bf0-410c-b881-e34f094fd168 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:17.338018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6931be-3bf0-410c-b881-e34f094fd168 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:17.338483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6931be-3bf0-410c-b881-e34f094fd168 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:17.338939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6931be-3bf0-410c-b881-e34f094fd168 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains/ea6ac01ccebb476ba982938379e2577b/users/2966dcef3f4d4b0981a2523db5e90afd/roles/7ed4d922b9cb460db87ca812ed796a97` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:17.354094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6931be-3bf0-410c-b881-e34f094fd168 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=ea6ac01ccebb476ba982938379e2577b, user_id=2966dcef3f4d4b0981a2523db5e90afd, role_id=7ed4d922b9cb460db87ca812ed796a97)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:17.357261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6931be-3bf0-410c-b881-e34f094fd168 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:17.418920 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3652/7292] 10.222.0.16 () {60 vars in 1479 bytes} [Mon May 2 10:49:17 2022] PUT /identity/v3/domains/ea6ac01ccebb476ba982938379e2577b/users/2966dcef3f4d4b0981a2523db5e90afd/roles/7ed4d922b9cb460db87ca812ed796a97 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:49:17.423276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe288e9-fffe-4843-b9e4-0b86e93ee874 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:17.434097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe288e9-fffe-4843-b9e4-0b86e93ee874 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:17.495331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce643c-fedf-45ba-81d2-e78622de6a96 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:17.496013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce643c-fedf-45ba-81d2-e78622de6a96 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:17.496299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce643c-fedf-45ba-81d2-e78622de6a96 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:17.496581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce643c-fedf-45ba-81d2-e78622de6a96 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:17.497375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce643c-fedf-45ba-81d2-e78622de6a96 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:17.499762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce643c-fedf-45ba-81d2-e78622de6a96 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:17.599413 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3641/7293] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:49:17 2022] POST /identity/v3/domains => generated 277 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:17.603618 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6931be-3bf0-410c-b881-e34f094fd168 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:17.616507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6931be-3bf0-410c-b881-e34f094fd168 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:17.674646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149f978-6d74-4bbc-a89d-c1cdd76af765 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:17.675241 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149f978-6d74-4bbc-a89d-c1cdd76af765 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:17.675892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149f978-6d74-4bbc-a89d-c1cdd76af765 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:17.675892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149f978-6d74-4bbc-a89d-c1cdd76af765 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:17.676549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149f978-6d74-4bbc-a89d-c1cdd76af765 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:17.678218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149f978-6d74-4bbc-a89d-c1cdd76af765 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:17.765903 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3653/7294] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:49:17 2022] POST /identity/v3/roles => generated 240 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:49:17.770426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce643c-fedf-45ba-81d2-e78622de6a96 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:17.780470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce643c-fedf-45ba-81d2-e78622de6a96 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:17.785092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fb551-1f7b-4685-b12c-88f66168982e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:17.785743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fb551-1f7b-4685-b12c-88f66168982e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:17.786030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fb551-1f7b-4685-b12c-88f66168982e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:17.786363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fb551-1f7b-4685-b12c-88f66168982e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/groups` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:17.786992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fb551-1f7b-4685-b12c-88f66168982e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:17.788011 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-625fb551-1f7b-4685-b12c-88f66168982e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:49:17.788011 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:49:17.788011 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:49:17.789230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fb551-1f7b-4685-b12c-88f66168982e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:17.913307 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3642/7295] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 2 10:49:17 2022] POST /identity/v3/groups => generated 326 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:17.915018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149f978-6d74-4bbc-a89d-c1cdd76af765 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:17.928262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149f978-6d74-4bbc-a89d-c1cdd76af765 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:17.934821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b106de1-9ea5-4faa-875c-fdaaf80e76e1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:17.936114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b106de1-9ea5-4faa-875c-fdaaf80e76e1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:17.944273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b106de1-9ea5-4faa-875c-fdaaf80e76e1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:17.944273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b106de1-9ea5-4faa-875c-fdaaf80e76e1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/groups/0a11243ae85c4cdab1df6d8cd13d5146/users/2966dcef3f4d4b0981a2523db5e90afd` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:17.965625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b106de1-9ea5-4faa-875c-fdaaf80e76e1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=0a11243ae85c4cdab1df6d8cd13d5146, user_id=2966dcef3f4d4b0981a2523db5e90afd)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:17.968394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b106de1-9ea5-4faa-875c-fdaaf80e76e1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:18.153750 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3654/7296] 10.222.0.16 () {60 vars in 1359 bytes} [Mon May 2 10:49:17 2022] PUT /identity/v3/groups/0a11243ae85c4cdab1df6d8cd13d5146/users/2966dcef3f4d4b0981a2523db5e90afd => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:18.158831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fb551-1f7b-4685-b12c-88f66168982e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:18.170193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fb551-1f7b-4685-b12c-88f66168982e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:18.263300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af37dea-25ed-42bd-b010-7f318a3670c1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:18.264257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af37dea-25ed-42bd-b010-7f318a3670c1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:18.264541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af37dea-25ed-42bd-b010-7f318a3670c1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:18.265061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af37dea-25ed-42bd-b010-7f318a3670c1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains/bea4f508f5fd4b22a91939eb90579e9b/groups/0a11243ae85c4cdab1df6d8cd13d5146/roles/da15ed4a900f49eb8db7d13281e96f2b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:18.284594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af37dea-25ed-42bd-b010-7f318a3670c1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=bea4f508f5fd4b22a91939eb90579e9b, group_id=0a11243ae85c4cdab1df6d8cd13d5146, role_id=da15ed4a900f49eb8db7d13281e96f2b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:18.290889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af37dea-25ed-42bd-b010-7f318a3670c1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:18.436516 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3643/7297] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:18 2022] PUT /identity/v3/domains/bea4f508f5fd4b22a91939eb90579e9b/groups/0a11243ae85c4cdab1df6d8cd13d5146/roles/da15ed4a900f49eb8db7d13281e96f2b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:18.441804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b106de1-9ea5-4faa-875c-fdaaf80e76e1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:18.638167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b106de1-9ea5-4faa-875c-fdaaf80e76e1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:18.798148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b670eb-4f2b-43bf-a0cc-19ffa0fadf2b tempest-TokensV3TestJSON-77867819 tempest-TokensV3TestJSON-77867819-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2966dcef3f4d4b0981a2523db5e90afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c441b239c0243bfbf09dd85d17556f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:18.799091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b670eb-4f2b-43bf-a0cc-19ffa0fadf2b tempest-TokensV3TestJSON-77867819 tempest-TokensV3TestJSON-77867819-project] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:18.803801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b670eb-4f2b-43bf-a0cc-19ffa0fadf2b tempest-TokensV3TestJSON-77867819 tempest-TokensV3TestJSON-77867819-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:18.803801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b670eb-4f2b-43bf-a0cc-19ffa0fadf2b tempest-TokensV3TestJSON-77867819 tempest-TokensV3TestJSON-77867819-project] PATH_INFO: `/v3/auth/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:18.803801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b670eb-4f2b-43bf-a0cc-19ffa0fadf2b tempest-TokensV3TestJSON-77867819 tempest-TokensV3TestJSON-77867819-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:18.803801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b670eb-4f2b-43bf-a0cc-19ffa0fadf2b tempest-TokensV3TestJSON-77867819 tempest-TokensV3TestJSON-77867819-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:18.877181 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3655/7298] 10.222.0.16 () {58 vars in 1142 bytes} [Mon May 2 10:49:18 2022] GET /identity/v3/auth/domains => generated 1173 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:49:18.881937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af37dea-25ed-42bd-b010-7f318a3670c1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:19.004258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af37dea-25ed-42bd-b010-7f318a3670c1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:19.020336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c53d4-0428-4872-9358-f57b546d7eab tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:19.020336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c53d4-0428-4872-9358-f57b546d7eab tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:19.020336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c53d4-0428-4872-9358-f57b546d7eab tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:19.020688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c53d4-0428-4872-9358-f57b546d7eab tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains/bea4f508f5fd4b22a91939eb90579e9b/groups/0a11243ae85c4cdab1df6d8cd13d5146/roles/da15ed4a900f49eb8db7d13281e96f2b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:19.023649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c53d4-0428-4872-9358-f57b546d7eab tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=bea4f508f5fd4b22a91939eb90579e9b, group_id=0a11243ae85c4cdab1df6d8cd13d5146, role_id=da15ed4a900f49eb8db7d13281e96f2b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:19.027224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c53d4-0428-4872-9358-f57b546d7eab tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:19.035482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bd6c53d4-0428-4872-9358-f57b546d7eab tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invalidating the token cache because role da15ed4a900f49eb8db7d13281e96f2b was removed from group 0a11243ae85c4cdab1df6d8cd13d5146 on domain bea4f508f5fd4b22a91939eb90579e9b. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:19.036050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bd6c53d4-0428-4872-9358-f57b546d7eab tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:19.036988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bd6c53d4-0428-4872-9358-f57b546d7eab tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:19.155399 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3644/7299] 10.222.0.16 () {58 vars in 1466 bytes} [Mon May 2 10:49:18 2022] DELETE /identity/v3/domains/bea4f508f5fd4b22a91939eb90579e9b/groups/0a11243ae85c4cdab1df6d8cd13d5146/roles/da15ed4a900f49eb8db7d13281e96f2b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:19.160395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b670eb-4f2b-43bf-a0cc-19ffa0fadf2b tempest-TokensV3TestJSON-77867819 tempest-TokensV3TestJSON-77867819-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:19.166354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b3b670eb-4f2b-43bf-a0cc-19ffa0fadf2b tempest-TokensV3TestJSON-77867819 tempest-TokensV3TestJSON-77867819-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:19.197989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b670eb-4f2b-43bf-a0cc-19ffa0fadf2b tempest-TokensV3TestJSON-77867819 tempest-TokensV3TestJSON-77867819-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:19.306580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cea2fa-d4e6-4df6-b268-f29c88d402a4 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:19.307553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cea2fa-d4e6-4df6-b268-f29c88d402a4 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:19.308054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cea2fa-d4e6-4df6-b268-f29c88d402a4 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:19.309408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cea2fa-d4e6-4df6-b268-f29c88d402a4 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/groups/0a11243ae85c4cdab1df6d8cd13d5146/users/2966dcef3f4d4b0981a2523db5e90afd` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:19.316767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cea2fa-d4e6-4df6-b268-f29c88d402a4 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=0a11243ae85c4cdab1df6d8cd13d5146, user_id=2966dcef3f4d4b0981a2523db5e90afd)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:19.319072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cea2fa-d4e6-4df6-b268-f29c88d402a4 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:19.377604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e7cea2fa-d4e6-4df6-b268-f29c88d402a4 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2966dcef3f4d4b0981a2523db5e90afd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:19.436449 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3656/7300] 10.222.0.16 () {58 vars in 1343 bytes} [Mon May 2 10:49:19 2022] DELETE /identity/v3/groups/0a11243ae85c4cdab1df6d8cd13d5146/users/2966dcef3f4d4b0981a2523db5e90afd => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:19.442130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c53d4-0428-4872-9358-f57b546d7eab tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:19.463457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c53d4-0428-4872-9358-f57b546d7eab tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:19.569133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98253443-f141-4337-9055-1e3e7656eeca tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:19.570590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98253443-f141-4337-9055-1e3e7656eeca tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:19.571010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98253443-f141-4337-9055-1e3e7656eeca tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:19.571456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98253443-f141-4337-9055-1e3e7656eeca tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/groups/0a11243ae85c4cdab1df6d8cd13d5146` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:19.573093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98253443-f141-4337-9055-1e3e7656eeca tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:delete_group(group_id=0a11243ae85c4cdab1df6d8cd13d5146)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:19.574297 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-98253443-f141-4337-9055-1e3e7656eeca tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:49:19.574297 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:49:19.574297 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:49:19.575579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98253443-f141-4337-9055-1e3e7656eeca tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:19.724059 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3645/7301] 10.222.0.16 () {58 vars in 1226 bytes} [Mon May 2 10:49:19 2022] DELETE /identity/v3/groups/0a11243ae85c4cdab1df6d8cd13d5146 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:19.728090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cea2fa-d4e6-4df6-b268-f29c88d402a4 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:19.744975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cea2fa-d4e6-4df6-b268-f29c88d402a4 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:19.833416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7370d-2408-4efa-8075-2e4efa49914e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:19.834878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7370d-2408-4efa-8075-2e4efa49914e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:19.835161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7370d-2408-4efa-8075-2e4efa49914e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:19.835628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7370d-2408-4efa-8075-2e4efa49914e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/roles/da15ed4a900f49eb8db7d13281e96f2b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:19.837790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7370d-2408-4efa-8075-2e4efa49914e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:delete_role(role_id=da15ed4a900f49eb8db7d13281e96f2b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:19.839482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7370d-2408-4efa-8075-2e4efa49914e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:19.949033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ac7370d-2408-4efa-8075-2e4efa49914e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invalidating the token cache because role da15ed4a900f49eb8db7d13281e96f2b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:19.949508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ac7370d-2408-4efa-8075-2e4efa49914e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:19.950068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ac7370d-2408-4efa-8075-2e4efa49914e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:19.952230 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3657/7302] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:49:19 2022] DELETE /identity/v3/roles/da15ed4a900f49eb8db7d13281e96f2b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:19.957002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98253443-f141-4337-9055-1e3e7656eeca tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:19.959047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-98253443-f141-4337-9055-1e3e7656eeca tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:19.972921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98253443-f141-4337-9055-1e3e7656eeca tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:20.035469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf3092-c322-4688-a957-4a617daf0d30 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:20.036469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf3092-c322-4688-a957-4a617daf0d30 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:20.036789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf3092-c322-4688-a957-4a617daf0d30 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:20.037118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf3092-c322-4688-a957-4a617daf0d30 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains/bea4f508f5fd4b22a91939eb90579e9b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:20.038712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf3092-c322-4688-a957-4a617daf0d30 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=bea4f508f5fd4b22a91939eb90579e9b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:20.040528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf3092-c322-4688-a957-4a617daf0d30 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:20.065421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9fdf3092-c322-4688-a957-4a617daf0d30 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bea4f508f5fd4b22a91939eb90579e9b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:20.069035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9fdf3092-c322-4688-a957-4a617daf0d30 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bea4f508f5fd4b22a91939eb90579e9b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:20.181644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9fdf3092-c322-4688-a957-4a617daf0d30 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bea4f508f5fd4b22a91939eb90579e9b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:20.182372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9fdf3092-c322-4688-a957-4a617daf0d30 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bea4f508f5fd4b22a91939eb90579e9b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:20.185015 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3646/7303] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:49:19 2022] PATCH /identity/v3/domains/bea4f508f5fd4b22a91939eb90579e9b => generated 278 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:49:20.189741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7370d-2408-4efa-8075-2e4efa49914e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:20.201477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7370d-2408-4efa-8075-2e4efa49914e tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:20.271920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9e79f-bf3a-4d67-9619-125de9fea4a9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:20.272960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9e79f-bf3a-4d67-9619-125de9fea4a9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:20.273398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9e79f-bf3a-4d67-9619-125de9fea4a9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:20.273750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9e79f-bf3a-4d67-9619-125de9fea4a9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains/bea4f508f5fd4b22a91939eb90579e9b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:20.286133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9e79f-bf3a-4d67-9619-125de9fea4a9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bea4f508f5fd4b22a91939eb90579e9b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:20.289232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9e79f-bf3a-4d67-9619-125de9fea4a9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:20.315857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-abd9e79f-bf3a-4d67-9619-125de9fea4a9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bea4f508f5fd4b22a91939eb90579e9b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:20.319566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-abd9e79f-bf3a-4d67-9619-125de9fea4a9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bea4f508f5fd4b22a91939eb90579e9b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:20.455992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-abd9e79f-bf3a-4d67-9619-125de9fea4a9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bea4f508f5fd4b22a91939eb90579e9b', 'request_id': 'req-abd9e79f-bf3a-4d67-9619-125de9fea4a9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:20.530818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-abd9e79f-bf3a-4d67-9619-125de9fea4a9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bea4f508f5fd4b22a91939eb90579e9b', 'request_id': 'req-abd9e79f-bf3a-4d67-9619-125de9fea4a9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:20.539913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-abd9e79f-bf3a-4d67-9619-125de9fea4a9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bea4f508f5fd4b22a91939eb90579e9b', 'request_id': 'req-abd9e79f-bf3a-4d67-9619-125de9fea4a9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:20.556452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-abd9e79f-bf3a-4d67-9619-125de9fea4a9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] The token cache is being invalidate because project bea4f508f5fd4b22a91939eb90579e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:20.556858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-abd9e79f-bf3a-4d67-9619-125de9fea4a9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:20.557695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-abd9e79f-bf3a-4d67-9619-125de9fea4a9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:20.566033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-abd9e79f-bf3a-4d67-9619-125de9fea4a9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bea4f508f5fd4b22a91939eb90579e9b', 'request_id': 'req-abd9e79f-bf3a-4d67-9619-125de9fea4a9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:20.566773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-abd9e79f-bf3a-4d67-9619-125de9fea4a9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bea4f508f5fd4b22a91939eb90579e9b', 'request_id': 'req-abd9e79f-bf3a-4d67-9619-125de9fea4a9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:20.570847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-abd9e79f-bf3a-4d67-9619-125de9fea4a9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bea4f508f5fd4b22a91939eb90579e9b', 'request_id': 'req-abd9e79f-bf3a-4d67-9619-125de9fea4a9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:20.576983 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3658/7304] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:49:20 2022] DELETE /identity/v3/domains/bea4f508f5fd4b22a91939eb90579e9b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:49:20.581263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf3092-c322-4688-a957-4a617daf0d30 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:20.583156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9fdf3092-c322-4688-a957-4a617daf0d30 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:20.596129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf3092-c322-4688-a957-4a617daf0d30 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:20.660248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fea8f0-c5c2-4b70-8a73-5cb445c618ab tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:20.661252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fea8f0-c5c2-4b70-8a73-5cb445c618ab tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:20.661656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fea8f0-c5c2-4b70-8a73-5cb445c618ab tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:20.662035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fea8f0-c5c2-4b70-8a73-5cb445c618ab tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains/ea6ac01ccebb476ba982938379e2577b/users/2966dcef3f4d4b0981a2523db5e90afd/roles/7ed4d922b9cb460db87ca812ed796a97` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:20.666160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fea8f0-c5c2-4b70-8a73-5cb445c618ab tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=ea6ac01ccebb476ba982938379e2577b, user_id=2966dcef3f4d4b0981a2523db5e90afd, role_id=7ed4d922b9cb460db87ca812ed796a97)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:20.670674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fea8f0-c5c2-4b70-8a73-5cb445c618ab tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:20.678052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-34fea8f0-c5c2-4b70-8a73-5cb445c618ab tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invalidating the token cache because role 7ed4d922b9cb460db87ca812ed796a97 was removed from user 2966dcef3f4d4b0981a2523db5e90afd on domain ea6ac01ccebb476ba982938379e2577b. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:20.678513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-34fea8f0-c5c2-4b70-8a73-5cb445c618ab tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:20.679486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-34fea8f0-c5c2-4b70-8a73-5cb445c618ab tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:20.784248 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3647/7305] 10.222.0.16 () {58 vars in 1463 bytes} [Mon May 2 10:49:20 2022] DELETE /identity/v3/domains/ea6ac01ccebb476ba982938379e2577b/users/2966dcef3f4d4b0981a2523db5e90afd/roles/7ed4d922b9cb460db87ca812ed796a97 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:20.788786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9e79f-bf3a-4d67-9619-125de9fea4a9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:20.790355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-abd9e79f-bf3a-4d67-9619-125de9fea4a9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:20.803028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9e79f-bf3a-4d67-9619-125de9fea4a9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:20.920799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525821b-b234-46af-b562-1a0d495e669b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:20.921691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525821b-b234-46af-b562-1a0d495e669b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:20.923770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525821b-b234-46af-b562-1a0d495e669b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:20.924261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525821b-b234-46af-b562-1a0d495e669b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/roles/7ed4d922b9cb460db87ca812ed796a97` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:20.925933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525821b-b234-46af-b562-1a0d495e669b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7ed4d922b9cb460db87ca812ed796a97)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:20.928001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525821b-b234-46af-b562-1a0d495e669b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:21.081829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8525821b-b234-46af-b562-1a0d495e669b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invalidating the token cache because role 7ed4d922b9cb460db87ca812ed796a97 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:21.082129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8525821b-b234-46af-b562-1a0d495e669b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:21.083010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8525821b-b234-46af-b562-1a0d495e669b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:21.085402 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3659/7306] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:49:20 2022] DELETE /identity/v3/roles/7ed4d922b9cb460db87ca812ed796a97 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:21.089644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fea8f0-c5c2-4b70-8a73-5cb445c618ab tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:21.091225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-34fea8f0-c5c2-4b70-8a73-5cb445c618ab tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:21.124440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fea8f0-c5c2-4b70-8a73-5cb445c618ab tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:21.184128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5403c-7ed1-4495-8c8d-b0af8f042084 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:21.185141 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5403c-7ed1-4495-8c8d-b0af8f042084 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:21.185517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5403c-7ed1-4495-8c8d-b0af8f042084 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:21.185864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5403c-7ed1-4495-8c8d-b0af8f042084 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains/ea6ac01ccebb476ba982938379e2577b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:21.187576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5403c-7ed1-4495-8c8d-b0af8f042084 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ea6ac01ccebb476ba982938379e2577b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:21.189268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5403c-7ed1-4495-8c8d-b0af8f042084 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:21.212448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fbe5403c-7ed1-4495-8c8d-b0af8f042084 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ea6ac01ccebb476ba982938379e2577b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:21.213310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fbe5403c-7ed1-4495-8c8d-b0af8f042084 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ea6ac01ccebb476ba982938379e2577b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:21.327576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fbe5403c-7ed1-4495-8c8d-b0af8f042084 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ea6ac01ccebb476ba982938379e2577b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:21.328234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fbe5403c-7ed1-4495-8c8d-b0af8f042084 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ea6ac01ccebb476ba982938379e2577b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:21.333905 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3648/7307] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:49:21 2022] PATCH /identity/v3/domains/ea6ac01ccebb476ba982938379e2577b => generated 278 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:49:21.335191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525821b-b234-46af-b562-1a0d495e669b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:21.337051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8525821b-b234-46af-b562-1a0d495e669b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:21.350194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525821b-b234-46af-b562-1a0d495e669b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:21.415360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:21.416560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:21.417049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:21.417707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains/ea6ac01ccebb476ba982938379e2577b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:21.431581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ea6ac01ccebb476ba982938379e2577b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:21.434034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:21.459480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ea6ac01ccebb476ba982938379e2577b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:21.462879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ea6ac01ccebb476ba982938379e2577b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:21.573775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea6ac01ccebb476ba982938379e2577b', 'request_id': 'req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:21.640381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea6ac01ccebb476ba982938379e2577b', 'request_id': 'req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:21.649245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea6ac01ccebb476ba982938379e2577b', 'request_id': 'req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:21.663835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] The token cache is being invalidate because project ea6ac01ccebb476ba982938379e2577b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:21.666189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:21.667213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:21.677639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ea6ac01ccebb476ba982938379e2577b', 'request_id': 'req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:21.678774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ea6ac01ccebb476ba982938379e2577b', 'request_id': 'req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:21.682820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ea6ac01ccebb476ba982938379e2577b', 'request_id': 'req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:21.691322 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3660/7308] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:49:21 2022] DELETE /identity/v3/domains/ea6ac01ccebb476ba982938379e2577b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:21.696080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5403c-7ed1-4495-8c8d-b0af8f042084 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:21.698068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fbe5403c-7ed1-4495-8c8d-b0af8f042084 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:21.711430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5403c-7ed1-4495-8c8d-b0af8f042084 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:21.774162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf135abe-2ca6-4eba-9359-1bd97137f58d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:21.775277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf135abe-2ca6-4eba-9359-1bd97137f58d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:21.775551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf135abe-2ca6-4eba-9359-1bd97137f58d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:21.775842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf135abe-2ca6-4eba-9359-1bd97137f58d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains/94e35cb6c64c42269950dc290cede909/groups/dcff837f5dbb48bdb8fbfe25bd9ba671/roles/f1c5aae2ab7a438d92df33096bb42cdb` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:21.778219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf135abe-2ca6-4eba-9359-1bd97137f58d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=94e35cb6c64c42269950dc290cede909, group_id=dcff837f5dbb48bdb8fbfe25bd9ba671, role_id=f1c5aae2ab7a438d92df33096bb42cdb)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:21.781243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf135abe-2ca6-4eba-9359-1bd97137f58d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:21.787727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cf135abe-2ca6-4eba-9359-1bd97137f58d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invalidating the token cache because role f1c5aae2ab7a438d92df33096bb42cdb was removed from group dcff837f5dbb48bdb8fbfe25bd9ba671 on domain 94e35cb6c64c42269950dc290cede909. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:21.788024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cf135abe-2ca6-4eba-9359-1bd97137f58d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:21.788771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cf135abe-2ca6-4eba-9359-1bd97137f58d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:21.873108 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3649/7309] 10.222.0.16 () {58 vars in 1466 bytes} [Mon May 2 10:49:21 2022] DELETE /identity/v3/domains/94e35cb6c64c42269950dc290cede909/groups/dcff837f5dbb48bdb8fbfe25bd9ba671/roles/f1c5aae2ab7a438d92df33096bb42cdb => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:21.877678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:21.881092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:21.896091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42a3f9-c82b-4949-89c8-c15f0ef9f167 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:21.959945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b016863-576a-44dc-92e2-71b60c75c91f tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:21.960989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b016863-576a-44dc-92e2-71b60c75c91f tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:21.961355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b016863-576a-44dc-92e2-71b60c75c91f tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:21.961709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b016863-576a-44dc-92e2-71b60c75c91f tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/groups/dcff837f5dbb48bdb8fbfe25bd9ba671/users/2966dcef3f4d4b0981a2523db5e90afd` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:21.963609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b016863-576a-44dc-92e2-71b60c75c91f tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=dcff837f5dbb48bdb8fbfe25bd9ba671, user_id=2966dcef3f4d4b0981a2523db5e90afd)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:21.965739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b016863-576a-44dc-92e2-71b60c75c91f tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:22.034833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7b016863-576a-44dc-92e2-71b60c75c91f tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2966dcef3f4d4b0981a2523db5e90afd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:22.128211 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3661/7310] 10.222.0.16 () {58 vars in 1343 bytes} [Mon May 2 10:49:21 2022] DELETE /identity/v3/groups/dcff837f5dbb48bdb8fbfe25bd9ba671/users/2966dcef3f4d4b0981a2523db5e90afd => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:22.132532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf135abe-2ca6-4eba-9359-1bd97137f58d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:22.134061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cf135abe-2ca6-4eba-9359-1bd97137f58d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:22.151262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf135abe-2ca6-4eba-9359-1bd97137f58d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:22.235642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e54de-a171-4184-82aa-2d5e8a86e409 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:22.236853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e54de-a171-4184-82aa-2d5e8a86e409 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:22.237381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e54de-a171-4184-82aa-2d5e8a86e409 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:22.237881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e54de-a171-4184-82aa-2d5e8a86e409 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/groups/dcff837f5dbb48bdb8fbfe25bd9ba671` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:22.239388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e54de-a171-4184-82aa-2d5e8a86e409 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:delete_group(group_id=dcff837f5dbb48bdb8fbfe25bd9ba671)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:22.242036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e54de-a171-4184-82aa-2d5e8a86e409 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:22.335719 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3650/7311] 10.222.0.16 () {58 vars in 1226 bytes} [Mon May 2 10:49:22 2022] DELETE /identity/v3/groups/dcff837f5dbb48bdb8fbfe25bd9ba671 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:49:22.339747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b016863-576a-44dc-92e2-71b60c75c91f tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:22.350666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b016863-576a-44dc-92e2-71b60c75c91f tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:22.422971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed335d-5673-49eb-812e-0e4aceb0a691 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:22.423861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed335d-5673-49eb-812e-0e4aceb0a691 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:22.424153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed335d-5673-49eb-812e-0e4aceb0a691 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:22.424433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed335d-5673-49eb-812e-0e4aceb0a691 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/roles/f1c5aae2ab7a438d92df33096bb42cdb` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:22.426321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed335d-5673-49eb-812e-0e4aceb0a691 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f1c5aae2ab7a438d92df33096bb42cdb)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:22.428152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed335d-5673-49eb-812e-0e4aceb0a691 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:22.517161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-82ed335d-5673-49eb-812e-0e4aceb0a691 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invalidating the token cache because role f1c5aae2ab7a438d92df33096bb42cdb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:22.517730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-82ed335d-5673-49eb-812e-0e4aceb0a691 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:22.519182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-82ed335d-5673-49eb-812e-0e4aceb0a691 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:22.524707 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3662/7312] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:49:22 2022] DELETE /identity/v3/roles/f1c5aae2ab7a438d92df33096bb42cdb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:49:22.526400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e54de-a171-4184-82aa-2d5e8a86e409 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:22.527933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-713e54de-a171-4184-82aa-2d5e8a86e409 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:22.543694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e54de-a171-4184-82aa-2d5e8a86e409 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:22.606825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730bc38-a7b8-41cc-ab93-f29a9d6a5948 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:22.608883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730bc38-a7b8-41cc-ab93-f29a9d6a5948 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:22.608883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730bc38-a7b8-41cc-ab93-f29a9d6a5948 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:22.608883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730bc38-a7b8-41cc-ab93-f29a9d6a5948 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains/94e35cb6c64c42269950dc290cede909` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:22.610607 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730bc38-a7b8-41cc-ab93-f29a9d6a5948 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=94e35cb6c64c42269950dc290cede909)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:22.612833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730bc38-a7b8-41cc-ab93-f29a9d6a5948 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:22.635034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9730bc38-a7b8-41cc-ab93-f29a9d6a5948 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '94e35cb6c64c42269950dc290cede909'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:22.637317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9730bc38-a7b8-41cc-ab93-f29a9d6a5948 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '94e35cb6c64c42269950dc290cede909'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:22.731918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9730bc38-a7b8-41cc-ab93-f29a9d6a5948 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '94e35cb6c64c42269950dc290cede909'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:22.733136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9730bc38-a7b8-41cc-ab93-f29a9d6a5948 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '94e35cb6c64c42269950dc290cede909'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:22.736067 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3651/7313] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:49:22 2022] PATCH /identity/v3/domains/94e35cb6c64c42269950dc290cede909 => generated 277 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:49:22.740638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed335d-5673-49eb-812e-0e4aceb0a691 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:22.753515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed335d-5673-49eb-812e-0e4aceb0a691 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:22.826165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108193d2-2b40-4667-ae91-ec3a3ec1b323 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:22.827058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108193d2-2b40-4667-ae91-ec3a3ec1b323 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:22.827345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108193d2-2b40-4667-ae91-ec3a3ec1b323 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:22.827626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108193d2-2b40-4667-ae91-ec3a3ec1b323 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains/94e35cb6c64c42269950dc290cede909` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:22.855415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108193d2-2b40-4667-ae91-ec3a3ec1b323 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=94e35cb6c64c42269950dc290cede909)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:22.858675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108193d2-2b40-4667-ae91-ec3a3ec1b323 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:22.908553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-108193d2-2b40-4667-ae91-ec3a3ec1b323 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '94e35cb6c64c42269950dc290cede909'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:22.913241 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-108193d2-2b40-4667-ae91-ec3a3ec1b323 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '94e35cb6c64c42269950dc290cede909'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:23.048429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-108193d2-2b40-4667-ae91-ec3a3ec1b323 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e35cb6c64c42269950dc290cede909', 'request_id': 'req-108193d2-2b40-4667-ae91-ec3a3ec1b323'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:23.110208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-108193d2-2b40-4667-ae91-ec3a3ec1b323 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e35cb6c64c42269950dc290cede909', 'request_id': 'req-108193d2-2b40-4667-ae91-ec3a3ec1b323'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:23.118036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-108193d2-2b40-4667-ae91-ec3a3ec1b323 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e35cb6c64c42269950dc290cede909', 'request_id': 'req-108193d2-2b40-4667-ae91-ec3a3ec1b323'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:23.140877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-108193d2-2b40-4667-ae91-ec3a3ec1b323 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] The token cache is being invalidate because project 94e35cb6c64c42269950dc290cede909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:23.140877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-108193d2-2b40-4667-ae91-ec3a3ec1b323 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:23.140877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-108193d2-2b40-4667-ae91-ec3a3ec1b323 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:23.146501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-108193d2-2b40-4667-ae91-ec3a3ec1b323 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '94e35cb6c64c42269950dc290cede909', 'request_id': 'req-108193d2-2b40-4667-ae91-ec3a3ec1b323'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:23.147483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-108193d2-2b40-4667-ae91-ec3a3ec1b323 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '94e35cb6c64c42269950dc290cede909', 'request_id': 'req-108193d2-2b40-4667-ae91-ec3a3ec1b323'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:23.160296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-108193d2-2b40-4667-ae91-ec3a3ec1b323 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '94e35cb6c64c42269950dc290cede909', 'request_id': 'req-108193d2-2b40-4667-ae91-ec3a3ec1b323'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:23.167084 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3663/7314] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:49:22 2022] DELETE /identity/v3/domains/94e35cb6c64c42269950dc290cede909 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:23.171195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730bc38-a7b8-41cc-ab93-f29a9d6a5948 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:23.174111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9730bc38-a7b8-41cc-ab93-f29a9d6a5948 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:23.213158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730bc38-a7b8-41cc-ab93-f29a9d6a5948 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:23.307295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0cdac-fa3b-47b4-a351-dca355b98dc5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:23.309884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0cdac-fa3b-47b4-a351-dca355b98dc5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:23.310395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0cdac-fa3b-47b4-a351-dca355b98dc5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:23.310863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0cdac-fa3b-47b4-a351-dca355b98dc5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains/f59e892b469c4017bb9193a57eecc459/users/2966dcef3f4d4b0981a2523db5e90afd/roles/fbcd8ad9fabb472399d00f1fff0829df` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:23.315208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0cdac-fa3b-47b4-a351-dca355b98dc5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f59e892b469c4017bb9193a57eecc459, user_id=2966dcef3f4d4b0981a2523db5e90afd, role_id=fbcd8ad9fabb472399d00f1fff0829df)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:23.318467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0cdac-fa3b-47b4-a351-dca355b98dc5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:23.326676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-20d0cdac-fa3b-47b4-a351-dca355b98dc5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invalidating the token cache because role fbcd8ad9fabb472399d00f1fff0829df was removed from user 2966dcef3f4d4b0981a2523db5e90afd on domain f59e892b469c4017bb9193a57eecc459. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:23.330116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-20d0cdac-fa3b-47b4-a351-dca355b98dc5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:23.330116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-20d0cdac-fa3b-47b4-a351-dca355b98dc5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:23.429753 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3652/7315] 10.222.0.16 () {58 vars in 1463 bytes} [Mon May 2 10:49:23 2022] DELETE /identity/v3/domains/f59e892b469c4017bb9193a57eecc459/users/2966dcef3f4d4b0981a2523db5e90afd/roles/fbcd8ad9fabb472399d00f1fff0829df => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:23.430736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108193d2-2b40-4667-ae91-ec3a3ec1b323 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:23.433741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-108193d2-2b40-4667-ae91-ec3a3ec1b323 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:23.451285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108193d2-2b40-4667-ae91-ec3a3ec1b323 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:23.486042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec1cf3-de11-4b58-b5e8-950e1e0d858c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:23.487870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec1cf3-de11-4b58-b5e8-950e1e0d858c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:23.488511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec1cf3-de11-4b58-b5e8-950e1e0d858c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:23.526226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-93ec1cf3-de11-4b58-b5e8-950e1e0d858c None None] MFA Rules not processed for user `e88accb1ff214b8eb38aed45f99dacb6`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:23.527625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-93ec1cf3-de11-4b58-b5e8-950e1e0d858c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:23.551923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534a5ed-fe1b-4d76-98d1-eb9ceeff3eb4 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:23.553336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534a5ed-fe1b-4d76-98d1-eb9ceeff3eb4 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:23.553927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534a5ed-fe1b-4d76-98d1-eb9ceeff3eb4 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:23.554406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534a5ed-fe1b-4d76-98d1-eb9ceeff3eb4 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/roles/fbcd8ad9fabb472399d00f1fff0829df` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:23.556343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534a5ed-fe1b-4d76-98d1-eb9ceeff3eb4 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fbcd8ad9fabb472399d00f1fff0829df)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:23.558193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534a5ed-fe1b-4d76-98d1-eb9ceeff3eb4 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:23.621018 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3653/7316] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:49:23.639682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec1cf3-de11-4b58-b5e8-950e1e0d858c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:23.643800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-93ec1cf3-de11-4b58-b5e8-950e1e0d858c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:23.668489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3534a5ed-fe1b-4d76-98d1-eb9ceeff3eb4 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invalidating the token cache because role fbcd8ad9fabb472399d00f1fff0829df has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:23.668489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3534a5ed-fe1b-4d76-98d1-eb9ceeff3eb4 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:23.668489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3534a5ed-fe1b-4d76-98d1-eb9ceeff3eb4 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:23.668897 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3664/7317] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:49:23 2022] DELETE /identity/v3/roles/fbcd8ad9fabb472399d00f1fff0829df => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:23.673139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534a5ed-fe1b-4d76-98d1-eb9ceeff3eb4 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:23.674746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3534a5ed-fe1b-4d76-98d1-eb9ceeff3eb4 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:23.739355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec1cf3-de11-4b58-b5e8-950e1e0d858c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:23.746025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534a5ed-fe1b-4d76-98d1-eb9ceeff3eb4 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:23.751539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a99a9-d294-482b-a0a8-a33bb1255e36 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:23.752439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a99a9-d294-482b-a0a8-a33bb1255e36 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:23.752941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a99a9-d294-482b-a0a8-a33bb1255e36 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:23.753246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a99a9-d294-482b-a0a8-a33bb1255e36 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains/f59e892b469c4017bb9193a57eecc459` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:23.754895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a99a9-d294-482b-a0a8-a33bb1255e36 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f59e892b469c4017bb9193a57eecc459)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:23.756542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a99a9-d294-482b-a0a8-a33bb1255e36 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:23.780869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fb7a99a9-d294-482b-a0a8-a33bb1255e36 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f59e892b469c4017bb9193a57eecc459'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:23.787718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fb7a99a9-d294-482b-a0a8-a33bb1255e36 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f59e892b469c4017bb9193a57eecc459'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:23.815930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c5ffc-979f-4ddd-bf3d-f542f678adff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:23.816946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c5ffc-979f-4ddd-bf3d-f542f678adff service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:23.817317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c5ffc-979f-4ddd-bf3d-f542f678adff service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:23.817675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c5ffc-979f-4ddd-bf3d-f542f678adff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:23.819548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e36c5ffc-979f-4ddd-bf3d-f542f678adff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:23.875734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fb7a99a9-d294-482b-a0a8-a33bb1255e36 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f59e892b469c4017bb9193a57eecc459'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:23.876372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-fb7a99a9-d294-482b-a0a8-a33bb1255e36 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f59e892b469c4017bb9193a57eecc459'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:23.885268 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3665/7318] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:49:23 2022] PATCH /identity/v3/domains/f59e892b469c4017bb9193a57eecc459 => generated 276 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:49:23.885268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a99a9-d294-482b-a0a8-a33bb1255e36 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:23.888188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fb7a99a9-d294-482b-a0a8-a33bb1255e36 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:23.930404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c5ffc-979f-4ddd-bf3d-f542f678adff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:23.932278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c5ffc-979f-4ddd-bf3d-f542f678adff service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:23.952802 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3654/7319] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:49:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:49:23.987680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a99a9-d294-482b-a0a8-a33bb1255e36 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:24.001770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74f400-9e14-401a-a789-7545ee783934 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:24.003640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74f400-9e14-401a-a789-7545ee783934 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:24.011232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74f400-9e14-401a-a789-7545ee783934 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:24.011622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74f400-9e14-401a-a789-7545ee783934 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains/f59e892b469c4017bb9193a57eecc459` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:24.027208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74f400-9e14-401a-a789-7545ee783934 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f59e892b469c4017bb9193a57eecc459)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:24.029079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74f400-9e14-401a-a789-7545ee783934 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:24.052111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-db74f400-9e14-401a-a789-7545ee783934 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f59e892b469c4017bb9193a57eecc459'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:24.055796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-db74f400-9e14-401a-a789-7545ee783934 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f59e892b469c4017bb9193a57eecc459'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:24.182912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-db74f400-9e14-401a-a789-7545ee783934 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f59e892b469c4017bb9193a57eecc459', 'request_id': 'req-db74f400-9e14-401a-a789-7545ee783934'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:24.245093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-db74f400-9e14-401a-a789-7545ee783934 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f59e892b469c4017bb9193a57eecc459', 'request_id': 'req-db74f400-9e14-401a-a789-7545ee783934'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:24.253022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-db74f400-9e14-401a-a789-7545ee783934 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f59e892b469c4017bb9193a57eecc459', 'request_id': 'req-db74f400-9e14-401a-a789-7545ee783934'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:24.263784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-db74f400-9e14-401a-a789-7545ee783934 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] The token cache is being invalidate because project f59e892b469c4017bb9193a57eecc459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:24.264084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-db74f400-9e14-401a-a789-7545ee783934 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:24.264790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-db74f400-9e14-401a-a789-7545ee783934 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:24.272359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-db74f400-9e14-401a-a789-7545ee783934 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f59e892b469c4017bb9193a57eecc459', 'request_id': 'req-db74f400-9e14-401a-a789-7545ee783934'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:24.273515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-db74f400-9e14-401a-a789-7545ee783934 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f59e892b469c4017bb9193a57eecc459', 'request_id': 'req-db74f400-9e14-401a-a789-7545ee783934'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:24.276791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-db74f400-9e14-401a-a789-7545ee783934 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f59e892b469c4017bb9193a57eecc459', 'request_id': 'req-db74f400-9e14-401a-a789-7545ee783934'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:24.282692 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3666/7320] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:49:23 2022] DELETE /identity/v3/domains/f59e892b469c4017bb9193a57eecc459 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:24.294230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c5ffc-979f-4ddd-bf3d-f542f678adff service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:24.295758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e36c5ffc-979f-4ddd-bf3d-f542f678adff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:24.309741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c5ffc-979f-4ddd-bf3d-f542f678adff service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:24.364866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a09a3-b435-493d-9395-2c14f2903924 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:24.365655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a09a3-b435-493d-9395-2c14f2903924 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:24.365942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a09a3-b435-493d-9395-2c14f2903924 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:24.366222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a09a3-b435-493d-9395-2c14f2903924 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:24.366942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a09a3-b435-493d-9395-2c14f2903924 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:24.369907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a09a3-b435-493d-9395-2c14f2903924 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:24.381734 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3655/7321] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:49:24.385836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74f400-9e14-401a-a789-7545ee783934 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:24.387228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-db74f400-9e14-401a-a789-7545ee783934 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:24.389572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a09a3-b435-493d-9395-2c14f2903924 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:24.392744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-dd0a09a3-b435-493d-9395-2c14f2903924 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:24.402594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74f400-9e14-401a-a789-7545ee783934 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:24.407410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b6906-95d8-47ee-9655-f46c7b9c95a1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:24.408304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b6906-95d8-47ee-9655-f46c7b9c95a1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:24.408595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b6906-95d8-47ee-9655-f46c7b9c95a1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:24.408997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b6906-95d8-47ee-9655-f46c7b9c95a1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/projects/daa310593c854e8f90aa5b1302dcbdda/users/15d9247cd5b1442eb09f7618c0156f45/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:24.411028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b6906-95d8-47ee-9655-f46c7b9c95a1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:create_grant(project_id=daa310593c854e8f90aa5b1302dcbdda, user_id=15d9247cd5b1442eb09f7618c0156f45, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:24.413728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b6906-95d8-47ee-9655-f46c7b9c95a1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:24.463026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a09a3-b435-493d-9395-2c14f2903924 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:24.468049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2ab29-26b2-4b6c-847d-765a0e4bd4f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:24.468735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2ab29-26b2-4b6c-847d-765a0e4bd4f7 service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:24.469534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2ab29-26b2-4b6c-847d-765a0e4bd4f7 service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:24.469816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2ab29-26b2-4b6c-847d-765a0e4bd4f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:24.471651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-daf2ab29-26b2-4b6c-847d-765a0e4bd4f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:24.485521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2ab29-26b2-4b6c-847d-765a0e4bd4f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:24.487117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2ab29-26b2-4b6c-847d-765a0e4bd4f7 service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:24.496722 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3667/7322] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:24 2022] PUT /identity/v3/projects/daa310593c854e8f90aa5b1302dcbdda/users/15d9247cd5b1442eb09f7618c0156f45/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:24.498871 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3656/7323] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:49:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:49:24.500771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b6906-95d8-47ee-9655-f46c7b9c95a1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:24.568329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b6906-95d8-47ee-9655-f46c7b9c95a1 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:24.573253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f264c0-247a-45b6-b0d9-62f34d774643 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:24.573908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f264c0-247a-45b6-b0d9-62f34d774643 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:24.574214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f264c0-247a-45b6-b0d9-62f34d774643 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:24.574485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f264c0-247a-45b6-b0d9-62f34d774643 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:24.575128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f264c0-247a-45b6-b0d9-62f34d774643 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:24.576213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f264c0-247a-45b6-b0d9-62f34d774643 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:24.617125 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3668/7324] 10.222.0.16 () {58 vars in 1145 bytes} [Mon May 2 10:49:24 2022] GET /identity/v3/auth/projects => generated 826 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:49:24.621487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2ab29-26b2-4b6c-847d-765a0e4bd4f7 service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:24.632587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2ab29-26b2-4b6c-847d-765a0e4bd4f7 service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:24.637295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102a89a-d7f0-4ba3-a640-99763fcc1763 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:24.638267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102a89a-d7f0-4ba3-a640-99763fcc1763 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:24.638563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102a89a-d7f0-4ba3-a640-99763fcc1763 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:24.638837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102a89a-d7f0-4ba3-a640-99763fcc1763 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/projects/daa310593c854e8f90aa5b1302dcbdda/users/15d9247cd5b1442eb09f7618c0156f45/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:24.641526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102a89a-d7f0-4ba3-a640-99763fcc1763 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=daa310593c854e8f90aa5b1302dcbdda, user_id=15d9247cd5b1442eb09f7618c0156f45, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:24.644293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102a89a-d7f0-4ba3-a640-99763fcc1763 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:24.649881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d102a89a-d7f0-4ba3-a640-99763fcc1763 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invalidating the token cache because role dd8a47ade22941849ebdf8fbdf994b66 was removed from user 15d9247cd5b1442eb09f7618c0156f45 on project daa310593c854e8f90aa5b1302dcbdda. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:24.650176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d102a89a-d7f0-4ba3-a640-99763fcc1763 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:24.650977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d102a89a-d7f0-4ba3-a640-99763fcc1763 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:24.743231 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3657/7325] 10.222.0.16 () {58 vars in 1466 bytes} [Mon May 2 10:49:24 2022] DELETE /identity/v3/projects/daa310593c854e8f90aa5b1302dcbdda/users/15d9247cd5b1442eb09f7618c0156f45/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:24.748673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f264c0-247a-45b6-b0d9-62f34d774643 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:24.750922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d5f264c0-247a-45b6-b0d9-62f34d774643 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:24.764191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f264c0-247a-45b6-b0d9-62f34d774643 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:24.825941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89572f6a-7071-4f94-acdf-b0c2978ed85f tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:24.826735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89572f6a-7071-4f94-acdf-b0c2978ed85f tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:24.827209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89572f6a-7071-4f94-acdf-b0c2978ed85f tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:24.827587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89572f6a-7071-4f94-acdf-b0c2978ed85f tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:24.828815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89572f6a-7071-4f94-acdf-b0c2978ed85f tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:24.830725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89572f6a-7071-4f94-acdf-b0c2978ed85f tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:24.915412 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3669/7326] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:49:24 2022] POST /identity/v3/users => generated 321 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:49:24.919169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102a89a-d7f0-4ba3-a640-99763fcc1763 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:24.929998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102a89a-d7f0-4ba3-a640-99763fcc1763 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:24.935469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742299e-4c06-4bbf-82fd-84390a648a7d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:24.935721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742299e-4c06-4bbf-82fd-84390a648a7d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:24.936106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742299e-4c06-4bbf-82fd-84390a648a7d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:24.936515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742299e-4c06-4bbf-82fd-84390a648a7d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:24.937346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742299e-4c06-4bbf-82fd-84390a648a7d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:24.939404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742299e-4c06-4bbf-82fd-84390a648a7d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:25.039125 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3658/7327] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:49:24 2022] POST /identity/v3/projects => generated 363 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:25.045630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89572f6a-7071-4f94-acdf-b0c2978ed85f tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:25.065632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89572f6a-7071-4f94-acdf-b0c2978ed85f tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:25.068323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742299e-4c06-4bbf-82fd-84390a648a7d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:25.070980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1742299e-4c06-4bbf-82fd-84390a648a7d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:25.159287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e4eee-d98d-4eb4-ae8e-3b65ec4c5129 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:25.159974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e4eee-d98d-4eb4-ae8e-3b65ec4c5129 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:25.160438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e4eee-d98d-4eb4-ae8e-3b65ec4c5129 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:25.160873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e4eee-d98d-4eb4-ae8e-3b65ec4c5129 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:25.161578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e4eee-d98d-4eb4-ae8e-3b65ec4c5129 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:25.163720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e4eee-d98d-4eb4-ae8e-3b65ec4c5129 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:25.183257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742299e-4c06-4bbf-82fd-84390a648a7d tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:25.190117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38589977-eea5-4e61-9397-0d13a7295275 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:25.190869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38589977-eea5-4e61-9397-0d13a7295275 service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:25.191224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38589977-eea5-4e61-9397-0d13a7295275 service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:25.191604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38589977-eea5-4e61-9397-0d13a7295275 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:25.193690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-38589977-eea5-4e61-9397-0d13a7295275 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:25.211273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38589977-eea5-4e61-9397-0d13a7295275 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:25.213153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38589977-eea5-4e61-9397-0d13a7295275 service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:25.227884 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3659/7328] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:49:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:49:25.261164 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3670/7329] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:49:25 2022] POST /identity/v3/projects => generated 363 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:25.264754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38589977-eea5-4e61-9397-0d13a7295275 service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:25.280879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38589977-eea5-4e61-9397-0d13a7295275 service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:25.354512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b54985-5f61-4709-9865-630fbe66d17b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:25.355197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b54985-5f61-4709-9865-630fbe66d17b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:25.355483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b54985-5f61-4709-9865-630fbe66d17b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:25.355762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b54985-5f61-4709-9865-630fbe66d17b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:25.356901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b54985-5f61-4709-9865-630fbe66d17b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:25.358354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b54985-5f61-4709-9865-630fbe66d17b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:25.447803 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3660/7330] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:49:25 2022] POST /identity/v3/roles => generated 240 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:25.451945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e4eee-d98d-4eb4-ae8e-3b65ec4c5129 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:25.471022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e4eee-d98d-4eb4-ae8e-3b65ec4c5129 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:25.492777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec023f36-fc61-4adc-8855-de93f5ba41b9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:25.494149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec023f36-fc61-4adc-8855-de93f5ba41b9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:25.494654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec023f36-fc61-4adc-8855-de93f5ba41b9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:25.495149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec023f36-fc61-4adc-8855-de93f5ba41b9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/projects/bd8a51af83e24c9781a3d124647bc0cf/users/fcfcf66fde204901813d07a931e74626/roles/5f6ee24df5974575b2da92c92490264d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:25.521390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec023f36-fc61-4adc-8855-de93f5ba41b9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:create_grant(project_id=bd8a51af83e24c9781a3d124647bc0cf, user_id=fcfcf66fde204901813d07a931e74626, role_id=5f6ee24df5974575b2da92c92490264d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:25.524174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec023f36-fc61-4adc-8855-de93f5ba41b9 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:25.601536 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3671/7331] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:25 2022] PUT /identity/v3/projects/bd8a51af83e24c9781a3d124647bc0cf/users/fcfcf66fde204901813d07a931e74626/roles/5f6ee24df5974575b2da92c92490264d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:25.605812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b54985-5f61-4709-9865-630fbe66d17b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:25.616652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b54985-5f61-4709-9865-630fbe66d17b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:25.671417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10625eb3-5566-4062-91f4-f2e680fb0902 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:25.672867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10625eb3-5566-4062-91f4-f2e680fb0902 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:25.673151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10625eb3-5566-4062-91f4-f2e680fb0902 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:25.673427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10625eb3-5566-4062-91f4-f2e680fb0902 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/projects/d637a60db0784bce9bd8ffc44a6211bb/users/fcfcf66fde204901813d07a931e74626/roles/5f6ee24df5974575b2da92c92490264d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:25.675690 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10625eb3-5566-4062-91f4-f2e680fb0902 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d637a60db0784bce9bd8ffc44a6211bb, user_id=fcfcf66fde204901813d07a931e74626, role_id=5f6ee24df5974575b2da92c92490264d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:25.678385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10625eb3-5566-4062-91f4-f2e680fb0902 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:25.748411 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3661/7332] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:25 2022] PUT /identity/v3/projects/d637a60db0784bce9bd8ffc44a6211bb/users/fcfcf66fde204901813d07a931e74626/roles/5f6ee24df5974575b2da92c92490264d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:25.753574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d20ed-7380-4260-888a-44af1317c00c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:25.753871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d20ed-7380-4260-888a-44af1317c00c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:25.754416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d20ed-7380-4260-888a-44af1317c00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:25.780746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-168d20ed-7380-4260-888a-44af1317c00c None None] MFA Rules not processed for user `fcfcf66fde204901813d07a931e74626`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:25.781961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-168d20ed-7380-4260-888a-44af1317c00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:25.785541 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3672/7333] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:25 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 10:49:25.793869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b4bda-14f1-491d-a927-b895b9dd8f88 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:25.794065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b4bda-14f1-491d-a927-b895b9dd8f88 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:25.794360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b4bda-14f1-491d-a927-b895b9dd8f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:25.805149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-834b4bda-14f1-491d-a927-b895b9dd8f88 None None] MFA Rules not processed for user `fcfcf66fde204901813d07a931e74626`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:25.808032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-834b4bda-14f1-491d-a927-b895b9dd8f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:25.876930 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3662/7334] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:25 2022] POST /identity/v3/auth/tokens => generated 3215 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) May 02 10:49:25.881486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d20ed-7380-4260-888a-44af1317c00c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:25.957655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d20ed-7380-4260-888a-44af1317c00c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:25.963386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658aeb5b-422f-4755-81d2-77092ecca4d5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:25.963847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658aeb5b-422f-4755-81d2-77092ecca4d5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:25.964142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658aeb5b-422f-4755-81d2-77092ecca4d5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:25.964428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658aeb5b-422f-4755-81d2-77092ecca4d5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:25.980349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658aeb5b-422f-4755-81d2-77092ecca4d5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:25.982392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658aeb5b-422f-4755-81d2-77092ecca4d5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:26.122137 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3673/7335] 10.222.0.16 () {56 vars in 1307 bytes} [Mon May 2 10:49:25 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:26.127352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d182890-16b4-40cd-9d16-7a0e552304c6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:26.127649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d182890-16b4-40cd-9d16-7a0e552304c6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:26.127933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d182890-16b4-40cd-9d16-7a0e552304c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:26.137853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3d182890-16b4-40cd-9d16-7a0e552304c6 None None] MFA Rules not processed for user `fcfcf66fde204901813d07a931e74626`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:26.139030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3d182890-16b4-40cd-9d16-7a0e552304c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:26.200953 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3663/7336] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:26 2022] POST /identity/v3/auth/tokens => generated 3214 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) May 02 10:49:26.206062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658aeb5b-422f-4755-81d2-77092ecca4d5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:26.215668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658aeb5b-422f-4755-81d2-77092ecca4d5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:26.221140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cddcb6-a029-4d64-ae04-c6a868e062fc tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:26.222003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cddcb6-a029-4d64-ae04-c6a868e062fc tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:26.222295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cddcb6-a029-4d64-ae04-c6a868e062fc tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:26.222609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cddcb6-a029-4d64-ae04-c6a868e062fc tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/roles/5f6ee24df5974575b2da92c92490264d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:26.224170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cddcb6-a029-4d64-ae04-c6a868e062fc tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5f6ee24df5974575b2da92c92490264d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:26.225808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cddcb6-a029-4d64-ae04-c6a868e062fc tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:26.383801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c4cddcb6-a029-4d64-ae04-c6a868e062fc tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invalidating the token cache because role 5f6ee24df5974575b2da92c92490264d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:26.384350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c4cddcb6-a029-4d64-ae04-c6a868e062fc tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:26.385357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c4cddcb6-a029-4d64-ae04-c6a868e062fc tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:26.388422 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3674/7337] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:49:26 2022] DELETE /identity/v3/roles/5f6ee24df5974575b2da92c92490264d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:26.391745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d182890-16b4-40cd-9d16-7a0e552304c6 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:26.403899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d182890-16b4-40cd-9d16-7a0e552304c6 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:26.463790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2c274-7c24-4637-9735-aaf16fa3110b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:26.464701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2c274-7c24-4637-9735-aaf16fa3110b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:26.464977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2c274-7c24-4637-9735-aaf16fa3110b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:26.465252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2c274-7c24-4637-9735-aaf16fa3110b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/projects/d637a60db0784bce9bd8ffc44a6211bb` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:26.466455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2c274-7c24-4637-9735-aaf16fa3110b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d637a60db0784bce9bd8ffc44a6211bb)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:26.468417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2c274-7c24-4637-9735-aaf16fa3110b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:26.596225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fac2c274-7c24-4637-9735-aaf16fa3110b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd637a60db0784bce9bd8ffc44a6211bb', 'request_id': 'req-fac2c274-7c24-4637-9735-aaf16fa3110b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:26.602712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fac2c274-7c24-4637-9735-aaf16fa3110b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd637a60db0784bce9bd8ffc44a6211bb', 'request_id': 'req-fac2c274-7c24-4637-9735-aaf16fa3110b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:26.686790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fac2c274-7c24-4637-9735-aaf16fa3110b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd637a60db0784bce9bd8ffc44a6211bb', 'request_id': 'req-fac2c274-7c24-4637-9735-aaf16fa3110b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:26.702931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fac2c274-7c24-4637-9735-aaf16fa3110b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] The token cache is being invalidate because project d637a60db0784bce9bd8ffc44a6211bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:26.704441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fac2c274-7c24-4637-9735-aaf16fa3110b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:26.705184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fac2c274-7c24-4637-9735-aaf16fa3110b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:26.711327 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3664/7338] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:26 2022] DELETE /identity/v3/projects/d637a60db0784bce9bd8ffc44a6211bb => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:49:26.712403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cddcb6-a029-4d64-ae04-c6a868e062fc tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:26.713808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c4cddcb6-a029-4d64-ae04-c6a868e062fc tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:26.738520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cddcb6-a029-4d64-ae04-c6a868e062fc tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:26.821533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a1635-1650-4204-bc46-b3ab2e9710ec tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:26.822416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a1635-1650-4204-bc46-b3ab2e9710ec tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:26.822855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a1635-1650-4204-bc46-b3ab2e9710ec tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:26.824021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a1635-1650-4204-bc46-b3ab2e9710ec tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/projects/d637a60db0784bce9bd8ffc44a6211bb` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:26.836626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a1635-1650-4204-bc46-b3ab2e9710ec tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d637a60db0784bce9bd8ffc44a6211bb)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:26.851722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a1635-1650-4204-bc46-b3ab2e9710ec tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:26.891718 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-ca6a1635-1650-4204-bc46-b3ab2e9710ec tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Could not find project: d637a60db0784bce9bd8ffc44a6211bb.: keystone.exception.ProjectNotFound: Could not find project: d637a60db0784bce9bd8ffc44a6211bb. May 02 10:49:26.891718 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:49:26.891718 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:49:26.891718 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:49:26.891718 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:49:26.891718 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:49:26.891718 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:49:26.891718 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:49:26.891718 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:49:26.891718 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:49:26.891718 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:49:26.891718 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:49:26.891718 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete May 02 10:49:26.891718 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( May 02 10:49:26.892949 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:49:26.892949 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:49:26.892949 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project May 02 10:49:26.892949 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) May 02 10:49:26.892949 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:49:26.892949 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:49:26.892949 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:49:26.892949 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:49:26.892949 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d637a60db0784bce9bd8ffc44a6211bb. May 02 10:49:26.892949 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:49:26.907992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2c274-7c24-4637-9735-aaf16fa3110b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:26.909532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fac2c274-7c24-4637-9735-aaf16fa3110b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:26.911989 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3675/7339] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:26 2022] DELETE /identity/v3/projects/d637a60db0784bce9bd8ffc44a6211bb => generated 113 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 02 10:49:26.931704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2c274-7c24-4637-9735-aaf16fa3110b tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:26.938157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32dede-e792-4aca-b4e1-0f44cd9f83b7 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:26.939570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32dede-e792-4aca-b4e1-0f44cd9f83b7 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:26.939570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32dede-e792-4aca-b4e1-0f44cd9f83b7 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:26.940154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32dede-e792-4aca-b4e1-0f44cd9f83b7 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/projects/bd8a51af83e24c9781a3d124647bc0cf` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:26.941517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32dede-e792-4aca-b4e1-0f44cd9f83b7 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bd8a51af83e24c9781a3d124647bc0cf)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:26.943629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32dede-e792-4aca-b4e1-0f44cd9f83b7 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:27.100816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3a32dede-e792-4aca-b4e1-0f44cd9f83b7 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8a51af83e24c9781a3d124647bc0cf', 'request_id': 'req-3a32dede-e792-4aca-b4e1-0f44cd9f83b7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:27.117321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3a32dede-e792-4aca-b4e1-0f44cd9f83b7 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8a51af83e24c9781a3d124647bc0cf', 'request_id': 'req-3a32dede-e792-4aca-b4e1-0f44cd9f83b7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:27.195890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3a32dede-e792-4aca-b4e1-0f44cd9f83b7 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8a51af83e24c9781a3d124647bc0cf', 'request_id': 'req-3a32dede-e792-4aca-b4e1-0f44cd9f83b7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:27.221947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3a32dede-e792-4aca-b4e1-0f44cd9f83b7 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] The token cache is being invalidate because project bd8a51af83e24c9781a3d124647bc0cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:27.227184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3a32dede-e792-4aca-b4e1-0f44cd9f83b7 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:27.238427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3a32dede-e792-4aca-b4e1-0f44cd9f83b7 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:27.256121 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3665/7340] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:26 2022] DELETE /identity/v3/projects/bd8a51af83e24c9781a3d124647bc0cf => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:27.258825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a1635-1650-4204-bc46-b3ab2e9710ec tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:27.260577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ca6a1635-1650-4204-bc46-b3ab2e9710ec tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:27.274480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a1635-1650-4204-bc46-b3ab2e9710ec tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:27.336334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb71650-b021-45c0-9faa-81e04b4759a5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:27.337382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb71650-b021-45c0-9faa-81e04b4759a5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:27.337747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb71650-b021-45c0-9faa-81e04b4759a5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:27.338111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb71650-b021-45c0-9faa-81e04b4759a5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/users/fcfcf66fde204901813d07a931e74626` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:27.339500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb71650-b021-45c0-9faa-81e04b4759a5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fcfcf66fde204901813d07a931e74626)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:27.341431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb71650-b021-45c0-9faa-81e04b4759a5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:27.485571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7cb71650-b021-45c0-9faa-81e04b4759a5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcfcf66fde204901813d07a931e74626'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:27.499601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7cb71650-b021-45c0-9faa-81e04b4759a5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcfcf66fde204901813d07a931e74626'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:27.500790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7cb71650-b021-45c0-9faa-81e04b4759a5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcfcf66fde204901813d07a931e74626'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:27.509504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7cb71650-b021-45c0-9faa-81e04b4759a5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcfcf66fde204901813d07a931e74626'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:27.600883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7cb71650-b021-45c0-9faa-81e04b4759a5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcfcf66fde204901813d07a931e74626'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:27.607675 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3676/7341] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:49:27 2022] DELETE /identity/v3/users/fcfcf66fde204901813d07a931e74626 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:27.614066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32dede-e792-4aca-b4e1-0f44cd9f83b7 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:27.630800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32dede-e792-4aca-b4e1-0f44cd9f83b7 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:27.711432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6cf598-0e65-41a0-817f-cfe3b749ab73 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:27.712332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cf598-0e65-41a0-817f-cfe3b749ab73 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:27.712647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cf598-0e65-41a0-817f-cfe3b749ab73 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:27.712924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cf598-0e65-41a0-817f-cfe3b749ab73 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains/bea4f508f5fd4b22a91939eb90579e9b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:27.721796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6cf598-0e65-41a0-817f-cfe3b749ab73 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:49:27.733660 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-7e6cf598-0e65-41a0-817f-cfe3b749ab73 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Could not find domain: bea4f508f5fd4b22a91939eb90579e9b.: keystone.exception.DomainNotFound: Could not find domain: bea4f508f5fd4b22a91939eb90579e9b. May 02 10:49:27.733660 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:49:27.733660 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 02 10:49:27.733660 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 02 10:49:27.733660 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:49:27.733660 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:49:27.733660 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:49:27.733660 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:49:27.733660 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: bea4f508f5fd4b22a91939eb90579e9b. May 02 10:49:27.733660 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:27.733660 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:49:27.733660 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:27.733660 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:49:27.733660 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:49:27.733660 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:49:27.733660 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:49:27.735557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:49:27.735557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:49:27.735557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:49:27.735557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:49:27.735557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:49:27.735557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:49:27.735557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:49:27.735557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 02 10:49:27.735557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 02 10:49:27.735557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:49:27.735557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:49:27.735557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:49:27.735557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:49:27.735557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:49:27.735557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:49:27.735557 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:49:27.737260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:49:27.737260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:49:27.737260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:49:27.737260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:49:27.737260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:49:27.737260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:49:27.737260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:49:27.737260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:49:27.737260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:49:27.737260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:49:27.737260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:49:27.737260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:49:27.737260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:49:27.737260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 02 10:49:27.737260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:49:27.737260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: bea4f508f5fd4b22a91939eb90579e9b. May 02 10:49:27.737260 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:27.738738 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3666/7342] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:49:27 2022] PATCH /identity/v3/domains/bea4f508f5fd4b22a91939eb90579e9b => generated 112 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:49:27.741163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb71650-b021-45c0-9faa-81e04b4759a5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:27.742814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7cb71650-b021-45c0-9faa-81e04b4759a5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:27.780382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb71650-b021-45c0-9faa-81e04b4759a5 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:27.800129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b013fb-10ba-4419-bb43-cff9efb5c754 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:27.805002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b013fb-10ba-4419-bb43-cff9efb5c754 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:27.806411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b013fb-10ba-4419-bb43-cff9efb5c754 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:27.806935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b013fb-10ba-4419-bb43-cff9efb5c754 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains/ea6ac01ccebb476ba982938379e2577b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:27.819956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b013fb-10ba-4419-bb43-cff9efb5c754 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:49:27.834204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-13b013fb-10ba-4419-bb43-cff9efb5c754 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Could not find domain: ea6ac01ccebb476ba982938379e2577b.: keystone.exception.DomainNotFound: Could not find domain: ea6ac01ccebb476ba982938379e2577b. May 02 10:49:27.834204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:49:27.834204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 02 10:49:27.834204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 02 10:49:27.834204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:49:27.834204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:49:27.834204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:49:27.834204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:49:27.834204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ea6ac01ccebb476ba982938379e2577b. May 02 10:49:27.834204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:49:27.834204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:49:27.834204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:49:27.834204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:49:27.834204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:49:27.834204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:49:27.834204 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:49:27.835734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:49:27.835734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:49:27.835734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:49:27.835734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:49:27.835734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:49:27.835734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:49:27.835734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:49:27.835734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 02 10:49:27.835734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 02 10:49:27.835734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:49:27.835734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:49:27.835734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:49:27.835734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:49:27.835734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:49:27.835734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:49:27.835734 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:49:27.837119 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:49:27.837119 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:49:27.837119 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:49:27.837119 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:49:27.837119 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:49:27.837119 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:49:27.837119 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:49:27.837119 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:49:27.837119 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:49:27.837119 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:49:27.837119 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:49:27.837119 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:49:27.837119 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:49:27.837119 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 02 10:49:27.837119 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:49:27.837119 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ea6ac01ccebb476ba982938379e2577b. May 02 10:49:27.837119 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:49:27.842700 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3677/7343] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:49:27 2022] PATCH /identity/v3/domains/ea6ac01ccebb476ba982938379e2577b => generated 112 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:49:27.845473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6cf598-0e65-41a0-817f-cfe3b749ab73 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:27.865667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6cf598-0e65-41a0-817f-cfe3b749ab73 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:27.881185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55500cc-de6a-460a-93c0-378ef0561640 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:27.884014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55500cc-de6a-460a-93c0-378ef0561640 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:27.884014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55500cc-de6a-460a-93c0-378ef0561640 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:27.884014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55500cc-de6a-460a-93c0-378ef0561640 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains/94e35cb6c64c42269950dc290cede909` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:27.893215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55500cc-de6a-460a-93c0-378ef0561640 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:49:27.907228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-d55500cc-de6a-460a-93c0-378ef0561640 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Could not find domain: 94e35cb6c64c42269950dc290cede909.: keystone.exception.DomainNotFound: Could not find domain: 94e35cb6c64c42269950dc290cede909. May 02 10:49:27.907228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:49:27.907228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 02 10:49:27.907228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 02 10:49:27.907228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:49:27.907228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:49:27.907228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:49:27.907228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:49:27.907228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 94e35cb6c64c42269950dc290cede909. May 02 10:49:27.907228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:27.907228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:49:27.907228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:27.907228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:49:27.907228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:49:27.907228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:49:27.907228 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:49:27.914010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:49:27.914010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:49:27.914010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:49:27.914010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:49:27.914010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:49:27.914010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:49:27.914010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:49:27.914010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 02 10:49:27.914010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 02 10:49:27.914010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:49:27.914010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:49:27.914010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:49:27.914010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:49:27.914010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:49:27.914010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:49:27.914010 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:49:27.915865 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:49:27.915865 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:49:27.915865 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:49:27.915865 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:49:27.915865 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:49:27.915865 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:49:27.915865 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:49:27.915865 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:49:27.915865 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:49:27.915865 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:49:27.915865 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:49:27.915865 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:49:27.915865 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:49:27.915865 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 02 10:49:27.915865 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:49:27.915865 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 94e35cb6c64c42269950dc290cede909. May 02 10:49:27.915865 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:49:27.920324 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3667/7344] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:49:27 2022] PATCH /identity/v3/domains/94e35cb6c64c42269950dc290cede909 => generated 112 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 02 10:49:27.920450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b013fb-10ba-4419-bb43-cff9efb5c754 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:27.935469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b013fb-10ba-4419-bb43-cff9efb5c754 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:27.941801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e96e15-83aa-4882-b4c3-83258dbd7f48 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d9247cd5b1442eb09f7618c0156f45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0506bf8122224b85b3f36f04f29e1b78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:27.942085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e96e15-83aa-4882-b4c3-83258dbd7f48 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:27.942762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e96e15-83aa-4882-b4c3-83258dbd7f48 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:27.943160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e96e15-83aa-4882-b4c3-83258dbd7f48 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] PATH_INFO: `/v3/domains/f59e892b469c4017bb9193a57eecc459` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:27.953818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e96e15-83aa-4882-b4c3-83258dbd7f48 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 02 10:49:27.965964 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-07e96e15-83aa-4882-b4c3-83258dbd7f48 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Could not find domain: f59e892b469c4017bb9193a57eecc459.: keystone.exception.DomainNotFound: Could not find domain: f59e892b469c4017bb9193a57eecc459. May 02 10:49:27.965964 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:49:27.965964 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 02 10:49:27.965964 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 02 10:49:27.965964 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:49:27.965964 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:49:27.965964 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:49:27.965964 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:49:27.965964 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f59e892b469c4017bb9193a57eecc459. May 02 10:49:27.965964 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:49:27.965964 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:49:27.965964 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:49:27.965964 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:49:27.965964 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:49:27.965964 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:49:27.965964 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:49:27.970701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:49:27.970701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:49:27.970701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:49:27.970701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:49:27.970701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:49:27.970701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:49:27.970701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:49:27.970701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 02 10:49:27.970701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 02 10:49:27.970701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 02 10:49:27.970701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 02 10:49:27.970701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 02 10:49:27.970701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 02 10:49:27.970701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:49:27.970701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:49:27.970701 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:49:27.972157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:49:27.972157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:49:27.972157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:49:27.972157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:49:27.972157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application with Lock( May 02 10:49:27.972157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:49:27.972157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._enter() May 02 10:49:27.972157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:49:27.972157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:49:27.972157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:49:27.972157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.creator() May 02 10:49:27.972157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:49:27.972157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application created_value = creator( May 02 10:49:27.972157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 02 10:49:27.972157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 02 10:49:27.972157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f59e892b469c4017bb9193a57eecc459. May 02 10:49:27.972157 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:49:27.974681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55500cc-de6a-460a-93c0-378ef0561640 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:27.977098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d55500cc-de6a-460a-93c0-378ef0561640 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:27.979287 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3678/7345] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:49:27 2022] PATCH /identity/v3/domains/f59e892b469c4017bb9193a57eecc459 => generated 112 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 02 10:49:28.092254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55500cc-de6a-460a-93c0-378ef0561640 tempest-TokensV3TestJSON-1132595467 tempest-TokensV3TestJSON-1132595467-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:28.119998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924e9a4-1da9-4177-9cf0-f5770068eea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:28.123519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924e9a4-1da9-4177-9cf0-f5770068eea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:28.124319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924e9a4-1da9-4177-9cf0-f5770068eea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:28.124820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924e9a4-1da9-4177-9cf0-f5770068eea1 admin admin] PATH_INFO: `/v3/users/967368dba4664fb486b7e890375f8448` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:28.128163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924e9a4-1da9-4177-9cf0-f5770068eea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=967368dba4664fb486b7e890375f8448)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:28.131899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924e9a4-1da9-4177-9cf0-f5770068eea1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:28.338341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d924e9a4-1da9-4177-9cf0-f5770068eea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '967368dba4664fb486b7e890375f8448'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:28.378509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d924e9a4-1da9-4177-9cf0-f5770068eea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '967368dba4664fb486b7e890375f8448'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:28.380083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d924e9a4-1da9-4177-9cf0-f5770068eea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '967368dba4664fb486b7e890375f8448'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:28.391539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d924e9a4-1da9-4177-9cf0-f5770068eea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '967368dba4664fb486b7e890375f8448'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:28.452703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d924e9a4-1da9-4177-9cf0-f5770068eea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '967368dba4664fb486b7e890375f8448'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:28.461261 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3668/7346] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:49:27 2022] DELETE /identity/v3/users/967368dba4664fb486b7e890375f8448 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:28.465899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab453a-cbd5-4cb5-af34-918fab11b37f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:28.466442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab453a-cbd5-4cb5-af34-918fab11b37f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:28.466552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab453a-cbd5-4cb5-af34-918fab11b37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:28.493398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-5bab453a-cbd5-4cb5-af34-918fab11b37f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:28.494780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5bab453a-cbd5-4cb5-af34-918fab11b37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:28.597450 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3679/7347] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:28.613840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924e9a4-1da9-4177-9cf0-f5770068eea1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:28.615717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d924e9a4-1da9-4177-9cf0-f5770068eea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:28.692803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924e9a4-1da9-4177-9cf0-f5770068eea1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:28.697621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd168c-d358-4f15-ba55-c7acf4574f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:28.698291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd168c-d358-4f15-ba55-c7acf4574f8c service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:28.699059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd168c-d358-4f15-ba55-c7acf4574f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:28.699059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd168c-d358-4f15-ba55-c7acf4574f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:28.713738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd168c-d358-4f15-ba55-c7acf4574f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:28.713738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd168c-d358-4f15-ba55-c7acf4574f8c service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:28.725902 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3669/7348] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:49:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:49:29.431755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab453a-cbd5-4cb5-af34-918fab11b37f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:29.433522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5bab453a-cbd5-4cb5-af34-918fab11b37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:29.459518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab453a-cbd5-4cb5-af34-918fab11b37f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:29.465957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8613b91-cd8d-45fa-8169-f719b3d37505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:29.467100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8613b91-cd8d-45fa-8169-f719b3d37505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:29.477643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8613b91-cd8d-45fa-8169-f719b3d37505 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:29.477643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8613b91-cd8d-45fa-8169-f719b3d37505 admin admin] PATH_INFO: `/v3/projects/daa310593c854e8f90aa5b1302dcbdda` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:29.477643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8613b91-cd8d-45fa-8169-f719b3d37505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daa310593c854e8f90aa5b1302dcbdda)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:29.477643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8613b91-cd8d-45fa-8169-f719b3d37505 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:29.672717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d8613b91-cd8d-45fa-8169-f719b3d37505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daa310593c854e8f90aa5b1302dcbdda', 'request_id': 'req-d8613b91-cd8d-45fa-8169-f719b3d37505'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:29.760791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d8613b91-cd8d-45fa-8169-f719b3d37505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daa310593c854e8f90aa5b1302dcbdda', 'request_id': 'req-d8613b91-cd8d-45fa-8169-f719b3d37505'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:29.767745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d8613b91-cd8d-45fa-8169-f719b3d37505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daa310593c854e8f90aa5b1302dcbdda', 'request_id': 'req-d8613b91-cd8d-45fa-8169-f719b3d37505'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:29.778283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d8613b91-cd8d-45fa-8169-f719b3d37505 admin admin] The token cache is being invalidate because project daa310593c854e8f90aa5b1302dcbdda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:29.778666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d8613b91-cd8d-45fa-8169-f719b3d37505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:29.779408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d8613b91-cd8d-45fa-8169-f719b3d37505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:29.781014 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3680/7349] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:29 2022] DELETE /identity/v3/projects/daa310593c854e8f90aa5b1302dcbdda => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:29.785640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd168c-d358-4f15-ba55-c7acf4574f8c service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:29.799748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd168c-d358-4f15-ba55-c7acf4574f8c service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:29.866325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467d5fc-cf1a-4116-aa43-20168cc6867b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:29.867318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467d5fc-cf1a-4116-aa43-20168cc6867b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:29.867677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467d5fc-cf1a-4116-aa43-20168cc6867b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:29.868030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467d5fc-cf1a-4116-aa43-20168cc6867b admin admin] PATH_INFO: `/v3/users/15d9247cd5b1442eb09f7618c0156f45` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:29.869371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467d5fc-cf1a-4116-aa43-20168cc6867b admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d9247cd5b1442eb09f7618c0156f45)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:29.871728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467d5fc-cf1a-4116-aa43-20168cc6867b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:30.197150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2467d5fc-cf1a-4116-aa43-20168cc6867b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d9247cd5b1442eb09f7618c0156f45'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:30.209140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2467d5fc-cf1a-4116-aa43-20168cc6867b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d9247cd5b1442eb09f7618c0156f45'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:30.209803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2467d5fc-cf1a-4116-aa43-20168cc6867b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d9247cd5b1442eb09f7618c0156f45'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:30.216632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2467d5fc-cf1a-4116-aa43-20168cc6867b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d9247cd5b1442eb09f7618c0156f45'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:30.291926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2467d5fc-cf1a-4116-aa43-20168cc6867b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d9247cd5b1442eb09f7618c0156f45'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:30.299302 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3670/7350] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:49:29 2022] DELETE /identity/v3/users/15d9247cd5b1442eb09f7618c0156f45 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:30.778129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8613b91-cd8d-45fa-8169-f719b3d37505 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:30.779511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d8613b91-cd8d-45fa-8169-f719b3d37505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:30.780219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a1b36-d9df-49d4-a2f6-c6fa7c10e7a5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:30.780519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a1b36-d9df-49d4-a2f6-c6fa7c10e7a5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:30.780833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a1b36-d9df-49d4-a2f6-c6fa7c10e7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:30.794049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8613b91-cd8d-45fa-8169-f719b3d37505 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:30.825653 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d96a1b36-d9df-49d4-a2f6-c6fa7c10e7a5 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:30.826913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d96a1b36-d9df-49d4-a2f6-c6fa7c10e7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:30.883124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2998a-1501-480a-b768-0ee2d3a555a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:30.885533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2998a-1501-480a-b768-0ee2d3a555a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:30.887133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2998a-1501-480a-b768-0ee2d3a555a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:30.887418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2998a-1501-480a-b768-0ee2d3a555a3 admin admin] PATH_INFO: `/v3/projects/0506bf8122224b85b3f36f04f29e1b78` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:30.891845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2998a-1501-480a-b768-0ee2d3a555a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0506bf8122224b85b3f36f04f29e1b78)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:30.894647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2998a-1501-480a-b768-0ee2d3a555a3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:30.944635 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3671/7351] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:49:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:30.957493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a1b36-d9df-49d4-a2f6-c6fa7c10e7a5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:30.959249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d96a1b36-d9df-49d4-a2f6-c6fa7c10e7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:31.055982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a1b36-d9df-49d4-a2f6-c6fa7c10e7a5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:31.059094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0ac2998a-1501-480a-b768-0ee2d3a555a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0506bf8122224b85b3f36f04f29e1b78', 'request_id': 'req-0ac2998a-1501-480a-b768-0ee2d3a555a3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:31.117011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb7cd2-b66a-451b-9013-f95e0762f2c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:31.117683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb7cd2-b66a-451b-9013-f95e0762f2c5 service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:31.117975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb7cd2-b66a-451b-9013-f95e0762f2c5 service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:31.118259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb7cd2-b66a-451b-9013-f95e0762f2c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:31.155331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0ac2998a-1501-480a-b768-0ee2d3a555a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0506bf8122224b85b3f36f04f29e1b78', 'request_id': 'req-0ac2998a-1501-480a-b768-0ee2d3a555a3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:31.164126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0ac2998a-1501-480a-b768-0ee2d3a555a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0506bf8122224b85b3f36f04f29e1b78', 'request_id': 'req-0ac2998a-1501-480a-b768-0ee2d3a555a3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:31.175211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0ac2998a-1501-480a-b768-0ee2d3a555a3 admin admin] The token cache is being invalidate because project 0506bf8122224b85b3f36f04f29e1b78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:31.175503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0ac2998a-1501-480a-b768-0ee2d3a555a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:31.176178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0ac2998a-1501-480a-b768-0ee2d3a555a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:31.178279 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3681/7352] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:30 2022] DELETE /identity/v3/projects/0506bf8122224b85b3f36f04f29e1b78 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:31.183250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2998a-1501-480a-b768-0ee2d3a555a3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:31.184678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0ac2998a-1501-480a-b768-0ee2d3a555a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:31.186155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb7cd2-b66a-451b-9013-f95e0762f2c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:31.188061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb7cd2-b66a-451b-9013-f95e0762f2c5 service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:31.198909 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3672/7353] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:49:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 02 10:49:31.272743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2998a-1501-480a-b768-0ee2d3a555a3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:31.279369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241a01a-06bd-4218-b033-65e32fa45af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:31.280282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241a01a-06bd-4218-b033-65e32fa45af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:31.280572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241a01a-06bd-4218-b033-65e32fa45af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:31.281130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241a01a-06bd-4218-b033-65e32fa45af2 admin admin] PATH_INFO: `/v3/users/2966dcef3f4d4b0981a2523db5e90afd` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:31.282417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241a01a-06bd-4218-b033-65e32fa45af2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2966dcef3f4d4b0981a2523db5e90afd)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:31.284707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241a01a-06bd-4218-b033-65e32fa45af2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:31.480397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1241a01a-06bd-4218-b033-65e32fa45af2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2966dcef3f4d4b0981a2523db5e90afd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:31.495479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1241a01a-06bd-4218-b033-65e32fa45af2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2966dcef3f4d4b0981a2523db5e90afd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:31.496832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1241a01a-06bd-4218-b033-65e32fa45af2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2966dcef3f4d4b0981a2523db5e90afd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:31.505832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1241a01a-06bd-4218-b033-65e32fa45af2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2966dcef3f4d4b0981a2523db5e90afd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:31.561101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1241a01a-06bd-4218-b033-65e32fa45af2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2966dcef3f4d4b0981a2523db5e90afd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:31.570483 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3682/7354] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:49:31 2022] DELETE /identity/v3/users/2966dcef3f4d4b0981a2523db5e90afd => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:32.065922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb7cd2-b66a-451b-9013-f95e0762f2c5 service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:32.067642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d3eb7cd2-b66a-451b-9013-f95e0762f2c5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:32.082320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb7cd2-b66a-451b-9013-f95e0762f2c5 service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:32.150379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb2dea-4e6b-4606-b291-b71e1d4113ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:32.151251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb2dea-4e6b-4606-b291-b71e1d4113ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:32.151535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb2dea-4e6b-4606-b291-b71e1d4113ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:32.151813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb2dea-4e6b-4606-b291-b71e1d4113ac admin admin] PATH_INFO: `/v3/projects/1c441b239c0243bfbf09dd85d17556f7` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:32.153062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb2dea-4e6b-4606-b291-b71e1d4113ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c441b239c0243bfbf09dd85d17556f7)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:32.154992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb2dea-4e6b-4606-b291-b71e1d4113ac admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:32.263449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-73eb2dea-4e6b-4606-b291-b71e1d4113ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c441b239c0243bfbf09dd85d17556f7', 'request_id': 'req-73eb2dea-4e6b-4606-b291-b71e1d4113ac'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:32.271291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-73eb2dea-4e6b-4606-b291-b71e1d4113ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c441b239c0243bfbf09dd85d17556f7', 'request_id': 'req-73eb2dea-4e6b-4606-b291-b71e1d4113ac'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:32.332664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-73eb2dea-4e6b-4606-b291-b71e1d4113ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c441b239c0243bfbf09dd85d17556f7', 'request_id': 'req-73eb2dea-4e6b-4606-b291-b71e1d4113ac'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:32.347533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-73eb2dea-4e6b-4606-b291-b71e1d4113ac admin admin] The token cache is being invalidate because project 1c441b239c0243bfbf09dd85d17556f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:32.347825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-73eb2dea-4e6b-4606-b291-b71e1d4113ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:32.348772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-73eb2dea-4e6b-4606-b291-b71e1d4113ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:32.350731 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3673/7355] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:32 2022] DELETE /identity/v3/projects/1c441b239c0243bfbf09dd85d17556f7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:32.356584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067f528-fd9b-4e54-8dcd-52e78f55cd4e None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:32.357124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067f528-fd9b-4e54-8dcd-52e78f55cd4e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:32.357235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067f528-fd9b-4e54-8dcd-52e78f55cd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:32.377836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6067f528-fd9b-4e54-8dcd-52e78f55cd4e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:32.379084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6067f528-fd9b-4e54-8dcd-52e78f55cd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:32.446001 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3683/7356] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:32.458161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cfbc5-ba14-44aa-965b-de44cc94e1be None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:32.458480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cfbc5-ba14-44aa-965b-de44cc94e1be None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:32.459501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cfbc5-ba14-44aa-965b-de44cc94e1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:32.481100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-db3cfbc5-ba14-44aa-965b-de44cc94e1be None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:32.482395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-db3cfbc5-ba14-44aa-965b-de44cc94e1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:32.495728 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3674/7357] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:32.500089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067f528-fd9b-4e54-8dcd-52e78f55cd4e None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:32.512215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067f528-fd9b-4e54-8dcd-52e78f55cd4e None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:32.517659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b303347-aeb8-4670-bcbe-212ec29dc8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:32.518329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b303347-aeb8-4670-bcbe-212ec29dc8cb admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:32.518614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b303347-aeb8-4670-bcbe-212ec29dc8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:32.518896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b303347-aeb8-4670-bcbe-212ec29dc8cb admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:32.519857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b303347-aeb8-4670-bcbe-212ec29dc8cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:49:32.520359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b303347-aeb8-4670-bcbe-212ec29dc8cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:32.522047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b303347-aeb8-4670-bcbe-212ec29dc8cb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:32.537642 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3684/7358] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:49:32.538710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cfbc5-ba14-44aa-965b-de44cc94e1be None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:32.547866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cfbc5-ba14-44aa-965b-de44cc94e1be None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:32.552881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11177226-7626-4ed2-a049-1e968bcd6eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:32.553675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11177226-7626-4ed2-a049-1e968bcd6eaf admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:32.553959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11177226-7626-4ed2-a049-1e968bcd6eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:32.555210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11177226-7626-4ed2-a049-1e968bcd6eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:32.555210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11177226-7626-4ed2-a049-1e968bcd6eaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:32.557015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11177226-7626-4ed2-a049-1e968bcd6eaf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:32.635645 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3675/7359] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:49:32 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:49:32.639680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b303347-aeb8-4670-bcbe-212ec29dc8cb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:32.654474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b303347-aeb8-4670-bcbe-212ec29dc8cb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:32.714614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ec1d1-7a54-43d4-9ff6-df65d7c2e39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:32.715296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ec1d1-7a54-43d4-9ff6-df65d7c2e39a admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:32.715580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ec1d1-7a54-43d4-9ff6-df65d7c2e39a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:32.715859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ec1d1-7a54-43d4-9ff6-df65d7c2e39a admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:32.716563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ec1d1-7a54-43d4-9ff6-df65d7c2e39a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:32.718768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ec1d1-7a54-43d4-9ff6-df65d7c2e39a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:32.785664 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3685/7360] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:49:32 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:49:32.789739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11177226-7626-4ed2-a049-1e968bcd6eaf admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:32.802840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11177226-7626-4ed2-a049-1e968bcd6eaf admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:32.817046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535458f-e1b9-4688-a039-d747cf9a0686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:32.817752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535458f-e1b9-4688-a039-d747cf9a0686 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:32.818042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535458f-e1b9-4688-a039-d747cf9a0686 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:32.818326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535458f-e1b9-4688-a039-d747cf9a0686 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:32.819076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535458f-e1b9-4688-a039-d747cf9a0686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:32.820726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535458f-e1b9-4688-a039-d747cf9a0686 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:32.833637 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3676/7361] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:49:32.837912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ec1d1-7a54-43d4-9ff6-df65d7c2e39a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:32.850137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ec1d1-7a54-43d4-9ff6-df65d7c2e39a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:32.860122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6b495-3e8d-4f26-b781-112bc841f2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:32.860122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6b495-3e8d-4f26-b781-112bc841f2ab admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:32.860122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6b495-3e8d-4f26-b781-112bc841f2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:32.860122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6b495-3e8d-4f26-b781-112bc841f2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:32.862424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6b495-3e8d-4f26-b781-112bc841f2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:32.865425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6b495-3e8d-4f26-b781-112bc841f2ab admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:32.879266 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3686/7362] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:49:32.883509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535458f-e1b9-4688-a039-d747cf9a0686 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:32.917006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535458f-e1b9-4688-a039-d747cf9a0686 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:32.939510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041edb6-8eb1-40dd-9ffa-879c649532bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:32.942568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041edb6-8eb1-40dd-9ffa-879c649532bb admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:32.942568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041edb6-8eb1-40dd-9ffa-879c649532bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:32.942568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041edb6-8eb1-40dd-9ffa-879c649532bb admin admin] PATH_INFO: `/v3/projects/1a7b92a002ae42e0b6f6405c56959e3b/users/2840c34a59c8434190006244c3b1907b/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:32.961990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041edb6-8eb1-40dd-9ffa-879c649532bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a7b92a002ae42e0b6f6405c56959e3b, user_id=2840c34a59c8434190006244c3b1907b, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:32.965080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041edb6-8eb1-40dd-9ffa-879c649532bb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:33.137602 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3677/7363] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:32 2022] PUT /identity/v3/projects/1a7b92a002ae42e0b6f6405c56959e3b/users/2840c34a59c8434190006244c3b1907b/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:33.144482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28a4c2-a09d-467b-9958-4f641b2f311b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:33.144982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28a4c2-a09d-467b-9958-4f641b2f311b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:33.145279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28a4c2-a09d-467b-9958-4f641b2f311b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:33.186356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6b28a4c2-a09d-467b-9958-4f641b2f311b None None] MFA Rules not processed for user `2840c34a59c8434190006244c3b1907b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:33.188383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6b28a4c2-a09d-467b-9958-4f641b2f311b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:33.258134 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3687/7364] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:33.283710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041edb6-8eb1-40dd-9ffa-879c649532bb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:33.286797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3041edb6-8eb1-40dd-9ffa-879c649532bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:33.383827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041edb6-8eb1-40dd-9ffa-879c649532bb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:33.393069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910cbb4-6b02-4f9c-ba63-414d43f07abf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:33.393069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910cbb4-6b02-4f9c-ba63-414d43f07abf service glance] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:33.393069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910cbb4-6b02-4f9c-ba63-414d43f07abf service glance] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:33.393069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910cbb4-6b02-4f9c-ba63-414d43f07abf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:33.400828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910cbb4-6b02-4f9c-ba63-414d43f07abf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:33.402269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910cbb4-6b02-4f9c-ba63-414d43f07abf service glance] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:33.421823 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3678/7365] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:49:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:49:33.815332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8fec1-6792-4db3-8fc0-5744c23806bb None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:33.815899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8fec1-6792-4db3-8fc0-5744c23806bb None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:33.815899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8fec1-6792-4db3-8fc0-5744c23806bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:33.843171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-90e8fec1-6792-4db3-8fc0-5744c23806bb None None] MFA Rules not processed for user `bad5953b4fbf4fe2a30a2b4208714631`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:33.845298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-90e8fec1-6792-4db3-8fc0-5744c23806bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:33.875514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344a995-73e7-4489-a4a6-9aca91af279f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:33.875514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344a995-73e7-4489-a4a6-9aca91af279f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:33.875775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344a995-73e7-4489-a4a6-9aca91af279f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:33.908766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3344a995-73e7-4489-a4a6-9aca91af279f None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:33.912155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3344a995-73e7-4489-a4a6-9aca91af279f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:33.947512 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3688/7366] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:49:34.048795 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3679/7367] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:49:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:34.070407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8fec1-6792-4db3-8fc0-5744c23806bb None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:34.071888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-90e8fec1-6792-4db3-8fc0-5744c23806bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:34.236679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8fec1-6792-4db3-8fc0-5744c23806bb None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:34.257446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bca62-ce76-4f01-b1b0-c3111ed0af89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:34.257446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bca62-ce76-4f01-b1b0-c3111ed0af89 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:34.257446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bca62-ce76-4f01-b1b0-c3111ed0af89 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:34.258742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bca62-ce76-4f01-b1b0-c3111ed0af89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:34.269211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bca62-ce76-4f01-b1b0-c3111ed0af89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:34.271269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bca62-ce76-4f01-b1b0-c3111ed0af89 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:34.283366 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3689/7368] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:49:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:49:34.946976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344a995-73e7-4489-a4a6-9aca91af279f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:34.949162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3344a995-73e7-4489-a4a6-9aca91af279f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:35.047738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344a995-73e7-4489-a4a6-9aca91af279f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:35.053218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7427e-4433-4e7f-aabd-725c9c79cc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:35.054423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7427e-4433-4e7f-aabd-725c9c79cc2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:35.054896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7427e-4433-4e7f-aabd-725c9c79cc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:35.055267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7427e-4433-4e7f-aabd-725c9c79cc2e admin admin] PATH_INFO: `/v3/users/4a6aea2df67c4cea8c2a784926b499c2` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:35.056663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7427e-4433-4e7f-aabd-725c9c79cc2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a6aea2df67c4cea8c2a784926b499c2)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:35.058722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7427e-4433-4e7f-aabd-725c9c79cc2e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:35.253292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e765158-346b-43c0-8cdb-392f5002a317 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:35.253843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e765158-346b-43c0-8cdb-392f5002a317 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:35.253843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e765158-346b-43c0-8cdb-392f5002a317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:35.272234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8e765158-346b-43c0-8cdb-392f5002a317 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:35.273518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8e765158-346b-43c0-8cdb-392f5002a317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:35.282087 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3690/7369] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:49:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:49:35.294213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e765158-346b-43c0-8cdb-392f5002a317 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:35.308379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e765158-346b-43c0-8cdb-392f5002a317 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:35.313649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a6c0e-d137-4721-bbe4-06344b9e7a88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:35.314275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a6c0e-d137-4721-bbe4-06344b9e7a88 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:35.314557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a6c0e-d137-4721-bbe4-06344b9e7a88 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:35.314832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a6c0e-d137-4721-bbe4-06344b9e7a88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:35.323256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a6c0e-d137-4721-bbe4-06344b9e7a88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:35.324896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a6c0e-d137-4721-bbe4-06344b9e7a88 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:35.333758 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3691/7370] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:49:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 02 10:49:35.335243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-04c7427e-4433-4e7f-aabd-725c9c79cc2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a6aea2df67c4cea8c2a784926b499c2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:35.347766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-04c7427e-4433-4e7f-aabd-725c9c79cc2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a6aea2df67c4cea8c2a784926b499c2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:35.348474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-04c7427e-4433-4e7f-aabd-725c9c79cc2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a6aea2df67c4cea8c2a784926b499c2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:35.355436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-04c7427e-4433-4e7f-aabd-725c9c79cc2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a6aea2df67c4cea8c2a784926b499c2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:35.435372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-04c7427e-4433-4e7f-aabd-725c9c79cc2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a6aea2df67c4cea8c2a784926b499c2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:35.442043 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3680/7371] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:49:34 2022] DELETE /identity/v3/users/4a6aea2df67c4cea8c2a784926b499c2 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:35.950374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a6c0e-d137-4721-bbe4-06344b9e7a88 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:35.958276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a6c0e-d137-4721-bbe4-06344b9e7a88 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:36.058452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0b153-eb4e-4fba-a176-1d9026abd3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:36.059708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0b153-eb4e-4fba-a176-1d9026abd3c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:36.059994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0b153-eb4e-4fba-a176-1d9026abd3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:36.060494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0b153-eb4e-4fba-a176-1d9026abd3c8 admin admin] PATH_INFO: `/v3/projects/25b31684bd0f406085f00c4d8c7ded50` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:36.061746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0b153-eb4e-4fba-a176-1d9026abd3c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b31684bd0f406085f00c4d8c7ded50)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:36.064220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0b153-eb4e-4fba-a176-1d9026abd3c8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:36.252286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-98c0b153-eb4e-4fba-a176-1d9026abd3c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b31684bd0f406085f00c4d8c7ded50', 'request_id': 'req-98c0b153-eb4e-4fba-a176-1d9026abd3c8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:36.361455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-98c0b153-eb4e-4fba-a176-1d9026abd3c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b31684bd0f406085f00c4d8c7ded50', 'request_id': 'req-98c0b153-eb4e-4fba-a176-1d9026abd3c8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:36.368124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-98c0b153-eb4e-4fba-a176-1d9026abd3c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b31684bd0f406085f00c4d8c7ded50', 'request_id': 'req-98c0b153-eb4e-4fba-a176-1d9026abd3c8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:36.380472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-98c0b153-eb4e-4fba-a176-1d9026abd3c8 admin admin] The token cache is being invalidate because project 25b31684bd0f406085f00c4d8c7ded50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:36.380808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-98c0b153-eb4e-4fba-a176-1d9026abd3c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:36.381458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-98c0b153-eb4e-4fba-a176-1d9026abd3c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:36.382999 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3692/7372] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:35 2022] DELETE /identity/v3/projects/25b31684bd0f406085f00c4d8c7ded50 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:36.386977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7427e-4433-4e7f-aabd-725c9c79cc2e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:36.388374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-04c7427e-4433-4e7f-aabd-725c9c79cc2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:36.401588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7427e-4433-4e7f-aabd-725c9c79cc2e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:36.457723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d52de2-2b74-4dd0-91d6-e4698a74eb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:36.458603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d52de2-2b74-4dd0-91d6-e4698a74eb71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:36.459508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d52de2-2b74-4dd0-91d6-e4698a74eb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:36.459508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d52de2-2b74-4dd0-91d6-e4698a74eb71 admin admin] PATH_INFO: `/v3/users/e88accb1ff214b8eb38aed45f99dacb6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:36.460384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d52de2-2b74-4dd0-91d6-e4698a74eb71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88accb1ff214b8eb38aed45f99dacb6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:36.462396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d52de2-2b74-4dd0-91d6-e4698a74eb71 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:36.675561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988206bc-5807-4f02-aa3b-dc509a2afb04 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:36.679263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988206bc-5807-4f02-aa3b-dc509a2afb04 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:36.679263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988206bc-5807-4f02-aa3b-dc509a2afb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:36.694296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-988206bc-5807-4f02-aa3b-dc509a2afb04 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:36.695475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-988206bc-5807-4f02-aa3b-dc509a2afb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:36.749927 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3693/7373] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:49:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:49:36.761767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988206bc-5807-4f02-aa3b-dc509a2afb04 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:36.763089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-988206bc-5807-4f02-aa3b-dc509a2afb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:36.803116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-10d52de2-2b74-4dd0-91d6-e4698a74eb71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88accb1ff214b8eb38aed45f99dacb6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:36.814723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-10d52de2-2b74-4dd0-91d6-e4698a74eb71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88accb1ff214b8eb38aed45f99dacb6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:36.816013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-10d52de2-2b74-4dd0-91d6-e4698a74eb71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88accb1ff214b8eb38aed45f99dacb6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:36.822553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-10d52de2-2b74-4dd0-91d6-e4698a74eb71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88accb1ff214b8eb38aed45f99dacb6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:36.832328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988206bc-5807-4f02-aa3b-dc509a2afb04 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:36.837427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76388d1e-1947-4ee9-bf0a-aaee2010b980 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:36.838699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388d1e-1947-4ee9-bf0a-aaee2010b980 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:36.838699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388d1e-1947-4ee9-bf0a-aaee2010b980 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:36.838699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388d1e-1947-4ee9-bf0a-aaee2010b980 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:36.847894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76388d1e-1947-4ee9-bf0a-aaee2010b980 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:36.849515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76388d1e-1947-4ee9-bf0a-aaee2010b980 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:36.858556 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3694/7374] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:49:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 02 10:49:36.898148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-10d52de2-2b74-4dd0-91d6-e4698a74eb71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88accb1ff214b8eb38aed45f99dacb6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:36.904489 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3681/7375] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:49:36 2022] DELETE /identity/v3/users/e88accb1ff214b8eb38aed45f99dacb6 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:37.174643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76388d1e-1947-4ee9-bf0a-aaee2010b980 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:37.176058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-76388d1e-1947-4ee9-bf0a-aaee2010b980 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:37.191190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76388d1e-1947-4ee9-bf0a-aaee2010b980 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:37.250411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd4fb0-1a2b-4165-b0e0-29d105197f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:37.251613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd4fb0-1a2b-4165-b0e0-29d105197f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:37.251892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd4fb0-1a2b-4165-b0e0-29d105197f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:37.252164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd4fb0-1a2b-4165-b0e0-29d105197f7e admin admin] PATH_INFO: `/v3/projects/73a4921ab6904eb88bfe9f5c629cff14` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:37.253435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd4fb0-1a2b-4165-b0e0-29d105197f7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=73a4921ab6904eb88bfe9f5c629cff14)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:37.255530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd4fb0-1a2b-4165-b0e0-29d105197f7e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:37.364952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-99fd4fb0-1a2b-4165-b0e0-29d105197f7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73a4921ab6904eb88bfe9f5c629cff14', 'request_id': 'req-99fd4fb0-1a2b-4165-b0e0-29d105197f7e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:37.440807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-99fd4fb0-1a2b-4165-b0e0-29d105197f7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73a4921ab6904eb88bfe9f5c629cff14', 'request_id': 'req-99fd4fb0-1a2b-4165-b0e0-29d105197f7e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:37.447603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-99fd4fb0-1a2b-4165-b0e0-29d105197f7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73a4921ab6904eb88bfe9f5c629cff14', 'request_id': 'req-99fd4fb0-1a2b-4165-b0e0-29d105197f7e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:37.458314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-99fd4fb0-1a2b-4165-b0e0-29d105197f7e admin admin] The token cache is being invalidate because project 73a4921ab6904eb88bfe9f5c629cff14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:37.458695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-99fd4fb0-1a2b-4165-b0e0-29d105197f7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:37.459340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-99fd4fb0-1a2b-4165-b0e0-29d105197f7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:37.460914 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3695/7376] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:37 2022] DELETE /identity/v3/projects/73a4921ab6904eb88bfe9f5c629cff14 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:37.680622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfb7c7-0a58-4a30-bddf-14e567c0f914 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:37.684663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfb7c7-0a58-4a30-bddf-14e567c0f914 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:37.684663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfb7c7-0a58-4a30-bddf-14e567c0f914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:37.702684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-97cfb7c7-0a58-4a30-bddf-14e567c0f914 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:37.704008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-97cfb7c7-0a58-4a30-bddf-14e567c0f914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:37.770756 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3682/7377] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:49:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:49:37.786434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd4fb0-1a2b-4165-b0e0-29d105197f7e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:37.788855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-99fd4fb0-1a2b-4165-b0e0-29d105197f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:37.874419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd4fb0-1a2b-4165-b0e0-29d105197f7e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:37.887641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186a79e-ef24-41fe-b849-40de25966f13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:37.888641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186a79e-ef24-41fe-b849-40de25966f13 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:37.889007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186a79e-ef24-41fe-b849-40de25966f13 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:37.889291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186a79e-ef24-41fe-b849-40de25966f13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:37.911261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186a79e-ef24-41fe-b849-40de25966f13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:37.920043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186a79e-ef24-41fe-b849-40de25966f13 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:37.924138 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3696/7378] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:49:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:49:38.810751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c029db-a4d5-4fe3-8456-2ca41c1ecf11 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:38.810751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c029db-a4d5-4fe3-8456-2ca41c1ecf11 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:38.811318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c029db-a4d5-4fe3-8456-2ca41c1ecf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:38.835407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f5c029db-a4d5-4fe3-8456-2ca41c1ecf11 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:38.837041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f5c029db-a4d5-4fe3-8456-2ca41c1ecf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:38.850013 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3683/7379] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:49:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:38.870489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186a79e-ef24-41fe-b849-40de25966f13 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:38.883410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186a79e-ef24-41fe-b849-40de25966f13 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:38.889488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784515cc-1e65-40a3-8eae-194cbbec7335 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:38.889849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784515cc-1e65-40a3-8eae-194cbbec7335 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:38.890353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784515cc-1e65-40a3-8eae-194cbbec7335 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:38.890847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784515cc-1e65-40a3-8eae-194cbbec7335 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:38.900923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784515cc-1e65-40a3-8eae-194cbbec7335 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:38.902562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784515cc-1e65-40a3-8eae-194cbbec7335 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:38.913586 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3697/7380] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:49:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:49:39.701320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9e84b-1369-4abf-9674-5165d31315ba None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:39.701538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9e84b-1369-4abf-9674-5165d31315ba None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:39.702074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9e84b-1369-4abf-9674-5165d31315ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:39.730686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a4e9e84b-1369-4abf-9674-5165d31315ba None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:39.732007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a4e9e84b-1369-4abf-9674-5165d31315ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:39.750925 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3684/7381] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:49:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:39.769724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784515cc-1e65-40a3-8eae-194cbbec7335 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:39.835405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784515cc-1e65-40a3-8eae-194cbbec7335 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:39.845293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323bf0e-e058-498d-a0d3-23f052c1df49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:39.846152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323bf0e-e058-498d-a0d3-23f052c1df49 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:39.846508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323bf0e-e058-498d-a0d3-23f052c1df49 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:39.846856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323bf0e-e058-498d-a0d3-23f052c1df49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:39.859952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323bf0e-e058-498d-a0d3-23f052c1df49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:39.861868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323bf0e-e058-498d-a0d3-23f052c1df49 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:39.872436 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3698/7382] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:49:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:49:41.107581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52a961-5a52-46bd-9fb6-c76c2cba95ee None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:41.108366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52a961-5a52-46bd-9fb6-c76c2cba95ee None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:41.108688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52a961-5a52-46bd-9fb6-c76c2cba95ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:41.127565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8b52a961-5a52-46bd-9fb6-c76c2cba95ee None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:41.128887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8b52a961-5a52-46bd-9fb6-c76c2cba95ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:41.136518 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3685/7383] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:49:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:41.149330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323bf0e-e058-498d-a0d3-23f052c1df49 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:41.161384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323bf0e-e058-498d-a0d3-23f052c1df49 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:41.166744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537ddd3-cbee-44ef-a255-9c971c79ab29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:41.167404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537ddd3-cbee-44ef-a255-9c971c79ab29 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:41.167691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537ddd3-cbee-44ef-a255-9c971c79ab29 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:41.167971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537ddd3-cbee-44ef-a255-9c971c79ab29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:41.176630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537ddd3-cbee-44ef-a255-9c971c79ab29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:41.178331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537ddd3-cbee-44ef-a255-9c971c79ab29 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:41.186497 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3699/7384] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:49:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 02 10:49:41.535151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abe06b-febf-4a4c-baf5-29c78cdf6004 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:41.536622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abe06b-febf-4a4c-baf5-29c78cdf6004 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:41.536622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abe06b-febf-4a4c-baf5-29c78cdf6004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:41.553486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b7abe06b-febf-4a4c-baf5-29c78cdf6004 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:41.554708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b7abe06b-febf-4a4c-baf5-29c78cdf6004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:41.577569 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3686/7385] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:49:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:41.589714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537ddd3-cbee-44ef-a255-9c971c79ab29 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:41.608778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537ddd3-cbee-44ef-a255-9c971c79ab29 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:41.615366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ec464-21a8-41b4-afb5-714fd050ff34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:41.616046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ec464-21a8-41b4-afb5-714fd050ff34 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:41.616332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ec464-21a8-41b4-afb5-714fd050ff34 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:41.616669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ec464-21a8-41b4-afb5-714fd050ff34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:41.625879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ec464-21a8-41b4-afb5-714fd050ff34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:41.627485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ec464-21a8-41b4-afb5-714fd050ff34 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:41.635975 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3700/7386] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:49:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:49:42.041491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51513f98-69b6-47f7-93d0-e7c67ae9e7d3 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:42.041491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51513f98-69b6-47f7-93d0-e7c67ae9e7d3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:42.041491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51513f98-69b6-47f7-93d0-e7c67ae9e7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:42.056855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-51513f98-69b6-47f7-93d0-e7c67ae9e7d3 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:42.058043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-51513f98-69b6-47f7-93d0-e7c67ae9e7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:42.065846 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3687/7387] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:49:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:42.078018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ec464-21a8-41b4-afb5-714fd050ff34 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:42.090661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ec464-21a8-41b4-afb5-714fd050ff34 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:42.100757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dff71-4f9d-4ac7-85e4-251865cd7d78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:42.102049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dff71-4f9d-4ac7-85e4-251865cd7d78 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:42.102314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dff71-4f9d-4ac7-85e4-251865cd7d78 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:42.102729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dff71-4f9d-4ac7-85e4-251865cd7d78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:42.112638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dff71-4f9d-4ac7-85e4-251865cd7d78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:42.114447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dff71-4f9d-4ac7-85e4-251865cd7d78 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:42.122753 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3701/7388] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:49:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:49:42.544816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81720545-a7bc-4717-b5f5-dd5cbfd84f34 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:42.544816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81720545-a7bc-4717-b5f5-dd5cbfd84f34 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:42.544816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81720545-a7bc-4717-b5f5-dd5cbfd84f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:42.561301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-81720545-a7bc-4717-b5f5-dd5cbfd84f34 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:42.563325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-81720545-a7bc-4717-b5f5-dd5cbfd84f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:42.570534 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3688/7389] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:49:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:42.582516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dff71-4f9d-4ac7-85e4-251865cd7d78 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:42.595583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dff71-4f9d-4ac7-85e4-251865cd7d78 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:42.601139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8498505-5ab3-4383-94be-6034f8f91f8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:42.601781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8498505-5ab3-4383-94be-6034f8f91f8e service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:42.602064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8498505-5ab3-4383-94be-6034f8f91f8e service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:42.602341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8498505-5ab3-4383-94be-6034f8f91f8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:42.611180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8498505-5ab3-4383-94be-6034f8f91f8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:42.612764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8498505-5ab3-4383-94be-6034f8f91f8e service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:42.620940 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3702/7390] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:49:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:49:43.038109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19db5cf-2019-4716-8e98-6a7a5868884e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:43.043076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19db5cf-2019-4716-8e98-6a7a5868884e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:43.043076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19db5cf-2019-4716-8e98-6a7a5868884e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:43.058113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c19db5cf-2019-4716-8e98-6a7a5868884e None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:43.059225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c19db5cf-2019-4716-8e98-6a7a5868884e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:43.076815 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3689/7391] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:49:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:43.090847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8498505-5ab3-4383-94be-6034f8f91f8e service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:43.110795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8498505-5ab3-4383-94be-6034f8f91f8e service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:43.126378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da6738-a05d-49fa-9d61-8e2dee556a00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:43.127288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da6738-a05d-49fa-9d61-8e2dee556a00 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:43.127687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da6738-a05d-49fa-9d61-8e2dee556a00 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:43.128272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da6738-a05d-49fa-9d61-8e2dee556a00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:43.139084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da6738-a05d-49fa-9d61-8e2dee556a00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:43.140915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da6738-a05d-49fa-9d61-8e2dee556a00 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:43.151157 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3703/7392] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:49:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:49:43.560137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebd38d-12e8-48cd-b5f6-c1f3840bc0a6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:43.560642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebd38d-12e8-48cd-b5f6-c1f3840bc0a6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:43.560864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebd38d-12e8-48cd-b5f6-c1f3840bc0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:43.581298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-60ebd38d-12e8-48cd-b5f6-c1f3840bc0a6 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:43.582806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-60ebd38d-12e8-48cd-b5f6-c1f3840bc0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:43.590741 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3690/7393] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:49:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:43.604015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da6738-a05d-49fa-9d61-8e2dee556a00 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:43.616457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da6738-a05d-49fa-9d61-8e2dee556a00 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:43.622363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893e9bd-8281-438d-9891-f135fc9c137d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:43.623123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893e9bd-8281-438d-9891-f135fc9c137d service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:43.623388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893e9bd-8281-438d-9891-f135fc9c137d service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:43.630190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893e9bd-8281-438d-9891-f135fc9c137d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:43.632832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893e9bd-8281-438d-9891-f135fc9c137d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:43.634425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893e9bd-8281-438d-9891-f135fc9c137d service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:43.643123 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3704/7394] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:49:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:49:44.063758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebd38d-12e8-48cd-b5f6-c1f3840bc0a6 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:44.065221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-60ebd38d-12e8-48cd-b5f6-c1f3840bc0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:44.152295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebd38d-12e8-48cd-b5f6-c1f3840bc0a6 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:44.157653 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935a2ab-4915-4d47-a4ce-789ea0ee9fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:44.158559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935a2ab-4915-4d47-a4ce-789ea0ee9fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:44.158841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935a2ab-4915-4d47-a4ce-789ea0ee9fec admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:44.159118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935a2ab-4915-4d47-a4ce-789ea0ee9fec admin admin] PATH_INFO: `/v3/users/2840c34a59c8434190006244c3b1907b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:44.160401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935a2ab-4915-4d47-a4ce-789ea0ee9fec admin admin] RBAC: Authorizing `identity:delete_user(user_id=2840c34a59c8434190006244c3b1907b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:44.162396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935a2ab-4915-4d47-a4ce-789ea0ee9fec admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:44.368453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5935a2ab-4915-4d47-a4ce-789ea0ee9fec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2840c34a59c8434190006244c3b1907b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:44.379621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5935a2ab-4915-4d47-a4ce-789ea0ee9fec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2840c34a59c8434190006244c3b1907b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:44.380533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5935a2ab-4915-4d47-a4ce-789ea0ee9fec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2840c34a59c8434190006244c3b1907b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:44.387169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5935a2ab-4915-4d47-a4ce-789ea0ee9fec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2840c34a59c8434190006244c3b1907b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:44.469750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5935a2ab-4915-4d47-a4ce-789ea0ee9fec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2840c34a59c8434190006244c3b1907b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:44.476704 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3691/7395] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:49:44 2022] DELETE /identity/v3/users/2840c34a59c8434190006244c3b1907b => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:44.481098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871536ae-dffc-4299-80a5-60ec208636c9 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:44.481385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871536ae-dffc-4299-80a5-60ec208636c9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:44.481665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871536ae-dffc-4299-80a5-60ec208636c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:44.655183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-871536ae-dffc-4299-80a5-60ec208636c9 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:44.657074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-871536ae-dffc-4299-80a5-60ec208636c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:44.710852 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3705/7396] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:44.721033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935a2ab-4915-4d47-a4ce-789ea0ee9fec admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:44.722474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5935a2ab-4915-4d47-a4ce-789ea0ee9fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:44.780260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935a2ab-4915-4d47-a4ce-789ea0ee9fec admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:44.783812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4eff3-3f1d-44d9-b234-7626ec520b9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:44.784450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4eff3-3f1d-44d9-b234-7626ec520b9c service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:44.784767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4eff3-3f1d-44d9-b234-7626ec520b9c service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:44.785047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4eff3-3f1d-44d9-b234-7626ec520b9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:44.793893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4eff3-3f1d-44d9-b234-7626ec520b9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:44.795324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4eff3-3f1d-44d9-b234-7626ec520b9c service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:44.804565 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3692/7397] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:49:45.219956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871536ae-dffc-4299-80a5-60ec208636c9 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:45.221816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-871536ae-dffc-4299-80a5-60ec208636c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:45.233205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871536ae-dffc-4299-80a5-60ec208636c9 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:45.238831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a61f2-5277-4b0f-8e35-ac215441339c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:45.239748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a61f2-5277-4b0f-8e35-ac215441339c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:45.240037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a61f2-5277-4b0f-8e35-ac215441339c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:45.244566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a61f2-5277-4b0f-8e35-ac215441339c admin admin] PATH_INFO: `/v3/projects/1a7b92a002ae42e0b6f6405c56959e3b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:45.244566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a61f2-5277-4b0f-8e35-ac215441339c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a7b92a002ae42e0b6f6405c56959e3b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:45.244566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a61f2-5277-4b0f-8e35-ac215441339c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:45.360934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2b2a61f2-5277-4b0f-8e35-ac215441339c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a7b92a002ae42e0b6f6405c56959e3b', 'request_id': 'req-2b2a61f2-5277-4b0f-8e35-ac215441339c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:45.428816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2b2a61f2-5277-4b0f-8e35-ac215441339c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a7b92a002ae42e0b6f6405c56959e3b', 'request_id': 'req-2b2a61f2-5277-4b0f-8e35-ac215441339c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:45.435878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2b2a61f2-5277-4b0f-8e35-ac215441339c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a7b92a002ae42e0b6f6405c56959e3b', 'request_id': 'req-2b2a61f2-5277-4b0f-8e35-ac215441339c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:45.450446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2b2a61f2-5277-4b0f-8e35-ac215441339c admin admin] The token cache is being invalidate because project 1a7b92a002ae42e0b6f6405c56959e3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:45.450763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2b2a61f2-5277-4b0f-8e35-ac215441339c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:45.451391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2b2a61f2-5277-4b0f-8e35-ac215441339c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:45.453190 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3706/7398] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:45 2022] DELETE /identity/v3/projects/1a7b92a002ae42e0b6f6405c56959e3b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:45.459142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159f319-7e49-4235-8dfe-d1f7d51b03c7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:45.459460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159f319-7e49-4235-8dfe-d1f7d51b03c7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:45.459746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159f319-7e49-4235-8dfe-d1f7d51b03c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:45.510639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5159f319-7e49-4235-8dfe-d1f7d51b03c7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:45.511775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5159f319-7e49-4235-8dfe-d1f7d51b03c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:45.573257 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3693/7399] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:45.580906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffd666-fc11-49e6-b9ec-842a9dd2a52f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:45.581199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffd666-fc11-49e6-b9ec-842a9dd2a52f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:45.581485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffd666-fc11-49e6-b9ec-842a9dd2a52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:45.601172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-eeffd666-fc11-49e6-b9ec-842a9dd2a52f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:45.602421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-eeffd666-fc11-49e6-b9ec-842a9dd2a52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:45.611051 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3707/7400] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:49:45.615251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159f319-7e49-4235-8dfe-d1f7d51b03c7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:45.625867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159f319-7e49-4235-8dfe-d1f7d51b03c7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:45.631037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b93ff-ad2c-4a99-9d20-390d159450c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:45.631707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b93ff-ad2c-4a99-9d20-390d159450c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:45.633853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b93ff-ad2c-4a99-9d20-390d159450c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:45.633853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b93ff-ad2c-4a99-9d20-390d159450c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:45.633853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b93ff-ad2c-4a99-9d20-390d159450c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:49:45.633853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b93ff-ad2c-4a99-9d20-390d159450c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:45.634889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b93ff-ad2c-4a99-9d20-390d159450c5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:45.647649 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3694/7401] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:49:45.652067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffd666-fc11-49e6-b9ec-842a9dd2a52f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:45.661499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffd666-fc11-49e6-b9ec-842a9dd2a52f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:45.666333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c008bf0-0cdb-474f-bf69-75265bfa2ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:45.666997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c008bf0-0cdb-474f-bf69-75265bfa2ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:45.667283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c008bf0-0cdb-474f-bf69-75265bfa2ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:45.667566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c008bf0-0cdb-474f-bf69-75265bfa2ae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:45.668265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c008bf0-0cdb-474f-bf69-75265bfa2ae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:45.670202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c008bf0-0cdb-474f-bf69-75265bfa2ae8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:45.802915 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3708/7402] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:49:45 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:49:45.808834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b93ff-ad2c-4a99-9d20-390d159450c5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:45.818946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b93ff-ad2c-4a99-9d20-390d159450c5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:45.872737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26221bfa-8576-4620-8022-85d1dc8b2005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:45.873410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26221bfa-8576-4620-8022-85d1dc8b2005 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:45.873696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26221bfa-8576-4620-8022-85d1dc8b2005 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:45.873998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26221bfa-8576-4620-8022-85d1dc8b2005 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:45.874694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26221bfa-8576-4620-8022-85d1dc8b2005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:45.876644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26221bfa-8576-4620-8022-85d1dc8b2005 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:45.966412 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3695/7403] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:49:45 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:45.974538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c008bf0-0cdb-474f-bf69-75265bfa2ae8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:45.986204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c008bf0-0cdb-474f-bf69-75265bfa2ae8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:45.990996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96d1de-b9b9-4969-b8f6-bd7b4ffa1cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:45.991653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96d1de-b9b9-4969-b8f6-bd7b4ffa1cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:45.991936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96d1de-b9b9-4969-b8f6-bd7b4ffa1cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:45.992211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96d1de-b9b9-4969-b8f6-bd7b4ffa1cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:45.992971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96d1de-b9b9-4969-b8f6-bd7b4ffa1cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:45.994709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96d1de-b9b9-4969-b8f6-bd7b4ffa1cb7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:46.005452 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3709/7404] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:49:46.009631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26221bfa-8576-4620-8022-85d1dc8b2005 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:46.029817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26221bfa-8576-4620-8022-85d1dc8b2005 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:46.029817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51b757-fa23-46bd-b3ba-652ee1f51e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:46.029817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51b757-fa23-46bd-b3ba-652ee1f51e7e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:46.029817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51b757-fa23-46bd-b3ba-652ee1f51e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:46.030276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51b757-fa23-46bd-b3ba-652ee1f51e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:46.030276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51b757-fa23-46bd-b3ba-652ee1f51e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:46.032089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51b757-fa23-46bd-b3ba-652ee1f51e7e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:46.041958 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3696/7405] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:49:46.046127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96d1de-b9b9-4969-b8f6-bd7b4ffa1cb7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:46.055930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96d1de-b9b9-4969-b8f6-bd7b4ffa1cb7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:46.060457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa48177-9c3d-43e7-b303-ab7c5fc87bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:46.061407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa48177-9c3d-43e7-b303-ab7c5fc87bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:46.061681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa48177-9c3d-43e7-b303-ab7c5fc87bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:46.061954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa48177-9c3d-43e7-b303-ab7c5fc87bb2 admin admin] PATH_INFO: `/v3/projects/cf7896c758e4405c8d6923420b26e924/users/0a6fd3933b3146b2bde082aa42875a29/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:46.075504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa48177-9c3d-43e7-b303-ab7c5fc87bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7896c758e4405c8d6923420b26e924, user_id=0a6fd3933b3146b2bde082aa42875a29, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:46.078881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa48177-9c3d-43e7-b303-ab7c5fc87bb2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:46.201459 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3710/7406] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:46 2022] PUT /identity/v3/projects/cf7896c758e4405c8d6923420b26e924/users/0a6fd3933b3146b2bde082aa42875a29/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:49:46.213076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623a519-d530-4570-a77f-7a14a2ba2e6c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:46.213366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623a519-d530-4570-a77f-7a14a2ba2e6c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:46.213642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623a519-d530-4570-a77f-7a14a2ba2e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:46.240380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a623a519-d530-4570-a77f-7a14a2ba2e6c None None] MFA Rules not processed for user `0a6fd3933b3146b2bde082aa42875a29`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:46.241609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a623a519-d530-4570-a77f-7a14a2ba2e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:46.302708 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3697/7407] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:46.307131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa48177-9c3d-43e7-b303-ab7c5fc87bb2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:46.372991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa48177-9c3d-43e7-b303-ab7c5fc87bb2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:46.378220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c21c5-3447-45b5-a752-de680a4e6c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:46.378872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c21c5-3447-45b5-a752-de680a4e6c49 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:46.379157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c21c5-3447-45b5-a752-de680a4e6c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:46.379435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c21c5-3447-45b5-a752-de680a4e6c49 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:46.380403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c21c5-3447-45b5-a752-de680a4e6c49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:46.382319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c21c5-3447-45b5-a752-de680a4e6c49 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:46.453691 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3711/7408] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:49:46 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:49:46.457804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623a519-d530-4570-a77f-7a14a2ba2e6c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:46.468587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623a519-d530-4570-a77f-7a14a2ba2e6c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:46.523832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db80347-0f71-47b0-b66a-18d38d80887e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:46.524502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db80347-0f71-47b0-b66a-18d38d80887e admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:46.524820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db80347-0f71-47b0-b66a-18d38d80887e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:46.525103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db80347-0f71-47b0-b66a-18d38d80887e admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:46.525801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db80347-0f71-47b0-b66a-18d38d80887e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:46.527770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db80347-0f71-47b0-b66a-18d38d80887e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:46.614115 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3698/7409] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:49:46 2022] POST /identity/v3/users => generated 295 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:46.617852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c21c5-3447-45b5-a752-de680a4e6c49 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:46.629194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c21c5-3447-45b5-a752-de680a4e6c49 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:46.634224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d9327-5808-4bca-a20c-6d91699d2872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:46.634896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d9327-5808-4bca-a20c-6d91699d2872 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:46.635213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d9327-5808-4bca-a20c-6d91699d2872 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:46.635495 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d9327-5808-4bca-a20c-6d91699d2872 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:46.636249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d9327-5808-4bca-a20c-6d91699d2872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:46.637905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d9327-5808-4bca-a20c-6d91699d2872 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:46.649403 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3712/7410] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:49:46.653724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db80347-0f71-47b0-b66a-18d38d80887e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:46.664384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db80347-0f71-47b0-b66a-18d38d80887e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:46.669202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b003755-bff4-4004-acdd-c2ad91eaa9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:46.670100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b003755-bff4-4004-acdd-c2ad91eaa9c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:46.670383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b003755-bff4-4004-acdd-c2ad91eaa9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:46.671645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b003755-bff4-4004-acdd-c2ad91eaa9c5 admin admin] PATH_INFO: `/v3/projects/281b10317d0d4ef7bcb25c32e13e2eda/users/8f5be1b604cc491281aedf4ebd0753a7/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:46.688341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b003755-bff4-4004-acdd-c2ad91eaa9c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=281b10317d0d4ef7bcb25c32e13e2eda, user_id=8f5be1b604cc491281aedf4ebd0753a7, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:46.692592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b003755-bff4-4004-acdd-c2ad91eaa9c5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:46.773004 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3699/7411] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:46 2022] PUT /identity/v3/projects/281b10317d0d4ef7bcb25c32e13e2eda/users/8f5be1b604cc491281aedf4ebd0753a7/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:46.778145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d9327-5808-4bca-a20c-6d91699d2872 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:46.788277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d9327-5808-4bca-a20c-6d91699d2872 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:46.880803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6f329-6d17-4cbd-a421-45a02cb36657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:46.881858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6f329-6d17-4cbd-a421-45a02cb36657 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:46.882330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6f329-6d17-4cbd-a421-45a02cb36657 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:46.882606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6f329-6d17-4cbd-a421-45a02cb36657 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:46.883512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6f329-6d17-4cbd-a421-45a02cb36657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:46.885285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6f329-6d17-4cbd-a421-45a02cb36657 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:46.905423 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3713/7412] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:49:46.910863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b003755-bff4-4004-acdd-c2ad91eaa9c5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:46.929714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b003755-bff4-4004-acdd-c2ad91eaa9c5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:46.941699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f8e9b-3234-4b9e-9e3c-e29bd8aad4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:47.326712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f8e9b-3234-4b9e-9e3c-e29bd8aad4f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:47.326712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f8e9b-3234-4b9e-9e3c-e29bd8aad4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:47.326712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f8e9b-3234-4b9e-9e3c-e29bd8aad4f3 admin admin] PATH_INFO: `/v3/projects/281b10317d0d4ef7bcb25c32e13e2eda/users/8f5be1b604cc491281aedf4ebd0753a7/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:47.326712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f8e9b-3234-4b9e-9e3c-e29bd8aad4f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=281b10317d0d4ef7bcb25c32e13e2eda, user_id=8f5be1b604cc491281aedf4ebd0753a7, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:47.326712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f8e9b-3234-4b9e-9e3c-e29bd8aad4f3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:47.327307 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3700/7413] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:46 2022] PUT /identity/v3/projects/281b10317d0d4ef7bcb25c32e13e2eda/users/8f5be1b604cc491281aedf4ebd0753a7/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:47.327575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294d888-a3be-478f-b8d6-d0876366792a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:47.327575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294d888-a3be-478f-b8d6-d0876366792a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:47.327575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294d888-a3be-478f-b8d6-d0876366792a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:47.327575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3294d888-a3be-478f-b8d6-d0876366792a None None] MFA Rules not processed for user `8f5be1b604cc491281aedf4ebd0753a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:47.327575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3294d888-a3be-478f-b8d6-d0876366792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:47.327575 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3714/7414] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:47.328589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f8e9b-3234-4b9e-9e3c-e29bd8aad4f3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:47.328589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-288f8e9b-3234-4b9e-9e3c-e29bd8aad4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:47.328589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f8e9b-3234-4b9e-9e3c-e29bd8aad4f3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:47.328868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379dd66-4299-4035-84df-c1d1d37ffdab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:47.328868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379dd66-4299-4035-84df-c1d1d37ffdab service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:47.328868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379dd66-4299-4035-84df-c1d1d37ffdab service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:47.328868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379dd66-4299-4035-84df-c1d1d37ffdab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:47.329229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379dd66-4299-4035-84df-c1d1d37ffdab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:47.329229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379dd66-4299-4035-84df-c1d1d37ffdab service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:47.329229 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3701/7415] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:49:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:49:49.127844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294d888-a3be-478f-b8d6-d0876366792a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:49.130741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3294d888-a3be-478f-b8d6-d0876366792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:49.145478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294d888-a3be-478f-b8d6-d0876366792a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:49.151107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cb984-1db6-4c3b-9626-97e66f79cf1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:49.151107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cb984-1db6-4c3b-9626-97e66f79cf1a service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:49.151107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cb984-1db6-4c3b-9626-97e66f79cf1a service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:49.151107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cb984-1db6-4c3b-9626-97e66f79cf1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:49.158317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f06cb984-1db6-4c3b-9626-97e66f79cf1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:49.279933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cb984-1db6-4c3b-9626-97e66f79cf1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:49.281619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cb984-1db6-4c3b-9626-97e66f79cf1a service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:49.313237 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3715/7416] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:49:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:49:49.847737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379dd66-4299-4035-84df-c1d1d37ffdab service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:49.910003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379dd66-4299-4035-84df-c1d1d37ffdab service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:49.914449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae405f-e8d9-4e7c-a729-76fac8c28ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:49.915282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae405f-e8d9-4e7c-a729-76fac8c28ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:49.915554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae405f-e8d9-4e7c-a729-76fac8c28ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:49.915833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae405f-e8d9-4e7c-a729-76fac8c28ad3 admin admin] PATH_INFO: `/v3/users/0a6fd3933b3146b2bde082aa42875a29` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:49.917100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae405f-e8d9-4e7c-a729-76fac8c28ad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a6fd3933b3146b2bde082aa42875a29)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:49.919314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae405f-e8d9-4e7c-a729-76fac8c28ad3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:50.122381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5cae405f-e8d9-4e7c-a729-76fac8c28ad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a6fd3933b3146b2bde082aa42875a29'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:50.134072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5cae405f-e8d9-4e7c-a729-76fac8c28ad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a6fd3933b3146b2bde082aa42875a29'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:50.134731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5cae405f-e8d9-4e7c-a729-76fac8c28ad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a6fd3933b3146b2bde082aa42875a29'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:50.143596 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5cae405f-e8d9-4e7c-a729-76fac8c28ad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a6fd3933b3146b2bde082aa42875a29'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:50.211145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5cae405f-e8d9-4e7c-a729-76fac8c28ad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a6fd3933b3146b2bde082aa42875a29'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:50.217248 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3702/7417] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:49:49 2022] DELETE /identity/v3/users/0a6fd3933b3146b2bde082aa42875a29 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:50.222391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f062c2-a75f-4442-9c9f-dbb8e73d2e41 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:50.222834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f062c2-a75f-4442-9c9f-dbb8e73d2e41 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:50.222951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f062c2-a75f-4442-9c9f-dbb8e73d2e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:50.240509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c4f062c2-a75f-4442-9c9f-dbb8e73d2e41 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:50.241898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c4f062c2-a75f-4442-9c9f-dbb8e73d2e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:50.299109 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3716/7418] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:50.308837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae405f-e8d9-4e7c-a729-76fac8c28ad3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:50.310301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5cae405f-e8d9-4e7c-a729-76fac8c28ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:50.382721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae405f-e8d9-4e7c-a729-76fac8c28ad3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:50.386472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe8369-329e-4488-8ba4-294bef3e68af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:50.387126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe8369-329e-4488-8ba4-294bef3e68af service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:50.387416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe8369-329e-4488-8ba4-294bef3e68af service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:50.387699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe8369-329e-4488-8ba4-294bef3e68af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:50.399364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe8369-329e-4488-8ba4-294bef3e68af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:50.400903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe8369-329e-4488-8ba4-294bef3e68af service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:50.411961 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3703/7419] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:49:50.623336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f062c2-a75f-4442-9c9f-dbb8e73d2e41 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:50.624983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c4f062c2-a75f-4442-9c9f-dbb8e73d2e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:50.653884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f062c2-a75f-4442-9c9f-dbb8e73d2e41 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:50.656111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a60120-a38f-4443-8b7d-dcc6c1f0cc63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:50.656966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a60120-a38f-4443-8b7d-dcc6c1f0cc63 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:50.657820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a60120-a38f-4443-8b7d-dcc6c1f0cc63 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:50.658109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a60120-a38f-4443-8b7d-dcc6c1f0cc63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:50.659918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-87a60120-a38f-4443-8b7d-dcc6c1f0cc63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:50.733629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a60120-a38f-4443-8b7d-dcc6c1f0cc63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:50.735059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a60120-a38f-4443-8b7d-dcc6c1f0cc63 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:50.747540 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3717/7420] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:49:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:49:50.928816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe8369-329e-4488-8ba4-294bef3e68af service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:50.930252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5fbe8369-329e-4488-8ba4-294bef3e68af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:50.956038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe8369-329e-4488-8ba4-294bef3e68af service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:50.962852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77225b4e-33c2-4a94-a234-d19e9850c5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:50.962852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77225b4e-33c2-4a94-a234-d19e9850c5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:50.962852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77225b4e-33c2-4a94-a234-d19e9850c5af admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:50.962852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77225b4e-33c2-4a94-a234-d19e9850c5af admin admin] PATH_INFO: `/v3/projects/cf7896c758e4405c8d6923420b26e924` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:50.963848 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77225b4e-33c2-4a94-a234-d19e9850c5af admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf7896c758e4405c8d6923420b26e924)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:50.965139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77225b4e-33c2-4a94-a234-d19e9850c5af admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:51.111271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-77225b4e-33c2-4a94-a234-d19e9850c5af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf7896c758e4405c8d6923420b26e924', 'request_id': 'req-77225b4e-33c2-4a94-a234-d19e9850c5af'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:51.117760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-77225b4e-33c2-4a94-a234-d19e9850c5af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf7896c758e4405c8d6923420b26e924', 'request_id': 'req-77225b4e-33c2-4a94-a234-d19e9850c5af'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:51.225533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-77225b4e-33c2-4a94-a234-d19e9850c5af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf7896c758e4405c8d6923420b26e924', 'request_id': 'req-77225b4e-33c2-4a94-a234-d19e9850c5af'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:51.239296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-77225b4e-33c2-4a94-a234-d19e9850c5af admin admin] The token cache is being invalidate because project cf7896c758e4405c8d6923420b26e924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:51.239639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-77225b4e-33c2-4a94-a234-d19e9850c5af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:51.240420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-77225b4e-33c2-4a94-a234-d19e9850c5af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:51.245965 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3704/7421] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:50 2022] DELETE /identity/v3/projects/cf7896c758e4405c8d6923420b26e924 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:51.250082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a60120-a38f-4443-8b7d-dcc6c1f0cc63 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:51.261546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a60120-a38f-4443-8b7d-dcc6c1f0cc63 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:51.317069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b638b-acdd-42f9-9d2f-65c4f2600edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:51.317941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b638b-acdd-42f9-9d2f-65c4f2600edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:51.318224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b638b-acdd-42f9-9d2f-65c4f2600edd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:51.318496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b638b-acdd-42f9-9d2f-65c4f2600edd admin admin] PATH_INFO: `/v3/users/8f5be1b604cc491281aedf4ebd0753a7` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:51.319920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b638b-acdd-42f9-9d2f-65c4f2600edd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f5be1b604cc491281aedf4ebd0753a7)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:51.321855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b638b-acdd-42f9-9d2f-65c4f2600edd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:51.517821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5f4b638b-acdd-42f9-9d2f-65c4f2600edd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f5be1b604cc491281aedf4ebd0753a7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:51.530620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5f4b638b-acdd-42f9-9d2f-65c4f2600edd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f5be1b604cc491281aedf4ebd0753a7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:51.531368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5f4b638b-acdd-42f9-9d2f-65c4f2600edd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f5be1b604cc491281aedf4ebd0753a7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:51.539351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5f4b638b-acdd-42f9-9d2f-65c4f2600edd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f5be1b604cc491281aedf4ebd0753a7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:51.651365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5f4b638b-acdd-42f9-9d2f-65c4f2600edd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f5be1b604cc491281aedf4ebd0753a7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:51.657889 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3718/7422] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:49:51 2022] DELETE /identity/v3/users/8f5be1b604cc491281aedf4ebd0753a7 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:52.208264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77225b4e-33c2-4a94-a234-d19e9850c5af admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:52.210277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-77225b4e-33c2-4a94-a234-d19e9850c5af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:52.237875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77225b4e-33c2-4a94-a234-d19e9850c5af admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:52.298706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cea271-96ac-4d42-b75e-867444714726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:52.299710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cea271-96ac-4d42-b75e-867444714726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:52.300047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cea271-96ac-4d42-b75e-867444714726 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:52.300349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cea271-96ac-4d42-b75e-867444714726 admin admin] PATH_INFO: `/v3/projects/281b10317d0d4ef7bcb25c32e13e2eda` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:52.301874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cea271-96ac-4d42-b75e-867444714726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=281b10317d0d4ef7bcb25c32e13e2eda)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:52.303959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cea271-96ac-4d42-b75e-867444714726 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:52.423906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-37cea271-96ac-4d42-b75e-867444714726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '281b10317d0d4ef7bcb25c32e13e2eda', 'request_id': 'req-37cea271-96ac-4d42-b75e-867444714726'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:52.431412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-37cea271-96ac-4d42-b75e-867444714726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '281b10317d0d4ef7bcb25c32e13e2eda', 'request_id': 'req-37cea271-96ac-4d42-b75e-867444714726'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:52.509731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-37cea271-96ac-4d42-b75e-867444714726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '281b10317d0d4ef7bcb25c32e13e2eda', 'request_id': 'req-37cea271-96ac-4d42-b75e-867444714726'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:52.521497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-37cea271-96ac-4d42-b75e-867444714726 admin admin] The token cache is being invalidate because project 281b10317d0d4ef7bcb25c32e13e2eda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:52.521783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-37cea271-96ac-4d42-b75e-867444714726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:52.522433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-37cea271-96ac-4d42-b75e-867444714726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:52.524035 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3705/7423] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:52 2022] DELETE /identity/v3/projects/281b10317d0d4ef7bcb25c32e13e2eda => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:52.529036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03607d-8974-4500-aa3d-13ee80c3286f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:52.529490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03607d-8974-4500-aa3d-13ee80c3286f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:52.529629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03607d-8974-4500-aa3d-13ee80c3286f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:52.548646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1d03607d-8974-4500-aa3d-13ee80c3286f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:52.549851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1d03607d-8974-4500-aa3d-13ee80c3286f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:52.607999 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3719/7424] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:49:52.617362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e71cd-1f1c-44b0-a3b6-f7d52b0207f1 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:52.617769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e71cd-1f1c-44b0-a3b6-f7d52b0207f1 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:52.618135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e71cd-1f1c-44b0-a3b6-f7d52b0207f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:52.637850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-594e71cd-1f1c-44b0-a3b6-f7d52b0207f1 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:52.639153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-594e71cd-1f1c-44b0-a3b6-f7d52b0207f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:52.650422 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3706/7425] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:52.651722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03607d-8974-4500-aa3d-13ee80c3286f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:52.661425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03607d-8974-4500-aa3d-13ee80c3286f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:52.666125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5803dfd-05cb-44f0-8213-2af87821abd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:52.666786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5803dfd-05cb-44f0-8213-2af87821abd9 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:52.668390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5803dfd-05cb-44f0-8213-2af87821abd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:52.668390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5803dfd-05cb-44f0-8213-2af87821abd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:52.668390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5803dfd-05cb-44f0-8213-2af87821abd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:49:52.668390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5803dfd-05cb-44f0-8213-2af87821abd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:52.669987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5803dfd-05cb-44f0-8213-2af87821abd9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:52.682603 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3720/7426] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:49:52.686948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e71cd-1f1c-44b0-a3b6-f7d52b0207f1 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:52.696873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e71cd-1f1c-44b0-a3b6-f7d52b0207f1 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:52.701670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb560e0b-2419-4c14-9d53-1c377e704bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:52.702361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb560e0b-2419-4c14-9d53-1c377e704bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:52.702653 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb560e0b-2419-4c14-9d53-1c377e704bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:52.702939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb560e0b-2419-4c14-9d53-1c377e704bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:52.703645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb560e0b-2419-4c14-9d53-1c377e704bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:52.705655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb560e0b-2419-4c14-9d53-1c377e704bd4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:52.785511 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3707/7427] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:49:52 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:52.792240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5803dfd-05cb-44f0-8213-2af87821abd9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:52.803014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5803dfd-05cb-44f0-8213-2af87821abd9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:52.863160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56692b-1641-4b57-86bb-713b647165c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:52.863847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56692b-1641-4b57-86bb-713b647165c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:52.865502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56692b-1641-4b57-86bb-713b647165c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:52.865787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56692b-1641-4b57-86bb-713b647165c9 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:52.866567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56692b-1641-4b57-86bb-713b647165c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:52.868535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56692b-1641-4b57-86bb-713b647165c9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:52.999472 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3721/7428] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:49:52 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:53.002361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb560e0b-2419-4c14-9d53-1c377e704bd4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:53.016285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb560e0b-2419-4c14-9d53-1c377e704bd4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:53.021402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb865ff-1b7f-4b00-9eb0-ad80fe8e6bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:53.022065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb865ff-1b7f-4b00-9eb0-ad80fe8e6bdf admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:53.022659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb865ff-1b7f-4b00-9eb0-ad80fe8e6bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:53.022956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb865ff-1b7f-4b00-9eb0-ad80fe8e6bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:53.023692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb865ff-1b7f-4b00-9eb0-ad80fe8e6bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:53.025567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb865ff-1b7f-4b00-9eb0-ad80fe8e6bdf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:53.044085 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3708/7429] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:49:53.045811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56692b-1641-4b57-86bb-713b647165c9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:53.056735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56692b-1641-4b57-86bb-713b647165c9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:53.061831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fc3e3-1360-472a-ba1b-123a004f3c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:53.062653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fc3e3-1360-472a-ba1b-123a004f3c02 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:53.062976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fc3e3-1360-472a-ba1b-123a004f3c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:53.063260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fc3e3-1360-472a-ba1b-123a004f3c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:53.064060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fc3e3-1360-472a-ba1b-123a004f3c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:53.065724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fc3e3-1360-472a-ba1b-123a004f3c02 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:53.076280 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3722/7430] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:49:53.080672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb865ff-1b7f-4b00-9eb0-ad80fe8e6bdf admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:53.091409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb865ff-1b7f-4b00-9eb0-ad80fe8e6bdf admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:53.103070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2e6ba-dbfe-47aa-a062-b8f85004bad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:53.104139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2e6ba-dbfe-47aa-a062-b8f85004bad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:53.104537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2e6ba-dbfe-47aa-a062-b8f85004bad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:53.104851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2e6ba-dbfe-47aa-a062-b8f85004bad0 admin admin] PATH_INFO: `/v3/projects/d4b6d02d54d243d3ba31f0537569ad0b/users/3dcc0cd87b004264aaa1e47b69867635/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:53.122307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2e6ba-dbfe-47aa-a062-b8f85004bad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b6d02d54d243d3ba31f0537569ad0b, user_id=3dcc0cd87b004264aaa1e47b69867635, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:53.125145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2e6ba-dbfe-47aa-a062-b8f85004bad0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:53.254230 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3709/7431] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:53 2022] PUT /identity/v3/projects/d4b6d02d54d243d3ba31f0537569ad0b/users/3dcc0cd87b004264aaa1e47b69867635/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:53.266052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25602e18-15b9-4711-9262-94007b472d57 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:53.266052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25602e18-15b9-4711-9262-94007b472d57 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:53.266295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25602e18-15b9-4711-9262-94007b472d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:53.297630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-25602e18-15b9-4711-9262-94007b472d57 None None] MFA Rules not processed for user `3dcc0cd87b004264aaa1e47b69867635`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:53.299468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-25602e18-15b9-4711-9262-94007b472d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:53.365032 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3723/7432] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:49:53.372228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2e6ba-dbfe-47aa-a062-b8f85004bad0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:53.435248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2e6ba-dbfe-47aa-a062-b8f85004bad0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:53.440148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2e4a5-26e2-46a6-b0bf-db3abf479c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:53.440839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2e4a5-26e2-46a6-b0bf-db3abf479c0a admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:53.441129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2e4a5-26e2-46a6-b0bf-db3abf479c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:53.441412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2e4a5-26e2-46a6-b0bf-db3abf479c0a admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:53.442100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2e4a5-26e2-46a6-b0bf-db3abf479c0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:53.444014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2e4a5-26e2-46a6-b0bf-db3abf479c0a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:53.505074 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3710/7433] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:49:53 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:49:53.509167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25602e18-15b9-4711-9262-94007b472d57 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:53.520305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25602e18-15b9-4711-9262-94007b472d57 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:53.574252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53238c4e-b6bf-463a-82e1-6adc7d962ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:53.574926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53238c4e-b6bf-463a-82e1-6adc7d962ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:53.575197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53238c4e-b6bf-463a-82e1-6adc7d962ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:53.575474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53238c4e-b6bf-463a-82e1-6adc7d962ce5 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:53.576156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53238c4e-b6bf-463a-82e1-6adc7d962ce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:53.578090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53238c4e-b6bf-463a-82e1-6adc7d962ce5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:53.652949 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3724/7434] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:49:53 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:49:53.657025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2e4a5-26e2-46a6-b0bf-db3abf479c0a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:53.667928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2e4a5-26e2-46a6-b0bf-db3abf479c0a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:53.672570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdc54a-cd7c-4ba3-8086-613780af2938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:53.673289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdc54a-cd7c-4ba3-8086-613780af2938 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:53.673805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdc54a-cd7c-4ba3-8086-613780af2938 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:53.673923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdc54a-cd7c-4ba3-8086-613780af2938 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:53.674639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdc54a-cd7c-4ba3-8086-613780af2938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:53.676229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdc54a-cd7c-4ba3-8086-613780af2938 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:53.686931 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3711/7435] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:49:53.692735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53238c4e-b6bf-463a-82e1-6adc7d962ce5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:53.702737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53238c4e-b6bf-463a-82e1-6adc7d962ce5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:53.708069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692145d-2210-4f83-a5c0-a828aa97f609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:53.709006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692145d-2210-4f83-a5c0-a828aa97f609 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:53.709431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692145d-2210-4f83-a5c0-a828aa97f609 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:53.713026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692145d-2210-4f83-a5c0-a828aa97f609 admin admin] PATH_INFO: `/v3/projects/4dc6dde87c314661a7cfd925630a9378/users/e3941352ac214755addf8c4f2f3b47ae/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:53.724076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692145d-2210-4f83-a5c0-a828aa97f609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dc6dde87c314661a7cfd925630a9378, user_id=e3941352ac214755addf8c4f2f3b47ae, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:53.726784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692145d-2210-4f83-a5c0-a828aa97f609 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:53.806814 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3725/7436] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:53 2022] PUT /identity/v3/projects/4dc6dde87c314661a7cfd925630a9378/users/e3941352ac214755addf8c4f2f3b47ae/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:53.816298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdc54a-cd7c-4ba3-8086-613780af2938 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:53.826189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdc54a-cd7c-4ba3-8086-613780af2938 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:53.882751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accef34b-5860-4ba5-b12b-f3ae26d05a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:53.883425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accef34b-5860-4ba5-b12b-f3ae26d05a5e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:53.883714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accef34b-5860-4ba5-b12b-f3ae26d05a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:53.883995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accef34b-5860-4ba5-b12b-f3ae26d05a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:53.884756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accef34b-5860-4ba5-b12b-f3ae26d05a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:53.886386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accef34b-5860-4ba5-b12b-f3ae26d05a5e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:53.896570 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3712/7437] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:49:53.900841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692145d-2210-4f83-a5c0-a828aa97f609 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:53.911307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692145d-2210-4f83-a5c0-a828aa97f609 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:53.916788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd05b2-04c6-4fb0-9947-d242e950147e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:53.917689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd05b2-04c6-4fb0-9947-d242e950147e admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:53.917976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd05b2-04c6-4fb0-9947-d242e950147e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:53.918260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd05b2-04c6-4fb0-9947-d242e950147e admin admin] PATH_INFO: `/v3/projects/4dc6dde87c314661a7cfd925630a9378/users/e3941352ac214755addf8c4f2f3b47ae/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:53.920277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd05b2-04c6-4fb0-9947-d242e950147e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dc6dde87c314661a7cfd925630a9378, user_id=e3941352ac214755addf8c4f2f3b47ae, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:53.922940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd05b2-04c6-4fb0-9947-d242e950147e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:53.933511 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3726/7438] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:49:53 2022] PUT /identity/v3/projects/4dc6dde87c314661a7cfd925630a9378/users/e3941352ac214755addf8c4f2f3b47ae/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:53.944259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fcc61-0d77-4de3-bc64-158819981f8b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:53.944547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fcc61-0d77-4de3-bc64-158819981f8b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:53.944857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fcc61-0d77-4de3-bc64-158819981f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:53.971095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-1c3fcc61-0d77-4de3-bc64-158819981f8b None None] MFA Rules not processed for user `e3941352ac214755addf8c4f2f3b47ae`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:53.972306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1c3fcc61-0d77-4de3-bc64-158819981f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:54.040163 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3713/7439] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:53 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:54.054977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd05b2-04c6-4fb0-9947-d242e950147e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:54.070315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd05b2-04c6-4fb0-9947-d242e950147e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:54.075274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ea38a-9375-4659-8afd-0781144f2c0e tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3941352ac214755addf8c4f2f3b47ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dc6dde87c314661a7cfd925630a9378', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:54.075996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ea38a-9375-4659-8afd-0781144f2c0e tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:54.076290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ea38a-9375-4659-8afd-0781144f2c0e tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:54.076587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ea38a-9375-4659-8afd-0781144f2c0e tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:54.077442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ea38a-9375-4659-8afd-0781144f2c0e tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:49:54.077755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ea38a-9375-4659-8afd-0781144f2c0e tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:54.079478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ea38a-9375-4659-8afd-0781144f2c0e tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:54.091730 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3727/7440] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:49:54.096099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fcc61-0d77-4de3-bc64-158819981f8b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:54.106243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fcc61-0d77-4de3-bc64-158819981f8b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:54.111591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982cd75-4e4a-403d-ba45-47ca9e85edcb tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3941352ac214755addf8c4f2f3b47ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dc6dde87c314661a7cfd925630a9378', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:54.112257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982cd75-4e4a-403d-ba45-47ca9e85edcb tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:54.112541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982cd75-4e4a-403d-ba45-47ca9e85edcb tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:54.112872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982cd75-4e4a-403d-ba45-47ca9e85edcb tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:54.113584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982cd75-4e4a-403d-ba45-47ca9e85edcb tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:54.115539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982cd75-4e4a-403d-ba45-47ca9e85edcb tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:54.197489 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3714/7441] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:49:54 2022] POST /identity/v3/projects => generated 349 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:49:54.202448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ea38a-9375-4659-8afd-0781144f2c0e tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:54.212514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ea38a-9375-4659-8afd-0781144f2c0e tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:54.269240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b407b-19e7-463e-852b-c187bc7c145d tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3941352ac214755addf8c4f2f3b47ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dc6dde87c314661a7cfd925630a9378', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:54.270080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b407b-19e7-463e-852b-c187bc7c145d tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:54.270198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b407b-19e7-463e-852b-c187bc7c145d tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:54.270481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b407b-19e7-463e-852b-c187bc7c145d tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:54.271212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b407b-19e7-463e-852b-c187bc7c145d tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:49:54.271510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b407b-19e7-463e-852b-c187bc7c145d tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:54.273131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b407b-19e7-463e-852b-c187bc7c145d tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:54.284660 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3728/7442] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:49:54.294550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982cd75-4e4a-403d-ba45-47ca9e85edcb tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:54.296340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a982cd75-4e4a-403d-ba45-47ca9e85edcb tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:54.357508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982cd75-4e4a-403d-ba45-47ca9e85edcb tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:54.361381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d987f3-ab43-4ec3-a516-447dc80e20b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:54.362717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d987f3-ab43-4ec3-a516-447dc80e20b2 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:54.363001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d987f3-ab43-4ec3-a516-447dc80e20b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:54.363335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d987f3-ab43-4ec3-a516-447dc80e20b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:54.379057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d987f3-ab43-4ec3-a516-447dc80e20b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:54.380949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d987f3-ab43-4ec3-a516-447dc80e20b2 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:54.393697 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3715/7443] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:49:54 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:49:57.050173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b407b-19e7-463e-852b-c187bc7c145d tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:57.060883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b407b-19e7-463e-852b-c187bc7c145d tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:57.066659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910907d-2396-4d05-a550-10901e10ab9b tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3941352ac214755addf8c4f2f3b47ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dc6dde87c314661a7cfd925630a9378', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:57.067556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910907d-2396-4d05-a550-10901e10ab9b tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:57.067840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910907d-2396-4d05-a550-10901e10ab9b tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:57.068475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910907d-2396-4d05-a550-10901e10ab9b tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] PATH_INFO: `/v3/projects/8e70c05d869a4d32a26584c3b1b0205e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:57.069367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910907d-2396-4d05-a550-10901e10ab9b tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8e70c05d869a4d32a26584c3b1b0205e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:57.071262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910907d-2396-4d05-a550-10901e10ab9b tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:57.201476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1910907d-2396-4d05-a550-10901e10ab9b tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e70c05d869a4d32a26584c3b1b0205e', 'request_id': 'req-1910907d-2396-4d05-a550-10901e10ab9b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:57.292373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1910907d-2396-4d05-a550-10901e10ab9b tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e70c05d869a4d32a26584c3b1b0205e', 'request_id': 'req-1910907d-2396-4d05-a550-10901e10ab9b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:57.300126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1910907d-2396-4d05-a550-10901e10ab9b tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e70c05d869a4d32a26584c3b1b0205e', 'request_id': 'req-1910907d-2396-4d05-a550-10901e10ab9b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:57.313934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1910907d-2396-4d05-a550-10901e10ab9b tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] The token cache is being invalidate because project 8e70c05d869a4d32a26584c3b1b0205e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:57.314871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1910907d-2396-4d05-a550-10901e10ab9b tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:57.315628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1910907d-2396-4d05-a550-10901e10ab9b tempest-QuotasNegativeTest-262154140 tempest-QuotasNegativeTest-262154140-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:57.317512 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3729/7444] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:57 2022] DELETE /identity/v3/projects/8e70c05d869a4d32a26584c3b1b0205e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:57.322453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d987f3-ab43-4ec3-a516-447dc80e20b2 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:57.398371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d987f3-ab43-4ec3-a516-447dc80e20b2 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:57.465295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4e602-b91f-4176-8e9c-91df14cf58d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:57.466532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4e602-b91f-4176-8e9c-91df14cf58d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:57.466856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4e602-b91f-4176-8e9c-91df14cf58d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:57.467275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4e602-b91f-4176-8e9c-91df14cf58d0 admin admin] PATH_INFO: `/v3/users/3dcc0cd87b004264aaa1e47b69867635` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:57.469114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4e602-b91f-4176-8e9c-91df14cf58d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dcc0cd87b004264aaa1e47b69867635)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:57.471756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4e602-b91f-4176-8e9c-91df14cf58d0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:57.738418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5eb4e602-b91f-4176-8e9c-91df14cf58d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dcc0cd87b004264aaa1e47b69867635'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:57.758358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5eb4e602-b91f-4176-8e9c-91df14cf58d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dcc0cd87b004264aaa1e47b69867635'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:57.759204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5eb4e602-b91f-4176-8e9c-91df14cf58d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dcc0cd87b004264aaa1e47b69867635'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:57.768394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5eb4e602-b91f-4176-8e9c-91df14cf58d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dcc0cd87b004264aaa1e47b69867635'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:57.848786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5eb4e602-b91f-4176-8e9c-91df14cf58d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dcc0cd87b004264aaa1e47b69867635'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:57.857061 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3716/7445] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:49:57 2022] DELETE /identity/v3/users/3dcc0cd87b004264aaa1e47b69867635 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:57.862395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd457d8e-13c7-45af-b4f4-44e85d2da35b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:57.862695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd457d8e-13c7-45af-b4f4-44e85d2da35b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:57.862989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd457d8e-13c7-45af-b4f4-44e85d2da35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:57.893580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-dd457d8e-13c7-45af-b4f4-44e85d2da35b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:49:57.895242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dd457d8e-13c7-45af-b4f4-44e85d2da35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:57.967647 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3730/7446] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:49:57.978469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4e602-b91f-4176-8e9c-91df14cf58d0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:57.980254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5eb4e602-b91f-4176-8e9c-91df14cf58d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:58.047611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4e602-b91f-4176-8e9c-91df14cf58d0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:58.051437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eef185-0fff-4367-a051-5a52c83f00a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:58.056968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eef185-0fff-4367-a051-5a52c83f00a8 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:58.057264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eef185-0fff-4367-a051-5a52c83f00a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:58.057568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eef185-0fff-4367-a051-5a52c83f00a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:58.071048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eef185-0fff-4367-a051-5a52c83f00a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:58.073255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eef185-0fff-4367-a051-5a52c83f00a8 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:58.084709 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3717/7447] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:49:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:49:58.747335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd457d8e-13c7-45af-b4f4-44e85d2da35b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:58.748909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dd457d8e-13c7-45af-b4f4-44e85d2da35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:58.776055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd457d8e-13c7-45af-b4f4-44e85d2da35b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:58.777566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b1a8b-1026-4f2e-b43f-a36c022a5a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:58.778439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b1a8b-1026-4f2e-b43f-a36c022a5a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:58.778750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b1a8b-1026-4f2e-b43f-a36c022a5a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:58.779029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b1a8b-1026-4f2e-b43f-a36c022a5a7a admin admin] PATH_INFO: `/v3/projects/d4b6d02d54d243d3ba31f0537569ad0b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:58.780400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b1a8b-1026-4f2e-b43f-a36c022a5a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b6d02d54d243d3ba31f0537569ad0b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:58.782522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b1a8b-1026-4f2e-b43f-a36c022a5a7a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:58.958879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b55b1a8b-1026-4f2e-b43f-a36c022a5a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b6d02d54d243d3ba31f0537569ad0b', 'request_id': 'req-b55b1a8b-1026-4f2e-b43f-a36c022a5a7a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:59.035909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b55b1a8b-1026-4f2e-b43f-a36c022a5a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b6d02d54d243d3ba31f0537569ad0b', 'request_id': 'req-b55b1a8b-1026-4f2e-b43f-a36c022a5a7a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:59.044611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b55b1a8b-1026-4f2e-b43f-a36c022a5a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b6d02d54d243d3ba31f0537569ad0b', 'request_id': 'req-b55b1a8b-1026-4f2e-b43f-a36c022a5a7a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:59.057069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b55b1a8b-1026-4f2e-b43f-a36c022a5a7a admin admin] The token cache is being invalidate because project d4b6d02d54d243d3ba31f0537569ad0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:49:59.057450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b55b1a8b-1026-4f2e-b43f-a36c022a5a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:59.058305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b55b1a8b-1026-4f2e-b43f-a36c022a5a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:59.059992 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3731/7448] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:58 2022] DELETE /identity/v3/projects/d4b6d02d54d243d3ba31f0537569ad0b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:59.064005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eef185-0fff-4367-a051-5a52c83f00a8 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:59.074846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eef185-0fff-4367-a051-5a52c83f00a8 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:49:59.150246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda84ba5-ca44-4936-9f51-f3faf5c21386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:49:59.151320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda84ba5-ca44-4936-9f51-f3faf5c21386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:49:59.151777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda84ba5-ca44-4936-9f51-f3faf5c21386 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:49:59.152192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda84ba5-ca44-4936-9f51-f3faf5c21386 admin admin] PATH_INFO: `/v3/users/e3941352ac214755addf8c4f2f3b47ae` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:49:59.157280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda84ba5-ca44-4936-9f51-f3faf5c21386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3941352ac214755addf8c4f2f3b47ae)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:49:59.160543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda84ba5-ca44-4936-9f51-f3faf5c21386 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:49:59.348121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cda84ba5-ca44-4936-9f51-f3faf5c21386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3941352ac214755addf8c4f2f3b47ae'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:59.361602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cda84ba5-ca44-4936-9f51-f3faf5c21386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3941352ac214755addf8c4f2f3b47ae'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:59.362655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cda84ba5-ca44-4936-9f51-f3faf5c21386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3941352ac214755addf8c4f2f3b47ae'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:59.370363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cda84ba5-ca44-4936-9f51-f3faf5c21386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3941352ac214755addf8c4f2f3b47ae'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:59.445666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cda84ba5-ca44-4936-9f51-f3faf5c21386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3941352ac214755addf8c4f2f3b47ae'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:49:59.452257 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3718/7449] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:49:59 2022] DELETE /identity/v3/users/e3941352ac214755addf8c4f2f3b47ae => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:49:59.960948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b1a8b-1026-4f2e-b43f-a36c022a5a7a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:49:59.963574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b55b1a8b-1026-4f2e-b43f-a36c022a5a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:49:59.979633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b1a8b-1026-4f2e-b43f-a36c022a5a7a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:00.054270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fa31e-5824-417b-b5e1-4c3d6427ca02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:00.055285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fa31e-5824-417b-b5e1-4c3d6427ca02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:00.055389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fa31e-5824-417b-b5e1-4c3d6427ca02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:00.055664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fa31e-5824-417b-b5e1-4c3d6427ca02 admin admin] PATH_INFO: `/v3/projects/4dc6dde87c314661a7cfd925630a9378` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:00.057223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46fa31e-5824-417b-b5e1-4c3d6427ca02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dc6dde87c314661a7cfd925630a9378)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:00.059388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46fa31e-5824-417b-b5e1-4c3d6427ca02 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:00.222860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a46fa31e-5824-417b-b5e1-4c3d6427ca02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dc6dde87c314661a7cfd925630a9378', 'request_id': 'req-a46fa31e-5824-417b-b5e1-4c3d6427ca02'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:00.327012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a46fa31e-5824-417b-b5e1-4c3d6427ca02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dc6dde87c314661a7cfd925630a9378', 'request_id': 'req-a46fa31e-5824-417b-b5e1-4c3d6427ca02'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:00.333747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a46fa31e-5824-417b-b5e1-4c3d6427ca02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dc6dde87c314661a7cfd925630a9378', 'request_id': 'req-a46fa31e-5824-417b-b5e1-4c3d6427ca02'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:00.344019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a46fa31e-5824-417b-b5e1-4c3d6427ca02 admin admin] The token cache is being invalidate because project 4dc6dde87c314661a7cfd925630a9378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:50:00.344316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a46fa31e-5824-417b-b5e1-4c3d6427ca02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:00.344992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a46fa31e-5824-417b-b5e1-4c3d6427ca02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:00.346577 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3732/7450] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:49:59 2022] DELETE /identity/v3/projects/4dc6dde87c314661a7cfd925630a9378 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:00.352504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ed0aa-d72f-4f98-bfc4-264014aacf91 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:00.353207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ed0aa-d72f-4f98-bfc4-264014aacf91 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:00.353207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ed0aa-d72f-4f98-bfc4-264014aacf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:00.384040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2a8ed0aa-d72f-4f98-bfc4-264014aacf91 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:00.385464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2a8ed0aa-d72f-4f98-bfc4-264014aacf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:00.457954 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3719/7451] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:50:00.466988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a439b6-4ed5-409a-86d7-2ee0d0d5edc4 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:00.467278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a439b6-4ed5-409a-86d7-2ee0d0d5edc4 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:00.467565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a439b6-4ed5-409a-86d7-2ee0d0d5edc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:00.487860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d9a439b6-4ed5-409a-86d7-2ee0d0d5edc4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:00.489139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d9a439b6-4ed5-409a-86d7-2ee0d0d5edc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:00.498921 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3733/7452] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:00.506176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ed0aa-d72f-4f98-bfc4-264014aacf91 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:00.516671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ed0aa-d72f-4f98-bfc4-264014aacf91 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:00.521650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34151f-1464-4a22-b687-f0ab9b18852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:00.522525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34151f-1464-4a22-b687-f0ab9b18852b admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:00.522910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34151f-1464-4a22-b687-f0ab9b18852b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:00.523359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34151f-1464-4a22-b687-f0ab9b18852b admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:00.524218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34151f-1464-4a22-b687-f0ab9b18852b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:50:00.524637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34151f-1464-4a22-b687-f0ab9b18852b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:00.526671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34151f-1464-4a22-b687-f0ab9b18852b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:00.539178 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3720/7453] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:50:00.544356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a439b6-4ed5-409a-86d7-2ee0d0d5edc4 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:00.556866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a439b6-4ed5-409a-86d7-2ee0d0d5edc4 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:00.562159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9151081-af4f-4bf5-aceb-e09fab3907cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:00.562827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9151081-af4f-4bf5-aceb-e09fab3907cd admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:00.563118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9151081-af4f-4bf5-aceb-e09fab3907cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:00.563397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9151081-af4f-4bf5-aceb-e09fab3907cd admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:00.564131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9151081-af4f-4bf5-aceb-e09fab3907cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:00.566107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9151081-af4f-4bf5-aceb-e09fab3907cd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:00.661485 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3734/7454] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:50:00 2022] POST /identity/v3/projects => generated 407 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:50:00.665749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34151f-1464-4a22-b687-f0ab9b18852b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:00.676510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34151f-1464-4a22-b687-f0ab9b18852b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:00.733862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5c47c-e832-4437-b4c3-fd330690bcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:00.734542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5c47c-e832-4437-b4c3-fd330690bcb4 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:00.734838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5c47c-e832-4437-b4c3-fd330690bcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:00.735122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5c47c-e832-4437-b4c3-fd330690bcb4 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:00.735823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5c47c-e832-4437-b4c3-fd330690bcb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:00.738449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5c47c-e832-4437-b4c3-fd330690bcb4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:00.827672 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3721/7455] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:50:00 2022] POST /identity/v3/users => generated 304 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:50:00.829089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9151081-af4f-4bf5-aceb-e09fab3907cd admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:00.841633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9151081-af4f-4bf5-aceb-e09fab3907cd admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:00.850028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dfd23-952a-4a03-b1d6-2874089abf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:00.850028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dfd23-952a-4a03-b1d6-2874089abf6a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:00.850028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dfd23-952a-4a03-b1d6-2874089abf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:00.850256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dfd23-952a-4a03-b1d6-2874089abf6a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:00.851045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dfd23-952a-4a03-b1d6-2874089abf6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:00.852742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dfd23-952a-4a03-b1d6-2874089abf6a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:00.864929 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3735/7456] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:50:00.869039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5c47c-e832-4437-b4c3-fd330690bcb4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:00.891059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5c47c-e832-4437-b4c3-fd330690bcb4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:00.891059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5c0ac-e2e2-4634-8e00-fd88703c71c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:00.891059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5c0ac-e2e2-4634-8e00-fd88703c71c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:00.891059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5c0ac-e2e2-4634-8e00-fd88703c71c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:00.892836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5c0ac-e2e2-4634-8e00-fd88703c71c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:00.892836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5c0ac-e2e2-4634-8e00-fd88703c71c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:00.892836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5c0ac-e2e2-4634-8e00-fd88703c71c3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:00.911675 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3722/7457] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:50:00.915662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dfd23-952a-4a03-b1d6-2874089abf6a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:00.926792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dfd23-952a-4a03-b1d6-2874089abf6a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:00.931845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98fb93-027a-41c3-bda7-8e299d691c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:00.932923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98fb93-027a-41c3-bda7-8e299d691c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:00.933248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98fb93-027a-41c3-bda7-8e299d691c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:00.933542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98fb93-027a-41c3-bda7-8e299d691c1c admin admin] PATH_INFO: `/v3/projects/ad642d2645e84e6d9636481e6b8eb8a2/users/201880b55ab248cb9f9c3473116b2b44/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:00.949462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98fb93-027a-41c3-bda7-8e299d691c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad642d2645e84e6d9636481e6b8eb8a2, user_id=201880b55ab248cb9f9c3473116b2b44, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:00.952145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98fb93-027a-41c3-bda7-8e299d691c1c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:01.020537 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3736/7458] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:50:00 2022] PUT /identity/v3/projects/ad642d2645e84e6d9636481e6b8eb8a2/users/201880b55ab248cb9f9c3473116b2b44/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:01.035497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a898b05-0fee-4e87-ae31-19fa98c8d0f4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:01.035949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a898b05-0fee-4e87-ae31-19fa98c8d0f4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:01.036269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a898b05-0fee-4e87-ae31-19fa98c8d0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:01.069747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4a898b05-0fee-4e87-ae31-19fa98c8d0f4 None None] MFA Rules not processed for user `201880b55ab248cb9f9c3473116b2b44`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:01.071091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4a898b05-0fee-4e87-ae31-19fa98c8d0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:01.166422 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3723/7459] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:01 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:50:01.170558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98fb93-027a-41c3-bda7-8e299d691c1c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:01.244321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98fb93-027a-41c3-bda7-8e299d691c1c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:01.249170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b38d3-903b-415a-a6af-3544622a304d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:01.249862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b38d3-903b-415a-a6af-3544622a304d admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:01.250145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b38d3-903b-415a-a6af-3544622a304d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:01.250425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b38d3-903b-415a-a6af-3544622a304d admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:01.251116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b38d3-903b-415a-a6af-3544622a304d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:01.253296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b38d3-903b-415a-a6af-3544622a304d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:01.353084 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3737/7460] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:50:01 2022] POST /identity/v3/projects => generated 407 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:50:01.357167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a898b05-0fee-4e87-ae31-19fa98c8d0f4 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:01.368842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a898b05-0fee-4e87-ae31-19fa98c8d0f4 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:01.426722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0d18f-f8ae-4d53-b5b6-348aebd8a327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:01.427326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0d18f-f8ae-4d53-b5b6-348aebd8a327 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:01.427613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0d18f-f8ae-4d53-b5b6-348aebd8a327 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:01.427904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0d18f-f8ae-4d53-b5b6-348aebd8a327 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:01.428646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0d18f-f8ae-4d53-b5b6-348aebd8a327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:01.430583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0d18f-f8ae-4d53-b5b6-348aebd8a327 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:01.529350 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3724/7461] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:50:01 2022] POST /identity/v3/users => generated 310 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:50:01.533885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b38d3-903b-415a-a6af-3544622a304d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:01.545027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b38d3-903b-415a-a6af-3544622a304d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:01.550632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e3775-deb3-49cb-aec5-75d175c20efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:01.551304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e3775-deb3-49cb-aec5-75d175c20efb admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:01.551587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e3775-deb3-49cb-aec5-75d175c20efb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:01.551888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e3775-deb3-49cb-aec5-75d175c20efb admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:01.552673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e3775-deb3-49cb-aec5-75d175c20efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:01.554315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e3775-deb3-49cb-aec5-75d175c20efb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:01.565423 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3738/7462] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:50:01.569554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0d18f-f8ae-4d53-b5b6-348aebd8a327 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:01.580346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0d18f-f8ae-4d53-b5b6-348aebd8a327 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:01.585184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b5a8c-bef7-4486-a67a-0bce22811768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:01.586071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b5a8c-bef7-4486-a67a-0bce22811768 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:01.586357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b5a8c-bef7-4486-a67a-0bce22811768 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:01.586639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b5a8c-bef7-4486-a67a-0bce22811768 admin admin] PATH_INFO: `/v3/projects/a8b15c0cc99943de8f7aabbc27b6f365/users/e02f0c2ec3254cbfaed3ca60b9681e95/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:01.601760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b5a8c-bef7-4486-a67a-0bce22811768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8b15c0cc99943de8f7aabbc27b6f365, user_id=e02f0c2ec3254cbfaed3ca60b9681e95, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:01.604476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b5a8c-bef7-4486-a67a-0bce22811768 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:01.697412 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3725/7463] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:50:01 2022] PUT /identity/v3/projects/a8b15c0cc99943de8f7aabbc27b6f365/users/e02f0c2ec3254cbfaed3ca60b9681e95/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:01.701332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e3775-deb3-49cb-aec5-75d175c20efb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:01.711700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e3775-deb3-49cb-aec5-75d175c20efb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:01.766653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a16a0e-6538-440a-88b2-7f7908c40d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:01.767894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a16a0e-6538-440a-88b2-7f7908c40d05 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:01.768152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a16a0e-6538-440a-88b2-7f7908c40d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:01.768475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a16a0e-6538-440a-88b2-7f7908c40d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:01.769273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a16a0e-6538-440a-88b2-7f7908c40d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:01.770922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a16a0e-6538-440a-88b2-7f7908c40d05 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:01.785254 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3739/7464] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:50:01.786602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b5a8c-bef7-4486-a67a-0bce22811768 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:01.803531 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b5a8c-bef7-4486-a67a-0bce22811768 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:01.809561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93930aef-0c15-43c4-9777-bd17e45abf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:01.810115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93930aef-0c15-43c4-9777-bd17e45abf87 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:01.810400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93930aef-0c15-43c4-9777-bd17e45abf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:01.810718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93930aef-0c15-43c4-9777-bd17e45abf87 admin admin] PATH_INFO: `/v3/projects/a8b15c0cc99943de8f7aabbc27b6f365/users/e02f0c2ec3254cbfaed3ca60b9681e95/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:01.819450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93930aef-0c15-43c4-9777-bd17e45abf87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8b15c0cc99943de8f7aabbc27b6f365, user_id=e02f0c2ec3254cbfaed3ca60b9681e95, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:01.819450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93930aef-0c15-43c4-9777-bd17e45abf87 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:01.826177 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3726/7465] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:50:01 2022] PUT /identity/v3/projects/a8b15c0cc99943de8f7aabbc27b6f365/users/e02f0c2ec3254cbfaed3ca60b9681e95/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:01.837289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5786da-c4a6-4ba0-a39b-b2b86686933b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:01.838906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5786da-c4a6-4ba0-a39b-b2b86686933b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:01.838906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5786da-c4a6-4ba0-a39b-b2b86686933b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:01.876407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-bd5786da-c4a6-4ba0-a39b-b2b86686933b None None] MFA Rules not processed for user `e02f0c2ec3254cbfaed3ca60b9681e95`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:01.877699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bd5786da-c4a6-4ba0-a39b-b2b86686933b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:01.944681 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3740/7466] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:01 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:01.955804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93930aef-0c15-43c4-9777-bd17e45abf87 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:01.958389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-93930aef-0c15-43c4-9777-bd17e45abf87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:02.025253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93930aef-0c15-43c4-9777-bd17e45abf87 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:02.029104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e47f4-ba85-4595-90fc-7ed7acffb822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:02.029754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e47f4-ba85-4595-90fc-7ed7acffb822 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:02.032883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e47f4-ba85-4595-90fc-7ed7acffb822 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:02.032883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e47f4-ba85-4595-90fc-7ed7acffb822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:02.086975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e47f4-ba85-4595-90fc-7ed7acffb822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:02.088428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e47f4-ba85-4595-90fc-7ed7acffb822 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:02.098008 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3727/7467] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:50:01 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:50:02.812084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5786da-c4a6-4ba0-a39b-b2b86686933b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:02.813655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bd5786da-c4a6-4ba0-a39b-b2b86686933b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:02.908627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5786da-c4a6-4ba0-a39b-b2b86686933b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:02.914786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e564e-ff2b-4d9f-bee3-2057d7605aba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:02.915448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e564e-ff2b-4d9f-bee3-2057d7605aba service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:02.915731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e564e-ff2b-4d9f-bee3-2057d7605aba service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:02.916010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e564e-ff2b-4d9f-bee3-2057d7605aba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:02.925296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e564e-ff2b-4d9f-bee3-2057d7605aba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:02.927027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e564e-ff2b-4d9f-bee3-2057d7605aba service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:02.937487 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3741/7468] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:50:02 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:50:04.082780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa224f-743d-4941-820c-284c3b5704b0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:04.083246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa224f-743d-4941-820c-284c3b5704b0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:04.083398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa224f-743d-4941-820c-284c3b5704b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:04.103083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4cfa224f-743d-4941-820c-284c3b5704b0 None None] MFA Rules not processed for user `1ca6e4cc7551419a9c5104419cd4b015`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:04.104354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4cfa224f-743d-4941-820c-284c3b5704b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:04.161700 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3728/7469] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:10.541357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e564e-ff2b-4d9f-bee3-2057d7605aba service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:10.616665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e564e-ff2b-4d9f-bee3-2057d7605aba service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:10.621394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d18ca3-0e34-4f14-b5e6-e4288d7dbe9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:10.622667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d18ca3-0e34-4f14-b5e6-e4288d7dbe9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:10.622928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d18ca3-0e34-4f14-b5e6-e4288d7dbe9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:10.623207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d18ca3-0e34-4f14-b5e6-e4288d7dbe9d admin admin] PATH_INFO: `/v3/users/201880b55ab248cb9f9c3473116b2b44` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:10.624456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d18ca3-0e34-4f14-b5e6-e4288d7dbe9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=201880b55ab248cb9f9c3473116b2b44)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:10.626867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d18ca3-0e34-4f14-b5e6-e4288d7dbe9d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:10.826175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d0d18ca3-0e34-4f14-b5e6-e4288d7dbe9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '201880b55ab248cb9f9c3473116b2b44'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:10.840373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d0d18ca3-0e34-4f14-b5e6-e4288d7dbe9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '201880b55ab248cb9f9c3473116b2b44'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:10.841198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d0d18ca3-0e34-4f14-b5e6-e4288d7dbe9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '201880b55ab248cb9f9c3473116b2b44'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:10.849087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d0d18ca3-0e34-4f14-b5e6-e4288d7dbe9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '201880b55ab248cb9f9c3473116b2b44'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:10.932518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d0d18ca3-0e34-4f14-b5e6-e4288d7dbe9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '201880b55ab248cb9f9c3473116b2b44'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:10.941268 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3742/7470] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:50:10 2022] DELETE /identity/v3/users/201880b55ab248cb9f9c3473116b2b44 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:10.945694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de643e31-85dd-4f3d-ab9e-7de2e9e9cb00 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:10.946562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de643e31-85dd-4f3d-ab9e-7de2e9e9cb00 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:10.946854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de643e31-85dd-4f3d-ab9e-7de2e9e9cb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:10.967581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-de643e31-85dd-4f3d-ab9e-7de2e9e9cb00 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:10.968797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-de643e31-85dd-4f3d-ab9e-7de2e9e9cb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:11.027436 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3729/7471] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:11.037429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d18ca3-0e34-4f14-b5e6-e4288d7dbe9d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:11.038834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d0d18ca3-0e34-4f14-b5e6-e4288d7dbe9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:11.096264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d18ca3-0e34-4f14-b5e6-e4288d7dbe9d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:11.100706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad326980-7b5b-4002-af36-7746f9e3acb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:11.101328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad326980-7b5b-4002-af36-7746f9e3acb3 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:11.101626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad326980-7b5b-4002-af36-7746f9e3acb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:11.101897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad326980-7b5b-4002-af36-7746f9e3acb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:11.112052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad326980-7b5b-4002-af36-7746f9e3acb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:11.113944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad326980-7b5b-4002-af36-7746f9e3acb3 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:11.123622 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3743/7472] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:50:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:50:11.657842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de643e31-85dd-4f3d-ab9e-7de2e9e9cb00 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:11.659780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-de643e31-85dd-4f3d-ab9e-7de2e9e9cb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:11.672386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de643e31-85dd-4f3d-ab9e-7de2e9e9cb00 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:11.678277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5daaebd-14b4-4c83-93c9-7dca9c755944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:11.679196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5daaebd-14b4-4c83-93c9-7dca9c755944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:11.679483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5daaebd-14b4-4c83-93c9-7dca9c755944 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:11.679765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5daaebd-14b4-4c83-93c9-7dca9c755944 admin admin] PATH_INFO: `/v3/projects/ad642d2645e84e6d9636481e6b8eb8a2` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:11.681001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5daaebd-14b4-4c83-93c9-7dca9c755944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad642d2645e84e6d9636481e6b8eb8a2)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:11.682920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5daaebd-14b4-4c83-93c9-7dca9c755944 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:11.790067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f5daaebd-14b4-4c83-93c9-7dca9c755944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad642d2645e84e6d9636481e6b8eb8a2', 'request_id': 'req-f5daaebd-14b4-4c83-93c9-7dca9c755944'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:11.796411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f5daaebd-14b4-4c83-93c9-7dca9c755944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad642d2645e84e6d9636481e6b8eb8a2', 'request_id': 'req-f5daaebd-14b4-4c83-93c9-7dca9c755944'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:11.898245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f5daaebd-14b4-4c83-93c9-7dca9c755944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad642d2645e84e6d9636481e6b8eb8a2', 'request_id': 'req-f5daaebd-14b4-4c83-93c9-7dca9c755944'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:11.909736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f5daaebd-14b4-4c83-93c9-7dca9c755944 admin admin] The token cache is being invalidate because project ad642d2645e84e6d9636481e6b8eb8a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:50:11.910027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f5daaebd-14b4-4c83-93c9-7dca9c755944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:11.910651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f5daaebd-14b4-4c83-93c9-7dca9c755944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:11.912241 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3730/7473] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:50:11 2022] DELETE /identity/v3/projects/ad642d2645e84e6d9636481e6b8eb8a2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:11.916499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad326980-7b5b-4002-af36-7746f9e3acb3 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:11.927091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad326980-7b5b-4002-af36-7746f9e3acb3 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:11.982121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef70fee-b5f6-47e4-8740-1defceac2645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:11.982998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef70fee-b5f6-47e4-8740-1defceac2645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:11.983288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef70fee-b5f6-47e4-8740-1defceac2645 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:11.983576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef70fee-b5f6-47e4-8740-1defceac2645 admin admin] PATH_INFO: `/v3/users/e02f0c2ec3254cbfaed3ca60b9681e95` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:11.984813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef70fee-b5f6-47e4-8740-1defceac2645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e02f0c2ec3254cbfaed3ca60b9681e95)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:11.986772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef70fee-b5f6-47e4-8740-1defceac2645 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:12.284365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2ef70fee-b5f6-47e4-8740-1defceac2645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e02f0c2ec3254cbfaed3ca60b9681e95'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:12.296163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2ef70fee-b5f6-47e4-8740-1defceac2645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e02f0c2ec3254cbfaed3ca60b9681e95'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:12.297269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2ef70fee-b5f6-47e4-8740-1defceac2645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e02f0c2ec3254cbfaed3ca60b9681e95'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:12.304194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2ef70fee-b5f6-47e4-8740-1defceac2645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e02f0c2ec3254cbfaed3ca60b9681e95'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:12.429605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2ef70fee-b5f6-47e4-8740-1defceac2645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e02f0c2ec3254cbfaed3ca60b9681e95'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:12.435994 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3744/7474] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:50:11 2022] DELETE /identity/v3/users/e02f0c2ec3254cbfaed3ca60b9681e95 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:50:12.661499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5daaebd-14b4-4c83-93c9-7dca9c755944 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:12.662995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f5daaebd-14b4-4c83-93c9-7dca9c755944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:12.676241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5daaebd-14b4-4c83-93c9-7dca9c755944 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:12.731472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b97eb-47ee-4f2b-ba70-e54b15ebcfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:12.732271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b97eb-47ee-4f2b-ba70-e54b15ebcfcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:12.732550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b97eb-47ee-4f2b-ba70-e54b15ebcfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:12.732885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b97eb-47ee-4f2b-ba70-e54b15ebcfcd admin admin] PATH_INFO: `/v3/projects/a8b15c0cc99943de8f7aabbc27b6f365` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:12.734058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b97eb-47ee-4f2b-ba70-e54b15ebcfcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8b15c0cc99943de8f7aabbc27b6f365)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:12.736054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b97eb-47ee-4f2b-ba70-e54b15ebcfcd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:12.829688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-865b97eb-47ee-4f2b-ba70-e54b15ebcfcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8b15c0cc99943de8f7aabbc27b6f365', 'request_id': 'req-865b97eb-47ee-4f2b-ba70-e54b15ebcfcd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:12.835780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-865b97eb-47ee-4f2b-ba70-e54b15ebcfcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8b15c0cc99943de8f7aabbc27b6f365', 'request_id': 'req-865b97eb-47ee-4f2b-ba70-e54b15ebcfcd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:12.886849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-865b97eb-47ee-4f2b-ba70-e54b15ebcfcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8b15c0cc99943de8f7aabbc27b6f365', 'request_id': 'req-865b97eb-47ee-4f2b-ba70-e54b15ebcfcd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:12.897357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-865b97eb-47ee-4f2b-ba70-e54b15ebcfcd admin admin] The token cache is being invalidate because project a8b15c0cc99943de8f7aabbc27b6f365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:50:12.897645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-865b97eb-47ee-4f2b-ba70-e54b15ebcfcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:12.898258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-865b97eb-47ee-4f2b-ba70-e54b15ebcfcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:12.899821 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3731/7475] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:50:12 2022] DELETE /identity/v3/projects/a8b15c0cc99943de8f7aabbc27b6f365 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:12.904695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae3ae4-3b31-4146-966c-f880ee7e84a3 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:12.904990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae3ae4-3b31-4146-966c-f880ee7e84a3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:12.905270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae3ae4-3b31-4146-966c-f880ee7e84a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:12.923139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-bcae3ae4-3b31-4146-966c-f880ee7e84a3 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:12.924938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bcae3ae4-3b31-4146-966c-f880ee7e84a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:12.983665 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3745/7476] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:12.993119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de9e42-9077-4627-99eb-6c30b2f75266 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:12.993409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de9e42-9077-4627-99eb-6c30b2f75266 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:12.993692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de9e42-9077-4627-99eb-6c30b2f75266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:13.114360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-03de9e42-9077-4627-99eb-6c30b2f75266 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:13.115565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-03de9e42-9077-4627-99eb-6c30b2f75266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:13.123570 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3732/7477] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:13.128562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae3ae4-3b31-4146-966c-f880ee7e84a3 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:13.139045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae3ae4-3b31-4146-966c-f880ee7e84a3 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:13.144503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720957ba-28d6-4db9-a9d6-618145ade61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:13.145264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720957ba-28d6-4db9-a9d6-618145ade61e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:13.145625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720957ba-28d6-4db9-a9d6-618145ade61e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:13.145907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720957ba-28d6-4db9-a9d6-618145ade61e admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:13.146649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720957ba-28d6-4db9-a9d6-618145ade61e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:50:13.147017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720957ba-28d6-4db9-a9d6-618145ade61e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:13.148627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720957ba-28d6-4db9-a9d6-618145ade61e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:13.164697 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3746/7478] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:50:13.166479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de9e42-9077-4627-99eb-6c30b2f75266 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:13.176892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de9e42-9077-4627-99eb-6c30b2f75266 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:13.182296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d80e85-d741-4b1d-bf8b-dd531a590266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:13.184938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d80e85-d741-4b1d-bf8b-dd531a590266 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:13.184938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d80e85-d741-4b1d-bf8b-dd531a590266 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:13.184938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d80e85-d741-4b1d-bf8b-dd531a590266 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:13.184938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d80e85-d741-4b1d-bf8b-dd531a590266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:13.186347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d80e85-d741-4b1d-bf8b-dd531a590266 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:13.243326 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3733/7479] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:50:13 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:50:13.247476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720957ba-28d6-4db9-a9d6-618145ade61e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:13.258551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720957ba-28d6-4db9-a9d6-618145ade61e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:13.323820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6539f-e87c-4830-90ec-b2c8f1243492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:13.324727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6539f-e87c-4830-90ec-b2c8f1243492 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:13.325159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6539f-e87c-4830-90ec-b2c8f1243492 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:13.325666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6539f-e87c-4830-90ec-b2c8f1243492 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:13.326534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6539f-e87c-4830-90ec-b2c8f1243492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:13.328457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6539f-e87c-4830-90ec-b2c8f1243492 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:13.439208 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3747/7480] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:50:13 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:50:13.440755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d80e85-d741-4b1d-bf8b-dd531a590266 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:13.451412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d80e85-d741-4b1d-bf8b-dd531a590266 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:13.456861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84c629-7dd7-4efd-9fc4-f04ee26efe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:13.457609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84c629-7dd7-4efd-9fc4-f04ee26efe32 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:13.457950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84c629-7dd7-4efd-9fc4-f04ee26efe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:13.458290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84c629-7dd7-4efd-9fc4-f04ee26efe32 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:13.462374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84c629-7dd7-4efd-9fc4-f04ee26efe32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:13.462374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84c629-7dd7-4efd-9fc4-f04ee26efe32 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:13.471968 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3734/7481] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:50:13.476243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6539f-e87c-4830-90ec-b2c8f1243492 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:13.486772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6539f-e87c-4830-90ec-b2c8f1243492 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:13.492576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a24385-f9ac-4cc8-8e0f-fc63a9b94aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:13.493396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a24385-f9ac-4cc8-8e0f-fc63a9b94aff admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:13.493641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a24385-f9ac-4cc8-8e0f-fc63a9b94aff admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:13.493926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a24385-f9ac-4cc8-8e0f-fc63a9b94aff admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:13.494656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a24385-f9ac-4cc8-8e0f-fc63a9b94aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:13.496243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a24385-f9ac-4cc8-8e0f-fc63a9b94aff admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:13.507406 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3748/7482] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:50:13.511648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84c629-7dd7-4efd-9fc4-f04ee26efe32 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:13.522353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84c629-7dd7-4efd-9fc4-f04ee26efe32 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:13.526875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333363c3-83ce-46e5-894c-25a2644d046b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:13.527746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333363c3-83ce-46e5-894c-25a2644d046b admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:13.528029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333363c3-83ce-46e5-894c-25a2644d046b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:13.528304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333363c3-83ce-46e5-894c-25a2644d046b admin admin] PATH_INFO: `/v3/projects/815da2c2841148f495e1fb41e214d69c/users/4a757f4f150b456a857c289e764525f5/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:13.542534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333363c3-83ce-46e5-894c-25a2644d046b admin admin] RBAC: Authorizing `identity:create_grant(project_id=815da2c2841148f495e1fb41e214d69c, user_id=4a757f4f150b456a857c289e764525f5, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:13.545248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333363c3-83ce-46e5-894c-25a2644d046b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:13.631670 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3735/7483] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:50:13 2022] PUT /identity/v3/projects/815da2c2841148f495e1fb41e214d69c/users/4a757f4f150b456a857c289e764525f5/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:13.641864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af9190-ca2d-4bf5-ac69-027436337fd9 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:13.642156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af9190-ca2d-4bf5-ac69-027436337fd9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:13.642672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af9190-ca2d-4bf5-ac69-027436337fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:13.669750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b9af9190-ca2d-4bf5-ac69-027436337fd9 None None] MFA Rules not processed for user `4a757f4f150b456a857c289e764525f5`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:13.670942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b9af9190-ca2d-4bf5-ac69-027436337fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:13.735054 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3749/7484] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:13.745947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333363c3-83ce-46e5-894c-25a2644d046b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:13.747613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-333363c3-83ce-46e5-894c-25a2644d046b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:13.807522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333363c3-83ce-46e5-894c-25a2644d046b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:13.811530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de925ea3-5794-4531-8a1a-eb92d50c01df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:13.812177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de925ea3-5794-4531-8a1a-eb92d50c01df service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:13.812461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de925ea3-5794-4531-8a1a-eb92d50c01df service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:13.812822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de925ea3-5794-4531-8a1a-eb92d50c01df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:13.821841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de925ea3-5794-4531-8a1a-eb92d50c01df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:13.823402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de925ea3-5794-4531-8a1a-eb92d50c01df service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:13.832900 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3736/7485] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:50:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:50:23.419391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af9190-ca2d-4bf5-ac69-027436337fd9 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:23.479070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af9190-ca2d-4bf5-ac69-027436337fd9 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:23.483588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416c128-bf4d-4b14-bd14-fcd593eb61f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:23.484487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416c128-bf4d-4b14-bd14-fcd593eb61f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:23.484799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416c128-bf4d-4b14-bd14-fcd593eb61f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:23.485079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416c128-bf4d-4b14-bd14-fcd593eb61f8 admin admin] PATH_INFO: `/v3/users/4a757f4f150b456a857c289e764525f5` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:23.486265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416c128-bf4d-4b14-bd14-fcd593eb61f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a757f4f150b456a857c289e764525f5)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:23.488702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416c128-bf4d-4b14-bd14-fcd593eb61f8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:23.630954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f416c128-bf4d-4b14-bd14-fcd593eb61f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a757f4f150b456a857c289e764525f5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:23.642590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f416c128-bf4d-4b14-bd14-fcd593eb61f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a757f4f150b456a857c289e764525f5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:23.643276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f416c128-bf4d-4b14-bd14-fcd593eb61f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a757f4f150b456a857c289e764525f5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:23.650003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f416c128-bf4d-4b14-bd14-fcd593eb61f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a757f4f150b456a857c289e764525f5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:23.772637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f416c128-bf4d-4b14-bd14-fcd593eb61f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a757f4f150b456a857c289e764525f5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:23.778976 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3750/7486] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:50:23 2022] DELETE /identity/v3/users/4a757f4f150b456a857c289e764525f5 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:23.783630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbea39-f75c-474d-a4cb-888844f91eb7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:23.784094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbea39-f75c-474d-a4cb-888844f91eb7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:23.784190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbea39-f75c-474d-a4cb-888844f91eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:23.801953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-decbea39-f75c-474d-a4cb-888844f91eb7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:23.803140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-decbea39-f75c-474d-a4cb-888844f91eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:23.860135 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3737/7487] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:23.870232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416c128-bf4d-4b14-bd14-fcd593eb61f8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:23.871664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f416c128-bf4d-4b14-bd14-fcd593eb61f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:23.930509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416c128-bf4d-4b14-bd14-fcd593eb61f8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:23.934079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a94041-2ac2-442a-9cb1-8b11ec51ce7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:23.934732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a94041-2ac2-442a-9cb1-8b11ec51ce7c service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:23.935018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a94041-2ac2-442a-9cb1-8b11ec51ce7c service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:23.935300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a94041-2ac2-442a-9cb1-8b11ec51ce7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:23.944396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a94041-2ac2-442a-9cb1-8b11ec51ce7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:23.945922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a94041-2ac2-442a-9cb1-8b11ec51ce7c service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:23.955350 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3751/7488] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:50:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:50:24.197293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbea39-f75c-474d-a4cb-888844f91eb7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:24.198727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-decbea39-f75c-474d-a4cb-888844f91eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:24.211721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbea39-f75c-474d-a4cb-888844f91eb7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:24.217072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846a613-cf82-4966-addb-2ae4b29d18e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:24.217890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846a613-cf82-4966-addb-2ae4b29d18e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:24.218175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846a613-cf82-4966-addb-2ae4b29d18e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:24.219230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846a613-cf82-4966-addb-2ae4b29d18e8 admin admin] PATH_INFO: `/v3/projects/815da2c2841148f495e1fb41e214d69c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:24.220961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846a613-cf82-4966-addb-2ae4b29d18e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=815da2c2841148f495e1fb41e214d69c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:24.223692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846a613-cf82-4966-addb-2ae4b29d18e8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:24.321370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b846a613-cf82-4966-addb-2ae4b29d18e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '815da2c2841148f495e1fb41e214d69c', 'request_id': 'req-b846a613-cf82-4966-addb-2ae4b29d18e8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:24.327512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b846a613-cf82-4966-addb-2ae4b29d18e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '815da2c2841148f495e1fb41e214d69c', 'request_id': 'req-b846a613-cf82-4966-addb-2ae4b29d18e8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:24.383881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b846a613-cf82-4966-addb-2ae4b29d18e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '815da2c2841148f495e1fb41e214d69c', 'request_id': 'req-b846a613-cf82-4966-addb-2ae4b29d18e8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:24.394094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b846a613-cf82-4966-addb-2ae4b29d18e8 admin admin] The token cache is being invalidate because project 815da2c2841148f495e1fb41e214d69c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:50:24.395019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b846a613-cf82-4966-addb-2ae4b29d18e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:24.395652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b846a613-cf82-4966-addb-2ae4b29d18e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:24.397242 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3738/7489] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:50:24 2022] DELETE /identity/v3/projects/815da2c2841148f495e1fb41e214d69c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:24.402068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604698a-ca96-495e-a328-23610e635493 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:24.402369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604698a-ca96-495e-a328-23610e635493 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:24.402659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604698a-ca96-495e-a328-23610e635493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:24.420774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b604698a-ca96-495e-a328-23610e635493 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:24.421975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b604698a-ca96-495e-a328-23610e635493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:24.480669 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3752/7490] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:24.571637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fd5b0-4c1b-4d01-a96c-eff988e29e1f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:24.571930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fd5b0-4c1b-4d01-a96c-eff988e29e1f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:24.572217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fd5b0-4c1b-4d01-a96c-eff988e29e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:24.591533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-660fd5b0-4c1b-4d01-a96c-eff988e29e1f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:24.592791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-660fd5b0-4c1b-4d01-a96c-eff988e29e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:24.600920 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3739/7491] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:24.605536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604698a-ca96-495e-a328-23610e635493 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:24.615095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604698a-ca96-495e-a328-23610e635493 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:24.619615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e78b2f-93df-4a29-a224-fb5fc661c599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:24.620261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e78b2f-93df-4a29-a224-fb5fc661c599 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:24.620541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e78b2f-93df-4a29-a224-fb5fc661c599 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:24.620850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e78b2f-93df-4a29-a224-fb5fc661c599 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:24.621596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e78b2f-93df-4a29-a224-fb5fc661c599 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:50:24.621897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e78b2f-93df-4a29-a224-fb5fc661c599 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:24.623494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e78b2f-93df-4a29-a224-fb5fc661c599 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:24.635207 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3753/7492] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:50:24.640004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fd5b0-4c1b-4d01-a96c-eff988e29e1f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:24.649951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fd5b0-4c1b-4d01-a96c-eff988e29e1f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:24.654704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf6cf8-ac66-4529-93a1-9f167909d1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:24.655350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf6cf8-ac66-4529-93a1-9f167909d1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:24.655637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf6cf8-ac66-4529-93a1-9f167909d1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:24.655919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf6cf8-ac66-4529-93a1-9f167909d1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:24.656659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf6cf8-ac66-4529-93a1-9f167909d1a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:24.658575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf6cf8-ac66-4529-93a1-9f167909d1a8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:24.745216 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3740/7493] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:50:24 2022] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:50:24.749388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e78b2f-93df-4a29-a224-fb5fc661c599 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:24.760410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e78b2f-93df-4a29-a224-fb5fc661c599 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:24.815146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7823150-89aa-4b85-ac1f-1d92ff3a62eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:24.815815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7823150-89aa-4b85-ac1f-1d92ff3a62eb admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:24.816100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7823150-89aa-4b85-ac1f-1d92ff3a62eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:24.817037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7823150-89aa-4b85-ac1f-1d92ff3a62eb admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:24.817783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7823150-89aa-4b85-ac1f-1d92ff3a62eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:24.821859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7823150-89aa-4b85-ac1f-1d92ff3a62eb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:24.943780 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3754/7494] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:50:24 2022] POST /identity/v3/users => generated 282 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:50:24.948034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf6cf8-ac66-4529-93a1-9f167909d1a8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:24.958357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf6cf8-ac66-4529-93a1-9f167909d1a8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:24.964029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f1d24-7007-4136-adad-1d5e967933f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:24.964029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f1d24-7007-4136-adad-1d5e967933f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:24.964029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f1d24-7007-4136-adad-1d5e967933f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:24.964318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f1d24-7007-4136-adad-1d5e967933f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:24.964954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f1d24-7007-4136-adad-1d5e967933f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:24.966560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f1d24-7007-4136-adad-1d5e967933f1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:24.976768 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3741/7495] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:50:24.980811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7823150-89aa-4b85-ac1f-1d92ff3a62eb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:24.993083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7823150-89aa-4b85-ac1f-1d92ff3a62eb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:24.996155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fa8b3-d49e-4318-955d-0e84d5acbb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:24.996823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fa8b3-d49e-4318-955d-0e84d5acbb30 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:24.997337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fa8b3-d49e-4318-955d-0e84d5acbb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:24.997648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fa8b3-d49e-4318-955d-0e84d5acbb30 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:24.998370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828fa8b3-d49e-4318-955d-0e84d5acbb30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:24.999987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828fa8b3-d49e-4318-955d-0e84d5acbb30 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:25.011436 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3755/7496] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:50:25.016007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f1d24-7007-4136-adad-1d5e967933f1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:25.026889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f1d24-7007-4136-adad-1d5e967933f1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:25.031424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda42f9e-abca-4ed4-862f-f28ac2af7447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:25.032336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda42f9e-abca-4ed4-862f-f28ac2af7447 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:25.032651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda42f9e-abca-4ed4-862f-f28ac2af7447 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:25.032942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda42f9e-abca-4ed4-862f-f28ac2af7447 admin admin] PATH_INFO: `/v3/projects/e95102f2c5c2486887058e53a40241e2/users/9d4e85e11cc74131bcef02c1b3224193/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:25.047184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda42f9e-abca-4ed4-862f-f28ac2af7447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95102f2c5c2486887058e53a40241e2, user_id=9d4e85e11cc74131bcef02c1b3224193, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:25.049900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda42f9e-abca-4ed4-862f-f28ac2af7447 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:25.184170 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3742/7497] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:50:25 2022] PUT /identity/v3/projects/e95102f2c5c2486887058e53a40241e2/users/9d4e85e11cc74131bcef02c1b3224193/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:25.194380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99d8f5-2379-410a-a404-6137da1613a0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:25.194666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99d8f5-2379-410a-a404-6137da1613a0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:25.194945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99d8f5-2379-410a-a404-6137da1613a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:25.220253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ab99d8f5-2379-410a-a404-6137da1613a0 None None] MFA Rules not processed for user `9d4e85e11cc74131bcef02c1b3224193`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:25.221499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ab99d8f5-2379-410a-a404-6137da1613a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:25.284490 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3756/7498] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:25 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:25.289373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda42f9e-abca-4ed4-862f-f28ac2af7447 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:25.349192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda42f9e-abca-4ed4-862f-f28ac2af7447 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:25.353863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce157692-0d8e-4d50-9c0a-3f95819a9cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:25.354520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce157692-0d8e-4d50-9c0a-3f95819a9cda admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:25.354803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce157692-0d8e-4d50-9c0a-3f95819a9cda admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:25.355079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce157692-0d8e-4d50-9c0a-3f95819a9cda admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:25.355855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce157692-0d8e-4d50-9c0a-3f95819a9cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:25.357684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce157692-0d8e-4d50-9c0a-3f95819a9cda admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:25.372626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c55a89-8110-40e9-ae1a-f0cf6e732c84 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:25.377533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c55a89-8110-40e9-ae1a-f0cf6e732c84 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:25.377533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c55a89-8110-40e9-ae1a-f0cf6e732c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:25.391024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-00c55a89-8110-40e9-ae1a-f0cf6e732c84 None None] MFA Rules not processed for user `f58c631280fb4cdb917abc34660e3325`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:25.392232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-00c55a89-8110-40e9-ae1a-f0cf6e732c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:25.442852 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3743/7499] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:50:25 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:50:25.446192 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3757/7500] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:25.446695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce157692-0d8e-4d50-9c0a-3f95819a9cda admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:25.514270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce157692-0d8e-4d50-9c0a-3f95819a9cda admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:25.520081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5ddbe-f969-4366-a573-5ea690131853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:25.520794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5ddbe-f969-4366-a573-5ea690131853 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:25.521085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5ddbe-f969-4366-a573-5ea690131853 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:25.521368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5ddbe-f969-4366-a573-5ea690131853 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:25.522062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5ddbe-f969-4366-a573-5ea690131853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:25.524034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5ddbe-f969-4366-a573-5ea690131853 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:25.639013 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3744/7501] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:50:25 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:50:25.640691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c55a89-8110-40e9-ae1a-f0cf6e732c84 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:25.651885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c55a89-8110-40e9-ae1a-f0cf6e732c84 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:25.656383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44022baf-3d7f-452c-9d46-2dfd8b79d741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:25.657109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44022baf-3d7f-452c-9d46-2dfd8b79d741 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:25.663107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44022baf-3d7f-452c-9d46-2dfd8b79d741 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:25.663107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44022baf-3d7f-452c-9d46-2dfd8b79d741 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:25.663107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44022baf-3d7f-452c-9d46-2dfd8b79d741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:25.663107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44022baf-3d7f-452c-9d46-2dfd8b79d741 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:25.672408 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3758/7502] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:50:25.676708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5ddbe-f969-4366-a573-5ea690131853 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:25.687185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5ddbe-f969-4366-a573-5ea690131853 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:25.692026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d485ffc-7f3f-472d-9ce6-b64187262ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:25.692957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d485ffc-7f3f-472d-9ce6-b64187262ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:25.693253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d485ffc-7f3f-472d-9ce6-b64187262ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:25.693591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d485ffc-7f3f-472d-9ce6-b64187262ff6 admin admin] PATH_INFO: `/v3/projects/20d9bc83ac1f416e823b04267f96f09b/users/8452cfa2485a475a90c2811595733a1d/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:25.710382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d485ffc-7f3f-472d-9ce6-b64187262ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d9bc83ac1f416e823b04267f96f09b, user_id=8452cfa2485a475a90c2811595733a1d, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:25.714240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d485ffc-7f3f-472d-9ce6-b64187262ff6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:25.801866 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3745/7503] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:50:25 2022] PUT /identity/v3/projects/20d9bc83ac1f416e823b04267f96f09b/users/8452cfa2485a475a90c2811595733a1d/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:50:25.806064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44022baf-3d7f-452c-9d46-2dfd8b79d741 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:25.815951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44022baf-3d7f-452c-9d46-2dfd8b79d741 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:25.873656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca017350-1f42-42c0-99d6-332ec3f1bb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:25.874364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca017350-1f42-42c0-99d6-332ec3f1bb9a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:25.874656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca017350-1f42-42c0-99d6-332ec3f1bb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:25.874929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca017350-1f42-42c0-99d6-332ec3f1bb9a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:25.875694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca017350-1f42-42c0-99d6-332ec3f1bb9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:25.877338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca017350-1f42-42c0-99d6-332ec3f1bb9a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:25.888410 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3759/7504] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:50:25.892672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d485ffc-7f3f-472d-9ce6-b64187262ff6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:25.903549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d485ffc-7f3f-472d-9ce6-b64187262ff6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:25.908350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc4aa5-032e-4aed-8c6a-50716a27d9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:25.909294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc4aa5-032e-4aed-8c6a-50716a27d9d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:25.909579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc4aa5-032e-4aed-8c6a-50716a27d9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:25.909933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc4aa5-032e-4aed-8c6a-50716a27d9d0 admin admin] PATH_INFO: `/v3/projects/20d9bc83ac1f416e823b04267f96f09b/users/8452cfa2485a475a90c2811595733a1d/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:25.912051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc4aa5-032e-4aed-8c6a-50716a27d9d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d9bc83ac1f416e823b04267f96f09b, user_id=8452cfa2485a475a90c2811595733a1d, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:25.914770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc4aa5-032e-4aed-8c6a-50716a27d9d0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:25.925051 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3746/7505] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:50:25 2022] PUT /identity/v3/projects/20d9bc83ac1f416e823b04267f96f09b/users/8452cfa2485a475a90c2811595733a1d/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:25.935722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c72dfa-dc81-4d20-9e9b-ab22e02c1bd8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:25.936050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c72dfa-dc81-4d20-9e9b-ab22e02c1bd8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:25.936335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c72dfa-dc81-4d20-9e9b-ab22e02c1bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:25.964003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-43c72dfa-dc81-4d20-9e9b-ab22e02c1bd8 None None] MFA Rules not processed for user `8452cfa2485a475a90c2811595733a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:25.965333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-43c72dfa-dc81-4d20-9e9b-ab22e02c1bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:26.031219 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3760/7506] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:25 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:26.042542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc4aa5-032e-4aed-8c6a-50716a27d9d0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:26.045187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3bdc4aa5-032e-4aed-8c6a-50716a27d9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:26.118075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc4aa5-032e-4aed-8c6a-50716a27d9d0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:26.122211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d1f2b-c113-445c-a3f4-65b503e23fb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:26.124311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d1f2b-c113-445c-a3f4-65b503e23fb9 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:26.124311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d1f2b-c113-445c-a3f4-65b503e23fb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:26.124311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d1f2b-c113-445c-a3f4-65b503e23fb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:26.137901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d1f2b-c113-445c-a3f4-65b503e23fb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:26.139414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d1f2b-c113-445c-a3f4-65b503e23fb9 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:26.151410 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3747/7507] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:50:26 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:50:27.213831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c72dfa-dc81-4d20-9e9b-ab22e02c1bd8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:27.287611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c72dfa-dc81-4d20-9e9b-ab22e02c1bd8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:27.292348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21acc0c6-b664-4d13-84a7-cfddbb9bb22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:27.293249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acc0c6-b664-4d13-84a7-cfddbb9bb22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:27.293534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acc0c6-b664-4d13-84a7-cfddbb9bb22b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:27.293808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acc0c6-b664-4d13-84a7-cfddbb9bb22b admin admin] PATH_INFO: `/v3/users/9d4e85e11cc74131bcef02c1b3224193` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:27.295282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21acc0c6-b664-4d13-84a7-cfddbb9bb22b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d4e85e11cc74131bcef02c1b3224193)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:27.297233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21acc0c6-b664-4d13-84a7-cfddbb9bb22b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:27.510759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-21acc0c6-b664-4d13-84a7-cfddbb9bb22b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d4e85e11cc74131bcef02c1b3224193'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:27.522903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-21acc0c6-b664-4d13-84a7-cfddbb9bb22b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d4e85e11cc74131bcef02c1b3224193'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:27.523610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-21acc0c6-b664-4d13-84a7-cfddbb9bb22b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d4e85e11cc74131bcef02c1b3224193'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:27.530558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-21acc0c6-b664-4d13-84a7-cfddbb9bb22b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d4e85e11cc74131bcef02c1b3224193'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:27.589419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-21acc0c6-b664-4d13-84a7-cfddbb9bb22b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d4e85e11cc74131bcef02c1b3224193'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:27.595747 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3761/7508] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:50:27 2022] DELETE /identity/v3/users/9d4e85e11cc74131bcef02c1b3224193 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:27.600517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3cba4-3507-4c07-a140-7e1bdfa483fe None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:27.601026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3cba4-3507-4c07-a140-7e1bdfa483fe None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:27.601116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3cba4-3507-4c07-a140-7e1bdfa483fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:27.619065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4ac3cba4-3507-4c07-a140-7e1bdfa483fe None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:27.620357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4ac3cba4-3507-4c07-a140-7e1bdfa483fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:27.680228 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3748/7509] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:27.689889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21acc0c6-b664-4d13-84a7-cfddbb9bb22b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:27.691350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-21acc0c6-b664-4d13-84a7-cfddbb9bb22b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:27.749774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21acc0c6-b664-4d13-84a7-cfddbb9bb22b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:27.753838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d20cd-2274-4671-84fc-a926c46322aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:27.760715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d20cd-2274-4671-84fc-a926c46322aa service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:27.760715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d20cd-2274-4671-84fc-a926c46322aa service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:27.760715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d20cd-2274-4671-84fc-a926c46322aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:27.765663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d20cd-2274-4671-84fc-a926c46322aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:27.767050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d20cd-2274-4671-84fc-a926c46322aa service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:27.776957 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3762/7510] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:50:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:50:28.219307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3cba4-3507-4c07-a140-7e1bdfa483fe None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:28.220839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4ac3cba4-3507-4c07-a140-7e1bdfa483fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:28.233018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3cba4-3507-4c07-a140-7e1bdfa483fe None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:28.237845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed374d33-a76d-4f61-aa3a-9e7bb08a91fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:28.238717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed374d33-a76d-4f61-aa3a-9e7bb08a91fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:28.239014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed374d33-a76d-4f61-aa3a-9e7bb08a91fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:28.239285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed374d33-a76d-4f61-aa3a-9e7bb08a91fa admin admin] PATH_INFO: `/v3/projects/e95102f2c5c2486887058e53a40241e2` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:28.240716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed374d33-a76d-4f61-aa3a-9e7bb08a91fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e95102f2c5c2486887058e53a40241e2)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:28.242661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed374d33-a76d-4f61-aa3a-9e7bb08a91fa admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:28.420005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed374d33-a76d-4f61-aa3a-9e7bb08a91fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e95102f2c5c2486887058e53a40241e2', 'request_id': 'req-ed374d33-a76d-4f61-aa3a-9e7bb08a91fa'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:28.426107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed374d33-a76d-4f61-aa3a-9e7bb08a91fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e95102f2c5c2486887058e53a40241e2', 'request_id': 'req-ed374d33-a76d-4f61-aa3a-9e7bb08a91fa'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:28.509934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed374d33-a76d-4f61-aa3a-9e7bb08a91fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e95102f2c5c2486887058e53a40241e2', 'request_id': 'req-ed374d33-a76d-4f61-aa3a-9e7bb08a91fa'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:28.521839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed374d33-a76d-4f61-aa3a-9e7bb08a91fa admin admin] The token cache is being invalidate because project e95102f2c5c2486887058e53a40241e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:50:28.521839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed374d33-a76d-4f61-aa3a-9e7bb08a91fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:28.522371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ed374d33-a76d-4f61-aa3a-9e7bb08a91fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:28.523929 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3749/7511] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:50:28 2022] DELETE /identity/v3/projects/e95102f2c5c2486887058e53a40241e2 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:28.528048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d20cd-2274-4671-84fc-a926c46322aa service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:28.539011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d20cd-2274-4671-84fc-a926c46322aa service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:28.595577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a955265-8ad4-42ae-8486-9fc09d4c77c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:28.596445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a955265-8ad4-42ae-8486-9fc09d4c77c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:28.596764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a955265-8ad4-42ae-8486-9fc09d4c77c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:28.597042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a955265-8ad4-42ae-8486-9fc09d4c77c3 admin admin] PATH_INFO: `/v3/users/8452cfa2485a475a90c2811595733a1d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:28.598222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a955265-8ad4-42ae-8486-9fc09d4c77c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8452cfa2485a475a90c2811595733a1d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:28.600237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a955265-8ad4-42ae-8486-9fc09d4c77c3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:28.843624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1a955265-8ad4-42ae-8486-9fc09d4c77c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8452cfa2485a475a90c2811595733a1d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:28.856850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1a955265-8ad4-42ae-8486-9fc09d4c77c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8452cfa2485a475a90c2811595733a1d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:28.857569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1a955265-8ad4-42ae-8486-9fc09d4c77c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8452cfa2485a475a90c2811595733a1d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:28.864883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1a955265-8ad4-42ae-8486-9fc09d4c77c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8452cfa2485a475a90c2811595733a1d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:28.950154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1a955265-8ad4-42ae-8486-9fc09d4c77c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8452cfa2485a475a90c2811595733a1d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:28.957429 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3763/7512] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:50:28 2022] DELETE /identity/v3/users/8452cfa2485a475a90c2811595733a1d => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:29.409419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed374d33-a76d-4f61-aa3a-9e7bb08a91fa admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:29.410973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ed374d33-a76d-4f61-aa3a-9e7bb08a91fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:29.454188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a955265-8ad4-42ae-8486-9fc09d4c77c3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:29.459714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1a955265-8ad4-42ae-8486-9fc09d4c77c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:29.472007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed374d33-a76d-4f61-aa3a-9e7bb08a91fa admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:29.525991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe33c1d-627d-456c-8a5e-5a53c9afe06c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:29.528749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe33c1d-627d-456c-8a5e-5a53c9afe06c service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:29.528749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe33c1d-627d-456c-8a5e-5a53c9afe06c service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:29.528749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe33c1d-627d-456c-8a5e-5a53c9afe06c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:29.529247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-efe33c1d-627d-456c-8a5e-5a53c9afe06c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:29.535787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a955265-8ad4-42ae-8486-9fc09d4c77c3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:29.541657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4902007-d96f-42a0-950f-86ad0c78d52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:29.541827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe33c1d-627d-456c-8a5e-5a53c9afe06c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:29.543141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4902007-d96f-42a0-950f-86ad0c78d52f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:29.543276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe33c1d-627d-456c-8a5e-5a53c9afe06c service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:29.543425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4902007-d96f-42a0-950f-86ad0c78d52f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:29.543819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4902007-d96f-42a0-950f-86ad0c78d52f admin admin] PATH_INFO: `/v3/projects/20d9bc83ac1f416e823b04267f96f09b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:29.544976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4902007-d96f-42a0-950f-86ad0c78d52f admin admin] RBAC: Authorizing `identity:delete_project(project_id=20d9bc83ac1f416e823b04267f96f09b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:29.547337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4902007-d96f-42a0-950f-86ad0c78d52f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:29.555304 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3750/7513] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:50:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:50:29.642524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f4902007-d96f-42a0-950f-86ad0c78d52f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20d9bc83ac1f416e823b04267f96f09b', 'request_id': 'req-f4902007-d96f-42a0-950f-86ad0c78d52f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:29.692382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f4902007-d96f-42a0-950f-86ad0c78d52f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20d9bc83ac1f416e823b04267f96f09b', 'request_id': 'req-f4902007-d96f-42a0-950f-86ad0c78d52f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:29.699560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f4902007-d96f-42a0-950f-86ad0c78d52f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20d9bc83ac1f416e823b04267f96f09b', 'request_id': 'req-f4902007-d96f-42a0-950f-86ad0c78d52f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:29.710756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f4902007-d96f-42a0-950f-86ad0c78d52f admin admin] The token cache is being invalidate because project 20d9bc83ac1f416e823b04267f96f09b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:50:29.711053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f4902007-d96f-42a0-950f-86ad0c78d52f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:29.711706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f4902007-d96f-42a0-950f-86ad0c78d52f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:29.713312 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3764/7514] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:50:29 2022] DELETE /identity/v3/projects/20d9bc83ac1f416e823b04267f96f09b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:50:29.718312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216b90c-b2c4-4c06-b596-e8d57adead56 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:29.718777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216b90c-b2c4-4c06-b596-e8d57adead56 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:29.722976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216b90c-b2c4-4c06-b596-e8d57adead56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:29.738524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3216b90c-b2c4-4c06-b596-e8d57adead56 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:29.739759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3216b90c-b2c4-4c06-b596-e8d57adead56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:29.800636 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3751/7515] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:29.809585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328370b-fac6-4c21-abf5-fc3cc1217df8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:29.809879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328370b-fac6-4c21-abf5-fc3cc1217df8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:29.810163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328370b-fac6-4c21-abf5-fc3cc1217df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:29.833902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c328370b-fac6-4c21-abf5-fc3cc1217df8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:29.835195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c328370b-fac6-4c21-abf5-fc3cc1217df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:29.843543 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3765/7516] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:29.847691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216b90c-b2c4-4c06-b596-e8d57adead56 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:29.858057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216b90c-b2c4-4c06-b596-e8d57adead56 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:29.862986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db3c58-579d-4b6f-bee4-0fab25993c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:29.863652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db3c58-579d-4b6f-bee4-0fab25993c68 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:29.863943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db3c58-579d-4b6f-bee4-0fab25993c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:29.864225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db3c58-579d-4b6f-bee4-0fab25993c68 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:29.865044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db3c58-579d-4b6f-bee4-0fab25993c68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:50:29.865420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db3c58-579d-4b6f-bee4-0fab25993c68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:29.867087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db3c58-579d-4b6f-bee4-0fab25993c68 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:29.885689 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3752/7517] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:50:29.886944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328370b-fac6-4c21-abf5-fc3cc1217df8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:29.897240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328370b-fac6-4c21-abf5-fc3cc1217df8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:29.902156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6233c-0583-49de-b79f-4561388b3f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:29.903145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6233c-0583-49de-b79f-4561388b3f90 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:29.903451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6233c-0583-49de-b79f-4561388b3f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:29.903829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6233c-0583-49de-b79f-4561388b3f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:29.904536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6233c-0583-49de-b79f-4561388b3f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:29.906481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6233c-0583-49de-b79f-4561388b3f90 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:30.002565 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3766/7518] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:50:29 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:50:30.007571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db3c58-579d-4b6f-bee4-0fab25993c68 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:30.017627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db3c58-579d-4b6f-bee4-0fab25993c68 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:30.073887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1094c90-dc8f-419e-92d2-d212bf30cb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:30.074678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1094c90-dc8f-419e-92d2-d212bf30cb5b admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:30.075022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1094c90-dc8f-419e-92d2-d212bf30cb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:30.075366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1094c90-dc8f-419e-92d2-d212bf30cb5b admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:30.076072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1094c90-dc8f-419e-92d2-d212bf30cb5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:30.078046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1094c90-dc8f-419e-92d2-d212bf30cb5b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:30.182873 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3753/7519] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:50:30 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:50:30.183935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6233c-0583-49de-b79f-4561388b3f90 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:30.194743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6233c-0583-49de-b79f-4561388b3f90 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:30.199804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e10ac-7bb4-4ce1-8858-c8f1cd11cc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:30.200472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e10ac-7bb4-4ce1-8858-c8f1cd11cc5a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:30.201061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e10ac-7bb4-4ce1-8858-c8f1cd11cc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:30.201357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e10ac-7bb4-4ce1-8858-c8f1cd11cc5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:30.202086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e10ac-7bb4-4ce1-8858-c8f1cd11cc5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:30.203735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e10ac-7bb4-4ce1-8858-c8f1cd11cc5a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:30.215221 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3767/7520] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:50:30.224465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1094c90-dc8f-419e-92d2-d212bf30cb5b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:30.234339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1094c90-dc8f-419e-92d2-d212bf30cb5b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:30.238960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2519c1-2083-480e-8f52-4056796802b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:30.240107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2519c1-2083-480e-8f52-4056796802b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:30.240390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2519c1-2083-480e-8f52-4056796802b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:30.240692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2519c1-2083-480e-8f52-4056796802b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:30.241440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2519c1-2083-480e-8f52-4056796802b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:30.243047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2519c1-2083-480e-8f52-4056796802b7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:30.253044 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3754/7521] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:50:30.258169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e10ac-7bb4-4ce1-8858-c8f1cd11cc5a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:30.268159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e10ac-7bb4-4ce1-8858-c8f1cd11cc5a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:30.272820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5fa7b-ff1c-4902-886b-e96cd32210b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:30.273700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5fa7b-ff1c-4902-886b-e96cd32210b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:30.273982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5fa7b-ff1c-4902-886b-e96cd32210b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:30.274259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5fa7b-ff1c-4902-886b-e96cd32210b9 admin admin] PATH_INFO: `/v3/projects/dffc5e15011249069b048b7c485c1ef2/users/bfbd5d35c0fd41bc86ac7809cee1cd3f/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:30.288205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5fa7b-ff1c-4902-886b-e96cd32210b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dffc5e15011249069b048b7c485c1ef2, user_id=bfbd5d35c0fd41bc86ac7809cee1cd3f, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:30.290885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5fa7b-ff1c-4902-886b-e96cd32210b9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:30.385211 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3768/7522] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:50:30 2022] PUT /identity/v3/projects/dffc5e15011249069b048b7c485c1ef2/users/bfbd5d35c0fd41bc86ac7809cee1cd3f/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:30.397786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649e9bd-b54d-4838-a5c0-e828e16ec97b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:30.398478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649e9bd-b54d-4838-a5c0-e828e16ec97b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:30.398846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649e9bd-b54d-4838-a5c0-e828e16ec97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:30.439733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3649e9bd-b54d-4838-a5c0-e828e16ec97b None None] MFA Rules not processed for user `bfbd5d35c0fd41bc86ac7809cee1cd3f`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:30.440985 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3649e9bd-b54d-4838-a5c0-e828e16ec97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:30.509210 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3755/7523] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:30.513714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5fa7b-ff1c-4902-886b-e96cd32210b9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:30.577841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5fa7b-ff1c-4902-886b-e96cd32210b9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:30.582563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdecb4-61de-4c5a-b399-d97513a6e098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:30.583262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdecb4-61de-4c5a-b399-d97513a6e098 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:30.583549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdecb4-61de-4c5a-b399-d97513a6e098 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:30.583831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdecb4-61de-4c5a-b399-d97513a6e098 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:30.584537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fdecb4-61de-4c5a-b399-d97513a6e098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:30.587112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fdecb4-61de-4c5a-b399-d97513a6e098 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:30.696696 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3769/7524] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:50:30 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:50:30.699487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649e9bd-b54d-4838-a5c0-e828e16ec97b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:30.710985 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649e9bd-b54d-4838-a5c0-e828e16ec97b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:30.777285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194d7f1-a6a0-4d71-b7f5-7f92b16a0bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:30.778219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194d7f1-a6a0-4d71-b7f5-7f92b16a0bda admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:30.778219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194d7f1-a6a0-4d71-b7f5-7f92b16a0bda admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:30.779174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194d7f1-a6a0-4d71-b7f5-7f92b16a0bda admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:30.779885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194d7f1-a6a0-4d71-b7f5-7f92b16a0bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:30.781894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194d7f1-a6a0-4d71-b7f5-7f92b16a0bda admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:30.859611 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3756/7525] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:50:30 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:50:30.863556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdecb4-61de-4c5a-b399-d97513a6e098 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:30.874105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdecb4-61de-4c5a-b399-d97513a6e098 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:30.878932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098c839-d563-4c26-b600-9b3456338b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:30.879604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098c839-d563-4c26-b600-9b3456338b93 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:30.879944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098c839-d563-4c26-b600-9b3456338b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:30.880234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098c839-d563-4c26-b600-9b3456338b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:30.880983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098c839-d563-4c26-b600-9b3456338b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:30.882835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098c839-d563-4c26-b600-9b3456338b93 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:30.894112 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3770/7526] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:50:30.898993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194d7f1-a6a0-4d71-b7f5-7f92b16a0bda admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:30.909069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194d7f1-a6a0-4d71-b7f5-7f92b16a0bda admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:30.914267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7d684-940b-41ed-abb1-be8b7abf8fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:30.915156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7d684-940b-41ed-abb1-be8b7abf8fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:30.915446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7d684-940b-41ed-abb1-be8b7abf8fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:30.915729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7d684-940b-41ed-abb1-be8b7abf8fd1 admin admin] PATH_INFO: `/v3/projects/fd8c7c2aa5ca4e1898a0af0f0cd9cb22/users/de041c0f3b3c4faca6b514a01cd2144a/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:30.930723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7d684-940b-41ed-abb1-be8b7abf8fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd8c7c2aa5ca4e1898a0af0f0cd9cb22, user_id=de041c0f3b3c4faca6b514a01cd2144a, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:30.933583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7d684-940b-41ed-abb1-be8b7abf8fd1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:31.053761 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3757/7527] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:50:30 2022] PUT /identity/v3/projects/fd8c7c2aa5ca4e1898a0af0f0cd9cb22/users/de041c0f3b3c4faca6b514a01cd2144a/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:31.057791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098c839-d563-4c26-b600-9b3456338b93 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:31.068440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098c839-d563-4c26-b600-9b3456338b93 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:31.126953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c8c63-4f7d-42ff-afc6-5f530e696ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:31.127633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c8c63-4f7d-42ff-afc6-5f530e696ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:31.127924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c8c63-4f7d-42ff-afc6-5f530e696ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:31.128207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c8c63-4f7d-42ff-afc6-5f530e696ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:31.129007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c8c63-4f7d-42ff-afc6-5f530e696ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:31.131811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c8c63-4f7d-42ff-afc6-5f530e696ec1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:31.141901 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3771/7528] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:50:31.146834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7d684-940b-41ed-abb1-be8b7abf8fd1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:31.157251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7d684-940b-41ed-abb1-be8b7abf8fd1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:31.162412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b7dce-1f1b-4d65-a536-81d2b3bc4d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:31.163295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b7dce-1f1b-4d65-a536-81d2b3bc4d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:31.163578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b7dce-1f1b-4d65-a536-81d2b3bc4d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:31.167426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b7dce-1f1b-4d65-a536-81d2b3bc4d6a admin admin] PATH_INFO: `/v3/projects/fd8c7c2aa5ca4e1898a0af0f0cd9cb22/users/de041c0f3b3c4faca6b514a01cd2144a/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:31.167426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b7dce-1f1b-4d65-a536-81d2b3bc4d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd8c7c2aa5ca4e1898a0af0f0cd9cb22, user_id=de041c0f3b3c4faca6b514a01cd2144a, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:31.169124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b7dce-1f1b-4d65-a536-81d2b3bc4d6a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:31.180732 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3758/7529] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:50:31 2022] PUT /identity/v3/projects/fd8c7c2aa5ca4e1898a0af0f0cd9cb22/users/de041c0f3b3c4faca6b514a01cd2144a/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:31.193052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab949f-8f8c-4c18-a42d-e9913004183c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:31.193431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab949f-8f8c-4c18-a42d-e9913004183c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:31.193717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab949f-8f8c-4c18-a42d-e9913004183c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:31.219885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b9ab949f-8f8c-4c18-a42d-e9913004183c None None] MFA Rules not processed for user `de041c0f3b3c4faca6b514a01cd2144a`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:31.221174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b9ab949f-8f8c-4c18-a42d-e9913004183c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:31.288844 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3772/7530] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:50:31.305375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b7dce-1f1b-4d65-a536-81d2b3bc4d6a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:31.307032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f93b7dce-1f1b-4d65-a536-81d2b3bc4d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:31.364076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b7dce-1f1b-4d65-a536-81d2b3bc4d6a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:31.367766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dd046-0bc2-4c76-8993-aecae0b7a23f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:31.368409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dd046-0bc2-4c76-8993-aecae0b7a23f service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:31.368726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dd046-0bc2-4c76-8993-aecae0b7a23f service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:31.369009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dd046-0bc2-4c76-8993-aecae0b7a23f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:31.378460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241dd046-0bc2-4c76-8993-aecae0b7a23f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:31.379931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241dd046-0bc2-4c76-8993-aecae0b7a23f service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:31.390195 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3759/7531] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:50:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:50:32.263198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab949f-8f8c-4c18-a42d-e9913004183c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:32.273260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab949f-8f8c-4c18-a42d-e9913004183c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:32.277871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a870b-4a17-499c-b3f6-c157b47b9daf tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de041c0f3b3c4faca6b514a01cd2144a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd8c7c2aa5ca4e1898a0af0f0cd9cb22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:32.278529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a870b-4a17-499c-b3f6-c157b47b9daf tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:32.278891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a870b-4a17-499c-b3f6-c157b47b9daf tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:32.279204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a870b-4a17-499c-b3f6-c157b47b9daf tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:32.279902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a870b-4a17-499c-b3f6-c157b47b9daf tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:50:32.280216 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a870b-4a17-499c-b3f6-c157b47b9daf tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:32.281845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a870b-4a17-499c-b3f6-c157b47b9daf tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:32.293694 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3773/7532] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:50:32.297696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dd046-0bc2-4c76-8993-aecae0b7a23f service cinder] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:32.306710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dd046-0bc2-4c76-8993-aecae0b7a23f service cinder] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:32.311543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27ebf3-afde-4f16-9d87-f452c80b607d tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de041c0f3b3c4faca6b514a01cd2144a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd8c7c2aa5ca4e1898a0af0f0cd9cb22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:32.312196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27ebf3-afde-4f16-9d87-f452c80b607d tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:32.312485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27ebf3-afde-4f16-9d87-f452c80b607d tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:32.312807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27ebf3-afde-4f16-9d87-f452c80b607d tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:32.313538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27ebf3-afde-4f16-9d87-f452c80b607d tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:32.315507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27ebf3-afde-4f16-9d87-f452c80b607d tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:32.419999 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3760/7533] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:50:32 2022] POST /identity/v3/projects => generated 354 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:50:32.424247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a870b-4a17-499c-b3f6-c157b47b9daf tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:32.434242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a870b-4a17-499c-b3f6-c157b47b9daf tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:32.491756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df0a47-c236-431b-bf96-5d349c63823c tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de041c0f3b3c4faca6b514a01cd2144a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd8c7c2aa5ca4e1898a0af0f0cd9cb22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:32.492347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df0a47-c236-431b-bf96-5d349c63823c tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:32.492659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df0a47-c236-431b-bf96-5d349c63823c tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:32.492942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df0a47-c236-431b-bf96-5d349c63823c tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:32.493668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df0a47-c236-431b-bf96-5d349c63823c tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:50:32.493976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df0a47-c236-431b-bf96-5d349c63823c tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:32.495553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df0a47-c236-431b-bf96-5d349c63823c tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:32.510522 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3774/7534] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:50:32.543292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27ebf3-afde-4f16-9d87-f452c80b607d tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:32.553597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27ebf3-afde-4f16-9d87-f452c80b607d tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:32.558173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b93a6-394b-47ba-bd91-b192ff02349e tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de041c0f3b3c4faca6b514a01cd2144a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd8c7c2aa5ca4e1898a0af0f0cd9cb22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:32.559049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b93a6-394b-47ba-bd91-b192ff02349e tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:32.559336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b93a6-394b-47ba-bd91-b192ff02349e tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:32.559618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b93a6-394b-47ba-bd91-b192ff02349e tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] PATH_INFO: `/v3/projects/42b6c9aaab9f427597c9fc2d26be3ecd` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:32.560892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b93a6-394b-47ba-bd91-b192ff02349e tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] RBAC: Authorizing `identity:delete_project(project_id=42b6c9aaab9f427597c9fc2d26be3ecd)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:32.562806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b93a6-394b-47ba-bd91-b192ff02349e tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:32.692393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-885b93a6-394b-47ba-bd91-b192ff02349e tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b6c9aaab9f427597c9fc2d26be3ecd', 'request_id': 'req-885b93a6-394b-47ba-bd91-b192ff02349e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:32.698439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-885b93a6-394b-47ba-bd91-b192ff02349e tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b6c9aaab9f427597c9fc2d26be3ecd', 'request_id': 'req-885b93a6-394b-47ba-bd91-b192ff02349e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:32.771561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-885b93a6-394b-47ba-bd91-b192ff02349e tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b6c9aaab9f427597c9fc2d26be3ecd', 'request_id': 'req-885b93a6-394b-47ba-bd91-b192ff02349e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:32.781841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-885b93a6-394b-47ba-bd91-b192ff02349e tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] The token cache is being invalidate because project 42b6c9aaab9f427597c9fc2d26be3ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:50:32.782129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-885b93a6-394b-47ba-bd91-b192ff02349e tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:32.782795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-885b93a6-394b-47ba-bd91-b192ff02349e tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:32.784346 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3761/7535] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:50:32 2022] DELETE /identity/v3/projects/42b6c9aaab9f427597c9fc2d26be3ecd => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:33.400318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df0a47-c236-431b-bf96-5d349c63823c tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:33.400318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-54df0a47-c236-431b-bf96-5d349c63823c tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:33.462804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df0a47-c236-431b-bf96-5d349c63823c tempest-VolumeQuotaClassesTest-1876260397 tempest-VolumeQuotaClassesTest-1876260397-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:33.515634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daa6eb-7312-4172-8dad-0a29c7bde4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:33.516499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daa6eb-7312-4172-8dad-0a29c7bde4e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:33.516813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daa6eb-7312-4172-8dad-0a29c7bde4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:33.517095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daa6eb-7312-4172-8dad-0a29c7bde4e7 admin admin] PATH_INFO: `/v3/users/bfbd5d35c0fd41bc86ac7809cee1cd3f` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:33.518298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70daa6eb-7312-4172-8dad-0a29c7bde4e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfbd5d35c0fd41bc86ac7809cee1cd3f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:33.520214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70daa6eb-7312-4172-8dad-0a29c7bde4e7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:33.660433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-70daa6eb-7312-4172-8dad-0a29c7bde4e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfbd5d35c0fd41bc86ac7809cee1cd3f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:33.671687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-70daa6eb-7312-4172-8dad-0a29c7bde4e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfbd5d35c0fd41bc86ac7809cee1cd3f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:33.672367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-70daa6eb-7312-4172-8dad-0a29c7bde4e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfbd5d35c0fd41bc86ac7809cee1cd3f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:33.679169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-70daa6eb-7312-4172-8dad-0a29c7bde4e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfbd5d35c0fd41bc86ac7809cee1cd3f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:33.743865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-70daa6eb-7312-4172-8dad-0a29c7bde4e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfbd5d35c0fd41bc86ac7809cee1cd3f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:33.750178 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3775/7536] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:50:33 2022] DELETE /identity/v3/users/bfbd5d35c0fd41bc86ac7809cee1cd3f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:33.754736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800e5c9-b1d0-4652-ab7e-3533729002f6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:33.755724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800e5c9-b1d0-4652-ab7e-3533729002f6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:33.755970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800e5c9-b1d0-4652-ab7e-3533729002f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:33.773926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b800e5c9-b1d0-4652-ab7e-3533729002f6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:33.775177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b800e5c9-b1d0-4652-ab7e-3533729002f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:33.832243 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3762/7537] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:50:33.842149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daa6eb-7312-4172-8dad-0a29c7bde4e7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:33.843562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-70daa6eb-7312-4172-8dad-0a29c7bde4e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:33.900765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daa6eb-7312-4172-8dad-0a29c7bde4e7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:33.904393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75f650-86ee-4bcf-b030-bb539c9f94fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:33.905071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75f650-86ee-4bcf-b030-bb539c9f94fe service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:33.905356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75f650-86ee-4bcf-b030-bb539c9f94fe service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:33.905661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75f650-86ee-4bcf-b030-bb539c9f94fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:33.915636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75f650-86ee-4bcf-b030-bb539c9f94fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:33.917035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75f650-86ee-4bcf-b030-bb539c9f94fe service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:33.926724 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3776/7538] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:50:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:50:34.334753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800e5c9-b1d0-4652-ab7e-3533729002f6 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:34.336206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b800e5c9-b1d0-4652-ab7e-3533729002f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:34.348291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800e5c9-b1d0-4652-ab7e-3533729002f6 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:34.354146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c195c9-5b54-4cd9-b8dd-33c57e492c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:34.354273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c195c9-5b54-4cd9-b8dd-33c57e492c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:34.354548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c195c9-5b54-4cd9-b8dd-33c57e492c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:34.355498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c195c9-5b54-4cd9-b8dd-33c57e492c74 admin admin] PATH_INFO: `/v3/projects/dffc5e15011249069b048b7c485c1ef2` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:34.357333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c195c9-5b54-4cd9-b8dd-33c57e492c74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dffc5e15011249069b048b7c485c1ef2)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:34.359327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c195c9-5b54-4cd9-b8dd-33c57e492c74 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:34.481616 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b3c195c9-5b54-4cd9-b8dd-33c57e492c74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dffc5e15011249069b048b7c485c1ef2', 'request_id': 'req-b3c195c9-5b54-4cd9-b8dd-33c57e492c74'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:34.487594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b3c195c9-5b54-4cd9-b8dd-33c57e492c74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dffc5e15011249069b048b7c485c1ef2', 'request_id': 'req-b3c195c9-5b54-4cd9-b8dd-33c57e492c74'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:34.538140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b3c195c9-5b54-4cd9-b8dd-33c57e492c74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dffc5e15011249069b048b7c485c1ef2', 'request_id': 'req-b3c195c9-5b54-4cd9-b8dd-33c57e492c74'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:34.548352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b3c195c9-5b54-4cd9-b8dd-33c57e492c74 admin admin] The token cache is being invalidate because project dffc5e15011249069b048b7c485c1ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:50:34.548658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b3c195c9-5b54-4cd9-b8dd-33c57e492c74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:34.549290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b3c195c9-5b54-4cd9-b8dd-33c57e492c74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:34.550827 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3763/7539] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:50:34 2022] DELETE /identity/v3/projects/dffc5e15011249069b048b7c485c1ef2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:34.555509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75f650-86ee-4bcf-b030-bb539c9f94fe service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:34.565744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75f650-86ee-4bcf-b030-bb539c9f94fe service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:34.621565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2c677-07a1-4771-b14b-223060ff39dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:34.622519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2c677-07a1-4771-b14b-223060ff39dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:34.622813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2c677-07a1-4771-b14b-223060ff39dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:34.623093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2c677-07a1-4771-b14b-223060ff39dc admin admin] PATH_INFO: `/v3/users/de041c0f3b3c4faca6b514a01cd2144a` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:34.624281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2c677-07a1-4771-b14b-223060ff39dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=de041c0f3b3c4faca6b514a01cd2144a)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:34.626243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2c677-07a1-4771-b14b-223060ff39dc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:34.768409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c9b2c677-07a1-4771-b14b-223060ff39dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de041c0f3b3c4faca6b514a01cd2144a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:34.779870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c9b2c677-07a1-4771-b14b-223060ff39dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de041c0f3b3c4faca6b514a01cd2144a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:34.780629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c9b2c677-07a1-4771-b14b-223060ff39dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de041c0f3b3c4faca6b514a01cd2144a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:34.787401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c9b2c677-07a1-4771-b14b-223060ff39dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de041c0f3b3c4faca6b514a01cd2144a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:34.839731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c9b2c677-07a1-4771-b14b-223060ff39dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de041c0f3b3c4faca6b514a01cd2144a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:34.845735 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3777/7540] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:50:34 2022] DELETE /identity/v3/users/de041c0f3b3c4faca6b514a01cd2144a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:35.248391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c195c9-5b54-4cd9-b8dd-33c57e492c74 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:35.249881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b3c195c9-5b54-4cd9-b8dd-33c57e492c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:35.263233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c195c9-5b54-4cd9-b8dd-33c57e492c74 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:35.335111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f34d28-a926-4a86-b946-f37029b32d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:35.335995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f34d28-a926-4a86-b946-f37029b32d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:35.336287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f34d28-a926-4a86-b946-f37029b32d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:35.336569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f34d28-a926-4a86-b946-f37029b32d70 admin admin] PATH_INFO: `/v3/projects/fd8c7c2aa5ca4e1898a0af0f0cd9cb22` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:35.338004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f34d28-a926-4a86-b946-f37029b32d70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd8c7c2aa5ca4e1898a0af0f0cd9cb22)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:35.340046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f34d28-a926-4a86-b946-f37029b32d70 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:35.476497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-64f34d28-a926-4a86-b946-f37029b32d70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd8c7c2aa5ca4e1898a0af0f0cd9cb22', 'request_id': 'req-64f34d28-a926-4a86-b946-f37029b32d70'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:35.483446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-64f34d28-a926-4a86-b946-f37029b32d70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd8c7c2aa5ca4e1898a0af0f0cd9cb22', 'request_id': 'req-64f34d28-a926-4a86-b946-f37029b32d70'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:35.560987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-64f34d28-a926-4a86-b946-f37029b32d70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd8c7c2aa5ca4e1898a0af0f0cd9cb22', 'request_id': 'req-64f34d28-a926-4a86-b946-f37029b32d70'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:35.572293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-64f34d28-a926-4a86-b946-f37029b32d70 admin admin] The token cache is being invalidate because project fd8c7c2aa5ca4e1898a0af0f0cd9cb22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:50:35.572590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-64f34d28-a926-4a86-b946-f37029b32d70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:35.586108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-64f34d28-a926-4a86-b946-f37029b32d70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:35.586108 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3764/7541] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:50:35 2022] DELETE /identity/v3/projects/fd8c7c2aa5ca4e1898a0af0f0cd9cb22 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:35.586317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f55c94-c683-4267-87ba-e8d7ebe3f8de None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:35.586317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f55c94-c683-4267-87ba-e8d7ebe3f8de None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:35.586317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f55c94-c683-4267-87ba-e8d7ebe3f8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:35.599119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b7f55c94-c683-4267-87ba-e8d7ebe3f8de None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:35.600320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b7f55c94-c683-4267-87ba-e8d7ebe3f8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:35.662405 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3778/7542] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:35.670171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3601f-e78b-4ffd-946b-fc2c81d2ef86 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:35.670465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3601f-e78b-4ffd-946b-fc2c81d2ef86 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:35.670755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3601f-e78b-4ffd-946b-fc2c81d2ef86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:35.690508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-fba3601f-e78b-4ffd-946b-fc2c81d2ef86 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:35.691960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fba3601f-e78b-4ffd-946b-fc2c81d2ef86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:35.701657 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3765/7543] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:35.706033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f55c94-c683-4267-87ba-e8d7ebe3f8de None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:35.716614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f55c94-c683-4267-87ba-e8d7ebe3f8de None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:35.721333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cacc33-a301-4851-b9a9-d529723aefb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:35.721993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cacc33-a301-4851-b9a9-d529723aefb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:35.722279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cacc33-a301-4851-b9a9-d529723aefb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:35.722579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cacc33-a301-4851-b9a9-d529723aefb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:35.723288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cacc33-a301-4851-b9a9-d529723aefb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:50:35.723605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cacc33-a301-4851-b9a9-d529723aefb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:35.725296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cacc33-a301-4851-b9a9-d529723aefb1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:35.737245 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3779/7544] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:50:35.741587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3601f-e78b-4ffd-946b-fc2c81d2ef86 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:35.751417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3601f-e78b-4ffd-946b-fc2c81d2ef86 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:35.757233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ab727-1b9e-409d-bc23-861f0c0b5929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:35.757899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ab727-1b9e-409d-bc23-861f0c0b5929 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:35.758186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ab727-1b9e-409d-bc23-861f0c0b5929 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:35.758466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ab727-1b9e-409d-bc23-861f0c0b5929 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:35.759157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ab727-1b9e-409d-bc23-861f0c0b5929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:35.761122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ab727-1b9e-409d-bc23-861f0c0b5929 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:35.837665 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3766/7545] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:50:35 2022] POST /identity/v3/projects => generated 401 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:50:35.841853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cacc33-a301-4851-b9a9-d529723aefb1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:35.851688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cacc33-a301-4851-b9a9-d529723aefb1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:35.908647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9133aae-1a43-4ab0-9753-363afd5ca95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:35.909464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9133aae-1a43-4ab0-9753-363afd5ca95f admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:35.909755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9133aae-1a43-4ab0-9753-363afd5ca95f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:35.910032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9133aae-1a43-4ab0-9753-363afd5ca95f admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:35.910734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9133aae-1a43-4ab0-9753-363afd5ca95f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:35.912686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9133aae-1a43-4ab0-9753-363afd5ca95f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:36.016183 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3780/7546] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:50:35 2022] POST /identity/v3/users => generated 301 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:50:36.017589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ab727-1b9e-409d-bc23-861f0c0b5929 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:36.027881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ab727-1b9e-409d-bc23-861f0c0b5929 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:36.032522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc0697-6da2-4926-bb15-437748dc0a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:36.034747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc0697-6da2-4926-bb15-437748dc0a0c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:36.034747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc0697-6da2-4926-bb15-437748dc0a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:36.034747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc0697-6da2-4926-bb15-437748dc0a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:36.034747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc0697-6da2-4926-bb15-437748dc0a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:36.036127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc0697-6da2-4926-bb15-437748dc0a0c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:36.046135 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3767/7547] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:50:36.050011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9133aae-1a43-4ab0-9753-363afd5ca95f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:36.060464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9133aae-1a43-4ab0-9753-363afd5ca95f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:36.065214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06799b7-ad84-4c78-88c5-f78bf2ab0154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:36.065813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06799b7-ad84-4c78-88c5-f78bf2ab0154 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:36.066100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06799b7-ad84-4c78-88c5-f78bf2ab0154 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:36.066381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06799b7-ad84-4c78-88c5-f78bf2ab0154 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:36.067103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06799b7-ad84-4c78-88c5-f78bf2ab0154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:36.069340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06799b7-ad84-4c78-88c5-f78bf2ab0154 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:36.078873 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3781/7548] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:50:36.083970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc0697-6da2-4926-bb15-437748dc0a0c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:36.093211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc0697-6da2-4926-bb15-437748dc0a0c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:36.097908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336c495-1caf-4017-8908-d51af9cd4c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:36.098798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336c495-1caf-4017-8908-d51af9cd4c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:36.099084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336c495-1caf-4017-8908-d51af9cd4c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:36.099362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336c495-1caf-4017-8908-d51af9cd4c9d admin admin] PATH_INFO: `/v3/projects/384320d476a5439a8154bbaf3bee36b3/users/13f497db6e2c4700a3f32fdceb47ee1a/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:36.115905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336c495-1caf-4017-8908-d51af9cd4c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=384320d476a5439a8154bbaf3bee36b3, user_id=13f497db6e2c4700a3f32fdceb47ee1a, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:36.118664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336c495-1caf-4017-8908-d51af9cd4c9d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:36.270599 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3768/7549] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:50:36 2022] PUT /identity/v3/projects/384320d476a5439a8154bbaf3bee36b3/users/13f497db6e2c4700a3f32fdceb47ee1a/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:50:36.281087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5769d5-97bd-48c8-a2c4-91fdb17abe53 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:36.281377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5769d5-97bd-48c8-a2c4-91fdb17abe53 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:36.281684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5769d5-97bd-48c8-a2c4-91fdb17abe53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:36.307916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-7e5769d5-97bd-48c8-a2c4-91fdb17abe53 None None] MFA Rules not processed for user `13f497db6e2c4700a3f32fdceb47ee1a`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:36.309243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7e5769d5-97bd-48c8-a2c4-91fdb17abe53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:36.375820 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3782/7550] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:36.380350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336c495-1caf-4017-8908-d51af9cd4c9d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:36.449464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336c495-1caf-4017-8908-d51af9cd4c9d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:36.454261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da5f41-71b7-45aa-a3d0-64ec107e3c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:36.455045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da5f41-71b7-45aa-a3d0-64ec107e3c86 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:36.455339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da5f41-71b7-45aa-a3d0-64ec107e3c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:36.455650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da5f41-71b7-45aa-a3d0-64ec107e3c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:36.456358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da5f41-71b7-45aa-a3d0-64ec107e3c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:36.458418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da5f41-71b7-45aa-a3d0-64ec107e3c86 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:36.541241 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3769/7551] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:50:36 2022] POST /identity/v3/projects => generated 399 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:50:36.545603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5769d5-97bd-48c8-a2c4-91fdb17abe53 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:36.560016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5769d5-97bd-48c8-a2c4-91fdb17abe53 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:36.621809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80bf80-236d-4bb8-93f0-753c4c6cf112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:36.622540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80bf80-236d-4bb8-93f0-753c4c6cf112 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:36.622793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80bf80-236d-4bb8-93f0-753c4c6cf112 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:36.623085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80bf80-236d-4bb8-93f0-753c4c6cf112 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:36.623808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80bf80-236d-4bb8-93f0-753c4c6cf112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:36.625760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80bf80-236d-4bb8-93f0-753c4c6cf112 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:36.704274 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3783/7552] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:50:36 2022] POST /identity/v3/users => generated 306 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:50:36.708918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da5f41-71b7-45aa-a3d0-64ec107e3c86 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:36.720308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da5f41-71b7-45aa-a3d0-64ec107e3c86 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:36.725656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681d890-7f40-438f-906e-0b47d4f8aa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:36.726316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681d890-7f40-438f-906e-0b47d4f8aa23 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:36.726597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681d890-7f40-438f-906e-0b47d4f8aa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:36.726874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681d890-7f40-438f-906e-0b47d4f8aa23 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:36.727619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681d890-7f40-438f-906e-0b47d4f8aa23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:36.729294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681d890-7f40-438f-906e-0b47d4f8aa23 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:36.740188 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3770/7553] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:50:36.744460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80bf80-236d-4bb8-93f0-753c4c6cf112 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:36.754892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80bf80-236d-4bb8-93f0-753c4c6cf112 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:36.759830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac4316-3c26-4f90-8a60-e0d90c4606d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:36.760898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac4316-3c26-4f90-8a60-e0d90c4606d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:36.761181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac4316-3c26-4f90-8a60-e0d90c4606d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:36.761456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac4316-3c26-4f90-8a60-e0d90c4606d0 admin admin] PATH_INFO: `/v3/projects/60b9c925149d4f4bb27f5e556b82b8c4/users/049fb1b3da4a4145b5a44e752d0a8f47/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:36.776623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac4316-3c26-4f90-8a60-e0d90c4606d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60b9c925149d4f4bb27f5e556b82b8c4, user_id=049fb1b3da4a4145b5a44e752d0a8f47, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:36.779544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac4316-3c26-4f90-8a60-e0d90c4606d0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:36.887956 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3784/7554] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:50:36 2022] PUT /identity/v3/projects/60b9c925149d4f4bb27f5e556b82b8c4/users/049fb1b3da4a4145b5a44e752d0a8f47/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:36.892086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681d890-7f40-438f-906e-0b47d4f8aa23 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:36.903073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681d890-7f40-438f-906e-0b47d4f8aa23 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:36.958934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2ce8b-fe0a-4270-9faa-6d8712149267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:36.959605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2ce8b-fe0a-4270-9faa-6d8712149267 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:36.959990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2ce8b-fe0a-4270-9faa-6d8712149267 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:36.960272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2ce8b-fe0a-4270-9faa-6d8712149267 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:36.961031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2ce8b-fe0a-4270-9faa-6d8712149267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:36.962648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2ce8b-fe0a-4270-9faa-6d8712149267 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:36.972352 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3771/7555] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:50:36.976905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac4316-3c26-4f90-8a60-e0d90c4606d0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:36.987184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac4316-3c26-4f90-8a60-e0d90c4606d0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:36.991776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cd2a2-6f2b-4e58-b52e-bf3750501646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:36.992727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cd2a2-6f2b-4e58-b52e-bf3750501646 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:36.993016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cd2a2-6f2b-4e58-b52e-bf3750501646 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:36.993295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cd2a2-6f2b-4e58-b52e-bf3750501646 admin admin] PATH_INFO: `/v3/projects/60b9c925149d4f4bb27f5e556b82b8c4/users/049fb1b3da4a4145b5a44e752d0a8f47/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:36.995308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178cd2a2-6f2b-4e58-b52e-bf3750501646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60b9c925149d4f4bb27f5e556b82b8c4, user_id=049fb1b3da4a4145b5a44e752d0a8f47, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:36.997982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178cd2a2-6f2b-4e58-b52e-bf3750501646 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:37.008833 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3785/7556] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:50:36 2022] PUT /identity/v3/projects/60b9c925149d4f4bb27f5e556b82b8c4/users/049fb1b3da4a4145b5a44e752d0a8f47/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:37.020198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1aabe-1b52-4c47-9dc3-47d5626bef18 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:37.020558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1aabe-1b52-4c47-9dc3-47d5626bef18 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:37.021569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1aabe-1b52-4c47-9dc3-47d5626bef18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:37.048527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5ee1aabe-1b52-4c47-9dc3-47d5626bef18 None None] MFA Rules not processed for user `049fb1b3da4a4145b5a44e752d0a8f47`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:37.049888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5ee1aabe-1b52-4c47-9dc3-47d5626bef18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:37.120214 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3772/7557] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:37 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:37.131862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cd2a2-6f2b-4e58-b52e-bf3750501646 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:37.133620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-178cd2a2-6f2b-4e58-b52e-bf3750501646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:37.195256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cd2a2-6f2b-4e58-b52e-bf3750501646 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:37.199281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b18ede-96ac-47ae-9848-644073169739 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:37.200813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b18ede-96ac-47ae-9848-644073169739 service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:37.200813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b18ede-96ac-47ae-9848-644073169739 service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:37.200813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b18ede-96ac-47ae-9848-644073169739 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:37.211294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b18ede-96ac-47ae-9848-644073169739 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:37.212759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b18ede-96ac-47ae-9848-644073169739 service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:37.222452 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3786/7558] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:50:37 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:50:37.458024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1aabe-1b52-4c47-9dc3-47d5626bef18 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:37.460113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5ee1aabe-1b52-4c47-9dc3-47d5626bef18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:37.473573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1aabe-1b52-4c47-9dc3-47d5626bef18 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:37.477252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ce799-257f-4b3e-bd0a-d3e19d50aeef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:37.477896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ce799-257f-4b3e-bd0a-d3e19d50aeef service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:37.478183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ce799-257f-4b3e-bd0a-d3e19d50aeef service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:37.478467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ce799-257f-4b3e-bd0a-d3e19d50aeef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:37.534406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ce799-257f-4b3e-bd0a-d3e19d50aeef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:37.535886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ce799-257f-4b3e-bd0a-d3e19d50aeef service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:37.545298 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3773/7559] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:50:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:50:48.303184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b18ede-96ac-47ae-9848-644073169739 service cinder] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:48.314496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b18ede-96ac-47ae-9848-644073169739 service cinder] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:48.318220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb477693-b833-4115-b7a1-56bce590c043 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:48.318870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb477693-b833-4115-b7a1-56bce590c043 service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:48.319153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb477693-b833-4115-b7a1-56bce590c043 service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:48.319431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb477693-b833-4115-b7a1-56bce590c043 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:48.321247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-eb477693-b833-4115-b7a1-56bce590c043 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:48.384957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb477693-b833-4115-b7a1-56bce590c043 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:48.386439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb477693-b833-4115-b7a1-56bce590c043 service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:48.396587 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3787/7560] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:50:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:50:50.043935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ce799-257f-4b3e-bd0a-d3e19d50aeef service cinder] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:50.108304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ce799-257f-4b3e-bd0a-d3e19d50aeef service cinder] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:50.112884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ec8a0-9a9f-4144-b684-5b7ad91a69aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:50.113805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ec8a0-9a9f-4144-b684-5b7ad91a69aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:50.114095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ec8a0-9a9f-4144-b684-5b7ad91a69aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:50.114377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ec8a0-9a9f-4144-b684-5b7ad91a69aa admin admin] PATH_INFO: `/v3/users/13f497db6e2c4700a3f32fdceb47ee1a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:50.115561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ec8a0-9a9f-4144-b684-5b7ad91a69aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=13f497db6e2c4700a3f32fdceb47ee1a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:50.118318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ec8a0-9a9f-4144-b684-5b7ad91a69aa admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:50.293310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b17ec8a0-9a9f-4144-b684-5b7ad91a69aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13f497db6e2c4700a3f32fdceb47ee1a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:50.304950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b17ec8a0-9a9f-4144-b684-5b7ad91a69aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13f497db6e2c4700a3f32fdceb47ee1a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:50.305625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b17ec8a0-9a9f-4144-b684-5b7ad91a69aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13f497db6e2c4700a3f32fdceb47ee1a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:50.312346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b17ec8a0-9a9f-4144-b684-5b7ad91a69aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13f497db6e2c4700a3f32fdceb47ee1a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:50.389883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b17ec8a0-9a9f-4144-b684-5b7ad91a69aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13f497db6e2c4700a3f32fdceb47ee1a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:50.396490 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3774/7561] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:50:50 2022] DELETE /identity/v3/users/13f497db6e2c4700a3f32fdceb47ee1a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:50.401125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bcb04-b824-4789-91f9-98572006b493 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:50.401599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bcb04-b824-4789-91f9-98572006b493 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:50.401854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bcb04-b824-4789-91f9-98572006b493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:50.420182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2b7bcb04-b824-4789-91f9-98572006b493 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:50.421542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2b7bcb04-b824-4789-91f9-98572006b493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:50.481550 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3788/7562] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:50.491409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ec8a0-9a9f-4144-b684-5b7ad91a69aa admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:50.493463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b17ec8a0-9a9f-4144-b684-5b7ad91a69aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:50.551503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ec8a0-9a9f-4144-b684-5b7ad91a69aa admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:50.555229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0ee96-0ffe-4035-b1bc-75cedc4655a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:50.555871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0ee96-0ffe-4035-b1bc-75cedc4655a3 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:50.556158 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0ee96-0ffe-4035-b1bc-75cedc4655a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:50.556440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0ee96-0ffe-4035-b1bc-75cedc4655a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:50.565316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0ee96-0ffe-4035-b1bc-75cedc4655a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:50.566752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0ee96-0ffe-4035-b1bc-75cedc4655a3 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:50.576288 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3775/7563] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:50:50.974401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bcb04-b824-4789-91f9-98572006b493 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:50.975705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2b7bcb04-b824-4789-91f9-98572006b493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:50.988053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bcb04-b824-4789-91f9-98572006b493 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:50.993105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d942d3-026f-4e36-abcd-bcd8446a11fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:50.994009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d942d3-026f-4e36-abcd-bcd8446a11fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:51.001116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d942d3-026f-4e36-abcd-bcd8446a11fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:51.001116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d942d3-026f-4e36-abcd-bcd8446a11fe admin admin] PATH_INFO: `/v3/projects/384320d476a5439a8154bbaf3bee36b3` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:51.001116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d942d3-026f-4e36-abcd-bcd8446a11fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=384320d476a5439a8154bbaf3bee36b3)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:51.001116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d942d3-026f-4e36-abcd-bcd8446a11fe admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:51.138185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-03d942d3-026f-4e36-abcd-bcd8446a11fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '384320d476a5439a8154bbaf3bee36b3', 'request_id': 'req-03d942d3-026f-4e36-abcd-bcd8446a11fe'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:51.224158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-03d942d3-026f-4e36-abcd-bcd8446a11fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '384320d476a5439a8154bbaf3bee36b3', 'request_id': 'req-03d942d3-026f-4e36-abcd-bcd8446a11fe'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:51.230646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-03d942d3-026f-4e36-abcd-bcd8446a11fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '384320d476a5439a8154bbaf3bee36b3', 'request_id': 'req-03d942d3-026f-4e36-abcd-bcd8446a11fe'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:51.241143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-03d942d3-026f-4e36-abcd-bcd8446a11fe admin admin] The token cache is being invalidate because project 384320d476a5439a8154bbaf3bee36b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:50:51.241429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-03d942d3-026f-4e36-abcd-bcd8446a11fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:51.242090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-03d942d3-026f-4e36-abcd-bcd8446a11fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:51.243651 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3789/7564] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:50:50 2022] DELETE /identity/v3/projects/384320d476a5439a8154bbaf3bee36b3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:51.247679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0ee96-0ffe-4035-b1bc-75cedc4655a3 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:51.258317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0ee96-0ffe-4035-b1bc-75cedc4655a3 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:51.312862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844e8c0-714c-44dd-8e85-9b4e4694de99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:51.313730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844e8c0-714c-44dd-8e85-9b4e4694de99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:51.314012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844e8c0-714c-44dd-8e85-9b4e4694de99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:51.314332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844e8c0-714c-44dd-8e85-9b4e4694de99 admin admin] PATH_INFO: `/v3/users/049fb1b3da4a4145b5a44e752d0a8f47` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:51.315508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844e8c0-714c-44dd-8e85-9b4e4694de99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=049fb1b3da4a4145b5a44e752d0a8f47)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:51.317506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844e8c0-714c-44dd-8e85-9b4e4694de99 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:51.493924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6844e8c0-714c-44dd-8e85-9b4e4694de99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '049fb1b3da4a4145b5a44e752d0a8f47'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:51.505201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6844e8c0-714c-44dd-8e85-9b4e4694de99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '049fb1b3da4a4145b5a44e752d0a8f47'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:51.505861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6844e8c0-714c-44dd-8e85-9b4e4694de99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '049fb1b3da4a4145b5a44e752d0a8f47'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:51.513326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6844e8c0-714c-44dd-8e85-9b4e4694de99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '049fb1b3da4a4145b5a44e752d0a8f47'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:51.577542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6844e8c0-714c-44dd-8e85-9b4e4694de99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '049fb1b3da4a4145b5a44e752d0a8f47'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:51.584378 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3776/7565] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:50:51 2022] DELETE /identity/v3/users/049fb1b3da4a4145b5a44e752d0a8f47 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:52.048912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d942d3-026f-4e36-abcd-bcd8446a11fe admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:52.050373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-03d942d3-026f-4e36-abcd-bcd8446a11fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:52.080786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d942d3-026f-4e36-abcd-bcd8446a11fe admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:52.141178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcf319-72a5-4ba4-9043-497fce37cc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:52.142048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcf319-72a5-4ba4-9043-497fce37cc08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:52.142333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcf319-72a5-4ba4-9043-497fce37cc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:52.142652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcf319-72a5-4ba4-9043-497fce37cc08 admin admin] PATH_INFO: `/v3/projects/60b9c925149d4f4bb27f5e556b82b8c4` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:52.143840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcf319-72a5-4ba4-9043-497fce37cc08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60b9c925149d4f4bb27f5e556b82b8c4)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:52.145777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcf319-72a5-4ba4-9043-497fce37cc08 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:52.241012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6fbcf319-72a5-4ba4-9043-497fce37cc08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60b9c925149d4f4bb27f5e556b82b8c4', 'request_id': 'req-6fbcf319-72a5-4ba4-9043-497fce37cc08'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:52.286581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6fbcf319-72a5-4ba4-9043-497fce37cc08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60b9c925149d4f4bb27f5e556b82b8c4', 'request_id': 'req-6fbcf319-72a5-4ba4-9043-497fce37cc08'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:52.293322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6fbcf319-72a5-4ba4-9043-497fce37cc08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60b9c925149d4f4bb27f5e556b82b8c4', 'request_id': 'req-6fbcf319-72a5-4ba4-9043-497fce37cc08'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:52.303148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6fbcf319-72a5-4ba4-9043-497fce37cc08 admin admin] The token cache is being invalidate because project 60b9c925149d4f4bb27f5e556b82b8c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:50:52.303427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6fbcf319-72a5-4ba4-9043-497fce37cc08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:52.304058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6fbcf319-72a5-4ba4-9043-497fce37cc08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:50:52.305630 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3790/7566] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:50:52 2022] DELETE /identity/v3/projects/60b9c925149d4f4bb27f5e556b82b8c4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:50:52.310625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69667938-ccea-4e44-b419-bcf83918d0d3 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:52.311076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69667938-ccea-4e44-b419-bcf83918d0d3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:52.311204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69667938-ccea-4e44-b419-bcf83918d0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:52.330522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-69667938-ccea-4e44-b419-bcf83918d0d3 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:52.331710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-69667938-ccea-4e44-b419-bcf83918d0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:52.388932 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3777/7567] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:52.396628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa318b96-9be4-4aa9-acea-f7b17f44c033 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:52.396936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa318b96-9be4-4aa9-acea-f7b17f44c033 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:52.397217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa318b96-9be4-4aa9-acea-f7b17f44c033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:52.415290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fa318b96-9be4-4aa9-acea-f7b17f44c033 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:52.416475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fa318b96-9be4-4aa9-acea-f7b17f44c033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:52.424240 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3791/7568] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:52.428164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69667938-ccea-4e44-b419-bcf83918d0d3 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:52.437841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69667938-ccea-4e44-b419-bcf83918d0d3 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:52.442407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120197d5-254d-4a69-86b1-55cb864f0a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:52.443037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120197d5-254d-4a69-86b1-55cb864f0a73 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:52.443324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120197d5-254d-4a69-86b1-55cb864f0a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:52.443605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120197d5-254d-4a69-86b1-55cb864f0a73 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:52.444329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120197d5-254d-4a69-86b1-55cb864f0a73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:50:52.444674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120197d5-254d-4a69-86b1-55cb864f0a73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:52.446785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120197d5-254d-4a69-86b1-55cb864f0a73 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:52.457818 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3778/7569] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:50:52.462386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa318b96-9be4-4aa9-acea-f7b17f44c033 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:52.471314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa318b96-9be4-4aa9-acea-f7b17f44c033 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:52.475925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269b36c-a569-4218-922f-92605f1e7560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:52.476559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269b36c-a569-4218-922f-92605f1e7560 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:52.476867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269b36c-a569-4218-922f-92605f1e7560 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:52.477141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269b36c-a569-4218-922f-92605f1e7560 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:52.477902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269b36c-a569-4218-922f-92605f1e7560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:52.479768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269b36c-a569-4218-922f-92605f1e7560 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:52.562568 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3792/7570] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:50:52 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:50:52.566650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120197d5-254d-4a69-86b1-55cb864f0a73 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:52.577406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120197d5-254d-4a69-86b1-55cb864f0a73 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:52.631984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561881bd-c48c-4a79-820c-fd7f6fe90b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:52.633684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561881bd-c48c-4a79-820c-fd7f6fe90b25 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:52.633971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561881bd-c48c-4a79-820c-fd7f6fe90b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:52.634253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561881bd-c48c-4a79-820c-fd7f6fe90b25 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:52.634960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561881bd-c48c-4a79-820c-fd7f6fe90b25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:52.636928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561881bd-c48c-4a79-820c-fd7f6fe90b25 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:52.719109 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3779/7571] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:50:52 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:50:52.720282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269b36c-a569-4218-922f-92605f1e7560 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:52.731438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269b36c-a569-4218-922f-92605f1e7560 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:52.736798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebaa08-6da8-4b6d-a026-96202275a7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:52.737536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebaa08-6da8-4b6d-a026-96202275a7fa admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:52.737824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebaa08-6da8-4b6d-a026-96202275a7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:52.742194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebaa08-6da8-4b6d-a026-96202275a7fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:52.742194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebaa08-6da8-4b6d-a026-96202275a7fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:52.742194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebaa08-6da8-4b6d-a026-96202275a7fa admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:52.753360 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3793/7572] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:50:52.758032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561881bd-c48c-4a79-820c-fd7f6fe90b25 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:52.768211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561881bd-c48c-4a79-820c-fd7f6fe90b25 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:52.773029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0331ad-6200-4fac-8e11-0cf9cec8206a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:52.774221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0331ad-6200-4fac-8e11-0cf9cec8206a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:52.774532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0331ad-6200-4fac-8e11-0cf9cec8206a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:52.774807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0331ad-6200-4fac-8e11-0cf9cec8206a admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:52.775529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0331ad-6200-4fac-8e11-0cf9cec8206a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:52.777223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0331ad-6200-4fac-8e11-0cf9cec8206a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:52.787227 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3780/7573] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:50:52.792154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebaa08-6da8-4b6d-a026-96202275a7fa admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:52.803025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebaa08-6da8-4b6d-a026-96202275a7fa admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:52.807677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5fdd6-0ddc-46be-8186-9656585931ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:52.808563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5fdd6-0ddc-46be-8186-9656585931ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:52.808882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5fdd6-0ddc-46be-8186-9656585931ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:52.809165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5fdd6-0ddc-46be-8186-9656585931ff admin admin] PATH_INFO: `/v3/projects/bee4b90de50a4ee8892e878b05fe2560/users/1f9a1244912e4296bde7c3a714e39bd0/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:52.823762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5fdd6-0ddc-46be-8186-9656585931ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=bee4b90de50a4ee8892e878b05fe2560, user_id=1f9a1244912e4296bde7c3a714e39bd0, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:52.826402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5fdd6-0ddc-46be-8186-9656585931ff admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:52.915130 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3794/7574] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:50:52 2022] PUT /identity/v3/projects/bee4b90de50a4ee8892e878b05fe2560/users/1f9a1244912e4296bde7c3a714e39bd0/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:50:52.917623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d086b52-6df1-4474-bba8-41da09045850 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:52.917895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d086b52-6df1-4474-bba8-41da09045850 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:52.918183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d086b52-6df1-4474-bba8-41da09045850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:52.949806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6d086b52-6df1-4474-bba8-41da09045850 None None] MFA Rules not processed for user `1f9a1244912e4296bde7c3a714e39bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:52.954519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6d086b52-6df1-4474-bba8-41da09045850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:53.035039 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3781/7575] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:53.040484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5fdd6-0ddc-46be-8186-9656585931ff admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:53.065080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b168eb1-3045-41b6-8dcd-88c71c6a9f50 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:53.065080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b168eb1-3045-41b6-8dcd-88c71c6a9f50 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:53.065080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b168eb1-3045-41b6-8dcd-88c71c6a9f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:53.092631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-1b168eb1-3045-41b6-8dcd-88c71c6a9f50 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:53.093286 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1b168eb1-3045-41b6-8dcd-88c71c6a9f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:53.118953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5fdd6-0ddc-46be-8186-9656585931ff admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:53.125202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2ffd9-f427-47aa-a1d3-22b67710a73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:53.125873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2ffd9-f427-47aa-a1d3-22b67710a73a admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:53.126159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2ffd9-f427-47aa-a1d3-22b67710a73a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:53.126439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2ffd9-f427-47aa-a1d3-22b67710a73a admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:53.127137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2ffd9-f427-47aa-a1d3-22b67710a73a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:53.129224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2ffd9-f427-47aa-a1d3-22b67710a73a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:53.160697 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3782/7576] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:50:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:50:53.244328 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3795/7577] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:50:53 2022] POST /identity/v3/projects => generated 381 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:50:53.245571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b168eb1-3045-41b6-8dcd-88c71c6a9f50 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:53.259204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b168eb1-3045-41b6-8dcd-88c71c6a9f50 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:53.315410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc9361-b8a7-48e3-98f4-fb162466646a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:53.316092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc9361-b8a7-48e3-98f4-fb162466646a admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:53.316509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc9361-b8a7-48e3-98f4-fb162466646a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:53.316825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc9361-b8a7-48e3-98f4-fb162466646a admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:53.317565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc9361-b8a7-48e3-98f4-fb162466646a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:53.319619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc9361-b8a7-48e3-98f4-fb162466646a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:53.326668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2ffd9-f427-47aa-a1d3-22b67710a73a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:53.328531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-60f2ffd9-f427-47aa-a1d3-22b67710a73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:53.393454 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3783/7578] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:50:53 2022] POST /identity/v3/users => generated 297 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:50:53.395351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc9361-b8a7-48e3-98f4-fb162466646a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:53.406144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2ffd9-f427-47aa-a1d3-22b67710a73a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:53.406345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc9361-b8a7-48e3-98f4-fb162466646a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:53.411075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba22cd-60f7-4ce6-b64f-3135590296ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:53.411489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61defa3f-75d4-4e3d-aff6-5d878fa77cca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:53.411855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba22cd-60f7-4ce6-b64f-3135590296ee admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:53.412140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61defa3f-75d4-4e3d-aff6-5d878fa77cca service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:53.412251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba22cd-60f7-4ce6-b64f-3135590296ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:53.412425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61defa3f-75d4-4e3d-aff6-5d878fa77cca service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:53.412521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba22cd-60f7-4ce6-b64f-3135590296ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:53.412757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61defa3f-75d4-4e3d-aff6-5d878fa77cca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:53.413524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba22cd-60f7-4ce6-b64f-3135590296ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:53.415022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba22cd-60f7-4ce6-b64f-3135590296ee admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:53.425230 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3784/7579] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:50:53.429301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba22cd-60f7-4ce6-b64f-3135590296ee admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:53.439171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba22cd-60f7-4ce6-b64f-3135590296ee admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:53.444001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb6678-9e47-420b-b60c-505869255b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:53.450923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb6678-9e47-420b-b60c-505869255b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:53.450923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb6678-9e47-420b-b60c-505869255b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:53.450923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb6678-9e47-420b-b60c-505869255b5c admin admin] PATH_INFO: `/v3/projects/6c673540bbb44b6c8feb318e69614c3c/users/105fef1dfe514f7ebc3d9a822afbc6fe/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:53.460659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb6678-9e47-420b-b60c-505869255b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c673540bbb44b6c8feb318e69614c3c, user_id=105fef1dfe514f7ebc3d9a822afbc6fe, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:53.464020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb6678-9e47-420b-b60c-505869255b5c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:53.469562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61defa3f-75d4-4e3d-aff6-5d878fa77cca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:53.471257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61defa3f-75d4-4e3d-aff6-5d878fa77cca service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:53.479572 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3796/7580] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:50:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 02 10:50:53.534023 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3785/7581] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:50:53 2022] PUT /identity/v3/projects/6c673540bbb44b6c8feb318e69614c3c/users/105fef1dfe514f7ebc3d9a822afbc6fe/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:50:53.537840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61defa3f-75d4-4e3d-aff6-5d878fa77cca service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:53.548154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61defa3f-75d4-4e3d-aff6-5d878fa77cca service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:53.606559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6b46e-1c19-4196-9b22-3f16e0eea4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:53.606559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6b46e-1c19-4196-9b22-3f16e0eea4dc admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:53.606559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6b46e-1c19-4196-9b22-3f16e0eea4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:53.606559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6b46e-1c19-4196-9b22-3f16e0eea4dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:53.607056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6b46e-1c19-4196-9b22-3f16e0eea4dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:53.607056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6b46e-1c19-4196-9b22-3f16e0eea4dc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:53.616341 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3797/7582] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:50:53.621136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb6678-9e47-420b-b60c-505869255b5c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:53.631549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb6678-9e47-420b-b60c-505869255b5c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:53.637749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e7200-b29f-4675-a2af-6a5c073f707c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:53.651983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e7200-b29f-4675-a2af-6a5c073f707c admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:53.651983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e7200-b29f-4675-a2af-6a5c073f707c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:53.651983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e7200-b29f-4675-a2af-6a5c073f707c admin admin] PATH_INFO: `/v3/projects/6c673540bbb44b6c8feb318e69614c3c/users/105fef1dfe514f7ebc3d9a822afbc6fe/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:53.651983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e7200-b29f-4675-a2af-6a5c073f707c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c673540bbb44b6c8feb318e69614c3c, user_id=105fef1dfe514f7ebc3d9a822afbc6fe, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:53.651983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e7200-b29f-4675-a2af-6a5c073f707c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:53.655235 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3786/7583] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:50:53 2022] PUT /identity/v3/projects/6c673540bbb44b6c8feb318e69614c3c/users/105fef1dfe514f7ebc3d9a822afbc6fe/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:50:53.667025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6906d3-e1c8-40b3-9aeb-a789b156dfba None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:53.667316 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6906d3-e1c8-40b3-9aeb-a789b156dfba None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:53.667599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6906d3-e1c8-40b3-9aeb-a789b156dfba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:53.694044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-dd6906d3-e1c8-40b3-9aeb-a789b156dfba None None] MFA Rules not processed for user `105fef1dfe514f7ebc3d9a822afbc6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:50:53.695339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dd6906d3-e1c8-40b3-9aeb-a789b156dfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:53.763886 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3798/7584] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:50:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:50:53.774728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e7200-b29f-4675-a2af-6a5c073f707c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:53.776394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b89e7200-b29f-4675-a2af-6a5c073f707c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:53.834214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e7200-b29f-4675-a2af-6a5c073f707c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:53.837984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32992c87-12f5-4943-9801-2565b3b121fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:53.838897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32992c87-12f5-4943-9801-2565b3b121fc service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:53.838897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32992c87-12f5-4943-9801-2565b3b121fc service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:53.839166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32992c87-12f5-4943-9801-2565b3b121fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:53.848738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32992c87-12f5-4943-9801-2565b3b121fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:53.850205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32992c87-12f5-4943-9801-2565b3b121fc service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:53.860112 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3787/7585] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:50:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:50:53.971646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6906d3-e1c8-40b3-9aeb-a789b156dfba None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:50:53.972104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dd6906d3-e1c8-40b3-9aeb-a789b156dfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:50:53.986567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6906d3-e1c8-40b3-9aeb-a789b156dfba None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:50:53.990272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d57125-5da7-4207-a331-42f13746dac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:50:53.990920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d57125-5da7-4207-a331-42f13746dac1 service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:50:53.991210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d57125-5da7-4207-a331-42f13746dac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:50:53.991491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d57125-5da7-4207-a331-42f13746dac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:50:54.051885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d57125-5da7-4207-a331-42f13746dac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:50:54.053434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d57125-5da7-4207-a331-42f13746dac1 service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:50:54.063786 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3799/7586] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:50:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:51:03.227586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590278d4-ac48-4a0d-8590-767217c98fca None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:03.228746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590278d4-ac48-4a0d-8590-767217c98fca None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:03.228746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590278d4-ac48-4a0d-8590-767217c98fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:03.246386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-590278d4-ac48-4a0d-8590-767217c98fca None None] MFA Rules not processed for user `bad5953b4fbf4fe2a30a2b4208714631`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:51:03.248773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-590278d4-ac48-4a0d-8590-767217c98fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:03.305854 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3788/7587] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:51:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:51:03.669759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d57125-5da7-4207-a331-42f13746dac1 service cinder] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:03.735359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d57125-5da7-4207-a331-42f13746dac1 service cinder] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:03.739843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa8bde-2485-47ee-bc22-5652fb7dd92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:03.740757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa8bde-2485-47ee-bc22-5652fb7dd92d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:03.741047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa8bde-2485-47ee-bc22-5652fb7dd92d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:03.741329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa8bde-2485-47ee-bc22-5652fb7dd92d admin admin] PATH_INFO: `/v3/users/1f9a1244912e4296bde7c3a714e39bd0` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:03.742544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa8bde-2485-47ee-bc22-5652fb7dd92d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f9a1244912e4296bde7c3a714e39bd0)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:03.744509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa8bde-2485-47ee-bc22-5652fb7dd92d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:03.940418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-62aa8bde-2485-47ee-bc22-5652fb7dd92d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f9a1244912e4296bde7c3a714e39bd0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:03.952301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-62aa8bde-2485-47ee-bc22-5652fb7dd92d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f9a1244912e4296bde7c3a714e39bd0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:03.953008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-62aa8bde-2485-47ee-bc22-5652fb7dd92d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f9a1244912e4296bde7c3a714e39bd0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:03.960244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-62aa8bde-2485-47ee-bc22-5652fb7dd92d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f9a1244912e4296bde7c3a714e39bd0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:04.046617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-62aa8bde-2485-47ee-bc22-5652fb7dd92d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f9a1244912e4296bde7c3a714e39bd0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:04.053328 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3800/7588] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:51:03 2022] DELETE /identity/v3/users/1f9a1244912e4296bde7c3a714e39bd0 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:51:04.058421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfd4b7-2880-4a75-a191-e2346f1ce6d1 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:04.058718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfd4b7-2880-4a75-a191-e2346f1ce6d1 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:04.059004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfd4b7-2880-4a75-a191-e2346f1ce6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:04.078833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b0bfd4b7-2880-4a75-a191-e2346f1ce6d1 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:51:04.080067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b0bfd4b7-2880-4a75-a191-e2346f1ce6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:04.140219 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3789/7589] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:51:04.150034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa8bde-2485-47ee-bc22-5652fb7dd92d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:04.151501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-62aa8bde-2485-47ee-bc22-5652fb7dd92d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:04.210635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa8bde-2485-47ee-bc22-5652fb7dd92d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:04.214376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23874e55-8694-4460-89a2-d1f57d2b2232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:04.215055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23874e55-8694-4460-89a2-d1f57d2b2232 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:04.215344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23874e55-8694-4460-89a2-d1f57d2b2232 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:04.215628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23874e55-8694-4460-89a2-d1f57d2b2232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:04.225247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23874e55-8694-4460-89a2-d1f57d2b2232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:04.226714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23874e55-8694-4460-89a2-d1f57d2b2232 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:04.236294 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3801/7590] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:51:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:51:04.673721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfd4b7-2880-4a75-a191-e2346f1ce6d1 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:04.675883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b0bfd4b7-2880-4a75-a191-e2346f1ce6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:04.696306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfd4b7-2880-4a75-a191-e2346f1ce6d1 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:04.700030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23874e55-8694-4460-89a2-d1f57d2b2232 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:04.701826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-23874e55-8694-4460-89a2-d1f57d2b2232 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:04.711082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50f73a-af81-42b9-ae32-0d0b602845dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:04.711966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50f73a-af81-42b9-ae32-0d0b602845dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:04.712252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50f73a-af81-42b9-ae32-0d0b602845dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:04.713073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50f73a-af81-42b9-ae32-0d0b602845dc admin admin] PATH_INFO: `/v3/projects/bee4b90de50a4ee8892e878b05fe2560` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:04.714288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50f73a-af81-42b9-ae32-0d0b602845dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bee4b90de50a4ee8892e878b05fe2560)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:04.716223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50f73a-af81-42b9-ae32-0d0b602845dc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:04.792912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23874e55-8694-4460-89a2-d1f57d2b2232 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:04.798028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd17ab-ecdb-430a-900c-059b61dd1db6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:04.798684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd17ab-ecdb-430a-900c-059b61dd1db6 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:04.798974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd17ab-ecdb-430a-900c-059b61dd1db6 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:04.799255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd17ab-ecdb-430a-900c-059b61dd1db6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:04.801299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d4dd17ab-ecdb-430a-900c-059b61dd1db6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:04.814251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd17ab-ecdb-430a-900c-059b61dd1db6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:04.815836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd17ab-ecdb-430a-900c-059b61dd1db6 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:04.818122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4d50f73a-af81-42b9-ae32-0d0b602845dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bee4b90de50a4ee8892e878b05fe2560', 'request_id': 'req-4d50f73a-af81-42b9-ae32-0d0b602845dc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:04.823684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4d50f73a-af81-42b9-ae32-0d0b602845dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bee4b90de50a4ee8892e878b05fe2560', 'request_id': 'req-4d50f73a-af81-42b9-ae32-0d0b602845dc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:04.828024 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3802/7591] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:51:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:51:04.887116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4d50f73a-af81-42b9-ae32-0d0b602845dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bee4b90de50a4ee8892e878b05fe2560', 'request_id': 'req-4d50f73a-af81-42b9-ae32-0d0b602845dc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:04.898110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4d50f73a-af81-42b9-ae32-0d0b602845dc admin admin] The token cache is being invalidate because project bee4b90de50a4ee8892e878b05fe2560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:51:04.898462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4d50f73a-af81-42b9-ae32-0d0b602845dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:04.899127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4d50f73a-af81-42b9-ae32-0d0b602845dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:04.901271 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3790/7592] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:51:04 2022] DELETE /identity/v3/projects/bee4b90de50a4ee8892e878b05fe2560 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:51:04.905415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd17ab-ecdb-430a-900c-059b61dd1db6 service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:04.916980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd17ab-ecdb-430a-900c-059b61dd1db6 service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:04.974983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a386fa-d732-4bcb-b0c5-586b0fe2d192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:04.975865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a386fa-d732-4bcb-b0c5-586b0fe2d192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:04.976149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a386fa-d732-4bcb-b0c5-586b0fe2d192 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:04.976473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a386fa-d732-4bcb-b0c5-586b0fe2d192 admin admin] PATH_INFO: `/v3/users/105fef1dfe514f7ebc3d9a822afbc6fe` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:04.977742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a386fa-d732-4bcb-b0c5-586b0fe2d192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=105fef1dfe514f7ebc3d9a822afbc6fe)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:04.980251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a386fa-d732-4bcb-b0c5-586b0fe2d192 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:05.231754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b2a386fa-d732-4bcb-b0c5-586b0fe2d192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '105fef1dfe514f7ebc3d9a822afbc6fe'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:05.243423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b2a386fa-d732-4bcb-b0c5-586b0fe2d192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '105fef1dfe514f7ebc3d9a822afbc6fe'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:05.244156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b2a386fa-d732-4bcb-b0c5-586b0fe2d192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '105fef1dfe514f7ebc3d9a822afbc6fe'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:05.250857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b2a386fa-d732-4bcb-b0c5-586b0fe2d192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '105fef1dfe514f7ebc3d9a822afbc6fe'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:05.310032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b2a386fa-d732-4bcb-b0c5-586b0fe2d192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '105fef1dfe514f7ebc3d9a822afbc6fe'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:05.316496 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3803/7593] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:51:04 2022] DELETE /identity/v3/users/105fef1dfe514f7ebc3d9a822afbc6fe => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:51:05.734090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50f73a-af81-42b9-ae32-0d0b602845dc admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:05.735650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4d50f73a-af81-42b9-ae32-0d0b602845dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:05.749803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50f73a-af81-42b9-ae32-0d0b602845dc admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:05.811496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a982a-b9ea-4b39-a7fc-528fde6af200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:05.812494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a982a-b9ea-4b39-a7fc-528fde6af200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:05.812827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a982a-b9ea-4b39-a7fc-528fde6af200 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:05.813106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a982a-b9ea-4b39-a7fc-528fde6af200 admin admin] PATH_INFO: `/v3/projects/6c673540bbb44b6c8feb318e69614c3c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:05.814364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a982a-b9ea-4b39-a7fc-528fde6af200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c673540bbb44b6c8feb318e69614c3c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:05.816387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a982a-b9ea-4b39-a7fc-528fde6af200 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:05.914779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-749a982a-b9ea-4b39-a7fc-528fde6af200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c673540bbb44b6c8feb318e69614c3c', 'request_id': 'req-749a982a-b9ea-4b39-a7fc-528fde6af200'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:05.921310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-749a982a-b9ea-4b39-a7fc-528fde6af200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c673540bbb44b6c8feb318e69614c3c', 'request_id': 'req-749a982a-b9ea-4b39-a7fc-528fde6af200'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:05.966773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-749a982a-b9ea-4b39-a7fc-528fde6af200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c673540bbb44b6c8feb318e69614c3c', 'request_id': 'req-749a982a-b9ea-4b39-a7fc-528fde6af200'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:05.977857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-749a982a-b9ea-4b39-a7fc-528fde6af200 admin admin] The token cache is being invalidate because project 6c673540bbb44b6c8feb318e69614c3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:51:05.978780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-749a982a-b9ea-4b39-a7fc-528fde6af200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:05.979421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-749a982a-b9ea-4b39-a7fc-528fde6af200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:05.981350 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3791/7594] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:51:05 2022] DELETE /identity/v3/projects/6c673540bbb44b6c8feb318e69614c3c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:51:05.986015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915f515-b847-40d4-a729-b70ad947d741 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:05.986472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915f515-b847-40d4-a729-b70ad947d741 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:05.986644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915f515-b847-40d4-a729-b70ad947d741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:06.005760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d915f515-b847-40d4-a729-b70ad947d741 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:51:06.006949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d915f515-b847-40d4-a729-b70ad947d741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:06.068352 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3804/7595] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:51:06.076917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e20278-4a12-4279-9629-425fedcac9a7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:06.077204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e20278-4a12-4279-9629-425fedcac9a7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:06.077485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e20278-4a12-4279-9629-425fedcac9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:06.096007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e2e20278-4a12-4279-9629-425fedcac9a7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:51:06.097280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e2e20278-4a12-4279-9629-425fedcac9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:06.107736 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3792/7596] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:51:06.111928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915f515-b847-40d4-a729-b70ad947d741 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:06.122278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915f515-b847-40d4-a729-b70ad947d741 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:06.126883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0177e15-c1d3-4236-8aad-d84e9e2fc56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:06.127540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0177e15-c1d3-4236-8aad-d84e9e2fc56f admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:06.127827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0177e15-c1d3-4236-8aad-d84e9e2fc56f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:06.128109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0177e15-c1d3-4236-8aad-d84e9e2fc56f admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:06.128874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0177e15-c1d3-4236-8aad-d84e9e2fc56f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:51:06.129188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0177e15-c1d3-4236-8aad-d84e9e2fc56f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:06.130808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0177e15-c1d3-4236-8aad-d84e9e2fc56f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:06.142242 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3805/7597] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:51:06.146657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e20278-4a12-4279-9629-425fedcac9a7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:06.156267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e20278-4a12-4279-9629-425fedcac9a7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:06.161230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a246311-af46-4c1d-b453-46c4fe40dd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:06.161908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a246311-af46-4c1d-b453-46c4fe40dd26 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:06.162189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a246311-af46-4c1d-b453-46c4fe40dd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:06.162521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a246311-af46-4c1d-b453-46c4fe40dd26 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:06.163715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a246311-af46-4c1d-b453-46c4fe40dd26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:06.166415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a246311-af46-4c1d-b453-46c4fe40dd26 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:06.237132 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3793/7598] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:51:06 2022] POST /identity/v3/projects => generated 407 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:51:06.241389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0177e15-c1d3-4236-8aad-d84e9e2fc56f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:06.251534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0177e15-c1d3-4236-8aad-d84e9e2fc56f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:06.306235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fdd4b-cab4-4bc9-8718-24cdd5ea0398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:06.307132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fdd4b-cab4-4bc9-8718-24cdd5ea0398 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:06.307532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fdd4b-cab4-4bc9-8718-24cdd5ea0398 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:06.307935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fdd4b-cab4-4bc9-8718-24cdd5ea0398 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:06.309020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fdd4b-cab4-4bc9-8718-24cdd5ea0398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:06.311932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fdd4b-cab4-4bc9-8718-24cdd5ea0398 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:06.384640 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3806/7599] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:51:06 2022] POST /identity/v3/users => generated 304 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:51:06.388374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a246311-af46-4c1d-b453-46c4fe40dd26 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:06.398976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a246311-af46-4c1d-b453-46c4fe40dd26 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:06.404489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e0b0c-8ebf-4813-8fcb-4d68dba89a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:06.405189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e0b0c-8ebf-4813-8fcb-4d68dba89a00 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:06.405489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e0b0c-8ebf-4813-8fcb-4d68dba89a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:06.405753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e0b0c-8ebf-4813-8fcb-4d68dba89a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:06.406477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e0b0c-8ebf-4813-8fcb-4d68dba89a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:06.408112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e0b0c-8ebf-4813-8fcb-4d68dba89a00 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:06.419636 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3794/7600] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:51:06.423635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fdd4b-cab4-4bc9-8718-24cdd5ea0398 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:06.436124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fdd4b-cab4-4bc9-8718-24cdd5ea0398 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:06.441264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7b1ae-bee9-48ba-a1b1-9113f7cc9ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:06.447486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7b1ae-bee9-48ba-a1b1-9113f7cc9ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:06.447486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7b1ae-bee9-48ba-a1b1-9113f7cc9ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:06.447486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7b1ae-bee9-48ba-a1b1-9113f7cc9ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:06.447486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7b1ae-bee9-48ba-a1b1-9113f7cc9ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:06.447486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7b1ae-bee9-48ba-a1b1-9113f7cc9ab6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:06.459149 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3807/7601] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:51:06.460342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e0b0c-8ebf-4813-8fcb-4d68dba89a00 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:06.471081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e0b0c-8ebf-4813-8fcb-4d68dba89a00 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:06.475798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc6ed2-1bb8-4f54-9b86-c2dedb3d60ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:06.476706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc6ed2-1bb8-4f54-9b86-c2dedb3d60ba admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:06.476993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc6ed2-1bb8-4f54-9b86-c2dedb3d60ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:06.477267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc6ed2-1bb8-4f54-9b86-c2dedb3d60ba admin admin] PATH_INFO: `/v3/projects/7fea13f6873b4ef88f4246a75da8b129/users/2b76a9becbd24965af1841b23f7a6908/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:06.492352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc6ed2-1bb8-4f54-9b86-c2dedb3d60ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fea13f6873b4ef88f4246a75da8b129, user_id=2b76a9becbd24965af1841b23f7a6908, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:06.495049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc6ed2-1bb8-4f54-9b86-c2dedb3d60ba admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:06.567123 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3795/7602] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:51:06 2022] PUT /identity/v3/projects/7fea13f6873b4ef88f4246a75da8b129/users/2b76a9becbd24965af1841b23f7a6908/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:51:06.578394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced8431-074e-4fc5-b1f6-f1a9fb6586ae None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:06.578684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced8431-074e-4fc5-b1f6-f1a9fb6586ae None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:06.578966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced8431-074e-4fc5-b1f6-f1a9fb6586ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:06.613420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-bced8431-074e-4fc5-b1f6-f1a9fb6586ae None None] MFA Rules not processed for user `2b76a9becbd24965af1841b23f7a6908`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:51:06.614752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bced8431-074e-4fc5-b1f6-f1a9fb6586ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:06.683764 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3808/7603] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:51:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:51:06.688348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc6ed2-1bb8-4f54-9b86-c2dedb3d60ba admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:06.762730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc6ed2-1bb8-4f54-9b86-c2dedb3d60ba admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:06.767632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0a211-28e6-4481-a4ff-5a2c0e874f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:06.768333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0a211-28e6-4481-a4ff-5a2c0e874f79 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:06.768645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0a211-28e6-4481-a4ff-5a2c0e874f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:06.768965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0a211-28e6-4481-a4ff-5a2c0e874f79 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:06.769662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0a211-28e6-4481-a4ff-5a2c0e874f79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:06.771592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0a211-28e6-4481-a4ff-5a2c0e874f79 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:06.882970 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3796/7604] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:51:06 2022] POST /identity/v3/projects => generated 407 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:51:06.887998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced8431-074e-4fc5-b1f6-f1a9fb6586ae None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:06.899329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced8431-074e-4fc5-b1f6-f1a9fb6586ae None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:06.975795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8edcb8-9d76-486a-ab12-4503b72d5582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:06.977134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8edcb8-9d76-486a-ab12-4503b72d5582 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:06.977612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8edcb8-9d76-486a-ab12-4503b72d5582 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:06.978305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8edcb8-9d76-486a-ab12-4503b72d5582 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:06.980271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8edcb8-9d76-486a-ab12-4503b72d5582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:06.981705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8edcb8-9d76-486a-ab12-4503b72d5582 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:07.076476 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3809/7605] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:51:06 2022] POST /identity/v3/users => generated 310 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:51:07.080384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0a211-28e6-4481-a4ff-5a2c0e874f79 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:07.092040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0a211-28e6-4481-a4ff-5a2c0e874f79 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:07.103908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa6b3c-f554-4760-8e3f-b28bb087d595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:07.104963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa6b3c-f554-4760-8e3f-b28bb087d595 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:07.106056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa6b3c-f554-4760-8e3f-b28bb087d595 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:07.106485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa6b3c-f554-4760-8e3f-b28bb087d595 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:07.107367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa6b3c-f554-4760-8e3f-b28bb087d595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:07.109508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa6b3c-f554-4760-8e3f-b28bb087d595 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:07.122847 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3797/7606] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:51:07.127131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8edcb8-9d76-486a-ab12-4503b72d5582 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:07.141439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8edcb8-9d76-486a-ab12-4503b72d5582 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:07.146304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92e137-2a2e-4c74-8ec2-b4510eec4e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:07.147204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92e137-2a2e-4c74-8ec2-b4510eec4e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:07.147488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92e137-2a2e-4c74-8ec2-b4510eec4e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:07.147766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92e137-2a2e-4c74-8ec2-b4510eec4e34 admin admin] PATH_INFO: `/v3/projects/7099fd333cd34781a6e57584548b12a7/users/3995937680ae433ea8bc333c6be3ff17/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:07.164624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92e137-2a2e-4c74-8ec2-b4510eec4e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7099fd333cd34781a6e57584548b12a7, user_id=3995937680ae433ea8bc333c6be3ff17, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:07.167899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92e137-2a2e-4c74-8ec2-b4510eec4e34 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:07.254711 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3810/7607] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:51:07 2022] PUT /identity/v3/projects/7099fd333cd34781a6e57584548b12a7/users/3995937680ae433ea8bc333c6be3ff17/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:51:07.259022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa6b3c-f554-4760-8e3f-b28bb087d595 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:07.269390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa6b3c-f554-4760-8e3f-b28bb087d595 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:07.324957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cdf78-69f0-458d-894b-97b87ab23ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:07.325586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cdf78-69f0-458d-894b-97b87ab23ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:07.325891 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cdf78-69f0-458d-894b-97b87ab23ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:07.326159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cdf78-69f0-458d-894b-97b87ab23ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:07.326995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cdf78-69f0-458d-894b-97b87ab23ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:07.328735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cdf78-69f0-458d-894b-97b87ab23ac9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:07.340904 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3798/7608] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:51:07.345325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92e137-2a2e-4c74-8ec2-b4510eec4e34 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:07.357856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92e137-2a2e-4c74-8ec2-b4510eec4e34 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:07.362655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7634e9-06ec-499d-91a1-5e16672fb895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:07.363573 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7634e9-06ec-499d-91a1-5e16672fb895 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:07.363890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7634e9-06ec-499d-91a1-5e16672fb895 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:07.364178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7634e9-06ec-499d-91a1-5e16672fb895 admin admin] PATH_INFO: `/v3/projects/7099fd333cd34781a6e57584548b12a7/users/3995937680ae433ea8bc333c6be3ff17/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:07.366237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7634e9-06ec-499d-91a1-5e16672fb895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7099fd333cd34781a6e57584548b12a7, user_id=3995937680ae433ea8bc333c6be3ff17, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:07.368967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7634e9-06ec-499d-91a1-5e16672fb895 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:07.381941 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3811/7609] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:51:07 2022] PUT /identity/v3/projects/7099fd333cd34781a6e57584548b12a7/users/3995937680ae433ea8bc333c6be3ff17/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:51:07.400888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca81c1d-7136-404c-9022-d9d71c6c8063 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:07.401602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca81c1d-7136-404c-9022-d9d71c6c8063 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:07.402556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca81c1d-7136-404c-9022-d9d71c6c8063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:07.440511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8ca81c1d-7136-404c-9022-d9d71c6c8063 None None] MFA Rules not processed for user `3995937680ae433ea8bc333c6be3ff17`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:51:07.441783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8ca81c1d-7136-404c-9022-d9d71c6c8063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:07.528402 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3799/7610] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:51:07 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:51:07.537078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7634e9-06ec-499d-91a1-5e16672fb895 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:07.538991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9c7634e9-06ec-499d-91a1-5e16672fb895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:07.614540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7634e9-06ec-499d-91a1-5e16672fb895 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:07.619164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6007c-8424-476a-a3c0-9b86d5dbf28e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:07.620074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6007c-8424-476a-a3c0-9b86d5dbf28e service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:07.620482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6007c-8424-476a-a3c0-9b86d5dbf28e service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:07.620900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6007c-8424-476a-a3c0-9b86d5dbf28e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:07.633467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6007c-8424-476a-a3c0-9b86d5dbf28e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:07.636758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6007c-8424-476a-a3c0-9b86d5dbf28e service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:07.652422 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3812/7611] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:51:07 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:51:07.995639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca81c1d-7136-404c-9022-d9d71c6c8063 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:08.007414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca81c1d-7136-404c-9022-d9d71c6c8063 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:08.014408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0840049-e001-4913-b1dd-6de0382e8ed0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:08.014726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0840049-e001-4913-b1dd-6de0382e8ed0 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:08.014858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0840049-e001-4913-b1dd-6de0382e8ed0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:08.015402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0840049-e001-4913-b1dd-6de0382e8ed0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:08.083795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0840049-e001-4913-b1dd-6de0382e8ed0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:08.085315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0840049-e001-4913-b1dd-6de0382e8ed0 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:08.095752 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3800/7612] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:51:07 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:51:08.519595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6007c-8424-476a-a3c0-9b86d5dbf28e service cinder] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:08.522150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-44a6007c-8424-476a-a3c0-9b86d5dbf28e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:08.617138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6007c-8424-476a-a3c0-9b86d5dbf28e service cinder] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:08.623122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f47d1-86f6-4bd9-8536-30ec02cee2b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:08.623790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f47d1-86f6-4bd9-8536-30ec02cee2b3 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:08.624074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f47d1-86f6-4bd9-8536-30ec02cee2b3 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:08.624358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f47d1-86f6-4bd9-8536-30ec02cee2b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:08.626310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-193f47d1-86f6-4bd9-8536-30ec02cee2b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:08.645860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f47d1-86f6-4bd9-8536-30ec02cee2b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:08.647663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f47d1-86f6-4bd9-8536-30ec02cee2b3 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:08.662443 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3813/7613] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:51:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:51:12.478654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbef22e-a1a6-4e30-8ca1-31c233dcfabe None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:12.479096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbef22e-a1a6-4e30-8ca1-31c233dcfabe None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:12.479288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbef22e-a1a6-4e30-8ca1-31c233dcfabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:12.496033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-bcbef22e-a1a6-4e30-8ca1-31c233dcfabe None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:51:12.497333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bcbef22e-a1a6-4e30-8ca1-31c233dcfabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:12.551227 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3801/7614] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:51:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:51:12.563458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f47d1-86f6-4bd9-8536-30ec02cee2b3 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:12.564966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-193f47d1-86f6-4bd9-8536-30ec02cee2b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:12.640199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f47d1-86f6-4bd9-8536-30ec02cee2b3 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:12.649349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46dcbf-9eff-4963-90d2-d8dd5f6e1802 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:12.649349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46dcbf-9eff-4963-90d2-d8dd5f6e1802 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:12.649349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46dcbf-9eff-4963-90d2-d8dd5f6e1802 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:12.649349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46dcbf-9eff-4963-90d2-d8dd5f6e1802 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:12.657719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46dcbf-9eff-4963-90d2-d8dd5f6e1802 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:12.659310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46dcbf-9eff-4963-90d2-d8dd5f6e1802 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:12.667373 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3814/7615] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:51:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 02 10:51:13.923966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbef22e-a1a6-4e30-8ca1-31c233dcfabe None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:13.927327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bcbef22e-a1a6-4e30-8ca1-31c233dcfabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:13.953358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbef22e-a1a6-4e30-8ca1-31c233dcfabe None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:13.965099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58015ed-911b-48fc-8c1e-af26f879a952 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:13.966965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58015ed-911b-48fc-8c1e-af26f879a952 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:13.967739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58015ed-911b-48fc-8c1e-af26f879a952 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:13.968396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58015ed-911b-48fc-8c1e-af26f879a952 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:13.972063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f58015ed-911b-48fc-8c1e-af26f879a952 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:13.992730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58015ed-911b-48fc-8c1e-af26f879a952 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:13.995238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58015ed-911b-48fc-8c1e-af26f879a952 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:14.023217 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3802/7616] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:51:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:51:19.471313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46dcbf-9eff-4963-90d2-d8dd5f6e1802 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:19.473138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7e46dcbf-9eff-4963-90d2-d8dd5f6e1802 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:19.540712 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46dcbf-9eff-4963-90d2-d8dd5f6e1802 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:19.545154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7c018-3e22-4f5f-9d78-470c51f51c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:19.545904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7c018-3e22-4f5f-9d78-470c51f51c7c service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:19.546197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7c018-3e22-4f5f-9d78-470c51f51c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:19.546483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7c018-3e22-4f5f-9d78-470c51f51c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:19.548270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-08a7c018-3e22-4f5f-9d78-470c51f51c7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:19.618189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7c018-3e22-4f5f-9d78-470c51f51c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:19.620264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7c018-3e22-4f5f-9d78-470c51f51c7c service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:19.630794 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3815/7617] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:51:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:51:21.359835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58015ed-911b-48fc-8c1e-af26f879a952 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:21.433035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58015ed-911b-48fc-8c1e-af26f879a952 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:21.438624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044648f-7193-40a3-858a-df3d226e8f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:21.439712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044648f-7193-40a3-858a-df3d226e8f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:21.440143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044648f-7193-40a3-858a-df3d226e8f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:21.440735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044648f-7193-40a3-858a-df3d226e8f0b admin admin] PATH_INFO: `/v3/users/2b76a9becbd24965af1841b23f7a6908` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:21.442272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044648f-7193-40a3-858a-df3d226e8f0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b76a9becbd24965af1841b23f7a6908)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:21.444443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044648f-7193-40a3-858a-df3d226e8f0b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:21.622661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b044648f-7193-40a3-858a-df3d226e8f0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b76a9becbd24965af1841b23f7a6908'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:21.637856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b044648f-7193-40a3-858a-df3d226e8f0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b76a9becbd24965af1841b23f7a6908'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:21.638430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b044648f-7193-40a3-858a-df3d226e8f0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b76a9becbd24965af1841b23f7a6908'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:21.646132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b044648f-7193-40a3-858a-df3d226e8f0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b76a9becbd24965af1841b23f7a6908'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:21.710365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b044648f-7193-40a3-858a-df3d226e8f0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b76a9becbd24965af1841b23f7a6908'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:21.717792 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3803/7618] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:51:21 2022] DELETE /identity/v3/users/2b76a9becbd24965af1841b23f7a6908 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:51:21.722542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c33af9-bd16-47e1-a7db-715c208c07ec None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:21.723475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c33af9-bd16-47e1-a7db-715c208c07ec None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:21.723919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c33af9-bd16-47e1-a7db-715c208c07ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:21.744441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-41c33af9-bd16-47e1-a7db-715c208c07ec None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:51:21.746647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-41c33af9-bd16-47e1-a7db-715c208c07ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:21.828217 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3816/7619] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:51:21.838837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044648f-7193-40a3-858a-df3d226e8f0b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:21.840632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b044648f-7193-40a3-858a-df3d226e8f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:21.922362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044648f-7193-40a3-858a-df3d226e8f0b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:21.926960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166fad6-953d-4345-879d-417cc05fe970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:21.927784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166fad6-953d-4345-879d-417cc05fe970 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:21.928191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166fad6-953d-4345-879d-417cc05fe970 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:21.928558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166fad6-953d-4345-879d-417cc05fe970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:21.942113 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166fad6-953d-4345-879d-417cc05fe970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:21.944062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166fad6-953d-4345-879d-417cc05fe970 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:21.959934 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3804/7620] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:51:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:51:22.506349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c33af9-bd16-47e1-a7db-715c208c07ec None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:22.507965 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-41c33af9-bd16-47e1-a7db-715c208c07ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:22.528650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c33af9-bd16-47e1-a7db-715c208c07ec None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:22.539828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e110e-7e50-4a82-8fdc-941f2a039d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:22.545362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e110e-7e50-4a82-8fdc-941f2a039d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:22.545949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e110e-7e50-4a82-8fdc-941f2a039d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:22.548526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e110e-7e50-4a82-8fdc-941f2a039d61 admin admin] PATH_INFO: `/v3/projects/7fea13f6873b4ef88f4246a75da8b129` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:22.548526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e110e-7e50-4a82-8fdc-941f2a039d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fea13f6873b4ef88f4246a75da8b129)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:22.550665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e110e-7e50-4a82-8fdc-941f2a039d61 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:22.672529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c18e110e-7e50-4a82-8fdc-941f2a039d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fea13f6873b4ef88f4246a75da8b129', 'request_id': 'req-c18e110e-7e50-4a82-8fdc-941f2a039d61'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:22.732959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c18e110e-7e50-4a82-8fdc-941f2a039d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fea13f6873b4ef88f4246a75da8b129', 'request_id': 'req-c18e110e-7e50-4a82-8fdc-941f2a039d61'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:22.746910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c18e110e-7e50-4a82-8fdc-941f2a039d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fea13f6873b4ef88f4246a75da8b129', 'request_id': 'req-c18e110e-7e50-4a82-8fdc-941f2a039d61'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:22.767988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c18e110e-7e50-4a82-8fdc-941f2a039d61 admin admin] The token cache is being invalidate because project 7fea13f6873b4ef88f4246a75da8b129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:51:22.768470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c18e110e-7e50-4a82-8fdc-941f2a039d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:22.769303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c18e110e-7e50-4a82-8fdc-941f2a039d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:22.771515 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3817/7621] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:51:22 2022] DELETE /identity/v3/projects/7fea13f6873b4ef88f4246a75da8b129 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:51:22.775611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166fad6-953d-4345-879d-417cc05fe970 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:22.793635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166fad6-953d-4345-879d-417cc05fe970 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:22.910354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58ed48-5f33-4cb3-8949-5f9d63e2b7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:22.911598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58ed48-5f33-4cb3-8949-5f9d63e2b7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:22.912037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58ed48-5f33-4cb3-8949-5f9d63e2b7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:22.912469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58ed48-5f33-4cb3-8949-5f9d63e2b7d7 admin admin] PATH_INFO: `/v3/users/3995937680ae433ea8bc333c6be3ff17` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:22.914162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58ed48-5f33-4cb3-8949-5f9d63e2b7d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3995937680ae433ea8bc333c6be3ff17)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:22.916705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58ed48-5f33-4cb3-8949-5f9d63e2b7d7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:23.133809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cd58ed48-5f33-4cb3-8949-5f9d63e2b7d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3995937680ae433ea8bc333c6be3ff17'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:23.152947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cd58ed48-5f33-4cb3-8949-5f9d63e2b7d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3995937680ae433ea8bc333c6be3ff17'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:23.153721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cd58ed48-5f33-4cb3-8949-5f9d63e2b7d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3995937680ae433ea8bc333c6be3ff17'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:23.165924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cd58ed48-5f33-4cb3-8949-5f9d63e2b7d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3995937680ae433ea8bc333c6be3ff17'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:23.299157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cd58ed48-5f33-4cb3-8949-5f9d63e2b7d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3995937680ae433ea8bc333c6be3ff17'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:23.309141 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3805/7622] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:51:22 2022] DELETE /identity/v3/users/3995937680ae433ea8bc333c6be3ff17 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:51:23.802889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e110e-7e50-4a82-8fdc-941f2a039d61 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:23.804358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c18e110e-7e50-4a82-8fdc-941f2a039d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:23.817239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e110e-7e50-4a82-8fdc-941f2a039d61 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:23.875132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ea0ae-3825-4f0c-b5c7-080b92ca3934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:23.876859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ea0ae-3825-4f0c-b5c7-080b92ca3934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:23.877273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ea0ae-3825-4f0c-b5c7-080b92ca3934 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:23.877561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ea0ae-3825-4f0c-b5c7-080b92ca3934 admin admin] PATH_INFO: `/v3/projects/7099fd333cd34781a6e57584548b12a7` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:23.879159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ea0ae-3825-4f0c-b5c7-080b92ca3934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7099fd333cd34781a6e57584548b12a7)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:23.881733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ea0ae-3825-4f0c-b5c7-080b92ca3934 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:23.984796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-df6ea0ae-3825-4f0c-b5c7-080b92ca3934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7099fd333cd34781a6e57584548b12a7', 'request_id': 'req-df6ea0ae-3825-4f0c-b5c7-080b92ca3934'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:24.041810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-df6ea0ae-3825-4f0c-b5c7-080b92ca3934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7099fd333cd34781a6e57584548b12a7', 'request_id': 'req-df6ea0ae-3825-4f0c-b5c7-080b92ca3934'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:24.049248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-df6ea0ae-3825-4f0c-b5c7-080b92ca3934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7099fd333cd34781a6e57584548b12a7', 'request_id': 'req-df6ea0ae-3825-4f0c-b5c7-080b92ca3934'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:24.060477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-df6ea0ae-3825-4f0c-b5c7-080b92ca3934 admin admin] The token cache is being invalidate because project 7099fd333cd34781a6e57584548b12a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:51:24.060732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-df6ea0ae-3825-4f0c-b5c7-080b92ca3934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:24.061407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-df6ea0ae-3825-4f0c-b5c7-080b92ca3934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:51:24.063031 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3818/7623] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:51:23 2022] DELETE /identity/v3/projects/7099fd333cd34781a6e57584548b12a7 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:51:24.068117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a69dd3-bf4a-4864-9356-4bf394ae2c86 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:24.068647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a69dd3-bf4a-4864-9356-4bf394ae2c86 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:24.068851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a69dd3-bf4a-4864-9356-4bf394ae2c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:24.090236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-81a69dd3-bf4a-4864-9356-4bf394ae2c86 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:51:24.091610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-81a69dd3-bf4a-4864-9356-4bf394ae2c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:24.158286 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3806/7624] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:51:24.166096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6bd65-104e-449a-99c7-25a81507965c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:24.168886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6bd65-104e-449a-99c7-25a81507965c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:24.168886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6bd65-104e-449a-99c7-25a81507965c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:24.185320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2ba6bd65-104e-449a-99c7-25a81507965c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:51:24.186528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2ba6bd65-104e-449a-99c7-25a81507965c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:24.194447 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3819/7625] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:51:24.198617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a69dd3-bf4a-4864-9356-4bf394ae2c86 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:24.208885 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a69dd3-bf4a-4864-9356-4bf394ae2c86 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:24.213426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b74dc5-293c-4985-9ba1-97c9d6bf7869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:24.214078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b74dc5-293c-4985-9ba1-97c9d6bf7869 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:24.214362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b74dc5-293c-4985-9ba1-97c9d6bf7869 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:24.214640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b74dc5-293c-4985-9ba1-97c9d6bf7869 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:24.215357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b74dc5-293c-4985-9ba1-97c9d6bf7869 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:51:24.215692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b74dc5-293c-4985-9ba1-97c9d6bf7869 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:24.217329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b74dc5-293c-4985-9ba1-97c9d6bf7869 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:24.228536 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3807/7626] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:51:24.232870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6bd65-104e-449a-99c7-25a81507965c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:24.242182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6bd65-104e-449a-99c7-25a81507965c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:24.247458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe4381-84cc-42a9-b944-aa8e481e4bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:24.248110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe4381-84cc-42a9-b944-aa8e481e4bff admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:24.248397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe4381-84cc-42a9-b944-aa8e481e4bff admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:24.248788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe4381-84cc-42a9-b944-aa8e481e4bff admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:24.249491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe4381-84cc-42a9-b944-aa8e481e4bff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:24.251431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe4381-84cc-42a9-b944-aa8e481e4bff admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:24.339432 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3820/7627] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:51:24 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:51:24.343466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b74dc5-293c-4985-9ba1-97c9d6bf7869 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:24.353779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b74dc5-293c-4985-9ba1-97c9d6bf7869 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:24.411198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc4e88-8850-4239-b2a9-865ae6f882da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:24.411874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc4e88-8850-4239-b2a9-865ae6f882da admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:24.412162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc4e88-8850-4239-b2a9-865ae6f882da admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:24.412464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc4e88-8850-4239-b2a9-865ae6f882da admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:24.413197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc4e88-8850-4239-b2a9-865ae6f882da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:24.415183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc4e88-8850-4239-b2a9-865ae6f882da admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:24.507115 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3808/7628] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:51:24 2022] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:51:24.508655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe4381-84cc-42a9-b944-aa8e481e4bff admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:24.519624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe4381-84cc-42a9-b944-aa8e481e4bff admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:24.530835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f345aac-ec0f-421b-a82c-d81e2e09199e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:24.531516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f345aac-ec0f-421b-a82c-d81e2e09199e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:24.531806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f345aac-ec0f-421b-a82c-d81e2e09199e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:24.532117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f345aac-ec0f-421b-a82c-d81e2e09199e admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:24.532890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f345aac-ec0f-421b-a82c-d81e2e09199e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:24.534564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f345aac-ec0f-421b-a82c-d81e2e09199e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:24.545114 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3821/7629] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:51:24.549101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc4e88-8850-4239-b2a9-865ae6f882da admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:24.559859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc4e88-8850-4239-b2a9-865ae6f882da admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:24.564507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cde22b-1ca0-46a3-8940-7f1f67327524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:24.565196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cde22b-1ca0-46a3-8940-7f1f67327524 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:24.565483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cde22b-1ca0-46a3-8940-7f1f67327524 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:24.565768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cde22b-1ca0-46a3-8940-7f1f67327524 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:24.566482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cde22b-1ca0-46a3-8940-7f1f67327524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:24.568108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cde22b-1ca0-46a3-8940-7f1f67327524 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:24.579040 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3809/7630] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:51:24.583032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f345aac-ec0f-421b-a82c-d81e2e09199e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:24.593550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f345aac-ec0f-421b-a82c-d81e2e09199e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:24.598267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b00bb-f8bf-495b-9468-77f4806a7db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:24.599172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b00bb-f8bf-495b-9468-77f4806a7db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:24.599522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b00bb-f8bf-495b-9468-77f4806a7db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:24.599808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b00bb-f8bf-495b-9468-77f4806a7db1 admin admin] PATH_INFO: `/v3/projects/ed2eac51a96c4377a9837675807d0bbd/users/456241eca666492ca5b25dfd2fb53769/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:24.617064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b00bb-f8bf-495b-9468-77f4806a7db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed2eac51a96c4377a9837675807d0bbd, user_id=456241eca666492ca5b25dfd2fb53769, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:24.620365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b00bb-f8bf-495b-9468-77f4806a7db1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:24.675113 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3822/7631] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:51:24 2022] PUT /identity/v3/projects/ed2eac51a96c4377a9837675807d0bbd/users/456241eca666492ca5b25dfd2fb53769/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:51:24.687015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f56d0-861e-43ff-832b-c174a67471e5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:24.687392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f56d0-861e-43ff-832b-c174a67471e5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:24.687699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f56d0-861e-43ff-832b-c174a67471e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:24.714668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-be8f56d0-861e-43ff-832b-c174a67471e5 None None] MFA Rules not processed for user `456241eca666492ca5b25dfd2fb53769`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:51:24.716032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-be8f56d0-861e-43ff-832b-c174a67471e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:24.777444 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3810/7632] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:51:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:51:24.781864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b00bb-f8bf-495b-9468-77f4806a7db1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:24.840644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b00bb-f8bf-495b-9468-77f4806a7db1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:24.845544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cadbc3-5bf2-4b00-bab7-e485dae8c822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:24.846138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cadbc3-5bf2-4b00-bab7-e485dae8c822 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:24.846421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cadbc3-5bf2-4b00-bab7-e485dae8c822 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:24.846727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cadbc3-5bf2-4b00-bab7-e485dae8c822 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:24.847408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cadbc3-5bf2-4b00-bab7-e485dae8c822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:24.849377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cadbc3-5bf2-4b00-bab7-e485dae8c822 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:25.008860 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3823/7633] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:51:24 2022] POST /identity/v3/projects => generated 383 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:51:25.012869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f56d0-861e-43ff-832b-c174a67471e5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:25.023376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f56d0-861e-43ff-832b-c174a67471e5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:25.079558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5e76c-9812-43d4-89a5-193dbca32e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:25.080228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5e76c-9812-43d4-89a5-193dbca32e59 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:25.080510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5e76c-9812-43d4-89a5-193dbca32e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:25.080819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5e76c-9812-43d4-89a5-193dbca32e59 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:25.081503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5e76c-9812-43d4-89a5-193dbca32e59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:25.083415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5e76c-9812-43d4-89a5-193dbca32e59 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:25.173658 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3811/7634] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:51:25 2022] POST /identity/v3/users => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:51:25.178051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cadbc3-5bf2-4b00-bab7-e485dae8c822 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:25.188475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cadbc3-5bf2-4b00-bab7-e485dae8c822 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:25.193411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4de3d8-4f2a-40ee-be47-eed9280cfe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:25.194084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4de3d8-4f2a-40ee-be47-eed9280cfe50 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:25.194400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4de3d8-4f2a-40ee-be47-eed9280cfe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:25.194680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4de3d8-4f2a-40ee-be47-eed9280cfe50 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:25.195402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4de3d8-4f2a-40ee-be47-eed9280cfe50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:25.197063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4de3d8-4f2a-40ee-be47-eed9280cfe50 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:25.208776 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3824/7635] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:51:25.213153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5e76c-9812-43d4-89a5-193dbca32e59 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:25.223823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5e76c-9812-43d4-89a5-193dbca32e59 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:25.228803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca7504-02ba-4042-86c1-3c5a14892004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:25.230321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca7504-02ba-4042-86c1-3c5a14892004 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:25.230605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca7504-02ba-4042-86c1-3c5a14892004 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:25.230883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca7504-02ba-4042-86c1-3c5a14892004 admin admin] PATH_INFO: `/v3/projects/937aedac420147b692d6c862827180a1/users/02fa3f4db1ab42e1b3ec9f88cd2a6eb1/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:25.246512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca7504-02ba-4042-86c1-3c5a14892004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=937aedac420147b692d6c862827180a1, user_id=02fa3f4db1ab42e1b3ec9f88cd2a6eb1, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:25.255414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca7504-02ba-4042-86c1-3c5a14892004 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:25.349879 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3812/7636] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:51:25 2022] PUT /identity/v3/projects/937aedac420147b692d6c862827180a1/users/02fa3f4db1ab42e1b3ec9f88cd2a6eb1/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:51:25.353814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4de3d8-4f2a-40ee-be47-eed9280cfe50 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:25.364581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4de3d8-4f2a-40ee-be47-eed9280cfe50 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:25.417695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df1015-9066-4b41-a936-6ecff939fe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:25.418347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df1015-9066-4b41-a936-6ecff939fe91 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:25.418631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df1015-9066-4b41-a936-6ecff939fe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:25.418912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df1015-9066-4b41-a936-6ecff939fe91 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:25.419620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df1015-9066-4b41-a936-6ecff939fe91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:25.421227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df1015-9066-4b41-a936-6ecff939fe91 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:25.430457 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3825/7637] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:51:25.434539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca7504-02ba-4042-86c1-3c5a14892004 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:25.444889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca7504-02ba-4042-86c1-3c5a14892004 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:25.450049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6815d41-557c-4fac-9930-3a4e93b9a726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:25.450928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6815d41-557c-4fac-9930-3a4e93b9a726 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:25.451213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6815d41-557c-4fac-9930-3a4e93b9a726 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:25.451492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6815d41-557c-4fac-9930-3a4e93b9a726 admin admin] PATH_INFO: `/v3/projects/937aedac420147b692d6c862827180a1/users/02fa3f4db1ab42e1b3ec9f88cd2a6eb1/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:25.453521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6815d41-557c-4fac-9930-3a4e93b9a726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=937aedac420147b692d6c862827180a1, user_id=02fa3f4db1ab42e1b3ec9f88cd2a6eb1, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:25.456177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6815d41-557c-4fac-9930-3a4e93b9a726 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:25.466545 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3813/7638] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:51:25 2022] PUT /identity/v3/projects/937aedac420147b692d6c862827180a1/users/02fa3f4db1ab42e1b3ec9f88cd2a6eb1/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:51:25.476469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507f8bb-1e37-420a-bf3f-f1010ddbdd76 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:25.476803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507f8bb-1e37-420a-bf3f-f1010ddbdd76 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:25.477083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507f8bb-1e37-420a-bf3f-f1010ddbdd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:25.503023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a507f8bb-1e37-420a-bf3f-f1010ddbdd76 None None] MFA Rules not processed for user `02fa3f4db1ab42e1b3ec9f88cd2a6eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:51:25.504225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a507f8bb-1e37-420a-bf3f-f1010ddbdd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:25.572079 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3826/7639] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:51:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:51:25.585290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6815d41-557c-4fac-9930-3a4e93b9a726 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:25.586967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e6815d41-557c-4fac-9930-3a4e93b9a726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:25.648507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6815d41-557c-4fac-9930-3a4e93b9a726 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:25.656481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76fd1e-2f3d-4fa4-82a4-28ab405b4a2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:25.657264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76fd1e-2f3d-4fa4-82a4-28ab405b4a2e service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:25.657551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76fd1e-2f3d-4fa4-82a4-28ab405b4a2e service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:25.657832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76fd1e-2f3d-4fa4-82a4-28ab405b4a2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:25.717081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76fd1e-2f3d-4fa4-82a4-28ab405b4a2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:25.718522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76fd1e-2f3d-4fa4-82a4-28ab405b4a2e service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:25.727772 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3814/7640] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:51:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:51:25.738748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507f8bb-1e37-420a-bf3f-f1010ddbdd76 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:25.740937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a507f8bb-1e37-420a-bf3f-f1010ddbdd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:25.797818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507f8bb-1e37-420a-bf3f-f1010ddbdd76 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:25.801371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aca990-29f2-42ac-b13f-c5073a92bee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:25.802202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aca990-29f2-42ac-b13f-c5073a92bee9 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:25.802495 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aca990-29f2-42ac-b13f-c5073a92bee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:25.802774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aca990-29f2-42ac-b13f-c5073a92bee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:25.804529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-39aca990-29f2-42ac-b13f-c5073a92bee9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:25.816046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aca990-29f2-42ac-b13f-c5073a92bee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:25.817485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aca990-29f2-42ac-b13f-c5073a92bee9 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:25.827294 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3827/7641] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:51:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:51:32.569387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cc913-4ed0-4a65-ab44-52d8a66d7e21 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:32.569873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cc913-4ed0-4a65-ab44-52d8a66d7e21 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:32.569964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cc913-4ed0-4a65-ab44-52d8a66d7e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:32.590538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ab2cc913-4ed0-4a65-ab44-52d8a66d7e21 None None] MFA Rules not processed for user `bb25448d45ac488797f59e828cafdb22`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:51:32.591770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ab2cc913-4ed0-4a65-ab44-52d8a66d7e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:32.650288 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3815/7642] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:51:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:51:32.975862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aca990-29f2-42ac-b13f-c5073a92bee9 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:32.986422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aca990-29f2-42ac-b13f-c5073a92bee9 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:32.990256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e09e0-b805-4bb5-94c2-a14d8fb74cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:32.990893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e09e0-b805-4bb5-94c2-a14d8fb74cee service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:32.991174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e09e0-b805-4bb5-94c2-a14d8fb74cee service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:32.991449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e09e0-b805-4bb5-94c2-a14d8fb74cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:32.993227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ff6e09e0-b805-4bb5-94c2-a14d8fb74cee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:33.004225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e09e0-b805-4bb5-94c2-a14d8fb74cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:33.005833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e09e0-b805-4bb5-94c2-a14d8fb74cee service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:33.016247 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3828/7643] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:51:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:51:34.004374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6e601-cd1e-418d-a2a1-05457741b847 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:34.004865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6e601-cd1e-418d-a2a1-05457741b847 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:34.004970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6e601-cd1e-418d-a2a1-05457741b847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:34.023152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0ce6e601-cd1e-418d-a2a1-05457741b847 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:51:34.026535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0ce6e601-cd1e-418d-a2a1-05457741b847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:34.078264 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3816/7644] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:51:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:51:34.091051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e09e0-b805-4bb5-94c2-a14d8fb74cee service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:34.092689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ff6e09e0-b805-4bb5-94c2-a14d8fb74cee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:34.172523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e09e0-b805-4bb5-94c2-a14d8fb74cee service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:34.177829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07734ed1-ed3f-4c53-a7b9-fee80e2c50af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:34.178564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07734ed1-ed3f-4c53-a7b9-fee80e2c50af service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:34.178876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07734ed1-ed3f-4c53-a7b9-fee80e2c50af service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:34.179160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07734ed1-ed3f-4c53-a7b9-fee80e2c50af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:34.187761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07734ed1-ed3f-4c53-a7b9-fee80e2c50af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:34.189443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07734ed1-ed3f-4c53-a7b9-fee80e2c50af service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:34.197913 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3829/7645] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:51:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:51:36.619791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6e601-cd1e-418d-a2a1-05457741b847 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:36.621420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0ce6e601-cd1e-418d-a2a1-05457741b847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:36.635027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6e601-cd1e-418d-a2a1-05457741b847 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:36.639707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e10846-1bda-4fed-a9d4-ac9fd07ec752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:36.640483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e10846-1bda-4fed-a9d4-ac9fd07ec752 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:36.640882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e10846-1bda-4fed-a9d4-ac9fd07ec752 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:36.641362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e10846-1bda-4fed-a9d4-ac9fd07ec752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:36.652123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e10846-1bda-4fed-a9d4-ac9fd07ec752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:36.653795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e10846-1bda-4fed-a9d4-ac9fd07ec752 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:36.665049 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3817/7646] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:51:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:51:45.694329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07734ed1-ed3f-4c53-a7b9-fee80e2c50af service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:45.696083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-07734ed1-ed3f-4c53-a7b9-fee80e2c50af service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:45.794778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07734ed1-ed3f-4c53-a7b9-fee80e2c50af service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:45.801280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541c1d0-68ce-4750-853b-af6feb181ef7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:45.805923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541c1d0-68ce-4750-853b-af6feb181ef7 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:45.805923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541c1d0-68ce-4750-853b-af6feb181ef7 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:45.805923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541c1d0-68ce-4750-853b-af6feb181ef7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:45.805923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c541c1d0-68ce-4750-853b-af6feb181ef7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:45.826075 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541c1d0-68ce-4750-853b-af6feb181ef7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:45.828341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541c1d0-68ce-4750-853b-af6feb181ef7 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:45.847395 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3830/7647] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:51:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:51:49.319572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d77713-24e5-49b2-96a2-63447b3df9ad None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:49.320086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d77713-24e5-49b2-96a2-63447b3df9ad None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:49.320227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d77713-24e5-49b2-96a2-63447b3df9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:49.339462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-34d77713-24e5-49b2-96a2-63447b3df9ad None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:51:49.341344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-34d77713-24e5-49b2-96a2-63447b3df9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:51:49.358628 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3818/7648] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:51:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:51:49.370896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541c1d0-68ce-4750-853b-af6feb181ef7 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:51:49.393017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541c1d0-68ce-4750-853b-af6feb181ef7 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:51:49.398017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53938308-0011-48db-b3a2-96eaf5bd47d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:51:49.398643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53938308-0011-48db-b3a2-96eaf5bd47d8 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:51:49.398926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53938308-0011-48db-b3a2-96eaf5bd47d8 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:51:49.399222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53938308-0011-48db-b3a2-96eaf5bd47d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:51:49.407862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53938308-0011-48db-b3a2-96eaf5bd47d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:51:49.409453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53938308-0011-48db-b3a2-96eaf5bd47d8 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:51:49.417342 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3831/7649] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:51:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 02 10:52:22.812227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d77713-24e5-49b2-96a2-63447b3df9ad None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:22.832780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d77713-24e5-49b2-96a2-63447b3df9ad None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:22.836355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b590df9-c836-4c91-bae3-66add2c00f0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:22.837030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b590df9-c836-4c91-bae3-66add2c00f0f service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:22.837314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b590df9-c836-4c91-bae3-66add2c00f0f service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:22.837590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b590df9-c836-4c91-bae3-66add2c00f0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:22.839342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9b590df9-c836-4c91-bae3-66add2c00f0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:22.899283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b590df9-c836-4c91-bae3-66add2c00f0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:22.900773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b590df9-c836-4c91-bae3-66add2c00f0f service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:22.910246 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3819/7650] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:52:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:52:43.590688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53938308-0011-48db-b3a2-96eaf5bd47d8 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:43.661476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53938308-0011-48db-b3a2-96eaf5bd47d8 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:43.667750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d15c2e-8be4-4a2a-ac29-3e9542bf0d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:43.668262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d15c2e-8be4-4a2a-ac29-3e9542bf0d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:43.668545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d15c2e-8be4-4a2a-ac29-3e9542bf0d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:43.668858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d15c2e-8be4-4a2a-ac29-3e9542bf0d38 admin admin] PATH_INFO: `/v3/users/456241eca666492ca5b25dfd2fb53769` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:43.670162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d15c2e-8be4-4a2a-ac29-3e9542bf0d38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=456241eca666492ca5b25dfd2fb53769)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:43.673234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d15c2e-8be4-4a2a-ac29-3e9542bf0d38 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:43.903869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-87d15c2e-8be4-4a2a-ac29-3e9542bf0d38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '456241eca666492ca5b25dfd2fb53769'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:43.917083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-87d15c2e-8be4-4a2a-ac29-3e9542bf0d38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '456241eca666492ca5b25dfd2fb53769'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:43.918054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-87d15c2e-8be4-4a2a-ac29-3e9542bf0d38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '456241eca666492ca5b25dfd2fb53769'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:43.927447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-87d15c2e-8be4-4a2a-ac29-3e9542bf0d38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '456241eca666492ca5b25dfd2fb53769'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:44.018760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-87d15c2e-8be4-4a2a-ac29-3e9542bf0d38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '456241eca666492ca5b25dfd2fb53769'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:44.025527 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3832/7651] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:52:43 2022] DELETE /identity/v3/users/456241eca666492ca5b25dfd2fb53769 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:44.031116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41d7ef-7748-420e-84fd-d058ce9a45d9 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:44.031116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41d7ef-7748-420e-84fd-d058ce9a45d9 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:44.031116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41d7ef-7748-420e-84fd-d058ce9a45d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:44.047634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-aa41d7ef-7748-420e-84fd-d058ce9a45d9 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:52:44.048857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-aa41d7ef-7748-420e-84fd-d058ce9a45d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:44.106443 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3820/7652] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:52:44.116227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d15c2e-8be4-4a2a-ac29-3e9542bf0d38 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:44.117678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-87d15c2e-8be4-4a2a-ac29-3e9542bf0d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:44.183994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d15c2e-8be4-4a2a-ac29-3e9542bf0d38 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:44.187600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de156ad8-ac70-4b30-9787-53ac7a4dbc1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:44.188243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de156ad8-ac70-4b30-9787-53ac7a4dbc1d service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:44.188558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de156ad8-ac70-4b30-9787-53ac7a4dbc1d service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:44.188874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de156ad8-ac70-4b30-9787-53ac7a4dbc1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:44.198212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de156ad8-ac70-4b30-9787-53ac7a4dbc1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:44.199630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de156ad8-ac70-4b30-9787-53ac7a4dbc1d service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:44.209612 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3833/7653] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:52:44.603040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41d7ef-7748-420e-84fd-d058ce9a45d9 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:44.604554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-aa41d7ef-7748-420e-84fd-d058ce9a45d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:44.616682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41d7ef-7748-420e-84fd-d058ce9a45d9 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:44.621999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061f52c-f89a-4c3f-acec-eed360ac547b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:44.623212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061f52c-f89a-4c3f-acec-eed360ac547b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:44.623515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061f52c-f89a-4c3f-acec-eed360ac547b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:44.623866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061f52c-f89a-4c3f-acec-eed360ac547b admin admin] PATH_INFO: `/v3/projects/ed2eac51a96c4377a9837675807d0bbd` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:44.625056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061f52c-f89a-4c3f-acec-eed360ac547b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed2eac51a96c4377a9837675807d0bbd)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:44.626986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061f52c-f89a-4c3f-acec-eed360ac547b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:44.727269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f061f52c-f89a-4c3f-acec-eed360ac547b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed2eac51a96c4377a9837675807d0bbd', 'request_id': 'req-f061f52c-f89a-4c3f-acec-eed360ac547b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:44.733385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f061f52c-f89a-4c3f-acec-eed360ac547b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed2eac51a96c4377a9837675807d0bbd', 'request_id': 'req-f061f52c-f89a-4c3f-acec-eed360ac547b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:44.795865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f061f52c-f89a-4c3f-acec-eed360ac547b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed2eac51a96c4377a9837675807d0bbd', 'request_id': 'req-f061f52c-f89a-4c3f-acec-eed360ac547b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:44.808029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f061f52c-f89a-4c3f-acec-eed360ac547b admin admin] The token cache is being invalidate because project ed2eac51a96c4377a9837675807d0bbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:52:44.808386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f061f52c-f89a-4c3f-acec-eed360ac547b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:44.809595 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f061f52c-f89a-4c3f-acec-eed360ac547b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:44.811506 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3821/7654] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:52:44 2022] DELETE /identity/v3/projects/ed2eac51a96c4377a9837675807d0bbd => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:44.815638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de156ad8-ac70-4b30-9787-53ac7a4dbc1d service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:44.830340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de156ad8-ac70-4b30-9787-53ac7a4dbc1d service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:44.904250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631140c-ec4a-4c80-bd60-e2317af138db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:44.904250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631140c-ec4a-4c80-bd60-e2317af138db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:44.904250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631140c-ec4a-4c80-bd60-e2317af138db admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:44.904250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631140c-ec4a-4c80-bd60-e2317af138db admin admin] PATH_INFO: `/v3/users/02fa3f4db1ab42e1b3ec9f88cd2a6eb1` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:44.905197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631140c-ec4a-4c80-bd60-e2317af138db admin admin] RBAC: Authorizing `identity:delete_user(user_id=02fa3f4db1ab42e1b3ec9f88cd2a6eb1)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:44.905980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631140c-ec4a-4c80-bd60-e2317af138db admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:45.186879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a631140c-ec4a-4c80-bd60-e2317af138db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02fa3f4db1ab42e1b3ec9f88cd2a6eb1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:45.198721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a631140c-ec4a-4c80-bd60-e2317af138db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02fa3f4db1ab42e1b3ec9f88cd2a6eb1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:45.199406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a631140c-ec4a-4c80-bd60-e2317af138db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02fa3f4db1ab42e1b3ec9f88cd2a6eb1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:45.206571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a631140c-ec4a-4c80-bd60-e2317af138db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02fa3f4db1ab42e1b3ec9f88cd2a6eb1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:45.293019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a631140c-ec4a-4c80-bd60-e2317af138db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02fa3f4db1ab42e1b3ec9f88cd2a6eb1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:45.299596 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3834/7655] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:52:44 2022] DELETE /identity/v3/users/02fa3f4db1ab42e1b3ec9f88cd2a6eb1 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:45.457428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061f52c-f89a-4c3f-acec-eed360ac547b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:45.458939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f061f52c-f89a-4c3f-acec-eed360ac547b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:45.521914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061f52c-f89a-4c3f-acec-eed360ac547b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:45.570219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7be95-70e0-4d34-a5a0-17d5f270d31e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:45.571494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7be95-70e0-4d34-a5a0-17d5f270d31e service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:45.571782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7be95-70e0-4d34-a5a0-17d5f270d31e service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:45.572058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7be95-70e0-4d34-a5a0-17d5f270d31e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:45.573907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3cb7be95-70e0-4d34-a5a0-17d5f270d31e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:45.635772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7be95-70e0-4d34-a5a0-17d5f270d31e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:45.637186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7be95-70e0-4d34-a5a0-17d5f270d31e service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:45.646820 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3822/7656] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:52:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:52:45.690744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631140c-ec4a-4c80-bd60-e2317af138db admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:45.690744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a631140c-ec4a-4c80-bd60-e2317af138db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:45.705575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631140c-ec4a-4c80-bd60-e2317af138db admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:45.710678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94ae1e-a5c7-400c-99b2-1f8f1342441d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:45.712235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94ae1e-a5c7-400c-99b2-1f8f1342441d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:45.717925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94ae1e-a5c7-400c-99b2-1f8f1342441d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:45.717925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94ae1e-a5c7-400c-99b2-1f8f1342441d admin admin] PATH_INFO: `/v3/projects/937aedac420147b692d6c862827180a1` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:45.717925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94ae1e-a5c7-400c-99b2-1f8f1342441d admin admin] RBAC: Authorizing `identity:delete_project(project_id=937aedac420147b692d6c862827180a1)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:45.719893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94ae1e-a5c7-400c-99b2-1f8f1342441d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:45.831065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e94ae1e-a5c7-400c-99b2-1f8f1342441d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '937aedac420147b692d6c862827180a1', 'request_id': 'req-3e94ae1e-a5c7-400c-99b2-1f8f1342441d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:45.881818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e94ae1e-a5c7-400c-99b2-1f8f1342441d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '937aedac420147b692d6c862827180a1', 'request_id': 'req-3e94ae1e-a5c7-400c-99b2-1f8f1342441d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:45.890551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e94ae1e-a5c7-400c-99b2-1f8f1342441d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '937aedac420147b692d6c862827180a1', 'request_id': 'req-3e94ae1e-a5c7-400c-99b2-1f8f1342441d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:45.901708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e94ae1e-a5c7-400c-99b2-1f8f1342441d admin admin] The token cache is being invalidate because project 937aedac420147b692d6c862827180a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:52:45.902001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e94ae1e-a5c7-400c-99b2-1f8f1342441d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:45.902665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e94ae1e-a5c7-400c-99b2-1f8f1342441d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:45.905215 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3835/7657] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:52:45 2022] DELETE /identity/v3/projects/937aedac420147b692d6c862827180a1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:45.909600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803327d-95fe-4907-a587-a513aecec4a3 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:45.910090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803327d-95fe-4907-a587-a513aecec4a3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:45.910628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803327d-95fe-4907-a587-a513aecec4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:45.928877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6803327d-95fe-4907-a587-a513aecec4a3 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:52:45.930108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6803327d-95fe-4907-a587-a513aecec4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:45.994213 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3823/7658] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:52:46.002149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4661d-5e2a-4d91-a700-b2effe525256 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:46.002519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4661d-5e2a-4d91-a700-b2effe525256 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:46.002877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4661d-5e2a-4d91-a700-b2effe525256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:46.022730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-48d4661d-5e2a-4d91-a700-b2effe525256 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:52:46.024026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-48d4661d-5e2a-4d91-a700-b2effe525256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:46.032769 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3836/7659] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:52:46.045137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803327d-95fe-4907-a587-a513aecec4a3 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:46.055716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803327d-95fe-4907-a587-a513aecec4a3 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:46.060944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91477b-6c3a-49b0-a88f-0ac9e87a68d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:46.061621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91477b-6c3a-49b0-a88f-0ac9e87a68d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:46.061909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91477b-6c3a-49b0-a88f-0ac9e87a68d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:46.062196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91477b-6c3a-49b0-a88f-0ac9e87a68d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:46.062928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91477b-6c3a-49b0-a88f-0ac9e87a68d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:52:46.063241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91477b-6c3a-49b0-a88f-0ac9e87a68d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:46.065037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91477b-6c3a-49b0-a88f-0ac9e87a68d8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:46.078106 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3824/7660] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:52:46.083431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4661d-5e2a-4d91-a700-b2effe525256 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:46.092928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4661d-5e2a-4d91-a700-b2effe525256 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:46.098380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79afeae-936f-427b-ae97-5e8ab474312c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:46.099325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79afeae-936f-427b-ae97-5e8ab474312c admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:46.099685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79afeae-936f-427b-ae97-5e8ab474312c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:46.100169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79afeae-936f-427b-ae97-5e8ab474312c admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:46.102238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79afeae-936f-427b-ae97-5e8ab474312c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:46.103902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79afeae-936f-427b-ae97-5e8ab474312c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:46.192651 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3837/7661] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:52:46 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:52:46.197367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91477b-6c3a-49b0-a88f-0ac9e87a68d8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:46.208223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91477b-6c3a-49b0-a88f-0ac9e87a68d8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:46.270791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93e7a9-ad87-4dc1-a3e5-b30ee059cad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:46.271472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93e7a9-ad87-4dc1-a3e5-b30ee059cad6 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:46.271758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93e7a9-ad87-4dc1-a3e5-b30ee059cad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:46.272036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93e7a9-ad87-4dc1-a3e5-b30ee059cad6 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:46.272839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93e7a9-ad87-4dc1-a3e5-b30ee059cad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:46.274828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93e7a9-ad87-4dc1-a3e5-b30ee059cad6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:46.405399 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3825/7662] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:52:46 2022] POST /identity/v3/users => generated 284 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:52:46.406583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79afeae-936f-427b-ae97-5e8ab474312c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:46.417795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79afeae-936f-427b-ae97-5e8ab474312c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:46.422305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019e57b-9f22-410f-aeba-862b39ca4164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:46.422972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e57b-9f22-410f-aeba-862b39ca4164 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:46.423251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e57b-9f22-410f-aeba-862b39ca4164 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:46.423542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e57b-9f22-410f-aeba-862b39ca4164 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:46.424261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019e57b-9f22-410f-aeba-862b39ca4164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:46.425895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019e57b-9f22-410f-aeba-862b39ca4164 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:46.437033 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3838/7663] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:52:46.441081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93e7a9-ad87-4dc1-a3e5-b30ee059cad6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:46.452298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93e7a9-ad87-4dc1-a3e5-b30ee059cad6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:46.458801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8eb7e-e861-4f0c-8ae8-33bfd6c9fcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:46.461239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8eb7e-e861-4f0c-8ae8-33bfd6c9fcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:46.461239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8eb7e-e861-4f0c-8ae8-33bfd6c9fcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:46.461239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8eb7e-e861-4f0c-8ae8-33bfd6c9fcf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:46.461239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8eb7e-e861-4f0c-8ae8-33bfd6c9fcf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:46.463587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8eb7e-e861-4f0c-8ae8-33bfd6c9fcf4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:46.498170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019e57b-9f22-410f-aeba-862b39ca4164 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:46.499587 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3826/7664] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:52:46.505090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019e57b-9f22-410f-aeba-862b39ca4164 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:46.510334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b40bcf-8fec-40e8-a226-5790ef33dd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:46.511492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b40bcf-8fec-40e8-a226-5790ef33dd89 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:46.511772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b40bcf-8fec-40e8-a226-5790ef33dd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:46.512084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b40bcf-8fec-40e8-a226-5790ef33dd89 admin admin] PATH_INFO: `/v3/projects/2161f6c2a9c042f291228503be66aeb5/users/64dc59860b5a4156b666c5307a43c925/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:46.536210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b40bcf-8fec-40e8-a226-5790ef33dd89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2161f6c2a9c042f291228503be66aeb5, user_id=64dc59860b5a4156b666c5307a43c925, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:46.539166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b40bcf-8fec-40e8-a226-5790ef33dd89 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:46.593912 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3839/7665] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:52:46 2022] PUT /identity/v3/projects/2161f6c2a9c042f291228503be66aeb5/users/64dc59860b5a4156b666c5307a43c925/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:46.602816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ae293-110a-4898-b5fc-7105577f197a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:46.603108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ae293-110a-4898-b5fc-7105577f197a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:46.603386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ae293-110a-4898-b5fc-7105577f197a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:46.632545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a46ae293-110a-4898-b5fc-7105577f197a None None] MFA Rules not processed for user `64dc59860b5a4156b666c5307a43c925`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:52:46.633809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a46ae293-110a-4898-b5fc-7105577f197a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:46.724074 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3827/7666] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:52:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:52:46.739036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b40bcf-8fec-40e8-a226-5790ef33dd89 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:46.740697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-76b40bcf-8fec-40e8-a226-5790ef33dd89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:46.834768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b40bcf-8fec-40e8-a226-5790ef33dd89 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:46.839396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6b0bc-1d49-4cff-81c0-488d83a86962 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:46.840074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6b0bc-1d49-4cff-81c0-488d83a86962 service glance] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:46.840392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6b0bc-1d49-4cff-81c0-488d83a86962 service glance] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:46.841255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6b0bc-1d49-4cff-81c0-488d83a86962 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:46.856827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6b0bc-1d49-4cff-81c0-488d83a86962 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:46.856827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6b0bc-1d49-4cff-81c0-488d83a86962 service glance] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:46.874203 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3840/7667] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:52:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:52:49.837283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ae293-110a-4898-b5fc-7105577f197a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:49.839254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a46ae293-110a-4898-b5fc-7105577f197a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:49.890250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6b0bc-1d49-4cff-81c0-488d83a86962 service glance] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:49.893674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f2f6b0bc-1d49-4cff-81c0-488d83a86962 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:49.927926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ae293-110a-4898-b5fc-7105577f197a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:49.937115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0737591-7bc3-4de2-ad29-85e84f692af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:49.938008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0737591-7bc3-4de2-ad29-85e84f692af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:49.939138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0737591-7bc3-4de2-ad29-85e84f692af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:49.939444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0737591-7bc3-4de2-ad29-85e84f692af3 admin admin] PATH_INFO: `/v3/users/1ca6e4cc7551419a9c5104419cd4b015` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:49.940723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0737591-7bc3-4de2-ad29-85e84f692af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ca6e4cc7551419a9c5104419cd4b015)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:49.942728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0737591-7bc3-4de2-ad29-85e84f692af3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:49.987524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6b0bc-1d49-4cff-81c0-488d83a86962 service glance] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:49.994622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e5758-4b80-4277-95be-52559712996b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:49.995409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e5758-4b80-4277-95be-52559712996b service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:49.995724 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e5758-4b80-4277-95be-52559712996b service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:49.996067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e5758-4b80-4277-95be-52559712996b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:49.998128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-842e5758-4b80-4277-95be-52559712996b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:50.015765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e5758-4b80-4277-95be-52559712996b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:50.017473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e5758-4b80-4277-95be-52559712996b service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:50.029710 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3841/7668] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:52:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:52:50.187390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c0737591-7bc3-4de2-ad29-85e84f692af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ca6e4cc7551419a9c5104419cd4b015'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:50.209409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c0737591-7bc3-4de2-ad29-85e84f692af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ca6e4cc7551419a9c5104419cd4b015'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:50.210827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c0737591-7bc3-4de2-ad29-85e84f692af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ca6e4cc7551419a9c5104419cd4b015'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:50.218679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c0737591-7bc3-4de2-ad29-85e84f692af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ca6e4cc7551419a9c5104419cd4b015'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:50.290380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c0737591-7bc3-4de2-ad29-85e84f692af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ca6e4cc7551419a9c5104419cd4b015'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:50.297838 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3828/7669] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:52:49 2022] DELETE /identity/v3/users/1ca6e4cc7551419a9c5104419cd4b015 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:50.643566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e5758-4b80-4277-95be-52559712996b service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:50.654498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e5758-4b80-4277-95be-52559712996b service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:50.713705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc5ce6-e664-48fb-9f3e-902fc22de291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:50.714613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc5ce6-e664-48fb-9f3e-902fc22de291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:50.714901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc5ce6-e664-48fb-9f3e-902fc22de291 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:50.715182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc5ce6-e664-48fb-9f3e-902fc22de291 admin admin] PATH_INFO: `/v3/projects/014235b8daef456e97692382aac97d1e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:50.716375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc5ce6-e664-48fb-9f3e-902fc22de291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=014235b8daef456e97692382aac97d1e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:50.718478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc5ce6-e664-48fb-9f3e-902fc22de291 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:50.800049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3cdc5ce6-e664-48fb-9f3e-902fc22de291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '014235b8daef456e97692382aac97d1e', 'request_id': 'req-3cdc5ce6-e664-48fb-9f3e-902fc22de291'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:50.841139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3cdc5ce6-e664-48fb-9f3e-902fc22de291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '014235b8daef456e97692382aac97d1e', 'request_id': 'req-3cdc5ce6-e664-48fb-9f3e-902fc22de291'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:50.847404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3cdc5ce6-e664-48fb-9f3e-902fc22de291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '014235b8daef456e97692382aac97d1e', 'request_id': 'req-3cdc5ce6-e664-48fb-9f3e-902fc22de291'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:50.858661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3cdc5ce6-e664-48fb-9f3e-902fc22de291 admin admin] The token cache is being invalidate because project 014235b8daef456e97692382aac97d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:52:50.858949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3cdc5ce6-e664-48fb-9f3e-902fc22de291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:50.859631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3cdc5ce6-e664-48fb-9f3e-902fc22de291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:50.861265 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3842/7670] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:52:50 2022] DELETE /identity/v3/projects/014235b8daef456e97692382aac97d1e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:50.866985 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c122f61-77f0-4180-8cb6-e8d04fe18d6e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:50.867461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c122f61-77f0-4180-8cb6-e8d04fe18d6e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:50.868204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c122f61-77f0-4180-8cb6-e8d04fe18d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:50.886421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3c122f61-77f0-4180-8cb6-e8d04fe18d6e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:52:50.887619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3c122f61-77f0-4180-8cb6-e8d04fe18d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:50.960783 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3829/7671] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:52:50.963471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd172dfa-defa-4095-90f6-d92da5c0bace None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:50.963928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd172dfa-defa-4095-90f6-d92da5c0bace None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:50.964018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd172dfa-defa-4095-90f6-d92da5c0bace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:50.984166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fd172dfa-defa-4095-90f6-d92da5c0bace None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:52:50.985445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fd172dfa-defa-4095-90f6-d92da5c0bace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:51.003862 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3843/7672] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:52:51.005057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c122f61-77f0-4180-8cb6-e8d04fe18d6e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:51.015954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c122f61-77f0-4180-8cb6-e8d04fe18d6e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:51.022013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd8bbf-5a2c-4baf-b400-4922b2e5ce85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:51.022896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd8bbf-5a2c-4baf-b400-4922b2e5ce85 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:51.023184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd8bbf-5a2c-4baf-b400-4922b2e5ce85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:51.023469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd8bbf-5a2c-4baf-b400-4922b2e5ce85 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:51.024321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd8bbf-5a2c-4baf-b400-4922b2e5ce85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:52:51.024717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd8bbf-5a2c-4baf-b400-4922b2e5ce85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:51.027367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd8bbf-5a2c-4baf-b400-4922b2e5ce85 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:51.044947 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3830/7673] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:52:51.047687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd172dfa-defa-4095-90f6-d92da5c0bace None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:51.058857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd172dfa-defa-4095-90f6-d92da5c0bace None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:51.063827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354999ed-e254-46ed-84e6-ea4e71eac34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:51.064487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354999ed-e254-46ed-84e6-ea4e71eac34b admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:51.064923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354999ed-e254-46ed-84e6-ea4e71eac34b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:51.065203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354999ed-e254-46ed-84e6-ea4e71eac34b admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:51.065989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354999ed-e254-46ed-84e6-ea4e71eac34b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:51.068005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354999ed-e254-46ed-84e6-ea4e71eac34b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:51.220560 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3844/7674] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:52:51 2022] POST /identity/v3/projects => generated 367 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:52:51.224783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd8bbf-5a2c-4baf-b400-4922b2e5ce85 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:51.235473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd8bbf-5a2c-4baf-b400-4922b2e5ce85 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:51.292940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f4e0b-74b1-4ca1-a955-30c5ab34550c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:51.293532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f4e0b-74b1-4ca1-a955-30c5ab34550c admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:51.293814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f4e0b-74b1-4ca1-a955-30c5ab34550c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:51.294136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f4e0b-74b1-4ca1-a955-30c5ab34550c admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:51.294922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f4e0b-74b1-4ca1-a955-30c5ab34550c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:51.296944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f4e0b-74b1-4ca1-a955-30c5ab34550c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:51.424767 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3831/7675] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:52:51 2022] POST /identity/v3/users => generated 284 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:52:51.428916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354999ed-e254-46ed-84e6-ea4e71eac34b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:51.439176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354999ed-e254-46ed-84e6-ea4e71eac34b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:51.443658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d7c7c-a196-4e7a-aeef-ba383e334edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:51.444313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d7c7c-a196-4e7a-aeef-ba383e334edb admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:51.444614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d7c7c-a196-4e7a-aeef-ba383e334edb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:51.444910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d7c7c-a196-4e7a-aeef-ba383e334edb admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:51.445638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d7c7c-a196-4e7a-aeef-ba383e334edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:51.447262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d7c7c-a196-4e7a-aeef-ba383e334edb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:51.458383 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3845/7676] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:52:51.462641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f4e0b-74b1-4ca1-a955-30c5ab34550c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:51.472797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f4e0b-74b1-4ca1-a955-30c5ab34550c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:51.477820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e882bf-8b92-460e-8bfc-cea8934dfdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:51.478472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e882bf-8b92-460e-8bfc-cea8934dfdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:51.478756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e882bf-8b92-460e-8bfc-cea8934dfdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:51.479033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e882bf-8b92-460e-8bfc-cea8934dfdc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:51.479747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e882bf-8b92-460e-8bfc-cea8934dfdc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:51.481467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e882bf-8b92-460e-8bfc-cea8934dfdc3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:51.491140 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3832/7677] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:52:51.495109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d7c7c-a196-4e7a-aeef-ba383e334edb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:51.504927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d7c7c-a196-4e7a-aeef-ba383e334edb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:51.509463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cb6bd-85d9-4ab5-83aa-ded9dac25cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:51.510330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cb6bd-85d9-4ab5-83aa-ded9dac25cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:51.510863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cb6bd-85d9-4ab5-83aa-ded9dac25cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:51.511151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cb6bd-85d9-4ab5-83aa-ded9dac25cc1 admin admin] PATH_INFO: `/v3/projects/ca34994907fa4265b622c6f9a56c2095/users/c7304814a6a943a29c94002f14139250/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:51.526222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cb6bd-85d9-4ab5-83aa-ded9dac25cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca34994907fa4265b622c6f9a56c2095, user_id=c7304814a6a943a29c94002f14139250, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:51.528978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cb6bd-85d9-4ab5-83aa-ded9dac25cc1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:51.618749 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3846/7678] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:52:51 2022] PUT /identity/v3/projects/ca34994907fa4265b622c6f9a56c2095/users/c7304814a6a943a29c94002f14139250/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:51.629568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a489409-ab61-4820-96bf-9eb96bcb6aa0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:51.629864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a489409-ab61-4820-96bf-9eb96bcb6aa0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:51.630149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a489409-ab61-4820-96bf-9eb96bcb6aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:51.657118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5a489409-ab61-4820-96bf-9eb96bcb6aa0 None None] MFA Rules not processed for user `c7304814a6a943a29c94002f14139250`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:52:51.658349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5a489409-ab61-4820-96bf-9eb96bcb6aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:51.723691 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3833/7679] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:52:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:52:51.727980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cb6bd-85d9-4ab5-83aa-ded9dac25cc1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:51.791893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cb6bd-85d9-4ab5-83aa-ded9dac25cc1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:51.796858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47a561-2c37-4e6b-923a-d71a87a232de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:51.797413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47a561-2c37-4e6b-923a-d71a87a232de admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:51.797705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47a561-2c37-4e6b-923a-d71a87a232de admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:51.797985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47a561-2c37-4e6b-923a-d71a87a232de admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:51.798676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47a561-2c37-4e6b-923a-d71a87a232de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:51.800693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47a561-2c37-4e6b-923a-d71a87a232de admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:51.947216 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3847/7680] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:52:51 2022] POST /identity/v3/projects => generated 365 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:52:51.950831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a489409-ab61-4820-96bf-9eb96bcb6aa0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:51.961444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a489409-ab61-4820-96bf-9eb96bcb6aa0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:52.021657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba25d8-4a0c-4e44-a212-feb19b5140c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:52.022333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba25d8-4a0c-4e44-a212-feb19b5140c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:52.022619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba25d8-4a0c-4e44-a212-feb19b5140c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:52.023324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba25d8-4a0c-4e44-a212-feb19b5140c8 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:52.023975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba25d8-4a0c-4e44-a212-feb19b5140c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:52.026055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba25d8-4a0c-4e44-a212-feb19b5140c8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:52.041135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47a561-2c37-4e6b-923a-d71a87a232de admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:52.042899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6f47a561-2c37-4e6b-923a-d71a87a232de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:52.136312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47a561-2c37-4e6b-923a-d71a87a232de admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:52.148409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3f899-cb1d-4c32-8bb9-487bfcb1a4f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:52.148409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3f899-cb1d-4c32-8bb9-487bfcb1a4f7 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:52.148409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3f899-cb1d-4c32-8bb9-487bfcb1a4f7 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:52.148409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3f899-cb1d-4c32-8bb9-487bfcb1a4f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:52.148953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7cf3f899-cb1d-4c32-8bb9-487bfcb1a4f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:52.164732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3f899-cb1d-4c32-8bb9-487bfcb1a4f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:52.166925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3f899-cb1d-4c32-8bb9-487bfcb1a4f7 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:52.173967 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3834/7681] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:52:51 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:52:52.182744 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3848/7682] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:52:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:52:52.185770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba25d8-4a0c-4e44-a212-feb19b5140c8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:52.196272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba25d8-4a0c-4e44-a212-feb19b5140c8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:52.209224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368525e0-b5aa-4a15-89a8-7225f66b9cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:52.211568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368525e0-b5aa-4a15-89a8-7225f66b9cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:52.211568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368525e0-b5aa-4a15-89a8-7225f66b9cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:52.211568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368525e0-b5aa-4a15-89a8-7225f66b9cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:52.211568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368525e0-b5aa-4a15-89a8-7225f66b9cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:52.212859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368525e0-b5aa-4a15-89a8-7225f66b9cd6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:52.231807 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3835/7683] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:52:52.233369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3f899-cb1d-4c32-8bb9-487bfcb1a4f7 service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:52.245470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3f899-cb1d-4c32-8bb9-487bfcb1a4f7 service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:52.250501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb0501-4a4b-4e6c-a8ce-7fa83e7f10fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:52.251492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb0501-4a4b-4e6c-a8ce-7fa83e7f10fb admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:52.252033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb0501-4a4b-4e6c-a8ce-7fa83e7f10fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:52.252291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb0501-4a4b-4e6c-a8ce-7fa83e7f10fb admin admin] PATH_INFO: `/v3/projects/4f7aa4d2101a4151973b5d6618b656ec/users/d407cd338aac494d960faa35e65b8cdc/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:52.270788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb0501-4a4b-4e6c-a8ce-7fa83e7f10fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7aa4d2101a4151973b5d6618b656ec, user_id=d407cd338aac494d960faa35e65b8cdc, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:52.275522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb0501-4a4b-4e6c-a8ce-7fa83e7f10fb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:52.373968 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3849/7684] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:52:52 2022] PUT /identity/v3/projects/4f7aa4d2101a4151973b5d6618b656ec/users/d407cd338aac494d960faa35e65b8cdc/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:52.378199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368525e0-b5aa-4a15-89a8-7225f66b9cd6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:52.390830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368525e0-b5aa-4a15-89a8-7225f66b9cd6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:52.453839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95dcb5-1dd5-4cba-8007-4f5ae0aecfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:52.454676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95dcb5-1dd5-4cba-8007-4f5ae0aecfbf admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:52.455100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95dcb5-1dd5-4cba-8007-4f5ae0aecfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:52.455483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95dcb5-1dd5-4cba-8007-4f5ae0aecfbf admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:52.456311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95dcb5-1dd5-4cba-8007-4f5ae0aecfbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:52.458146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95dcb5-1dd5-4cba-8007-4f5ae0aecfbf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:52.468682 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3836/7685] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:52:52.472934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb0501-4a4b-4e6c-a8ce-7fa83e7f10fb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:52.483674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb0501-4a4b-4e6c-a8ce-7fa83e7f10fb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:52.488350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e8ee5-d356-460e-8bbe-0ac8501b3a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:52.489273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e8ee5-d356-460e-8bbe-0ac8501b3a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:52.489821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e8ee5-d356-460e-8bbe-0ac8501b3a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:52.490110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e8ee5-d356-460e-8bbe-0ac8501b3a79 admin admin] PATH_INFO: `/v3/projects/4f7aa4d2101a4151973b5d6618b656ec/users/d407cd338aac494d960faa35e65b8cdc/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:52.492111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e8ee5-d356-460e-8bbe-0ac8501b3a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7aa4d2101a4151973b5d6618b656ec, user_id=d407cd338aac494d960faa35e65b8cdc, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:52.495427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e8ee5-d356-460e-8bbe-0ac8501b3a79 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:52.505661 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3850/7686] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:52:52 2022] PUT /identity/v3/projects/4f7aa4d2101a4151973b5d6618b656ec/users/d407cd338aac494d960faa35e65b8cdc/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:52:52.516572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43df98-f741-4cb9-8ef4-d17e3d9c5ce0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:52.516836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43df98-f741-4cb9-8ef4-d17e3d9c5ce0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:52.517121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43df98-f741-4cb9-8ef4-d17e3d9c5ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:52.544110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2d43df98-f741-4cb9-8ef4-d17e3d9c5ce0 None None] MFA Rules not processed for user `d407cd338aac494d960faa35e65b8cdc`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:52:52.545362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2d43df98-f741-4cb9-8ef4-d17e3d9c5ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:52.613838 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3837/7687] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:52:52 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:52:52.618249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e8ee5-d356-460e-8bbe-0ac8501b3a79 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:52.630224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e8ee5-d356-460e-8bbe-0ac8501b3a79 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:52.634826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a27a72-ef8f-417b-a2c1-8cffb7e596f8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:52.635472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a27a72-ef8f-417b-a2c1-8cffb7e596f8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:52.636016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a27a72-ef8f-417b-a2c1-8cffb7e596f8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:52.636299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a27a72-ef8f-417b-a2c1-8cffb7e596f8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:52.637069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a27a72-ef8f-417b-a2c1-8cffb7e596f8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:52.638694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a27a72-ef8f-417b-a2c1-8cffb7e596f8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:52.719859 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3851/7688] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:52:52 2022] POST /identity/v3/domains => generated 276 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:52:52.725334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43df98-f741-4cb9-8ef4-d17e3d9c5ce0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:52.735773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43df98-f741-4cb9-8ef4-d17e3d9c5ce0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:52.794378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289b691-35a0-4a50-9b3a-2baa8d7a6a1c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:52.795020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289b691-35a0-4a50-9b3a-2baa8d7a6a1c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:52.795308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289b691-35a0-4a50-9b3a-2baa8d7a6a1c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:52.795589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289b691-35a0-4a50-9b3a-2baa8d7a6a1c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:52.796291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289b691-35a0-4a50-9b3a-2baa8d7a6a1c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:52.798231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289b691-35a0-4a50-9b3a-2baa8d7a6a1c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:52.859687 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3838/7689] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 2 10:52:52 2022] POST /identity/v3/groups => generated 280 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:52:52.863787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a27a72-ef8f-417b-a2c1-8cffb7e596f8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:52.874456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a27a72-ef8f-417b-a2c1-8cffb7e596f8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:52.879583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbc28b-5479-4132-be89-680afd9c347e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:52.880536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbc28b-5479-4132-be89-680afd9c347e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:52.883306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbc28b-5479-4132-be89-680afd9c347e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:52.883306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbc28b-5479-4132-be89-680afd9c347e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups/191a424f6a8e44268fb9b05d58031b5f` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:52.886924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbc28b-5479-4132-be89-680afd9c347e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:update_group(group_id=191a424f6a8e44268fb9b05d58031b5f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:52.887955 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-adfbc28b-5479-4132-be89-680afd9c347e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:52:52.887955 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:52:52.887955 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:52:52.889273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbc28b-5479-4132-be89-680afd9c347e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:52.952693 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3852/7690] 10.222.0.16 () {60 vars in 1246 bytes} [Mon May 2 10:52:52 2022] PATCH /identity/v3/groups/191a424f6a8e44268fb9b05d58031b5f => generated 293 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:52:52.955144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289b691-35a0-4a50-9b3a-2baa8d7a6a1c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:52.965794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289b691-35a0-4a50-9b3a-2baa8d7a6a1c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:52.970416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7335dbc-8164-4b39-8282-44e615e22c4f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:52.971312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7335dbc-8164-4b39-8282-44e615e22c4f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:52.971597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7335dbc-8164-4b39-8282-44e615e22c4f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:52.971877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7335dbc-8164-4b39-8282-44e615e22c4f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups/191a424f6a8e44268fb9b05d58031b5f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:52.976679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7335dbc-8164-4b39-8282-44e615e22c4f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:get_group(group_id=191a424f6a8e44268fb9b05d58031b5f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:52.979257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7335dbc-8164-4b39-8282-44e615e22c4f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:52.980905 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3839/7691] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:52:52 2022] GET /identity/v3/groups/191a424f6a8e44268fb9b05d58031b5f => generated 293 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:52:52.992143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbc28b-5479-4132-be89-680afd9c347e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:53.002516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbc28b-5479-4132-be89-680afd9c347e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:53.007115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246c283-bb26-4ef4-886a-2f34e4f689cf tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:53.007956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246c283-bb26-4ef4-886a-2f34e4f689cf tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:53.008242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246c283-bb26-4ef4-886a-2f34e4f689cf tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:53.008522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246c283-bb26-4ef4-886a-2f34e4f689cf tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups/191a424f6a8e44268fb9b05d58031b5f` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:53.009815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246c283-bb26-4ef4-886a-2f34e4f689cf tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:update_group(group_id=191a424f6a8e44268fb9b05d58031b5f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:53.012010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246c283-bb26-4ef4-886a-2f34e4f689cf tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:53.158499 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3853/7692] 10.222.0.16 () {60 vars in 1245 bytes} [Mon May 2 10:52:52 2022] PATCH /identity/v3/groups/191a424f6a8e44268fb9b05d58031b5f => generated 309 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:52:53.163756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7335dbc-8164-4b39-8282-44e615e22c4f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:53.175293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7335dbc-8164-4b39-8282-44e615e22c4f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:53.183000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63132f61-b4af-4eae-a506-3e3dcda60a7e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:53.183000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63132f61-b4af-4eae-a506-3e3dcda60a7e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:53.183199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63132f61-b4af-4eae-a506-3e3dcda60a7e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:53.183372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63132f61-b4af-4eae-a506-3e3dcda60a7e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups/191a424f6a8e44268fb9b05d58031b5f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:53.188588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63132f61-b4af-4eae-a506-3e3dcda60a7e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:delete_group(group_id=191a424f6a8e44268fb9b05d58031b5f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:53.190606 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63132f61-b4af-4eae-a506-3e3dcda60a7e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:53.287365 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3840/7693] 10.222.0.16 () {58 vars in 1226 bytes} [Mon May 2 10:52:53 2022] DELETE /identity/v3/groups/191a424f6a8e44268fb9b05d58031b5f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:53.292673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246c283-bb26-4ef4-886a-2f34e4f689cf tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:53.302646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246c283-bb26-4ef4-886a-2f34e4f689cf tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:53.356205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb445f8-70b6-435a-8bda-866bdb86e21a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:53.356834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb445f8-70b6-435a-8bda-866bdb86e21a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:53.357125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb445f8-70b6-435a-8bda-866bdb86e21a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:53.357414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb445f8-70b6-435a-8bda-866bdb86e21a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:53.358098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb445f8-70b6-435a-8bda-866bdb86e21a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:53.360029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb445f8-70b6-435a-8bda-866bdb86e21a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:53.408211 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3854/7694] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 2 10:52:53 2022] POST /identity/v3/groups => generated 326 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:52:53.412454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63132f61-b4af-4eae-a506-3e3dcda60a7e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:53.422915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63132f61-b4af-4eae-a506-3e3dcda60a7e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:53.427594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c8279-7393-4d6e-b3ed-8cf746b7ad09 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:53.428297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8279-7393-4d6e-b3ed-8cf746b7ad09 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:53.428587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8279-7393-4d6e-b3ed-8cf746b7ad09 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:53.428912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8279-7393-4d6e-b3ed-8cf746b7ad09 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:53.429608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c8279-7393-4d6e-b3ed-8cf746b7ad09 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:53.431972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c8279-7393-4d6e-b3ed-8cf746b7ad09 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:53.502862 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3841/7695] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:52:53 2022] POST /identity/v3/users => generated 321 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:52:53.506906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb445f8-70b6-435a-8bda-866bdb86e21a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:53.518011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb445f8-70b6-435a-8bda-866bdb86e21a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:53.522786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788d4b7-664a-451d-8183-fd3dc08fdfa5 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:53.528890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788d4b7-664a-451d-8183-fd3dc08fdfa5 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:53.528890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788d4b7-664a-451d-8183-fd3dc08fdfa5 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:53.528890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788d4b7-664a-451d-8183-fd3dc08fdfa5 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb/users/602f222ce7d54afbaf60688d918710c4` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:53.542615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788d4b7-664a-451d-8183-fd3dc08fdfa5 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=91b1af3a4eeb491e9e751ede3e12d9cb, user_id=602f222ce7d54afbaf60688d918710c4)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:53.544522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788d4b7-664a-451d-8183-fd3dc08fdfa5 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:53.659306 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3855/7696] 10.222.0.16 () {60 vars in 1359 bytes} [Mon May 2 10:52:53 2022] PUT /identity/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb/users/602f222ce7d54afbaf60688d918710c4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:53.663588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c8279-7393-4d6e-b3ed-8cf746b7ad09 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:53.677644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c8279-7393-4d6e-b3ed-8cf746b7ad09 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:53.735157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22500524-90f8-4c22-b978-53b87324130a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:53.735833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22500524-90f8-4c22-b978-53b87324130a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:53.736123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22500524-90f8-4c22-b978-53b87324130a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:53.736408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22500524-90f8-4c22-b978-53b87324130a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:53.737231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22500524-90f8-4c22-b978-53b87324130a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:53.739329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22500524-90f8-4c22-b978-53b87324130a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:53.862861 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3842/7697] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:52:53 2022] POST /identity/v3/users => generated 323 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:52:53.866983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788d4b7-664a-451d-8183-fd3dc08fdfa5 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:53.878593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788d4b7-664a-451d-8183-fd3dc08fdfa5 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:53.883427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3b0c6-9c3c-4f3e-9213-779172c8b746 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:53.884425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3b0c6-9c3c-4f3e-9213-779172c8b746 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:53.884708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3b0c6-9c3c-4f3e-9213-779172c8b746 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:53.884989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3b0c6-9c3c-4f3e-9213-779172c8b746 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb/users/2e6e3e37f9e64de684e903a79dc2e22b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:53.900149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3b0c6-9c3c-4f3e-9213-779172c8b746 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=91b1af3a4eeb491e9e751ede3e12d9cb, user_id=2e6e3e37f9e64de684e903a79dc2e22b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:53.902138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3b0c6-9c3c-4f3e-9213-779172c8b746 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:53.995037 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3856/7698] 10.222.0.16 () {60 vars in 1359 bytes} [Mon May 2 10:52:53 2022] PUT /identity/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb/users/2e6e3e37f9e64de684e903a79dc2e22b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:53.997153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22500524-90f8-4c22-b978-53b87324130a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:54.007683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22500524-90f8-4c22-b978-53b87324130a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:54.074048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6feb6af-857d-483e-990d-0d72903a20d6 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:54.074803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6feb6af-857d-483e-990d-0d72903a20d6 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:54.075095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6feb6af-857d-483e-990d-0d72903a20d6 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:54.075384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6feb6af-857d-483e-990d-0d72903a20d6 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:54.077086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6feb6af-857d-483e-990d-0d72903a20d6 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:54.079344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6feb6af-857d-483e-990d-0d72903a20d6 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:54.188459 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3843/7699] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:52:53 2022] POST /identity/v3/users => generated 323 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:52:54.188561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3b0c6-9c3c-4f3e-9213-779172c8b746 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:54.199199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3b0c6-9c3c-4f3e-9213-779172c8b746 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:54.203845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ead17c-3e9d-4675-b116-3ffb96f7bc1f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:54.204803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ead17c-3e9d-4675-b116-3ffb96f7bc1f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:54.205093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ead17c-3e9d-4675-b116-3ffb96f7bc1f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:54.205375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ead17c-3e9d-4675-b116-3ffb96f7bc1f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb/users/283abf1b676b46e1a6aae69e18cff376` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:54.230926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ead17c-3e9d-4675-b116-3ffb96f7bc1f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=91b1af3a4eeb491e9e751ede3e12d9cb, user_id=283abf1b676b46e1a6aae69e18cff376)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:54.232984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ead17c-3e9d-4675-b116-3ffb96f7bc1f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:54.333534 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3857/7700] 10.222.0.16 () {60 vars in 1359 bytes} [Mon May 2 10:52:54 2022] PUT /identity/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb/users/283abf1b676b46e1a6aae69e18cff376 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:54.338352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6feb6af-857d-483e-990d-0d72903a20d6 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:54.351194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6feb6af-857d-483e-990d-0d72903a20d6 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:54.407636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af9ee2-0b87-44f9-9fb4-c074cbfa1bcf tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:54.408497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af9ee2-0b87-44f9-9fb4-c074cbfa1bcf tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:54.408815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af9ee2-0b87-44f9-9fb4-c074cbfa1bcf tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:54.409099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af9ee2-0b87-44f9-9fb4-c074cbfa1bcf tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:54.410350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af9ee2-0b87-44f9-9fb4-c074cbfa1bcf tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=91b1af3a4eeb491e9e751ede3e12d9cb)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:54.411577 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-11af9ee2-0b87-44f9-9fb4-c074cbfa1bcf tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:52:54.411577 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:52:54.411577 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:52:54.412837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af9ee2-0b87-44f9-9fb4-c074cbfa1bcf tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:54.433024 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3844/7701] 10.222.0.16 () {58 vars in 1241 bytes} [Mon May 2 10:52:54 2022] GET /identity/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb/users => generated 1083 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:52:54.437231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ead17c-3e9d-4675-b116-3ffb96f7bc1f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:54.447852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ead17c-3e9d-4675-b116-3ffb96f7bc1f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:54.452833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b28b60-af61-4a3b-809d-b76677ce94b8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:54.458027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b28b60-af61-4a3b-809d-b76677ce94b8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:54.458027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b28b60-af61-4a3b-809d-b76677ce94b8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:54.458027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b28b60-af61-4a3b-809d-b76677ce94b8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb/users/602f222ce7d54afbaf60688d918710c4` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:54.458027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b28b60-af61-4a3b-809d-b76677ce94b8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=91b1af3a4eeb491e9e751ede3e12d9cb, user_id=602f222ce7d54afbaf60688d918710c4)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:54.458373 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-52b28b60-af61-4a3b-809d-b76677ce94b8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:52:54.458373 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:52:54.458373 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:52:54.458373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b28b60-af61-4a3b-809d-b76677ce94b8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:54.472486 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3858/7702] 10.222.0.16 () {58 vars in 1341 bytes} [Mon May 2 10:52:54 2022] HEAD /identity/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb/users/602f222ce7d54afbaf60688d918710c4 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:54.476534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af9ee2-0b87-44f9-9fb4-c074cbfa1bcf tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:54.488152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af9ee2-0b87-44f9-9fb4-c074cbfa1bcf tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:54.493135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1449203-d13d-41c8-b395-cffcb3401b41 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:54.496193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1449203-d13d-41c8-b395-cffcb3401b41 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:54.496193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1449203-d13d-41c8-b395-cffcb3401b41 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:54.496193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1449203-d13d-41c8-b395-cffcb3401b41 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb/users/602f222ce7d54afbaf60688d918710c4` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:54.498746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1449203-d13d-41c8-b395-cffcb3401b41 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=91b1af3a4eeb491e9e751ede3e12d9cb, user_id=602f222ce7d54afbaf60688d918710c4)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:54.499860 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-d1449203-d13d-41c8-b395-cffcb3401b41 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:52:54.499860 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:52:54.499860 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:52:54.501299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1449203-d13d-41c8-b395-cffcb3401b41 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:54.561554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d1449203-d13d-41c8-b395-cffcb3401b41 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '602f222ce7d54afbaf60688d918710c4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:54.631614 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3845/7703] 10.222.0.16 () {58 vars in 1343 bytes} [Mon May 2 10:52:54 2022] DELETE /identity/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb/users/602f222ce7d54afbaf60688d918710c4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:54.636588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b28b60-af61-4a3b-809d-b76677ce94b8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:54.647043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b28b60-af61-4a3b-809d-b76677ce94b8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:54.706148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bd22f-a606-4d2a-b238-4e74362e28f0 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:54.707036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bd22f-a606-4d2a-b238-4e74362e28f0 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:54.707445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bd22f-a606-4d2a-b238-4e74362e28f0 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:54.707734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bd22f-a606-4d2a-b238-4e74362e28f0 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb/users/2e6e3e37f9e64de684e903a79dc2e22b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:54.709562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bd22f-a606-4d2a-b238-4e74362e28f0 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=91b1af3a4eeb491e9e751ede3e12d9cb, user_id=2e6e3e37f9e64de684e903a79dc2e22b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:54.711468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bd22f-a606-4d2a-b238-4e74362e28f0 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:54.726482 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3859/7704] 10.222.0.16 () {58 vars in 1341 bytes} [Mon May 2 10:52:54 2022] HEAD /identity/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb/users/2e6e3e37f9e64de684e903a79dc2e22b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:54.730543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1449203-d13d-41c8-b395-cffcb3401b41 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:54.742495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1449203-d13d-41c8-b395-cffcb3401b41 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:54.748179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e1545-ab52-42e0-88ac-55df965ecb17 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:54.749210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e1545-ab52-42e0-88ac-55df965ecb17 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:54.749575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e1545-ab52-42e0-88ac-55df965ecb17 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:54.749961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e1545-ab52-42e0-88ac-55df965ecb17 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb/users/2e6e3e37f9e64de684e903a79dc2e22b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:54.752060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e1545-ab52-42e0-88ac-55df965ecb17 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=91b1af3a4eeb491e9e751ede3e12d9cb, user_id=2e6e3e37f9e64de684e903a79dc2e22b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:54.754392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e1545-ab52-42e0-88ac-55df965ecb17 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:54.853115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4a3e1545-ab52-42e0-88ac-55df965ecb17 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2e6e3e37f9e64de684e903a79dc2e22b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:54.945274 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3846/7705] 10.222.0.16 () {58 vars in 1343 bytes} [Mon May 2 10:52:54 2022] DELETE /identity/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb/users/2e6e3e37f9e64de684e903a79dc2e22b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:54.950755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bd22f-a606-4d2a-b238-4e74362e28f0 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:54.960947 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bd22f-a606-4d2a-b238-4e74362e28f0 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:55.057760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ee1b8-b721-429f-b2cc-674a3cdad48f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:55.057760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ee1b8-b721-429f-b2cc-674a3cdad48f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:55.057760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ee1b8-b721-429f-b2cc-674a3cdad48f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:55.058026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ee1b8-b721-429f-b2cc-674a3cdad48f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb/users/283abf1b676b46e1a6aae69e18cff376` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:55.058026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ee1b8-b721-429f-b2cc-674a3cdad48f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=91b1af3a4eeb491e9e751ede3e12d9cb, user_id=283abf1b676b46e1a6aae69e18cff376)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:55.058026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ee1b8-b721-429f-b2cc-674a3cdad48f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:55.058026 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3860/7706] 10.222.0.16 () {58 vars in 1341 bytes} [Mon May 2 10:52:54 2022] HEAD /identity/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb/users/283abf1b676b46e1a6aae69e18cff376 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:52:55.058321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e1545-ab52-42e0-88ac-55df965ecb17 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:55.062283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e1545-ab52-42e0-88ac-55df965ecb17 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:55.067267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628e762-48b5-4677-855e-977f3b6fb2e8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:55.068161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628e762-48b5-4677-855e-977f3b6fb2e8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:55.068542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628e762-48b5-4677-855e-977f3b6fb2e8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:55.068860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628e762-48b5-4677-855e-977f3b6fb2e8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb/users/283abf1b676b46e1a6aae69e18cff376` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:55.070614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628e762-48b5-4677-855e-977f3b6fb2e8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=91b1af3a4eeb491e9e751ede3e12d9cb, user_id=283abf1b676b46e1a6aae69e18cff376)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:55.073122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628e762-48b5-4677-855e-977f3b6fb2e8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:55.146178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5628e762-48b5-4677-855e-977f3b6fb2e8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '283abf1b676b46e1a6aae69e18cff376'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:55.278375 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3847/7707] 10.222.0.16 () {58 vars in 1343 bytes} [Mon May 2 10:52:55 2022] DELETE /identity/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb/users/283abf1b676b46e1a6aae69e18cff376 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:55.284429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ee1b8-b721-429f-b2cc-674a3cdad48f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:55.297461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ee1b8-b721-429f-b2cc-674a3cdad48f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:55.366565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b04296-1583-4b86-92b5-814878c0278d tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:55.367552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b04296-1583-4b86-92b5-814878c0278d tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:55.367910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b04296-1583-4b86-92b5-814878c0278d tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:55.368290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b04296-1583-4b86-92b5-814878c0278d tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:55.369739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b04296-1583-4b86-92b5-814878c0278d tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=91b1af3a4eeb491e9e751ede3e12d9cb)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:55.371060 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-50b04296-1583-4b86-92b5-814878c0278d tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:52:55.371060 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:52:55.371060 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:52:55.372991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b04296-1583-4b86-92b5-814878c0278d tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:55.390189 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3861/7708] 10.222.0.16 () {58 vars in 1241 bytes} [Mon May 2 10:52:55 2022] GET /identity/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb/users => generated 145 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:52:55.391147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628e762-48b5-4677-855e-977f3b6fb2e8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:55.406378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628e762-48b5-4677-855e-977f3b6fb2e8 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:55.426868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e7c33-aa95-480b-83ef-68432ea3d245 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:55.428053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e7c33-aa95-480b-83ef-68432ea3d245 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:55.428423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e7c33-aa95-480b-83ef-68432ea3d245 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:55.428969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e7c33-aa95-480b-83ef-68432ea3d245 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/users/283abf1b676b46e1a6aae69e18cff376` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:55.430359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e7c33-aa95-480b-83ef-68432ea3d245 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:delete_user(user_id=283abf1b676b46e1a6aae69e18cff376)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:55.432548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e7c33-aa95-480b-83ef-68432ea3d245 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:55.558532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6b6e7c33-aa95-480b-83ef-68432ea3d245 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '283abf1b676b46e1a6aae69e18cff376'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:55.574474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6b6e7c33-aa95-480b-83ef-68432ea3d245 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '283abf1b676b46e1a6aae69e18cff376'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:55.575349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6b6e7c33-aa95-480b-83ef-68432ea3d245 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '283abf1b676b46e1a6aae69e18cff376'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:55.582691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6b6e7c33-aa95-480b-83ef-68432ea3d245 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '283abf1b676b46e1a6aae69e18cff376'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:55.641917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6b6e7c33-aa95-480b-83ef-68432ea3d245 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '283abf1b676b46e1a6aae69e18cff376'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:55.648936 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3848/7709] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:52:55 2022] DELETE /identity/v3/users/283abf1b676b46e1a6aae69e18cff376 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:55.653640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b04296-1583-4b86-92b5-814878c0278d tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:55.655392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-50b04296-1583-4b86-92b5-814878c0278d tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:55.667941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b04296-1583-4b86-92b5-814878c0278d tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:55.724570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5c3a7-616b-4e06-a041-3f86db65a29e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:55.725235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5c3a7-616b-4e06-a041-3f86db65a29e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:55.725522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5c3a7-616b-4e06-a041-3f86db65a29e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:55.725803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5c3a7-616b-4e06-a041-3f86db65a29e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/users/2e6e3e37f9e64de684e903a79dc2e22b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:55.727057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5c3a7-616b-4e06-a041-3f86db65a29e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2e6e3e37f9e64de684e903a79dc2e22b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:55.729102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5c3a7-616b-4e06-a041-3f86db65a29e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:55.833589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b8a5c3a7-616b-4e06-a041-3f86db65a29e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e6e3e37f9e64de684e903a79dc2e22b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:55.847601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b8a5c3a7-616b-4e06-a041-3f86db65a29e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e6e3e37f9e64de684e903a79dc2e22b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:55.848459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b8a5c3a7-616b-4e06-a041-3f86db65a29e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e6e3e37f9e64de684e903a79dc2e22b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:55.862500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b8a5c3a7-616b-4e06-a041-3f86db65a29e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e6e3e37f9e64de684e903a79dc2e22b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:55.950413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b8a5c3a7-616b-4e06-a041-3f86db65a29e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e6e3e37f9e64de684e903a79dc2e22b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:55.956976 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3862/7710] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:52:55 2022] DELETE /identity/v3/users/2e6e3e37f9e64de684e903a79dc2e22b => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:52:55.961155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e7c33-aa95-480b-83ef-68432ea3d245 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:55.971224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e7c33-aa95-480b-83ef-68432ea3d245 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:56.030852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f18be-f071-4006-ad7d-038f2219c4f2 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:56.039476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f18be-f071-4006-ad7d-038f2219c4f2 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:56.039476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f18be-f071-4006-ad7d-038f2219c4f2 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:56.039476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f18be-f071-4006-ad7d-038f2219c4f2 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/users/602f222ce7d54afbaf60688d918710c4` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:56.039476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f18be-f071-4006-ad7d-038f2219c4f2 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:delete_user(user_id=602f222ce7d54afbaf60688d918710c4)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:56.039476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f18be-f071-4006-ad7d-038f2219c4f2 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:56.170356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-155f18be-f071-4006-ad7d-038f2219c4f2 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '602f222ce7d54afbaf60688d918710c4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:56.183972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-155f18be-f071-4006-ad7d-038f2219c4f2 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '602f222ce7d54afbaf60688d918710c4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:56.184922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-155f18be-f071-4006-ad7d-038f2219c4f2 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '602f222ce7d54afbaf60688d918710c4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:56.193216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-155f18be-f071-4006-ad7d-038f2219c4f2 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '602f222ce7d54afbaf60688d918710c4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:56.247725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-155f18be-f071-4006-ad7d-038f2219c4f2 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '602f222ce7d54afbaf60688d918710c4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:56.259205 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3849/7711] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:52:55 2022] DELETE /identity/v3/users/602f222ce7d54afbaf60688d918710c4 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:56.262537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5c3a7-616b-4e06-a041-3f86db65a29e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:56.265223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b8a5c3a7-616b-4e06-a041-3f86db65a29e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:56.279151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5c3a7-616b-4e06-a041-3f86db65a29e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:56.346029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c22a91-801a-48d9-8296-1f5efad9f219 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:56.346928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c22a91-801a-48d9-8296-1f5efad9f219 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:56.347214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c22a91-801a-48d9-8296-1f5efad9f219 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:56.347494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c22a91-801a-48d9-8296-1f5efad9f219 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:56.348824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c22a91-801a-48d9-8296-1f5efad9f219 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:delete_group(group_id=91b1af3a4eeb491e9e751ede3e12d9cb)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:56.350883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c22a91-801a-48d9-8296-1f5efad9f219 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:56.453103 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3863/7712] 10.222.0.16 () {58 vars in 1226 bytes} [Mon May 2 10:52:56 2022] DELETE /identity/v3/groups/91b1af3a4eeb491e9e751ede3e12d9cb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:56.458508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f18be-f071-4006-ad7d-038f2219c4f2 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:56.460188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-155f18be-f071-4006-ad7d-038f2219c4f2 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:56.476926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f18be-f071-4006-ad7d-038f2219c4f2 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:56.535637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ae699-55b6-4f7c-874e-362b7960004a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:56.536318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ae699-55b6-4f7c-874e-362b7960004a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:56.536629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ae699-55b6-4f7c-874e-362b7960004a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:56.536966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ae699-55b6-4f7c-874e-362b7960004a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:56.537648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ae699-55b6-4f7c-874e-362b7960004a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:56.540023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ae699-55b6-4f7c-874e-362b7960004a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:56.619691 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3850/7713] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 2 10:52:56 2022] POST /identity/v3/groups => generated 326 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:52:56.623784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c22a91-801a-48d9-8296-1f5efad9f219 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:56.634634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c22a91-801a-48d9-8296-1f5efad9f219 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:56.640414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283efda-c125-4564-ae16-881e6067df1e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:56.641154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283efda-c125-4564-ae16-881e6067df1e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:56.641448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283efda-c125-4564-ae16-881e6067df1e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:56.641735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283efda-c125-4564-ae16-881e6067df1e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:56.642432 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283efda-c125-4564-ae16-881e6067df1e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:56.644371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283efda-c125-4564-ae16-881e6067df1e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:56.725293 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3864/7714] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 2 10:52:56 2022] POST /identity/v3/groups => generated 327 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:52:56.726363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ae699-55b6-4f7c-874e-362b7960004a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:56.737253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ae699-55b6-4f7c-874e-362b7960004a tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:56.742079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241a828-e8e8-4cdc-b96a-d3985a85b702 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:56.742878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241a828-e8e8-4cdc-b96a-d3985a85b702 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:56.743056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241a828-e8e8-4cdc-b96a-d3985a85b702 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:56.743340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241a828-e8e8-4cdc-b96a-d3985a85b702 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:56.744045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241a828-e8e8-4cdc-b96a-d3985a85b702 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:56.746004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241a828-e8e8-4cdc-b96a-d3985a85b702 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:56.862735 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3851/7715] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 2 10:52:56 2022] POST /identity/v3/groups => generated 326 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:52:56.863921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283efda-c125-4564-ae16-881e6067df1e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:56.875572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283efda-c125-4564-ae16-881e6067df1e tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:56.885271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa9c53-149f-4c61-b88c-fe6d59d3104c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:56.885271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa9c53-149f-4c61-b88c-fe6d59d3104c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:56.885707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa9c53-149f-4c61-b88c-fe6d59d3104c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:56.886325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa9c53-149f-4c61-b88c-fe6d59d3104c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:56.887124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa9c53-149f-4c61-b88c-fe6d59d3104c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:56.888180 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-6aaa9c53-149f-4c61-b88c-fe6d59d3104c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 02 10:52:56.888180 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:52:56.888180 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:52:56.889528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa9c53-149f-4c61-b88c-fe6d59d3104c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:56.901831 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3865/7716] 10.222.0.16 () {58 vars in 1124 bytes} [Mon May 2 10:52:56 2022] GET /identity/v3/groups => generated 1489 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:52:56.902993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241a828-e8e8-4cdc-b96a-d3985a85b702 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:56.916354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241a828-e8e8-4cdc-b96a-d3985a85b702 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:56.921169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f633c69-58b4-440f-b6c0-5ace8df2f8d3 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:56.922017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f633c69-58b4-440f-b6c0-5ace8df2f8d3 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:56.922307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f633c69-58b4-440f-b6c0-5ace8df2f8d3 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:56.922609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f633c69-58b4-440f-b6c0-5ace8df2f8d3 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups/c2d6117a4e74415ea0cc7509fff2d0e3` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:56.927921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f633c69-58b4-440f-b6c0-5ace8df2f8d3 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c2d6117a4e74415ea0cc7509fff2d0e3)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:56.929866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f633c69-58b4-440f-b6c0-5ace8df2f8d3 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:57.088422 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3852/7717] 10.222.0.16 () {58 vars in 1226 bytes} [Mon May 2 10:52:56 2022] DELETE /identity/v3/groups/c2d6117a4e74415ea0cc7509fff2d0e3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:52:57.093151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa9c53-149f-4c61-b88c-fe6d59d3104c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:57.103984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa9c53-149f-4c61-b88c-fe6d59d3104c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:57.169215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98727ad2-60e6-447c-8f0e-68129abef082 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:57.170119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98727ad2-60e6-447c-8f0e-68129abef082 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:57.170410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98727ad2-60e6-447c-8f0e-68129abef082 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:57.170699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98727ad2-60e6-447c-8f0e-68129abef082 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups/270df3a721914ff88266eb49fa04c95e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:57.175686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98727ad2-60e6-447c-8f0e-68129abef082 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:delete_group(group_id=270df3a721914ff88266eb49fa04c95e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:57.177716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98727ad2-60e6-447c-8f0e-68129abef082 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:57.280674 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3866/7718] 10.222.0.16 () {58 vars in 1226 bytes} [Mon May 2 10:52:57 2022] DELETE /identity/v3/groups/270df3a721914ff88266eb49fa04c95e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:57.284984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f633c69-58b4-440f-b6c0-5ace8df2f8d3 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:57.295534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f633c69-58b4-440f-b6c0-5ace8df2f8d3 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:57.352701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b8494-d4b3-408a-b6b3-f449d185eae9 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:57.353652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b8494-d4b3-408a-b6b3-f449d185eae9 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:57.353944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b8494-d4b3-408a-b6b3-f449d185eae9 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:57.354260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b8494-d4b3-408a-b6b3-f449d185eae9 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups/281d5d73f0a94b1cbbaa94b09bb060e4` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:57.359291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b8494-d4b3-408a-b6b3-f449d185eae9 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:delete_group(group_id=281d5d73f0a94b1cbbaa94b09bb060e4)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:57.361430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b8494-d4b3-408a-b6b3-f449d185eae9 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:57.486786 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3853/7719] 10.222.0.16 () {58 vars in 1226 bytes} [Mon May 2 10:52:57 2022] DELETE /identity/v3/groups/281d5d73f0a94b1cbbaa94b09bb060e4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:57.491963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98727ad2-60e6-447c-8f0e-68129abef082 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:57.502772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98727ad2-60e6-447c-8f0e-68129abef082 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:57.559162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fcd04-ea79-482e-93c1-861dba462d72 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:57.559762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fcd04-ea79-482e-93c1-861dba462d72 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:57.560055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fcd04-ea79-482e-93c1-861dba462d72 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:57.560340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fcd04-ea79-482e-93c1-861dba462d72 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:57.561089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989fcd04-ea79-482e-93c1-861dba462d72 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:57.562946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989fcd04-ea79-482e-93c1-861dba462d72 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:57.616281 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3867/7720] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:52:57 2022] POST /identity/v3/users => generated 321 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:52:57.621226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b8494-d4b3-408a-b6b3-f449d185eae9 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:57.631629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b8494-d4b3-408a-b6b3-f449d185eae9 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:57.636521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6863e6f-5620-40fd-b758-94c29f0b6cb0 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:57.642839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6863e6f-5620-40fd-b758-94c29f0b6cb0 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:57.642839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6863e6f-5620-40fd-b758-94c29f0b6cb0 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:57.642839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6863e6f-5620-40fd-b758-94c29f0b6cb0 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:57.642839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6863e6f-5620-40fd-b758-94c29f0b6cb0 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:57.642839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6863e6f-5620-40fd-b758-94c29f0b6cb0 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:57.709950 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3854/7721] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 2 10:52:57 2022] POST /identity/v3/groups => generated 326 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:52:57.714215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fcd04-ea79-482e-93c1-861dba462d72 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:57.725500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fcd04-ea79-482e-93c1-861dba462d72 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:57.731226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96942044-7a5a-4366-b459-f3f785e3343f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:57.732259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96942044-7a5a-4366-b459-f3f785e3343f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:57.732712 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96942044-7a5a-4366-b459-f3f785e3343f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:57.733099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96942044-7a5a-4366-b459-f3f785e3343f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups/959a67778dcc419580d822e83a7c1580/users/01dc8c9537e34fad9ce2d8b5dc9a5442` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:57.754742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96942044-7a5a-4366-b459-f3f785e3343f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=959a67778dcc419580d822e83a7c1580, user_id=01dc8c9537e34fad9ce2d8b5dc9a5442)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:57.756903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96942044-7a5a-4366-b459-f3f785e3343f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:57.851298 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3868/7722] 10.222.0.16 () {60 vars in 1359 bytes} [Mon May 2 10:52:57 2022] PUT /identity/v3/groups/959a67778dcc419580d822e83a7c1580/users/01dc8c9537e34fad9ce2d8b5dc9a5442 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:57.852466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6863e6f-5620-40fd-b758-94c29f0b6cb0 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:57.863223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6863e6f-5620-40fd-b758-94c29f0b6cb0 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:57.917581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8eda44-71a7-4f6b-8314-f0299e75e62d tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:57.918251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8eda44-71a7-4f6b-8314-f0299e75e62d tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:57.918538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8eda44-71a7-4f6b-8314-f0299e75e62d tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:57.918818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8eda44-71a7-4f6b-8314-f0299e75e62d tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:57.919504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8eda44-71a7-4f6b-8314-f0299e75e62d tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:57.921446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8eda44-71a7-4f6b-8314-f0299e75e62d tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:58.009437 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3855/7723] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 2 10:52:57 2022] POST /identity/v3/groups => generated 327 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:52:58.011663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96942044-7a5a-4366-b459-f3f785e3343f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:58.022015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96942044-7a5a-4366-b459-f3f785e3343f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:58.027241 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106990f-fdb7-4288-acc8-992e8f957f1f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:58.028159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106990f-fdb7-4288-acc8-992e8f957f1f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:58.028475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106990f-fdb7-4288-acc8-992e8f957f1f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:58.028857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106990f-fdb7-4288-acc8-992e8f957f1f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups/501b7ffb37c242ddb971cb24c1333dac/users/01dc8c9537e34fad9ce2d8b5dc9a5442` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:58.034423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106990f-fdb7-4288-acc8-992e8f957f1f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=501b7ffb37c242ddb971cb24c1333dac, user_id=01dc8c9537e34fad9ce2d8b5dc9a5442)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:58.036474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106990f-fdb7-4288-acc8-992e8f957f1f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:58.122297 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3869/7724] 10.222.0.16 () {60 vars in 1359 bytes} [Mon May 2 10:52:58 2022] PUT /identity/v3/groups/501b7ffb37c242ddb971cb24c1333dac/users/01dc8c9537e34fad9ce2d8b5dc9a5442 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:58.126454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8eda44-71a7-4f6b-8314-f0299e75e62d tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:58.136857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8eda44-71a7-4f6b-8314-f0299e75e62d tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:58.190608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725de0bc-f2fb-47da-ab95-5c9681d10cb9 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:58.191432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725de0bc-f2fb-47da-ab95-5c9681d10cb9 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:58.191720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725de0bc-f2fb-47da-ab95-5c9681d10cb9 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:58.192000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725de0bc-f2fb-47da-ab95-5c9681d10cb9 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/users/01dc8c9537e34fad9ce2d8b5dc9a5442/groups` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:58.193296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725de0bc-f2fb-47da-ab95-5c9681d10cb9 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=01dc8c9537e34fad9ce2d8b5dc9a5442)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:58.195417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725de0bc-f2fb-47da-ab95-5c9681d10cb9 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:58.211989 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3856/7725] 10.222.0.16 () {58 vars in 1241 bytes} [Mon May 2 10:52:58 2022] GET /identity/v3/users/01dc8c9537e34fad9ce2d8b5dc9a5442/groups => generated 839 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:52:58.213937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106990f-fdb7-4288-acc8-992e8f957f1f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:58.224522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106990f-fdb7-4288-acc8-992e8f957f1f tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:58.230953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c1677-5245-4220-94a4-cca77835df68 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:58.231866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c1677-5245-4220-94a4-cca77835df68 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:58.232151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c1677-5245-4220-94a4-cca77835df68 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:58.236779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c1677-5245-4220-94a4-cca77835df68 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups/501b7ffb37c242ddb971cb24c1333dac` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:58.236779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c1677-5245-4220-94a4-cca77835df68 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:delete_group(group_id=501b7ffb37c242ddb971cb24c1333dac)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:58.236779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c1677-5245-4220-94a4-cca77835df68 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:58.344397 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3870/7726] 10.222.0.16 () {58 vars in 1226 bytes} [Mon May 2 10:52:58 2022] DELETE /identity/v3/groups/501b7ffb37c242ddb971cb24c1333dac => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:58.348483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725de0bc-f2fb-47da-ab95-5c9681d10cb9 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:58.358819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725de0bc-f2fb-47da-ab95-5c9681d10cb9 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:58.415538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5b821-614b-4faa-ad37-d433e6ed9a3c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:58.416408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5b821-614b-4faa-ad37-d433e6ed9a3c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:58.416728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5b821-614b-4faa-ad37-d433e6ed9a3c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:58.417040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5b821-614b-4faa-ad37-d433e6ed9a3c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/groups/959a67778dcc419580d822e83a7c1580` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:58.418302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5b821-614b-4faa-ad37-d433e6ed9a3c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:delete_group(group_id=959a67778dcc419580d822e83a7c1580)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:58.420211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5b821-614b-4faa-ad37-d433e6ed9a3c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:58.532867 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3857/7727] 10.222.0.16 () {58 vars in 1226 bytes} [Mon May 2 10:52:58 2022] DELETE /identity/v3/groups/959a67778dcc419580d822e83a7c1580 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:58.536968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c1677-5245-4220-94a4-cca77835df68 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:58.547779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c1677-5245-4220-94a4-cca77835df68 tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:58.603294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d704d2-de41-44dc-95f5-6028165710af tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:58.604195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d704d2-de41-44dc-95f5-6028165710af tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:58.604473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d704d2-de41-44dc-95f5-6028165710af tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:58.604790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d704d2-de41-44dc-95f5-6028165710af tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/users/01dc8c9537e34fad9ce2d8b5dc9a5442` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:58.606049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d704d2-de41-44dc-95f5-6028165710af tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:delete_user(user_id=01dc8c9537e34fad9ce2d8b5dc9a5442)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:58.607955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d704d2-de41-44dc-95f5-6028165710af tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:58.709540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-91d704d2-de41-44dc-95f5-6028165710af tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01dc8c9537e34fad9ce2d8b5dc9a5442'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:58.720900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-91d704d2-de41-44dc-95f5-6028165710af tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01dc8c9537e34fad9ce2d8b5dc9a5442'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:58.730537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-91d704d2-de41-44dc-95f5-6028165710af tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01dc8c9537e34fad9ce2d8b5dc9a5442'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:58.730537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-91d704d2-de41-44dc-95f5-6028165710af tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01dc8c9537e34fad9ce2d8b5dc9a5442'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:58.795695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-91d704d2-de41-44dc-95f5-6028165710af tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01dc8c9537e34fad9ce2d8b5dc9a5442'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:58.801977 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3871/7728] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:52:58 2022] DELETE /identity/v3/users/01dc8c9537e34fad9ce2d8b5dc9a5442 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:52:58.807674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5b821-614b-4faa-ad37-d433e6ed9a3c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:58.809450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-eff5b821-614b-4faa-ad37-d433e6ed9a3c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:58.822619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5b821-614b-4faa-ad37-d433e6ed9a3c tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:58.878831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48487e6c-3e14-4392-a27a-c338bfd7accb tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:58.879684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48487e6c-3e14-4392-a27a-c338bfd7accb tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:58.879967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48487e6c-3e14-4392-a27a-c338bfd7accb tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:58.880340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48487e6c-3e14-4392-a27a-c338bfd7accb tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/domains/71606cb1024f4dd1ae87eefab199b77c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:58.881616 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48487e6c-3e14-4392-a27a-c338bfd7accb tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=71606cb1024f4dd1ae87eefab199b77c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:58.883218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48487e6c-3e14-4392-a27a-c338bfd7accb tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:58.903772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-48487e6c-3e14-4392-a27a-c338bfd7accb tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '71606cb1024f4dd1ae87eefab199b77c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:58.904471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-48487e6c-3e14-4392-a27a-c338bfd7accb tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '71606cb1024f4dd1ae87eefab199b77c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:58.965739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-48487e6c-3e14-4392-a27a-c338bfd7accb tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '71606cb1024f4dd1ae87eefab199b77c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:58.967710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-48487e6c-3e14-4392-a27a-c338bfd7accb tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '71606cb1024f4dd1ae87eefab199b77c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:58.978070 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3858/7729] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:52:58 2022] PATCH /identity/v3/domains/71606cb1024f4dd1ae87eefab199b77c => generated 277 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:52:58.978163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d704d2-de41-44dc-95f5-6028165710af tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:58.985263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d704d2-de41-44dc-95f5-6028165710af tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:59.044375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7eaef1-b613-4cb0-8481-b8b49e4af8ee tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd407cd338aac494d960faa35e65b8cdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f7aa4d2101a4151973b5d6618b656ec', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:59.045282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7eaef1-b613-4cb0-8481-b8b49e4af8ee tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:59.045644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7eaef1-b613-4cb0-8481-b8b49e4af8ee tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:59.046015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7eaef1-b613-4cb0-8481-b8b49e4af8ee tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] PATH_INFO: `/v3/domains/71606cb1024f4dd1ae87eefab199b77c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:59.057012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7eaef1-b613-4cb0-8481-b8b49e4af8ee tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=71606cb1024f4dd1ae87eefab199b77c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:59.058778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7eaef1-b613-4cb0-8481-b8b49e4af8ee tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:59.081717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1b7eaef1-b613-4cb0-8481-b8b49e4af8ee tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '71606cb1024f4dd1ae87eefab199b77c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:59.084931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1b7eaef1-b613-4cb0-8481-b8b49e4af8ee tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '71606cb1024f4dd1ae87eefab199b77c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:59.218009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1b7eaef1-b613-4cb0-8481-b8b49e4af8ee tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71606cb1024f4dd1ae87eefab199b77c', 'request_id': 'req-1b7eaef1-b613-4cb0-8481-b8b49e4af8ee'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:59.321296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1b7eaef1-b613-4cb0-8481-b8b49e4af8ee tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71606cb1024f4dd1ae87eefab199b77c', 'request_id': 'req-1b7eaef1-b613-4cb0-8481-b8b49e4af8ee'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:59.328340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1b7eaef1-b613-4cb0-8481-b8b49e4af8ee tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71606cb1024f4dd1ae87eefab199b77c', 'request_id': 'req-1b7eaef1-b613-4cb0-8481-b8b49e4af8ee'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:59.338386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1b7eaef1-b613-4cb0-8481-b8b49e4af8ee tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] The token cache is being invalidate because project 71606cb1024f4dd1ae87eefab199b77c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:52:59.338676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1b7eaef1-b613-4cb0-8481-b8b49e4af8ee tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:59.339359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1b7eaef1-b613-4cb0-8481-b8b49e4af8ee tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:59.346523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1b7eaef1-b613-4cb0-8481-b8b49e4af8ee tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '71606cb1024f4dd1ae87eefab199b77c', 'request_id': 'req-1b7eaef1-b613-4cb0-8481-b8b49e4af8ee'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:59.347147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1b7eaef1-b613-4cb0-8481-b8b49e4af8ee tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '71606cb1024f4dd1ae87eefab199b77c', 'request_id': 'req-1b7eaef1-b613-4cb0-8481-b8b49e4af8ee'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:59.350340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1b7eaef1-b613-4cb0-8481-b8b49e4af8ee tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '71606cb1024f4dd1ae87eefab199b77c', 'request_id': 'req-1b7eaef1-b613-4cb0-8481-b8b49e4af8ee'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:59.356271 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3872/7730] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:52:58 2022] DELETE /identity/v3/domains/71606cb1024f4dd1ae87eefab199b77c => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:59.360221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48487e6c-3e14-4392-a27a-c338bfd7accb tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:59.361639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-48487e6c-3e14-4392-a27a-c338bfd7accb tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:59.427482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48487e6c-3e14-4392-a27a-c338bfd7accb tempest-GroupsV3TestJSON-82434087 tempest-GroupsV3TestJSON-82434087-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:59.485887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed0783-b103-41a6-a0e9-8a8eaa6c7260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:59.486699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed0783-b103-41a6-a0e9-8a8eaa6c7260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:59.486990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed0783-b103-41a6-a0e9-8a8eaa6c7260 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:59.487273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed0783-b103-41a6-a0e9-8a8eaa6c7260 admin admin] PATH_INFO: `/v3/users/c7304814a6a943a29c94002f14139250` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:59.488505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed0783-b103-41a6-a0e9-8a8eaa6c7260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7304814a6a943a29c94002f14139250)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:59.490478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed0783-b103-41a6-a0e9-8a8eaa6c7260 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:59.707601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ffed0783-b103-41a6-a0e9-8a8eaa6c7260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7304814a6a943a29c94002f14139250'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:59.723412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ffed0783-b103-41a6-a0e9-8a8eaa6c7260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7304814a6a943a29c94002f14139250'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:59.724280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ffed0783-b103-41a6-a0e9-8a8eaa6c7260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7304814a6a943a29c94002f14139250'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:59.732122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ffed0783-b103-41a6-a0e9-8a8eaa6c7260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7304814a6a943a29c94002f14139250'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:59.801979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ffed0783-b103-41a6-a0e9-8a8eaa6c7260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7304814a6a943a29c94002f14139250'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:52:59.808342 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3859/7731] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:52:59 2022] DELETE /identity/v3/users/c7304814a6a943a29c94002f14139250 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:52:59.813150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774be1d5-61b3-4c58-886d-084e4b76908d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:59.813620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774be1d5-61b3-4c58-886d-084e4b76908d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:59.813727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774be1d5-61b3-4c58-886d-084e4b76908d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:59.832110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-774be1d5-61b3-4c58-886d-084e4b76908d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:52:59.833638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-774be1d5-61b3-4c58-886d-084e4b76908d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:59.892401 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3873/7732] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:52:59.903013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed0783-b103-41a6-a0e9-8a8eaa6c7260 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:52:59.908507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ffed0783-b103-41a6-a0e9-8a8eaa6c7260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:52:59.960775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed0783-b103-41a6-a0e9-8a8eaa6c7260 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:52:59.964940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c0df5-7bc0-4a3b-8ee5-d8a0fa068f36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:52:59.965572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c0df5-7bc0-4a3b-8ee5-d8a0fa068f36 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:52:59.965904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c0df5-7bc0-4a3b-8ee5-d8a0fa068f36 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:52:59.966192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c0df5-7bc0-4a3b-8ee5-d8a0fa068f36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:52:59.975253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c0df5-7bc0-4a3b-8ee5-d8a0fa068f36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:52:59.976721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c0df5-7bc0-4a3b-8ee5-d8a0fa068f36 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:52:59.986188 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3860/7733] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:52:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:53:00.455243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774be1d5-61b3-4c58-886d-084e4b76908d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:00.456696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-774be1d5-61b3-4c58-886d-084e4b76908d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:00.470530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774be1d5-61b3-4c58-886d-084e4b76908d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:00.477422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e040b-74d5-46ec-a067-094b43f92a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:00.477422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e040b-74d5-46ec-a067-094b43f92a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:00.477422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e040b-74d5-46ec-a067-094b43f92a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:00.477422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e040b-74d5-46ec-a067-094b43f92a94 admin admin] PATH_INFO: `/v3/projects/ca34994907fa4265b622c6f9a56c2095` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:00.478479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e040b-74d5-46ec-a067-094b43f92a94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca34994907fa4265b622c6f9a56c2095)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:00.480688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e040b-74d5-46ec-a067-094b43f92a94 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:00.596306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-877e040b-74d5-46ec-a067-094b43f92a94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca34994907fa4265b622c6f9a56c2095', 'request_id': 'req-877e040b-74d5-46ec-a067-094b43f92a94'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:00.687363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-877e040b-74d5-46ec-a067-094b43f92a94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca34994907fa4265b622c6f9a56c2095', 'request_id': 'req-877e040b-74d5-46ec-a067-094b43f92a94'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:00.694571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-877e040b-74d5-46ec-a067-094b43f92a94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca34994907fa4265b622c6f9a56c2095', 'request_id': 'req-877e040b-74d5-46ec-a067-094b43f92a94'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:00.705118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-877e040b-74d5-46ec-a067-094b43f92a94 admin admin] The token cache is being invalidate because project ca34994907fa4265b622c6f9a56c2095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:00.705410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-877e040b-74d5-46ec-a067-094b43f92a94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:00.706081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-877e040b-74d5-46ec-a067-094b43f92a94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:00.707639 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3874/7734] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:00 2022] DELETE /identity/v3/projects/ca34994907fa4265b622c6f9a56c2095 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:00.711605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c0df5-7bc0-4a3b-8ee5-d8a0fa068f36 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:00.721724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c0df5-7bc0-4a3b-8ee5-d8a0fa068f36 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:00.777942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2154b-c0a6-4bcd-8e29-39c1a16786cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:00.778733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2154b-c0a6-4bcd-8e29-39c1a16786cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:00.779018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2154b-c0a6-4bcd-8e29-39c1a16786cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:00.779298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2154b-c0a6-4bcd-8e29-39c1a16786cf admin admin] PATH_INFO: `/v3/users/d407cd338aac494d960faa35e65b8cdc` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:00.780477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2154b-c0a6-4bcd-8e29-39c1a16786cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d407cd338aac494d960faa35e65b8cdc)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:00.782449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2154b-c0a6-4bcd-8e29-39c1a16786cf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:00.992660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0de2154b-c0a6-4bcd-8e29-39c1a16786cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd407cd338aac494d960faa35e65b8cdc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:01.004234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0de2154b-c0a6-4bcd-8e29-39c1a16786cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd407cd338aac494d960faa35e65b8cdc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:01.004929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0de2154b-c0a6-4bcd-8e29-39c1a16786cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd407cd338aac494d960faa35e65b8cdc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:01.012882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0de2154b-c0a6-4bcd-8e29-39c1a16786cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd407cd338aac494d960faa35e65b8cdc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:01.093001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0de2154b-c0a6-4bcd-8e29-39c1a16786cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd407cd338aac494d960faa35e65b8cdc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:01.103871 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3861/7735] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:00 2022] DELETE /identity/v3/users/d407cd338aac494d960faa35e65b8cdc => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:01.534955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e040b-74d5-46ec-a067-094b43f92a94 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:01.534955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-877e040b-74d5-46ec-a067-094b43f92a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:01.549330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e040b-74d5-46ec-a067-094b43f92a94 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:01.610137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0926e-1529-4538-83d9-687b2275d1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:01.611002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0926e-1529-4538-83d9-687b2275d1d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:01.611341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0926e-1529-4538-83d9-687b2275d1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:01.611619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0926e-1529-4538-83d9-687b2275d1d6 admin admin] PATH_INFO: `/v3/projects/4f7aa4d2101a4151973b5d6618b656ec` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:01.612854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0926e-1529-4538-83d9-687b2275d1d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7aa4d2101a4151973b5d6618b656ec)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:01.614765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0926e-1529-4538-83d9-687b2275d1d6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:01.724984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6af0926e-1529-4538-83d9-687b2275d1d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7aa4d2101a4151973b5d6618b656ec', 'request_id': 'req-6af0926e-1529-4538-83d9-687b2275d1d6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:01.784825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6af0926e-1529-4538-83d9-687b2275d1d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7aa4d2101a4151973b5d6618b656ec', 'request_id': 'req-6af0926e-1529-4538-83d9-687b2275d1d6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:01.792451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6af0926e-1529-4538-83d9-687b2275d1d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7aa4d2101a4151973b5d6618b656ec', 'request_id': 'req-6af0926e-1529-4538-83d9-687b2275d1d6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:01.803740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6af0926e-1529-4538-83d9-687b2275d1d6 admin admin] The token cache is being invalidate because project 4f7aa4d2101a4151973b5d6618b656ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:01.804038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6af0926e-1529-4538-83d9-687b2275d1d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:01.804751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6af0926e-1529-4538-83d9-687b2275d1d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:01.806875 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3875/7736] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:01 2022] DELETE /identity/v3/projects/4f7aa4d2101a4151973b5d6618b656ec => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:01.812088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efeec08-5f21-4fb6-b39c-77d86e109e1c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:01.812561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efeec08-5f21-4fb6-b39c-77d86e109e1c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:01.812745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efeec08-5f21-4fb6-b39c-77d86e109e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:01.832945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2efeec08-5f21-4fb6-b39c-77d86e109e1c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:01.834725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2efeec08-5f21-4fb6-b39c-77d86e109e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:01.896823 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3862/7737] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:53:01.904314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47048b5-b607-42c2-9900-dcef2304bd73 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:01.904626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47048b5-b607-42c2-9900-dcef2304bd73 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:01.904917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47048b5-b607-42c2-9900-dcef2304bd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:01.924568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f47048b5-b607-42c2-9900-dcef2304bd73 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:01.925808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f47048b5-b607-42c2-9900-dcef2304bd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:01.934535 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3876/7738] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:53:01.938808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efeec08-5f21-4fb6-b39c-77d86e109e1c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:01.949150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efeec08-5f21-4fb6-b39c-77d86e109e1c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:01.953691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce98143-ad4c-4304-8df2-c2ab79431413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:01.954348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce98143-ad4c-4304-8df2-c2ab79431413 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:01.954632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce98143-ad4c-4304-8df2-c2ab79431413 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:01.954911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce98143-ad4c-4304-8df2-c2ab79431413 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:01.960732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce98143-ad4c-4304-8df2-c2ab79431413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:53:01.960732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce98143-ad4c-4304-8df2-c2ab79431413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:01.960732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce98143-ad4c-4304-8df2-c2ab79431413 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:01.969604 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3863/7739] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:01.974026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47048b5-b607-42c2-9900-dcef2304bd73 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:01.984719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47048b5-b607-42c2-9900-dcef2304bd73 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:01.989505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf96c0f-1a51-43e0-81cd-c274d2482550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:01.990168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf96c0f-1a51-43e0-81cd-c274d2482550 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:01.990459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf96c0f-1a51-43e0-81cd-c274d2482550 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:01.990788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf96c0f-1a51-43e0-81cd-c274d2482550 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:01.992067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf96c0f-1a51-43e0-81cd-c274d2482550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:01.994801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf96c0f-1a51-43e0-81cd-c274d2482550 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:02.109396 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3877/7740] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:01 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:02.110959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce98143-ad4c-4304-8df2-c2ab79431413 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:02.122198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce98143-ad4c-4304-8df2-c2ab79431413 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:02.186636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36a4a6-361d-49a7-9929-52c72978bbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:02.187328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36a4a6-361d-49a7-9929-52c72978bbe1 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:02.187674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36a4a6-361d-49a7-9929-52c72978bbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:02.187955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36a4a6-361d-49a7-9929-52c72978bbe1 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:02.188677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36a4a6-361d-49a7-9929-52c72978bbe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:02.191237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36a4a6-361d-49a7-9929-52c72978bbe1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:02.293878 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3864/7741] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:53:02 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:02.297897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf96c0f-1a51-43e0-81cd-c274d2482550 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:02.308986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf96c0f-1a51-43e0-81cd-c274d2482550 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:02.313588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55f096-45d0-40cd-ad69-979288567454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:02.314294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55f096-45d0-40cd-ad69-979288567454 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:02.314584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55f096-45d0-40cd-ad69-979288567454 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:02.314869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55f096-45d0-40cd-ad69-979288567454 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:02.315595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55f096-45d0-40cd-ad69-979288567454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:02.317284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55f096-45d0-40cd-ad69-979288567454 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:02.327822 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3878/7742] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:02.331763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36a4a6-361d-49a7-9929-52c72978bbe1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:02.341564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36a4a6-361d-49a7-9929-52c72978bbe1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:02.346294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da1df3-39e2-4f4b-98ae-40d274db6ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:02.346944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da1df3-39e2-4f4b-98ae-40d274db6ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:02.347227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da1df3-39e2-4f4b-98ae-40d274db6ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:02.347507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da1df3-39e2-4f4b-98ae-40d274db6ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:02.348250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da1df3-39e2-4f4b-98ae-40d274db6ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:02.350166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da1df3-39e2-4f4b-98ae-40d274db6ea4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:02.361165 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3865/7743] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:02.365455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55f096-45d0-40cd-ad69-979288567454 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:02.376149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55f096-45d0-40cd-ad69-979288567454 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:02.380862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6031c8-496e-4610-84c9-962b98bae5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:02.381755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6031c8-496e-4610-84c9-962b98bae5ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:02.382053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6031c8-496e-4610-84c9-962b98bae5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:02.382330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6031c8-496e-4610-84c9-962b98bae5ff admin admin] PATH_INFO: `/v3/projects/712b2d0f002246e8a83547914d9a8530/users/ef3e8cd50e2f42e0a2ebd8ddc840d0eb/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:02.396623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6031c8-496e-4610-84c9-962b98bae5ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=712b2d0f002246e8a83547914d9a8530, user_id=ef3e8cd50e2f42e0a2ebd8ddc840d0eb, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:02.399536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6031c8-496e-4610-84c9-962b98bae5ff admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:02.516591 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3879/7744] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:02 2022] PUT /identity/v3/projects/712b2d0f002246e8a83547914d9a8530/users/ef3e8cd50e2f42e0a2ebd8ddc840d0eb/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:02.528551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb2951-d0e0-473c-965d-f0d78b0d56fe None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:02.528894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb2951-d0e0-473c-965d-f0d78b0d56fe None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:02.529183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb2951-d0e0-473c-965d-f0d78b0d56fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:02.557782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-dccb2951-d0e0-473c-965d-f0d78b0d56fe None None] MFA Rules not processed for user `ef3e8cd50e2f42e0a2ebd8ddc840d0eb`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:02.559008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-dccb2951-d0e0-473c-965d-f0d78b0d56fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:02.624948 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3866/7745] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:02.638505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6031c8-496e-4610-84c9-962b98bae5ff admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:02.692612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6031c8-496e-4610-84c9-962b98bae5ff admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:02.697527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c6bf4-11ee-4287-a691-22cc0afbb9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:02.698200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c6bf4-11ee-4287-a691-22cc0afbb9fe admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:02.698493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c6bf4-11ee-4287-a691-22cc0afbb9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:02.698778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c6bf4-11ee-4287-a691-22cc0afbb9fe admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:02.700539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c6bf4-11ee-4287-a691-22cc0afbb9fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:02.701518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c6bf4-11ee-4287-a691-22cc0afbb9fe admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:02.790187 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3880/7746] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:02 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:02.791842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb2951-d0e0-473c-965d-f0d78b0d56fe None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:02.803821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb2951-d0e0-473c-965d-f0d78b0d56fe None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:02.859428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed346e-b521-4ac2-b989-b356e4b661c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:02.860107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed346e-b521-4ac2-b989-b356e4b661c7 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:02.860377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed346e-b521-4ac2-b989-b356e4b661c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:02.860688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed346e-b521-4ac2-b989-b356e4b661c7 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:02.861374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed346e-b521-4ac2-b989-b356e4b661c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:02.863345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed346e-b521-4ac2-b989-b356e4b661c7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:02.955873 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3867/7747] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:53:02 2022] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:02.959955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c6bf4-11ee-4287-a691-22cc0afbb9fe admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:02.971019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c6bf4-11ee-4287-a691-22cc0afbb9fe admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:02.975901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c1399-a35e-4495-938c-acd8a4eecc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:02.976559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c1399-a35e-4495-938c-acd8a4eecc57 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:02.976882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c1399-a35e-4495-938c-acd8a4eecc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:02.977196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c1399-a35e-4495-938c-acd8a4eecc57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:02.977920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c1399-a35e-4495-938c-acd8a4eecc57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:02.979548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c1399-a35e-4495-938c-acd8a4eecc57 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:02.990133 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3881/7748] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:02.994253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed346e-b521-4ac2-b989-b356e4b661c7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:03.005370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed346e-b521-4ac2-b989-b356e4b661c7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:03.010096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52509fa2-29df-4bea-810c-92b73f1ecf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:03.011917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52509fa2-29df-4bea-810c-92b73f1ecf9b admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:03.012208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52509fa2-29df-4bea-810c-92b73f1ecf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:03.012725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52509fa2-29df-4bea-810c-92b73f1ecf9b admin admin] PATH_INFO: `/v3/projects/c147d47f26e34ebf8b99e86cf3610140/users/2b6072cc9dc845ccb9332377a1c89d42/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:03.029768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52509fa2-29df-4bea-810c-92b73f1ecf9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c147d47f26e34ebf8b99e86cf3610140, user_id=2b6072cc9dc845ccb9332377a1c89d42, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:03.033000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52509fa2-29df-4bea-810c-92b73f1ecf9b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:03.122485 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3868/7749] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:02 2022] PUT /identity/v3/projects/c147d47f26e34ebf8b99e86cf3610140/users/2b6072cc9dc845ccb9332377a1c89d42/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:03.126665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c1399-a35e-4495-938c-acd8a4eecc57 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:03.137873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c1399-a35e-4495-938c-acd8a4eecc57 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:03.192935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a20ce-da06-4895-b34e-3dcf8d93d23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:03.193676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a20ce-da06-4895-b34e-3dcf8d93d23e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:03.193953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a20ce-da06-4895-b34e-3dcf8d93d23e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:03.194232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a20ce-da06-4895-b34e-3dcf8d93d23e admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:03.194953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a20ce-da06-4895-b34e-3dcf8d93d23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:03.196550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a20ce-da06-4895-b34e-3dcf8d93d23e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:03.207193 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3882/7750] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:03.211323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52509fa2-29df-4bea-810c-92b73f1ecf9b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:03.221791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52509fa2-29df-4bea-810c-92b73f1ecf9b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:03.226590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0def1-c296-4694-bc8c-e51567c70182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:03.228100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0def1-c296-4694-bc8c-e51567c70182 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:03.228100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0def1-c296-4694-bc8c-e51567c70182 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:03.228100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0def1-c296-4694-bc8c-e51567c70182 admin admin] PATH_INFO: `/v3/projects/c147d47f26e34ebf8b99e86cf3610140/users/2b6072cc9dc845ccb9332377a1c89d42/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:03.230405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0def1-c296-4694-bc8c-e51567c70182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c147d47f26e34ebf8b99e86cf3610140, user_id=2b6072cc9dc845ccb9332377a1c89d42, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:03.233300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0def1-c296-4694-bc8c-e51567c70182 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:03.243655 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3869/7751] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:03 2022] PUT /identity/v3/projects/c147d47f26e34ebf8b99e86cf3610140/users/2b6072cc9dc845ccb9332377a1c89d42/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:03.259756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7a3d9-8a10-470d-87b9-93aded6a3358 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:03.260052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7a3d9-8a10-470d-87b9-93aded6a3358 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:03.260341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7a3d9-8a10-470d-87b9-93aded6a3358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:03.287662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-61e7a3d9-8a10-470d-87b9-93aded6a3358 None None] MFA Rules not processed for user `2b6072cc9dc845ccb9332377a1c89d42`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:03.288948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-61e7a3d9-8a10-470d-87b9-93aded6a3358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:03.354524 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3883/7752] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:03.359479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0def1-c296-4694-bc8c-e51567c70182 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:03.370509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0def1-c296-4694-bc8c-e51567c70182 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:03.375320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de9d7b-c6a0-4af6-b64e-7ab54e293a22 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b6072cc9dc845ccb9332377a1c89d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c147d47f26e34ebf8b99e86cf3610140', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:03.375955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de9d7b-c6a0-4af6-b64e-7ab54e293a22 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:03.376248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de9d7b-c6a0-4af6-b64e-7ab54e293a22 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:03.376532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de9d7b-c6a0-4af6-b64e-7ab54e293a22 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:03.377307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de9d7b-c6a0-4af6-b64e-7ab54e293a22 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:03.378313 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-f2de9d7b-c6a0-4af6-b64e-7ab54e293a22 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:53:03.378313 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:53:03.378313 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:53:03.379202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de9d7b-c6a0-4af6-b64e-7ab54e293a22 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:03.464386 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3870/7753] 10.222.0.16 () {60 vars in 1184 bytes} [Mon May 2 10:53:03 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:03.468289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7a3d9-8a10-470d-87b9-93aded6a3358 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:03.477608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7a3d9-8a10-470d-87b9-93aded6a3358 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:03.482353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df069f-6056-4236-baed-8b3c6b1a088c tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b6072cc9dc845ccb9332377a1c89d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c147d47f26e34ebf8b99e86cf3610140', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:03.483185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df069f-6056-4236-baed-8b3c6b1a088c tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:03.483472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df069f-6056-4236-baed-8b3c6b1a088c tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:03.483754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df069f-6056-4236-baed-8b3c6b1a088c tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/04e186330ccf4fdfbc3c6b889297f5d6` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:03.484442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df069f-6056-4236-baed-8b3c6b1a088c tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=04e186330ccf4fdfbc3c6b889297f5d6)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:03.485479 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-40df069f-6056-4236-baed-8b3c6b1a088c tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:53:03.485479 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:53:03.485479 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:53:03.486368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df069f-6056-4236-baed-8b3c6b1a088c tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:03.493181 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3884/7754] 10.222.0.16 () {58 vars in 1262 bytes} [Mon May 2 10:53:03 2022] GET /identity/v3/OS-OAUTH1/consumers/04e186330ccf4fdfbc3c6b889297f5d6 => generated 221 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:03.497632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de9d7b-c6a0-4af6-b64e-7ab54e293a22 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:03.507570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de9d7b-c6a0-4af6-b64e-7ab54e293a22 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:03.513202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1631671-5327-4ff3-a1f8-9b12b0727ea1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b6072cc9dc845ccb9332377a1c89d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c147d47f26e34ebf8b99e86cf3610140', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:03.514016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1631671-5327-4ff3-a1f8-9b12b0727ea1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:03.514376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1631671-5327-4ff3-a1f8-9b12b0727ea1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:03.514657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1631671-5327-4ff3-a1f8-9b12b0727ea1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/04e186330ccf4fdfbc3c6b889297f5d6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:03.515309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1631671-5327-4ff3-a1f8-9b12b0727ea1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=04e186330ccf4fdfbc3c6b889297f5d6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:03.516397 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-b1631671-5327-4ff3-a1f8-9b12b0727ea1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:53:03.516397 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:53:03.516397 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:53:03.517308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1631671-5327-4ff3-a1f8-9b12b0727ea1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:03.517580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b1631671-5327-4ff3-a1f8-9b12b0727ea1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Invalidating token cache because consumer 04e186330ccf4fdfbc3c6b889297f5d6 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:03.517872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b1631671-5327-4ff3-a1f8-9b12b0727ea1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:03.518536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b1631671-5327-4ff3-a1f8-9b12b0727ea1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:03.606899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b1631671-5327-4ff3-a1f8-9b12b0727ea1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '04e186330ccf4fdfbc3c6b889297f5d6', 'request_id': 'req-b1631671-5327-4ff3-a1f8-9b12b0727ea1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:03.692634 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3871/7755] 10.222.0.16 () {58 vars in 1265 bytes} [Mon May 2 10:53:03 2022] DELETE /identity/v3/OS-OAUTH1/consumers/04e186330ccf4fdfbc3c6b889297f5d6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:03.697563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df069f-6056-4236-baed-8b3c6b1a088c tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:03.699491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-40df069f-6056-4236-baed-8b3c6b1a088c tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:03.712466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df069f-6056-4236-baed-8b3c6b1a088c tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:03.717127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cfddf-9469-4610-9a1b-9e5d8f7c52ea tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b6072cc9dc845ccb9332377a1c89d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c147d47f26e34ebf8b99e86cf3610140', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:03.717702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cfddf-9469-4610-9a1b-9e5d8f7c52ea tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:03.717990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cfddf-9469-4610-9a1b-9e5d8f7c52ea tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:03.718272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cfddf-9469-4610-9a1b-9e5d8f7c52ea tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:03.718988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cfddf-9469-4610-9a1b-9e5d8f7c52ea tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:03.720034 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-fa4cfddf-9469-4610-9a1b-9e5d8f7c52ea tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:53:03.720034 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:53:03.720034 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:53:03.723683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cfddf-9469-4610-9a1b-9e5d8f7c52ea tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:03.839984 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3885/7756] 10.222.0.16 () {60 vars in 1184 bytes} [Mon May 2 10:53:03 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:03.841265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1631671-5327-4ff3-a1f8-9b12b0727ea1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:03.851840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1631671-5327-4ff3-a1f8-9b12b0727ea1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:03.857115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f010b5-449e-46b2-8785-63fcd8a5b6a4 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b6072cc9dc845ccb9332377a1c89d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c147d47f26e34ebf8b99e86cf3610140', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:03.857962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f010b5-449e-46b2-8785-63fcd8a5b6a4 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:03.858252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f010b5-449e-46b2-8785-63fcd8a5b6a4 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:03.858537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f010b5-449e-46b2-8785-63fcd8a5b6a4 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/def5def5bfda49349e5c91d9e35b6562` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:03.859220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f010b5-449e-46b2-8785-63fcd8a5b6a4 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=def5def5bfda49349e5c91d9e35b6562)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:03.860329 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-66f010b5-449e-46b2-8785-63fcd8a5b6a4 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:53:03.860329 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:53:03.860329 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:53:03.861256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f010b5-449e-46b2-8785-63fcd8a5b6a4 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:03.868883 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3872/7757] 10.222.0.16 () {58 vars in 1262 bytes} [Mon May 2 10:53:03 2022] GET /identity/v3/OS-OAUTH1/consumers/def5def5bfda49349e5c91d9e35b6562 => generated 221 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:53:03.870732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cfddf-9469-4610-9a1b-9e5d8f7c52ea tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:03.881012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cfddf-9469-4610-9a1b-9e5d8f7c52ea tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:03.885790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fe5a1-31d0-47bf-a5b5-deafcee6a5d1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b6072cc9dc845ccb9332377a1c89d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c147d47f26e34ebf8b99e86cf3610140', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:03.886878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fe5a1-31d0-47bf-a5b5-deafcee6a5d1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:03.887163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fe5a1-31d0-47bf-a5b5-deafcee6a5d1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:03.887444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fe5a1-31d0-47bf-a5b5-deafcee6a5d1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/def5def5bfda49349e5c91d9e35b6562` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:03.888103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fe5a1-31d0-47bf-a5b5-deafcee6a5d1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=def5def5bfda49349e5c91d9e35b6562)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:03.889138 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-2f3fe5a1-31d0-47bf-a5b5-deafcee6a5d1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:53:03.889138 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:53:03.889138 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:53:03.890033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fe5a1-31d0-47bf-a5b5-deafcee6a5d1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:03.890306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f3fe5a1-31d0-47bf-a5b5-deafcee6a5d1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Invalidating token cache because consumer def5def5bfda49349e5c91d9e35b6562 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:03.890589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f3fe5a1-31d0-47bf-a5b5-deafcee6a5d1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:03.891266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f3fe5a1-31d0-47bf-a5b5-deafcee6a5d1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:03.978423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f3fe5a1-31d0-47bf-a5b5-deafcee6a5d1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'def5def5bfda49349e5c91d9e35b6562', 'request_id': 'req-2f3fe5a1-31d0-47bf-a5b5-deafcee6a5d1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:04.121856 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3886/7758] 10.222.0.16 () {58 vars in 1265 bytes} [Mon May 2 10:53:03 2022] DELETE /identity/v3/OS-OAUTH1/consumers/def5def5bfda49349e5c91d9e35b6562 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:04.126211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f010b5-449e-46b2-8785-63fcd8a5b6a4 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:04.127888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-66f010b5-449e-46b2-8785-63fcd8a5b6a4 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:04.141066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f010b5-449e-46b2-8785-63fcd8a5b6a4 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:04.145540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7900f3-056a-41b5-9449-4abf2af19c6e tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b6072cc9dc845ccb9332377a1c89d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c147d47f26e34ebf8b99e86cf3610140', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:04.146352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7900f3-056a-41b5-9449-4abf2af19c6e tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:04.146636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7900f3-056a-41b5-9449-4abf2af19c6e tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:04.146916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7900f3-056a-41b5-9449-4abf2af19c6e tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/def5def5bfda49349e5c91d9e35b6562` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:04.147566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7900f3-056a-41b5-9449-4abf2af19c6e tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=def5def5bfda49349e5c91d9e35b6562)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:04.149244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7900f3-056a-41b5-9449-4abf2af19c6e tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:04.182941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-ac7900f3-056a-41b5-9449-4abf2af19c6e tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found May 02 10:53:04.182941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:53:04.182941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:53:04.182941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:53:04.182941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:53:04.182941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:53:04.182941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:53:04.182941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:53:04.182941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:53:04.182941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:53:04.182941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:53:04.182941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:53:04.182941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get May 02 10:53:04.182941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) May 02 10:53:04.182941 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer May 02 10:53:04.184004 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) May 02 10:53:04.184004 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer May 02 10:53:04.184004 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) May 02 10:53:04.184004 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret May 02 10:53:04.184004 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) May 02 10:53:04.184004 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer May 02 10:53:04.184004 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) May 02 10:53:04.184004 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found May 02 10:53:04.184004 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:53:04.184716 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3873/7759] 10.222.0.16 () {58 vars in 1262 bytes} [Mon May 2 10:53:04 2022] GET /identity/v3/OS-OAUTH1/consumers/def5def5bfda49349e5c91d9e35b6562 => generated 74 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 02 10:53:04.188264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fe5a1-31d0-47bf-a5b5-deafcee6a5d1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:04.198376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fe5a1-31d0-47bf-a5b5-deafcee6a5d1 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:04.202881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed20e8-dda9-4497-a068-2824e08cb539 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b6072cc9dc845ccb9332377a1c89d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c147d47f26e34ebf8b99e86cf3610140', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:04.203716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed20e8-dda9-4497-a068-2824e08cb539 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:04.203999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed20e8-dda9-4497-a068-2824e08cb539 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:04.204273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed20e8-dda9-4497-a068-2824e08cb539 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/def5def5bfda49349e5c91d9e35b6562` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:04.204986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed20e8-dda9-4497-a068-2824e08cb539 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=def5def5bfda49349e5c91d9e35b6562)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:04.206623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed20e8-dda9-4497-a068-2824e08cb539 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:04.206894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d3ed20e8-dda9-4497-a068-2824e08cb539 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Invalidating token cache because consumer def5def5bfda49349e5c91d9e35b6562 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:04.207171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d3ed20e8-dda9-4497-a068-2824e08cb539 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:04.207812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d3ed20e8-dda9-4497-a068-2824e08cb539 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:04.226781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-d3ed20e8-dda9-4497-a068-2824e08cb539 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found May 02 10:53:04.226781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:53:04.226781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:53:04.226781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:53:04.226781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:53:04.226781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:53:04.226781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:53:04.226781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:53:04.226781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:53:04.226781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:53:04.226781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:53:04.226781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:53:04.226781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete May 02 10:53:04.226781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( May 02 10:53:04.226781 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:53:04.227864 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:53:04.227864 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer May 02 10:53:04.227864 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) May 02 10:53:04.227864 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer May 02 10:53:04.227864 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) May 02 10:53:04.227864 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer May 02 10:53:04.227864 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) May 02 10:53:04.227864 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer May 02 10:53:04.227864 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) May 02 10:53:04.227864 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found May 02 10:53:04.227864 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:53:04.228848 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3887/7760] 10.222.0.16 () {58 vars in 1265 bytes} [Mon May 2 10:53:04 2022] DELETE /identity/v3/OS-OAUTH1/consumers/def5def5bfda49349e5c91d9e35b6562 => generated 74 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:53:04.233497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7900f3-056a-41b5-9449-4abf2af19c6e tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:04.235306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ac7900f3-056a-41b5-9449-4abf2af19c6e tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:04.248821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7900f3-056a-41b5-9449-4abf2af19c6e tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:04.253361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bca679-006b-49bf-b4a7-98b9c83d69f6 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b6072cc9dc845ccb9332377a1c89d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c147d47f26e34ebf8b99e86cf3610140', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:04.254029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bca679-006b-49bf-b4a7-98b9c83d69f6 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:04.261392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bca679-006b-49bf-b4a7-98b9c83d69f6 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:04.261392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bca679-006b-49bf-b4a7-98b9c83d69f6 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:04.261392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bca679-006b-49bf-b4a7-98b9c83d69f6 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:04.261392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bca679-006b-49bf-b4a7-98b9c83d69f6 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:04.328062 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3874/7761] 10.222.0.16 () {60 vars in 1184 bytes} [Mon May 2 10:53:04 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:04.331888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed20e8-dda9-4497-a068-2824e08cb539 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:04.342436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed20e8-dda9-4497-a068-2824e08cb539 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:04.346943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dc4aa-9300-4fb5-b141-b4bc1f9672ba tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b6072cc9dc845ccb9332377a1c89d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c147d47f26e34ebf8b99e86cf3610140', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:04.347568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dc4aa-9300-4fb5-b141-b4bc1f9672ba tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:04.347858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dc4aa-9300-4fb5-b141-b4bc1f9672ba tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:04.348137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dc4aa-9300-4fb5-b141-b4bc1f9672ba tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:04.348912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8dc4aa-9300-4fb5-b141-b4bc1f9672ba tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:04.350522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8dc4aa-9300-4fb5-b141-b4bc1f9672ba tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:04.430358 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3888/7762] 10.222.0.16 () {60 vars in 1184 bytes} [Mon May 2 10:53:04 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:04.434410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bca679-006b-49bf-b4a7-98b9c83d69f6 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:04.445247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bca679-006b-49bf-b4a7-98b9c83d69f6 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:04.450551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d45b72-29e5-4914-a606-d211650962dc tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b6072cc9dc845ccb9332377a1c89d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c147d47f26e34ebf8b99e86cf3610140', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:04.451324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d45b72-29e5-4914-a606-d211650962dc tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:04.451615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d45b72-29e5-4914-a606-d211650962dc tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:04.451894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d45b72-29e5-4914-a606-d211650962dc tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:04.452529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d45b72-29e5-4914-a606-d211650962dc tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:04.453594 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-35d45b72-29e5-4914-a606-d211650962dc tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:53:04.453594 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:53:04.453594 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:53:04.454468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d45b72-29e5-4914-a606-d211650962dc tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:04.460080 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3875/7763] 10.222.0.16 () {58 vars in 1163 bytes} [Mon May 2 10:53:04 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 537 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:53:04.464864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dc4aa-9300-4fb5-b141-b4bc1f9672ba tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:04.475078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dc4aa-9300-4fb5-b141-b4bc1f9672ba tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:04.479858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78643ca2-2923-4045-bcb1-c9044808be8f tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b6072cc9dc845ccb9332377a1c89d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c147d47f26e34ebf8b99e86cf3610140', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:04.480650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78643ca2-2923-4045-bcb1-c9044808be8f tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:04.481010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78643ca2-2923-4045-bcb1-c9044808be8f tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:04.481298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78643ca2-2923-4045-bcb1-c9044808be8f tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a83d3a303cc44959b1267c62cc9b6017` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:04.482174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78643ca2-2923-4045-bcb1-c9044808be8f tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=a83d3a303cc44959b1267c62cc9b6017)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:04.484235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78643ca2-2923-4045-bcb1-c9044808be8f tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:04.484517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-78643ca2-2923-4045-bcb1-c9044808be8f tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Invalidating token cache because consumer a83d3a303cc44959b1267c62cc9b6017 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:04.484825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-78643ca2-2923-4045-bcb1-c9044808be8f tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:04.485544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-78643ca2-2923-4045-bcb1-c9044808be8f tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:04.560860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-78643ca2-2923-4045-bcb1-c9044808be8f tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'a83d3a303cc44959b1267c62cc9b6017', 'request_id': 'req-78643ca2-2923-4045-bcb1-c9044808be8f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:04.642890 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3889/7764] 10.222.0.16 () {58 vars in 1265 bytes} [Mon May 2 10:53:04 2022] DELETE /identity/v3/OS-OAUTH1/consumers/a83d3a303cc44959b1267c62cc9b6017 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:04.647074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d45b72-29e5-4914-a606-d211650962dc tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:04.648893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-35d45b72-29e5-4914-a606-d211650962dc tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:04.663120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d45b72-29e5-4914-a606-d211650962dc tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:04.667793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2d124-877c-40d8-94b8-4ab057ecaab6 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b6072cc9dc845ccb9332377a1c89d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c147d47f26e34ebf8b99e86cf3610140', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:04.668704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2d124-877c-40d8-94b8-4ab057ecaab6 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:04.668993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2d124-877c-40d8-94b8-4ab057ecaab6 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:04.669272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2d124-877c-40d8-94b8-4ab057ecaab6 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/37742a3425624e6ab9f202ca63d1ec08` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:04.669920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2d124-877c-40d8-94b8-4ab057ecaab6 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=37742a3425624e6ab9f202ca63d1ec08)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:04.671503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2d124-877c-40d8-94b8-4ab057ecaab6 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:04.671772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c8d2d124-877c-40d8-94b8-4ab057ecaab6 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Invalidating token cache because consumer 37742a3425624e6ab9f202ca63d1ec08 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:04.672051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c8d2d124-877c-40d8-94b8-4ab057ecaab6 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:04.672716 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c8d2d124-877c-40d8-94b8-4ab057ecaab6 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:04.744053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c8d2d124-877c-40d8-94b8-4ab057ecaab6 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '37742a3425624e6ab9f202ca63d1ec08', 'request_id': 'req-c8d2d124-877c-40d8-94b8-4ab057ecaab6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:04.836789 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3876/7765] 10.222.0.16 () {58 vars in 1265 bytes} [Mon May 2 10:53:04 2022] DELETE /identity/v3/OS-OAUTH1/consumers/37742a3425624e6ab9f202ca63d1ec08 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:04.841853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78643ca2-2923-4045-bcb1-c9044808be8f tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:04.852370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78643ca2-2923-4045-bcb1-c9044808be8f tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:04.857038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057376c5-96af-4586-8f37-ef42642eb33e tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b6072cc9dc845ccb9332377a1c89d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c147d47f26e34ebf8b99e86cf3610140', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:04.857683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057376c5-96af-4586-8f37-ef42642eb33e tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:04.857969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057376c5-96af-4586-8f37-ef42642eb33e tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:04.858255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057376c5-96af-4586-8f37-ef42642eb33e tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:04.859088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057376c5-96af-4586-8f37-ef42642eb33e tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:04.860707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057376c5-96af-4586-8f37-ef42642eb33e tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:04.962411 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3890/7766] 10.222.0.16 () {60 vars in 1184 bytes} [Mon May 2 10:53:04 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:04.967088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2d124-877c-40d8-94b8-4ab057ecaab6 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:04.968651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c8d2d124-877c-40d8-94b8-4ab057ecaab6 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:04.981866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2d124-877c-40d8-94b8-4ab057ecaab6 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:04.986776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd8ed8-1b67-4ecd-bc8e-702b1ba83afe tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b6072cc9dc845ccb9332377a1c89d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c147d47f26e34ebf8b99e86cf3610140', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:04.987551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd8ed8-1b67-4ecd-bc8e-702b1ba83afe tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:04.987839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd8ed8-1b67-4ecd-bc8e-702b1ba83afe tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:04.988119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd8ed8-1b67-4ecd-bc8e-702b1ba83afe tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/7ca12b95428b46fcafcd54fda702037d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:04.988968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd8ed8-1b67-4ecd-bc8e-702b1ba83afe tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=7ca12b95428b46fcafcd54fda702037d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:04.990016 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-f6cd8ed8-1b67-4ecd-bc8e-702b1ba83afe tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:53:04.990016 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:53:04.990016 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:53:04.995952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd8ed8-1b67-4ecd-bc8e-702b1ba83afe tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:05.100267 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3877/7767] 10.222.0.16 () {60 vars in 1284 bytes} [Mon May 2 10:53:04 2022] PATCH /identity/v3/OS-OAUTH1/consumers/7ca12b95428b46fcafcd54fda702037d => generated 221 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:05.103421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057376c5-96af-4586-8f37-ef42642eb33e tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:05.115788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057376c5-96af-4586-8f37-ef42642eb33e tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:05.121204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5871962-11d2-4d7d-8ef0-b5d0d08796c0 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b6072cc9dc845ccb9332377a1c89d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c147d47f26e34ebf8b99e86cf3610140', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:05.122025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5871962-11d2-4d7d-8ef0-b5d0d08796c0 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:05.122308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5871962-11d2-4d7d-8ef0-b5d0d08796c0 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:05.122584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5871962-11d2-4d7d-8ef0-b5d0d08796c0 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/7ca12b95428b46fcafcd54fda702037d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:05.123233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5871962-11d2-4d7d-8ef0-b5d0d08796c0 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=7ca12b95428b46fcafcd54fda702037d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:05.124830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5871962-11d2-4d7d-8ef0-b5d0d08796c0 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:05.129569 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3891/7768] 10.222.0.16 () {58 vars in 1262 bytes} [Mon May 2 10:53:05 2022] GET /identity/v3/OS-OAUTH1/consumers/7ca12b95428b46fcafcd54fda702037d => generated 221 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:05.133871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd8ed8-1b67-4ecd-bc8e-702b1ba83afe tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:05.145351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd8ed8-1b67-4ecd-bc8e-702b1ba83afe tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:05.151208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63df84e-3d1e-4c34-bda1-e0f0e912b3cc tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b6072cc9dc845ccb9332377a1c89d42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c147d47f26e34ebf8b99e86cf3610140', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:05.152030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63df84e-3d1e-4c34-bda1-e0f0e912b3cc tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:05.152317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63df84e-3d1e-4c34-bda1-e0f0e912b3cc tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:05.152617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63df84e-3d1e-4c34-bda1-e0f0e912b3cc tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/7ca12b95428b46fcafcd54fda702037d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:05.153272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63df84e-3d1e-4c34-bda1-e0f0e912b3cc tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=7ca12b95428b46fcafcd54fda702037d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:05.154925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63df84e-3d1e-4c34-bda1-e0f0e912b3cc tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:05.155195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d63df84e-3d1e-4c34-bda1-e0f0e912b3cc tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Invalidating token cache because consumer 7ca12b95428b46fcafcd54fda702037d has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:05.155474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d63df84e-3d1e-4c34-bda1-e0f0e912b3cc tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:05.156152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d63df84e-3d1e-4c34-bda1-e0f0e912b3cc tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:05.212102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d63df84e-3d1e-4c34-bda1-e0f0e912b3cc tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '7ca12b95428b46fcafcd54fda702037d', 'request_id': 'req-d63df84e-3d1e-4c34-bda1-e0f0e912b3cc'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:05.258741 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3878/7769] 10.222.0.16 () {58 vars in 1265 bytes} [Mon May 2 10:53:05 2022] DELETE /identity/v3/OS-OAUTH1/consumers/7ca12b95428b46fcafcd54fda702037d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:05.264394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5871962-11d2-4d7d-8ef0-b5d0d08796c0 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:05.266134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f5871962-11d2-4d7d-8ef0-b5d0d08796c0 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:05.329395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5871962-11d2-4d7d-8ef0-b5d0d08796c0 tempest-OAUTHConsumersV3Test-755714576 tempest-OAUTHConsumersV3Test-755714576-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:05.334001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0774bcc-ea37-40ec-b21b-f4a840c1ecc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:05.334872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0774bcc-ea37-40ec-b21b-f4a840c1ecc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:05.335156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0774bcc-ea37-40ec-b21b-f4a840c1ecc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:05.335435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0774bcc-ea37-40ec-b21b-f4a840c1ecc3 admin admin] PATH_INFO: `/v3/users/ef3e8cd50e2f42e0a2ebd8ddc840d0eb` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:05.336687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0774bcc-ea37-40ec-b21b-f4a840c1ecc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef3e8cd50e2f42e0a2ebd8ddc840d0eb)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:05.338595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0774bcc-ea37-40ec-b21b-f4a840c1ecc3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:05.489199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b0774bcc-ea37-40ec-b21b-f4a840c1ecc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef3e8cd50e2f42e0a2ebd8ddc840d0eb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:05.500576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b0774bcc-ea37-40ec-b21b-f4a840c1ecc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef3e8cd50e2f42e0a2ebd8ddc840d0eb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:05.501322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b0774bcc-ea37-40ec-b21b-f4a840c1ecc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef3e8cd50e2f42e0a2ebd8ddc840d0eb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:05.508244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b0774bcc-ea37-40ec-b21b-f4a840c1ecc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef3e8cd50e2f42e0a2ebd8ddc840d0eb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:05.567132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-b0774bcc-ea37-40ec-b21b-f4a840c1ecc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef3e8cd50e2f42e0a2ebd8ddc840d0eb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:05.573715 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3892/7770] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:05 2022] DELETE /identity/v3/users/ef3e8cd50e2f42e0a2ebd8ddc840d0eb => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:05.578703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d8fed-6543-4228-a7a0-1797fba6d5bb None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:05.579006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d8fed-6543-4228-a7a0-1797fba6d5bb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:05.579297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d8fed-6543-4228-a7a0-1797fba6d5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:05.598414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-498d8fed-6543-4228-a7a0-1797fba6d5bb None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:05.599661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-498d8fed-6543-4228-a7a0-1797fba6d5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:05.656069 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3879/7771] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:05.665946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0774bcc-ea37-40ec-b21b-f4a840c1ecc3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:05.667962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b0774bcc-ea37-40ec-b21b-f4a840c1ecc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:05.725437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0774bcc-ea37-40ec-b21b-f4a840c1ecc3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:05.729969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf91f9c-4bb1-4fce-b8b3-9db20c0420d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:05.730624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf91f9c-4bb1-4fce-b8b3-9db20c0420d7 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:05.730937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf91f9c-4bb1-4fce-b8b3-9db20c0420d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:05.731227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf91f9c-4bb1-4fce-b8b3-9db20c0420d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:05.742555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf91f9c-4bb1-4fce-b8b3-9db20c0420d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:05.743996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf91f9c-4bb1-4fce-b8b3-9db20c0420d7 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:05.754018 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3893/7772] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:53:06.145763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d8fed-6543-4228-a7a0-1797fba6d5bb None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:06.147384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-498d8fed-6543-4228-a7a0-1797fba6d5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:06.161212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d8fed-6543-4228-a7a0-1797fba6d5bb None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:06.166293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb083e-b375-48d6-9473-0898ae2b2cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:06.167185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb083e-b375-48d6-9473-0898ae2b2cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:06.167468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb083e-b375-48d6-9473-0898ae2b2cef admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:06.167749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb083e-b375-48d6-9473-0898ae2b2cef admin admin] PATH_INFO: `/v3/projects/712b2d0f002246e8a83547914d9a8530` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:06.169062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb083e-b375-48d6-9473-0898ae2b2cef admin admin] RBAC: Authorizing `identity:delete_project(project_id=712b2d0f002246e8a83547914d9a8530)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:06.171153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb083e-b375-48d6-9473-0898ae2b2cef admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:06.281304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-49fb083e-b375-48d6-9473-0898ae2b2cef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '712b2d0f002246e8a83547914d9a8530', 'request_id': 'req-49fb083e-b375-48d6-9473-0898ae2b2cef'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:06.287310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-49fb083e-b375-48d6-9473-0898ae2b2cef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '712b2d0f002246e8a83547914d9a8530', 'request_id': 'req-49fb083e-b375-48d6-9473-0898ae2b2cef'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:06.384021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-49fb083e-b375-48d6-9473-0898ae2b2cef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '712b2d0f002246e8a83547914d9a8530', 'request_id': 'req-49fb083e-b375-48d6-9473-0898ae2b2cef'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:06.395584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-49fb083e-b375-48d6-9473-0898ae2b2cef admin admin] The token cache is being invalidate because project 712b2d0f002246e8a83547914d9a8530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:06.395873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-49fb083e-b375-48d6-9473-0898ae2b2cef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:06.396496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-49fb083e-b375-48d6-9473-0898ae2b2cef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:06.398106 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3880/7773] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:06 2022] DELETE /identity/v3/projects/712b2d0f002246e8a83547914d9a8530 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:06.402147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf91f9c-4bb1-4fce-b8b3-9db20c0420d7 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:06.412633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf91f9c-4bb1-4fce-b8b3-9db20c0420d7 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:06.467057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39592bab-dca4-43e5-b1ae-108b51e311ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:06.467922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39592bab-dca4-43e5-b1ae-108b51e311ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:06.468205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39592bab-dca4-43e5-b1ae-108b51e311ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:06.468481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39592bab-dca4-43e5-b1ae-108b51e311ee admin admin] PATH_INFO: `/v3/users/2b6072cc9dc845ccb9332377a1c89d42` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:06.469684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39592bab-dca4-43e5-b1ae-108b51e311ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b6072cc9dc845ccb9332377a1c89d42)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:06.471717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39592bab-dca4-43e5-b1ae-108b51e311ee admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:06.609423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-39592bab-dca4-43e5-b1ae-108b51e311ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b6072cc9dc845ccb9332377a1c89d42'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:06.621820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-39592bab-dca4-43e5-b1ae-108b51e311ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b6072cc9dc845ccb9332377a1c89d42'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:06.622592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-39592bab-dca4-43e5-b1ae-108b51e311ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b6072cc9dc845ccb9332377a1c89d42'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:06.629480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-39592bab-dca4-43e5-b1ae-108b51e311ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b6072cc9dc845ccb9332377a1c89d42'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:06.693466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-39592bab-dca4-43e5-b1ae-108b51e311ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b6072cc9dc845ccb9332377a1c89d42'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:06.700252 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3894/7774] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:06 2022] DELETE /identity/v3/users/2b6072cc9dc845ccb9332377a1c89d42 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:07.065947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb083e-b375-48d6-9473-0898ae2b2cef admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:07.067422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-49fb083e-b375-48d6-9473-0898ae2b2cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:07.081857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb083e-b375-48d6-9473-0898ae2b2cef admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:07.153181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefcdc4-4273-4fe0-a5cc-1f8c57778318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:07.154082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefcdc4-4273-4fe0-a5cc-1f8c57778318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:07.154367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefcdc4-4273-4fe0-a5cc-1f8c57778318 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:07.154645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefcdc4-4273-4fe0-a5cc-1f8c57778318 admin admin] PATH_INFO: `/v3/projects/c147d47f26e34ebf8b99e86cf3610140` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:07.155860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefcdc4-4273-4fe0-a5cc-1f8c57778318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c147d47f26e34ebf8b99e86cf3610140)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:07.157811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefcdc4-4273-4fe0-a5cc-1f8c57778318 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:07.293014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ddefcdc4-4273-4fe0-a5cc-1f8c57778318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c147d47f26e34ebf8b99e86cf3610140', 'request_id': 'req-ddefcdc4-4273-4fe0-a5cc-1f8c57778318'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:07.299234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ddefcdc4-4273-4fe0-a5cc-1f8c57778318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c147d47f26e34ebf8b99e86cf3610140', 'request_id': 'req-ddefcdc4-4273-4fe0-a5cc-1f8c57778318'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:07.378939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ddefcdc4-4273-4fe0-a5cc-1f8c57778318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c147d47f26e34ebf8b99e86cf3610140', 'request_id': 'req-ddefcdc4-4273-4fe0-a5cc-1f8c57778318'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:07.390430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ddefcdc4-4273-4fe0-a5cc-1f8c57778318 admin admin] The token cache is being invalidate because project c147d47f26e34ebf8b99e86cf3610140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:07.390721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ddefcdc4-4273-4fe0-a5cc-1f8c57778318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:07.391380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ddefcdc4-4273-4fe0-a5cc-1f8c57778318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:07.392959 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3881/7775] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:07 2022] DELETE /identity/v3/projects/c147d47f26e34ebf8b99e86cf3610140 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:07.398429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a7a69-d289-47e7-9931-a66559e3c704 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:07.398722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a7a69-d289-47e7-9931-a66559e3c704 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:07.399005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a7a69-d289-47e7-9931-a66559e3c704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:07.418299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-773a7a69-d289-47e7-9931-a66559e3c704 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:07.419492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-773a7a69-d289-47e7-9931-a66559e3c704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:07.475905 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3895/7776] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:07.483839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64bc0d-9935-435a-8d9f-53b248d6634a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:07.484184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64bc0d-9935-435a-8d9f-53b248d6634a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:07.484477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64bc0d-9935-435a-8d9f-53b248d6634a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:07.507717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-af64bc0d-9935-435a-8d9f-53b248d6634a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:07.509636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-af64bc0d-9935-435a-8d9f-53b248d6634a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:07.519458 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3882/7777] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:07.523794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a7a69-d289-47e7-9931-a66559e3c704 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:07.534971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a7a69-d289-47e7-9931-a66559e3c704 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:07.540382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9781997-1302-42f9-9c14-5e91872806bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:07.541130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9781997-1302-42f9-9c14-5e91872806bc admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:07.541426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9781997-1302-42f9-9c14-5e91872806bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:07.541726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9781997-1302-42f9-9c14-5e91872806bc admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:07.542488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9781997-1302-42f9-9c14-5e91872806bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:53:07.542819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9781997-1302-42f9-9c14-5e91872806bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:07.544574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9781997-1302-42f9-9c14-5e91872806bc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:07.557214 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3896/7778] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:07.561684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64bc0d-9935-435a-8d9f-53b248d6634a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:07.570891 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64bc0d-9935-435a-8d9f-53b248d6634a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:07.576157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cabca1-9bdb-4c08-8a26-a2c7d27d461b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:07.576824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cabca1-9bdb-4c08-8a26-a2c7d27d461b admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:07.577142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cabca1-9bdb-4c08-8a26-a2c7d27d461b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:07.577457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cabca1-9bdb-4c08-8a26-a2c7d27d461b admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:07.578126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cabca1-9bdb-4c08-8a26-a2c7d27d461b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:07.580032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cabca1-9bdb-4c08-8a26-a2c7d27d461b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:07.701037 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3883/7779] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:07 2022] POST /identity/v3/projects => generated 369 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:07.705250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9781997-1302-42f9-9c14-5e91872806bc admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:07.715692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9781997-1302-42f9-9c14-5e91872806bc admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:07.771278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e3218-e11f-4e6e-a551-a0f4aaf795e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:07.772067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e3218-e11f-4e6e-a551-a0f4aaf795e3 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:07.772362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e3218-e11f-4e6e-a551-a0f4aaf795e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:07.772677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e3218-e11f-4e6e-a551-a0f4aaf795e3 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:07.773481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e3218-e11f-4e6e-a551-a0f4aaf795e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:07.775290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e3218-e11f-4e6e-a551-a0f4aaf795e3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:07.866578 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3897/7780] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:53:07 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:07.873052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cabca1-9bdb-4c08-8a26-a2c7d27d461b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:07.883939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cabca1-9bdb-4c08-8a26-a2c7d27d461b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:07.890459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9a63f-7f99-4cbb-bb52-bb2a52a346c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:07.891148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9a63f-7f99-4cbb-bb52-bb2a52a346c6 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:07.891410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9a63f-7f99-4cbb-bb52-bb2a52a346c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:07.891691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9a63f-7f99-4cbb-bb52-bb2a52a346c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:07.892482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9a63f-7f99-4cbb-bb52-bb2a52a346c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:07.894166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9a63f-7f99-4cbb-bb52-bb2a52a346c6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:07.904500 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3884/7781] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:07.908727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e3218-e11f-4e6e-a551-a0f4aaf795e3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:07.918855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e3218-e11f-4e6e-a551-a0f4aaf795e3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:07.923544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844bde2-af02-4c81-9c3e-0997422f93c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:07.924200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844bde2-af02-4c81-9c3e-0997422f93c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:07.924488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844bde2-af02-4c81-9c3e-0997422f93c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:07.924792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844bde2-af02-4c81-9c3e-0997422f93c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:07.925549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844bde2-af02-4c81-9c3e-0997422f93c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:07.927174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844bde2-af02-4c81-9c3e-0997422f93c3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:07.938949 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3898/7782] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:07.941801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9a63f-7f99-4cbb-bb52-bb2a52a346c6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:07.952387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9a63f-7f99-4cbb-bb52-bb2a52a346c6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:07.957068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bcb21-2613-495e-9a13-c9313db262ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:07.957949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bcb21-2613-495e-9a13-c9313db262ec admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:07.958235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bcb21-2613-495e-9a13-c9313db262ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:07.958514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bcb21-2613-495e-9a13-c9313db262ec admin admin] PATH_INFO: `/v3/projects/470b853ab562485bb98d27a90ca74c6a/users/1ea8dc2168714884a70e8021a6a1f720/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:07.973223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bcb21-2613-495e-9a13-c9313db262ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=470b853ab562485bb98d27a90ca74c6a, user_id=1ea8dc2168714884a70e8021a6a1f720, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:07.975902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bcb21-2613-495e-9a13-c9313db262ec admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:08.076453 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3885/7783] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:07 2022] PUT /identity/v3/projects/470b853ab562485bb98d27a90ca74c6a/users/1ea8dc2168714884a70e8021a6a1f720/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:08.088185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051ba1a-536b-46a0-833a-fb5430b9ad0d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:08.088482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051ba1a-536b-46a0-833a-fb5430b9ad0d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:08.088812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051ba1a-536b-46a0-833a-fb5430b9ad0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:08.123880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4051ba1a-536b-46a0-833a-fb5430b9ad0d None None] MFA Rules not processed for user `1ea8dc2168714884a70e8021a6a1f720`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:08.125577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4051ba1a-536b-46a0-833a-fb5430b9ad0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:08.188851 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3899/7784] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:08 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:08.193534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bcb21-2613-495e-9a13-c9313db262ec admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:08.205121 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bcb21-2613-495e-9a13-c9313db262ec admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:08.209576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95674e8-e73e-4b72-b5e0-0f8f9df3568d tempest-TestApiDiscovery-1767601056 tempest-TestApiDiscovery-1767601056-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea8dc2168714884a70e8021a6a1f720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470b853ab562485bb98d27a90ca74c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:08.210281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95674e8-e73e-4b72-b5e0-0f8f9df3568d tempest-TestApiDiscovery-1767601056 tempest-TestApiDiscovery-1767601056-project] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:08.210572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95674e8-e73e-4b72-b5e0-0f8f9df3568d tempest-TestApiDiscovery-1767601056 tempest-TestApiDiscovery-1767601056-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:08.214409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95674e8-e73e-4b72-b5e0-0f8f9df3568d tempest-TestApiDiscovery-1767601056 tempest-TestApiDiscovery-1767601056-project] PATH_INFO: `/v3` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:08.214409 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3886/7785] 10.222.0.16 () {58 vars in 1103 bytes} [Mon May 2 10:53:08 2022] GET /identity/v3 => generated 255 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:08.218174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051ba1a-536b-46a0-833a-fb5430b9ad0d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:08.226767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051ba1a-536b-46a0-833a-fb5430b9ad0d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:08.232190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471125f-d2b8-494c-8f69-1f521b4f4cfa tempest-TestApiDiscovery-1767601056 tempest-TestApiDiscovery-1767601056-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea8dc2168714884a70e8021a6a1f720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470b853ab562485bb98d27a90ca74c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:08.232907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471125f-d2b8-494c-8f69-1f521b4f4cfa tempest-TestApiDiscovery-1767601056 tempest-TestApiDiscovery-1767601056-project] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:08.233198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471125f-d2b8-494c-8f69-1f521b4f4cfa tempest-TestApiDiscovery-1767601056 tempest-TestApiDiscovery-1767601056-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:08.233482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471125f-d2b8-494c-8f69-1f521b4f4cfa tempest-TestApiDiscovery-1767601056 tempest-TestApiDiscovery-1767601056-project] PATH_INFO: `/v3` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:08.234883 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3900/7786] 10.222.0.16 () {58 vars in 1103 bytes} [Mon May 2 10:53:08 2022] GET /identity/v3 => generated 255 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:08.239397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95674e8-e73e-4b72-b5e0-0f8f9df3568d tempest-TestApiDiscovery-1767601056 tempest-TestApiDiscovery-1767601056-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:08.249434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95674e8-e73e-4b72-b5e0-0f8f9df3568d tempest-TestApiDiscovery-1767601056 tempest-TestApiDiscovery-1767601056-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:08.253824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2425d-fb65-426e-aeb6-8fd5e8f85d52 tempest-TestApiDiscovery-1767601056 tempest-TestApiDiscovery-1767601056-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea8dc2168714884a70e8021a6a1f720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470b853ab562485bb98d27a90ca74c6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:08.254576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2425d-fb65-426e-aeb6-8fd5e8f85d52 tempest-TestApiDiscovery-1767601056 tempest-TestApiDiscovery-1767601056-project] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:08.254867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2425d-fb65-426e-aeb6-8fd5e8f85d52 tempest-TestApiDiscovery-1767601056 tempest-TestApiDiscovery-1767601056-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:08.255151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2425d-fb65-426e-aeb6-8fd5e8f85d52 tempest-TestApiDiscovery-1767601056 tempest-TestApiDiscovery-1767601056-project] PATH_INFO: `/v3` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:08.260236 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3887/7787] 10.222.0.16 () {58 vars in 1103 bytes} [Mon May 2 10:53:08 2022] GET /identity/v3 => generated 255 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:08.262688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeec808-21a0-4392-a8b4-be5b386b3390 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:08.263338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeec808-21a0-4392-a8b4-be5b386b3390 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:08.263662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeec808-21a0-4392-a8b4-be5b386b3390 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:08.265013 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3901/7788] 10.222.0.16 () {56 vars in 894 bytes} [Mon May 2 10:53:08 2022] GET /identity/ => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:53:08.270194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5edd83-6459-4b60-bf78-fd287daf19bc None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:08.270483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5edd83-6459-4b60-bf78-fd287daf19bc None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:08.270765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5edd83-6459-4b60-bf78-fd287daf19bc None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:08.272181 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3888/7789] 10.222.0.16 () {56 vars in 894 bytes} [Mon May 2 10:53:08 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:53:08.276420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeec808-21a0-4392-a8b4-be5b386b3390 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:08.339812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeec808-21a0-4392-a8b4-be5b386b3390 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:08.345044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aedfa4-9ea1-494b-b91e-7487546aa0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:08.345911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aedfa4-9ea1-494b-b91e-7487546aa0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:08.346195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aedfa4-9ea1-494b-b91e-7487546aa0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:08.346471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aedfa4-9ea1-494b-b91e-7487546aa0f3 admin admin] PATH_INFO: `/v3/users/1ea8dc2168714884a70e8021a6a1f720` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:08.347673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aedfa4-9ea1-494b-b91e-7487546aa0f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ea8dc2168714884a70e8021a6a1f720)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:08.349671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aedfa4-9ea1-494b-b91e-7487546aa0f3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:08.495639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-66aedfa4-9ea1-494b-b91e-7487546aa0f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea8dc2168714884a70e8021a6a1f720'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:08.506662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-66aedfa4-9ea1-494b-b91e-7487546aa0f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea8dc2168714884a70e8021a6a1f720'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:08.507337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-66aedfa4-9ea1-494b-b91e-7487546aa0f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea8dc2168714884a70e8021a6a1f720'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:08.514158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-66aedfa4-9ea1-494b-b91e-7487546aa0f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea8dc2168714884a70e8021a6a1f720'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:08.573087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-66aedfa4-9ea1-494b-b91e-7487546aa0f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea8dc2168714884a70e8021a6a1f720'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:08.580467 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3902/7790] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:08 2022] DELETE /identity/v3/users/1ea8dc2168714884a70e8021a6a1f720 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:08.584831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ce771-d354-4e3c-873d-747f2c0247a0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:08.585227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ce771-d354-4e3c-873d-747f2c0247a0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:08.585537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ce771-d354-4e3c-873d-747f2c0247a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:08.603172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-796ce771-d354-4e3c-873d-747f2c0247a0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:08.604363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-796ce771-d354-4e3c-873d-747f2c0247a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:08.661244 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3889/7791] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:08.671826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aedfa4-9ea1-494b-b91e-7487546aa0f3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:08.673348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-66aedfa4-9ea1-494b-b91e-7487546aa0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:08.733723 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aedfa4-9ea1-494b-b91e-7487546aa0f3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:08.737379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8959b9a-014e-4f61-8d76-c084e4dd3aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:08.738033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8959b9a-014e-4f61-8d76-c084e4dd3aff service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:08.738317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8959b9a-014e-4f61-8d76-c084e4dd3aff service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:08.738597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8959b9a-014e-4f61-8d76-c084e4dd3aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:08.747645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8959b9a-014e-4f61-8d76-c084e4dd3aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:08.749091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8959b9a-014e-4f61-8d76-c084e4dd3aff service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:08.758372 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3903/7792] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:53:09.192463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ce771-d354-4e3c-873d-747f2c0247a0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:09.194002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-796ce771-d354-4e3c-873d-747f2c0247a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:09.214145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ce771-d354-4e3c-873d-747f2c0247a0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:09.219374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3292e94-2357-46e2-a5ea-42e47600d78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:09.220271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3292e94-2357-46e2-a5ea-42e47600d78b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:09.220512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3292e94-2357-46e2-a5ea-42e47600d78b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:09.220829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3292e94-2357-46e2-a5ea-42e47600d78b admin admin] PATH_INFO: `/v3/projects/470b853ab562485bb98d27a90ca74c6a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:09.222016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3292e94-2357-46e2-a5ea-42e47600d78b admin admin] RBAC: Authorizing `identity:delete_project(project_id=470b853ab562485bb98d27a90ca74c6a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:09.223942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3292e94-2357-46e2-a5ea-42e47600d78b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:09.305253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e3292e94-2357-46e2-a5ea-42e47600d78b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '470b853ab562485bb98d27a90ca74c6a', 'request_id': 'req-e3292e94-2357-46e2-a5ea-42e47600d78b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:09.312153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e3292e94-2357-46e2-a5ea-42e47600d78b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '470b853ab562485bb98d27a90ca74c6a', 'request_id': 'req-e3292e94-2357-46e2-a5ea-42e47600d78b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:09.378583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e3292e94-2357-46e2-a5ea-42e47600d78b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '470b853ab562485bb98d27a90ca74c6a', 'request_id': 'req-e3292e94-2357-46e2-a5ea-42e47600d78b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:09.390231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e3292e94-2357-46e2-a5ea-42e47600d78b admin admin] The token cache is being invalidate because project 470b853ab562485bb98d27a90ca74c6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:09.390524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e3292e94-2357-46e2-a5ea-42e47600d78b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:09.391157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e3292e94-2357-46e2-a5ea-42e47600d78b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:09.392739 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3890/7793] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:09 2022] DELETE /identity/v3/projects/470b853ab562485bb98d27a90ca74c6a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:09.399816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194ffa1-d41a-493e-844b-53396c2b5f5a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:09.400108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194ffa1-d41a-493e-844b-53396c2b5f5a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:09.400395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194ffa1-d41a-493e-844b-53396c2b5f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:09.419286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-7194ffa1-d41a-493e-844b-53396c2b5f5a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:09.420514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7194ffa1-d41a-493e-844b-53396c2b5f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:09.481097 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3904/7794] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:09.489516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fa605-ec51-4467-a9e5-2a9b1eba78f5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:09.489841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fa605-ec51-4467-a9e5-2a9b1eba78f5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:09.490131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fa605-ec51-4467-a9e5-2a9b1eba78f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:09.509391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-707fa605-ec51-4467-a9e5-2a9b1eba78f5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:09.510658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-707fa605-ec51-4467-a9e5-2a9b1eba78f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:09.519182 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3891/7795] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:09.523378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194ffa1-d41a-493e-844b-53396c2b5f5a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:09.533138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194ffa1-d41a-493e-844b-53396c2b5f5a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:09.537767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1199a-d2bd-4d2e-8fba-eee74ecec2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:09.538420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1199a-d2bd-4d2e-8fba-eee74ecec2cf admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:09.538706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1199a-d2bd-4d2e-8fba-eee74ecec2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:09.538982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1199a-d2bd-4d2e-8fba-eee74ecec2cf admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:09.539700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1199a-d2bd-4d2e-8fba-eee74ecec2cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:53:09.540005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1199a-d2bd-4d2e-8fba-eee74ecec2cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:09.541623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1199a-d2bd-4d2e-8fba-eee74ecec2cf admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:09.553911 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3905/7796] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:53:09.565542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fa605-ec51-4467-a9e5-2a9b1eba78f5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:09.575174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fa605-ec51-4467-a9e5-2a9b1eba78f5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:09.579943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f19eeb-9e3b-4be1-9690-c6106b28b7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:09.580702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f19eeb-9e3b-4be1-9690-c6106b28b7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:09.580992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f19eeb-9e3b-4be1-9690-c6106b28b7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:09.581292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f19eeb-9e3b-4be1-9690-c6106b28b7e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:09.581976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f19eeb-9e3b-4be1-9690-c6106b28b7e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:09.583899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f19eeb-9e3b-4be1-9690-c6106b28b7e9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:09.689615 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3892/7797] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:09 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:09.693880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1199a-d2bd-4d2e-8fba-eee74ecec2cf admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:09.703934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1199a-d2bd-4d2e-8fba-eee74ecec2cf admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:09.760500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21072292-5470-45fa-9c33-870228394842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:09.761036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21072292-5470-45fa-9c33-870228394842 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:09.761574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21072292-5470-45fa-9c33-870228394842 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:09.761880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21072292-5470-45fa-9c33-870228394842 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:09.762579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21072292-5470-45fa-9c33-870228394842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:09.764507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21072292-5470-45fa-9c33-870228394842 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:09.818903 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3906/7798] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:53:09 2022] POST /identity/v3/users => generated 297 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:09.822905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f19eeb-9e3b-4be1-9690-c6106b28b7e9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:09.834177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f19eeb-9e3b-4be1-9690-c6106b28b7e9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:09.839078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f74af-1f27-4d41-80bb-415a2149ba64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:09.839791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f74af-1f27-4d41-80bb-415a2149ba64 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:09.840082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f74af-1f27-4d41-80bb-415a2149ba64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:09.843624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f74af-1f27-4d41-80bb-415a2149ba64 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:09.843624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f74af-1f27-4d41-80bb-415a2149ba64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:09.843624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f74af-1f27-4d41-80bb-415a2149ba64 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:09.863441 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3893/7799] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:09.864854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21072292-5470-45fa-9c33-870228394842 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:09.875428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21072292-5470-45fa-9c33-870228394842 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:09.880464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3a51d-f336-46c9-826e-c2fe34c854ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:09.881396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3a51d-f336-46c9-826e-c2fe34c854ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:09.881678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3a51d-f336-46c9-826e-c2fe34c854ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:09.881952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3a51d-f336-46c9-826e-c2fe34c854ff admin admin] PATH_INFO: `/v3/projects/bcf88aef241c4f3ebf1777ff7da36c9f/users/c17ae99d886a4edf8bcee52d5b15708e/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:09.896977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3a51d-f336-46c9-826e-c2fe34c854ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf88aef241c4f3ebf1777ff7da36c9f, user_id=c17ae99d886a4edf8bcee52d5b15708e, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:09.899677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3a51d-f336-46c9-826e-c2fe34c854ff admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:09.979260 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3907/7800] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:09 2022] PUT /identity/v3/projects/bcf88aef241c4f3ebf1777ff7da36c9f/users/c17ae99d886a4edf8bcee52d5b15708e/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:09.984015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f74af-1f27-4d41-80bb-415a2149ba64 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:09.995171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f74af-1f27-4d41-80bb-415a2149ba64 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:10.052524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d25a4-67f8-45f1-a125-9bf93fe964cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:10.053268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d25a4-67f8-45f1-a125-9bf93fe964cd admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:10.053560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d25a4-67f8-45f1-a125-9bf93fe964cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:10.053843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d25a4-67f8-45f1-a125-9bf93fe964cd admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:10.054573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d25a4-67f8-45f1-a125-9bf93fe964cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:10.056180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d25a4-67f8-45f1-a125-9bf93fe964cd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:10.068264 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3894/7801] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:53:10.072679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3a51d-f336-46c9-826e-c2fe34c854ff admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:10.085028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3a51d-f336-46c9-826e-c2fe34c854ff admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:10.090540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78daae8c-c5d5-4c6d-8b18-bd6e58ac927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:10.092363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daae8c-c5d5-4c6d-8b18-bd6e58ac927c admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:10.092652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daae8c-c5d5-4c6d-8b18-bd6e58ac927c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:10.092946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daae8c-c5d5-4c6d-8b18-bd6e58ac927c admin admin] PATH_INFO: `/v3/projects/bcf88aef241c4f3ebf1777ff7da36c9f/users/c17ae99d886a4edf8bcee52d5b15708e/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:10.098928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78daae8c-c5d5-4c6d-8b18-bd6e58ac927c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf88aef241c4f3ebf1777ff7da36c9f, user_id=c17ae99d886a4edf8bcee52d5b15708e, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:10.098928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78daae8c-c5d5-4c6d-8b18-bd6e58ac927c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:10.111675 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3908/7802] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:10 2022] PUT /identity/v3/projects/bcf88aef241c4f3ebf1777ff7da36c9f/users/c17ae99d886a4edf8bcee52d5b15708e/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:10.126523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70339c26-3ea9-423d-9601-cad008682ced None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:10.126816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70339c26-3ea9-423d-9601-cad008682ced None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:10.127100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70339c26-3ea9-423d-9601-cad008682ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:10.154477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-70339c26-3ea9-423d-9601-cad008682ced None None] MFA Rules not processed for user `c17ae99d886a4edf8bcee52d5b15708e`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:10.155659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-70339c26-3ea9-423d-9601-cad008682ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:10.222782 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3895/7803] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:10.227140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78daae8c-c5d5-4c6d-8b18-bd6e58ac927c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:10.288608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78daae8c-c5d5-4c6d-8b18-bd6e58ac927c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:10.293318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b623e38-d23b-4bcf-9177-f01ed4737112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:10.293977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b623e38-d23b-4bcf-9177-f01ed4737112 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:10.294259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b623e38-d23b-4bcf-9177-f01ed4737112 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:10.294654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b623e38-d23b-4bcf-9177-f01ed4737112 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:10.295343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b623e38-d23b-4bcf-9177-f01ed4737112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:10.297320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b623e38-d23b-4bcf-9177-f01ed4737112 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:10.374274 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3909/7804] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:10 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:10.378227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70339c26-3ea9-423d-9601-cad008682ced None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:10.390085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70339c26-3ea9-423d-9601-cad008682ced None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:10.453760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca009e-4dfb-4517-93fc-a10b3bf74550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:10.454433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca009e-4dfb-4517-93fc-a10b3bf74550 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:10.454723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca009e-4dfb-4517-93fc-a10b3bf74550 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:10.455004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca009e-4dfb-4517-93fc-a10b3bf74550 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:10.455691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca009e-4dfb-4517-93fc-a10b3bf74550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:10.457786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca009e-4dfb-4517-93fc-a10b3bf74550 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:10.527351 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3896/7805] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:53:10 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:10.531974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b623e38-d23b-4bcf-9177-f01ed4737112 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:10.542228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b623e38-d23b-4bcf-9177-f01ed4737112 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:10.546953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43a3f9-7a71-4f58-9386-e1b67468f33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:10.547608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43a3f9-7a71-4f58-9386-e1b67468f33f admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:10.547890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43a3f9-7a71-4f58-9386-e1b67468f33f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:10.548166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43a3f9-7a71-4f58-9386-e1b67468f33f admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:10.549173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43a3f9-7a71-4f58-9386-e1b67468f33f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:10.550755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43a3f9-7a71-4f58-9386-e1b67468f33f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:10.560415 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3910/7806] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:10.564563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca009e-4dfb-4517-93fc-a10b3bf74550 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:10.574622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca009e-4dfb-4517-93fc-a10b3bf74550 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:10.579896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b22e58-4543-4e56-bbfa-59ee4327252f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:10.580547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b22e58-4543-4e56-bbfa-59ee4327252f admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:10.580865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b22e58-4543-4e56-bbfa-59ee4327252f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:10.581142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b22e58-4543-4e56-bbfa-59ee4327252f admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:10.582047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b22e58-4543-4e56-bbfa-59ee4327252f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:10.583639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b22e58-4543-4e56-bbfa-59ee4327252f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:10.593819 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3897/7807] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:10.597977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43a3f9-7a71-4f58-9386-e1b67468f33f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:10.607771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43a3f9-7a71-4f58-9386-e1b67468f33f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:10.612398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82114cb8-41cd-4b83-9d9b-ac35251dd1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:10.613303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82114cb8-41cd-4b83-9d9b-ac35251dd1b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:10.613586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82114cb8-41cd-4b83-9d9b-ac35251dd1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:10.613863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82114cb8-41cd-4b83-9d9b-ac35251dd1b3 admin admin] PATH_INFO: `/v3/projects/4f859a78ff474c31a5f45b5b7682c043/users/1167a9d0fe9b4cd49d2d52b25995f568/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:10.628655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82114cb8-41cd-4b83-9d9b-ac35251dd1b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f859a78ff474c31a5f45b5b7682c043, user_id=1167a9d0fe9b4cd49d2d52b25995f568, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:10.631238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82114cb8-41cd-4b83-9d9b-ac35251dd1b3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:10.715543 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3911/7808] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:10 2022] PUT /identity/v3/projects/4f859a78ff474c31a5f45b5b7682c043/users/1167a9d0fe9b4cd49d2d52b25995f568/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:10.726702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b6fbe-0702-408d-937b-4a297d905df2 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:10.727021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b6fbe-0702-408d-937b-4a297d905df2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:10.727310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b6fbe-0702-408d-937b-4a297d905df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:10.754829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-501b6fbe-0702-408d-937b-4a297d905df2 None None] MFA Rules not processed for user `1167a9d0fe9b4cd49d2d52b25995f568`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:10.756032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-501b6fbe-0702-408d-937b-4a297d905df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:10.819359 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3898/7809] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:10.830975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82114cb8-41cd-4b83-9d9b-ac35251dd1b3 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:10.832746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-82114cb8-41cd-4b83-9d9b-ac35251dd1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:10.891030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82114cb8-41cd-4b83-9d9b-ac35251dd1b3 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:10.894656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323ca19-7932-4903-b6a2-ca8b04c3365f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:10.895297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323ca19-7932-4903-b6a2-ca8b04c3365f service glance] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:10.895580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323ca19-7932-4903-b6a2-ca8b04c3365f service glance] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:10.895859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323ca19-7932-4903-b6a2-ca8b04c3365f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:10.954679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323ca19-7932-4903-b6a2-ca8b04c3365f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:10.956112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323ca19-7932-4903-b6a2-ca8b04c3365f service glance] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:10.966128 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3912/7810] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:53:11.790965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b6fbe-0702-408d-937b-4a297d905df2 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:11.854926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b6fbe-0702-408d-937b-4a297d905df2 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:11.859876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f83a1-0014-46c5-b9d8-b31a76bd19fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:11.862342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f83a1-0014-46c5-b9d8-b31a76bd19fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:11.862342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f83a1-0014-46c5-b9d8-b31a76bd19fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:11.862342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f83a1-0014-46c5-b9d8-b31a76bd19fa admin admin] PATH_INFO: `/v3/users/c17ae99d886a4edf8bcee52d5b15708e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:11.862832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f83a1-0014-46c5-b9d8-b31a76bd19fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c17ae99d886a4edf8bcee52d5b15708e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:11.865050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f83a1-0014-46c5-b9d8-b31a76bd19fa admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:12.041338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bf2f83a1-0014-46c5-b9d8-b31a76bd19fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c17ae99d886a4edf8bcee52d5b15708e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:12.052651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bf2f83a1-0014-46c5-b9d8-b31a76bd19fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c17ae99d886a4edf8bcee52d5b15708e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:12.053343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bf2f83a1-0014-46c5-b9d8-b31a76bd19fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c17ae99d886a4edf8bcee52d5b15708e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:12.060078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bf2f83a1-0014-46c5-b9d8-b31a76bd19fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c17ae99d886a4edf8bcee52d5b15708e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:12.121548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-bf2f83a1-0014-46c5-b9d8-b31a76bd19fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c17ae99d886a4edf8bcee52d5b15708e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:12.128941 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3899/7811] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:11 2022] DELETE /identity/v3/users/c17ae99d886a4edf8bcee52d5b15708e => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:12.133621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055697d9-94d7-4c73-a935-7a1ba1b0cb3a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:12.134072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055697d9-94d7-4c73-a935-7a1ba1b0cb3a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:12.134326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055697d9-94d7-4c73-a935-7a1ba1b0cb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:12.152830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-055697d9-94d7-4c73-a935-7a1ba1b0cb3a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:12.154060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-055697d9-94d7-4c73-a935-7a1ba1b0cb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:12.214328 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3913/7812] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:12.224187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f83a1-0014-46c5-b9d8-b31a76bd19fa admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:12.225699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bf2f83a1-0014-46c5-b9d8-b31a76bd19fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:12.291264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f83a1-0014-46c5-b9d8-b31a76bd19fa admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:12.295003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abac41-7bb4-4833-9074-6e029a5942cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:12.295594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abac41-7bb4-4833-9074-6e029a5942cc service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:12.295880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abac41-7bb4-4833-9074-6e029a5942cc service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:12.296160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abac41-7bb4-4833-9074-6e029a5942cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:12.305230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02abac41-7bb4-4833-9074-6e029a5942cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:12.306669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02abac41-7bb4-4833-9074-6e029a5942cc service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:12.316644 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3900/7813] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:53:12.803718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055697d9-94d7-4c73-a935-7a1ba1b0cb3a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:12.805217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-055697d9-94d7-4c73-a935-7a1ba1b0cb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:12.818787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055697d9-94d7-4c73-a935-7a1ba1b0cb3a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:12.823844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aab742-89e5-4116-a227-dd4fc717283a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:12.824905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aab742-89e5-4116-a227-dd4fc717283a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:12.825193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aab742-89e5-4116-a227-dd4fc717283a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:12.825987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aab742-89e5-4116-a227-dd4fc717283a admin admin] PATH_INFO: `/v3/projects/bcf88aef241c4f3ebf1777ff7da36c9f` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:12.827226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aab742-89e5-4116-a227-dd4fc717283a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf88aef241c4f3ebf1777ff7da36c9f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:12.829530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aab742-89e5-4116-a227-dd4fc717283a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:12.988182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-52aab742-89e5-4116-a227-dd4fc717283a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf88aef241c4f3ebf1777ff7da36c9f', 'request_id': 'req-52aab742-89e5-4116-a227-dd4fc717283a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:13.087394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-52aab742-89e5-4116-a227-dd4fc717283a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf88aef241c4f3ebf1777ff7da36c9f', 'request_id': 'req-52aab742-89e5-4116-a227-dd4fc717283a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:13.094628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-52aab742-89e5-4116-a227-dd4fc717283a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf88aef241c4f3ebf1777ff7da36c9f', 'request_id': 'req-52aab742-89e5-4116-a227-dd4fc717283a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:13.105377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-52aab742-89e5-4116-a227-dd4fc717283a admin admin] The token cache is being invalidate because project bcf88aef241c4f3ebf1777ff7da36c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:13.105674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-52aab742-89e5-4116-a227-dd4fc717283a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:13.106331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-52aab742-89e5-4116-a227-dd4fc717283a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:13.108776 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3914/7814] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:12 2022] DELETE /identity/v3/projects/bcf88aef241c4f3ebf1777ff7da36c9f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:13.113789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abac41-7bb4-4833-9074-6e029a5942cc service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:13.123018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abac41-7bb4-4833-9074-6e029a5942cc service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:13.185754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b4409-c347-42da-abd3-3368fb0d2048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:13.186724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b4409-c347-42da-abd3-3368fb0d2048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:13.186915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b4409-c347-42da-abd3-3368fb0d2048 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:13.187194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b4409-c347-42da-abd3-3368fb0d2048 admin admin] PATH_INFO: `/v3/users/1167a9d0fe9b4cd49d2d52b25995f568` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:13.188406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b4409-c347-42da-abd3-3368fb0d2048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1167a9d0fe9b4cd49d2d52b25995f568)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:13.190394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b4409-c347-42da-abd3-3368fb0d2048 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:13.335718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-731b4409-c347-42da-abd3-3368fb0d2048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1167a9d0fe9b4cd49d2d52b25995f568'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:13.347671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-731b4409-c347-42da-abd3-3368fb0d2048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1167a9d0fe9b4cd49d2d52b25995f568'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:13.348291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-731b4409-c347-42da-abd3-3368fb0d2048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1167a9d0fe9b4cd49d2d52b25995f568'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:13.355598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-731b4409-c347-42da-abd3-3368fb0d2048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1167a9d0fe9b4cd49d2d52b25995f568'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:13.418343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-731b4409-c347-42da-abd3-3368fb0d2048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1167a9d0fe9b4cd49d2d52b25995f568'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:13.424565 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3901/7815] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:13 2022] DELETE /identity/v3/users/1167a9d0fe9b4cd49d2d52b25995f568 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:13.843292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aab742-89e5-4116-a227-dd4fc717283a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:13.844831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-52aab742-89e5-4116-a227-dd4fc717283a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:13.875203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aab742-89e5-4116-a227-dd4fc717283a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:13.928111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f519116-177e-4dfe-b1db-039603947671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:13.929011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519116-177e-4dfe-b1db-039603947671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:13.929297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519116-177e-4dfe-b1db-039603947671 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:13.929574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519116-177e-4dfe-b1db-039603947671 admin admin] PATH_INFO: `/v3/projects/4f859a78ff474c31a5f45b5b7682c043` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:13.930811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f519116-177e-4dfe-b1db-039603947671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f859a78ff474c31a5f45b5b7682c043)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:13.932742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f519116-177e-4dfe-b1db-039603947671 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:14.014594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8f519116-177e-4dfe-b1db-039603947671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f859a78ff474c31a5f45b5b7682c043', 'request_id': 'req-8f519116-177e-4dfe-b1db-039603947671'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:14.127578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8f519116-177e-4dfe-b1db-039603947671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f859a78ff474c31a5f45b5b7682c043', 'request_id': 'req-8f519116-177e-4dfe-b1db-039603947671'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:14.134243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8f519116-177e-4dfe-b1db-039603947671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f859a78ff474c31a5f45b5b7682c043', 'request_id': 'req-8f519116-177e-4dfe-b1db-039603947671'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:14.145089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8f519116-177e-4dfe-b1db-039603947671 admin admin] The token cache is being invalidate because project 4f859a78ff474c31a5f45b5b7682c043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:14.145340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8f519116-177e-4dfe-b1db-039603947671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:14.145995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8f519116-177e-4dfe-b1db-039603947671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:14.147836 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3915/7816] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:13 2022] DELETE /identity/v3/projects/4f859a78ff474c31a5f45b5b7682c043 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:14.152672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcf357-94e2-47af-9ae9-08188d83e479 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:14.153139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcf357-94e2-47af-9ae9-08188d83e479 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:14.153309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcf357-94e2-47af-9ae9-08188d83e479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:14.171867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9ffcf357-94e2-47af-9ae9-08188d83e479 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:14.176723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9ffcf357-94e2-47af-9ae9-08188d83e479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:14.234985 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3902/7817] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:14.243021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b05b9-7b99-4410-8600-59144a5d4e45 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:14.243314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b05b9-7b99-4410-8600-59144a5d4e45 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:14.243709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b05b9-7b99-4410-8600-59144a5d4e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:14.262999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d73b05b9-7b99-4410-8600-59144a5d4e45 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:14.264293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d73b05b9-7b99-4410-8600-59144a5d4e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:14.272366 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3916/7818] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:14.276678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcf357-94e2-47af-9ae9-08188d83e479 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:14.287119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcf357-94e2-47af-9ae9-08188d83e479 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:14.291681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe71e40-6664-479d-9af9-ff879171c2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:14.292343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe71e40-6664-479d-9af9-ff879171c2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:14.297984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe71e40-6664-479d-9af9-ff879171c2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:14.297984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe71e40-6664-479d-9af9-ff879171c2c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:14.297984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe71e40-6664-479d-9af9-ff879171c2c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:53:14.297984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe71e40-6664-479d-9af9-ff879171c2c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:14.297984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe71e40-6664-479d-9af9-ff879171c2c7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:14.307616 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3903/7819] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:14.312519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b05b9-7b99-4410-8600-59144a5d4e45 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:14.322250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b05b9-7b99-4410-8600-59144a5d4e45 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:14.327096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99238372-88bb-42a4-a3d6-e75be7b19921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:14.327756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99238372-88bb-42a4-a3d6-e75be7b19921 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:14.328037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99238372-88bb-42a4-a3d6-e75be7b19921 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:14.328314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99238372-88bb-42a4-a3d6-e75be7b19921 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:14.329055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99238372-88bb-42a4-a3d6-e75be7b19921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:14.330945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99238372-88bb-42a4-a3d6-e75be7b19921 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:14.446534 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3917/7820] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:14 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:14.448016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe71e40-6664-479d-9af9-ff879171c2c7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:14.458127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe71e40-6664-479d-9af9-ff879171c2c7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:14.516851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee93ae-437a-4afe-8aed-4ae905652a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:14.517541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee93ae-437a-4afe-8aed-4ae905652a1f admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:14.517830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee93ae-437a-4afe-8aed-4ae905652a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:14.518111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee93ae-437a-4afe-8aed-4ae905652a1f admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:14.518807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee93ae-437a-4afe-8aed-4ae905652a1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:14.520784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee93ae-437a-4afe-8aed-4ae905652a1f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:14.609683 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3904/7821] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:53:14 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:14.614314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99238372-88bb-42a4-a3d6-e75be7b19921 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:14.625497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99238372-88bb-42a4-a3d6-e75be7b19921 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:14.630129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e813a-8907-4343-b94a-d5ba3c4c14e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:14.630816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e813a-8907-4343-b94a-d5ba3c4c14e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:14.631097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e813a-8907-4343-b94a-d5ba3c4c14e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:14.631371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e813a-8907-4343-b94a-d5ba3c4c14e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:14.632089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e813a-8907-4343-b94a-d5ba3c4c14e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:14.633697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e813a-8907-4343-b94a-d5ba3c4c14e4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:14.644262 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3918/7822] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:14.648083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee93ae-437a-4afe-8aed-4ae905652a1f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:14.658383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee93ae-437a-4afe-8aed-4ae905652a1f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:14.663092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bebb7b-ea1f-497e-97f2-e7e15f98fd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:14.663783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bebb7b-ea1f-497e-97f2-e7e15f98fd13 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:14.664066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bebb7b-ea1f-497e-97f2-e7e15f98fd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:14.664342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bebb7b-ea1f-497e-97f2-e7e15f98fd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:14.665090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bebb7b-ea1f-497e-97f2-e7e15f98fd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:14.666684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bebb7b-ea1f-497e-97f2-e7e15f98fd13 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:14.677568 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3905/7823] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:14.683140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e813a-8907-4343-b94a-d5ba3c4c14e4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:14.693079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e813a-8907-4343-b94a-d5ba3c4c14e4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:14.697821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880943a-25ab-42a4-b0d4-b2752213b0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:14.698585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880943a-25ab-42a4-b0d4-b2752213b0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:14.698871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880943a-25ab-42a4-b0d4-b2752213b0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:14.699151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880943a-25ab-42a4-b0d4-b2752213b0e4 admin admin] PATH_INFO: `/v3/projects/05ca0db98cf74e2b8872502cf19e5547/users/ade65fb9632b4ff1836598d51fa02cc9/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:14.713596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880943a-25ab-42a4-b0d4-b2752213b0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ca0db98cf74e2b8872502cf19e5547, user_id=ade65fb9632b4ff1836598d51fa02cc9, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:14.716945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880943a-25ab-42a4-b0d4-b2752213b0e4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:14.785090 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3919/7824] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:14 2022] PUT /identity/v3/projects/05ca0db98cf74e2b8872502cf19e5547/users/ade65fb9632b4ff1836598d51fa02cc9/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:14.796445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4611d10-612d-448c-a936-518fcd062f91 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:14.796761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4611d10-612d-448c-a936-518fcd062f91 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:14.797044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4611d10-612d-448c-a936-518fcd062f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:14.822688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b4611d10-612d-448c-a936-518fcd062f91 None None] MFA Rules not processed for user `ade65fb9632b4ff1836598d51fa02cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:14.823933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b4611d10-612d-448c-a936-518fcd062f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:14.886679 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3906/7825] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:14.891729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880943a-25ab-42a4-b0d4-b2752213b0e4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:14.952139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880943a-25ab-42a4-b0d4-b2752213b0e4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:14.956975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668cca1-76c7-435b-a16c-847da8ec8988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:14.957635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668cca1-76c7-435b-a16c-847da8ec8988 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:14.957919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668cca1-76c7-435b-a16c-847da8ec8988 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:14.958214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668cca1-76c7-435b-a16c-847da8ec8988 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:14.958912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668cca1-76c7-435b-a16c-847da8ec8988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:14.960822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668cca1-76c7-435b-a16c-847da8ec8988 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:15.066328 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3920/7826] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:14 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:15.070485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4611d10-612d-448c-a936-518fcd062f91 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:15.081481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4611d10-612d-448c-a936-518fcd062f91 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:15.138881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e74bd2-d679-4454-a0c3-41753dc29972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:15.139567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e74bd2-d679-4454-a0c3-41753dc29972 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:15.139852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e74bd2-d679-4454-a0c3-41753dc29972 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:15.140128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e74bd2-d679-4454-a0c3-41753dc29972 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:15.140842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e74bd2-d679-4454-a0c3-41753dc29972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:15.142765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e74bd2-d679-4454-a0c3-41753dc29972 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:15.333598 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3907/7827] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:53:15 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:15.340163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668cca1-76c7-435b-a16c-847da8ec8988 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:15.350613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668cca1-76c7-435b-a16c-847da8ec8988 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:15.355456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508fb9f-9406-4484-a8b7-cb1a5ea612ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:15.356117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508fb9f-9406-4484-a8b7-cb1a5ea612ab admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:15.356449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508fb9f-9406-4484-a8b7-cb1a5ea612ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:15.360368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508fb9f-9406-4484-a8b7-cb1a5ea612ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:15.360368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508fb9f-9406-4484-a8b7-cb1a5ea612ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:15.360368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508fb9f-9406-4484-a8b7-cb1a5ea612ab admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:15.373360 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3921/7828] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:15.377665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e74bd2-d679-4454-a0c3-41753dc29972 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:15.387115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e74bd2-d679-4454-a0c3-41753dc29972 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:15.392544 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9afef-a524-4348-8925-6dfd7fcea527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:15.393246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9afef-a524-4348-8925-6dfd7fcea527 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:15.393537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9afef-a524-4348-8925-6dfd7fcea527 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:15.393815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9afef-a524-4348-8925-6dfd7fcea527 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:15.394691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9afef-a524-4348-8925-6dfd7fcea527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:15.396325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9afef-a524-4348-8925-6dfd7fcea527 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:15.410378 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3908/7829] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:15.411445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508fb9f-9406-4484-a8b7-cb1a5ea612ab admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:15.424309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508fb9f-9406-4484-a8b7-cb1a5ea612ab admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:15.432494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f5449-06b9-41d4-844b-d918b766be5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:15.432494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f5449-06b9-41d4-844b-d918b766be5a admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:15.432494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f5449-06b9-41d4-844b-d918b766be5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:15.432494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f5449-06b9-41d4-844b-d918b766be5a admin admin] PATH_INFO: `/v3/projects/ed9999001600436fae7e235ecfdd1c04/users/6d48d7d2ae0643ccb2edc6afed792326/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:15.447682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f5449-06b9-41d4-844b-d918b766be5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed9999001600436fae7e235ecfdd1c04, user_id=6d48d7d2ae0643ccb2edc6afed792326, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:15.451061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f5449-06b9-41d4-844b-d918b766be5a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:15.513703 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3922/7830] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:15 2022] PUT /identity/v3/projects/ed9999001600436fae7e235ecfdd1c04/users/6d48d7d2ae0643ccb2edc6afed792326/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:15.600156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04594fb2-86d6-4923-8ce1-6dd3ab3cfb62 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:15.600512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04594fb2-86d6-4923-8ce1-6dd3ab3cfb62 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:15.600941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04594fb2-86d6-4923-8ce1-6dd3ab3cfb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:15.630856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-04594fb2-86d6-4923-8ce1-6dd3ab3cfb62 None None] MFA Rules not processed for user `6d48d7d2ae0643ccb2edc6afed792326`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:15.693631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-04594fb2-86d6-4923-8ce1-6dd3ab3cfb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:15.693631 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3909/7831] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:53:15.705886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f5449-06b9-41d4-844b-d918b766be5a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:15.707612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-302f5449-06b9-41d4-844b-d918b766be5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:15.765907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f5449-06b9-41d4-844b-d918b766be5a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:15.769586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5519c-5017-4a74-b6c9-17bc5d949642 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:15.770235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5519c-5017-4a74-b6c9-17bc5d949642 service glance] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:15.770519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5519c-5017-4a74-b6c9-17bc5d949642 service glance] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:15.770800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5519c-5017-4a74-b6c9-17bc5d949642 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:15.836560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5519c-5017-4a74-b6c9-17bc5d949642 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:15.841322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5519c-5017-4a74-b6c9-17bc5d949642 service glance] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:15.847902 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3923/7832] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:53:16.129152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04594fb2-86d6-4923-8ce1-6dd3ab3cfb62 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:16.141509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04594fb2-86d6-4923-8ce1-6dd3ab3cfb62 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:16.145710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2195e36-10e4-4005-a7cc-59f09f0ad743 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:16.146384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2195e36-10e4-4005-a7cc-59f09f0ad743 service glance] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:16.146672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2195e36-10e4-4005-a7cc-59f09f0ad743 service glance] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:16.146952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2195e36-10e4-4005-a7cc-59f09f0ad743 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:16.156307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2195e36-10e4-4005-a7cc-59f09f0ad743 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:16.157812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2195e36-10e4-4005-a7cc-59f09f0ad743 service glance] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:16.166900 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3910/7833] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:53:16.906060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5519c-5017-4a74-b6c9-17bc5d949642 service glance] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:16.966828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5519c-5017-4a74-b6c9-17bc5d949642 service glance] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:16.971407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392d360-ed73-4014-ba8e-f3e1ffc9077e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:16.972263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392d360-ed73-4014-ba8e-f3e1ffc9077e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:16.972548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392d360-ed73-4014-ba8e-f3e1ffc9077e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:16.972871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392d360-ed73-4014-ba8e-f3e1ffc9077e admin admin] PATH_INFO: `/v3/users/ade65fb9632b4ff1836598d51fa02cc9` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:16.974024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392d360-ed73-4014-ba8e-f3e1ffc9077e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ade65fb9632b4ff1836598d51fa02cc9)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:16.975934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392d360-ed73-4014-ba8e-f3e1ffc9077e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:17.191960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3392d360-ed73-4014-ba8e-f3e1ffc9077e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ade65fb9632b4ff1836598d51fa02cc9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:17.202945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3392d360-ed73-4014-ba8e-f3e1ffc9077e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ade65fb9632b4ff1836598d51fa02cc9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:17.203612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3392d360-ed73-4014-ba8e-f3e1ffc9077e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ade65fb9632b4ff1836598d51fa02cc9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:17.210248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3392d360-ed73-4014-ba8e-f3e1ffc9077e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ade65fb9632b4ff1836598d51fa02cc9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:17.304296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3392d360-ed73-4014-ba8e-f3e1ffc9077e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ade65fb9632b4ff1836598d51fa02cc9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:17.311722 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3924/7834] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:16 2022] DELETE /identity/v3/users/ade65fb9632b4ff1836598d51fa02cc9 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:17.316283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f06bb-c1b9-4381-957e-d698b147897c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:17.316788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f06bb-c1b9-4381-957e-d698b147897c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:17.316888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f06bb-c1b9-4381-957e-d698b147897c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:17.334228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-1f3f06bb-c1b9-4381-957e-d698b147897c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:17.335419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1f3f06bb-c1b9-4381-957e-d698b147897c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:17.393625 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3911/7835] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:17.403690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392d360-ed73-4014-ba8e-f3e1ffc9077e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:17.408193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3392d360-ed73-4014-ba8e-f3e1ffc9077e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:17.462177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392d360-ed73-4014-ba8e-f3e1ffc9077e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:17.466368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc418672-0492-40db-a537-8b50074b8889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:17.467063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc418672-0492-40db-a537-8b50074b8889 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:17.467347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc418672-0492-40db-a537-8b50074b8889 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:17.467626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc418672-0492-40db-a537-8b50074b8889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:17.476717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc418672-0492-40db-a537-8b50074b8889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:17.478217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc418672-0492-40db-a537-8b50074b8889 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:17.489446 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3925/7836] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:53:17.820384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f06bb-c1b9-4381-957e-d698b147897c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:17.822102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1f3f06bb-c1b9-4381-957e-d698b147897c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:17.835943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f06bb-c1b9-4381-957e-d698b147897c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:17.841572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5cfd7-cef0-45a9-a4ea-3fc4431198fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:17.842581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5cfd7-cef0-45a9-a4ea-3fc4431198fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:17.842895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5cfd7-cef0-45a9-a4ea-3fc4431198fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:17.843177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5cfd7-cef0-45a9-a4ea-3fc4431198fd admin admin] PATH_INFO: `/v3/projects/05ca0db98cf74e2b8872502cf19e5547` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:17.855377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5cfd7-cef0-45a9-a4ea-3fc4431198fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=05ca0db98cf74e2b8872502cf19e5547)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:17.856762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5cfd7-cef0-45a9-a4ea-3fc4431198fd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:17.978682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-43f5cfd7-cef0-45a9-a4ea-3fc4431198fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ca0db98cf74e2b8872502cf19e5547', 'request_id': 'req-43f5cfd7-cef0-45a9-a4ea-3fc4431198fd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:17.984990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-43f5cfd7-cef0-45a9-a4ea-3fc4431198fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ca0db98cf74e2b8872502cf19e5547', 'request_id': 'req-43f5cfd7-cef0-45a9-a4ea-3fc4431198fd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:18.081705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-43f5cfd7-cef0-45a9-a4ea-3fc4431198fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ca0db98cf74e2b8872502cf19e5547', 'request_id': 'req-43f5cfd7-cef0-45a9-a4ea-3fc4431198fd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:18.093383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-43f5cfd7-cef0-45a9-a4ea-3fc4431198fd admin admin] The token cache is being invalidate because project 05ca0db98cf74e2b8872502cf19e5547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:18.093671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-43f5cfd7-cef0-45a9-a4ea-3fc4431198fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:18.094328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-43f5cfd7-cef0-45a9-a4ea-3fc4431198fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:18.096074 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3912/7837] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:17 2022] DELETE /identity/v3/projects/05ca0db98cf74e2b8872502cf19e5547 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:18.100546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc418672-0492-40db-a537-8b50074b8889 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:18.111040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc418672-0492-40db-a537-8b50074b8889 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:18.169736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f5cbd-4629-463d-9f14-d193dd60c48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:18.170536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f5cbd-4629-463d-9f14-d193dd60c48f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:18.170821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f5cbd-4629-463d-9f14-d193dd60c48f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:18.171129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f5cbd-4629-463d-9f14-d193dd60c48f admin admin] PATH_INFO: `/v3/users/6d48d7d2ae0643ccb2edc6afed792326` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:18.172340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f5cbd-4629-463d-9f14-d193dd60c48f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d48d7d2ae0643ccb2edc6afed792326)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:18.174287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f5cbd-4629-463d-9f14-d193dd60c48f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:18.415299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1a9f5cbd-4629-463d-9f14-d193dd60c48f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d48d7d2ae0643ccb2edc6afed792326'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:18.426976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1a9f5cbd-4629-463d-9f14-d193dd60c48f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d48d7d2ae0643ccb2edc6afed792326'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:18.427740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1a9f5cbd-4629-463d-9f14-d193dd60c48f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d48d7d2ae0643ccb2edc6afed792326'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:18.435654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1a9f5cbd-4629-463d-9f14-d193dd60c48f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d48d7d2ae0643ccb2edc6afed792326'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:18.475664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1a9f5cbd-4629-463d-9f14-d193dd60c48f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d48d7d2ae0643ccb2edc6afed792326'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:18.482415 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3926/7838] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:18 2022] DELETE /identity/v3/users/6d48d7d2ae0643ccb2edc6afed792326 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:18.877955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5cfd7-cef0-45a9-a4ea-3fc4431198fd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:18.879422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-43f5cfd7-cef0-45a9-a4ea-3fc4431198fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:18.893539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5cfd7-cef0-45a9-a4ea-3fc4431198fd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:18.949592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc7b75-2879-41cf-bfe7-44216db47c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:18.950621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc7b75-2879-41cf-bfe7-44216db47c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:18.950916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc7b75-2879-41cf-bfe7-44216db47c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:18.951198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc7b75-2879-41cf-bfe7-44216db47c4d admin admin] PATH_INFO: `/v3/projects/ed9999001600436fae7e235ecfdd1c04` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:18.952393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc7b75-2879-41cf-bfe7-44216db47c4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed9999001600436fae7e235ecfdd1c04)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:18.954403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc7b75-2879-41cf-bfe7-44216db47c4d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:19.064005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b2cc7b75-2879-41cf-bfe7-44216db47c4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed9999001600436fae7e235ecfdd1c04', 'request_id': 'req-b2cc7b75-2879-41cf-bfe7-44216db47c4d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:19.070599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b2cc7b75-2879-41cf-bfe7-44216db47c4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed9999001600436fae7e235ecfdd1c04', 'request_id': 'req-b2cc7b75-2879-41cf-bfe7-44216db47c4d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:19.144194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b2cc7b75-2879-41cf-bfe7-44216db47c4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed9999001600436fae7e235ecfdd1c04', 'request_id': 'req-b2cc7b75-2879-41cf-bfe7-44216db47c4d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:19.155688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b2cc7b75-2879-41cf-bfe7-44216db47c4d admin admin] The token cache is being invalidate because project ed9999001600436fae7e235ecfdd1c04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:19.155983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b2cc7b75-2879-41cf-bfe7-44216db47c4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:19.156648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b2cc7b75-2879-41cf-bfe7-44216db47c4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:19.158202 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3913/7839] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:18 2022] DELETE /identity/v3/projects/ed9999001600436fae7e235ecfdd1c04 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:19.164885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5f562-7acc-4d8a-98ac-975bfb3167f7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:19.165637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5f562-7acc-4d8a-98ac-975bfb3167f7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:19.165936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5f562-7acc-4d8a-98ac-975bfb3167f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:19.184635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b9d5f562-7acc-4d8a-98ac-975bfb3167f7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:19.185838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b9d5f562-7acc-4d8a-98ac-975bfb3167f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:19.243311 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3927/7840] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:19.251511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b301e-3d33-4006-9325-ae149ca91559 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:19.251801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b301e-3d33-4006-9325-ae149ca91559 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:19.252115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b301e-3d33-4006-9325-ae149ca91559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:19.270702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4f0b301e-3d33-4006-9325-ae149ca91559 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:19.271895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4f0b301e-3d33-4006-9325-ae149ca91559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:19.280478 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3914/7841] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:19.284731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5f562-7acc-4d8a-98ac-975bfb3167f7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:19.294510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5f562-7acc-4d8a-98ac-975bfb3167f7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:19.299186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad0f90-a8dc-441e-96de-da358da2d6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:19.299849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad0f90-a8dc-441e-96de-da358da2d6bd admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:19.300135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad0f90-a8dc-441e-96de-da358da2d6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:19.300418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad0f90-a8dc-441e-96de-da358da2d6bd admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:19.301186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad0f90-a8dc-441e-96de-da358da2d6bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:53:19.301497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad0f90-a8dc-441e-96de-da358da2d6bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:19.303150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad0f90-a8dc-441e-96de-da358da2d6bd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:19.314576 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3928/7842] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:19.318991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b301e-3d33-4006-9325-ae149ca91559 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:19.328968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b301e-3d33-4006-9325-ae149ca91559 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:19.333670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3643040-3d58-44bf-a91e-420b3cfd199d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:19.334316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3643040-3d58-44bf-a91e-420b3cfd199d admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:19.334600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3643040-3d58-44bf-a91e-420b3cfd199d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:19.334880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3643040-3d58-44bf-a91e-420b3cfd199d admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:19.335565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3643040-3d58-44bf-a91e-420b3cfd199d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:19.337527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3643040-3d58-44bf-a91e-420b3cfd199d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:19.414027 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3915/7843] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:19 2022] POST /identity/v3/projects => generated 389 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:19.418115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad0f90-a8dc-441e-96de-da358da2d6bd admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:19.428016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad0f90-a8dc-441e-96de-da358da2d6bd admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:19.487652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca6a1e-af69-4e61-993e-41ee77ef8cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:19.488366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca6a1e-af69-4e61-993e-41ee77ef8cbd admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:19.488675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca6a1e-af69-4e61-993e-41ee77ef8cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:19.488961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca6a1e-af69-4e61-993e-41ee77ef8cbd admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:19.489726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca6a1e-af69-4e61-993e-41ee77ef8cbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:19.491683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca6a1e-af69-4e61-993e-41ee77ef8cbd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:19.584259 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3929/7844] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:53:19 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:19.588192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3643040-3d58-44bf-a91e-420b3cfd199d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:19.599384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3643040-3d58-44bf-a91e-420b3cfd199d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:19.603984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab45e7-3734-447c-8644-eea02d419f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:19.604659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab45e7-3734-447c-8644-eea02d419f1d admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:19.604946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab45e7-3734-447c-8644-eea02d419f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:19.605223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab45e7-3734-447c-8644-eea02d419f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:19.606070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab45e7-3734-447c-8644-eea02d419f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:19.607706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab45e7-3734-447c-8644-eea02d419f1d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:19.618029 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3916/7845] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:19.622425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca6a1e-af69-4e61-993e-41ee77ef8cbd admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:19.632666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca6a1e-af69-4e61-993e-41ee77ef8cbd admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:19.638197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc93ed-8d2c-49b2-a80b-90d7e8010f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:19.638845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc93ed-8d2c-49b2-a80b-90d7e8010f3a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:19.639126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc93ed-8d2c-49b2-a80b-90d7e8010f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:19.639399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc93ed-8d2c-49b2-a80b-90d7e8010f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:19.640154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc93ed-8d2c-49b2-a80b-90d7e8010f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:19.641828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc93ed-8d2c-49b2-a80b-90d7e8010f3a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:19.651336 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3930/7846] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:19.655336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab45e7-3734-447c-8644-eea02d419f1d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:19.665381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab45e7-3734-447c-8644-eea02d419f1d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:19.670086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15cd6e-a468-412f-a1c9-b146c40d235d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:19.670955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15cd6e-a468-412f-a1c9-b146c40d235d admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:19.671235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15cd6e-a468-412f-a1c9-b146c40d235d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:19.671509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15cd6e-a468-412f-a1c9-b146c40d235d admin admin] PATH_INFO: `/v3/projects/3d75240cadbb4b1da2c6bb462108030f/users/405f525ac55f49688c93871ac8635f98/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:19.685872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15cd6e-a468-412f-a1c9-b146c40d235d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d75240cadbb4b1da2c6bb462108030f, user_id=405f525ac55f49688c93871ac8635f98, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:19.688545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15cd6e-a468-412f-a1c9-b146c40d235d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:19.772918 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3917/7847] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:19 2022] PUT /identity/v3/projects/3d75240cadbb4b1da2c6bb462108030f/users/405f525ac55f49688c93871ac8635f98/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:19.785863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8c30c-98b6-4948-8b88-5b94d489e234 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:19.786156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8c30c-98b6-4948-8b88-5b94d489e234 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:19.786441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8c30c-98b6-4948-8b88-5b94d489e234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:19.815104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-dfd8c30c-98b6-4948-8b88-5b94d489e234 None None] MFA Rules not processed for user `405f525ac55f49688c93871ac8635f98`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:19.816361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dfd8c30c-98b6-4948-8b88-5b94d489e234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:19.878873 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3931/7848] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:19.883601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15cd6e-a468-412f-a1c9-b146c40d235d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:19.945688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15cd6e-a468-412f-a1c9-b146c40d235d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:19.951069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aad214-3e2c-4172-929a-e13645e64658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:19.951728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aad214-3e2c-4172-929a-e13645e64658 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:19.952011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aad214-3e2c-4172-929a-e13645e64658 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:19.952283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aad214-3e2c-4172-929a-e13645e64658 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:19.953009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aad214-3e2c-4172-929a-e13645e64658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:19.954988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aad214-3e2c-4172-929a-e13645e64658 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:20.066687 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3918/7849] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:19 2022] POST /identity/v3/projects => generated 391 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:20.070865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8c30c-98b6-4948-8b88-5b94d489e234 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:20.081482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8c30c-98b6-4948-8b88-5b94d489e234 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:20.137224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d49c7-b0de-4269-a68c-bb0782fe2dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:20.137855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d49c7-b0de-4269-a68c-bb0782fe2dca admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:20.138138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d49c7-b0de-4269-a68c-bb0782fe2dca admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:20.138414 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d49c7-b0de-4269-a68c-bb0782fe2dca admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:20.139113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d49c7-b0de-4269-a68c-bb0782fe2dca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:20.141065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d49c7-b0de-4269-a68c-bb0782fe2dca admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:20.207867 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3932/7850] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:53:20 2022] POST /identity/v3/users => generated 302 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:20.212190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aad214-3e2c-4172-929a-e13645e64658 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:20.222424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aad214-3e2c-4172-929a-e13645e64658 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:20.227024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283ac68-5e3e-4b4e-a340-1b0a1d2a3c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:20.227679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283ac68-5e3e-4b4e-a340-1b0a1d2a3c65 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:20.227962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283ac68-5e3e-4b4e-a340-1b0a1d2a3c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:20.228240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283ac68-5e3e-4b4e-a340-1b0a1d2a3c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:20.229186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283ac68-5e3e-4b4e-a340-1b0a1d2a3c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:20.230784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283ac68-5e3e-4b4e-a340-1b0a1d2a3c65 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:20.241914 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3919/7851] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:20.246184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d49c7-b0de-4269-a68c-bb0782fe2dca admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:20.256615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d49c7-b0de-4269-a68c-bb0782fe2dca admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:20.262764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b484b-2437-4299-873f-36df89e479c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:20.263856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b484b-2437-4299-873f-36df89e479c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:20.264226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b484b-2437-4299-873f-36df89e479c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:20.264556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b484b-2437-4299-873f-36df89e479c6 admin admin] PATH_INFO: `/v3/projects/75eca22b70fa4597b467a7b4f05f1000/users/ffb84a309bc642e994a3bd307814b6ae/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:20.279750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b484b-2437-4299-873f-36df89e479c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75eca22b70fa4597b467a7b4f05f1000, user_id=ffb84a309bc642e994a3bd307814b6ae, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:20.282451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b484b-2437-4299-873f-36df89e479c6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:20.349863 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3933/7852] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:20 2022] PUT /identity/v3/projects/75eca22b70fa4597b467a7b4f05f1000/users/ffb84a309bc642e994a3bd307814b6ae/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:20.353794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283ac68-5e3e-4b4e-a340-1b0a1d2a3c65 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:20.364270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283ac68-5e3e-4b4e-a340-1b0a1d2a3c65 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:20.418413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc527d1-d559-420f-ab4d-7f86e8683050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:20.419677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc527d1-d559-420f-ab4d-7f86e8683050 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:20.419960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc527d1-d559-420f-ab4d-7f86e8683050 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:20.420235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc527d1-d559-420f-ab4d-7f86e8683050 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:20.420982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc527d1-d559-420f-ab4d-7f86e8683050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:20.427255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc527d1-d559-420f-ab4d-7f86e8683050 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:20.432096 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3920/7853] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:20.436330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b484b-2437-4299-873f-36df89e479c6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:20.446638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b484b-2437-4299-873f-36df89e479c6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:20.451407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57f6e9-f913-484f-ba07-bcd0c8d47818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:20.452281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57f6e9-f913-484f-ba07-bcd0c8d47818 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:20.452574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57f6e9-f913-484f-ba07-bcd0c8d47818 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:20.452884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57f6e9-f913-484f-ba07-bcd0c8d47818 admin admin] PATH_INFO: `/v3/projects/75eca22b70fa4597b467a7b4f05f1000/users/ffb84a309bc642e994a3bd307814b6ae/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:20.454881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57f6e9-f913-484f-ba07-bcd0c8d47818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75eca22b70fa4597b467a7b4f05f1000, user_id=ffb84a309bc642e994a3bd307814b6ae, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:20.457605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57f6e9-f913-484f-ba07-bcd0c8d47818 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:20.468836 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3934/7854] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:20 2022] PUT /identity/v3/projects/75eca22b70fa4597b467a7b4f05f1000/users/ffb84a309bc642e994a3bd307814b6ae/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:20.479154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45742004-a18b-4aac-a9cb-953639f9124a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:20.479448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45742004-a18b-4aac-a9cb-953639f9124a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:20.482477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45742004-a18b-4aac-a9cb-953639f9124a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:20.507122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-45742004-a18b-4aac-a9cb-953639f9124a None None] MFA Rules not processed for user `ffb84a309bc642e994a3bd307814b6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:20.508359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-45742004-a18b-4aac-a9cb-953639f9124a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:20.575736 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3921/7855] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:20 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:20.586181 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57f6e9-f913-484f-ba07-bcd0c8d47818 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:20.587907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0e57f6e9-f913-484f-ba07-bcd0c8d47818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:20.647996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57f6e9-f913-484f-ba07-bcd0c8d47818 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:20.651695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5fd9c-65db-415c-ae56-7d8c487f5685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:20.652337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5fd9c-65db-415c-ae56-7d8c487f5685 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:20.652650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5fd9c-65db-415c-ae56-7d8c487f5685 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:20.652935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5fd9c-65db-415c-ae56-7d8c487f5685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:20.708182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5fd9c-65db-415c-ae56-7d8c487f5685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:20.709584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5fd9c-65db-415c-ae56-7d8c487f5685 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:20.719260 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3935/7856] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:53:23.435968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45742004-a18b-4aac-a9cb-953639f9124a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:23.449332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45742004-a18b-4aac-a9cb-953639f9124a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:23.453808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc640c4-bea9-4473-a2c7-50a1a50917d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:23.454469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc640c4-bea9-4473-a2c7-50a1a50917d1 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:23.454789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc640c4-bea9-4473-a2c7-50a1a50917d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:23.455069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc640c4-bea9-4473-a2c7-50a1a50917d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:23.465368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc640c4-bea9-4473-a2c7-50a1a50917d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:23.467495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc640c4-bea9-4473-a2c7-50a1a50917d1 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:23.478234 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3922/7857] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:53:26.384133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5fd9c-65db-415c-ae56-7d8c487f5685 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:26.396446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5fd9c-65db-415c-ae56-7d8c487f5685 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:26.400997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1586ba-18b7-4341-b257-bae9230489c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:26.401661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1586ba-18b7-4341-b257-bae9230489c5 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:26.401951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1586ba-18b7-4341-b257-bae9230489c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:26.402234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1586ba-18b7-4341-b257-bae9230489c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:26.404178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0e1586ba-18b7-4341-b257-bae9230489c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:26.482789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1586ba-18b7-4341-b257-bae9230489c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:26.485659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1586ba-18b7-4341-b257-bae9230489c5 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:26.502186 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3936/7858] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:53:27.160262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc640c4-bea9-4473-a2c7-50a1a50917d1 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:27.178055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc640c4-bea9-4473-a2c7-50a1a50917d1 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:27.185109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c674f08-b342-4a22-bd9d-41e97d74798c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:27.186603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c674f08-b342-4a22-bd9d-41e97d74798c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:27.186894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c674f08-b342-4a22-bd9d-41e97d74798c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:27.187740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c674f08-b342-4a22-bd9d-41e97d74798c admin admin] PATH_INFO: `/v3/users/405f525ac55f49688c93871ac8635f98` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:27.189220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c674f08-b342-4a22-bd9d-41e97d74798c admin admin] RBAC: Authorizing `identity:delete_user(user_id=405f525ac55f49688c93871ac8635f98)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:27.191874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c674f08-b342-4a22-bd9d-41e97d74798c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:27.341179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5c674f08-b342-4a22-bd9d-41e97d74798c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '405f525ac55f49688c93871ac8635f98'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:27.356679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5c674f08-b342-4a22-bd9d-41e97d74798c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '405f525ac55f49688c93871ac8635f98'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:27.356679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5c674f08-b342-4a22-bd9d-41e97d74798c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '405f525ac55f49688c93871ac8635f98'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:27.363093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5c674f08-b342-4a22-bd9d-41e97d74798c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '405f525ac55f49688c93871ac8635f98'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:27.401579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-5c674f08-b342-4a22-bd9d-41e97d74798c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '405f525ac55f49688c93871ac8635f98'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:27.408614 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3923/7859] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:27 2022] DELETE /identity/v3/users/405f525ac55f49688c93871ac8635f98 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:27.413343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5a246-25f2-4b47-8169-d4511bcac04c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:27.413824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5a246-25f2-4b47-8169-d4511bcac04c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:27.413921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5a246-25f2-4b47-8169-d4511bcac04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:27.433018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f1d5a246-25f2-4b47-8169-d4511bcac04c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:27.434424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f1d5a246-25f2-4b47-8169-d4511bcac04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:27.494326 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3937/7860] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:27.504484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c674f08-b342-4a22-bd9d-41e97d74798c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:27.506000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5c674f08-b342-4a22-bd9d-41e97d74798c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:27.567175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c674f08-b342-4a22-bd9d-41e97d74798c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:27.570901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7e8b0-7087-4f15-a929-cf12bb887371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:27.571722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7e8b0-7087-4f15-a929-cf12bb887371 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:27.572135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7e8b0-7087-4f15-a929-cf12bb887371 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:27.572480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7e8b0-7087-4f15-a929-cf12bb887371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:27.582796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7e8b0-7087-4f15-a929-cf12bb887371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:27.584237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7e8b0-7087-4f15-a929-cf12bb887371 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:27.594459 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3924/7861] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:53:27.837489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5a246-25f2-4b47-8169-d4511bcac04c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:27.840842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f1d5a246-25f2-4b47-8169-d4511bcac04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:27.856200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5a246-25f2-4b47-8169-d4511bcac04c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:27.870325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c1edc-14ea-4ab7-9927-e312e329c5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:27.871333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c1edc-14ea-4ab7-9927-e312e329c5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:27.873338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c1edc-14ea-4ab7-9927-e312e329c5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:27.873698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c1edc-14ea-4ab7-9927-e312e329c5bb admin admin] PATH_INFO: `/v3/projects/3d75240cadbb4b1da2c6bb462108030f` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:27.876005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c1edc-14ea-4ab7-9927-e312e329c5bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d75240cadbb4b1da2c6bb462108030f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:27.879537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c1edc-14ea-4ab7-9927-e312e329c5bb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:28.004423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0f8c1edc-14ea-4ab7-9927-e312e329c5bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d75240cadbb4b1da2c6bb462108030f', 'request_id': 'req-0f8c1edc-14ea-4ab7-9927-e312e329c5bb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:28.076757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0f8c1edc-14ea-4ab7-9927-e312e329c5bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d75240cadbb4b1da2c6bb462108030f', 'request_id': 'req-0f8c1edc-14ea-4ab7-9927-e312e329c5bb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:28.084128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0f8c1edc-14ea-4ab7-9927-e312e329c5bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d75240cadbb4b1da2c6bb462108030f', 'request_id': 'req-0f8c1edc-14ea-4ab7-9927-e312e329c5bb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:28.101220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0f8c1edc-14ea-4ab7-9927-e312e329c5bb admin admin] The token cache is being invalidate because project 3d75240cadbb4b1da2c6bb462108030f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:28.102141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0f8c1edc-14ea-4ab7-9927-e312e329c5bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:28.102544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0f8c1edc-14ea-4ab7-9927-e312e329c5bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:28.112894 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3938/7862] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:27 2022] DELETE /identity/v3/projects/3d75240cadbb4b1da2c6bb462108030f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:28.114386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7e8b0-7087-4f15-a929-cf12bb887371 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:28.127673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7e8b0-7087-4f15-a929-cf12bb887371 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:28.216247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ffbd0-f40e-4069-8231-4db332f02f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:28.217876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ffbd0-f40e-4069-8231-4db332f02f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:28.218422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ffbd0-f40e-4069-8231-4db332f02f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:28.218820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ffbd0-f40e-4069-8231-4db332f02f73 admin admin] PATH_INFO: `/v3/users/ffb84a309bc642e994a3bd307814b6ae` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:28.220364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ffbd0-f40e-4069-8231-4db332f02f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffb84a309bc642e994a3bd307814b6ae)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:28.223037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ffbd0-f40e-4069-8231-4db332f02f73 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:28.466665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-763ffbd0-f40e-4069-8231-4db332f02f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffb84a309bc642e994a3bd307814b6ae'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:28.479340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-763ffbd0-f40e-4069-8231-4db332f02f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffb84a309bc642e994a3bd307814b6ae'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:28.482622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-763ffbd0-f40e-4069-8231-4db332f02f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffb84a309bc642e994a3bd307814b6ae'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:28.488421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-763ffbd0-f40e-4069-8231-4db332f02f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffb84a309bc642e994a3bd307814b6ae'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:28.546089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-763ffbd0-f40e-4069-8231-4db332f02f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffb84a309bc642e994a3bd307814b6ae'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:28.553960 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3925/7863] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:28 2022] DELETE /identity/v3/users/ffb84a309bc642e994a3bd307814b6ae => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:28.826997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c1edc-14ea-4ab7-9927-e312e329c5bb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:28.828459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0f8c1edc-14ea-4ab7-9927-e312e329c5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:28.844577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c1edc-14ea-4ab7-9927-e312e329c5bb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:28.907203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146157d7-e014-4ecf-8d3e-541272e51bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:28.907987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146157d7-e014-4ecf-8d3e-541272e51bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:28.908272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146157d7-e014-4ecf-8d3e-541272e51bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:28.910458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146157d7-e014-4ecf-8d3e-541272e51bb4 admin admin] PATH_INFO: `/v3/users/bb25448d45ac488797f59e828cafdb22` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:28.910458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146157d7-e014-4ecf-8d3e-541272e51bb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb25448d45ac488797f59e828cafdb22)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:28.911752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146157d7-e014-4ecf-8d3e-541272e51bb4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:28.980571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ffbd0-f40e-4069-8231-4db332f02f73 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:28.982468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-763ffbd0-f40e-4069-8231-4db332f02f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:29.003406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ffbd0-f40e-4069-8231-4db332f02f73 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:29.012187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60d1f5-8208-4b57-a17f-ef93ddeb6595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:29.014256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60d1f5-8208-4b57-a17f-ef93ddeb6595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:29.014774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60d1f5-8208-4b57-a17f-ef93ddeb6595 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:29.015281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60d1f5-8208-4b57-a17f-ef93ddeb6595 admin admin] PATH_INFO: `/v3/projects/75eca22b70fa4597b467a7b4f05f1000` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:29.017427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60d1f5-8208-4b57-a17f-ef93ddeb6595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75eca22b70fa4597b467a7b4f05f1000)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:29.021001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60d1f5-8208-4b57-a17f-ef93ddeb6595 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:29.070077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-146157d7-e014-4ecf-8d3e-541272e51bb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb25448d45ac488797f59e828cafdb22'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:29.091124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-146157d7-e014-4ecf-8d3e-541272e51bb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb25448d45ac488797f59e828cafdb22'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:29.093677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-146157d7-e014-4ecf-8d3e-541272e51bb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb25448d45ac488797f59e828cafdb22'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:29.116533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-146157d7-e014-4ecf-8d3e-541272e51bb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb25448d45ac488797f59e828cafdb22'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:29.145563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2a60d1f5-8208-4b57-a17f-ef93ddeb6595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75eca22b70fa4597b467a7b4f05f1000', 'request_id': 'req-2a60d1f5-8208-4b57-a17f-ef93ddeb6595'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:29.158470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2a60d1f5-8208-4b57-a17f-ef93ddeb6595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75eca22b70fa4597b467a7b4f05f1000', 'request_id': 'req-2a60d1f5-8208-4b57-a17f-ef93ddeb6595'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:29.218998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-146157d7-e014-4ecf-8d3e-541272e51bb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb25448d45ac488797f59e828cafdb22'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:29.225340 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3939/7864] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:28 2022] DELETE /identity/v3/users/bb25448d45ac488797f59e828cafdb22 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:29.290101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2a60d1f5-8208-4b57-a17f-ef93ddeb6595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75eca22b70fa4597b467a7b4f05f1000', 'request_id': 'req-2a60d1f5-8208-4b57-a17f-ef93ddeb6595'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:29.301668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2a60d1f5-8208-4b57-a17f-ef93ddeb6595 admin admin] The token cache is being invalidate because project 75eca22b70fa4597b467a7b4f05f1000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:29.302239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2a60d1f5-8208-4b57-a17f-ef93ddeb6595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:29.302953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-2a60d1f5-8208-4b57-a17f-ef93ddeb6595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:29.308060 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3926/7865] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:28 2022] DELETE /identity/v3/projects/75eca22b70fa4597b467a7b4f05f1000 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:29.311317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6614eb-5ed8-4640-8b2d-eb3ef53f7335 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:29.311842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6614eb-5ed8-4640-8b2d-eb3ef53f7335 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:29.312759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6614eb-5ed8-4640-8b2d-eb3ef53f7335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:29.334450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6e6614eb-5ed8-4640-8b2d-eb3ef53f7335 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:29.335663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6e6614eb-5ed8-4640-8b2d-eb3ef53f7335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:29.395876 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3940/7866] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:29.403818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bf9bd-0a2d-4dc4-b256-7d057a0f92a6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:29.404269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bf9bd-0a2d-4dc4-b256-7d057a0f92a6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:29.404770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bf9bd-0a2d-4dc4-b256-7d057a0f92a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:29.423600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a86bf9bd-0a2d-4dc4-b256-7d057a0f92a6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:29.424870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a86bf9bd-0a2d-4dc4-b256-7d057a0f92a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:29.432889 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3927/7867] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:29.437627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6614eb-5ed8-4640-8b2d-eb3ef53f7335 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:29.447139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6614eb-5ed8-4640-8b2d-eb3ef53f7335 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:29.452433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178a4e9-8d48-4f87-9cc3-2f8e65fc7471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:29.453122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178a4e9-8d48-4f87-9cc3-2f8e65fc7471 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:29.453407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178a4e9-8d48-4f87-9cc3-2f8e65fc7471 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:29.453688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178a4e9-8d48-4f87-9cc3-2f8e65fc7471 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:29.457474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178a4e9-8d48-4f87-9cc3-2f8e65fc7471 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:53:29.457474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178a4e9-8d48-4f87-9cc3-2f8e65fc7471 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:29.457474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178a4e9-8d48-4f87-9cc3-2f8e65fc7471 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:29.467420 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3941/7868] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:29.471849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bf9bd-0a2d-4dc4-b256-7d057a0f92a6 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:29.481306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bf9bd-0a2d-4dc4-b256-7d057a0f92a6 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:29.486282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cfba3-740b-46fa-adff-dfb5b66f2e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:29.487094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cfba3-740b-46fa-adff-dfb5b66f2e66 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:29.487388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cfba3-740b-46fa-adff-dfb5b66f2e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:29.487711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cfba3-740b-46fa-adff-dfb5b66f2e66 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:29.488386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cfba3-740b-46fa-adff-dfb5b66f2e66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:29.489215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178a4e9-8d48-4f87-9cc3-2f8e65fc7471 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:29.490401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cfba3-740b-46fa-adff-dfb5b66f2e66 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:29.491234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2178a4e9-8d48-4f87-9cc3-2f8e65fc7471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:29.505929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178a4e9-8d48-4f87-9cc3-2f8e65fc7471 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:29.514649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd78aa1-dd75-4ab4-98ce-97147c91f2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:29.514649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd78aa1-dd75-4ab4-98ce-97147c91f2d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:29.514649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd78aa1-dd75-4ab4-98ce-97147c91f2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:29.514649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd78aa1-dd75-4ab4-98ce-97147c91f2d0 admin admin] PATH_INFO: `/v3/projects/2257323c692e4608b9a5468b7aa57846` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:29.516343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd78aa1-dd75-4ab4-98ce-97147c91f2d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2257323c692e4608b9a5468b7aa57846)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:29.518317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd78aa1-dd75-4ab4-98ce-97147c91f2d0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:29.566869 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3928/7869] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:29 2022] POST /identity/v3/projects => generated 397 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:29.567870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cfba3-740b-46fa-adff-dfb5b66f2e66 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:29.609166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1fd78aa1-dd75-4ab4-98ce-97147c91f2d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2257323c692e4608b9a5468b7aa57846', 'request_id': 'req-1fd78aa1-dd75-4ab4-98ce-97147c91f2d0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:29.629843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cfba3-740b-46fa-adff-dfb5b66f2e66 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:29.653364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1fd78aa1-dd75-4ab4-98ce-97147c91f2d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2257323c692e4608b9a5468b7aa57846', 'request_id': 'req-1fd78aa1-dd75-4ab4-98ce-97147c91f2d0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:29.661835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1fd78aa1-dd75-4ab4-98ce-97147c91f2d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2257323c692e4608b9a5468b7aa57846', 'request_id': 'req-1fd78aa1-dd75-4ab4-98ce-97147c91f2d0'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:29.670874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1fd78aa1-dd75-4ab4-98ce-97147c91f2d0 admin admin] The token cache is being invalidate because project 2257323c692e4608b9a5468b7aa57846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:29.671166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1fd78aa1-dd75-4ab4-98ce-97147c91f2d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:29.671838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1fd78aa1-dd75-4ab4-98ce-97147c91f2d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:29.673507 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3942/7870] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:29 2022] DELETE /identity/v3/projects/2257323c692e4608b9a5468b7aa57846 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:29.678541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850626d-54db-4969-92fe-4c00602c0043 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:29.678832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850626d-54db-4969-92fe-4c00602c0043 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:29.679118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850626d-54db-4969-92fe-4c00602c0043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:29.688423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952feb16-d280-43c0-bfb8-9c97049fd275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:29.689129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952feb16-d280-43c0-bfb8-9c97049fd275 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:29.689444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952feb16-d280-43c0-bfb8-9c97049fd275 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:29.689740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952feb16-d280-43c0-bfb8-9c97049fd275 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:29.690400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952feb16-d280-43c0-bfb8-9c97049fd275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:29.692388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952feb16-d280-43c0-bfb8-9c97049fd275 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:29.698750 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b850626d-54db-4969-92fe-4c00602c0043 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:29.699962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b850626d-54db-4969-92fe-4c00602c0043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:29.709206 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3943/7871] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:53:29.717377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d12955-7b45-448c-87ea-0750b2d70362 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:29.717669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d12955-7b45-448c-87ea-0750b2d70362 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:29.717975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d12955-7b45-448c-87ea-0750b2d70362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:29.735785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a6d12955-7b45-448c-87ea-0750b2d70362 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:29.737020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a6d12955-7b45-448c-87ea-0750b2d70362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:29.744978 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3944/7872] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:53:29.750943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d12955-7b45-448c-87ea-0750b2d70362 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:29.759692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d12955-7b45-448c-87ea-0750b2d70362 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:29.764586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad80e0-7dde-4e30-bc7e-f33559fd7fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:29.765234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad80e0-7dde-4e30-bc7e-f33559fd7fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:29.765523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad80e0-7dde-4e30-bc7e-f33559fd7fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:29.766407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad80e0-7dde-4e30-bc7e-f33559fd7fd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:29.767123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad80e0-7dde-4e30-bc7e-f33559fd7fd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:53:29.767484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad80e0-7dde-4e30-bc7e-f33559fd7fd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:29.769122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad80e0-7dde-4e30-bc7e-f33559fd7fd6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:29.776643 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3929/7873] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:53:29 2022] POST /identity/v3/users => generated 299 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:29.779397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952feb16-d280-43c0-bfb8-9c97049fd275 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:29.781424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-952feb16-d280-43c0-bfb8-9c97049fd275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:29.788212 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3945/7874] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:53:29.789990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad80e0-7dde-4e30-bc7e-f33559fd7fd6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:29.793197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952feb16-d280-43c0-bfb8-9c97049fd275 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:29.799270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312d801-033c-4068-9ed9-bb7d7c00e103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:29.800220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312d801-033c-4068-9ed9-bb7d7c00e103 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:29.800401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312d801-033c-4068-9ed9-bb7d7c00e103 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:29.800723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312d801-033c-4068-9ed9-bb7d7c00e103 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:29.805567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad80e0-7dde-4e30-bc7e-f33559fd7fd6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:29.806004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312d801-033c-4068-9ed9-bb7d7c00e103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:29.806004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312d801-033c-4068-9ed9-bb7d7c00e103 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:29.806994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ec054-0385-4973-8b18-7e2df020d70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:29.808960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ec054-0385-4973-8b18-7e2df020d70d admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:29.809259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ec054-0385-4973-8b18-7e2df020d70d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:29.809548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ec054-0385-4973-8b18-7e2df020d70d admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:29.810926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ec054-0385-4973-8b18-7e2df020d70d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:29.812768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ec054-0385-4973-8b18-7e2df020d70d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:29.814278 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3930/7875] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:53:29.818221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312d801-033c-4068-9ed9-bb7d7c00e103 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:29.829328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312d801-033c-4068-9ed9-bb7d7c00e103 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:29.834081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9d3c1-0e23-4c4c-b449-e46de11cdaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:29.834738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9d3c1-0e23-4c4c-b449-e46de11cdaec admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:29.835026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9d3c1-0e23-4c4c-b449-e46de11cdaec admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:29.835303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9d3c1-0e23-4c4c-b449-e46de11cdaec admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:29.836051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9d3c1-0e23-4c4c-b449-e46de11cdaec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:29.837659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9d3c1-0e23-4c4c-b449-e46de11cdaec admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:29.847969 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3931/7876] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:29.852003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9d3c1-0e23-4c4c-b449-e46de11cdaec admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:29.861803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9d3c1-0e23-4c4c-b449-e46de11cdaec admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:29.866370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e58671-4d41-4f29-8376-9bec9cabead0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:29.867217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e58671-4d41-4f29-8376-9bec9cabead0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:29.867495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e58671-4d41-4f29-8376-9bec9cabead0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:29.867778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e58671-4d41-4f29-8376-9bec9cabead0 admin admin] PATH_INFO: `/v3/projects/645ae3da78364e50bd273b91c5ed4f61/users/b82fd80344054f30823522b13f936a0e/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:29.882181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e58671-4d41-4f29-8376-9bec9cabead0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=645ae3da78364e50bd273b91c5ed4f61, user_id=b82fd80344054f30823522b13f936a0e, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:29.884848 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e58671-4d41-4f29-8376-9bec9cabead0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:29.906361 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3946/7877] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:29 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:29.909722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ec054-0385-4973-8b18-7e2df020d70d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:29.968977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ec054-0385-4973-8b18-7e2df020d70d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:29.974073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c5cff-bcf7-4437-82c9-4767c8c50f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:29.974755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c5cff-bcf7-4437-82c9-4767c8c50f43 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:29.975094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c5cff-bcf7-4437-82c9-4767c8c50f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:29.975380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c5cff-bcf7-4437-82c9-4767c8c50f43 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:29.976080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c5cff-bcf7-4437-82c9-4767c8c50f43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:29.978138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c5cff-bcf7-4437-82c9-4767c8c50f43 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:29.996073 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3932/7878] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:29 2022] PUT /identity/v3/projects/645ae3da78364e50bd273b91c5ed4f61/users/b82fd80344054f30823522b13f936a0e/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:30.007950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45314846-e042-42c6-935b-1f4735de0324 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:30.010460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45314846-e042-42c6-935b-1f4735de0324 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:30.010460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45314846-e042-42c6-935b-1f4735de0324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:30.039859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-45314846-e042-42c6-935b-1f4735de0324 None None] MFA Rules not processed for user `b82fd80344054f30823522b13f936a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:30.041323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-45314846-e042-42c6-935b-1f4735de0324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:30.081786 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3947/7879] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:53:29 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:30.086005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c5cff-bcf7-4437-82c9-4767c8c50f43 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:30.096379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c5cff-bcf7-4437-82c9-4767c8c50f43 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:30.110772 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3933/7880] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:53:30.120959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45314846-e042-42c6-935b-1f4735de0324 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:30.122456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-45314846-e042-42c6-935b-1f4735de0324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:30.165470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5d4ae-c8a7-4760-8b24-75e8540644f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:30.166284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5d4ae-c8a7-4760-8b24-75e8540644f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:30.166963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5d4ae-c8a7-4760-8b24-75e8540644f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:30.167207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5d4ae-c8a7-4760-8b24-75e8540644f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:30.168285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5d4ae-c8a7-4760-8b24-75e8540644f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:30.170969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5d4ae-c8a7-4760-8b24-75e8540644f5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:30.185463 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3948/7881] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:53:30.186382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5d4ae-c8a7-4760-8b24-75e8540644f5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:30.187923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45314846-e042-42c6-935b-1f4735de0324 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:30.192322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7521b-bed4-43b0-81aa-7e835d1796c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:30.193122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7521b-bed4-43b0-81aa-7e835d1796c1 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:30.196000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7521b-bed4-43b0-81aa-7e835d1796c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:30.196000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7521b-bed4-43b0-81aa-7e835d1796c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:30.196402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5d4ae-c8a7-4760-8b24-75e8540644f5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:30.201139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e34f90-dbbd-4593-99f0-5b5fb56ad6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:30.201794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e34f90-dbbd-4593-99f0-5b5fb56ad6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:30.202080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e34f90-dbbd-4593-99f0-5b5fb56ad6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:30.202363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e34f90-dbbd-4593-99f0-5b5fb56ad6c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:30.202646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7521b-bed4-43b0-81aa-7e835d1796c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:30.203085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e34f90-dbbd-4593-99f0-5b5fb56ad6c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:30.204100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7521b-bed4-43b0-81aa-7e835d1796c1 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:30.204854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e34f90-dbbd-4593-99f0-5b5fb56ad6c0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:30.213369 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3934/7882] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:53:30.215017 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3949/7883] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:30.221593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7521b-bed4-43b0-81aa-7e835d1796c1 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:30.233580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7521b-bed4-43b0-81aa-7e835d1796c1 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:30.239020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b9813-74c2-414a-a16e-b23cf1aa7a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:30.239867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b9813-74c2-414a-a16e-b23cf1aa7a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:30.240145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b9813-74c2-414a-a16e-b23cf1aa7a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:30.240423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b9813-74c2-414a-a16e-b23cf1aa7a96 admin admin] PATH_INFO: `/v3/projects/043eea15ed83460d972d776c76125475/users/13159e7a8af841dbb05ade1f11dc458a/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:30.254810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b9813-74c2-414a-a16e-b23cf1aa7a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=043eea15ed83460d972d776c76125475, user_id=13159e7a8af841dbb05ade1f11dc458a, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:30.257537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b9813-74c2-414a-a16e-b23cf1aa7a96 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:30.327783 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3935/7884] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:30 2022] PUT /identity/v3/projects/043eea15ed83460d972d776c76125475/users/13159e7a8af841dbb05ade1f11dc458a/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:30.338036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212184fb-c2d7-4eb9-b6c8-95900c778af8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:30.338336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212184fb-c2d7-4eb9-b6c8-95900c778af8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:30.338688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212184fb-c2d7-4eb9-b6c8-95900c778af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:30.367045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-212184fb-c2d7-4eb9-b6c8-95900c778af8 None None] MFA Rules not processed for user `13159e7a8af841dbb05ade1f11dc458a`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:30.368407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-212184fb-c2d7-4eb9-b6c8-95900c778af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:30.435479 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3950/7885] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:30.447971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b9813-74c2-414a-a16e-b23cf1aa7a96 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:30.449697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0a7b9813-74c2-414a-a16e-b23cf1aa7a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:30.529443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b9813-74c2-414a-a16e-b23cf1aa7a96 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:30.535501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231af00-fab4-4cc5-8301-9e12d0c7e7ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:30.536138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231af00-fab4-4cc5-8301-9e12d0c7e7ba service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:30.536360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231af00-fab4-4cc5-8301-9e12d0c7e7ba service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:30.537301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231af00-fab4-4cc5-8301-9e12d0c7e7ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:30.546319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231af00-fab4-4cc5-8301-9e12d0c7e7ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:30.548027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231af00-fab4-4cc5-8301-9e12d0c7e7ba service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:30.558293 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3936/7886] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:53:30.757504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212184fb-c2d7-4eb9-b6c8-95900c778af8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:30.828279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212184fb-c2d7-4eb9-b6c8-95900c778af8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:30.833046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560af9d-6822-4f08-acd4-0b444353d5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:30.839310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560af9d-6822-4f08-acd4-0b444353d5f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:30.839310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560af9d-6822-4f08-acd4-0b444353d5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:30.839310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560af9d-6822-4f08-acd4-0b444353d5f5 admin admin] PATH_INFO: `/v3/users/13159e7a8af841dbb05ade1f11dc458a` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:30.839310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560af9d-6822-4f08-acd4-0b444353d5f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13159e7a8af841dbb05ade1f11dc458a)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:30.839310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560af9d-6822-4f08-acd4-0b444353d5f5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:31.061139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1560af9d-6822-4f08-acd4-0b444353d5f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13159e7a8af841dbb05ade1f11dc458a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:31.075054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1560af9d-6822-4f08-acd4-0b444353d5f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13159e7a8af841dbb05ade1f11dc458a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:31.076356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1560af9d-6822-4f08-acd4-0b444353d5f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13159e7a8af841dbb05ade1f11dc458a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:31.084811 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1560af9d-6822-4f08-acd4-0b444353d5f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13159e7a8af841dbb05ade1f11dc458a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:31.178893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1560af9d-6822-4f08-acd4-0b444353d5f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13159e7a8af841dbb05ade1f11dc458a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:31.186392 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3951/7887] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:30 2022] DELETE /identity/v3/users/13159e7a8af841dbb05ade1f11dc458a => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:31.190861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080de56c-a97e-475d-a4fb-03b3ab42e483 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:31.191461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080de56c-a97e-475d-a4fb-03b3ab42e483 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:31.191461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080de56c-a97e-475d-a4fb-03b3ab42e483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:31.214082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-080de56c-a97e-475d-a4fb-03b3ab42e483 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:31.215957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-080de56c-a97e-475d-a4fb-03b3ab42e483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:31.276657 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3937/7888] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:31.286454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560af9d-6822-4f08-acd4-0b444353d5f5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:31.291205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1560af9d-6822-4f08-acd4-0b444353d5f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:31.347132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560af9d-6822-4f08-acd4-0b444353d5f5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:31.351231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a8816-4b31-446c-b6cc-51af61b2e0c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:31.351427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a8816-4b31-446c-b6cc-51af61b2e0c4 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:31.351711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a8816-4b31-446c-b6cc-51af61b2e0c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:31.351992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a8816-4b31-446c-b6cc-51af61b2e0c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:31.362199 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a8816-4b31-446c-b6cc-51af61b2e0c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:31.363651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a8816-4b31-446c-b6cc-51af61b2e0c4 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:31.373863 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3952/7889] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:53:31.877524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080de56c-a97e-475d-a4fb-03b3ab42e483 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:31.879037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-080de56c-a97e-475d-a4fb-03b3ab42e483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:31.892084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080de56c-a97e-475d-a4fb-03b3ab42e483 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:31.896761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9339f-ad35-492e-8927-b931e09a9173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:31.897701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9339f-ad35-492e-8927-b931e09a9173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:31.897985 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9339f-ad35-492e-8927-b931e09a9173 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:31.898260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9339f-ad35-492e-8927-b931e09a9173 admin admin] PATH_INFO: `/v3/projects/043eea15ed83460d972d776c76125475` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:31.899473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9339f-ad35-492e-8927-b931e09a9173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=043eea15ed83460d972d776c76125475)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:31.901768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9339f-ad35-492e-8927-b931e09a9173 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:32.045360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b4f9339f-ad35-492e-8927-b931e09a9173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '043eea15ed83460d972d776c76125475', 'request_id': 'req-b4f9339f-ad35-492e-8927-b931e09a9173'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:32.052289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b4f9339f-ad35-492e-8927-b931e09a9173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '043eea15ed83460d972d776c76125475', 'request_id': 'req-b4f9339f-ad35-492e-8927-b931e09a9173'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:32.104827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b4f9339f-ad35-492e-8927-b931e09a9173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '043eea15ed83460d972d776c76125475', 'request_id': 'req-b4f9339f-ad35-492e-8927-b931e09a9173'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:32.116409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b4f9339f-ad35-492e-8927-b931e09a9173 admin admin] The token cache is being invalidate because project 043eea15ed83460d972d776c76125475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:32.116742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b4f9339f-ad35-492e-8927-b931e09a9173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:32.117600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b4f9339f-ad35-492e-8927-b931e09a9173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:32.119223 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3938/7890] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:31 2022] DELETE /identity/v3/projects/043eea15ed83460d972d776c76125475 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:32.125962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fdf45-283f-4b11-89e2-eca411f8b7b5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:32.126441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fdf45-283f-4b11-89e2-eca411f8b7b5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:32.126550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fdf45-283f-4b11-89e2-eca411f8b7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:32.146457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fe0fdf45-283f-4b11-89e2-eca411f8b7b5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:32.147926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fe0fdf45-283f-4b11-89e2-eca411f8b7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:32.218489 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3953/7891] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:32.226504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5810e8-1210-476b-b7b6-86bd7602e31a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:32.226796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5810e8-1210-476b-b7b6-86bd7602e31a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:32.227461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5810e8-1210-476b-b7b6-86bd7602e31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:32.254257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6e5810e8-1210-476b-b7b6-86bd7602e31a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:32.256139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6e5810e8-1210-476b-b7b6-86bd7602e31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:32.271780 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3939/7892] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:32.275611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fdf45-283f-4b11-89e2-eca411f8b7b5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:32.287920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fdf45-283f-4b11-89e2-eca411f8b7b5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:32.296406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa55e04-9413-4f0c-a9fb-d078e7eb6c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:32.297470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa55e04-9413-4f0c-a9fb-d078e7eb6c40 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:32.297928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa55e04-9413-4f0c-a9fb-d078e7eb6c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:32.298520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa55e04-9413-4f0c-a9fb-d078e7eb6c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:32.299424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa55e04-9413-4f0c-a9fb-d078e7eb6c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:53:32.299915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa55e04-9413-4f0c-a9fb-d078e7eb6c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:32.302446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa55e04-9413-4f0c-a9fb-d078e7eb6c40 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:32.316706 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3954/7893] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:32.321291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5810e8-1210-476b-b7b6-86bd7602e31a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:32.333686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5810e8-1210-476b-b7b6-86bd7602e31a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:32.338823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c890225-2a99-4554-9a05-1724dba64e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:32.339552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c890225-2a99-4554-9a05-1724dba64e56 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:32.339888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c890225-2a99-4554-9a05-1724dba64e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:32.340172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c890225-2a99-4554-9a05-1724dba64e56 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:32.340912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c890225-2a99-4554-9a05-1724dba64e56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:32.343104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c890225-2a99-4554-9a05-1724dba64e56 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:32.457405 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3940/7894] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:32 2022] POST /identity/v3/projects => generated 401 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:32.461339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa55e04-9413-4f0c-a9fb-d078e7eb6c40 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:32.476957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa55e04-9413-4f0c-a9fb-d078e7eb6c40 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:32.561989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c9ca5-626d-48b1-9f79-09e8e8e7b764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:32.562770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c9ca5-626d-48b1-9f79-09e8e8e7b764 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:32.563142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c9ca5-626d-48b1-9f79-09e8e8e7b764 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:32.563488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c9ca5-626d-48b1-9f79-09e8e8e7b764 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:32.564309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c9ca5-626d-48b1-9f79-09e8e8e7b764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:32.566582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c9ca5-626d-48b1-9f79-09e8e8e7b764 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:32.671354 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3955/7895] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:53:32 2022] POST /identity/v3/users => generated 301 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:32.674673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c890225-2a99-4554-9a05-1724dba64e56 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:32.688868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c890225-2a99-4554-9a05-1724dba64e56 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:32.695238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a6545-ad3c-47dc-9984-f9d626108360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:32.696132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a6545-ad3c-47dc-9984-f9d626108360 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:32.696653 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a6545-ad3c-47dc-9984-f9d626108360 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:32.696980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a6545-ad3c-47dc-9984-f9d626108360 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:32.697975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a6545-ad3c-47dc-9984-f9d626108360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:32.699929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a6545-ad3c-47dc-9984-f9d626108360 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:32.712360 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3941/7896] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:32.716479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c9ca5-626d-48b1-9f79-09e8e8e7b764 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:32.728529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c9ca5-626d-48b1-9f79-09e8e8e7b764 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:32.734322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4b462-90e1-4dea-989c-39a51910faf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:32.735073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4b462-90e1-4dea-989c-39a51910faf8 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:32.735358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4b462-90e1-4dea-989c-39a51910faf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:32.735806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4b462-90e1-4dea-989c-39a51910faf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:32.736533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4b462-90e1-4dea-989c-39a51910faf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:32.738328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4b462-90e1-4dea-989c-39a51910faf8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:32.750766 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3956/7897] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:32.754952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a6545-ad3c-47dc-9984-f9d626108360 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:32.769074 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a6545-ad3c-47dc-9984-f9d626108360 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:32.774491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4b81e-af52-402f-a212-1586648f1fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:32.775441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4b81e-af52-402f-a212-1586648f1fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:32.775731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4b81e-af52-402f-a212-1586648f1fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:32.776195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4b81e-af52-402f-a212-1586648f1fe5 admin admin] PATH_INFO: `/v3/projects/bd576e9a04624e3499fcadc484e23e2e/users/e8d7e5f9f13745c982e53af2808be312/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:32.796269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4b81e-af52-402f-a212-1586648f1fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd576e9a04624e3499fcadc484e23e2e, user_id=e8d7e5f9f13745c982e53af2808be312, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:32.799102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4b81e-af52-402f-a212-1586648f1fe5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:32.894261 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3942/7898] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:32 2022] PUT /identity/v3/projects/bd576e9a04624e3499fcadc484e23e2e/users/e8d7e5f9f13745c982e53af2808be312/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:32.905893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccf4b5-ab05-4f1f-ac9a-2b3cfa153d16 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:32.906184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccf4b5-ab05-4f1f-ac9a-2b3cfa153d16 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:32.906468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccf4b5-ab05-4f1f-ac9a-2b3cfa153d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:32.934739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b8ccf4b5-ab05-4f1f-ac9a-2b3cfa153d16 None None] MFA Rules not processed for user `e8d7e5f9f13745c982e53af2808be312`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:32.937063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b8ccf4b5-ab05-4f1f-ac9a-2b3cfa153d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:33.017579 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3957/7899] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:33.021477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4b81e-af52-402f-a212-1586648f1fe5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:33.116006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4b81e-af52-402f-a212-1586648f1fe5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:33.121065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867b22c-299a-4c8d-8749-01843f18597e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:33.121750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867b22c-299a-4c8d-8749-01843f18597e admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:33.122088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867b22c-299a-4c8d-8749-01843f18597e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:33.122542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867b22c-299a-4c8d-8749-01843f18597e admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:33.123264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867b22c-299a-4c8d-8749-01843f18597e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:33.125839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867b22c-299a-4c8d-8749-01843f18597e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:33.340360 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3943/7900] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:33 2022] POST /identity/v3/projects => generated 403 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:33.344572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccf4b5-ab05-4f1f-ac9a-2b3cfa153d16 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:33.356194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccf4b5-ab05-4f1f-ac9a-2b3cfa153d16 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:33.432407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca67133-dd60-4820-beab-c0c903ef64dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:33.433271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca67133-dd60-4820-beab-c0c903ef64dc admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:33.433635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca67133-dd60-4820-beab-c0c903ef64dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:33.434067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca67133-dd60-4820-beab-c0c903ef64dc admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:33.436002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca67133-dd60-4820-beab-c0c903ef64dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:33.438158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca67133-dd60-4820-beab-c0c903ef64dc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:33.538286 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3958/7901] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:53:33 2022] POST /identity/v3/users => generated 308 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:33.542058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867b22c-299a-4c8d-8749-01843f18597e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:33.555442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867b22c-299a-4c8d-8749-01843f18597e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:33.561242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f23a0-3993-4fe2-813f-484a65b4ea48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:33.562177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f23a0-3993-4fe2-813f-484a65b4ea48 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:33.562630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f23a0-3993-4fe2-813f-484a65b4ea48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:33.563070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f23a0-3993-4fe2-813f-484a65b4ea48 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:33.563956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f23a0-3993-4fe2-813f-484a65b4ea48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:33.565972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f23a0-3993-4fe2-813f-484a65b4ea48 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:33.578874 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3944/7902] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:53:33.583298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca67133-dd60-4820-beab-c0c903ef64dc admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:33.605196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca67133-dd60-4820-beab-c0c903ef64dc admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:33.619987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ff90b-6dc0-48fe-9f6d-0dc8146e8699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:33.619987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ff90b-6dc0-48fe-9f6d-0dc8146e8699 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:33.619987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ff90b-6dc0-48fe-9f6d-0dc8146e8699 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:33.619987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ff90b-6dc0-48fe-9f6d-0dc8146e8699 admin admin] PATH_INFO: `/v3/projects/a91e5378d28f4531b70e7a97ddfa017d/users/051da3f2d5324441a762492662cb2d6c/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:33.638179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ff90b-6dc0-48fe-9f6d-0dc8146e8699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91e5378d28f4531b70e7a97ddfa017d, user_id=051da3f2d5324441a762492662cb2d6c, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:33.641232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ff90b-6dc0-48fe-9f6d-0dc8146e8699 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:33.746772 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3959/7903] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:33 2022] PUT /identity/v3/projects/a91e5378d28f4531b70e7a97ddfa017d/users/051da3f2d5324441a762492662cb2d6c/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:33.746862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f23a0-3993-4fe2-813f-484a65b4ea48 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:33.761297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f23a0-3993-4fe2-813f-484a65b4ea48 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:33.841775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d4eac-6612-40bb-bba8-287818bc403c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:33.842458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d4eac-6612-40bb-bba8-287818bc403c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:33.842750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d4eac-6612-40bb-bba8-287818bc403c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:33.843034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d4eac-6612-40bb-bba8-287818bc403c admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:33.843765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d4eac-6612-40bb-bba8-287818bc403c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:33.845747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d4eac-6612-40bb-bba8-287818bc403c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:33.856375 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3945/7904] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:33.861225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ff90b-6dc0-48fe-9f6d-0dc8146e8699 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:33.873301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ff90b-6dc0-48fe-9f6d-0dc8146e8699 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:33.878380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7d0d4-f7ce-4e91-8b30-bd15256cf250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:33.879448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7d0d4-f7ce-4e91-8b30-bd15256cf250 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:33.879593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7d0d4-f7ce-4e91-8b30-bd15256cf250 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:33.879938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7d0d4-f7ce-4e91-8b30-bd15256cf250 admin admin] PATH_INFO: `/v3/projects/a91e5378d28f4531b70e7a97ddfa017d/users/051da3f2d5324441a762492662cb2d6c/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:33.882126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7d0d4-f7ce-4e91-8b30-bd15256cf250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91e5378d28f4531b70e7a97ddfa017d, user_id=051da3f2d5324441a762492662cb2d6c, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:33.885564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7d0d4-f7ce-4e91-8b30-bd15256cf250 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:33.898679 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3960/7905] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:33 2022] PUT /identity/v3/projects/a91e5378d28f4531b70e7a97ddfa017d/users/051da3f2d5324441a762492662cb2d6c/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:33.908963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6a306-9e39-45b2-8036-eb00a7ef772b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:33.909546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6a306-9e39-45b2-8036-eb00a7ef772b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:33.909546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6a306-9e39-45b2-8036-eb00a7ef772b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:33.939279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3cf6a306-9e39-45b2-8036-eb00a7ef772b None None] MFA Rules not processed for user `051da3f2d5324441a762492662cb2d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:33.940668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3cf6a306-9e39-45b2-8036-eb00a7ef772b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:34.025313 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3946/7906] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:33 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:34.031085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7d0d4-f7ce-4e91-8b30-bd15256cf250 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:34.056173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7d0d4-f7ce-4e91-8b30-bd15256cf250 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:34.064810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a6bc8-868c-4fee-82f9-9da46a345a06 tempest-ApplicationCredentialsV3AdminTest-1366957728 tempest-ApplicationCredentialsV3AdminTest-1366957728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051da3f2d5324441a762492662cb2d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a91e5378d28f4531b70e7a97ddfa017d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:34.065728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a6bc8-868c-4fee-82f9-9da46a345a06 tempest-ApplicationCredentialsV3AdminTest-1366957728 tempest-ApplicationCredentialsV3AdminTest-1366957728-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:34.066330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a6bc8-868c-4fee-82f9-9da46a345a06 tempest-ApplicationCredentialsV3AdminTest-1366957728 tempest-ApplicationCredentialsV3AdminTest-1366957728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:34.066754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a6bc8-868c-4fee-82f9-9da46a345a06 tempest-ApplicationCredentialsV3AdminTest-1366957728 tempest-ApplicationCredentialsV3AdminTest-1366957728-project-admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:34.067882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a6bc8-868c-4fee-82f9-9da46a345a06 tempest-ApplicationCredentialsV3AdminTest-1366957728 tempest-ApplicationCredentialsV3AdminTest-1366957728-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:34.070732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a6bc8-868c-4fee-82f9-9da46a345a06 tempest-ApplicationCredentialsV3AdminTest-1366957728 tempest-ApplicationCredentialsV3AdminTest-1366957728-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:34.164881 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3961/7907] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:53:34 2022] POST /identity/v3/roles => generated 240 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:34.169194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6a306-9e39-45b2-8036-eb00a7ef772b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:34.180193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6a306-9e39-45b2-8036-eb00a7ef772b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:34.185331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806f8b0-2513-43cc-b234-7ddf764e5002 tempest-ApplicationCredentialsV3AdminTest-1366957728 tempest-ApplicationCredentialsV3AdminTest-1366957728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051da3f2d5324441a762492662cb2d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a91e5378d28f4531b70e7a97ddfa017d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:34.186247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806f8b0-2513-43cc-b234-7ddf764e5002 tempest-ApplicationCredentialsV3AdminTest-1366957728 tempest-ApplicationCredentialsV3AdminTest-1366957728-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:34.186535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806f8b0-2513-43cc-b234-7ddf764e5002 tempest-ApplicationCredentialsV3AdminTest-1366957728 tempest-ApplicationCredentialsV3AdminTest-1366957728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:34.186825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806f8b0-2513-43cc-b234-7ddf764e5002 tempest-ApplicationCredentialsV3AdminTest-1366957728 tempest-ApplicationCredentialsV3AdminTest-1366957728-project-admin] PATH_INFO: `/v3/projects/bd576e9a04624e3499fcadc484e23e2e/users/e8d7e5f9f13745c982e53af2808be312/roles/93373956404946d29bc64b36ca1e36d9` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:34.189443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806f8b0-2513-43cc-b234-7ddf764e5002 tempest-ApplicationCredentialsV3AdminTest-1366957728 tempest-ApplicationCredentialsV3AdminTest-1366957728-project-admin] RBAC: Authorizing `identity:create_grant(project_id=bd576e9a04624e3499fcadc484e23e2e, user_id=e8d7e5f9f13745c982e53af2808be312, role_id=93373956404946d29bc64b36ca1e36d9)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:34.192148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806f8b0-2513-43cc-b234-7ddf764e5002 tempest-ApplicationCredentialsV3AdminTest-1366957728 tempest-ApplicationCredentialsV3AdminTest-1366957728-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:34.265551 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3947/7908] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:34 2022] PUT /identity/v3/projects/bd576e9a04624e3499fcadc484e23e2e/users/e8d7e5f9f13745c982e53af2808be312/roles/93373956404946d29bc64b36ca1e36d9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:34.269740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a6bc8-868c-4fee-82f9-9da46a345a06 tempest-ApplicationCredentialsV3AdminTest-1366957728 tempest-ApplicationCredentialsV3AdminTest-1366957728-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:34.352880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a6bc8-868c-4fee-82f9-9da46a345a06 tempest-ApplicationCredentialsV3AdminTest-1366957728 tempest-ApplicationCredentialsV3AdminTest-1366957728-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:34.412553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537df1b7-b49c-4d58-9f59-921591c0b6cb tempest-ApplicationCredentialsV3AdminTest-414895602 tempest-ApplicationCredentialsV3AdminTest-414895602-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8d7e5f9f13745c982e53af2808be312', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd576e9a04624e3499fcadc484e23e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-1339577302'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:34.413589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537df1b7-b49c-4d58-9f59-921591c0b6cb tempest-ApplicationCredentialsV3AdminTest-414895602 tempest-ApplicationCredentialsV3AdminTest-414895602-project] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:34.413887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537df1b7-b49c-4d58-9f59-921591c0b6cb tempest-ApplicationCredentialsV3AdminTest-414895602 tempest-ApplicationCredentialsV3AdminTest-414895602-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:34.418878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537df1b7-b49c-4d58-9f59-921591c0b6cb tempest-ApplicationCredentialsV3AdminTest-414895602 tempest-ApplicationCredentialsV3AdminTest-414895602-project] PATH_INFO: `/v3/users/e8d7e5f9f13745c982e53af2808be312/application_credentials` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:34.418878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537df1b7-b49c-4d58-9f59-921591c0b6cb tempest-ApplicationCredentialsV3AdminTest-414895602 tempest-ApplicationCredentialsV3AdminTest-414895602-project] RBAC: Authorizing `identity:create_application_credential(user_id=e8d7e5f9f13745c982e53af2808be312)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:34.418878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537df1b7-b49c-4d58-9f59-921591c0b6cb tempest-ApplicationCredentialsV3AdminTest-414895602 tempest-ApplicationCredentialsV3AdminTest-414895602-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:34.569501 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3962/7909] 10.222.0.16 () {60 vars in 1314 bytes} [Mon May 2 10:53:34 2022] POST /identity/v3/users/e8d7e5f9f13745c982e53af2808be312/application_credentials => generated 659 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:34.573862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7810b5c-f413-44c0-b0e1-354cd7d18d4d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:34.574365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7810b5c-f413-44c0-b0e1-354cd7d18d4d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:34.574655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7810b5c-f413-44c0-b0e1-354cd7d18d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:34.596235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f7810b5c-f413-44c0-b0e1-354cd7d18d4d None None] MFA Rules not processed for user `e8d7e5f9f13745c982e53af2808be312`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:34.597507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f7810b5c-f413-44c0-b0e1-354cd7d18d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:34.703863 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3948/7910] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:34 2022] POST /identity/v3/auth/tokens => generated 3384 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) May 02 10:53:34.708271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537df1b7-b49c-4d58-9f59-921591c0b6cb tempest-ApplicationCredentialsV3AdminTest-414895602 tempest-ApplicationCredentialsV3AdminTest-414895602-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:34.720229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537df1b7-b49c-4d58-9f59-921591c0b6cb tempest-ApplicationCredentialsV3AdminTest-414895602 tempest-ApplicationCredentialsV3AdminTest-414895602-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:34.725366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d95f14-32bf-4586-abc9-80a073bbb868 tempest-ApplicationCredentialsV3AdminTest-414895602 tempest-ApplicationCredentialsV3AdminTest-414895602-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8d7e5f9f13745c982e53af2808be312', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd576e9a04624e3499fcadc484e23e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-1339577302'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:34.726533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d95f14-32bf-4586-abc9-80a073bbb868 tempest-ApplicationCredentialsV3AdminTest-414895602 tempest-ApplicationCredentialsV3AdminTest-414895602-project] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:34.726890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d95f14-32bf-4586-abc9-80a073bbb868 tempest-ApplicationCredentialsV3AdminTest-414895602 tempest-ApplicationCredentialsV3AdminTest-414895602-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:34.727241 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d95f14-32bf-4586-abc9-80a073bbb868 tempest-ApplicationCredentialsV3AdminTest-414895602 tempest-ApplicationCredentialsV3AdminTest-414895602-project] PATH_INFO: `/v3/users/e8d7e5f9f13745c982e53af2808be312/application_credentials/e72d68a390554cde8f0bfa8e9a46e820` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:34.728958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d95f14-32bf-4586-abc9-80a073bbb868 tempest-ApplicationCredentialsV3AdminTest-414895602 tempest-ApplicationCredentialsV3AdminTest-414895602-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e8d7e5f9f13745c982e53af2808be312, application_credential_id=e72d68a390554cde8f0bfa8e9a46e820)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:34.730562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d95f14-32bf-4586-abc9-80a073bbb868 tempest-ApplicationCredentialsV3AdminTest-414895602 tempest-ApplicationCredentialsV3AdminTest-414895602-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:34.833215 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3963/7911] 10.222.0.16 () {58 vars in 1394 bytes} [Mon May 2 10:53:34 2022] DELETE /identity/v3/users/e8d7e5f9f13745c982e53af2808be312/application_credentials/e72d68a390554cde8f0bfa8e9a46e820 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:34.837525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7810b5c-f413-44c0-b0e1-354cd7d18d4d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:34.909059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7810b5c-f413-44c0-b0e1-354cd7d18d4d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:34.914076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78ae11-a34f-4415-a5d4-18ac48c53125 tempest-ApplicationCredentialsV3AdminTest-1366957728 tempest-ApplicationCredentialsV3AdminTest-1366957728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051da3f2d5324441a762492662cb2d6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a91e5378d28f4531b70e7a97ddfa017d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:34.915031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78ae11-a34f-4415-a5d4-18ac48c53125 tempest-ApplicationCredentialsV3AdminTest-1366957728 tempest-ApplicationCredentialsV3AdminTest-1366957728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:34.915327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78ae11-a34f-4415-a5d4-18ac48c53125 tempest-ApplicationCredentialsV3AdminTest-1366957728 tempest-ApplicationCredentialsV3AdminTest-1366957728-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:34.915609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78ae11-a34f-4415-a5d4-18ac48c53125 tempest-ApplicationCredentialsV3AdminTest-1366957728 tempest-ApplicationCredentialsV3AdminTest-1366957728-project-admin] PATH_INFO: `/v3/roles/93373956404946d29bc64b36ca1e36d9` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:34.917308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78ae11-a34f-4415-a5d4-18ac48c53125 tempest-ApplicationCredentialsV3AdminTest-1366957728 tempest-ApplicationCredentialsV3AdminTest-1366957728-project-admin] RBAC: Authorizing `identity:delete_role(role_id=93373956404946d29bc64b36ca1e36d9)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:34.919005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78ae11-a34f-4415-a5d4-18ac48c53125 tempest-ApplicationCredentialsV3AdminTest-1366957728 tempest-ApplicationCredentialsV3AdminTest-1366957728-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:35.143832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0b78ae11-a34f-4415-a5d4-18ac48c53125 tempest-ApplicationCredentialsV3AdminTest-1366957728 tempest-ApplicationCredentialsV3AdminTest-1366957728-project-admin] Invalidating the token cache because role 93373956404946d29bc64b36ca1e36d9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:35.144119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0b78ae11-a34f-4415-a5d4-18ac48c53125 tempest-ApplicationCredentialsV3AdminTest-1366957728 tempest-ApplicationCredentialsV3AdminTest-1366957728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:35.144915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-0b78ae11-a34f-4415-a5d4-18ac48c53125 tempest-ApplicationCredentialsV3AdminTest-1366957728 tempest-ApplicationCredentialsV3AdminTest-1366957728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:35.146958 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3949/7912] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:34 2022] DELETE /identity/v3/roles/93373956404946d29bc64b36ca1e36d9 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:35.152224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d95f14-32bf-4586-abc9-80a073bbb868 tempest-ApplicationCredentialsV3AdminTest-414895602 tempest-ApplicationCredentialsV3AdminTest-414895602-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:35.154307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d4d95f14-32bf-4586-abc9-80a073bbb868 tempest-ApplicationCredentialsV3AdminTest-414895602 tempest-ApplicationCredentialsV3AdminTest-414895602-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:35.224965 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d95f14-32bf-4586-abc9-80a073bbb868 tempest-ApplicationCredentialsV3AdminTest-414895602 tempest-ApplicationCredentialsV3AdminTest-414895602-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:35.292340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f225d-a1d4-4809-9351-864b7c222317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:35.293265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f225d-a1d4-4809-9351-864b7c222317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:35.293546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f225d-a1d4-4809-9351-864b7c222317 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:35.293830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f225d-a1d4-4809-9351-864b7c222317 admin admin] PATH_INFO: `/v3/users/e8d7e5f9f13745c982e53af2808be312` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:35.295815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f225d-a1d4-4809-9351-864b7c222317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8d7e5f9f13745c982e53af2808be312)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:35.297865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f225d-a1d4-4809-9351-864b7c222317 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:35.467916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1c0f225d-a1d4-4809-9351-864b7c222317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8d7e5f9f13745c982e53af2808be312'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:35.484152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1c0f225d-a1d4-4809-9351-864b7c222317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8d7e5f9f13745c982e53af2808be312'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:35.485091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1c0f225d-a1d4-4809-9351-864b7c222317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8d7e5f9f13745c982e53af2808be312'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:35.492871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1c0f225d-a1d4-4809-9351-864b7c222317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8d7e5f9f13745c982e53af2808be312'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:35.556006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1c0f225d-a1d4-4809-9351-864b7c222317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8d7e5f9f13745c982e53af2808be312'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:35.563039 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3964/7913] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:35 2022] DELETE /identity/v3/users/e8d7e5f9f13745c982e53af2808be312 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:35.567714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d7c93-5ed5-467e-ae6f-4a736c73fd4b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:35.568050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d7c93-5ed5-467e-ae6f-4a736c73fd4b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:35.568390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d7c93-5ed5-467e-ae6f-4a736c73fd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:35.587829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b12d7c93-5ed5-467e-ae6f-4a736c73fd4b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:35.589185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b12d7c93-5ed5-467e-ae6f-4a736c73fd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:35.648369 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3950/7914] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:35.658796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f225d-a1d4-4809-9351-864b7c222317 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:35.660586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1c0f225d-a1d4-4809-9351-864b7c222317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:35.736789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f225d-a1d4-4809-9351-864b7c222317 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:35.741461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671613c3-b60e-46ed-8400-4ff09759b0f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:35.742958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671613c3-b60e-46ed-8400-4ff09759b0f9 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:35.744139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671613c3-b60e-46ed-8400-4ff09759b0f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:35.745067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671613c3-b60e-46ed-8400-4ff09759b0f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:35.760780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671613c3-b60e-46ed-8400-4ff09759b0f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:35.762606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671613c3-b60e-46ed-8400-4ff09759b0f9 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:35.774975 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3965/7915] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:53:36.226403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d7c93-5ed5-467e-ae6f-4a736c73fd4b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:36.227935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b12d7c93-5ed5-467e-ae6f-4a736c73fd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:36.241665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d7c93-5ed5-467e-ae6f-4a736c73fd4b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:36.246630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0799a41-50d1-4850-b68f-e6313520bcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:36.247556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0799a41-50d1-4850-b68f-e6313520bcb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:36.247839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0799a41-50d1-4850-b68f-e6313520bcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:36.248120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0799a41-50d1-4850-b68f-e6313520bcb7 admin admin] PATH_INFO: `/v3/projects/bd576e9a04624e3499fcadc484e23e2e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:36.255539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0799a41-50d1-4850-b68f-e6313520bcb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd576e9a04624e3499fcadc484e23e2e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:36.257522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0799a41-50d1-4850-b68f-e6313520bcb7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:36.381808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c0799a41-50d1-4850-b68f-e6313520bcb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd576e9a04624e3499fcadc484e23e2e', 'request_id': 'req-c0799a41-50d1-4850-b68f-e6313520bcb7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:36.389501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c0799a41-50d1-4850-b68f-e6313520bcb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd576e9a04624e3499fcadc484e23e2e', 'request_id': 'req-c0799a41-50d1-4850-b68f-e6313520bcb7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:36.465094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c0799a41-50d1-4850-b68f-e6313520bcb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd576e9a04624e3499fcadc484e23e2e', 'request_id': 'req-c0799a41-50d1-4850-b68f-e6313520bcb7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:36.477352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c0799a41-50d1-4850-b68f-e6313520bcb7 admin admin] The token cache is being invalidate because project bd576e9a04624e3499fcadc484e23e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:36.477663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c0799a41-50d1-4850-b68f-e6313520bcb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:36.478321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c0799a41-50d1-4850-b68f-e6313520bcb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:36.479888 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3951/7916] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:36 2022] DELETE /identity/v3/projects/bd576e9a04624e3499fcadc484e23e2e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:36.484201 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671613c3-b60e-46ed-8400-4ff09759b0f9 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:36.494145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671613c3-b60e-46ed-8400-4ff09759b0f9 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:36.548388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ed3f5-d663-468f-8948-2ae418410c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:36.549303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ed3f5-d663-468f-8948-2ae418410c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:36.549592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ed3f5-d663-468f-8948-2ae418410c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:36.549985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ed3f5-d663-468f-8948-2ae418410c58 admin admin] PATH_INFO: `/v3/users/051da3f2d5324441a762492662cb2d6c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:36.551140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ed3f5-d663-468f-8948-2ae418410c58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=051da3f2d5324441a762492662cb2d6c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:36.553113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ed3f5-d663-468f-8948-2ae418410c58 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:36.694914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-810ed3f5-d663-468f-8948-2ae418410c58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '051da3f2d5324441a762492662cb2d6c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:36.707275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-810ed3f5-d663-468f-8948-2ae418410c58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '051da3f2d5324441a762492662cb2d6c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:36.708079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-810ed3f5-d663-468f-8948-2ae418410c58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '051da3f2d5324441a762492662cb2d6c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:36.715209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-810ed3f5-d663-468f-8948-2ae418410c58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '051da3f2d5324441a762492662cb2d6c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:36.784809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-810ed3f5-d663-468f-8948-2ae418410c58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '051da3f2d5324441a762492662cb2d6c'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:36.791937 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3966/7917] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:36 2022] DELETE /identity/v3/users/051da3f2d5324441a762492662cb2d6c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:37.233665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0799a41-50d1-4850-b68f-e6313520bcb7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:37.235284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c0799a41-50d1-4850-b68f-e6313520bcb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:37.249317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0799a41-50d1-4850-b68f-e6313520bcb7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:37.316983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa10c71-614c-4427-995b-7500dc7f3fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:37.318205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa10c71-614c-4427-995b-7500dc7f3fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:37.318492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa10c71-614c-4427-995b-7500dc7f3fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:37.318771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa10c71-614c-4427-995b-7500dc7f3fa4 admin admin] PATH_INFO: `/v3/projects/a91e5378d28f4531b70e7a97ddfa017d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:37.320038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa10c71-614c-4427-995b-7500dc7f3fa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a91e5378d28f4531b70e7a97ddfa017d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:37.322027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa10c71-614c-4427-995b-7500dc7f3fa4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:37.419006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-afa10c71-614c-4427-995b-7500dc7f3fa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a91e5378d28f4531b70e7a97ddfa017d', 'request_id': 'req-afa10c71-614c-4427-995b-7500dc7f3fa4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:37.425276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-afa10c71-614c-4427-995b-7500dc7f3fa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a91e5378d28f4531b70e7a97ddfa017d', 'request_id': 'req-afa10c71-614c-4427-995b-7500dc7f3fa4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:37.505646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-afa10c71-614c-4427-995b-7500dc7f3fa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a91e5378d28f4531b70e7a97ddfa017d', 'request_id': 'req-afa10c71-614c-4427-995b-7500dc7f3fa4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:37.519455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-afa10c71-614c-4427-995b-7500dc7f3fa4 admin admin] The token cache is being invalidate because project a91e5378d28f4531b70e7a97ddfa017d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:37.521993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-afa10c71-614c-4427-995b-7500dc7f3fa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:37.522702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-afa10c71-614c-4427-995b-7500dc7f3fa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:37.524354 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3952/7918] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:37 2022] DELETE /identity/v3/projects/a91e5378d28f4531b70e7a97ddfa017d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:37.530203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff05151-907b-4774-a43c-0df895960495 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:37.530673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff05151-907b-4774-a43c-0df895960495 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:37.541099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff05151-907b-4774-a43c-0df895960495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:37.551926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-fff05151-907b-4774-a43c-0df895960495 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:37.553215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fff05151-907b-4774-a43c-0df895960495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:37.627855 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3967/7919] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:37.636024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237e573-a750-4d69-9c25-7018ec421732 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:37.636320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237e573-a750-4d69-9c25-7018ec421732 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:37.636667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237e573-a750-4d69-9c25-7018ec421732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:37.666093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f237e573-a750-4d69-9c25-7018ec421732 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:37.667551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f237e573-a750-4d69-9c25-7018ec421732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:37.680410 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3953/7920] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:53:37.682027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff05151-907b-4774-a43c-0df895960495 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:37.694001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff05151-907b-4774-a43c-0df895960495 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:37.699817 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2aa9d-39fe-49ee-b7d2-ec0c09bd2fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:37.701078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2aa9d-39fe-49ee-b7d2-ec0c09bd2fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:37.701457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2aa9d-39fe-49ee-b7d2-ec0c09bd2fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:37.701988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2aa9d-39fe-49ee-b7d2-ec0c09bd2fc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:37.703233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2aa9d-39fe-49ee-b7d2-ec0c09bd2fc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:53:37.703233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2aa9d-39fe-49ee-b7d2-ec0c09bd2fc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:37.705038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2aa9d-39fe-49ee-b7d2-ec0c09bd2fc0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:37.722778 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3968/7921] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:37.723927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237e573-a750-4d69-9c25-7018ec421732 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:37.742152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237e573-a750-4d69-9c25-7018ec421732 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:37.750038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2a9bf-d7e7-4a3b-a2f8-64b8a1fbff50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:37.750656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2a9bf-d7e7-4a3b-a2f8-64b8a1fbff50 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:37.750926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2a9bf-d7e7-4a3b-a2f8-64b8a1fbff50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:37.751257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2a9bf-d7e7-4a3b-a2f8-64b8a1fbff50 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:37.751959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2a9bf-d7e7-4a3b-a2f8-64b8a1fbff50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:37.755157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2a9bf-d7e7-4a3b-a2f8-64b8a1fbff50 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:37.844133 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3954/7922] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:37 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:37.848691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2aa9d-39fe-49ee-b7d2-ec0c09bd2fc0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:37.858606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2aa9d-39fe-49ee-b7d2-ec0c09bd2fc0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:37.917844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46230b6-4e5d-4ce6-a660-00bc971e4fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:37.918521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46230b6-4e5d-4ce6-a660-00bc971e4fce admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:37.918810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46230b6-4e5d-4ce6-a660-00bc971e4fce admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:37.919640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46230b6-4e5d-4ce6-a660-00bc971e4fce admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:37.920336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46230b6-4e5d-4ce6-a660-00bc971e4fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:37.922293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46230b6-4e5d-4ce6-a660-00bc971e4fce admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:38.065842 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3969/7923] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:53:37 2022] POST /identity/v3/users => generated 294 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:38.073671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2a9bf-d7e7-4a3b-a2f8-64b8a1fbff50 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:38.085541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2a9bf-d7e7-4a3b-a2f8-64b8a1fbff50 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:38.091371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832547e7-08a5-4e26-ae66-b0dd699d9bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:38.095557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832547e7-08a5-4e26-ae66-b0dd699d9bbf admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:38.095557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832547e7-08a5-4e26-ae66-b0dd699d9bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:38.095557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832547e7-08a5-4e26-ae66-b0dd699d9bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:38.095557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832547e7-08a5-4e26-ae66-b0dd699d9bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:38.097448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832547e7-08a5-4e26-ae66-b0dd699d9bbf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:38.117178 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3955/7924] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:38.121345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46230b6-4e5d-4ce6-a660-00bc971e4fce admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:38.133123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46230b6-4e5d-4ce6-a660-00bc971e4fce admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:38.138533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d44fc-0f39-4683-9307-78ea6210e8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:38.139224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d44fc-0f39-4683-9307-78ea6210e8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:38.139510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d44fc-0f39-4683-9307-78ea6210e8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:38.139786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d44fc-0f39-4683-9307-78ea6210e8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:38.140518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d44fc-0f39-4683-9307-78ea6210e8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:38.142184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d44fc-0f39-4683-9307-78ea6210e8b4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:38.156342 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3970/7925] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:38.157625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832547e7-08a5-4e26-ae66-b0dd699d9bbf admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:38.170900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832547e7-08a5-4e26-ae66-b0dd699d9bbf admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:38.176144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045e6a5-4591-40b1-afda-5d14ac60bfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:38.177186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045e6a5-4591-40b1-afda-5d14ac60bfbf admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:38.177477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045e6a5-4591-40b1-afda-5d14ac60bfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:38.177795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045e6a5-4591-40b1-afda-5d14ac60bfbf admin admin] PATH_INFO: `/v3/projects/f01655620d224e8f9598238e181b462a/users/6f2491efb1154d0fb9d0b6b2dfe17093/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:38.194068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045e6a5-4591-40b1-afda-5d14ac60bfbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f01655620d224e8f9598238e181b462a, user_id=6f2491efb1154d0fb9d0b6b2dfe17093, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:38.196906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045e6a5-4591-40b1-afda-5d14ac60bfbf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:38.276316 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3956/7926] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:38 2022] PUT /identity/v3/projects/f01655620d224e8f9598238e181b462a/users/6f2491efb1154d0fb9d0b6b2dfe17093/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:38.286708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0676b-0d94-4a1c-b4fc-2de063e6c766 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:38.286997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0676b-0d94-4a1c-b4fc-2de063e6c766 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:38.287304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0676b-0d94-4a1c-b4fc-2de063e6c766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:38.314526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3ab0676b-0d94-4a1c-b4fc-2de063e6c766 None None] MFA Rules not processed for user `6f2491efb1154d0fb9d0b6b2dfe17093`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:38.315752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3ab0676b-0d94-4a1c-b4fc-2de063e6c766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:38.384074 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3971/7927] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:38.389233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045e6a5-4591-40b1-afda-5d14ac60bfbf admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:38.452981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045e6a5-4591-40b1-afda-5d14ac60bfbf admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:38.457671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfcf25-5369-4697-b8ca-567060459084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:38.458336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfcf25-5369-4697-b8ca-567060459084 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:38.458617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfcf25-5369-4697-b8ca-567060459084 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:38.458891 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfcf25-5369-4697-b8ca-567060459084 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:38.459581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfcf25-5369-4697-b8ca-567060459084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:38.461529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfcf25-5369-4697-b8ca-567060459084 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:38.574782 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3957/7928] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:38 2022] POST /identity/v3/projects => generated 387 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:38.579016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0676b-0d94-4a1c-b4fc-2de063e6c766 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:38.589597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0676b-0d94-4a1c-b4fc-2de063e6c766 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:38.647763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855314f-ad80-444e-8bd5-b20479163752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:38.648445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855314f-ad80-444e-8bd5-b20479163752 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:38.648763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855314f-ad80-444e-8bd5-b20479163752 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:38.649045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855314f-ad80-444e-8bd5-b20479163752 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:38.649748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855314f-ad80-444e-8bd5-b20479163752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:38.651768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855314f-ad80-444e-8bd5-b20479163752 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:38.733846 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3972/7929] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:53:38 2022] POST /identity/v3/users => generated 300 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:38.742995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfcf25-5369-4697-b8ca-567060459084 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:38.753954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfcf25-5369-4697-b8ca-567060459084 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:38.759063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e43e1c-502a-4eab-935a-c1057e9331c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:38.759746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e43e1c-502a-4eab-935a-c1057e9331c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:38.760087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e43e1c-502a-4eab-935a-c1057e9331c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:38.772078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e43e1c-502a-4eab-935a-c1057e9331c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:38.772078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e43e1c-502a-4eab-935a-c1057e9331c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:38.772078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e43e1c-502a-4eab-935a-c1057e9331c8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:38.780725 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3958/7930] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:53:38.782031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855314f-ad80-444e-8bd5-b20479163752 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:38.795110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855314f-ad80-444e-8bd5-b20479163752 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:38.798072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957d108-3387-41a8-9505-b94ec29302e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:38.799152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957d108-3387-41a8-9505-b94ec29302e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:38.799240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957d108-3387-41a8-9505-b94ec29302e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:38.799536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957d108-3387-41a8-9505-b94ec29302e8 admin admin] PATH_INFO: `/v3/projects/a22731b4d3b24a73ac7d7fadb21374aa/users/a2485f1d4f194eac97566e40536526ab/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:38.822125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957d108-3387-41a8-9505-b94ec29302e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22731b4d3b24a73ac7d7fadb21374aa, user_id=a2485f1d4f194eac97566e40536526ab, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:38.826189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957d108-3387-41a8-9505-b94ec29302e8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:38.916505 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3973/7931] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:38 2022] PUT /identity/v3/projects/a22731b4d3b24a73ac7d7fadb21374aa/users/a2485f1d4f194eac97566e40536526ab/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:38.920640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e43e1c-502a-4eab-935a-c1057e9331c8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:38.931197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e43e1c-502a-4eab-935a-c1057e9331c8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:38.993273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44163c9-011d-47c4-b611-19196bfc1e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:38.996167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44163c9-011d-47c4-b611-19196bfc1e19 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:38.996167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44163c9-011d-47c4-b611-19196bfc1e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:38.996167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44163c9-011d-47c4-b611-19196bfc1e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:38.996167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44163c9-011d-47c4-b611-19196bfc1e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:38.997172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44163c9-011d-47c4-b611-19196bfc1e19 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:39.010153 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3959/7932] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:39.014701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957d108-3387-41a8-9505-b94ec29302e8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:39.025689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957d108-3387-41a8-9505-b94ec29302e8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:39.032641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a5d6e-b303-4e53-9d50-ae907dd39768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:39.033962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a5d6e-b303-4e53-9d50-ae907dd39768 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:39.035609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a5d6e-b303-4e53-9d50-ae907dd39768 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:39.035609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a5d6e-b303-4e53-9d50-ae907dd39768 admin admin] PATH_INFO: `/v3/projects/a22731b4d3b24a73ac7d7fadb21374aa/users/a2485f1d4f194eac97566e40536526ab/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:39.037034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a5d6e-b303-4e53-9d50-ae907dd39768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22731b4d3b24a73ac7d7fadb21374aa, user_id=a2485f1d4f194eac97566e40536526ab, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:39.049674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a5d6e-b303-4e53-9d50-ae907dd39768 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:39.073891 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3974/7933] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:39 2022] PUT /identity/v3/projects/a22731b4d3b24a73ac7d7fadb21374aa/users/a2485f1d4f194eac97566e40536526ab/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:39.076220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e2c6f-322a-4b14-b6ca-f9b959cfe616 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:39.076515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e2c6f-322a-4b14-b6ca-f9b959cfe616 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:39.077404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e2c6f-322a-4b14-b6ca-f9b959cfe616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:39.116503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-381e2c6f-322a-4b14-b6ca-f9b959cfe616 None None] MFA Rules not processed for user `a2485f1d4f194eac97566e40536526ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:39.117836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-381e2c6f-322a-4b14-b6ca-f9b959cfe616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:39.187640 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3960/7934] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:53:39.192459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a5d6e-b303-4e53-9d50-ae907dd39768 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:39.203986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a5d6e-b303-4e53-9d50-ae907dd39768 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:39.208720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3762b4c-94ab-4f65-b333-d92060ef27a5 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2485f1d4f194eac97566e40536526ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a22731b4d3b24a73ac7d7fadb21374aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:39.209380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3762b4c-94ab-4f65-b333-d92060ef27a5 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:39.209665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3762b4c-94ab-4f65-b333-d92060ef27a5 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:39.210405 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3762b4c-94ab-4f65-b333-d92060ef27a5 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:39.210670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3762b4c-94ab-4f65-b333-d92060ef27a5 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:39.212252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3762b4c-94ab-4f65-b333-d92060ef27a5 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:39.272824 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3975/7935] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:39 2022] POST /identity/v3/services => generated 289 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:39.277336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e2c6f-322a-4b14-b6ca-f9b959cfe616 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:39.287306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e2c6f-322a-4b14-b6ca-f9b959cfe616 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:39.301849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebc370-9633-42c0-a39a-0b9057fcbc00 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2485f1d4f194eac97566e40536526ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a22731b4d3b24a73ac7d7fadb21374aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:39.302470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebc370-9633-42c0-a39a-0b9057fcbc00 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:39.302764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebc370-9633-42c0-a39a-0b9057fcbc00 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:39.303047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebc370-9633-42c0-a39a-0b9057fcbc00 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:39.303789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebc370-9633-42c0-a39a-0b9057fcbc00 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:39.305474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebc370-9633-42c0-a39a-0b9057fcbc00 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:39.312102 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-ddebc370-9633-42c0-a39a-0b9057fcbc00 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' May 02 10:53:39.312102 ncdv-master-1 devstack@keystone.service[91119]: Failed validating 'type' in schema['properties']['enabled']: May 02 10:53:39.312102 ncdv-master-1 devstack@keystone.service[91119]: {'enum': [True, False, None], 'type': 'boolean'} May 02 10:53:39.312102 ncdv-master-1 devstack@keystone.service[91119]: On instance['enabled']: May 02 10:53:39.312102 ncdv-master-1 devstack@keystone.service[91119]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' May 02 10:53:39.312102 ncdv-master-1 devstack@keystone.service[91119]: Failed validating 'type' in schema['properties']['enabled']: May 02 10:53:39.312102 ncdv-master-1 devstack@keystone.service[91119]: {'enum': [True, False, None], 'type': 'boolean'} May 02 10:53:39.312102 ncdv-master-1 devstack@keystone.service[91119]: On instance['enabled']: May 02 10:53:39.312102 ncdv-master-1 devstack@keystone.service[91119]: 'False' May 02 10:53:39.312102 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:53:39.312102 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 02 10:53:39.312102 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 02 10:53:39.312102 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 02 10:53:39.312102 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise error May 02 10:53:39.312102 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' May 02 10:53:39.312102 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:53:39.312102 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 02 10:53:39.312102 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 02 10:53:39.312102 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:53:39.312102 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application On instance['enabled']: May 02 10:53:39.312102 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application 'False' May 02 10:53:39.312102 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:53:39.312102 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:53:39.313848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:53:39.313848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:53:39.313848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:53:39.313848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:53:39.313848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:53:39.313848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:53:39.313848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:53:39.313848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:53:39.313848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:53:39.313848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:53:39.313848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:53:39.313848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:53:39.313848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post May 02 10:53:39.313848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) May 02 10:53:39.313848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 02 10:53:39.313848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 02 10:53:39.313848 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 02 10:53:39.314896 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 02 10:53:39.314896 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' May 02 10:53:39.314896 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:53:39.314896 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 02 10:53:39.314896 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 02 10:53:39.314896 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:53:39.314896 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application On instance['enabled']: May 02 10:53:39.314896 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application 'False' May 02 10:53:39.314896 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:53:39.317466 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3961/7936] 10.222.0.16 () {60 vars in 1155 bytes} [Mon May 2 10:53:39 2022] POST /identity/v3/endpoints => generated 283 bytes in 41 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 02 10:53:39.318656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3762b4c-94ab-4f65-b333-d92060ef27a5 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:39.333471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3762b4c-94ab-4f65-b333-d92060ef27a5 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:39.338398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86529c-fe4f-4ccf-b369-7015fe6a8707 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2485f1d4f194eac97566e40536526ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a22731b4d3b24a73ac7d7fadb21374aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:39.339053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86529c-fe4f-4ccf-b369-7015fe6a8707 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:39.339341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86529c-fe4f-4ccf-b369-7015fe6a8707 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:39.339623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86529c-fe4f-4ccf-b369-7015fe6a8707 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:39.340420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86529c-fe4f-4ccf-b369-7015fe6a8707 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:39.342080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86529c-fe4f-4ccf-b369-7015fe6a8707 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:39.347985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-ef86529c-fe4f-4ccf-b369-7015fe6a8707 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' May 02 10:53:39.347985 ncdv-master-1 devstack@keystone.service[91118]: Failed validating 'type' in schema['properties']['enabled']: May 02 10:53:39.347985 ncdv-master-1 devstack@keystone.service[91118]: {'enum': [True, False, None], 'type': 'boolean'} May 02 10:53:39.347985 ncdv-master-1 devstack@keystone.service[91118]: On instance['enabled']: May 02 10:53:39.347985 ncdv-master-1 devstack@keystone.service[91118]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' May 02 10:53:39.347985 ncdv-master-1 devstack@keystone.service[91118]: Failed validating 'type' in schema['properties']['enabled']: May 02 10:53:39.347985 ncdv-master-1 devstack@keystone.service[91118]: {'enum': [True, False, None], 'type': 'boolean'} May 02 10:53:39.347985 ncdv-master-1 devstack@keystone.service[91118]: On instance['enabled']: May 02 10:53:39.347985 ncdv-master-1 devstack@keystone.service[91118]: 'True' May 02 10:53:39.347985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:53:39.347985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 02 10:53:39.347985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 02 10:53:39.347985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 02 10:53:39.347985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise error May 02 10:53:39.347985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' May 02 10:53:39.347985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:53:39.347985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 02 10:53:39.347985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 02 10:53:39.347985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:53:39.347985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application On instance['enabled']: May 02 10:53:39.347985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application 'True' May 02 10:53:39.347985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:53:39.347985 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:53:39.353183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:53:39.353183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:53:39.353183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:53:39.353183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:53:39.353183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:53:39.353183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:53:39.353183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:53:39.353183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:53:39.353183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:53:39.353183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:53:39.353183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:53:39.353183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:53:39.353183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post May 02 10:53:39.353183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) May 02 10:53:39.353183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 02 10:53:39.353183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 02 10:53:39.353183 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 02 10:53:39.354067 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 02 10:53:39.354067 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' May 02 10:53:39.354067 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:53:39.354067 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 02 10:53:39.354067 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 02 10:53:39.354067 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:53:39.354067 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application On instance['enabled']: May 02 10:53:39.354067 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application 'True' May 02 10:53:39.354067 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:53:39.354067 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3976/7937] 10.222.0.16 () {60 vars in 1155 bytes} [Mon May 2 10:53:39 2022] POST /identity/v3/endpoints => generated 281 bytes in 31 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 02 10:53:39.355943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebc370-9633-42c0-a39a-0b9057fcbc00 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:39.366218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebc370-9633-42c0-a39a-0b9057fcbc00 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:39.371504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2469f98-3a85-436f-94ef-d8030e4166b0 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2485f1d4f194eac97566e40536526ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a22731b4d3b24a73ac7d7fadb21374aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:39.372164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2469f98-3a85-436f-94ef-d8030e4166b0 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:39.373006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2469f98-3a85-436f-94ef-d8030e4166b0 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:39.373290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2469f98-3a85-436f-94ef-d8030e4166b0 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:39.374205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2469f98-3a85-436f-94ef-d8030e4166b0 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:39.375844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2469f98-3a85-436f-94ef-d8030e4166b0 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:39.446896 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-c2469f98-3a85-436f-94ef-d8030e4166b0 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1219051033. To ensure interoperability, identifiers should be a valid uuid. May 02 10:53:39.446896 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 02 10:53:39.446896 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:53:39.525094 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3962/7938] 10.222.0.16 () {60 vars in 1155 bytes} [Mon May 2 10:53:39 2022] POST /identity/v3/endpoints => generated 361 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:39.529361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86529c-fe4f-4ccf-b369-7015fe6a8707 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:39.539625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86529c-fe4f-4ccf-b369-7015fe6a8707 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:39.556709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4eea9-8c50-4204-bce3-73fb61db3c70 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2485f1d4f194eac97566e40536526ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a22731b4d3b24a73ac7d7fadb21374aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:39.557508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4eea9-8c50-4204-bce3-73fb61db3c70 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:39.557797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4eea9-8c50-4204-bce3-73fb61db3c70 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:39.558074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4eea9-8c50-4204-bce3-73fb61db3c70 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] PATH_INFO: `/v3/regions/tempest-region-1219051033` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:39.558731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4eea9-8c50-4204-bce3-73fb61db3c70 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1219051033)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:39.560413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4eea9-8c50-4204-bce3-73fb61db3c70 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:39.562582 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3977/7939] 10.222.0.16 () {58 vars in 1205 bytes} [Mon May 2 10:53:39 2022] GET /identity/v3/regions/tempest-region-1219051033 => generated 180 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:39.566811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2469f98-3a85-436f-94ef-d8030e4166b0 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:39.581794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2469f98-3a85-436f-94ef-d8030e4166b0 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:39.586758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68edbb6-923e-4bfd-a67e-984f35ac8095 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2485f1d4f194eac97566e40536526ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a22731b4d3b24a73ac7d7fadb21374aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:39.587712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68edbb6-923e-4bfd-a67e-984f35ac8095 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:39.587934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68edbb6-923e-4bfd-a67e-984f35ac8095 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:39.588210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68edbb6-923e-4bfd-a67e-984f35ac8095 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] PATH_INFO: `/v3/endpoints/5b9f285eb98f4ec9a1a0fcb64bdc4ac3` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:39.597519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68edbb6-923e-4bfd-a67e-984f35ac8095 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=5b9f285eb98f4ec9a1a0fcb64bdc4ac3)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:39.598647 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-a68edbb6-923e-4bfd-a67e-984f35ac8095 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:53:39.598647 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:53:39.598647 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:53:39.599622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68edbb6-923e-4bfd-a67e-984f35ac8095 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:39.611512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-a68edbb6-923e-4bfd-a67e-984f35ac8095 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' May 02 10:53:39.611512 ncdv-master-1 devstack@keystone.service[91119]: Failed validating 'type' in schema['properties']['enabled']: May 02 10:53:39.611512 ncdv-master-1 devstack@keystone.service[91119]: {'enum': [True, False, None], 'type': 'boolean'} May 02 10:53:39.611512 ncdv-master-1 devstack@keystone.service[91119]: On instance['enabled']: May 02 10:53:39.611512 ncdv-master-1 devstack@keystone.service[91119]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' May 02 10:53:39.611512 ncdv-master-1 devstack@keystone.service[91119]: Failed validating 'type' in schema['properties']['enabled']: May 02 10:53:39.611512 ncdv-master-1 devstack@keystone.service[91119]: {'enum': [True, False, None], 'type': 'boolean'} May 02 10:53:39.611512 ncdv-master-1 devstack@keystone.service[91119]: On instance['enabled']: May 02 10:53:39.611512 ncdv-master-1 devstack@keystone.service[91119]: 'False' May 02 10:53:39.611512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:53:39.611512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 02 10:53:39.611512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 02 10:53:39.611512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 02 10:53:39.611512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise error May 02 10:53:39.611512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' May 02 10:53:39.611512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:53:39.611512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 02 10:53:39.611512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 02 10:53:39.611512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:53:39.611512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application On instance['enabled']: May 02 10:53:39.611512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application 'False' May 02 10:53:39.611512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:53:39.611512 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:53:39.612960 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:53:39.612960 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:53:39.612960 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:53:39.612960 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:53:39.612960 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:53:39.612960 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:53:39.612960 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:53:39.612960 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:53:39.612960 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:53:39.612960 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:53:39.612960 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:53:39.612960 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:53:39.612960 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch May 02 10:53:39.612960 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) May 02 10:53:39.612960 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 02 10:53:39.612960 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 02 10:53:39.612960 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 02 10:53:39.613834 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 02 10:53:39.613834 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' May 02 10:53:39.613834 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:53:39.613834 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 02 10:53:39.613834 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 02 10:53:39.613834 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:53:39.613834 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application On instance['enabled']: May 02 10:53:39.613834 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application 'False' May 02 10:53:39.613834 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:53:39.613834 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3963/7940] 10.222.0.16 () {60 vars in 1254 bytes} [Mon May 2 10:53:39 2022] PATCH /identity/v3/endpoints/5b9f285eb98f4ec9a1a0fcb64bdc4ac3 => generated 283 bytes in 47 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 02 10:53:39.617982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4eea9-8c50-4204-bce3-73fb61db3c70 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:39.630685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4eea9-8c50-4204-bce3-73fb61db3c70 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:39.639659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb90e3-0ce4-4883-8003-093a9b0308ee tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2485f1d4f194eac97566e40536526ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a22731b4d3b24a73ac7d7fadb21374aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:39.639659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb90e3-0ce4-4883-8003-093a9b0308ee tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:39.639659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb90e3-0ce4-4883-8003-093a9b0308ee tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:39.639949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb90e3-0ce4-4883-8003-093a9b0308ee tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] PATH_INFO: `/v3/endpoints/5b9f285eb98f4ec9a1a0fcb64bdc4ac3` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:39.639949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb90e3-0ce4-4883-8003-093a9b0308ee tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=5b9f285eb98f4ec9a1a0fcb64bdc4ac3)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:39.641123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb90e3-0ce4-4883-8003-093a9b0308ee tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:39.726697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-9efb90e3-0ce4-4883-8003-093a9b0308ee tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '5b9f285eb98f4ec9a1a0fcb64bdc4ac3', 'request_id': 'req-9efb90e3-0ce4-4883-8003-093a9b0308ee'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:39.739009 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3978/7941] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 2 10:53:39 2022] DELETE /identity/v3/endpoints/5b9f285eb98f4ec9a1a0fcb64bdc4ac3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:39.742827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68edbb6-923e-4bfd-a67e-984f35ac8095 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:39.756168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68edbb6-923e-4bfd-a67e-984f35ac8095 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:39.769834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35457927-f6eb-4ab0-99cb-6018c6dad41e tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2485f1d4f194eac97566e40536526ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a22731b4d3b24a73ac7d7fadb21374aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:39.770609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35457927-f6eb-4ab0-99cb-6018c6dad41e tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:39.770894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35457927-f6eb-4ab0-99cb-6018c6dad41e tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:39.771582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35457927-f6eb-4ab0-99cb-6018c6dad41e tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] PATH_INFO: `/v3/regions/tempest-region-1219051033` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:39.772410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35457927-f6eb-4ab0-99cb-6018c6dad41e tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1219051033)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:39.774066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35457927-f6eb-4ab0-99cb-6018c6dad41e tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:39.855187 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3964/7942] 10.222.0.16 () {58 vars in 1208 bytes} [Mon May 2 10:53:39 2022] DELETE /identity/v3/regions/tempest-region-1219051033 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:39.861208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb90e3-0ce4-4883-8003-093a9b0308ee tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:39.871761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb90e3-0ce4-4883-8003-093a9b0308ee tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:39.886576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e6f56-519d-4e8e-be0f-e4805ba50db3 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2485f1d4f194eac97566e40536526ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a22731b4d3b24a73ac7d7fadb21374aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:39.887585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e6f56-519d-4e8e-be0f-e4805ba50db3 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:39.887901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e6f56-519d-4e8e-be0f-e4805ba50db3 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:39.888182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e6f56-519d-4e8e-be0f-e4805ba50db3 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:39.888992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e6f56-519d-4e8e-be0f-e4805ba50db3 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:39.890762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e6f56-519d-4e8e-be0f-e4805ba50db3 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:39.955379 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-691e6f56-519d-4e8e-be0f-e4805ba50db3 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2064230941. To ensure interoperability, identifiers should be a valid uuid. May 02 10:53:39.955379 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 02 10:53:39.955379 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:53:40.048349 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3979/7943] 10.222.0.16 () {60 vars in 1155 bytes} [Mon May 2 10:53:39 2022] POST /identity/v3/endpoints => generated 360 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:40.052202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35457927-f6eb-4ab0-99cb-6018c6dad41e tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:40.066178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35457927-f6eb-4ab0-99cb-6018c6dad41e tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:40.090079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac573ff1-b780-42d7-95d4-4927d31aa1e9 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2485f1d4f194eac97566e40536526ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a22731b4d3b24a73ac7d7fadb21374aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:40.091145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac573ff1-b780-42d7-95d4-4927d31aa1e9 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:40.091552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac573ff1-b780-42d7-95d4-4927d31aa1e9 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:40.092703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac573ff1-b780-42d7-95d4-4927d31aa1e9 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] PATH_INFO: `/v3/regions/tempest-region-2064230941` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:40.093435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac573ff1-b780-42d7-95d4-4927d31aa1e9 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2064230941)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:40.094511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac573ff1-b780-42d7-95d4-4927d31aa1e9 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:40.110524 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3965/7944] 10.222.0.16 () {58 vars in 1205 bytes} [Mon May 2 10:53:40 2022] GET /identity/v3/regions/tempest-region-2064230941 => generated 180 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:53:40.113086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e6f56-519d-4e8e-be0f-e4805ba50db3 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:40.130371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e6f56-519d-4e8e-be0f-e4805ba50db3 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:40.143389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48e151-e28e-4c96-8a7d-4d0b51d2569a tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2485f1d4f194eac97566e40536526ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a22731b4d3b24a73ac7d7fadb21374aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:40.147961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48e151-e28e-4c96-8a7d-4d0b51d2569a tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:40.147961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48e151-e28e-4c96-8a7d-4d0b51d2569a tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:40.147961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48e151-e28e-4c96-8a7d-4d0b51d2569a tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] PATH_INFO: `/v3/endpoints/0d6cd4ee77c6467b907f8f287c775ff8` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:40.152296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48e151-e28e-4c96-8a7d-4d0b51d2569a tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=0d6cd4ee77c6467b907f8f287c775ff8)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:40.154306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48e151-e28e-4c96-8a7d-4d0b51d2569a tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:40.170932 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-fe48e151-e28e-4c96-8a7d-4d0b51d2569a tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' May 02 10:53:40.170932 ncdv-master-1 devstack@keystone.service[91118]: Failed validating 'type' in schema['properties']['enabled']: May 02 10:53:40.170932 ncdv-master-1 devstack@keystone.service[91118]: {'enum': [True, False, None], 'type': 'boolean'} May 02 10:53:40.170932 ncdv-master-1 devstack@keystone.service[91118]: On instance['enabled']: May 02 10:53:40.170932 ncdv-master-1 devstack@keystone.service[91118]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' May 02 10:53:40.170932 ncdv-master-1 devstack@keystone.service[91118]: Failed validating 'type' in schema['properties']['enabled']: May 02 10:53:40.170932 ncdv-master-1 devstack@keystone.service[91118]: {'enum': [True, False, None], 'type': 'boolean'} May 02 10:53:40.170932 ncdv-master-1 devstack@keystone.service[91118]: On instance['enabled']: May 02 10:53:40.170932 ncdv-master-1 devstack@keystone.service[91118]: 'True' May 02 10:53:40.170932 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:53:40.170932 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 02 10:53:40.170932 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 02 10:53:40.170932 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 02 10:53:40.170932 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise error May 02 10:53:40.170932 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' May 02 10:53:40.170932 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:53:40.170932 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 02 10:53:40.170932 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 02 10:53:40.170932 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:53:40.170932 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application On instance['enabled']: May 02 10:53:40.170932 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application 'True' May 02 10:53:40.170932 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:53:40.170932 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:53:40.176920 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:53:40.176920 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:53:40.176920 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:53:40.176920 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:53:40.176920 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:53:40.176920 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:53:40.176920 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:53:40.176920 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:53:40.176920 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:53:40.176920 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:53:40.176920 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:53:40.176920 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:53:40.176920 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch May 02 10:53:40.176920 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) May 02 10:53:40.176920 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 02 10:53:40.176920 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 02 10:53:40.176920 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 02 10:53:40.178014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 02 10:53:40.178014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' May 02 10:53:40.178014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:53:40.178014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 02 10:53:40.178014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 02 10:53:40.178014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:53:40.178014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application On instance['enabled']: May 02 10:53:40.178014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application 'True' May 02 10:53:40.178014 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:53:40.178014 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3980/7945] 10.222.0.16 () {60 vars in 1254 bytes} [Mon May 2 10:53:40 2022] PATCH /identity/v3/endpoints/0d6cd4ee77c6467b907f8f287c775ff8 => generated 281 bytes in 60 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) May 02 10:53:40.179070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac573ff1-b780-42d7-95d4-4927d31aa1e9 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:40.190886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac573ff1-b780-42d7-95d4-4927d31aa1e9 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:40.196043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe8149-9963-40d6-a5b3-66dce5bf1419 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2485f1d4f194eac97566e40536526ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a22731b4d3b24a73ac7d7fadb21374aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:40.196931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe8149-9963-40d6-a5b3-66dce5bf1419 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:40.199453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe8149-9963-40d6-a5b3-66dce5bf1419 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:40.199453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe8149-9963-40d6-a5b3-66dce5bf1419 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] PATH_INFO: `/v3/endpoints/0d6cd4ee77c6467b907f8f287c775ff8` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:40.199453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe8149-9963-40d6-a5b3-66dce5bf1419 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=0d6cd4ee77c6467b907f8f287c775ff8)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:40.200417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe8149-9963-40d6-a5b3-66dce5bf1419 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:40.286774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-9cbe8149-9963-40d6-a5b3-66dce5bf1419 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '0d6cd4ee77c6467b907f8f287c775ff8', 'request_id': 'req-9cbe8149-9963-40d6-a5b3-66dce5bf1419'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:40.298325 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3966/7946] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 2 10:53:40 2022] DELETE /identity/v3/endpoints/0d6cd4ee77c6467b907f8f287c775ff8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:40.302464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48e151-e28e-4c96-8a7d-4d0b51d2569a tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:40.315322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48e151-e28e-4c96-8a7d-4d0b51d2569a tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:40.329961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ecae1-9d6e-4eee-8103-e624039b6e27 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2485f1d4f194eac97566e40536526ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a22731b4d3b24a73ac7d7fadb21374aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:40.330801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ecae1-9d6e-4eee-8103-e624039b6e27 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:40.331141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ecae1-9d6e-4eee-8103-e624039b6e27 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:40.331368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ecae1-9d6e-4eee-8103-e624039b6e27 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] PATH_INFO: `/v3/regions/tempest-region-2064230941` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:40.336500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ecae1-9d6e-4eee-8103-e624039b6e27 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2064230941)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:40.336500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ecae1-9d6e-4eee-8103-e624039b6e27 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:40.420240 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3981/7947] 10.222.0.16 () {58 vars in 1208 bytes} [Mon May 2 10:53:40 2022] DELETE /identity/v3/regions/tempest-region-2064230941 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:40.425034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe8149-9963-40d6-a5b3-66dce5bf1419 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:40.436162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe8149-9963-40d6-a5b3-66dce5bf1419 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:40.450618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806739ee-97ca-4465-bee3-b891b18862b1 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2485f1d4f194eac97566e40536526ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a22731b4d3b24a73ac7d7fadb21374aa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:40.451493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806739ee-97ca-4465-bee3-b891b18862b1 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:40.451782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806739ee-97ca-4465-bee3-b891b18862b1 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:40.452067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806739ee-97ca-4465-bee3-b891b18862b1 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] PATH_INFO: `/v3/services/06076d2b650c433a88e4c3fbb7348d0d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:40.452773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806739ee-97ca-4465-bee3-b891b18862b1 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorizing `identity:delete_service(service_id=06076d2b650c433a88e4c3fbb7348d0d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:40.454413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806739ee-97ca-4465-bee3-b891b18862b1 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:40.520401 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3967/7948] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:40 2022] DELETE /identity/v3/services/06076d2b650c433a88e4c3fbb7348d0d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:40.521684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ecae1-9d6e-4eee-8103-e624039b6e27 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:40.610096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ecae1-9d6e-4eee-8103-e624039b6e27 tempest-EndpointsNegativeTestJSON-1910286073 tempest-EndpointsNegativeTestJSON-1910286073-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:40.627609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12d4d4-9d31-4265-92ab-89341093171f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:40.629286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12d4d4-9d31-4265-92ab-89341093171f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:40.629744 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12d4d4-9d31-4265-92ab-89341093171f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:40.630034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12d4d4-9d31-4265-92ab-89341093171f admin admin] PATH_INFO: `/v3/users/6f2491efb1154d0fb9d0b6b2dfe17093` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:40.633500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12d4d4-9d31-4265-92ab-89341093171f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f2491efb1154d0fb9d0b6b2dfe17093)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:40.635975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12d4d4-9d31-4265-92ab-89341093171f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:40.844173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-de12d4d4-9d31-4265-92ab-89341093171f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f2491efb1154d0fb9d0b6b2dfe17093'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:40.855606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-de12d4d4-9d31-4265-92ab-89341093171f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f2491efb1154d0fb9d0b6b2dfe17093'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:40.856377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-de12d4d4-9d31-4265-92ab-89341093171f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f2491efb1154d0fb9d0b6b2dfe17093'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:40.866222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-de12d4d4-9d31-4265-92ab-89341093171f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f2491efb1154d0fb9d0b6b2dfe17093'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:40.938753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-de12d4d4-9d31-4265-92ab-89341093171f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f2491efb1154d0fb9d0b6b2dfe17093'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:40.945216 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3982/7949] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:40 2022] DELETE /identity/v3/users/6f2491efb1154d0fb9d0b6b2dfe17093 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:40.949720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb176aa-5a89-4a6f-a20d-3b149db44d8c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:40.949993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb176aa-5a89-4a6f-a20d-3b149db44d8c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:40.950277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb176aa-5a89-4a6f-a20d-3b149db44d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:40.971246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ddb176aa-5a89-4a6f-a20d-3b149db44d8c None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:40.972487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ddb176aa-5a89-4a6f-a20d-3b149db44d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:41.034120 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3968/7950] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:41.043471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12d4d4-9d31-4265-92ab-89341093171f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:41.045075 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-de12d4d4-9d31-4265-92ab-89341093171f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:41.117020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12d4d4-9d31-4265-92ab-89341093171f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:41.120791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66e940-9747-4e6b-b158-38c42fff6b76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:41.121457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66e940-9747-4e6b-b158-38c42fff6b76 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:41.121754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66e940-9747-4e6b-b158-38c42fff6b76 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:41.122034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66e940-9747-4e6b-b158-38c42fff6b76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:41.133708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66e940-9747-4e6b-b158-38c42fff6b76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:41.135168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66e940-9747-4e6b-b158-38c42fff6b76 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:41.154240 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3983/7951] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:53:41.715984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb176aa-5a89-4a6f-a20d-3b149db44d8c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:41.717620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ddb176aa-5a89-4a6f-a20d-3b149db44d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:41.748030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb176aa-5a89-4a6f-a20d-3b149db44d8c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:41.759901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a05401-9e61-40e3-9903-f2c2b4589bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:41.759901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a05401-9e61-40e3-9903-f2c2b4589bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:41.759901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a05401-9e61-40e3-9903-f2c2b4589bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:41.760289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a05401-9e61-40e3-9903-f2c2b4589bd4 admin admin] PATH_INFO: `/v3/projects/f01655620d224e8f9598238e181b462a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:41.761878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a05401-9e61-40e3-9903-f2c2b4589bd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f01655620d224e8f9598238e181b462a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:41.764364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a05401-9e61-40e3-9903-f2c2b4589bd4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:41.903495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f0a05401-9e61-40e3-9903-f2c2b4589bd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f01655620d224e8f9598238e181b462a', 'request_id': 'req-f0a05401-9e61-40e3-9903-f2c2b4589bd4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:41.915812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f0a05401-9e61-40e3-9903-f2c2b4589bd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f01655620d224e8f9598238e181b462a', 'request_id': 'req-f0a05401-9e61-40e3-9903-f2c2b4589bd4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:41.967639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f0a05401-9e61-40e3-9903-f2c2b4589bd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f01655620d224e8f9598238e181b462a', 'request_id': 'req-f0a05401-9e61-40e3-9903-f2c2b4589bd4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:41.978399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f0a05401-9e61-40e3-9903-f2c2b4589bd4 admin admin] The token cache is being invalidate because project f01655620d224e8f9598238e181b462a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:41.978689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f0a05401-9e61-40e3-9903-f2c2b4589bd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:41.979325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f0a05401-9e61-40e3-9903-f2c2b4589bd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:41.980926 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3969/7952] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:41 2022] DELETE /identity/v3/projects/f01655620d224e8f9598238e181b462a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:41.985599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66e940-9747-4e6b-b158-38c42fff6b76 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:42.000043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66e940-9747-4e6b-b158-38c42fff6b76 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:42.052286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc745d-9eed-4b7a-8fa5-f8a44a394957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:42.053187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc745d-9eed-4b7a-8fa5-f8a44a394957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:42.053466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc745d-9eed-4b7a-8fa5-f8a44a394957 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:42.053740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc745d-9eed-4b7a-8fa5-f8a44a394957 admin admin] PATH_INFO: `/v3/users/a2485f1d4f194eac97566e40536526ab` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:42.054916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc745d-9eed-4b7a-8fa5-f8a44a394957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2485f1d4f194eac97566e40536526ab)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:42.056847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc745d-9eed-4b7a-8fa5-f8a44a394957 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:42.250543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-95cc745d-9eed-4b7a-8fa5-f8a44a394957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2485f1d4f194eac97566e40536526ab'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:42.265175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-95cc745d-9eed-4b7a-8fa5-f8a44a394957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2485f1d4f194eac97566e40536526ab'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:42.265936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-95cc745d-9eed-4b7a-8fa5-f8a44a394957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2485f1d4f194eac97566e40536526ab'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:42.274171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-95cc745d-9eed-4b7a-8fa5-f8a44a394957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2485f1d4f194eac97566e40536526ab'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:42.332888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-95cc745d-9eed-4b7a-8fa5-f8a44a394957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2485f1d4f194eac97566e40536526ab'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:42.344538 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3984/7953] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:41 2022] DELETE /identity/v3/users/a2485f1d4f194eac97566e40536526ab => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:42.745933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a05401-9e61-40e3-9903-f2c2b4589bd4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:42.747562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f0a05401-9e61-40e3-9903-f2c2b4589bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:42.762580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a05401-9e61-40e3-9903-f2c2b4589bd4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:42.821962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af41ba-25dd-49bc-aca1-cb1928ff7a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:42.823177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af41ba-25dd-49bc-aca1-cb1928ff7a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:42.823476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af41ba-25dd-49bc-aca1-cb1928ff7a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:42.823764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af41ba-25dd-49bc-aca1-cb1928ff7a61 admin admin] PATH_INFO: `/v3/projects/a22731b4d3b24a73ac7d7fadb21374aa` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:42.825049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af41ba-25dd-49bc-aca1-cb1928ff7a61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22731b4d3b24a73ac7d7fadb21374aa)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:42.827701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af41ba-25dd-49bc-aca1-cb1928ff7a61 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:42.874579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc745d-9eed-4b7a-8fa5-f8a44a394957 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:42.876277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-95cc745d-9eed-4b7a-8fa5-f8a44a394957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:42.891386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc745d-9eed-4b7a-8fa5-f8a44a394957 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:42.896299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df3f7b-dc9e-4e3b-a3a9-2c30c80498ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:42.897206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df3f7b-dc9e-4e3b-a3a9-2c30c80498ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:42.897496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df3f7b-dc9e-4e3b-a3a9-2c30c80498ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:42.897779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df3f7b-dc9e-4e3b-a3a9-2c30c80498ce admin admin] PATH_INFO: `/v3/users/b82fd80344054f30823522b13f936a0e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:42.898989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df3f7b-dc9e-4e3b-a3a9-2c30c80498ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=b82fd80344054f30823522b13f936a0e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:42.900967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df3f7b-dc9e-4e3b-a3a9-2c30c80498ce admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:42.921255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e0af41ba-25dd-49bc-aca1-cb1928ff7a61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22731b4d3b24a73ac7d7fadb21374aa', 'request_id': 'req-e0af41ba-25dd-49bc-aca1-cb1928ff7a61'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:42.927266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e0af41ba-25dd-49bc-aca1-cb1928ff7a61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22731b4d3b24a73ac7d7fadb21374aa', 'request_id': 'req-e0af41ba-25dd-49bc-aca1-cb1928ff7a61'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:42.990059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e0af41ba-25dd-49bc-aca1-cb1928ff7a61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22731b4d3b24a73ac7d7fadb21374aa', 'request_id': 'req-e0af41ba-25dd-49bc-aca1-cb1928ff7a61'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:43.001840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e0af41ba-25dd-49bc-aca1-cb1928ff7a61 admin admin] The token cache is being invalidate because project a22731b4d3b24a73ac7d7fadb21374aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:43.002133 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e0af41ba-25dd-49bc-aca1-cb1928ff7a61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:43.002858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e0af41ba-25dd-49bc-aca1-cb1928ff7a61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:43.004537 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3970/7954] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:42 2022] DELETE /identity/v3/projects/a22731b4d3b24a73ac7d7fadb21374aa => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:43.009675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81147a5c-9a75-414b-aabb-786972f260dd None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:43.009971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81147a5c-9a75-414b-aabb-786972f260dd None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:43.010348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81147a5c-9a75-414b-aabb-786972f260dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:43.030568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-81147a5c-9a75-414b-aabb-786972f260dd None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:43.032043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-81147a5c-9a75-414b-aabb-786972f260dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:43.074354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a9df3f7b-dc9e-4e3b-a3a9-2c30c80498ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b82fd80344054f30823522b13f936a0e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:43.090677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a9df3f7b-dc9e-4e3b-a3a9-2c30c80498ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b82fd80344054f30823522b13f936a0e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:43.091495 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a9df3f7b-dc9e-4e3b-a3a9-2c30c80498ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b82fd80344054f30823522b13f936a0e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:43.096185 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3971/7955] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:53:43.104933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a9df3f7b-dc9e-4e3b-a3a9-2c30c80498ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b82fd80344054f30823522b13f936a0e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:43.105152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99088c7-df08-4724-93bd-9d261dce1f7f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:43.105541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99088c7-df08-4724-93bd-9d261dce1f7f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:43.105722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99088c7-df08-4724-93bd-9d261dce1f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:43.124415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f99088c7-df08-4724-93bd-9d261dce1f7f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:43.125740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f99088c7-df08-4724-93bd-9d261dce1f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:43.133792 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3972/7956] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:53:43.138858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99088c7-df08-4724-93bd-9d261dce1f7f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:43.147738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99088c7-df08-4724-93bd-9d261dce1f7f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:43.152943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b86dc9-5cfa-49d8-9a0f-f87895364b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:43.153636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b86dc9-5cfa-49d8-9a0f-f87895364b06 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:43.153926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b86dc9-5cfa-49d8-9a0f-f87895364b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:43.154205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b86dc9-5cfa-49d8-9a0f-f87895364b06 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:43.155056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b86dc9-5cfa-49d8-9a0f-f87895364b06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:53:43.155389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b86dc9-5cfa-49d8-9a0f-f87895364b06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:43.157054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b86dc9-5cfa-49d8-9a0f-f87895364b06 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:43.168490 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3973/7957] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:43.173334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b86dc9-5cfa-49d8-9a0f-f87895364b06 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:43.183310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b86dc9-5cfa-49d8-9a0f-f87895364b06 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:43.189266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0731dc-bbe4-4571-9a49-20b16e478af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:43.189977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0731dc-bbe4-4571-9a49-20b16e478af2 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:43.190421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0731dc-bbe4-4571-9a49-20b16e478af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:43.190791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0731dc-bbe4-4571-9a49-20b16e478af2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:43.191572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0731dc-bbe4-4571-9a49-20b16e478af2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:43.193790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0731dc-bbe4-4571-9a49-20b16e478af2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:43.201625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a9df3f7b-dc9e-4e3b-a3a9-2c30c80498ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b82fd80344054f30823522b13f936a0e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:43.208580 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3985/7958] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:42 2022] DELETE /identity/v3/users/b82fd80344054f30823522b13f936a0e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:43.213014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985609e-909c-4854-ba8e-0620d6ff1b71 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:43.213310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985609e-909c-4854-ba8e-0620d6ff1b71 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:43.213595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985609e-909c-4854-ba8e-0620d6ff1b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:43.230777 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6985609e-909c-4854-ba8e-0620d6ff1b71 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:43.232517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6985609e-909c-4854-ba8e-0620d6ff1b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:43.289615 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3986/7959] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:53:43.299841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985609e-909c-4854-ba8e-0620d6ff1b71 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:43.301192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6985609e-909c-4854-ba8e-0620d6ff1b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:43.306403 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3974/7960] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:43 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:43.311204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0731dc-bbe4-4571-9a49-20b16e478af2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:43.313170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fa0731dc-bbe4-4571-9a49-20b16e478af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:43.370150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985609e-909c-4854-ba8e-0620d6ff1b71 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:43.386337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0731dc-bbe4-4571-9a49-20b16e478af2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:43.391760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc99d84-9e11-4662-8fad-51e3bcb4eddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:43.392435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc99d84-9e11-4662-8fad-51e3bcb4eddc admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:43.392775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc99d84-9e11-4662-8fad-51e3bcb4eddc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:43.393062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc99d84-9e11-4662-8fad-51e3bcb4eddc admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:43.393753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc99d84-9e11-4662-8fad-51e3bcb4eddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:43.395714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc99d84-9e11-4662-8fad-51e3bcb4eddc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:43.417921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc7c0a-c982-4308-8909-5595cbc10bc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:43.418576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc7c0a-c982-4308-8909-5595cbc10bc7 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:43.418863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc7c0a-c982-4308-8909-5595cbc10bc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:43.419672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc7c0a-c982-4308-8909-5595cbc10bc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:43.428982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc7c0a-c982-4308-8909-5595cbc10bc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:43.430407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc7c0a-c982-4308-8909-5595cbc10bc7 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:43.440570 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3987/7961] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:53:43.502347 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3975/7962] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:53:43 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:43.503652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc7c0a-c982-4308-8909-5595cbc10bc7 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:43.513727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc7c0a-c982-4308-8909-5595cbc10bc7 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:43.518517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa55fc-3b60-4a35-bab0-ba979636ed51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:43.519224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa55fc-3b60-4a35-bab0-ba979636ed51 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:43.521251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa55fc-3b60-4a35-bab0-ba979636ed51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:43.521251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa55fc-3b60-4a35-bab0-ba979636ed51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:43.521251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa55fc-3b60-4a35-bab0-ba979636ed51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:43.522211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa55fc-3b60-4a35-bab0-ba979636ed51 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:43.532169 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3988/7963] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:43.536182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc99d84-9e11-4662-8fad-51e3bcb4eddc admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:43.547140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc99d84-9e11-4662-8fad-51e3bcb4eddc admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:43.551878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8fbcf-14aa-40b2-986f-3403d042b5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:43.552536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8fbcf-14aa-40b2-986f-3403d042b5bb admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:43.552851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8fbcf-14aa-40b2-986f-3403d042b5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:43.553131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8fbcf-14aa-40b2-986f-3403d042b5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:43.553849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8fbcf-14aa-40b2-986f-3403d042b5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:43.555663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8fbcf-14aa-40b2-986f-3403d042b5bb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:43.569652 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3976/7964] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:53:43.571475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa55fc-3b60-4a35-bab0-ba979636ed51 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:43.581718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa55fc-3b60-4a35-bab0-ba979636ed51 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:43.586747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73143612-7a3e-456e-8d86-979248c164c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:43.587637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73143612-7a3e-456e-8d86-979248c164c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:43.587923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73143612-7a3e-456e-8d86-979248c164c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:43.588480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73143612-7a3e-456e-8d86-979248c164c6 admin admin] PATH_INFO: `/v3/projects/dd9650bf3c8b401fb2644f9f66c4f340/users/61303ce801054f51b1fa4a814e2fb64b/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:43.603521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73143612-7a3e-456e-8d86-979248c164c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd9650bf3c8b401fb2644f9f66c4f340, user_id=61303ce801054f51b1fa4a814e2fb64b, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:43.606259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73143612-7a3e-456e-8d86-979248c164c6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:43.708238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8fbcf-14aa-40b2-986f-3403d042b5bb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:43.708238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3fd8fbcf-14aa-40b2-986f-3403d042b5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:43.721703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8fbcf-14aa-40b2-986f-3403d042b5bb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:43.726703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602d15d-7455-46d5-b836-10599147c707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:43.728129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602d15d-7455-46d5-b836-10599147c707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:43.728708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602d15d-7455-46d5-b836-10599147c707 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:43.729214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602d15d-7455-46d5-b836-10599147c707 admin admin] PATH_INFO: `/v3/projects/645ae3da78364e50bd273b91c5ed4f61` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:43.730518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602d15d-7455-46d5-b836-10599147c707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=645ae3da78364e50bd273b91c5ed4f61)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:43.733258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602d15d-7455-46d5-b836-10599147c707 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:43.736972 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3989/7965] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:43 2022] PUT /identity/v3/projects/dd9650bf3c8b401fb2644f9f66c4f340/users/61303ce801054f51b1fa4a814e2fb64b/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:43.746656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d905d-41c4-4d46-9011-94d4ed2bc275 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:43.746946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d905d-41c4-4d46-9011-94d4ed2bc275 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:43.747229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d905d-41c4-4d46-9011-94d4ed2bc275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:43.775699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-259d905d-41c4-4d46-9011-94d4ed2bc275 None None] MFA Rules not processed for user `61303ce801054f51b1fa4a814e2fb64b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:43.776954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-259d905d-41c4-4d46-9011-94d4ed2bc275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:43.838264 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3990/7966] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:43.842795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d905d-41c4-4d46-9011-94d4ed2bc275 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:43.856291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1602d15d-7455-46d5-b836-10599147c707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '645ae3da78364e50bd273b91c5ed4f61', 'request_id': 'req-1602d15d-7455-46d5-b836-10599147c707'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:43.866233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1602d15d-7455-46d5-b836-10599147c707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '645ae3da78364e50bd273b91c5ed4f61', 'request_id': 'req-1602d15d-7455-46d5-b836-10599147c707'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:43.907010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d905d-41c4-4d46-9011-94d4ed2bc275 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:43.949948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1602d15d-7455-46d5-b836-10599147c707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '645ae3da78364e50bd273b91c5ed4f61', 'request_id': 'req-1602d15d-7455-46d5-b836-10599147c707'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:43.961443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4892420-b226-459a-bddd-5748ec161d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:43.961617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1602d15d-7455-46d5-b836-10599147c707 admin admin] The token cache is being invalidate because project 645ae3da78364e50bd273b91c5ed4f61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:43.961740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1602d15d-7455-46d5-b836-10599147c707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:43.962113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4892420-b226-459a-bddd-5748ec161d2c admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:43.962398 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1602d15d-7455-46d5-b836-10599147c707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:43.962500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4892420-b226-459a-bddd-5748ec161d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:43.962674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4892420-b226-459a-bddd-5748ec161d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:43.963369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4892420-b226-459a-bddd-5748ec161d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:43.963978 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3977/7967] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:43 2022] DELETE /identity/v3/projects/645ae3da78364e50bd273b91c5ed4f61 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:43.965313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4892420-b226-459a-bddd-5748ec161d2c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:43.969418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181b740-1bca-431a-90af-0c809c72fbba None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:43.969699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181b740-1bca-431a-90af-0c809c72fbba None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:43.969982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181b740-1bca-431a-90af-0c809c72fbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:43.989630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b181b740-1bca-431a-90af-0c809c72fbba None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:43.990947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b181b740-1bca-431a-90af-0c809c72fbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:43.999113 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3978/7968] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:53:44.006522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9c048-ce2d-4a72-b437-2d1a838a3c60 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:44.006814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9c048-ce2d-4a72-b437-2d1a838a3c60 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:44.007097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9c048-ce2d-4a72-b437-2d1a838a3c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:44.025204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-13a9c048-ce2d-4a72-b437-2d1a838a3c60 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:44.026400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-13a9c048-ce2d-4a72-b437-2d1a838a3c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:44.034940 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3979/7969] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:53:44.039029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9c048-ce2d-4a72-b437-2d1a838a3c60 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:44.048003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9c048-ce2d-4a72-b437-2d1a838a3c60 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:44.052759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf12ce-a5c4-4f5b-950e-f2c8ef3eaded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:44.053411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf12ce-a5c4-4f5b-950e-f2c8ef3eaded admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:44.053692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf12ce-a5c4-4f5b-950e-f2c8ef3eaded admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:44.056290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf12ce-a5c4-4f5b-950e-f2c8ef3eaded admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:44.056290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf12ce-a5c4-4f5b-950e-f2c8ef3eaded admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:53:44.056290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf12ce-a5c4-4f5b-950e-f2c8ef3eaded admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:44.056634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf12ce-a5c4-4f5b-950e-f2c8ef3eaded admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:44.067842 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3980/7970] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:44.072132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf12ce-a5c4-4f5b-950e-f2c8ef3eaded admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:44.082135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf12ce-a5c4-4f5b-950e-f2c8ef3eaded admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:44.086308 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3991/7971] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:43 2022] POST /identity/v3/projects => generated 371 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:44.087398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4892420-b226-459a-bddd-5748ec161d2c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:44.089363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a4892420-b226-459a-bddd-5748ec161d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:44.141471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b831ec-f042-422f-ac14-2f753daafec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:44.142165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b831ec-f042-422f-ac14-2f753daafec1 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:44.142453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b831ec-f042-422f-ac14-2f753daafec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:44.142732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b831ec-f042-422f-ac14-2f753daafec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:44.143448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b831ec-f042-422f-ac14-2f753daafec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:44.145395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b831ec-f042-422f-ac14-2f753daafec1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:44.157362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4892420-b226-459a-bddd-5748ec161d2c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:44.162071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f0642-f396-490d-9a31-c753b2d3c5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:44.162748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f0642-f396-490d-9a31-c753b2d3c5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:44.163030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f0642-f396-490d-9a31-c753b2d3c5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:44.163331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f0642-f396-490d-9a31-c753b2d3c5e2 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:44.164027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f0642-f396-490d-9a31-c753b2d3c5e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:44.165985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f0642-f396-490d-9a31-c753b2d3c5e2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:44.228049 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3992/7972] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:53:44 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:44.228259 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3981/7973] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:44 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:44.229625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f0642-f396-490d-9a31-c753b2d3c5e2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:44.230599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b831ec-f042-422f-ac14-2f753daafec1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:44.239571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f0642-f396-490d-9a31-c753b2d3c5e2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:44.293381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b831ec-f042-422f-ac14-2f753daafec1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:44.298517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edb466-5c52-49cd-8b81-5d76a2d0e516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:44.299385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376315be-2538-4f3f-8df3-ee3c79706a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:44.299570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edb466-5c52-49cd-8b81-5d76a2d0e516 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:44.299858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edb466-5c52-49cd-8b81-5d76a2d0e516 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:44.300135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edb466-5c52-49cd-8b81-5d76a2d0e516 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:44.300225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376315be-2538-4f3f-8df3-ee3c79706a18 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:44.300507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376315be-2538-4f3f-8df3-ee3c79706a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:44.300824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376315be-2538-4f3f-8df3-ee3c79706a18 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:44.301076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edb466-5c52-49cd-8b81-5d76a2d0e516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:44.301506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376315be-2538-4f3f-8df3-ee3c79706a18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:44.302904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edb466-5c52-49cd-8b81-5d76a2d0e516 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:44.303635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376315be-2538-4f3f-8df3-ee3c79706a18 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:44.316820 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3993/7974] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:44.317805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edb466-5c52-49cd-8b81-5d76a2d0e516 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:44.327763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edb466-5c52-49cd-8b81-5d76a2d0e516 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:44.332453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324cf20-a5a9-433c-b0a0-1522aa8c967d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:44.333353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324cf20-a5a9-433c-b0a0-1522aa8c967d admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:44.333635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324cf20-a5a9-433c-b0a0-1522aa8c967d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:44.333917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324cf20-a5a9-433c-b0a0-1522aa8c967d admin admin] PATH_INFO: `/v3/projects/198302ee998e416e833de3ac874314e7/users/b8a71d68fa3e492d8fea30a3249567d1/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:44.348348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324cf20-a5a9-433c-b0a0-1522aa8c967d admin admin] RBAC: Authorizing `identity:create_grant(project_id=198302ee998e416e833de3ac874314e7, user_id=b8a71d68fa3e492d8fea30a3249567d1, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:44.350966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324cf20-a5a9-433c-b0a0-1522aa8c967d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:44.392683 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3982/7975] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:53:44 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:44.397191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376315be-2538-4f3f-8df3-ee3c79706a18 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:44.407678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376315be-2538-4f3f-8df3-ee3c79706a18 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:44.413491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28028b4c-f340-419d-81d5-c8d795b71242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:44.414273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28028b4c-f340-419d-81d5-c8d795b71242 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:44.414714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28028b4c-f340-419d-81d5-c8d795b71242 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:44.415062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28028b4c-f340-419d-81d5-c8d795b71242 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:44.415870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28028b4c-f340-419d-81d5-c8d795b71242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:44.417628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28028b4c-f340-419d-81d5-c8d795b71242 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:44.425902 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3994/7976] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:44 2022] PUT /identity/v3/projects/198302ee998e416e833de3ac874314e7/users/b8a71d68fa3e492d8fea30a3249567d1/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:44.429992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324cf20-a5a9-433c-b0a0-1522aa8c967d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:44.432645 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3983/7977] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:53:44.436720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28028b4c-f340-419d-81d5-c8d795b71242 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:44.448415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28028b4c-f340-419d-81d5-c8d795b71242 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:44.502159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324cf20-a5a9-433c-b0a0-1522aa8c967d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:44.507309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519eeb6-92da-4d58-a366-ef4aa0fa1fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:44.507982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519eeb6-92da-4d58-a366-ef4aa0fa1fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:44.508282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519eeb6-92da-4d58-a366-ef4aa0fa1fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:44.508560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519eeb6-92da-4d58-a366-ef4aa0fa1fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:44.509207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0145e-7d8a-49fb-93cd-1da6e3785f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:44.509341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519eeb6-92da-4d58-a366-ef4aa0fa1fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:44.510090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0145e-7d8a-49fb-93cd-1da6e3785f53 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:44.510482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0145e-7d8a-49fb-93cd-1da6e3785f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:44.510864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0145e-7d8a-49fb-93cd-1da6e3785f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:44.510966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519eeb6-92da-4d58-a366-ef4aa0fa1fa2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:44.511916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0145e-7d8a-49fb-93cd-1da6e3785f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:44.514445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0145e-7d8a-49fb-93cd-1da6e3785f53 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:44.521740 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3995/7978] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:53:44.527581 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3984/7979] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:53:44.527726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519eeb6-92da-4d58-a366-ef4aa0fa1fa2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:44.528911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0145e-7d8a-49fb-93cd-1da6e3785f53 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:44.535812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519eeb6-92da-4d58-a366-ef4aa0fa1fa2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:44.538892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0145e-7d8a-49fb-93cd-1da6e3785f53 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:44.543438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de9799-56ce-4a56-b22b-323744c641ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:44.543721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd283ea-37ad-4b45-8490-c257406af1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:44.544352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de9799-56ce-4a56-b22b-323744c641ad admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:44.544668 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de9799-56ce-4a56-b22b-323744c641ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:44.544771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd283ea-37ad-4b45-8490-c257406af1f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:44.544952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de9799-56ce-4a56-b22b-323744c641ad admin admin] PATH_INFO: `/v3/projects/198302ee998e416e833de3ac874314e7/users/b8a71d68fa3e492d8fea30a3249567d1/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:44.545063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd283ea-37ad-4b45-8490-c257406af1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:44.545227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd283ea-37ad-4b45-8490-c257406af1f1 admin admin] PATH_INFO: `/v3/projects/78bd08880fc54674a35eab203f825de5/users/f303b2ff57704cdc9405bf0a51b0d4f4/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:44.546998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de9799-56ce-4a56-b22b-323744c641ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=198302ee998e416e833de3ac874314e7, user_id=b8a71d68fa3e492d8fea30a3249567d1, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:44.549735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de9799-56ce-4a56-b22b-323744c641ad admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:44.567333 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3996/7980] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:44 2022] PUT /identity/v3/projects/198302ee998e416e833de3ac874314e7/users/b8a71d68fa3e492d8fea30a3249567d1/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:44.567445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd283ea-37ad-4b45-8490-c257406af1f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78bd08880fc54674a35eab203f825de5, user_id=f303b2ff57704cdc9405bf0a51b0d4f4, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:44.567445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd283ea-37ad-4b45-8490-c257406af1f1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:44.572501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba3d71-4cba-4fa7-8846-53043611fe16 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:44.572826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba3d71-4cba-4fa7-8846-53043611fe16 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:44.573112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba3d71-4cba-4fa7-8846-53043611fe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:44.609158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-63ba3d71-4cba-4fa7-8846-53043611fe16 None None] MFA Rules not processed for user `b8a71d68fa3e492d8fea30a3249567d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:44.610384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-63ba3d71-4cba-4fa7-8846-53043611fe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:44.628779 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3985/7981] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:44 2022] PUT /identity/v3/projects/78bd08880fc54674a35eab203f825de5/users/f303b2ff57704cdc9405bf0a51b0d4f4/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:44.639525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5b57f-7ee8-4b2e-8137-4092bb1ecc57 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:44.639815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5b57f-7ee8-4b2e-8137-4092bb1ecc57 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:44.640374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5b57f-7ee8-4b2e-8137-4092bb1ecc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:44.668396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b6c5b57f-7ee8-4b2e-8137-4092bb1ecc57 None None] MFA Rules not processed for user `f303b2ff57704cdc9405bf0a51b0d4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:44.670524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b6c5b57f-7ee8-4b2e-8137-4092bb1ecc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:44.687917 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3997/7982] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:44 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:44.692473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba3d71-4cba-4fa7-8846-53043611fe16 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:44.702390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba3d71-4cba-4fa7-8846-53043611fe16 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:44.743116 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3986/7983] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:53:44.753980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5b57f-7ee8-4b2e-8137-4092bb1ecc57 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:44.755466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b6c5b57f-7ee8-4b2e-8137-4092bb1ecc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:44.765372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde62527-4593-4ec8-9d7f-9e09ab1bb855 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:44.766752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde62527-4593-4ec8-9d7f-9e09ab1bb855 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:44.767118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde62527-4593-4ec8-9d7f-9e09ab1bb855 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:44.767467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde62527-4593-4ec8-9d7f-9e09ab1bb855 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:44.768275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde62527-4593-4ec8-9d7f-9e09ab1bb855 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:44.769990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde62527-4593-4ec8-9d7f-9e09ab1bb855 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:44.818577 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3998/7984] 10.222.0.16 () {60 vars in 1148 bytes} [Mon May 2 10:53:44 2022] POST /identity/v3/domains => generated 276 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:44.818753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5b57f-7ee8-4b2e-8137-4092bb1ecc57 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:44.819465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde62527-4593-4ec8-9d7f-9e09ab1bb855 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:44.873776 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a462028-a200-4599-bdf5-e2b065b256b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:44.874578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a462028-a200-4599-bdf5-e2b065b256b0 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:44.874945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a462028-a200-4599-bdf5-e2b065b256b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:44.875289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a462028-a200-4599-bdf5-e2b065b256b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:44.884469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde62527-4593-4ec8-9d7f-9e09ab1bb855 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:44.890510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b11e7-52f5-42c6-ab95-80ab56718799 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:44.891313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b11e7-52f5-42c6-ab95-80ab56718799 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:44.891673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b11e7-52f5-42c6-ab95-80ab56718799 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:44.892029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b11e7-52f5-42c6-ab95-80ab56718799 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:44.892846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b11e7-52f5-42c6-ab95-80ab56718799 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:44.905295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b11e7-52f5-42c6-ab95-80ab56718799 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:44.933351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a462028-a200-4599-bdf5-e2b065b256b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:44.935525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a462028-a200-4599-bdf5-e2b065b256b0 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:44.944831 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3987/7985] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:53:44.998682 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 3999/7986] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:44 2022] POST /identity/v3/projects => generated 403 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:45.002755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a462028-a200-4599-bdf5-e2b065b256b0 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:45.014099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a462028-a200-4599-bdf5-e2b065b256b0 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:45.073789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee6357-5510-43c0-bc4d-3636e02a2a2c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:45.074514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee6357-5510-43c0-bc4d-3636e02a2a2c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:45.074784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee6357-5510-43c0-bc4d-3636e02a2a2c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:45.075069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee6357-5510-43c0-bc4d-3636e02a2a2c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/groups` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:45.075793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee6357-5510-43c0-bc4d-3636e02a2a2c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:45.077759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee6357-5510-43c0-bc4d-3636e02a2a2c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:45.150872 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3988/7987] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 2 10:53:45 2022] POST /identity/v3/groups => generated 302 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:45.155356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b11e7-52f5-42c6-ab95-80ab56718799 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:45.166356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b11e7-52f5-42c6-ab95-80ab56718799 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:45.172039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fde04-3f84-41ed-a3f4-a96c0b412047 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:45.172874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fde04-3f84-41ed-a3f4-a96c0b412047 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:45.174015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fde04-3f84-41ed-a3f4-a96c0b412047 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:45.174015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fde04-3f84-41ed-a3f4-a96c0b412047 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:45.174376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fde04-3f84-41ed-a3f4-a96c0b412047 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:45.176399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fde04-3f84-41ed-a3f4-a96c0b412047 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:45.266904 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4000/7988] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:53:45 2022] POST /identity/v3/users => generated 442 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:45.271481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee6357-5510-43c0-bc4d-3636e02a2a2c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:45.282546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee6357-5510-43c0-bc4d-3636e02a2a2c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:45.288063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32408a90-9e74-4946-b204-e5781d40489c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:45.288872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32408a90-9e74-4946-b204-e5781d40489c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:45.289252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32408a90-9e74-4946-b204-e5781d40489c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:45.292484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32408a90-9e74-4946-b204-e5781d40489c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:45.292484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32408a90-9e74-4946-b204-e5781d40489c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:45.292484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32408a90-9e74-4946-b204-e5781d40489c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:45.421164 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3989/7989] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:53:45 2022] POST /identity/v3/roles => generated 239 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:45.426067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fde04-3f84-41ed-a3f4-a96c0b412047 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:45.436183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fde04-3f84-41ed-a3f4-a96c0b412047 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:45.441069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ca4cd-d147-4abe-b635-caebe353a184 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:45.441900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ca4cd-d147-4abe-b635-caebe353a184 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:45.442184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ca4cd-d147-4abe-b635-caebe353a184 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:45.442463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ca4cd-d147-4abe-b635-caebe353a184 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/adeb8b42772c41deb765db4e0b5b701d/groups/b5f71d641b7f412795d2d320b28635a7/roles/5e32ad6491a2461e981c9c3acabd14b5/inherited_to_projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:45.449127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ca4cd-d147-4abe-b635-caebe353a184 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:create_grant(project_id=adeb8b42772c41deb765db4e0b5b701d, group_id=b5f71d641b7f412795d2d320b28635a7, role_id=5e32ad6491a2461e981c9c3acabd14b5)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:45.452321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ca4cd-d147-4abe-b635-caebe353a184 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:45.544328 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4001/7990] 10.222.0.16 () {60 vars in 1584 bytes} [Mon May 2 10:53:45 2022] PUT /identity/v3/OS-INHERIT/projects/adeb8b42772c41deb765db4e0b5b701d/groups/b5f71d641b7f412795d2d320b28635a7/roles/5e32ad6491a2461e981c9c3acabd14b5/inherited_to_projects => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:45.548667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32408a90-9e74-4946-b204-e5781d40489c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:45.558873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32408a90-9e74-4946-b204-e5781d40489c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:45.614609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6079da5-6248-41bf-8cd2-48d888edbf27 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:45.615457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6079da5-6248-41bf-8cd2-48d888edbf27 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:45.615744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6079da5-6248-41bf-8cd2-48d888edbf27 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:45.616023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6079da5-6248-41bf-8cd2-48d888edbf27 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/adeb8b42772c41deb765db4e0b5b701d/groups/b5f71d641b7f412795d2d320b28635a7/roles/5e32ad6491a2461e981c9c3acabd14b5/inherited_to_projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:45.618310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6079da5-6248-41bf-8cd2-48d888edbf27 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:check_grant(project_id=adeb8b42772c41deb765db4e0b5b701d, group_id=b5f71d641b7f412795d2d320b28635a7, role_id=5e32ad6491a2461e981c9c3acabd14b5)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:45.621012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6079da5-6248-41bf-8cd2-48d888edbf27 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:45.628193 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3990/7991] 10.222.0.16 () {58 vars in 1566 bytes} [Mon May 2 10:53:45 2022] HEAD /identity/v3/OS-INHERIT/projects/adeb8b42772c41deb765db4e0b5b701d/groups/b5f71d641b7f412795d2d320b28635a7/roles/5e32ad6491a2461e981c9c3acabd14b5/inherited_to_projects => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:45.632386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ca4cd-d147-4abe-b635-caebe353a184 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:45.643722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ca4cd-d147-4abe-b635-caebe353a184 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:45.648409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e06b6b-7c29-4322-bf45-45720b1917a1 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:45.649309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e06b6b-7c29-4322-bf45-45720b1917a1 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:45.649733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e06b6b-7c29-4322-bf45-45720b1917a1 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:45.650022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e06b6b-7c29-4322-bf45-45720b1917a1 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/adeb8b42772c41deb765db4e0b5b701d/groups/b5f71d641b7f412795d2d320b28635a7/roles/5e32ad6491a2461e981c9c3acabd14b5/inherited_to_projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:45.652320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e06b6b-7c29-4322-bf45-45720b1917a1 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=adeb8b42772c41deb765db4e0b5b701d, group_id=b5f71d641b7f412795d2d320b28635a7, role_id=5e32ad6491a2461e981c9c3acabd14b5)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:45.655686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e06b6b-7c29-4322-bf45-45720b1917a1 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:45.663305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e4e06b6b-7c29-4322-bf45-45720b1917a1 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invalidating the token cache because role 5e32ad6491a2461e981c9c3acabd14b5 was removed from group b5f71d641b7f412795d2d320b28635a7 on project adeb8b42772c41deb765db4e0b5b701d. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:45.663305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e4e06b6b-7c29-4322-bf45-45720b1917a1 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:45.663942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e4e06b6b-7c29-4322-bf45-45720b1917a1 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:45.780030 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4002/7992] 10.222.0.16 () {58 vars in 1568 bytes} [Mon May 2 10:53:45 2022] DELETE /identity/v3/OS-INHERIT/projects/adeb8b42772c41deb765db4e0b5b701d/groups/b5f71d641b7f412795d2d320b28635a7/roles/5e32ad6491a2461e981c9c3acabd14b5/inherited_to_projects => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:45.784243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6079da5-6248-41bf-8cd2-48d888edbf27 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:45.786123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e6079da5-6248-41bf-8cd2-48d888edbf27 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:45.798778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6079da5-6248-41bf-8cd2-48d888edbf27 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:45.855246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557bb8f0-90a4-4777-880f-4e5fe3c75a87 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:45.856218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bb8f0-90a4-4777-880f-4e5fe3c75a87 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:45.856511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bb8f0-90a4-4777-880f-4e5fe3c75a87 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:45.856912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bb8f0-90a4-4777-880f-4e5fe3c75a87 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/roles/5e32ad6491a2461e981c9c3acabd14b5` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:45.858420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557bb8f0-90a4-4777-880f-4e5fe3c75a87 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5e32ad6491a2461e981c9c3acabd14b5)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:45.860062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557bb8f0-90a4-4777-880f-4e5fe3c75a87 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:45.956203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-557bb8f0-90a4-4777-880f-4e5fe3c75a87 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invalidating the token cache because role 5e32ad6491a2461e981c9c3acabd14b5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:45.956927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-557bb8f0-90a4-4777-880f-4e5fe3c75a87 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:45.957488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-557bb8f0-90a4-4777-880f-4e5fe3c75a87 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:45.959598 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3991/7993] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:45 2022] DELETE /identity/v3/roles/5e32ad6491a2461e981c9c3acabd14b5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:45.964643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e06b6b-7c29-4322-bf45-45720b1917a1 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:45.976977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e06b6b-7c29-4322-bf45-45720b1917a1 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:46.038911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220e6ba-457b-40b0-9794-2effa8ca9751 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:46.039583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220e6ba-457b-40b0-9794-2effa8ca9751 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:46.039868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220e6ba-457b-40b0-9794-2effa8ca9751 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:46.040147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220e6ba-457b-40b0-9794-2effa8ca9751 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:46.040925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220e6ba-457b-40b0-9794-2effa8ca9751 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:46.042571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220e6ba-457b-40b0-9794-2effa8ca9751 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:46.151280 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4003/7994] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:53:45 2022] POST /identity/v3/roles => generated 240 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:46.155509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557bb8f0-90a4-4777-880f-4e5fe3c75a87 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:46.157036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-557bb8f0-90a4-4777-880f-4e5fe3c75a87 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:46.171860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557bb8f0-90a4-4777-880f-4e5fe3c75a87 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:46.176699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807ab68-4ca6-4bad-8ae5-1f9798828fc5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:46.177680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807ab68-4ca6-4bad-8ae5-1f9798828fc5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:46.177972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807ab68-4ca6-4bad-8ae5-1f9798828fc5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:46.178254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807ab68-4ca6-4bad-8ae5-1f9798828fc5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/adeb8b42772c41deb765db4e0b5b701d/users/b4ee0119a43946598d2f9fd09b6ef02f/roles/0755e8c35e554863a200efee9e7786b2/inherited_to_projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:46.194001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807ab68-4ca6-4bad-8ae5-1f9798828fc5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:create_grant(project_id=adeb8b42772c41deb765db4e0b5b701d, user_id=b4ee0119a43946598d2f9fd09b6ef02f, role_id=0755e8c35e554863a200efee9e7786b2)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:46.196705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807ab68-4ca6-4bad-8ae5-1f9798828fc5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:46.461227 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3992/7995] 10.222.0.16 () {60 vars in 1581 bytes} [Mon May 2 10:53:46 2022] PUT /identity/v3/OS-INHERIT/projects/adeb8b42772c41deb765db4e0b5b701d/users/b4ee0119a43946598d2f9fd09b6ef02f/roles/0755e8c35e554863a200efee9e7786b2/inherited_to_projects => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:46.465348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220e6ba-457b-40b0-9794-2effa8ca9751 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:46.477526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220e6ba-457b-40b0-9794-2effa8ca9751 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:46.544028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383659a-1b44-4144-9139-b37f08d5f288 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:46.545290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383659a-1b44-4144-9139-b37f08d5f288 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:46.545577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383659a-1b44-4144-9139-b37f08d5f288 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:46.545862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383659a-1b44-4144-9139-b37f08d5f288 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/adeb8b42772c41deb765db4e0b5b701d/users/b4ee0119a43946598d2f9fd09b6ef02f/roles/0755e8c35e554863a200efee9e7786b2/inherited_to_projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:46.548253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383659a-1b44-4144-9139-b37f08d5f288 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:check_grant(project_id=adeb8b42772c41deb765db4e0b5b701d, user_id=b4ee0119a43946598d2f9fd09b6ef02f, role_id=0755e8c35e554863a200efee9e7786b2)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:46.551554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383659a-1b44-4144-9139-b37f08d5f288 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:46.560711 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4004/7996] 10.222.0.16 () {58 vars in 1563 bytes} [Mon May 2 10:53:46 2022] HEAD /identity/v3/OS-INHERIT/projects/adeb8b42772c41deb765db4e0b5b701d/users/b4ee0119a43946598d2f9fd09b6ef02f/roles/0755e8c35e554863a200efee9e7786b2/inherited_to_projects => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:46.563300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807ab68-4ca6-4bad-8ae5-1f9798828fc5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:46.576731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807ab68-4ca6-4bad-8ae5-1f9798828fc5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:46.587930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d5ce3-187c-4a9d-9623-db7852f520aa tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:46.588915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d5ce3-187c-4a9d-9623-db7852f520aa tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:46.590754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d5ce3-187c-4a9d-9623-db7852f520aa tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:46.591688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d5ce3-187c-4a9d-9623-db7852f520aa tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/adeb8b42772c41deb765db4e0b5b701d/users/b4ee0119a43946598d2f9fd09b6ef02f/roles/0755e8c35e554863a200efee9e7786b2/inherited_to_projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:46.594102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d5ce3-187c-4a9d-9623-db7852f520aa tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=adeb8b42772c41deb765db4e0b5b701d, user_id=b4ee0119a43946598d2f9fd09b6ef02f, role_id=0755e8c35e554863a200efee9e7786b2)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:46.597025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d5ce3-187c-4a9d-9623-db7852f520aa tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:46.602746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-574d5ce3-187c-4a9d-9623-db7852f520aa tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invalidating the token cache because role 0755e8c35e554863a200efee9e7786b2 was removed from user b4ee0119a43946598d2f9fd09b6ef02f on project adeb8b42772c41deb765db4e0b5b701d. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:46.603044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-574d5ce3-187c-4a9d-9623-db7852f520aa tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:46.603877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-574d5ce3-187c-4a9d-9623-db7852f520aa tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:46.667246 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3993/7997] 10.222.0.16 () {58 vars in 1565 bytes} [Mon May 2 10:53:46 2022] DELETE /identity/v3/OS-INHERIT/projects/adeb8b42772c41deb765db4e0b5b701d/users/b4ee0119a43946598d2f9fd09b6ef02f/roles/0755e8c35e554863a200efee9e7786b2/inherited_to_projects => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:46.671595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383659a-1b44-4144-9139-b37f08d5f288 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:46.673395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3383659a-1b44-4144-9139-b37f08d5f288 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:46.688348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383659a-1b44-4144-9139-b37f08d5f288 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:46.773108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc715a84-63c0-45a4-8e50-a270b2806336 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:46.774017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc715a84-63c0-45a4-8e50-a270b2806336 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:46.774381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc715a84-63c0-45a4-8e50-a270b2806336 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:46.774648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc715a84-63c0-45a4-8e50-a270b2806336 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/roles/0755e8c35e554863a200efee9e7786b2` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:46.776130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc715a84-63c0-45a4-8e50-a270b2806336 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0755e8c35e554863a200efee9e7786b2)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:46.779003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc715a84-63c0-45a4-8e50-a270b2806336 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:46.864312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dc715a84-63c0-45a4-8e50-a270b2806336 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invalidating the token cache because role 0755e8c35e554863a200efee9e7786b2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:46.864689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dc715a84-63c0-45a4-8e50-a270b2806336 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:46.865381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dc715a84-63c0-45a4-8e50-a270b2806336 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:46.867280 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4005/7998] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:46 2022] DELETE /identity/v3/roles/0755e8c35e554863a200efee9e7786b2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:46.872796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d5ce3-187c-4a9d-9623-db7852f520aa tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:46.883238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d5ce3-187c-4a9d-9623-db7852f520aa tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:46.942094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979790a5-1c68-4482-a860-17a5a84f4d3c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:46.942913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979790a5-1c68-4482-a860-17a5a84f4d3c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:46.943281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979790a5-1c68-4482-a860-17a5a84f4d3c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:46.943634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979790a5-1c68-4482-a860-17a5a84f4d3c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:46.944589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979790a5-1c68-4482-a860-17a5a84f4d3c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:46.954125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979790a5-1c68-4482-a860-17a5a84f4d3c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:47.060338 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3994/7999] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:53:46 2022] POST /identity/v3/roles => generated 239 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:47.064804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc715a84-63c0-45a4-8e50-a270b2806336 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:47.066503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dc715a84-63c0-45a4-8e50-a270b2806336 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:47.081315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc715a84-63c0-45a4-8e50-a270b2806336 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:47.086461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770f727-90d3-4c55-b168-f2331429c37d tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:47.091733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770f727-90d3-4c55-b168-f2331429c37d tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:47.091733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770f727-90d3-4c55-b168-f2331429c37d tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:47.091733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770f727-90d3-4c55-b168-f2331429c37d tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8555aae633c84d15b12fe7e5ab67aba6/groups/b5f71d641b7f412795d2d320b28635a7/roles/e484a522c1834b8cbf0aa6c3982e5da8/inherited_to_projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:47.091733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770f727-90d3-4c55-b168-f2331429c37d tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=8555aae633c84d15b12fe7e5ab67aba6, group_id=b5f71d641b7f412795d2d320b28635a7, role_id=e484a522c1834b8cbf0aa6c3982e5da8)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:47.098094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770f727-90d3-4c55-b168-f2331429c37d tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:47.178688 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4006/8000] 10.222.0.16 () {60 vars in 1581 bytes} [Mon May 2 10:53:47 2022] PUT /identity/v3/OS-INHERIT/domains/8555aae633c84d15b12fe7e5ab67aba6/groups/b5f71d641b7f412795d2d320b28635a7/roles/e484a522c1834b8cbf0aa6c3982e5da8/inherited_to_projects => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:47.183119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979790a5-1c68-4482-a860-17a5a84f4d3c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:47.193806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979790a5-1c68-4482-a860-17a5a84f4d3c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:47.312340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708b474-e04d-4879-bb4d-8f2c251c91a0 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:47.313669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708b474-e04d-4879-bb4d-8f2c251c91a0 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:47.314064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708b474-e04d-4879-bb4d-8f2c251c91a0 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:47.314564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708b474-e04d-4879-bb4d-8f2c251c91a0 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8555aae633c84d15b12fe7e5ab67aba6/groups/b5f71d641b7f412795d2d320b28635a7/roles/inherited_to_projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:47.316422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708b474-e04d-4879-bb4d-8f2c251c91a0 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=8555aae633c84d15b12fe7e5ab67aba6, group_id=b5f71d641b7f412795d2d320b28635a7)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:47.319131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708b474-e04d-4879-bb4d-8f2c251c91a0 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:47.334114 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3995/8001] 10.222.0.16 () {58 vars in 1463 bytes} [Mon May 2 10:53:47 2022] GET /identity/v3/OS-INHERIT/domains/8555aae633c84d15b12fe7e5ab67aba6/groups/b5f71d641b7f412795d2d320b28635a7/roles/inherited_to_projects => generated 447 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:47.339657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770f727-90d3-4c55-b168-f2331429c37d tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:47.351362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770f727-90d3-4c55-b168-f2331429c37d tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:47.357164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f6606-7318-45ab-a296-9d13c6e7c7da tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:47.358110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f6606-7318-45ab-a296-9d13c6e7c7da tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:47.358472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f6606-7318-45ab-a296-9d13c6e7c7da tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:47.358828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f6606-7318-45ab-a296-9d13c6e7c7da tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8555aae633c84d15b12fe7e5ab67aba6/groups/b5f71d641b7f412795d2d320b28635a7/roles/e484a522c1834b8cbf0aa6c3982e5da8/inherited_to_projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:47.361162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f6606-7318-45ab-a296-9d13c6e7c7da tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=8555aae633c84d15b12fe7e5ab67aba6, group_id=b5f71d641b7f412795d2d320b28635a7, role_id=e484a522c1834b8cbf0aa6c3982e5da8)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:47.364143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f6606-7318-45ab-a296-9d13c6e7c7da tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:47.375371 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4007/8002] 10.222.0.16 () {58 vars in 1563 bytes} [Mon May 2 10:53:47 2022] HEAD /identity/v3/OS-INHERIT/domains/8555aae633c84d15b12fe7e5ab67aba6/groups/b5f71d641b7f412795d2d320b28635a7/roles/e484a522c1834b8cbf0aa6c3982e5da8/inherited_to_projects => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:47.378756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708b474-e04d-4879-bb4d-8f2c251c91a0 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:47.390100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708b474-e04d-4879-bb4d-8f2c251c91a0 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:47.395393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bce26-65d3-4389-aa6c-6132834cac06 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:47.396506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bce26-65d3-4389-aa6c-6132834cac06 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:47.396742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bce26-65d3-4389-aa6c-6132834cac06 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:47.397077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bce26-65d3-4389-aa6c-6132834cac06 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8555aae633c84d15b12fe7e5ab67aba6/groups/b5f71d641b7f412795d2d320b28635a7/roles/e484a522c1834b8cbf0aa6c3982e5da8/inherited_to_projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:47.399420 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361bce26-65d3-4389-aa6c-6132834cac06 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=8555aae633c84d15b12fe7e5ab67aba6, group_id=b5f71d641b7f412795d2d320b28635a7, role_id=e484a522c1834b8cbf0aa6c3982e5da8)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:47.402179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361bce26-65d3-4389-aa6c-6132834cac06 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:47.408664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-361bce26-65d3-4389-aa6c-6132834cac06 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invalidating the token cache because role e484a522c1834b8cbf0aa6c3982e5da8 was removed from group b5f71d641b7f412795d2d320b28635a7 on domain 8555aae633c84d15b12fe7e5ab67aba6. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:47.409160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-361bce26-65d3-4389-aa6c-6132834cac06 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:47.409725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-361bce26-65d3-4389-aa6c-6132834cac06 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:47.517332 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3996/8003] 10.222.0.16 () {58 vars in 1565 bytes} [Mon May 2 10:53:47 2022] DELETE /identity/v3/OS-INHERIT/domains/8555aae633c84d15b12fe7e5ab67aba6/groups/b5f71d641b7f412795d2d320b28635a7/roles/e484a522c1834b8cbf0aa6c3982e5da8/inherited_to_projects => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:47.521880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f6606-7318-45ab-a296-9d13c6e7c7da tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:47.523706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-559f6606-7318-45ab-a296-9d13c6e7c7da tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:47.537278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f6606-7318-45ab-a296-9d13c6e7c7da tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:47.605433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2289e26-8cc3-4af5-92d2-e27408b0b88a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:47.606312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2289e26-8cc3-4af5-92d2-e27408b0b88a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:47.607219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2289e26-8cc3-4af5-92d2-e27408b0b88a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:47.607703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2289e26-8cc3-4af5-92d2-e27408b0b88a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/roles/e484a522c1834b8cbf0aa6c3982e5da8` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:47.609230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2289e26-8cc3-4af5-92d2-e27408b0b88a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e484a522c1834b8cbf0aa6c3982e5da8)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:47.614469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2289e26-8cc3-4af5-92d2-e27408b0b88a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:47.698612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a2289e26-8cc3-4af5-92d2-e27408b0b88a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invalidating the token cache because role e484a522c1834b8cbf0aa6c3982e5da8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:47.698829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a2289e26-8cc3-4af5-92d2-e27408b0b88a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:47.699525 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-a2289e26-8cc3-4af5-92d2-e27408b0b88a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:47.701889 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4008/8004] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:47 2022] DELETE /identity/v3/roles/e484a522c1834b8cbf0aa6c3982e5da8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:47.707294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bce26-65d3-4389-aa6c-6132834cac06 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:47.719841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bce26-65d3-4389-aa6c-6132834cac06 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:47.788229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa985f-3c42-4ac0-b09c-e194f97e5d4f tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:47.789104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa985f-3c42-4ac0-b09c-e194f97e5d4f tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:47.792519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa985f-3c42-4ac0-b09c-e194f97e5d4f tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:47.792519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa985f-3c42-4ac0-b09c-e194f97e5d4f tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:47.792519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa985f-3c42-4ac0-b09c-e194f97e5d4f tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:47.792519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa985f-3c42-4ac0-b09c-e194f97e5d4f tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:47.854575 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3997/8005] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:53:47 2022] POST /identity/v3/roles => generated 239 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:47.858964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2289e26-8cc3-4af5-92d2-e27408b0b88a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:47.860437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a2289e26-8cc3-4af5-92d2-e27408b0b88a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:47.873946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2289e26-8cc3-4af5-92d2-e27408b0b88a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:47.878976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee17fb1-090b-4106-97d5-71b5a6635967 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:47.880090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee17fb1-090b-4106-97d5-71b5a6635967 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:47.880369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee17fb1-090b-4106-97d5-71b5a6635967 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:47.880760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee17fb1-090b-4106-97d5-71b5a6635967 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8555aae633c84d15b12fe7e5ab67aba6/users/b4ee0119a43946598d2f9fd09b6ef02f/roles/3aa13ece7ab74136ac5d868bc5e404f2/inherited_to_projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:47.883210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee17fb1-090b-4106-97d5-71b5a6635967 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=8555aae633c84d15b12fe7e5ab67aba6, user_id=b4ee0119a43946598d2f9fd09b6ef02f, role_id=3aa13ece7ab74136ac5d868bc5e404f2)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:47.894326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee17fb1-090b-4106-97d5-71b5a6635967 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:47.974042 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4009/8006] 10.222.0.16 () {60 vars in 1578 bytes} [Mon May 2 10:53:47 2022] PUT /identity/v3/OS-INHERIT/domains/8555aae633c84d15b12fe7e5ab67aba6/users/b4ee0119a43946598d2f9fd09b6ef02f/roles/3aa13ece7ab74136ac5d868bc5e404f2/inherited_to_projects => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:47.978353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa985f-3c42-4ac0-b09c-e194f97e5d4f tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:47.989696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa985f-3c42-4ac0-b09c-e194f97e5d4f tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:48.052129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4a579-df67-4e3c-8ef6-d4c95fa64447 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:48.053095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4a579-df67-4e3c-8ef6-d4c95fa64447 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:48.053380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4a579-df67-4e3c-8ef6-d4c95fa64447 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:48.053665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4a579-df67-4e3c-8ef6-d4c95fa64447 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8555aae633c84d15b12fe7e5ab67aba6/users/b4ee0119a43946598d2f9fd09b6ef02f/roles/inherited_to_projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:48.055433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4a579-df67-4e3c-8ef6-d4c95fa64447 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=8555aae633c84d15b12fe7e5ab67aba6, user_id=b4ee0119a43946598d2f9fd09b6ef02f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:48.058408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4a579-df67-4e3c-8ef6-d4c95fa64447 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:48.072645 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3998/8007] 10.222.0.16 () {58 vars in 1460 bytes} [Mon May 2 10:53:47 2022] GET /identity/v3/OS-INHERIT/domains/8555aae633c84d15b12fe7e5ab67aba6/users/b4ee0119a43946598d2f9fd09b6ef02f/roles/inherited_to_projects => generated 446 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:53:48.077828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee17fb1-090b-4106-97d5-71b5a6635967 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:48.090076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee17fb1-090b-4106-97d5-71b5a6635967 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:48.095419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f8b44-219e-4ced-8620-902d843596d2 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:48.097034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f8b44-219e-4ced-8620-902d843596d2 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:48.097034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f8b44-219e-4ced-8620-902d843596d2 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:48.097034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f8b44-219e-4ced-8620-902d843596d2 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8555aae633c84d15b12fe7e5ab67aba6/users/b4ee0119a43946598d2f9fd09b6ef02f/roles/3aa13ece7ab74136ac5d868bc5e404f2/inherited_to_projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:48.099297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f8b44-219e-4ced-8620-902d843596d2 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=8555aae633c84d15b12fe7e5ab67aba6, user_id=b4ee0119a43946598d2f9fd09b6ef02f, role_id=3aa13ece7ab74136ac5d868bc5e404f2)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:48.102209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f8b44-219e-4ced-8620-902d843596d2 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:48.112068 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4010/8008] 10.222.0.16 () {58 vars in 1560 bytes} [Mon May 2 10:53:48 2022] HEAD /identity/v3/OS-INHERIT/domains/8555aae633c84d15b12fe7e5ab67aba6/users/b4ee0119a43946598d2f9fd09b6ef02f/roles/3aa13ece7ab74136ac5d868bc5e404f2/inherited_to_projects => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:48.113091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4a579-df67-4e3c-8ef6-d4c95fa64447 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:48.124802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4a579-df67-4e3c-8ef6-d4c95fa64447 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:48.130019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6579e6-727c-4639-b2f5-9ffbf7b4b2c5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:48.130902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6579e6-727c-4639-b2f5-9ffbf7b4b2c5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:48.131194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6579e6-727c-4639-b2f5-9ffbf7b4b2c5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:48.131490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6579e6-727c-4639-b2f5-9ffbf7b4b2c5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8555aae633c84d15b12fe7e5ab67aba6/users/b4ee0119a43946598d2f9fd09b6ef02f/roles/3aa13ece7ab74136ac5d868bc5e404f2/inherited_to_projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:48.133869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6579e6-727c-4639-b2f5-9ffbf7b4b2c5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=8555aae633c84d15b12fe7e5ab67aba6, user_id=b4ee0119a43946598d2f9fd09b6ef02f, role_id=3aa13ece7ab74136ac5d868bc5e404f2)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:48.136735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6579e6-727c-4639-b2f5-9ffbf7b4b2c5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:48.144355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cf6579e6-727c-4639-b2f5-9ffbf7b4b2c5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invalidating the token cache because role 3aa13ece7ab74136ac5d868bc5e404f2 was removed from user b4ee0119a43946598d2f9fd09b6ef02f on domain 8555aae633c84d15b12fe7e5ab67aba6. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:48.144698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cf6579e6-727c-4639-b2f5-9ffbf7b4b2c5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:48.145579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cf6579e6-727c-4639-b2f5-9ffbf7b4b2c5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:48.265704 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 3999/8009] 10.222.0.16 () {58 vars in 1562 bytes} [Mon May 2 10:53:48 2022] DELETE /identity/v3/OS-INHERIT/domains/8555aae633c84d15b12fe7e5ab67aba6/users/b4ee0119a43946598d2f9fd09b6ef02f/roles/3aa13ece7ab74136ac5d868bc5e404f2/inherited_to_projects => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:48.269916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f8b44-219e-4ced-8620-902d843596d2 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:48.272379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1c4f8b44-219e-4ced-8620-902d843596d2 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:48.290355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f8b44-219e-4ced-8620-902d843596d2 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:48.351374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e677a-a69e-4c82-bc8d-d1c0fa7ca886 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:48.352240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e677a-a69e-4c82-bc8d-d1c0fa7ca886 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:48.352527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e677a-a69e-4c82-bc8d-d1c0fa7ca886 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:48.352838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e677a-a69e-4c82-bc8d-d1c0fa7ca886 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/roles/3aa13ece7ab74136ac5d868bc5e404f2` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:48.354442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e677a-a69e-4c82-bc8d-d1c0fa7ca886 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3aa13ece7ab74136ac5d868bc5e404f2)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:48.356037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e677a-a69e-4c82-bc8d-d1c0fa7ca886 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:48.472361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8a1e677a-a69e-4c82-bc8d-d1c0fa7ca886 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invalidating the token cache because role 3aa13ece7ab74136ac5d868bc5e404f2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:48.472361 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8a1e677a-a69e-4c82-bc8d-d1c0fa7ca886 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:48.472886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8a1e677a-a69e-4c82-bc8d-d1c0fa7ca886 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:48.475330 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4011/8010] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:48 2022] DELETE /identity/v3/roles/3aa13ece7ab74136ac5d868bc5e404f2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:48.482435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6579e6-727c-4639-b2f5-9ffbf7b4b2c5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:48.496302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6579e6-727c-4639-b2f5-9ffbf7b4b2c5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:48.576118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30509ac8-c5b0-47e6-8d52-274ac1d4608b tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:48.576118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30509ac8-c5b0-47e6-8d52-274ac1d4608b tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:48.576118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30509ac8-c5b0-47e6-8d52-274ac1d4608b tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:48.576475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30509ac8-c5b0-47e6-8d52-274ac1d4608b tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:48.576475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30509ac8-c5b0-47e6-8d52-274ac1d4608b tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:48.576475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30509ac8-c5b0-47e6-8d52-274ac1d4608b tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:48.726016 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4000/8011] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:53:48 2022] POST /identity/v3/roles => generated 239 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:48.729589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e677a-a69e-4c82-bc8d-d1c0fa7ca886 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:48.731131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8a1e677a-a69e-4c82-bc8d-d1c0fa7ca886 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:48.747764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e677a-a69e-4c82-bc8d-d1c0fa7ca886 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:48.754137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c94019-6179-4dbe-b777-8562554e8643 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:48.755298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c94019-6179-4dbe-b777-8562554e8643 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:48.755852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c94019-6179-4dbe-b777-8562554e8643 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:48.756306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c94019-6179-4dbe-b777-8562554e8643 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:48.757393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c94019-6179-4dbe-b777-8562554e8643 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:48.759843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c94019-6179-4dbe-b777-8562554e8643 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:48.871347 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4012/8012] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:48 2022] POST /identity/v3/projects => generated 408 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:48.875667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30509ac8-c5b0-47e6-8d52-274ac1d4608b tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:48.891818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30509ac8-c5b0-47e6-8d52-274ac1d4608b tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:48.955712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bd248-2a77-408e-ba50-e4061101cf0d tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:48.956708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bd248-2a77-408e-ba50-e4061101cf0d tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:48.957204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bd248-2a77-408e-ba50-e4061101cf0d tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:48.957441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bd248-2a77-408e-ba50-e4061101cf0d tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8555aae633c84d15b12fe7e5ab67aba6/users/b4ee0119a43946598d2f9fd09b6ef02f/roles/fada9e7061944510aaba2fbcfc9c5138/inherited_to_projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:48.960931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10bd248-2a77-408e-ba50-e4061101cf0d tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=8555aae633c84d15b12fe7e5ab67aba6, user_id=b4ee0119a43946598d2f9fd09b6ef02f, role_id=fada9e7061944510aaba2fbcfc9c5138)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:48.966376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10bd248-2a77-408e-ba50-e4061101cf0d tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:49.081426 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4001/8013] 10.222.0.16 () {60 vars in 1578 bytes} [Mon May 2 10:53:48 2022] PUT /identity/v3/OS-INHERIT/domains/8555aae633c84d15b12fe7e5ab67aba6/users/b4ee0119a43946598d2f9fd09b6ef02f/roles/fada9e7061944510aaba2fbcfc9c5138/inherited_to_projects => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:49.082646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c94019-6179-4dbe-b777-8562554e8643 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:49.118820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c94019-6179-4dbe-b777-8562554e8643 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:49.181286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af0f0c-133b-42e8-ac81-75a193897143 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:49.181957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af0f0c-133b-42e8-ac81-75a193897143 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:49.182247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af0f0c-133b-42e8-ac81-75a193897143 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:49.182532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af0f0c-133b-42e8-ac81-75a193897143 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:49.183370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af0f0c-133b-42e8-ac81-75a193897143 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Adding query filter params (scope.project.id=adeb8b42772c41deb765db4e0b5b701d, user.id=b4ee0119a43946598d2f9fd09b6ef02f) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:53:49.183711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af0f0c-133b-42e8-ac81-75a193897143 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:49.185652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af0f0c-133b-42e8-ac81-75a193897143 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:49.244090 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4013/8014] 10.222.0.16 () {58 vars in 1355 bytes} [Mon May 2 10:53:49 2022] GET /identity/v3/role_assignments?scope.project.id=adeb8b42772c41deb765db4e0b5b701d&user.id=b4ee0119a43946598d2f9fd09b6ef02f&effective => generated 648 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:49.248321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bd248-2a77-408e-ba50-e4061101cf0d tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:49.259402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bd248-2a77-408e-ba50-e4061101cf0d tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:49.265645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae397a27-ac66-49cf-8700-53a8c7ed898c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:49.267167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae397a27-ac66-49cf-8700-53a8c7ed898c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:49.267167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae397a27-ac66-49cf-8700-53a8c7ed898c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:49.267167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae397a27-ac66-49cf-8700-53a8c7ed898c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:49.268169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae397a27-ac66-49cf-8700-53a8c7ed898c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Adding query filter params (scope.project.id=86183705be3d40a28df5dbb388806e9c, user.id=b4ee0119a43946598d2f9fd09b6ef02f) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:53:49.268578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae397a27-ac66-49cf-8700-53a8c7ed898c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:49.270645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae397a27-ac66-49cf-8700-53a8c7ed898c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:49.348268 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4002/8015] 10.222.0.16 () {58 vars in 1355 bytes} [Mon May 2 10:53:49 2022] GET /identity/v3/role_assignments?scope.project.id=86183705be3d40a28df5dbb388806e9c&user.id=b4ee0119a43946598d2f9fd09b6ef02f&effective => generated 648 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:53:49.352466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af0f0c-133b-42e8-ac81-75a193897143 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:49.367685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af0f0c-133b-42e8-ac81-75a193897143 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:49.379063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002e928-0285-4480-a871-dfbdc06eb51b tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:49.379063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002e928-0285-4480-a871-dfbdc06eb51b tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:49.379063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002e928-0285-4480-a871-dfbdc06eb51b tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:49.379479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002e928-0285-4480-a871-dfbdc06eb51b tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8555aae633c84d15b12fe7e5ab67aba6/users/b4ee0119a43946598d2f9fd09b6ef02f/roles/fada9e7061944510aaba2fbcfc9c5138/inherited_to_projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:49.379479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002e928-0285-4480-a871-dfbdc06eb51b tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=8555aae633c84d15b12fe7e5ab67aba6, user_id=b4ee0119a43946598d2f9fd09b6ef02f, role_id=fada9e7061944510aaba2fbcfc9c5138)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:49.381277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002e928-0285-4480-a871-dfbdc06eb51b tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:49.387374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3002e928-0285-4480-a871-dfbdc06eb51b tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invalidating the token cache because role fada9e7061944510aaba2fbcfc9c5138 was removed from user b4ee0119a43946598d2f9fd09b6ef02f on domain 8555aae633c84d15b12fe7e5ab67aba6. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:49.388287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3002e928-0285-4480-a871-dfbdc06eb51b tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:49.389129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3002e928-0285-4480-a871-dfbdc06eb51b tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:49.471039 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4014/8016] 10.222.0.16 () {58 vars in 1562 bytes} [Mon May 2 10:53:49 2022] DELETE /identity/v3/OS-INHERIT/domains/8555aae633c84d15b12fe7e5ab67aba6/users/b4ee0119a43946598d2f9fd09b6ef02f/roles/fada9e7061944510aaba2fbcfc9c5138/inherited_to_projects => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:49.474778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae397a27-ac66-49cf-8700-53a8c7ed898c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:49.476578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ae397a27-ac66-49cf-8700-53a8c7ed898c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:49.490756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae397a27-ac66-49cf-8700-53a8c7ed898c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:49.554741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf014696-868c-4223-aacd-85c53e77d8b6 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:49.555315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf014696-868c-4223-aacd-85c53e77d8b6 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:49.555600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf014696-868c-4223-aacd-85c53e77d8b6 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:49.555883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf014696-868c-4223-aacd-85c53e77d8b6 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:49.556753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf014696-868c-4223-aacd-85c53e77d8b6 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Adding query filter params (scope.project.id=adeb8b42772c41deb765db4e0b5b701d, user.id=b4ee0119a43946598d2f9fd09b6ef02f) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:53:49.557073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf014696-868c-4223-aacd-85c53e77d8b6 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:49.558931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf014696-868c-4223-aacd-85c53e77d8b6 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:49.606807 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4003/8017] 10.222.0.16 () {58 vars in 1355 bytes} [Mon May 2 10:53:49 2022] GET /identity/v3/role_assignments?scope.project.id=adeb8b42772c41deb765db4e0b5b701d&user.id=b4ee0119a43946598d2f9fd09b6ef02f&effective => generated 228 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:49.610749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002e928-0285-4480-a871-dfbdc06eb51b tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:49.621709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002e928-0285-4480-a871-dfbdc06eb51b tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:49.627836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2457e7-3861-4314-a3fd-7a44472ed896 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:49.628498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2457e7-3861-4314-a3fd-7a44472ed896 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:49.628838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2457e7-3861-4314-a3fd-7a44472ed896 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:49.629130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2457e7-3861-4314-a3fd-7a44472ed896 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:49.629960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2457e7-3861-4314-a3fd-7a44472ed896 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Adding query filter params (scope.project.id=86183705be3d40a28df5dbb388806e9c, user.id=b4ee0119a43946598d2f9fd09b6ef02f) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:53:49.630285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2457e7-3861-4314-a3fd-7a44472ed896 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:49.632263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2457e7-3861-4314-a3fd-7a44472ed896 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:49.683078 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4015/8018] 10.222.0.16 () {58 vars in 1355 bytes} [Mon May 2 10:53:49 2022] GET /identity/v3/role_assignments?scope.project.id=86183705be3d40a28df5dbb388806e9c&user.id=b4ee0119a43946598d2f9fd09b6ef02f&effective => generated 228 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:49.687812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf014696-868c-4223-aacd-85c53e77d8b6 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:49.698316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf014696-868c-4223-aacd-85c53e77d8b6 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:49.705289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe88900-f575-4d4b-9c45-5bed224dd25c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:49.706212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe88900-f575-4d4b-9c45-5bed224dd25c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:49.706506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe88900-f575-4d4b-9c45-5bed224dd25c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:49.706789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe88900-f575-4d4b-9c45-5bed224dd25c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/projects/86183705be3d40a28df5dbb388806e9c` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:49.708013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe88900-f575-4d4b-9c45-5bed224dd25c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:delete_project(project_id=86183705be3d40a28df5dbb388806e9c)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:49.710009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe88900-f575-4d4b-9c45-5bed224dd25c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:49.897510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-afe88900-f575-4d4b-9c45-5bed224dd25c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86183705be3d40a28df5dbb388806e9c', 'request_id': 'req-afe88900-f575-4d4b-9c45-5bed224dd25c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:49.921669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-afe88900-f575-4d4b-9c45-5bed224dd25c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86183705be3d40a28df5dbb388806e9c', 'request_id': 'req-afe88900-f575-4d4b-9c45-5bed224dd25c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:50.030799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-afe88900-f575-4d4b-9c45-5bed224dd25c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86183705be3d40a28df5dbb388806e9c', 'request_id': 'req-afe88900-f575-4d4b-9c45-5bed224dd25c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:50.050212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-afe88900-f575-4d4b-9c45-5bed224dd25c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] The token cache is being invalidate because project 86183705be3d40a28df5dbb388806e9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:50.050703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-afe88900-f575-4d4b-9c45-5bed224dd25c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:50.051796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-afe88900-f575-4d4b-9c45-5bed224dd25c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:50.057479 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4004/8019] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:49 2022] DELETE /identity/v3/projects/86183705be3d40a28df5dbb388806e9c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:50.059058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2457e7-3861-4314-a3fd-7a44472ed896 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:50.062470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9a2457e7-3861-4314-a3fd-7a44472ed896 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:50.087180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2457e7-3861-4314-a3fd-7a44472ed896 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:50.154997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7a7ef-4519-4d50-91d8-0914c358e866 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:50.156574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7a7ef-4519-4d50-91d8-0914c358e866 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:50.162804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7a7ef-4519-4d50-91d8-0914c358e866 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:50.162804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7a7ef-4519-4d50-91d8-0914c358e866 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/roles/fada9e7061944510aaba2fbcfc9c5138` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:50.162804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7a7ef-4519-4d50-91d8-0914c358e866 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fada9e7061944510aaba2fbcfc9c5138)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:50.162804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7a7ef-4519-4d50-91d8-0914c358e866 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:50.252907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3dd7a7ef-4519-4d50-91d8-0914c358e866 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invalidating the token cache because role fada9e7061944510aaba2fbcfc9c5138 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:50.253207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3dd7a7ef-4519-4d50-91d8-0914c358e866 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:50.253892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3dd7a7ef-4519-4d50-91d8-0914c358e866 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:50.255766 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4016/8020] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:50 2022] DELETE /identity/v3/roles/fada9e7061944510aaba2fbcfc9c5138 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:50.269261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe88900-f575-4d4b-9c45-5bed224dd25c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:50.280363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe88900-f575-4d4b-9c45-5bed224dd25c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:50.339964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a88ca-dddd-4241-85cf-e15d95562716 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:50.340644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a88ca-dddd-4241-85cf-e15d95562716 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:50.341458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a88ca-dddd-4241-85cf-e15d95562716 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:50.341736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a88ca-dddd-4241-85cf-e15d95562716 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:50.342489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a88ca-dddd-4241-85cf-e15d95562716 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:50.344094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a88ca-dddd-4241-85cf-e15d95562716 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:50.437958 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4005/8021] 10.222.0.16 () {60 vars in 1142 bytes} [Mon May 2 10:53:50 2022] POST /identity/v3/roles => generated 240 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:50.438119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7a7ef-4519-4d50-91d8-0914c358e866 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:50.438119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3dd7a7ef-4519-4d50-91d8-0914c358e866 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:50.454963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7a7ef-4519-4d50-91d8-0914c358e866 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:50.465345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a4659-b902-4bb9-a09d-7a3b5ef42a1a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:50.466564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a4659-b902-4bb9-a09d-7a3b5ef42a1a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:50.466857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a4659-b902-4bb9-a09d-7a3b5ef42a1a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:50.467140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a4659-b902-4bb9-a09d-7a3b5ef42a1a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:50.467866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a4659-b902-4bb9-a09d-7a3b5ef42a1a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:50.471730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a4659-b902-4bb9-a09d-7a3b5ef42a1a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:50.624796 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4017/8022] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:50 2022] POST /identity/v3/projects => generated 409 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:50.625774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a88ca-dddd-4241-85cf-e15d95562716 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:50.637087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a88ca-dddd-4241-85cf-e15d95562716 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:50.700334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf2ed4-b099-4b90-bc33-84637ca40931 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:50.701265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf2ed4-b099-4b90-bc33-84637ca40931 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:50.701553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf2ed4-b099-4b90-bc33-84637ca40931 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:50.701837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf2ed4-b099-4b90-bc33-84637ca40931 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/adeb8b42772c41deb765db4e0b5b701d/users/b4ee0119a43946598d2f9fd09b6ef02f/roles/4a2519a2d1ef4acea63bcc99575d15aa/inherited_to_projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:50.704351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf2ed4-b099-4b90-bc33-84637ca40931 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:create_grant(project_id=adeb8b42772c41deb765db4e0b5b701d, user_id=b4ee0119a43946598d2f9fd09b6ef02f, role_id=4a2519a2d1ef4acea63bcc99575d15aa)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:50.707079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf2ed4-b099-4b90-bc33-84637ca40931 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:50.771344 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4006/8023] 10.222.0.16 () {60 vars in 1581 bytes} [Mon May 2 10:53:50 2022] PUT /identity/v3/OS-INHERIT/projects/adeb8b42772c41deb765db4e0b5b701d/users/b4ee0119a43946598d2f9fd09b6ef02f/roles/4a2519a2d1ef4acea63bcc99575d15aa/inherited_to_projects => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:50.775552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a4659-b902-4bb9-a09d-7a3b5ef42a1a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:50.787272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a4659-b902-4bb9-a09d-7a3b5ef42a1a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:50.854149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f3946-4da7-4d60-b6c8-deb69f171244 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:50.854825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f3946-4da7-4d60-b6c8-deb69f171244 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:50.855117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f3946-4da7-4d60-b6c8-deb69f171244 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:50.855404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f3946-4da7-4d60-b6c8-deb69f171244 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:50.856297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f3946-4da7-4d60-b6c8-deb69f171244 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Adding query filter params (scope.project.id=733d44bb32a04ab0b867c6db396f78de, user.id=b4ee0119a43946598d2f9fd09b6ef02f) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:53:50.857238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f3946-4da7-4d60-b6c8-deb69f171244 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:50.859212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f3946-4da7-4d60-b6c8-deb69f171244 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:50.915418 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4018/8024] 10.222.0.16 () {58 vars in 1355 bytes} [Mon May 2 10:53:50 2022] GET /identity/v3/role_assignments?scope.project.id=733d44bb32a04ab0b867c6db396f78de&user.id=b4ee0119a43946598d2f9fd09b6ef02f&effective => generated 649 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:50.918142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf2ed4-b099-4b90-bc33-84637ca40931 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:50.939574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf2ed4-b099-4b90-bc33-84637ca40931 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:50.945782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4e6d3-963d-4818-b332-4765127ed465 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:50.946998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4e6d3-963d-4818-b332-4765127ed465 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:50.947561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4e6d3-963d-4818-b332-4765127ed465 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:50.948130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4e6d3-963d-4818-b332-4765127ed465 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/adeb8b42772c41deb765db4e0b5b701d/users/b4ee0119a43946598d2f9fd09b6ef02f/roles/4a2519a2d1ef4acea63bcc99575d15aa/inherited_to_projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:50.951634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4e6d3-963d-4818-b332-4765127ed465 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=adeb8b42772c41deb765db4e0b5b701d, user_id=b4ee0119a43946598d2f9fd09b6ef02f, role_id=4a2519a2d1ef4acea63bcc99575d15aa)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:50.956047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4e6d3-963d-4818-b332-4765127ed465 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:50.964818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dcd4e6d3-963d-4818-b332-4765127ed465 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invalidating the token cache because role 4a2519a2d1ef4acea63bcc99575d15aa was removed from user b4ee0119a43946598d2f9fd09b6ef02f on project adeb8b42772c41deb765db4e0b5b701d. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:50.970470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dcd4e6d3-963d-4818-b332-4765127ed465 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:50.970470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dcd4e6d3-963d-4818-b332-4765127ed465 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:51.058334 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4007/8025] 10.222.0.16 () {58 vars in 1565 bytes} [Mon May 2 10:53:50 2022] DELETE /identity/v3/OS-INHERIT/projects/adeb8b42772c41deb765db4e0b5b701d/users/b4ee0119a43946598d2f9fd09b6ef02f/roles/4a2519a2d1ef4acea63bcc99575d15aa/inherited_to_projects => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:51.063577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f3946-4da7-4d60-b6c8-deb69f171244 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:51.075459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-629f3946-4da7-4d60-b6c8-deb69f171244 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:51.079649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f3946-4da7-4d60-b6c8-deb69f171244 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:51.168369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9666b-cb9c-4fe5-8ac7-9162a16a748e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:51.170064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9666b-cb9c-4fe5-8ac7-9162a16a748e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:51.170064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9666b-cb9c-4fe5-8ac7-9162a16a748e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:51.170263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9666b-cb9c-4fe5-8ac7-9162a16a748e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:51.171026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9666b-cb9c-4fe5-8ac7-9162a16a748e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Adding query filter params (scope.project.id=733d44bb32a04ab0b867c6db396f78de, user.id=b4ee0119a43946598d2f9fd09b6ef02f) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:53:51.171339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9666b-cb9c-4fe5-8ac7-9162a16a748e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:51.173790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9666b-cb9c-4fe5-8ac7-9162a16a748e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:51.232253 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4019/8026] 10.222.0.16 () {58 vars in 1355 bytes} [Mon May 2 10:53:51 2022] GET /identity/v3/role_assignments?scope.project.id=733d44bb32a04ab0b867c6db396f78de&user.id=b4ee0119a43946598d2f9fd09b6ef02f&effective => generated 228 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:53:51.235553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4e6d3-963d-4818-b332-4765127ed465 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:51.245847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4e6d3-963d-4818-b332-4765127ed465 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:51.252464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a22a36-18fd-4d34-a5c6-0749f774283a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:51.253472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a22a36-18fd-4d34-a5c6-0749f774283a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:51.253828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a22a36-18fd-4d34-a5c6-0749f774283a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:51.254175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a22a36-18fd-4d34-a5c6-0749f774283a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/projects/733d44bb32a04ab0b867c6db396f78de` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:51.255470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a22a36-18fd-4d34-a5c6-0749f774283a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:delete_project(project_id=733d44bb32a04ab0b867c6db396f78de)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:51.258295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a22a36-18fd-4d34-a5c6-0749f774283a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:51.425979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-13a22a36-18fd-4d34-a5c6-0749f774283a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '733d44bb32a04ab0b867c6db396f78de', 'request_id': 'req-13a22a36-18fd-4d34-a5c6-0749f774283a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:51.436477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-13a22a36-18fd-4d34-a5c6-0749f774283a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '733d44bb32a04ab0b867c6db396f78de', 'request_id': 'req-13a22a36-18fd-4d34-a5c6-0749f774283a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:51.505820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-13a22a36-18fd-4d34-a5c6-0749f774283a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '733d44bb32a04ab0b867c6db396f78de', 'request_id': 'req-13a22a36-18fd-4d34-a5c6-0749f774283a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:51.518276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-13a22a36-18fd-4d34-a5c6-0749f774283a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] The token cache is being invalidate because project 733d44bb32a04ab0b867c6db396f78de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:51.518569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-13a22a36-18fd-4d34-a5c6-0749f774283a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:51.519226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-13a22a36-18fd-4d34-a5c6-0749f774283a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:51.521230 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4008/8027] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:51 2022] DELETE /identity/v3/projects/733d44bb32a04ab0b867c6db396f78de => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:51.525483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9666b-cb9c-4fe5-8ac7-9162a16a748e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:51.528089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-10a9666b-cb9c-4fe5-8ac7-9162a16a748e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:51.542683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9666b-cb9c-4fe5-8ac7-9162a16a748e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:51.609261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75061e18-42e6-43b1-a158-9a1dc3fb1af5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:51.610129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75061e18-42e6-43b1-a158-9a1dc3fb1af5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:51.610427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75061e18-42e6-43b1-a158-9a1dc3fb1af5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:51.610714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75061e18-42e6-43b1-a158-9a1dc3fb1af5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/roles/4a2519a2d1ef4acea63bcc99575d15aa` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:51.612252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75061e18-42e6-43b1-a158-9a1dc3fb1af5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4a2519a2d1ef4acea63bcc99575d15aa)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:51.613895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75061e18-42e6-43b1-a158-9a1dc3fb1af5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:51.661624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a22a36-18fd-4d34-a5c6-0749f774283a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:51.663124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-13a22a36-18fd-4d34-a5c6-0749f774283a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:51.709512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75061e18-42e6-43b1-a158-9a1dc3fb1af5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invalidating the token cache because role 4a2519a2d1ef4acea63bcc99575d15aa has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:51.709917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75061e18-42e6-43b1-a158-9a1dc3fb1af5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:51.710667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-75061e18-42e6-43b1-a158-9a1dc3fb1af5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:51.712833 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4020/8028] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:51 2022] DELETE /identity/v3/roles/4a2519a2d1ef4acea63bcc99575d15aa => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:51.718981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75061e18-42e6-43b1-a158-9a1dc3fb1af5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:51.720401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-75061e18-42e6-43b1-a158-9a1dc3fb1af5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:51.731620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a22a36-18fd-4d34-a5c6-0749f774283a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:51.783837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75061e18-42e6-43b1-a158-9a1dc3fb1af5 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:51.788085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6ec67-94ca-4ffb-a308-921bd4b3c95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:51.788509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f06fa1-5706-4de4-a9dd-02032c5911fe tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:51.794033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6ec67-94ca-4ffb-a308-921bd4b3c95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:51.794033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6ec67-94ca-4ffb-a308-921bd4b3c95f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:51.794224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f06fa1-5706-4de4-a9dd-02032c5911fe tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:51.794320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6ec67-94ca-4ffb-a308-921bd4b3c95f admin admin] PATH_INFO: `/v3/users/f303b2ff57704cdc9405bf0a51b0d4f4` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:51.794415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f06fa1-5706-4de4-a9dd-02032c5911fe tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:51.794415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f06fa1-5706-4de4-a9dd-02032c5911fe tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/users/b4ee0119a43946598d2f9fd09b6ef02f` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:51.794568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e6ec67-94ca-4ffb-a308-921bd4b3c95f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f303b2ff57704cdc9405bf0a51b0d4f4)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:51.794651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f06fa1-5706-4de4-a9dd-02032c5911fe tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b4ee0119a43946598d2f9fd09b6ef02f)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:51.794746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e6ec67-94ca-4ffb-a308-921bd4b3c95f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:51.794831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f06fa1-5706-4de4-a9dd-02032c5911fe tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:51.920511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-62f06fa1-5706-4de4-a9dd-02032c5911fe tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ee0119a43946598d2f9fd09b6ef02f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:51.932520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-62f06fa1-5706-4de4-a9dd-02032c5911fe tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ee0119a43946598d2f9fd09b6ef02f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:51.933196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-62f06fa1-5706-4de4-a9dd-02032c5911fe tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ee0119a43946598d2f9fd09b6ef02f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:51.940442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-62f06fa1-5706-4de4-a9dd-02032c5911fe tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ee0119a43946598d2f9fd09b6ef02f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:51.958396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c4e6ec67-94ca-4ffb-a308-921bd4b3c95f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f303b2ff57704cdc9405bf0a51b0d4f4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:51.970187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c4e6ec67-94ca-4ffb-a308-921bd4b3c95f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f303b2ff57704cdc9405bf0a51b0d4f4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:51.973393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c4e6ec67-94ca-4ffb-a308-921bd4b3c95f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f303b2ff57704cdc9405bf0a51b0d4f4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:51.977727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c4e6ec67-94ca-4ffb-a308-921bd4b3c95f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f303b2ff57704cdc9405bf0a51b0d4f4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:51.984933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-62f06fa1-5706-4de4-a9dd-02032c5911fe tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ee0119a43946598d2f9fd09b6ef02f'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:51.992995 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4021/8029] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:51 2022] DELETE /identity/v3/users/b4ee0119a43946598d2f9fd09b6ef02f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:51.998625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f06fa1-5706-4de4-a9dd-02032c5911fe tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:52.000684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-62f06fa1-5706-4de4-a9dd-02032c5911fe tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:52.018833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c4e6ec67-94ca-4ffb-a308-921bd4b3c95f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f303b2ff57704cdc9405bf0a51b0d4f4'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:52.034836 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4009/8030] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:51 2022] DELETE /identity/v3/users/f303b2ff57704cdc9405bf0a51b0d4f4 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:52.035886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b199e-db8b-466c-a97b-b72b21754686 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:52.036173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b199e-db8b-466c-a97b-b72b21754686 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:52.036530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b199e-db8b-466c-a97b-b72b21754686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:52.056377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5f7b199e-db8b-466c-a97b-b72b21754686 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:52.057706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5f7b199e-db8b-466c-a97b-b72b21754686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:52.072081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f06fa1-5706-4de4-a9dd-02032c5911fe tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:52.120955 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4010/8031] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:52.131167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b199e-db8b-466c-a97b-b72b21754686 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:52.132175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fedd5-d059-4a46-a762-6b308a78585c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:52.132464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5f7b199e-db8b-466c-a97b-b72b21754686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:52.133106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fedd5-d059-4a46-a762-6b308a78585c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:52.133463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fedd5-d059-4a46-a762-6b308a78585c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:52.133729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fedd5-d059-4a46-a762-6b308a78585c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/groups/b5f71d641b7f412795d2d320b28635a7` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:52.134992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6fedd5-d059-4a46-a762-6b308a78585c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:delete_group(group_id=b5f71d641b7f412795d2d320b28635a7)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:52.136941 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6fedd5-d059-4a46-a762-6b308a78585c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:52.191017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b199e-db8b-466c-a97b-b72b21754686 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:52.194576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541ec8b-78fb-4563-88d7-c29a9fd09d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:52.195217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541ec8b-78fb-4563-88d7-c29a9fd09d93 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:52.195499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541ec8b-78fb-4563-88d7-c29a9fd09d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:52.195777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541ec8b-78fb-4563-88d7-c29a9fd09d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:52.204896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541ec8b-78fb-4563-88d7-c29a9fd09d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:52.206433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541ec8b-78fb-4563-88d7-c29a9fd09d93 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:52.215735 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4011/8032] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:53:52.298942 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4022/8033] 10.222.0.16 () {58 vars in 1226 bytes} [Mon May 2 10:53:51 2022] DELETE /identity/v3/groups/b5f71d641b7f412795d2d320b28635a7 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:52.303031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541ec8b-78fb-4563-88d7-c29a9fd09d93 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:52.304417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6541ec8b-78fb-4563-88d7-c29a9fd09d93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:52.319185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541ec8b-78fb-4563-88d7-c29a9fd09d93 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:52.375599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20772fdc-0618-423b-8b1c-8278f1747378 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:52.376462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20772fdc-0618-423b-8b1c-8278f1747378 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:52.376780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20772fdc-0618-423b-8b1c-8278f1747378 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:52.377057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20772fdc-0618-423b-8b1c-8278f1747378 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/projects/adeb8b42772c41deb765db4e0b5b701d` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:52.378242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20772fdc-0618-423b-8b1c-8278f1747378 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:delete_project(project_id=adeb8b42772c41deb765db4e0b5b701d)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:52.380157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20772fdc-0618-423b-8b1c-8278f1747378 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:52.449577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fedd5-d059-4a46-a762-6b308a78585c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:52.451527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4d6fedd5-d059-4a46-a762-6b308a78585c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:52.495096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-20772fdc-0618-423b-8b1c-8278f1747378 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adeb8b42772c41deb765db4e0b5b701d', 'request_id': 'req-20772fdc-0618-423b-8b1c-8278f1747378'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:52.502642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-20772fdc-0618-423b-8b1c-8278f1747378 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adeb8b42772c41deb765db4e0b5b701d', 'request_id': 'req-20772fdc-0618-423b-8b1c-8278f1747378'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:52.533483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fedd5-d059-4a46-a762-6b308a78585c tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:52.590144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-20772fdc-0618-423b-8b1c-8278f1747378 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adeb8b42772c41deb765db4e0b5b701d', 'request_id': 'req-20772fdc-0618-423b-8b1c-8278f1747378'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:52.593217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e2c3c-4137-4504-8ff5-8b559e6baa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:52.594091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e2c3c-4137-4504-8ff5-8b559e6baa73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:52.594385 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e2c3c-4137-4504-8ff5-8b559e6baa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:52.594655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e2c3c-4137-4504-8ff5-8b559e6baa73 admin admin] PATH_INFO: `/v3/projects/78bd08880fc54674a35eab203f825de5` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:52.595860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e2c3c-4137-4504-8ff5-8b559e6baa73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78bd08880fc54674a35eab203f825de5)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:52.597791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e2c3c-4137-4504-8ff5-8b559e6baa73 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:52.602941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-20772fdc-0618-423b-8b1c-8278f1747378 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] The token cache is being invalidate because project adeb8b42772c41deb765db4e0b5b701d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:52.603319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-20772fdc-0618-423b-8b1c-8278f1747378 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:52.604032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-20772fdc-0618-423b-8b1c-8278f1747378 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:52.605949 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4012/8034] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:52 2022] DELETE /identity/v3/projects/adeb8b42772c41deb765db4e0b5b701d => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:52.610214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20772fdc-0618-423b-8b1c-8278f1747378 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:52.611642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-20772fdc-0618-423b-8b1c-8278f1747378 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:52.674189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20772fdc-0618-423b-8b1c-8278f1747378 tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:52.678828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1ecaa-eccf-446c-96eb-d4e5d773a32a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:52.679682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1ecaa-eccf-446c-96eb-d4e5d773a32a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:52.679970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1ecaa-eccf-446c-96eb-d4e5d773a32a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:52.680250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1ecaa-eccf-446c-96eb-d4e5d773a32a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/domains/8555aae633c84d15b12fe7e5ab67aba6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:52.681600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1ecaa-eccf-446c-96eb-d4e5d773a32a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8555aae633c84d15b12fe7e5ab67aba6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:52.683197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1ecaa-eccf-446c-96eb-d4e5d773a32a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:52.702125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-20f1ecaa-eccf-446c-96eb-d4e5d773a32a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8555aae633c84d15b12fe7e5ab67aba6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:52.702733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-20f1ecaa-eccf-446c-96eb-d4e5d773a32a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8555aae633c84d15b12fe7e5ab67aba6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:52.710532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8e0e2c3c-4137-4504-8ff5-8b559e6baa73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78bd08880fc54674a35eab203f825de5', 'request_id': 'req-8e0e2c3c-4137-4504-8ff5-8b559e6baa73'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:52.776443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-20f1ecaa-eccf-446c-96eb-d4e5d773a32a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8555aae633c84d15b12fe7e5ab67aba6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:52.777085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-20f1ecaa-eccf-446c-96eb-d4e5d773a32a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8555aae633c84d15b12fe7e5ab67aba6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:52.780064 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4013/8035] 10.222.0.16 () {60 vars in 1248 bytes} [Mon May 2 10:53:52 2022] PATCH /identity/v3/domains/8555aae633c84d15b12fe7e5ab67aba6 => generated 277 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:53:52.783778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1ecaa-eccf-446c-96eb-d4e5d773a32a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:52.785066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-20f1ecaa-eccf-446c-96eb-d4e5d773a32a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:52.789937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8e0e2c3c-4137-4504-8ff5-8b559e6baa73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78bd08880fc54674a35eab203f825de5', 'request_id': 'req-8e0e2c3c-4137-4504-8ff5-8b559e6baa73'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:52.797306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8e0e2c3c-4137-4504-8ff5-8b559e6baa73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78bd08880fc54674a35eab203f825de5', 'request_id': 'req-8e0e2c3c-4137-4504-8ff5-8b559e6baa73'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:52.807580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8e0e2c3c-4137-4504-8ff5-8b559e6baa73 admin admin] The token cache is being invalidate because project 78bd08880fc54674a35eab203f825de5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:52.807877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8e0e2c3c-4137-4504-8ff5-8b559e6baa73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:52.808550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8e0e2c3c-4137-4504-8ff5-8b559e6baa73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:52.810166 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4023/8036] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:52 2022] DELETE /identity/v3/projects/78bd08880fc54674a35eab203f825de5 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:52.814929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf734a-6c93-461b-b25c-ad97bde17477 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:52.815221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf734a-6c93-461b-b25c-ad97bde17477 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:52.815507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf734a-6c93-461b-b25c-ad97bde17477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:52.833540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-40cf734a-6c93-461b-b25c-ad97bde17477 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:52.834743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-40cf734a-6c93-461b-b25c-ad97bde17477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:52.847898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1ecaa-eccf-446c-96eb-d4e5d773a32a tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:52.853393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27449d97-62a8-476a-bdb9-5bd8029a5c2e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8a71d68fa3e492d8fea30a3249567d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '198302ee998e416e833de3ac874314e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:52.854265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27449d97-62a8-476a-bdb9-5bd8029a5c2e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:52.854554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27449d97-62a8-476a-bdb9-5bd8029a5c2e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:52.854832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27449d97-62a8-476a-bdb9-5bd8029a5c2e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] PATH_INFO: `/v3/domains/8555aae633c84d15b12fe7e5ab67aba6` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:52.866535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27449d97-62a8-476a-bdb9-5bd8029a5c2e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8555aae633c84d15b12fe7e5ab67aba6)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:52.868161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27449d97-62a8-476a-bdb9-5bd8029a5c2e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:52.889736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-27449d97-62a8-476a-bdb9-5bd8029a5c2e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8555aae633c84d15b12fe7e5ab67aba6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:52.893443 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4024/8037] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:53:52.899284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-27449d97-62a8-476a-bdb9-5bd8029a5c2e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8555aae633c84d15b12fe7e5ab67aba6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:52.901717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58bd46-892c-4bdf-9ab1-b1706104fc31 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:52.902013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58bd46-892c-4bdf-9ab1-b1706104fc31 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:52.902294 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58bd46-892c-4bdf-9ab1-b1706104fc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:52.921337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-5e58bd46-892c-4bdf-9ab1-b1706104fc31 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:52.922657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5e58bd46-892c-4bdf-9ab1-b1706104fc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:52.931305 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4025/8038] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:53:52.935577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58bd46-892c-4bdf-9ab1-b1706104fc31 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:52.944689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58bd46-892c-4bdf-9ab1-b1706104fc31 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:52.949517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db42fe-dac5-4e7d-a0df-3f9bfb50efa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:52.950770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db42fe-dac5-4e7d-a0df-3f9bfb50efa0 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:52.951072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db42fe-dac5-4e7d-a0df-3f9bfb50efa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:52.951355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db42fe-dac5-4e7d-a0df-3f9bfb50efa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:52.952077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db42fe-dac5-4e7d-a0df-3f9bfb50efa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:53:52.952438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db42fe-dac5-4e7d-a0df-3f9bfb50efa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:52.954242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db42fe-dac5-4e7d-a0df-3f9bfb50efa0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:52.969378 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4026/8039] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:53:52.971982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db42fe-dac5-4e7d-a0df-3f9bfb50efa0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:52.981494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db42fe-dac5-4e7d-a0df-3f9bfb50efa0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:52.986245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e63eb-afdd-4c4a-a10a-331ff4a91384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:52.986870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e63eb-afdd-4c4a-a10a-331ff4a91384 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:52.987160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e63eb-afdd-4c4a-a10a-331ff4a91384 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:52.987445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e63eb-afdd-4c4a-a10a-331ff4a91384 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:52.988125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e63eb-afdd-4c4a-a10a-331ff4a91384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:52.990071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e63eb-afdd-4c4a-a10a-331ff4a91384 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:53.026956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-27449d97-62a8-476a-bdb9-5bd8029a5c2e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8555aae633c84d15b12fe7e5ab67aba6', 'request_id': 'req-27449d97-62a8-476a-bdb9-5bd8029a5c2e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:53.034287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-27449d97-62a8-476a-bdb9-5bd8029a5c2e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8555aae633c84d15b12fe7e5ab67aba6', 'request_id': 'req-27449d97-62a8-476a-bdb9-5bd8029a5c2e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:53.069704 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4027/8040] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:52 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:53.071263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e63eb-afdd-4c4a-a10a-331ff4a91384 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:53.110671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-27449d97-62a8-476a-bdb9-5bd8029a5c2e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8555aae633c84d15b12fe7e5ab67aba6', 'request_id': 'req-27449d97-62a8-476a-bdb9-5bd8029a5c2e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:53.122878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-27449d97-62a8-476a-bdb9-5bd8029a5c2e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] The token cache is being invalidate because project 8555aae633c84d15b12fe7e5ab67aba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:53.123173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-27449d97-62a8-476a-bdb9-5bd8029a5c2e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:53.123848 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-27449d97-62a8-476a-bdb9-5bd8029a5c2e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:53.131218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-27449d97-62a8-476a-bdb9-5bd8029a5c2e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8555aae633c84d15b12fe7e5ab67aba6', 'request_id': 'req-27449d97-62a8-476a-bdb9-5bd8029a5c2e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:53.134773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-27449d97-62a8-476a-bdb9-5bd8029a5c2e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8555aae633c84d15b12fe7e5ab67aba6', 'request_id': 'req-27449d97-62a8-476a-bdb9-5bd8029a5c2e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:53.135468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-27449d97-62a8-476a-bdb9-5bd8029a5c2e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8555aae633c84d15b12fe7e5ab67aba6', 'request_id': 'req-27449d97-62a8-476a-bdb9-5bd8029a5c2e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:53.136438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e63eb-afdd-4c4a-a10a-331ff4a91384 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:53.142766 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4014/8041] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:53:52 2022] DELETE /identity/v3/domains/8555aae633c84d15b12fe7e5ab67aba6 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:53.142950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64702f9-bcb1-467b-9200-daaccff3a6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:53.143387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64702f9-bcb1-467b-9200-daaccff3a6ea admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:53.143672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64702f9-bcb1-467b-9200-daaccff3a6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:53.143977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64702f9-bcb1-467b-9200-daaccff3a6ea admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:53.144703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64702f9-bcb1-467b-9200-daaccff3a6ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:53.146165 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27449d97-62a8-476a-bdb9-5bd8029a5c2e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:53.146925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64702f9-bcb1-467b-9200-daaccff3a6ea admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:53.147557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-27449d97-62a8-476a-bdb9-5bd8029a5c2e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:53.210727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27449d97-62a8-476a-bdb9-5bd8029a5c2e tempest-InheritsV3TestJSON-272228528 tempest-InheritsV3TestJSON-272228528-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:53.215332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31066c7-f094-4045-a7f6-fa165039bb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:53.216894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31066c7-f094-4045-a7f6-fa165039bb8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:53.217183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31066c7-f094-4045-a7f6-fa165039bb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:53.217463 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31066c7-f094-4045-a7f6-fa165039bb8d admin admin] PATH_INFO: `/v3/users/61303ce801054f51b1fa4a814e2fb64b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:53.218667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31066c7-f094-4045-a7f6-fa165039bb8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=61303ce801054f51b1fa4a814e2fb64b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:53.220675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31066c7-f094-4045-a7f6-fa165039bb8d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:53.258444 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4028/8042] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:53:53 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:53.263223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64702f9-bcb1-467b-9200-daaccff3a6ea admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:53.264851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f64702f9-bcb1-467b-9200-daaccff3a6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:53.276747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64702f9-bcb1-467b-9200-daaccff3a6ea admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:53.282161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3979f7-f250-404e-82e3-092a87ece403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:53.282814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3979f7-f250-404e-82e3-092a87ece403 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:53.283100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3979f7-f250-404e-82e3-092a87ece403 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:53.283424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3979f7-f250-404e-82e3-092a87ece403 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:53.284132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3979f7-f250-404e-82e3-092a87ece403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:53.285772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3979f7-f250-404e-82e3-092a87ece403 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:53.295572 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4029/8043] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:53:53.299446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3979f7-f250-404e-82e3-092a87ece403 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:53.309946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3979f7-f250-404e-82e3-092a87ece403 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:53.314590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875d6cf-be29-4539-9dc6-ff80bda19c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:53.315280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875d6cf-be29-4539-9dc6-ff80bda19c37 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:53.315549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875d6cf-be29-4539-9dc6-ff80bda19c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:53.315828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875d6cf-be29-4539-9dc6-ff80bda19c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:53.316567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875d6cf-be29-4539-9dc6-ff80bda19c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:53.318155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875d6cf-be29-4539-9dc6-ff80bda19c37 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:53.329776 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4030/8044] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:53.333854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875d6cf-be29-4539-9dc6-ff80bda19c37 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:53.343825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875d6cf-be29-4539-9dc6-ff80bda19c37 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:53.348539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1b756-0aae-4ee2-9099-1f97ca663f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:53.349464 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1b756-0aae-4ee2-9099-1f97ca663f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:53.349749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1b756-0aae-4ee2-9099-1f97ca663f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:53.350028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1b756-0aae-4ee2-9099-1f97ca663f3d admin admin] PATH_INFO: `/v3/projects/338615e31b6d40afa8284770f941785d/users/ae225802744348a59b3525a3b8041c44/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:53.364911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1b756-0aae-4ee2-9099-1f97ca663f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=338615e31b6d40afa8284770f941785d, user_id=ae225802744348a59b3525a3b8041c44, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:53.367583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1b756-0aae-4ee2-9099-1f97ca663f3d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:53.397941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a31066c7-f094-4045-a7f6-fa165039bb8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61303ce801054f51b1fa4a814e2fb64b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:53.410941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a31066c7-f094-4045-a7f6-fa165039bb8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61303ce801054f51b1fa4a814e2fb64b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:53.411711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a31066c7-f094-4045-a7f6-fa165039bb8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61303ce801054f51b1fa4a814e2fb64b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:53.418329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a31066c7-f094-4045-a7f6-fa165039bb8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61303ce801054f51b1fa4a814e2fb64b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:53.459213 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4031/8045] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:53 2022] PUT /identity/v3/projects/338615e31b6d40afa8284770f941785d/users/ae225802744348a59b3525a3b8041c44/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:53.469365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9526061-16de-43f8-9607-25490d53e747 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:53.469593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9526061-16de-43f8-9607-25490d53e747 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:53.469874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9526061-16de-43f8-9607-25490d53e747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:53.481580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a31066c7-f094-4045-a7f6-fa165039bb8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61303ce801054f51b1fa4a814e2fb64b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:53.488213 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4015/8046] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:53 2022] DELETE /identity/v3/users/61303ce801054f51b1fa4a814e2fb64b => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:53.495031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08ad18-6d27-4311-9f6b-862120d5a523 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:53.495323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08ad18-6d27-4311-9f6b-862120d5a523 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:53.495876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08ad18-6d27-4311-9f6b-862120d5a523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:53.496113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b9526061-16de-43f8-9607-25490d53e747 None None] MFA Rules not processed for user `ae225802744348a59b3525a3b8041c44`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:53.498185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b9526061-16de-43f8-9607-25490d53e747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:53.514059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2b08ad18-6d27-4311-9f6b-862120d5a523 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:53.515250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2b08ad18-6d27-4311-9f6b-862120d5a523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:53.565071 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4032/8047] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:53:53.574499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9526061-16de-43f8-9607-25490d53e747 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:53.576737 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4016/8048] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:53:53.577077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b9526061-16de-43f8-9607-25490d53e747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:53.586686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08ad18-6d27-4311-9f6b-862120d5a523 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:53.594760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2b08ad18-6d27-4311-9f6b-862120d5a523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:53.644027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9526061-16de-43f8-9607-25490d53e747 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:53.648273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e113da-05fb-4082-8a95-1d7f00b95813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:53.648968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e113da-05fb-4082-8a95-1d7f00b95813 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:53.649261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e113da-05fb-4082-8a95-1d7f00b95813 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:53.649544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e113da-05fb-4082-8a95-1d7f00b95813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:53.653518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08ad18-6d27-4311-9f6b-862120d5a523 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:53.657341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef749fa5-5eba-4b97-b7c4-b63a13fea7c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:53.658043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef749fa5-5eba-4b97-b7c4-b63a13fea7c8 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:53.658329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef749fa5-5eba-4b97-b7c4-b63a13fea7c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:53.658609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef749fa5-5eba-4b97-b7c4-b63a13fea7c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:53.658999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e113da-05fb-4082-8a95-1d7f00b95813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:53.660629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e113da-05fb-4082-8a95-1d7f00b95813 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:53.667976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef749fa5-5eba-4b97-b7c4-b63a13fea7c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:53.669983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef749fa5-5eba-4b97-b7c4-b63a13fea7c8 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:53.670556 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4033/8049] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:53:53.681385 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4017/8050] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:53:54.142738 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e113da-05fb-4082-8a95-1d7f00b95813 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:54.144383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-39e113da-05fb-4082-8a95-1d7f00b95813 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:54.159163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e113da-05fb-4082-8a95-1d7f00b95813 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:54.164539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec130509-5d40-4898-aa9d-b1e11b85d734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:54.165633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130509-5d40-4898-aa9d-b1e11b85d734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:54.166036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130509-5d40-4898-aa9d-b1e11b85d734 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:54.166322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130509-5d40-4898-aa9d-b1e11b85d734 admin admin] PATH_INFO: `/v3/projects/dd9650bf3c8b401fb2644f9f66c4f340` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:54.167823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec130509-5d40-4898-aa9d-b1e11b85d734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd9650bf3c8b401fb2644f9f66c4f340)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:54.170501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec130509-5d40-4898-aa9d-b1e11b85d734 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:54.258084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ec130509-5d40-4898-aa9d-b1e11b85d734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd9650bf3c8b401fb2644f9f66c4f340', 'request_id': 'req-ec130509-5d40-4898-aa9d-b1e11b85d734'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:54.304466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ec130509-5d40-4898-aa9d-b1e11b85d734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd9650bf3c8b401fb2644f9f66c4f340', 'request_id': 'req-ec130509-5d40-4898-aa9d-b1e11b85d734'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:54.310913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ec130509-5d40-4898-aa9d-b1e11b85d734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd9650bf3c8b401fb2644f9f66c4f340', 'request_id': 'req-ec130509-5d40-4898-aa9d-b1e11b85d734'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:54.321374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ec130509-5d40-4898-aa9d-b1e11b85d734 admin admin] The token cache is being invalidate because project dd9650bf3c8b401fb2644f9f66c4f340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:54.321665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ec130509-5d40-4898-aa9d-b1e11b85d734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:54.322323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ec130509-5d40-4898-aa9d-b1e11b85d734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:54.323889 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4034/8051] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:54 2022] DELETE /identity/v3/projects/dd9650bf3c8b401fb2644f9f66c4f340 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:54.328022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef749fa5-5eba-4b97-b7c4-b63a13fea7c8 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:54.337727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef749fa5-5eba-4b97-b7c4-b63a13fea7c8 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:54.400411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe4618-f40c-46eb-8c7b-c831271eefa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:54.401482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe4618-f40c-46eb-8c7b-c831271eefa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:54.402400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe4618-f40c-46eb-8c7b-c831271eefa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:54.402400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe4618-f40c-46eb-8c7b-c831271eefa4 admin admin] PATH_INFO: `/v3/users/b8a71d68fa3e492d8fea30a3249567d1` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:54.404648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe4618-f40c-46eb-8c7b-c831271eefa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8a71d68fa3e492d8fea30a3249567d1)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:54.406572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe4618-f40c-46eb-8c7b-c831271eefa4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:54.581356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fabe4618-f40c-46eb-8c7b-c831271eefa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8a71d68fa3e492d8fea30a3249567d1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:54.593782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fabe4618-f40c-46eb-8c7b-c831271eefa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8a71d68fa3e492d8fea30a3249567d1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:54.594553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fabe4618-f40c-46eb-8c7b-c831271eefa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8a71d68fa3e492d8fea30a3249567d1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:54.601456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fabe4618-f40c-46eb-8c7b-c831271eefa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8a71d68fa3e492d8fea30a3249567d1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:54.661990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-fabe4618-f40c-46eb-8c7b-c831271eefa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8a71d68fa3e492d8fea30a3249567d1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:54.668453 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4018/8052] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:54 2022] DELETE /identity/v3/users/b8a71d68fa3e492d8fea30a3249567d1 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:55.111337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec130509-5d40-4898-aa9d-b1e11b85d734 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:55.113077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ec130509-5d40-4898-aa9d-b1e11b85d734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:55.127117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec130509-5d40-4898-aa9d-b1e11b85d734 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:55.191949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0ecb6-522e-4c98-b050-618310351377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:55.193037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0ecb6-522e-4c98-b050-618310351377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:55.193340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0ecb6-522e-4c98-b050-618310351377 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:55.193617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0ecb6-522e-4c98-b050-618310351377 admin admin] PATH_INFO: `/v3/projects/198302ee998e416e833de3ac874314e7` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:55.194909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0ecb6-522e-4c98-b050-618310351377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=198302ee998e416e833de3ac874314e7)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:55.196853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0ecb6-522e-4c98-b050-618310351377 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:55.306477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5dc0ecb6-522e-4c98-b050-618310351377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '198302ee998e416e833de3ac874314e7', 'request_id': 'req-5dc0ecb6-522e-4c98-b050-618310351377'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:55.384785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5dc0ecb6-522e-4c98-b050-618310351377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '198302ee998e416e833de3ac874314e7', 'request_id': 'req-5dc0ecb6-522e-4c98-b050-618310351377'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:55.392554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5dc0ecb6-522e-4c98-b050-618310351377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '198302ee998e416e833de3ac874314e7', 'request_id': 'req-5dc0ecb6-522e-4c98-b050-618310351377'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:55.404057 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5dc0ecb6-522e-4c98-b050-618310351377 admin admin] The token cache is being invalidate because project 198302ee998e416e833de3ac874314e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:55.404311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5dc0ecb6-522e-4c98-b050-618310351377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:55.405006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-5dc0ecb6-522e-4c98-b050-618310351377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:55.406731 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4035/8053] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:55 2022] DELETE /identity/v3/projects/198302ee998e416e833de3ac874314e7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:55.411653 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48087a9b-9574-4b94-bdf5-0612bcbd3e45 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:55.411943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48087a9b-9574-4b94-bdf5-0612bcbd3e45 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:55.412277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48087a9b-9574-4b94-bdf5-0612bcbd3e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:55.431124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-48087a9b-9574-4b94-bdf5-0612bcbd3e45 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:55.432754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-48087a9b-9574-4b94-bdf5-0612bcbd3e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:55.491974 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4019/8054] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:55.499973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36820c7b-0152-462a-ba9c-b91fd6b98320 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:55.500266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36820c7b-0152-462a-ba9c-b91fd6b98320 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:55.500549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36820c7b-0152-462a-ba9c-b91fd6b98320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:55.520473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-36820c7b-0152-462a-ba9c-b91fd6b98320 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:55.521810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-36820c7b-0152-462a-ba9c-b91fd6b98320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:55.530485 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4036/8055] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:55.534755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48087a9b-9574-4b94-bdf5-0612bcbd3e45 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:55.544814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48087a9b-9574-4b94-bdf5-0612bcbd3e45 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:55.549372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3e20c-6d52-4cb3-8702-d7076510a8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:55.550063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3e20c-6d52-4cb3-8702-d7076510a8da admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:55.550345 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3e20c-6d52-4cb3-8702-d7076510a8da admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:55.550623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3e20c-6d52-4cb3-8702-d7076510a8da admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:55.551340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3e20c-6d52-4cb3-8702-d7076510a8da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:53:55.551649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3e20c-6d52-4cb3-8702-d7076510a8da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:55.553281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3e20c-6d52-4cb3-8702-d7076510a8da admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:55.564941 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4020/8056] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:55.569499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36820c7b-0152-462a-ba9c-b91fd6b98320 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:55.580337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36820c7b-0152-462a-ba9c-b91fd6b98320 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:55.585174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1c23c-0d10-45d7-b9ac-661c9ba8bae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:55.585831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1c23c-0d10-45d7-b9ac-661c9ba8bae8 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:55.586142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1c23c-0d10-45d7-b9ac-661c9ba8bae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:55.586423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1c23c-0d10-45d7-b9ac-661c9ba8bae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:55.587155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1c23c-0d10-45d7-b9ac-661c9ba8bae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:55.589135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1c23c-0d10-45d7-b9ac-661c9ba8bae8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:55.694267 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4037/8057] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:55 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:55.695494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3e20c-6d52-4cb3-8702-d7076510a8da admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:55.707067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3e20c-6d52-4cb3-8702-d7076510a8da admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:55.768341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c27185-2c49-470b-849b-a7ee23cacd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:55.769069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c27185-2c49-470b-849b-a7ee23cacd92 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:55.769357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c27185-2c49-470b-849b-a7ee23cacd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:55.769633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c27185-2c49-470b-849b-a7ee23cacd92 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:55.770328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c27185-2c49-470b-849b-a7ee23cacd92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:55.772273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c27185-2c49-470b-849b-a7ee23cacd92 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:55.857151 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4021/8058] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:53:55 2022] POST /identity/v3/users => generated 284 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:55.858310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1c23c-0d10-45d7-b9ac-661c9ba8bae8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:55.868958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1c23c-0d10-45d7-b9ac-661c9ba8bae8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:55.874341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef923a3a-e365-4b1f-b0d3-cf3d387da2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:55.875042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef923a3a-e365-4b1f-b0d3-cf3d387da2ab admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:55.875455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef923a3a-e365-4b1f-b0d3-cf3d387da2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:55.875742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef923a3a-e365-4b1f-b0d3-cf3d387da2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:55.876475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef923a3a-e365-4b1f-b0d3-cf3d387da2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:55.878148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef923a3a-e365-4b1f-b0d3-cf3d387da2ab admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:55.890248 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4038/8059] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:53:55.894153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c27185-2c49-470b-849b-a7ee23cacd92 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:55.904253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c27185-2c49-470b-849b-a7ee23cacd92 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:55.909105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0650007-afbb-48aa-85c0-2eb4eeedb143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:55.909764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0650007-afbb-48aa-85c0-2eb4eeedb143 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:55.910075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0650007-afbb-48aa-85c0-2eb4eeedb143 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:55.910329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0650007-afbb-48aa-85c0-2eb4eeedb143 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:55.911052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0650007-afbb-48aa-85c0-2eb4eeedb143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:55.912674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0650007-afbb-48aa-85c0-2eb4eeedb143 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:55.933011 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4022/8060] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:53:55.933214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef923a3a-e365-4b1f-b0d3-cf3d387da2ab admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:55.938099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef923a3a-e365-4b1f-b0d3-cf3d387da2ab admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:55.942869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5c06e-7c93-4b3d-aa44-c4a9a463e34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:55.944136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5c06e-7c93-4b3d-aa44-c4a9a463e34b admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:55.944136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5c06e-7c93-4b3d-aa44-c4a9a463e34b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:55.944489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5c06e-7c93-4b3d-aa44-c4a9a463e34b admin admin] PATH_INFO: `/v3/projects/da7d1983d47641e8bfc168cfae7d77be/users/0067959d17124c78a1cc15aee2a5e7e6/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:55.959960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5c06e-7c93-4b3d-aa44-c4a9a463e34b admin admin] RBAC: Authorizing `identity:create_grant(project_id=da7d1983d47641e8bfc168cfae7d77be, user_id=0067959d17124c78a1cc15aee2a5e7e6, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:55.962681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5c06e-7c93-4b3d-aa44-c4a9a463e34b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:56.036404 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4039/8061] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:55 2022] PUT /identity/v3/projects/da7d1983d47641e8bfc168cfae7d77be/users/0067959d17124c78a1cc15aee2a5e7e6/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:56.047352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71455b1b-c306-45ec-abc5-45bee6416290 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:56.047644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71455b1b-c306-45ec-abc5-45bee6416290 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:56.047928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71455b1b-c306-45ec-abc5-45bee6416290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:56.075364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-71455b1b-c306-45ec-abc5-45bee6416290 None None] MFA Rules not processed for user `0067959d17124c78a1cc15aee2a5e7e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:56.076512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-71455b1b-c306-45ec-abc5-45bee6416290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:56.139975 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4023/8062] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:56.144534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5c06e-7c93-4b3d-aa44-c4a9a463e34b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:56.207027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5c06e-7c93-4b3d-aa44-c4a9a463e34b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:56.211936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced860d-ff5b-43b0-97b5-a348e20550b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:56.212739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced860d-ff5b-43b0-97b5-a348e20550b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:56.213163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced860d-ff5b-43b0-97b5-a348e20550b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:56.213599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced860d-ff5b-43b0-97b5-a348e20550b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:56.214322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced860d-ff5b-43b0-97b5-a348e20550b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:56.216428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced860d-ff5b-43b0-97b5-a348e20550b9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:56.280248 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4040/8063] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:56 2022] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:56.281396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71455b1b-c306-45ec-abc5-45bee6416290 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:56.292227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71455b1b-c306-45ec-abc5-45bee6416290 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:56.351733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54361ec6-7c75-4e91-8e6e-d78105c7ecfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:56.352402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54361ec6-7c75-4e91-8e6e-d78105c7ecfb admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:56.352722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54361ec6-7c75-4e91-8e6e-d78105c7ecfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:56.353000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54361ec6-7c75-4e91-8e6e-d78105c7ecfb admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:56.353681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54361ec6-7c75-4e91-8e6e-d78105c7ecfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:56.355615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54361ec6-7c75-4e91-8e6e-d78105c7ecfb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:56.436426 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4024/8064] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:53:56 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:56.440350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced860d-ff5b-43b0-97b5-a348e20550b9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:56.451689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced860d-ff5b-43b0-97b5-a348e20550b9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:56.456542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c6a6d-30e2-4b31-8aec-ecbc6c37778e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:56.462010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c6a6d-30e2-4b31-8aec-ecbc6c37778e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:56.462010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c6a6d-30e2-4b31-8aec-ecbc6c37778e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:56.462010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c6a6d-30e2-4b31-8aec-ecbc6c37778e admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:56.462010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c6a6d-30e2-4b31-8aec-ecbc6c37778e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:56.462010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c6a6d-30e2-4b31-8aec-ecbc6c37778e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:56.471149 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4041/8065] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:56.475370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54361ec6-7c75-4e91-8e6e-d78105c7ecfb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:56.485875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54361ec6-7c75-4e91-8e6e-d78105c7ecfb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:56.490619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161a749-82f4-4554-b114-f3fa514eb1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:56.495194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161a749-82f4-4554-b114-f3fa514eb1e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:56.495194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161a749-82f4-4554-b114-f3fa514eb1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:56.495194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161a749-82f4-4554-b114-f3fa514eb1e2 admin admin] PATH_INFO: `/v3/projects/78821c5bc57841078df73d9ffd137939/users/05cf3f9ba9284fbc84c91df270369844/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:56.507222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161a749-82f4-4554-b114-f3fa514eb1e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78821c5bc57841078df73d9ffd137939, user_id=05cf3f9ba9284fbc84c91df270369844, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:56.511150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161a749-82f4-4554-b114-f3fa514eb1e2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:56.580622 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4025/8066] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:56 2022] PUT /identity/v3/projects/78821c5bc57841078df73d9ffd137939/users/05cf3f9ba9284fbc84c91df270369844/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:56.585083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c6a6d-30e2-4b31-8aec-ecbc6c37778e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:56.596812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c6a6d-30e2-4b31-8aec-ecbc6c37778e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:56.664957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62672b-16b7-43b8-be3b-8331d4a05eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:56.665836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62672b-16b7-43b8-be3b-8331d4a05eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:56.666089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62672b-16b7-43b8-be3b-8331d4a05eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:56.666492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62672b-16b7-43b8-be3b-8331d4a05eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:56.667232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c62672b-16b7-43b8-be3b-8331d4a05eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:56.669395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c62672b-16b7-43b8-be3b-8331d4a05eb6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:56.679838 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4042/8067] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:56.684088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161a749-82f4-4554-b114-f3fa514eb1e2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:56.695431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161a749-82f4-4554-b114-f3fa514eb1e2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:56.700131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af813f-4887-4c70-afde-16154eabae59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:56.701135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af813f-4887-4c70-afde-16154eabae59 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:56.701429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af813f-4887-4c70-afde-16154eabae59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:56.701755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af813f-4887-4c70-afde-16154eabae59 admin admin] PATH_INFO: `/v3/projects/78821c5bc57841078df73d9ffd137939/users/05cf3f9ba9284fbc84c91df270369844/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:56.703694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af813f-4887-4c70-afde-16154eabae59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78821c5bc57841078df73d9ffd137939, user_id=05cf3f9ba9284fbc84c91df270369844, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:56.706428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af813f-4887-4c70-afde-16154eabae59 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:56.729573 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4026/8068] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:56 2022] PUT /identity/v3/projects/78821c5bc57841078df73d9ffd137939/users/05cf3f9ba9284fbc84c91df270369844/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:56.814627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82d1ff-353b-415b-89c2-4c6938ea0041 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:56.814916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82d1ff-353b-415b-89c2-4c6938ea0041 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:56.815200 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82d1ff-353b-415b-89c2-4c6938ea0041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:56.848116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9e82d1ff-353b-415b-89c2-4c6938ea0041 None None] MFA Rules not processed for user `05cf3f9ba9284fbc84c91df270369844`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:56.849716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9e82d1ff-353b-415b-89c2-4c6938ea0041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:56.953557 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4043/8069] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:56 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:56.954847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af813f-4887-4c70-afde-16154eabae59 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:56.969565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af813f-4887-4c70-afde-16154eabae59 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:56.977411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5efc31-a679-459b-9cf9-0aa72d507093 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cf3f9ba9284fbc84c91df270369844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78821c5bc57841078df73d9ffd137939', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:56.978260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5efc31-a679-459b-9cf9-0aa72d507093 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:56.978550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5efc31-a679-459b-9cf9-0aa72d507093 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:56.979806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5efc31-a679-459b-9cf9-0aa72d507093 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:56.980543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5efc31-a679-459b-9cf9-0aa72d507093 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:56.982827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5efc31-a679-459b-9cf9-0aa72d507093 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:57.076096 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4027/8070] 10.222.0.16 () {60 vars in 1151 bytes} [Mon May 2 10:53:56 2022] POST /identity/v3/services => generated 240 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:57.077922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82d1ff-353b-415b-89c2-4c6938ea0041 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:57.087539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82d1ff-353b-415b-89c2-4c6938ea0041 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:57.103785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f70c4d-0cce-476d-b399-d005ecda8a79 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cf3f9ba9284fbc84c91df270369844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78821c5bc57841078df73d9ffd137939', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:57.104785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f70c4d-0cce-476d-b399-d005ecda8a79 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:57.105144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f70c4d-0cce-476d-b399-d005ecda8a79 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:57.105526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f70c4d-0cce-476d-b399-d005ecda8a79 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] PATH_INFO: `/v3/services/a4fc62f8692142a09cacbcc30cdc6778` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:57.106295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f70c4d-0cce-476d-b399-d005ecda8a79 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a4fc62f8692142a09cacbcc30cdc6778)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:57.108050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f70c4d-0cce-476d-b399-d005ecda8a79 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:57.232461 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4044/8071] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:57 2022] DELETE /identity/v3/services/a4fc62f8692142a09cacbcc30cdc6778 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:57.237308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5efc31-a679-459b-9cf9-0aa72d507093 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:57.253845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5efc31-a679-459b-9cf9-0aa72d507093 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:57.269977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a837d3-f639-416e-8e7e-6e35d721b7c3 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cf3f9ba9284fbc84c91df270369844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78821c5bc57841078df73d9ffd137939', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:57.270788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a837d3-f639-416e-8e7e-6e35d721b7c3 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:57.271215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a837d3-f639-416e-8e7e-6e35d721b7c3 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:57.279225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a837d3-f639-416e-8e7e-6e35d721b7c3 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:57.279225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a837d3-f639-416e-8e7e-6e35d721b7c3 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:57.279225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a837d3-f639-416e-8e7e-6e35d721b7c3 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:57.294582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f70c4d-0cce-476d-b399-d005ecda8a79 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:57.296481 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b0f70c4d-0cce-476d-b399-d005ecda8a79 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:57.380541 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4028/8072] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:57 2022] POST /identity/v3/services => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:57.385127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a837d3-f639-416e-8e7e-6e35d721b7c3 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:57.407609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f70c4d-0cce-476d-b399-d005ecda8a79 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:57.410279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a837d3-f639-416e-8e7e-6e35d721b7c3 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:57.416399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544db88f-3133-42d5-a808-08461872d84e tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cf3f9ba9284fbc84c91df270369844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78821c5bc57841078df73d9ffd137939', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:57.417675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544db88f-3133-42d5-a808-08461872d84e tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:57.418126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544db88f-3133-42d5-a808-08461872d84e tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:57.418412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544db88f-3133-42d5-a808-08461872d84e tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] PATH_INFO: `/v3/services/aa2d69492f2847ad9c0cf76880fc8430` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:57.419687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544db88f-3133-42d5-a808-08461872d84e tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorizing `identity:update_service(service_id=aa2d69492f2847ad9c0cf76880fc8430)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:57.420755 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-544db88f-3133-42d5-a808-08461872d84e tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:53:57.420755 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:53:57.420755 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:53:57.421650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544db88f-3133-42d5-a808-08461872d84e tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:57.423996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1aea3f-4d06-46b5-b6a7-b4b4a6bb8e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:57.424931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1aea3f-4d06-46b5-b6a7-b4b4a6bb8e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:57.425223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1aea3f-4d06-46b5-b6a7-b4b4a6bb8e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:57.425504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1aea3f-4d06-46b5-b6a7-b4b4a6bb8e77 admin admin] PATH_INFO: `/v3/users/64dc59860b5a4156b666c5307a43c925` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:57.426728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1aea3f-4d06-46b5-b6a7-b4b4a6bb8e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64dc59860b5a4156b666c5307a43c925)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:57.428725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1aea3f-4d06-46b5-b6a7-b4b4a6bb8e77 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:57.497483 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4029/8073] 10.222.0.16 () {60 vars in 1251 bytes} [Mon May 2 10:53:57 2022] PATCH /identity/v3/services/aa2d69492f2847ad9c0cf76880fc8430 => generated 282 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:53:57.498462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544db88f-3133-42d5-a808-08461872d84e tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:57.517927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544db88f-3133-42d5-a808-08461872d84e tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:57.522570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6875c7-58bf-41ca-b83b-e4d35c58d402 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cf3f9ba9284fbc84c91df270369844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78821c5bc57841078df73d9ffd137939', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:57.523405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6875c7-58bf-41ca-b83b-e4d35c58d402 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:57.523691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6875c7-58bf-41ca-b83b-e4d35c58d402 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:57.523969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6875c7-58bf-41ca-b83b-e4d35c58d402 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] PATH_INFO: `/v3/services/aa2d69492f2847ad9c0cf76880fc8430` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:57.524630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6875c7-58bf-41ca-b83b-e4d35c58d402 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorizing `identity:get_service(service_id=aa2d69492f2847ad9c0cf76880fc8430)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:57.525957 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-fc6875c7-58bf-41ca-b83b-e4d35c58d402 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:53:57.525957 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:53:57.525957 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:53:57.526867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6875c7-58bf-41ca-b83b-e4d35c58d402 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:57.533767 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4030/8074] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:53:57 2022] GET /identity/v3/services/aa2d69492f2847ad9c0cf76880fc8430 => generated 282 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:53:57.538870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6875c7-58bf-41ca-b83b-e4d35c58d402 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:57.549155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6875c7-58bf-41ca-b83b-e4d35c58d402 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:57.553849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c26fe3-d9dd-452d-ab7b-b33b3293d4b1 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cf3f9ba9284fbc84c91df270369844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78821c5bc57841078df73d9ffd137939', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:57.554762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c26fe3-d9dd-452d-ab7b-b33b3293d4b1 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:57.555021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c26fe3-d9dd-452d-ab7b-b33b3293d4b1 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:57.555390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c26fe3-d9dd-452d-ab7b-b33b3293d4b1 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] PATH_INFO: `/v3/services/aa2d69492f2847ad9c0cf76880fc8430` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:57.555946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c26fe3-d9dd-452d-ab7b-b33b3293d4b1 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorizing `identity:delete_service(service_id=aa2d69492f2847ad9c0cf76880fc8430)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:57.557584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c26fe3-d9dd-452d-ab7b-b33b3293d4b1 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:57.632352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2c1aea3f-4d06-46b5-b6a7-b4b4a6bb8e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64dc59860b5a4156b666c5307a43c925'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:57.644207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2c1aea3f-4d06-46b5-b6a7-b4b4a6bb8e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64dc59860b5a4156b666c5307a43c925'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:57.644932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2c1aea3f-4d06-46b5-b6a7-b4b4a6bb8e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64dc59860b5a4156b666c5307a43c925'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:57.652741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2c1aea3f-4d06-46b5-b6a7-b4b4a6bb8e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64dc59860b5a4156b666c5307a43c925'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:57.655509 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4031/8075] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:57 2022] DELETE /identity/v3/services/aa2d69492f2847ad9c0cf76880fc8430 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:57.659540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c26fe3-d9dd-452d-ab7b-b33b3293d4b1 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:57.680729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c26fe3-d9dd-452d-ab7b-b33b3293d4b1 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:57.686376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe66320-50db-4bfb-ad4e-60bcb7090929 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cf3f9ba9284fbc84c91df270369844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78821c5bc57841078df73d9ffd137939', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:57.687230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe66320-50db-4bfb-ad4e-60bcb7090929 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:57.687520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe66320-50db-4bfb-ad4e-60bcb7090929 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:57.687804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe66320-50db-4bfb-ad4e-60bcb7090929 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] PATH_INFO: `/v3/services/aa2d69492f2847ad9c0cf76880fc8430` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:57.688452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe66320-50db-4bfb-ad4e-60bcb7090929 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorizing `identity:get_service(service_id=aa2d69492f2847ad9c0cf76880fc8430)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:57.690087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe66320-50db-4bfb-ad4e-60bcb7090929 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:57.711802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-6fe66320-50db-4bfb-ad4e-60bcb7090929 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Could not find service: aa2d69492f2847ad9c0cf76880fc8430.: keystone.exception.ServiceNotFound: Could not find service: aa2d69492f2847ad9c0cf76880fc8430. May 02 10:53:57.711802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:53:57.711802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 02 10:53:57.711802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 02 10:53:57.711802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 02 10:53:57.711802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 02 10:53:57.711802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 02 10:53:57.711802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 10:53:57.711802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: aa2d69492f2847ad9c0cf76880fc8430. May 02 10:53:57.711802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:53:57.711802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 02 10:53:57.711802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:53:57.711802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:53:57.711802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:53:57.711802 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:53:57.713494 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:53:57.713494 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:53:57.713494 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:53:57.713494 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:53:57.713494 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:53:57.713494 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:53:57.713494 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:53:57.713494 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:53:57.713494 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 02 10:53:57.713494 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._get_service(service_id) May 02 10:53:57.713494 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 02 10:53:57.713494 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 02 10:53:57.713494 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:53:57.713494 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:53:57.713494 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 02 10:53:57.713494 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 02 10:53:57.714792 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 02 10:53:57.714792 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.get_or_create( May 02 10:53:57.714792 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 02 10:53:57.714792 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application with Lock( May 02 10:53:57.714792 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 02 10:53:57.714792 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self._enter() May 02 10:53:57.714792 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 02 10:53:57.714792 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 02 10:53:57.714792 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 02 10:53:57.714792 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.creator() May 02 10:53:57.714792 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 02 10:53:57.714792 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application created_value = creator( May 02 10:53:57.714792 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 02 10:53:57.714792 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 02 10:53:57.714792 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: aa2d69492f2847ad9c0cf76880fc8430. May 02 10:53:57.714792 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:53:57.715785 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4032/8076] 10.222.0.16 () {58 vars in 1229 bytes} [Mon May 2 10:53:57 2022] GET /identity/v3/services/aa2d69492f2847ad9c0cf76880fc8430 => generated 113 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 02 10:53:57.718241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe66320-50db-4bfb-ad4e-60bcb7090929 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:57.727053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2c1aea3f-4d06-46b5-b6a7-b4b4a6bb8e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64dc59860b5a4156b666c5307a43c925'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:57.730464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe66320-50db-4bfb-ad4e-60bcb7090929 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:57.734872 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4045/8077] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:57 2022] DELETE /identity/v3/users/64dc59860b5a4156b666c5307a43c925 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:57.738080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704192d-582f-4d29-ac1f-676f65dc283f tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cf3f9ba9284fbc84c91df270369844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78821c5bc57841078df73d9ffd137939', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:57.738754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704192d-582f-4d29-ac1f-676f65dc283f tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:57.739053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704192d-582f-4d29-ac1f-676f65dc283f tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:57.739335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704192d-582f-4d29-ac1f-676f65dc283f tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:57.739798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73259e51-049d-4d83-a0e0-80eae535303d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:57.740053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704192d-582f-4d29-ac1f-676f65dc283f tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:57.740296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73259e51-049d-4d83-a0e0-80eae535303d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:57.740704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73259e51-049d-4d83-a0e0-80eae535303d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:57.741756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704192d-582f-4d29-ac1f-676f65dc283f tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:57.760690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-73259e51-049d-4d83-a0e0-80eae535303d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:57.761985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-73259e51-049d-4d83-a0e0-80eae535303d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:57.812478 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4033/8078] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:57 2022] POST /identity/v3/services => generated 274 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:57.816439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704192d-582f-4d29-ac1f-676f65dc283f tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:57.818171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b704192d-582f-4d29-ac1f-676f65dc283f tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:57.853578 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704192d-582f-4d29-ac1f-676f65dc283f tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:57.854100 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4046/8079] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:57 2022] POST /identity/v3/auth/tokens => generated 3396 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:53:57.866425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73259e51-049d-4d83-a0e0-80eae535303d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:57.868174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-73259e51-049d-4d83-a0e0-80eae535303d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:57.923450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af5c7b-d4ad-4ec3-96dc-d52adbe1d10c tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cf3f9ba9284fbc84c91df270369844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78821c5bc57841078df73d9ffd137939', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:57.924242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af5c7b-d4ad-4ec3-96dc-d52adbe1d10c tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:57.924641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af5c7b-d4ad-4ec3-96dc-d52adbe1d10c tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:57.925365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af5c7b-d4ad-4ec3-96dc-d52adbe1d10c tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:57.925854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af5c7b-d4ad-4ec3-96dc-d52adbe1d10c tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:57.927573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af5c7b-d4ad-4ec3-96dc-d52adbe1d10c tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:57.952431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73259e51-049d-4d83-a0e0-80eae535303d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:57.956716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4904c70-869f-490d-8c33-af19fc2d1721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:57.957443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4904c70-869f-490d-8c33-af19fc2d1721 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:57.958086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4904c70-869f-490d-8c33-af19fc2d1721 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:57.958318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4904c70-869f-490d-8c33-af19fc2d1721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:57.969546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4904c70-869f-490d-8c33-af19fc2d1721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:57.971010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4904c70-869f-490d-8c33-af19fc2d1721 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:57.982546 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4047/8080] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:57 2022] GET /identity/v3/auth/tokens => generated 3396 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:53:58.003141 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4034/8081] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:57 2022] POST /identity/v3/services => generated 274 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:58.007570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4904c70-869f-490d-8c33-af19fc2d1721 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:58.019467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4904c70-869f-490d-8c33-af19fc2d1721 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:58.036238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212b715-8546-49f0-ba6c-bd7105d9e3bb tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cf3f9ba9284fbc84c91df270369844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78821c5bc57841078df73d9ffd137939', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:58.037235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212b715-8546-49f0-ba6c-bd7105d9e3bb tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:58.037601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212b715-8546-49f0-ba6c-bd7105d9e3bb tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:58.037960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212b715-8546-49f0-ba6c-bd7105d9e3bb tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:58.039030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212b715-8546-49f0-ba6c-bd7105d9e3bb tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:58.040740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212b715-8546-49f0-ba6c-bd7105d9e3bb tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:58.120647 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4048/8082] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:58 2022] POST /identity/v3/services => generated 275 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:53:58.122203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af5c7b-d4ad-4ec3-96dc-d52adbe1d10c tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:58.133103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af5c7b-d4ad-4ec3-96dc-d52adbe1d10c tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:58.148960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc656f95-d2ab-4ffc-9710-505aa90ac1cb tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cf3f9ba9284fbc84c91df270369844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78821c5bc57841078df73d9ffd137939', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:58.149782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc656f95-d2ab-4ffc-9710-505aa90ac1cb tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:58.150073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc656f95-d2ab-4ffc-9710-505aa90ac1cb tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:58.150354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc656f95-d2ab-4ffc-9710-505aa90ac1cb tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:58.151045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc656f95-d2ab-4ffc-9710-505aa90ac1cb tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:58.152063 ncdv-master-1 devstack@keystone.service[91119]: WARNING py.warnings [None req-dc656f95-d2ab-4ffc-9710-505aa90ac1cb tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:53:58.152063 ncdv-master-1 devstack@keystone.service[91119]: warnings.warn(msg) May 02 10:53:58.152063 ncdv-master-1 devstack@keystone.service[91119]: May 02 10:53:58.152987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc656f95-d2ab-4ffc-9710-505aa90ac1cb tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:58.162045 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4035/8083] 10.222.0.16 () {58 vars in 1130 bytes} [Mon May 2 10:53:58 2022] GET /identity/v3/services => generated 2978 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:58.166796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212b715-8546-49f0-ba6c-bd7105d9e3bb tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:58.179230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212b715-8546-49f0-ba6c-bd7105d9e3bb tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:58.187023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830314e-8ef9-436b-809e-9bbbb5bb05e6 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cf3f9ba9284fbc84c91df270369844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78821c5bc57841078df73d9ffd137939', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:58.188298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830314e-8ef9-436b-809e-9bbbb5bb05e6 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:58.188728 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830314e-8ef9-436b-809e-9bbbb5bb05e6 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:58.189504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830314e-8ef9-436b-809e-9bbbb5bb05e6 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:58.190764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830314e-8ef9-436b-809e-9bbbb5bb05e6 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1822952054) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:53:58.191183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830314e-8ef9-436b-809e-9bbbb5bb05e6 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:58.192210 ncdv-master-1 devstack@keystone.service[91118]: WARNING py.warnings [None req-6830314e-8ef9-436b-809e-9bbbb5bb05e6 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 02 10:53:58.192210 ncdv-master-1 devstack@keystone.service[91118]: warnings.warn(msg) May 02 10:53:58.192210 ncdv-master-1 devstack@keystone.service[91118]: May 02 10:53:58.193161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830314e-8ef9-436b-809e-9bbbb5bb05e6 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:58.198978 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4049/8084] 10.222.0.16 () {58 vars in 1221 bytes} [Mon May 2 10:53:58 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1822952054 => generated 417 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:58.203628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc656f95-d2ab-4ffc-9710-505aa90ac1cb tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:58.214546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc656f95-d2ab-4ffc-9710-505aa90ac1cb tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:58.221539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5cf84-785f-4c89-874e-ae85fb2c1869 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cf3f9ba9284fbc84c91df270369844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78821c5bc57841078df73d9ffd137939', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:58.222421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5cf84-785f-4c89-874e-ae85fb2c1869 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:58.222689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5cf84-785f-4c89-874e-ae85fb2c1869 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:58.223108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5cf84-785f-4c89-874e-ae85fb2c1869 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:58.223834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5cf84-785f-4c89-874e-ae85fb2c1869 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-822461322) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:53:58.224202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5cf84-785f-4c89-874e-ae85fb2c1869 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:58.225864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5cf84-785f-4c89-874e-ae85fb2c1869 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:58.235632 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4036/8085] 10.222.0.16 () {58 vars in 1219 bytes} [Mon May 2 10:53:58 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-822461322 => generated 416 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:58.236930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830314e-8ef9-436b-809e-9bbbb5bb05e6 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:58.248672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830314e-8ef9-436b-809e-9bbbb5bb05e6 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:58.253894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cf771-2109-4703-b1e6-0412b0c1c6f9 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cf3f9ba9284fbc84c91df270369844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78821c5bc57841078df73d9ffd137939', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:58.254983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cf771-2109-4703-b1e6-0412b0c1c6f9 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:58.255502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cf771-2109-4703-b1e6-0412b0c1c6f9 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:58.256281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cf771-2109-4703-b1e6-0412b0c1c6f9 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] PATH_INFO: `/v3/services` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:58.256749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cf771-2109-4703-b1e6-0412b0c1c6f9 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-2051298074) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:53:58.257426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cf771-2109-4703-b1e6-0412b0c1c6f9 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:58.260639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cf771-2109-4703-b1e6-0412b0c1c6f9 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:58.268723 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4050/8086] 10.222.0.16 () {58 vars in 1221 bytes} [Mon May 2 10:53:58 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-2051298074 => generated 418 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:53:58.274589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5cf84-785f-4c89-874e-ae85fb2c1869 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:58.291112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5cf84-785f-4c89-874e-ae85fb2c1869 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:58.297894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c8d2a-b068-4787-8b80-7d979bb6fcae tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cf3f9ba9284fbc84c91df270369844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78821c5bc57841078df73d9ffd137939', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:58.298778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c8d2a-b068-4787-8b80-7d979bb6fcae tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:58.299049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c8d2a-b068-4787-8b80-7d979bb6fcae tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:58.299328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c8d2a-b068-4787-8b80-7d979bb6fcae tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] PATH_INFO: `/v3/services/e1cc360a974d4d25af2d437616e1e815` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:58.300077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c8d2a-b068-4787-8b80-7d979bb6fcae tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorizing `identity:delete_service(service_id=e1cc360a974d4d25af2d437616e1e815)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:58.302389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c8d2a-b068-4787-8b80-7d979bb6fcae tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:58.409398 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4037/8087] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:58 2022] DELETE /identity/v3/services/e1cc360a974d4d25af2d437616e1e815 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:58.414299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cf771-2109-4703-b1e6-0412b0c1c6f9 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:58.427317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cf771-2109-4703-b1e6-0412b0c1c6f9 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:58.436400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c8d2a-b068-4787-8b80-7d979bb6fcae tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:58.438606 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-682c8d2a-b068-4787-8b80-7d979bb6fcae tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:58.446657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ec68b-23ed-4e3b-8588-717cf5d87af3 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cf3f9ba9284fbc84c91df270369844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78821c5bc57841078df73d9ffd137939', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:58.447701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ec68b-23ed-4e3b-8588-717cf5d87af3 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:58.448077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ec68b-23ed-4e3b-8588-717cf5d87af3 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:58.448260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ec68b-23ed-4e3b-8588-717cf5d87af3 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] PATH_INFO: `/v3/services/b527aaddcb1747f98786c06bdc3c0914` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:58.448992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ec68b-23ed-4e3b-8588-717cf5d87af3 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b527aaddcb1747f98786c06bdc3c0914)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:58.451166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ec68b-23ed-4e3b-8588-717cf5d87af3 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:58.477286 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c8d2a-b068-4787-8b80-7d979bb6fcae tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:58.481711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f8e65-4b33-43e4-87c7-fdd1c03fac36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:58.482638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f8e65-4b33-43e4-87c7-fdd1c03fac36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:58.482926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f8e65-4b33-43e4-87c7-fdd1c03fac36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:58.483204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f8e65-4b33-43e4-87c7-fdd1c03fac36 admin admin] PATH_INFO: `/v3/projects/2161f6c2a9c042f291228503be66aeb5` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:58.484416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f8e65-4b33-43e4-87c7-fdd1c03fac36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2161f6c2a9c042f291228503be66aeb5)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:58.486496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f8e65-4b33-43e4-87c7-fdd1c03fac36 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:58.522121 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4051/8088] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:58 2022] DELETE /identity/v3/services/b527aaddcb1747f98786c06bdc3c0914 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:58.526124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ec68b-23ed-4e3b-8588-717cf5d87af3 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:58.545983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ec68b-23ed-4e3b-8588-717cf5d87af3 tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:58.550796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f950ca1-927a-467f-8e8e-4a4b933651ba tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05cf3f9ba9284fbc84c91df270369844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78821c5bc57841078df73d9ffd137939', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:58.551726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f950ca1-927a-467f-8e8e-4a4b933651ba tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:58.552019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f950ca1-927a-467f-8e8e-4a4b933651ba tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:58.552305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f950ca1-927a-467f-8e8e-4a4b933651ba tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] PATH_INFO: `/v3/services/f729c910ed6e4252ae9aafb6b8260611` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:58.553017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f950ca1-927a-467f-8e8e-4a4b933651ba tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f729c910ed6e4252ae9aafb6b8260611)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:58.555549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f950ca1-927a-467f-8e8e-4a4b933651ba tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:58.573387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-006f8e65-4b33-43e4-87c7-fdd1c03fac36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2161f6c2a9c042f291228503be66aeb5', 'request_id': 'req-006f8e65-4b33-43e4-87c7-fdd1c03fac36'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:58.580433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-006f8e65-4b33-43e4-87c7-fdd1c03fac36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2161f6c2a9c042f291228503be66aeb5', 'request_id': 'req-006f8e65-4b33-43e4-87c7-fdd1c03fac36'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:58.636832 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4052/8089] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:58 2022] DELETE /identity/v3/services/f729c910ed6e4252ae9aafb6b8260611 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:53:58.644437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f950ca1-927a-467f-8e8e-4a4b933651ba tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:58.646306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2f950ca1-927a-467f-8e8e-4a4b933651ba tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:58.647930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-006f8e65-4b33-43e4-87c7-fdd1c03fac36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2161f6c2a9c042f291228503be66aeb5', 'request_id': 'req-006f8e65-4b33-43e4-87c7-fdd1c03fac36'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:58.665524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-006f8e65-4b33-43e4-87c7-fdd1c03fac36 admin admin] The token cache is being invalidate because project 2161f6c2a9c042f291228503be66aeb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:53:58.665948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-006f8e65-4b33-43e4-87c7-fdd1c03fac36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:58.666723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-006f8e65-4b33-43e4-87c7-fdd1c03fac36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:58.670048 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4038/8090] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:58 2022] DELETE /identity/v3/projects/2161f6c2a9c042f291228503be66aeb5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:58.674695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0127e-6f8e-4c1f-a9d8-71e0210d3fbf None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:58.675110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0127e-6f8e-4c1f-a9d8-71e0210d3fbf None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:58.675224 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f950ca1-927a-467f-8e8e-4a4b933651ba tempest-ServicesTestJSON-1389763390 tempest-ServicesTestJSON-1389763390-project-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:58.675523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0127e-6f8e-4c1f-a9d8-71e0210d3fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:58.695753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a4d0127e-6f8e-4c1f-a9d8-71e0210d3fbf None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:58.697570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a4d0127e-6f8e-4c1f-a9d8-71e0210d3fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:58.742717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698a65f-2968-4c3e-b9de-b41f8649c10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:58.743797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698a65f-2968-4c3e-b9de-b41f8649c10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:58.744120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698a65f-2968-4c3e-b9de-b41f8649c10a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:58.744852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698a65f-2968-4c3e-b9de-b41f8649c10a admin admin] PATH_INFO: `/v3/users/0067959d17124c78a1cc15aee2a5e7e6` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:58.746109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698a65f-2968-4c3e-b9de-b41f8649c10a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0067959d17124c78a1cc15aee2a5e7e6)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:58.748578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698a65f-2968-4c3e-b9de-b41f8649c10a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:58.768225 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4039/8091] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:53:58.770419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dcf23-2d2b-4daf-930c-f3835817e2cf None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:58.771024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dcf23-2d2b-4daf-930c-f3835817e2cf None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:58.771313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dcf23-2d2b-4daf-930c-f3835817e2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:58.789480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-153dcf23-2d2b-4daf-930c-f3835817e2cf None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:58.790610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-153dcf23-2d2b-4daf-930c-f3835817e2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:58.798935 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4040/8092] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:58.806783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153dcf23-2d2b-4daf-930c-f3835817e2cf None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:58.812771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153dcf23-2d2b-4daf-930c-f3835817e2cf None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:58.818089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42aed5-52f5-44d0-8ef3-f453ed0fbf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:58.818738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42aed5-52f5-44d0-8ef3-f453ed0fbf77 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:58.819030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42aed5-52f5-44d0-8ef3-f453ed0fbf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:58.819313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42aed5-52f5-44d0-8ef3-f453ed0fbf77 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:58.820073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42aed5-52f5-44d0-8ef3-f453ed0fbf77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:53:58.820534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42aed5-52f5-44d0-8ef3-f453ed0fbf77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:58.822186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42aed5-52f5-44d0-8ef3-f453ed0fbf77 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:58.834845 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4041/8093] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:53:58.839003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42aed5-52f5-44d0-8ef3-f453ed0fbf77 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:58.849629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42aed5-52f5-44d0-8ef3-f453ed0fbf77 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:58.854496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ef8ee-36dd-4c45-bcd7-84c5ae261284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:58.855151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ef8ee-36dd-4c45-bcd7-84c5ae261284 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:58.855443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ef8ee-36dd-4c45-bcd7-84c5ae261284 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:58.855723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ef8ee-36dd-4c45-bcd7-84c5ae261284 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:58.856576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ef8ee-36dd-4c45-bcd7-84c5ae261284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:58.858811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ef8ee-36dd-4c45-bcd7-84c5ae261284 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:58.936143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e698a65f-2968-4c3e-b9de-b41f8649c10a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0067959d17124c78a1cc15aee2a5e7e6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:58.936420 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4042/8094] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:53:58 2022] POST /identity/v3/projects => generated 399 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:58.941669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ef8ee-36dd-4c45-bcd7-84c5ae261284 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:58.949133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e698a65f-2968-4c3e-b9de-b41f8649c10a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0067959d17124c78a1cc15aee2a5e7e6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:58.950377 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e698a65f-2968-4c3e-b9de-b41f8649c10a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0067959d17124c78a1cc15aee2a5e7e6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:58.959291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e698a65f-2968-4c3e-b9de-b41f8649c10a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0067959d17124c78a1cc15aee2a5e7e6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:59.004982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ef8ee-36dd-4c45-bcd7-84c5ae261284 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:59.009693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb71560-a68b-4111-9df4-f2468d2d38fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:59.010361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb71560-a68b-4111-9df4-f2468d2d38fb admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:59.010646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb71560-a68b-4111-9df4-f2468d2d38fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:59.010929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb71560-a68b-4111-9df4-f2468d2d38fb admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:59.011836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb71560-a68b-4111-9df4-f2468d2d38fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:59.013427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-e698a65f-2968-4c3e-b9de-b41f8649c10a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0067959d17124c78a1cc15aee2a5e7e6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:53:59.014032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb71560-a68b-4111-9df4-f2468d2d38fb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:59.027304 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4053/8095] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:53:58 2022] DELETE /identity/v3/users/0067959d17124c78a1cc15aee2a5e7e6 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:59.029202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac09d1-1f3e-4330-9f95-1f1e480683dd None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:59.029527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac09d1-1f3e-4330-9f95-1f1e480683dd None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:59.029815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac09d1-1f3e-4330-9f95-1f1e480683dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:59.048442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1cac09d1-1f3e-4330-9f95-1f1e480683dd None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:59.049642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1cac09d1-1f3e-4330-9f95-1f1e480683dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:59.114964 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4054/8096] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:59.124794 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4043/8097] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:53:58 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:53:59.125881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac09d1-1f3e-4330-9f95-1f1e480683dd None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:59.128136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1cac09d1-1f3e-4330-9f95-1f1e480683dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:59.128767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb71560-a68b-4111-9df4-f2468d2d38fb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:59.130763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1fb71560-a68b-4111-9df4-f2468d2d38fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:59.143322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb71560-a68b-4111-9df4-f2468d2d38fb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:59.148082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662133d5-6db4-4bae-bb26-a0dee74dc3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:59.148793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662133d5-6db4-4bae-bb26-a0dee74dc3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:59.149084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662133d5-6db4-4bae-bb26-a0dee74dc3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:59.149658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662133d5-6db4-4bae-bb26-a0dee74dc3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:59.150228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662133d5-6db4-4bae-bb26-a0dee74dc3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:59.151848 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662133d5-6db4-4bae-bb26-a0dee74dc3b9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:59.164705 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4044/8098] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:59.166354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662133d5-6db4-4bae-bb26-a0dee74dc3b9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:59.176697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662133d5-6db4-4bae-bb26-a0dee74dc3b9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:59.181979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0812cf-486b-457a-a643-0c4117ea7f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:59.182739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0812cf-486b-457a-a643-0c4117ea7f10 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:59.183019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0812cf-486b-457a-a643-0c4117ea7f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:59.183349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0812cf-486b-457a-a643-0c4117ea7f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:59.184107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0812cf-486b-457a-a643-0c4117ea7f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:59.186315 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0812cf-486b-457a-a643-0c4117ea7f10 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:59.200044 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4045/8099] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:53:59.201292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0812cf-486b-457a-a643-0c4117ea7f10 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:59.209948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac09d1-1f3e-4330-9f95-1f1e480683dd None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:59.212094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0812cf-486b-457a-a643-0c4117ea7f10 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:59.213603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df82a7-e347-42e4-97be-bbc3493c0a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:59.219133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df82a7-e347-42e4-97be-bbc3493c0a99 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:59.219133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df82a7-e347-42e4-97be-bbc3493c0a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:59.219133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df82a7-e347-42e4-97be-bbc3493c0a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:59.219411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71ce26-1127-44a8-b62b-6fc32f8b6247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:59.219411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71ce26-1127-44a8-b62b-6fc32f8b6247 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:59.219411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71ce26-1127-44a8-b62b-6fc32f8b6247 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:59.219411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71ce26-1127-44a8-b62b-6fc32f8b6247 admin admin] PATH_INFO: `/v3/projects/2827d1e1688c459fa4a3078297cbbfc5/users/fadb79774ea24b12b22150064091845e/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:59.224061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df82a7-e347-42e4-97be-bbc3493c0a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:59.225565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df82a7-e347-42e4-97be-bbc3493c0a99 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:59.234414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71ce26-1127-44a8-b62b-6fc32f8b6247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2827d1e1688c459fa4a3078297cbbfc5, user_id=fadb79774ea24b12b22150064091845e, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:59.235518 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4055/8100] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:53:59.242218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71ce26-1127-44a8-b62b-6fc32f8b6247 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:59.379269 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4046/8101] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:53:59 2022] PUT /identity/v3/projects/2827d1e1688c459fa4a3078297cbbfc5/users/fadb79774ea24b12b22150064091845e/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:53:59.390082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaa45f-a128-47f5-992b-67fa39cabb88 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:59.392680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaa45f-a128-47f5-992b-67fa39cabb88 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:59.392680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaa45f-a128-47f5-992b-67fa39cabb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:59.422504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a2eaa45f-a128-47f5-992b-67fa39cabb88 None None] MFA Rules not processed for user `fadb79774ea24b12b22150064091845e`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:53:59.423884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a2eaa45f-a128-47f5-992b-67fa39cabb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:59.510608 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4056/8102] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:53:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:53:59.523253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71ce26-1127-44a8-b62b-6fc32f8b6247 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:59.525753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3f71ce26-1127-44a8-b62b-6fc32f8b6247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:59.601387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71ce26-1127-44a8-b62b-6fc32f8b6247 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:59.605046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dde44-f168-4b79-aa88-a08f6becdcb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:59.605718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dde44-f168-4b79-aa88-a08f6becdcb1 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:59.606007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dde44-f168-4b79-aa88-a08f6becdcb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:59.606867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dde44-f168-4b79-aa88-a08f6becdcb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:59.615401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95dde44-f168-4b79-aa88-a08f6becdcb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:59.618358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95dde44-f168-4b79-aa88-a08f6becdcb1 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:59.625970 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4047/8103] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:53:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:53:59.700516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eaa45f-a128-47f5-992b-67fa39cabb88 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:53:59.702039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a2eaa45f-a128-47f5-992b-67fa39cabb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:53:59.818407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eaa45f-a128-47f5-992b-67fa39cabb88 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:53:59.823338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb2f7d-c4ab-43e4-83e0-bf7c6e40b856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:53:59.824296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb2f7d-c4ab-43e4-83e0-bf7c6e40b856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:53:59.824570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb2f7d-c4ab-43e4-83e0-bf7c6e40b856 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:53:59.825403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb2f7d-c4ab-43e4-83e0-bf7c6e40b856 admin admin] PATH_INFO: `/v3/projects/da7d1983d47641e8bfc168cfae7d77be` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:53:59.832496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb2f7d-c4ab-43e4-83e0-bf7c6e40b856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da7d1983d47641e8bfc168cfae7d77be)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:53:59.835172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb2f7d-c4ab-43e4-83e0-bf7c6e40b856 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:53:59.984393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ceb2f7d-c4ab-43e4-83e0-bf7c6e40b856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da7d1983d47641e8bfc168cfae7d77be', 'request_id': 'req-8ceb2f7d-c4ab-43e4-83e0-bf7c6e40b856'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:00.041658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ceb2f7d-c4ab-43e4-83e0-bf7c6e40b856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da7d1983d47641e8bfc168cfae7d77be', 'request_id': 'req-8ceb2f7d-c4ab-43e4-83e0-bf7c6e40b856'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:00.048488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ceb2f7d-c4ab-43e4-83e0-bf7c6e40b856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da7d1983d47641e8bfc168cfae7d77be', 'request_id': 'req-8ceb2f7d-c4ab-43e4-83e0-bf7c6e40b856'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:00.058641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ceb2f7d-c4ab-43e4-83e0-bf7c6e40b856 admin admin] The token cache is being invalidate because project da7d1983d47641e8bfc168cfae7d77be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:54:00.058935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ceb2f7d-c4ab-43e4-83e0-bf7c6e40b856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:00.060095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8ceb2f7d-c4ab-43e4-83e0-bf7c6e40b856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:00.061690 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4057/8104] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:53:59 2022] DELETE /identity/v3/projects/da7d1983d47641e8bfc168cfae7d77be => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:00.065701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dde44-f168-4b79-aa88-a08f6becdcb1 service cinder] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:00.077899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dde44-f168-4b79-aa88-a08f6becdcb1 service cinder] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:00.142061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab571cf1-4c82-4569-b18d-7c4b2589a31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:00.142930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab571cf1-4c82-4569-b18d-7c4b2589a31b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:00.143185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab571cf1-4c82-4569-b18d-7c4b2589a31b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:00.143481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab571cf1-4c82-4569-b18d-7c4b2589a31b admin admin] PATH_INFO: `/v3/users/05cf3f9ba9284fbc84c91df270369844` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:00.144693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab571cf1-4c82-4569-b18d-7c4b2589a31b admin admin] RBAC: Authorizing `identity:delete_user(user_id=05cf3f9ba9284fbc84c91df270369844)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:00.146669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab571cf1-4c82-4569-b18d-7c4b2589a31b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:00.334206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ab571cf1-4c82-4569-b18d-7c4b2589a31b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05cf3f9ba9284fbc84c91df270369844'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:00.346464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ab571cf1-4c82-4569-b18d-7c4b2589a31b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05cf3f9ba9284fbc84c91df270369844'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:00.347260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ab571cf1-4c82-4569-b18d-7c4b2589a31b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05cf3f9ba9284fbc84c91df270369844'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:00.355685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ab571cf1-4c82-4569-b18d-7c4b2589a31b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05cf3f9ba9284fbc84c91df270369844'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:00.430573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ab571cf1-4c82-4569-b18d-7c4b2589a31b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05cf3f9ba9284fbc84c91df270369844'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:00.438858 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4048/8105] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:54:00 2022] DELETE /identity/v3/users/05cf3f9ba9284fbc84c91df270369844 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:54:01.247232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb2f7d-c4ab-43e4-83e0-bf7c6e40b856 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:01.249330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8ceb2f7d-c4ab-43e4-83e0-bf7c6e40b856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:01.264367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb2f7d-c4ab-43e4-83e0-bf7c6e40b856 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:01.324732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae5ef7-f5d3-4790-b4a5-79b2918664c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:01.325631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae5ef7-f5d3-4790-b4a5-79b2918664c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:01.325918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae5ef7-f5d3-4790-b4a5-79b2918664c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:01.326198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae5ef7-f5d3-4790-b4a5-79b2918664c1 admin admin] PATH_INFO: `/v3/projects/78821c5bc57841078df73d9ffd137939` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:01.328204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae5ef7-f5d3-4790-b4a5-79b2918664c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78821c5bc57841078df73d9ffd137939)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:01.330156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae5ef7-f5d3-4790-b4a5-79b2918664c1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:01.421287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-24ae5ef7-f5d3-4790-b4a5-79b2918664c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78821c5bc57841078df73d9ffd137939', 'request_id': 'req-24ae5ef7-f5d3-4790-b4a5-79b2918664c1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:01.499085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-24ae5ef7-f5d3-4790-b4a5-79b2918664c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78821c5bc57841078df73d9ffd137939', 'request_id': 'req-24ae5ef7-f5d3-4790-b4a5-79b2918664c1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:01.505983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-24ae5ef7-f5d3-4790-b4a5-79b2918664c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78821c5bc57841078df73d9ffd137939', 'request_id': 'req-24ae5ef7-f5d3-4790-b4a5-79b2918664c1'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:01.517149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-24ae5ef7-f5d3-4790-b4a5-79b2918664c1 admin admin] The token cache is being invalidate because project 78821c5bc57841078df73d9ffd137939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:54:01.517376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-24ae5ef7-f5d3-4790-b4a5-79b2918664c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:01.518043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-24ae5ef7-f5d3-4790-b4a5-79b2918664c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:01.519586 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4058/8106] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:54:01 2022] DELETE /identity/v3/projects/78821c5bc57841078df73d9ffd137939 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:01.526071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9c6c7-180b-440f-aa1b-2412bf082168 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:01.526567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9c6c7-180b-440f-aa1b-2412bf082168 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:01.526803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9c6c7-180b-440f-aa1b-2412bf082168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:01.547139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-02e9c6c7-180b-440f-aa1b-2412bf082168 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:01.548377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-02e9c6c7-180b-440f-aa1b-2412bf082168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:01.607980 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4049/8107] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:54:01.615704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb830816-3cb6-46b4-92c0-ff45437ee7d1 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:01.616006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb830816-3cb6-46b4-92c0-ff45437ee7d1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:01.616291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb830816-3cb6-46b4-92c0-ff45437ee7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:01.637107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-eb830816-3cb6-46b4-92c0-ff45437ee7d1 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:01.638763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-eb830816-3cb6-46b4-92c0-ff45437ee7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:01.647723 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4059/8108] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:54:01.652191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9c6c7-180b-440f-aa1b-2412bf082168 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:01.662688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9c6c7-180b-440f-aa1b-2412bf082168 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:01.667498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b99151-18e9-48f5-906e-04a7b72b67cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:01.671857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b99151-18e9-48f5-906e-04a7b72b67cf admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:01.671857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b99151-18e9-48f5-906e-04a7b72b67cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:01.671857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b99151-18e9-48f5-906e-04a7b72b67cf admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:01.671857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b99151-18e9-48f5-906e-04a7b72b67cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:54:01.671857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b99151-18e9-48f5-906e-04a7b72b67cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:01.672288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b99151-18e9-48f5-906e-04a7b72b67cf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:01.683510 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4050/8109] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:54:01.688039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb830816-3cb6-46b4-92c0-ff45437ee7d1 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:01.697611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb830816-3cb6-46b4-92c0-ff45437ee7d1 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:01.702412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915f5ae-46f7-4e55-8b37-f1e0171c27fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:01.703067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f5ae-46f7-4e55-8b37-f1e0171c27fe admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:01.703354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f5ae-46f7-4e55-8b37-f1e0171c27fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:01.703718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f5ae-46f7-4e55-8b37-f1e0171c27fe admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:01.704452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915f5ae-46f7-4e55-8b37-f1e0171c27fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:01.706399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915f5ae-46f7-4e55-8b37-f1e0171c27fe admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:01.780977 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4060/8110] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:54:01 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:54:01.785237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b99151-18e9-48f5-906e-04a7b72b67cf admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:01.796179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b99151-18e9-48f5-906e-04a7b72b67cf admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:01.852282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3fb27-902a-4457-974a-82e181bbff04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:01.852993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3fb27-902a-4457-974a-82e181bbff04 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:01.853280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3fb27-902a-4457-974a-82e181bbff04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:01.853558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3fb27-902a-4457-974a-82e181bbff04 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:01.854267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3fb27-902a-4457-974a-82e181bbff04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:01.856180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3fb27-902a-4457-974a-82e181bbff04 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:01.945353 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4051/8111] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:54:01 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:54:01.949576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915f5ae-46f7-4e55-8b37-f1e0171c27fe admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:01.960469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915f5ae-46f7-4e55-8b37-f1e0171c27fe admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:01.965148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0404f-5eb5-42d6-89e5-b72a516401b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:01.965922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0404f-5eb5-42d6-89e5-b72a516401b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:01.966843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0404f-5eb5-42d6-89e5-b72a516401b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:01.967136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0404f-5eb5-42d6-89e5-b72a516401b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:01.967860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0404f-5eb5-42d6-89e5-b72a516401b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:01.969503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0404f-5eb5-42d6-89e5-b72a516401b2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:01.980251 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4061/8112] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:54:01.984103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3fb27-902a-4457-974a-82e181bbff04 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:01.995512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3fb27-902a-4457-974a-82e181bbff04 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:02.000514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e042b-2c24-4e96-85c0-357664777238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:02.001215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e042b-2c24-4e96-85c0-357664777238 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:02.001505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e042b-2c24-4e96-85c0-357664777238 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:02.001812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e042b-2c24-4e96-85c0-357664777238 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:02.002534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e042b-2c24-4e96-85c0-357664777238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:02.004180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e042b-2c24-4e96-85c0-357664777238 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:02.018448 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4052/8113] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:54:02.019674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0404f-5eb5-42d6-89e5-b72a516401b2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:02.031079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0404f-5eb5-42d6-89e5-b72a516401b2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:02.036156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055ac8b-d3ce-40d6-a786-5b5f70c29394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:02.037096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055ac8b-d3ce-40d6-a786-5b5f70c29394 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:02.042670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055ac8b-d3ce-40d6-a786-5b5f70c29394 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:02.042670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055ac8b-d3ce-40d6-a786-5b5f70c29394 admin admin] PATH_INFO: `/v3/projects/a22cd843f9c642578561322bb0123ef2/users/3fe7bf9eac084efa8353c8e84fd2ff6a/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:02.052415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055ac8b-d3ce-40d6-a786-5b5f70c29394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22cd843f9c642578561322bb0123ef2, user_id=3fe7bf9eac084efa8353c8e84fd2ff6a, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:02.055132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055ac8b-d3ce-40d6-a786-5b5f70c29394 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:02.133706 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4062/8114] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:54:02 2022] PUT /identity/v3/projects/a22cd843f9c642578561322bb0123ef2/users/3fe7bf9eac084efa8353c8e84fd2ff6a/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:02.145333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7349f3-8808-4eaf-b582-b3134c3a2f3a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:02.145333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7349f3-8808-4eaf-b582-b3134c3a2f3a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:02.145602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7349f3-8808-4eaf-b582-b3134c3a2f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:02.172790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2e7349f3-8808-4eaf-b582-b3134c3a2f3a None None] MFA Rules not processed for user `3fe7bf9eac084efa8353c8e84fd2ff6a`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:02.174009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2e7349f3-8808-4eaf-b582-b3134c3a2f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:02.235570 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4053/8115] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:54:02.240368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055ac8b-d3ce-40d6-a786-5b5f70c29394 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:02.250262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055ac8b-d3ce-40d6-a786-5b5f70c29394 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:02.254635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1af3b-6a73-47dd-beb2-dbc470edbd05 tempest-IdentityCatalogTest-1568434446 tempest-IdentityCatalogTest-1568434446-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe7bf9eac084efa8353c8e84fd2ff6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a22cd843f9c642578561322bb0123ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:02.255292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1af3b-6a73-47dd-beb2-dbc470edbd05 tempest-IdentityCatalogTest-1568434446 tempest-IdentityCatalogTest-1568434446-project] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:02.255586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1af3b-6a73-47dd-beb2-dbc470edbd05 tempest-IdentityCatalogTest-1568434446 tempest-IdentityCatalogTest-1568434446-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:02.256778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1af3b-6a73-47dd-beb2-dbc470edbd05 tempest-IdentityCatalogTest-1568434446 tempest-IdentityCatalogTest-1568434446-project] PATH_INFO: `/v3/auth/catalog` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:02.257670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1af3b-6a73-47dd-beb2-dbc470edbd05 tempest-IdentityCatalogTest-1568434446 tempest-IdentityCatalogTest-1568434446-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:02.258755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1af3b-6a73-47dd-beb2-dbc470edbd05 tempest-IdentityCatalogTest-1568434446 tempest-IdentityCatalogTest-1568434446-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:02.260619 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4063/8116] 10.222.0.16 () {58 vars in 1142 bytes} [Mon May 2 10:54:02 2022] GET /identity/v3/auth/catalog => generated 2648 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:54:02.266470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7349f3-8808-4eaf-b582-b3134c3a2f3a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:02.329661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7349f3-8808-4eaf-b582-b3134c3a2f3a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:02.334374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6485136-2cf1-480a-98ee-6c237c97af17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:02.335264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6485136-2cf1-480a-98ee-6c237c97af17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:02.335542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6485136-2cf1-480a-98ee-6c237c97af17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:02.336247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6485136-2cf1-480a-98ee-6c237c97af17 admin admin] PATH_INFO: `/v3/users/3fe7bf9eac084efa8353c8e84fd2ff6a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:02.337164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6485136-2cf1-480a-98ee-6c237c97af17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fe7bf9eac084efa8353c8e84fd2ff6a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:02.339116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6485136-2cf1-480a-98ee-6c237c97af17 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:02.473320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a6485136-2cf1-480a-98ee-6c237c97af17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fe7bf9eac084efa8353c8e84fd2ff6a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:02.486757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a6485136-2cf1-480a-98ee-6c237c97af17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fe7bf9eac084efa8353c8e84fd2ff6a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:02.487831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a6485136-2cf1-480a-98ee-6c237c97af17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fe7bf9eac084efa8353c8e84fd2ff6a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:02.495894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a6485136-2cf1-480a-98ee-6c237c97af17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fe7bf9eac084efa8353c8e84fd2ff6a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:02.568723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-a6485136-2cf1-480a-98ee-6c237c97af17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fe7bf9eac084efa8353c8e84fd2ff6a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:02.576982 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4054/8117] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:54:02 2022] DELETE /identity/v3/users/3fe7bf9eac084efa8353c8e84fd2ff6a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:02.581759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a8586-e2cf-49e3-bd7d-388750f072f8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:02.582347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a8586-e2cf-49e3-bd7d-388750f072f8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:02.582783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a8586-e2cf-49e3-bd7d-388750f072f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:02.603438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-184a8586-e2cf-49e3-bd7d-388750f072f8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:02.604705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-184a8586-e2cf-49e3-bd7d-388750f072f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:02.667932 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4064/8118] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:54:02.678596 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6485136-2cf1-480a-98ee-6c237c97af17 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:02.680106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a6485136-2cf1-480a-98ee-6c237c97af17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:02.742497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6485136-2cf1-480a-98ee-6c237c97af17 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:02.746633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24971f0-06c1-4e80-a20d-266077fcc57c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:02.747293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24971f0-06c1-4e80-a20d-266077fcc57c service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:02.748185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24971f0-06c1-4e80-a20d-266077fcc57c service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:02.748547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24971f0-06c1-4e80-a20d-266077fcc57c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:02.757876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24971f0-06c1-4e80-a20d-266077fcc57c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:02.759336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24971f0-06c1-4e80-a20d-266077fcc57c service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:02.769392 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4055/8119] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:54:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:54:03.195528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a8586-e2cf-49e3-bd7d-388750f072f8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:03.197077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-184a8586-e2cf-49e3-bd7d-388750f072f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:03.211006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a8586-e2cf-49e3-bd7d-388750f072f8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:03.216123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30b28c-0774-4ade-b434-b39654f7744b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:03.218540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30b28c-0774-4ade-b434-b39654f7744b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:03.218847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30b28c-0774-4ade-b434-b39654f7744b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:03.219156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30b28c-0774-4ade-b434-b39654f7744b admin admin] PATH_INFO: `/v3/projects/a22cd843f9c642578561322bb0123ef2` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:03.223491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30b28c-0774-4ade-b434-b39654f7744b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22cd843f9c642578561322bb0123ef2)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:03.228443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30b28c-0774-4ade-b434-b39654f7744b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:03.327473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e30b28c-0774-4ade-b434-b39654f7744b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22cd843f9c642578561322bb0123ef2', 'request_id': 'req-3e30b28c-0774-4ade-b434-b39654f7744b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:03.389854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e30b28c-0774-4ade-b434-b39654f7744b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22cd843f9c642578561322bb0123ef2', 'request_id': 'req-3e30b28c-0774-4ade-b434-b39654f7744b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:03.396743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e30b28c-0774-4ade-b434-b39654f7744b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22cd843f9c642578561322bb0123ef2', 'request_id': 'req-3e30b28c-0774-4ade-b434-b39654f7744b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:03.407467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e30b28c-0774-4ade-b434-b39654f7744b admin admin] The token cache is being invalidate because project a22cd843f9c642578561322bb0123ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:54:03.407763 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e30b28c-0774-4ade-b434-b39654f7744b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:03.408427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-3e30b28c-0774-4ade-b434-b39654f7744b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:03.410026 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4065/8120] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:54:03 2022] DELETE /identity/v3/projects/a22cd843f9c642578561322bb0123ef2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:54:03.414875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f950153-0b17-42b4-a028-cf946b0b3738 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:03.415195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f950153-0b17-42b4-a028-cf946b0b3738 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:03.415514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f950153-0b17-42b4-a028-cf946b0b3738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:03.433839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9f950153-0b17-42b4-a028-cf946b0b3738 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:03.435123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9f950153-0b17-42b4-a028-cf946b0b3738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:03.499074 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4056/8121] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:54:03.507968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6c342-a872-4fdc-bd63-b4d384dffc03 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:03.508255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6c342-a872-4fdc-bd63-b4d384dffc03 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:03.508593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6c342-a872-4fdc-bd63-b4d384dffc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:03.527745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9ad6c342-a872-4fdc-bd63-b4d384dffc03 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:03.529539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9ad6c342-a872-4fdc-bd63-b4d384dffc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:03.541930 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4066/8122] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:54:03.546107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f950153-0b17-42b4-a028-cf946b0b3738 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:03.556426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f950153-0b17-42b4-a028-cf946b0b3738 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:03.561542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d2c90-5766-4008-af7a-4b73fa0e3888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:03.562071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d2c90-5766-4008-af7a-4b73fa0e3888 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:03.562356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d2c90-5766-4008-af7a-4b73fa0e3888 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:03.562637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d2c90-5766-4008-af7a-4b73fa0e3888 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:03.563515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d2c90-5766-4008-af7a-4b73fa0e3888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:54:03.563833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d2c90-5766-4008-af7a-4b73fa0e3888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:03.566001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d2c90-5766-4008-af7a-4b73fa0e3888 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:03.580712 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4057/8123] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:54:03.585264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6c342-a872-4fdc-bd63-b4d384dffc03 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:03.595440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6c342-a872-4fdc-bd63-b4d384dffc03 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:03.600197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ed09c-4436-4573-8a48-6e439984839c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:03.600888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ed09c-4436-4573-8a48-6e439984839c admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:03.601172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ed09c-4436-4573-8a48-6e439984839c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:03.601450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ed09c-4436-4573-8a48-6e439984839c admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:03.602220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ed09c-4436-4573-8a48-6e439984839c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:03.604132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ed09c-4436-4573-8a48-6e439984839c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:03.723383 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4067/8124] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:54:03 2022] POST /identity/v3/projects => generated 359 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:54:03.727916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d2c90-5766-4008-af7a-4b73fa0e3888 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:03.738903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d2c90-5766-4008-af7a-4b73fa0e3888 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:03.795368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46c5e9-630a-46a2-9a66-eb3c6ab4c49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:03.796050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46c5e9-630a-46a2-9a66-eb3c6ab4c49d admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:03.796339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46c5e9-630a-46a2-9a66-eb3c6ab4c49d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:03.796728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46c5e9-630a-46a2-9a66-eb3c6ab4c49d admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:03.797421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46c5e9-630a-46a2-9a66-eb3c6ab4c49d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:03.799498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46c5e9-630a-46a2-9a66-eb3c6ab4c49d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:03.902155 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4058/8125] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:54:03 2022] POST /identity/v3/users => generated 280 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:54:03.904228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ed09c-4436-4573-8a48-6e439984839c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:03.915239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ed09c-4436-4573-8a48-6e439984839c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:03.920624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c90a2-a4d6-44e7-8fc3-98958964bfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:03.921305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c90a2-a4d6-44e7-8fc3-98958964bfc8 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:03.921597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c90a2-a4d6-44e7-8fc3-98958964bfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:03.921881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c90a2-a4d6-44e7-8fc3-98958964bfc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:03.922611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c90a2-a4d6-44e7-8fc3-98958964bfc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:03.924267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c90a2-a4d6-44e7-8fc3-98958964bfc8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:03.937488 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4068/8126] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:54:03.938696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46c5e9-630a-46a2-9a66-eb3c6ab4c49d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:03.948854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46c5e9-630a-46a2-9a66-eb3c6ab4c49d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:03.953732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813809d-e7e7-42dd-aa54-81d15aeab3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:03.954412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813809d-e7e7-42dd-aa54-81d15aeab3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:03.954693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813809d-e7e7-42dd-aa54-81d15aeab3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:03.954972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813809d-e7e7-42dd-aa54-81d15aeab3a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:03.955696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813809d-e7e7-42dd-aa54-81d15aeab3a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:03.957323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813809d-e7e7-42dd-aa54-81d15aeab3a9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:03.970764 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4059/8127] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:54:03.971901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c90a2-a4d6-44e7-8fc3-98958964bfc8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:03.981686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c90a2-a4d6-44e7-8fc3-98958964bfc8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:03.987026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126615b-521f-4ecc-8566-6cdc24679c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:03.987925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126615b-521f-4ecc-8566-6cdc24679c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:03.988208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126615b-521f-4ecc-8566-6cdc24679c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:03.988560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126615b-521f-4ecc-8566-6cdc24679c9e admin admin] PATH_INFO: `/v3/projects/97e0e5ee2d704fadae8d7e1a467af5a5/users/1dac6abee4ba4b8da44f39045238979e/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:04.007673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126615b-521f-4ecc-8566-6cdc24679c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=97e0e5ee2d704fadae8d7e1a467af5a5, user_id=1dac6abee4ba4b8da44f39045238979e, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:04.010448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126615b-521f-4ecc-8566-6cdc24679c9e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:04.099026 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4069/8128] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:54:03 2022] PUT /identity/v3/projects/97e0e5ee2d704fadae8d7e1a467af5a5/users/1dac6abee4ba4b8da44f39045238979e/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:54:04.109477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d5860-7caf-441e-8bc4-5b8997f6f718 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:04.109766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d5860-7caf-441e-8bc4-5b8997f6f718 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:04.110048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d5860-7caf-441e-8bc4-5b8997f6f718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:04.139357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-393d5860-7caf-441e-8bc4-5b8997f6f718 None None] MFA Rules not processed for user `1dac6abee4ba4b8da44f39045238979e`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:04.140569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-393d5860-7caf-441e-8bc4-5b8997f6f718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:04.203892 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4060/8129] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:04 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:54:04.209007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302f531-c53c-4ee7-a405-d87371bba75c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:04.209310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302f531-c53c-4ee7-a405-d87371bba75c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:04.211847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302f531-c53c-4ee7-a405-d87371bba75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:04.226287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-e302f531-c53c-4ee7-a405-d87371bba75c None None] MFA Rules not processed for user `1dac6abee4ba4b8da44f39045238979e`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:04.227700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e302f531-c53c-4ee7-a405-d87371bba75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:04.231180 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4070/8130] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:04 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 10:54:04.237064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae926d-e7fe-4e21-a0b0-e7b3ec498f15 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:04.237357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae926d-e7fe-4e21-a0b0-e7b3ec498f15 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:04.237642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae926d-e7fe-4e21-a0b0-e7b3ec498f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:04.254976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e0ae926d-e7fe-4e21-a0b0-e7b3ec498f15 None None] MFA Rules not processed for user `1dac6abee4ba4b8da44f39045238979e`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:04.256156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e0ae926d-e7fe-4e21-a0b0-e7b3ec498f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:04.259936 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4061/8131] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:04 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 10:54:04.264244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302f531-c53c-4ee7-a405-d87371bba75c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:04.275207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302f531-c53c-4ee7-a405-d87371bba75c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:04.279249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894aa1df-79c6-4e31-88e1-9920f10c2ef8 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dac6abee4ba4b8da44f39045238979e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e0e5ee2d704fadae8d7e1a467af5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:04.279890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894aa1df-79c6-4e31-88e1-9920f10c2ef8 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] REQUEST_METHOD: `HEAD` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:04.282036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894aa1df-79c6-4e31-88e1-9920f10c2ef8 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:04.282036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894aa1df-79c6-4e31-88e1-9920f10c2ef8 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:04.287264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894aa1df-79c6-4e31-88e1-9920f10c2ef8 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] RBAC: Authorizing `identity:check_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:04.288910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894aa1df-79c6-4e31-88e1-9920f10c2ef8 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:04.295518 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4071/8132] 10.222.0.16 () {56 vars in 1263 bytes} [Mon May 2 10:54:04 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) May 02 10:54:04.299556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae926d-e7fe-4e21-a0b0-e7b3ec498f15 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:04.311395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae926d-e7fe-4e21-a0b0-e7b3ec498f15 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:04.315669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e3eea-a61e-44e0-8bf7-d1aaf8d5a4fa tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dac6abee4ba4b8da44f39045238979e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e0e5ee2d704fadae8d7e1a467af5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:04.316319 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e3eea-a61e-44e0-8bf7-d1aaf8d5a4fa tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:04.316692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e3eea-a61e-44e0-8bf7-d1aaf8d5a4fa tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:04.316917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e3eea-a61e-44e0-8bf7-d1aaf8d5a4fa tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:04.323025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e3eea-a61e-44e0-8bf7-d1aaf8d5a4fa tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:04.324829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e3eea-a61e-44e0-8bf7-d1aaf8d5a4fa tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:04.331073 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4062/8133] 10.222.0.16 () {56 vars in 1262 bytes} [Mon May 2 10:54:04 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 10:54:04.334929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894aa1df-79c6-4e31-88e1-9920f10c2ef8 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:04.344292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894aa1df-79c6-4e31-88e1-9920f10c2ef8 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:04.348438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889f1c5-411d-4e6e-830c-c3775610e8e1 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dac6abee4ba4b8da44f39045238979e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e0e5ee2d704fadae8d7e1a467af5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:04.349106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889f1c5-411d-4e6e-830c-c3775610e8e1 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:04.349509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889f1c5-411d-4e6e-830c-c3775610e8e1 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:04.349792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889f1c5-411d-4e6e-830c-c3775610e8e1 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:04.356260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889f1c5-411d-4e6e-830c-c3775610e8e1 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:04.358343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3889f1c5-411d-4e6e-830c-c3775610e8e1 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:04.465613 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4072/8134] 10.222.0.16 () {56 vars in 1265 bytes} [Mon May 2 10:54:04 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:04.469932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e3eea-a61e-44e0-8bf7-d1aaf8d5a4fa tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:04.488566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e3eea-a61e-44e0-8bf7-d1aaf8d5a4fa tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:04.493801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c5c17-d055-4675-a0ab-cd746e66b306 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dac6abee4ba4b8da44f39045238979e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e0e5ee2d704fadae8d7e1a467af5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:04.494467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c5c17-d055-4675-a0ab-cd746e66b306 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] REQUEST_METHOD: `HEAD` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:04.496474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c5c17-d055-4675-a0ab-cd746e66b306 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:04.496474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c5c17-d055-4675-a0ab-cd746e66b306 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:04.496993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-577c5c17-d055-4675-a0ab-cd746e66b306 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:04.517680 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-577c5c17-d055-4675-a0ab-cd746e66b306 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token May 02 10:54:04.517680 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:54:04.517680 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:54:04.517680 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:54:04.517680 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:54:04.517680 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:54:04.517680 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:54:04.517680 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:54:04.517680 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:54:04.517680 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:54:04.517680 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:54:04.517680 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:54:04.517680 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get May 02 10:54:04.517680 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') May 02 10:54:04.517680 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call May 02 10:54:04.518885 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() May 02 10:54:04.518885 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data May 02 10:54:04.518885 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( May 02 10:54:04.518885 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:54:04.518885 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:54:04.518885 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token May 02 10:54:04.518885 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) May 02 10:54:04.518885 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token May 02 10:54:04.518885 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.check_revocation(token) May 02 10:54:04.518885 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:54:04.518885 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:54:04.518885 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation May 02 10:54:04.518885 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) May 02 10:54:04.518885 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:54:04.518885 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:54:04.518885 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 May 02 10:54:04.518885 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) May 02 10:54:04.519889 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:54:04.519889 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:54:04.519889 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token May 02 10:54:04.519889 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) May 02 10:54:04.519889 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token May 02 10:54:04.519889 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:54:04.519889 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4063/8135] 10.222.0.16 () {56 vars in 1263 bytes} [Mon May 2 10:54:04 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) May 02 10:54:04.532302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0322865-1e4b-41df-bbac-8ad322003ece None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:04.532749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0322865-1e4b-41df-bbac-8ad322003ece None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:04.533227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0322865-1e4b-41df-bbac-8ad322003ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:04.551403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f0322865-1e4b-41df-bbac-8ad322003ece None None] MFA Rules not processed for user `1dac6abee4ba4b8da44f39045238979e`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:04.552765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f0322865-1e4b-41df-bbac-8ad322003ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:04.556644 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4073/8136] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:04 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 02 10:54:04.560956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c5c17-d055-4675-a0ab-cd746e66b306 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:04.570676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c5c17-d055-4675-a0ab-cd746e66b306 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:04.575444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdd67c-49e6-4cb8-9e18-516969cb0bfb tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dac6abee4ba4b8da44f39045238979e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e0e5ee2d704fadae8d7e1a467af5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:04.576279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdd67c-49e6-4cb8-9e18-516969cb0bfb tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:04.576669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdd67c-49e6-4cb8-9e18-516969cb0bfb tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:04.577028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdd67c-49e6-4cb8-9e18-516969cb0bfb tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:04.583405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcdd67c-49e6-4cb8-9e18-516969cb0bfb tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:04.585268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcdd67c-49e6-4cb8-9e18-516969cb0bfb tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:04.592537 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4064/8137] 10.222.0.16 () {56 vars in 1262 bytes} [Mon May 2 10:54:04 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 02 10:54:04.596551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0322865-1e4b-41df-bbac-8ad322003ece None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:04.608942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0322865-1e4b-41df-bbac-8ad322003ece None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:04.615229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21556524-b9a4-46a2-9bce-851df5ce6ca3 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dac6abee4ba4b8da44f39045238979e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e0e5ee2d704fadae8d7e1a467af5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:04.615682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21556524-b9a4-46a2-9bce-851df5ce6ca3 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:04.616041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21556524-b9a4-46a2-9bce-851df5ce6ca3 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:04.616399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21556524-b9a4-46a2-9bce-851df5ce6ca3 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:04.624412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21556524-b9a4-46a2-9bce-851df5ce6ca3 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:04.626296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21556524-b9a4-46a2-9bce-851df5ce6ca3 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:04.688813 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4074/8138] 10.222.0.16 () {56 vars in 1265 bytes} [Mon May 2 10:54:04 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:04.692997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdd67c-49e6-4cb8-9e18-516969cb0bfb tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:04.703131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdd67c-49e6-4cb8-9e18-516969cb0bfb tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:04.707425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e253543-69d6-41b4-9e67-d47ef1a039e5 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dac6abee4ba4b8da44f39045238979e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97e0e5ee2d704fadae8d7e1a467af5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:04.708126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e253543-69d6-41b4-9e67-d47ef1a039e5 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:04.708413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e253543-69d6-41b4-9e67-d47ef1a039e5 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:04.708752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e253543-69d6-41b4-9e67-d47ef1a039e5 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:04.714916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0e253543-69d6-41b4-9e67-d47ef1a039e5 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:04.722264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application [None req-0e253543-69d6-41b4-9e67-d47ef1a039e5 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token May 02 10:54:04.722264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:54:04.722264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:54:04.722264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:54:04.722264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:54:04.722264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:54:04.722264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:54:04.722264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:54:04.722264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:54:04.722264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:54:04.722264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:54:04.722264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:54:04.722264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get May 02 10:54:04.722264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') May 02 10:54:04.722264 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call May 02 10:54:04.723215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() May 02 10:54:04.723215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data May 02 10:54:04.723215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( May 02 10:54:04.723215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:54:04.723215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:54:04.723215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token May 02 10:54:04.723215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) May 02 10:54:04.723215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token May 02 10:54:04.723215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application self.check_revocation(token) May 02 10:54:04.723215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:54:04.723215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:54:04.723215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation May 02 10:54:04.723215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) May 02 10:54:04.723215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:54:04.723215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:54:04.723215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 May 02 10:54:04.723215 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) May 02 10:54:04.724731 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:54:04.724731 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:54:04.724731 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token May 02 10:54:04.724731 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) May 02 10:54:04.724731 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token May 02 10:54:04.724731 ncdv-master-1 devstack@keystone.service[91119]: ERROR keystone.server.flask.application May 02 10:54:04.724731 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4065/8139] 10.222.0.16 () {56 vars in 1262 bytes} [Mon May 2 10:54:04 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:54:04.728752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21556524-b9a4-46a2-9bce-851df5ce6ca3 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:04.794041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21556524-b9a4-46a2-9bce-851df5ce6ca3 tempest-TokensV3Test-766550022 tempest-TokensV3Test-766550022-project] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:04.798794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f2662-c7ff-4089-86c3-9e924b60b244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:04.799674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f2662-c7ff-4089-86c3-9e924b60b244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:04.799962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f2662-c7ff-4089-86c3-9e924b60b244 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:04.800239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f2662-c7ff-4089-86c3-9e924b60b244 admin admin] PATH_INFO: `/v3/users/1dac6abee4ba4b8da44f39045238979e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:04.801630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f2662-c7ff-4089-86c3-9e924b60b244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dac6abee4ba4b8da44f39045238979e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:04.803557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f2662-c7ff-4089-86c3-9e924b60b244 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:04.972988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ff9f2662-c7ff-4089-86c3-9e924b60b244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dac6abee4ba4b8da44f39045238979e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:04.985262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ff9f2662-c7ff-4089-86c3-9e924b60b244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dac6abee4ba4b8da44f39045238979e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:04.985984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ff9f2662-c7ff-4089-86c3-9e924b60b244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dac6abee4ba4b8da44f39045238979e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:04.992831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ff9f2662-c7ff-4089-86c3-9e924b60b244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dac6abee4ba4b8da44f39045238979e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:05.081895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ff9f2662-c7ff-4089-86c3-9e924b60b244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dac6abee4ba4b8da44f39045238979e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:05.088307 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4075/8140] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:54:04 2022] DELETE /identity/v3/users/1dac6abee4ba4b8da44f39045238979e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:05.092831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5085b84-773f-4ed4-ba40-b5efea2cd8c4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:05.093143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5085b84-773f-4ed4-ba40-b5efea2cd8c4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:05.093429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5085b84-773f-4ed4-ba40-b5efea2cd8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:05.111720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f5085b84-773f-4ed4-ba40-b5efea2cd8c4 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:05.112960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f5085b84-773f-4ed4-ba40-b5efea2cd8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:05.171033 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4066/8141] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:54:05.180932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f2662-c7ff-4089-86c3-9e924b60b244 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:05.182344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ff9f2662-c7ff-4089-86c3-9e924b60b244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:05.241878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f2662-c7ff-4089-86c3-9e924b60b244 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:05.245467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d094f13-cece-4fde-b8a7-b34d764d8b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:05.246145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d094f13-cece-4fde-b8a7-b34d764d8b3a service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:05.246430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d094f13-cece-4fde-b8a7-b34d764d8b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:05.246830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d094f13-cece-4fde-b8a7-b34d764d8b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:05.256856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d094f13-cece-4fde-b8a7-b34d764d8b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:05.258340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d094f13-cece-4fde-b8a7-b34d764d8b3a service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:05.268701 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4076/8142] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:54:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:54:05.797594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5085b84-773f-4ed4-ba40-b5efea2cd8c4 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:05.799743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f5085b84-773f-4ed4-ba40-b5efea2cd8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:05.813311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5085b84-773f-4ed4-ba40-b5efea2cd8c4 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:05.818308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e0ca7-a0ea-498a-8fce-b147c99c339a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:05.819179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e0ca7-a0ea-498a-8fce-b147c99c339a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:05.819464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e0ca7-a0ea-498a-8fce-b147c99c339a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:05.819740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e0ca7-a0ea-498a-8fce-b147c99c339a admin admin] PATH_INFO: `/v3/projects/97e0e5ee2d704fadae8d7e1a467af5a5` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:05.821130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e0ca7-a0ea-498a-8fce-b147c99c339a admin admin] RBAC: Authorizing `identity:delete_project(project_id=97e0e5ee2d704fadae8d7e1a467af5a5)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:05.823283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e0ca7-a0ea-498a-8fce-b147c99c339a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:05.929108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c22e0ca7-a0ea-498a-8fce-b147c99c339a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97e0e5ee2d704fadae8d7e1a467af5a5', 'request_id': 'req-c22e0ca7-a0ea-498a-8fce-b147c99c339a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:05.936136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c22e0ca7-a0ea-498a-8fce-b147c99c339a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97e0e5ee2d704fadae8d7e1a467af5a5', 'request_id': 'req-c22e0ca7-a0ea-498a-8fce-b147c99c339a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:06.007928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c22e0ca7-a0ea-498a-8fce-b147c99c339a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97e0e5ee2d704fadae8d7e1a467af5a5', 'request_id': 'req-c22e0ca7-a0ea-498a-8fce-b147c99c339a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:06.019629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c22e0ca7-a0ea-498a-8fce-b147c99c339a admin admin] The token cache is being invalidate because project 97e0e5ee2d704fadae8d7e1a467af5a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:54:06.019918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c22e0ca7-a0ea-498a-8fce-b147c99c339a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:06.020585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c22e0ca7-a0ea-498a-8fce-b147c99c339a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:06.022404 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4067/8143] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:54:05 2022] DELETE /identity/v3/projects/97e0e5ee2d704fadae8d7e1a467af5a5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:06.028088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e8e53-38df-4f71-b7ab-1f4035ea8e9f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:06.028671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e8e53-38df-4f71-b7ab-1f4035ea8e9f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:06.029378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e8e53-38df-4f71-b7ab-1f4035ea8e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:06.048244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-cd1e8e53-38df-4f71-b7ab-1f4035ea8e9f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:06.049510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-cd1e8e53-38df-4f71-b7ab-1f4035ea8e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:06.121253 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4077/8144] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:54:06.129828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97b806-57ff-4aaf-9d29-1b750a87c77d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:06.130124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97b806-57ff-4aaf-9d29-1b750a87c77d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:06.130406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97b806-57ff-4aaf-9d29-1b750a87c77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:06.150867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7d97b806-57ff-4aaf-9d29-1b750a87c77d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:06.152090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7d97b806-57ff-4aaf-9d29-1b750a87c77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:06.160931 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4068/8145] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:54:06.165179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e8e53-38df-4f71-b7ab-1f4035ea8e9f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:06.175116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e8e53-38df-4f71-b7ab-1f4035ea8e9f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:06.180634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b7c02-6920-436d-9d6e-2d9196f757ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:06.181283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b7c02-6920-436d-9d6e-2d9196f757ae admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:06.181568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b7c02-6920-436d-9d6e-2d9196f757ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:06.181846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b7c02-6920-436d-9d6e-2d9196f757ae admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:06.182578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b7c02-6920-436d-9d6e-2d9196f757ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:54:06.182884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b7c02-6920-436d-9d6e-2d9196f757ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:06.184476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b7c02-6920-436d-9d6e-2d9196f757ae admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:06.197042 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4078/8146] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:54:06.201854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97b806-57ff-4aaf-9d29-1b750a87c77d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:06.211042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97b806-57ff-4aaf-9d29-1b750a87c77d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:06.215762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247e104-c92f-4da2-8098-3e50a366b26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:06.216450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247e104-c92f-4da2-8098-3e50a366b26a admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:06.216778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247e104-c92f-4da2-8098-3e50a366b26a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:06.217163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247e104-c92f-4da2-8098-3e50a366b26a admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:06.217745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247e104-c92f-4da2-8098-3e50a366b26a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:06.219668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247e104-c92f-4da2-8098-3e50a366b26a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:06.333695 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4069/8147] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:54:06 2022] POST /identity/v3/projects => generated 399 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:54:06.334815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b7c02-6920-436d-9d6e-2d9196f757ae admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:06.346700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b7c02-6920-436d-9d6e-2d9196f757ae admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:06.402967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0669b4-6b03-4f11-8341-e74cc4df8fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:06.403721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0669b4-6b03-4f11-8341-e74cc4df8fdc admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:06.404293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0669b4-6b03-4f11-8341-e74cc4df8fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:06.404579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0669b4-6b03-4f11-8341-e74cc4df8fdc admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:06.405329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0669b4-6b03-4f11-8341-e74cc4df8fdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:06.407237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0669b4-6b03-4f11-8341-e74cc4df8fdc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:06.490912 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4079/8148] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:54:06 2022] POST /identity/v3/users => generated 306 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:54:06.492115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247e104-c92f-4da2-8098-3e50a366b26a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:06.503501 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247e104-c92f-4da2-8098-3e50a366b26a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:06.508122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83ebb5-2b16-40ef-8cda-58d9ffa4737a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:06.508810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83ebb5-2b16-40ef-8cda-58d9ffa4737a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:06.509098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83ebb5-2b16-40ef-8cda-58d9ffa4737a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:06.509380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83ebb5-2b16-40ef-8cda-58d9ffa4737a admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:06.510097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83ebb5-2b16-40ef-8cda-58d9ffa4737a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:06.511693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83ebb5-2b16-40ef-8cda-58d9ffa4737a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:06.522012 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4070/8149] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:54:06.527288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0669b4-6b03-4f11-8341-e74cc4df8fdc admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:06.538323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0669b4-6b03-4f11-8341-e74cc4df8fdc admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:06.543135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07644e7a-537d-4d32-a6ab-8129da6f7f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:06.544042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07644e7a-537d-4d32-a6ab-8129da6f7f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:06.544860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07644e7a-537d-4d32-a6ab-8129da6f7f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:06.545144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07644e7a-537d-4d32-a6ab-8129da6f7f9c admin admin] PATH_INFO: `/v3/projects/c2ce61d99a864d3092130ee18dc7f765/users/b0bbb78010804bb984f347a8e8d322c8/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:06.559704 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07644e7a-537d-4d32-a6ab-8129da6f7f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2ce61d99a864d3092130ee18dc7f765, user_id=b0bbb78010804bb984f347a8e8d322c8, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:06.563016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07644e7a-537d-4d32-a6ab-8129da6f7f9c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:06.664659 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4080/8150] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:54:06 2022] PUT /identity/v3/projects/c2ce61d99a864d3092130ee18dc7f765/users/b0bbb78010804bb984f347a8e8d322c8/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:54:06.668762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83ebb5-2b16-40ef-8cda-58d9ffa4737a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:06.680022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83ebb5-2b16-40ef-8cda-58d9ffa4737a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:06.751524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d8653-9ef2-4085-8ca5-2a871cda1298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:06.752209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d8653-9ef2-4085-8ca5-2a871cda1298 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:06.752524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d8653-9ef2-4085-8ca5-2a871cda1298 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:06.752841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d8653-9ef2-4085-8ca5-2a871cda1298 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:06.753602 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d8653-9ef2-4085-8ca5-2a871cda1298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:06.755231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d8653-9ef2-4085-8ca5-2a871cda1298 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:06.765493 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4071/8151] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:54:06.769685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07644e7a-537d-4d32-a6ab-8129da6f7f9c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:06.780552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07644e7a-537d-4d32-a6ab-8129da6f7f9c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:06.785342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a84b7f-a293-40ab-9ff5-86efc02fbd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:06.786257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a84b7f-a293-40ab-9ff5-86efc02fbd65 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:06.786545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a84b7f-a293-40ab-9ff5-86efc02fbd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:06.786826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a84b7f-a293-40ab-9ff5-86efc02fbd65 admin admin] PATH_INFO: `/v3/projects/c2ce61d99a864d3092130ee18dc7f765/users/b0bbb78010804bb984f347a8e8d322c8/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:06.788867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a84b7f-a293-40ab-9ff5-86efc02fbd65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2ce61d99a864d3092130ee18dc7f765, user_id=b0bbb78010804bb984f347a8e8d322c8, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:06.791564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a84b7f-a293-40ab-9ff5-86efc02fbd65 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:06.802601 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4081/8152] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:54:06 2022] PUT /identity/v3/projects/c2ce61d99a864d3092130ee18dc7f765/users/b0bbb78010804bb984f347a8e8d322c8/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:06.813934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2b71a-d71f-444b-848d-9392fb22aa50 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:06.814397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2b71a-d71f-444b-848d-9392fb22aa50 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:06.814505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2b71a-d71f-444b-848d-9392fb22aa50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:06.840416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-aff2b71a-d71f-444b-848d-9392fb22aa50 None None] MFA Rules not processed for user `b0bbb78010804bb984f347a8e8d322c8`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:06.842204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-aff2b71a-d71f-444b-848d-9392fb22aa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:06.912798 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4072/8153] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:06 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:54:06.917760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a84b7f-a293-40ab-9ff5-86efc02fbd65 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:06.982776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a84b7f-a293-40ab-9ff5-86efc02fbd65 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:06.987474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34cb74-9f6d-4ab9-83a1-cd4fdb6e2ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:06.988137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34cb74-9f6d-4ab9-83a1-cd4fdb6e2ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:06.988420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34cb74-9f6d-4ab9-83a1-cd4fdb6e2ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:06.988792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34cb74-9f6d-4ab9-83a1-cd4fdb6e2ac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:06.994382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34cb74-9f6d-4ab9-83a1-cd4fdb6e2ac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:06.994382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34cb74-9f6d-4ab9-83a1-cd4fdb6e2ac6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:07.074630 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4082/8154] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:54:06 2022] POST /identity/v3/projects => generated 397 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:54:07.076619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2b71a-d71f-444b-848d-9392fb22aa50 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:07.090871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2b71a-d71f-444b-848d-9392fb22aa50 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:07.153651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928c8a8-26f8-4579-8523-880d17123a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:07.154360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928c8a8-26f8-4579-8523-880d17123a9a admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:07.154649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928c8a8-26f8-4579-8523-880d17123a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:07.154931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928c8a8-26f8-4579-8523-880d17123a9a admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:07.155626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928c8a8-26f8-4579-8523-880d17123a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:07.157608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928c8a8-26f8-4579-8523-880d17123a9a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:07.253707 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4073/8155] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:54:07 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:54:07.257633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34cb74-9f6d-4ab9-83a1-cd4fdb6e2ac6 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:07.268253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34cb74-9f6d-4ab9-83a1-cd4fdb6e2ac6 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:07.273826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b3f82-116c-446e-9301-549f6abd2774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:07.274906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b3f82-116c-446e-9301-549f6abd2774 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:07.275195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b3f82-116c-446e-9301-549f6abd2774 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:07.275473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b3f82-116c-446e-9301-549f6abd2774 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:07.280507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b3f82-116c-446e-9301-549f6abd2774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:07.280507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b3f82-116c-446e-9301-549f6abd2774 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:07.290687 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4083/8156] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:54:07.291842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928c8a8-26f8-4579-8523-880d17123a9a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:07.302861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928c8a8-26f8-4579-8523-880d17123a9a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:07.307782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ac939-6d50-435f-bbff-d0e3b34f58b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:07.308470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ac939-6d50-435f-bbff-d0e3b34f58b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:07.308796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ac939-6d50-435f-bbff-d0e3b34f58b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:07.309077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ac939-6d50-435f-bbff-d0e3b34f58b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:07.309915 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ac939-6d50-435f-bbff-d0e3b34f58b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:07.312123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ac939-6d50-435f-bbff-d0e3b34f58b3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:07.322163 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4074/8157] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:54:07.326439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b3f82-116c-446e-9301-549f6abd2774 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:07.336156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b3f82-116c-446e-9301-549f6abd2774 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:07.340778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d00fe-975e-4c00-b539-48553f28549e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:07.341713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d00fe-975e-4c00-b539-48553f28549e admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:07.341992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d00fe-975e-4c00-b539-48553f28549e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:07.342272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d00fe-975e-4c00-b539-48553f28549e admin admin] PATH_INFO: `/v3/projects/2e8b83d9239a4f3a94a7c18c0686b7f0/users/af3469a5b3c0426e97a72f7ad8a2426f/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:07.360479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d00fe-975e-4c00-b539-48553f28549e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e8b83d9239a4f3a94a7c18c0686b7f0, user_id=af3469a5b3c0426e97a72f7ad8a2426f, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:07.363352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d00fe-975e-4c00-b539-48553f28549e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:07.437092 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4084/8158] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:54:07 2022] PUT /identity/v3/projects/2e8b83d9239a4f3a94a7c18c0686b7f0/users/af3469a5b3c0426e97a72f7ad8a2426f/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:07.447475 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf43edb-f225-4eb9-871b-2252175174b5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:07.447768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf43edb-f225-4eb9-871b-2252175174b5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:07.448051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf43edb-f225-4eb9-871b-2252175174b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:07.479635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-bcf43edb-f225-4eb9-871b-2252175174b5 None None] MFA Rules not processed for user `af3469a5b3c0426e97a72f7ad8a2426f`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:07.484025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bcf43edb-f225-4eb9-871b-2252175174b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:07.556184 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4075/8159] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:54:07.568094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d00fe-975e-4c00-b539-48553f28549e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:07.569902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-474d00fe-975e-4c00-b539-48553f28549e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:07.645927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d00fe-975e-4c00-b539-48553f28549e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:07.649721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21aa70c-5d61-4b89-aeeb-377f9b86cd31 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:07.650382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21aa70c-5d61-4b89-aeeb-377f9b86cd31 service glance] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:07.650669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21aa70c-5d61-4b89-aeeb-377f9b86cd31 service glance] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:07.650950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21aa70c-5d61-4b89-aeeb-377f9b86cd31 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:07.711046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21aa70c-5d61-4b89-aeeb-377f9b86cd31 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:07.712498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21aa70c-5d61-4b89-aeeb-377f9b86cd31 service glance] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:07.722338 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4085/8160] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:54:07 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:54:08.502173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf43edb-f225-4eb9-871b-2252175174b5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:08.565440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf43edb-f225-4eb9-871b-2252175174b5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:08.570237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02ba40-3062-4d4b-91fe-e8038ce705fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:08.571122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02ba40-3062-4d4b-91fe-e8038ce705fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:08.571436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02ba40-3062-4d4b-91fe-e8038ce705fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:08.571712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02ba40-3062-4d4b-91fe-e8038ce705fa admin admin] PATH_INFO: `/v3/users/b0bbb78010804bb984f347a8e8d322c8` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:08.572936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02ba40-3062-4d4b-91fe-e8038ce705fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0bbb78010804bb984f347a8e8d322c8)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:08.574881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02ba40-3062-4d4b-91fe-e8038ce705fa admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:08.769497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6f02ba40-3062-4d4b-91fe-e8038ce705fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0bbb78010804bb984f347a8e8d322c8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:08.782321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6f02ba40-3062-4d4b-91fe-e8038ce705fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0bbb78010804bb984f347a8e8d322c8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:08.783080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6f02ba40-3062-4d4b-91fe-e8038ce705fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0bbb78010804bb984f347a8e8d322c8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:08.790465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6f02ba40-3062-4d4b-91fe-e8038ce705fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0bbb78010804bb984f347a8e8d322c8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:08.864583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6f02ba40-3062-4d4b-91fe-e8038ce705fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0bbb78010804bb984f347a8e8d322c8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:08.875605 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4076/8161] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:54:08 2022] DELETE /identity/v3/users/b0bbb78010804bb984f347a8e8d322c8 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:08.876863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c53ad-ecaa-431b-adae-66cfe080f550 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:08.877328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c53ad-ecaa-431b-adae-66cfe080f550 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:08.877424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c53ad-ecaa-431b-adae-66cfe080f550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:08.895117 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f95c53ad-ecaa-431b-adae-66cfe080f550 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:08.897014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f95c53ad-ecaa-431b-adae-66cfe080f550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:08.961647 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4086/8162] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:54:08.975967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02ba40-3062-4d4b-91fe-e8038ce705fa admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:08.977481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6f02ba40-3062-4d4b-91fe-e8038ce705fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:09.044953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02ba40-3062-4d4b-91fe-e8038ce705fa admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:09.048861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdca721-d617-4e0f-9f7d-10087a0f2217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:09.049688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdca721-d617-4e0f-9f7d-10087a0f2217 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:09.049840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdca721-d617-4e0f-9f7d-10087a0f2217 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:09.050127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdca721-d617-4e0f-9f7d-10087a0f2217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:09.060131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdca721-d617-4e0f-9f7d-10087a0f2217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:09.061632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdca721-d617-4e0f-9f7d-10087a0f2217 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:09.072619 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4077/8163] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:54:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:54:09.600013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c53ad-ecaa-431b-adae-66cfe080f550 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:09.601549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f95c53ad-ecaa-431b-adae-66cfe080f550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:09.615863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c53ad-ecaa-431b-adae-66cfe080f550 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:09.624981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e287c-0522-4154-a438-6df4109b4997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:09.626154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e287c-0522-4154-a438-6df4109b4997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:09.626562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e287c-0522-4154-a438-6df4109b4997 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:09.626976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e287c-0522-4154-a438-6df4109b4997 admin admin] PATH_INFO: `/v3/projects/c2ce61d99a864d3092130ee18dc7f765` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:09.628373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e287c-0522-4154-a438-6df4109b4997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2ce61d99a864d3092130ee18dc7f765)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:09.630398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e287c-0522-4154-a438-6df4109b4997 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:09.749643 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2c2e287c-0522-4154-a438-6df4109b4997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2ce61d99a864d3092130ee18dc7f765', 'request_id': 'req-2c2e287c-0522-4154-a438-6df4109b4997'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:09.842357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2c2e287c-0522-4154-a438-6df4109b4997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2ce61d99a864d3092130ee18dc7f765', 'request_id': 'req-2c2e287c-0522-4154-a438-6df4109b4997'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:09.849511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2c2e287c-0522-4154-a438-6df4109b4997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2ce61d99a864d3092130ee18dc7f765', 'request_id': 'req-2c2e287c-0522-4154-a438-6df4109b4997'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:09.860544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2c2e287c-0522-4154-a438-6df4109b4997 admin admin] The token cache is being invalidate because project c2ce61d99a864d3092130ee18dc7f765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:54:09.860906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2c2e287c-0522-4154-a438-6df4109b4997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:09.861571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2c2e287c-0522-4154-a438-6df4109b4997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:09.863197 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4087/8164] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:54:09 2022] DELETE /identity/v3/projects/c2ce61d99a864d3092130ee18dc7f765 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:09.867383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdca721-d617-4e0f-9f7d-10087a0f2217 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:09.879477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdca721-d617-4e0f-9f7d-10087a0f2217 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:09.938222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bb855-3a88-4022-b6ac-9bf10bd35977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:09.939139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bb855-3a88-4022-b6ac-9bf10bd35977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:09.939419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bb855-3a88-4022-b6ac-9bf10bd35977 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:09.939693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bb855-3a88-4022-b6ac-9bf10bd35977 admin admin] PATH_INFO: `/v3/users/af3469a5b3c0426e97a72f7ad8a2426f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:09.940922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bb855-3a88-4022-b6ac-9bf10bd35977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af3469a5b3c0426e97a72f7ad8a2426f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:09.943010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bb855-3a88-4022-b6ac-9bf10bd35977 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:10.152731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-433bb855-3a88-4022-b6ac-9bf10bd35977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af3469a5b3c0426e97a72f7ad8a2426f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:10.168017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-433bb855-3a88-4022-b6ac-9bf10bd35977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af3469a5b3c0426e97a72f7ad8a2426f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:10.168017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-433bb855-3a88-4022-b6ac-9bf10bd35977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af3469a5b3c0426e97a72f7ad8a2426f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:10.176049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-433bb855-3a88-4022-b6ac-9bf10bd35977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af3469a5b3c0426e97a72f7ad8a2426f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:10.242522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-433bb855-3a88-4022-b6ac-9bf10bd35977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af3469a5b3c0426e97a72f7ad8a2426f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:10.250514 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4078/8165] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:54:09 2022] DELETE /identity/v3/users/af3469a5b3c0426e97a72f7ad8a2426f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:10.714908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e287c-0522-4154-a438-6df4109b4997 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:10.716357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2c2e287c-0522-4154-a438-6df4109b4997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:10.731566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e287c-0522-4154-a438-6df4109b4997 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:10.799269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f2a61-17e7-497b-9324-a4df26873c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:10.800479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f2a61-17e7-497b-9324-a4df26873c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:10.800960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f2a61-17e7-497b-9324-a4df26873c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:10.801241 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f2a61-17e7-497b-9324-a4df26873c61 admin admin] PATH_INFO: `/v3/projects/2e8b83d9239a4f3a94a7c18c0686b7f0` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:10.802442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f2a61-17e7-497b-9324-a4df26873c61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e8b83d9239a4f3a94a7c18c0686b7f0)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:10.804341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f2a61-17e7-497b-9324-a4df26873c61 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:10.916211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-506f2a61-17e7-497b-9324-a4df26873c61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e8b83d9239a4f3a94a7c18c0686b7f0', 'request_id': 'req-506f2a61-17e7-497b-9324-a4df26873c61'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:11.014012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-506f2a61-17e7-497b-9324-a4df26873c61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e8b83d9239a4f3a94a7c18c0686b7f0', 'request_id': 'req-506f2a61-17e7-497b-9324-a4df26873c61'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:11.020670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-506f2a61-17e7-497b-9324-a4df26873c61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e8b83d9239a4f3a94a7c18c0686b7f0', 'request_id': 'req-506f2a61-17e7-497b-9324-a4df26873c61'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:11.034729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-506f2a61-17e7-497b-9324-a4df26873c61 admin admin] The token cache is being invalidate because project 2e8b83d9239a4f3a94a7c18c0686b7f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:54:11.035098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-506f2a61-17e7-497b-9324-a4df26873c61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:11.035903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-506f2a61-17e7-497b-9324-a4df26873c61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:11.037561 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4088/8166] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:54:10 2022] DELETE /identity/v3/projects/2e8b83d9239a4f3a94a7c18c0686b7f0 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:54:11.042430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c3c38-7372-45ef-8dfd-ac2a4f242b8d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:11.042948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c3c38-7372-45ef-8dfd-ac2a4f242b8d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:11.043042 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c3c38-7372-45ef-8dfd-ac2a4f242b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:11.061836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7a9c3c38-7372-45ef-8dfd-ac2a4f242b8d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:11.063036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7a9c3c38-7372-45ef-8dfd-ac2a4f242b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:11.124404 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4079/8167] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:54:11.132298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a175f-7d84-44e5-a5ba-8d65c9131516 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:11.132593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a175f-7d84-44e5-a5ba-8d65c9131516 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:11.132916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a175f-7d84-44e5-a5ba-8d65c9131516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:11.151150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-060a175f-7d84-44e5-a5ba-8d65c9131516 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:11.152367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-060a175f-7d84-44e5-a5ba-8d65c9131516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:11.160462 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4089/8168] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:54:11.164844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c3c38-7372-45ef-8dfd-ac2a4f242b8d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:11.175417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c3c38-7372-45ef-8dfd-ac2a4f242b8d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:11.180213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6578a-3ada-4d6a-935c-bc2d8c6806c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:11.180906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6578a-3ada-4d6a-935c-bc2d8c6806c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:11.181196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6578a-3ada-4d6a-935c-bc2d8c6806c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:11.181480 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6578a-3ada-4d6a-935c-bc2d8c6806c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:11.182209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6578a-3ada-4d6a-935c-bc2d8c6806c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:54:11.182524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6578a-3ada-4d6a-935c-bc2d8c6806c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:11.184238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6578a-3ada-4d6a-935c-bc2d8c6806c0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:11.196494 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4080/8169] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:54:11.201040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a175f-7d84-44e5-a5ba-8d65c9131516 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:11.210627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a175f-7d84-44e5-a5ba-8d65c9131516 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:11.215299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741d00a-25b4-4d44-b00c-afd9415f5aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:11.216071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d00a-25b4-4d44-b00c-afd9415f5aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:11.216269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d00a-25b4-4d44-b00c-afd9415f5aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:11.216549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d00a-25b4-4d44-b00c-afd9415f5aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:11.217279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741d00a-25b4-4d44-b00c-afd9415f5aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:11.219182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741d00a-25b4-4d44-b00c-afd9415f5aa0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:11.331800 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4090/8170] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:54:11 2022] POST /identity/v3/projects => generated 389 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:54:11.333266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6578a-3ada-4d6a-935c-bc2d8c6806c0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:11.345952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6578a-3ada-4d6a-935c-bc2d8c6806c0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:11.402399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b294d9-c0d4-49e1-9a54-373b023c7436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:11.403082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b294d9-c0d4-49e1-9a54-373b023c7436 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:11.403366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b294d9-c0d4-49e1-9a54-373b023c7436 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:11.404275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b294d9-c0d4-49e1-9a54-373b023c7436 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:11.405025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b294d9-c0d4-49e1-9a54-373b023c7436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:11.406988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b294d9-c0d4-49e1-9a54-373b023c7436 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:11.488061 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4081/8171] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:54:11 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:54:11.498663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741d00a-25b4-4d44-b00c-afd9415f5aa0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:11.509288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741d00a-25b4-4d44-b00c-afd9415f5aa0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:11.515173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07840c4-be83-4e53-8a75-fd1a25fc34db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:11.516001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07840c4-be83-4e53-8a75-fd1a25fc34db admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:11.516347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07840c4-be83-4e53-8a75-fd1a25fc34db admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:11.516659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07840c4-be83-4e53-8a75-fd1a25fc34db admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:11.517391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07840c4-be83-4e53-8a75-fd1a25fc34db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:11.518985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07840c4-be83-4e53-8a75-fd1a25fc34db admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:11.532515 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4091/8172] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:54:11.533664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b294d9-c0d4-49e1-9a54-373b023c7436 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:11.543788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b294d9-c0d4-49e1-9a54-373b023c7436 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:11.548839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48b5f3-b9a4-4f59-b64c-1029d9f07c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:11.549520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48b5f3-b9a4-4f59-b64c-1029d9f07c26 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:11.549810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48b5f3-b9a4-4f59-b64c-1029d9f07c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:11.550093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48b5f3-b9a4-4f59-b64c-1029d9f07c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:11.550823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48b5f3-b9a4-4f59-b64c-1029d9f07c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:11.552462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48b5f3-b9a4-4f59-b64c-1029d9f07c26 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:11.563166 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4082/8173] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:54:11.567399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07840c4-be83-4e53-8a75-fd1a25fc34db admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:11.578460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07840c4-be83-4e53-8a75-fd1a25fc34db admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:11.583236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9c474-bc02-4f31-a53d-b47119417d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:11.584128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9c474-bc02-4f31-a53d-b47119417d12 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:11.584413 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9c474-bc02-4f31-a53d-b47119417d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:11.584732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9c474-bc02-4f31-a53d-b47119417d12 admin admin] PATH_INFO: `/v3/projects/e448900f55144f4ca760ba4c6ab85141/users/5620336b7ec244d4bd644de94cf70c61/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:11.599352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9c474-bc02-4f31-a53d-b47119417d12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e448900f55144f4ca760ba4c6ab85141, user_id=5620336b7ec244d4bd644de94cf70c61, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:11.602242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9c474-bc02-4f31-a53d-b47119417d12 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:11.751952 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4092/8174] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:54:11 2022] PUT /identity/v3/projects/e448900f55144f4ca760ba4c6ab85141/users/5620336b7ec244d4bd644de94cf70c61/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:54:11.763200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7030d-afbd-4f60-aa4a-bc5ecdebe8ca None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:11.763494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7030d-afbd-4f60-aa4a-bc5ecdebe8ca None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:11.763781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7030d-afbd-4f60-aa4a-bc5ecdebe8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:11.795138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-92f7030d-afbd-4f60-aa4a-bc5ecdebe8ca None None] MFA Rules not processed for user `5620336b7ec244d4bd644de94cf70c61`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:11.796340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-92f7030d-afbd-4f60-aa4a-bc5ecdebe8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:11.857243 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4083/8175] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:54:11.867571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9c474-bc02-4f31-a53d-b47119417d12 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:11.869166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e4e9c474-bc02-4f31-a53d-b47119417d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:11.931099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9c474-bc02-4f31-a53d-b47119417d12 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:11.936328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517aed7-238c-47a7-a0a9-b4d2dbe61e41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:11.937029 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517aed7-238c-47a7-a0a9-b4d2dbe61e41 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:11.937320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517aed7-238c-47a7-a0a9-b4d2dbe61e41 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:11.937603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517aed7-238c-47a7-a0a9-b4d2dbe61e41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:11.946746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517aed7-238c-47a7-a0a9-b4d2dbe61e41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:11.948306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517aed7-238c-47a7-a0a9-b4d2dbe61e41 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:11.957803 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4093/8176] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:54:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:54:21.799201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7030d-afbd-4f60-aa4a-bc5ecdebe8ca None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:21.812481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7030d-afbd-4f60-aa4a-bc5ecdebe8ca None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:21.818942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c49a4-36e8-4c56-9384-272942b7869b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:21.818942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c49a4-36e8-4c56-9384-272942b7869b service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:21.818942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c49a4-36e8-4c56-9384-272942b7869b service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:21.818942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c49a4-36e8-4c56-9384-272942b7869b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:21.820654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fc4c49a4-36e8-4c56-9384-272942b7869b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:21.889691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c49a4-36e8-4c56-9384-272942b7869b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:21.891200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c49a4-36e8-4c56-9384-272942b7869b service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:21.902488 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4084/8177] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:54:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:54:22.210141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517aed7-238c-47a7-a0a9-b4d2dbe61e41 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:22.213094 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0517aed7-238c-47a7-a0a9-b4d2dbe61e41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:22.242104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517aed7-238c-47a7-a0a9-b4d2dbe61e41 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:22.253630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97486c-5da8-4a2b-bb23-a9850ce4e8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:22.254833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97486c-5da8-4a2b-bb23-a9850ce4e8bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:22.255197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97486c-5da8-4a2b-bb23-a9850ce4e8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:22.255544 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97486c-5da8-4a2b-bb23-a9850ce4e8bd admin admin] PATH_INFO: `/v3/users/fadb79774ea24b12b22150064091845e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:22.256900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97486c-5da8-4a2b-bb23-a9850ce4e8bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fadb79774ea24b12b22150064091845e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:22.258937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97486c-5da8-4a2b-bb23-a9850ce4e8bd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:22.510660 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bb97486c-5da8-4a2b-bb23-a9850ce4e8bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fadb79774ea24b12b22150064091845e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:22.534465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bb97486c-5da8-4a2b-bb23-a9850ce4e8bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fadb79774ea24b12b22150064091845e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:22.535527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bb97486c-5da8-4a2b-bb23-a9850ce4e8bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fadb79774ea24b12b22150064091845e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:22.543661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bb97486c-5da8-4a2b-bb23-a9850ce4e8bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fadb79774ea24b12b22150064091845e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:22.595951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bb97486c-5da8-4a2b-bb23-a9850ce4e8bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fadb79774ea24b12b22150064091845e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:22.603824 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4094/8178] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:54:22 2022] DELETE /identity/v3/users/fadb79774ea24b12b22150064091845e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:22.608930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d83b1e-75ab-4380-860a-f7cb14c2ae2d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:22.609256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d83b1e-75ab-4380-860a-f7cb14c2ae2d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:22.609500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d83b1e-75ab-4380-860a-f7cb14c2ae2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:22.630729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-29d83b1e-75ab-4380-860a-f7cb14c2ae2d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:22.632251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-29d83b1e-75ab-4380-860a-f7cb14c2ae2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:22.703274 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4085/8179] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:54:22.719731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97486c-5da8-4a2b-bb23-a9850ce4e8bd admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:22.722945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bb97486c-5da8-4a2b-bb23-a9850ce4e8bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:22.794574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97486c-5da8-4a2b-bb23-a9850ce4e8bd admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:22.799096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4dd2c-fc7a-4be3-b6b1-492ea2c89e7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:22.799924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4dd2c-fc7a-4be3-b6b1-492ea2c89e7f service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:22.800222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4dd2c-fc7a-4be3-b6b1-492ea2c89e7f service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:22.800509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4dd2c-fc7a-4be3-b6b1-492ea2c89e7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:22.811504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4dd2c-fc7a-4be3-b6b1-492ea2c89e7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:22.813491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4dd2c-fc7a-4be3-b6b1-492ea2c89e7f service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:22.823439 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4095/8180] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:54:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:54:23.028375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d83b1e-75ab-4380-860a-f7cb14c2ae2d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:23.031454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-29d83b1e-75ab-4380-860a-f7cb14c2ae2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:23.058886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d83b1e-75ab-4380-860a-f7cb14c2ae2d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:23.066085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c48ecb-0eea-4e8a-aa8c-d5ea6e008064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:23.067397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c48ecb-0eea-4e8a-aa8c-d5ea6e008064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:23.067782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c48ecb-0eea-4e8a-aa8c-d5ea6e008064 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:23.068134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c48ecb-0eea-4e8a-aa8c-d5ea6e008064 admin admin] PATH_INFO: `/v3/users/f58c631280fb4cdb917abc34660e3325` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:23.069701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c48ecb-0eea-4e8a-aa8c-d5ea6e008064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f58c631280fb4cdb917abc34660e3325)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:23.071935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c48ecb-0eea-4e8a-aa8c-d5ea6e008064 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:23.233836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53c48ecb-0eea-4e8a-aa8c-d5ea6e008064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f58c631280fb4cdb917abc34660e3325'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:23.246316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53c48ecb-0eea-4e8a-aa8c-d5ea6e008064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f58c631280fb4cdb917abc34660e3325'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:23.247820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53c48ecb-0eea-4e8a-aa8c-d5ea6e008064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f58c631280fb4cdb917abc34660e3325'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:23.254660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53c48ecb-0eea-4e8a-aa8c-d5ea6e008064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f58c631280fb4cdb917abc34660e3325'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:23.293218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53c48ecb-0eea-4e8a-aa8c-d5ea6e008064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f58c631280fb4cdb917abc34660e3325'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:23.302029 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4086/8181] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:54:23 2022] DELETE /identity/v3/users/f58c631280fb4cdb917abc34660e3325 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:23.610795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4dd2c-fc7a-4be3-b6b1-492ea2c89e7f service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:23.612926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-adf4dd2c-fc7a-4be3-b6b1-492ea2c89e7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:23.630494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4dd2c-fc7a-4be3-b6b1-492ea2c89e7f service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:23.737625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da470f11-c386-4da1-b5f8-9b36c4b79108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:23.739932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da470f11-c386-4da1-b5f8-9b36c4b79108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:23.741664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da470f11-c386-4da1-b5f8-9b36c4b79108 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:23.741986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da470f11-c386-4da1-b5f8-9b36c4b79108 admin admin] PATH_INFO: `/v3/projects/2827d1e1688c459fa4a3078297cbbfc5` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:23.748462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da470f11-c386-4da1-b5f8-9b36c4b79108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2827d1e1688c459fa4a3078297cbbfc5)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:23.750613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da470f11-c386-4da1-b5f8-9b36c4b79108 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:23.798898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c48ecb-0eea-4e8a-aa8c-d5ea6e008064 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:23.800537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-53c48ecb-0eea-4e8a-aa8c-d5ea6e008064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:23.832464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c48ecb-0eea-4e8a-aa8c-d5ea6e008064 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:23.841930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7777a5f-33c1-4180-8d9d-e3f8124d6942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:23.844774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7777a5f-33c1-4180-8d9d-e3f8124d6942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:23.845278 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7777a5f-33c1-4180-8d9d-e3f8124d6942 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:23.845783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7777a5f-33c1-4180-8d9d-e3f8124d6942 admin admin] PATH_INFO: `/v3/projects/23dc31c03ada4eba97ae47aab53487d9` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:23.847154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7777a5f-33c1-4180-8d9d-e3f8124d6942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23dc31c03ada4eba97ae47aab53487d9)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:23.849393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7777a5f-33c1-4180-8d9d-e3f8124d6942 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:23.884835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-da470f11-c386-4da1-b5f8-9b36c4b79108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2827d1e1688c459fa4a3078297cbbfc5', 'request_id': 'req-da470f11-c386-4da1-b5f8-9b36c4b79108'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:23.985255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-da470f11-c386-4da1-b5f8-9b36c4b79108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2827d1e1688c459fa4a3078297cbbfc5', 'request_id': 'req-da470f11-c386-4da1-b5f8-9b36c4b79108'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:23.994482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-da470f11-c386-4da1-b5f8-9b36c4b79108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2827d1e1688c459fa4a3078297cbbfc5', 'request_id': 'req-da470f11-c386-4da1-b5f8-9b36c4b79108'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:24.006471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b7777a5f-33c1-4180-8d9d-e3f8124d6942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23dc31c03ada4eba97ae47aab53487d9', 'request_id': 'req-b7777a5f-33c1-4180-8d9d-e3f8124d6942'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:24.009731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-da470f11-c386-4da1-b5f8-9b36c4b79108 admin admin] The token cache is being invalidate because project 2827d1e1688c459fa4a3078297cbbfc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:54:24.010196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-da470f11-c386-4da1-b5f8-9b36c4b79108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:24.011044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-da470f11-c386-4da1-b5f8-9b36c4b79108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:24.014372 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4096/8182] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:54:23 2022] DELETE /identity/v3/projects/2827d1e1688c459fa4a3078297cbbfc5 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:24.016734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b7777a5f-33c1-4180-8d9d-e3f8124d6942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23dc31c03ada4eba97ae47aab53487d9', 'request_id': 'req-b7777a5f-33c1-4180-8d9d-e3f8124d6942'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:24.020488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef9777-2ad6-408d-9c6d-3cb31313411f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:24.020996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef9777-2ad6-408d-9c6d-3cb31313411f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:24.021781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef9777-2ad6-408d-9c6d-3cb31313411f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:24.059208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b9ef9777-2ad6-408d-9c6d-3cb31313411f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:24.063143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b9ef9777-2ad6-408d-9c6d-3cb31313411f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:24.127425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b7777a5f-33c1-4180-8d9d-e3f8124d6942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23dc31c03ada4eba97ae47aab53487d9', 'request_id': 'req-b7777a5f-33c1-4180-8d9d-e3f8124d6942'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:24.142656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b7777a5f-33c1-4180-8d9d-e3f8124d6942 admin admin] The token cache is being invalidate because project 23dc31c03ada4eba97ae47aab53487d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:54:24.143239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b7777a5f-33c1-4180-8d9d-e3f8124d6942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:24.144071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b7777a5f-33c1-4180-8d9d-e3f8124d6942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:24.156731 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4097/8184] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:54:24.161992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7aad6a-b0af-427b-bdf2-0a567e3eff8f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:24.161992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7aad6a-b0af-427b-bdf2-0a567e3eff8f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:24.161992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7aad6a-b0af-427b-bdf2-0a567e3eff8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:24.169993 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4087/8184] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:54:23 2022] DELETE /identity/v3/projects/23dc31c03ada4eba97ae47aab53487d9 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:54:24.188911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ba7aad6a-b0af-427b-bdf2-0a567e3eff8f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:24.190202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ba7aad6a-b0af-427b-bdf2-0a567e3eff8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:24.202967 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4098/8185] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:54:24.204340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7777a5f-33c1-4180-8d9d-e3f8124d6942 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:24.218047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7777a5f-33c1-4180-8d9d-e3f8124d6942 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:24.224068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da1435-3e7e-4d5f-ac23-769ebf88fcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:24.224811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da1435-3e7e-4d5f-ac23-769ebf88fcaf admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:24.225103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da1435-3e7e-4d5f-ac23-769ebf88fcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:24.225385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da1435-3e7e-4d5f-ac23-769ebf88fcaf admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:24.226219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da1435-3e7e-4d5f-ac23-769ebf88fcaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:54:24.226537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da1435-3e7e-4d5f-ac23-769ebf88fcaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:24.228743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da1435-3e7e-4d5f-ac23-769ebf88fcaf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:24.248313 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4088/8186] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:54:24.249636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7aad6a-b0af-427b-bdf2-0a567e3eff8f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:24.261868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7aad6a-b0af-427b-bdf2-0a567e3eff8f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:24.267772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012d2ed-0b7f-4862-b538-191239bfb350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:24.268959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012d2ed-0b7f-4862-b538-191239bfb350 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:24.269576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012d2ed-0b7f-4862-b538-191239bfb350 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:24.269576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012d2ed-0b7f-4862-b538-191239bfb350 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:24.270424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012d2ed-0b7f-4862-b538-191239bfb350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:24.273318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012d2ed-0b7f-4862-b538-191239bfb350 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:24.416706 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4099/8187] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:54:24 2022] POST /identity/v3/projects => generated 389 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:54:24.422887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da1435-3e7e-4d5f-ac23-769ebf88fcaf admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:24.434283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da1435-3e7e-4d5f-ac23-769ebf88fcaf admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:24.512149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd277dcf-be69-4d03-9f04-4d0a06af4a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:24.514073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd277dcf-be69-4d03-9f04-4d0a06af4a26 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:24.514368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd277dcf-be69-4d03-9f04-4d0a06af4a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:24.514648 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd277dcf-be69-4d03-9f04-4d0a06af4a26 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:24.515503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd277dcf-be69-4d03-9f04-4d0a06af4a26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:24.517604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd277dcf-be69-4d03-9f04-4d0a06af4a26 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:24.592633 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4089/8188] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:54:24 2022] POST /identity/v3/users => generated 295 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:54:24.600423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012d2ed-0b7f-4862-b538-191239bfb350 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:24.617567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012d2ed-0b7f-4862-b538-191239bfb350 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:24.625693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775112a-806b-42c6-8823-b345a492decb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:24.627126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775112a-806b-42c6-8823-b345a492decb admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:24.627653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775112a-806b-42c6-8823-b345a492decb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:24.628081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775112a-806b-42c6-8823-b345a492decb admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:24.629304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775112a-806b-42c6-8823-b345a492decb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:24.631543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775112a-806b-42c6-8823-b345a492decb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:24.654693 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4100/8189] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:54:24.658367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd277dcf-be69-4d03-9f04-4d0a06af4a26 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:24.670804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd277dcf-be69-4d03-9f04-4d0a06af4a26 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:24.678923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9948f0-92ad-4e10-a556-901c199cefba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:24.682015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9948f0-92ad-4e10-a556-901c199cefba admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:24.682015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9948f0-92ad-4e10-a556-901c199cefba admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:24.682015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9948f0-92ad-4e10-a556-901c199cefba admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:24.682958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9948f0-92ad-4e10-a556-901c199cefba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:24.684678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9948f0-92ad-4e10-a556-901c199cefba admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:24.696034 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4090/8190] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:54:24.700741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775112a-806b-42c6-8823-b345a492decb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:24.716868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775112a-806b-42c6-8823-b345a492decb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:24.723463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb0b8b-988b-4a58-a67d-3e942e169af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:24.724646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb0b8b-988b-4a58-a67d-3e942e169af4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:24.724782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb0b8b-988b-4a58-a67d-3e942e169af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:24.724990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb0b8b-988b-4a58-a67d-3e942e169af4 admin admin] PATH_INFO: `/v3/projects/eeb256951e894594a924e2d25b0d80c9/users/adfc2828d2bb4affbc749cc9589e588e/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:24.742499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb0b8b-988b-4a58-a67d-3e942e169af4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb256951e894594a924e2d25b0d80c9, user_id=adfc2828d2bb4affbc749cc9589e588e, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:24.745490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb0b8b-988b-4a58-a67d-3e942e169af4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:24.803295 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4101/8191] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:54:24 2022] PUT /identity/v3/projects/eeb256951e894594a924e2d25b0d80c9/users/adfc2828d2bb4affbc749cc9589e588e/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:24.814235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe82b04-6d78-4de9-82e2-493c16642d9c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:24.814575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe82b04-6d78-4de9-82e2-493c16642d9c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:24.814806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe82b04-6d78-4de9-82e2-493c16642d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:24.848571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5fe82b04-6d78-4de9-82e2-493c16642d9c None None] MFA Rules not processed for user `adfc2828d2bb4affbc749cc9589e588e`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:24.850749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5fe82b04-6d78-4de9-82e2-493c16642d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:24.929141 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4091/8192] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:54:24.934079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb0b8b-988b-4a58-a67d-3e942e169af4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:25.030425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb0b8b-988b-4a58-a67d-3e942e169af4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:25.036555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34185b43-2cd2-4ecb-88ae-cb25569ead4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:25.037534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34185b43-2cd2-4ecb-88ae-cb25569ead4f admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:25.037826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34185b43-2cd2-4ecb-88ae-cb25569ead4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:25.038108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34185b43-2cd2-4ecb-88ae-cb25569ead4f admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:25.038819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34185b43-2cd2-4ecb-88ae-cb25569ead4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:25.041193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34185b43-2cd2-4ecb-88ae-cb25569ead4f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:25.149534 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4102/8193] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:54:24 2022] POST /identity/v3/projects => generated 389 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:54:25.150670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe82b04-6d78-4de9-82e2-493c16642d9c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:25.162542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe82b04-6d78-4de9-82e2-493c16642d9c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:25.225252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5528f-0fd1-42d8-bcd1-26329f0af18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:25.225926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5528f-0fd1-42d8-bcd1-26329f0af18e admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:25.226214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5528f-0fd1-42d8-bcd1-26329f0af18e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:25.226487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5528f-0fd1-42d8-bcd1-26329f0af18e admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:25.227188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5528f-0fd1-42d8-bcd1-26329f0af18e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:25.229232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5528f-0fd1-42d8-bcd1-26329f0af18e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:25.347233 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4092/8194] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:54:25 2022] POST /identity/v3/users => generated 295 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:54:25.351634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34185b43-2cd2-4ecb-88ae-cb25569ead4f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:25.364028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34185b43-2cd2-4ecb-88ae-cb25569ead4f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:25.371656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8b0af-6e2e-46b4-84b3-b5bcd42ef21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:25.373192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8b0af-6e2e-46b4-84b3-b5bcd42ef21c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:25.373594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8b0af-6e2e-46b4-84b3-b5bcd42ef21c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:25.373983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8b0af-6e2e-46b4-84b3-b5bcd42ef21c admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:25.374833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8b0af-6e2e-46b4-84b3-b5bcd42ef21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:25.377831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8b0af-6e2e-46b4-84b3-b5bcd42ef21c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:25.393260 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4103/8195] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:54:25.396951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5528f-0fd1-42d8-bcd1-26329f0af18e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:25.410339 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5528f-0fd1-42d8-bcd1-26329f0af18e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:25.419238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b4cb7-06c9-428b-a0f0-2fb142672733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:25.420246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b4cb7-06c9-428b-a0f0-2fb142672733 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:25.420638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b4cb7-06c9-428b-a0f0-2fb142672733 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:25.421010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b4cb7-06c9-428b-a0f0-2fb142672733 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:25.422506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b4cb7-06c9-428b-a0f0-2fb142672733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:25.424200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b4cb7-06c9-428b-a0f0-2fb142672733 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:25.440781 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4093/8196] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:54:25.444714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8b0af-6e2e-46b4-84b3-b5bcd42ef21c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:25.462483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8b0af-6e2e-46b4-84b3-b5bcd42ef21c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:25.468293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e7722-4886-4402-adfd-ae03dbff1961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:25.469650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e7722-4886-4402-adfd-ae03dbff1961 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:25.470168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e7722-4886-4402-adfd-ae03dbff1961 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:25.470685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e7722-4886-4402-adfd-ae03dbff1961 admin admin] PATH_INFO: `/v3/projects/83f8e3250de649088696a71864eaa70c/users/f271053c9fa2462a8cbe012adf62a397/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:25.490529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e7722-4886-4402-adfd-ae03dbff1961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f8e3250de649088696a71864eaa70c, user_id=f271053c9fa2462a8cbe012adf62a397, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:25.493762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e7722-4886-4402-adfd-ae03dbff1961 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:25.573069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e975d72-042b-4154-8ae9-37bdd05e4779 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:25.573221 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4104/8197] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:54:25 2022] PUT /identity/v3/projects/83f8e3250de649088696a71864eaa70c/users/f271053c9fa2462a8cbe012adf62a397/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:25.573365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e975d72-042b-4154-8ae9-37bdd05e4779 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:25.574871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e975d72-042b-4154-8ae9-37bdd05e4779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:25.606150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0e975d72-042b-4154-8ae9-37bdd05e4779 None None] MFA Rules not processed for user `f271053c9fa2462a8cbe012adf62a397`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:25.614444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0e975d72-042b-4154-8ae9-37bdd05e4779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:25.702403 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4094/8198] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:54:25.703925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e7722-4886-4402-adfd-ae03dbff1961 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:25.780220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e7722-4886-4402-adfd-ae03dbff1961 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:25.786223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784a098-ca00-46f8-9c8c-69bf38a7a185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:25.786927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784a098-ca00-46f8-9c8c-69bf38a7a185 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:25.787220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784a098-ca00-46f8-9c8c-69bf38a7a185 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:25.787509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784a098-ca00-46f8-9c8c-69bf38a7a185 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:25.788903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784a098-ca00-46f8-9c8c-69bf38a7a185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:25.791290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784a098-ca00-46f8-9c8c-69bf38a7a185 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:25.890242 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4105/8199] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:54:25 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:54:25.894424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e975d72-042b-4154-8ae9-37bdd05e4779 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:25.905936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e975d72-042b-4154-8ae9-37bdd05e4779 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:25.989466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965e83d-d3fa-4fb6-90b8-0a2caa8b60ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:25.990130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965e83d-d3fa-4fb6-90b8-0a2caa8b60ba admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:25.994560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965e83d-d3fa-4fb6-90b8-0a2caa8b60ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:25.994560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965e83d-d3fa-4fb6-90b8-0a2caa8b60ba admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:25.994560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965e83d-d3fa-4fb6-90b8-0a2caa8b60ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:25.995013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965e83d-d3fa-4fb6-90b8-0a2caa8b60ba admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:26.125786 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4095/8200] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:54:25 2022] POST /identity/v3/users => generated 300 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:54:26.129583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784a098-ca00-46f8-9c8c-69bf38a7a185 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:26.141916 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784a098-ca00-46f8-9c8c-69bf38a7a185 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:26.146829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1920c-b312-4776-ad05-4f10f44023a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:26.147497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1920c-b312-4776-ad05-4f10f44023a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:26.147807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1920c-b312-4776-ad05-4f10f44023a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:26.148085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1920c-b312-4776-ad05-4f10f44023a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:26.148872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1920c-b312-4776-ad05-4f10f44023a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:26.159244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1920c-b312-4776-ad05-4f10f44023a5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:26.161297 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4106/8201] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:54:26.165433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965e83d-d3fa-4fb6-90b8-0a2caa8b60ba admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:26.176346 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965e83d-d3fa-4fb6-90b8-0a2caa8b60ba admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:26.181051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808262a-aff9-490a-96a6-b880c95eba49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:26.181943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808262a-aff9-490a-96a6-b880c95eba49 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:26.182262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808262a-aff9-490a-96a6-b880c95eba49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:26.182512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808262a-aff9-490a-96a6-b880c95eba49 admin admin] PATH_INFO: `/v3/projects/6a41a810c57f408ab43e96fdc897866b/users/82859a65e0f24a4682c5f86d647d3000/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:26.197761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808262a-aff9-490a-96a6-b880c95eba49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a41a810c57f408ab43e96fdc897866b, user_id=82859a65e0f24a4682c5f86d647d3000, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:26.200484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808262a-aff9-490a-96a6-b880c95eba49 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:26.311762 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4096/8202] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:54:26 2022] PUT /identity/v3/projects/6a41a810c57f408ab43e96fdc897866b/users/82859a65e0f24a4682c5f86d647d3000/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:26.315739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1920c-b312-4776-ad05-4f10f44023a5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:26.330389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1920c-b312-4776-ad05-4f10f44023a5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:26.388434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a12b11-9e7a-48bf-acbc-0e79433d3356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:26.391787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a12b11-9e7a-48bf-acbc-0e79433d3356 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:26.394367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a12b11-9e7a-48bf-acbc-0e79433d3356 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:26.394614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a12b11-9e7a-48bf-acbc-0e79433d3356 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:26.396115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a12b11-9e7a-48bf-acbc-0e79433d3356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:26.398044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a12b11-9e7a-48bf-acbc-0e79433d3356 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:26.405287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808262a-aff9-490a-96a6-b880c95eba49 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:26.407415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0808262a-aff9-490a-96a6-b880c95eba49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:26.419714 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4107/8203] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:54:26.424337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a12b11-9e7a-48bf-acbc-0e79433d3356 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:26.427481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808262a-aff9-490a-96a6-b880c95eba49 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:26.434025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb3f9b-af47-4a4d-9c7f-abf3dd9d50b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:26.435457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb3f9b-af47-4a4d-9c7f-abf3dd9d50b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:26.435576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a12b11-9e7a-48bf-acbc-0e79433d3356 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:26.435795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb3f9b-af47-4a4d-9c7f-abf3dd9d50b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:26.436103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb3f9b-af47-4a4d-9c7f-abf3dd9d50b1 admin admin] PATH_INFO: `/v3/users/5620336b7ec244d4bd644de94cf70c61` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:26.437601 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb3f9b-af47-4a4d-9c7f-abf3dd9d50b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5620336b7ec244d4bd644de94cf70c61)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:26.441760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb3f9b-af47-4a4d-9c7f-abf3dd9d50b1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:26.442388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ab29a-cb63-4ea4-b3dc-db60f14f883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:26.443301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ab29a-cb63-4ea4-b3dc-db60f14f883c admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:26.443585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ab29a-cb63-4ea4-b3dc-db60f14f883c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:26.444006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ab29a-cb63-4ea4-b3dc-db60f14f883c admin admin] PATH_INFO: `/v3/projects/6a41a810c57f408ab43e96fdc897866b/users/82859a65e0f24a4682c5f86d647d3000/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:26.446032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ab29a-cb63-4ea4-b3dc-db60f14f883c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a41a810c57f408ab43e96fdc897866b, user_id=82859a65e0f24a4682c5f86d647d3000, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:26.448881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ab29a-cb63-4ea4-b3dc-db60f14f883c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:26.460341 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4108/8204] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:54:26 2022] PUT /identity/v3/projects/6a41a810c57f408ab43e96fdc897866b/users/82859a65e0f24a4682c5f86d647d3000/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:54:26.471786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcf981-0456-41bd-8a32-0227ec2495ba None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:26.472077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcf981-0456-41bd-8a32-0227ec2495ba None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:26.472451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcf981-0456-41bd-8a32-0227ec2495ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:26.499518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ffdcf981-0456-41bd-8a32-0227ec2495ba None None] MFA Rules not processed for user `82859a65e0f24a4682c5f86d647d3000`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:26.500907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ffdcf981-0456-41bd-8a32-0227ec2495ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:26.569585 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4109/8205] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:54:26.584348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcf981-0456-41bd-8a32-0227ec2495ba None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:26.586046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ffdcf981-0456-41bd-8a32-0227ec2495ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:26.645593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-44eb3f9b-af47-4a4d-9c7f-abf3dd9d50b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5620336b7ec244d4bd644de94cf70c61'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:26.658574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-44eb3f9b-af47-4a4d-9c7f-abf3dd9d50b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5620336b7ec244d4bd644de94cf70c61'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:26.660957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-44eb3f9b-af47-4a4d-9c7f-abf3dd9d50b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5620336b7ec244d4bd644de94cf70c61'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:26.668058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-44eb3f9b-af47-4a4d-9c7f-abf3dd9d50b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5620336b7ec244d4bd644de94cf70c61'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:26.677198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcf981-0456-41bd-8a32-0227ec2495ba None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:26.683521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfeafe-15b0-44a3-bb48-a5b4e3d3995d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:26.684255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfeafe-15b0-44a3-bb48-a5b4e3d3995d service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:26.685271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfeafe-15b0-44a3-bb48-a5b4e3d3995d service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:26.687285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfeafe-15b0-44a3-bb48-a5b4e3d3995d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:26.738483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-44eb3f9b-af47-4a4d-9c7f-abf3dd9d50b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5620336b7ec244d4bd644de94cf70c61'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:26.740636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfeafe-15b0-44a3-bb48-a5b4e3d3995d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:26.742245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfeafe-15b0-44a3-bb48-a5b4e3d3995d service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:26.745966 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4097/8206] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:54:26 2022] DELETE /identity/v3/users/5620336b7ec244d4bd644de94cf70c61 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:26.751213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5440790-dc06-4ac7-99fd-c38103d6784b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:26.751620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5440790-dc06-4ac7-99fd-c38103d6784b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:26.751918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5440790-dc06-4ac7-99fd-c38103d6784b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:26.753493 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4110/8207] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:54:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:54:26.772803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c5440790-dc06-4ac7-99fd-c38103d6784b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:26.774305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c5440790-dc06-4ac7-99fd-c38103d6784b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:26.858659 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4098/8208] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:54:26.866196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfeafe-15b0-44a3-bb48-a5b4e3d3995d service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:26.867787 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5adfeafe-15b0-44a3-bb48-a5b4e3d3995d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:26.935708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfeafe-15b0-44a3-bb48-a5b4e3d3995d service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:26.993703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00a8bf-0d8f-4b04-a2de-d42105d5d465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:26.993703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00a8bf-0d8f-4b04-a2de-d42105d5d465 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:26.993703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00a8bf-0d8f-4b04-a2de-d42105d5d465 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:26.993703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00a8bf-0d8f-4b04-a2de-d42105d5d465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:27.001163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00a8bf-0d8f-4b04-a2de-d42105d5d465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:27.003677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00a8bf-0d8f-4b04-a2de-d42105d5d465 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:27.013249 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4111/8209] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:54:27.290557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5440790-dc06-4ac7-99fd-c38103d6784b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:27.292010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c5440790-dc06-4ac7-99fd-c38103d6784b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:27.305015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5440790-dc06-4ac7-99fd-c38103d6784b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:27.310483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68094b4e-989d-4a6a-ae91-898190fcecd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:27.311372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68094b4e-989d-4a6a-ae91-898190fcecd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:27.311714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68094b4e-989d-4a6a-ae91-898190fcecd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:27.312009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68094b4e-989d-4a6a-ae91-898190fcecd8 admin admin] PATH_INFO: `/v3/projects/e448900f55144f4ca760ba4c6ab85141` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:27.313306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68094b4e-989d-4a6a-ae91-898190fcecd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e448900f55144f4ca760ba4c6ab85141)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:27.315243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68094b4e-989d-4a6a-ae91-898190fcecd8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:27.433747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-68094b4e-989d-4a6a-ae91-898190fcecd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e448900f55144f4ca760ba4c6ab85141', 'request_id': 'req-68094b4e-989d-4a6a-ae91-898190fcecd8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:27.446166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-68094b4e-989d-4a6a-ae91-898190fcecd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e448900f55144f4ca760ba4c6ab85141', 'request_id': 'req-68094b4e-989d-4a6a-ae91-898190fcecd8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:27.487668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-68094b4e-989d-4a6a-ae91-898190fcecd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e448900f55144f4ca760ba4c6ab85141', 'request_id': 'req-68094b4e-989d-4a6a-ae91-898190fcecd8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:27.497934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-68094b4e-989d-4a6a-ae91-898190fcecd8 admin admin] The token cache is being invalidate because project e448900f55144f4ca760ba4c6ab85141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:54:27.498223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-68094b4e-989d-4a6a-ae91-898190fcecd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:27.498839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-68094b4e-989d-4a6a-ae91-898190fcecd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:27.500392 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4099/8210] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:54:27 2022] DELETE /identity/v3/projects/e448900f55144f4ca760ba4c6ab85141 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:27.505351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5ccff-bd06-4776-9398-a6e738af8238 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:27.505652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5ccff-bd06-4776-9398-a6e738af8238 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:27.505930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5ccff-bd06-4776-9398-a6e738af8238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:27.526434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-efc5ccff-bd06-4776-9398-a6e738af8238 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:27.527697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-efc5ccff-bd06-4776-9398-a6e738af8238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:27.596075 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4112/8211] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:54:27.603846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b0783-1518-43b5-986f-840ffa44f512 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:27.604157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b0783-1518-43b5-986f-840ffa44f512 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:27.604432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b0783-1518-43b5-986f-840ffa44f512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:27.624006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9e3b0783-1518-43b5-986f-840ffa44f512 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:27.625271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9e3b0783-1518-43b5-986f-840ffa44f512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:27.633964 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4100/8212] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:54:27.638956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5ccff-bd06-4776-9398-a6e738af8238 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:27.649080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5ccff-bd06-4776-9398-a6e738af8238 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:27.655101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d45739-3ed9-457d-b2b4-3d209d746a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:27.655773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d45739-3ed9-457d-b2b4-3d209d746a4c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:27.656066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d45739-3ed9-457d-b2b4-3d209d746a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:27.656349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d45739-3ed9-457d-b2b4-3d209d746a4c admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:27.657129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d45739-3ed9-457d-b2b4-3d209d746a4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:54:27.657441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d45739-3ed9-457d-b2b4-3d209d746a4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:27.659059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d45739-3ed9-457d-b2b4-3d209d746a4c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:27.672437 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4113/8213] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:54:27.676964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b0783-1518-43b5-986f-840ffa44f512 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:27.688303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b0783-1518-43b5-986f-840ffa44f512 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:27.693382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253bf475-7bd5-4176-9b15-98dfa22ab2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:27.694046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253bf475-7bd5-4176-9b15-98dfa22ab2e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:27.694456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253bf475-7bd5-4176-9b15-98dfa22ab2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:27.694742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253bf475-7bd5-4176-9b15-98dfa22ab2e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:27.695450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253bf475-7bd5-4176-9b15-98dfa22ab2e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:27.697609 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253bf475-7bd5-4176-9b15-98dfa22ab2e1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:27.810658 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4101/8214] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:54:27 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:54:27.814898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d45739-3ed9-457d-b2b4-3d209d746a4c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:27.824889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d45739-3ed9-457d-b2b4-3d209d746a4c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:27.886197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8332ff5-dccb-4803-8db1-55a9212735fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:27.887002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8332ff5-dccb-4803-8db1-55a9212735fe admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:27.888512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8332ff5-dccb-4803-8db1-55a9212735fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:27.888843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8332ff5-dccb-4803-8db1-55a9212735fe admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:27.889548 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8332ff5-dccb-4803-8db1-55a9212735fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:27.891488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8332ff5-dccb-4803-8db1-55a9212735fe admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:28.050760 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4114/8215] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:54:27 2022] POST /identity/v3/users => generated 284 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:54:28.054876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253bf475-7bd5-4176-9b15-98dfa22ab2e1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:28.065933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253bf475-7bd5-4176-9b15-98dfa22ab2e1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:28.070739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db215a-f20a-4b9c-84ab-be261947a8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:28.071435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db215a-f20a-4b9c-84ab-be261947a8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:28.071704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db215a-f20a-4b9c-84ab-be261947a8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:28.071982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db215a-f20a-4b9c-84ab-be261947a8d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:28.072743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db215a-f20a-4b9c-84ab-be261947a8d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:28.074377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db215a-f20a-4b9c-84ab-be261947a8d4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:28.085554 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4102/8216] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:54:28.089803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8332ff5-dccb-4803-8db1-55a9212735fe admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:28.102109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8332ff5-dccb-4803-8db1-55a9212735fe admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:28.107244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a1730-843f-42fe-b3f3-da8842b35a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:28.107921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a1730-843f-42fe-b3f3-da8842b35a42 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:28.108206 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a1730-843f-42fe-b3f3-da8842b35a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:28.108486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a1730-843f-42fe-b3f3-da8842b35a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:28.109321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a1730-843f-42fe-b3f3-da8842b35a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:28.111194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a1730-843f-42fe-b3f3-da8842b35a42 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:28.121743 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4115/8217] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:54:28.126624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db215a-f20a-4b9c-84ab-be261947a8d4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:28.137018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db215a-f20a-4b9c-84ab-be261947a8d4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:28.142525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2a7a2-ad1e-43ef-bb78-7d7aa460184f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:28.144721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2a7a2-ad1e-43ef-bb78-7d7aa460184f admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:28.144721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2a7a2-ad1e-43ef-bb78-7d7aa460184f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:28.144721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2a7a2-ad1e-43ef-bb78-7d7aa460184f admin admin] PATH_INFO: `/v3/projects/d4c47f3d452746a0bf7fd974f89f9105/users/c36734aab6ee4c0da7aefd83a8917548/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:28.157824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2a7a2-ad1e-43ef-bb78-7d7aa460184f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4c47f3d452746a0bf7fd974f89f9105, user_id=c36734aab6ee4c0da7aefd83a8917548, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:28.160498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2a7a2-ad1e-43ef-bb78-7d7aa460184f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:28.278002 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4103/8218] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:54:28 2022] PUT /identity/v3/projects/d4c47f3d452746a0bf7fd974f89f9105/users/c36734aab6ee4c0da7aefd83a8917548/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:28.289974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe34eb-3938-44b2-b79a-b3894713192d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:28.290264 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe34eb-3938-44b2-b79a-b3894713192d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:28.290583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe34eb-3938-44b2-b79a-b3894713192d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:28.319571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2dfe34eb-3938-44b2-b79a-b3894713192d None None] MFA Rules not processed for user `c36734aab6ee4c0da7aefd83a8917548`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:28.321586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2dfe34eb-3938-44b2-b79a-b3894713192d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:28.401446 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4116/8219] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:54:28.412948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2a7a2-ad1e-43ef-bb78-7d7aa460184f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:28.415901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-aba2a7a2-ad1e-43ef-bb78-7d7aa460184f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:28.503199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2a7a2-ad1e-43ef-bb78-7d7aa460184f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:28.507918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77603a2-28e2-41bd-b68a-3ddc7b61caee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:28.508587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77603a2-28e2-41bd-b68a-3ddc7b61caee service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:28.509516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77603a2-28e2-41bd-b68a-3ddc7b61caee service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:28.509516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77603a2-28e2-41bd-b68a-3ddc7b61caee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:28.520103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77603a2-28e2-41bd-b68a-3ddc7b61caee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:28.521742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77603a2-28e2-41bd-b68a-3ddc7b61caee service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:28.534566 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4104/8220] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:54:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:54:29.982208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe34eb-3938-44b2-b79a-b3894713192d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:29.998061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe34eb-3938-44b2-b79a-b3894713192d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:30.005676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0d607-bd44-478e-bf82-2347fe8740b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:30.006769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0d607-bd44-478e-bf82-2347fe8740b2 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:30.009151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0d607-bd44-478e-bf82-2347fe8740b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:30.009709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0d607-bd44-478e-bf82-2347fe8740b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:30.017297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f8b0d607-bd44-478e-bf82-2347fe8740b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:30.156458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0d607-bd44-478e-bf82-2347fe8740b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:30.158447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0d607-bd44-478e-bf82-2347fe8740b2 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:30.170508 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4117/8221] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:54:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:54:37.079473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f47d78-33de-40ac-9f73-9325cdb50d48 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:37.080779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f47d78-33de-40ac-9f73-9325cdb50d48 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:37.081221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f47d78-33de-40ac-9f73-9325cdb50d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:37.123128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-50f47d78-33de-40ac-9f73-9325cdb50d48 None None] MFA Rules not processed for user `adfc2828d2bb4affbc749cc9589e588e`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:37.124435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-50f47d78-33de-40ac-9f73-9325cdb50d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:37.247425 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4105/8222] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:54:38.291853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0d607-bd44-478e-bf82-2347fe8740b2 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:38.293478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f8b0d607-bd44-478e-bf82-2347fe8740b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:38.315487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0d607-bd44-478e-bf82-2347fe8740b2 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:38.330216 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbd9c3-8698-419f-9d5d-9030ad9e0c23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:38.330907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbd9c3-8698-419f-9d5d-9030ad9e0c23 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:38.331567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbd9c3-8698-419f-9d5d-9030ad9e0c23 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:38.331567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbd9c3-8698-419f-9d5d-9030ad9e0c23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:38.335735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-89bbd9c3-8698-419f-9d5d-9030ad9e0c23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:38.367610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbd9c3-8698-419f-9d5d-9030ad9e0c23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:38.372122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbd9c3-8698-419f-9d5d-9030ad9e0c23 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:38.395694 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4118/8223] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:54:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:54:50.728650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f47d78-33de-40ac-9f73-9325cdb50d48 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:50.742789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbd9c3-8698-419f-9d5d-9030ad9e0c23 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:50.746280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-89bbd9c3-8698-419f-9d5d-9030ad9e0c23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:50.750862 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f47d78-33de-40ac-9f73-9325cdb50d48 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:50.755019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f58ec8-2aa6-4681-92d2-cf6de7f0af9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:50.755898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f58ec8-2aa6-4681-92d2-cf6de7f0af9f service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:50.756449 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f58ec8-2aa6-4681-92d2-cf6de7f0af9f service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:50.757271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f58ec8-2aa6-4681-92d2-cf6de7f0af9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:50.759826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-56f58ec8-2aa6-4681-92d2-cf6de7f0af9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:50.863866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbd9c3-8698-419f-9d5d-9030ad9e0c23 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:50.870193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf4ac2-9362-4833-8598-b480066e7453 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:50.876689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf4ac2-9362-4833-8598-b480066e7453 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:50.876689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf4ac2-9362-4833-8598-b480066e7453 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:50.876689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf4ac2-9362-4833-8598-b480066e7453 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:50.876689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9edf4ac2-9362-4833-8598-b480066e7453 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:50.906448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f58ec8-2aa6-4681-92d2-cf6de7f0af9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:50.908433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f58ec8-2aa6-4681-92d2-cf6de7f0af9f service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:50.930423 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4106/8224] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:54:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:54:50.970822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf4ac2-9362-4833-8598-b480066e7453 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:50.972475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf4ac2-9362-4833-8598-b480066e7453 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:51.004631 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4119/8225] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:54:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:54:51.993574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f58ec8-2aa6-4681-92d2-cf6de7f0af9f service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:51.995706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-56f58ec8-2aa6-4681-92d2-cf6de7f0af9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:52.098834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f58ec8-2aa6-4681-92d2-cf6de7f0af9f service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:52.105364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0a540-bcb0-471a-a746-eebb48732579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:52.107686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0a540-bcb0-471a-a746-eebb48732579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:52.108171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0a540-bcb0-471a-a746-eebb48732579 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:52.108663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0a540-bcb0-471a-a746-eebb48732579 admin admin] PATH_INFO: `/v3/users/ae225802744348a59b3525a3b8041c44` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:52.110790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0a540-bcb0-471a-a746-eebb48732579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae225802744348a59b3525a3b8041c44)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:52.113038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0a540-bcb0-471a-a746-eebb48732579 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:52.322597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf4ac2-9362-4833-8598-b480066e7453 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:52.337263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf4ac2-9362-4833-8598-b480066e7453 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:52.342749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47673b51-c61e-460e-b879-1498651b0c23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:52.343683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47673b51-c61e-460e-b879-1498651b0c23 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:52.344139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47673b51-c61e-460e-b879-1498651b0c23 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:52.344576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47673b51-c61e-460e-b879-1498651b0c23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:52.347610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-44b0a540-bcb0-471a-a746-eebb48732579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae225802744348a59b3525a3b8041c44'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:52.348191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-47673b51-c61e-460e-b879-1498651b0c23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:52.373295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47673b51-c61e-460e-b879-1498651b0c23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:52.375839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47673b51-c61e-460e-b879-1498651b0c23 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:52.378491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-44b0a540-bcb0-471a-a746-eebb48732579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae225802744348a59b3525a3b8041c44'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:52.384439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-44b0a540-bcb0-471a-a746-eebb48732579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae225802744348a59b3525a3b8041c44'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:52.392357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-44b0a540-bcb0-471a-a746-eebb48732579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae225802744348a59b3525a3b8041c44'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:52.394703 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4120/8226] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:54:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:54:52.453846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-44b0a540-bcb0-471a-a746-eebb48732579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae225802744348a59b3525a3b8041c44'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:52.461216 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4107/8227] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:54:51 2022] DELETE /identity/v3/users/ae225802744348a59b3525a3b8041c44 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:52.466132 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac04b0-9d33-4ddf-9da6-15db6712bdb9 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:52.466549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac04b0-9d33-4ddf-9da6-15db6712bdb9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:52.466936 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac04b0-9d33-4ddf-9da6-15db6712bdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:52.488790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4dac04b0-9d33-4ddf-9da6-15db6712bdb9 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:52.490154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4dac04b0-9d33-4ddf-9da6-15db6712bdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:52.555654 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4121/8228] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:54:52.566333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0a540-bcb0-471a-a746-eebb48732579 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:52.567929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-44b0a540-bcb0-471a-a746-eebb48732579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:52.639943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0a540-bcb0-471a-a746-eebb48732579 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:52.644102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605d3be-0ec9-43f8-a98a-78857f6735ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:52.652397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605d3be-0ec9-43f8-a98a-78857f6735ff service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:52.652397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605d3be-0ec9-43f8-a98a-78857f6735ff service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:52.652397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605d3be-0ec9-43f8-a98a-78857f6735ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:52.655892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605d3be-0ec9-43f8-a98a-78857f6735ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:52.657440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605d3be-0ec9-43f8-a98a-78857f6735ff service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:52.670956 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4108/8229] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:54:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:54:53.040560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac04b0-9d33-4ddf-9da6-15db6712bdb9 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:53.042418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4dac04b0-9d33-4ddf-9da6-15db6712bdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:53.058267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac04b0-9d33-4ddf-9da6-15db6712bdb9 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:53.066042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba358990-66df-4789-8cd6-bbbddf0e14e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:53.067008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba358990-66df-4789-8cd6-bbbddf0e14e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:53.067813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba358990-66df-4789-8cd6-bbbddf0e14e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:53.067813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba358990-66df-4789-8cd6-bbbddf0e14e6 admin admin] PATH_INFO: `/v3/projects/338615e31b6d40afa8284770f941785d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:53.068954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba358990-66df-4789-8cd6-bbbddf0e14e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=338615e31b6d40afa8284770f941785d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:53.071145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba358990-66df-4789-8cd6-bbbddf0e14e6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:53.215276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ba358990-66df-4789-8cd6-bbbddf0e14e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '338615e31b6d40afa8284770f941785d', 'request_id': 'req-ba358990-66df-4789-8cd6-bbbddf0e14e6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:53.329492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ba358990-66df-4789-8cd6-bbbddf0e14e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '338615e31b6d40afa8284770f941785d', 'request_id': 'req-ba358990-66df-4789-8cd6-bbbddf0e14e6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:53.346168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ba358990-66df-4789-8cd6-bbbddf0e14e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '338615e31b6d40afa8284770f941785d', 'request_id': 'req-ba358990-66df-4789-8cd6-bbbddf0e14e6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:53.365990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ba358990-66df-4789-8cd6-bbbddf0e14e6 admin admin] The token cache is being invalidate because project 338615e31b6d40afa8284770f941785d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:54:53.366532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ba358990-66df-4789-8cd6-bbbddf0e14e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:53.368753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ba358990-66df-4789-8cd6-bbbddf0e14e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:54:53.372307 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4122/8230] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:54:53 2022] DELETE /identity/v3/projects/338615e31b6d40afa8284770f941785d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:53.377128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1384e5-d2f1-47eb-83a0-5f0bce11f4c6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:53.377673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1384e5-d2f1-47eb-83a0-5f0bce11f4c6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:53.377777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1384e5-d2f1-47eb-83a0-5f0bce11f4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:53.402376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-da1384e5-d2f1-47eb-83a0-5f0bce11f4c6 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:53.405007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-da1384e5-d2f1-47eb-83a0-5f0bce11f4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:53.521926 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4109/8231] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:54:53.533767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab3349-1b51-429f-9031-bd0d5ecd631e None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:53.534070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab3349-1b51-429f-9031-bd0d5ecd631e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:53.534555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab3349-1b51-429f-9031-bd0d5ecd631e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:53.561568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-72ab3349-1b51-429f-9031-bd0d5ecd631e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:53.563004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-72ab3349-1b51-429f-9031-bd0d5ecd631e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:53.575381 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4123/8232] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:54:53.580438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1384e5-d2f1-47eb-83a0-5f0bce11f4c6 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:53.599169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1384e5-d2f1-47eb-83a0-5f0bce11f4c6 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:53.613671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe598a-bc10-419b-9cb5-fa14768500dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:53.614378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe598a-bc10-419b-9cb5-fa14768500dd admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:53.614698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe598a-bc10-419b-9cb5-fa14768500dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:53.614992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe598a-bc10-419b-9cb5-fa14768500dd admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:53.615733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe598a-bc10-419b-9cb5-fa14768500dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:54:53.616077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe598a-bc10-419b-9cb5-fa14768500dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:53.617751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe598a-bc10-419b-9cb5-fa14768500dd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:53.646392 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4110/8233] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:54:53.651189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab3349-1b51-429f-9031-bd0d5ecd631e None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:53.662735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab3349-1b51-429f-9031-bd0d5ecd631e None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:53.668922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2f82d-88b3-431e-9ca5-d1c3f53d5247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:53.669317 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2f82d-88b3-431e-9ca5-d1c3f53d5247 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:53.669611 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2f82d-88b3-431e-9ca5-d1c3f53d5247 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:53.670135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2f82d-88b3-431e-9ca5-d1c3f53d5247 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:53.670870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2f82d-88b3-431e-9ca5-d1c3f53d5247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:53.672826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2f82d-88b3-431e-9ca5-d1c3f53d5247 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:53.798262 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4124/8234] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:54:53 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:54:53.802342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe598a-bc10-419b-9cb5-fa14768500dd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:53.812910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe598a-bc10-419b-9cb5-fa14768500dd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:53.878722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23711c40-b407-411f-b9c1-f80265fdd096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:53.879786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23711c40-b407-411f-b9c1-f80265fdd096 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:53.880546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23711c40-b407-411f-b9c1-f80265fdd096 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:53.881035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23711c40-b407-411f-b9c1-f80265fdd096 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:53.881758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23711c40-b407-411f-b9c1-f80265fdd096 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:53.883725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23711c40-b407-411f-b9c1-f80265fdd096 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:53.955218 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4111/8235] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:54:53 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:54:53.958903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2f82d-88b3-431e-9ca5-d1c3f53d5247 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:53.972160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2f82d-88b3-431e-9ca5-d1c3f53d5247 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:53.990012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73597bde-661a-4d25-9bdf-dec7cd985ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:53.990012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73597bde-661a-4d25-9bdf-dec7cd985ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:53.990012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73597bde-661a-4d25-9bdf-dec7cd985ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:53.990012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73597bde-661a-4d25-9bdf-dec7cd985ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:53.990774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73597bde-661a-4d25-9bdf-dec7cd985ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:53.991933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73597bde-661a-4d25-9bdf-dec7cd985ac8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:54.004635 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4125/8236] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:54:54.007622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23711c40-b407-411f-b9c1-f80265fdd096 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:54.018867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23711c40-b407-411f-b9c1-f80265fdd096 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:54.023832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754e18f-119e-467a-9e12-a513359eadcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:54.025154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754e18f-119e-467a-9e12-a513359eadcb admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:54.025520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754e18f-119e-467a-9e12-a513359eadcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:54.025837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754e18f-119e-467a-9e12-a513359eadcb admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:54.026637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754e18f-119e-467a-9e12-a513359eadcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:54.028926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754e18f-119e-467a-9e12-a513359eadcb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:54.039962 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4112/8237] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:54:54.044313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73597bde-661a-4d25-9bdf-dec7cd985ac8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:54.054878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73597bde-661a-4d25-9bdf-dec7cd985ac8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:54.060673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfd53d-926e-4c08-80e8-9c61913dd651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:54.061952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfd53d-926e-4c08-80e8-9c61913dd651 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:54.061952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfd53d-926e-4c08-80e8-9c61913dd651 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:54.062142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfd53d-926e-4c08-80e8-9c61913dd651 admin admin] PATH_INFO: `/v3/projects/69ba2e157a534424b5954b8fbd93777a/users/2ea0296763f340b287e3f2f2bd594472/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:54.080253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfd53d-926e-4c08-80e8-9c61913dd651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69ba2e157a534424b5954b8fbd93777a, user_id=2ea0296763f340b287e3f2f2bd594472, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:54.096466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfd53d-926e-4c08-80e8-9c61913dd651 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:54.243460 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4126/8238] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:54:54 2022] PUT /identity/v3/projects/69ba2e157a534424b5954b8fbd93777a/users/2ea0296763f340b287e3f2f2bd594472/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:54:54.253769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea53f2-9c2d-47a5-a5b1-e242f79a2536 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:54.254147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea53f2-9c2d-47a5-a5b1-e242f79a2536 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:54.254559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea53f2-9c2d-47a5-a5b1-e242f79a2536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:54.285528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-abea53f2-9c2d-47a5-a5b1-e242f79a2536 None None] MFA Rules not processed for user `2ea0296763f340b287e3f2f2bd594472`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:54:54.286955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-abea53f2-9c2d-47a5-a5b1-e242f79a2536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:54.389745 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4113/8239] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:54:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:54:54.396101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfd53d-926e-4c08-80e8-9c61913dd651 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:54:54.398436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-38bfd53d-926e-4c08-80e8-9c61913dd651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:54:54.473757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfd53d-926e-4c08-80e8-9c61913dd651 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:54:54.477625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3715f-994f-4137-9f7d-00cb585fa273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:54:54.478276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3715f-994f-4137-9f7d-00cb585fa273 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:54:54.478564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3715f-994f-4137-9f7d-00cb585fa273 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:54:54.478851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3715f-994f-4137-9f7d-00cb585fa273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:54:54.488435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3715f-994f-4137-9f7d-00cb585fa273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:54:54.489912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3715f-994f-4137-9f7d-00cb585fa273 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:54:54.499969 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4127/8240] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:54:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:55:07.131950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea53f2-9c2d-47a5-a5b1-e242f79a2536 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:07.133447 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-abea53f2-9c2d-47a5-a5b1-e242f79a2536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:07.149584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea53f2-9c2d-47a5-a5b1-e242f79a2536 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:07.155055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab12921-9129-4274-ad8a-ec08c8c82fd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:07.155938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab12921-9129-4274-ad8a-ec08c8c82fd0 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:07.156425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab12921-9129-4274-ad8a-ec08c8c82fd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:07.157030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab12921-9129-4274-ad8a-ec08c8c82fd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:07.161999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1ab12921-9129-4274-ad8a-ec08c8c82fd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:07.250918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab12921-9129-4274-ad8a-ec08c8c82fd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:07.253418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab12921-9129-4274-ad8a-ec08c8c82fd0 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:07.269155 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4114/8241] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:55:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:55:10.581484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3715f-994f-4137-9f7d-00cb585fa273 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:10.600019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3715f-994f-4137-9f7d-00cb585fa273 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:10.609179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3288a-91af-47dc-ad28-4108863723f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:10.610458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3288a-91af-47dc-ad28-4108863723f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:10.617839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3288a-91af-47dc-ad28-4108863723f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:10.617839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3288a-91af-47dc-ad28-4108863723f5 admin admin] PATH_INFO: `/v3/users/2ea0296763f340b287e3f2f2bd594472` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:10.617839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3288a-91af-47dc-ad28-4108863723f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea0296763f340b287e3f2f2bd594472)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:10.617839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3288a-91af-47dc-ad28-4108863723f5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:10.829348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ece3288a-91af-47dc-ad28-4108863723f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea0296763f340b287e3f2f2bd594472'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:10.846748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ece3288a-91af-47dc-ad28-4108863723f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea0296763f340b287e3f2f2bd594472'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:10.847601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ece3288a-91af-47dc-ad28-4108863723f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea0296763f340b287e3f2f2bd594472'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:10.863651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ece3288a-91af-47dc-ad28-4108863723f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea0296763f340b287e3f2f2bd594472'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:10.927588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ece3288a-91af-47dc-ad28-4108863723f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea0296763f340b287e3f2f2bd594472'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:10.935493 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4128/8242] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:55:10 2022] DELETE /identity/v3/users/2ea0296763f340b287e3f2f2bd594472 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:55:10.939946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0350cb-43a0-4d90-825c-9c8d8a0aed2f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:10.940974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0350cb-43a0-4d90-825c-9c8d8a0aed2f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:10.941446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0350cb-43a0-4d90-825c-9c8d8a0aed2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:10.968442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7f0350cb-43a0-4d90-825c-9c8d8a0aed2f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:55:10.968442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7f0350cb-43a0-4d90-825c-9c8d8a0aed2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:11.073291 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4115/8243] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:55:11.082619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3288a-91af-47dc-ad28-4108863723f5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:11.084123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ece3288a-91af-47dc-ad28-4108863723f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:11.228342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3288a-91af-47dc-ad28-4108863723f5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:11.235863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f675233-8151-4777-800f-aefa3e89a5dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:11.236856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f675233-8151-4777-800f-aefa3e89a5dd service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:11.237318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f675233-8151-4777-800f-aefa3e89a5dd service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:11.237659 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f675233-8151-4777-800f-aefa3e89a5dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:11.250737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f675233-8151-4777-800f-aefa3e89a5dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:11.268115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f675233-8151-4777-800f-aefa3e89a5dd service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:11.296525 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4129/8244] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:55:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:55:11.778028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0350cb-43a0-4d90-825c-9c8d8a0aed2f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:11.779589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7f0350cb-43a0-4d90-825c-9c8d8a0aed2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:11.810645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0350cb-43a0-4d90-825c-9c8d8a0aed2f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:11.826642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27303cc4-0bf5-4533-be73-def7178095f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:11.826642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27303cc4-0bf5-4533-be73-def7178095f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:11.826642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27303cc4-0bf5-4533-be73-def7178095f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:11.826642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27303cc4-0bf5-4533-be73-def7178095f5 admin admin] PATH_INFO: `/v3/projects/69ba2e157a534424b5954b8fbd93777a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:11.827981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27303cc4-0bf5-4533-be73-def7178095f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69ba2e157a534424b5954b8fbd93777a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:11.830804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27303cc4-0bf5-4533-be73-def7178095f5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:11.987623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-27303cc4-0bf5-4533-be73-def7178095f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69ba2e157a534424b5954b8fbd93777a', 'request_id': 'req-27303cc4-0bf5-4533-be73-def7178095f5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:11.995173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-27303cc4-0bf5-4533-be73-def7178095f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69ba2e157a534424b5954b8fbd93777a', 'request_id': 'req-27303cc4-0bf5-4533-be73-def7178095f5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:12.063312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-27303cc4-0bf5-4533-be73-def7178095f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69ba2e157a534424b5954b8fbd93777a', 'request_id': 'req-27303cc4-0bf5-4533-be73-def7178095f5'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:12.076909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-27303cc4-0bf5-4533-be73-def7178095f5 admin admin] The token cache is being invalidate because project 69ba2e157a534424b5954b8fbd93777a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:55:12.077492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-27303cc4-0bf5-4533-be73-def7178095f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:12.078540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-27303cc4-0bf5-4533-be73-def7178095f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:12.080992 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4116/8245] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:55:11 2022] DELETE /identity/v3/projects/69ba2e157a534424b5954b8fbd93777a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:55:12.085960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46cabf-832d-4b8f-9a7d-97fd5befd2ad None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:12.086440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46cabf-832d-4b8f-9a7d-97fd5befd2ad None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:12.086587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46cabf-832d-4b8f-9a7d-97fd5befd2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:12.106490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6a46cabf-832d-4b8f-9a7d-97fd5befd2ad None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:55:12.108064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6a46cabf-832d-4b8f-9a7d-97fd5befd2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:12.178969 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4130/8246] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:55:12.187095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c247de-f7b0-44a5-b2d2-c144258ce57a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:12.187423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c247de-f7b0-44a5-b2d2-c144258ce57a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:12.187772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c247de-f7b0-44a5-b2d2-c144258ce57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:12.209534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-59c247de-f7b0-44a5-b2d2-c144258ce57a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:55:12.211184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-59c247de-f7b0-44a5-b2d2-c144258ce57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:12.224921 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4117/8247] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:55:12.226091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46cabf-832d-4b8f-9a7d-97fd5befd2ad None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:12.247799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46cabf-832d-4b8f-9a7d-97fd5befd2ad None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:12.250362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb47fe-bbf1-409f-a413-5e80973c09c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:12.251044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb47fe-bbf1-409f-a413-5e80973c09c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:12.251337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb47fe-bbf1-409f-a413-5e80973c09c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:12.251846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb47fe-bbf1-409f-a413-5e80973c09c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:12.252593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb47fe-bbf1-409f-a413-5e80973c09c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:55:12.252934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb47fe-bbf1-409f-a413-5e80973c09c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:12.254616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb47fe-bbf1-409f-a413-5e80973c09c4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:12.270713 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4131/8248] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:55:12.274912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c247de-f7b0-44a5-b2d2-c144258ce57a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:12.285009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c247de-f7b0-44a5-b2d2-c144258ce57a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:12.289674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1140b-074e-4cbb-86d2-053309f7258a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:12.290410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1140b-074e-4cbb-86d2-053309f7258a admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:12.290786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1140b-074e-4cbb-86d2-053309f7258a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:12.291148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1140b-074e-4cbb-86d2-053309f7258a admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:12.291897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1140b-074e-4cbb-86d2-053309f7258a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:12.293898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1140b-074e-4cbb-86d2-053309f7258a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:12.364430 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4118/8249] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:55:12 2022] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:55:12.371256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb47fe-bbf1-409f-a413-5e80973c09c4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:12.385126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb47fe-bbf1-409f-a413-5e80973c09c4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:12.450450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599ccc6-b8ab-4f70-9556-56774fac838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:12.451299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599ccc6-b8ab-4f70-9556-56774fac838c admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:12.451658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599ccc6-b8ab-4f70-9556-56774fac838c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:12.452267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599ccc6-b8ab-4f70-9556-56774fac838c admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:12.452855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599ccc6-b8ab-4f70-9556-56774fac838c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:12.454984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599ccc6-b8ab-4f70-9556-56774fac838c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:12.524985 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4132/8250] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:55:12 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:55:12.526202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1140b-074e-4cbb-86d2-053309f7258a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:12.536660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1140b-074e-4cbb-86d2-053309f7258a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:12.554371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556dd7b-6cf3-4101-82a3-41326c6956e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:12.555359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556dd7b-6cf3-4101-82a3-41326c6956e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:12.555809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556dd7b-6cf3-4101-82a3-41326c6956e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:12.556089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556dd7b-6cf3-4101-82a3-41326c6956e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:12.556931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556dd7b-6cf3-4101-82a3-41326c6956e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:12.559387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556dd7b-6cf3-4101-82a3-41326c6956e8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:12.573384 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4119/8251] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:55:12.578988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599ccc6-b8ab-4f70-9556-56774fac838c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:12.595150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599ccc6-b8ab-4f70-9556-56774fac838c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:12.603098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266c5bd-507f-4924-8312-f80f12ae2ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:12.603098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266c5bd-507f-4924-8312-f80f12ae2ffe admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:12.603098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266c5bd-507f-4924-8312-f80f12ae2ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:12.603098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266c5bd-507f-4924-8312-f80f12ae2ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:12.604755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266c5bd-507f-4924-8312-f80f12ae2ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:12.606923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266c5bd-507f-4924-8312-f80f12ae2ffe admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:12.624807 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4133/8252] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:55:12.626522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556dd7b-6cf3-4101-82a3-41326c6956e8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:12.638824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556dd7b-6cf3-4101-82a3-41326c6956e8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:12.644573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343853d-21fc-4447-b55f-f3102c36f260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:12.645514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343853d-21fc-4447-b55f-f3102c36f260 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:12.645790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343853d-21fc-4447-b55f-f3102c36f260 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:12.646294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343853d-21fc-4447-b55f-f3102c36f260 admin admin] PATH_INFO: `/v3/projects/0d388d514f434af89e98ad4b0626fbda/users/1a44bde5803a4e17bd656e302cfca597/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:12.666504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343853d-21fc-4447-b55f-f3102c36f260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d388d514f434af89e98ad4b0626fbda, user_id=1a44bde5803a4e17bd656e302cfca597, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:12.669361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343853d-21fc-4447-b55f-f3102c36f260 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:12.745679 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4120/8253] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:55:12 2022] PUT /identity/v3/projects/0d388d514f434af89e98ad4b0626fbda/users/1a44bde5803a4e17bd656e302cfca597/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:55:12.755963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec613b3e-7ef9-4618-9646-d91144c9b433 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:12.756367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec613b3e-7ef9-4618-9646-d91144c9b433 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:12.756790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec613b3e-7ef9-4618-9646-d91144c9b433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:12.799577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ec613b3e-7ef9-4618-9646-d91144c9b433 None None] MFA Rules not processed for user `1a44bde5803a4e17bd656e302cfca597`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:55:12.801017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ec613b3e-7ef9-4618-9646-d91144c9b433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:12.904222 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4134/8254] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:55:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:55:12.925517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343853d-21fc-4447-b55f-f3102c36f260 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:12.929818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4343853d-21fc-4447-b55f-f3102c36f260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:13.040842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343853d-21fc-4447-b55f-f3102c36f260 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:13.050938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe00186-54c5-4588-984e-d63b51b09d09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:13.051767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe00186-54c5-4588-984e-d63b51b09d09 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:13.053372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe00186-54c5-4588-984e-d63b51b09d09 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:13.054154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe00186-54c5-4588-984e-d63b51b09d09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:13.069600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe00186-54c5-4588-984e-d63b51b09d09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:13.071417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe00186-54c5-4588-984e-d63b51b09d09 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:13.085589 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4121/8255] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:55:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:55:15.502492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec613b3e-7ef9-4618-9646-d91144c9b433 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:15.504097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ec613b3e-7ef9-4618-9646-d91144c9b433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:15.580328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec613b3e-7ef9-4618-9646-d91144c9b433 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:15.587376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41009761-a121-48fc-b653-ba28135721c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:15.588549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41009761-a121-48fc-b653-ba28135721c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:15.589814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41009761-a121-48fc-b653-ba28135721c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:15.589814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41009761-a121-48fc-b653-ba28135721c1 admin admin] PATH_INFO: `/v3/users/c36734aab6ee4c0da7aefd83a8917548` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:15.590542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41009761-a121-48fc-b653-ba28135721c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c36734aab6ee4c0da7aefd83a8917548)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:15.592493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41009761-a121-48fc-b653-ba28135721c1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:15.785401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-41009761-a121-48fc-b653-ba28135721c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c36734aab6ee4c0da7aefd83a8917548'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:15.806618 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-41009761-a121-48fc-b653-ba28135721c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c36734aab6ee4c0da7aefd83a8917548'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:15.807621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-41009761-a121-48fc-b653-ba28135721c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c36734aab6ee4c0da7aefd83a8917548'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:15.815511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-41009761-a121-48fc-b653-ba28135721c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c36734aab6ee4c0da7aefd83a8917548'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:15.894018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-41009761-a121-48fc-b653-ba28135721c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c36734aab6ee4c0da7aefd83a8917548'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:15.903183 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4135/8256] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:55:15 2022] DELETE /identity/v3/users/c36734aab6ee4c0da7aefd83a8917548 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:55:15.910085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96cd5e-69e4-483c-b228-732946c6dea9 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:15.911636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96cd5e-69e4-483c-b228-732946c6dea9 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:15.911788 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96cd5e-69e4-483c-b228-732946c6dea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:15.931506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-fc96cd5e-69e4-483c-b228-732946c6dea9 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:55:15.933100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fc96cd5e-69e4-483c-b228-732946c6dea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:16.013422 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4122/8257] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:55:16.026172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41009761-a121-48fc-b653-ba28135721c1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:16.029554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-41009761-a121-48fc-b653-ba28135721c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:16.097687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41009761-a121-48fc-b653-ba28135721c1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:16.106799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151e285-2349-449e-926a-241f034af895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:16.108766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151e285-2349-449e-926a-241f034af895 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:16.109663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151e285-2349-449e-926a-241f034af895 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:16.110165 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151e285-2349-449e-926a-241f034af895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:16.130014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151e285-2349-449e-926a-241f034af895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:16.132833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151e285-2349-449e-926a-241f034af895 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:16.148014 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4136/8258] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:55:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:55:16.600623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96cd5e-69e4-483c-b228-732946c6dea9 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:16.603767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fc96cd5e-69e4-483c-b228-732946c6dea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:16.619652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96cd5e-69e4-483c-b228-732946c6dea9 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:16.626337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403e343-b30a-49b4-bca1-3cdfcc937a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:16.627632 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403e343-b30a-49b4-bca1-3cdfcc937a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:16.627972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403e343-b30a-49b4-bca1-3cdfcc937a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:16.628505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403e343-b30a-49b4-bca1-3cdfcc937a12 admin admin] PATH_INFO: `/v3/projects/d4c47f3d452746a0bf7fd974f89f9105` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:16.629837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403e343-b30a-49b4-bca1-3cdfcc937a12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4c47f3d452746a0bf7fd974f89f9105)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:16.632181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403e343-b30a-49b4-bca1-3cdfcc937a12 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:16.759606 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b403e343-b30a-49b4-bca1-3cdfcc937a12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4c47f3d452746a0bf7fd974f89f9105', 'request_id': 'req-b403e343-b30a-49b4-bca1-3cdfcc937a12'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:16.769663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b403e343-b30a-49b4-bca1-3cdfcc937a12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4c47f3d452746a0bf7fd974f89f9105', 'request_id': 'req-b403e343-b30a-49b4-bca1-3cdfcc937a12'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:16.905233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b403e343-b30a-49b4-bca1-3cdfcc937a12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4c47f3d452746a0bf7fd974f89f9105', 'request_id': 'req-b403e343-b30a-49b4-bca1-3cdfcc937a12'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:16.923027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b403e343-b30a-49b4-bca1-3cdfcc937a12 admin admin] The token cache is being invalidate because project d4c47f3d452746a0bf7fd974f89f9105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:55:16.923685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b403e343-b30a-49b4-bca1-3cdfcc937a12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:16.924293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b403e343-b30a-49b4-bca1-3cdfcc937a12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:16.931463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7489545-c26d-4e51-8035-fc17cad0faa8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:16.932355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7489545-c26d-4e51-8035-fc17cad0faa8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:16.932851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7489545-c26d-4e51-8035-fc17cad0faa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:16.944587 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4123/8259] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:55:16 2022] DELETE /identity/v3/projects/d4c47f3d452746a0bf7fd974f89f9105 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:55:16.961350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c7489545-c26d-4e51-8035-fc17cad0faa8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:55:16.962604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c7489545-c26d-4e51-8035-fc17cad0faa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:17.034585 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4137/8260] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:55:17.044954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ed98c-d574-4e36-a7e2-aadbb5d04310 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:17.045250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ed98c-d574-4e36-a7e2-aadbb5d04310 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:17.045630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ed98c-d574-4e36-a7e2-aadbb5d04310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:17.080368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b07ed98c-d574-4e36-a7e2-aadbb5d04310 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:55:17.081775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b07ed98c-d574-4e36-a7e2-aadbb5d04310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:17.097880 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4124/8261] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:55:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:55:17.101397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7489545-c26d-4e51-8035-fc17cad0faa8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:17.117913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7489545-c26d-4e51-8035-fc17cad0faa8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:17.124943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37bbf5-8167-42dc-a6b9-6b366626c770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:17.126001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37bbf5-8167-42dc-a6b9-6b366626c770 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:17.126448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37bbf5-8167-42dc-a6b9-6b366626c770 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:17.126913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37bbf5-8167-42dc-a6b9-6b366626c770 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:17.127814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37bbf5-8167-42dc-a6b9-6b366626c770 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:55:17.128314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37bbf5-8167-42dc-a6b9-6b366626c770 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:17.130116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37bbf5-8167-42dc-a6b9-6b366626c770 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:17.168049 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4138/8262] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:55:17.169373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ed98c-d574-4e36-a7e2-aadbb5d04310 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:17.179813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ed98c-d574-4e36-a7e2-aadbb5d04310 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:17.187160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201caac3-7830-4753-8a4e-cf65dd97c67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:17.187845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201caac3-7830-4753-8a4e-cf65dd97c67b admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:17.188129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201caac3-7830-4753-8a4e-cf65dd97c67b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:17.191497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201caac3-7830-4753-8a4e-cf65dd97c67b admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:17.191497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201caac3-7830-4753-8a4e-cf65dd97c67b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:17.193029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201caac3-7830-4753-8a4e-cf65dd97c67b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:17.352787 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4125/8263] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:55:17 2022] POST /identity/v3/projects => generated 359 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:55:17.353569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37bbf5-8167-42dc-a6b9-6b366626c770 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:17.367821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37bbf5-8167-42dc-a6b9-6b366626c770 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:17.505408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98972713-1b23-46f7-9408-4759ab9b3355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:17.506128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98972713-1b23-46f7-9408-4759ab9b3355 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:17.506419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98972713-1b23-46f7-9408-4759ab9b3355 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:17.506699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98972713-1b23-46f7-9408-4759ab9b3355 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:17.509046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98972713-1b23-46f7-9408-4759ab9b3355 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:17.511979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98972713-1b23-46f7-9408-4759ab9b3355 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:17.605864 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4139/8264] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:55:17 2022] POST /identity/v3/users => generated 280 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:55:17.609808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201caac3-7830-4753-8a4e-cf65dd97c67b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:17.620508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201caac3-7830-4753-8a4e-cf65dd97c67b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:17.627900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22412c67-5ebf-48c7-b5c6-ca272a6fdd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:17.628866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22412c67-5ebf-48c7-b5c6-ca272a6fdd30 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:17.629159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22412c67-5ebf-48c7-b5c6-ca272a6fdd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:17.629439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22412c67-5ebf-48c7-b5c6-ca272a6fdd30 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:17.631077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22412c67-5ebf-48c7-b5c6-ca272a6fdd30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:17.632101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22412c67-5ebf-48c7-b5c6-ca272a6fdd30 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:17.644720 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4126/8265] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:55:17.648453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98972713-1b23-46f7-9408-4759ab9b3355 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:17.662868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98972713-1b23-46f7-9408-4759ab9b3355 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:17.681419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19407192-0085-4e47-8118-b787652cd94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:17.682120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19407192-0085-4e47-8118-b787652cd94b admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:17.682407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19407192-0085-4e47-8118-b787652cd94b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:17.682687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19407192-0085-4e47-8118-b787652cd94b admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:17.685522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19407192-0085-4e47-8118-b787652cd94b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:17.687188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19407192-0085-4e47-8118-b787652cd94b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:17.699406 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4140/8266] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:55:17.703194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22412c67-5ebf-48c7-b5c6-ca272a6fdd30 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:17.720214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22412c67-5ebf-48c7-b5c6-ca272a6fdd30 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:17.729652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565df970-df69-4041-b0a8-23ad21842c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:17.731253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565df970-df69-4041-b0a8-23ad21842c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:17.731671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565df970-df69-4041-b0a8-23ad21842c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:17.732259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565df970-df69-4041-b0a8-23ad21842c03 admin admin] PATH_INFO: `/v3/projects/223e686b9e6b42838812fca054c3f249/users/b27c839514ea4ecabd15a272ac9678a4/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:17.758275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565df970-df69-4041-b0a8-23ad21842c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=223e686b9e6b42838812fca054c3f249, user_id=b27c839514ea4ecabd15a272ac9678a4, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:17.763637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565df970-df69-4041-b0a8-23ad21842c03 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:17.842337 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4127/8267] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:55:17 2022] PUT /identity/v3/projects/223e686b9e6b42838812fca054c3f249/users/b27c839514ea4ecabd15a272ac9678a4/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:55:17.857648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d04122-cfa0-43ab-bf0a-977f9d16ca9f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:17.858231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d04122-cfa0-43ab-bf0a-977f9d16ca9f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:17.858716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d04122-cfa0-43ab-bf0a-977f9d16ca9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:17.894345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f6d04122-cfa0-43ab-bf0a-977f9d16ca9f None None] MFA Rules not processed for user `b27c839514ea4ecabd15a272ac9678a4`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:55:17.895709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f6d04122-cfa0-43ab-bf0a-977f9d16ca9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:18.002230 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4141/8268] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:55:17 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:55:18.008745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565df970-df69-4041-b0a8-23ad21842c03 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:18.011473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-565df970-df69-4041-b0a8-23ad21842c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:18.067730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d04122-cfa0-43ab-bf0a-977f9d16ca9f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:18.073190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f6d04122-cfa0-43ab-bf0a-977f9d16ca9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:18.152553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565df970-df69-4041-b0a8-23ad21842c03 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:18.158641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c312868-72bd-409d-94cc-9ac11f6addfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:18.159895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c312868-72bd-409d-94cc-9ac11f6addfc service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:18.160390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c312868-72bd-409d-94cc-9ac11f6addfc service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:18.161318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c312868-72bd-409d-94cc-9ac11f6addfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:18.173585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c312868-72bd-409d-94cc-9ac11f6addfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:18.175555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c312868-72bd-409d-94cc-9ac11f6addfc service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:18.212968 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4128/8269] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:55:18 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:55:18.248210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d04122-cfa0-43ab-bf0a-977f9d16ca9f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:18.251775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302aab7a-6c85-4908-bdfd-0778cd6e755f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:18.252717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302aab7a-6c85-4908-bdfd-0778cd6e755f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:18.253001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302aab7a-6c85-4908-bdfd-0778cd6e755f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:18.253284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302aab7a-6c85-4908-bdfd-0778cd6e755f admin admin] PATH_INFO: `/v3/users/bad5953b4fbf4fe2a30a2b4208714631` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:18.256173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302aab7a-6c85-4908-bdfd-0778cd6e755f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bad5953b4fbf4fe2a30a2b4208714631)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:18.261140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302aab7a-6c85-4908-bdfd-0778cd6e755f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:18.498244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-302aab7a-6c85-4908-bdfd-0778cd6e755f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bad5953b4fbf4fe2a30a2b4208714631'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:18.512089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-302aab7a-6c85-4908-bdfd-0778cd6e755f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bad5953b4fbf4fe2a30a2b4208714631'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:18.512867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-302aab7a-6c85-4908-bdfd-0778cd6e755f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bad5953b4fbf4fe2a30a2b4208714631'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:18.519852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-302aab7a-6c85-4908-bdfd-0778cd6e755f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bad5953b4fbf4fe2a30a2b4208714631'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:18.592790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-302aab7a-6c85-4908-bdfd-0778cd6e755f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bad5953b4fbf4fe2a30a2b4208714631'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:18.609930 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4142/8270] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:55:18 2022] DELETE /identity/v3/users/bad5953b4fbf4fe2a30a2b4208714631 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:55:19.090253 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c312868-72bd-409d-94cc-9ac11f6addfc service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:19.109583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c312868-72bd-409d-94cc-9ac11f6addfc service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:19.182462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4bb9c-ffcc-49b1-a99f-558f2d937a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:19.183747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4bb9c-ffcc-49b1-a99f-558f2d937a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:19.184224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4bb9c-ffcc-49b1-a99f-558f2d937a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:19.184747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4bb9c-ffcc-49b1-a99f-558f2d937a19 admin admin] PATH_INFO: `/v3/projects/24a92939abc5401d88f4cdc0f1b109f5` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:19.187552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4bb9c-ffcc-49b1-a99f-558f2d937a19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24a92939abc5401d88f4cdc0f1b109f5)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:19.189905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4bb9c-ffcc-49b1-a99f-558f2d937a19 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:19.350411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b5e4bb9c-ffcc-49b1-a99f-558f2d937a19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a92939abc5401d88f4cdc0f1b109f5', 'request_id': 'req-b5e4bb9c-ffcc-49b1-a99f-558f2d937a19'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:19.358059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b5e4bb9c-ffcc-49b1-a99f-558f2d937a19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a92939abc5401d88f4cdc0f1b109f5', 'request_id': 'req-b5e4bb9c-ffcc-49b1-a99f-558f2d937a19'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:19.460122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b5e4bb9c-ffcc-49b1-a99f-558f2d937a19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a92939abc5401d88f4cdc0f1b109f5', 'request_id': 'req-b5e4bb9c-ffcc-49b1-a99f-558f2d937a19'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:19.500377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b5e4bb9c-ffcc-49b1-a99f-558f2d937a19 admin admin] The token cache is being invalidate because project 24a92939abc5401d88f4cdc0f1b109f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:55:19.500753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b5e4bb9c-ffcc-49b1-a99f-558f2d937a19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:19.502864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b5e4bb9c-ffcc-49b1-a99f-558f2d937a19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:19.507541 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4129/8271] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:55:19 2022] DELETE /identity/v3/projects/24a92939abc5401d88f4cdc0f1b109f5 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:55:19.514105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302aab7a-6c85-4908-bdfd-0778cd6e755f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:19.516153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-302aab7a-6c85-4908-bdfd-0778cd6e755f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:19.563097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302aab7a-6c85-4908-bdfd-0778cd6e755f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:19.704871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec9efe-a3e1-4d79-96a6-4a46cb32788a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:19.706298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec9efe-a3e1-4d79-96a6-4a46cb32788a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:19.706759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec9efe-a3e1-4d79-96a6-4a46cb32788a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:19.707383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec9efe-a3e1-4d79-96a6-4a46cb32788a admin admin] PATH_INFO: `/v3/users/fbe9eb56384842fc94e28404714e66ca` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:19.709243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec9efe-a3e1-4d79-96a6-4a46cb32788a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbe9eb56384842fc94e28404714e66ca)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:19.711612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec9efe-a3e1-4d79-96a6-4a46cb32788a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:19.966779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d6ec9efe-a3e1-4d79-96a6-4a46cb32788a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe9eb56384842fc94e28404714e66ca'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:19.999710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d6ec9efe-a3e1-4d79-96a6-4a46cb32788a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe9eb56384842fc94e28404714e66ca'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:20.000623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d6ec9efe-a3e1-4d79-96a6-4a46cb32788a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe9eb56384842fc94e28404714e66ca'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:20.009307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d6ec9efe-a3e1-4d79-96a6-4a46cb32788a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe9eb56384842fc94e28404714e66ca'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:20.100447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d6ec9efe-a3e1-4d79-96a6-4a46cb32788a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe9eb56384842fc94e28404714e66ca'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:20.113294 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4143/8272] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:55:19 2022] DELETE /identity/v3/users/fbe9eb56384842fc94e28404714e66ca => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:55:20.459910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4bb9c-ffcc-49b1-a99f-558f2d937a19 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:20.461495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b5e4bb9c-ffcc-49b1-a99f-558f2d937a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:20.479221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4bb9c-ffcc-49b1-a99f-558f2d937a19 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:20.563839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982768b3-e382-467f-8cf0-bbf62319aced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:20.565056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982768b3-e382-467f-8cf0-bbf62319aced admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:20.565357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982768b3-e382-467f-8cf0-bbf62319aced admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:20.565691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982768b3-e382-467f-8cf0-bbf62319aced admin admin] PATH_INFO: `/v3/projects/93dbad165604400cb3b3bfb2cc90529a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:20.567248 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982768b3-e382-467f-8cf0-bbf62319aced admin admin] RBAC: Authorizing `identity:delete_project(project_id=93dbad165604400cb3b3bfb2cc90529a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:20.569606 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982768b3-e382-467f-8cf0-bbf62319aced admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:20.680030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-982768b3-e382-467f-8cf0-bbf62319aced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93dbad165604400cb3b3bfb2cc90529a', 'request_id': 'req-982768b3-e382-467f-8cf0-bbf62319aced'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:20.689310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-982768b3-e382-467f-8cf0-bbf62319aced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93dbad165604400cb3b3bfb2cc90529a', 'request_id': 'req-982768b3-e382-467f-8cf0-bbf62319aced'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:20.744960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-982768b3-e382-467f-8cf0-bbf62319aced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93dbad165604400cb3b3bfb2cc90529a', 'request_id': 'req-982768b3-e382-467f-8cf0-bbf62319aced'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:20.757448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-982768b3-e382-467f-8cf0-bbf62319aced admin admin] The token cache is being invalidate because project 93dbad165604400cb3b3bfb2cc90529a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:55:20.757799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-982768b3-e382-467f-8cf0-bbf62319aced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:20.758462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-982768b3-e382-467f-8cf0-bbf62319aced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:20.760348 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4130/8273] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:55:20 2022] DELETE /identity/v3/projects/93dbad165604400cb3b3bfb2cc90529a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:55:33.825328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec9efe-a3e1-4d79-96a6-4a46cb32788a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:33.827369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d6ec9efe-a3e1-4d79-96a6-4a46cb32788a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:33.846012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec9efe-a3e1-4d79-96a6-4a46cb32788a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:33.916901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d03458-058b-4e64-bda4-5b4609a9a24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:33.917897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d03458-058b-4e64-bda4-5b4609a9a24a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:33.918189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d03458-058b-4e64-bda4-5b4609a9a24a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:33.918720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d03458-058b-4e64-bda4-5b4609a9a24a admin admin] PATH_INFO: `/v3/users/b27c839514ea4ecabd15a272ac9678a4` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:33.920895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d03458-058b-4e64-bda4-5b4609a9a24a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b27c839514ea4ecabd15a272ac9678a4)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:33.923887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d03458-058b-4e64-bda4-5b4609a9a24a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:34.138290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-04d03458-058b-4e64-bda4-5b4609a9a24a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b27c839514ea4ecabd15a272ac9678a4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:34.154309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-04d03458-058b-4e64-bda4-5b4609a9a24a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b27c839514ea4ecabd15a272ac9678a4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:34.157128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-04d03458-058b-4e64-bda4-5b4609a9a24a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b27c839514ea4ecabd15a272ac9678a4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:34.181680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-04d03458-058b-4e64-bda4-5b4609a9a24a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b27c839514ea4ecabd15a272ac9678a4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:34.270356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-04d03458-058b-4e64-bda4-5b4609a9a24a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b27c839514ea4ecabd15a272ac9678a4'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:34.277354 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4144/8274] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:55:33 2022] DELETE /identity/v3/users/b27c839514ea4ecabd15a272ac9678a4 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:55:34.281907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff1fe9-6437-4719-ade7-9d6e46c1e816 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:34.282371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff1fe9-6437-4719-ade7-9d6e46c1e816 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:34.282500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff1fe9-6437-4719-ade7-9d6e46c1e816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:34.301725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6dff1fe9-6437-4719-ade7-9d6e46c1e816 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:55:34.303123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6dff1fe9-6437-4719-ade7-9d6e46c1e816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:34.360500 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4131/8275] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:55:34.369922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d03458-058b-4e64-bda4-5b4609a9a24a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:34.372011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-04d03458-058b-4e64-bda4-5b4609a9a24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:34.468000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d03458-058b-4e64-bda4-5b4609a9a24a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:34.480898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05530c0e-92c0-49fe-a6b1-42c64670a99e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:34.481688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05530c0e-92c0-49fe-a6b1-42c64670a99e service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:34.481982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05530c0e-92c0-49fe-a6b1-42c64670a99e service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:34.482249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05530c0e-92c0-49fe-a6b1-42c64670a99e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:34.494965 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05530c0e-92c0-49fe-a6b1-42c64670a99e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:34.497783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05530c0e-92c0-49fe-a6b1-42c64670a99e service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:34.508352 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4145/8276] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:55:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:55:34.922521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff1fe9-6437-4719-ade7-9d6e46c1e816 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:34.923591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6dff1fe9-6437-4719-ade7-9d6e46c1e816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:34.936223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff1fe9-6437-4719-ade7-9d6e46c1e816 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:34.942205 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a4e60-561d-48cc-ab97-e793468c8b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:34.943364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a4e60-561d-48cc-ab97-e793468c8b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:34.943938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a4e60-561d-48cc-ab97-e793468c8b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:34.944457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a4e60-561d-48cc-ab97-e793468c8b00 admin admin] PATH_INFO: `/v3/projects/223e686b9e6b42838812fca054c3f249` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:34.945993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a4e60-561d-48cc-ab97-e793468c8b00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=223e686b9e6b42838812fca054c3f249)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:34.948189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a4e60-561d-48cc-ab97-e793468c8b00 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:35.067617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e02a4e60-561d-48cc-ab97-e793468c8b00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '223e686b9e6b42838812fca054c3f249', 'request_id': 'req-e02a4e60-561d-48cc-ab97-e793468c8b00'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:35.074698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e02a4e60-561d-48cc-ab97-e793468c8b00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '223e686b9e6b42838812fca054c3f249', 'request_id': 'req-e02a4e60-561d-48cc-ab97-e793468c8b00'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:35.181161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e02a4e60-561d-48cc-ab97-e793468c8b00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '223e686b9e6b42838812fca054c3f249', 'request_id': 'req-e02a4e60-561d-48cc-ab97-e793468c8b00'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:35.195208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e02a4e60-561d-48cc-ab97-e793468c8b00 admin admin] The token cache is being invalidate because project 223e686b9e6b42838812fca054c3f249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:55:35.195513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e02a4e60-561d-48cc-ab97-e793468c8b00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:35.196367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e02a4e60-561d-48cc-ab97-e793468c8b00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:35.198050 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4132/8277] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:55:34 2022] DELETE /identity/v3/projects/223e686b9e6b42838812fca054c3f249 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:55:35.203218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69120625-7092-45d0-ba16-363099bf106f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:35.203788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69120625-7092-45d0-ba16-363099bf106f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:35.203788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69120625-7092-45d0-ba16-363099bf106f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:35.227932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-69120625-7092-45d0-ba16-363099bf106f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:55:35.232233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-69120625-7092-45d0-ba16-363099bf106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:35.357012 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4146/8278] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:55:35.362837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a4e60-561d-48cc-ab97-e793468c8b00 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:35.363460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77138d46-c0ad-4060-a030-8ecda6c77c28 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:35.363914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77138d46-c0ad-4060-a030-8ecda6c77c28 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:35.364277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77138d46-c0ad-4060-a030-8ecda6c77c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:35.364838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e02a4e60-561d-48cc-ab97-e793468c8b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:35.380087 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a4e60-561d-48cc-ab97-e793468c8b00 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:35.387482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee032383-06ca-4020-806a-b358bb2c85f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:35.388418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee032383-06ca-4020-806a-b358bb2c85f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:35.388806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee032383-06ca-4020-806a-b358bb2c85f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:35.389152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee032383-06ca-4020-806a-b358bb2c85f5 admin admin] PATH_INFO: `/v3/users/1a44bde5803a4e17bd656e302cfca597` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:35.390291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-77138d46-c0ad-4060-a030-8ecda6c77c28 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:55:35.391117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee032383-06ca-4020-806a-b358bb2c85f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a44bde5803a4e17bd656e302cfca597)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:35.391810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-77138d46-c0ad-4060-a030-8ecda6c77c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:35.404126 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4147/8279] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:55:35.408720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee032383-06ca-4020-806a-b358bb2c85f5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:35.414743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77138d46-c0ad-4060-a030-8ecda6c77c28 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:35.428292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77138d46-c0ad-4060-a030-8ecda6c77c28 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:35.435898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051c8f9-4458-42bb-99f5-ba94ae7a89dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:35.435898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051c8f9-4458-42bb-99f5-ba94ae7a89dd admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:35.435898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051c8f9-4458-42bb-99f5-ba94ae7a89dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:35.435898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051c8f9-4458-42bb-99f5-ba94ae7a89dd admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:35.436798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051c8f9-4458-42bb-99f5-ba94ae7a89dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:55:35.437240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051c8f9-4458-42bb-99f5-ba94ae7a89dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:35.439309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051c8f9-4458-42bb-99f5-ba94ae7a89dd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:35.473927 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4148/8280] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:55:35.475553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051c8f9-4458-42bb-99f5-ba94ae7a89dd admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:35.488188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051c8f9-4458-42bb-99f5-ba94ae7a89dd admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:35.497595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be69b02-cb55-4866-9262-2276f6725517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:35.498367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be69b02-cb55-4866-9262-2276f6725517 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:35.498631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be69b02-cb55-4866-9262-2276f6725517 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:35.504902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be69b02-cb55-4866-9262-2276f6725517 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:35.504902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be69b02-cb55-4866-9262-2276f6725517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:35.504902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be69b02-cb55-4866-9262-2276f6725517 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:35.596957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ee032383-06ca-4020-806a-b358bb2c85f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a44bde5803a4e17bd656e302cfca597'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:35.619962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ee032383-06ca-4020-806a-b358bb2c85f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a44bde5803a4e17bd656e302cfca597'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:35.621954 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ee032383-06ca-4020-806a-b358bb2c85f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a44bde5803a4e17bd656e302cfca597'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:35.631662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ee032383-06ca-4020-806a-b358bb2c85f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a44bde5803a4e17bd656e302cfca597'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:35.659620 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4149/8281] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:55:35 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:55:35.669347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be69b02-cb55-4866-9262-2276f6725517 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:35.716792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ee032383-06ca-4020-806a-b358bb2c85f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a44bde5803a4e17bd656e302cfca597'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:35.727910 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4133/8282] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:55:35 2022] DELETE /identity/v3/users/1a44bde5803a4e17bd656e302cfca597 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:55:35.732940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833af035-8600-4e59-8f8e-9b89655000bb None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:35.734329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833af035-8600-4e59-8f8e-9b89655000bb None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:35.734726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833af035-8600-4e59-8f8e-9b89655000bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:35.762204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be69b02-cb55-4866-9262-2276f6725517 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:35.777564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-833af035-8600-4e59-8f8e-9b89655000bb None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:55:35.779162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-833af035-8600-4e59-8f8e-9b89655000bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:35.847574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31abe64-da2d-4585-b237-dc5c972f951a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:35.848267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31abe64-da2d-4585-b237-dc5c972f951a admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:35.848554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31abe64-da2d-4585-b237-dc5c972f951a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:35.848856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31abe64-da2d-4585-b237-dc5c972f951a admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:35.850652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31abe64-da2d-4585-b237-dc5c972f951a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:35.859542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31abe64-da2d-4585-b237-dc5c972f951a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:35.880941 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4134/8283] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:55:35.890613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833af035-8600-4e59-8f8e-9b89655000bb None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:35.892881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-833af035-8600-4e59-8f8e-9b89655000bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:35.956211 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4150/8284] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:55:35 2022] POST /identity/v3/users => generated 289 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:55:35.959159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31abe64-da2d-4585-b237-dc5c972f951a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:35.961123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a31abe64-da2d-4585-b237-dc5c972f951a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:35.961849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833af035-8600-4e59-8f8e-9b89655000bb None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:35.966635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b5ae3-a906-47b7-bff3-74ce97137adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:35.967444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b5ae3-a906-47b7-bff3-74ce97137adb service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:35.967803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b5ae3-a906-47b7-bff3-74ce97137adb service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:35.968162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b5ae3-a906-47b7-bff3-74ce97137adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:35.979053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b5ae3-a906-47b7-bff3-74ce97137adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:35.981086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b5ae3-a906-47b7-bff3-74ce97137adb service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:35.989600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31abe64-da2d-4585-b237-dc5c972f951a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:35.993779 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4135/8285] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:55:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:55:36.013034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dcd44-dfac-4e11-bdd0-815fa1d08584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:36.013747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dcd44-dfac-4e11-bdd0-815fa1d08584 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:36.014034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dcd44-dfac-4e11-bdd0-815fa1d08584 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:36.015190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dcd44-dfac-4e11-bdd0-815fa1d08584 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:36.015949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2dcd44-dfac-4e11-bdd0-815fa1d08584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:36.017642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2dcd44-dfac-4e11-bdd0-815fa1d08584 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:36.058948 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4151/8286] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:55:36.063266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b5ae3-a906-47b7-bff3-74ce97137adb service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:36.079268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b5ae3-a906-47b7-bff3-74ce97137adb service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:36.098952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0ff0a-1a7e-47ce-9659-211e03e22357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:36.099656 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0ff0a-1a7e-47ce-9659-211e03e22357 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:36.099938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0ff0a-1a7e-47ce-9659-211e03e22357 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:36.100229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0ff0a-1a7e-47ce-9659-211e03e22357 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:36.103386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0ff0a-1a7e-47ce-9659-211e03e22357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:36.106842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0ff0a-1a7e-47ce-9659-211e03e22357 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:36.135820 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4136/8287] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:55:36.140539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dcd44-dfac-4e11-bdd0-815fa1d08584 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:36.155088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dcd44-dfac-4e11-bdd0-815fa1d08584 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:36.161036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249c97f-e3d4-4cf8-8935-0413392627bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:36.161962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249c97f-e3d4-4cf8-8935-0413392627bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:36.162248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249c97f-e3d4-4cf8-8935-0413392627bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:36.162531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249c97f-e3d4-4cf8-8935-0413392627bc admin admin] PATH_INFO: `/v3/projects/3eb679ab3c4249398fb3abd91c44c8bd/users/e4e782af7347483bb0548443e32678f1/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:36.191447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249c97f-e3d4-4cf8-8935-0413392627bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eb679ab3c4249398fb3abd91c44c8bd, user_id=e4e782af7347483bb0548443e32678f1, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:36.199041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249c97f-e3d4-4cf8-8935-0413392627bc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:36.313284 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4152/8288] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:55:36 2022] PUT /identity/v3/projects/3eb679ab3c4249398fb3abd91c44c8bd/users/e4e782af7347483bb0548443e32678f1/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:55:36.315402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fac5a-77c9-4f1f-a42c-a19c61744894 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:36.315701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fac5a-77c9-4f1f-a42c-a19c61744894 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:36.316937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fac5a-77c9-4f1f-a42c-a19c61744894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:36.345689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-343fac5a-77c9-4f1f-a42c-a19c61744894 None None] MFA Rules not processed for user `e4e782af7347483bb0548443e32678f1`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:55:36.346921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-343fac5a-77c9-4f1f-a42c-a19c61744894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:36.422363 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4137/8289] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:55:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:55:36.427160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249c97f-e3d4-4cf8-8935-0413392627bc admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:36.441998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fac5a-77c9-4f1f-a42c-a19c61744894 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:36.447028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-343fac5a-77c9-4f1f-a42c-a19c61744894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:36.568351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249c97f-e3d4-4cf8-8935-0413392627bc admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:36.574680 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cc6e2-057b-4f9f-944c-f090f81ec313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:36.575362 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cc6e2-057b-4f9f-944c-f090f81ec313 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:36.575646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cc6e2-057b-4f9f-944c-f090f81ec313 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:36.575926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cc6e2-057b-4f9f-944c-f090f81ec313 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:36.576953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cc6e2-057b-4f9f-944c-f090f81ec313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:36.577709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fac5a-77c9-4f1f-a42c-a19c61744894 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:36.579185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cc6e2-057b-4f9f-944c-f090f81ec313 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:36.583748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d1dcc-3c95-4f8c-9f9b-c78f65900b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:36.584951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d1dcc-3c95-4f8c-9f9b-c78f65900b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:36.585421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d1dcc-3c95-4f8c-9f9b-c78f65900b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:36.585903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d1dcc-3c95-4f8c-9f9b-c78f65900b60 admin admin] PATH_INFO: `/v3/projects/0d388d514f434af89e98ad4b0626fbda` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:36.587664 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d1dcc-3c95-4f8c-9f9b-c78f65900b60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d388d514f434af89e98ad4b0626fbda)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:36.594410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d1dcc-3c95-4f8c-9f9b-c78f65900b60 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:36.670199 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4153/8290] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:55:36 2022] POST /identity/v3/projects => generated 377 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:55:36.672066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cc6e2-057b-4f9f-944c-f090f81ec313 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:36.725674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-483d1dcc-3c95-4f8c-9f9b-c78f65900b60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d388d514f434af89e98ad4b0626fbda', 'request_id': 'req-483d1dcc-3c95-4f8c-9f9b-c78f65900b60'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:36.733793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-483d1dcc-3c95-4f8c-9f9b-c78f65900b60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d388d514f434af89e98ad4b0626fbda', 'request_id': 'req-483d1dcc-3c95-4f8c-9f9b-c78f65900b60'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:36.785298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cc6e2-057b-4f9f-944c-f090f81ec313 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:36.824875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-483d1dcc-3c95-4f8c-9f9b-c78f65900b60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d388d514f434af89e98ad4b0626fbda', 'request_id': 'req-483d1dcc-3c95-4f8c-9f9b-c78f65900b60'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:36.838157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-483d1dcc-3c95-4f8c-9f9b-c78f65900b60 admin admin] The token cache is being invalidate because project 0d388d514f434af89e98ad4b0626fbda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:55:36.838553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-483d1dcc-3c95-4f8c-9f9b-c78f65900b60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:36.840711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-483d1dcc-3c95-4f8c-9f9b-c78f65900b60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:36.845494 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4138/8291] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:55:36 2022] DELETE /identity/v3/projects/0d388d514f434af89e98ad4b0626fbda => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:55:36.848593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333c438-27b6-4526-a004-60316ba9f163 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:36.849630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333c438-27b6-4526-a004-60316ba9f163 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:36.851076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333c438-27b6-4526-a004-60316ba9f163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:36.875661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59604de9-5596-4653-b563-4d76c26a8769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:36.876719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59604de9-5596-4653-b563-4d76c26a8769 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:36.877009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59604de9-5596-4653-b563-4d76c26a8769 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:36.877346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59604de9-5596-4653-b563-4d76c26a8769 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:36.878049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59604de9-5596-4653-b563-4d76c26a8769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:36.880183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59604de9-5596-4653-b563-4d76c26a8769 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:36.880854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e333c438-27b6-4526-a004-60316ba9f163 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:55:36.882356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e333c438-27b6-4526-a004-60316ba9f163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:36.892591 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4139/8292] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:55:36.901840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58810d9c-6b22-458c-bc7c-14e5e046d22f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:36.902208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58810d9c-6b22-458c-bc7c-14e5e046d22f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:36.902562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58810d9c-6b22-458c-bc7c-14e5e046d22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:36.925192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-58810d9c-6b22-458c-bc7c-14e5e046d22f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:55:36.926637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-58810d9c-6b22-458c-bc7c-14e5e046d22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:36.936064 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4140/8293] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:55:36.940102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58810d9c-6b22-458c-bc7c-14e5e046d22f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:36.950552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58810d9c-6b22-458c-bc7c-14e5e046d22f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:36.957767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5b79d-bbb7-4f2d-9508-cc9b7a46c953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:36.958545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5b79d-bbb7-4f2d-9508-cc9b7a46c953 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:36.958978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5b79d-bbb7-4f2d-9508-cc9b7a46c953 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:36.959365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5b79d-bbb7-4f2d-9508-cc9b7a46c953 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:36.961145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5b79d-bbb7-4f2d-9508-cc9b7a46c953 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:55:36.961145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5b79d-bbb7-4f2d-9508-cc9b7a46c953 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:36.968647 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4154/8294] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:55:36 2022] POST /identity/v3/users => generated 295 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:55:36.968756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5b79d-bbb7-4f2d-9508-cc9b7a46c953 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:36.969649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59604de9-5596-4653-b563-4d76c26a8769 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:36.971441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-59604de9-5596-4653-b563-4d76c26a8769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:36.977851 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4141/8295] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:55:36.982419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5b79d-bbb7-4f2d-9508-cc9b7a46c953 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:36.987762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59604de9-5596-4653-b563-4d76c26a8769 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:36.992880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746faf1-e70a-4e13-bed5-9b29fd99d933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:36.993568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746faf1-e70a-4e13-bed5-9b29fd99d933 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:36.993726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5b79d-bbb7-4f2d-9508-cc9b7a46c953 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:36.993857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746faf1-e70a-4e13-bed5-9b29fd99d933 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:36.994145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746faf1-e70a-4e13-bed5-9b29fd99d933 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:36.994885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746faf1-e70a-4e13-bed5-9b29fd99d933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:36.997473 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746faf1-e70a-4e13-bed5-9b29fd99d933 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:36.999190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ab53b-d5df-4ea1-aae0-f11df15018b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:37.000039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ab53b-d5df-4ea1-aae0-f11df15018b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:37.000386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ab53b-d5df-4ea1-aae0-f11df15018b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:37.000775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ab53b-d5df-4ea1-aae0-f11df15018b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:37.001533 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ab53b-d5df-4ea1-aae0-f11df15018b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:37.003567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ab53b-d5df-4ea1-aae0-f11df15018b0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:37.012303 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4155/8296] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:55:37.013234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746faf1-e70a-4e13-bed5-9b29fd99d933 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:37.024524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746faf1-e70a-4e13-bed5-9b29fd99d933 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:37.029403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8d352-608a-4332-a407-8afbbdc8861e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:37.030322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8d352-608a-4332-a407-8afbbdc8861e admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:37.030608 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8d352-608a-4332-a407-8afbbdc8861e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:37.030891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8d352-608a-4332-a407-8afbbdc8861e admin admin] PATH_INFO: `/v3/projects/9c0840a54a9b4a1b8f86b83febbbe230/users/d8eec30ee92746ca950f41ff1e7c57a8/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:37.045480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8d352-608a-4332-a407-8afbbdc8861e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c0840a54a9b4a1b8f86b83febbbe230, user_id=d8eec30ee92746ca950f41ff1e7c57a8, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:37.048191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8d352-608a-4332-a407-8afbbdc8861e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:37.134862 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4142/8297] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:55:36 2022] POST /identity/v3/projects => generated 369 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:55:37.139902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ab53b-d5df-4ea1-aae0-f11df15018b0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:37.191901 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4156/8298] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:55:37 2022] PUT /identity/v3/projects/9c0840a54a9b4a1b8f86b83febbbe230/users/d8eec30ee92746ca950f41ff1e7c57a8/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:55:37.196490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8d352-608a-4332-a407-8afbbdc8861e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:37.205041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ab53b-d5df-4ea1-aae0-f11df15018b0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:37.282035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8d352-608a-4332-a407-8afbbdc8861e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:37.286758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bff25-25a2-4baf-be1e-062f41f165ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:37.287689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bff25-25a2-4baf-be1e-062f41f165ae admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:37.288056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bff25-25a2-4baf-be1e-062f41f165ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:37.288191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517407ea-3d71-4b09-9c12-848ab3d4a766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:37.288526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bff25-25a2-4baf-be1e-062f41f165ae admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:37.288883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517407ea-3d71-4b09-9c12-848ab3d4a766 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:37.289407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bff25-25a2-4baf-be1e-062f41f165ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:37.290240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517407ea-3d71-4b09-9c12-848ab3d4a766 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:37.290541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517407ea-3d71-4b09-9c12-848ab3d4a766 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:37.291296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517407ea-3d71-4b09-9c12-848ab3d4a766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:37.291724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bff25-25a2-4baf-be1e-062f41f165ae admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:37.293897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517407ea-3d71-4b09-9c12-848ab3d4a766 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:37.312830 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4157/8299] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:55:37.317098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517407ea-3d71-4b09-9c12-848ab3d4a766 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:37.328709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517407ea-3d71-4b09-9c12-848ab3d4a766 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:37.334225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562899a-32cd-4054-8e05-5801db381bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:37.335173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562899a-32cd-4054-8e05-5801db381bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:37.335459 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562899a-32cd-4054-8e05-5801db381bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:37.335741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562899a-32cd-4054-8e05-5801db381bf8 admin admin] PATH_INFO: `/v3/projects/9c0840a54a9b4a1b8f86b83febbbe230/users/d8eec30ee92746ca950f41ff1e7c57a8/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:37.337977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562899a-32cd-4054-8e05-5801db381bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c0840a54a9b4a1b8f86b83febbbe230, user_id=d8eec30ee92746ca950f41ff1e7c57a8, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:37.340749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562899a-32cd-4054-8e05-5801db381bf8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:37.351963 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4158/8300] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:55:37 2022] PUT /identity/v3/projects/9c0840a54a9b4a1b8f86b83febbbe230/users/d8eec30ee92746ca950f41ff1e7c57a8/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:55:37.365594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daeacf8-88b3-4130-9595-1ea8236d8091 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:37.365594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daeacf8-88b3-4130-9595-1ea8236d8091 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:37.365594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daeacf8-88b3-4130-9595-1ea8236d8091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:37.397674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2daeacf8-88b3-4130-9595-1ea8236d8091 None None] MFA Rules not processed for user `d8eec30ee92746ca950f41ff1e7c57a8`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:55:37.398924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2daeacf8-88b3-4130-9595-1ea8236d8091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:37.423157 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4143/8301] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:55:37 2022] POST /identity/v3/users => generated 285 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:55:37.424321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bff25-25a2-4baf-be1e-062f41f165ae admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:37.447495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bff25-25a2-4baf-be1e-062f41f165ae admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:37.517134 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4159/8302] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:55:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:55:37.529981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daeacf8-88b3-4130-9595-1ea8236d8091 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:37.545285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2daeacf8-88b3-4130-9595-1ea8236d8091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:37.555451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f26e5-0678-4a6c-b084-22e62fba755c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:37.556146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f26e5-0678-4a6c-b084-22e62fba755c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:37.556435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f26e5-0678-4a6c-b084-22e62fba755c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:37.556769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f26e5-0678-4a6c-b084-22e62fba755c admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:37.558083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f26e5-0678-4a6c-b084-22e62fba755c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:37.560123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f26e5-0678-4a6c-b084-22e62fba755c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:37.576644 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4144/8303] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:55:37.579824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f26e5-0678-4a6c-b084-22e62fba755c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:37.616125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f26e5-0678-4a6c-b084-22e62fba755c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:37.622654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6022f9b-1686-4838-b3a0-dc6badde439f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:37.623322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6022f9b-1686-4838-b3a0-dc6badde439f admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:37.623612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6022f9b-1686-4838-b3a0-dc6badde439f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:37.623894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6022f9b-1686-4838-b3a0-dc6badde439f admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:37.624724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6022f9b-1686-4838-b3a0-dc6badde439f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:37.627559 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6022f9b-1686-4838-b3a0-dc6badde439f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:37.643990 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4145/8304] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:55:37.645577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6022f9b-1686-4838-b3a0-dc6badde439f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:37.651984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daeacf8-88b3-4130-9595-1ea8236d8091 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:37.655929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bd975-3511-4e0e-95cb-bf8173f5f8bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:37.656937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bd975-3511-4e0e-95cb-bf8173f5f8bf service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:37.657330 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bd975-3511-4e0e-95cb-bf8173f5f8bf service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:37.657838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bd975-3511-4e0e-95cb-bf8173f5f8bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:37.660026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6022f9b-1686-4838-b3a0-dc6badde439f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:37.660824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1f4bd975-3511-4e0e-95cb-bf8173f5f8bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:37.687006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177327b2-41a4-437a-9364-e583fca3c4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:37.688413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177327b2-41a4-437a-9364-e583fca3c4e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:37.688832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177327b2-41a4-437a-9364-e583fca3c4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:37.689125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177327b2-41a4-437a-9364-e583fca3c4e0 admin admin] PATH_INFO: `/v3/projects/81640debc8dc40d4ac69082093bb3d06/users/9c416151a63c42148d02e6d90d0a06e7/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:37.717827 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177327b2-41a4-437a-9364-e583fca3c4e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81640debc8dc40d4ac69082093bb3d06, user_id=9c416151a63c42148d02e6d90d0a06e7, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:37.721612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177327b2-41a4-437a-9364-e583fca3c4e0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:37.750756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4bd975-3511-4e0e-95cb-bf8173f5f8bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:37.752420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4bd975-3511-4e0e-95cb-bf8173f5f8bf service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:37.763645 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4160/8305] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:55:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:55:37.820777 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4146/8306] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:55:37 2022] PUT /identity/v3/projects/81640debc8dc40d4ac69082093bb3d06/users/9c416151a63c42148d02e6d90d0a06e7/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:55:37.825904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b74f81-66c8-4cce-96db-958ecb1702a5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:37.826324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b74f81-66c8-4cce-96db-958ecb1702a5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:37.826716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b74f81-66c8-4cce-96db-958ecb1702a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:37.859868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-70b74f81-66c8-4cce-96db-958ecb1702a5 None None] MFA Rules not processed for user `9c416151a63c42148d02e6d90d0a06e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:55:37.861269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-70b74f81-66c8-4cce-96db-958ecb1702a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:37.940759 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4161/8307] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:55:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:55:37.951107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177327b2-41a4-437a-9364-e583fca3c4e0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:37.952896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-177327b2-41a4-437a-9364-e583fca3c4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:38.016332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177327b2-41a4-437a-9364-e583fca3c4e0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:38.020119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e860c04-6c71-4b94-a7ac-458daf75653e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:38.020826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e860c04-6c71-4b94-a7ac-458daf75653e service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:38.021119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e860c04-6c71-4b94-a7ac-458daf75653e service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:38.021429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e860c04-6c71-4b94-a7ac-458daf75653e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:38.031290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e860c04-6c71-4b94-a7ac-458daf75653e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:38.033136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e860c04-6c71-4b94-a7ac-458daf75653e service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:38.044908 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4147/8308] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:55:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:55:38.637266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97aa87-1cfc-468d-a7c7-91af44e89226 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:38.638205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97aa87-1cfc-468d-a7c7-91af44e89226 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:38.638489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97aa87-1cfc-468d-a7c7-91af44e89226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:38.693247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3e97aa87-1cfc-468d-a7c7-91af44e89226 None None] MFA Rules not processed for user `adfc2828d2bb4affbc749cc9589e588e`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:55:38.694992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3e97aa87-1cfc-468d-a7c7-91af44e89226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:38.787281 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4162/8309] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:55:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:55:43.298472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e860c04-6c71-4b94-a7ac-458daf75653e service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:43.310910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e860c04-6c71-4b94-a7ac-458daf75653e service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:43.317213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd95e96-9d56-4821-8886-e6724eaff5af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:43.319182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd95e96-9d56-4821-8886-e6724eaff5af service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:43.319288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd95e96-9d56-4821-8886-e6724eaff5af service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:43.319550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd95e96-9d56-4821-8886-e6724eaff5af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:43.322550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5dd95e96-9d56-4821-8886-e6724eaff5af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:43.346147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd95e96-9d56-4821-8886-e6724eaff5af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:43.347603 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd95e96-9d56-4821-8886-e6724eaff5af service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:43.359293 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4148/8310] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:55:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:55:44.401640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97aa87-1cfc-468d-a7c7-91af44e89226 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:44.403635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3e97aa87-1cfc-468d-a7c7-91af44e89226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:44.475528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97aa87-1cfc-468d-a7c7-91af44e89226 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:44.481367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae468fe-e234-4feb-a2f0-987b86ae27c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:44.482043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae468fe-e234-4feb-a2f0-987b86ae27c5 service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:44.482332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae468fe-e234-4feb-a2f0-987b86ae27c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:44.482613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae468fe-e234-4feb-a2f0-987b86ae27c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:44.551251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae468fe-e234-4feb-a2f0-987b86ae27c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:44.552760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae468fe-e234-4feb-a2f0-987b86ae27c5 service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:44.562916 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4163/8311] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:55:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:55:51.871546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd95e96-9d56-4821-8886-e6724eaff5af service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:51.940418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd95e96-9d56-4821-8886-e6724eaff5af service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:51.946354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969543b-6a03-4bac-ac9b-fa19182130e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:51.948703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969543b-6a03-4bac-ac9b-fa19182130e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:51.948703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969543b-6a03-4bac-ac9b-fa19182130e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:51.948703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969543b-6a03-4bac-ac9b-fa19182130e8 admin admin] PATH_INFO: `/v3/users/9c416151a63c42148d02e6d90d0a06e7` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:51.949768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4969543b-6a03-4bac-ac9b-fa19182130e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c416151a63c42148d02e6d90d0a06e7)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:51.951833 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4969543b-6a03-4bac-ac9b-fa19182130e8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:52.233407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4969543b-6a03-4bac-ac9b-fa19182130e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c416151a63c42148d02e6d90d0a06e7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:52.245550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4969543b-6a03-4bac-ac9b-fa19182130e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c416151a63c42148d02e6d90d0a06e7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:52.246226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4969543b-6a03-4bac-ac9b-fa19182130e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c416151a63c42148d02e6d90d0a06e7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:52.252855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4969543b-6a03-4bac-ac9b-fa19182130e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c416151a63c42148d02e6d90d0a06e7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:52.338967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4969543b-6a03-4bac-ac9b-fa19182130e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c416151a63c42148d02e6d90d0a06e7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:52.345307 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4149/8312] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:55:51 2022] DELETE /identity/v3/users/9c416151a63c42148d02e6d90d0a06e7 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:55:52.355134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f16be-8dfa-473b-b789-53a115ac639a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:52.355616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f16be-8dfa-473b-b789-53a115ac639a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:52.355722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f16be-8dfa-473b-b789-53a115ac639a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:52.374267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-db7f16be-8dfa-473b-b789-53a115ac639a None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:55:52.379901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-db7f16be-8dfa-473b-b789-53a115ac639a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:52.433420 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4164/8313] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:55:52.443307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969543b-6a03-4bac-ac9b-fa19182130e8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:52.444853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4969543b-6a03-4bac-ac9b-fa19182130e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:52.520119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969543b-6a03-4bac-ac9b-fa19182130e8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:52.524056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2274f-6908-41f6-a905-6837ae46a82e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:52.524844 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2274f-6908-41f6-a905-6837ae46a82e service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:52.525199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2274f-6908-41f6-a905-6837ae46a82e service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:52.525550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2274f-6908-41f6-a905-6837ae46a82e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:52.535926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2274f-6908-41f6-a905-6837ae46a82e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:52.537536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2274f-6908-41f6-a905-6837ae46a82e service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:52.548084 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4150/8314] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:55:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:55:52.785840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f16be-8dfa-473b-b789-53a115ac639a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:52.787257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-db7f16be-8dfa-473b-b789-53a115ac639a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:52.800513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f16be-8dfa-473b-b789-53a115ac639a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:52.805163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae2e77-e516-40a2-b789-37642020b92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:52.806036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae2e77-e516-40a2-b789-37642020b92d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:52.806322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae2e77-e516-40a2-b789-37642020b92d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:52.806605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae2e77-e516-40a2-b789-37642020b92d admin admin] PATH_INFO: `/v3/projects/81640debc8dc40d4ac69082093bb3d06` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:52.807884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae2e77-e516-40a2-b789-37642020b92d admin admin] RBAC: Authorizing `identity:delete_project(project_id=81640debc8dc40d4ac69082093bb3d06)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:52.809847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae2e77-e516-40a2-b789-37642020b92d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:52.909843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-61ae2e77-e516-40a2-b789-37642020b92d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81640debc8dc40d4ac69082093bb3d06', 'request_id': 'req-61ae2e77-e516-40a2-b789-37642020b92d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:52.978323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-61ae2e77-e516-40a2-b789-37642020b92d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81640debc8dc40d4ac69082093bb3d06', 'request_id': 'req-61ae2e77-e516-40a2-b789-37642020b92d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:52.985390 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-61ae2e77-e516-40a2-b789-37642020b92d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81640debc8dc40d4ac69082093bb3d06', 'request_id': 'req-61ae2e77-e516-40a2-b789-37642020b92d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:52.995915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-61ae2e77-e516-40a2-b789-37642020b92d admin admin] The token cache is being invalidate because project 81640debc8dc40d4ac69082093bb3d06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:55:52.996203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-61ae2e77-e516-40a2-b789-37642020b92d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:52.996867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-61ae2e77-e516-40a2-b789-37642020b92d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:55:52.998391 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4165/8315] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:55:52 2022] DELETE /identity/v3/projects/81640debc8dc40d4ac69082093bb3d06 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:55:53.008546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231f08b-5c97-4c00-a458-5fc518521988 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:53.009049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231f08b-5c97-4c00-a458-5fc518521988 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:53.009150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231f08b-5c97-4c00-a458-5fc518521988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:53.026699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6231f08b-5c97-4c00-a458-5fc518521988 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:55:53.028469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6231f08b-5c97-4c00-a458-5fc518521988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:53.085146 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4151/8316] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:55:53.093624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af2c79-647d-49fa-9951-91a02e112a28 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:53.093920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af2c79-647d-49fa-9951-91a02e112a28 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:53.094204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af2c79-647d-49fa-9951-91a02e112a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:53.114900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-01af2c79-647d-49fa-9951-91a02e112a28 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:55:53.116494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-01af2c79-647d-49fa-9951-91a02e112a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:53.124728 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4166/8317] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:55:53.128992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231f08b-5c97-4c00-a458-5fc518521988 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:53.138740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231f08b-5c97-4c00-a458-5fc518521988 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:53.143557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa203c13-f6e7-44b0-8547-ee082d66e7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:53.144212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa203c13-f6e7-44b0-8547-ee082d66e7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:53.144493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa203c13-f6e7-44b0-8547-ee082d66e7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:53.144804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa203c13-f6e7-44b0-8547-ee082d66e7a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:53.145525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa203c13-f6e7-44b0-8547-ee082d66e7a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:55:53.145832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa203c13-f6e7-44b0-8547-ee082d66e7a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:53.147428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa203c13-f6e7-44b0-8547-ee082d66e7a0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:53.159983 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4152/8318] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:55:53.164412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af2c79-647d-49fa-9951-91a02e112a28 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:53.174299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af2c79-647d-49fa-9951-91a02e112a28 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:53.178926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b1fb1-f0e7-4b69-8d8f-990a93160f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:53.179571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b1fb1-f0e7-4b69-8d8f-990a93160f7f admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:53.179857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b1fb1-f0e7-4b69-8d8f-990a93160f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:53.180139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b1fb1-f0e7-4b69-8d8f-990a93160f7f admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:53.180868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b1fb1-f0e7-4b69-8d8f-990a93160f7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:53.182755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b1fb1-f0e7-4b69-8d8f-990a93160f7f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:53.292012 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4167/8319] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:55:53 2022] POST /identity/v3/projects => generated 357 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:55:53.293194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa203c13-f6e7-44b0-8547-ee082d66e7a0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:53.304053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa203c13-f6e7-44b0-8547-ee082d66e7a0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:53.364933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46553f-4225-43e9-9dfc-213b253322c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:53.365685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46553f-4225-43e9-9dfc-213b253322c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:53.366044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46553f-4225-43e9-9dfc-213b253322c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:53.366399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46553f-4225-43e9-9dfc-213b253322c3 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:53.367172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46553f-4225-43e9-9dfc-213b253322c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:53.369538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46553f-4225-43e9-9dfc-213b253322c3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:53.447698 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4153/8320] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:55:53 2022] POST /identity/v3/users => generated 279 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:55:53.452670 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b1fb1-f0e7-4b69-8d8f-990a93160f7f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:53.463252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b1fb1-f0e7-4b69-8d8f-990a93160f7f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:53.469349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8342e45-e106-400d-a60d-65e5d73cdbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:53.470026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8342e45-e106-400d-a60d-65e5d73cdbee admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:53.470310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8342e45-e106-400d-a60d-65e5d73cdbee admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:53.470588 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8342e45-e106-400d-a60d-65e5d73cdbee admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:53.471315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8342e45-e106-400d-a60d-65e5d73cdbee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:53.473097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8342e45-e106-400d-a60d-65e5d73cdbee admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:53.484635 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4168/8321] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:55:53.489163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46553f-4225-43e9-9dfc-213b253322c3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:53.502444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46553f-4225-43e9-9dfc-213b253322c3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:53.507906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e96c5b-380e-4881-b16f-b1d7c37c2623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:53.508845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e96c5b-380e-4881-b16f-b1d7c37c2623 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:53.510045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e96c5b-380e-4881-b16f-b1d7c37c2623 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:53.510424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e96c5b-380e-4881-b16f-b1d7c37c2623 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:53.511185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e96c5b-380e-4881-b16f-b1d7c37c2623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:53.512910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e96c5b-380e-4881-b16f-b1d7c37c2623 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:53.528654 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4154/8322] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:55:53.531184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8342e45-e106-400d-a60d-65e5d73cdbee admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:53.543140 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8342e45-e106-400d-a60d-65e5d73cdbee admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:53.547952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6a06f-3498-44b1-a50e-125fa5c3453a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:53.548977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6a06f-3498-44b1-a50e-125fa5c3453a admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:53.549261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6a06f-3498-44b1-a50e-125fa5c3453a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:53.549541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6a06f-3498-44b1-a50e-125fa5c3453a admin admin] PATH_INFO: `/v3/projects/26581b0ed8c3415aa3ed71e780eee587/users/8cf044ab77294958b788b5906c3bb0b8/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:53.566359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6a06f-3498-44b1-a50e-125fa5c3453a admin admin] RBAC: Authorizing `identity:create_grant(project_id=26581b0ed8c3415aa3ed71e780eee587, user_id=8cf044ab77294958b788b5906c3bb0b8, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:53.569284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6a06f-3498-44b1-a50e-125fa5c3453a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:53.665070 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4169/8323] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:55:53 2022] PUT /identity/v3/projects/26581b0ed8c3415aa3ed71e780eee587/users/8cf044ab77294958b788b5906c3bb0b8/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:55:53.676212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dba53-10e2-4e60-ab11-e75d7b50df97 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:53.676812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dba53-10e2-4e60-ab11-e75d7b50df97 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:53.677209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dba53-10e2-4e60-ab11-e75d7b50df97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:53.705387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b35dba53-10e2-4e60-ab11-e75d7b50df97 None None] MFA Rules not processed for user `8cf044ab77294958b788b5906c3bb0b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:55:53.706654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b35dba53-10e2-4e60-ab11-e75d7b50df97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:53.779616 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4155/8324] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:55:53 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:55:53.786594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6a06f-3498-44b1-a50e-125fa5c3453a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:55:53.788766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e7c6a06f-3498-44b1-a50e-125fa5c3453a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:55:53.850351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6a06f-3498-44b1-a50e-125fa5c3453a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:55:53.857620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ae924-995d-4a6e-8146-89999f47e458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:55:53.857620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ae924-995d-4a6e-8146-89999f47e458 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:55:53.857620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ae924-995d-4a6e-8146-89999f47e458 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:55:53.857620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ae924-995d-4a6e-8146-89999f47e458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:55:53.866709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ae924-995d-4a6e-8146-89999f47e458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:55:53.868162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ae924-995d-4a6e-8146-89999f47e458 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:55:53.878007 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4170/8325] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:55:53 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:56:05.985804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35dba53-10e2-4e60-ab11-e75d7b50df97 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:06.055626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35dba53-10e2-4e60-ab11-e75d7b50df97 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:06.061396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30280ae8-012e-4ac6-818b-f068df71ee2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:06.062369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30280ae8-012e-4ac6-818b-f068df71ee2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:06.062659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30280ae8-012e-4ac6-818b-f068df71ee2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:06.062961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30280ae8-012e-4ac6-818b-f068df71ee2c admin admin] PATH_INFO: `/v3/users/8cf044ab77294958b788b5906c3bb0b8` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:06.064231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30280ae8-012e-4ac6-818b-f068df71ee2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cf044ab77294958b788b5906c3bb0b8)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:06.066321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30280ae8-012e-4ac6-818b-f068df71ee2c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:06.268591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30280ae8-012e-4ac6-818b-f068df71ee2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf044ab77294958b788b5906c3bb0b8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:06.280327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30280ae8-012e-4ac6-818b-f068df71ee2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf044ab77294958b788b5906c3bb0b8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:06.281078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30280ae8-012e-4ac6-818b-f068df71ee2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf044ab77294958b788b5906c3bb0b8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:06.287787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30280ae8-012e-4ac6-818b-f068df71ee2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf044ab77294958b788b5906c3bb0b8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:06.377619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-30280ae8-012e-4ac6-818b-f068df71ee2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf044ab77294958b788b5906c3bb0b8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:06.383857 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4156/8326] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:56:05 2022] DELETE /identity/v3/users/8cf044ab77294958b788b5906c3bb0b8 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:06.388486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cfb47-6e67-42b1-907c-6cbd77901ce5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:06.388993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cfb47-6e67-42b1-907c-6cbd77901ce5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:06.389096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cfb47-6e67-42b1-907c-6cbd77901ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:06.407344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a64cfb47-6e67-42b1-907c-6cbd77901ce5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:06.408531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a64cfb47-6e67-42b1-907c-6cbd77901ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:06.474564 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4171/8327] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:06.485342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30280ae8-012e-4ac6-818b-f068df71ee2c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:06.486966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-30280ae8-012e-4ac6-818b-f068df71ee2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:06.546451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30280ae8-012e-4ac6-818b-f068df71ee2c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:06.550093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607e4f3-e4ca-4fd1-aced-cbcebc7335e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:06.550735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607e4f3-e4ca-4fd1-aced-cbcebc7335e7 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:06.551018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607e4f3-e4ca-4fd1-aced-cbcebc7335e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:06.551292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607e4f3-e4ca-4fd1-aced-cbcebc7335e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:06.561139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607e4f3-e4ca-4fd1-aced-cbcebc7335e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:06.562756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607e4f3-e4ca-4fd1-aced-cbcebc7335e7 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:06.572584 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4157/8328] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:56:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:56:06.804091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64cfb47-6e67-42b1-907c-6cbd77901ce5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:06.805655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a64cfb47-6e67-42b1-907c-6cbd77901ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:06.818767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64cfb47-6e67-42b1-907c-6cbd77901ce5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:06.824283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9796b-f62d-43f9-a579-6260f2ca6cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:06.825211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9796b-f62d-43f9-a579-6260f2ca6cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:06.825500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9796b-f62d-43f9-a579-6260f2ca6cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:06.825778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9796b-f62d-43f9-a579-6260f2ca6cd7 admin admin] PATH_INFO: `/v3/projects/26581b0ed8c3415aa3ed71e780eee587` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:06.826998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9796b-f62d-43f9-a579-6260f2ca6cd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26581b0ed8c3415aa3ed71e780eee587)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:06.828976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9796b-f62d-43f9-a579-6260f2ca6cd7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:06.933036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7ac9796b-f62d-43f9-a579-6260f2ca6cd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26581b0ed8c3415aa3ed71e780eee587', 'request_id': 'req-7ac9796b-f62d-43f9-a579-6260f2ca6cd7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:06.984022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7ac9796b-f62d-43f9-a579-6260f2ca6cd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26581b0ed8c3415aa3ed71e780eee587', 'request_id': 'req-7ac9796b-f62d-43f9-a579-6260f2ca6cd7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:06.991404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7ac9796b-f62d-43f9-a579-6260f2ca6cd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26581b0ed8c3415aa3ed71e780eee587', 'request_id': 'req-7ac9796b-f62d-43f9-a579-6260f2ca6cd7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:07.003100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7ac9796b-f62d-43f9-a579-6260f2ca6cd7 admin admin] The token cache is being invalidate because project 26581b0ed8c3415aa3ed71e780eee587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:56:07.003532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7ac9796b-f62d-43f9-a579-6260f2ca6cd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:07.004093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7ac9796b-f62d-43f9-a579-6260f2ca6cd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:07.005744 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4172/8329] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:56:06 2022] DELETE /identity/v3/projects/26581b0ed8c3415aa3ed71e780eee587 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:07.011162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fa89c-7296-4785-9b57-4b3ec81bfb76 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:07.011641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fa89c-7296-4785-9b57-4b3ec81bfb76 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:07.011738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fa89c-7296-4785-9b57-4b3ec81bfb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:07.030563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-849fa89c-7296-4785-9b57-4b3ec81bfb76 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:07.031778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-849fa89c-7296-4785-9b57-4b3ec81bfb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:07.096840 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4158/8330] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:07.101809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e39f3-f67d-445f-a8ce-d245fde12ce5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:07.102179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e39f3-f67d-445f-a8ce-d245fde12ce5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:07.102564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e39f3-f67d-445f-a8ce-d245fde12ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:07.122082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1a5e39f3-f67d-445f-a8ce-d245fde12ce5 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:07.123906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1a5e39f3-f67d-445f-a8ce-d245fde12ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:07.132426 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4173/8331] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:07.136814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fa89c-7296-4785-9b57-4b3ec81bfb76 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:07.147725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fa89c-7296-4785-9b57-4b3ec81bfb76 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:07.152342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19356074-9124-44b5-91fb-6eec05021df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:07.153039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19356074-9124-44b5-91fb-6eec05021df2 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:07.153327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19356074-9124-44b5-91fb-6eec05021df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:07.154224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19356074-9124-44b5-91fb-6eec05021df2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:07.154956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19356074-9124-44b5-91fb-6eec05021df2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:56:07.155267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19356074-9124-44b5-91fb-6eec05021df2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:07.156923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19356074-9124-44b5-91fb-6eec05021df2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:07.168136 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4159/8332] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:56:07.173198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e39f3-f67d-445f-a8ce-d245fde12ce5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:07.182630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e39f3-f67d-445f-a8ce-d245fde12ce5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:07.187329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690106d-3361-4b7a-8a87-8359bff24017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:07.187981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690106d-3361-4b7a-8a87-8359bff24017 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:07.188303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690106d-3361-4b7a-8a87-8359bff24017 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:07.188584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690106d-3361-4b7a-8a87-8359bff24017 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:07.189306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690106d-3361-4b7a-8a87-8359bff24017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:07.193244 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690106d-3361-4b7a-8a87-8359bff24017 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:07.254093 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4174/8333] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:56:07 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:56:07.259692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19356074-9124-44b5-91fb-6eec05021df2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:07.274001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19356074-9124-44b5-91fb-6eec05021df2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:07.332408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d381c64-4e0a-4063-97b7-dfdfc51cdf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:07.333120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d381c64-4e0a-4063-97b7-dfdfc51cdf92 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:07.333405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d381c64-4e0a-4063-97b7-dfdfc51cdf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:07.333685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d381c64-4e0a-4063-97b7-dfdfc51cdf92 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:07.334405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d381c64-4e0a-4063-97b7-dfdfc51cdf92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:07.336326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d381c64-4e0a-4063-97b7-dfdfc51cdf92 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:07.410846 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4160/8334] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:56:07 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:56:07.412054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690106d-3361-4b7a-8a87-8359bff24017 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:07.423520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690106d-3361-4b7a-8a87-8359bff24017 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:07.428277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf192f-137c-4dd2-b25b-d50c700de8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:07.429011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf192f-137c-4dd2-b25b-d50c700de8be admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:07.429293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf192f-137c-4dd2-b25b-d50c700de8be admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:07.429577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf192f-137c-4dd2-b25b-d50c700de8be admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:07.430306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf192f-137c-4dd2-b25b-d50c700de8be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:07.431894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf192f-137c-4dd2-b25b-d50c700de8be admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:07.442521 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4175/8335] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:56:07.458300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d381c64-4e0a-4063-97b7-dfdfc51cdf92 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:07.470293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d381c64-4e0a-4063-97b7-dfdfc51cdf92 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:07.476058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a5750-4bea-4db4-b950-2ee7c2fc2fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:07.476787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a5750-4bea-4db4-b950-2ee7c2fc2fcd admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:07.477075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a5750-4bea-4db4-b950-2ee7c2fc2fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:07.477388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a5750-4bea-4db4-b950-2ee7c2fc2fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:07.478297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a5750-4bea-4db4-b950-2ee7c2fc2fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:07.480100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a5750-4bea-4db4-b950-2ee7c2fc2fcd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:07.500869 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4161/8336] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:56:07.502686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf192f-137c-4dd2-b25b-d50c700de8be admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:07.512748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf192f-137c-4dd2-b25b-d50c700de8be admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:07.518378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c09e40-7fa5-46c5-8eb7-e218808bb992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:07.519277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c09e40-7fa5-46c5-8eb7-e218808bb992 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:07.519561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c09e40-7fa5-46c5-8eb7-e218808bb992 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:07.519841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c09e40-7fa5-46c5-8eb7-e218808bb992 admin admin] PATH_INFO: `/v3/projects/e5579201e7ef47d0a5f56c4c0cff6612/users/cab0b88500b7427ca47c70559236f8e8/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:07.536967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c09e40-7fa5-46c5-8eb7-e218808bb992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5579201e7ef47d0a5f56c4c0cff6612, user_id=cab0b88500b7427ca47c70559236f8e8, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:07.539805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c09e40-7fa5-46c5-8eb7-e218808bb992 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:07.603805 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4176/8337] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:56:07 2022] PUT /identity/v3/projects/e5579201e7ef47d0a5f56c4c0cff6612/users/cab0b88500b7427ca47c70559236f8e8/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:07.615215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537017b-e2c9-49a5-b1d2-5c21e06fe726 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:07.615642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537017b-e2c9-49a5-b1d2-5c21e06fe726 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:07.615856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537017b-e2c9-49a5-b1d2-5c21e06fe726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:07.643239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a537017b-e2c9-49a5-b1d2-5c21e06fe726 None None] MFA Rules not processed for user `cab0b88500b7427ca47c70559236f8e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:07.644683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a537017b-e2c9-49a5-b1d2-5c21e06fe726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:07.715440 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4162/8338] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:07.720497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c09e40-7fa5-46c5-8eb7-e218808bb992 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:07.798147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c09e40-7fa5-46c5-8eb7-e218808bb992 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:07.803075 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e907d3e-484c-4cc5-8d8e-b73459d6b648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:07.805285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907d3e-484c-4cc5-8d8e-b73459d6b648 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:07.805583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907d3e-484c-4cc5-8d8e-b73459d6b648 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:07.805870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907d3e-484c-4cc5-8d8e-b73459d6b648 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:07.806596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e907d3e-484c-4cc5-8d8e-b73459d6b648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:07.808566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e907d3e-484c-4cc5-8d8e-b73459d6b648 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:07.912751 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4177/8339] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:56:07 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:56:07.916798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537017b-e2c9-49a5-b1d2-5c21e06fe726 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:07.929659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537017b-e2c9-49a5-b1d2-5c21e06fe726 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:07.984458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdde64-9ff1-402e-89c9-693232dd24b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:07.985166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdde64-9ff1-402e-89c9-693232dd24b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:07.985451 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdde64-9ff1-402e-89c9-693232dd24b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:07.985724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdde64-9ff1-402e-89c9-693232dd24b6 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:07.986421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdde64-9ff1-402e-89c9-693232dd24b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:07.988358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdde64-9ff1-402e-89c9-693232dd24b6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:08.090219 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4163/8340] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:56:07 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:56:08.092116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e907d3e-484c-4cc5-8d8e-b73459d6b648 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:08.108805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e907d3e-484c-4cc5-8d8e-b73459d6b648 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:08.113812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd5ada-08a3-46fc-a795-32059bbe584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:08.114499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd5ada-08a3-46fc-a795-32059bbe584c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:08.114784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd5ada-08a3-46fc-a795-32059bbe584c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:08.115066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd5ada-08a3-46fc-a795-32059bbe584c admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:08.115831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd5ada-08a3-46fc-a795-32059bbe584c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:08.117472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd5ada-08a3-46fc-a795-32059bbe584c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:08.129017 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4178/8341] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:56:08.133306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdde64-9ff1-402e-89c9-693232dd24b6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:08.144270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdde64-9ff1-402e-89c9-693232dd24b6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:08.149034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5fe99-484b-4d61-a71e-4cf3cd7945d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:08.149930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5fe99-484b-4d61-a71e-4cf3cd7945d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:08.150212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5fe99-484b-4d61-a71e-4cf3cd7945d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:08.150489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5fe99-484b-4d61-a71e-4cf3cd7945d7 admin admin] PATH_INFO: `/v3/projects/ebe7f9d4add141e5bf9dbbb93ed95300/users/e4e6c494f5234f2e8c19142009a5cc0e/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:08.165430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5fe99-484b-4d61-a71e-4cf3cd7945d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe7f9d4add141e5bf9dbbb93ed95300, user_id=e4e6c494f5234f2e8c19142009a5cc0e, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:08.168152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5fe99-484b-4d61-a71e-4cf3cd7945d7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:08.265810 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4164/8342] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:56:08 2022] PUT /identity/v3/projects/ebe7f9d4add141e5bf9dbbb93ed95300/users/e4e6c494f5234f2e8c19142009a5cc0e/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:56:08.269923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd5ada-08a3-46fc-a795-32059bbe584c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:08.280334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd5ada-08a3-46fc-a795-32059bbe584c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:08.342794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24dbd0-77f9-4077-bcf9-7e8eae923f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:08.342794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24dbd0-77f9-4077-bcf9-7e8eae923f1a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:08.342794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24dbd0-77f9-4077-bcf9-7e8eae923f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:08.342794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24dbd0-77f9-4077-bcf9-7e8eae923f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:08.343296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24dbd0-77f9-4077-bcf9-7e8eae923f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:08.343389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24dbd0-77f9-4077-bcf9-7e8eae923f1a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:08.354397 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4179/8343] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:56:08.359164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5fe99-484b-4d61-a71e-4cf3cd7945d7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:08.373945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5fe99-484b-4d61-a71e-4cf3cd7945d7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:08.381715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b4a0b-6fc4-4eee-ac38-b5d0ce393ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:08.382820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b4a0b-6fc4-4eee-ac38-b5d0ce393ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:08.383337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b4a0b-6fc4-4eee-ac38-b5d0ce393ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:08.383812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b4a0b-6fc4-4eee-ac38-b5d0ce393ab3 admin admin] PATH_INFO: `/v3/projects/ebe7f9d4add141e5bf9dbbb93ed95300/users/e4e6c494f5234f2e8c19142009a5cc0e/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:08.386639 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b4a0b-6fc4-4eee-ac38-b5d0ce393ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe7f9d4add141e5bf9dbbb93ed95300, user_id=e4e6c494f5234f2e8c19142009a5cc0e, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:08.389444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b4a0b-6fc4-4eee-ac38-b5d0ce393ab3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:08.400289 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4165/8344] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:56:08 2022] PUT /identity/v3/projects/ebe7f9d4add141e5bf9dbbb93ed95300/users/e4e6c494f5234f2e8c19142009a5cc0e/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:08.411530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407e647-de16-4919-b6e2-655c47676e81 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:08.411824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407e647-de16-4919-b6e2-655c47676e81 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:08.415090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407e647-de16-4919-b6e2-655c47676e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:08.441073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-5407e647-de16-4919-b6e2-655c47676e81 None None] MFA Rules not processed for user `e4e6c494f5234f2e8c19142009a5cc0e`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:08.442320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5407e647-de16-4919-b6e2-655c47676e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:08.510908 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4180/8345] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:08.523646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b4a0b-6fc4-4eee-ac38-b5d0ce393ab3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:08.525479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-098b4a0b-6fc4-4eee-ac38-b5d0ce393ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:08.585702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b4a0b-6fc4-4eee-ac38-b5d0ce393ab3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:08.589704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b40769-6dd7-411f-8e5b-8c0596eab08b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:08.590376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b40769-6dd7-411f-8e5b-8c0596eab08b service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:08.590658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b40769-6dd7-411f-8e5b-8c0596eab08b service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:08.591128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b40769-6dd7-411f-8e5b-8c0596eab08b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:08.600330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b40769-6dd7-411f-8e5b-8c0596eab08b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:08.601960 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b40769-6dd7-411f-8e5b-8c0596eab08b service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:08.612209 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4166/8346] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:56:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:56:08.832278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407e647-de16-4919-b6e2-655c47676e81 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:08.833889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5407e647-de16-4919-b6e2-655c47676e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:08.850808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407e647-de16-4919-b6e2-655c47676e81 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:08.855261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea1a71-202d-4949-8eb0-a417386f8f09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:08.856030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea1a71-202d-4949-8eb0-a417386f8f09 service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:08.856324 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea1a71-202d-4949-8eb0-a417386f8f09 service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:08.857276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea1a71-202d-4949-8eb0-a417386f8f09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:08.926821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea1a71-202d-4949-8eb0-a417386f8f09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:08.928365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea1a71-202d-4949-8eb0-a417386f8f09 service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:08.939509 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4181/8347] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:56:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 10:56:11.266252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b40769-6dd7-411f-8e5b-8c0596eab08b service cinder] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:11.268077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-12b40769-6dd7-411f-8e5b-8c0596eab08b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:11.336381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b40769-6dd7-411f-8e5b-8c0596eab08b service cinder] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:11.341584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26783bdf-60fb-4ba7-9d92-d85dbfd4e19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:11.342541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26783bdf-60fb-4ba7-9d92-d85dbfd4e19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:11.342937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26783bdf-60fb-4ba7-9d92-d85dbfd4e19a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:11.343221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26783bdf-60fb-4ba7-9d92-d85dbfd4e19a admin admin] PATH_INFO: `/v3/users/adfc2828d2bb4affbc749cc9589e588e` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:11.344429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26783bdf-60fb-4ba7-9d92-d85dbfd4e19a admin admin] RBAC: Authorizing `identity:delete_user(user_id=adfc2828d2bb4affbc749cc9589e588e)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:11.346445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26783bdf-60fb-4ba7-9d92-d85dbfd4e19a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:11.563118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-26783bdf-60fb-4ba7-9d92-d85dbfd4e19a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adfc2828d2bb4affbc749cc9589e588e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:11.583159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-26783bdf-60fb-4ba7-9d92-d85dbfd4e19a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adfc2828d2bb4affbc749cc9589e588e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:11.584034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-26783bdf-60fb-4ba7-9d92-d85dbfd4e19a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adfc2828d2bb4affbc749cc9589e588e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:11.591978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-26783bdf-60fb-4ba7-9d92-d85dbfd4e19a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adfc2828d2bb4affbc749cc9589e588e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:11.646164 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-26783bdf-60fb-4ba7-9d92-d85dbfd4e19a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adfc2828d2bb4affbc749cc9589e588e'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:11.652617 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4167/8348] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:56:11 2022] DELETE /identity/v3/users/adfc2828d2bb4affbc749cc9589e588e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:11.657195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054ff64-c160-4764-87a9-c0d554741b78 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:11.657652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054ff64-c160-4764-87a9-c0d554741b78 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:11.657748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054ff64-c160-4764-87a9-c0d554741b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:11.675125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2054ff64-c160-4764-87a9-c0d554741b78 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:11.676323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2054ff64-c160-4764-87a9-c0d554741b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:11.739516 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4182/8349] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:11.746421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26783bdf-60fb-4ba7-9d92-d85dbfd4e19a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:11.748422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-26783bdf-60fb-4ba7-9d92-d85dbfd4e19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:11.808103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26783bdf-60fb-4ba7-9d92-d85dbfd4e19a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:11.812328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab1c1b-a783-4a6b-a514-1cd37229729c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:11.813028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab1c1b-a783-4a6b-a514-1cd37229729c service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:11.813311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab1c1b-a783-4a6b-a514-1cd37229729c service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:11.820070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab1c1b-a783-4a6b-a514-1cd37229729c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:11.823006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab1c1b-a783-4a6b-a514-1cd37229729c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:11.824438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab1c1b-a783-4a6b-a514-1cd37229729c service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:11.834505 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4168/8350] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:56:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:56:12.077305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054ff64-c160-4764-87a9-c0d554741b78 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:12.078745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2054ff64-c160-4764-87a9-c0d554741b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:12.091645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054ff64-c160-4764-87a9-c0d554741b78 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:12.102271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a63393-c13f-47ff-91ce-62dc41b63613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:12.103336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a63393-c13f-47ff-91ce-62dc41b63613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:12.103907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a63393-c13f-47ff-91ce-62dc41b63613 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:12.104452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a63393-c13f-47ff-91ce-62dc41b63613 admin admin] PATH_INFO: `/v3/projects/eeb256951e894594a924e2d25b0d80c9` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:12.105713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a63393-c13f-47ff-91ce-62dc41b63613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeb256951e894594a924e2d25b0d80c9)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:12.108345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a63393-c13f-47ff-91ce-62dc41b63613 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:12.256005 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-96a63393-c13f-47ff-91ce-62dc41b63613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeb256951e894594a924e2d25b0d80c9', 'request_id': 'req-96a63393-c13f-47ff-91ce-62dc41b63613'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:12.332491 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-96a63393-c13f-47ff-91ce-62dc41b63613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeb256951e894594a924e2d25b0d80c9', 'request_id': 'req-96a63393-c13f-47ff-91ce-62dc41b63613'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:12.339786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-96a63393-c13f-47ff-91ce-62dc41b63613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeb256951e894594a924e2d25b0d80c9', 'request_id': 'req-96a63393-c13f-47ff-91ce-62dc41b63613'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:12.350134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-96a63393-c13f-47ff-91ce-62dc41b63613 admin admin] The token cache is being invalidate because project eeb256951e894594a924e2d25b0d80c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:56:12.350425 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-96a63393-c13f-47ff-91ce-62dc41b63613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:12.351063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-96a63393-c13f-47ff-91ce-62dc41b63613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:12.352675 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4183/8351] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:56:12 2022] DELETE /identity/v3/projects/eeb256951e894594a924e2d25b0d80c9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:56:12.357458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab1c1b-a783-4a6b-a514-1cd37229729c service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:12.366877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab1c1b-a783-4a6b-a514-1cd37229729c service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:12.422511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f8cc2-d0b9-4c8e-9d40-00ac34b033cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:12.423376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f8cc2-d0b9-4c8e-9d40-00ac34b033cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:12.423657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f8cc2-d0b9-4c8e-9d40-00ac34b033cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:12.423933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f8cc2-d0b9-4c8e-9d40-00ac34b033cd admin admin] PATH_INFO: `/v3/users/f271053c9fa2462a8cbe012adf62a397` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:12.425148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f8cc2-d0b9-4c8e-9d40-00ac34b033cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f271053c9fa2462a8cbe012adf62a397)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:12.427083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f8cc2-d0b9-4c8e-9d40-00ac34b033cd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:12.625976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6b3f8cc2-d0b9-4c8e-9d40-00ac34b033cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f271053c9fa2462a8cbe012adf62a397'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:12.637393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6b3f8cc2-d0b9-4c8e-9d40-00ac34b033cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f271053c9fa2462a8cbe012adf62a397'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:12.638061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6b3f8cc2-d0b9-4c8e-9d40-00ac34b033cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f271053c9fa2462a8cbe012adf62a397'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:12.645077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6b3f8cc2-d0b9-4c8e-9d40-00ac34b033cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f271053c9fa2462a8cbe012adf62a397'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:12.698311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-6b3f8cc2-d0b9-4c8e-9d40-00ac34b033cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f271053c9fa2462a8cbe012adf62a397'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:12.704492 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4169/8352] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:56:12 2022] DELETE /identity/v3/users/f271053c9fa2462a8cbe012adf62a397 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:13.117599 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a63393-c13f-47ff-91ce-62dc41b63613 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:13.119150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-96a63393-c13f-47ff-91ce-62dc41b63613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:13.138765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a63393-c13f-47ff-91ce-62dc41b63613 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:13.195977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c16b3-d50d-4fab-8973-02fe9a76c76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:13.196897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c16b3-d50d-4fab-8973-02fe9a76c76a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:13.197185 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c16b3-d50d-4fab-8973-02fe9a76c76a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:13.197465 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c16b3-d50d-4fab-8973-02fe9a76c76a admin admin] PATH_INFO: `/v3/projects/83f8e3250de649088696a71864eaa70c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:13.198672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c16b3-d50d-4fab-8973-02fe9a76c76a admin admin] RBAC: Authorizing `identity:delete_project(project_id=83f8e3250de649088696a71864eaa70c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:13.201262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c16b3-d50d-4fab-8973-02fe9a76c76a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:13.328911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-663c16b3-d50d-4fab-8973-02fe9a76c76a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83f8e3250de649088696a71864eaa70c', 'request_id': 'req-663c16b3-d50d-4fab-8973-02fe9a76c76a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:13.418946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-663c16b3-d50d-4fab-8973-02fe9a76c76a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83f8e3250de649088696a71864eaa70c', 'request_id': 'req-663c16b3-d50d-4fab-8973-02fe9a76c76a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:13.426128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-663c16b3-d50d-4fab-8973-02fe9a76c76a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83f8e3250de649088696a71864eaa70c', 'request_id': 'req-663c16b3-d50d-4fab-8973-02fe9a76c76a'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:13.437091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-663c16b3-d50d-4fab-8973-02fe9a76c76a admin admin] The token cache is being invalidate because project 83f8e3250de649088696a71864eaa70c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:56:13.437383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-663c16b3-d50d-4fab-8973-02fe9a76c76a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:13.438031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-663c16b3-d50d-4fab-8973-02fe9a76c76a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:13.439589 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4184/8353] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:56:13 2022] DELETE /identity/v3/projects/83f8e3250de649088696a71864eaa70c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:13.443583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f8cc2-d0b9-4c8e-9d40-00ac34b033cd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:13.445017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6b3f8cc2-d0b9-4c8e-9d40-00ac34b033cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:13.458389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f8cc2-d0b9-4c8e-9d40-00ac34b033cd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:13.662599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1cf30-f6b2-4a25-b068-cfd272f3e57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:13.663504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1cf30-f6b2-4a25-b068-cfd272f3e57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:13.663787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1cf30-f6b2-4a25-b068-cfd272f3e57d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:13.664064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1cf30-f6b2-4a25-b068-cfd272f3e57d admin admin] PATH_INFO: `/v3/users/82859a65e0f24a4682c5f86d647d3000` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:13.665273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1cf30-f6b2-4a25-b068-cfd272f3e57d admin admin] RBAC: Authorizing `identity:delete_user(user_id=82859a65e0f24a4682c5f86d647d3000)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:13.667216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1cf30-f6b2-4a25-b068-cfd272f3e57d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:13.844263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-aed1cf30-f6b2-4a25-b068-cfd272f3e57d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82859a65e0f24a4682c5f86d647d3000'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:13.856432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-aed1cf30-f6b2-4a25-b068-cfd272f3e57d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82859a65e0f24a4682c5f86d647d3000'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:13.857711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-aed1cf30-f6b2-4a25-b068-cfd272f3e57d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82859a65e0f24a4682c5f86d647d3000'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:13.864490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-aed1cf30-f6b2-4a25-b068-cfd272f3e57d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82859a65e0f24a4682c5f86d647d3000'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:13.944349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-aed1cf30-f6b2-4a25-b068-cfd272f3e57d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82859a65e0f24a4682c5f86d647d3000'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:13.950376 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4170/8354] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:56:13 2022] DELETE /identity/v3/users/82859a65e0f24a4682c5f86d647d3000 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:14.186088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c16b3-d50d-4fab-8973-02fe9a76c76a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:14.188271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-663c16b3-d50d-4fab-8973-02fe9a76c76a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:14.201546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c16b3-d50d-4fab-8973-02fe9a76c76a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:14.257874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6bf57-c6d0-4112-8235-d67c23a3ed4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:14.258740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6bf57-c6d0-4112-8235-d67c23a3ed4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:14.259025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6bf57-c6d0-4112-8235-d67c23a3ed4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:14.259304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6bf57-c6d0-4112-8235-d67c23a3ed4e admin admin] PATH_INFO: `/v3/projects/6a41a810c57f408ab43e96fdc897866b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:14.260485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6bf57-c6d0-4112-8235-d67c23a3ed4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a41a810c57f408ab43e96fdc897866b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:14.262566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6bf57-c6d0-4112-8235-d67c23a3ed4e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:14.389672 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-31b6bf57-c6d0-4112-8235-d67c23a3ed4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a41a810c57f408ab43e96fdc897866b', 'request_id': 'req-31b6bf57-c6d0-4112-8235-d67c23a3ed4e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:14.446847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-31b6bf57-c6d0-4112-8235-d67c23a3ed4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a41a810c57f408ab43e96fdc897866b', 'request_id': 'req-31b6bf57-c6d0-4112-8235-d67c23a3ed4e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:14.453849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-31b6bf57-c6d0-4112-8235-d67c23a3ed4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a41a810c57f408ab43e96fdc897866b', 'request_id': 'req-31b6bf57-c6d0-4112-8235-d67c23a3ed4e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:14.464870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-31b6bf57-c6d0-4112-8235-d67c23a3ed4e admin admin] The token cache is being invalidate because project 6a41a810c57f408ab43e96fdc897866b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:56:14.465163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-31b6bf57-c6d0-4112-8235-d67c23a3ed4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:14.465915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-31b6bf57-c6d0-4112-8235-d67c23a3ed4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:14.468118 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4185/8355] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:56:14 2022] DELETE /identity/v3/projects/6a41a810c57f408ab43e96fdc897866b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:56:21.387105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1cf30-f6b2-4a25-b068-cfd272f3e57d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:21.388541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-aed1cf30-f6b2-4a25-b068-cfd272f3e57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:21.403309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1cf30-f6b2-4a25-b068-cfd272f3e57d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:21.456413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232c75b-ee89-4ff7-bc1f-333c3c0d8dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:21.457343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232c75b-ee89-4ff7-bc1f-333c3c0d8dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:21.457630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232c75b-ee89-4ff7-bc1f-333c3c0d8dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:21.457906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232c75b-ee89-4ff7-bc1f-333c3c0d8dcc admin admin] PATH_INFO: `/v3/users/e4e782af7347483bb0548443e32678f1` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:21.459070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232c75b-ee89-4ff7-bc1f-333c3c0d8dcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4e782af7347483bb0548443e32678f1)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:21.461058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232c75b-ee89-4ff7-bc1f-333c3c0d8dcc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:21.689662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f232c75b-ee89-4ff7-bc1f-333c3c0d8dcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4e782af7347483bb0548443e32678f1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:21.701532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f232c75b-ee89-4ff7-bc1f-333c3c0d8dcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4e782af7347483bb0548443e32678f1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:21.702917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f232c75b-ee89-4ff7-bc1f-333c3c0d8dcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4e782af7347483bb0548443e32678f1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:21.709177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f232c75b-ee89-4ff7-bc1f-333c3c0d8dcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4e782af7347483bb0548443e32678f1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:21.789941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f232c75b-ee89-4ff7-bc1f-333c3c0d8dcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4e782af7347483bb0548443e32678f1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:21.796254 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4171/8356] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:56:21 2022] DELETE /identity/v3/users/e4e782af7347483bb0548443e32678f1 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:21.801332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1cf15-c79f-45d8-bb5f-f4e836ca1b55 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:21.809521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1cf15-c79f-45d8-bb5f-f4e836ca1b55 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:21.809521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1cf15-c79f-45d8-bb5f-f4e836ca1b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:21.820157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-90f1cf15-c79f-45d8-bb5f-f4e836ca1b55 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:21.821398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-90f1cf15-c79f-45d8-bb5f-f4e836ca1b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:21.880901 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4186/8357] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:21.891264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232c75b-ee89-4ff7-bc1f-333c3c0d8dcc admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:21.897269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f232c75b-ee89-4ff7-bc1f-333c3c0d8dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:21.950204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232c75b-ee89-4ff7-bc1f-333c3c0d8dcc admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:21.953813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdf867-aa8c-421e-8d9b-bf4cf87fe733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:21.954465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdf867-aa8c-421e-8d9b-bf4cf87fe733 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:21.954753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdf867-aa8c-421e-8d9b-bf4cf87fe733 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:21.955047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdf867-aa8c-421e-8d9b-bf4cf87fe733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:21.963955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafdf867-aa8c-421e-8d9b-bf4cf87fe733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:21.965491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafdf867-aa8c-421e-8d9b-bf4cf87fe733 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:21.974831 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4172/8358] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:56:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:56:22.368931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1cf15-c79f-45d8-bb5f-f4e836ca1b55 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:22.370397 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-90f1cf15-c79f-45d8-bb5f-f4e836ca1b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:22.382663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1cf15-c79f-45d8-bb5f-f4e836ca1b55 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:22.388456 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacb3bf-473b-49d4-8cb4-3963c13a13fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:22.389239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacb3bf-473b-49d4-8cb4-3963c13a13fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:22.389529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacb3bf-473b-49d4-8cb4-3963c13a13fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:22.389813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacb3bf-473b-49d4-8cb4-3963c13a13fd admin admin] PATH_INFO: `/v3/projects/3eb679ab3c4249398fb3abd91c44c8bd` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:22.391355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacb3bf-473b-49d4-8cb4-3963c13a13fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eb679ab3c4249398fb3abd91c44c8bd)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:22.393418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacb3bf-473b-49d4-8cb4-3963c13a13fd admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:22.509794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2dacb3bf-473b-49d4-8cb4-3963c13a13fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eb679ab3c4249398fb3abd91c44c8bd', 'request_id': 'req-2dacb3bf-473b-49d4-8cb4-3963c13a13fd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:22.555576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2dacb3bf-473b-49d4-8cb4-3963c13a13fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eb679ab3c4249398fb3abd91c44c8bd', 'request_id': 'req-2dacb3bf-473b-49d4-8cb4-3963c13a13fd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:22.561760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2dacb3bf-473b-49d4-8cb4-3963c13a13fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eb679ab3c4249398fb3abd91c44c8bd', 'request_id': 'req-2dacb3bf-473b-49d4-8cb4-3963c13a13fd'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:22.571844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2dacb3bf-473b-49d4-8cb4-3963c13a13fd admin admin] The token cache is being invalidate because project 3eb679ab3c4249398fb3abd91c44c8bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:56:22.572135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2dacb3bf-473b-49d4-8cb4-3963c13a13fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:22.572801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2dacb3bf-473b-49d4-8cb4-3963c13a13fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:22.574445 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4187/8359] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:56:22 2022] DELETE /identity/v3/projects/3eb679ab3c4249398fb3abd91c44c8bd => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:22.579117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdf867-aa8c-421e-8d9b-bf4cf87fe733 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:22.589144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdf867-aa8c-421e-8d9b-bf4cf87fe733 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:22.644457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff5cd4-dafd-46ad-a645-9f37cacf98dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:22.645389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff5cd4-dafd-46ad-a645-9f37cacf98dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:22.645638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff5cd4-dafd-46ad-a645-9f37cacf98dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:22.645914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff5cd4-dafd-46ad-a645-9f37cacf98dc admin admin] PATH_INFO: `/v3/users/d8eec30ee92746ca950f41ff1e7c57a8` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:22.647111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff5cd4-dafd-46ad-a645-9f37cacf98dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8eec30ee92746ca950f41ff1e7c57a8)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:22.649085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff5cd4-dafd-46ad-a645-9f37cacf98dc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:22.871631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7bff5cd4-dafd-46ad-a645-9f37cacf98dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8eec30ee92746ca950f41ff1e7c57a8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:22.884331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7bff5cd4-dafd-46ad-a645-9f37cacf98dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8eec30ee92746ca950f41ff1e7c57a8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:22.885225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7bff5cd4-dafd-46ad-a645-9f37cacf98dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8eec30ee92746ca950f41ff1e7c57a8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:22.892958 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7bff5cd4-dafd-46ad-a645-9f37cacf98dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8eec30ee92746ca950f41ff1e7c57a8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:22.971643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7bff5cd4-dafd-46ad-a645-9f37cacf98dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8eec30ee92746ca950f41ff1e7c57a8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:22.977869 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4173/8360] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:56:22 2022] DELETE /identity/v3/users/d8eec30ee92746ca950f41ff1e7c57a8 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:23.387154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacb3bf-473b-49d4-8cb4-3963c13a13fd admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:23.388653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2dacb3bf-473b-49d4-8cb4-3963c13a13fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:23.405490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacb3bf-473b-49d4-8cb4-3963c13a13fd admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:23.460663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5708aa-d28c-4538-b95f-2f2651a0e403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:23.461542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5708aa-d28c-4538-b95f-2f2651a0e403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:23.461827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5708aa-d28c-4538-b95f-2f2651a0e403 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:23.462107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5708aa-d28c-4538-b95f-2f2651a0e403 admin admin] PATH_INFO: `/v3/projects/9c0840a54a9b4a1b8f86b83febbbe230` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:23.463336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5708aa-d28c-4538-b95f-2f2651a0e403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c0840a54a9b4a1b8f86b83febbbe230)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:23.465379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5708aa-d28c-4538-b95f-2f2651a0e403 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:23.572342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0f5708aa-d28c-4538-b95f-2f2651a0e403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c0840a54a9b4a1b8f86b83febbbe230', 'request_id': 'req-0f5708aa-d28c-4538-b95f-2f2651a0e403'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:23.658510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0f5708aa-d28c-4538-b95f-2f2651a0e403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c0840a54a9b4a1b8f86b83febbbe230', 'request_id': 'req-0f5708aa-d28c-4538-b95f-2f2651a0e403'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:23.665125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0f5708aa-d28c-4538-b95f-2f2651a0e403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c0840a54a9b4a1b8f86b83febbbe230', 'request_id': 'req-0f5708aa-d28c-4538-b95f-2f2651a0e403'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:23.675681 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0f5708aa-d28c-4538-b95f-2f2651a0e403 admin admin] The token cache is being invalidate because project 9c0840a54a9b4a1b8f86b83febbbe230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:56:23.676234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0f5708aa-d28c-4538-b95f-2f2651a0e403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:23.676716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0f5708aa-d28c-4538-b95f-2f2651a0e403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:23.678275 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4188/8361] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:56:23 2022] DELETE /identity/v3/projects/9c0840a54a9b4a1b8f86b83febbbe230 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:23.683068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b964c4-e025-4571-b934-f0b3e787870f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:23.683536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b964c4-e025-4571-b934-f0b3e787870f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:23.683660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b964c4-e025-4571-b934-f0b3e787870f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:23.702678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-16b964c4-e025-4571-b934-f0b3e787870f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:23.703926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-16b964c4-e025-4571-b934-f0b3e787870f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:23.761099 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4174/8362] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:23.771812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676632f-76e8-43b3-bf4c-d9f12b1d3a51 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:23.771812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676632f-76e8-43b3-bf4c-d9f12b1d3a51 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:23.771812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676632f-76e8-43b3-bf4c-d9f12b1d3a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:23.789500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1676632f-76e8-43b3-bf4c-d9f12b1d3a51 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:23.794393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1676632f-76e8-43b3-bf4c-d9f12b1d3a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:23.802774 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4189/8363] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:23.804155 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b964c4-e025-4571-b934-f0b3e787870f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:23.813995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b964c4-e025-4571-b934-f0b3e787870f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:23.818604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641f813-7a12-4efa-8d28-08b52d90973c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:23.819261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641f813-7a12-4efa-8d28-08b52d90973c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:23.819574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641f813-7a12-4efa-8d28-08b52d90973c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:23.819871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641f813-7a12-4efa-8d28-08b52d90973c admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:23.820615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641f813-7a12-4efa-8d28-08b52d90973c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:56:23.820939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641f813-7a12-4efa-8d28-08b52d90973c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:23.822715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641f813-7a12-4efa-8d28-08b52d90973c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:23.834368 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4175/8364] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:56:23.838727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676632f-76e8-43b3-bf4c-d9f12b1d3a51 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:23.849616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676632f-76e8-43b3-bf4c-d9f12b1d3a51 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:23.854479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee5877-379e-4d41-8b72-be68bade9107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:23.855135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee5877-379e-4d41-8b72-be68bade9107 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:23.855417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee5877-379e-4d41-8b72-be68bade9107 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:23.855695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee5877-379e-4d41-8b72-be68bade9107 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:23.856395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee5877-379e-4d41-8b72-be68bade9107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:23.858436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee5877-379e-4d41-8b72-be68bade9107 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:23.934578 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4190/8365] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:56:23 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:56:23.938697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641f813-7a12-4efa-8d28-08b52d90973c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:23.948970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641f813-7a12-4efa-8d28-08b52d90973c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:24.003226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027491b-b6ee-4290-a613-8c47858e3db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:24.003949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027491b-b6ee-4290-a613-8c47858e3db5 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:24.004236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027491b-b6ee-4290-a613-8c47858e3db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:24.004511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027491b-b6ee-4290-a613-8c47858e3db5 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:24.005215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027491b-b6ee-4290-a613-8c47858e3db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:24.012079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027491b-b6ee-4290-a613-8c47858e3db5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:24.121849 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4176/8366] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:56:23 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:56:24.126223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee5877-379e-4d41-8b72-be68bade9107 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:24.136663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee5877-379e-4d41-8b72-be68bade9107 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:24.142174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c66cf8-03c2-4ffa-b261-6d83ba40da43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:24.142823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c66cf8-03c2-4ffa-b261-6d83ba40da43 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:24.143999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c66cf8-03c2-4ffa-b261-6d83ba40da43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:24.143999 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c66cf8-03c2-4ffa-b261-6d83ba40da43 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:24.144196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c66cf8-03c2-4ffa-b261-6d83ba40da43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:24.145819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c66cf8-03c2-4ffa-b261-6d83ba40da43 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:24.156100 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4191/8367] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:56:24.160725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027491b-b6ee-4290-a613-8c47858e3db5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:24.170658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027491b-b6ee-4290-a613-8c47858e3db5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:24.175251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483f9fa-3f39-43a7-9647-a8b886378b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:24.175902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483f9fa-3f39-43a7-9647-a8b886378b09 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:24.176189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483f9fa-3f39-43a7-9647-a8b886378b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:24.176469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483f9fa-3f39-43a7-9647-a8b886378b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:24.177351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483f9fa-3f39-43a7-9647-a8b886378b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:24.178940 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483f9fa-3f39-43a7-9647-a8b886378b09 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:24.190401 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4177/8368] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:56:24.192923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c66cf8-03c2-4ffa-b261-6d83ba40da43 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:24.202907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c66cf8-03c2-4ffa-b261-6d83ba40da43 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:24.207996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd735b7a-921e-493a-930b-b2df7284fb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:24.208906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd735b7a-921e-493a-930b-b2df7284fb98 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:24.209189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd735b7a-921e-493a-930b-b2df7284fb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:24.209462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd735b7a-921e-493a-930b-b2df7284fb98 admin admin] PATH_INFO: `/v3/projects/a5c967c4c413428cbeb1fc59f2f41710/users/03afd042adef4f12bbcf4b9d27fd3e1f/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:24.224212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd735b7a-921e-493a-930b-b2df7284fb98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5c967c4c413428cbeb1fc59f2f41710, user_id=03afd042adef4f12bbcf4b9d27fd3e1f, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:24.227164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd735b7a-921e-493a-930b-b2df7284fb98 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:24.304050 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4192/8369] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:56:24 2022] PUT /identity/v3/projects/a5c967c4c413428cbeb1fc59f2f41710/users/03afd042adef4f12bbcf4b9d27fd3e1f/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:56:24.314438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c68b95-db17-441a-9383-f87440a1846a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:24.318011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c68b95-db17-441a-9383-f87440a1846a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:24.318011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c68b95-db17-441a-9383-f87440a1846a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:24.342413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-24c68b95-db17-441a-9383-f87440a1846a None None] MFA Rules not processed for user `03afd042adef4f12bbcf4b9d27fd3e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:24.343624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-24c68b95-db17-441a-9383-f87440a1846a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:24.404127 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4178/8370] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:24.408792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd735b7a-921e-493a-930b-b2df7284fb98 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:24.469290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd735b7a-921e-493a-930b-b2df7284fb98 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:24.473955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae62bd-a99f-4e91-a7ee-b7e453fbad1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:24.474615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae62bd-a99f-4e91-a7ee-b7e453fbad1d admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:24.474925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae62bd-a99f-4e91-a7ee-b7e453fbad1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:24.475205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae62bd-a99f-4e91-a7ee-b7e453fbad1d admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:24.475909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae62bd-a99f-4e91-a7ee-b7e453fbad1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:24.477842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae62bd-a99f-4e91-a7ee-b7e453fbad1d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:24.613398 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4193/8371] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:56:24 2022] POST /identity/v3/projects => generated 367 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:56:24.617587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c68b95-db17-441a-9383-f87440a1846a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:24.628796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c68b95-db17-441a-9383-f87440a1846a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:24.683522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd201c48-798c-4015-bc84-5f666cb2bd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:24.684206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd201c48-798c-4015-bc84-5f666cb2bd2f admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:24.684459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd201c48-798c-4015-bc84-5f666cb2bd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:24.684811 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd201c48-798c-4015-bc84-5f666cb2bd2f admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:24.685496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd201c48-798c-4015-bc84-5f666cb2bd2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:24.687397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd201c48-798c-4015-bc84-5f666cb2bd2f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:24.789640 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4179/8372] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:56:24 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:56:24.793532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae62bd-a99f-4e91-a7ee-b7e453fbad1d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:24.804577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae62bd-a99f-4e91-a7ee-b7e453fbad1d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:24.809205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189bee8-d94e-4e09-872b-451fb3c6dfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:24.809866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189bee8-d94e-4e09-872b-451fb3c6dfa8 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:24.810153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189bee8-d94e-4e09-872b-451fb3c6dfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:24.810446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189bee8-d94e-4e09-872b-451fb3c6dfa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:24.811204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189bee8-d94e-4e09-872b-451fb3c6dfa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:24.813427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189bee8-d94e-4e09-872b-451fb3c6dfa8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:24.824461 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4194/8373] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:56:24.828445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd201c48-798c-4015-bc84-5f666cb2bd2f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:24.843322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd201c48-798c-4015-bc84-5f666cb2bd2f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:24.848321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c72e1-91a5-4217-9b40-bfb4340deafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:24.849034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c72e1-91a5-4217-9b40-bfb4340deafb admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:24.849326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c72e1-91a5-4217-9b40-bfb4340deafb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:24.849608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c72e1-91a5-4217-9b40-bfb4340deafb admin admin] PATH_INFO: `/v3/projects/f20068c69f8b4305b81afb10469ca156/users/d3beb7fe8d7c4948983709234a86f915/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:24.865114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c72e1-91a5-4217-9b40-bfb4340deafb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f20068c69f8b4305b81afb10469ca156, user_id=d3beb7fe8d7c4948983709234a86f915, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:24.867883 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c72e1-91a5-4217-9b40-bfb4340deafb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:25.008100 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4180/8374] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:56:24 2022] PUT /identity/v3/projects/f20068c69f8b4305b81afb10469ca156/users/d3beb7fe8d7c4948983709234a86f915/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:56:25.012272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189bee8-d94e-4e09-872b-451fb3c6dfa8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:25.022532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189bee8-d94e-4e09-872b-451fb3c6dfa8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:25.078749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59874453-fbf2-409c-91df-e2cf084a1d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:25.079338 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59874453-fbf2-409c-91df-e2cf084a1d1d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:25.079677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59874453-fbf2-409c-91df-e2cf084a1d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:25.079953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59874453-fbf2-409c-91df-e2cf084a1d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:25.080698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59874453-fbf2-409c-91df-e2cf084a1d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:25.082332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59874453-fbf2-409c-91df-e2cf084a1d1d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:25.092081 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4195/8375] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:56:25.096574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c72e1-91a5-4217-9b40-bfb4340deafb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:25.107371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c72e1-91a5-4217-9b40-bfb4340deafb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:25.113203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd48f4-5c7d-4990-a46c-f4b3529dd915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:25.114162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd48f4-5c7d-4990-a46c-f4b3529dd915 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:25.114383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd48f4-5c7d-4990-a46c-f4b3529dd915 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:25.114671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd48f4-5c7d-4990-a46c-f4b3529dd915 admin admin] PATH_INFO: `/v3/projects/f20068c69f8b4305b81afb10469ca156/users/d3beb7fe8d7c4948983709234a86f915/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:25.116686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd48f4-5c7d-4990-a46c-f4b3529dd915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f20068c69f8b4305b81afb10469ca156, user_id=d3beb7fe8d7c4948983709234a86f915, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:25.119323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd48f4-5c7d-4990-a46c-f4b3529dd915 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:25.129561 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4181/8376] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:56:25 2022] PUT /identity/v3/projects/f20068c69f8b4305b81afb10469ca156/users/d3beb7fe8d7c4948983709234a86f915/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:56:25.140257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f271a-3e99-499e-bc87-eb702fbfec7c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:25.140554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f271a-3e99-499e-bc87-eb702fbfec7c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:25.141177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f271a-3e99-499e-bc87-eb702fbfec7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:25.167353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8f8f271a-3e99-499e-bc87-eb702fbfec7c None None] MFA Rules not processed for user `d3beb7fe8d7c4948983709234a86f915`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:25.168623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8f8f271a-3e99-499e-bc87-eb702fbfec7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:25.235373 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4196/8377] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:25 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:25.247272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd48f4-5c7d-4990-a46c-f4b3529dd915 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:25.249019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-dbcd48f4-5c7d-4990-a46c-f4b3529dd915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:25.306981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd48f4-5c7d-4990-a46c-f4b3529dd915 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:25.310695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37650484-b64c-45ea-9d77-91939f336cae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:25.311368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37650484-b64c-45ea-9d77-91939f336cae service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:25.311650 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37650484-b64c-45ea-9d77-91939f336cae service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:25.311928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37650484-b64c-45ea-9d77-91939f336cae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:25.321162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37650484-b64c-45ea-9d77-91939f336cae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:25.322592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37650484-b64c-45ea-9d77-91939f336cae service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:25.331921 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4182/8378] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:56:25 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:56:25.525887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f271a-3e99-499e-bc87-eb702fbfec7c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:25.538893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f271a-3e99-499e-bc87-eb702fbfec7c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:25.542858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fea4e1-18c5-4e90-939f-d1b97e64d830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:25.543518 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fea4e1-18c5-4e90-939f-d1b97e64d830 service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:25.543805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fea4e1-18c5-4e90-939f-d1b97e64d830 service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:25.544088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fea4e1-18c5-4e90-939f-d1b97e64d830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:25.608245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fea4e1-18c5-4e90-939f-d1b97e64d830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:25.609803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fea4e1-18c5-4e90-939f-d1b97e64d830 service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:25.618927 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4197/8379] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:56:25 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:56:37.106922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37650484-b64c-45ea-9d77-91939f336cae service cinder] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:37.168190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37650484-b64c-45ea-9d77-91939f336cae service cinder] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:37.172772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e36fbd-b499-4125-82d8-5de1429418bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:37.173662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e36fbd-b499-4125-82d8-5de1429418bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:37.173947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e36fbd-b499-4125-82d8-5de1429418bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:37.174372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e36fbd-b499-4125-82d8-5de1429418bf admin admin] PATH_INFO: `/v3/users/03afd042adef4f12bbcf4b9d27fd3e1f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:37.175400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e36fbd-b499-4125-82d8-5de1429418bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=03afd042adef4f12bbcf4b9d27fd3e1f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:37.177373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e36fbd-b499-4125-82d8-5de1429418bf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:37.305349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3e36fbd-b499-4125-82d8-5de1429418bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03afd042adef4f12bbcf4b9d27fd3e1f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:37.316396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3e36fbd-b499-4125-82d8-5de1429418bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03afd042adef4f12bbcf4b9d27fd3e1f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:37.317115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3e36fbd-b499-4125-82d8-5de1429418bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03afd042adef4f12bbcf4b9d27fd3e1f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:37.323765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3e36fbd-b499-4125-82d8-5de1429418bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03afd042adef4f12bbcf4b9d27fd3e1f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:37.366572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d3e36fbd-b499-4125-82d8-5de1429418bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03afd042adef4f12bbcf4b9d27fd3e1f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:37.372474 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4183/8380] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:56:37 2022] DELETE /identity/v3/users/03afd042adef4f12bbcf4b9d27fd3e1f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:37.377197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f31fe-3c3b-4f52-83e6-400dedbb9f0e None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:37.377697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f31fe-3c3b-4f52-83e6-400dedbb9f0e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:37.378311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f31fe-3c3b-4f52-83e6-400dedbb9f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:37.396223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-862f31fe-3c3b-4f52-83e6-400dedbb9f0e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:37.397455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-862f31fe-3c3b-4f52-83e6-400dedbb9f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:37.453950 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4198/8381] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:37.464072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e36fbd-b499-4125-82d8-5de1429418bf admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:37.465548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d3e36fbd-b499-4125-82d8-5de1429418bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:37.524884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e36fbd-b499-4125-82d8-5de1429418bf admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:37.528450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a88abe-e030-4772-8368-5b050eb91f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:37.529195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a88abe-e030-4772-8368-5b050eb91f72 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:37.529486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a88abe-e030-4772-8368-5b050eb91f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:37.529760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a88abe-e030-4772-8368-5b050eb91f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:37.538549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a88abe-e030-4772-8368-5b050eb91f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:37.539965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a88abe-e030-4772-8368-5b050eb91f72 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:37.549648 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4184/8382] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:56:37.917963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f31fe-3c3b-4f52-83e6-400dedbb9f0e None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:37.919376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-862f31fe-3c3b-4f52-83e6-400dedbb9f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:37.937450 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f31fe-3c3b-4f52-83e6-400dedbb9f0e None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:37.941758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669ae59-1eab-46b5-9ff1-49a809d72a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:37.942673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669ae59-1eab-46b5-9ff1-49a809d72a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:37.942959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669ae59-1eab-46b5-9ff1-49a809d72a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:37.943241 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669ae59-1eab-46b5-9ff1-49a809d72a78 admin admin] PATH_INFO: `/v3/projects/a5c967c4c413428cbeb1fc59f2f41710` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:37.944509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669ae59-1eab-46b5-9ff1-49a809d72a78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5c967c4c413428cbeb1fc59f2f41710)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:37.946455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669ae59-1eab-46b5-9ff1-49a809d72a78 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:38.063218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7669ae59-1eab-46b5-9ff1-49a809d72a78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5c967c4c413428cbeb1fc59f2f41710', 'request_id': 'req-7669ae59-1eab-46b5-9ff1-49a809d72a78'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:38.172528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7669ae59-1eab-46b5-9ff1-49a809d72a78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5c967c4c413428cbeb1fc59f2f41710', 'request_id': 'req-7669ae59-1eab-46b5-9ff1-49a809d72a78'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:38.179890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7669ae59-1eab-46b5-9ff1-49a809d72a78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5c967c4c413428cbeb1fc59f2f41710', 'request_id': 'req-7669ae59-1eab-46b5-9ff1-49a809d72a78'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:38.190334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7669ae59-1eab-46b5-9ff1-49a809d72a78 admin admin] The token cache is being invalidate because project a5c967c4c413428cbeb1fc59f2f41710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:56:38.190650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7669ae59-1eab-46b5-9ff1-49a809d72a78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:38.191292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-7669ae59-1eab-46b5-9ff1-49a809d72a78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:38.192916 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4199/8383] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:56:37 2022] DELETE /identity/v3/projects/a5c967c4c413428cbeb1fc59f2f41710 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:38.197109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a88abe-e030-4772-8368-5b050eb91f72 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:38.206688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a88abe-e030-4772-8368-5b050eb91f72 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:38.262005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c46b0-a16f-46ce-96fa-f72c76a7d4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:38.263105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c46b0-a16f-46ce-96fa-f72c76a7d4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:38.263458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c46b0-a16f-46ce-96fa-f72c76a7d4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:38.263816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c46b0-a16f-46ce-96fa-f72c76a7d4d1 admin admin] PATH_INFO: `/v3/users/d3beb7fe8d7c4948983709234a86f915` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:38.265357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c46b0-a16f-46ce-96fa-f72c76a7d4d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3beb7fe8d7c4948983709234a86f915)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:38.267702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c46b0-a16f-46ce-96fa-f72c76a7d4d1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:38.385791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dd2c46b0-a16f-46ce-96fa-f72c76a7d4d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3beb7fe8d7c4948983709234a86f915'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:38.397790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dd2c46b0-a16f-46ce-96fa-f72c76a7d4d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3beb7fe8d7c4948983709234a86f915'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:38.398476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dd2c46b0-a16f-46ce-96fa-f72c76a7d4d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3beb7fe8d7c4948983709234a86f915'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:38.404974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dd2c46b0-a16f-46ce-96fa-f72c76a7d4d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3beb7fe8d7c4948983709234a86f915'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:38.492678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-dd2c46b0-a16f-46ce-96fa-f72c76a7d4d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3beb7fe8d7c4948983709234a86f915'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:38.499091 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4185/8384] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:56:38 2022] DELETE /identity/v3/users/d3beb7fe8d7c4948983709234a86f915 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:38.894358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669ae59-1eab-46b5-9ff1-49a809d72a78 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:38.895847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7669ae59-1eab-46b5-9ff1-49a809d72a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:38.908574 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669ae59-1eab-46b5-9ff1-49a809d72a78 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:38.965045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ba85c-7eb2-4d17-8d49-0440a168f2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:38.965914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ba85c-7eb2-4d17-8d49-0440a168f2a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:38.966193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ba85c-7eb2-4d17-8d49-0440a168f2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:38.966471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ba85c-7eb2-4d17-8d49-0440a168f2a6 admin admin] PATH_INFO: `/v3/projects/f20068c69f8b4305b81afb10469ca156` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:38.967667 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ba85c-7eb2-4d17-8d49-0440a168f2a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f20068c69f8b4305b81afb10469ca156)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:38.969607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ba85c-7eb2-4d17-8d49-0440a168f2a6 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:39.068872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bc4ba85c-7eb2-4d17-8d49-0440a168f2a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f20068c69f8b4305b81afb10469ca156', 'request_id': 'req-bc4ba85c-7eb2-4d17-8d49-0440a168f2a6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:39.144806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bc4ba85c-7eb2-4d17-8d49-0440a168f2a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f20068c69f8b4305b81afb10469ca156', 'request_id': 'req-bc4ba85c-7eb2-4d17-8d49-0440a168f2a6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:39.151540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bc4ba85c-7eb2-4d17-8d49-0440a168f2a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f20068c69f8b4305b81afb10469ca156', 'request_id': 'req-bc4ba85c-7eb2-4d17-8d49-0440a168f2a6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:39.161411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bc4ba85c-7eb2-4d17-8d49-0440a168f2a6 admin admin] The token cache is being invalidate because project f20068c69f8b4305b81afb10469ca156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:56:39.161679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bc4ba85c-7eb2-4d17-8d49-0440a168f2a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:39.165483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bc4ba85c-7eb2-4d17-8d49-0440a168f2a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:39.165483 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4200/8385] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:56:38 2022] DELETE /identity/v3/projects/f20068c69f8b4305b81afb10469ca156 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:56:39.168905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ad880-b43d-42b5-a588-12845c0469d0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:39.169222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ad880-b43d-42b5-a588-12845c0469d0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:39.169502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ad880-b43d-42b5-a588-12845c0469d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:39.187584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f82ad880-b43d-42b5-a588-12845c0469d0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:39.188845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f82ad880-b43d-42b5-a588-12845c0469d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:39.247845 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4186/8386] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:39.256471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed08b1-19b9-4bad-b3e3-701fa7bf6231 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:39.260073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed08b1-19b9-4bad-b3e3-701fa7bf6231 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:39.260073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed08b1-19b9-4bad-b3e3-701fa7bf6231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:39.275648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-72ed08b1-19b9-4bad-b3e3-701fa7bf6231 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:39.276892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-72ed08b1-19b9-4bad-b3e3-701fa7bf6231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:39.284889 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4201/8387] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:39.289435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ad880-b43d-42b5-a588-12845c0469d0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:39.299209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ad880-b43d-42b5-a588-12845c0469d0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:39.304232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b878f26-5f31-4ae5-b4d0-000bf0e5fd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:39.306419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b878f26-5f31-4ae5-b4d0-000bf0e5fd92 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:39.306419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b878f26-5f31-4ae5-b4d0-000bf0e5fd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:39.306419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b878f26-5f31-4ae5-b4d0-000bf0e5fd92 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:39.306419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b878f26-5f31-4ae5-b4d0-000bf0e5fd92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:56:39.306854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b878f26-5f31-4ae5-b4d0-000bf0e5fd92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:39.308110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b878f26-5f31-4ae5-b4d0-000bf0e5fd92 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:39.319947 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4187/8388] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:56:39.324280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed08b1-19b9-4bad-b3e3-701fa7bf6231 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:39.333421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed08b1-19b9-4bad-b3e3-701fa7bf6231 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:39.338069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9859cb7-6810-47f2-8fed-1140e1ede8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:39.338719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9859cb7-6810-47f2-8fed-1140e1ede8ac admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:39.339006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9859cb7-6810-47f2-8fed-1140e1ede8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:39.339280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9859cb7-6810-47f2-8fed-1140e1ede8ac admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:39.339964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9859cb7-6810-47f2-8fed-1140e1ede8ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:39.341873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9859cb7-6810-47f2-8fed-1140e1ede8ac admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:39.412128 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4202/8389] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:56:39 2022] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:56:39.413677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b878f26-5f31-4ae5-b4d0-000bf0e5fd92 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:39.423510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b878f26-5f31-4ae5-b4d0-000bf0e5fd92 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:39.480055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71597e4-bcb1-4ae0-a84d-c34087d1cb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:39.480766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71597e4-bcb1-4ae0-a84d-c34087d1cb41 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:39.481057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71597e4-bcb1-4ae0-a84d-c34087d1cb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:39.481336 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71597e4-bcb1-4ae0-a84d-c34087d1cb41 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:39.482020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71597e4-bcb1-4ae0-a84d-c34087d1cb41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:39.483952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71597e4-bcb1-4ae0-a84d-c34087d1cb41 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:39.555211 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4188/8390] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:56:39 2022] POST /identity/v3/users => generated 291 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:56:39.559513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9859cb7-6810-47f2-8fed-1140e1ede8ac admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:39.570541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9859cb7-6810-47f2-8fed-1140e1ede8ac admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:39.575346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adea6ff-bf8d-4026-84cd-cdf57b026bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:39.576014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adea6ff-bf8d-4026-84cd-cdf57b026bad admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:39.576301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adea6ff-bf8d-4026-84cd-cdf57b026bad admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:39.576584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adea6ff-bf8d-4026-84cd-cdf57b026bad admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:39.577632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adea6ff-bf8d-4026-84cd-cdf57b026bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:39.579550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adea6ff-bf8d-4026-84cd-cdf57b026bad admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:39.589835 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4203/8391] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:56:39.593708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71597e4-bcb1-4ae0-a84d-c34087d1cb41 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:39.603502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71597e4-bcb1-4ae0-a84d-c34087d1cb41 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:39.608117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cb52a-8ae1-468c-8737-a7443f3a847f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:39.612795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cb52a-8ae1-468c-8737-a7443f3a847f admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:39.612795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cb52a-8ae1-468c-8737-a7443f3a847f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:39.612795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cb52a-8ae1-468c-8737-a7443f3a847f admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:39.612795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135cb52a-8ae1-468c-8737-a7443f3a847f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:39.612795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135cb52a-8ae1-468c-8737-a7443f3a847f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:39.622027 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4189/8392] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:56:39.626040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adea6ff-bf8d-4026-84cd-cdf57b026bad admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:39.636567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adea6ff-bf8d-4026-84cd-cdf57b026bad admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:39.641972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5b279-c7c9-4d15-90fc-c8056bb0d5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:39.642807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5b279-c7c9-4d15-90fc-c8056bb0d5d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:39.643089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5b279-c7c9-4d15-90fc-c8056bb0d5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:39.643391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5b279-c7c9-4d15-90fc-c8056bb0d5d8 admin admin] PATH_INFO: `/v3/projects/9a8c49d7f1074631b8df267ce6e84af0/users/3dec44b2219843c79c1aa26405787044/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:39.657664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5b279-c7c9-4d15-90fc-c8056bb0d5d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8c49d7f1074631b8df267ce6e84af0, user_id=3dec44b2219843c79c1aa26405787044, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:39.660989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5b279-c7c9-4d15-90fc-c8056bb0d5d8 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:39.739063 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4204/8393] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:56:39 2022] PUT /identity/v3/projects/9a8c49d7f1074631b8df267ce6e84af0/users/3dec44b2219843c79c1aa26405787044/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:39.749135 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cedbe-dfe7-4a70-8894-eb4243fbf6e9 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:39.749453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cedbe-dfe7-4a70-8894-eb4243fbf6e9 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:39.749748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cedbe-dfe7-4a70-8894-eb4243fbf6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:39.776200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e96cedbe-dfe7-4a70-8894-eb4243fbf6e9 None None] MFA Rules not processed for user `3dec44b2219843c79c1aa26405787044`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:39.777504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e96cedbe-dfe7-4a70-8894-eb4243fbf6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:39.839624 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4190/8394] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:39.844176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5b279-c7c9-4d15-90fc-c8056bb0d5d8 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:39.908298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5b279-c7c9-4d15-90fc-c8056bb0d5d8 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:39.913688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda6d92-3e7c-4dee-bd7f-77a0661e2b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:39.914411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda6d92-3e7c-4dee-bd7f-77a0661e2b13 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:39.914721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda6d92-3e7c-4dee-bd7f-77a0661e2b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:39.914989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda6d92-3e7c-4dee-bd7f-77a0661e2b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:39.915705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda6d92-3e7c-4dee-bd7f-77a0661e2b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:39.917657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda6d92-3e7c-4dee-bd7f-77a0661e2b13 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:39.995872 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4205/8395] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:56:39 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:56:39.999558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cedbe-dfe7-4a70-8894-eb4243fbf6e9 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:40.010515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cedbe-dfe7-4a70-8894-eb4243fbf6e9 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:40.065090 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7351f8-544c-44a3-8951-a89f42b9d266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:40.065780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7351f8-544c-44a3-8951-a89f42b9d266 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:40.066064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7351f8-544c-44a3-8951-a89f42b9d266 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:40.066340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7351f8-544c-44a3-8951-a89f42b9d266 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:40.067018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7351f8-544c-44a3-8951-a89f42b9d266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:40.068967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7351f8-544c-44a3-8951-a89f42b9d266 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:40.173455 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4191/8396] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:56:39 2022] POST /identity/v3/users => generated 296 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:56:40.177472 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda6d92-3e7c-4dee-bd7f-77a0661e2b13 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:40.188155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda6d92-3e7c-4dee-bd7f-77a0661e2b13 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:40.192888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071e9bf-0144-44b5-8bec-a48f4ca4f9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:40.193537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071e9bf-0144-44b5-8bec-a48f4ca4f9ab admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:40.193822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071e9bf-0144-44b5-8bec-a48f4ca4f9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:40.194102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071e9bf-0144-44b5-8bec-a48f4ca4f9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:40.194828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071e9bf-0144-44b5-8bec-a48f4ca4f9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:40.196411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071e9bf-0144-44b5-8bec-a48f4ca4f9ab admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:40.207466 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4206/8397] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:56:40.211753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7351f8-544c-44a3-8951-a89f42b9d266 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:40.222680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7351f8-544c-44a3-8951-a89f42b9d266 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:40.227283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa89a82-c088-4e10-984c-85ce76280dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:40.228153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa89a82-c088-4e10-984c-85ce76280dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:40.228440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa89a82-c088-4e10-984c-85ce76280dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:40.228742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa89a82-c088-4e10-984c-85ce76280dfe admin admin] PATH_INFO: `/v3/projects/b3d639ee15df42a8ae7ac08215f49357/users/fa7ac92cf6554a0087459f83555569b3/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:40.242677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa89a82-c088-4e10-984c-85ce76280dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3d639ee15df42a8ae7ac08215f49357, user_id=fa7ac92cf6554a0087459f83555569b3, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:40.245410 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa89a82-c088-4e10-984c-85ce76280dfe admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:40.343546 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4192/8398] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:56:40 2022] PUT /identity/v3/projects/b3d639ee15df42a8ae7ac08215f49357/users/fa7ac92cf6554a0087459f83555569b3/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:56:40.344115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071e9bf-0144-44b5-8bec-a48f4ca4f9ab admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:40.354145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071e9bf-0144-44b5-8bec-a48f4ca4f9ab admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:40.411604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e29821-7622-43a1-b03e-3744f25c0396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:40.412276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e29821-7622-43a1-b03e-3744f25c0396 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:40.412725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e29821-7622-43a1-b03e-3744f25c0396 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:40.413008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e29821-7622-43a1-b03e-3744f25c0396 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:40.413733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e29821-7622-43a1-b03e-3744f25c0396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:40.415366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e29821-7622-43a1-b03e-3744f25c0396 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:40.425026 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4207/8399] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:56:40.429295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa89a82-c088-4e10-984c-85ce76280dfe admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:40.439798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa89a82-c088-4e10-984c-85ce76280dfe admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:40.445069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec7bab-965d-4384-ba0b-e272d333bc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:40.445955 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec7bab-965d-4384-ba0b-e272d333bc3c admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:40.446242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec7bab-965d-4384-ba0b-e272d333bc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:40.446554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec7bab-965d-4384-ba0b-e272d333bc3c admin admin] PATH_INFO: `/v3/projects/b3d639ee15df42a8ae7ac08215f49357/users/fa7ac92cf6554a0087459f83555569b3/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:40.452696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec7bab-965d-4384-ba0b-e272d333bc3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3d639ee15df42a8ae7ac08215f49357, user_id=fa7ac92cf6554a0087459f83555569b3, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:40.452696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec7bab-965d-4384-ba0b-e272d333bc3c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:40.462016 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4193/8400] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:56:40 2022] PUT /identity/v3/projects/b3d639ee15df42a8ae7ac08215f49357/users/fa7ac92cf6554a0087459f83555569b3/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:40.472922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67661f84-4615-4d99-b876-ac6274d8ccb7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:40.473219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67661f84-4615-4d99-b876-ac6274d8ccb7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:40.473502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67661f84-4615-4d99-b876-ac6274d8ccb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:40.500577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-67661f84-4615-4d99-b876-ac6274d8ccb7 None None] MFA Rules not processed for user `fa7ac92cf6554a0087459f83555569b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:40.501828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-67661f84-4615-4d99-b876-ac6274d8ccb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:40.570076 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4208/8401] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:40.581795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec7bab-965d-4384-ba0b-e272d333bc3c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:40.583586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6eec7bab-965d-4384-ba0b-e272d333bc3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:40.643022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec7bab-965d-4384-ba0b-e272d333bc3c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:40.647224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5676c-fbb0-41f0-a7d9-ddafcec6410c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:40.647866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5676c-fbb0-41f0-a7d9-ddafcec6410c service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:40.648150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5676c-fbb0-41f0-a7d9-ddafcec6410c service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:40.648428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5676c-fbb0-41f0-a7d9-ddafcec6410c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:40.657181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5676c-fbb0-41f0-a7d9-ddafcec6410c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:40.658616 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5676c-fbb0-41f0-a7d9-ddafcec6410c service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:40.673438 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4194/8402] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:56:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:56:41.180970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67661f84-4615-4d99-b876-ac6274d8ccb7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:41.246510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67661f84-4615-4d99-b876-ac6274d8ccb7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:41.251157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaff8c-8424-4f94-8cf7-200ca30dbdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:41.252056 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaff8c-8424-4f94-8cf7-200ca30dbdc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:41.252345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaff8c-8424-4f94-8cf7-200ca30dbdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:41.252655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaff8c-8424-4f94-8cf7-200ca30dbdc1 admin admin] PATH_INFO: `/v3/users/3dec44b2219843c79c1aa26405787044` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:41.253867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcaff8c-8424-4f94-8cf7-200ca30dbdc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dec44b2219843c79c1aa26405787044)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:41.255807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcaff8c-8424-4f94-8cf7-200ca30dbdc1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:41.477802 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8fcaff8c-8424-4f94-8cf7-200ca30dbdc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dec44b2219843c79c1aa26405787044'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:41.490155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8fcaff8c-8424-4f94-8cf7-200ca30dbdc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dec44b2219843c79c1aa26405787044'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:41.490945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8fcaff8c-8424-4f94-8cf7-200ca30dbdc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dec44b2219843c79c1aa26405787044'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:41.498050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8fcaff8c-8424-4f94-8cf7-200ca30dbdc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dec44b2219843c79c1aa26405787044'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:41.560975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-8fcaff8c-8424-4f94-8cf7-200ca30dbdc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dec44b2219843c79c1aa26405787044'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:41.567363 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4209/8403] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:56:41 2022] DELETE /identity/v3/users/3dec44b2219843c79c1aa26405787044 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:41.571926 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d48a9-b37e-469d-880c-ce92683e7fa2 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:41.572406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d48a9-b37e-469d-880c-ce92683e7fa2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:41.572546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d48a9-b37e-469d-880c-ce92683e7fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:41.592758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-309d48a9-b37e-469d-880c-ce92683e7fa2 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:41.593965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-309d48a9-b37e-469d-880c-ce92683e7fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:41.652759 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4195/8404] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:41.662866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaff8c-8424-4f94-8cf7-200ca30dbdc1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:41.664263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8fcaff8c-8424-4f94-8cf7-200ca30dbdc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:41.724568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaff8c-8424-4f94-8cf7-200ca30dbdc1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:41.728087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cf44a-3ed1-42a0-866b-31ff801d6212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:41.728761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cf44a-3ed1-42a0-866b-31ff801d6212 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:41.729045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cf44a-3ed1-42a0-866b-31ff801d6212 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:41.729318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cf44a-3ed1-42a0-866b-31ff801d6212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:41.738617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cf44a-3ed1-42a0-866b-31ff801d6212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:41.740033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cf44a-3ed1-42a0-866b-31ff801d6212 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:41.749201 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4210/8405] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:56:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:56:42.100623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d48a9-b37e-469d-880c-ce92683e7fa2 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:42.102371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-309d48a9-b37e-469d-880c-ce92683e7fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:42.116073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d48a9-b37e-469d-880c-ce92683e7fa2 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:42.120810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594640f-2054-413f-872a-760ddbaa3a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:42.121679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594640f-2054-413f-872a-760ddbaa3a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:42.122094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594640f-2054-413f-872a-760ddbaa3a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:42.122381 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594640f-2054-413f-872a-760ddbaa3a3b admin admin] PATH_INFO: `/v3/projects/9a8c49d7f1074631b8df267ce6e84af0` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:42.123568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594640f-2054-413f-872a-760ddbaa3a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a8c49d7f1074631b8df267ce6e84af0)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:42.125564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594640f-2054-413f-872a-760ddbaa3a3b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:42.248161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d594640f-2054-413f-872a-760ddbaa3a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a8c49d7f1074631b8df267ce6e84af0', 'request_id': 'req-d594640f-2054-413f-872a-760ddbaa3a3b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:42.254125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d594640f-2054-413f-872a-760ddbaa3a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a8c49d7f1074631b8df267ce6e84af0', 'request_id': 'req-d594640f-2054-413f-872a-760ddbaa3a3b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:42.304144 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d594640f-2054-413f-872a-760ddbaa3a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a8c49d7f1074631b8df267ce6e84af0', 'request_id': 'req-d594640f-2054-413f-872a-760ddbaa3a3b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:42.314889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d594640f-2054-413f-872a-760ddbaa3a3b admin admin] The token cache is being invalidate because project 9a8c49d7f1074631b8df267ce6e84af0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:56:42.315201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d594640f-2054-413f-872a-760ddbaa3a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:42.315866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-d594640f-2054-413f-872a-760ddbaa3a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:42.317466 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4196/8406] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:56:42 2022] DELETE /identity/v3/projects/9a8c49d7f1074631b8df267ce6e84af0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:42.321584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cf44a-3ed1-42a0-866b-31ff801d6212 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:42.331463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cf44a-3ed1-42a0-866b-31ff801d6212 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:42.389386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa3a6b-2f3b-444b-b05a-3ea6dee23f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:42.390320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa3a6b-2f3b-444b-b05a-3ea6dee23f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:42.390604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa3a6b-2f3b-444b-b05a-3ea6dee23f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:42.391380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa3a6b-2f3b-444b-b05a-3ea6dee23f2c admin admin] PATH_INFO: `/v3/users/fa7ac92cf6554a0087459f83555569b3` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:42.392664 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa3a6b-2f3b-444b-b05a-3ea6dee23f2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa7ac92cf6554a0087459f83555569b3)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:42.395120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa3a6b-2f3b-444b-b05a-3ea6dee23f2c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:42.574015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f3fa3a6b-2f3b-444b-b05a-3ea6dee23f2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa7ac92cf6554a0087459f83555569b3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:42.585874 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f3fa3a6b-2f3b-444b-b05a-3ea6dee23f2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa7ac92cf6554a0087459f83555569b3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:42.586558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f3fa3a6b-2f3b-444b-b05a-3ea6dee23f2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa7ac92cf6554a0087459f83555569b3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:42.593183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f3fa3a6b-2f3b-444b-b05a-3ea6dee23f2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa7ac92cf6554a0087459f83555569b3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:42.652384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f3fa3a6b-2f3b-444b-b05a-3ea6dee23f2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa7ac92cf6554a0087459f83555569b3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:42.658543 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4211/8407] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:56:42 2022] DELETE /identity/v3/users/fa7ac92cf6554a0087459f83555569b3 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:43.026193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594640f-2054-413f-872a-760ddbaa3a3b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:43.027645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d594640f-2054-413f-872a-760ddbaa3a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:43.043613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594640f-2054-413f-872a-760ddbaa3a3b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:43.099828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee10bbf-562e-4398-8d5e-79bda9ec1e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:43.100757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee10bbf-562e-4398-8d5e-79bda9ec1e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:43.100961 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee10bbf-562e-4398-8d5e-79bda9ec1e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:43.101243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee10bbf-562e-4398-8d5e-79bda9ec1e30 admin admin] PATH_INFO: `/v3/projects/b3d639ee15df42a8ae7ac08215f49357` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:43.102441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee10bbf-562e-4398-8d5e-79bda9ec1e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3d639ee15df42a8ae7ac08215f49357)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:43.104423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee10bbf-562e-4398-8d5e-79bda9ec1e30 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:43.201026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3ee10bbf-562e-4398-8d5e-79bda9ec1e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3d639ee15df42a8ae7ac08215f49357', 'request_id': 'req-3ee10bbf-562e-4398-8d5e-79bda9ec1e30'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:43.206949 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3ee10bbf-562e-4398-8d5e-79bda9ec1e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3d639ee15df42a8ae7ac08215f49357', 'request_id': 'req-3ee10bbf-562e-4398-8d5e-79bda9ec1e30'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:43.274534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3ee10bbf-562e-4398-8d5e-79bda9ec1e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3d639ee15df42a8ae7ac08215f49357', 'request_id': 'req-3ee10bbf-562e-4398-8d5e-79bda9ec1e30'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:43.284748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3ee10bbf-562e-4398-8d5e-79bda9ec1e30 admin admin] The token cache is being invalidate because project b3d639ee15df42a8ae7ac08215f49357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:56:43.285034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3ee10bbf-562e-4398-8d5e-79bda9ec1e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:43.285821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-3ee10bbf-562e-4398-8d5e-79bda9ec1e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:43.287344 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4197/8408] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:56:43 2022] DELETE /identity/v3/projects/b3d639ee15df42a8ae7ac08215f49357 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:43.294376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205c4cc-551f-4e6b-9d22-0facf6e1dcb2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:43.294669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205c4cc-551f-4e6b-9d22-0facf6e1dcb2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:43.294954 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205c4cc-551f-4e6b-9d22-0facf6e1dcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:43.313610 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8205c4cc-551f-4e6b-9d22-0facf6e1dcb2 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:43.314816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8205c4cc-551f-4e6b-9d22-0facf6e1dcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:43.373232 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4212/8409] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:43.380860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d85ed2-e28b-4bc4-8f5c-a77acae7021f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:43.381160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d85ed2-e28b-4bc4-8f5c-a77acae7021f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:43.381473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d85ed2-e28b-4bc4-8f5c-a77acae7021f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:43.400564 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-48d85ed2-e28b-4bc4-8f5c-a77acae7021f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:43.401798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-48d85ed2-e28b-4bc4-8f5c-a77acae7021f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:43.411042 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4198/8410] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:43.414984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205c4cc-551f-4e6b-9d22-0facf6e1dcb2 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:43.424638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205c4cc-551f-4e6b-9d22-0facf6e1dcb2 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:43.429830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec4351-05d8-44e2-af1e-d33429e6350f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:43.430489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec4351-05d8-44e2-af1e-d33429e6350f admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:43.430766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec4351-05d8-44e2-af1e-d33429e6350f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:43.431042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec4351-05d8-44e2-af1e-d33429e6350f admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:43.431760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec4351-05d8-44e2-af1e-d33429e6350f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:56:43.432064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec4351-05d8-44e2-af1e-d33429e6350f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:43.439076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec4351-05d8-44e2-af1e-d33429e6350f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:43.448770 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4213/8411] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:56:43.449881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d85ed2-e28b-4bc4-8f5c-a77acae7021f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:43.458819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d85ed2-e28b-4bc4-8f5c-a77acae7021f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:43.463611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a75b5-1971-4ea9-a376-454e4c64f84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:43.464259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a75b5-1971-4ea9-a376-454e4c64f84d admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:43.464541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a75b5-1971-4ea9-a376-454e4c64f84d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:43.464864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a75b5-1971-4ea9-a376-454e4c64f84d admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:43.465542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a75b5-1971-4ea9-a376-454e4c64f84d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:43.467440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a75b5-1971-4ea9-a376-454e4c64f84d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:43.598595 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4199/8412] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:56:43 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:56:43.606105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec4351-05d8-44e2-af1e-d33429e6350f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:43.612983 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec4351-05d8-44e2-af1e-d33429e6350f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:43.671031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab95fef-2c23-4e0a-b2be-ceaa98154fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:43.671774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab95fef-2c23-4e0a-b2be-ceaa98154fce admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:43.672067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab95fef-2c23-4e0a-b2be-ceaa98154fce admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:43.672353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab95fef-2c23-4e0a-b2be-ceaa98154fce admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:43.673097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab95fef-2c23-4e0a-b2be-ceaa98154fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:43.675128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab95fef-2c23-4e0a-b2be-ceaa98154fce admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:43.756017 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4214/8413] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:56:43 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:56:43.759919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a75b5-1971-4ea9-a376-454e4c64f84d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:43.771436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a75b5-1971-4ea9-a376-454e4c64f84d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:43.775996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095406ac-21d1-4df2-87ac-bc9541f6cad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:43.777286 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095406ac-21d1-4df2-87ac-bc9541f6cad3 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:43.777636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095406ac-21d1-4df2-87ac-bc9541f6cad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:43.777923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095406ac-21d1-4df2-87ac-bc9541f6cad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:43.778688 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095406ac-21d1-4df2-87ac-bc9541f6cad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:43.780297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095406ac-21d1-4df2-87ac-bc9541f6cad3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:43.791725 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4200/8414] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:56:43.795710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab95fef-2c23-4e0a-b2be-ceaa98154fce admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:43.805781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab95fef-2c23-4e0a-b2be-ceaa98154fce admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:43.810363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0a33a-3802-441b-ac67-cc343449f364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:43.811386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0a33a-3802-441b-ac67-cc343449f364 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:43.811673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0a33a-3802-441b-ac67-cc343449f364 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:43.811952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0a33a-3802-441b-ac67-cc343449f364 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:43.813159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0a33a-3802-441b-ac67-cc343449f364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:43.814346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0a33a-3802-441b-ac67-cc343449f364 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:43.823921 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4215/8415] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:56:43.828098 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095406ac-21d1-4df2-87ac-bc9541f6cad3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:43.838553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095406ac-21d1-4df2-87ac-bc9541f6cad3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:43.843048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852331d-415e-46d2-8360-61b50f520a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:43.843913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852331d-415e-46d2-8360-61b50f520a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:43.844193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852331d-415e-46d2-8360-61b50f520a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:43.844470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852331d-415e-46d2-8360-61b50f520a2d admin admin] PATH_INFO: `/v3/projects/716e1a79c8544bc599bac3e7f7c4ed81/users/7994819cbc1b431aba6c6a2b9b72b652/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:43.858935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852331d-415e-46d2-8360-61b50f520a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=716e1a79c8544bc599bac3e7f7c4ed81, user_id=7994819cbc1b431aba6c6a2b9b72b652, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:43.861765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852331d-415e-46d2-8360-61b50f520a2d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:43.932867 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4201/8416] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:56:43 2022] PUT /identity/v3/projects/716e1a79c8544bc599bac3e7f7c4ed81/users/7994819cbc1b431aba6c6a2b9b72b652/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:43.942587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752ec56-9295-488b-a99e-a656033d77d2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:43.942877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752ec56-9295-488b-a99e-a656033d77d2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:43.943186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752ec56-9295-488b-a99e-a656033d77d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:43.968952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4752ec56-9295-488b-a99e-a656033d77d2 None None] MFA Rules not processed for user `7994819cbc1b431aba6c6a2b9b72b652`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:43.970150 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4752ec56-9295-488b-a99e-a656033d77d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:44.033451 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4216/8417] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:44.038432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852331d-415e-46d2-8360-61b50f520a2d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:44.097445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852331d-415e-46d2-8360-61b50f520a2d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:44.102769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c330ac-2729-4caa-a58a-697691ba26bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:44.103438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c330ac-2729-4caa-a58a-697691ba26bd admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:44.103729 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c330ac-2729-4caa-a58a-697691ba26bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:44.104009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c330ac-2729-4caa-a58a-697691ba26bd admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:44.104741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c330ac-2729-4caa-a58a-697691ba26bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:44.106686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c330ac-2729-4caa-a58a-697691ba26bd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:44.230175 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4202/8418] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:56:44 2022] POST /identity/v3/projects => generated 383 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:56:44.234228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752ec56-9295-488b-a99e-a656033d77d2 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:44.244831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752ec56-9295-488b-a99e-a656033d77d2 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:44.298531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5ca80-163a-4808-ad5d-f01c681459f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:44.299198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5ca80-163a-4808-ad5d-f01c681459f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:44.299480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5ca80-163a-4808-ad5d-f01c681459f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:44.299757 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5ca80-163a-4808-ad5d-f01c681459f1 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:44.300449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5ca80-163a-4808-ad5d-f01c681459f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:44.302375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5ca80-163a-4808-ad5d-f01c681459f1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:44.366684 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4217/8419] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:56:44 2022] POST /identity/v3/users => generated 298 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:56:44.370730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c330ac-2729-4caa-a58a-697691ba26bd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:44.381687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c330ac-2729-4caa-a58a-697691ba26bd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:44.386343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8551553-0984-4ddf-a89e-0c846f01bb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:44.387003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8551553-0984-4ddf-a89e-0c846f01bb73 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:44.387305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8551553-0984-4ddf-a89e-0c846f01bb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:44.387696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8551553-0984-4ddf-a89e-0c846f01bb73 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:44.388422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8551553-0984-4ddf-a89e-0c846f01bb73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:44.390151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8551553-0984-4ddf-a89e-0c846f01bb73 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:44.401215 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4203/8420] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:56:44.405159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5ca80-163a-4808-ad5d-f01c681459f1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:44.415078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5ca80-163a-4808-ad5d-f01c681459f1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:44.419677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3818c-ea7d-4632-8bfb-8c8c73585309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:44.420553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3818c-ea7d-4632-8bfb-8c8c73585309 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:44.420872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3818c-ea7d-4632-8bfb-8c8c73585309 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:44.421152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3818c-ea7d-4632-8bfb-8c8c73585309 admin admin] PATH_INFO: `/v3/projects/598522b148484e7f9d9cc65313c4d487/users/5b39a44d34e54e34a605c7301919d893/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:44.435221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3818c-ea7d-4632-8bfb-8c8c73585309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=598522b148484e7f9d9cc65313c4d487, user_id=5b39a44d34e54e34a605c7301919d893, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:44.437907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3818c-ea7d-4632-8bfb-8c8c73585309 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:44.515784 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4218/8421] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:56:44 2022] PUT /identity/v3/projects/598522b148484e7f9d9cc65313c4d487/users/5b39a44d34e54e34a605c7301919d893/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:56:44.520095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8551553-0984-4ddf-a89e-0c846f01bb73 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:44.530371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8551553-0984-4ddf-a89e-0c846f01bb73 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:44.585481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec189e-5886-4273-9262-e02c6682dfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:44.586147 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec189e-5886-4273-9262-e02c6682dfe7 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:44.586435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec189e-5886-4273-9262-e02c6682dfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:44.586713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec189e-5886-4273-9262-e02c6682dfe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:44.587424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec189e-5886-4273-9262-e02c6682dfe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:44.589063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec189e-5886-4273-9262-e02c6682dfe7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:44.598467 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4204/8422] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:56:44.602589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3818c-ea7d-4632-8bfb-8c8c73585309 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:44.614130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3818c-ea7d-4632-8bfb-8c8c73585309 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:44.618944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d94f0-9694-4532-8a4d-5e260054768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:44.619864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d94f0-9694-4532-8a4d-5e260054768c admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:44.620143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d94f0-9694-4532-8a4d-5e260054768c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:44.620423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d94f0-9694-4532-8a4d-5e260054768c admin admin] PATH_INFO: `/v3/projects/598522b148484e7f9d9cc65313c4d487/users/5b39a44d34e54e34a605c7301919d893/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:44.622620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d94f0-9694-4532-8a4d-5e260054768c admin admin] RBAC: Authorizing `identity:create_grant(project_id=598522b148484e7f9d9cc65313c4d487, user_id=5b39a44d34e54e34a605c7301919d893, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:44.625275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d94f0-9694-4532-8a4d-5e260054768c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:44.636212 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4219/8423] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:56:44 2022] PUT /identity/v3/projects/598522b148484e7f9d9cc65313c4d487/users/5b39a44d34e54e34a605c7301919d893/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:44.732588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a139bc-9414-45ba-9c5c-62e7810adcce None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:44.732912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a139bc-9414-45ba-9c5c-62e7810adcce None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:44.733216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a139bc-9414-45ba-9c5c-62e7810adcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:44.762068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-32a139bc-9414-45ba-9c5c-62e7810adcce None None] MFA Rules not processed for user `5b39a44d34e54e34a605c7301919d893`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:44.766838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-32a139bc-9414-45ba-9c5c-62e7810adcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:44.839279 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4205/8424] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:44.851105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d94f0-9694-4532-8a4d-5e260054768c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:44.852825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1c8d94f0-9694-4532-8a4d-5e260054768c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:44.912492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d94f0-9694-4532-8a4d-5e260054768c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:44.916075 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bd799-4469-4415-bea9-31df2743ba4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:44.916785 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bd799-4469-4415-bea9-31df2743ba4b service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:44.917070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bd799-4469-4415-bea9-31df2743ba4b service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:44.917379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bd799-4469-4415-bea9-31df2743ba4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:44.926889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bd799-4469-4415-bea9-31df2743ba4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:44.928314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bd799-4469-4415-bea9-31df2743ba4b service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:44.938113 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4220/8425] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:56:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:56:45.067920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a139bc-9414-45ba-9c5c-62e7810adcce None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:45.080085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a139bc-9414-45ba-9c5c-62e7810adcce None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:45.083646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c5fb2-3823-4d97-b9fe-a753c5b52510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:45.084814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c5fb2-3823-4d97-b9fe-a753c5b52510 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:45.085103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c5fb2-3823-4d97-b9fe-a753c5b52510 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:45.085385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c5fb2-3823-4d97-b9fe-a753c5b52510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:45.139847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c5fb2-3823-4d97-b9fe-a753c5b52510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:45.141593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c5fb2-3823-4d97-b9fe-a753c5b52510 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:45.150505 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4206/8426] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:56:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:56:45.556985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bd799-4469-4415-bea9-31df2743ba4b service cinder] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:45.616766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bd799-4469-4415-bea9-31df2743ba4b service cinder] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:45.621263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176afea0-3f12-4e99-971a-bf16e83b7089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:45.622133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176afea0-3f12-4e99-971a-bf16e83b7089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:45.622416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176afea0-3f12-4e99-971a-bf16e83b7089 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:45.622693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176afea0-3f12-4e99-971a-bf16e83b7089 admin admin] PATH_INFO: `/v3/users/7994819cbc1b431aba6c6a2b9b72b652` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:45.623881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176afea0-3f12-4e99-971a-bf16e83b7089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7994819cbc1b431aba6c6a2b9b72b652)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:45.625856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176afea0-3f12-4e99-971a-bf16e83b7089 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:45.804034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-176afea0-3f12-4e99-971a-bf16e83b7089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7994819cbc1b431aba6c6a2b9b72b652'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:45.817813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-176afea0-3f12-4e99-971a-bf16e83b7089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7994819cbc1b431aba6c6a2b9b72b652'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:45.818604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-176afea0-3f12-4e99-971a-bf16e83b7089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7994819cbc1b431aba6c6a2b9b72b652'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:45.825315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-176afea0-3f12-4e99-971a-bf16e83b7089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7994819cbc1b431aba6c6a2b9b72b652'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:45.909331 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-176afea0-3f12-4e99-971a-bf16e83b7089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7994819cbc1b431aba6c6a2b9b72b652'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:45.915805 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4221/8427] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:56:45 2022] DELETE /identity/v3/users/7994819cbc1b431aba6c6a2b9b72b652 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:45.920540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3d73a-a53b-4e68-98c8-1d10d2462b3f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:45.920861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3d73a-a53b-4e68-98c8-1d10d2462b3f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:45.921143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3d73a-a53b-4e68-98c8-1d10d2462b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:45.938299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c7d3d73a-a53b-4e68-98c8-1d10d2462b3f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:45.939492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c7d3d73a-a53b-4e68-98c8-1d10d2462b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:46.001407 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4207/8428] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:56:46.011896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176afea0-3f12-4e99-971a-bf16e83b7089 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:46.013388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-176afea0-3f12-4e99-971a-bf16e83b7089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:46.072322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176afea0-3f12-4e99-971a-bf16e83b7089 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:46.076155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0290e-2dd3-465b-83bd-ef470d248100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:46.076826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0290e-2dd3-465b-83bd-ef470d248100 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:46.077108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0290e-2dd3-465b-83bd-ef470d248100 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:46.077387 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0290e-2dd3-465b-83bd-ef470d248100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:46.086365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0290e-2dd3-465b-83bd-ef470d248100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:46.087780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0290e-2dd3-465b-83bd-ef470d248100 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:46.098125 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4222/8429] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:56:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:56:46.523529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3d73a-a53b-4e68-98c8-1d10d2462b3f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:46.525039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c7d3d73a-a53b-4e68-98c8-1d10d2462b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:46.540908 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3d73a-a53b-4e68-98c8-1d10d2462b3f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:46.542224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce721808-3249-4095-96e7-b59ad0dee39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:46.543105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce721808-3249-4095-96e7-b59ad0dee39b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:46.543388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce721808-3249-4095-96e7-b59ad0dee39b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:46.543662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce721808-3249-4095-96e7-b59ad0dee39b admin admin] PATH_INFO: `/v3/projects/716e1a79c8544bc599bac3e7f7c4ed81` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:46.544881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce721808-3249-4095-96e7-b59ad0dee39b admin admin] RBAC: Authorizing `identity:delete_project(project_id=716e1a79c8544bc599bac3e7f7c4ed81)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:46.546832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce721808-3249-4095-96e7-b59ad0dee39b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:46.649040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ce721808-3249-4095-96e7-b59ad0dee39b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '716e1a79c8544bc599bac3e7f7c4ed81', 'request_id': 'req-ce721808-3249-4095-96e7-b59ad0dee39b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:46.655386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ce721808-3249-4095-96e7-b59ad0dee39b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '716e1a79c8544bc599bac3e7f7c4ed81', 'request_id': 'req-ce721808-3249-4095-96e7-b59ad0dee39b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:46.709489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ce721808-3249-4095-96e7-b59ad0dee39b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '716e1a79c8544bc599bac3e7f7c4ed81', 'request_id': 'req-ce721808-3249-4095-96e7-b59ad0dee39b'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:46.719882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ce721808-3249-4095-96e7-b59ad0dee39b admin admin] The token cache is being invalidate because project 716e1a79c8544bc599bac3e7f7c4ed81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:56:46.720169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ce721808-3249-4095-96e7-b59ad0dee39b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:46.720824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ce721808-3249-4095-96e7-b59ad0dee39b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:46.722355 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4208/8430] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:56:46 2022] DELETE /identity/v3/projects/716e1a79c8544bc599bac3e7f7c4ed81 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:46.726906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0290e-2dd3-465b-83bd-ef470d248100 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:46.736778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0290e-2dd3-465b-83bd-ef470d248100 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:46.791906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1fb9d-7b3f-4d90-a43f-6f451a5659e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:46.792741 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1fb9d-7b3f-4d90-a43f-6f451a5659e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:46.793015 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1fb9d-7b3f-4d90-a43f-6f451a5659e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:46.793291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1fb9d-7b3f-4d90-a43f-6f451a5659e0 admin admin] PATH_INFO: `/v3/users/5b39a44d34e54e34a605c7301919d893` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:46.794494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1fb9d-7b3f-4d90-a43f-6f451a5659e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b39a44d34e54e34a605c7301919d893)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:46.796382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1fb9d-7b3f-4d90-a43f-6f451a5659e0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:46.975448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1ac1fb9d-7b3f-4d90-a43f-6f451a5659e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b39a44d34e54e34a605c7301919d893'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:46.987089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1ac1fb9d-7b3f-4d90-a43f-6f451a5659e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b39a44d34e54e34a605c7301919d893'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:46.987778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1ac1fb9d-7b3f-4d90-a43f-6f451a5659e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b39a44d34e54e34a605c7301919d893'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:46.994830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1ac1fb9d-7b3f-4d90-a43f-6f451a5659e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b39a44d34e54e34a605c7301919d893'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:47.063952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-1ac1fb9d-7b3f-4d90-a43f-6f451a5659e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b39a44d34e54e34a605c7301919d893'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:47.070703 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4223/8431] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:56:46 2022] DELETE /identity/v3/users/5b39a44d34e54e34a605c7301919d893 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:47.448927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce721808-3249-4095-96e7-b59ad0dee39b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:47.450442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ce721808-3249-4095-96e7-b59ad0dee39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:47.468131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce721808-3249-4095-96e7-b59ad0dee39b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:47.524755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f06d12-5d6c-4a88-9e89-e7535f6faea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:47.525618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f06d12-5d6c-4a88-9e89-e7535f6faea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:47.525903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f06d12-5d6c-4a88-9e89-e7535f6faea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:47.526184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f06d12-5d6c-4a88-9e89-e7535f6faea6 admin admin] PATH_INFO: `/v3/projects/598522b148484e7f9d9cc65313c4d487` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:47.527355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f06d12-5d6c-4a88-9e89-e7535f6faea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=598522b148484e7f9d9cc65313c4d487)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:47.529317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f06d12-5d6c-4a88-9e89-e7535f6faea6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:47.641457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-36f06d12-5d6c-4a88-9e89-e7535f6faea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '598522b148484e7f9d9cc65313c4d487', 'request_id': 'req-36f06d12-5d6c-4a88-9e89-e7535f6faea6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:47.648024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-36f06d12-5d6c-4a88-9e89-e7535f6faea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '598522b148484e7f9d9cc65313c4d487', 'request_id': 'req-36f06d12-5d6c-4a88-9e89-e7535f6faea6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:47.697893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-36f06d12-5d6c-4a88-9e89-e7535f6faea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '598522b148484e7f9d9cc65313c4d487', 'request_id': 'req-36f06d12-5d6c-4a88-9e89-e7535f6faea6'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:47.708174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-36f06d12-5d6c-4a88-9e89-e7535f6faea6 admin admin] The token cache is being invalidate because project 598522b148484e7f9d9cc65313c4d487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:56:47.708582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-36f06d12-5d6c-4a88-9e89-e7535f6faea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:47.709267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-36f06d12-5d6c-4a88-9e89-e7535f6faea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:56:47.710856 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4209/8432] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:56:47 2022] DELETE /identity/v3/projects/598522b148484e7f9d9cc65313c4d487 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:47.715720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f0622-029d-47c4-9242-190fd55a3bf2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:47.716012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f0622-029d-47c4-9242-190fd55a3bf2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:47.716291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f0622-029d-47c4-9242-190fd55a3bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:47.734570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-af2f0622-029d-47c4-9242-190fd55a3bf2 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:47.735783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-af2f0622-029d-47c4-9242-190fd55a3bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:47.793111 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4224/8433] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:47.801025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608a14b-552c-494f-9bf8-085c6bd7c3ed None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:47.801322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608a14b-552c-494f-9bf8-085c6bd7c3ed None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:47.801599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608a14b-552c-494f-9bf8-085c6bd7c3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:47.821258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-1608a14b-552c-494f-9bf8-085c6bd7c3ed None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:47.822450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1608a14b-552c-494f-9bf8-085c6bd7c3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:47.830508 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4210/8434] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:47.834824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f0622-029d-47c4-9242-190fd55a3bf2 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:47.844553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f0622-029d-47c4-9242-190fd55a3bf2 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:47.849380 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaeaf47-806d-4998-934e-380acf5c9a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:47.850035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaeaf47-806d-4998-934e-380acf5c9a33 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:47.850812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaeaf47-806d-4998-934e-380acf5c9a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:47.851091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaeaf47-806d-4998-934e-380acf5c9a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:47.851859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaeaf47-806d-4998-934e-380acf5c9a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:56:47.852208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaeaf47-806d-4998-934e-380acf5c9a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:47.854158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaeaf47-806d-4998-934e-380acf5c9a33 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:47.865900 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4225/8435] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:56:47.870711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608a14b-552c-494f-9bf8-085c6bd7c3ed None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:47.880543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608a14b-552c-494f-9bf8-085c6bd7c3ed None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:47.885115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a691ab-fc32-413d-9139-d07da23119c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:47.885760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a691ab-fc32-413d-9139-d07da23119c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:47.889266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a691ab-fc32-413d-9139-d07da23119c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:47.889266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a691ab-fc32-413d-9139-d07da23119c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:47.889266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a691ab-fc32-413d-9139-d07da23119c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:47.889266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a691ab-fc32-413d-9139-d07da23119c3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:47.955871 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4211/8436] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:56:47 2022] POST /identity/v3/projects => generated 363 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:56:47.960078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaeaf47-806d-4998-934e-380acf5c9a33 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:47.970310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaeaf47-806d-4998-934e-380acf5c9a33 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:48.027271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31787a02-0dc5-45dd-9b9a-0517f9de8faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:48.027949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31787a02-0dc5-45dd-9b9a-0517f9de8faf admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:48.028269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31787a02-0dc5-45dd-9b9a-0517f9de8faf admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:48.028697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31787a02-0dc5-45dd-9b9a-0517f9de8faf admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:48.029401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31787a02-0dc5-45dd-9b9a-0517f9de8faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:48.031348 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31787a02-0dc5-45dd-9b9a-0517f9de8faf admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:48.109446 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4226/8437] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:56:47 2022] POST /identity/v3/users => generated 282 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:56:48.113830 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a691ab-fc32-413d-9139-d07da23119c3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:48.124953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a691ab-fc32-413d-9139-d07da23119c3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:48.129546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6dff9-e2bb-418b-8654-c8e1055bd086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:48.130195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6dff9-e2bb-418b-8654-c8e1055bd086 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:48.130532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6dff9-e2bb-418b-8654-c8e1055bd086 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:48.141491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6dff9-e2bb-418b-8654-c8e1055bd086 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:48.141491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6dff9-e2bb-418b-8654-c8e1055bd086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:48.141491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6dff9-e2bb-418b-8654-c8e1055bd086 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:48.143530 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4212/8438] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:56:48.147973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31787a02-0dc5-45dd-9b9a-0517f9de8faf admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:48.158059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31787a02-0dc5-45dd-9b9a-0517f9de8faf admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:48.163424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b1521-a3c0-452c-8a92-be4845c66b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:48.164566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b1521-a3c0-452c-8a92-be4845c66b43 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:48.164566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b1521-a3c0-452c-8a92-be4845c66b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:48.164768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b1521-a3c0-452c-8a92-be4845c66b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:48.165384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b1521-a3c0-452c-8a92-be4845c66b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:48.166964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b1521-a3c0-452c-8a92-be4845c66b43 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:48.176663 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4227/8439] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:56:48.180749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6dff9-e2bb-418b-8654-c8e1055bd086 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:48.190780 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6dff9-e2bb-418b-8654-c8e1055bd086 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:48.195773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5c3b0-756d-4f34-abe0-f9cef8fe5ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:48.196676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5c3b0-756d-4f34-abe0-f9cef8fe5ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:48.196963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5c3b0-756d-4f34-abe0-f9cef8fe5ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:48.197241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5c3b0-756d-4f34-abe0-f9cef8fe5ef4 admin admin] PATH_INFO: `/v3/projects/a2414cc78d8648ed91a1527ecf826bee/users/1cfbc4371862424ab7c6ff88c6fc009d/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:48.211685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5c3b0-756d-4f34-abe0-f9cef8fe5ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2414cc78d8648ed91a1527ecf826bee, user_id=1cfbc4371862424ab7c6ff88c6fc009d, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:48.214412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5c3b0-756d-4f34-abe0-f9cef8fe5ef4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:48.281086 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4213/8440] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:56:48 2022] PUT /identity/v3/projects/a2414cc78d8648ed91a1527ecf826bee/users/1cfbc4371862424ab7c6ff88c6fc009d/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:56:48.292799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4935db-6639-4e89-b2b4-73356a7ffaa6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:48.293101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4935db-6639-4e89-b2b4-73356a7ffaa6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:48.293383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4935db-6639-4e89-b2b4-73356a7ffaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:48.319368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ee4935db-6639-4e89-b2b4-73356a7ffaa6 None None] MFA Rules not processed for user `1cfbc4371862424ab7c6ff88c6fc009d`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:56:48.320581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ee4935db-6639-4e89-b2b4-73356a7ffaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:48.382943 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4228/8441] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:56:48 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:56:48.394710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5c3b0-756d-4f34-abe0-f9cef8fe5ef4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:56:48.396326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-01d5c3b0-756d-4f34-abe0-f9cef8fe5ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:56:48.454194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5c3b0-756d-4f34-abe0-f9cef8fe5ef4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:56:48.458124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1a7f4-6329-4c2a-a6ea-074fa38d9c60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:56:48.458768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1a7f4-6329-4c2a-a6ea-074fa38d9c60 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:56:48.459049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1a7f4-6329-4c2a-a6ea-074fa38d9c60 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:56:48.459331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1a7f4-6329-4c2a-a6ea-074fa38d9c60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:56:48.468244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1a7f4-6329-4c2a-a6ea-074fa38d9c60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:56:48.469720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1a7f4-6329-4c2a-a6ea-074fa38d9c60 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:56:48.478962 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4214/8442] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:56:48 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:57:35.712309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4935db-6639-4e89-b2b4-73356a7ffaa6 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:35.716156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ee4935db-6639-4e89-b2b4-73356a7ffaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:35.778079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4935db-6639-4e89-b2b4-73356a7ffaa6 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:35.782640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb310ae0-e113-4aa8-8984-02d8a8a89641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:35.784118 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb310ae0-e113-4aa8-8984-02d8a8a89641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:35.784409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb310ae0-e113-4aa8-8984-02d8a8a89641 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:35.784718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb310ae0-e113-4aa8-8984-02d8a8a89641 admin admin] PATH_INFO: `/v3/users/cab0b88500b7427ca47c70559236f8e8` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:35.785927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb310ae0-e113-4aa8-8984-02d8a8a89641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cab0b88500b7427ca47c70559236f8e8)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:35.787839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb310ae0-e113-4aa8-8984-02d8a8a89641 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:35.941131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bb310ae0-e113-4aa8-8984-02d8a8a89641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cab0b88500b7427ca47c70559236f8e8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:35.952428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bb310ae0-e113-4aa8-8984-02d8a8a89641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cab0b88500b7427ca47c70559236f8e8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:35.954984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bb310ae0-e113-4aa8-8984-02d8a8a89641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cab0b88500b7427ca47c70559236f8e8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:35.960691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bb310ae0-e113-4aa8-8984-02d8a8a89641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cab0b88500b7427ca47c70559236f8e8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:36.047180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-bb310ae0-e113-4aa8-8984-02d8a8a89641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cab0b88500b7427ca47c70559236f8e8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:36.053747 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4229/8443] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:57:35 2022] DELETE /identity/v3/users/cab0b88500b7427ca47c70559236f8e8 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:57:36.058327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc9305-e5c8-4d4d-b13e-050b4534e816 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:36.058805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc9305-e5c8-4d4d-b13e-050b4534e816 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:36.058913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc9305-e5c8-4d4d-b13e-050b4534e816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:36.075779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-aebc9305-e5c8-4d4d-b13e-050b4534e816 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:57:36.077009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-aebc9305-e5c8-4d4d-b13e-050b4534e816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:36.136914 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4215/8444] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:57:36.147528 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb310ae0-e113-4aa8-8984-02d8a8a89641 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:36.149043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bb310ae0-e113-4aa8-8984-02d8a8a89641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:36.215490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb310ae0-e113-4aa8-8984-02d8a8a89641 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:36.222297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f7943-1dc9-49cb-ab7e-6e90da845525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:36.222297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f7943-1dc9-49cb-ab7e-6e90da845525 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:36.222297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f7943-1dc9-49cb-ab7e-6e90da845525 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:36.222297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f7943-1dc9-49cb-ab7e-6e90da845525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:36.232009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f7943-1dc9-49cb-ab7e-6e90da845525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:36.233366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f7943-1dc9-49cb-ab7e-6e90da845525 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:36.243553 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4230/8445] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:57:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:57:37.008458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc9305-e5c8-4d4d-b13e-050b4534e816 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:37.009936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-aebc9305-e5c8-4d4d-b13e-050b4534e816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:37.022799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc9305-e5c8-4d4d-b13e-050b4534e816 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:37.027726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f4256-b2cc-4c5a-91e1-bd7fe3f6447d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:37.028620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f4256-b2cc-4c5a-91e1-bd7fe3f6447d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:37.032114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f4256-b2cc-4c5a-91e1-bd7fe3f6447d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:37.032114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f4256-b2cc-4c5a-91e1-bd7fe3f6447d admin admin] PATH_INFO: `/v3/projects/e5579201e7ef47d0a5f56c4c0cff6612` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:37.032114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f4256-b2cc-4c5a-91e1-bd7fe3f6447d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5579201e7ef47d0a5f56c4c0cff6612)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:37.032384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f4256-b2cc-4c5a-91e1-bd7fe3f6447d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:37.161525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-837f4256-b2cc-4c5a-91e1-bd7fe3f6447d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5579201e7ef47d0a5f56c4c0cff6612', 'request_id': 'req-837f4256-b2cc-4c5a-91e1-bd7fe3f6447d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:37.168046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-837f4256-b2cc-4c5a-91e1-bd7fe3f6447d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5579201e7ef47d0a5f56c4c0cff6612', 'request_id': 'req-837f4256-b2cc-4c5a-91e1-bd7fe3f6447d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:37.235646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-837f4256-b2cc-4c5a-91e1-bd7fe3f6447d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5579201e7ef47d0a5f56c4c0cff6612', 'request_id': 'req-837f4256-b2cc-4c5a-91e1-bd7fe3f6447d'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:37.246424 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-837f4256-b2cc-4c5a-91e1-bd7fe3f6447d admin admin] The token cache is being invalidate because project e5579201e7ef47d0a5f56c4c0cff6612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:57:37.246713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-837f4256-b2cc-4c5a-91e1-bd7fe3f6447d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:37.247340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-837f4256-b2cc-4c5a-91e1-bd7fe3f6447d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:37.248919 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4216/8446] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:57:37 2022] DELETE /identity/v3/projects/e5579201e7ef47d0a5f56c4c0cff6612 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:57:37.253070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f7943-1dc9-49cb-ab7e-6e90da845525 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:37.266350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f7943-1dc9-49cb-ab7e-6e90da845525 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:37.327722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9faf4-0909-43ab-ae14-931a96e4db95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:37.328618 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9faf4-0909-43ab-ae14-931a96e4db95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:37.328902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9faf4-0909-43ab-ae14-931a96e4db95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:37.329177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9faf4-0909-43ab-ae14-931a96e4db95 admin admin] PATH_INFO: `/v3/users/e4e6c494f5234f2e8c19142009a5cc0e` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:37.330359 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9faf4-0909-43ab-ae14-931a96e4db95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4e6c494f5234f2e8c19142009a5cc0e)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:37.332912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9faf4-0909-43ab-ae14-931a96e4db95 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:37.534367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-23b9faf4-0909-43ab-ae14-931a96e4db95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4e6c494f5234f2e8c19142009a5cc0e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:37.545914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-23b9faf4-0909-43ab-ae14-931a96e4db95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4e6c494f5234f2e8c19142009a5cc0e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:37.546677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-23b9faf4-0909-43ab-ae14-931a96e4db95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4e6c494f5234f2e8c19142009a5cc0e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:37.553403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-23b9faf4-0909-43ab-ae14-931a96e4db95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4e6c494f5234f2e8c19142009a5cc0e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:37.617909 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-23b9faf4-0909-43ab-ae14-931a96e4db95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4e6c494f5234f2e8c19142009a5cc0e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:37.623968 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4231/8447] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:57:37 2022] DELETE /identity/v3/users/e4e6c494f5234f2e8c19142009a5cc0e => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:57:38.059894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f4256-b2cc-4c5a-91e1-bd7fe3f6447d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:38.061356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-837f4256-b2cc-4c5a-91e1-bd7fe3f6447d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:38.075334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f4256-b2cc-4c5a-91e1-bd7fe3f6447d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:38.136246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25726cba-792e-4cf7-aac8-fe88d995d3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:38.137166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25726cba-792e-4cf7-aac8-fe88d995d3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:38.137450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25726cba-792e-4cf7-aac8-fe88d995d3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:38.137727 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25726cba-792e-4cf7-aac8-fe88d995d3b7 admin admin] PATH_INFO: `/v3/projects/ebe7f9d4add141e5bf9dbbb93ed95300` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:38.138919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25726cba-792e-4cf7-aac8-fe88d995d3b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebe7f9d4add141e5bf9dbbb93ed95300)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:38.140981 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25726cba-792e-4cf7-aac8-fe88d995d3b7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:38.263551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-25726cba-792e-4cf7-aac8-fe88d995d3b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebe7f9d4add141e5bf9dbbb93ed95300', 'request_id': 'req-25726cba-792e-4cf7-aac8-fe88d995d3b7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:38.269826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-25726cba-792e-4cf7-aac8-fe88d995d3b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebe7f9d4add141e5bf9dbbb93ed95300', 'request_id': 'req-25726cba-792e-4cf7-aac8-fe88d995d3b7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:38.383752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-25726cba-792e-4cf7-aac8-fe88d995d3b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebe7f9d4add141e5bf9dbbb93ed95300', 'request_id': 'req-25726cba-792e-4cf7-aac8-fe88d995d3b7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:38.395284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-25726cba-792e-4cf7-aac8-fe88d995d3b7 admin admin] The token cache is being invalidate because project ebe7f9d4add141e5bf9dbbb93ed95300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:57:38.395642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-25726cba-792e-4cf7-aac8-fe88d995d3b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:38.396286 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-25726cba-792e-4cf7-aac8-fe88d995d3b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:38.397877 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4217/8448] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:57:38 2022] DELETE /identity/v3/projects/ebe7f9d4add141e5bf9dbbb93ed95300 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:57:38.402857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71994f-1d6d-4c46-b14f-cbfecb66e681 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:38.403389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71994f-1d6d-4c46-b14f-cbfecb66e681 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:38.403389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71994f-1d6d-4c46-b14f-cbfecb66e681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:38.422044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-7a71994f-1d6d-4c46-b14f-cbfecb66e681 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:57:38.423288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7a71994f-1d6d-4c46-b14f-cbfecb66e681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:38.481210 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4232/8449] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:57:38.490286 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e8db4-48e2-4ce3-9b39-c5a15529d468 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:38.490580 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e8db4-48e2-4ce3-9b39-c5a15529d468 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:38.490864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e8db4-48e2-4ce3-9b39-c5a15529d468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:38.509962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-481e8db4-48e2-4ce3-9b39-c5a15529d468 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:57:38.511169 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-481e8db4-48e2-4ce3-9b39-c5a15529d468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:38.519726 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4218/8450] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:57:38.523776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71994f-1d6d-4c46-b14f-cbfecb66e681 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:38.533409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71994f-1d6d-4c46-b14f-cbfecb66e681 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:38.538083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4fe10-322e-45ca-bbf6-d7044d53bf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:38.538742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4fe10-322e-45ca-bbf6-d7044d53bf2a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:38.539024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4fe10-322e-45ca-bbf6-d7044d53bf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:38.539299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4fe10-322e-45ca-bbf6-d7044d53bf2a admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:38.540019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b4fe10-322e-45ca-bbf6-d7044d53bf2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:57:38.540328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b4fe10-322e-45ca-bbf6-d7044d53bf2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:38.541975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b4fe10-322e-45ca-bbf6-d7044d53bf2a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:38.553973 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4233/8451] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:57:38.558291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e8db4-48e2-4ce3-9b39-c5a15529d468 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:38.568291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e8db4-48e2-4ce3-9b39-c5a15529d468 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:38.573304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4479d-9fd0-4940-9295-332763cf7d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:38.573959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4479d-9fd0-4940-9295-332763cf7d22 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:38.574246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4479d-9fd0-4940-9295-332763cf7d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:38.574530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4479d-9fd0-4940-9295-332763cf7d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:38.575316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4479d-9fd0-4940-9295-332763cf7d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:38.577301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4479d-9fd0-4940-9295-332763cf7d22 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:38.687861 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4219/8452] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:57:38 2022] POST /identity/v3/projects => generated 367 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:57:38.692560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4fe10-322e-45ca-bbf6-d7044d53bf2a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:38.702356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4fe10-322e-45ca-bbf6-d7044d53bf2a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:38.759769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1453e8-76b9-4f2d-ad9d-31ccf2e63b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:38.760478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1453e8-76b9-4f2d-ad9d-31ccf2e63b73 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:38.760810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1453e8-76b9-4f2d-ad9d-31ccf2e63b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:38.761093 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1453e8-76b9-4f2d-ad9d-31ccf2e63b73 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:38.761789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1453e8-76b9-4f2d-ad9d-31ccf2e63b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:38.763716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1453e8-76b9-4f2d-ad9d-31ccf2e63b73 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:38.870843 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4234/8453] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:57:38 2022] POST /identity/v3/users => generated 284 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:57:38.874918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4479d-9fd0-4940-9295-332763cf7d22 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:38.885127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4479d-9fd0-4940-9295-332763cf7d22 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:38.889695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713517f1-23fd-412f-aab9-be9f50f67438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:38.890355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713517f1-23fd-412f-aab9-be9f50f67438 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:38.890642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713517f1-23fd-412f-aab9-be9f50f67438 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:38.890928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713517f1-23fd-412f-aab9-be9f50f67438 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:38.891699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713517f1-23fd-412f-aab9-be9f50f67438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:38.893625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713517f1-23fd-412f-aab9-be9f50f67438 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:38.903752 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4220/8454] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:57:38.907701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1453e8-76b9-4f2d-ad9d-31ccf2e63b73 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:38.918230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1453e8-76b9-4f2d-ad9d-31ccf2e63b73 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:38.922937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3353f49-61d7-492b-bb93-1ce547eae411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:38.923596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3353f49-61d7-492b-bb93-1ce547eae411 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:38.923881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3353f49-61d7-492b-bb93-1ce547eae411 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:38.924166 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3353f49-61d7-492b-bb93-1ce547eae411 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:38.924927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3353f49-61d7-492b-bb93-1ce547eae411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:38.927213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3353f49-61d7-492b-bb93-1ce547eae411 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:38.937069 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4235/8455] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:57:38.941207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713517f1-23fd-412f-aab9-be9f50f67438 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:38.951263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713517f1-23fd-412f-aab9-be9f50f67438 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:38.956014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201b56d-9df1-4001-8830-979cc390065b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:38.956978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201b56d-9df1-4001-8830-979cc390065b admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:38.957267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201b56d-9df1-4001-8830-979cc390065b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:38.957549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201b56d-9df1-4001-8830-979cc390065b admin admin] PATH_INFO: `/v3/projects/89ac7fdfa9ba47fc9515cd3108438cb8/users/795e36b7a40f4d7da0a48db475cbcc71/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:38.972821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201b56d-9df1-4001-8830-979cc390065b admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ac7fdfa9ba47fc9515cd3108438cb8, user_id=795e36b7a40f4d7da0a48db475cbcc71, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:38.975490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201b56d-9df1-4001-8830-979cc390065b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:39.069419 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4221/8456] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:57:38 2022] PUT /identity/v3/projects/89ac7fdfa9ba47fc9515cd3108438cb8/users/795e36b7a40f4d7da0a48db475cbcc71/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:57:39.079675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5be700-50b4-425d-9c4c-605b8c41655c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:39.080018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5be700-50b4-425d-9c4c-605b8c41655c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:39.080410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5be700-50b4-425d-9c4c-605b8c41655c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:39.109277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3a5be700-50b4-425d-9c4c-605b8c41655c None None] MFA Rules not processed for user `795e36b7a40f4d7da0a48db475cbcc71`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:57:39.110522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3a5be700-50b4-425d-9c4c-605b8c41655c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:39.173038 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4236/8457] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:57:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:57:39.178197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201b56d-9df1-4001-8830-979cc390065b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:39.238216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201b56d-9df1-4001-8830-979cc390065b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:39.242835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af855c-c00d-4819-8a97-cdd9bf05c139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:39.243489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af855c-c00d-4819-8a97-cdd9bf05c139 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:39.243774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af855c-c00d-4819-8a97-cdd9bf05c139 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:39.244054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af855c-c00d-4819-8a97-cdd9bf05c139 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:39.244774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af855c-c00d-4819-8a97-cdd9bf05c139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:39.246702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af855c-c00d-4819-8a97-cdd9bf05c139 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:39.368184 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4222/8458] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:57:39 2022] POST /identity/v3/projects => generated 367 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:57:39.372277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5be700-50b4-425d-9c4c-605b8c41655c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:39.382897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5be700-50b4-425d-9c4c-605b8c41655c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:39.438732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ed486-f6df-47d7-aa90-88e0afb27221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:39.439401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ed486-f6df-47d7-aa90-88e0afb27221 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:39.439793 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ed486-f6df-47d7-aa90-88e0afb27221 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:39.440069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ed486-f6df-47d7-aa90-88e0afb27221 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:39.440812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ed486-f6df-47d7-aa90-88e0afb27221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:39.450737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ed486-f6df-47d7-aa90-88e0afb27221 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:39.543984 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4237/8459] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:57:39 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:57:39.547804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af855c-c00d-4819-8a97-cdd9bf05c139 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:39.558261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af855c-c00d-4819-8a97-cdd9bf05c139 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:39.563015 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b84a72-f308-4cb1-89d2-1a39b0dc0269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:39.563674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b84a72-f308-4cb1-89d2-1a39b0dc0269 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:39.563966 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b84a72-f308-4cb1-89d2-1a39b0dc0269 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:39.564273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b84a72-f308-4cb1-89d2-1a39b0dc0269 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:39.565039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b84a72-f308-4cb1-89d2-1a39b0dc0269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:39.567128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b84a72-f308-4cb1-89d2-1a39b0dc0269 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:39.577904 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4223/8460] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:57:39.582832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ed486-f6df-47d7-aa90-88e0afb27221 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:39.592650 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ed486-f6df-47d7-aa90-88e0afb27221 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:39.597334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d836d1-b8a3-42e5-90ac-470908655612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:39.598204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d836d1-b8a3-42e5-90ac-470908655612 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:39.598488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d836d1-b8a3-42e5-90ac-470908655612 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:39.598766 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d836d1-b8a3-42e5-90ac-470908655612 admin admin] PATH_INFO: `/v3/projects/6a4a38a6fb064ca38675d932001b647a/users/52551c493d614659977b51f717fd7538/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:39.613038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d836d1-b8a3-42e5-90ac-470908655612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a4a38a6fb064ca38675d932001b647a, user_id=52551c493d614659977b51f717fd7538, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:39.616137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d836d1-b8a3-42e5-90ac-470908655612 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:39.714994 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4238/8461] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:57:39 2022] PUT /identity/v3/projects/6a4a38a6fb064ca38675d932001b647a/users/52551c493d614659977b51f717fd7538/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:57:39.718839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b84a72-f308-4cb1-89d2-1a39b0dc0269 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:39.728615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b84a72-f308-4cb1-89d2-1a39b0dc0269 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:39.783391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee8a2e-41d4-4a3f-8ec7-bc1994c13be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:39.784584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee8a2e-41d4-4a3f-8ec7-bc1994c13be4 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:39.784759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee8a2e-41d4-4a3f-8ec7-bc1994c13be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:39.784959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee8a2e-41d4-4a3f-8ec7-bc1994c13be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:39.785686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee8a2e-41d4-4a3f-8ec7-bc1994c13be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:39.787338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee8a2e-41d4-4a3f-8ec7-bc1994c13be4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:39.797277 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4224/8462] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:57:39.801600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d836d1-b8a3-42e5-90ac-470908655612 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:39.812101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d836d1-b8a3-42e5-90ac-470908655612 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:39.820047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d88093-c2b1-4d91-8b7c-987e1c469929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:39.820047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d88093-c2b1-4d91-8b7c-987e1c469929 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:39.820047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d88093-c2b1-4d91-8b7c-987e1c469929 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:39.820047 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d88093-c2b1-4d91-8b7c-987e1c469929 admin admin] PATH_INFO: `/v3/projects/6a4a38a6fb064ca38675d932001b647a/users/52551c493d614659977b51f717fd7538/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:39.821198 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d88093-c2b1-4d91-8b7c-987e1c469929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a4a38a6fb064ca38675d932001b647a, user_id=52551c493d614659977b51f717fd7538, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:39.824091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d88093-c2b1-4d91-8b7c-987e1c469929 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:39.835124 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4239/8463] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:57:39 2022] PUT /identity/v3/projects/6a4a38a6fb064ca38675d932001b647a/users/52551c493d614659977b51f717fd7538/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:57:39.845360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e63e14-16de-4ac4-8d00-32a500151108 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:39.845649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e63e14-16de-4ac4-8d00-32a500151108 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:39.845927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e63e14-16de-4ac4-8d00-32a500151108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:39.870962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d4e63e14-16de-4ac4-8d00-32a500151108 None None] MFA Rules not processed for user `52551c493d614659977b51f717fd7538`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:57:39.872160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d4e63e14-16de-4ac4-8d00-32a500151108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:39.937280 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4225/8464] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:57:39 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:57:39.948298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d88093-c2b1-4d91-8b7c-987e1c469929 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:39.950033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-76d88093-c2b1-4d91-8b7c-987e1c469929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:40.009847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d88093-c2b1-4d91-8b7c-987e1c469929 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:40.013647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170734df-dc71-467c-b5a8-5653515f01c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:40.014322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170734df-dc71-467c-b5a8-5653515f01c7 service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:40.016537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170734df-dc71-467c-b5a8-5653515f01c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:40.016537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170734df-dc71-467c-b5a8-5653515f01c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:40.024357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170734df-dc71-467c-b5a8-5653515f01c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:40.025971 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170734df-dc71-467c-b5a8-5653515f01c7 service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:40.039430 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4240/8465] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:57:39 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:57:42.918219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e63e14-16de-4ac4-8d00-32a500151108 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:42.978017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e63e14-16de-4ac4-8d00-32a500151108 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:42.982608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f417955-280d-4d91-acfd-456d18e0deca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:42.985852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f417955-280d-4d91-acfd-456d18e0deca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:42.985852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f417955-280d-4d91-acfd-456d18e0deca admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:42.985852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f417955-280d-4d91-acfd-456d18e0deca admin admin] PATH_INFO: `/v3/users/795e36b7a40f4d7da0a48db475cbcc71` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:42.985852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f417955-280d-4d91-acfd-456d18e0deca admin admin] RBAC: Authorizing `identity:delete_user(user_id=795e36b7a40f4d7da0a48db475cbcc71)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:42.987152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f417955-280d-4d91-acfd-456d18e0deca admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:43.163641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1f417955-280d-4d91-acfd-456d18e0deca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '795e36b7a40f4d7da0a48db475cbcc71'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:43.176484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1f417955-280d-4d91-acfd-456d18e0deca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '795e36b7a40f4d7da0a48db475cbcc71'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:43.177246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1f417955-280d-4d91-acfd-456d18e0deca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '795e36b7a40f4d7da0a48db475cbcc71'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:43.184034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1f417955-280d-4d91-acfd-456d18e0deca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '795e36b7a40f4d7da0a48db475cbcc71'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:43.258477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1f417955-280d-4d91-acfd-456d18e0deca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '795e36b7a40f4d7da0a48db475cbcc71'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:43.265401 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4226/8466] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:57:42 2022] DELETE /identity/v3/users/795e36b7a40f4d7da0a48db475cbcc71 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:57:43.270268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850ca91-30b8-4c95-9a1e-b3b957766741 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:43.270746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850ca91-30b8-4c95-9a1e-b3b957766741 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:43.270846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850ca91-30b8-4c95-9a1e-b3b957766741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:43.287996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1850ca91-30b8-4c95-9a1e-b3b957766741 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:57:43.289293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1850ca91-30b8-4c95-9a1e-b3b957766741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:43.345120 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4241/8467] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:57:43.360711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f417955-280d-4d91-acfd-456d18e0deca admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:43.360711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1f417955-280d-4d91-acfd-456d18e0deca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:43.415509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f417955-280d-4d91-acfd-456d18e0deca admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:43.419227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe878f1f-63e2-4185-a7ad-46a3fd7ed64e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:43.419872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe878f1f-63e2-4185-a7ad-46a3fd7ed64e service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:43.420161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe878f1f-63e2-4185-a7ad-46a3fd7ed64e service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:43.420445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe878f1f-63e2-4185-a7ad-46a3fd7ed64e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:43.433050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe878f1f-63e2-4185-a7ad-46a3fd7ed64e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:43.434514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe878f1f-63e2-4185-a7ad-46a3fd7ed64e service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:43.444748 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4227/8468] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:57:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:57:43.825598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850ca91-30b8-4c95-9a1e-b3b957766741 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:43.827104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1850ca91-30b8-4c95-9a1e-b3b957766741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:43.842138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850ca91-30b8-4c95-9a1e-b3b957766741 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:43.848133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c93a1-bb00-49f8-9a33-30aa9f93b1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:43.849128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c93a1-bb00-49f8-9a33-30aa9f93b1e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:43.849368 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c93a1-bb00-49f8-9a33-30aa9f93b1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:43.849669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c93a1-bb00-49f8-9a33-30aa9f93b1e7 admin admin] PATH_INFO: `/v3/projects/89ac7fdfa9ba47fc9515cd3108438cb8` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:43.851008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c93a1-bb00-49f8-9a33-30aa9f93b1e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89ac7fdfa9ba47fc9515cd3108438cb8)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:43.852925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c93a1-bb00-49f8-9a33-30aa9f93b1e7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:43.943386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-325c93a1-bb00-49f8-9a33-30aa9f93b1e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89ac7fdfa9ba47fc9515cd3108438cb8', 'request_id': 'req-325c93a1-bb00-49f8-9a33-30aa9f93b1e7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:44.000843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-325c93a1-bb00-49f8-9a33-30aa9f93b1e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89ac7fdfa9ba47fc9515cd3108438cb8', 'request_id': 'req-325c93a1-bb00-49f8-9a33-30aa9f93b1e7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:44.007296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-325c93a1-bb00-49f8-9a33-30aa9f93b1e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89ac7fdfa9ba47fc9515cd3108438cb8', 'request_id': 'req-325c93a1-bb00-49f8-9a33-30aa9f93b1e7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:44.017556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-325c93a1-bb00-49f8-9a33-30aa9f93b1e7 admin admin] The token cache is being invalidate because project 89ac7fdfa9ba47fc9515cd3108438cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:57:44.017843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-325c93a1-bb00-49f8-9a33-30aa9f93b1e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:44.018487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-325c93a1-bb00-49f8-9a33-30aa9f93b1e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:44.020562 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4242/8469] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:57:43 2022] DELETE /identity/v3/projects/89ac7fdfa9ba47fc9515cd3108438cb8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:57:44.024708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe878f1f-63e2-4185-a7ad-46a3fd7ed64e service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:44.035109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe878f1f-63e2-4185-a7ad-46a3fd7ed64e service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:44.089088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ac1bb-47c4-4dfd-8f6f-440129205cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:44.089948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ac1bb-47c4-4dfd-8f6f-440129205cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:44.090228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ac1bb-47c4-4dfd-8f6f-440129205cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:44.090502 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ac1bb-47c4-4dfd-8f6f-440129205cb1 admin admin] PATH_INFO: `/v3/users/52551c493d614659977b51f717fd7538` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:44.091672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ac1bb-47c4-4dfd-8f6f-440129205cb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52551c493d614659977b51f717fd7538)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:44.093681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ac1bb-47c4-4dfd-8f6f-440129205cb1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:44.232128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-956ac1bb-47c4-4dfd-8f6f-440129205cb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52551c493d614659977b51f717fd7538'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:44.243696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-956ac1bb-47c4-4dfd-8f6f-440129205cb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52551c493d614659977b51f717fd7538'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:44.244396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-956ac1bb-47c4-4dfd-8f6f-440129205cb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52551c493d614659977b51f717fd7538'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:44.251130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-956ac1bb-47c4-4dfd-8f6f-440129205cb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52551c493d614659977b51f717fd7538'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:44.303677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-956ac1bb-47c4-4dfd-8f6f-440129205cb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52551c493d614659977b51f717fd7538'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:44.309665 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4228/8470] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:57:44 2022] DELETE /identity/v3/users/52551c493d614659977b51f717fd7538 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:57:44.715822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c93a1-bb00-49f8-9a33-30aa9f93b1e7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:44.717261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-325c93a1-bb00-49f8-9a33-30aa9f93b1e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:44.731784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c93a1-bb00-49f8-9a33-30aa9f93b1e7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:44.789151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f251b7a-e421-4c2a-b5bd-54e0adb080df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:44.790021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f251b7a-e421-4c2a-b5bd-54e0adb080df admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:44.790310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f251b7a-e421-4c2a-b5bd-54e0adb080df admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:44.790617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f251b7a-e421-4c2a-b5bd-54e0adb080df admin admin] PATH_INFO: `/v3/projects/6a4a38a6fb064ca38675d932001b647a` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:44.791796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f251b7a-e421-4c2a-b5bd-54e0adb080df admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a4a38a6fb064ca38675d932001b647a)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:44.793850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f251b7a-e421-4c2a-b5bd-54e0adb080df admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:44.926036 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f251b7a-e421-4c2a-b5bd-54e0adb080df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a4a38a6fb064ca38675d932001b647a', 'request_id': 'req-2f251b7a-e421-4c2a-b5bd-54e0adb080df'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:45.017845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f251b7a-e421-4c2a-b5bd-54e0adb080df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a4a38a6fb064ca38675d932001b647a', 'request_id': 'req-2f251b7a-e421-4c2a-b5bd-54e0adb080df'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:45.024106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f251b7a-e421-4c2a-b5bd-54e0adb080df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a4a38a6fb064ca38675d932001b647a', 'request_id': 'req-2f251b7a-e421-4c2a-b5bd-54e0adb080df'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:45.034086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f251b7a-e421-4c2a-b5bd-54e0adb080df admin admin] The token cache is being invalidate because project 6a4a38a6fb064ca38675d932001b647a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:57:45.034313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f251b7a-e421-4c2a-b5bd-54e0adb080df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:45.035428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f251b7a-e421-4c2a-b5bd-54e0adb080df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:45.037021 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4243/8471] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:57:44 2022] DELETE /identity/v3/projects/6a4a38a6fb064ca38675d932001b647a => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:57:45.041843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88da6ac-768c-4a23-9f54-a1dbec28f0c0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:45.042310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88da6ac-768c-4a23-9f54-a1dbec28f0c0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:45.042403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88da6ac-768c-4a23-9f54-a1dbec28f0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:45.061091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f88da6ac-768c-4a23-9f54-a1dbec28f0c0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:57:45.062473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f88da6ac-768c-4a23-9f54-a1dbec28f0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:45.121412 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4229/8472] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:57:45.129462 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba1c41-41db-4462-a4ed-9205c922a5cb None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:45.129788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba1c41-41db-4462-a4ed-9205c922a5cb None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:45.130080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba1c41-41db-4462-a4ed-9205c922a5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:45.148322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-feba1c41-41db-4462-a4ed-9205c922a5cb None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:57:45.149556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-feba1c41-41db-4462-a4ed-9205c922a5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:45.157576 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4244/8473] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:57:45.162251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88da6ac-768c-4a23-9f54-a1dbec28f0c0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:45.171805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88da6ac-768c-4a23-9f54-a1dbec28f0c0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:45.179019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca6349-4ca0-49fb-a09a-7ee8d8d865a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:45.179019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca6349-4ca0-49fb-a09a-7ee8d8d865a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:45.179019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca6349-4ca0-49fb-a09a-7ee8d8d865a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:45.179019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca6349-4ca0-49fb-a09a-7ee8d8d865a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:45.179406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca6349-4ca0-49fb-a09a-7ee8d8d865a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:57:45.179406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca6349-4ca0-49fb-a09a-7ee8d8d865a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:45.180746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca6349-4ca0-49fb-a09a-7ee8d8d865a8 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:45.191799 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4230/8474] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:57:45.199398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba1c41-41db-4462-a4ed-9205c922a5cb None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:45.209714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba1c41-41db-4462-a4ed-9205c922a5cb None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:45.214768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9ed5e-5bd9-4780-84d1-8b4eb48d02ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:45.215415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9ed5e-5bd9-4780-84d1-8b4eb48d02ad admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:45.215697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9ed5e-5bd9-4780-84d1-8b4eb48d02ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:45.215970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9ed5e-5bd9-4780-84d1-8b4eb48d02ad admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:45.216759 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9ed5e-5bd9-4780-84d1-8b4eb48d02ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:45.218684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9ed5e-5bd9-4780-84d1-8b4eb48d02ad admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:45.334281 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4245/8475] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:57:45 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:57:45.338340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca6349-4ca0-49fb-a09a-7ee8d8d865a8 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:45.349071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca6349-4ca0-49fb-a09a-7ee8d8d865a8 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:45.404218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b695e-c563-46bb-b9af-b8ba15d45012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:45.404924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b695e-c563-46bb-b9af-b8ba15d45012 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:45.405219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b695e-c563-46bb-b9af-b8ba15d45012 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:45.405517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b695e-c563-46bb-b9af-b8ba15d45012 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:45.406209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b695e-c563-46bb-b9af-b8ba15d45012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:45.408125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b695e-c563-46bb-b9af-b8ba15d45012 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:45.496791 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4231/8476] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:57:45 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:57:45.500868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9ed5e-5bd9-4780-84d1-8b4eb48d02ad admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:45.511446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9ed5e-5bd9-4780-84d1-8b4eb48d02ad admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:45.516426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa55bf-6662-49cc-be94-9e87d92df17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:45.518501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa55bf-6662-49cc-be94-9e87d92df17e admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:45.518501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa55bf-6662-49cc-be94-9e87d92df17e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:45.518501 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa55bf-6662-49cc-be94-9e87d92df17e admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:45.519292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa55bf-6662-49cc-be94-9e87d92df17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:45.520949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa55bf-6662-49cc-be94-9e87d92df17e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:45.532268 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4246/8477] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:57:45.537114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b695e-c563-46bb-b9af-b8ba15d45012 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:45.547026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b695e-c563-46bb-b9af-b8ba15d45012 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:45.551798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19c0ac-2456-4f92-a60d-c755ba24de96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:45.552455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19c0ac-2456-4f92-a60d-c755ba24de96 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:45.552772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19c0ac-2456-4f92-a60d-c755ba24de96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:45.553138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19c0ac-2456-4f92-a60d-c755ba24de96 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:45.553861 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19c0ac-2456-4f92-a60d-c755ba24de96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:45.555498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19c0ac-2456-4f92-a60d-c755ba24de96 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:45.565266 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4232/8478] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:57:45.569847 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa55bf-6662-49cc-be94-9e87d92df17e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:45.579625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa55bf-6662-49cc-be94-9e87d92df17e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:45.584997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea622b0b-7f58-4f86-976f-22a836132932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:45.585820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea622b0b-7f58-4f86-976f-22a836132932 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:45.586107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea622b0b-7f58-4f86-976f-22a836132932 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:45.586386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea622b0b-7f58-4f86-976f-22a836132932 admin admin] PATH_INFO: `/v3/projects/bcb9c16cf2754d7daf750dc61ffb7645/users/213c8391519b47489e038f4359d699c8/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:45.600527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea622b0b-7f58-4f86-976f-22a836132932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb9c16cf2754d7daf750dc61ffb7645, user_id=213c8391519b47489e038f4359d699c8, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:45.603269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea622b0b-7f58-4f86-976f-22a836132932 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:45.698631 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4247/8479] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:57:45 2022] PUT /identity/v3/projects/bcb9c16cf2754d7daf750dc61ffb7645/users/213c8391519b47489e038f4359d699c8/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:57:45.709761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93100b-153c-46e8-b885-e86c2578d3b2 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:45.710056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93100b-153c-46e8-b885-e86c2578d3b2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:45.710341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93100b-153c-46e8-b885-e86c2578d3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:45.735757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-aa93100b-153c-46e8-b885-e86c2578d3b2 None None] MFA Rules not processed for user `213c8391519b47489e038f4359d699c8`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:57:45.737040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-aa93100b-153c-46e8-b885-e86c2578d3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:45.799780 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4233/8480] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:57:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:57:45.804706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea622b0b-7f58-4f86-976f-22a836132932 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:45.864701 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea622b0b-7f58-4f86-976f-22a836132932 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:45.869335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91745aa-7138-4984-8b77-fe70ce9e5d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:45.869989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91745aa-7138-4984-8b77-fe70ce9e5d11 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:45.870272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91745aa-7138-4984-8b77-fe70ce9e5d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:45.870557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91745aa-7138-4984-8b77-fe70ce9e5d11 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:45.871238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91745aa-7138-4984-8b77-fe70ce9e5d11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:45.873157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91745aa-7138-4984-8b77-fe70ce9e5d11 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:45.979485 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4248/8481] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:57:45 2022] POST /identity/v3/projects => generated 387 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:57:45.983496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93100b-153c-46e8-b885-e86c2578d3b2 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:45.994713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93100b-153c-46e8-b885-e86c2578d3b2 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:46.050813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facf7c6-bbda-4695-a467-0d0e0e95dc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:46.051547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facf7c6-bbda-4695-a467-0d0e0e95dc52 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:46.051829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facf7c6-bbda-4695-a467-0d0e0e95dc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:46.052103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facf7c6-bbda-4695-a467-0d0e0e95dc52 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:46.052813 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7facf7c6-bbda-4695-a467-0d0e0e95dc52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:46.054738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7facf7c6-bbda-4695-a467-0d0e0e95dc52 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:46.149985 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4234/8482] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:57:45 2022] POST /identity/v3/users => generated 300 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:57:46.154023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91745aa-7138-4984-8b77-fe70ce9e5d11 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:46.164267 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91745aa-7138-4984-8b77-fe70ce9e5d11 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:46.169488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a4a08-9996-4fce-992a-d7a80523916b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:46.170145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a4a08-9996-4fce-992a-d7a80523916b admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:46.170609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a4a08-9996-4fce-992a-d7a80523916b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:46.170723 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a4a08-9996-4fce-992a-d7a80523916b admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:46.171433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a4a08-9996-4fce-992a-d7a80523916b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:46.173054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a4a08-9996-4fce-992a-d7a80523916b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:46.183931 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4249/8483] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:57:46.188092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facf7c6-bbda-4695-a467-0d0e0e95dc52 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:46.198753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facf7c6-bbda-4695-a467-0d0e0e95dc52 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:46.203334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece55d4-ad9d-445c-a115-bdbd27a28793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:46.204239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece55d4-ad9d-445c-a115-bdbd27a28793 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:46.204521 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece55d4-ad9d-445c-a115-bdbd27a28793 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:46.204831 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece55d4-ad9d-445c-a115-bdbd27a28793 admin admin] PATH_INFO: `/v3/projects/e4e8a630edf242b6807005362c453a63/users/4238dc5c0b1849b68e728ede58cc5252/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:46.218998 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece55d4-ad9d-445c-a115-bdbd27a28793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e8a630edf242b6807005362c453a63, user_id=4238dc5c0b1849b68e728ede58cc5252, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:46.221723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece55d4-ad9d-445c-a115-bdbd27a28793 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:46.320671 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4235/8484] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:57:46 2022] PUT /identity/v3/projects/e4e8a630edf242b6807005362c453a63/users/4238dc5c0b1849b68e728ede58cc5252/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:57:46.326370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a4a08-9996-4fce-992a-d7a80523916b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:46.336090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a4a08-9996-4fce-992a-d7a80523916b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:46.392001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6db05-80e1-41c6-ae56-b37138141b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:46.392939 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6db05-80e1-41c6-ae56-b37138141b53 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:46.393228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6db05-80e1-41c6-ae56-b37138141b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:46.393524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6db05-80e1-41c6-ae56-b37138141b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:46.394232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6db05-80e1-41c6-ae56-b37138141b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:46.395818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6db05-80e1-41c6-ae56-b37138141b53 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:46.407379 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4250/8485] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:57:46.412237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece55d4-ad9d-445c-a115-bdbd27a28793 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:46.422581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece55d4-ad9d-445c-a115-bdbd27a28793 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:46.428117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9aadc8-4473-49bf-8527-8186e8f7ad8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:46.429301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9aadc8-4473-49bf-8527-8186e8f7ad8d admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:46.429581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9aadc8-4473-49bf-8527-8186e8f7ad8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:46.435758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9aadc8-4473-49bf-8527-8186e8f7ad8d admin admin] PATH_INFO: `/v3/projects/e4e8a630edf242b6807005362c453a63/users/4238dc5c0b1849b68e728ede58cc5252/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:46.435758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9aadc8-4473-49bf-8527-8186e8f7ad8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e8a630edf242b6807005362c453a63, user_id=4238dc5c0b1849b68e728ede58cc5252, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:46.435758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9aadc8-4473-49bf-8527-8186e8f7ad8d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:46.444542 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4236/8486] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:57:46 2022] PUT /identity/v3/projects/e4e8a630edf242b6807005362c453a63/users/4238dc5c0b1849b68e728ede58cc5252/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:57:46.543536 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cbbb0-9cc2-46cb-9a24-a2fa8c08fda3 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:46.543826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cbbb0-9cc2-46cb-9a24-a2fa8c08fda3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:46.544112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cbbb0-9cc2-46cb-9a24-a2fa8c08fda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:46.570877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-665cbbb0-9cc2-46cb-9a24-a2fa8c08fda3 None None] MFA Rules not processed for user `4238dc5c0b1849b68e728ede58cc5252`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:57:46.572175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-665cbbb0-9cc2-46cb-9a24-a2fa8c08fda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:46.639616 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4251/8487] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:57:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:57:46.652834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9aadc8-4473-49bf-8527-8186e8f7ad8d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:46.652834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5a9aadc8-4473-49bf-8527-8186e8f7ad8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:46.710615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9aadc8-4473-49bf-8527-8186e8f7ad8d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:46.714240 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8138e38-8ba7-468e-8bd6-fc7616d59b56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:46.714877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8138e38-8ba7-468e-8bd6-fc7616d59b56 service cinder] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:46.715157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8138e38-8ba7-468e-8bd6-fc7616d59b56 service cinder] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:46.715432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8138e38-8ba7-468e-8bd6-fc7616d59b56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:46.724947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8138e38-8ba7-468e-8bd6-fc7616d59b56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:46.726397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8138e38-8ba7-468e-8bd6-fc7616d59b56 service cinder] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:46.735770 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4237/8488] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:57:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:57:46.802237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cbbb0-9cc2-46cb-9a24-a2fa8c08fda3 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:46.866982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cbbb0-9cc2-46cb-9a24-a2fa8c08fda3 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:46.871718 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5d4a6-375d-4552-9ec9-ca00d1987210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:46.872640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5d4a6-375d-4552-9ec9-ca00d1987210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:46.872953 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5d4a6-375d-4552-9ec9-ca00d1987210 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:46.873238 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5d4a6-375d-4552-9ec9-ca00d1987210 admin admin] PATH_INFO: `/v3/users/213c8391519b47489e038f4359d699c8` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:46.874483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5d4a6-375d-4552-9ec9-ca00d1987210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=213c8391519b47489e038f4359d699c8)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:46.876427 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5d4a6-375d-4552-9ec9-ca00d1987210 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:47.094767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-78e5d4a6-375d-4552-9ec9-ca00d1987210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '213c8391519b47489e038f4359d699c8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:47.107143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-78e5d4a6-375d-4552-9ec9-ca00d1987210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '213c8391519b47489e038f4359d699c8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:47.108038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-78e5d4a6-375d-4552-9ec9-ca00d1987210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '213c8391519b47489e038f4359d699c8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:47.114882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-78e5d4a6-375d-4552-9ec9-ca00d1987210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '213c8391519b47489e038f4359d699c8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:47.166529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-78e5d4a6-375d-4552-9ec9-ca00d1987210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '213c8391519b47489e038f4359d699c8'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:47.172856 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4252/8489] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:57:46 2022] DELETE /identity/v3/users/213c8391519b47489e038f4359d699c8 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:57:47.177682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d554bda-dd70-466e-9700-dec0e97ea5e0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:47.178176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d554bda-dd70-466e-9700-dec0e97ea5e0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:47.178291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d554bda-dd70-466e-9700-dec0e97ea5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:47.195902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0d554bda-dd70-466e-9700-dec0e97ea5e0 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:57:47.197139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0d554bda-dd70-466e-9700-dec0e97ea5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:47.255593 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4238/8490] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:57:47.265463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5d4a6-375d-4552-9ec9-ca00d1987210 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:47.266924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-78e5d4a6-375d-4552-9ec9-ca00d1987210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:47.327288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5d4a6-375d-4552-9ec9-ca00d1987210 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:47.330898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071e092-6f70-4cbf-ba94-d5bd2955d768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:47.332187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071e092-6f70-4cbf-ba94-d5bd2955d768 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:47.332448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071e092-6f70-4cbf-ba94-d5bd2955d768 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:47.332784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071e092-6f70-4cbf-ba94-d5bd2955d768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:47.342378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071e092-6f70-4cbf-ba94-d5bd2955d768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:47.343828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071e092-6f70-4cbf-ba94-d5bd2955d768 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:47.357897 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4253/8491] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:57:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:57:47.763019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d554bda-dd70-466e-9700-dec0e97ea5e0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:47.766438 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0d554bda-dd70-466e-9700-dec0e97ea5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:47.776864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d554bda-dd70-466e-9700-dec0e97ea5e0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:47.781584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0404d-ac6d-49ae-92c9-91372e40483c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:47.782568 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0404d-ac6d-49ae-92c9-91372e40483c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:47.783051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0404d-ac6d-49ae-92c9-91372e40483c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:47.783671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0404d-ac6d-49ae-92c9-91372e40483c admin admin] PATH_INFO: `/v3/projects/bcb9c16cf2754d7daf750dc61ffb7645` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:47.787154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0404d-ac6d-49ae-92c9-91372e40483c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb9c16cf2754d7daf750dc61ffb7645)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:47.789206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0404d-ac6d-49ae-92c9-91372e40483c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:47.892867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53d0404d-ac6d-49ae-92c9-91372e40483c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb9c16cf2754d7daf750dc61ffb7645', 'request_id': 'req-53d0404d-ac6d-49ae-92c9-91372e40483c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:47.899287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53d0404d-ac6d-49ae-92c9-91372e40483c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb9c16cf2754d7daf750dc61ffb7645', 'request_id': 'req-53d0404d-ac6d-49ae-92c9-91372e40483c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:47.944007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53d0404d-ac6d-49ae-92c9-91372e40483c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb9c16cf2754d7daf750dc61ffb7645', 'request_id': 'req-53d0404d-ac6d-49ae-92c9-91372e40483c'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:47.955148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53d0404d-ac6d-49ae-92c9-91372e40483c admin admin] The token cache is being invalidate because project bcb9c16cf2754d7daf750dc61ffb7645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:57:47.955442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53d0404d-ac6d-49ae-92c9-91372e40483c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:47.957045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-53d0404d-ac6d-49ae-92c9-91372e40483c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:47.957708 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4239/8492] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:57:47 2022] DELETE /identity/v3/projects/bcb9c16cf2754d7daf750dc61ffb7645 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:57:47.961735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071e092-6f70-4cbf-ba94-d5bd2955d768 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:47.971229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071e092-6f70-4cbf-ba94-d5bd2955d768 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:48.025865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297246b8-a8f6-423b-a1de-6a2f852b7f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:48.026764 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297246b8-a8f6-423b-a1de-6a2f852b7f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:48.027090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297246b8-a8f6-423b-a1de-6a2f852b7f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:48.027388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297246b8-a8f6-423b-a1de-6a2f852b7f77 admin admin] PATH_INFO: `/v3/users/4238dc5c0b1849b68e728ede58cc5252` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:48.028687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297246b8-a8f6-423b-a1de-6a2f852b7f77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4238dc5c0b1849b68e728ede58cc5252)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:48.030627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297246b8-a8f6-423b-a1de-6a2f852b7f77 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:48.195112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-297246b8-a8f6-423b-a1de-6a2f852b7f77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4238dc5c0b1849b68e728ede58cc5252'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:48.206162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-297246b8-a8f6-423b-a1de-6a2f852b7f77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4238dc5c0b1849b68e728ede58cc5252'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:48.207318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-297246b8-a8f6-423b-a1de-6a2f852b7f77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4238dc5c0b1849b68e728ede58cc5252'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:48.213897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-297246b8-a8f6-423b-a1de-6a2f852b7f77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4238dc5c0b1849b68e728ede58cc5252'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:48.274175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-297246b8-a8f6-423b-a1de-6a2f852b7f77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4238dc5c0b1849b68e728ede58cc5252'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:48.280201 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4254/8493] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:57:47 2022] DELETE /identity/v3/users/4238dc5c0b1849b68e728ede58cc5252 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:57:48.688187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0404d-ac6d-49ae-92c9-91372e40483c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:48.689779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-53d0404d-ac6d-49ae-92c9-91372e40483c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:48.704927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0404d-ac6d-49ae-92c9-91372e40483c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:48.760620 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9399b-30f8-425a-8c5e-67642126eba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:48.761488 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9399b-30f8-425a-8c5e-67642126eba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:48.761770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9399b-30f8-425a-8c5e-67642126eba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:48.762046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9399b-30f8-425a-8c5e-67642126eba9 admin admin] PATH_INFO: `/v3/projects/e4e8a630edf242b6807005362c453a63` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:48.763214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9399b-30f8-425a-8c5e-67642126eba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4e8a630edf242b6807005362c453a63)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:48.765230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9399b-30f8-425a-8c5e-67642126eba9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:48.857708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eaf9399b-30f8-425a-8c5e-67642126eba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4e8a630edf242b6807005362c453a63', 'request_id': 'req-eaf9399b-30f8-425a-8c5e-67642126eba9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:48.863599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eaf9399b-30f8-425a-8c5e-67642126eba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4e8a630edf242b6807005362c453a63', 'request_id': 'req-eaf9399b-30f8-425a-8c5e-67642126eba9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:48.955163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eaf9399b-30f8-425a-8c5e-67642126eba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4e8a630edf242b6807005362c453a63', 'request_id': 'req-eaf9399b-30f8-425a-8c5e-67642126eba9'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:48.965391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eaf9399b-30f8-425a-8c5e-67642126eba9 admin admin] The token cache is being invalidate because project e4e8a630edf242b6807005362c453a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:57:48.965678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eaf9399b-30f8-425a-8c5e-67642126eba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:48.966299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eaf9399b-30f8-425a-8c5e-67642126eba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:48.967832 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4240/8494] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:57:48 2022] DELETE /identity/v3/projects/e4e8a630edf242b6807005362c453a63 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:57:48.972814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69643403-0a2f-44d3-a2ae-79d8db14bb77 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:48.973296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69643403-0a2f-44d3-a2ae-79d8db14bb77 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:48.973419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69643403-0a2f-44d3-a2ae-79d8db14bb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:48.994187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-69643403-0a2f-44d3-a2ae-79d8db14bb77 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:57:48.995471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-69643403-0a2f-44d3-a2ae-79d8db14bb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:49.052344 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4255/8495] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:57:49.060006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe85dc-8fc2-4fe1-b493-816c7988cc26 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:49.060295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe85dc-8fc2-4fe1-b493-816c7988cc26 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:49.060575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe85dc-8fc2-4fe1-b493-816c7988cc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:49.078867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8afe85dc-8fc2-4fe1-b493-816c7988cc26 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:57:49.080061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8afe85dc-8fc2-4fe1-b493-816c7988cc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:49.087924 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4241/8496] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:57:49.092052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69643403-0a2f-44d3-a2ae-79d8db14bb77 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:49.102027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69643403-0a2f-44d3-a2ae-79d8db14bb77 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:49.106884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb5a8d-9dfa-466f-b733-23cfedaa8399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:49.107551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb5a8d-9dfa-466f-b733-23cfedaa8399 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:49.107838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb5a8d-9dfa-466f-b733-23cfedaa8399 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:49.108120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb5a8d-9dfa-466f-b733-23cfedaa8399 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:49.108872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb5a8d-9dfa-466f-b733-23cfedaa8399 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:57:49.109259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb5a8d-9dfa-466f-b733-23cfedaa8399 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:49.110910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb5a8d-9dfa-466f-b733-23cfedaa8399 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:49.123123 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4256/8497] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:57:49.127513 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe85dc-8fc2-4fe1-b493-816c7988cc26 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:49.137674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe85dc-8fc2-4fe1-b493-816c7988cc26 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:49.142671 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94875c-e9f9-4a0f-8310-4548f3a1be80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:49.143329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94875c-e9f9-4a0f-8310-4548f3a1be80 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:49.143853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94875c-e9f9-4a0f-8310-4548f3a1be80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:49.144137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94875c-e9f9-4a0f-8310-4548f3a1be80 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:49.144860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94875c-e9f9-4a0f-8310-4548f3a1be80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:49.146771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94875c-e9f9-4a0f-8310-4548f3a1be80 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:49.225121 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4242/8498] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:57:49 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:57:49.229278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb5a8d-9dfa-466f-b733-23cfedaa8399 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:49.240191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb5a8d-9dfa-466f-b733-23cfedaa8399 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:49.294223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ae266-0425-4656-828e-88663ac35385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:49.295032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ae266-0425-4656-828e-88663ac35385 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:49.295329 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ae266-0425-4656-828e-88663ac35385 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:49.295614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ae266-0425-4656-828e-88663ac35385 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:49.296321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ae266-0425-4656-828e-88663ac35385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:49.298300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ae266-0425-4656-828e-88663ac35385 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:49.378997 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4257/8499] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:57:49 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:57:49.383264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94875c-e9f9-4a0f-8310-4548f3a1be80 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:49.394790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94875c-e9f9-4a0f-8310-4548f3a1be80 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:49.399616 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cf8ff-e856-44b0-9494-3d61dd72e567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:49.400303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cf8ff-e856-44b0-9494-3d61dd72e567 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:49.400589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cf8ff-e856-44b0-9494-3d61dd72e567 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:49.400905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cf8ff-e856-44b0-9494-3d61dd72e567 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:49.401631 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5cf8ff-e856-44b0-9494-3d61dd72e567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:49.403267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5cf8ff-e856-44b0-9494-3d61dd72e567 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:49.415115 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4243/8500] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:57:49.419130 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ae266-0425-4656-828e-88663ac35385 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:49.431745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ae266-0425-4656-828e-88663ac35385 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:49.435989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423757d-57f2-470e-a282-e2e722a89152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:49.436686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423757d-57f2-470e-a282-e2e722a89152 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:49.436981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423757d-57f2-470e-a282-e2e722a89152 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:49.437261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423757d-57f2-470e-a282-e2e722a89152 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:49.437990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423757d-57f2-470e-a282-e2e722a89152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:49.439635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423757d-57f2-470e-a282-e2e722a89152 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:49.449556 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4258/8501] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:57:49.456736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cf8ff-e856-44b0-9494-3d61dd72e567 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:49.463741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cf8ff-e856-44b0-9494-3d61dd72e567 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:49.468575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95a264-bc98-4a70-b480-35db680f6473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:49.469515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95a264-bc98-4a70-b480-35db680f6473 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:49.469803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95a264-bc98-4a70-b480-35db680f6473 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:49.470078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95a264-bc98-4a70-b480-35db680f6473 admin admin] PATH_INFO: `/v3/projects/3c467c5de099441b939ec93e1c773441/users/c3998993aeaa4739ac9e0cb2fa4e28a7/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:49.484910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95a264-bc98-4a70-b480-35db680f6473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c467c5de099441b939ec93e1c773441, user_id=c3998993aeaa4739ac9e0cb2fa4e28a7, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:49.487539 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95a264-bc98-4a70-b480-35db680f6473 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:49.601289 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4244/8502] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:57:49 2022] PUT /identity/v3/projects/3c467c5de099441b939ec93e1c773441/users/c3998993aeaa4739ac9e0cb2fa4e28a7/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:57:49.606721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef41199-101b-4328-922b-ceb4e8137562 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:49.607018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef41199-101b-4328-922b-ceb4e8137562 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:49.607297 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef41199-101b-4328-922b-ceb4e8137562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:49.625774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-eef41199-101b-4328-922b-ceb4e8137562 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:57:49.626977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-eef41199-101b-4328-922b-ceb4e8137562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:49.686038 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4259/8503] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:57:49.695579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95a264-bc98-4a70-b480-35db680f6473 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:49.697477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2e95a264-bc98-4a70-b480-35db680f6473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:49.757536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95a264-bc98-4a70-b480-35db680f6473 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:49.761307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82658d30-d50a-43c1-b235-5650d5f2a53e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:49.761952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82658d30-d50a-43c1-b235-5650d5f2a53e service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:49.762234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82658d30-d50a-43c1-b235-5650d5f2a53e service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:49.762512 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82658d30-d50a-43c1-b235-5650d5f2a53e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:49.772414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82658d30-d50a-43c1-b235-5650d5f2a53e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:49.773866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82658d30-d50a-43c1-b235-5650d5f2a53e service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:49.783286 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4245/8504] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:57:50.812890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef41199-101b-4328-922b-ceb4e8137562 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:50.814277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-eef41199-101b-4328-922b-ceb4e8137562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:50.897241 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef41199-101b-4328-922b-ceb4e8137562 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:50.903239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39569214-a492-4944-9b0b-842049a30a08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:50.903903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39569214-a492-4944-9b0b-842049a30a08 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:50.904309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39569214-a492-4944-9b0b-842049a30a08 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:50.904660 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39569214-a492-4944-9b0b-842049a30a08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:50.906400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-39569214-a492-4944-9b0b-842049a30a08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:50.921223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39569214-a492-4944-9b0b-842049a30a08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:50.922788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39569214-a492-4944-9b0b-842049a30a08 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:50.935542 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4260/8505] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:57:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:57:51.115669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669928e-d32e-42c7-9b19-b43baa418220 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:51.116131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669928e-d32e-42c7-9b19-b43baa418220 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:51.116259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669928e-d32e-42c7-9b19-b43baa418220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:51.143149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d669928e-d32e-42c7-9b19-b43baa418220 None None] MFA Rules not processed for user `c3998993aeaa4739ac9e0cb2fa4e28a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:57:51.144388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d669928e-d32e-42c7-9b19-b43baa418220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:51.212248 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4246/8506] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:57:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:57:51.223595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39569214-a492-4944-9b0b-842049a30a08 service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:51.224990 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-39569214-a492-4944-9b0b-842049a30a08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:51.294259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39569214-a492-4944-9b0b-842049a30a08 service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:51.297825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e7563-dfa4-49ea-83c6-1d4f5462ce2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:51.298471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e7563-dfa4-49ea-83c6-1d4f5462ce2a service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:51.298751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e7563-dfa4-49ea-83c6-1d4f5462ce2a service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:51.299054 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e7563-dfa4-49ea-83c6-1d4f5462ce2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:51.308281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e7563-dfa4-49ea-83c6-1d4f5462ce2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:51.309825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e7563-dfa4-49ea-83c6-1d4f5462ce2a service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:51.319765 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4261/8507] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:57:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:57:53.022193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669928e-d32e-42c7-9b19-b43baa418220 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:53.031893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d669928e-d32e-42c7-9b19-b43baa418220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:53.041178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669928e-d32e-42c7-9b19-b43baa418220 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:53.046234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9cb1e-64e8-4f33-ae87-0fea3ebd53bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:53.046867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9cb1e-64e8-4f33-ae87-0fea3ebd53bc service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:53.047149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9cb1e-64e8-4f33-ae87-0fea3ebd53bc service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:53.047427 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9cb1e-64e8-4f33-ae87-0fea3ebd53bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:53.049122 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-adc9cb1e-64e8-4f33-ae87-0fea3ebd53bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:53.063640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9cb1e-64e8-4f33-ae87-0fea3ebd53bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:53.069167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9cb1e-64e8-4f33-ae87-0fea3ebd53bc service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:53.078304 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4247/8508] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:57:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:57:53.995765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99890545-5b69-40f9-8e20-41ab305aac9b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:54.001477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99890545-5b69-40f9-8e20-41ab305aac9b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:54.001477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99890545-5b69-40f9-8e20-41ab305aac9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:54.014493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-99890545-5b69-40f9-8e20-41ab305aac9b None None] MFA Rules not processed for user `c3998993aeaa4739ac9e0cb2fa4e28a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:57:54.015695 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-99890545-5b69-40f9-8e20-41ab305aac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:54.022934 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4262/8509] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:57:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:57:54.253394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9cb1e-64e8-4f33-ae87-0fea3ebd53bc service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:54.254866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-adc9cb1e-64e8-4f33-ae87-0fea3ebd53bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:54.269066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9cb1e-64e8-4f33-ae87-0fea3ebd53bc service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:54.272674 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc1dff-3e49-48ae-9c7b-35def82c49b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:54.273311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc1dff-3e49-48ae-9c7b-35def82c49b4 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:54.273591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc1dff-3e49-48ae-9c7b-35def82c49b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:54.273868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc1dff-3e49-48ae-9c7b-35def82c49b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:54.275596 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-aedc1dff-3e49-48ae-9c7b-35def82c49b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:54.287149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc1dff-3e49-48ae-9c7b-35def82c49b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:54.289132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc1dff-3e49-48ae-9c7b-35def82c49b4 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:54.299475 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4248/8510] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:57:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:57:54.981250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99890545-5b69-40f9-8e20-41ab305aac9b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:54.982711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-99890545-5b69-40f9-8e20-41ab305aac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:54.999754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99890545-5b69-40f9-8e20-41ab305aac9b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:55.001002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0452b2-15f0-4092-bf08-8369b6aeccb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:55.001948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0452b2-15f0-4092-bf08-8369b6aeccb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:55.002302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0452b2-15f0-4092-bf08-8369b6aeccb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:55.002647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0452b2-15f0-4092-bf08-8369b6aeccb5 admin admin] PATH_INFO: `/v3/users/1cfbc4371862424ab7c6ff88c6fc009d` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:55.003944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0452b2-15f0-4092-bf08-8369b6aeccb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cfbc4371862424ab7c6ff88c6fc009d)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:55.005960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0452b2-15f0-4092-bf08-8369b6aeccb5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:55.180187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f0452b2-15f0-4092-bf08-8369b6aeccb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cfbc4371862424ab7c6ff88c6fc009d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:55.191949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f0452b2-15f0-4092-bf08-8369b6aeccb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cfbc4371862424ab7c6ff88c6fc009d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:55.192691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f0452b2-15f0-4092-bf08-8369b6aeccb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cfbc4371862424ab7c6ff88c6fc009d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:55.200258 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f0452b2-15f0-4092-bf08-8369b6aeccb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cfbc4371862424ab7c6ff88c6fc009d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:55.292358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2f0452b2-15f0-4092-bf08-8369b6aeccb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cfbc4371862424ab7c6ff88c6fc009d'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:55.298548 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4263/8511] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:57:54 2022] DELETE /identity/v3/users/1cfbc4371862424ab7c6ff88c6fc009d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:57:55.303083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12d582-d8c7-4926-8d0f-b73272b1dd04 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:55.303598 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12d582-d8c7-4926-8d0f-b73272b1dd04 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:55.304217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12d582-d8c7-4926-8d0f-b73272b1dd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:55.322344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6a12d582-d8c7-4926-8d0f-b73272b1dd04 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:57:55.323546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6a12d582-d8c7-4926-8d0f-b73272b1dd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:55.378960 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4249/8512] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:57:55.389358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0452b2-15f0-4092-bf08-8369b6aeccb5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:55.390743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2f0452b2-15f0-4092-bf08-8369b6aeccb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:55.448205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0452b2-15f0-4092-bf08-8369b6aeccb5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:55.451828 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64fd9f-0bd1-47ad-89b8-dcc3dc270745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:55.452475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64fd9f-0bd1-47ad-89b8-dcc3dc270745 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:55.452816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64fd9f-0bd1-47ad-89b8-dcc3dc270745 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:55.453103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64fd9f-0bd1-47ad-89b8-dcc3dc270745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:55.462288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64fd9f-0bd1-47ad-89b8-dcc3dc270745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:55.463707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64fd9f-0bd1-47ad-89b8-dcc3dc270745 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:55.473021 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4264/8513] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:57:55.713457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12d582-d8c7-4926-8d0f-b73272b1dd04 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:55.715058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6a12d582-d8c7-4926-8d0f-b73272b1dd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:55.795743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12d582-d8c7-4926-8d0f-b73272b1dd04 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:55.801361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40221e5d-6fa7-4b33-aed3-37604522920f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:55.802017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40221e5d-6fa7-4b33-aed3-37604522920f service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:55.802305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40221e5d-6fa7-4b33-aed3-37604522920f service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:55.802583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40221e5d-6fa7-4b33-aed3-37604522920f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:55.805007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-40221e5d-6fa7-4b33-aed3-37604522920f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:55.818939 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40221e5d-6fa7-4b33-aed3-37604522920f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:55.820628 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40221e5d-6fa7-4b33-aed3-37604522920f service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:55.833151 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4250/8514] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:57:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:57:55.894686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64fd9f-0bd1-47ad-89b8-dcc3dc270745 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:55.896022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-5c64fd9f-0bd1-47ad-89b8-dcc3dc270745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:55.909640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64fd9f-0bd1-47ad-89b8-dcc3dc270745 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:55.914959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcb941-4d1b-4b14-a068-d80a5a83c3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:55.915830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcb941-4d1b-4b14-a068-d80a5a83c3ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:55.916327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcb941-4d1b-4b14-a068-d80a5a83c3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:55.916924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcb941-4d1b-4b14-a068-d80a5a83c3ce admin admin] PATH_INFO: `/v3/projects/a2414cc78d8648ed91a1527ecf826bee` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:55.918156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebcb941-4d1b-4b14-a068-d80a5a83c3ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2414cc78d8648ed91a1527ecf826bee)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:55.920700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebcb941-4d1b-4b14-a068-d80a5a83c3ce admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:56.029547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0ebcb941-4d1b-4b14-a068-d80a5a83c3ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2414cc78d8648ed91a1527ecf826bee', 'request_id': 'req-0ebcb941-4d1b-4b14-a068-d80a5a83c3ce'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:56.087052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0ebcb941-4d1b-4b14-a068-d80a5a83c3ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2414cc78d8648ed91a1527ecf826bee', 'request_id': 'req-0ebcb941-4d1b-4b14-a068-d80a5a83c3ce'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:56.093961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0ebcb941-4d1b-4b14-a068-d80a5a83c3ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2414cc78d8648ed91a1527ecf826bee', 'request_id': 'req-0ebcb941-4d1b-4b14-a068-d80a5a83c3ce'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:56.105700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0ebcb941-4d1b-4b14-a068-d80a5a83c3ce admin admin] The token cache is being invalidate because project a2414cc78d8648ed91a1527ecf826bee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:57:56.105992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0ebcb941-4d1b-4b14-a068-d80a5a83c3ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:56.106769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0ebcb941-4d1b-4b14-a068-d80a5a83c3ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:57:56.108398 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4265/8515] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:57:55 2022] DELETE /identity/v3/projects/a2414cc78d8648ed91a1527ecf826bee => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:57:56.113440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45750772-ff69-4a0b-af14-87f7e150b76b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:56.113810 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45750772-ff69-4a0b-af14-87f7e150b76b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:56.114091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45750772-ff69-4a0b-af14-87f7e150b76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:56.133076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-45750772-ff69-4a0b-af14-87f7e150b76b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:57:56.134301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-45750772-ff69-4a0b-af14-87f7e150b76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:56.191010 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4251/8516] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:57:56.199145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27490e99-b693-4515-9010-6b5b86e24a1e None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:56.199455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27490e99-b693-4515-9010-6b5b86e24a1e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:56.199776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27490e99-b693-4515-9010-6b5b86e24a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:56.219124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-27490e99-b693-4515-9010-6b5b86e24a1e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:57:56.224183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-27490e99-b693-4515-9010-6b5b86e24a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:56.229542 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4266/8517] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:57:56.233814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45750772-ff69-4a0b-af14-87f7e150b76b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:56.243320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45750772-ff69-4a0b-af14-87f7e150b76b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:56.247928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfdc7d-d2e3-46cf-bb50-8336b23df268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:56.248758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfdc7d-d2e3-46cf-bb50-8336b23df268 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:56.249051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfdc7d-d2e3-46cf-bb50-8336b23df268 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:56.249360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfdc7d-d2e3-46cf-bb50-8336b23df268 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:56.250088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfdc7d-d2e3-46cf-bb50-8336b23df268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:57:56.250402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfdc7d-d2e3-46cf-bb50-8336b23df268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:56.252056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfdc7d-d2e3-46cf-bb50-8336b23df268 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:56.263663 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4252/8518] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 10:57:56.270519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27490e99-b693-4515-9010-6b5b86e24a1e None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:56.279262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27490e99-b693-4515-9010-6b5b86e24a1e None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:56.284135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb061d34-5aab-4778-8b47-70e26d6aab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:56.284822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb061d34-5aab-4778-8b47-70e26d6aab31 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:56.285156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb061d34-5aab-4778-8b47-70e26d6aab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:56.285402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb061d34-5aab-4778-8b47-70e26d6aab31 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:56.286113 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb061d34-5aab-4778-8b47-70e26d6aab31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:56.288083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb061d34-5aab-4778-8b47-70e26d6aab31 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:56.361767 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4267/8519] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:57:56 2022] POST /identity/v3/projects => generated 391 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:57:56.365925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfdc7d-d2e3-46cf-bb50-8336b23df268 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:56.375945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfdc7d-d2e3-46cf-bb50-8336b23df268 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:56.433228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbbfee-9117-4a85-8a83-785c4915f67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:56.433930 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbbfee-9117-4a85-8a83-785c4915f67f admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:56.434224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbbfee-9117-4a85-8a83-785c4915f67f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:56.434505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbbfee-9117-4a85-8a83-785c4915f67f admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:56.435208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbbfee-9117-4a85-8a83-785c4915f67f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:56.437175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbbfee-9117-4a85-8a83-785c4915f67f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:56.511250 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4253/8520] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:57:56 2022] POST /identity/v3/users => generated 296 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:57:56.512671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb061d34-5aab-4778-8b47-70e26d6aab31 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:56.523102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb061d34-5aab-4778-8b47-70e26d6aab31 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:56.527761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64141b39-2c35-44d6-b43d-57fd41f2458c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:56.528417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64141b39-2c35-44d6-b43d-57fd41f2458c admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:56.528737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64141b39-2c35-44d6-b43d-57fd41f2458c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:56.529018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64141b39-2c35-44d6-b43d-57fd41f2458c admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:56.529816 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64141b39-2c35-44d6-b43d-57fd41f2458c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:56.531344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64141b39-2c35-44d6-b43d-57fd41f2458c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:56.541936 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4268/8521] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:57:56.545935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbbfee-9117-4a85-8a83-785c4915f67f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:56.556483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbbfee-9117-4a85-8a83-785c4915f67f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:56.561519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c245a9-7378-4a30-bf8c-d0a31c319e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:56.562183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c245a9-7378-4a30-bf8c-d0a31c319e6d admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:56.562471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c245a9-7378-4a30-bf8c-d0a31c319e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:56.562753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c245a9-7378-4a30-bf8c-d0a31c319e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:56.563491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c245a9-7378-4a30-bf8c-d0a31c319e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:56.565160 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c245a9-7378-4a30-bf8c-d0a31c319e6d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:56.575801 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4254/8522] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:57:56.579609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64141b39-2c35-44d6-b43d-57fd41f2458c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:56.589607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64141b39-2c35-44d6-b43d-57fd41f2458c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:56.594389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404f0b1-1a15-4e7b-bd5e-45929b99eadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:56.595272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404f0b1-1a15-4e7b-bd5e-45929b99eadc admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:56.595558 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404f0b1-1a15-4e7b-bd5e-45929b99eadc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:56.595835 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404f0b1-1a15-4e7b-bd5e-45929b99eadc admin admin] PATH_INFO: `/v3/projects/43505981798d4147970c495b8fa9c9e8/users/a3d9515cb8634af582a4caf0de507192/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:56.610739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404f0b1-1a15-4e7b-bd5e-45929b99eadc admin admin] RBAC: Authorizing `identity:create_grant(project_id=43505981798d4147970c495b8fa9c9e8, user_id=a3d9515cb8634af582a4caf0de507192, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:56.613441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404f0b1-1a15-4e7b-bd5e-45929b99eadc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:56.714300 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4269/8523] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:57:56 2022] PUT /identity/v3/projects/43505981798d4147970c495b8fa9c9e8/users/a3d9515cb8634af582a4caf0de507192/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:57:56.726120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6d0d0-07d2-4096-a2b5-c9cbc5f29286 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:56.726495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6d0d0-07d2-4096-a2b5-c9cbc5f29286 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:56.726796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6d0d0-07d2-4096-a2b5-c9cbc5f29286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:56.754270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-21e6d0d0-07d2-4096-a2b5-c9cbc5f29286 None None] MFA Rules not processed for user `a3d9515cb8634af582a4caf0de507192`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:57:56.755473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-21e6d0d0-07d2-4096-a2b5-c9cbc5f29286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:56.818864 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4255/8524] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:57:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:57:56.828050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404f0b1-1a15-4e7b-bd5e-45929b99eadc admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:56.894374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404f0b1-1a15-4e7b-bd5e-45929b99eadc admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:56.899674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23a17e-6abd-4496-9267-97bcafc87213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:56.900340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23a17e-6abd-4496-9267-97bcafc87213 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:56.900651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23a17e-6abd-4496-9267-97bcafc87213 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:56.900938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23a17e-6abd-4496-9267-97bcafc87213 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:56.901631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23a17e-6abd-4496-9267-97bcafc87213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:56.903641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23a17e-6abd-4496-9267-97bcafc87213 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:56.996723 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4270/8525] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:57:56 2022] POST /identity/v3/projects => generated 393 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:57:57.000672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6d0d0-07d2-4096-a2b5-c9cbc5f29286 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:57.011212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6d0d0-07d2-4096-a2b5-c9cbc5f29286 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:57.066556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53ed56-c969-41f1-ac43-daa1e9421e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:57.067237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53ed56-c969-41f1-ac43-daa1e9421e14 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:57.067526 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53ed56-c969-41f1-ac43-daa1e9421e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:57.067808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53ed56-c969-41f1-ac43-daa1e9421e14 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:57.068542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53ed56-c969-41f1-ac43-daa1e9421e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:57.070504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53ed56-c969-41f1-ac43-daa1e9421e14 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:57.155782 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4256/8526] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:57:56 2022] POST /identity/v3/users => generated 303 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:57:57.159827 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23a17e-6abd-4496-9267-97bcafc87213 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:57.170365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23a17e-6abd-4496-9267-97bcafc87213 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:57.175354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795258b-cae0-4ce1-9222-60500e3e3427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:57.179112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795258b-cae0-4ce1-9222-60500e3e3427 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:57.179112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795258b-cae0-4ce1-9222-60500e3e3427 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:57.179112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795258b-cae0-4ce1-9222-60500e3e3427 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:57.179112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795258b-cae0-4ce1-9222-60500e3e3427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:57.179112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795258b-cae0-4ce1-9222-60500e3e3427 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:57.189845 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4271/8527] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:57:57.194201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53ed56-c969-41f1-ac43-daa1e9421e14 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:57.204614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53ed56-c969-41f1-ac43-daa1e9421e14 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:57.211262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82aeac-d0b5-4958-8654-04a963771f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:57.211262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82aeac-d0b5-4958-8654-04a963771f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:57.211262 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82aeac-d0b5-4958-8654-04a963771f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:57.211624 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82aeac-d0b5-4958-8654-04a963771f02 admin admin] PATH_INFO: `/v3/projects/0db0df81ebed46f9a0522d116377565c/users/c2e3912c146b4cba897bd6cd36b9050a/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:57.225295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82aeac-d0b5-4958-8654-04a963771f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0db0df81ebed46f9a0522d116377565c, user_id=c2e3912c146b4cba897bd6cd36b9050a, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:57.228007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82aeac-d0b5-4958-8654-04a963771f02 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:57.304136 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4257/8528] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:57:57 2022] PUT /identity/v3/projects/0db0df81ebed46f9a0522d116377565c/users/c2e3912c146b4cba897bd6cd36b9050a/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:57:57.307972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795258b-cae0-4ce1-9222-60500e3e3427 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:57.318205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795258b-cae0-4ce1-9222-60500e3e3427 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:57.372630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1eb5a7-ff79-46b5-bbf8-96c07e9bf3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:57.373306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1eb5a7-ff79-46b5-bbf8-96c07e9bf3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:57.373594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1eb5a7-ff79-46b5-bbf8-96c07e9bf3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:57.373875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1eb5a7-ff79-46b5-bbf8-96c07e9bf3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:57.374593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1eb5a7-ff79-46b5-bbf8-96c07e9bf3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:57.376179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1eb5a7-ff79-46b5-bbf8-96c07e9bf3e3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:57.386460 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4272/8529] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:57:57.393951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82aeac-d0b5-4958-8654-04a963771f02 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:57.401657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82aeac-d0b5-4958-8654-04a963771f02 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:57.406464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c58071-9fb6-4bbf-b6fa-1542b7865f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:57.407350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c58071-9fb6-4bbf-b6fa-1542b7865f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:57.407658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c58071-9fb6-4bbf-b6fa-1542b7865f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:57.407964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c58071-9fb6-4bbf-b6fa-1542b7865f5b admin admin] PATH_INFO: `/v3/projects/0db0df81ebed46f9a0522d116377565c/users/c2e3912c146b4cba897bd6cd36b9050a/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:57.410034 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c58071-9fb6-4bbf-b6fa-1542b7865f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0db0df81ebed46f9a0522d116377565c, user_id=c2e3912c146b4cba897bd6cd36b9050a, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:57.412745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c58071-9fb6-4bbf-b6fa-1542b7865f5b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:57.422789 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4258/8530] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:57:57 2022] PUT /identity/v3/projects/0db0df81ebed46f9a0522d116377565c/users/c2e3912c146b4cba897bd6cd36b9050a/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:57:57.433173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3480a6f-381f-4bd6-a5a4-7add821fbb5d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:57.433485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3480a6f-381f-4bd6-a5a4-7add821fbb5d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:57.433824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3480a6f-381f-4bd6-a5a4-7add821fbb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:57.461346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a3480a6f-381f-4bd6-a5a4-7add821fbb5d None None] MFA Rules not processed for user `c2e3912c146b4cba897bd6cd36b9050a`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:57:57.462629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a3480a6f-381f-4bd6-a5a4-7add821fbb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:57.531149 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4273/8531] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:57:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:57:57.544361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c58071-9fb6-4bbf-b6fa-1542b7865f5b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:57.546399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-33c58071-9fb6-4bbf-b6fa-1542b7865f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:57.625010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c58071-9fb6-4bbf-b6fa-1542b7865f5b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:57.630800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d2ead-32cf-470e-b63a-ce80d11d8cf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:57.631452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d2ead-32cf-470e-b63a-ce80d11d8cf4 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:57.631814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d2ead-32cf-470e-b63a-ce80d11d8cf4 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:57.632630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d2ead-32cf-470e-b63a-ce80d11d8cf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:57.686115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d2ead-32cf-470e-b63a-ce80d11d8cf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:57.687715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d2ead-32cf-470e-b63a-ce80d11d8cf4 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:57.697683 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4259/8532] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:57:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:57:58.732173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3480a6f-381f-4bd6-a5a4-7add821fbb5d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:58.733638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a3480a6f-381f-4bd6-a5a4-7add821fbb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:58.794565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3480a6f-381f-4bd6-a5a4-7add821fbb5d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:58.798240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1b197-3fca-4be8-b0ef-130e3c9614ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:58.798886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1b197-3fca-4be8-b0ef-130e3c9614ac service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:58.799170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1b197-3fca-4be8-b0ef-130e3c9614ac service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:58.799506 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1b197-3fca-4be8-b0ef-130e3c9614ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:58.801281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-81c1b197-3fca-4be8-b0ef-130e3c9614ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:58.815860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1b197-3fca-4be8-b0ef-130e3c9614ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:58.817383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1b197-3fca-4be8-b0ef-130e3c9614ac service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:58.830443 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4274/8533] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:57:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:57:59.566987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d2ead-32cf-470e-b63a-ce80d11d8cf4 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:57:59.568506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8a1d2ead-32cf-470e-b63a-ce80d11d8cf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:59.585893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d2ead-32cf-470e-b63a-ce80d11d8cf4 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:57:59.591738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e30f3-edaa-4e9d-890e-752e49286609 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:57:59.592416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e30f3-edaa-4e9d-890e-752e49286609 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:57:59.592714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e30f3-edaa-4e9d-890e-752e49286609 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:57:59.592992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e30f3-edaa-4e9d-890e-752e49286609 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:57:59.594768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-bd1e30f3-edaa-4e9d-890e-752e49286609 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:57:59.610441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e30f3-edaa-4e9d-890e-752e49286609 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:57:59.612023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e30f3-edaa-4e9d-890e-752e49286609 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:57:59.625447 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4260/8534] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:57:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:58:03.413765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1b197-3fca-4be8-b0ef-130e3c9614ac service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:03.424914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1b197-3fca-4be8-b0ef-130e3c9614ac service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:03.428583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67211430-fa93-44d1-ab51-33322c5f1fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:03.429280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67211430-fa93-44d1-ab51-33322c5f1fdb service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:03.429563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67211430-fa93-44d1-ab51-33322c5f1fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:03.429837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67211430-fa93-44d1-ab51-33322c5f1fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:03.439055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67211430-fa93-44d1-ab51-33322c5f1fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:03.440530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67211430-fa93-44d1-ab51-33322c5f1fdb service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:03.451273 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4275/8535] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:58:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:58:03.792726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e30f3-edaa-4e9d-890e-752e49286609 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:03.809221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e30f3-edaa-4e9d-890e-752e49286609 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:03.815742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27defc-ecfa-47b0-af97-2db4e9e5bc56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:03.816619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27defc-ecfa-47b0-af97-2db4e9e5bc56 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:03.816988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27defc-ecfa-47b0-af97-2db4e9e5bc56 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:03.817350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27defc-ecfa-47b0-af97-2db4e9e5bc56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:03.820021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3d27defc-ecfa-47b0-af97-2db4e9e5bc56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:58:03.842053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27defc-ecfa-47b0-af97-2db4e9e5bc56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:03.843887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27defc-ecfa-47b0-af97-2db4e9e5bc56 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:03.858839 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4261/8536] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:58:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:58:07.198052 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc808225-d27d-491a-b622-7a02b072b559 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:07.198487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc808225-d27d-491a-b622-7a02b072b559 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:07.198487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc808225-d27d-491a-b622-7a02b072b559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:07.220311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-bc808225-d27d-491a-b622-7a02b072b559 None None] MFA Rules not processed for user `a3d9515cb8634af582a4caf0de507192`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:58:07.222002 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bc808225-d27d-491a-b622-7a02b072b559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:58:07.231083 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4276/8537] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:58:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:58:11.434465 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891ada9-24ba-4140-af66-4173075fba4f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:11.435018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891ada9-24ba-4140-af66-4173075fba4f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:11.435018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891ada9-24ba-4140-af66-4173075fba4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:11.454323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-3891ada9-24ba-4140-af66-4173075fba4f None None] MFA Rules not processed for user `c3998993aeaa4739ac9e0cb2fa4e28a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:58:11.456785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3891ada9-24ba-4140-af66-4173075fba4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:58:11.514193 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4262/8538] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:58:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:58:24.871635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc808225-d27d-491a-b622-7a02b072b559 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:24.890262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc808225-d27d-491a-b622-7a02b072b559 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:24.896891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a43a80-3ebf-427d-a2d0-a5c7ffff1c2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:24.898153 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a43a80-3ebf-427d-a2d0-a5c7ffff1c2b service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:24.898443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a43a80-3ebf-427d-a2d0-a5c7ffff1c2b service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:24.898726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a43a80-3ebf-427d-a2d0-a5c7ffff1c2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:24.900568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b8a43a80-3ebf-427d-a2d0-a5c7ffff1c2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:58:24.920920 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a43a80-3ebf-427d-a2d0-a5c7ffff1c2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:24.922621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a43a80-3ebf-427d-a2d0-a5c7ffff1c2b service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:24.951915 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4277/8539] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:58:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:58:30.273766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b717bd8-0876-4aeb-a43c-4d7db97475a5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:30.274237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b717bd8-0876-4aeb-a43c-4d7db97475a5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:30.274370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b717bd8-0876-4aeb-a43c-4d7db97475a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:30.323204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5b717bd8-0876-4aeb-a43c-4d7db97475a5 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:58:30.324472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5b717bd8-0876-4aeb-a43c-4d7db97475a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:58:30.386337 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4263/8540] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:58:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:58:30.541892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a43a80-3ebf-427d-a2d0-a5c7ffff1c2b service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:30.543298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b8a43a80-3ebf-427d-a2d0-a5c7ffff1c2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:58:30.635257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a43a80-3ebf-427d-a2d0-a5c7ffff1c2b service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:30.640946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6f91a-2205-484c-92a1-94358529a4cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:30.641637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6f91a-2205-484c-92a1-94358529a4cf service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:30.641928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6f91a-2205-484c-92a1-94358529a4cf service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:30.642229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6f91a-2205-484c-92a1-94358529a4cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:30.653073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6f91a-2205-484c-92a1-94358529a4cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:30.654669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6f91a-2205-484c-92a1-94358529a4cf service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:30.663352 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4278/8541] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:58:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 10:58:47.165244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e6414-a254-4301-9a38-60942d1f18e7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:47.165244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e6414-a254-4301-9a38-60942d1f18e7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:47.165244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e6414-a254-4301-9a38-60942d1f18e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:47.184178 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-934e6414-a254-4301-9a38-60942d1f18e7 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:58:47.185413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-934e6414-a254-4301-9a38-60942d1f18e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:58:47.192871 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4264/8542] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 10:58:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:58:47.205906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6f91a-2205-484c-92a1-94358529a4cf service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:47.219101 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6f91a-2205-484c-92a1-94358529a4cf service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:47.224214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca154e5-32bf-46f8-a747-858689cb25d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:47.224887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca154e5-32bf-46f8-a747-858689cb25d5 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:47.225173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca154e5-32bf-46f8-a747-858689cb25d5 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:47.225446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca154e5-32bf-46f8-a747-858689cb25d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:47.233691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca154e5-32bf-46f8-a747-858689cb25d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:47.235261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca154e5-32bf-46f8-a747-858689cb25d5 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:47.243140 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4279/8543] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 10:58:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 02 10:58:53.291789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e6414-a254-4301-9a38-60942d1f18e7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:53.293517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-934e6414-a254-4301-9a38-60942d1f18e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:58:53.358145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e6414-a254-4301-9a38-60942d1f18e7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:53.362720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ecf65-13c6-43bb-bd58-3f0739266bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:53.363585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ecf65-13c6-43bb-bd58-3f0739266bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:53.363870 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ecf65-13c6-43bb-bd58-3f0739266bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:53.364146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ecf65-13c6-43bb-bd58-3f0739266bc2 admin admin] PATH_INFO: `/v3/users/c3998993aeaa4739ac9e0cb2fa4e28a7` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:53.365390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ecf65-13c6-43bb-bd58-3f0739266bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3998993aeaa4739ac9e0cb2fa4e28a7)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:53.367337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ecf65-13c6-43bb-bd58-3f0739266bc2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:53.573654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cb8ecf65-13c6-43bb-bd58-3f0739266bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3998993aeaa4739ac9e0cb2fa4e28a7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:58:53.585009 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cb8ecf65-13c6-43bb-bd58-3f0739266bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3998993aeaa4739ac9e0cb2fa4e28a7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:58:53.585696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cb8ecf65-13c6-43bb-bd58-3f0739266bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3998993aeaa4739ac9e0cb2fa4e28a7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:58:53.592261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cb8ecf65-13c6-43bb-bd58-3f0739266bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3998993aeaa4739ac9e0cb2fa4e28a7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:58:53.680408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-cb8ecf65-13c6-43bb-bd58-3f0739266bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3998993aeaa4739ac9e0cb2fa4e28a7'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:58:53.686444 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4265/8544] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:58:53 2022] DELETE /identity/v3/users/c3998993aeaa4739ac9e0cb2fa4e28a7 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:58:53.933615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca154e5-32bf-46f8-a747-858689cb25d5 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:53.944270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca154e5-32bf-46f8-a747-858689cb25d5 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:54.000855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed89c40-0636-42d3-8087-ae7eec484b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:54.001717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed89c40-0636-42d3-8087-ae7eec484b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:54.001997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed89c40-0636-42d3-8087-ae7eec484b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:54.002271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed89c40-0636-42d3-8087-ae7eec484b40 admin admin] PATH_INFO: `/v3/projects/3c467c5de099441b939ec93e1c773441` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:54.003452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed89c40-0636-42d3-8087-ae7eec484b40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c467c5de099441b939ec93e1c773441)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:54.005440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed89c40-0636-42d3-8087-ae7eec484b40 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:54.103711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6ed89c40-0636-42d3-8087-ae7eec484b40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c467c5de099441b939ec93e1c773441', 'request_id': 'req-6ed89c40-0636-42d3-8087-ae7eec484b40'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:58:54.175975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6ed89c40-0636-42d3-8087-ae7eec484b40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c467c5de099441b939ec93e1c773441', 'request_id': 'req-6ed89c40-0636-42d3-8087-ae7eec484b40'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:58:54.182334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6ed89c40-0636-42d3-8087-ae7eec484b40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c467c5de099441b939ec93e1c773441', 'request_id': 'req-6ed89c40-0636-42d3-8087-ae7eec484b40'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:58:54.192568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6ed89c40-0636-42d3-8087-ae7eec484b40 admin admin] The token cache is being invalidate because project 3c467c5de099441b939ec93e1c773441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:58:54.192889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6ed89c40-0636-42d3-8087-ae7eec484b40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:58:54.193529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-6ed89c40-0636-42d3-8087-ae7eec484b40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:58:54.195087 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4280/8545] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:58:53 2022] DELETE /identity/v3/projects/3c467c5de099441b939ec93e1c773441 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:58:54.200649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec73497-7d7a-48d6-b5ab-13cc39e33a76 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:54.203672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec73497-7d7a-48d6-b5ab-13cc39e33a76 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:54.203672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec73497-7d7a-48d6-b5ab-13cc39e33a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:54.219903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-aec73497-7d7a-48d6-b5ab-13cc39e33a76 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:58:54.221143 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-aec73497-7d7a-48d6-b5ab-13cc39e33a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:58:54.278032 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4266/8546] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:58:54.286211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe53ce-e318-4f61-865f-63e53904f801 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:54.286500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe53ce-e318-4f61-865f-63e53904f801 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:54.286781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe53ce-e318-4f61-865f-63e53904f801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:54.304882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-cdfe53ce-e318-4f61-865f-63e53904f801 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:58:54.306111 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-cdfe53ce-e318-4f61-865f-63e53904f801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:58:54.314029 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4281/8547] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:58:54.318263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec73497-7d7a-48d6-b5ab-13cc39e33a76 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:54.328616 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec73497-7d7a-48d6-b5ab-13cc39e33a76 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:54.333172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbd5ef-fee5-467b-af56-7dca951cebcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:54.333971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbd5ef-fee5-467b-af56-7dca951cebcd admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:54.334260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbd5ef-fee5-467b-af56-7dca951cebcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:54.334545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbd5ef-fee5-467b-af56-7dca951cebcd admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:54.335274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbd5ef-fee5-467b-af56-7dca951cebcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:58:54.335585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbd5ef-fee5-467b-af56-7dca951cebcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:54.337863 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbd5ef-fee5-467b-af56-7dca951cebcd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:54.349016 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4267/8548] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:58:54.353358 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe53ce-e318-4f61-865f-63e53904f801 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:54.363259 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe53ce-e318-4f61-865f-63e53904f801 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:54.367927 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69044da2-c32c-482d-9144-3ed28515b703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:54.368587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69044da2-c32c-482d-9144-3ed28515b703 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:54.368898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69044da2-c32c-482d-9144-3ed28515b703 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:54.369178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69044da2-c32c-482d-9144-3ed28515b703 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:54.370299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69044da2-c32c-482d-9144-3ed28515b703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:54.372419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69044da2-c32c-482d-9144-3ed28515b703 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:54.447937 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4282/8549] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:58:54 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:58:54.452222 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbd5ef-fee5-467b-af56-7dca951cebcd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:54.462136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbd5ef-fee5-467b-af56-7dca951cebcd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:54.517031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1f545-c232-4a57-af1c-535520ae70c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:54.517699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1f545-c232-4a57-af1c-535520ae70c0 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:54.517988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1f545-c232-4a57-af1c-535520ae70c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:54.518527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1f545-c232-4a57-af1c-535520ae70c0 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:54.519258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1f545-c232-4a57-af1c-535520ae70c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:54.521212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1f545-c232-4a57-af1c-535520ae70c0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:54.600530 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4268/8550] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:58:54 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:58:54.604625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69044da2-c32c-482d-9144-3ed28515b703 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:54.614899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69044da2-c32c-482d-9144-3ed28515b703 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:54.620090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ad688-6b5f-4d59-814b-27ca167f8bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:54.620782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ad688-6b5f-4d59-814b-27ca167f8bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:54.621071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ad688-6b5f-4d59-814b-27ca167f8bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:54.621353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ad688-6b5f-4d59-814b-27ca167f8bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:54.622076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ad688-6b5f-4d59-814b-27ca167f8bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:54.623708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ad688-6b5f-4d59-814b-27ca167f8bc4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:54.635043 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4283/8551] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:58:54.638991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1f545-c232-4a57-af1c-535520ae70c0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:54.649079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1f545-c232-4a57-af1c-535520ae70c0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:54.653680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586a3d0-d5af-42a5-aa69-eac4b33e9e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:54.654310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586a3d0-d5af-42a5-aa69-eac4b33e9e85 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:54.654594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586a3d0-d5af-42a5-aa69-eac4b33e9e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:54.654897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586a3d0-d5af-42a5-aa69-eac4b33e9e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:54.655610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586a3d0-d5af-42a5-aa69-eac4b33e9e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:54.657272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586a3d0-d5af-42a5-aa69-eac4b33e9e85 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:54.667268 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4269/8552] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:58:54.671133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ad688-6b5f-4d59-814b-27ca167f8bc4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:54.681420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ad688-6b5f-4d59-814b-27ca167f8bc4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:54.685996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e55fe-8770-4813-8ab3-ef5057b56d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:54.686875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e55fe-8770-4813-8ab3-ef5057b56d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:54.687158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e55fe-8770-4813-8ab3-ef5057b56d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:54.687438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e55fe-8770-4813-8ab3-ef5057b56d76 admin admin] PATH_INFO: `/v3/projects/6d90116e3c8642569ffe7971b0d6a147/users/f4e226be66bf484683442e48b054f517/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:54.702014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e55fe-8770-4813-8ab3-ef5057b56d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d90116e3c8642569ffe7971b0d6a147, user_id=f4e226be66bf484683442e48b054f517, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:54.704674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e55fe-8770-4813-8ab3-ef5057b56d76 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:54.795281 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4284/8553] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:58:54 2022] PUT /identity/v3/projects/6d90116e3c8642569ffe7971b0d6a147/users/f4e226be66bf484683442e48b054f517/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:58:54.811829 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d25191-d537-49c8-8e60-0b6122a3ec52 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:54.812119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d25191-d537-49c8-8e60-0b6122a3ec52 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:54.812405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d25191-d537-49c8-8e60-0b6122a3ec52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:54.838040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-00d25191-d537-49c8-8e60-0b6122a3ec52 None None] MFA Rules not processed for user `f4e226be66bf484683442e48b054f517`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:58:54.839255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-00d25191-d537-49c8-8e60-0b6122a3ec52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:58:54.901055 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4270/8554] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:58:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:58:54.912306 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e55fe-8770-4813-8ab3-ef5057b56d76 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:54.914030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-588e55fe-8770-4813-8ab3-ef5057b56d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:58:54.973651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e55fe-8770-4813-8ab3-ef5057b56d76 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:54.977357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ad8f3-e9e2-4f89-b1e0-1af0aec9d84d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eab371b02c34a13b629eacdf504dbdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:54.978502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ad8f3-e9e2-4f89-b1e0-1af0aec9d84d service cinder] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:54.978786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ad8f3-e9e2-4f89-b1e0-1af0aec9d84d service cinder] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:54.979064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ad8f3-e9e2-4f89-b1e0-1af0aec9d84d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:54.987212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ad8f3-e9e2-4f89-b1e0-1af0aec9d84d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:54.988674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ad8f3-e9e2-4f89-b1e0-1af0aec9d84d service cinder] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:54.998252 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4285/8555] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:58:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:58:55.023784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d25191-d537-49c8-8e60-0b6122a3ec52 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:55.085841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d25191-d537-49c8-8e60-0b6122a3ec52 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:55.091974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c3e32-3301-4879-97ba-922d15aa1a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:55.092877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c3e32-3301-4879-97ba-922d15aa1a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:55.093167 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c3e32-3301-4879-97ba-922d15aa1a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:55.093446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c3e32-3301-4879-97ba-922d15aa1a93 admin admin] PATH_INFO: `/v3/users/f4e226be66bf484683442e48b054f517` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:55.094677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c3e32-3301-4879-97ba-922d15aa1a93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4e226be66bf484683442e48b054f517)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:55.096643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c3e32-3301-4879-97ba-922d15aa1a93 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:55.292426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b14c3e32-3301-4879-97ba-922d15aa1a93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4e226be66bf484683442e48b054f517'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:58:55.303371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b14c3e32-3301-4879-97ba-922d15aa1a93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4e226be66bf484683442e48b054f517'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:58:55.304045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b14c3e32-3301-4879-97ba-922d15aa1a93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4e226be66bf484683442e48b054f517'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:58:55.310593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b14c3e32-3301-4879-97ba-922d15aa1a93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4e226be66bf484683442e48b054f517'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:58:55.376142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b14c3e32-3301-4879-97ba-922d15aa1a93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4e226be66bf484683442e48b054f517'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:58:55.382221 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4271/8556] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:58:55 2022] DELETE /identity/v3/users/f4e226be66bf484683442e48b054f517 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:58:55.391707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba21a88-0222-464f-af92-dac098765fe3 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:55.391707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba21a88-0222-464f-af92-dac098765fe3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:55.391707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba21a88-0222-464f-af92-dac098765fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:55.405492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8ba21a88-0222-464f-af92-dac098765fe3 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:58:55.406684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8ba21a88-0222-464f-af92-dac098765fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:58:55.463517 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4286/8557] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:58:55.473220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c3e32-3301-4879-97ba-922d15aa1a93 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:55.474646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b14c3e32-3301-4879-97ba-922d15aa1a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:58:55.536412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c3e32-3301-4879-97ba-922d15aa1a93 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:55.540201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ffc16-efe7-4757-b665-9e09a186c88c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:55.540903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ffc16-efe7-4757-b665-9e09a186c88c service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:55.541191 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ffc16-efe7-4757-b665-9e09a186c88c service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:55.541469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ffc16-efe7-4757-b665-9e09a186c88c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:55.550873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ffc16-efe7-4757-b665-9e09a186c88c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:55.552247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ffc16-efe7-4757-b665-9e09a186c88c service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:55.563182 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4272/8558] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:58:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:58:55.956690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba21a88-0222-464f-af92-dac098765fe3 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:55.958188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8ba21a88-0222-464f-af92-dac098765fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:58:55.972339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba21a88-0222-464f-af92-dac098765fe3 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:55.978565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5917b6d-8447-4624-a9b8-0df74f740cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:55.981098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5917b6d-8447-4624-a9b8-0df74f740cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:55.981098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5917b6d-8447-4624-a9b8-0df74f740cad admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:55.981098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5917b6d-8447-4624-a9b8-0df74f740cad admin admin] PATH_INFO: `/v3/projects/6d90116e3c8642569ffe7971b0d6a147` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:55.981903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5917b6d-8447-4624-a9b8-0df74f740cad admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d90116e3c8642569ffe7971b0d6a147)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:55.983115 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5917b6d-8447-4624-a9b8-0df74f740cad admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:56.115434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f5917b6d-8447-4624-a9b8-0df74f740cad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d90116e3c8642569ffe7971b0d6a147', 'request_id': 'req-f5917b6d-8447-4624-a9b8-0df74f740cad'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:58:56.188899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f5917b6d-8447-4624-a9b8-0df74f740cad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d90116e3c8642569ffe7971b0d6a147', 'request_id': 'req-f5917b6d-8447-4624-a9b8-0df74f740cad'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:58:56.195231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f5917b6d-8447-4624-a9b8-0df74f740cad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d90116e3c8642569ffe7971b0d6a147', 'request_id': 'req-f5917b6d-8447-4624-a9b8-0df74f740cad'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:58:56.205851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f5917b6d-8447-4624-a9b8-0df74f740cad admin admin] The token cache is being invalidate because project 6d90116e3c8642569ffe7971b0d6a147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:58:56.210340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f5917b6d-8447-4624-a9b8-0df74f740cad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:58:56.210340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f5917b6d-8447-4624-a9b8-0df74f740cad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:58:56.210340 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4287/8559] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:58:55 2022] DELETE /identity/v3/projects/6d90116e3c8642569ffe7971b0d6a147 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:58:56.213562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2bcd8-21cb-4b42-a182-ca58aa9056cd None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:56.213857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2bcd8-21cb-4b42-a182-ca58aa9056cd None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:56.214139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2bcd8-21cb-4b42-a182-ca58aa9056cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:56.231389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-84a2bcd8-21cb-4b42-a182-ca58aa9056cd None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:58:56.232594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-84a2bcd8-21cb-4b42-a182-ca58aa9056cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:58:56.289386 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4273/8560] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:58:56.297571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb05107-d2d7-4858-94e5-b8509fc8d86d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:56.297865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb05107-d2d7-4858-94e5-b8509fc8d86d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:56.298174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb05107-d2d7-4858-94e5-b8509fc8d86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:56.316555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4cb05107-d2d7-4858-94e5-b8509fc8d86d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:58:56.317769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4cb05107-d2d7-4858-94e5-b8509fc8d86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:58:56.325735 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4288/8561] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:58:56.329763 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2bcd8-21cb-4b42-a182-ca58aa9056cd None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:56.339333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2bcd8-21cb-4b42-a182-ca58aa9056cd None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:56.343839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c2ca9-fa6f-4ada-9f61-290d5d105cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:56.344487 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c2ca9-fa6f-4ada-9f61-290d5d105cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:56.344873 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c2ca9-fa6f-4ada-9f61-290d5d105cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:56.345157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c2ca9-fa6f-4ada-9f61-290d5d105cd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:56.345884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c2ca9-fa6f-4ada-9f61-290d5d105cd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:58:56.346195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c2ca9-fa6f-4ada-9f61-290d5d105cd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:56.347795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c2ca9-fa6f-4ada-9f61-290d5d105cd9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:56.359409 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4274/8562] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:58:56.363419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb05107-d2d7-4858-94e5-b8509fc8d86d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:56.373313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb05107-d2d7-4858-94e5-b8509fc8d86d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:56.378026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb227ebf-037a-4e82-a5a3-35448d25b16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:56.378675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb227ebf-037a-4e82-a5a3-35448d25b16a admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:56.378959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb227ebf-037a-4e82-a5a3-35448d25b16a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:56.379239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb227ebf-037a-4e82-a5a3-35448d25b16a admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:56.379934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb227ebf-037a-4e82-a5a3-35448d25b16a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:56.381881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb227ebf-037a-4e82-a5a3-35448d25b16a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:56.486162 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4289/8563] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:58:56 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:58:56.490384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c2ca9-fa6f-4ada-9f61-290d5d105cd9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:56.500893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c2ca9-fa6f-4ada-9f61-290d5d105cd9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:56.557308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dc398-55ca-474e-9cef-508776ad68ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:56.557978 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dc398-55ca-474e-9cef-508776ad68ac admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:56.558265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dc398-55ca-474e-9cef-508776ad68ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:56.558547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dc398-55ca-474e-9cef-508776ad68ac admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:56.559227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375dc398-55ca-474e-9cef-508776ad68ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:56.561175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375dc398-55ca-474e-9cef-508776ad68ac admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:56.645178 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4275/8564] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:58:56 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:58:56.649753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb227ebf-037a-4e82-a5a3-35448d25b16a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:56.659896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb227ebf-037a-4e82-a5a3-35448d25b16a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:56.664470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a9079-9628-40b5-84fa-31656cafbb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:56.665803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a9079-9628-40b5-84fa-31656cafbb5a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:56.666082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a9079-9628-40b5-84fa-31656cafbb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:56.666389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a9079-9628-40b5-84fa-31656cafbb5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:56.667108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a9079-9628-40b5-84fa-31656cafbb5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:56.668729 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a9079-9628-40b5-84fa-31656cafbb5a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:56.678739 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4290/8565] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:58:56.682583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dc398-55ca-474e-9cef-508776ad68ac admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:56.692292 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dc398-55ca-474e-9cef-508776ad68ac admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:56.696807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151448d-c13e-47ec-af7a-e5acc1925296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:56.697452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151448d-c13e-47ec-af7a-e5acc1925296 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:56.697737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151448d-c13e-47ec-af7a-e5acc1925296 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:56.698011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151448d-c13e-47ec-af7a-e5acc1925296 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:56.698726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151448d-c13e-47ec-af7a-e5acc1925296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:56.700307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151448d-c13e-47ec-af7a-e5acc1925296 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:56.710211 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4276/8566] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:58:56.714479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a9079-9628-40b5-84fa-31656cafbb5a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:56.724169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a9079-9628-40b5-84fa-31656cafbb5a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:56.729636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84934731-b638-4ef1-9620-9ba40c9d24ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:56.730512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84934731-b638-4ef1-9620-9ba40c9d24ba admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:56.730798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84934731-b638-4ef1-9620-9ba40c9d24ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:56.731078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84934731-b638-4ef1-9620-9ba40c9d24ba admin admin] PATH_INFO: `/v3/projects/e92d9933ffea46e98cc6d26a56bda751/users/0b837c11739740838d2fc4ee1d826bf9/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:56.744801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84934731-b638-4ef1-9620-9ba40c9d24ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e92d9933ffea46e98cc6d26a56bda751, user_id=0b837c11739740838d2fc4ee1d826bf9, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:56.747440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84934731-b638-4ef1-9620-9ba40c9d24ba admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:56.852070 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4291/8567] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:58:56 2022] PUT /identity/v3/projects/e92d9933ffea46e98cc6d26a56bda751/users/0b837c11739740838d2fc4ee1d826bf9/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:58:56.857965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478b969-b82a-47c2-840e-c7bf7bac0a70 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:56.858303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478b969-b82a-47c2-840e-c7bf7bac0a70 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:56.858606 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478b969-b82a-47c2-840e-c7bf7bac0a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:56.876565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6478b969-b82a-47c2-840e-c7bf7bac0a70 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:58:56.877892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6478b969-b82a-47c2-840e-c7bf7bac0a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:58:56.934314 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4277/8568] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:58:56.944004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84934731-b638-4ef1-9620-9ba40c9d24ba admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:56.945749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-84934731-b638-4ef1-9620-9ba40c9d24ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:58:57.004742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84934731-b638-4ef1-9620-9ba40c9d24ba admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:57.008430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf7151-3d8e-4856-8ff0-44d9d5ba2de2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:57.009631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf7151-3d8e-4856-8ff0-44d9d5ba2de2 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:57.009917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf7151-3d8e-4856-8ff0-44d9d5ba2de2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:57.010195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf7151-3d8e-4856-8ff0-44d9d5ba2de2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:57.019815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf7151-3d8e-4856-8ff0-44d9d5ba2de2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:57.021285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf7151-3d8e-4856-8ff0-44d9d5ba2de2 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:57.031285 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4292/8569] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:58:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:58:58.169187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7ed08-06b5-4893-a2f5-ae6938c47137 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:58.169710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7ed08-06b5-4893-a2f5-ae6938c47137 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:58.169821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7ed08-06b5-4893-a2f5-ae6938c47137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:58.195992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f0f7ed08-06b5-4893-a2f5-ae6938c47137 None None] MFA Rules not processed for user `0b837c11739740838d2fc4ee1d826bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:58:58.197232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f0f7ed08-06b5-4893-a2f5-ae6938c47137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:58:58.260533 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4278/8570] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:58:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:58:58.265334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf7151-3d8e-4856-8ff0-44d9d5ba2de2 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:58.275935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf7151-3d8e-4856-8ff0-44d9d5ba2de2 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:58.281084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5d9d3-4f58-4ffa-9148-a18e356b08e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:58.281758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5d9d3-4f58-4ffa-9148-a18e356b08e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:58.282048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5d9d3-4f58-4ffa-9148-a18e356b08e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:58.282360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5d9d3-4f58-4ffa-9148-a18e356b08e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:58.283067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5d9d3-4f58-4ffa-9148-a18e356b08e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:58.285099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5d9d3-4f58-4ffa-9148-a18e356b08e5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:58.361449 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4293/8571] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:58:58 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:58:58.365565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7ed08-06b5-4893-a2f5-ae6938c47137 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:58.376189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7ed08-06b5-4893-a2f5-ae6938c47137 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:58.431294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e5f78-90e7-42c8-bbee-21018e5cf5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:58.431892 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e5f78-90e7-42c8-bbee-21018e5cf5ae admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:58.432177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e5f78-90e7-42c8-bbee-21018e5cf5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:58.432457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e5f78-90e7-42c8-bbee-21018e5cf5ae admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:58.433243 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e5f78-90e7-42c8-bbee-21018e5cf5ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:58.435187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e5f78-90e7-42c8-bbee-21018e5cf5ae admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:58.515322 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4279/8572] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:58:58 2022] POST /identity/v3/users => generated 296 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:58:58.519551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5d9d3-4f58-4ffa-9148-a18e356b08e5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:58.530229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5d9d3-4f58-4ffa-9148-a18e356b08e5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:58.535453 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038ab10-a736-4e2f-994b-0040bc22cf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:58.536125 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038ab10-a736-4e2f-994b-0040bc22cf3f admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:58.536439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038ab10-a736-4e2f-994b-0040bc22cf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:58.536760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038ab10-a736-4e2f-994b-0040bc22cf3f admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:58.537497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038ab10-a736-4e2f-994b-0040bc22cf3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:58.539131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038ab10-a736-4e2f-994b-0040bc22cf3f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:58.549705 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4294/8573] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:58:58.553792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e5f78-90e7-42c8-bbee-21018e5cf5ae admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:58.563912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e5f78-90e7-42c8-bbee-21018e5cf5ae admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:58.568705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc5162-c410-4bd9-aa17-2a1b77d8c2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:58.569577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc5162-c410-4bd9-aa17-2a1b77d8c2ef admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:58.569866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc5162-c410-4bd9-aa17-2a1b77d8c2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:58.570149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc5162-c410-4bd9-aa17-2a1b77d8c2ef admin admin] PATH_INFO: `/v3/projects/18e9950ebc504170b27d69186cd85680/users/70d0694ce4164692a027512c028e3260/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:58.585511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc5162-c410-4bd9-aa17-2a1b77d8c2ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=18e9950ebc504170b27d69186cd85680, user_id=70d0694ce4164692a027512c028e3260, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:58.589056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc5162-c410-4bd9-aa17-2a1b77d8c2ef admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:58.646539 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4280/8574] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:58:58 2022] PUT /identity/v3/projects/18e9950ebc504170b27d69186cd85680/users/70d0694ce4164692a027512c028e3260/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:58:58.651179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038ab10-a736-4e2f-994b-0040bc22cf3f admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:58.660957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038ab10-a736-4e2f-994b-0040bc22cf3f admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:58.715984 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940026dc-2222-44ab-a600-4e608cf66036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:58.716583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940026dc-2222-44ab-a600-4e608cf66036 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:58.716884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940026dc-2222-44ab-a600-4e608cf66036 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:58.717162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940026dc-2222-44ab-a600-4e608cf66036 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:58.717913 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940026dc-2222-44ab-a600-4e608cf66036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:58.719533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940026dc-2222-44ab-a600-4e608cf66036 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:58.732319 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4295/8575] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:58:58.733596 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc5162-c410-4bd9-aa17-2a1b77d8c2ef admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:58:58.743903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc5162-c410-4bd9-aa17-2a1b77d8c2ef admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:58:58.748698 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f2414-3467-4a59-a959-bb5bef584096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:58:58.749597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f2414-3467-4a59-a959-bb5bef584096 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:58:58.749881 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f2414-3467-4a59-a959-bb5bef584096 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:58:58.750161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f2414-3467-4a59-a959-bb5bef584096 admin admin] PATH_INFO: `/v3/projects/18e9950ebc504170b27d69186cd85680/users/70d0694ce4164692a027512c028e3260/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:58:58.752185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f2414-3467-4a59-a959-bb5bef584096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18e9950ebc504170b27d69186cd85680, user_id=70d0694ce4164692a027512c028e3260, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:58:58.754900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f2414-3467-4a59-a959-bb5bef584096 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:58:58.766104 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4281/8576] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:58:58 2022] PUT /identity/v3/projects/18e9950ebc504170b27d69186cd85680/users/70d0694ce4164692a027512c028e3260/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:59:00.542699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f8d34-a6d1-46c6-80ad-926b94d036e0 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:00.543236 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f8d34-a6d1-46c6-80ad-926b94d036e0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:00.543363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f8d34-a6d1-46c6-80ad-926b94d036e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:00.574685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-167f8d34-a6d1-46c6-80ad-926b94d036e0 None None] MFA Rules not processed for user `70d0694ce4164692a027512c028e3260`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:59:00.575917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-167f8d34-a6d1-46c6-80ad-926b94d036e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:59:00.646403 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4296/8577] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:59:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:59:00.657534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31904dc-5ac0-4801-a1a0-10b745a875b7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:00.657997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31904dc-5ac0-4801-a1a0-10b745a875b7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:00.658084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31904dc-5ac0-4801-a1a0-10b745a875b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:00.678706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e31904dc-5ac0-4801-a1a0-10b745a875b7 None None] MFA Rules not processed for user `0b837c11739740838d2fc4ee1d826bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:59:00.680032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e31904dc-5ac0-4801-a1a0-10b745a875b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:59:00.739064 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4282/8578] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:59:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:59:00.746694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f8d34-a6d1-46c6-80ad-926b94d036e0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:00.748315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-167f8d34-a6d1-46c6-80ad-926b94d036e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:59:00.783824 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454cb60-2ffb-4342-b894-285a7ef84845 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:00.784267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454cb60-2ffb-4342-b894-285a7ef84845 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:00.784551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454cb60-2ffb-4342-b894-285a7ef84845 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:00.786006 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4283/8579] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 10:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 10:59:00.791516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2d4d8-f76f-45e9-885b-50e16d033cae None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:00.791798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2d4d8-f76f-45e9-885b-50e16d033cae None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:00.792071 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2d4d8-f76f-45e9-885b-50e16d033cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:00.830212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f8d34-a6d1-46c6-80ad-926b94d036e0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:00.830445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7ed2d4d8-f76f-45e9-885b-50e16d033cae None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:59:00.831431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7ed2d4d8-f76f-45e9-885b-50e16d033cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:59:00.837144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e424ba-45fd-4305-bfcd-948662a3c6b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:00.837812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e424ba-45fd-4305-bfcd-948662a3c6b4 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:00.838095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e424ba-45fd-4305-bfcd-948662a3c6b4 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:00.838424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e424ba-45fd-4305-bfcd-948662a3c6b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:00.846887 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e424ba-45fd-4305-bfcd-948662a3c6b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:00.848648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e424ba-45fd-4305-bfcd-948662a3c6b4 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:00.859147 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4297/8580] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:59:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:59:00.906542 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4284/8581] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 10:59:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:59:00.931479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e424ba-45fd-4305-bfcd-948662a3c6b4 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:00.932929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-52e424ba-45fd-4305-bfcd-948662a3c6b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:59:00.949689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e424ba-45fd-4305-bfcd-948662a3c6b4 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:00.955240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aec672-0bfa-4591-b509-3304b7ba9275 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:00.955896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aec672-0bfa-4591-b509-3304b7ba9275 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:00.956186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aec672-0bfa-4591-b509-3304b7ba9275 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:00.956505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aec672-0bfa-4591-b509-3304b7ba9275 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:00.965678 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aec672-0bfa-4591-b509-3304b7ba9275 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:00.967252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aec672-0bfa-4591-b509-3304b7ba9275 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:00.977185 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4298/8582] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:59:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:59:01.468491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2d4d8-f76f-45e9-885b-50e16d033cae None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:01.528815 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2d4d8-f76f-45e9-885b-50e16d033cae None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:01.533509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7e172-71b1-44c5-bddc-793235ad80a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:01.534196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7e172-71b1-44c5-bddc-793235ad80a5 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:01.534496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7e172-71b1-44c5-bddc-793235ad80a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:01.534773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7e172-71b1-44c5-bddc-793235ad80a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:01.538484 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-56d7e172-71b1-44c5-bddc-793235ad80a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:59:01.560900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d7e172-71b1-44c5-bddc-793235ad80a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:01.562439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d7e172-71b1-44c5-bddc-793235ad80a5 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:01.573639 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4285/8583] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:59:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:59:01.766164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b833b-14e5-490f-9c0f-fe4928d947c0 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:01.766689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b833b-14e5-490f-9c0f-fe4928d947c0 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:01.766689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b833b-14e5-490f-9c0f-fe4928d947c0 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:01.768075 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4299/8584] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 10:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 10:59:01.773198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0b8a1-9af1-4b81-92e9-ebda2888dda6 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:01.773629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0b8a1-9af1-4b81-92e9-ebda2888dda6 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:01.773793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0b8a1-9af1-4b81-92e9-ebda2888dda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:01.793546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-94a0b8a1-9af1-4b81-92e9-ebda2888dda6 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:59:01.794744 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-94a0b8a1-9af1-4b81-92e9-ebda2888dda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:59:01.803411 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4286/8585] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 10:59:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:59:01.823845 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b833b-14e5-490f-9c0f-fe4928d947c0 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:01.840562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b833b-14e5-490f-9c0f-fe4928d947c0 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:01.845641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda74a9-53ff-4f84-9e09-383ce83eb5ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:01.846321 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda74a9-53ff-4f84-9e09-383ce83eb5ba service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:01.846607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda74a9-53ff-4f84-9e09-383ce83eb5ba service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:01.846892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda74a9-53ff-4f84-9e09-383ce83eb5ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:01.855314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda74a9-53ff-4f84-9e09-383ce83eb5ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:01.856949 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda74a9-53ff-4f84-9e09-383ce83eb5ba service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:01.866619 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4300/8586] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:59:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:59:02.141216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0b8a1-9af1-4b81-92e9-ebda2888dda6 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:02.142661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-94a0b8a1-9af1-4b81-92e9-ebda2888dda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:59:02.156884 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0b8a1-9af1-4b81-92e9-ebda2888dda6 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:02.160452 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d81a9c-d9da-4a60-adf8-cb7d8c989e69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:02.161176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d81a9c-d9da-4a60-adf8-cb7d8c989e69 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:02.161422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d81a9c-d9da-4a60-adf8-cb7d8c989e69 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:02.161721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d81a9c-d9da-4a60-adf8-cb7d8c989e69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:02.163552 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-88d81a9c-d9da-4a60-adf8-cb7d8c989e69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:59:02.181373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d81a9c-d9da-4a60-adf8-cb7d8c989e69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:02.182874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d81a9c-d9da-4a60-adf8-cb7d8c989e69 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:02.197168 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4287/8587] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:59:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:59:27.782514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda74a9-53ff-4f84-9e09-383ce83eb5ba service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:27.844045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda74a9-53ff-4f84-9e09-383ce83eb5ba service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:27.849051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205acbdc-7e9d-4fba-9afa-b141bd530d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:27.849937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205acbdc-7e9d-4fba-9afa-b141bd530d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:27.850231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205acbdc-7e9d-4fba-9afa-b141bd530d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:27.850516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205acbdc-7e9d-4fba-9afa-b141bd530d5c admin admin] PATH_INFO: `/v3/users/0b837c11739740838d2fc4ee1d826bf9` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:27.851719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205acbdc-7e9d-4fba-9afa-b141bd530d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b837c11739740838d2fc4ee1d826bf9)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:27.854197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205acbdc-7e9d-4fba-9afa-b141bd530d5c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:28.035022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-205acbdc-7e9d-4fba-9afa-b141bd530d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b837c11739740838d2fc4ee1d826bf9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:28.046240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-205acbdc-7e9d-4fba-9afa-b141bd530d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b837c11739740838d2fc4ee1d826bf9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:28.046902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-205acbdc-7e9d-4fba-9afa-b141bd530d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b837c11739740838d2fc4ee1d826bf9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:28.055108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-205acbdc-7e9d-4fba-9afa-b141bd530d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b837c11739740838d2fc4ee1d826bf9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:28.126204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-205acbdc-7e9d-4fba-9afa-b141bd530d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b837c11739740838d2fc4ee1d826bf9'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:28.132594 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4301/8588] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:59:27 2022] DELETE /identity/v3/users/0b837c11739740838d2fc4ee1d826bf9 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:59:28.379913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d81a9c-d9da-4a60-adf8-cb7d8c989e69 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:28.391369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d81a9c-d9da-4a60-adf8-cb7d8c989e69 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:28.450271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85361e14-9a4f-47ff-bb91-cb1334fef540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:28.451173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85361e14-9a4f-47ff-bb91-cb1334fef540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:28.451462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85361e14-9a4f-47ff-bb91-cb1334fef540 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:28.451746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85361e14-9a4f-47ff-bb91-cb1334fef540 admin admin] PATH_INFO: `/v3/projects/e92d9933ffea46e98cc6d26a56bda751` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:28.452969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85361e14-9a4f-47ff-bb91-cb1334fef540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e92d9933ffea46e98cc6d26a56bda751)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:28.455029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85361e14-9a4f-47ff-bb91-cb1334fef540 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:28.586675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-85361e14-9a4f-47ff-bb91-cb1334fef540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e92d9933ffea46e98cc6d26a56bda751', 'request_id': 'req-85361e14-9a4f-47ff-bb91-cb1334fef540'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:28.592634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-85361e14-9a4f-47ff-bb91-cb1334fef540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e92d9933ffea46e98cc6d26a56bda751', 'request_id': 'req-85361e14-9a4f-47ff-bb91-cb1334fef540'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:28.669061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-85361e14-9a4f-47ff-bb91-cb1334fef540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e92d9933ffea46e98cc6d26a56bda751', 'request_id': 'req-85361e14-9a4f-47ff-bb91-cb1334fef540'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:28.679264 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-85361e14-9a4f-47ff-bb91-cb1334fef540 admin admin] The token cache is being invalidate because project e92d9933ffea46e98cc6d26a56bda751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:59:28.679576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-85361e14-9a4f-47ff-bb91-cb1334fef540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:28.680196 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-85361e14-9a4f-47ff-bb91-cb1334fef540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:28.682414 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4288/8589] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:59:28 2022] DELETE /identity/v3/projects/e92d9933ffea46e98cc6d26a56bda751 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 10:59:28.686694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205acbdc-7e9d-4fba-9afa-b141bd530d5c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:28.688172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-205acbdc-7e9d-4fba-9afa-b141bd530d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:59:28.701225 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205acbdc-7e9d-4fba-9afa-b141bd530d5c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:28.754946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eecc6a-c567-4f1e-b03a-507b8b0ac56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:28.755814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eecc6a-c567-4f1e-b03a-507b8b0ac56d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:28.756100 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eecc6a-c567-4f1e-b03a-507b8b0ac56d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:28.756376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eecc6a-c567-4f1e-b03a-507b8b0ac56d admin admin] PATH_INFO: `/v3/users/70d0694ce4164692a027512c028e3260` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:28.757606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eecc6a-c567-4f1e-b03a-507b8b0ac56d admin admin] RBAC: Authorizing `identity:delete_user(user_id=70d0694ce4164692a027512c028e3260)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:28.759549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eecc6a-c567-4f1e-b03a-507b8b0ac56d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:28.944834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-19eecc6a-c567-4f1e-b03a-507b8b0ac56d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70d0694ce4164692a027512c028e3260'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:28.956407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-19eecc6a-c567-4f1e-b03a-507b8b0ac56d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70d0694ce4164692a027512c028e3260'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:28.957102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-19eecc6a-c567-4f1e-b03a-507b8b0ac56d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70d0694ce4164692a027512c028e3260'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:28.964215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-19eecc6a-c567-4f1e-b03a-507b8b0ac56d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70d0694ce4164692a027512c028e3260'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:29.023131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-19eecc6a-c567-4f1e-b03a-507b8b0ac56d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70d0694ce4164692a027512c028e3260'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:29.029603 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4302/8590] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:59:28 2022] DELETE /identity/v3/users/70d0694ce4164692a027512c028e3260 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:59:29.253428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85361e14-9a4f-47ff-bb91-cb1334fef540 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:29.254969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-85361e14-9a4f-47ff-bb91-cb1334fef540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:59:29.273348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85361e14-9a4f-47ff-bb91-cb1334fef540 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:29.329851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8f1dd-3667-4842-b4df-2175c905b1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:29.330697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8f1dd-3667-4842-b4df-2175c905b1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:29.330979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8f1dd-3667-4842-b4df-2175c905b1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:29.331256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8f1dd-3667-4842-b4df-2175c905b1d3 admin admin] PATH_INFO: `/v3/projects/18e9950ebc504170b27d69186cd85680` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:29.332437 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8f1dd-3667-4842-b4df-2175c905b1d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18e9950ebc504170b27d69186cd85680)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:29.334378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8f1dd-3667-4842-b4df-2175c905b1d3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:29.428548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-70e8f1dd-3667-4842-b4df-2175c905b1d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18e9950ebc504170b27d69186cd85680', 'request_id': 'req-70e8f1dd-3667-4842-b4df-2175c905b1d3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:29.434583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-70e8f1dd-3667-4842-b4df-2175c905b1d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18e9950ebc504170b27d69186cd85680', 'request_id': 'req-70e8f1dd-3667-4842-b4df-2175c905b1d3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:29.497757 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-70e8f1dd-3667-4842-b4df-2175c905b1d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18e9950ebc504170b27d69186cd85680', 'request_id': 'req-70e8f1dd-3667-4842-b4df-2175c905b1d3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:29.508359 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-70e8f1dd-3667-4842-b4df-2175c905b1d3 admin admin] The token cache is being invalidate because project 18e9950ebc504170b27d69186cd85680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:59:29.510146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-70e8f1dd-3667-4842-b4df-2175c905b1d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:29.510146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-70e8f1dd-3667-4842-b4df-2175c905b1d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:29.511433 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4289/8591] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:59:29 2022] DELETE /identity/v3/projects/18e9950ebc504170b27d69186cd85680 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:59:29.516398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ac3d8-5946-48ee-8f2f-925d0e2b1252 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:29.516746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ac3d8-5946-48ee-8f2f-925d0e2b1252 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:29.517011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ac3d8-5946-48ee-8f2f-925d0e2b1252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:29.535806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-794ac3d8-5946-48ee-8f2f-925d0e2b1252 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:59:29.537055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-794ac3d8-5946-48ee-8f2f-925d0e2b1252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:59:29.594415 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4303/8592] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:59:29.602972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b4686-231f-45f9-bae5-62d44d9b4617 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:29.603263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b4686-231f-45f9-bae5-62d44d9b4617 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:29.603547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b4686-231f-45f9-bae5-62d44d9b4617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:29.622132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b55b4686-231f-45f9-bae5-62d44d9b4617 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:59:29.623326 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b55b4686-231f-45f9-bae5-62d44d9b4617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:59:29.631512 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4290/8593] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:59:29.636522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ac3d8-5946-48ee-8f2f-925d0e2b1252 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:29.646479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ac3d8-5946-48ee-8f2f-925d0e2b1252 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:29.653468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147b79d-f20f-4942-9464-25ac369a5bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:29.653468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147b79d-f20f-4942-9464-25ac369a5bde admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:29.653468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147b79d-f20f-4942-9464-25ac369a5bde admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:29.653468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147b79d-f20f-4942-9464-25ac369a5bde admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:29.653898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147b79d-f20f-4942-9464-25ac369a5bde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 10:59:29.653898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147b79d-f20f-4942-9464-25ac369a5bde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:29.654888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147b79d-f20f-4942-9464-25ac369a5bde admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:29.666409 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4304/8594] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 10:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:59:29.670705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b4686-231f-45f9-bae5-62d44d9b4617 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:29.680088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b4686-231f-45f9-bae5-62d44d9b4617 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:29.685317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f827c1-030d-42a6-8ebe-306b068f39ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:29.686299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f827c1-030d-42a6-8ebe-306b068f39ab admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:29.686593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f827c1-030d-42a6-8ebe-306b068f39ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:29.686871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f827c1-030d-42a6-8ebe-306b068f39ab admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:29.687561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f827c1-030d-42a6-8ebe-306b068f39ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:29.689596 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f827c1-030d-42a6-8ebe-306b068f39ab admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:29.794486 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4291/8595] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 10:59:29 2022] POST /identity/v3/projects => generated 365 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:59:29.798702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147b79d-f20f-4942-9464-25ac369a5bde admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:29.809156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147b79d-f20f-4942-9464-25ac369a5bde admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:29.864500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4358b1-d6f3-4e08-b640-2c88da9359d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:29.865251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4358b1-d6f3-4e08-b640-2c88da9359d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:29.865533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4358b1-d6f3-4e08-b640-2c88da9359d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:29.865808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4358b1-d6f3-4e08-b640-2c88da9359d0 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:29.866490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4358b1-d6f3-4e08-b640-2c88da9359d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:29.868902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4358b1-d6f3-4e08-b640-2c88da9359d0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:29.983875 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4305/8596] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:59:29 2022] POST /identity/v3/users => generated 283 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 10:59:29.987999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f827c1-030d-42a6-8ebe-306b068f39ab admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:29.999117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f827c1-030d-42a6-8ebe-306b068f39ab admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:30.003783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a35ef-00cb-4b38-831b-b05d36ef8c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:30.008026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a35ef-00cb-4b38-831b-b05d36ef8c4a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:30.008026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a35ef-00cb-4b38-831b-b05d36ef8c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:30.008026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a35ef-00cb-4b38-831b-b05d36ef8c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:30.008026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a35ef-00cb-4b38-831b-b05d36ef8c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:30.008026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a35ef-00cb-4b38-831b-b05d36ef8c4a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:30.017749 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4292/8597] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:59:30.022001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4358b1-d6f3-4e08-b640-2c88da9359d0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:30.031837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4358b1-d6f3-4e08-b640-2c88da9359d0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:30.036553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832831ca-2a9c-4119-ac19-a95d1a1bd77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:30.043634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832831ca-2a9c-4119-ac19-a95d1a1bd77f admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:30.043634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832831ca-2a9c-4119-ac19-a95d1a1bd77f admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:30.043634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832831ca-2a9c-4119-ac19-a95d1a1bd77f admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:30.043634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832831ca-2a9c-4119-ac19-a95d1a1bd77f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:30.043634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832831ca-2a9c-4119-ac19-a95d1a1bd77f admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:30.050270 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4306/8598] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:59:30.054433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a35ef-00cb-4b38-831b-b05d36ef8c4a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:30.064950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a35ef-00cb-4b38-831b-b05d36ef8c4a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:30.069702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fa90a-2757-4de1-b27a-8d22219b93f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:30.070581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fa90a-2757-4de1-b27a-8d22219b93f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:30.070867 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fa90a-2757-4de1-b27a-8d22219b93f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:30.071254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fa90a-2757-4de1-b27a-8d22219b93f2 admin admin] PATH_INFO: `/v3/projects/5f895a4ab91f4ba4b38ae54eb907fa19/users/ec5a88416e1a49658ea02f3cb9b311fd/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:30.085306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fa90a-2757-4de1-b27a-8d22219b93f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f895a4ab91f4ba4b38ae54eb907fa19, user_id=ec5a88416e1a49658ea02f3cb9b311fd, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:30.087973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fa90a-2757-4de1-b27a-8d22219b93f2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:30.160373 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4293/8599] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 10:59:30 2022] PUT /identity/v3/projects/5f895a4ab91f4ba4b38ae54eb907fa19/users/ec5a88416e1a49658ea02f3cb9b311fd/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:59:30.165947 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d9d47-645d-4a2b-bc7d-75a4c9032624 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:30.166243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d9d47-645d-4a2b-bc7d-75a4c9032624 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:30.166526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d9d47-645d-4a2b-bc7d-75a4c9032624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:30.184444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ed8d9d47-645d-4a2b-bc7d-75a4c9032624 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:59:30.185673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ed8d9d47-645d-4a2b-bc7d-75a4c9032624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:59:30.242238 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4307/8600] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 10:59:30.252434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fa90a-2757-4de1-b27a-8d22219b93f2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:30.254282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7f1fa90a-2757-4de1-b27a-8d22219b93f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:59:30.312208 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fa90a-2757-4de1-b27a-8d22219b93f2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:30.315717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bce5b4-dab9-467c-9815-434da306a2a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:30.316377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bce5b4-dab9-467c-9815-434da306a2a3 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:30.316693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bce5b4-dab9-467c-9815-434da306a2a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:30.316973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bce5b4-dab9-467c-9815-434da306a2a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:30.325755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bce5b4-dab9-467c-9815-434da306a2a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:30.327182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bce5b4-dab9-467c-9815-434da306a2a3 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:30.336403 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4294/8601] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:59:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:59:35.526394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d70f2-42de-4172-ba06-ba909a932f5f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:35.526963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d70f2-42de-4172-ba06-ba909a932f5f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:35.526963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d70f2-42de-4172-ba06-ba909a932f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:35.556907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b81d70f2-42de-4172-ba06-ba909a932f5f None None] MFA Rules not processed for user `ec5a88416e1a49658ea02f3cb9b311fd`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:59:35.560706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b81d70f2-42de-4172-ba06-ba909a932f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:59:35.659310 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4308/8602] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:59:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 10:59:35.664212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bce5b4-dab9-467c-9815-434da306a2a3 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:35.674234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bce5b4-dab9-467c-9815-434da306a2a3 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:35.679662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa01074-3888-4b79-8df4-be96acd20be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:35.681183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa01074-3888-4b79-8df4-be96acd20be7 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:35.681687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa01074-3888-4b79-8df4-be96acd20be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:35.682201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa01074-3888-4b79-8df4-be96acd20be7 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:35.683561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa01074-3888-4b79-8df4-be96acd20be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:35.685035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa01074-3888-4b79-8df4-be96acd20be7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:35.767163 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4295/8603] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 10:59:35 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 10:59:35.771572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d70f2-42de-4172-ba06-ba909a932f5f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:35.784208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d70f2-42de-4172-ba06-ba909a932f5f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:35.789894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815ece4-bcf9-4f02-987e-08a4adb36a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:35.790280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815ece4-bcf9-4f02-987e-08a4adb36a60 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:35.790280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815ece4-bcf9-4f02-987e-08a4adb36a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:35.790576 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815ece4-bcf9-4f02-987e-08a4adb36a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:35.791307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815ece4-bcf9-4f02-987e-08a4adb36a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:35.792937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815ece4-bcf9-4f02-987e-08a4adb36a60 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:35.806544 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4309/8604] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 10:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 10:59:35.810267 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa01074-3888-4b79-8df4-be96acd20be7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:35.822692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa01074-3888-4b79-8df4-be96acd20be7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:35.828378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ba662-5fb7-45f3-b956-b5e806c0bb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:35.829301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ba662-5fb7-45f3-b956-b5e806c0bb61 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:35.829592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ba662-5fb7-45f3-b956-b5e806c0bb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:35.829876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ba662-5fb7-45f3-b956-b5e806c0bb61 admin admin] PATH_INFO: `/v3/system/users/a44010b71b6548d4ab286530b05cc985/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:35.845825 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ba662-5fb7-45f3-b956-b5e806c0bb61 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a44010b71b6548d4ab286530b05cc985, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:35.847516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ba662-5fb7-45f3-b956-b5e806c0bb61 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:35.905410 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4296/8605] 10.222.0.16 () {60 vars in 1377 bytes} [Mon May 2 10:59:35 2022] PUT /identity/v3/system/users/a44010b71b6548d4ab286530b05cc985/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:59:35.915500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1544715-fd65-436e-9dcf-d3cac510af83 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:35.915747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1544715-fd65-436e-9dcf-d3cac510af83 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:35.916033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1544715-fd65-436e-9dcf-d3cac510af83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:35.944138 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b1544715-fd65-436e-9dcf-d3cac510af83 None None] MFA Rules not processed for user `a44010b71b6548d4ab286530b05cc985`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 10:59:35.945441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b1544715-fd65-436e-9dcf-d3cac510af83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:59:36.016070 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4310/8606] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 10:59:35 2022] POST /identity/v3/auth/tokens => generated 2404 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 02 10:59:36.021046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ba662-5fb7-45f3-b956-b5e806c0bb61 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:36.119352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ba662-5fb7-45f3-b956-b5e806c0bb61 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:36.153003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3fde9-f44f-452e-9f8f-11a9711d6343 None tempest-ImageQuotaTest-552973423-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44010b71b6548d4ab286530b05cc985', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:36.153684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3fde9-f44f-452e-9f8f-11a9711d6343 None tempest-ImageQuotaTest-552973423-system-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:36.153970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3fde9-f44f-452e-9f8f-11a9711d6343 None tempest-ImageQuotaTest-552973423-system-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:36.154254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3fde9-f44f-452e-9f8f-11a9711d6343 None tempest-ImageQuotaTest-552973423-system-admin] PATH_INFO: `/v3/services` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:36.154985 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3fde9-f44f-452e-9f8f-11a9711d6343 None tempest-ImageQuotaTest-552973423-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:36.156363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3fde9-f44f-452e-9f8f-11a9711d6343 None tempest-ImageQuotaTest-552973423-system-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:36.163680 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4297/8607] 10.222.0.16 () {58 vars in 1109 bytes} [Mon May 2 10:59:36 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 10:59:36.168638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1544715-fd65-436e-9dcf-d3cac510af83 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:36.263106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1544715-fd65-436e-9dcf-d3cac510af83 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:36.295542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ee092-6853-42c6-bf59-d59325d5d557 None tempest-ImageQuotaTest-552973423-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44010b71b6548d4ab286530b05cc985', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:36.296202 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ee092-6853-42c6-bf59-d59325d5d557 None tempest-ImageQuotaTest-552973423-system-admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:36.296486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ee092-6853-42c6-bf59-d59325d5d557 None tempest-ImageQuotaTest-552973423-system-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:36.296792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ee092-6853-42c6-bf59-d59325d5d557 None tempest-ImageQuotaTest-552973423-system-admin] PATH_INFO: `/v3/limits` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:36.297509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ee092-6853-42c6-bf59-d59325d5d557 None tempest-ImageQuotaTest-552973423-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:36.298792 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ee092-6853-42c6-bf59-d59325d5d557 None tempest-ImageQuotaTest-552973423-system-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:36.338598 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-bf3ee092-6853-42c6-bf59-d59325d5d557 None tempest-ImageQuotaTest-552973423-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. May 02 10:59:36.338598 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:59:36.338598 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:59:36.338598 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:59:36.338598 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:59:36.338598 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:59:36.338598 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:59:36.338598 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:59:36.338598 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:59:36.338598 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:59:36.338598 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:59:36.338598 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:59:36.338598 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post May 02 10:59:36.338598 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) May 02 10:59:36.339832 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:59:36.339832 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:59:36.339832 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits May 02 10:59:36.339832 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) May 02 10:59:36.339832 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 02 10:59:36.339832 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 02 10:59:36.339832 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits May 02 10:59:36.339832 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) May 02 10:59:36.339832 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id May 02 10:59:36.339832 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.NoLimitReference May 02 10:59:36.339832 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. May 02 10:59:36.339832 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:59:36.341989 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4311/8608] 10.222.0.16 () {60 vars in 1125 bytes} [Mon May 2 10:59:36 2022] POST /identity/v3/limits => generated 124 bytes in 172 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) May 02 10:59:36.345140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3fde9-f44f-452e-9f8f-11a9711d6343 None tempest-ImageQuotaTest-552973423-system-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:36.448919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3fde9-f44f-452e-9f8f-11a9711d6343 None tempest-ImageQuotaTest-552973423-system-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:36.484286 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165c91a-e056-46ff-999e-72c2c3caab12 None tempest-ImageQuotaTest-552973423-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44010b71b6548d4ab286530b05cc985', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:36.485103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165c91a-e056-46ff-999e-72c2c3caab12 None tempest-ImageQuotaTest-552973423-system-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:36.485387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165c91a-e056-46ff-999e-72c2c3caab12 None tempest-ImageQuotaTest-552973423-system-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:36.485669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165c91a-e056-46ff-999e-72c2c3caab12 None tempest-ImageQuotaTest-552973423-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:36.486364 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165c91a-e056-46ff-999e-72c2c3caab12 None tempest-ImageQuotaTest-552973423-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:36.487464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165c91a-e056-46ff-999e-72c2c3caab12 None tempest-ImageQuotaTest-552973423-system-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:36.494364 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4298/8609] 10.222.0.16 () {58 vars in 1136 bytes} [Mon May 2 10:59:36 2022] GET /identity/v3/registered_limits => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:59:36.500445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ee092-6853-42c6-bf59-d59325d5d557 None tempest-ImageQuotaTest-552973423-system-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:36.598663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ee092-6853-42c6-bf59-d59325d5d557 None tempest-ImageQuotaTest-552973423-system-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:36.631561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de8f45-b0d8-43bc-ab77-e84c8cb92f36 None tempest-ImageQuotaTest-552973423-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a44010b71b6548d4ab286530b05cc985', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:36.632234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de8f45-b0d8-43bc-ab77-e84c8cb92f36 None tempest-ImageQuotaTest-552973423-system-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:36.632522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de8f45-b0d8-43bc-ab77-e84c8cb92f36 None tempest-ImageQuotaTest-552973423-system-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:36.632834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de8f45-b0d8-43bc-ab77-e84c8cb92f36 None tempest-ImageQuotaTest-552973423-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:36.633581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de8f45-b0d8-43bc-ab77-e84c8cb92f36 None tempest-ImageQuotaTest-552973423-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:36.634657 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de8f45-b0d8-43bc-ab77-e84c8cb92f36 None tempest-ImageQuotaTest-552973423-system-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:36.639979 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4312/8610] 10.222.0.16 () {58 vars in 1136 bytes} [Mon May 2 10:59:36 2022] GET /identity/v3/registered_limits => generated 129 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 10:59:40.963805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165c91a-e056-46ff-999e-72c2c3caab12 None tempest-ImageQuotaTest-552973423-system-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:40.999337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165c91a-e056-46ff-999e-72c2c3caab12 None tempest-ImageQuotaTest-552973423-system-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:41.004011 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29096500-559f-4dee-af57-773cac70ac50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:41.004924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29096500-559f-4dee-af57-773cac70ac50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:41.005213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29096500-559f-4dee-af57-773cac70ac50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:41.005494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29096500-559f-4dee-af57-773cac70ac50 admin admin] PATH_INFO: `/v3/users/ec5a88416e1a49658ea02f3cb9b311fd` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:41.009445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29096500-559f-4dee-af57-773cac70ac50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec5a88416e1a49658ea02f3cb9b311fd)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:41.009445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29096500-559f-4dee-af57-773cac70ac50 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:41.246224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-29096500-559f-4dee-af57-773cac70ac50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec5a88416e1a49658ea02f3cb9b311fd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:41.257666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-29096500-559f-4dee-af57-773cac70ac50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec5a88416e1a49658ea02f3cb9b311fd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:41.260963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-29096500-559f-4dee-af57-773cac70ac50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec5a88416e1a49658ea02f3cb9b311fd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:41.265643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-29096500-559f-4dee-af57-773cac70ac50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec5a88416e1a49658ea02f3cb9b311fd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:41.331710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-29096500-559f-4dee-af57-773cac70ac50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec5a88416e1a49658ea02f3cb9b311fd'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:41.338636 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4299/8611] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:59:40 2022] DELETE /identity/v3/users/ec5a88416e1a49658ea02f3cb9b311fd => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:59:41.579641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de8f45-b0d8-43bc-ab77-e84c8cb92f36 None tempest-ImageQuotaTest-552973423-system-admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:41.581506 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-24de8f45-b0d8-43bc-ab77-e84c8cb92f36 None tempest-ImageQuotaTest-552973423-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:59:41.698273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de8f45-b0d8-43bc-ab77-e84c8cb92f36 None tempest-ImageQuotaTest-552973423-system-admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:41.703024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74c90f-1944-4470-a160-f4df7d81e9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:41.703976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74c90f-1944-4470-a160-f4df7d81e9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:41.704265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74c90f-1944-4470-a160-f4df7d81e9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:41.704541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74c90f-1944-4470-a160-f4df7d81e9a5 admin admin] PATH_INFO: `/v3/projects/5f895a4ab91f4ba4b38ae54eb907fa19` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:41.705773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74c90f-1944-4470-a160-f4df7d81e9a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f895a4ab91f4ba4b38ae54eb907fa19)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:41.707675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74c90f-1944-4470-a160-f4df7d81e9a5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:41.798967 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2b74c90f-1944-4470-a160-f4df7d81e9a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f895a4ab91f4ba4b38ae54eb907fa19', 'request_id': 'req-2b74c90f-1944-4470-a160-f4df7d81e9a5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:41.851733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2b74c90f-1944-4470-a160-f4df7d81e9a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f895a4ab91f4ba4b38ae54eb907fa19', 'request_id': 'req-2b74c90f-1944-4470-a160-f4df7d81e9a5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:41.858351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2b74c90f-1944-4470-a160-f4df7d81e9a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f895a4ab91f4ba4b38ae54eb907fa19', 'request_id': 'req-2b74c90f-1944-4470-a160-f4df7d81e9a5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:41.869013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2b74c90f-1944-4470-a160-f4df7d81e9a5 admin admin] The token cache is being invalidate because project 5f895a4ab91f4ba4b38ae54eb907fa19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 10:59:41.869300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2b74c90f-1944-4470-a160-f4df7d81e9a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:41.870019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-2b74c90f-1944-4470-a160-f4df7d81e9a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:41.871662 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4313/8612] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 10:59:41 2022] DELETE /identity/v3/projects/5f895a4ab91f4ba4b38ae54eb907fa19 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:59:41.875695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29096500-559f-4dee-af57-773cac70ac50 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:41.886219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29096500-559f-4dee-af57-773cac70ac50 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:41.940407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d29bba-b5f4-461c-bc38-e82bec84701a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:41.941304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d29bba-b5f4-461c-bc38-e82bec84701a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:41.941590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d29bba-b5f4-461c-bc38-e82bec84701a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:41.941890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d29bba-b5f4-461c-bc38-e82bec84701a admin admin] PATH_INFO: `/v3/users/a44010b71b6548d4ab286530b05cc985` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:41.943063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d29bba-b5f4-461c-bc38-e82bec84701a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a44010b71b6548d4ab286530b05cc985)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:41.945017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d29bba-b5f4-461c-bc38-e82bec84701a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:42.130875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b5d29bba-b5f4-461c-bc38-e82bec84701a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a44010b71b6548d4ab286530b05cc985'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:42.142370 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b5d29bba-b5f4-461c-bc38-e82bec84701a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a44010b71b6548d4ab286530b05cc985'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:42.143040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b5d29bba-b5f4-461c-bc38-e82bec84701a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a44010b71b6548d4ab286530b05cc985'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:42.150069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b5d29bba-b5f4-461c-bc38-e82bec84701a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a44010b71b6548d4ab286530b05cc985'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:42.215636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-b5d29bba-b5f4-461c-bc38-e82bec84701a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a44010b71b6548d4ab286530b05cc985'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 10:59:42.221913 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4300/8613] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 10:59:41 2022] DELETE /identity/v3/users/a44010b71b6548d4ab286530b05cc985 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 10:59:42.624513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74c90f-1944-4470-a160-f4df7d81e9a5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:42.629716 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2b74c90f-1944-4470-a160-f4df7d81e9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:59:42.642121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74c90f-1944-4470-a160-f4df7d81e9a5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:42.700373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef879ee-a261-413a-9622-d092d7d64277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:42.701245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef879ee-a261-413a-9622-d092d7d64277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:42.701531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef879ee-a261-413a-9622-d092d7d64277 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:42.701812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef879ee-a261-413a-9622-d092d7d64277 admin admin] PATH_INFO: `/v3/projects/None` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:42.708581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef879ee-a261-413a-9622-d092d7d64277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:42.710566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef879ee-a261-413a-9622-d092d7d64277 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:42.723930 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application [None req-aef879ee-a261-413a-9622-d092d7d64277 admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. May 02 10:59:42.723930 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application Traceback (most recent call last): May 02 10:59:42.723930 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 02 10:59:42.723930 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 02 10:59:42.723930 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 02 10:59:42.723930 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 02 10:59:42.723930 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 02 10:59:42.723930 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 02 10:59:42.723930 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 02 10:59:42.723930 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 02 10:59:42.723930 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 02 10:59:42.723930 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 02 10:59:42.723930 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete May 02 10:59:42.723930 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( May 02 10:59:42.723930 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 02 10:59:42.723930 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 02 10:59:42.725256 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project May 02 10:59:42.725256 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) May 02 10:59:42.725256 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 02 10:59:42.725256 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 02 10:59:42.725256 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 02 10:59:42.725256 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 02 10:59:42.725256 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. May 02 10:59:42.725256 ncdv-master-1 devstack@keystone.service[91118]: ERROR keystone.server.flask.application May 02 10:59:42.725853 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4314/8614] 10.222.0.16 () {58 vars in 1148 bytes} [Mon May 2 10:59:42 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 02 10:59:52.040950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d29bba-b5f4-461c-bc38-e82bec84701a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:52.042374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b5d29bba-b5f4-461c-bc38-e82bec84701a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:59:52.127792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d29bba-b5f4-461c-bc38-e82bec84701a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:52.131403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99ea47-d6c8-410a-91ea-8bd640ea2646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:52.132088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99ea47-d6c8-410a-91ea-8bd640ea2646 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:52.132378 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99ea47-d6c8-410a-91ea-8bd640ea2646 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:52.132701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99ea47-d6c8-410a-91ea-8bd640ea2646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:52.135150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5a99ea47-d6c8-410a-91ea-8bd640ea2646 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:59:52.225266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99ea47-d6c8-410a-91ea-8bd640ea2646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:52.226747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a99ea47-d6c8-410a-91ea-8bd640ea2646 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:52.240710 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4301/8615] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:59:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 10:59:54.978836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef879ee-a261-413a-9622-d092d7d64277 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 10:59:54.980676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-aef879ee-a261-413a-9622-d092d7d64277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:59:54.995862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef879ee-a261-413a-9622-d092d7d64277 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 10:59:54.999508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8570e8-4099-4e19-87a4-01970cfcc5d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 10:59:55.000158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8570e8-4099-4e19-87a4-01970cfcc5d4 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 10:59:55.000444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8570e8-4099-4e19-87a4-01970cfcc5d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 10:59:55.000836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8570e8-4099-4e19-87a4-01970cfcc5d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 10:59:55.002644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0c8570e8-4099-4e19-87a4-01970cfcc5d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 10:59:55.020635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8570e8-4099-4e19-87a4-01970cfcc5d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 10:59:55.021475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8570e8-4099-4e19-87a4-01970cfcc5d4 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 10:59:55.035813 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4315/8616] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 10:59:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:00:10.539722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c1533-7aa6-4477-8661-6ce918a09056 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:00:10.540916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c1533-7aa6-4477-8661-6ce918a09056 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:00:10.540916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c1533-7aa6-4477-8661-6ce918a09056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:00:10.570100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-cb7c1533-7aa6-4477-8661-6ce918a09056 None None] MFA Rules not processed for user `a3d9515cb8634af582a4caf0de507192`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:00:10.572023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cb7c1533-7aa6-4477-8661-6ce918a09056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:00:10.657572 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4302/8617] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:00:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:00:10.978300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8570e8-4099-4e19-87a4-01970cfcc5d4 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:00:10.989155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8570e8-4099-4e19-87a4-01970cfcc5d4 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:00:10.992851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c730520-af4a-4264-8c4e-d2b752f08447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:00:10.993525 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c730520-af4a-4264-8c4e-d2b752f08447 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:00:10.993841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c730520-af4a-4264-8c4e-d2b752f08447 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:00:10.994122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c730520-af4a-4264-8c4e-d2b752f08447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:00:10.996409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2c730520-af4a-4264-8c4e-d2b752f08447 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:00:11.008951 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c730520-af4a-4264-8c4e-d2b752f08447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:00:11.010746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c730520-af4a-4264-8c4e-d2b752f08447 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:00:11.022083 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4316/8618] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:00:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:00:57.594917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c1533-7aa6-4477-8661-6ce918a09056 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:00:57.607228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c1533-7aa6-4477-8661-6ce918a09056 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:00:57.611095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252aa8d-73c5-4979-8d2c-347af0274635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:00:57.614269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252aa8d-73c5-4979-8d2c-347af0274635 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:00:57.614269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252aa8d-73c5-4979-8d2c-347af0274635 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:00:57.614269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252aa8d-73c5-4979-8d2c-347af0274635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:00:57.614269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0252aa8d-73c5-4979-8d2c-347af0274635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:00:57.626875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252aa8d-73c5-4979-8d2c-347af0274635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:00:57.628350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252aa8d-73c5-4979-8d2c-347af0274635 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:00:57.639286 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4303/8619] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:00:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:00:57.787833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f0d6c-e705-4915-923d-02164fba89c4 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:00:57.788396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f0d6c-e705-4915-923d-02164fba89c4 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:00:57.788396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f0d6c-e705-4915-923d-02164fba89c4 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:00:57.790315 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4317/8620] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 11:00:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 11:00:57.795417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237463a-79e4-4939-bee7-487605578d5a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:00:57.795715 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237463a-79e4-4939-bee7-487605578d5a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:00:57.796001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237463a-79e4-4939-bee7-487605578d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:00:57.833183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0237463a-79e4-4939-bee7-487605578d5a None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:00:57.834494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0237463a-79e4-4939-bee7-487605578d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:00:57.898901 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4304/8621] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 11:00:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:00:57.919747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f0d6c-e705-4915-923d-02164fba89c4 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:00:57.925955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-795f0d6c-e705-4915-923d-02164fba89c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:00:57.946128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f0d6c-e705-4915-923d-02164fba89c4 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:00:57.950994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f936aae-4bde-41f6-b7e0-e1ff17d11a6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:00:57.951629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f936aae-4bde-41f6-b7e0-e1ff17d11a6b service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:00:57.951912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f936aae-4bde-41f6-b7e0-e1ff17d11a6b service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:00:57.952190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f936aae-4bde-41f6-b7e0-e1ff17d11a6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:00:57.960302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f936aae-4bde-41f6-b7e0-e1ff17d11a6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:00:57.961912 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f936aae-4bde-41f6-b7e0-e1ff17d11a6b service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:00:57.971261 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4318/8622] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:00:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:01:13.420411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237463a-79e4-4939-bee7-487605578d5a None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:01:13.432766 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237463a-79e4-4939-bee7-487605578d5a None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:01:13.436297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade2a9e-f928-4eae-a3c1-f67b63748fec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:01:13.436969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade2a9e-f928-4eae-a3c1-f67b63748fec service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:01:13.437280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade2a9e-f928-4eae-a3c1-f67b63748fec service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:01:13.437555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade2a9e-f928-4eae-a3c1-f67b63748fec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:01:13.439266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-eade2a9e-f928-4eae-a3c1-f67b63748fec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:01:13.451510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade2a9e-f928-4eae-a3c1-f67b63748fec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:01:13.452986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade2a9e-f928-4eae-a3c1-f67b63748fec service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:01:13.462998 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4305/8623] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:01:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:02:13.359376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a372cb6-b3ef-4dc1-9b84-441a132bc834 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:02:13.361243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a372cb6-b3ef-4dc1-9b84-441a132bc834 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:02:13.361243 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a372cb6-b3ef-4dc1-9b84-441a132bc834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:02:13.379254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3a372cb6-b3ef-4dc1-9b84-441a132bc834 None None] MFA Rules not processed for user `a3d9515cb8634af582a4caf0de507192`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:02:13.380483 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3a372cb6-b3ef-4dc1-9b84-441a132bc834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:02:13.389793 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4319/8624] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:02:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:02:56.878593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade2a9e-f928-4eae-a3c1-f67b63748fec service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:02:56.893333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade2a9e-f928-4eae-a3c1-f67b63748fec service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:02:56.898676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfdb068-1855-4e90-bf53-fcc56e562c38 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:02:56.899969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdb068-1855-4e90-bf53-fcc56e562c38 service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:02:56.900249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdb068-1855-4e90-bf53-fcc56e562c38 service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:02:56.900522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdb068-1855-4e90-bf53-fcc56e562c38 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:02:56.902298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ebfdb068-1855-4e90-bf53-fcc56e562c38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:02:56.928306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfdb068-1855-4e90-bf53-fcc56e562c38 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:02:56.929943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfdb068-1855-4e90-bf53-fcc56e562c38 service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:02:56.942081 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4306/8625] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:02:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:02:59.031804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a372cb6-b3ef-4dc1-9b84-441a132bc834 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:02:59.033290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3a372cb6-b3ef-4dc1-9b84-441a132bc834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:02:59.050434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a372cb6-b3ef-4dc1-9b84-441a132bc834 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:02:59.055869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801f40f-6c24-460d-a87c-3b5969cd4e5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:02:59.056583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801f40f-6c24-460d-a87c-3b5969cd4e5d service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:02:59.056897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801f40f-6c24-460d-a87c-3b5969cd4e5d service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:02:59.057176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801f40f-6c24-460d-a87c-3b5969cd4e5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:02:59.058893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9801f40f-6c24-460d-a87c-3b5969cd4e5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:02:59.072976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801f40f-6c24-460d-a87c-3b5969cd4e5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:02:59.074538 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801f40f-6c24-460d-a87c-3b5969cd4e5d service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:02:59.086498 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4320/8626] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:02:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:02:59.467310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfdb068-1855-4e90-bf53-fcc56e562c38 service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:02:59.468797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ebfdb068-1855-4e90-bf53-fcc56e562c38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:02:59.486218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfdb068-1855-4e90-bf53-fcc56e562c38 service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:02:59.491845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf74da-1e2f-431a-98cf-0ec883e36980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:02:59.492478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf74da-1e2f-431a-98cf-0ec883e36980 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:02:59.492795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf74da-1e2f-431a-98cf-0ec883e36980 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:02:59.493612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf74da-1e2f-431a-98cf-0ec883e36980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:02:59.495313 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2ecf74da-1e2f-431a-98cf-0ec883e36980 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:02:59.505417 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf74da-1e2f-431a-98cf-0ec883e36980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:02:59.506971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf74da-1e2f-431a-98cf-0ec883e36980 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:02:59.515693 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4307/8627] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:02:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:03:00.631885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ccb4f-38e7-42d2-9cb2-1fc8e9aed270 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:03:00.632463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ccb4f-38e7-42d2-9cb2-1fc8e9aed270 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:03:00.632463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ccb4f-38e7-42d2-9cb2-1fc8e9aed270 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:03:00.633870 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4321/8628] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 11:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 11:03:00.639394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614c024-53f2-4bfe-bcfb-6dba57c1a824 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:03:00.639804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614c024-53f2-4bfe-bcfb-6dba57c1a824 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:03:00.639967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614c024-53f2-4bfe-bcfb-6dba57c1a824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:03:00.657673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b614c024-53f2-4bfe-bcfb-6dba57c1a824 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:03:00.658852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b614c024-53f2-4bfe-bcfb-6dba57c1a824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:03:00.668431 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4308/8629] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 11:03:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:03:00.689402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ccb4f-38e7-42d2-9cb2-1fc8e9aed270 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:03:00.705615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ccb4f-38e7-42d2-9cb2-1fc8e9aed270 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:03:00.710497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45227bc-c817-4771-9128-11ba4bf1a518 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:03:00.711135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45227bc-c817-4771-9128-11ba4bf1a518 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:03:00.711426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45227bc-c817-4771-9128-11ba4bf1a518 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:03:00.711769 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45227bc-c817-4771-9128-11ba4bf1a518 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:03:00.719902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45227bc-c817-4771-9128-11ba4bf1a518 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:03:00.721503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45227bc-c817-4771-9128-11ba4bf1a518 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:03:00.731658 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4322/8630] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:03:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:03:01.100171 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614c024-53f2-4bfe-bcfb-6dba57c1a824 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:03:01.113061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614c024-53f2-4bfe-bcfb-6dba57c1a824 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:03:01.118075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84d5ff-bf46-416e-bddb-16563e0a8910 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:03:01.118753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84d5ff-bf46-416e-bddb-16563e0a8910 service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:03:01.119038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84d5ff-bf46-416e-bddb-16563e0a8910 service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:03:01.119311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84d5ff-bf46-416e-bddb-16563e0a8910 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:03:01.121101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4c84d5ff-bf46-416e-bddb-16563e0a8910 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:03:01.134637 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84d5ff-bf46-416e-bddb-16563e0a8910 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:03:01.136211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84d5ff-bf46-416e-bddb-16563e0a8910 service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:03:01.148463 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4309/8631] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:03:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:03:03.863855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45227bc-c817-4771-9128-11ba4bf1a518 service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:03:03.879595 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45227bc-c817-4771-9128-11ba4bf1a518 service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:03:03.885872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9be45-1124-4719-b8ec-d8522df9b78d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:03:03.886541 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9be45-1124-4719-b8ec-d8522df9b78d service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:03:03.886824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9be45-1124-4719-b8ec-d8522df9b78d service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:03:03.887126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9be45-1124-4719-b8ec-d8522df9b78d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:03:03.890060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-73f9be45-1124-4719-b8ec-d8522df9b78d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:03:03.905702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9be45-1124-4719-b8ec-d8522df9b78d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:03:03.907618 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9be45-1124-4719-b8ec-d8522df9b78d service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:03:03.921532 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4323/8632] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:03:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:03:04.770987 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84d5ff-bf46-416e-bddb-16563e0a8910 service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:03:04.772713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4c84d5ff-bf46-416e-bddb-16563e0a8910 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:03:04.791474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84d5ff-bf46-416e-bddb-16563e0a8910 service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:03:04.799136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f3605-2f5c-4aba-917f-8ddf467bf962 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:03:04.799136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f3605-2f5c-4aba-917f-8ddf467bf962 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:03:04.799136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f3605-2f5c-4aba-917f-8ddf467bf962 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:03:04.799136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f3605-2f5c-4aba-917f-8ddf467bf962 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:03:04.800538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9b3f3605-2f5c-4aba-917f-8ddf467bf962 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:03:04.815948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f3605-2f5c-4aba-917f-8ddf467bf962 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:03:04.817581 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f3605-2f5c-4aba-917f-8ddf467bf962 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:03:04.831122 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4310/8633] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:03:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:03:05.629103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9be45-1124-4719-b8ec-d8522df9b78d service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:03:05.641072 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9be45-1124-4719-b8ec-d8522df9b78d service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:03:05.644636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da29e3-3a5b-4645-af3f-4128fbadba25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:03:05.645285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da29e3-3a5b-4645-af3f-4128fbadba25 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:03:05.645569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da29e3-3a5b-4645-af3f-4128fbadba25 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:03:05.645849 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da29e3-3a5b-4645-af3f-4128fbadba25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:03:05.647877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-77da29e3-3a5b-4645-af3f-4128fbadba25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:03:05.660213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da29e3-3a5b-4645-af3f-4128fbadba25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:03:05.661673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da29e3-3a5b-4645-af3f-4128fbadba25 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:03:05.672710 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4324/8634] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:03:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:03:11.009928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f3605-2f5c-4aba-917f-8ddf467bf962 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:03:11.021662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f3605-2f5c-4aba-917f-8ddf467bf962 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:03:11.026057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354fad2-d254-447d-bae0-2e23721fe089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:03:11.026687 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354fad2-d254-447d-bae0-2e23721fe089 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:03:11.026969 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354fad2-d254-447d-bae0-2e23721fe089 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:03:11.027241 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354fad2-d254-447d-bae0-2e23721fe089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:03:11.029002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f354fad2-d254-447d-bae0-2e23721fe089 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:03:11.089305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354fad2-d254-447d-bae0-2e23721fe089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:03:11.090787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354fad2-d254-447d-bae0-2e23721fe089 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:03:11.100967 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4311/8635] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:03:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:03:31.771974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165474e-780a-4f64-b1f4-1abe5abb6578 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:03:31.773145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165474e-780a-4f64-b1f4-1abe5abb6578 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:03:31.773511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165474e-780a-4f64-b1f4-1abe5abb6578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:03:31.799373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8165474e-780a-4f64-b1f4-1abe5abb6578 None None] MFA Rules not processed for user `a3d9515cb8634af582a4caf0de507192`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:03:31.800644 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8165474e-780a-4f64-b1f4-1abe5abb6578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:03:31.819455 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4325/8636] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:03:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:03:32.149896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354fad2-d254-447d-bae0-2e23721fe089 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:03:32.161704 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354fad2-d254-447d-bae0-2e23721fe089 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:03:32.165525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba86f6-ca05-4e6a-8033-fc1992d72688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:03:32.166206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba86f6-ca05-4e6a-8033-fc1992d72688 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:03:32.167075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba86f6-ca05-4e6a-8033-fc1992d72688 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:03:32.167477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba86f6-ca05-4e6a-8033-fc1992d72688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:03:32.169383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a8ba86f6-ca05-4e6a-8033-fc1992d72688 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:03:32.182095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba86f6-ca05-4e6a-8033-fc1992d72688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:03:32.184527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba86f6-ca05-4e6a-8033-fc1992d72688 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:03:32.195139 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4312/8637] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:03:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:03:45.280025 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165474e-780a-4f64-b1f4-1abe5abb6578 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:03:45.300566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165474e-780a-4f64-b1f4-1abe5abb6578 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:03:45.306018 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923d6e2-2a97-4616-8acb-65a4de31c14c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:03:45.306722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923d6e2-2a97-4616-8acb-65a4de31c14c service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:03:45.306969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923d6e2-2a97-4616-8acb-65a4de31c14c service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:03:45.307276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923d6e2-2a97-4616-8acb-65a4de31c14c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:03:45.309911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8923d6e2-2a97-4616-8acb-65a4de31c14c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:03:45.326830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923d6e2-2a97-4616-8acb-65a4de31c14c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:03:45.329170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923d6e2-2a97-4616-8acb-65a4de31c14c service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:03:45.343050 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4326/8638] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:03:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 11:05:10.332154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba86f6-ca05-4e6a-8033-fc1992d72688 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:05:10.352673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba86f6-ca05-4e6a-8033-fc1992d72688 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:05:10.356344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3df59-7bb4-4aa4-adde-81a7794e5f02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:05:10.357175 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3df59-7bb4-4aa4-adde-81a7794e5f02 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:10.357462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3df59-7bb4-4aa4-adde-81a7794e5f02 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:10.357859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3df59-7bb4-4aa4-adde-81a7794e5f02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:10.371393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3df59-7bb4-4aa4-adde-81a7794e5f02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:05:10.372900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3df59-7bb4-4aa4-adde-81a7794e5f02 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:05:10.396517 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4313/8639] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:05:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:05:11.580284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923d6e2-2a97-4616-8acb-65a4de31c14c service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:05:11.593146 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923d6e2-2a97-4616-8acb-65a4de31c14c service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:05:11.596794 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de7c9c-4db4-4edf-bf21-7beccad3d454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:05:11.599899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de7c9c-4db4-4edf-bf21-7beccad3d454 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:11.599899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de7c9c-4db4-4edf-bf21-7beccad3d454 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:11.599899 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de7c9c-4db4-4edf-bf21-7beccad3d454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:11.611910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de7c9c-4db4-4edf-bf21-7beccad3d454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:05:11.613440 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de7c9c-4db4-4edf-bf21-7beccad3d454 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:05:11.627995 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4327/8640] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:05:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:05:17.769752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3df59-7bb4-4aa4-adde-81a7794e5f02 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:05:17.771318 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-eba3df59-7bb4-4aa4-adde-81a7794e5f02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:05:17.819226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3df59-7bb4-4aa4-adde-81a7794e5f02 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:05:17.824216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710613c7-fbd9-4d4f-ae4d-5c71ebb338ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:05:17.825129 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710613c7-fbd9-4d4f-ae4d-5c71ebb338ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:17.825415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710613c7-fbd9-4d4f-ae4d-5c71ebb338ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:17.825722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710613c7-fbd9-4d4f-ae4d-5c71ebb338ea admin admin] PATH_INFO: `/v3/users/a3d9515cb8634af582a4caf0de507192` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:17.827051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710613c7-fbd9-4d4f-ae4d-5c71ebb338ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d9515cb8634af582a4caf0de507192)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:05:17.829593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710613c7-fbd9-4d4f-ae4d-5c71ebb338ea admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:05:18.004667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-710613c7-fbd9-4d4f-ae4d-5c71ebb338ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d9515cb8634af582a4caf0de507192'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:05:18.016586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-710613c7-fbd9-4d4f-ae4d-5c71ebb338ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d9515cb8634af582a4caf0de507192'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:05:18.017288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-710613c7-fbd9-4d4f-ae4d-5c71ebb338ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d9515cb8634af582a4caf0de507192'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:05:18.024277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-710613c7-fbd9-4d4f-ae4d-5c71ebb338ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d9515cb8634af582a4caf0de507192'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:05:18.084899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-710613c7-fbd9-4d4f-ae4d-5c71ebb338ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d9515cb8634af582a4caf0de507192'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:05:18.090837 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4314/8641] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 11:05:17 2022] DELETE /identity/v3/users/a3d9515cb8634af582a4caf0de507192 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:05:18.095636 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568234f2-4432-46a1-8daf-8fe6533d41eb None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:18.096120 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568234f2-4432-46a1-8daf-8fe6533d41eb None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:18.096228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568234f2-4432-46a1-8daf-8fe6533d41eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:18.122062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-568234f2-4432-46a1-8daf-8fe6533d41eb None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:05:18.123272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-568234f2-4432-46a1-8daf-8fe6533d41eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:05:18.179321 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4328/8642] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:05:18.189636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710613c7-fbd9-4d4f-ae4d-5c71ebb338ea admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:05:18.191043 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-710613c7-fbd9-4d4f-ae4d-5c71ebb338ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:05:18.247794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710613c7-fbd9-4d4f-ae4d-5c71ebb338ea admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:05:18.251947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c0b79-fd01-4220-9df7-ee0a3da77399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:05:18.252623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c0b79-fd01-4220-9df7-ee0a3da77399 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:18.252914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c0b79-fd01-4220-9df7-ee0a3da77399 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:18.253217 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c0b79-fd01-4220-9df7-ee0a3da77399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:18.262067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c0b79-fd01-4220-9df7-ee0a3da77399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:05:18.263444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c0b79-fd01-4220-9df7-ee0a3da77399 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:05:18.273662 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4315/8643] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:05:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:05:18.513563 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568234f2-4432-46a1-8daf-8fe6533d41eb None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:05:18.515123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-568234f2-4432-46a1-8daf-8fe6533d41eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:05:18.529273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568234f2-4432-46a1-8daf-8fe6533d41eb None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:05:18.534007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1d7d7-b0d4-4d39-8f48-a9a08107a314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:05:18.535430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1d7d7-b0d4-4d39-8f48-a9a08107a314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:18.535914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1d7d7-b0d4-4d39-8f48-a9a08107a314 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:18.536211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1d7d7-b0d4-4d39-8f48-a9a08107a314 admin admin] PATH_INFO: `/v3/projects/43505981798d4147970c495b8fa9c9e8` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:18.537474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1d7d7-b0d4-4d39-8f48-a9a08107a314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43505981798d4147970c495b8fa9c9e8)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:05:18.539429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1d7d7-b0d4-4d39-8f48-a9a08107a314 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:05:18.642991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4ac1d7d7-b0d4-4d39-8f48-a9a08107a314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43505981798d4147970c495b8fa9c9e8', 'request_id': 'req-4ac1d7d7-b0d4-4d39-8f48-a9a08107a314'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:05:18.711645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4ac1d7d7-b0d4-4d39-8f48-a9a08107a314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43505981798d4147970c495b8fa9c9e8', 'request_id': 'req-4ac1d7d7-b0d4-4d39-8f48-a9a08107a314'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:05:18.717989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4ac1d7d7-b0d4-4d39-8f48-a9a08107a314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43505981798d4147970c495b8fa9c9e8', 'request_id': 'req-4ac1d7d7-b0d4-4d39-8f48-a9a08107a314'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:05:18.728896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4ac1d7d7-b0d4-4d39-8f48-a9a08107a314 admin admin] The token cache is being invalidate because project 43505981798d4147970c495b8fa9c9e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 11:05:18.729191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4ac1d7d7-b0d4-4d39-8f48-a9a08107a314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:05:18.729873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-4ac1d7d7-b0d4-4d39-8f48-a9a08107a314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:05:18.731461 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4329/8644] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 11:05:18 2022] DELETE /identity/v3/projects/43505981798d4147970c495b8fa9c9e8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:05:18.736249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c0b79-fd01-4220-9df7-ee0a3da77399 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:05:18.746141 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c0b79-fd01-4220-9df7-ee0a3da77399 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:05:18.800377 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0975a2-320e-4cd2-aa6a-a704306717f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:05:18.801199 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0975a2-320e-4cd2-aa6a-a704306717f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:18.801486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0975a2-320e-4cd2-aa6a-a704306717f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:18.801765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0975a2-320e-4cd2-aa6a-a704306717f2 admin admin] PATH_INFO: `/v3/users/c2e3912c146b4cba897bd6cd36b9050a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:18.802948 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0975a2-320e-4cd2-aa6a-a704306717f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2e3912c146b4cba897bd6cd36b9050a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:05:18.804913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0975a2-320e-4cd2-aa6a-a704306717f2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:05:18.989758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7b0975a2-320e-4cd2-aa6a-a704306717f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2e3912c146b4cba897bd6cd36b9050a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:05:19.001673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7b0975a2-320e-4cd2-aa6a-a704306717f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2e3912c146b4cba897bd6cd36b9050a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:05:19.002357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7b0975a2-320e-4cd2-aa6a-a704306717f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2e3912c146b4cba897bd6cd36b9050a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:05:19.009024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7b0975a2-320e-4cd2-aa6a-a704306717f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2e3912c146b4cba897bd6cd36b9050a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:05:19.082878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7b0975a2-320e-4cd2-aa6a-a704306717f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2e3912c146b4cba897bd6cd36b9050a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:05:19.089033 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4316/8645] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 11:05:18 2022] DELETE /identity/v3/users/c2e3912c146b4cba897bd6cd36b9050a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:05:19.313586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1d7d7-b0d4-4d39-8f48-a9a08107a314 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:05:19.315191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4ac1d7d7-b0d4-4d39-8f48-a9a08107a314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:05:19.328594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1d7d7-b0d4-4d39-8f48-a9a08107a314 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:05:19.384693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7da7e4-05d1-4ce4-8645-95d9900c08d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:05:19.385590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7da7e4-05d1-4ce4-8645-95d9900c08d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:19.385900 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7da7e4-05d1-4ce4-8645-95d9900c08d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:19.386184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7da7e4-05d1-4ce4-8645-95d9900c08d5 admin admin] PATH_INFO: `/v3/projects/0db0df81ebed46f9a0522d116377565c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:19.387374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7da7e4-05d1-4ce4-8645-95d9900c08d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0db0df81ebed46f9a0522d116377565c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:05:19.389322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7da7e4-05d1-4ce4-8645-95d9900c08d5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:05:19.478977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ef7da7e4-05d1-4ce4-8645-95d9900c08d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0db0df81ebed46f9a0522d116377565c', 'request_id': 'req-ef7da7e4-05d1-4ce4-8645-95d9900c08d5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:05:19.542122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ef7da7e4-05d1-4ce4-8645-95d9900c08d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0db0df81ebed46f9a0522d116377565c', 'request_id': 'req-ef7da7e4-05d1-4ce4-8645-95d9900c08d5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:05:19.549195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ef7da7e4-05d1-4ce4-8645-95d9900c08d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0db0df81ebed46f9a0522d116377565c', 'request_id': 'req-ef7da7e4-05d1-4ce4-8645-95d9900c08d5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:05:19.559709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ef7da7e4-05d1-4ce4-8645-95d9900c08d5 admin admin] The token cache is being invalidate because project 0db0df81ebed46f9a0522d116377565c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 11:05:19.559998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ef7da7e4-05d1-4ce4-8645-95d9900c08d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:05:19.560685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ef7da7e4-05d1-4ce4-8645-95d9900c08d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:05:19.562267 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4330/8646] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 11:05:19 2022] DELETE /identity/v3/projects/0db0df81ebed46f9a0522d116377565c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 11:05:19.567720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36615685-f14d-425c-8ee0-c0b4234b5b18 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:19.568016 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36615685-f14d-425c-8ee0-c0b4234b5b18 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:19.568302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36615685-f14d-425c-8ee0-c0b4234b5b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:19.604932 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-36615685-f14d-425c-8ee0-c0b4234b5b18 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:05:19.606069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-36615685-f14d-425c-8ee0-c0b4234b5b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:05:19.663766 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4317/8647] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:05:19.672631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e419d-50f3-4edd-bfcc-d41a6e0d9a1f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:19.672943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e419d-50f3-4edd-bfcc-d41a6e0d9a1f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:19.673249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e419d-50f3-4edd-bfcc-d41a6e0d9a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:19.691862 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d33e419d-50f3-4edd-bfcc-d41a6e0d9a1f None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:05:19.693104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d33e419d-50f3-4edd-bfcc-d41a6e0d9a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:05:19.701369 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4331/8648] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:05:19.710871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36615685-f14d-425c-8ee0-c0b4234b5b18 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:05:19.721154 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36615685-f14d-425c-8ee0-c0b4234b5b18 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:05:19.726065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a52f0-3e41-4183-a7fa-1862bb5f918e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:05:19.726828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a52f0-3e41-4183-a7fa-1862bb5f918e admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:19.727146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a52f0-3e41-4183-a7fa-1862bb5f918e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:19.727456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a52f0-3e41-4183-a7fa-1862bb5f918e admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:19.728192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a52f0-3e41-4183-a7fa-1862bb5f918e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 11:05:19.728506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a52f0-3e41-4183-a7fa-1862bb5f918e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:05:19.730244 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a52f0-3e41-4183-a7fa-1862bb5f918e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:05:19.742503 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4318/8649] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 11:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 11:05:19.746873 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e419d-50f3-4edd-bfcc-d41a6e0d9a1f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:05:19.756128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e419d-50f3-4edd-bfcc-d41a6e0d9a1f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:05:19.761180 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194ebdf-e429-418d-b540-8297f702ad5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:05:19.761830 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194ebdf-e429-418d-b540-8297f702ad5d admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:19.762114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194ebdf-e429-418d-b540-8297f702ad5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:19.762389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194ebdf-e429-418d-b540-8297f702ad5d admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:19.763082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194ebdf-e429-418d-b540-8297f702ad5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:05:19.765082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194ebdf-e429-418d-b540-8297f702ad5d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:05:19.846668 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4332/8650] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 11:05:19 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:05:19.850814 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a52f0-3e41-4183-a7fa-1862bb5f918e admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:05:19.861622 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a52f0-3e41-4183-a7fa-1862bb5f918e admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:05:19.917516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa4e3f-7169-4b68-ba59-22a1a6ac3da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:05:19.918190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa4e3f-7169-4b68-ba59-22a1a6ac3da1 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:19.918470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa4e3f-7169-4b68-ba59-22a1a6ac3da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:19.918746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa4e3f-7169-4b68-ba59-22a1a6ac3da1 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:19.919422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa4e3f-7169-4b68-ba59-22a1a6ac3da1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:05:19.921374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa4e3f-7169-4b68-ba59-22a1a6ac3da1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:05:20.002722 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4319/8651] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 11:05:19 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:05:20.006882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194ebdf-e429-418d-b540-8297f702ad5d admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:05:20.017730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194ebdf-e429-418d-b540-8297f702ad5d admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:05:20.022502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d6f1f-eda2-48d4-8555-13c1113fa074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:05:20.023164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d6f1f-eda2-48d4-8555-13c1113fa074 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:20.023747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d6f1f-eda2-48d4-8555-13c1113fa074 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:20.024032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d6f1f-eda2-48d4-8555-13c1113fa074 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:20.024853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d6f1f-eda2-48d4-8555-13c1113fa074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:05:20.032283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d6f1f-eda2-48d4-8555-13c1113fa074 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:05:20.037571 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4333/8652] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:05:20.041887 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa4e3f-7169-4b68-ba59-22a1a6ac3da1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:05:20.052096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa4e3f-7169-4b68-ba59-22a1a6ac3da1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:05:20.056990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00986cf3-4f98-4318-8d89-5aed6ef748c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:05:20.058795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00986cf3-4f98-4318-8d89-5aed6ef748c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:20.058795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00986cf3-4f98-4318-8d89-5aed6ef748c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:20.058795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00986cf3-4f98-4318-8d89-5aed6ef748c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:20.059082 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00986cf3-4f98-4318-8d89-5aed6ef748c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:05:20.060494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00986cf3-4f98-4318-8d89-5aed6ef748c4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:05:20.071012 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4320/8653] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:05:20.075137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d6f1f-eda2-48d4-8555-13c1113fa074 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:05:20.085506 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d6f1f-eda2-48d4-8555-13c1113fa074 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:05:20.090235 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d1f5c-db4a-4060-9086-7aa7dc74c595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:05:20.091121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d1f5c-db4a-4060-9086-7aa7dc74c595 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:20.091411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d1f5c-db4a-4060-9086-7aa7dc74c595 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:20.091697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d1f5c-db4a-4060-9086-7aa7dc74c595 admin admin] PATH_INFO: `/v3/projects/dccab55a052648fbb6bbc3b93eaf849b/users/ea624fdbcf21473e8572542184a717df/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:20.107027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d1f5c-db4a-4060-9086-7aa7dc74c595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dccab55a052648fbb6bbc3b93eaf849b, user_id=ea624fdbcf21473e8572542184a717df, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:05:20.109819 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d1f5c-db4a-4060-9086-7aa7dc74c595 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:05:20.170808 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4334/8654] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:05:20 2022] PUT /identity/v3/projects/dccab55a052648fbb6bbc3b93eaf849b/users/ea624fdbcf21473e8572542184a717df/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 11:05:20.175995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78ac2b-5498-451e-b2f6-9f2b3de5418e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:20.176299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78ac2b-5498-451e-b2f6-9f2b3de5418e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:20.176583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78ac2b-5498-451e-b2f6-9f2b3de5418e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:20.193823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5a78ac2b-5498-451e-b2f6-9f2b3de5418e None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:05:20.195058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5a78ac2b-5498-451e-b2f6-9f2b3de5418e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:05:20.254358 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4321/8655] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 11:05:20.263973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d1f5c-db4a-4060-9086-7aa7dc74c595 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:05:20.266318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-fc8d1f5c-db4a-4060-9086-7aa7dc74c595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:05:20.322302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d1f5c-db4a-4060-9086-7aa7dc74c595 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:05:20.326044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504199a-9ded-45af-b9a8-93db4d7e3087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:05:20.326682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504199a-9ded-45af-b9a8-93db4d7e3087 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:20.326964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504199a-9ded-45af-b9a8-93db4d7e3087 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:20.327237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504199a-9ded-45af-b9a8-93db4d7e3087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:20.336732 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504199a-9ded-45af-b9a8-93db4d7e3087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:05:20.338142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504199a-9ded-45af-b9a8-93db4d7e3087 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:05:20.347433 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4335/8656] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:05:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:05:25.522092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d15f18-e7b1-4fb2-8d5b-dde8c398768c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:25.523035 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d15f18-e7b1-4fb2-8d5b-dde8c398768c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:25.523775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d15f18-e7b1-4fb2-8d5b-dde8c398768c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:25.557423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a5d15f18-e7b1-4fb2-8d5b-dde8c398768c None None] MFA Rules not processed for user `ea624fdbcf21473e8572542184a717df`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:05:25.558655 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a5d15f18-e7b1-4fb2-8d5b-dde8c398768c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:05:25.629855 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4322/8657] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:05:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:05:25.632663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504199a-9ded-45af-b9a8-93db4d7e3087 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:05:25.642797 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504199a-9ded-45af-b9a8-93db4d7e3087 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:05:25.647891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ca416-230e-42c0-8951-9a415c8e5543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:05:25.648928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ca416-230e-42c0-8951-9a415c8e5543 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:25.649221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ca416-230e-42c0-8951-9a415c8e5543 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:25.649509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ca416-230e-42c0-8951-9a415c8e5543 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:25.650275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ca416-230e-42c0-8951-9a415c8e5543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:05:25.652221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ca416-230e-42c0-8951-9a415c8e5543 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:05:25.746328 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4336/8658] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 11:05:25 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:05:25.750170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d15f18-e7b1-4fb2-8d5b-dde8c398768c None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:05:25.761312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d15f18-e7b1-4fb2-8d5b-dde8c398768c None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:05:25.819787 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7e03c-68de-4014-9f21-765fdb808096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:05:25.820218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7e03c-68de-4014-9f21-765fdb808096 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:25.820504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7e03c-68de-4014-9f21-765fdb808096 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:25.820819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7e03c-68de-4014-9f21-765fdb808096 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:25.821520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7e03c-68de-4014-9f21-765fdb808096 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:05:25.823474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7e03c-68de-4014-9f21-765fdb808096 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:05:25.951702 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4323/8659] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 11:05:25 2022] POST /identity/v3/users => generated 298 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:05:25.955779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ca416-230e-42c0-8951-9a415c8e5543 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:05:25.972486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ca416-230e-42c0-8951-9a415c8e5543 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:05:25.977178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db930af2-531a-4ff8-adad-247c1446670a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:05:25.977906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db930af2-531a-4ff8-adad-247c1446670a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:25.978221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db930af2-531a-4ff8-adad-247c1446670a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:25.978590 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db930af2-531a-4ff8-adad-247c1446670a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:25.979315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db930af2-531a-4ff8-adad-247c1446670a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:05:25.980943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db930af2-531a-4ff8-adad-247c1446670a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:05:25.991728 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4337/8660] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 11:05:25.996038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7e03c-68de-4014-9f21-765fdb808096 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:05:26.010382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7e03c-68de-4014-9f21-765fdb808096 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:05:26.015917 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149b29c-af4a-4b8e-8b06-46b4d28d6d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:05:26.016936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149b29c-af4a-4b8e-8b06-46b4d28d6d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:26.017227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149b29c-af4a-4b8e-8b06-46b4d28d6d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:26.017509 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149b29c-af4a-4b8e-8b06-46b4d28d6d0b admin admin] PATH_INFO: `/v3/projects/0f0f1a13956849548d75099cffd4b83b/users/2971059a5d0a4461b0ba08289731d5c6/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:26.034517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149b29c-af4a-4b8e-8b06-46b4d28d6d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f0f1a13956849548d75099cffd4b83b, user_id=2971059a5d0a4461b0ba08289731d5c6, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:05:26.038868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149b29c-af4a-4b8e-8b06-46b4d28d6d0b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:05:26.137875 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4324/8661] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:05:25 2022] PUT /identity/v3/projects/0f0f1a13956849548d75099cffd4b83b/users/2971059a5d0a4461b0ba08289731d5c6/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 11:05:26.146402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db930af2-531a-4ff8-adad-247c1446670a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:05:26.157692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db930af2-531a-4ff8-adad-247c1446670a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:05:26.214037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a375084-9ff3-45e1-8b7d-d882e4ea26dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:05:26.214717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a375084-9ff3-45e1-8b7d-d882e4ea26dc admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:26.215001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a375084-9ff3-45e1-8b7d-d882e4ea26dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:26.215277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a375084-9ff3-45e1-8b7d-d882e4ea26dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:26.216003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a375084-9ff3-45e1-8b7d-d882e4ea26dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:05:26.217631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a375084-9ff3-45e1-8b7d-d882e4ea26dc admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:05:26.228858 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4338/8662] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 11:05:26.233170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149b29c-af4a-4b8e-8b06-46b4d28d6d0b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:05:26.243786 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149b29c-af4a-4b8e-8b06-46b4d28d6d0b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:05:26.248665 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f360a9c-4d6c-4f11-9657-6b8985f08965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:05:26.250064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f360a9c-4d6c-4f11-9657-6b8985f08965 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:26.250348 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f360a9c-4d6c-4f11-9657-6b8985f08965 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:26.250623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f360a9c-4d6c-4f11-9657-6b8985f08965 admin admin] PATH_INFO: `/v3/projects/0f0f1a13956849548d75099cffd4b83b/users/2971059a5d0a4461b0ba08289731d5c6/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:26.252678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f360a9c-4d6c-4f11-9657-6b8985f08965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f0f1a13956849548d75099cffd4b83b, user_id=2971059a5d0a4461b0ba08289731d5c6, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:05:26.255347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f360a9c-4d6c-4f11-9657-6b8985f08965 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:05:26.266697 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4325/8663] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:05:26 2022] PUT /identity/v3/projects/0f0f1a13956849548d75099cffd4b83b/users/2971059a5d0a4461b0ba08289731d5c6/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:05:31.780119 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f094e-c58e-4a4d-8e39-cabcaf10365e None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:31.781242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f094e-c58e-4a4d-8e39-cabcaf10365e None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:31.781357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f094e-c58e-4a4d-8e39-cabcaf10365e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:31.809908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1b6f094e-c58e-4a4d-8e39-cabcaf10365e None None] MFA Rules not processed for user `2971059a5d0a4461b0ba08289731d5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:05:31.811312 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1b6f094e-c58e-4a4d-8e39-cabcaf10365e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:05:31.883398 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4339/8664] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:05:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:05:31.891771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f360a9c-4d6c-4f11-9657-6b8985f08965 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:05:31.893617 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4f360a9c-4d6c-4f11-9657-6b8985f08965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:05:31.993223 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f360a9c-4d6c-4f11-9657-6b8985f08965 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:05:31.997872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2cc06-7901-4c46-a396-f5221f33bfb8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:05:31.998647 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2cc06-7901-4c46-a396-f5221f33bfb8 service glance] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:05:31.999036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2cc06-7901-4c46-a396-f5221f33bfb8 service glance] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:05:31.999445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2cc06-7901-4c46-a396-f5221f33bfb8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:05:32.067992 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb2cc06-7901-4c46-a396-f5221f33bfb8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:05:32.069503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb2cc06-7901-4c46-a396-f5221f33bfb8 service glance] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:05:32.080783 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4326/8665] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:05:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:07:08.975480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd99e3e-ed88-4f95-9eee-a37598e0d856 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:07:08.976026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd99e3e-ed88-4f95-9eee-a37598e0d856 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:07:08.976026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd99e3e-ed88-4f95-9eee-a37598e0d856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:07:08.993683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8dd99e3e-ed88-4f95-9eee-a37598e0d856 None None] MFA Rules not processed for user `ea624fdbcf21473e8572542184a717df`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:07:08.995215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8dd99e3e-ed88-4f95-9eee-a37598e0d856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:07:09.001889 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4340/8666] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:07:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:07:09.315454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0efdd0-1bb0-41ae-8e2c-03f9420c98a0 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:07:09.316021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0efdd0-1bb0-41ae-8e2c-03f9420c98a0 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:07:09.316021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0efdd0-1bb0-41ae-8e2c-03f9420c98a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:07:09.351031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-eb0efdd0-1bb0-41ae-8e2c-03f9420c98a0 None None] MFA Rules not processed for user `4cd9fe10f94f43aeb3eb10009ee96ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:07:09.352237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-eb0efdd0-1bb0-41ae-8e2c-03f9420c98a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:07:09.400956 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4327/8667] 10.222.0.16 () {58 vars in 1061 bytes} [Mon May 2 11:07:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:07:09.406749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd99e3e-ed88-4f95-9eee-a37598e0d856 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:07:09.415929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd99e3e-ed88-4f95-9eee-a37598e0d856 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:07:09.419441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909c877-e9c6-4bb3-a776-9d357412f261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:07:09.420074 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909c877-e9c6-4bb3-a776-9d357412f261 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:07:09.420355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909c877-e9c6-4bb3-a776-9d357412f261 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:07:09.420655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909c877-e9c6-4bb3-a776-9d357412f261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:07:09.422404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7909c877-e9c6-4bb3-a776-9d357412f261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:07:09.434170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909c877-e9c6-4bb3-a776-9d357412f261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:07:09.435630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909c877-e9c6-4bb3-a776-9d357412f261 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:07:09.446500 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4341/8668] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:07:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 11:07:24.865335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0efdd0-1bb0-41ae-8e2c-03f9420c98a0 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:07:24.873287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0efdd0-1bb0-41ae-8e2c-03f9420c98a0 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:07:24.877518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6f3e8-bed8-4f0d-9e69-32daa5340926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:07:24.878159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6f3e8-bed8-4f0d-9e69-32daa5340926 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:07:24.878443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6f3e8-bed8-4f0d-9e69-32daa5340926 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:07:24.878722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6f3e8-bed8-4f0d-9e69-32daa5340926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:07:24.887604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6f3e8-bed8-4f0d-9e69-32daa5340926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:07:24.889084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6f3e8-bed8-4f0d-9e69-32daa5340926 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:07:24.898457 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4328/8669] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:07:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:08:03.857411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909c877-e9c6-4bb3-a776-9d357412f261 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:08:03.858903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7909c877-e9c6-4bb3-a776-9d357412f261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:08:03.940722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909c877-e9c6-4bb3-a776-9d357412f261 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:08:03.947276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d89e0-bf50-4ba2-9842-06c9deddc066 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:08:03.947933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d89e0-bf50-4ba2-9842-06c9deddc066 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:08:03.948217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d89e0-bf50-4ba2-9842-06c9deddc066 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:08:03.948497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d89e0-bf50-4ba2-9842-06c9deddc066 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:08:03.950388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8c7d89e0-bf50-4ba2-9842-06c9deddc066 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:08:03.965356 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d89e0-bf50-4ba2-9842-06c9deddc066 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:08:03.966950 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d89e0-bf50-4ba2-9842-06c9deddc066 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:08:03.977798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6f3e8-bed8-4f0d-9e69-32daa5340926 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:08:03.979215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-44c6f3e8-bed8-4f0d-9e69-32daa5340926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:08:03.979348 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4342/8670] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:08:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:08:04.000025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6f3e8-bed8-4f0d-9e69-32daa5340926 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:08:04.005667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ce1c9-2e04-49d5-80d8-cef616519368 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:08:04.006102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ce1c9-2e04-49d5-80d8-cef616519368 service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:08:04.006102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ce1c9-2e04-49d5-80d8-cef616519368 service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:08:04.006304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ce1c9-2e04-49d5-80d8-cef616519368 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:08:04.008020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2a4ce1c9-2e04-49d5-80d8-cef616519368 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:08:04.023062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ce1c9-2e04-49d5-80d8-cef616519368 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:08:04.024800 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ce1c9-2e04-49d5-80d8-cef616519368 service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:08:04.038312 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4329/8671] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:08:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 11:08:07.585841 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1ba8c-1274-45a7-ba03-fd29e95d17c5 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:08:07.586428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1ba8c-1274-45a7-ba03-fd29e95d17c5 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:08:07.586428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1ba8c-1274-45a7-ba03-fd29e95d17c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:08:07.604110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-30e1ba8c-1274-45a7-ba03-fd29e95d17c5 None None] MFA Rules not processed for user `4cd9fe10f94f43aeb3eb10009ee96ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:08:07.605420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-30e1ba8c-1274-45a7-ba03-fd29e95d17c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:08:07.612029 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4343/8672] 10.222.0.16 () {58 vars in 1061 bytes} [Mon May 2 11:08:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:08:07.618104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ce1c9-2e04-49d5-80d8-cef616519368 service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:08:07.627850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ce1c9-2e04-49d5-80d8-cef616519368 service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:08:07.631495 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519fbc5-2a38-4738-b359-fb25bb76f160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:08:07.632130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519fbc5-2a38-4738-b359-fb25bb76f160 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:08:07.632418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519fbc5-2a38-4738-b359-fb25bb76f160 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:08:07.632733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519fbc5-2a38-4738-b359-fb25bb76f160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:08:07.634491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0519fbc5-2a38-4738-b359-fb25bb76f160 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:08:07.647048 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519fbc5-2a38-4738-b359-fb25bb76f160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:08:07.648477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519fbc5-2a38-4738-b359-fb25bb76f160 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:08:07.659136 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4330/8673] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:08:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:12:21.695452 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1ba8c-1274-45a7-ba03-fd29e95d17c5 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:12:21.715010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1ba8c-1274-45a7-ba03-fd29e95d17c5 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:12:21.718850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6dc575-0e1d-40ad-b7f2-308c70f1193e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:12:21.719509 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6dc575-0e1d-40ad-b7f2-308c70f1193e service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:12:21.719795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6dc575-0e1d-40ad-b7f2-308c70f1193e service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:12:21.720077 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6dc575-0e1d-40ad-b7f2-308c70f1193e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:12:21.741733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6dc575-0e1d-40ad-b7f2-308c70f1193e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:12:21.743197 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6dc575-0e1d-40ad-b7f2-308c70f1193e service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:12:21.752189 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4344/8674] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:12:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 11:12:22.700869 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519fbc5-2a38-4738-b359-fb25bb76f160 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:12:22.702385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0519fbc5-2a38-4738-b359-fb25bb76f160 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:12:22.839330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519fbc5-2a38-4738-b359-fb25bb76f160 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:12:22.845159 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b5e14-b3d4-48b5-88f2-5d51a4209dab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:12:22.845821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b5e14-b3d4-48b5-88f2-5d51a4209dab service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:12:22.846109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b5e14-b3d4-48b5-88f2-5d51a4209dab service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:12:22.846394 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b5e14-b3d4-48b5-88f2-5d51a4209dab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:12:22.848284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1e2b5e14-b3d4-48b5-88f2-5d51a4209dab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:12:22.866732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b5e14-b3d4-48b5-88f2-5d51a4209dab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:12:22.868682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b5e14-b3d4-48b5-88f2-5d51a4209dab service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:12:22.883506 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4331/8675] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:12:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:12:23.065858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6dc575-0e1d-40ad-b7f2-308c70f1193e service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:12:23.075988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6dc575-0e1d-40ad-b7f2-308c70f1193e service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:12:23.080641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009de2e9-15fc-47ff-9b11-a6bdc6ddd3dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:12:23.081549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009de2e9-15fc-47ff-9b11-a6bdc6ddd3dd service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:12:23.082162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009de2e9-15fc-47ff-9b11-a6bdc6ddd3dd service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:12:23.082679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009de2e9-15fc-47ff-9b11-a6bdc6ddd3dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:12:23.085127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-009de2e9-15fc-47ff-9b11-a6bdc6ddd3dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:12:23.105467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009de2e9-15fc-47ff-9b11-a6bdc6ddd3dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:12:23.107078 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009de2e9-15fc-47ff-9b11-a6bdc6ddd3dd service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:12:23.121621 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4345/8676] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:12:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:12:24.322138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b5e14-b3d4-48b5-88f2-5d51a4209dab service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:12:24.331306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b5e14-b3d4-48b5-88f2-5d51a4209dab service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:12:24.335384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0a7c8-c609-46f6-8c7e-5b4f64dce5d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:12:24.336012 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0a7c8-c609-46f6-8c7e-5b4f64dce5d3 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:12:24.336297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0a7c8-c609-46f6-8c7e-5b4f64dce5d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:12:24.336569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0a7c8-c609-46f6-8c7e-5b4f64dce5d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:12:24.338379 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-19e0a7c8-c609-46f6-8c7e-5b4f64dce5d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:12:24.354897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0a7c8-c609-46f6-8c7e-5b4f64dce5d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:12:24.356380 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0a7c8-c609-46f6-8c7e-5b4f64dce5d3 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:12:24.369650 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4332/8677] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:12:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:12:24.474978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009de2e9-15fc-47ff-9b11-a6bdc6ddd3dd service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:12:24.490081 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009de2e9-15fc-47ff-9b11-a6bdc6ddd3dd service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:12:24.496010 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1a71a-904e-453e-8b78-c0544fea01a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:12:24.496692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1a71a-904e-453e-8b78-c0544fea01a9 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:12:24.496988 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1a71a-904e-453e-8b78-c0544fea01a9 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:12:24.497287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1a71a-904e-453e-8b78-c0544fea01a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:12:24.499055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1bb1a71a-904e-453e-8b78-c0544fea01a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:12:24.515285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1a71a-904e-453e-8b78-c0544fea01a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:12:24.515285 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1a71a-904e-453e-8b78-c0544fea01a9 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:12:24.529056 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4346/8678] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:12:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:12:43.059140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0a7c8-c609-46f6-8c7e-5b4f64dce5d3 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:12:43.067430 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0a7c8-c609-46f6-8c7e-5b4f64dce5d3 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:12:43.071635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70337fe-ea38-42ea-a5a2-5cb5b444ee83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:12:43.072263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70337fe-ea38-42ea-a5a2-5cb5b444ee83 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:12:43.072575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70337fe-ea38-42ea-a5a2-5cb5b444ee83 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:12:43.072875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70337fe-ea38-42ea-a5a2-5cb5b444ee83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:12:43.130173 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70337fe-ea38-42ea-a5a2-5cb5b444ee83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:12:43.132328 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70337fe-ea38-42ea-a5a2-5cb5b444ee83 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:12:43.141719 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4333/8679] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:12:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:12:50.586582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1a71a-904e-453e-8b78-c0544fea01a9 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:12:50.597926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1a71a-904e-453e-8b78-c0544fea01a9 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:12:50.608400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f20c7-9a50-4893-9ff7-101eccae9a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:12:50.608400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f20c7-9a50-4893-9ff7-101eccae9a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:12:50.608400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f20c7-9a50-4893-9ff7-101eccae9a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:12:50.608400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f20c7-9a50-4893-9ff7-101eccae9a24 admin admin] PATH_INFO: `/v3/users/ea624fdbcf21473e8572542184a717df` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:12:50.609069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f20c7-9a50-4893-9ff7-101eccae9a24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea624fdbcf21473e8572542184a717df)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:12:50.609069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f20c7-9a50-4893-9ff7-101eccae9a24 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:12:50.770592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-384f20c7-9a50-4893-9ff7-101eccae9a24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea624fdbcf21473e8572542184a717df'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:12:50.782859 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-384f20c7-9a50-4893-9ff7-101eccae9a24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea624fdbcf21473e8572542184a717df'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:12:50.783531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-384f20c7-9a50-4893-9ff7-101eccae9a24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea624fdbcf21473e8572542184a717df'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:12:50.791158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-384f20c7-9a50-4893-9ff7-101eccae9a24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea624fdbcf21473e8572542184a717df'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:12:50.836875 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-384f20c7-9a50-4893-9ff7-101eccae9a24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea624fdbcf21473e8572542184a717df'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:12:50.842779 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4347/8680] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 11:12:50 2022] DELETE /identity/v3/users/ea624fdbcf21473e8572542184a717df => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:12:51.090625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70337fe-ea38-42ea-a5a2-5cb5b444ee83 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:12:51.105860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70337fe-ea38-42ea-a5a2-5cb5b444ee83 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:12:51.165748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9ae64-5b35-43dd-8bdd-b222d19cfd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:12:51.166595 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9ae64-5b35-43dd-8bdd-b222d19cfd7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:12:51.166875 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9ae64-5b35-43dd-8bdd-b222d19cfd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:12:51.167152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9ae64-5b35-43dd-8bdd-b222d19cfd7f admin admin] PATH_INFO: `/v3/projects/dccab55a052648fbb6bbc3b93eaf849b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:12:51.168316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9ae64-5b35-43dd-8bdd-b222d19cfd7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dccab55a052648fbb6bbc3b93eaf849b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:12:51.170265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9ae64-5b35-43dd-8bdd-b222d19cfd7f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:12:51.281775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-16f9ae64-5b35-43dd-8bdd-b222d19cfd7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dccab55a052648fbb6bbc3b93eaf849b', 'request_id': 'req-16f9ae64-5b35-43dd-8bdd-b222d19cfd7f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:12:51.287945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-16f9ae64-5b35-43dd-8bdd-b222d19cfd7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dccab55a052648fbb6bbc3b93eaf849b', 'request_id': 'req-16f9ae64-5b35-43dd-8bdd-b222d19cfd7f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:12:51.351213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-16f9ae64-5b35-43dd-8bdd-b222d19cfd7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dccab55a052648fbb6bbc3b93eaf849b', 'request_id': 'req-16f9ae64-5b35-43dd-8bdd-b222d19cfd7f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:12:51.361634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-16f9ae64-5b35-43dd-8bdd-b222d19cfd7f admin admin] The token cache is being invalidate because project dccab55a052648fbb6bbc3b93eaf849b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 11:12:51.363161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-16f9ae64-5b35-43dd-8bdd-b222d19cfd7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:12:51.363161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-16f9ae64-5b35-43dd-8bdd-b222d19cfd7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:12:51.364106 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4334/8681] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 11:12:51 2022] DELETE /identity/v3/projects/dccab55a052648fbb6bbc3b93eaf849b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:12:51.368623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f20c7-9a50-4893-9ff7-101eccae9a24 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:12:51.370020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-384f20c7-9a50-4893-9ff7-101eccae9a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:12:51.383679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f20c7-9a50-4893-9ff7-101eccae9a24 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:12:51.437674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d6f0f-09a6-4e70-b1f0-d6fb490c1f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:12:51.438553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d6f0f-09a6-4e70-b1f0-d6fb490c1f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:12:51.438840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d6f0f-09a6-4e70-b1f0-d6fb490c1f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:12:51.439124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d6f0f-09a6-4e70-b1f0-d6fb490c1f68 admin admin] PATH_INFO: `/v3/users/2971059a5d0a4461b0ba08289731d5c6` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:12:51.440325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d6f0f-09a6-4e70-b1f0-d6fb490c1f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2971059a5d0a4461b0ba08289731d5c6)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:12:51.442363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d6f0f-09a6-4e70-b1f0-d6fb490c1f68 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:12:51.667683 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-714d6f0f-09a6-4e70-b1f0-d6fb490c1f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2971059a5d0a4461b0ba08289731d5c6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:12:51.679833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-714d6f0f-09a6-4e70-b1f0-d6fb490c1f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2971059a5d0a4461b0ba08289731d5c6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:12:51.680512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-714d6f0f-09a6-4e70-b1f0-d6fb490c1f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2971059a5d0a4461b0ba08289731d5c6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:12:51.687495 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-714d6f0f-09a6-4e70-b1f0-d6fb490c1f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2971059a5d0a4461b0ba08289731d5c6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:12:51.751726 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-714d6f0f-09a6-4e70-b1f0-d6fb490c1f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2971059a5d0a4461b0ba08289731d5c6'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:12:51.757882 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4348/8682] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 11:12:51 2022] DELETE /identity/v3/users/2971059a5d0a4461b0ba08289731d5c6 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:12:52.017403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9ae64-5b35-43dd-8bdd-b222d19cfd7f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:12:52.017403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-16f9ae64-5b35-43dd-8bdd-b222d19cfd7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:12:52.026678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9ae64-5b35-43dd-8bdd-b222d19cfd7f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:12:52.081789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067020bd-fabd-4f5e-969c-6ef137680ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:12:52.082765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067020bd-fabd-4f5e-969c-6ef137680ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:12:52.083050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067020bd-fabd-4f5e-969c-6ef137680ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:12:52.083322 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067020bd-fabd-4f5e-969c-6ef137680ec1 admin admin] PATH_INFO: `/v3/projects/0f0f1a13956849548d75099cffd4b83b` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:12:52.085033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067020bd-fabd-4f5e-969c-6ef137680ec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f0f1a13956849548d75099cffd4b83b)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:12:52.086943 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067020bd-fabd-4f5e-969c-6ef137680ec1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:12:52.207002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-067020bd-fabd-4f5e-969c-6ef137680ec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f0f1a13956849548d75099cffd4b83b', 'request_id': 'req-067020bd-fabd-4f5e-969c-6ef137680ec1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:12:52.213506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-067020bd-fabd-4f5e-969c-6ef137680ec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f0f1a13956849548d75099cffd4b83b', 'request_id': 'req-067020bd-fabd-4f5e-969c-6ef137680ec1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:12:52.276649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-067020bd-fabd-4f5e-969c-6ef137680ec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f0f1a13956849548d75099cffd4b83b', 'request_id': 'req-067020bd-fabd-4f5e-969c-6ef137680ec1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:12:52.286865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-067020bd-fabd-4f5e-969c-6ef137680ec1 admin admin] The token cache is being invalidate because project 0f0f1a13956849548d75099cffd4b83b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 11:12:52.289643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-067020bd-fabd-4f5e-969c-6ef137680ec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:12:52.289643 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-067020bd-fabd-4f5e-969c-6ef137680ec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:12:52.289887 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4335/8683] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 11:12:52 2022] DELETE /identity/v3/projects/0f0f1a13956849548d75099cffd4b83b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:13:02.394799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f234da-469e-4a23-97fe-d2043d8891c2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:02.395388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f234da-469e-4a23-97fe-d2043d8891c2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:02.395388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f234da-469e-4a23-97fe-d2043d8891c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:02.422994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-78f234da-469e-4a23-97fe-d2043d8891c2 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:13:02.424192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-78f234da-469e-4a23-97fe-d2043d8891c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:02.481168 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4349/8684] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:13:02.492284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be5dac-e3af-4a0a-b435-5e8309b62e93 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:02.492927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be5dac-e3af-4a0a-b435-5e8309b62e93 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:02.492927 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be5dac-e3af-4a0a-b435-5e8309b62e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:02.511291 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-36be5dac-e3af-4a0a-b435-5e8309b62e93 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:13:02.512538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-36be5dac-e3af-4a0a-b435-5e8309b62e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:02.520424 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4336/8685] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:13:02.525080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f234da-469e-4a23-97fe-d2043d8891c2 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:02.535044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f234da-469e-4a23-97fe-d2043d8891c2 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:02.539774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a639c7-6be4-43f7-8c79-1385e0a00377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:02.544460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a639c7-6be4-43f7-8c79-1385e0a00377 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:02.544460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a639c7-6be4-43f7-8c79-1385e0a00377 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:02.544460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a639c7-6be4-43f7-8c79-1385e0a00377 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:02.544460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a639c7-6be4-43f7-8c79-1385e0a00377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 11:13:02.544460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a639c7-6be4-43f7-8c79-1385e0a00377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:02.544460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a639c7-6be4-43f7-8c79-1385e0a00377 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:02.555863 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4350/8686] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 11:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 11:13:02.568311 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be5dac-e3af-4a0a-b435-5e8309b62e93 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:02.578211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be5dac-e3af-4a0a-b435-5e8309b62e93 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:02.582860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462b893-3adc-4ca6-bc13-5fca786d718c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:02.583506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462b893-3adc-4ca6-bc13-5fca786d718c admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:02.583791 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462b893-3adc-4ca6-bc13-5fca786d718c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:02.584153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462b893-3adc-4ca6-bc13-5fca786d718c admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:02.584877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462b893-3adc-4ca6-bc13-5fca786d718c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:02.586790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462b893-3adc-4ca6-bc13-5fca786d718c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:02.696016 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4337/8687] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 11:13:02 2022] POST /identity/v3/projects => generated 391 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:13:02.700304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a639c7-6be4-43f7-8c79-1385e0a00377 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:02.710268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a639c7-6be4-43f7-8c79-1385e0a00377 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:02.765609 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38cce9-cb65-448e-985e-b8c806da3393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:02.766277 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38cce9-cb65-448e-985e-b8c806da3393 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:02.766561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38cce9-cb65-448e-985e-b8c806da3393 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:02.766840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38cce9-cb65-448e-985e-b8c806da3393 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:02.767530 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38cce9-cb65-448e-985e-b8c806da3393 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:02.769458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38cce9-cb65-448e-985e-b8c806da3393 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:02.876754 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4351/8688] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 11:13:02 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 11:13:02.881490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462b893-3adc-4ca6-bc13-5fca786d718c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:02.891542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462b893-3adc-4ca6-bc13-5fca786d718c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:02.896067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716829a-88be-4186-b7d1-c1af195441f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:02.896783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716829a-88be-4186-b7d1-c1af195441f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:02.897069 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716829a-88be-4186-b7d1-c1af195441f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:02.897349 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716829a-88be-4186-b7d1-c1af195441f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:02.898064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716829a-88be-4186-b7d1-c1af195441f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:02.899660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716829a-88be-4186-b7d1-c1af195441f4 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:02.910189 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4338/8689] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:13:02.917754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38cce9-cb65-448e-985e-b8c806da3393 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:02.927658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38cce9-cb65-448e-985e-b8c806da3393 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:02.933196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977ebc1-e413-439a-a37b-676b46f352d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:02.933721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977ebc1-e413-439a-a37b-676b46f352d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:02.934009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977ebc1-e413-439a-a37b-676b46f352d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:02.934292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977ebc1-e413-439a-a37b-676b46f352d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:02.935021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977ebc1-e413-439a-a37b-676b46f352d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:02.936640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977ebc1-e413-439a-a37b-676b46f352d0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:02.947081 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4352/8690] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 11:13:02.951064 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716829a-88be-4186-b7d1-c1af195441f4 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:02.961025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716829a-88be-4186-b7d1-c1af195441f4 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:02.965758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04950b50-dd80-4840-bfa2-bf661db476c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:02.966627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04950b50-dd80-4840-bfa2-bf661db476c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:02.966941 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04950b50-dd80-4840-bfa2-bf661db476c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:02.967218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04950b50-dd80-4840-bfa2-bf661db476c7 admin admin] PATH_INFO: `/v3/projects/45f60d118286471cae9653ab9e36318c/users/df2587013fdb49148b7ef16b3c7beb2f/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:02.981646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04950b50-dd80-4840-bfa2-bf661db476c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f60d118286471cae9653ab9e36318c, user_id=df2587013fdb49148b7ef16b3c7beb2f, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:02.984306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04950b50-dd80-4840-bfa2-bf661db476c7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:03.088303 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4339/8691] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:13:02 2022] PUT /identity/v3/projects/45f60d118286471cae9653ab9e36318c/users/df2587013fdb49148b7ef16b3c7beb2f/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:13:03.106434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fee14-cfc4-43e7-90b5-1a9dcbb38fd3 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:03.106434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fee14-cfc4-43e7-90b5-1a9dcbb38fd3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:03.106434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fee14-cfc4-43e7-90b5-1a9dcbb38fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:03.127300 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-673fee14-cfc4-43e7-90b5-1a9dcbb38fd3 None None] MFA Rules not processed for user `df2587013fdb49148b7ef16b3c7beb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:13:03.128500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-673fee14-cfc4-43e7-90b5-1a9dcbb38fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:03.189688 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4353/8692] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:13:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:13:03.194306 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04950b50-dd80-4840-bfa2-bf661db476c7 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:03.255033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04950b50-dd80-4840-bfa2-bf661db476c7 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:03.259759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e64280-77f1-4a8d-89e0-733ccb4883c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:03.260419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e64280-77f1-4a8d-89e0-733ccb4883c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:03.260749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e64280-77f1-4a8d-89e0-733ccb4883c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:03.261032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e64280-77f1-4a8d-89e0-733ccb4883c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:03.261725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e64280-77f1-4a8d-89e0-733ccb4883c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:03.263641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e64280-77f1-4a8d-89e0-733ccb4883c9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:03.404502 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4340/8693] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 11:13:03 2022] POST /identity/v3/projects => generated 393 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:13:03.408818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fee14-cfc4-43e7-90b5-1a9dcbb38fd3 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:03.420391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fee14-cfc4-43e7-90b5-1a9dcbb38fd3 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:03.474352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53940852-cba7-4d83-87d7-760a49c86861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:03.475715 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53940852-cba7-4d83-87d7-760a49c86861 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:03.476004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53940852-cba7-4d83-87d7-760a49c86861 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:03.476286 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53940852-cba7-4d83-87d7-760a49c86861 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:03.477004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53940852-cba7-4d83-87d7-760a49c86861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:03.478908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53940852-cba7-4d83-87d7-760a49c86861 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:03.596860 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4354/8694] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 11:13:03 2022] POST /identity/v3/users => generated 303 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:13:03.601303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e64280-77f1-4a8d-89e0-733ccb4883c9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:03.611768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e64280-77f1-4a8d-89e0-733ccb4883c9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:03.616357 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4132c-b7d9-4858-af72-c8ed69ef7397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:03.617054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4132c-b7d9-4858-af72-c8ed69ef7397 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:03.617340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4132c-b7d9-4858-af72-c8ed69ef7397 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:03.617621 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4132c-b7d9-4858-af72-c8ed69ef7397 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:03.618391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4132c-b7d9-4858-af72-c8ed69ef7397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:03.619936 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4132c-b7d9-4858-af72-c8ed69ef7397 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:03.630509 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4341/8695] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:13:03.635028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53940852-cba7-4d83-87d7-760a49c86861 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:03.644989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53940852-cba7-4d83-87d7-760a49c86861 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:03.650246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e66eb5-3f36-4556-89d6-3953f2b5fe24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:03.651149 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e66eb5-3f36-4556-89d6-3953f2b5fe24 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:03.651437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e66eb5-3f36-4556-89d6-3953f2b5fe24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:03.651717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e66eb5-3f36-4556-89d6-3953f2b5fe24 admin admin] PATH_INFO: `/v3/projects/8dec7df6c82c449688e8eb5715aba72a/users/51a9b8bf77214b3dbc69421182e36146/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:03.666883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e66eb5-3f36-4556-89d6-3953f2b5fe24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dec7df6c82c449688e8eb5715aba72a, user_id=51a9b8bf77214b3dbc69421182e36146, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:03.669638 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e66eb5-3f36-4556-89d6-3953f2b5fe24 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:03.751476 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4355/8696] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:13:03 2022] PUT /identity/v3/projects/8dec7df6c82c449688e8eb5715aba72a/users/51a9b8bf77214b3dbc69421182e36146/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:13:03.756265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4132c-b7d9-4858-af72-c8ed69ef7397 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:03.766290 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4132c-b7d9-4858-af72-c8ed69ef7397 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:03.824110 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08dfda-b531-4593-97d5-e807bc655d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:03.824821 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08dfda-b531-4593-97d5-e807bc655d7c admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:03.825107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08dfda-b531-4593-97d5-e807bc655d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:03.825385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08dfda-b531-4593-97d5-e807bc655d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:03.826105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08dfda-b531-4593-97d5-e807bc655d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:03.827706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08dfda-b531-4593-97d5-e807bc655d7c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:03.837913 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4342/8697] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:13:03.842156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e66eb5-3f36-4556-89d6-3953f2b5fe24 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:03.853035 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e66eb5-3f36-4556-89d6-3953f2b5fe24 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:03.857647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900e165-d383-427e-8beb-b989f74f8c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:03.858529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900e165-d383-427e-8beb-b989f74f8c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:03.858812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900e165-d383-427e-8beb-b989f74f8c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:03.859091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900e165-d383-427e-8beb-b989f74f8c20 admin admin] PATH_INFO: `/v3/projects/8dec7df6c82c449688e8eb5715aba72a/users/51a9b8bf77214b3dbc69421182e36146/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:03.861135 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900e165-d383-427e-8beb-b989f74f8c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dec7df6c82c449688e8eb5715aba72a, user_id=51a9b8bf77214b3dbc69421182e36146, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:03.863812 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900e165-d383-427e-8beb-b989f74f8c20 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:03.873965 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4356/8698] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:13:03 2022] PUT /identity/v3/projects/8dec7df6c82c449688e8eb5715aba72a/users/51a9b8bf77214b3dbc69421182e36146/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:13:03.885896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e5cce-cba6-4b41-b9c1-50f215897c4f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:03.886194 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e5cce-cba6-4b41-b9c1-50f215897c4f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:03.886507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e5cce-cba6-4b41-b9c1-50f215897c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:03.914510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-631e5cce-cba6-4b41-b9c1-50f215897c4f None None] MFA Rules not processed for user `51a9b8bf77214b3dbc69421182e36146`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:13:03.915852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-631e5cce-cba6-4b41-b9c1-50f215897c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:03.981466 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4343/8699] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:13:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:13:03.993925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee016b-4928-426f-8cdd-2d487497352f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:03.994217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee016b-4928-426f-8cdd-2d487497352f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:03.994499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee016b-4928-426f-8cdd-2d487497352f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:04.012768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-bfee016b-4928-426f-8cdd-2d487497352f None None] MFA Rules not processed for user `df2587013fdb49148b7ef16b3c7beb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:13:04.013989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bfee016b-4928-426f-8cdd-2d487497352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:04.069443 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4357/8700] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:13:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:13:04.080953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e5cce-cba6-4b41-b9c1-50f215897c4f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:04.082404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-631e5cce-cba6-4b41-b9c1-50f215897c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:04.157841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e5cce-cba6-4b41-b9c1-50f215897c4f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:04.163808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba67ebd-c9db-41e8-9f27-afdfff087717 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:04.164529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba67ebd-c9db-41e8-9f27-afdfff087717 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:04.164846 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba67ebd-c9db-41e8-9f27-afdfff087717 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:04.165130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba67ebd-c9db-41e8-9f27-afdfff087717 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:04.173756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba67ebd-c9db-41e8-9f27-afdfff087717 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:04.175358 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba67ebd-c9db-41e8-9f27-afdfff087717 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:04.184907 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4344/8701] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:13:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:13:05.786012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6574eab-a2ef-4db3-9c5c-333a0477ca8b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:05.786512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6574eab-a2ef-4db3-9c5c-333a0477ca8b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:05.786623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6574eab-a2ef-4db3-9c5c-333a0477ca8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:05.845510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a6574eab-a2ef-4db3-9c5c-333a0477ca8b None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:13:05.846722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a6574eab-a2ef-4db3-9c5c-333a0477ca8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:05.906856 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4358/8702] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 11:13:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:13:05.918257 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba67ebd-c9db-41e8-9f27-afdfff087717 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:05.919635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6ba67ebd-c9db-41e8-9f27-afdfff087717 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:05.936192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba67ebd-c9db-41e8-9f27-afdfff087717 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:05.941075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0152ff3-2611-4e08-bd7e-8022264c4836 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:05.941701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0152ff3-2611-4e08-bd7e-8022264c4836 service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:05.942299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0152ff3-2611-4e08-bd7e-8022264c4836 service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:05.942582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0152ff3-2611-4e08-bd7e-8022264c4836 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:05.951473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0152ff3-2611-4e08-bd7e-8022264c4836 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:05.953072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0152ff3-2611-4e08-bd7e-8022264c4836 service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:05.963305 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4345/8703] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:13:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:13:09.050637 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6574eab-a2ef-4db3-9c5c-333a0477ca8b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:09.052109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a6574eab-a2ef-4db3-9c5c-333a0477ca8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:09.067734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6574eab-a2ef-4db3-9c5c-333a0477ca8b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:09.073756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ff4b4-9fbd-47c1-ab60-727836c724ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:09.074408 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ff4b4-9fbd-47c1-ab60-727836c724ed service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:09.074692 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ff4b4-9fbd-47c1-ab60-727836c724ed service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:09.074970 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ff4b4-9fbd-47c1-ab60-727836c724ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:09.077079 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-684ff4b4-9fbd-47c1-ab60-727836c724ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:09.091935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ff4b4-9fbd-47c1-ab60-727836c724ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:09.093628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ff4b4-9fbd-47c1-ab60-727836c724ed service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:09.107667 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4359/8704] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:13:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:13:10.812701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0152ff3-2611-4e08-bd7e-8022264c4836 service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:10.814203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c0152ff3-2611-4e08-bd7e-8022264c4836 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:10.882957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0152ff3-2611-4e08-bd7e-8022264c4836 service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:10.886519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc4738-778f-4c06-82ec-ae1ecf0c05a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:10.887161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc4738-778f-4c06-82ec-ae1ecf0c05a6 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:10.887445 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc4738-778f-4c06-82ec-ae1ecf0c05a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:10.887764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc4738-778f-4c06-82ec-ae1ecf0c05a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:10.889454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f7cc4738-778f-4c06-82ec-ae1ecf0c05a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:10.901187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc4738-778f-4c06-82ec-ae1ecf0c05a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:10.902619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc4738-778f-4c06-82ec-ae1ecf0c05a6 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:10.913204 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4346/8705] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:13:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:13:11.034126 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ff4b4-9fbd-47c1-ab60-727836c724ed service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:11.047044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ff4b4-9fbd-47c1-ab60-727836c724ed service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:11.052192 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27ee1c-1a21-4f2b-ab70-c96cda946f66 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:11.052879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27ee1c-1a21-4f2b-ab70-c96cda946f66 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:11.053662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27ee1c-1a21-4f2b-ab70-c96cda946f66 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:11.053942 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27ee1c-1a21-4f2b-ab70-c96cda946f66 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:11.055727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bf27ee1c-1a21-4f2b-ab70-c96cda946f66 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:11.070559 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27ee1c-1a21-4f2b-ab70-c96cda946f66 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:11.075616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27ee1c-1a21-4f2b-ab70-c96cda946f66 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:11.084716 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4360/8706] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:13:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:13:17.936837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc4738-778f-4c06-82ec-ae1ecf0c05a6 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:17.938361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f7cc4738-778f-4c06-82ec-ae1ecf0c05a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:17.956922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc4738-778f-4c06-82ec-ae1ecf0c05a6 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:17.963039 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c730c7-53c4-4262-84dc-1f9ef8a6501e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:17.963675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c730c7-53c4-4262-84dc-1f9ef8a6501e service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:17.963963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c730c7-53c4-4262-84dc-1f9ef8a6501e service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:17.964242 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c730c7-53c4-4262-84dc-1f9ef8a6501e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:17.965995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-73c730c7-53c4-4262-84dc-1f9ef8a6501e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:17.980441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c730c7-53c4-4262-84dc-1f9ef8a6501e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:17.982189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c730c7-53c4-4262-84dc-1f9ef8a6501e service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:17.995530 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4347/8707] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:13:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:13:19.675565 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27ee1c-1a21-4f2b-ab70-c96cda946f66 service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:19.691386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27ee1c-1a21-4f2b-ab70-c96cda946f66 service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:19.696858 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47892099-e29c-4125-b561-eeed31fb8d63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:19.697493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47892099-e29c-4125-b561-eeed31fb8d63 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:19.697778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47892099-e29c-4125-b561-eeed31fb8d63 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:19.698104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47892099-e29c-4125-b561-eeed31fb8d63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:19.706295 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47892099-e29c-4125-b561-eeed31fb8d63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:19.708059 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47892099-e29c-4125-b561-eeed31fb8d63 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:19.717738 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4361/8708] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:13:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:13:19.731793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee496f71-b948-4582-a2e0-fc5fb4774236 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:19.732219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee496f71-b948-4582-a2e0-fc5fb4774236 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:19.732387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee496f71-b948-4582-a2e0-fc5fb4774236 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:19.733836 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4348/8709] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 11:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 11:13:19.738152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47892099-e29c-4125-b561-eeed31fb8d63 service nova] Authenticating service token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 11:13:19.751648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47892099-e29c-4125-b561-eeed31fb8d63 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:19.759743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47892099-e29c-4125-b561-eeed31fb8d63 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:19.764402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371622ae-6cb1-4b09-8014-225f204706b0 tempest-ServersAdminNegativeTestJSON-1998345070 tempest-ServersAdminNegativeTestJSON-1998345070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a9b8bf77214b3dbc69421182e36146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dec7df6c82c449688e8eb5715aba72a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:19.765276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371622ae-6cb1-4b09-8014-225f204706b0 tempest-ServersAdminNegativeTestJSON-1998345070 tempest-ServersAdminNegativeTestJSON-1998345070-project-admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:19.765569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371622ae-6cb1-4b09-8014-225f204706b0 tempest-ServersAdminNegativeTestJSON-1998345070 tempest-ServersAdminNegativeTestJSON-1998345070-project-admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:19.765857 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371622ae-6cb1-4b09-8014-225f204706b0 tempest-ServersAdminNegativeTestJSON-1998345070 tempest-ServersAdminNegativeTestJSON-1998345070-project-admin] PATH_INFO: `/v3/projects/8dec7df6c82c449688e8eb5715aba72a` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:19.767066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371622ae-6cb1-4b09-8014-225f204706b0 tempest-ServersAdminNegativeTestJSON-1998345070 tempest-ServersAdminNegativeTestJSON-1998345070-project-admin] RBAC: Authorizing `identity:get_project(project_id=8dec7df6c82c449688e8eb5715aba72a)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:19.768868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371622ae-6cb1-4b09-8014-225f204706b0 tempest-ServersAdminNegativeTestJSON-1998345070 tempest-ServersAdminNegativeTestJSON-1998345070-project-admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:19.770531 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4362/8710] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 11:13:19 2022] GET /identity/v3/projects/8dec7df6c82c449688e8eb5715aba72a => generated 393 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 11:13:19.991590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee496f71-b948-4582-a2e0-fc5fb4774236 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:20.002374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee496f71-b948-4582-a2e0-fc5fb4774236 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:20.005953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a5b50-007b-4330-be1a-b134c8a42941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:20.006589 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a5b50-007b-4330-be1a-b134c8a42941 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:20.006874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a5b50-007b-4330-be1a-b134c8a42941 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:20.007153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a5b50-007b-4330-be1a-b134c8a42941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:20.008979 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6a0a5b50-007b-4330-be1a-b134c8a42941 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:20.020557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a5b50-007b-4330-be1a-b134c8a42941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:20.022503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a5b50-007b-4330-be1a-b134c8a42941 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:20.032950 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4349/8711] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:13:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:13:20.217910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6af57e-77af-495d-928a-2e518857c56a None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:20.218278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6af57e-77af-495d-928a-2e518857c56a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:20.218570 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6af57e-77af-495d-928a-2e518857c56a None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:20.219949 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4363/8712] 10.222.0.16 () {54 vars in 912 bytes} [Mon May 2 11:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 11:13:20.224528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a5b50-007b-4330-be1a-b134c8a42941 service neutron] Authenticating service token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 02 11:13:20.240462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a5b50-007b-4330-be1a-b134c8a42941 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:20.249789 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a5b50-007b-4330-be1a-b134c8a42941 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:20.254504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e9f7f-4685-453d-8aec-bd6fe918090d tempest-ServersAdminNegativeTestJSON-1998345070 tempest-ServersAdminNegativeTestJSON-1998345070-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51a9b8bf77214b3dbc69421182e36146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dec7df6c82c449688e8eb5715aba72a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:20.255412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e9f7f-4685-453d-8aec-bd6fe918090d tempest-ServersAdminNegativeTestJSON-1998345070 tempest-ServersAdminNegativeTestJSON-1998345070-project-admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:20.255706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e9f7f-4685-453d-8aec-bd6fe918090d tempest-ServersAdminNegativeTestJSON-1998345070 tempest-ServersAdminNegativeTestJSON-1998345070-project-admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:20.256485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e9f7f-4685-453d-8aec-bd6fe918090d tempest-ServersAdminNegativeTestJSON-1998345070 tempest-ServersAdminNegativeTestJSON-1998345070-project-admin] PATH_INFO: `/v3/projects/8dec7df6c82c449688e8eb5715aba72a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:20.257723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e9f7f-4685-453d-8aec-bd6fe918090d tempest-ServersAdminNegativeTestJSON-1998345070 tempest-ServersAdminNegativeTestJSON-1998345070-project-admin] RBAC: Authorizing `identity:get_project(project_id=8dec7df6c82c449688e8eb5715aba72a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:20.259503 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e9f7f-4685-453d-8aec-bd6fe918090d tempest-ServersAdminNegativeTestJSON-1998345070 tempest-ServersAdminNegativeTestJSON-1998345070-project-admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:20.261235 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4350/8713] 10.222.0.16 () {58 vars in 1443 bytes} [Mon May 2 11:13:20 2022] GET /identity/v3/projects/8dec7df6c82c449688e8eb5715aba72a => generated 393 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 11:13:20.470666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6af57e-77af-495d-928a-2e518857c56a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:20.472365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ba6af57e-77af-495d-928a-2e518857c56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:20.485143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6af57e-77af-495d-928a-2e518857c56a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:20.488698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e232a-f98f-4fba-a29e-f5cecb98615a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:20.489328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e232a-f98f-4fba-a29e-f5cecb98615a service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:20.489613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e232a-f98f-4fba-a29e-f5cecb98615a service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:20.489893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e232a-f98f-4fba-a29e-f5cecb98615a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:20.492071 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e65e232a-f98f-4fba-a29e-f5cecb98615a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:20.503594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e232a-f98f-4fba-a29e-f5cecb98615a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:20.505109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e232a-f98f-4fba-a29e-f5cecb98615a service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:20.515843 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4364/8714] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:13:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:13:24.560255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e9f7f-4685-453d-8aec-bd6fe918090d tempest-ServersAdminNegativeTestJSON-1998345070 tempest-ServersAdminNegativeTestJSON-1998345070-project-admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:24.620720 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e9f7f-4685-453d-8aec-bd6fe918090d tempest-ServersAdminNegativeTestJSON-1998345070 tempest-ServersAdminNegativeTestJSON-1998345070-project-admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:24.626198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c9cbd-fb07-4567-855d-e2f285d079cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:24.627142 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c9cbd-fb07-4567-855d-e2f285d079cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:24.627456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c9cbd-fb07-4567-855d-e2f285d079cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:24.627737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c9cbd-fb07-4567-855d-e2f285d079cd admin admin] PATH_INFO: `/v3/users/df2587013fdb49148b7ef16b3c7beb2f` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:24.628959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c9cbd-fb07-4567-855d-e2f285d079cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=df2587013fdb49148b7ef16b3c7beb2f)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:24.631392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c9cbd-fb07-4567-855d-e2f285d079cd admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:24.786274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f75c9cbd-fb07-4567-855d-e2f285d079cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df2587013fdb49148b7ef16b3c7beb2f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:13:24.797623 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f75c9cbd-fb07-4567-855d-e2f285d079cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df2587013fdb49148b7ef16b3c7beb2f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:13:24.798304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f75c9cbd-fb07-4567-855d-e2f285d079cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df2587013fdb49148b7ef16b3c7beb2f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:13:24.805112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f75c9cbd-fb07-4567-855d-e2f285d079cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df2587013fdb49148b7ef16b3c7beb2f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:13:24.864795 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f75c9cbd-fb07-4567-855d-e2f285d079cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df2587013fdb49148b7ef16b3c7beb2f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:13:24.870860 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4351/8715] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 11:13:24 2022] DELETE /identity/v3/users/df2587013fdb49148b7ef16b3c7beb2f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:13:24.875540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c01f1-820a-49e9-b50f-7e5e99828156 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:24.876122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c01f1-820a-49e9-b50f-7e5e99828156 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:24.876122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c01f1-820a-49e9-b50f-7e5e99828156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:24.893867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-b32c01f1-820a-49e9-b50f-7e5e99828156 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:13:24.895053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b32c01f1-820a-49e9-b50f-7e5e99828156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:24.950711 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4365/8716] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:13:24.961024 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c9cbd-fb07-4567-855d-e2f285d079cd admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:24.962419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f75c9cbd-fb07-4567-855d-e2f285d079cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:25.017469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c9cbd-fb07-4567-855d-e2f285d079cd admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:25.021156 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ee009-bc12-45cb-a9f3-65a3d33c44cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:25.021794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ee009-bc12-45cb-a9f3-65a3d33c44cc service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:25.022081 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ee009-bc12-45cb-a9f3-65a3d33c44cc service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:25.022363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ee009-bc12-45cb-a9f3-65a3d33c44cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:25.031614 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ee009-bc12-45cb-a9f3-65a3d33c44cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:25.033079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ee009-bc12-45cb-a9f3-65a3d33c44cc service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:25.042469 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4352/8717] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:13:25.300960 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c01f1-820a-49e9-b50f-7e5e99828156 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:25.302431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b32c01f1-820a-49e9-b50f-7e5e99828156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:25.323131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c01f1-820a-49e9-b50f-7e5e99828156 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:25.323131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae100a-928e-42b9-a7ba-889502f3bfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:25.323131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae100a-928e-42b9-a7ba-889502f3bfcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:25.323131 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae100a-928e-42b9-a7ba-889502f3bfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:25.323554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae100a-928e-42b9-a7ba-889502f3bfcb admin admin] PATH_INFO: `/v3/projects/45f60d118286471cae9653ab9e36318c` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:25.324334 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae100a-928e-42b9-a7ba-889502f3bfcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=45f60d118286471cae9653ab9e36318c)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:25.326514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae100a-928e-42b9-a7ba-889502f3bfcb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:25.413287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-95ae100a-928e-42b9-a7ba-889502f3bfcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45f60d118286471cae9653ab9e36318c', 'request_id': 'req-95ae100a-928e-42b9-a7ba-889502f3bfcb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:13:25.476438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-95ae100a-928e-42b9-a7ba-889502f3bfcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45f60d118286471cae9653ab9e36318c', 'request_id': 'req-95ae100a-928e-42b9-a7ba-889502f3bfcb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:13:25.482821 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-95ae100a-928e-42b9-a7ba-889502f3bfcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45f60d118286471cae9653ab9e36318c', 'request_id': 'req-95ae100a-928e-42b9-a7ba-889502f3bfcb'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:13:25.493639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-95ae100a-928e-42b9-a7ba-889502f3bfcb admin admin] The token cache is being invalidate because project 45f60d118286471cae9653ab9e36318c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 11:13:25.493926 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-95ae100a-928e-42b9-a7ba-889502f3bfcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:13:25.494624 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-95ae100a-928e-42b9-a7ba-889502f3bfcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:13:25.496162 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4366/8718] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 11:13:25 2022] DELETE /identity/v3/projects/45f60d118286471cae9653ab9e36318c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:13:25.500166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ee009-bc12-45cb-a9f3-65a3d33c44cc service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:25.510107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ee009-bc12-45cb-a9f3-65a3d33c44cc service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:25.564822 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46266aab-5d2c-41a6-87fa-24a4ec568f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:25.565618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46266aab-5d2c-41a6-87fa-24a4ec568f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:25.565905 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46266aab-5d2c-41a6-87fa-24a4ec568f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:25.566186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46266aab-5d2c-41a6-87fa-24a4ec568f08 admin admin] PATH_INFO: `/v3/users/51a9b8bf77214b3dbc69421182e36146` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:25.567396 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46266aab-5d2c-41a6-87fa-24a4ec568f08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51a9b8bf77214b3dbc69421182e36146)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:25.569397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46266aab-5d2c-41a6-87fa-24a4ec568f08 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:25.736005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-46266aab-5d2c-41a6-87fa-24a4ec568f08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51a9b8bf77214b3dbc69421182e36146'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:13:25.747797 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-46266aab-5d2c-41a6-87fa-24a4ec568f08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51a9b8bf77214b3dbc69421182e36146'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:13:25.748494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-46266aab-5d2c-41a6-87fa-24a4ec568f08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51a9b8bf77214b3dbc69421182e36146'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:13:25.755137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-46266aab-5d2c-41a6-87fa-24a4ec568f08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51a9b8bf77214b3dbc69421182e36146'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:13:25.835419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-46266aab-5d2c-41a6-87fa-24a4ec568f08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51a9b8bf77214b3dbc69421182e36146'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:13:25.837867 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4353/8719] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 11:13:25 2022] DELETE /identity/v3/users/51a9b8bf77214b3dbc69421182e36146 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:13:26.243227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae100a-928e-42b9-a7ba-889502f3bfcb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:26.244708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-95ae100a-928e-42b9-a7ba-889502f3bfcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:26.258908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae100a-928e-42b9-a7ba-889502f3bfcb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:26.313479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8091199-3eac-4373-8827-95e94d2615d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:26.314340 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8091199-3eac-4373-8827-95e94d2615d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:26.314619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8091199-3eac-4373-8827-95e94d2615d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:26.314893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8091199-3eac-4373-8827-95e94d2615d3 admin admin] PATH_INFO: `/v3/projects/8dec7df6c82c449688e8eb5715aba72a` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:26.316061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8091199-3eac-4373-8827-95e94d2615d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dec7df6c82c449688e8eb5715aba72a)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:26.317989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8091199-3eac-4373-8827-95e94d2615d3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:26.419323 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d8091199-3eac-4373-8827-95e94d2615d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dec7df6c82c449688e8eb5715aba72a', 'request_id': 'req-d8091199-3eac-4373-8827-95e94d2615d3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:13:26.481965 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d8091199-3eac-4373-8827-95e94d2615d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dec7df6c82c449688e8eb5715aba72a', 'request_id': 'req-d8091199-3eac-4373-8827-95e94d2615d3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:13:26.488247 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d8091199-3eac-4373-8827-95e94d2615d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dec7df6c82c449688e8eb5715aba72a', 'request_id': 'req-d8091199-3eac-4373-8827-95e94d2615d3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:13:26.498708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d8091199-3eac-4373-8827-95e94d2615d3 admin admin] The token cache is being invalidate because project 8dec7df6c82c449688e8eb5715aba72a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 11:13:26.498996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d8091199-3eac-4373-8827-95e94d2615d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:13:26.499616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-d8091199-3eac-4373-8827-95e94d2615d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:13:26.501169 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4367/8720] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 11:13:26 2022] DELETE /identity/v3/projects/8dec7df6c82c449688e8eb5715aba72a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:13:26.507950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5e814-43a6-4e93-8471-15875dcd2a43 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:26.508235 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5e814-43a6-4e93-8471-15875dcd2a43 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:26.508510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5e814-43a6-4e93-8471-15875dcd2a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:26.526387 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-15e5e814-43a6-4e93-8471-15875dcd2a43 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:13:26.528125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-15e5e814-43a6-4e93-8471-15875dcd2a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:26.584545 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4354/8721] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:13:26.592784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b7f77-727f-4ed5-8527-fd65dad61b36 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:26.593080 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b7f77-727f-4ed5-8527-fd65dad61b36 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:26.593363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b7f77-727f-4ed5-8527-fd65dad61b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:26.611178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2b7b7f77-727f-4ed5-8527-fd65dad61b36 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:13:26.612381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2b7b7f77-727f-4ed5-8527-fd65dad61b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:26.621043 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4368/8722] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:13:26.625745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5e814-43a6-4e93-8471-15875dcd2a43 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:26.636149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5e814-43a6-4e93-8471-15875dcd2a43 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:26.640803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59dc37-2697-4db3-b1c4-861d71baac4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:26.641478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59dc37-2697-4db3-b1c4-861d71baac4a admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:26.641765 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59dc37-2697-4db3-b1c4-861d71baac4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:26.642046 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59dc37-2697-4db3-b1c4-861d71baac4a admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:26.642775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59dc37-2697-4db3-b1c4-861d71baac4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 11:13:26.643096 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59dc37-2697-4db3-b1c4-861d71baac4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:26.644730 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59dc37-2697-4db3-b1c4-861d71baac4a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:26.656277 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4355/8723] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 11:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 11:13:26.660648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b7f77-727f-4ed5-8527-fd65dad61b36 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:26.669872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b7f77-727f-4ed5-8527-fd65dad61b36 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:26.674581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1026f7f-6ce4-4c8e-940a-a26d83aa8ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:26.675231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1026f7f-6ce4-4c8e-940a-a26d83aa8ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:26.675514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1026f7f-6ce4-4c8e-940a-a26d83aa8ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:26.675791 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1026f7f-6ce4-4c8e-940a-a26d83aa8ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:26.676478 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1026f7f-6ce4-4c8e-940a-a26d83aa8ea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:26.678918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1026f7f-6ce4-4c8e-940a-a26d83aa8ea0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:26.768997 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4369/8724] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 11:13:26 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:13:26.773197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59dc37-2697-4db3-b1c4-861d71baac4a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:26.783918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59dc37-2697-4db3-b1c4-861d71baac4a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:26.838995 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4738e4-b45a-4369-9168-ea7a500716de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:26.839682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4738e4-b45a-4369-9168-ea7a500716de admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:26.839977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4738e4-b45a-4369-9168-ea7a500716de admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:26.840289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4738e4-b45a-4369-9168-ea7a500716de admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:26.841047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4738e4-b45a-4369-9168-ea7a500716de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:26.842963 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4738e4-b45a-4369-9168-ea7a500716de admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:26.898735 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4356/8725] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 11:13:26 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:13:26.908274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1026f7f-6ce4-4c8e-940a-a26d83aa8ea0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:26.919248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1026f7f-6ce4-4c8e-940a-a26d83aa8ea0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:26.923843 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df358aa5-ba9c-4bd8-ae1d-041ea948c8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:26.924435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df358aa5-ba9c-4bd8-ae1d-041ea948c8ed admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:26.924755 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df358aa5-ba9c-4bd8-ae1d-041ea948c8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:26.925182 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df358aa5-ba9c-4bd8-ae1d-041ea948c8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:26.925901 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df358aa5-ba9c-4bd8-ae1d-041ea948c8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:26.927482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df358aa5-ba9c-4bd8-ae1d-041ea948c8ed admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:26.938658 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4370/8726] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:13:26.942365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4738e4-b45a-4369-9168-ea7a500716de admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:26.952366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4738e4-b45a-4369-9168-ea7a500716de admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:26.957005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33509d-c719-4342-8913-08a92236103f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:26.957663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33509d-c719-4342-8913-08a92236103f admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:26.957971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33509d-c719-4342-8913-08a92236103f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:26.958258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33509d-c719-4342-8913-08a92236103f admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:26.959010 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33509d-c719-4342-8913-08a92236103f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:26.960640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33509d-c719-4342-8913-08a92236103f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:26.970266 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4357/8727] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:13:26.974066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df358aa5-ba9c-4bd8-ae1d-041ea948c8ed admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:26.984217 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df358aa5-ba9c-4bd8-ae1d-041ea948c8ed admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:26.988844 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16035c7-b803-493c-a59b-fd5a1a924173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:26.989706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16035c7-b803-493c-a59b-fd5a1a924173 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:26.989981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16035c7-b803-493c-a59b-fd5a1a924173 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:26.990252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16035c7-b803-493c-a59b-fd5a1a924173 admin admin] PATH_INFO: `/v3/projects/1e2e1841e1a9409b88dd38de07fff438/users/70500f410e0649f4bd8c9adad545c2f2/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:27.004693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16035c7-b803-493c-a59b-fd5a1a924173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2e1841e1a9409b88dd38de07fff438, user_id=70500f410e0649f4bd8c9adad545c2f2, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:27.007310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16035c7-b803-493c-a59b-fd5a1a924173 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:27.081653 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4371/8728] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:13:26 2022] PUT /identity/v3/projects/1e2e1841e1a9409b88dd38de07fff438/users/70500f410e0649f4bd8c9adad545c2f2/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 11:13:27.086666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56321668-413f-4b1e-b05f-4b5cad6db846 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:27.086962 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56321668-413f-4b1e-b05f-4b5cad6db846 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:27.087246 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56321668-413f-4b1e-b05f-4b5cad6db846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:27.105921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-56321668-413f-4b1e-b05f-4b5cad6db846 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:13:27.107130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-56321668-413f-4b1e-b05f-4b5cad6db846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:27.163733 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4358/8729] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 11:13:27.174017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16035c7-b803-493c-a59b-fd5a1a924173 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:27.175617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-e16035c7-b803-493c-a59b-fd5a1a924173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:27.230882 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16035c7-b803-493c-a59b-fd5a1a924173 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:27.234523 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3622b0e-f297-45e6-87a3-8f42dd43a19d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:27.235172 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3622b0e-f297-45e6-87a3-8f42dd43a19d service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:27.235458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3622b0e-f297-45e6-87a3-8f42dd43a19d service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:27.235739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3622b0e-f297-45e6-87a3-8f42dd43a19d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:27.244461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3622b0e-f297-45e6-87a3-8f42dd43a19d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:27.245932 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3622b0e-f297-45e6-87a3-8f42dd43a19d service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:27.255266 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4372/8730] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:13:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 11:13:28.569816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f25de9-125d-49b6-a98c-ec38ded93aff None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:28.570483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f25de9-125d-49b6-a98c-ec38ded93aff None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:28.570858 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f25de9-125d-49b6-a98c-ec38ded93aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:28.597312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-f6f25de9-125d-49b6-a98c-ec38ded93aff None None] MFA Rules not processed for user `70500f410e0649f4bd8c9adad545c2f2`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:13:28.598483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f6f25de9-125d-49b6-a98c-ec38ded93aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:28.665111 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4359/8731] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:13:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:13:28.677088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6ec7b-d420-408f-8d5d-5260b421ffa1 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:28.677614 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6ec7b-d420-408f-8d5d-5260b421ffa1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:28.677717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6ec7b-d420-408f-8d5d-5260b421ffa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:28.694974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f1a6ec7b-d420-408f-8d5d-5260b421ffa1 None None] MFA Rules not processed for user `70500f410e0649f4bd8c9adad545c2f2`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:13:28.696253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f1a6ec7b-d420-408f-8d5d-5260b421ffa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:28.703403 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4373/8732] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:13:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:13:28.715781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f25de9-125d-49b6-a98c-ec38ded93aff None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:28.717429 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f6f25de9-125d-49b6-a98c-ec38ded93aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:28.791373 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f25de9-125d-49b6-a98c-ec38ded93aff None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:28.796944 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5283eec-8ac6-4c7b-a63a-58d7682017d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:28.797594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5283eec-8ac6-4c7b-a63a-58d7682017d6 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:28.797882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5283eec-8ac6-4c7b-a63a-58d7682017d6 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:28.798162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5283eec-8ac6-4c7b-a63a-58d7682017d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:28.805836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5283eec-8ac6-4c7b-a63a-58d7682017d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:28.807439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5283eec-8ac6-4c7b-a63a-58d7682017d6 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:28.816156 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4360/8733] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:13:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:13:29.413989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898aa39-e3e9-4e71-9757-bf0c4e6d26ba None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:29.414349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898aa39-e3e9-4e71-9757-bf0c4e6d26ba None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:29.414697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898aa39-e3e9-4e71-9757-bf0c4e6d26ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:29.434328 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8898aa39-e3e9-4e71-9757-bf0c4e6d26ba None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:13:29.435553 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8898aa39-e3e9-4e71-9757-bf0c4e6d26ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:29.502233 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4374/8734] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 11:13:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:13:29.514176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5283eec-8ac6-4c7b-a63a-58d7682017d6 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:29.515583 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e5283eec-8ac6-4c7b-a63a-58d7682017d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:29.533426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5283eec-8ac6-4c7b-a63a-58d7682017d6 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:29.538520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e26fef-0116-4dc8-9f97-3e027ce85a62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:29.539818 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e26fef-0116-4dc8-9f97-3e027ce85a62 service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:29.540101 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e26fef-0116-4dc8-9f97-3e027ce85a62 service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:29.540382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e26fef-0116-4dc8-9f97-3e027ce85a62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:29.548839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e26fef-0116-4dc8-9f97-3e027ce85a62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:29.550582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e26fef-0116-4dc8-9f97-3e027ce85a62 service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:29.562478 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4361/8735] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:13:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:13:42.748170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898aa39-e3e9-4e71-9757-bf0c4e6d26ba None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:42.749660 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8898aa39-e3e9-4e71-9757-bf0c4e6d26ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:42.760740 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898aa39-e3e9-4e71-9757-bf0c4e6d26ba None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:42.764546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ba91c-c388-4c82-849d-bc42681bc3b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:42.765228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ba91c-c388-4c82-849d-bc42681bc3b2 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:42.765510 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ba91c-c388-4c82-849d-bc42681bc3b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:42.765786 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ba91c-c388-4c82-849d-bc42681bc3b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:42.767617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-934ba91c-c388-4c82-849d-bc42681bc3b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:42.780688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ba91c-c388-4c82-849d-bc42681bc3b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:42.782136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ba91c-c388-4c82-849d-bc42681bc3b2 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:42.793281 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4375/8736] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:13:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:13:42.916856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bb7ae-5e98-42b5-8bbe-974465fb1657 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:42.917393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bb7ae-5e98-42b5-8bbe-974465fb1657 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:42.917393 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bb7ae-5e98-42b5-8bbe-974465fb1657 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:42.918779 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4362/8737] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 11:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 11:13:42.924084 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e54f18-6dd3-481e-ab2e-b934fb69fc7b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:42.924375 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e54f18-6dd3-481e-ab2e-b934fb69fc7b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:42.924690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e54f18-6dd3-481e-ab2e-b934fb69fc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:42.942795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-94e54f18-6dd3-481e-ab2e-b934fb69fc7b None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:13:42.949582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-94e54f18-6dd3-481e-ab2e-b934fb69fc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:42.952497 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4376/8738] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 11:13:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:13:42.972577 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bb7ae-5e98-42b5-8bbe-974465fb1657 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:42.974343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-236bb7ae-5e98-42b5-8bbe-974465fb1657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:42.993514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bb7ae-5e98-42b5-8bbe-974465fb1657 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:42.998508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd3479-a640-4bd6-9e6d-0dd4ccc89241 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:42.999139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd3479-a640-4bd6-9e6d-0dd4ccc89241 service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:42.999425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd3479-a640-4bd6-9e6d-0dd4ccc89241 service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:42.999703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd3479-a640-4bd6-9e6d-0dd4ccc89241 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:43.007790 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd3479-a640-4bd6-9e6d-0dd4ccc89241 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:43.009418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd3479-a640-4bd6-9e6d-0dd4ccc89241 service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:43.018963 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4363/8739] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:13:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:13:43.250484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e54f18-6dd3-481e-ab2e-b934fb69fc7b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:13:43.259751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e54f18-6dd3-481e-ab2e-b934fb69fc7b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:13:43.263320 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b6cf0-bfce-4a9b-949b-cb9b32013137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:13:43.263962 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b6cf0-bfce-4a9b-949b-cb9b32013137 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:13:43.264250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b6cf0-bfce-4a9b-949b-cb9b32013137 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:13:43.264537 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b6cf0-bfce-4a9b-949b-cb9b32013137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:13:43.266307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ad1b6cf0-bfce-4a9b-949b-cb9b32013137 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:13:43.282616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b6cf0-bfce-4a9b-949b-cb9b32013137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:13:43.284038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b6cf0-bfce-4a9b-949b-cb9b32013137 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:13:43.297794 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4377/8740] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:13:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:14:12.861985 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd3479-a640-4bd6-9e6d-0dd4ccc89241 service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:14:12.872282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd3479-a640-4bd6-9e6d-0dd4ccc89241 service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:14:12.875988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4b953-0c24-446f-b220-b087032852a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:14:12.876660 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4b953-0c24-446f-b220-b087032852a7 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:14:12.876952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4b953-0c24-446f-b220-b087032852a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:14:12.877232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4b953-0c24-446f-b220-b087032852a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:14:12.879019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-73c4b953-0c24-446f-b220-b087032852a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:14:12.890902 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4b953-0c24-446f-b220-b087032852a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:14:12.892748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4b953-0c24-446f-b220-b087032852a7 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:14:12.903788 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4364/8741] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:14:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:14:23.129196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b6cf0-bfce-4a9b-949b-cb9b32013137 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:14:23.139959 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b6cf0-bfce-4a9b-949b-cb9b32013137 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:14:23.144929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9412d-5ed9-487f-8a39-ba37f2946716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:14:23.145810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9412d-5ed9-487f-8a39-ba37f2946716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:14:23.146095 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9412d-5ed9-487f-8a39-ba37f2946716 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:14:23.146383 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9412d-5ed9-487f-8a39-ba37f2946716 admin admin] PATH_INFO: `/v3/users/70500f410e0649f4bd8c9adad545c2f2` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:14:23.147584 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9412d-5ed9-487f-8a39-ba37f2946716 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70500f410e0649f4bd8c9adad545c2f2)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:14:23.149592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9412d-5ed9-487f-8a39-ba37f2946716 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:14:23.288064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ada9412d-5ed9-487f-8a39-ba37f2946716 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70500f410e0649f4bd8c9adad545c2f2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:14:23.299630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ada9412d-5ed9-487f-8a39-ba37f2946716 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70500f410e0649f4bd8c9adad545c2f2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:14:23.300296 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ada9412d-5ed9-487f-8a39-ba37f2946716 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70500f410e0649f4bd8c9adad545c2f2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:14:23.307543 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ada9412d-5ed9-487f-8a39-ba37f2946716 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70500f410e0649f4bd8c9adad545c2f2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:14:23.367751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-ada9412d-5ed9-487f-8a39-ba37f2946716 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70500f410e0649f4bd8c9adad545c2f2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:14:23.374200 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4378/8742] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 11:14:23 2022] DELETE /identity/v3/users/70500f410e0649f4bd8c9adad545c2f2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 11:14:23.604014 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4b953-0c24-446f-b220-b087032852a7 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:14:23.615702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4b953-0c24-446f-b220-b087032852a7 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:14:23.672389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a83c07-c6e2-45ff-bf4f-40088167bb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:14:23.673297 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a83c07-c6e2-45ff-bf4f-40088167bb36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:14:23.673842 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a83c07-c6e2-45ff-bf4f-40088167bb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:14:23.673976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a83c07-c6e2-45ff-bf4f-40088167bb36 admin admin] PATH_INFO: `/v3/projects/1e2e1841e1a9409b88dd38de07fff438` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:14:23.675089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a83c07-c6e2-45ff-bf4f-40088167bb36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e2e1841e1a9409b88dd38de07fff438)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:14:23.677070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a83c07-c6e2-45ff-bf4f-40088167bb36 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:14:23.790103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-87a83c07-c6e2-45ff-bf4f-40088167bb36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2e1841e1a9409b88dd38de07fff438', 'request_id': 'req-87a83c07-c6e2-45ff-bf4f-40088167bb36'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:14:23.796186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-87a83c07-c6e2-45ff-bf4f-40088167bb36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2e1841e1a9409b88dd38de07fff438', 'request_id': 'req-87a83c07-c6e2-45ff-bf4f-40088167bb36'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:14:23.864629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-87a83c07-c6e2-45ff-bf4f-40088167bb36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2e1841e1a9409b88dd38de07fff438', 'request_id': 'req-87a83c07-c6e2-45ff-bf4f-40088167bb36'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:14:23.875497 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-87a83c07-c6e2-45ff-bf4f-40088167bb36 admin admin] The token cache is being invalidate because project 1e2e1841e1a9409b88dd38de07fff438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 11:14:23.875785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-87a83c07-c6e2-45ff-bf4f-40088167bb36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:14:23.876407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-87a83c07-c6e2-45ff-bf4f-40088167bb36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:14:23.878002 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4365/8743] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 11:14:23 2022] DELETE /identity/v3/projects/1e2e1841e1a9409b88dd38de07fff438 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:14:23.883765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28c646-944f-4cd4-b260-c856e69465b9 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:14:23.884058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28c646-944f-4cd4-b260-c856e69465b9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:14:23.884343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28c646-944f-4cd4-b260-c856e69465b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:14:23.902699 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-8e28c646-944f-4cd4-b260-c856e69465b9 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:14:23.904169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-8e28c646-944f-4cd4-b260-c856e69465b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:14:23.959818 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4379/8744] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:14:23.968754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96411d1-86fe-4451-a91e-09753c69b1e2 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:14:23.969051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96411d1-86fe-4451-a91e-09753c69b1e2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:14:23.969337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96411d1-86fe-4451-a91e-09753c69b1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:14:23.987109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b96411d1-86fe-4451-a91e-09753c69b1e2 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:14:23.988308 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b96411d1-86fe-4451-a91e-09753c69b1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:14:23.996226 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4366/8745] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:14:24.000301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28c646-944f-4cd4-b260-c856e69465b9 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:14:24.010395 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28c646-944f-4cd4-b260-c856e69465b9 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:14:24.014896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bada5-b69c-46a2-8c1f-ae00e184c638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:14:24.015551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bada5-b69c-46a2-8c1f-ae00e184c638 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:14:24.015837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bada5-b69c-46a2-8c1f-ae00e184c638 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:14:24.016116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bada5-b69c-46a2-8c1f-ae00e184c638 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:14:24.016878 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bada5-b69c-46a2-8c1f-ae00e184c638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 11:14:24.017190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bada5-b69c-46a2-8c1f-ae00e184c638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:14:24.018779 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bada5-b69c-46a2-8c1f-ae00e184c638 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:14:24.030693 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4380/8746] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 11:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 11:14:24.035086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96411d1-86fe-4451-a91e-09753c69b1e2 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:14:24.044494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96411d1-86fe-4451-a91e-09753c69b1e2 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:14:24.049103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68262521-ef71-413f-a8ab-fce503e96b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:14:24.049742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68262521-ef71-413f-a8ab-fce503e96b85 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:14:24.050025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68262521-ef71-413f-a8ab-fce503e96b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:14:24.050303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68262521-ef71-413f-a8ab-fce503e96b85 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:14:24.050996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68262521-ef71-413f-a8ab-fce503e96b85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:14:24.052916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68262521-ef71-413f-a8ab-fce503e96b85 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:14:24.163463 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4367/8747] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 11:14:24 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:14:24.167770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bada5-b69c-46a2-8c1f-ae00e184c638 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:14:24.178163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bada5-b69c-46a2-8c1f-ae00e184c638 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:14:24.232720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969041f3-b216-467a-bf7b-1241bfe8cf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:14:24.233411 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969041f3-b216-467a-bf7b-1241bfe8cf22 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:14:24.233703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969041f3-b216-467a-bf7b-1241bfe8cf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:14:24.233986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969041f3-b216-467a-bf7b-1241bfe8cf22 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:14:24.234705 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969041f3-b216-467a-bf7b-1241bfe8cf22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:14:24.236655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969041f3-b216-467a-bf7b-1241bfe8cf22 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:14:24.338407 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4381/8748] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 11:14:24 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:14:24.342425 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68262521-ef71-413f-a8ab-fce503e96b85 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:14:24.352719 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68262521-ef71-413f-a8ab-fce503e96b85 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:14:24.357314 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e1f0f-8d0d-45fe-92f1-03f4dcd50460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:14:24.358390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e1f0f-8d0d-45fe-92f1-03f4dcd50460 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:14:24.358675 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e1f0f-8d0d-45fe-92f1-03f4dcd50460 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:14:24.358957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e1f0f-8d0d-45fe-92f1-03f4dcd50460 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:14:24.359685 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e1f0f-8d0d-45fe-92f1-03f4dcd50460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:14:24.361342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e1f0f-8d0d-45fe-92f1-03f4dcd50460 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:14:24.371988 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4368/8749] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:14:24.375940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969041f3-b216-467a-bf7b-1241bfe8cf22 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:14:24.386555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969041f3-b216-467a-bf7b-1241bfe8cf22 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:14:24.391210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f81eb2-72f6-46f6-9357-15a132f0c6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:14:24.391863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f81eb2-72f6-46f6-9357-15a132f0c6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:14:24.392145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f81eb2-72f6-46f6-9357-15a132f0c6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:14:24.392423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f81eb2-72f6-46f6-9357-15a132f0c6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:14:24.393287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f81eb2-72f6-46f6-9357-15a132f0c6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:14:24.394869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f81eb2-72f6-46f6-9357-15a132f0c6d1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:14:24.404660 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4382/8750] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 11:14:24.408773 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e1f0f-8d0d-45fe-92f1-03f4dcd50460 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:14:24.418649 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e1f0f-8d0d-45fe-92f1-03f4dcd50460 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:14:24.423221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc690cc-8464-4f60-8e97-0fde8d2649bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:14:24.424095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc690cc-8464-4f60-8e97-0fde8d2649bb admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:14:24.424383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc690cc-8464-4f60-8e97-0fde8d2649bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:14:24.424693 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc690cc-8464-4f60-8e97-0fde8d2649bb admin admin] PATH_INFO: `/v3/projects/0b0458fbd066459d8dfcbc6bf6a941a6/users/192e5f37074c494d88cf66bc56135fd8/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:14:24.439571 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc690cc-8464-4f60-8e97-0fde8d2649bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b0458fbd066459d8dfcbc6bf6a941a6, user_id=192e5f37074c494d88cf66bc56135fd8, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:14:24.442330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc690cc-8464-4f60-8e97-0fde8d2649bb admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:14:24.515226 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4369/8751] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:14:24 2022] PUT /identity/v3/projects/0b0458fbd066459d8dfcbc6bf6a941a6/users/192e5f37074c494d88cf66bc56135fd8/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 11:14:24.520384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d64e17-116e-4f5a-a73c-ed2f20f9d0ae None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:14:24.520697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d64e17-116e-4f5a-a73c-ed2f20f9d0ae None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:14:24.520981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d64e17-116e-4f5a-a73c-ed2f20f9d0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:14:24.538616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d8d64e17-116e-4f5a-a73c-ed2f20f9d0ae None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:14:24.540302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d8d64e17-116e-4f5a-a73c-ed2f20f9d0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:14:24.595609 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4383/8752] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 11:14:24.605549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc690cc-8464-4f60-8e97-0fde8d2649bb admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:14:24.607213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ebc690cc-8464-4f60-8e97-0fde8d2649bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:14:24.662755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc690cc-8464-4f60-8e97-0fde8d2649bb admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:14:24.667115 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0a2ea-284f-4afb-8e3f-83f5485ea71e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:14:24.667754 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0a2ea-284f-4afb-8e3f-83f5485ea71e service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:14:24.668036 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0a2ea-284f-4afb-8e3f-83f5485ea71e service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:14:24.668312 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0a2ea-284f-4afb-8e3f-83f5485ea71e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:14:24.677367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0a2ea-284f-4afb-8e3f-83f5485ea71e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:14:24.678735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0a2ea-284f-4afb-8e3f-83f5485ea71e service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:14:24.688802 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4370/8753] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:14:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:14:25.762986 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ffbc6-d7ee-4176-82d1-d66eb5d13c79 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:14:25.763466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ffbc6-d7ee-4176-82d1-d66eb5d13c79 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:14:25.763851 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ffbc6-d7ee-4176-82d1-d66eb5d13c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:14:25.792493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ae5ffbc6-d7ee-4176-82d1-d66eb5d13c79 None None] MFA Rules not processed for user `192e5f37074c494d88cf66bc56135fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:14:25.793958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ae5ffbc6-d7ee-4176-82d1-d66eb5d13c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:14:25.863856 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4384/8754] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:14:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:14:25.874874 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d67668-8872-43e1-a67b-ede2693d303b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:14:25.875412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d67668-8872-43e1-a67b-ede2693d303b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:14:25.875412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d67668-8872-43e1-a67b-ede2693d303b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:14:25.893553 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-45d67668-8872-43e1-a67b-ede2693d303b None None] MFA Rules not processed for user `192e5f37074c494d88cf66bc56135fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:14:25.895063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-45d67668-8872-43e1-a67b-ede2693d303b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:14:25.902488 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4371/8755] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:14:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:14:25.913837 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ffbc6-d7ee-4176-82d1-d66eb5d13c79 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:14:25.915391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ae5ffbc6-d7ee-4176-82d1-d66eb5d13c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:14:25.991571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ffbc6-d7ee-4176-82d1-d66eb5d13c79 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:14:25.997723 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1faba-2407-4829-bdbe-dcc158f262a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:14:25.998376 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1faba-2407-4829-bdbe-dcc158f262a6 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:14:25.998661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1faba-2407-4829-bdbe-dcc158f262a6 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:14:25.998945 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1faba-2407-4829-bdbe-dcc158f262a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:14:26.007801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1faba-2407-4829-bdbe-dcc158f262a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:14:26.009529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1faba-2407-4829-bdbe-dcc158f262a6 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:14:26.018798 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4385/8756] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:14:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 11:14:39.732876 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7e20e-52bd-4560-9c6f-b47d7366b986 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:14:39.733478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7e20e-52bd-4560-9c6f-b47d7366b986 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:14:39.733478 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7e20e-52bd-4560-9c6f-b47d7366b986 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:14:39.734820 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4372/8757] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 11:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 11:14:39.739521 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6e71e-4ec6-4e68-9c5e-cb2a209df6ff None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:14:39.739968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6e71e-4ec6-4e68-9c5e-cb2a209df6ff None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:14:39.740075 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6e71e-4ec6-4e68-9c5e-cb2a209df6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:14:39.757641 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-98e6e71e-4ec6-4e68-9c5e-cb2a209df6ff None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:14:39.759342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-98e6e71e-4ec6-4e68-9c5e-cb2a209df6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:14:39.818981 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4386/8758] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 11:14:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:14:39.839706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7e20e-52bd-4560-9c6f-b47d7366b986 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:14:39.841499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-39c7e20e-52bd-4560-9c6f-b47d7366b986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:14:39.860203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7e20e-52bd-4560-9c6f-b47d7366b986 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:14:39.865180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4ec16-e731-43c3-b390-158c02d72bc2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:14:39.865838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4ec16-e731-43c3-b390-158c02d72bc2 service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:14:39.866125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4ec16-e731-43c3-b390-158c02d72bc2 service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:14:39.866405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4ec16-e731-43c3-b390-158c02d72bc2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:14:39.875112 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4ec16-e731-43c3-b390-158c02d72bc2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:14:39.876721 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4ec16-e731-43c3-b390-158c02d72bc2 service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:14:39.887045 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4373/8759] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:14:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:15:15.217429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9574d-8b90-48e9-9170-ce1c7f333db6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:15:15.218044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9574d-8b90-48e9-9170-ce1c7f333db6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:15:15.218044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9574d-8b90-48e9-9170-ce1c7f333db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:15:15.236160 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-42b9574d-8b90-48e9-9170-ce1c7f333db6 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:15:15.237400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-42b9574d-8b90-48e9-9170-ce1c7f333db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:15:15.246831 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4387/8760] 10.222.0.24 () {58 vars in 1015 bytes} [Mon May 2 11:15:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:15:15.258769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4ec16-e731-43c3-b390-158c02d72bc2 service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:15:15.272211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4ec16-e731-43c3-b390-158c02d72bc2 service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:15:15.277888 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe43f81-368a-4ad5-b783-cee984d187ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:15:15.278525 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe43f81-368a-4ad5-b783-cee984d187ad service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:15:15.279058 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe43f81-368a-4ad5-b783-cee984d187ad service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:15:15.279332 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe43f81-368a-4ad5-b783-cee984d187ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:15:15.287855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe43f81-368a-4ad5-b783-cee984d187ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:15:15.289481 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe43f81-368a-4ad5-b783-cee984d187ad service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:15:15.299351 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4374/8761] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:15:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:15:17.050747 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac13b4-bab6-4f11-ad48-805a51dcbd9f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:15:17.051626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac13b4-bab6-4f11-ad48-805a51dcbd9f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:15:17.051910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac13b4-bab6-4f11-ad48-805a51dcbd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:15:17.069106 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-32ac13b4-bab6-4f11-ad48-805a51dcbd9f None None] MFA Rules not processed for user `192e5f37074c494d88cf66bc56135fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:15:17.070442 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-32ac13b4-bab6-4f11-ad48-805a51dcbd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:15:17.077514 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4388/8762] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:15:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:15:19.588213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86d695-71c2-4abb-8b34-733c5718ff5e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:15:19.588808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86d695-71c2-4abb-8b34-733c5718ff5e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:15:19.588808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86d695-71c2-4abb-8b34-733c5718ff5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:15:19.609673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2e86d695-71c2-4abb-8b34-733c5718ff5e None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:15:19.610901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2e86d695-71c2-4abb-8b34-733c5718ff5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:15:19.619774 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4375/8763] 10.222.0.15 () {58 vars in 1015 bytes} [Mon May 2 11:15:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:15:19.656116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac13b4-bab6-4f11-ad48-805a51dcbd9f None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:15:19.657621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-32ac13b4-bab6-4f11-ad48-805a51dcbd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:15:19.675798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac13b4-bab6-4f11-ad48-805a51dcbd9f None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:15:19.681134 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adfa8d-8e62-4855-89cb-25984741d94b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:15:19.681801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adfa8d-8e62-4855-89cb-25984741d94b service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:15:19.682121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adfa8d-8e62-4855-89cb-25984741d94b service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:15:19.682407 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adfa8d-8e62-4855-89cb-25984741d94b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:15:19.691908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adfa8d-8e62-4855-89cb-25984741d94b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:15:19.693551 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adfa8d-8e62-4855-89cb-25984741d94b service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:15:19.703685 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4389/8764] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:15:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:15:28.817140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14841dc0-2a62-4af6-9bd8-41cd17e8bad8 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:15:28.817680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14841dc0-2a62-4af6-9bd8-41cd17e8bad8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:15:28.817680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14841dc0-2a62-4af6-9bd8-41cd17e8bad8 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:15:28.819087 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4376/8765] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 11:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 11:15:28.824503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b20bce-3378-4f9e-b02c-927b045cc495 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:15:28.824963 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b20bce-3378-4f9e-b02c-927b045cc495 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:15:28.825162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b20bce-3378-4f9e-b02c-927b045cc495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:15:28.843438 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f2b20bce-3378-4f9e-b02c-927b045cc495 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:15:28.844557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f2b20bce-3378-4f9e-b02c-927b045cc495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:15:28.853042 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4390/8766] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 11:15:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 11:15:28.873102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bc270-573a-4cee-8da2-504a23a480a8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:15:28.873392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bc270-573a-4cee-8da2-504a23a480a8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:15:28.873673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bc270-573a-4cee-8da2-504a23a480a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:15:28.892227 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b31bc270-573a-4cee-8da2-504a23a480a8 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:15:28.893551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b31bc270-573a-4cee-8da2-504a23a480a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:15:28.902248 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4377/8767] 10.222.0.16 () {58 vars in 1057 bytes} [Mon May 2 11:15:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:15:28.908546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b20bce-3378-4f9e-b02c-927b045cc495 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:15:28.918964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b20bce-3378-4f9e-b02c-927b045cc495 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:15:28.924053 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d8432-58e9-4e3f-8c8b-d039a19d41ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:15:28.924727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d8432-58e9-4e3f-8c8b-d039a19d41ea service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:15:28.925037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d8432-58e9-4e3f-8c8b-d039a19d41ea service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:15:28.925319 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d8432-58e9-4e3f-8c8b-d039a19d41ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:15:28.934090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d8432-58e9-4e3f-8c8b-d039a19d41ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:15:28.935655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d8432-58e9-4e3f-8c8b-d039a19d41ea service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:15:28.945144 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4391/8768] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:15:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:16:10.229026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bc270-573a-4cee-8da2-504a23a480a8 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:16:10.258828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bc270-573a-4cee-8da2-504a23a480a8 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:16:10.264283 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e861c5-02f8-45c0-9b5a-42c92c5478c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:16:10.265181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e861c5-02f8-45c0-9b5a-42c92c5478c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:16:10.265469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e861c5-02f8-45c0-9b5a-42c92c5478c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:16:10.265748 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e861c5-02f8-45c0-9b5a-42c92c5478c7 admin admin] PATH_INFO: `/v3/users/192e5f37074c494d88cf66bc56135fd8` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:16:10.266931 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e861c5-02f8-45c0-9b5a-42c92c5478c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=192e5f37074c494d88cf66bc56135fd8)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:16:10.268994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e861c5-02f8-45c0-9b5a-42c92c5478c7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:16:10.390070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c2e861c5-02f8-45c0-9b5a-42c92c5478c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '192e5f37074c494d88cf66bc56135fd8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:16:10.401402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c2e861c5-02f8-45c0-9b5a-42c92c5478c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '192e5f37074c494d88cf66bc56135fd8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:16:10.402078 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c2e861c5-02f8-45c0-9b5a-42c92c5478c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '192e5f37074c494d88cf66bc56135fd8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:16:10.408994 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c2e861c5-02f8-45c0-9b5a-42c92c5478c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '192e5f37074c494d88cf66bc56135fd8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:16:10.451070 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-c2e861c5-02f8-45c0-9b5a-42c92c5478c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '192e5f37074c494d88cf66bc56135fd8'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:16:10.457002 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4378/8769] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 11:16:10 2022] DELETE /identity/v3/users/192e5f37074c494d88cf66bc56135fd8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:16:10.693381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d8432-58e9-4e3f-8c8b-d039a19d41ea service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:16:10.704731 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d8432-58e9-4e3f-8c8b-d039a19d41ea service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:16:10.760906 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa34d4b-81ed-4b56-ad98-255420cb4a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:16:10.761696 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa34d4b-81ed-4b56-ad98-255420cb4a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:16:10.762019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa34d4b-81ed-4b56-ad98-255420cb4a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:16:10.762299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa34d4b-81ed-4b56-ad98-255420cb4a55 admin admin] PATH_INFO: `/v3/projects/0b0458fbd066459d8dfcbc6bf6a941a6` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:16:10.763474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa34d4b-81ed-4b56-ad98-255420cb4a55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b0458fbd066459d8dfcbc6bf6a941a6)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:16:10.765503 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa34d4b-81ed-4b56-ad98-255420cb4a55 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:16:10.890930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-cfa34d4b-81ed-4b56-ad98-255420cb4a55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b0458fbd066459d8dfcbc6bf6a941a6', 'request_id': 'req-cfa34d4b-81ed-4b56-ad98-255420cb4a55'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:16:10.965567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-cfa34d4b-81ed-4b56-ad98-255420cb4a55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b0458fbd066459d8dfcbc6bf6a941a6', 'request_id': 'req-cfa34d4b-81ed-4b56-ad98-255420cb4a55'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:16:10.972034 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-cfa34d4b-81ed-4b56-ad98-255420cb4a55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b0458fbd066459d8dfcbc6bf6a941a6', 'request_id': 'req-cfa34d4b-81ed-4b56-ad98-255420cb4a55'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:16:10.994938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-cfa34d4b-81ed-4b56-ad98-255420cb4a55 admin admin] The token cache is being invalidate because project 0b0458fbd066459d8dfcbc6bf6a941a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 11:16:10.995227 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-cfa34d4b-81ed-4b56-ad98-255420cb4a55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:16:10.995853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-cfa34d4b-81ed-4b56-ad98-255420cb4a55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:16:10.997899 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4392/8770] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 11:16:10 2022] DELETE /identity/v3/projects/0b0458fbd066459d8dfcbc6bf6a941a6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:16:11.003125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e405037-1807-4ed0-a163-c8dafb5d9d64 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:16:11.003412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e405037-1807-4ed0-a163-c8dafb5d9d64 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:16:11.003696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e405037-1807-4ed0-a163-c8dafb5d9d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:16:11.048382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9e405037-1807-4ed0-a163-c8dafb5d9d64 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:16:11.049529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9e405037-1807-4ed0-a163-c8dafb5d9d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:16:11.105434 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4379/8771] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:16:11.113502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e9545-2207-4209-a619-a4f806ff6cfa None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:16:11.113809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e9545-2207-4209-a619-a4f806ff6cfa None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:16:11.114091 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e9545-2207-4209-a619-a4f806ff6cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:16:11.131713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-671e9545-2207-4209-a619-a4f806ff6cfa None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:16:11.132944 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-671e9545-2207-4209-a619-a4f806ff6cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:16:11.140786 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4393/8772] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:16:11.144696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e405037-1807-4ed0-a163-c8dafb5d9d64 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:16:11.154882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e405037-1807-4ed0-a163-c8dafb5d9d64 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:16:11.159344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8230491-ab32-4de3-8faa-3ee189c018c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:16:11.159991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8230491-ab32-4de3-8faa-3ee189c018c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:16:11.160276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8230491-ab32-4de3-8faa-3ee189c018c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:16:11.160555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8230491-ab32-4de3-8faa-3ee189c018c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:16:11.161371 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8230491-ab32-4de3-8faa-3ee189c018c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 11:16:11.161683 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8230491-ab32-4de3-8faa-3ee189c018c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:16:11.163275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8230491-ab32-4de3-8faa-3ee189c018c9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:16:11.174884 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4380/8773] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 11:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 11:16:11.179164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e9545-2207-4209-a619-a4f806ff6cfa None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:16:11.188287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e9545-2207-4209-a619-a4f806ff6cfa None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:16:11.192987 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102006b-e4ee-4b6a-98cc-7da0c548ef26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:16:11.193632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102006b-e4ee-4b6a-98cc-7da0c548ef26 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:16:11.193921 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102006b-e4ee-4b6a-98cc-7da0c548ef26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:16:11.194204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102006b-e4ee-4b6a-98cc-7da0c548ef26 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:16:11.194935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102006b-e4ee-4b6a-98cc-7da0c548ef26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:16:11.196870 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102006b-e4ee-4b6a-98cc-7da0c548ef26 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:16:11.327379 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4394/8774] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 11:16:11 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 11:16:11.331585 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8230491-ab32-4de3-8faa-3ee189c018c9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:16:11.342307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8230491-ab32-4de3-8faa-3ee189c018c9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:16:11.395670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1585b3d-4afc-4fb6-af73-95ef9e1bd93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:16:11.396335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1585b3d-4afc-4fb6-af73-95ef9e1bd93f admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:16:11.396641 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1585b3d-4afc-4fb6-af73-95ef9e1bd93f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:16:11.396923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1585b3d-4afc-4fb6-af73-95ef9e1bd93f admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:16:11.397610 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1585b3d-4afc-4fb6-af73-95ef9e1bd93f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:16:11.399547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1585b3d-4afc-4fb6-af73-95ef9e1bd93f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:16:11.485043 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4381/8775] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 11:16:11 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:16:11.489210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102006b-e4ee-4b6a-98cc-7da0c548ef26 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:16:11.499601 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102006b-e4ee-4b6a-98cc-7da0c548ef26 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:16:11.504343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b95d9f-9c03-4793-956e-ed777e6244e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:16:11.510833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b95d9f-9c03-4793-956e-ed777e6244e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:16:11.510833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b95d9f-9c03-4793-956e-ed777e6244e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:16:11.510833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b95d9f-9c03-4793-956e-ed777e6244e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:16:11.510833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b95d9f-9c03-4793-956e-ed777e6244e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:16:11.510833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b95d9f-9c03-4793-956e-ed777e6244e0 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:16:11.518136 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4395/8776] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:16:11.522004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1585b3d-4afc-4fb6-af73-95ef9e1bd93f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:16:11.532906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1585b3d-4afc-4fb6-af73-95ef9e1bd93f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:16:11.537619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba27faa-fa15-48fb-a942-98c1c02cda54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:16:11.538268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba27faa-fa15-48fb-a942-98c1c02cda54 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:16:11.538556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba27faa-fa15-48fb-a942-98c1c02cda54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:16:11.538836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba27faa-fa15-48fb-a942-98c1c02cda54 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:16:11.539680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba27faa-fa15-48fb-a942-98c1c02cda54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:16:11.541613 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba27faa-fa15-48fb-a942-98c1c02cda54 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:16:11.551691 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4382/8777] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:16:11.555735 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b95d9f-9c03-4793-956e-ed777e6244e0 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:16:11.565980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b95d9f-9c03-4793-956e-ed777e6244e0 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:16:11.570775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd79b8-5388-4ea5-bf92-e47e790ed625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:16:11.571671 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd79b8-5388-4ea5-bf92-e47e790ed625 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:16:11.571955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd79b8-5388-4ea5-bf92-e47e790ed625 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:16:11.572266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd79b8-5388-4ea5-bf92-e47e790ed625 admin admin] PATH_INFO: `/v3/projects/5b9461ec4cf54a98ab67b4c860d3b6b0/users/54222a689c0c4006b33913f18f33be09/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:16:11.593009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd79b8-5388-4ea5-bf92-e47e790ed625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b9461ec4cf54a98ab67b4c860d3b6b0, user_id=54222a689c0c4006b33913f18f33be09, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:16:11.593009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd79b8-5388-4ea5-bf92-e47e790ed625 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:16:11.673567 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4396/8778] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:16:11 2022] PUT /identity/v3/projects/5b9461ec4cf54a98ab67b4c860d3b6b0/users/54222a689c0c4006b33913f18f33be09/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:16:11.678768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365cce4-3672-4869-a723-618a37b935fe None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:16:11.679067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365cce4-3672-4869-a723-618a37b935fe None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:16:11.679419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365cce4-3672-4869-a723-618a37b935fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:16:11.697573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8365cce4-3672-4869-a723-618a37b935fe None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:16:11.698784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8365cce4-3672-4869-a723-618a37b935fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:16:11.754750 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4383/8779] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:16:11.765908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd79b8-5388-4ea5-bf92-e47e790ed625 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:16:11.767635 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-45cd79b8-5388-4ea5-bf92-e47e790ed625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:16:11.832004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd79b8-5388-4ea5-bf92-e47e790ed625 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:16:11.835826 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f45930-9cd3-4c09-aa87-ee416699f208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:16:11.836475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f45930-9cd3-4c09-aa87-ee416699f208 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:16:11.836788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f45930-9cd3-4c09-aa87-ee416699f208 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:16:11.837065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f45930-9cd3-4c09-aa87-ee416699f208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:16:11.846011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f45930-9cd3-4c09-aa87-ee416699f208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:16:11.847364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f45930-9cd3-4c09-aa87-ee416699f208 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:16:11.856562 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4397/8780] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:16:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:16:17.146764 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9e9e3-3afe-4cb2-8d9f-f51a82cb44ea None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:16:17.147295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9e9e3-3afe-4cb2-8d9f-f51a82cb44ea None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:16:17.147413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9e9e3-3afe-4cb2-8d9f-f51a82cb44ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:16:17.174697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-07b9e9e3-3afe-4cb2-8d9f-f51a82cb44ea None None] MFA Rules not processed for user `54222a689c0c4006b33913f18f33be09`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:16:17.175838 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-07b9e9e3-3afe-4cb2-8d9f-f51a82cb44ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:16:17.240039 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4384/8781] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:16:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:16:17.251807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f45930-9cd3-4c09-aa87-ee416699f208 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:16:17.253299 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c3f45930-9cd3-4c09-aa87-ee416699f208 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:16:17.339147 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f45930-9cd3-4c09-aa87-ee416699f208 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:16:17.345252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f663da-6f80-4d37-9efb-fbcca935a6b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:16:17.345907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f663da-6f80-4d37-9efb-fbcca935a6b3 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:16:17.346195 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f663da-6f80-4d37-9efb-fbcca935a6b3 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:16:17.346476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f663da-6f80-4d37-9efb-fbcca935a6b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:16:17.354219 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f663da-6f80-4d37-9efb-fbcca935a6b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:16:17.355813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f663da-6f80-4d37-9efb-fbcca935a6b3 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:16:17.364634 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4398/8782] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:16:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:16:19.699206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef447ce4-c05f-46f7-977e-e057a7388e2b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:16:19.699761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef447ce4-c05f-46f7-977e-e057a7388e2b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:16:19.699761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef447ce4-c05f-46f7-977e-e057a7388e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:16:19.718051 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ef447ce4-c05f-46f7-977e-e057a7388e2b None None] MFA Rules not processed for user `54222a689c0c4006b33913f18f33be09`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:16:19.719263 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ef447ce4-c05f-46f7-977e-e057a7388e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:16:19.726340 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4385/8783] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:16:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:16:34.758829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001d6e4-85c5-46ab-a662-eda70ce210f3 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:16:34.759370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001d6e4-85c5-46ab-a662-eda70ce210f3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:16:34.759370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001d6e4-85c5-46ab-a662-eda70ce210f3 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:16:34.760715 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4399/8784] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 11:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 11:16:34.765547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcf663-bb8c-4692-ab4e-21543278a124 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:16:34.766003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcf663-bb8c-4692-ab4e-21543278a124 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:16:34.766157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcf663-bb8c-4692-ab4e-21543278a124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:16:34.785986 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b0bcf663-bb8c-4692-ab4e-21543278a124 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:16:34.787184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b0bcf663-bb8c-4692-ab4e-21543278a124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:16:34.846013 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4386/8785] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 11:16:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 11:16:34.866382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12498094-4859-4fc0-8b3c-b7b7d8b97335 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:16:34.866673 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12498094-4859-4fc0-8b3c-b7b7d8b97335 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:16:34.866955 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12498094-4859-4fc0-8b3c-b7b7d8b97335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:16:34.884578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-12498094-4859-4fc0-8b3c-b7b7d8b97335 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:16:34.885800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-12498094-4859-4fc0-8b3c-b7b7d8b97335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:16:34.894373 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4400/8786] 10.222.0.16 () {58 vars in 1057 bytes} [Mon May 2 11:16:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:16:34.900232 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcf663-bb8c-4692-ab4e-21543278a124 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:16:34.911123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcf663-bb8c-4692-ab4e-21543278a124 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:16:34.916068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9e674-52c6-4716-b966-567062532d64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:16:34.916735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9e674-52c6-4716-b966-567062532d64 service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:16:34.917017 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9e674-52c6-4716-b966-567062532d64 service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:16:34.917294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9e674-52c6-4716-b966-567062532d64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:16:34.925977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9e674-52c6-4716-b966-567062532d64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:16:34.927582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9e674-52c6-4716-b966-567062532d64 service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:16:34.937420 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4387/8787] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:16:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:17:06.153647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e0f1f-bd3e-4f1e-84e0-6b362014531c None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:17:06.154187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e0f1f-bd3e-4f1e-84e0-6b362014531c None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:17:06.154307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e0f1f-bd3e-4f1e-84e0-6b362014531c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:17:06.171546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-821e0f1f-bd3e-4f1e-84e0-6b362014531c None None] MFA Rules not processed for user `54222a689c0c4006b33913f18f33be09`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:17:06.172814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-821e0f1f-bd3e-4f1e-84e0-6b362014531c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:17:06.179698 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4401/8788] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:17:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:17:22.265816 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9e674-52c6-4716-b966-567062532d64 service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:17:22.275385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9e674-52c6-4716-b966-567062532d64 service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:17:22.278909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d9b12-fac1-4fd3-b4f9-3358c52c90ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:17:22.279540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d9b12-fac1-4fd3-b4f9-3358c52c90ed service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:17:22.280075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d9b12-fac1-4fd3-b4f9-3358c52c90ed service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:17:22.280351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d9b12-fac1-4fd3-b4f9-3358c52c90ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:17:22.282145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b42d9b12-fac1-4fd3-b4f9-3358c52c90ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:17:22.297880 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d9b12-fac1-4fd3-b4f9-3358c52c90ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:17:22.299301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d9b12-fac1-4fd3-b4f9-3358c52c90ed service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:17:22.312178 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4388/8789] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:17:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:17:23.482784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e0f1f-bd3e-4f1e-84e0-6b362014531c None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:17:23.484379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-821e0f1f-bd3e-4f1e-84e0-6b362014531c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:17:23.496176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e0f1f-bd3e-4f1e-84e0-6b362014531c None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:17:23.502527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa6a1e-7287-4e47-aa74-90bcb9126216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:17:23.502527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa6a1e-7287-4e47-aa74-90bcb9126216 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:17:23.502527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa6a1e-7287-4e47-aa74-90bcb9126216 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:17:23.502527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa6a1e-7287-4e47-aa74-90bcb9126216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:17:23.503360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-dffa6a1e-7287-4e47-aa74-90bcb9126216 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:17:23.519958 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa6a1e-7287-4e47-aa74-90bcb9126216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:17:23.521469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa6a1e-7287-4e47-aa74-90bcb9126216 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:17:23.535135 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4402/8790] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:17:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:17:43.323756 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02be5d-d273-4450-86cb-5c12f426204a None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:17:43.324389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02be5d-d273-4450-86cb-5c12f426204a None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:17:43.324389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02be5d-d273-4450-86cb-5c12f426204a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:17:43.359889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-2d02be5d-d273-4450-86cb-5c12f426204a None None] MFA Rules not processed for user `e6036dd39fb74289a8cbdcd6a21f8662`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:17:43.361018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2d02be5d-d273-4450-86cb-5c12f426204a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:17:43.370537 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4389/8791] 10.222.0.16 () {58 vars in 1057 bytes} [Mon May 2 11:17:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:17:44.539639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0507e29-e0c4-4816-8cd5-b2351e8d005a None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:17:44.540175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0507e29-e0c4-4816-8cd5-b2351e8d005a None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:17:44.540175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0507e29-e0c4-4816-8cd5-b2351e8d005a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:17:44.560067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f0507e29-e0c4-4816-8cd5-b2351e8d005a None None] MFA Rules not processed for user `e6036dd39fb74289a8cbdcd6a21f8662`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:17:44.561305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f0507e29-e0c4-4816-8cd5-b2351e8d005a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:17:44.570497 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4403/8792] 10.222.0.16 () {58 vars in 1057 bytes} [Mon May 2 11:17:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:17:45.742454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be3673-5997-4f9a-ac23-ca13107bf0c4 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:17:45.743002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be3673-5997-4f9a-ac23-ca13107bf0c4 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:17:45.743002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be3673-5997-4f9a-ac23-ca13107bf0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:17:45.761157 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-82be3673-5997-4f9a-ac23-ca13107bf0c4 None None] MFA Rules not processed for user `e6036dd39fb74289a8cbdcd6a21f8662`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:17:45.762330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-82be3673-5997-4f9a-ac23-ca13107bf0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:17:45.771513 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4390/8793] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 11:17:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:17:45.782443 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0507e29-e0c4-4816-8cd5-b2351e8d005a None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:17:45.791655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0507e29-e0c4-4816-8cd5-b2351e8d005a None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:17:45.795252 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c2264-26f5-473e-b3f4-7d7d331f42b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:17:45.795889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c2264-26f5-473e-b3f4-7d7d331f42b7 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:17:45.796173 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c2264-26f5-473e-b3f4-7d7d331f42b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:17:45.796455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c2264-26f5-473e-b3f4-7d7d331f42b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:17:45.807191 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c2264-26f5-473e-b3f4-7d7d331f42b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:17:45.808803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c2264-26f5-473e-b3f4-7d7d331f42b7 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:17:45.819954 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4404/8794] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:17:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:17:46.552718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae9ebb-c3b4-435e-82e9-feb3f175c2df None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:17:46.552951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae9ebb-c3b4-435e-82e9-feb3f175c2df None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:17:46.553233 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae9ebb-c3b4-435e-82e9-feb3f175c2df None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:17:46.554773 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4391/8795] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 11:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 02 11:17:46.559888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d9305-f07e-4b1e-afbd-5d8491f878c1 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:17:46.560179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d9305-f07e-4b1e-afbd-5d8491f878c1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:17:46.560458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d9305-f07e-4b1e-afbd-5d8491f878c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:17:46.578365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-709d9305-f07e-4b1e-afbd-5d8491f878c1 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:17:46.579555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-709d9305-f07e-4b1e-afbd-5d8491f878c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:17:46.588123 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4405/8796] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 11:17:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:17:46.608389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae9ebb-c3b4-435e-82e9-feb3f175c2df None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:17:46.610751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3eae9ebb-c3b4-435e-82e9-feb3f175c2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:17:46.627957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae9ebb-c3b4-435e-82e9-feb3f175c2df None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:17:46.633054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0d95a-cf57-4af4-8d63-3de2a580736e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:17:46.633710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0d95a-cf57-4af4-8d63-3de2a580736e service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:17:46.633977 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0d95a-cf57-4af4-8d63-3de2a580736e service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:17:46.634255 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0d95a-cf57-4af4-8d63-3de2a580736e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:17:46.642493 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0d95a-cf57-4af4-8d63-3de2a580736e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:17:46.644066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0d95a-cf57-4af4-8d63-3de2a580736e service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:17:46.653699 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4392/8797] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:17:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:17:47.447369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26b4bd-01af-4530-b745-8171629b3739 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:17:47.447924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26b4bd-01af-4530-b745-8171629b3739 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:17:47.447924 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26b4bd-01af-4530-b745-8171629b3739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:17:47.466527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ad26b4bd-01af-4530-b745-8171629b3739 None None] MFA Rules not processed for user `e6036dd39fb74289a8cbdcd6a21f8662`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:17:47.467733 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ad26b4bd-01af-4530-b745-8171629b3739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:17:47.477229 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4406/8798] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 11:17:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:17:47.488072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0d95a-cf57-4af4-8d63-3de2a580736e service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:17:47.497295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0d95a-cf57-4af4-8d63-3de2a580736e service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:17:47.501472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c3beb-40d6-43fe-b371-a27f5a2dc7d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:17:47.502108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c3beb-40d6-43fe-b371-a27f5a2dc7d8 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:17:47.502397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c3beb-40d6-43fe-b371-a27f5a2dc7d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:17:47.502676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c3beb-40d6-43fe-b371-a27f5a2dc7d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:17:47.513528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c3beb-40d6-43fe-b371-a27f5a2dc7d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:17:47.514974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c3beb-40d6-43fe-b371-a27f5a2dc7d8 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:17:47.527003 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4393/8799] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:17:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:17:51.021783 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0e85a-98b1-4d38-a5e6-301964b2e743 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:17:51.022381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0e85a-98b1-4d38-a5e6-301964b2e743 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:17:51.022381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0e85a-98b1-4d38-a5e6-301964b2e743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:17:51.058748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-36b0e85a-98b1-4d38-a5e6-301964b2e743 None None] MFA Rules not processed for user `4cd9fe10f94f43aeb3eb10009ee96ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:17:51.059966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-36b0e85a-98b1-4d38-a5e6-301964b2e743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:17:51.067419 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4407/8800] 10.222.0.15 () {58 vars in 1015 bytes} [Mon May 2 11:17:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:17:51.083611 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c3beb-40d6-43fe-b371-a27f5a2dc7d8 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:17:51.092041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c3beb-40d6-43fe-b371-a27f5a2dc7d8 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:17:51.096367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ac6a5-1179-4329-81ce-a42974638758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:17:51.097041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ac6a5-1179-4329-81ce-a42974638758 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:17:51.097327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ac6a5-1179-4329-81ce-a42974638758 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:17:51.097605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ac6a5-1179-4329-81ce-a42974638758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:17:51.105331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ac6a5-1179-4329-81ce-a42974638758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:17:51.106803 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ac6a5-1179-4329-81ce-a42974638758 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:17:51.115678 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4394/8801] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:17:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 11:17:52.007245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0e85a-98b1-4d38-a5e6-301964b2e743 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:17:52.021353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0e85a-98b1-4d38-a5e6-301964b2e743 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:17:52.026933 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33f0f2-83eb-4b18-88fa-c906f4fdfce5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:17:52.027582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33f0f2-83eb-4b18-88fa-c906f4fdfce5 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:17:52.027865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33f0f2-83eb-4b18-88fa-c906f4fdfce5 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:17:52.028229 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33f0f2-83eb-4b18-88fa-c906f4fdfce5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:17:52.030221 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4c33f0f2-83eb-4b18-88fa-c906f4fdfce5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:17:52.044706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33f0f2-83eb-4b18-88fa-c906f4fdfce5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:17:52.046269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33f0f2-83eb-4b18-88fa-c906f4fdfce5 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:17:52.059227 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4408/8802] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:17:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:17:59.273946 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da638210-d6c5-4175-b60e-a0e0f20c4d0c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:17:59.274593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da638210-d6c5-4175-b60e-a0e0f20c4d0c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:17:59.274593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da638210-d6c5-4175-b60e-a0e0f20c4d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:17:59.292638 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-da638210-d6c5-4175-b60e-a0e0f20c4d0c None None] MFA Rules not processed for user `4cd9fe10f94f43aeb3eb10009ee96ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:17:59.293860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-da638210-d6c5-4175-b60e-a0e0f20c4d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:17:59.301091 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4395/8803] 10.222.0.24 () {58 vars in 1015 bytes} [Mon May 2 11:17:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:17:59.315352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33f0f2-83eb-4b18-88fa-c906f4fdfce5 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:17:59.324762 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33f0f2-83eb-4b18-88fa-c906f4fdfce5 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:17:59.328352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a841b-93cf-492f-ac3c-ce215ee6174f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:17:59.329055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a841b-93cf-492f-ac3c-ce215ee6174f service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:17:59.329341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a841b-93cf-492f-ac3c-ce215ee6174f service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:17:59.329625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a841b-93cf-492f-ac3c-ce215ee6174f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:17:59.337279 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a841b-93cf-492f-ac3c-ce215ee6174f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:17:59.343048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a841b-93cf-492f-ac3c-ce215ee6174f service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:17:59.347143 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4409/8804] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:17:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:18:04.645903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc82419-cc03-410a-be9d-e4054e33f54f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:18:04.646993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc82419-cc03-410a-be9d-e4054e33f54f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:18:04.647284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc82419-cc03-410a-be9d-e4054e33f54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:18:04.669131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-acc82419-cc03-410a-be9d-e4054e33f54f None None] MFA Rules not processed for user `e6036dd39fb74289a8cbdcd6a21f8662`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:18:04.670522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-acc82419-cc03-410a-be9d-e4054e33f54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:18:04.681417 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4396/8805] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 11:18:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:18:04.694402 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a841b-93cf-492f-ac3c-ce215ee6174f service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:18:04.708911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a841b-93cf-492f-ac3c-ce215ee6174f service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:18:04.714424 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9520f9-4251-4600-b20f-9318a6a0b35b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:18:04.715082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9520f9-4251-4600-b20f-9318a6a0b35b service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:18:04.715364 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9520f9-4251-4600-b20f-9318a6a0b35b service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:18:04.715640 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9520f9-4251-4600-b20f-9318a6a0b35b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:18:04.725582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9520f9-4251-4600-b20f-9318a6a0b35b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:18:04.731517 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9520f9-4251-4600-b20f-9318a6a0b35b service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:18:04.737773 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4410/8806] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:18:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:18:05.499828 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b23f0-3731-46d1-9fa6-1dfe19966427 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:18:05.500030 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b23f0-3731-46d1-9fa6-1dfe19966427 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:18:05.500320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b23f0-3731-46d1-9fa6-1dfe19966427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:18:05.519636 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-458b23f0-3731-46d1-9fa6-1dfe19966427 None None] MFA Rules not processed for user `54222a689c0c4006b33913f18f33be09`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:18:05.520922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-458b23f0-3731-46d1-9fa6-1dfe19966427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:18:05.528409 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4397/8807] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:18:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:18:05.836145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3288373-2cb4-48b8-8ab4-31552315f36f None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:18:05.836719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3288373-2cb4-48b8-8ab4-31552315f36f None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:18:05.836719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3288373-2cb4-48b8-8ab4-31552315f36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:18:05.854381 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d3288373-2cb4-48b8-8ab4-31552315f36f None None] MFA Rules not processed for user `4cd9fe10f94f43aeb3eb10009ee96ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:18:05.855580 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d3288373-2cb4-48b8-8ab4-31552315f36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:18:05.862907 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4411/8808] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 11:18:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:18:05.874536 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b23f0-3731-46d1-9fa6-1dfe19966427 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:18:05.884586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b23f0-3731-46d1-9fa6-1dfe19966427 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:18:05.888061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff3666-4663-4482-9daa-0c085eef2729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:18:05.888737 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff3666-4663-4482-9daa-0c085eef2729 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:18:05.889023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff3666-4663-4482-9daa-0c085eef2729 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:18:05.889299 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff3666-4663-4482-9daa-0c085eef2729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:18:05.897052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff3666-4663-4482-9daa-0c085eef2729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:18:05.898529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff3666-4663-4482-9daa-0c085eef2729 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:18:05.906877 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4398/8809] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:18:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:18:15.356156 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c801f60-0b35-42dd-a7d6-fd1ad55c66d6 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:18:15.358311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c801f60-0b35-42dd-a7d6-fd1ad55c66d6 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:18:15.358311 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c801f60-0b35-42dd-a7d6-fd1ad55c66d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:18:15.374998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9c801f60-0b35-42dd-a7d6-fd1ad55c66d6 None None] MFA Rules not processed for user `e6036dd39fb74289a8cbdcd6a21f8662`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:18:15.376205 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9c801f60-0b35-42dd-a7d6-fd1ad55c66d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:18:15.385857 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4412/8810] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 11:18:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:18:15.399131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff3666-4663-4482-9daa-0c085eef2729 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:18:15.412957 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff3666-4663-4482-9daa-0c085eef2729 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:18:15.418556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c68e56-94bc-442b-a431-283b6f90166f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:18:15.419280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c68e56-94bc-442b-a431-283b6f90166f service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:18:15.419518 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c68e56-94bc-442b-a431-283b6f90166f service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:18:15.419889 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c68e56-94bc-442b-a431-283b6f90166f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:18:15.429911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c68e56-94bc-442b-a431-283b6f90166f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:18:15.431543 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c68e56-94bc-442b-a431-283b6f90166f service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:18:15.444495 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4399/8811] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:18:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:18:19.971276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d194fb9-5fe9-4a83-9ebe-7f9d6d0050e1 None None] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:18:19.971917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d194fb9-5fe9-4a83-9ebe-7f9d6d0050e1 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:18:19.971917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d194fb9-5fe9-4a83-9ebe-7f9d6d0050e1 None None] PATH_INFO: `/` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:18:19.974189 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4413/8812] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 11:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 11:18:19.979696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61e78b-0e56-4470-875b-27c83188166e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:18:19.980699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61e78b-0e56-4470-875b-27c83188166e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:18:19.981411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61e78b-0e56-4470-875b-27c83188166e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:18:20.005067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-1a61e78b-0e56-4470-875b-27c83188166e None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:18:20.006599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1a61e78b-0e56-4470-875b-27c83188166e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:18:20.026390 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4400/8813] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 11:18:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:18:20.049854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d194fb9-5fe9-4a83-9ebe-7f9d6d0050e1 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:18:20.063512 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d194fb9-5fe9-4a83-9ebe-7f9d6d0050e1 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:18:20.068957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ca2ee-b49a-4eb4-9541-a61749726b73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:18:20.069606 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ca2ee-b49a-4eb4-9541-a61749726b73 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:18:20.069886 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ca2ee-b49a-4eb4-9541-a61749726b73 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:18:20.070164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ca2ee-b49a-4eb4-9541-a61749726b73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:18:20.078915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ca2ee-b49a-4eb4-9541-a61749726b73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:18:20.080476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ca2ee-b49a-4eb4-9541-a61749726b73 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:18:20.090966 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4414/8814] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:18:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:18:20.415529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61e78b-0e56-4470-875b-27c83188166e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:18:20.426050 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61e78b-0e56-4470-875b-27c83188166e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:18:20.431467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406eddb-4b2b-497e-ba41-ca80b8862156 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:18:20.432149 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406eddb-4b2b-497e-ba41-ca80b8862156 service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:18:20.432428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406eddb-4b2b-497e-ba41-ca80b8862156 service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:18:20.432732 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406eddb-4b2b-497e-ba41-ca80b8862156 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:18:20.434500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4406eddb-4b2b-497e-ba41-ca80b8862156 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:18:20.447100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406eddb-4b2b-497e-ba41-ca80b8862156 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:18:20.448712 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406eddb-4b2b-497e-ba41-ca80b8862156 service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:18:20.459250 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4401/8815] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:18:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:18:40.154065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447351b3-5cae-4b34-aad0-78b0557bebd3 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:18:40.154065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447351b3-5cae-4b34-aad0-78b0557bebd3 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:18:40.154065 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447351b3-5cae-4b34-aad0-78b0557bebd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:18:40.172546 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-447351b3-5cae-4b34-aad0-78b0557bebd3 None None] MFA Rules not processed for user `e6036dd39fb74289a8cbdcd6a21f8662`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:18:40.173829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-447351b3-5cae-4b34-aad0-78b0557bebd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:18:40.183932 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4415/8816] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 11:18:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:18:40.197108 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406eddb-4b2b-497e-ba41-ca80b8862156 service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:18:40.209820 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406eddb-4b2b-497e-ba41-ca80b8862156 service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:18:40.215514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6f19a-aec3-411f-a348-03066e42a544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:18:40.216185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6f19a-aec3-411f-a348-03066e42a544 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:18:40.216476 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6f19a-aec3-411f-a348-03066e42a544 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:18:40.216794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6f19a-aec3-411f-a348-03066e42a544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:18:40.226049 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6f19a-aec3-411f-a348-03066e42a544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:18:40.227646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6f19a-aec3-411f-a348-03066e42a544 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:18:40.238937 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4402/8817] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:18:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:18:56.616578 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4ba54-1549-4d13-a76b-48fd182b615b None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:18:56.617129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4ba54-1549-4d13-a76b-48fd182b615b None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:18:56.617239 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4ba54-1549-4d13-a76b-48fd182b615b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:18:56.634669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-37c4ba54-1549-4d13-a76b-48fd182b615b None None] MFA Rules not processed for user `54222a689c0c4006b33913f18f33be09`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:18:56.635911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-37c4ba54-1549-4d13-a76b-48fd182b615b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:18:56.642754 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4416/8818] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:18:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:18:56.947316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1ddf0-d13f-48ec-92c6-f63b9568a4b1 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:18:56.947855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1ddf0-d13f-48ec-92c6-f63b9568a4b1 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:18:56.947855 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1ddf0-d13f-48ec-92c6-f63b9568a4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:18:56.966219 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-77b1ddf0-d13f-48ec-92c6-f63b9568a4b1 None None] MFA Rules not processed for user `4cd9fe10f94f43aeb3eb10009ee96ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:18:56.967148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-77b1ddf0-d13f-48ec-92c6-f63b9568a4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:18:56.974728 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4403/8819] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 11:18:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:18:56.986019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4ba54-1549-4d13-a76b-48fd182b615b None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:18:56.996169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4ba54-1549-4d13-a76b-48fd182b615b None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:18:57.000104 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb206cb-9d47-41a1-89ad-bcb399d792b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:18:57.000801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb206cb-9d47-41a1-89ad-bcb399d792b9 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:18:57.001088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb206cb-9d47-41a1-89ad-bcb399d792b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:18:57.001490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb206cb-9d47-41a1-89ad-bcb399d792b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:18:57.009110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb206cb-9d47-41a1-89ad-bcb399d792b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:18:57.010539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb206cb-9d47-41a1-89ad-bcb399d792b9 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:18:57.018320 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4417/8820] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:18:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 11:18:57.423021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1ddf0-d13f-48ec-92c6-f63b9568a4b1 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:18:57.436415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1ddf0-d13f-48ec-92c6-f63b9568a4b1 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:18:57.441574 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf0f8a-0393-4ad4-a759-015a01ad9caa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:18:57.442225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf0f8a-0393-4ad4-a759-015a01ad9caa service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:18:57.442519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf0f8a-0393-4ad4-a759-015a01ad9caa service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:18:57.442799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf0f8a-0393-4ad4-a759-015a01ad9caa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:18:57.444928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7fcf0f8a-0393-4ad4-a759-015a01ad9caa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:18:57.457967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf0f8a-0393-4ad4-a759-015a01ad9caa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:18:57.460075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf0f8a-0393-4ad4-a759-015a01ad9caa service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:18:57.470128 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4404/8821] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:18:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:19:15.663597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb206cb-9d47-41a1-89ad-bcb399d792b9 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:19:15.672467 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb206cb-9d47-41a1-89ad-bcb399d792b9 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:19:15.676068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb89e79-e656-46aa-af90-2c232f27a407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:19:15.676739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb89e79-e656-46aa-af90-2c232f27a407 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:19:15.677026 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb89e79-e656-46aa-af90-2c232f27a407 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:19:15.677302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb89e79-e656-46aa-af90-2c232f27a407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:19:15.679044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9eb89e79-e656-46aa-af90-2c232f27a407 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:19:15.690642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb89e79-e656-46aa-af90-2c232f27a407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:19:15.692045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb89e79-e656-46aa-af90-2c232f27a407 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:19:15.702642 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4418/8822] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:19:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:19:15.831320 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d42b9-ccaf-4dee-a7eb-16b423dccc7d None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:19:15.831895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d42b9-ccaf-4dee-a7eb-16b423dccc7d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:19:15.831895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d42b9-ccaf-4dee-a7eb-16b423dccc7d None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:19:15.833300 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4405/8823] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 11:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 11:19:15.838616 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021706a-2612-4973-bec4-35913dff4f65 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:19:15.838905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021706a-2612-4973-bec4-35913dff4f65 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:19:15.839188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021706a-2612-4973-bec4-35913dff4f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:19:15.856846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4021706a-2612-4973-bec4-35913dff4f65 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:19:15.858756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4021706a-2612-4973-bec4-35913dff4f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:19:15.866897 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4419/8824] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 11:19:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:19:15.899851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d42b9-ccaf-4dee-a7eb-16b423dccc7d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:19:15.902416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d42b9-ccaf-4dee-a7eb-16b423dccc7d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:19:15.907634 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03b70f-4c9a-470d-860b-9733654f94e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:19:15.908271 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03b70f-4c9a-470d-860b-9733654f94e2 service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:19:15.908556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03b70f-4c9a-470d-860b-9733654f94e2 service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:19:15.908871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03b70f-4c9a-470d-860b-9733654f94e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:19:15.917238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03b70f-4c9a-470d-860b-9733654f94e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:19:15.918817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03b70f-4c9a-470d-860b-9733654f94e2 service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:19:15.928516 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4406/8825] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:19:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:19:16.182070 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021706a-2612-4973-bec4-35913dff4f65 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:19:16.191378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021706a-2612-4973-bec4-35913dff4f65 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:19:16.195619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a0f40-756f-4f12-af0e-94469c0be097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:19:16.196262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a0f40-756f-4f12-af0e-94469c0be097 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:19:16.196549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a0f40-756f-4f12-af0e-94469c0be097 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:19:16.196852 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a0f40-756f-4f12-af0e-94469c0be097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:19:16.198589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-697a0f40-756f-4f12-af0e-94469c0be097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:19:16.213872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a0f40-756f-4f12-af0e-94469c0be097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:19:16.215282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a0f40-756f-4f12-af0e-94469c0be097 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:19:16.228190 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4420/8826] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:19:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:20:12.466132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03b70f-4c9a-470d-860b-9733654f94e2 service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:20:12.481226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03b70f-4c9a-470d-860b-9733654f94e2 service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:20:12.483482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe8b7c-114d-49e6-90a3-a9cbc4bba42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:20:12.484401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8b7c-114d-49e6-90a3-a9cbc4bba42e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:12.484711 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8b7c-114d-49e6-90a3-a9cbc4bba42e admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:12.484993 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8b7c-114d-49e6-90a3-a9cbc4bba42e admin admin] PATH_INFO: `/v3/users/54222a689c0c4006b33913f18f33be09` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:12.486275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe8b7c-114d-49e6-90a3-a9cbc4bba42e admin admin] RBAC: Authorizing `identity:delete_user(user_id=54222a689c0c4006b33913f18f33be09)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:20:12.488368 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe8b7c-114d-49e6-90a3-a9cbc4bba42e admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:20:12.775126 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eabe8b7c-114d-49e6-90a3-a9cbc4bba42e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54222a689c0c4006b33913f18f33be09'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:20:12.786413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eabe8b7c-114d-49e6-90a3-a9cbc4bba42e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54222a689c0c4006b33913f18f33be09'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:20:12.787097 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eabe8b7c-114d-49e6-90a3-a9cbc4bba42e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54222a689c0c4006b33913f18f33be09'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:20:12.794561 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eabe8b7c-114d-49e6-90a3-a9cbc4bba42e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54222a689c0c4006b33913f18f33be09'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:20:12.870062 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-eabe8b7c-114d-49e6-90a3-a9cbc4bba42e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54222a689c0c4006b33913f18f33be09'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:20:12.876116 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4407/8827] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 11:20:12 2022] DELETE /identity/v3/users/54222a689c0c4006b33913f18f33be09 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:20:13.409583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a0f40-756f-4f12-af0e-94469c0be097 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:20:13.420274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a0f40-756f-4f12-af0e-94469c0be097 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:20:13.476881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a19629-4b6a-4d2a-ab24-cc60c1a455e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:20:13.477754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a19629-4b6a-4d2a-ab24-cc60c1a455e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:13.478038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a19629-4b6a-4d2a-ab24-cc60c1a455e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:13.478313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a19629-4b6a-4d2a-ab24-cc60c1a455e7 admin admin] PATH_INFO: `/v3/projects/5b9461ec4cf54a98ab67b4c860d3b6b0` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:13.479495 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a19629-4b6a-4d2a-ab24-cc60c1a455e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b9461ec4cf54a98ab67b4c860d3b6b0)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:20:13.481497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a19629-4b6a-4d2a-ab24-cc60c1a455e7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:20:13.617374 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-42a19629-4b6a-4d2a-ab24-cc60c1a455e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b9461ec4cf54a98ab67b4c860d3b6b0', 'request_id': 'req-42a19629-4b6a-4d2a-ab24-cc60c1a455e7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:20:13.737352 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-42a19629-4b6a-4d2a-ab24-cc60c1a455e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b9461ec4cf54a98ab67b4c860d3b6b0', 'request_id': 'req-42a19629-4b6a-4d2a-ab24-cc60c1a455e7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:20:13.744422 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-42a19629-4b6a-4d2a-ab24-cc60c1a455e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b9461ec4cf54a98ab67b4c860d3b6b0', 'request_id': 'req-42a19629-4b6a-4d2a-ab24-cc60c1a455e7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:20:13.754327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-42a19629-4b6a-4d2a-ab24-cc60c1a455e7 admin admin] The token cache is being invalidate because project 5b9461ec4cf54a98ab67b4c860d3b6b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 11:20:13.754617 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-42a19629-4b6a-4d2a-ab24-cc60c1a455e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:20:13.755254 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-42a19629-4b6a-4d2a-ab24-cc60c1a455e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:20:13.756851 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4421/8828] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 11:20:13 2022] DELETE /identity/v3/projects/5b9461ec4cf54a98ab67b4c860d3b6b0 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:20:13.762006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b4376-2bb3-42b3-8812-1a06c47e82cf None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:13.762498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b4376-2bb3-42b3-8812-1a06c47e82cf None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:13.762645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b4376-2bb3-42b3-8812-1a06c47e82cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:13.781234 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-db0b4376-2bb3-42b3-8812-1a06c47e82cf None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:20:13.782448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-db0b4376-2bb3-42b3-8812-1a06c47e82cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:20:13.840404 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4408/8829] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:20:13.848686 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca46c41-0764-46a3-8d98-30e2f9afee72 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:13.848980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca46c41-0764-46a3-8d98-30e2f9afee72 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:13.850437 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca46c41-0764-46a3-8d98-30e2f9afee72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:13.868804 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1ca46c41-0764-46a3-8d98-30e2f9afee72 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:20:13.870017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1ca46c41-0764-46a3-8d98-30e2f9afee72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:20:13.877930 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4422/8830] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:20:13.882279 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b4376-2bb3-42b3-8812-1a06c47e82cf None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:20:13.891913 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b4376-2bb3-42b3-8812-1a06c47e82cf None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:20:13.896823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483840ac-716a-41c5-8c8b-16572394d5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:20:13.897485 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483840ac-716a-41c5-8c8b-16572394d5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:13.897770 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483840ac-716a-41c5-8c8b-16572394d5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:13.898052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483840ac-716a-41c5-8c8b-16572394d5f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:13.898767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483840ac-716a-41c5-8c8b-16572394d5f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 11:20:13.899079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483840ac-716a-41c5-8c8b-16572394d5f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:20:13.900739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483840ac-716a-41c5-8c8b-16572394d5f2 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:20:13.912317 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4409/8831] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 11:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 11:20:13.917282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca46c41-0764-46a3-8d98-30e2f9afee72 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:20:13.926742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca46c41-0764-46a3-8d98-30e2f9afee72 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:20:13.932293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae61bf-f381-4d84-b15c-2c259b56b6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:20:13.932965 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae61bf-f381-4d84-b15c-2c259b56b6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:13.933248 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae61bf-f381-4d84-b15c-2c259b56b6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:13.933529 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae61bf-f381-4d84-b15c-2c259b56b6b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:13.934232 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae61bf-f381-4d84-b15c-2c259b56b6b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:20:13.936112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae61bf-f381-4d84-b15c-2c259b56b6b5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:20:14.048775 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4423/8832] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 11:20:13 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 11:20:14.052935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483840ac-716a-41c5-8c8b-16572394d5f2 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:20:14.063548 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483840ac-716a-41c5-8c8b-16572394d5f2 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:20:14.119224 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae5916-c35e-4f1c-83a5-6f415e4a8050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:20:14.119900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae5916-c35e-4f1c-83a5-6f415e4a8050 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:14.120186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae5916-c35e-4f1c-83a5-6f415e4a8050 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:14.120467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae5916-c35e-4f1c-83a5-6f415e4a8050 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:14.121197 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae5916-c35e-4f1c-83a5-6f415e4a8050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:20:14.123125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae5916-c35e-4f1c-83a5-6f415e4a8050 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:20:14.230922 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4410/8833] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 11:20:14 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:20:14.235062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae61bf-f381-4d84-b15c-2c259b56b6b5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:20:14.245305 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae61bf-f381-4d84-b15c-2c259b56b6b5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:20:14.249840 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735614ce-e01a-4ad4-ba8d-2a41895989f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:20:14.250492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735614ce-e01a-4ad4-ba8d-2a41895989f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:14.250773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735614ce-e01a-4ad4-ba8d-2a41895989f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:14.251050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735614ce-e01a-4ad4-ba8d-2a41895989f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:14.251815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735614ce-e01a-4ad4-ba8d-2a41895989f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:20:14.253434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735614ce-e01a-4ad4-ba8d-2a41895989f1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:20:14.263503 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4424/8834] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:20:14.267258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae5916-c35e-4f1c-83a5-6f415e4a8050 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:20:14.277709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae5916-c35e-4f1c-83a5-6f415e4a8050 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:20:14.282542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc2e8d-cb63-43c9-93e0-2550db00603f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:20:14.283183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc2e8d-cb63-43c9-93e0-2550db00603f admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:14.283464 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc2e8d-cb63-43c9-93e0-2550db00603f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:14.283738 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc2e8d-cb63-43c9-93e0-2550db00603f admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:14.284459 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc2e8d-cb63-43c9-93e0-2550db00603f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:20:14.286106 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc2e8d-cb63-43c9-93e0-2550db00603f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:20:14.296502 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4411/8835] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:20:14.300560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735614ce-e01a-4ad4-ba8d-2a41895989f1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:20:14.310579 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735614ce-e01a-4ad4-ba8d-2a41895989f1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:20:14.315170 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78540e-a6d9-4bee-831c-d1e193f23493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:20:14.316038 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78540e-a6d9-4bee-831c-d1e193f23493 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:14.316318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78540e-a6d9-4bee-831c-d1e193f23493 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:14.316594 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78540e-a6d9-4bee-831c-d1e193f23493 admin admin] PATH_INFO: `/v3/projects/5d6fbc308ca84836a950ffdd2d8fb4a6/users/f0648105ed3941dbbdd36d9bc1ed386a/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:14.330618 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78540e-a6d9-4bee-831c-d1e193f23493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d6fbc308ca84836a950ffdd2d8fb4a6, user_id=f0648105ed3941dbbdd36d9bc1ed386a, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:20:14.333293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78540e-a6d9-4bee-831c-d1e193f23493 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:20:14.411473 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4425/8836] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:20:14 2022] PUT /identity/v3/projects/5d6fbc308ca84836a950ffdd2d8fb4a6/users/f0648105ed3941dbbdd36d9bc1ed386a/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:20:14.417277 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d090bf-557e-4902-bf46-0bd1a706c5e7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:14.417630 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d090bf-557e-4902-bf46-0bd1a706c5e7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:14.417947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d090bf-557e-4902-bf46-0bd1a706c5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:14.436099 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-b8d090bf-557e-4902-bf46-0bd1a706c5e7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:20:14.437341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-b8d090bf-557e-4902-bf46-0bd1a706c5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:20:14.494863 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4412/8837] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 11:20:14.504534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78540e-a6d9-4bee-831c-d1e193f23493 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:20:14.506810 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7f78540e-a6d9-4bee-831c-d1e193f23493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:20:14.569846 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78540e-a6d9-4bee-831c-d1e193f23493 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:20:14.573774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a0e65-e00e-4bb0-90e6-ccd6a46b6b48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:20:14.574421 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a0e65-e00e-4bb0-90e6-ccd6a46b6b48 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:14.574710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a0e65-e00e-4bb0-90e6-ccd6a46b6b48 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:14.574991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a0e65-e00e-4bb0-90e6-ccd6a46b6b48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:14.584288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a0e65-e00e-4bb0-90e6-ccd6a46b6b48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:20:14.586031 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a0e65-e00e-4bb0-90e6-ccd6a46b6b48 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:20:14.595474 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4426/8838] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:20:16.087916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de4707-7be7-43d6-beed-635bc03cfa9d None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:16.090878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de4707-7be7-43d6-beed-635bc03cfa9d None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:16.090878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de4707-7be7-43d6-beed-635bc03cfa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:16.117511 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-52de4707-7be7-43d6-beed-635bc03cfa9d None None] MFA Rules not processed for user `f0648105ed3941dbbdd36d9bc1ed386a`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:20:16.118774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-52de4707-7be7-43d6-beed-635bc03cfa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:20:16.184687 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4413/8839] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:20:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:20:16.197154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79a821-125b-4150-a487-120936491d81 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:16.197665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79a821-125b-4150-a487-120936491d81 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:16.198090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79a821-125b-4150-a487-120936491d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:16.216471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0a79a821-125b-4150-a487-120936491d81 None None] MFA Rules not processed for user `f0648105ed3941dbbdd36d9bc1ed386a`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:20:16.217761 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0a79a821-125b-4150-a487-120936491d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:20:16.225460 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4427/8840] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:20:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 11:20:16.237354 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de4707-7be7-43d6-beed-635bc03cfa9d None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:20:16.239021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-52de4707-7be7-43d6-beed-635bc03cfa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:20:16.313095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de4707-7be7-43d6-beed-635bc03cfa9d None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:20:16.319413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e4582-c824-4dc1-9d7f-a7ac927aac4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:20:16.320076 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e4582-c824-4dc1-9d7f-a7ac927aac4c service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:16.320361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e4582-c824-4dc1-9d7f-a7ac927aac4c service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:16.320662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e4582-c824-4dc1-9d7f-a7ac927aac4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:16.328911 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e4582-c824-4dc1-9d7f-a7ac927aac4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:20:16.330510 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e4582-c824-4dc1-9d7f-a7ac927aac4c service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:20:16.340028 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4414/8841] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:20:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:20:18.565445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79a821-125b-4150-a487-120936491d81 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:20:18.566893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0a79a821-125b-4150-a487-120936491d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:20:18.636895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79a821-125b-4150-a487-120936491d81 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:20:18.642275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bd905-4aee-4879-a795-b365cf1a0b7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:20:18.643017 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bd905-4aee-4879-a795-b365cf1a0b7d service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:18.643339 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bd905-4aee-4879-a795-b365cf1a0b7d service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:18.643743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bd905-4aee-4879-a795-b365cf1a0b7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:18.645629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-192bd905-4aee-4879-a795-b365cf1a0b7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:20:18.657492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192bd905-4aee-4879-a795-b365cf1a0b7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:20:18.659176 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192bd905-4aee-4879-a795-b365cf1a0b7d service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:20:18.669113 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4428/8842] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:20:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:20:28.699806 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042941ac-6c9a-404d-8e23-c3d42676c4db None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:28.700321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042941ac-6c9a-404d-8e23-c3d42676c4db None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:28.700321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042941ac-6c9a-404d-8e23-c3d42676c4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:28.717340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-042941ac-6c9a-404d-8e23-c3d42676c4db None None] MFA Rules not processed for user `f0648105ed3941dbbdd36d9bc1ed386a`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:20:28.718532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-042941ac-6c9a-404d-8e23-c3d42676c4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:20:28.725910 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4415/8843] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:20:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 11:20:30.678855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bd905-4aee-4879-a795-b365cf1a0b7d service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:20:30.680251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-192bd905-4aee-4879-a795-b365cf1a0b7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:20:30.693506 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bd905-4aee-4879-a795-b365cf1a0b7d service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:20:30.698612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad35b2-7c1d-4aa4-adba-1fb5d310d1ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:20:30.699256 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad35b2-7c1d-4aa4-adba-1fb5d310d1ab service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:30.699545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad35b2-7c1d-4aa4-adba-1fb5d310d1ab service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:30.699824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad35b2-7c1d-4aa4-adba-1fb5d310d1ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:30.701625 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-34ad35b2-7c1d-4aa4-adba-1fb5d310d1ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:20:30.713985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad35b2-7c1d-4aa4-adba-1fb5d310d1ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:20:30.715561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad35b2-7c1d-4aa4-adba-1fb5d310d1ab service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:20:30.726030 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4429/8844] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:20:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:20:53.052854 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042941ac-6c9a-404d-8e23-c3d42676c4db None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:20:53.063582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042941ac-6c9a-404d-8e23-c3d42676c4db None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:20:53.068759 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f52aa-0724-469d-8416-00d7dfda1198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:20:53.069625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f52aa-0724-469d-8416-00d7dfda1198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:53.069937 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f52aa-0724-469d-8416-00d7dfda1198 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:53.070218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f52aa-0724-469d-8416-00d7dfda1198 admin admin] PATH_INFO: `/v3/users/f0648105ed3941dbbdd36d9bc1ed386a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:53.071403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f52aa-0724-469d-8416-00d7dfda1198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0648105ed3941dbbdd36d9bc1ed386a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:20:53.073367 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f52aa-0724-469d-8416-00d7dfda1198 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:20:53.306745 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8e5f52aa-0724-469d-8416-00d7dfda1198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0648105ed3941dbbdd36d9bc1ed386a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:20:53.318667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8e5f52aa-0724-469d-8416-00d7dfda1198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0648105ed3941dbbdd36d9bc1ed386a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:20:53.319335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8e5f52aa-0724-469d-8416-00d7dfda1198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0648105ed3941dbbdd36d9bc1ed386a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:20:53.326226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8e5f52aa-0724-469d-8416-00d7dfda1198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0648105ed3941dbbdd36d9bc1ed386a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:20:53.424448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-8e5f52aa-0724-469d-8416-00d7dfda1198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0648105ed3941dbbdd36d9bc1ed386a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:20:53.431082 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4416/8845] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 11:20:53 2022] DELETE /identity/v3/users/f0648105ed3941dbbdd36d9bc1ed386a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:20:53.711391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad35b2-7c1d-4aa4-adba-1fb5d310d1ab service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:20:53.724706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad35b2-7c1d-4aa4-adba-1fb5d310d1ab service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:20:53.778760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd7c20-6eda-4ea1-a3b0-97e4dcf06531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:20:53.779615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd7c20-6eda-4ea1-a3b0-97e4dcf06531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:53.779896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd7c20-6eda-4ea1-a3b0-97e4dcf06531 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:53.780169 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd7c20-6eda-4ea1-a3b0-97e4dcf06531 admin admin] PATH_INFO: `/v3/projects/5d6fbc308ca84836a950ffdd2d8fb4a6` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:53.781639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd7c20-6eda-4ea1-a3b0-97e4dcf06531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d6fbc308ca84836a950ffdd2d8fb4a6)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:20:53.783534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd7c20-6eda-4ea1-a3b0-97e4dcf06531 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:20:53.908164 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c5fd7c20-6eda-4ea1-a3b0-97e4dcf06531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d6fbc308ca84836a950ffdd2d8fb4a6', 'request_id': 'req-c5fd7c20-6eda-4ea1-a3b0-97e4dcf06531'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:20:54.012697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c5fd7c20-6eda-4ea1-a3b0-97e4dcf06531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d6fbc308ca84836a950ffdd2d8fb4a6', 'request_id': 'req-c5fd7c20-6eda-4ea1-a3b0-97e4dcf06531'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:20:54.019175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c5fd7c20-6eda-4ea1-a3b0-97e4dcf06531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d6fbc308ca84836a950ffdd2d8fb4a6', 'request_id': 'req-c5fd7c20-6eda-4ea1-a3b0-97e4dcf06531'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:20:54.029765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c5fd7c20-6eda-4ea1-a3b0-97e4dcf06531 admin admin] The token cache is being invalidate because project 5d6fbc308ca84836a950ffdd2d8fb4a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 11:20:54.030048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c5fd7c20-6eda-4ea1-a3b0-97e4dcf06531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:20:54.030679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c5fd7c20-6eda-4ea1-a3b0-97e4dcf06531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:20:54.032478 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4430/8846] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 11:20:53 2022] DELETE /identity/v3/projects/5d6fbc308ca84836a950ffdd2d8fb4a6 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:20:54.038140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7871f01-0811-4b0b-9268-7f58843d1e98 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:54.038462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7871f01-0811-4b0b-9268-7f58843d1e98 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:54.038747 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7871f01-0811-4b0b-9268-7f58843d1e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:54.057506 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d7871f01-0811-4b0b-9268-7f58843d1e98 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:20:54.058692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d7871f01-0811-4b0b-9268-7f58843d1e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:20:54.116734 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4417/8847] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:20:54.124865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47ab1c-dc26-4a48-afaa-7e1648addbe8 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:54.125157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47ab1c-dc26-4a48-afaa-7e1648addbe8 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:54.125444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47ab1c-dc26-4a48-afaa-7e1648addbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:54.143214 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-9b47ab1c-dc26-4a48-afaa-7e1648addbe8 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:20:54.144410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9b47ab1c-dc26-4a48-afaa-7e1648addbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:20:54.152777 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4431/8848] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:20:54.157184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7871f01-0811-4b0b-9268-7f58843d1e98 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:20:54.166662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7871f01-0811-4b0b-9268-7f58843d1e98 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:20:54.171270 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc09374-f093-4ea2-ae34-3cfd358892c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:20:54.171920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc09374-f093-4ea2-ae34-3cfd358892c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:54.172200 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc09374-f093-4ea2-ae34-3cfd358892c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:54.172474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc09374-f093-4ea2-ae34-3cfd358892c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:54.173221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc09374-f093-4ea2-ae34-3cfd358892c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 11:20:54.173528 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc09374-f093-4ea2-ae34-3cfd358892c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:20:54.175389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc09374-f093-4ea2-ae34-3cfd358892c5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:20:54.186867 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4418/8849] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 11:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 11:20:54.191187 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47ab1c-dc26-4a48-afaa-7e1648addbe8 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:20:54.200771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47ab1c-dc26-4a48-afaa-7e1648addbe8 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:20:54.205441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc32ce-c63a-43ed-bf17-e867c231f218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:20:54.206089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc32ce-c63a-43ed-bf17-e867c231f218 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:54.206373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc32ce-c63a-43ed-bf17-e867c231f218 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:54.206658 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc32ce-c63a-43ed-bf17-e867c231f218 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:54.207345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc32ce-c63a-43ed-bf17-e867c231f218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:20:54.209752 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc32ce-c63a-43ed-bf17-e867c231f218 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:20:54.317116 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4432/8850] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 11:20:54 2022] POST /identity/v3/projects => generated 369 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 11:20:54.321209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc09374-f093-4ea2-ae34-3cfd358892c5 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:20:54.331341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc09374-f093-4ea2-ae34-3cfd358892c5 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:20:54.386341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68770c8e-27d6-4cf6-9d93-e92432de9600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:20:54.387004 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68770c8e-27d6-4cf6-9d93-e92432de9600 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:54.387286 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68770c8e-27d6-4cf6-9d93-e92432de9600 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:54.387562 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68770c8e-27d6-4cf6-9d93-e92432de9600 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:54.388239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68770c8e-27d6-4cf6-9d93-e92432de9600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:20:54.390187 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68770c8e-27d6-4cf6-9d93-e92432de9600 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:20:54.479810 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4419/8851] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 11:20:54 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:20:54.483748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc32ce-c63a-43ed-bf17-e867c231f218 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:20:54.495396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc32ce-c63a-43ed-bf17-e867c231f218 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:20:54.500062 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47755c42-a129-469c-bda3-209c54a06798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:20:54.500807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47755c42-a129-469c-bda3-209c54a06798 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:54.501096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47755c42-a129-469c-bda3-209c54a06798 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:54.501410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47755c42-a129-469c-bda3-209c54a06798 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:54.502396 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47755c42-a129-469c-bda3-209c54a06798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:20:54.503982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47755c42-a129-469c-bda3-209c54a06798 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:20:54.514398 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4433/8852] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:20:54.518207 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68770c8e-27d6-4cf6-9d93-e92432de9600 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:20:54.528700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68770c8e-27d6-4cf6-9d93-e92432de9600 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:20:54.533807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221b621-c72b-4502-8db6-571e21fa88cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:20:54.534593 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221b621-c72b-4502-8db6-571e21fa88cc admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:54.534877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221b621-c72b-4502-8db6-571e21fa88cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:54.535183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221b621-c72b-4502-8db6-571e21fa88cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:54.536405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221b621-c72b-4502-8db6-571e21fa88cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:20:54.538065 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221b621-c72b-4502-8db6-571e21fa88cc admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:20:54.548660 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4420/8853] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:20:54.553486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47755c42-a129-469c-bda3-209c54a06798 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:20:54.563948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47755c42-a129-469c-bda3-209c54a06798 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:20:54.568868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13a67f-51ad-4735-993b-1ac087bd859c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:20:54.569690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13a67f-51ad-4735-993b-1ac087bd859c admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:54.569975 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13a67f-51ad-4735-993b-1ac087bd859c admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:54.570289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13a67f-51ad-4735-993b-1ac087bd859c admin admin] PATH_INFO: `/v3/projects/b3c0c44c481b4e41b45b869f24b34641/users/7cb5996ba16146a6bf483c8a8f97da4a/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:54.585298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13a67f-51ad-4735-993b-1ac087bd859c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c0c44c481b4e41b45b869f24b34641, user_id=7cb5996ba16146a6bf483c8a8f97da4a, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:20:54.588272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13a67f-51ad-4735-993b-1ac087bd859c admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:20:54.693171 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4434/8854] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:20:54 2022] PUT /identity/v3/projects/b3c0c44c481b4e41b45b869f24b34641/users/7cb5996ba16146a6bf483c8a8f97da4a/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:20:54.753618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be81b1-9d3f-4a51-aa71-2bdf7c71673f None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:54.753909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be81b1-9d3f-4a51-aa71-2bdf7c71673f None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:54.754193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be81b1-9d3f-4a51-aa71-2bdf7c71673f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:54.782590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-34be81b1-9d3f-4a51-aa71-2bdf7c71673f None None] MFA Rules not processed for user `7cb5996ba16146a6bf483c8a8f97da4a`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:20:54.783933 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-34be81b1-9d3f-4a51-aa71-2bdf7c71673f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:20:54.847007 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4421/8855] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:20:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:20:54.857675 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13a67f-51ad-4735-993b-1ac087bd859c admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:20:54.859486 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ec13a67f-51ad-4735-993b-1ac087bd859c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:20:54.916262 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13a67f-51ad-4735-993b-1ac087bd859c admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:20:54.919925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd909ba5-b0ec-4f37-ab32-9b7fd91c69f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:20:54.920618 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd909ba5-b0ec-4f37-ab32-9b7fd91c69f6 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:20:54.920925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd909ba5-b0ec-4f37-ab32-9b7fd91c69f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:20:54.921313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd909ba5-b0ec-4f37-ab32-9b7fd91c69f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:20:54.929500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd909ba5-b0ec-4f37-ab32-9b7fd91c69f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:20:54.930925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd909ba5-b0ec-4f37-ab32-9b7fd91c69f6 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:20:54.939887 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4435/8856] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:20:54 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:21:14.104713 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be81b1-9d3f-4a51-aa71-2bdf7c71673f None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:14.169604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be81b1-9d3f-4a51-aa71-2bdf7c71673f None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:14.174063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bef3a2-bef2-4485-b4b9-8a430c51c5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:14.174918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bef3a2-bef2-4485-b4b9-8a430c51c5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:14.175184 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bef3a2-bef2-4485-b4b9-8a430c51c5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:14.175456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bef3a2-bef2-4485-b4b9-8a430c51c5c0 admin admin] PATH_INFO: `/v3/users/7cb5996ba16146a6bf483c8a8f97da4a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:14.176679 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bef3a2-bef2-4485-b4b9-8a430c51c5c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cb5996ba16146a6bf483c8a8f97da4a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:14.178640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bef3a2-bef2-4485-b4b9-8a430c51c5c0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:14.381192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f9bef3a2-bef2-4485-b4b9-8a430c51c5c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cb5996ba16146a6bf483c8a8f97da4a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:21:14.392570 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f9bef3a2-bef2-4485-b4b9-8a430c51c5c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cb5996ba16146a6bf483c8a8f97da4a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:21:14.393256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f9bef3a2-bef2-4485-b4b9-8a430c51c5c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cb5996ba16146a6bf483c8a8f97da4a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:21:14.400714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f9bef3a2-bef2-4485-b4b9-8a430c51c5c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cb5996ba16146a6bf483c8a8f97da4a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:21:14.565000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f9bef3a2-bef2-4485-b4b9-8a430c51c5c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cb5996ba16146a6bf483c8a8f97da4a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:21:14.572025 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4422/8857] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 11:21:14 2022] DELETE /identity/v3/users/7cb5996ba16146a6bf483c8a8f97da4a => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:21:14.576571 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ede9be-d08c-4281-9a27-6e59cf617ec7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:14.577090 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ede9be-d08c-4281-9a27-6e59cf617ec7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:14.577218 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ede9be-d08c-4281-9a27-6e59cf617ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:14.594549 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-22ede9be-d08c-4281-9a27-6e59cf617ec7 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:21:14.595739 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-22ede9be-d08c-4281-9a27-6e59cf617ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:21:14.651669 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4436/8858] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 11:21:14.662231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bef3a2-bef2-4485-b4b9-8a430c51c5c0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:14.663651 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f9bef3a2-bef2-4485-b4b9-8a430c51c5c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:21:14.719974 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bef3a2-bef2-4485-b4b9-8a430c51c5c0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:14.723582 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b191c6-2b83-46a4-927e-1e9c3845ebc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:14.724258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b191c6-2b83-46a4-927e-1e9c3845ebc5 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:14.724644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b191c6-2b83-46a4-927e-1e9c3845ebc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:14.724852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b191c6-2b83-46a4-927e-1e9c3845ebc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:14.734300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b191c6-2b83-46a4-927e-1e9c3845ebc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:14.735799 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b191c6-2b83-46a4-927e-1e9c3845ebc5 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:14.745784 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4423/8859] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:21:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 11:21:15.076934 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ede9be-d08c-4281-9a27-6e59cf617ec7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:15.078455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-22ede9be-d08c-4281-9a27-6e59cf617ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:21:15.095666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ede9be-d08c-4281-9a27-6e59cf617ec7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:15.106431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dce1f1-1d30-4b78-8d66-7d1e9954fcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:15.107394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dce1f1-1d30-4b78-8d66-7d1e9954fcb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:15.107748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dce1f1-1d30-4b78-8d66-7d1e9954fcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:15.108116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dce1f1-1d30-4b78-8d66-7d1e9954fcb3 admin admin] PATH_INFO: `/v3/projects/b3c0c44c481b4e41b45b869f24b34641` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:15.110040 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dce1f1-1d30-4b78-8d66-7d1e9954fcb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c0c44c481b4e41b45b869f24b34641)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:15.112128 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dce1f1-1d30-4b78-8d66-7d1e9954fcb3 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:15.243039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-99dce1f1-1d30-4b78-8d66-7d1e9954fcb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c0c44c481b4e41b45b869f24b34641', 'request_id': 'req-99dce1f1-1d30-4b78-8d66-7d1e9954fcb3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:21:15.349898 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-99dce1f1-1d30-4b78-8d66-7d1e9954fcb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c0c44c481b4e41b45b869f24b34641', 'request_id': 'req-99dce1f1-1d30-4b78-8d66-7d1e9954fcb3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:21:15.356881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-99dce1f1-1d30-4b78-8d66-7d1e9954fcb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c0c44c481b4e41b45b869f24b34641', 'request_id': 'req-99dce1f1-1d30-4b78-8d66-7d1e9954fcb3'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:21:15.367008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-99dce1f1-1d30-4b78-8d66-7d1e9954fcb3 admin admin] The token cache is being invalidate because project b3c0c44c481b4e41b45b869f24b34641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 11:21:15.367292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-99dce1f1-1d30-4b78-8d66-7d1e9954fcb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:21:15.367930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-99dce1f1-1d30-4b78-8d66-7d1e9954fcb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:21:15.372229 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4437/8860] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 11:21:15 2022] DELETE /identity/v3/projects/b3c0c44c481b4e41b45b869f24b34641 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:21:15.374779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a97ea-06d0-4438-b821-cf7615cc7367 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:15.375285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a97ea-06d0-4438-b821-cf7615cc7367 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:15.375419 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a97ea-06d0-4438-b821-cf7615cc7367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:15.392557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-de1a97ea-06d0-4438-b821-cf7615cc7367 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:21:15.393775 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-de1a97ea-06d0-4438-b821-cf7615cc7367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:21:15.451343 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4424/8861] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:21:15.460410 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a029df-6caf-4aaa-8126-92b2207d354d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:15.460737 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a029df-6caf-4aaa-8126-92b2207d354d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:15.461022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a029df-6caf-4aaa-8126-92b2207d354d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:15.480968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-18a029df-6caf-4aaa-8126-92b2207d354d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:21:15.480968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-18a029df-6caf-4aaa-8126-92b2207d354d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:21:15.488618 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4438/8862] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:21:15.492924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a97ea-06d0-4438-b821-cf7615cc7367 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:15.503304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a97ea-06d0-4438-b821-cf7615cc7367 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:15.507989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf7ede-8a78-4aae-93ff-012bb1bcdf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:15.508676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf7ede-8a78-4aae-93ff-012bb1bcdf41 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:15.508972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf7ede-8a78-4aae-93ff-012bb1bcdf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:15.509268 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf7ede-8a78-4aae-93ff-012bb1bcdf41 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:15.510075 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf7ede-8a78-4aae-93ff-012bb1bcdf41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 11:21:15.510435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf7ede-8a78-4aae-93ff-012bb1bcdf41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:15.512252 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf7ede-8a78-4aae-93ff-012bb1bcdf41 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:15.524428 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4425/8863] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 11:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 11:21:15.528655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a029df-6caf-4aaa-8126-92b2207d354d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:15.538666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a029df-6caf-4aaa-8126-92b2207d354d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:15.543325 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870bda5-8d16-4634-bd0d-9d6b1367fe06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:15.543974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870bda5-8d16-4634-bd0d-9d6b1367fe06 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:15.544257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870bda5-8d16-4634-bd0d-9d6b1367fe06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:15.544539 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870bda5-8d16-4634-bd0d-9d6b1367fe06 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:15.545271 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870bda5-8d16-4634-bd0d-9d6b1367fe06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:15.547159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870bda5-8d16-4634-bd0d-9d6b1367fe06 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:15.662730 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4439/8864] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 11:21:15 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 11:21:15.666996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf7ede-8a78-4aae-93ff-012bb1bcdf41 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:15.677202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf7ede-8a78-4aae-93ff-012bb1bcdf41 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:15.734066 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38866e2-0104-42b0-b017-072c54be433a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:15.734739 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38866e2-0104-42b0-b017-072c54be433a admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:15.735028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38866e2-0104-42b0-b017-072c54be433a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:15.735309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38866e2-0104-42b0-b017-072c54be433a admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:15.736040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38866e2-0104-42b0-b017-072c54be433a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:15.738028 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38866e2-0104-42b0-b017-072c54be433a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:15.859026 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4426/8865] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 11:21:15 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 02 11:21:15.862415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870bda5-8d16-4634-bd0d-9d6b1367fe06 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:15.872743 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870bda5-8d16-4634-bd0d-9d6b1367fe06 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:15.877511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341b94d-b09e-4c90-88ab-0a6886c99267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:15.878184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341b94d-b09e-4c90-88ab-0a6886c99267 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:15.878475 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341b94d-b09e-4c90-88ab-0a6886c99267 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:15.879278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341b94d-b09e-4c90-88ab-0a6886c99267 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:15.880011 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341b94d-b09e-4c90-88ab-0a6886c99267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:15.881742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341b94d-b09e-4c90-88ab-0a6886c99267 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:15.892434 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4440/8866] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:21:15.896997 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38866e2-0104-42b0-b017-072c54be433a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:15.907469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38866e2-0104-42b0-b017-072c54be433a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:15.912352 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664e11c-a283-4c80-b014-4ba056ce9dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:15.913053 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664e11c-a283-4c80-b014-4ba056ce9dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:15.913344 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664e11c-a283-4c80-b014-4ba056ce9dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:15.913627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664e11c-a283-4c80-b014-4ba056ce9dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:15.914351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664e11c-a283-4c80-b014-4ba056ce9dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:15.916067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664e11c-a283-4c80-b014-4ba056ce9dd7 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:15.926420 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4427/8867] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 02 11:21:15.930384 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341b94d-b09e-4c90-88ab-0a6886c99267 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:15.940630 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341b94d-b09e-4c90-88ab-0a6886c99267 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:15.945694 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a4204-f61b-4eb8-9a66-cb7922c0ba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:15.946621 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a4204-f61b-4eb8-9a66-cb7922c0ba4a admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:15.946904 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a4204-f61b-4eb8-9a66-cb7922c0ba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:15.947179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a4204-f61b-4eb8-9a66-cb7922c0ba4a admin admin] PATH_INFO: `/v3/projects/eb22b182ffe84a88a7954d5f08fb4aa1/users/73ff67faaeb14d71acc3ade0dee0c722/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:15.961751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a4204-f61b-4eb8-9a66-cb7922c0ba4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb22b182ffe84a88a7954d5f08fb4aa1, user_id=73ff67faaeb14d71acc3ade0dee0c722, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:15.964471 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a4204-f61b-4eb8-9a66-cb7922c0ba4a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:16.084034 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4441/8868] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:21:15 2022] PUT /identity/v3/projects/eb22b182ffe84a88a7954d5f08fb4aa1/users/73ff67faaeb14d71acc3ade0dee0c722/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:21:16.094189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10440d-762b-457e-8323-5462b23ddca8 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:16.094486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10440d-762b-457e-8323-5462b23ddca8 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:16.094772 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10440d-762b-457e-8323-5462b23ddca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:16.122256 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ae10440d-762b-457e-8323-5462b23ddca8 None None] MFA Rules not processed for user `73ff67faaeb14d71acc3ade0dee0c722`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:21:16.123515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ae10440d-762b-457e-8323-5462b23ddca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:21:16.186058 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4428/8869] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:21:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:21:16.196799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a4204-f61b-4eb8-9a66-cb7922c0ba4a admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:16.198488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-551a4204-f61b-4eb8-9a66-cb7922c0ba4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:21:16.261027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a4204-f61b-4eb8-9a66-cb7922c0ba4a admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:16.265834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dba06-6e25-479a-b9ee-d5d3874caa09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:16.266522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dba06-6e25-479a-b9ee-d5d3874caa09 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:16.266803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dba06-6e25-479a-b9ee-d5d3874caa09 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:16.267083 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dba06-6e25-479a-b9ee-d5d3874caa09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:16.277092 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dba06-6e25-479a-b9ee-d5d3874caa09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:16.295710 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dba06-6e25-479a-b9ee-d5d3874caa09 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:16.295710 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4442/8870] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:21:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:21:23.153436 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10440d-762b-457e-8323-5462b23ddca8 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:23.215247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10440d-762b-457e-8323-5462b23ddca8 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:23.219724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9beaf-6582-45dd-8ee0-e6d09a0bac80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:23.220645 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9beaf-6582-45dd-8ee0-e6d09a0bac80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:23.220934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9beaf-6582-45dd-8ee0-e6d09a0bac80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:23.221212 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9beaf-6582-45dd-8ee0-e6d09a0bac80 admin admin] PATH_INFO: `/v3/users/73ff67faaeb14d71acc3ade0dee0c722` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:23.222906 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9beaf-6582-45dd-8ee0-e6d09a0bac80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ff67faaeb14d71acc3ade0dee0c722)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:23.224877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9beaf-6582-45dd-8ee0-e6d09a0bac80 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:23.465084 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e1e9beaf-6582-45dd-8ee0-e6d09a0bac80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ff67faaeb14d71acc3ade0dee0c722'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:21:23.477093 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e1e9beaf-6582-45dd-8ee0-e6d09a0bac80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ff67faaeb14d71acc3ade0dee0c722'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:21:23.477761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e1e9beaf-6582-45dd-8ee0-e6d09a0bac80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ff67faaeb14d71acc3ade0dee0c722'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:21:23.484879 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e1e9beaf-6582-45dd-8ee0-e6d09a0bac80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ff67faaeb14d71acc3ade0dee0c722'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:21:23.578203 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-e1e9beaf-6582-45dd-8ee0-e6d09a0bac80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ff67faaeb14d71acc3ade0dee0c722'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:21:23.585520 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4429/8871] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 11:21:23 2022] DELETE /identity/v3/users/73ff67faaeb14d71acc3ade0dee0c722 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:21:23.595009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e77a94-37b9-4ff5-9343-bfbe4a1bb8dc None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:23.595009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e77a94-37b9-4ff5-9343-bfbe4a1bb8dc None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:23.595009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e77a94-37b9-4ff5-9343-bfbe4a1bb8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:23.608871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-39e77a94-37b9-4ff5-9343-bfbe4a1bb8dc None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:21:23.610061 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-39e77a94-37b9-4ff5-9343-bfbe4a1bb8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:21:23.667682 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4443/8872] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:21:23.677441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9beaf-6582-45dd-8ee0-e6d09a0bac80 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:23.679072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e1e9beaf-6582-45dd-8ee0-e6d09a0bac80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:21:23.737179 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9beaf-6582-45dd-8ee0-e6d09a0bac80 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:23.741002 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969deef-2ff3-448d-b910-832e411d8f8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:23.741686 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969deef-2ff3-448d-b910-832e411d8f8b service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:23.741973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969deef-2ff3-448d-b910-832e411d8f8b service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:23.742298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969deef-2ff3-448d-b910-832e411d8f8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:23.752294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969deef-2ff3-448d-b910-832e411d8f8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:23.753812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969deef-2ff3-448d-b910-832e411d8f8b service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:23.763936 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4430/8873] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:21:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 11:21:24.013928 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e77a94-37b9-4ff5-9343-bfbe4a1bb8dc None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:24.015350 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-39e77a94-37b9-4ff5-9343-bfbe4a1bb8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:21:24.028446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e77a94-37b9-4ff5-9343-bfbe4a1bb8dc None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:24.033499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62ab20-26a5-4017-af14-ba989f3ddf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:24.034367 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62ab20-26a5-4017-af14-ba989f3ddf23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:24.035203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62ab20-26a5-4017-af14-ba989f3ddf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:24.035492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62ab20-26a5-4017-af14-ba989f3ddf23 admin admin] PATH_INFO: `/v3/projects/eb22b182ffe84a88a7954d5f08fb4aa1` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:24.036770 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62ab20-26a5-4017-af14-ba989f3ddf23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb22b182ffe84a88a7954d5f08fb4aa1)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:24.038799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62ab20-26a5-4017-af14-ba989f3ddf23 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:24.172978 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0e62ab20-26a5-4017-af14-ba989f3ddf23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb22b182ffe84a88a7954d5f08fb4aa1', 'request_id': 'req-0e62ab20-26a5-4017-af14-ba989f3ddf23'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:21:24.269566 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0e62ab20-26a5-4017-af14-ba989f3ddf23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb22b182ffe84a88a7954d5f08fb4aa1', 'request_id': 'req-0e62ab20-26a5-4017-af14-ba989f3ddf23'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:21:24.276007 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0e62ab20-26a5-4017-af14-ba989f3ddf23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb22b182ffe84a88a7954d5f08fb4aa1', 'request_id': 'req-0e62ab20-26a5-4017-af14-ba989f3ddf23'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:21:24.286961 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0e62ab20-26a5-4017-af14-ba989f3ddf23 admin admin] The token cache is being invalidate because project eb22b182ffe84a88a7954d5f08fb4aa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 11:21:24.287249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0e62ab20-26a5-4017-af14-ba989f3ddf23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:21:24.287903 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-0e62ab20-26a5-4017-af14-ba989f3ddf23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:21:24.289481 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4444/8874] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 11:21:24 2022] DELETE /identity/v3/projects/eb22b182ffe84a88a7954d5f08fb4aa1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:21:24.295228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655aab4d-45e4-4c6c-ada5-b6ea471b4b06 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:24.295726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655aab4d-45e4-4c6c-ada5-b6ea471b4b06 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:24.295871 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655aab4d-45e4-4c6c-ada5-b6ea471b4b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:24.315973 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-655aab4d-45e4-4c6c-ada5-b6ea471b4b06 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:21:24.317210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-655aab4d-45e4-4c6c-ada5-b6ea471b4b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:21:24.379601 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4431/8875] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:21:24.387457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971e179-a1c6-4a94-bae6-b4a0627c7c43 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:24.387756 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971e179-a1c6-4a94-bae6-b4a0627c7c43 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:24.388037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971e179-a1c6-4a94-bae6-b4a0627c7c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:24.407082 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-2971e179-a1c6-4a94-bae6-b4a0627c7c43 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:21:24.408288 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-2971e179-a1c6-4a94-bae6-b4a0627c7c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:21:24.416949 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4445/8876] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:21:24.421123 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655aab4d-45e4-4c6c-ada5-b6ea471b4b06 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:24.431146 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655aab4d-45e4-4c6c-ada5-b6ea471b4b06 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:24.435661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549ce85-2abf-4e2e-ae26-da3430f572c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:24.436307 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549ce85-2abf-4e2e-ae26-da3430f572c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:24.436590 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549ce85-2abf-4e2e-ae26-da3430f572c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:24.436900 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549ce85-2abf-4e2e-ae26-da3430f572c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:24.437612 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549ce85-2abf-4e2e-ae26-da3430f572c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 11:21:24.437923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549ce85-2abf-4e2e-ae26-da3430f572c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:24.439515 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549ce85-2abf-4e2e-ae26-da3430f572c3 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:24.451054 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4432/8877] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 11:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 11:21:24.455291 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971e179-a1c6-4a94-bae6-b4a0627c7c43 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:24.464994 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971e179-a1c6-4a94-bae6-b4a0627c7c43 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:24.469722 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bd405-4ddb-4fc8-b032-1468f7bf6bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:24.470365 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bd405-4ddb-4fc8-b032-1468f7bf6bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:24.470646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bd405-4ddb-4fc8-b032-1468f7bf6bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:24.470985 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bd405-4ddb-4fc8-b032-1468f7bf6bf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:24.471706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701bd405-4ddb-4fc8-b032-1468f7bf6bf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:24.474203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701bd405-4ddb-4fc8-b032-1468f7bf6bf1 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:24.568123 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4446/8878] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 11:21:24 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:21:24.572404 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549ce85-2abf-4e2e-ae26-da3430f572c3 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:24.582682 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549ce85-2abf-4e2e-ae26-da3430f572c3 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:24.640218 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee09431-a722-4ba5-a5a6-ff193a68a6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:24.640925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee09431-a722-4ba5-a5a6-ff193a68a6c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:24.641213 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee09431-a722-4ba5-a5a6-ff193a68a6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:24.641490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee09431-a722-4ba5-a5a6-ff193a68a6c1 admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:24.642183 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee09431-a722-4ba5-a5a6-ff193a68a6c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:24.644817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee09431-a722-4ba5-a5a6-ff193a68a6c1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:24.773227 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4433/8879] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 11:21:24 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:21:24.777531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bd405-4ddb-4fc8-b032-1468f7bf6bf1 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:24.788866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bd405-4ddb-4fc8-b032-1468f7bf6bf1 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:24.793772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f942e3c-ccac-4bfb-af98-8b5d47548d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:24.794434 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f942e3c-ccac-4bfb-af98-8b5d47548d04 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:24.794721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f942e3c-ccac-4bfb-af98-8b5d47548d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:24.795272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f942e3c-ccac-4bfb-af98-8b5d47548d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:24.796004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f942e3c-ccac-4bfb-af98-8b5d47548d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:24.797622 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f942e3c-ccac-4bfb-af98-8b5d47548d04 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:24.807975 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4447/8880] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:21:24.811898 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee09431-a722-4ba5-a5a6-ff193a68a6c1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:24.821782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee09431-a722-4ba5-a5a6-ff193a68a6c1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:24.826416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443fb3d2-314d-4fb0-9760-4c93d7d6b6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:24.827104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fb3d2-314d-4fb0-9760-4c93d7d6b6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:24.827388 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fb3d2-314d-4fb0-9760-4c93d7d6b6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:24.827662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fb3d2-314d-4fb0-9760-4c93d7d6b6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:24.828376 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443fb3d2-314d-4fb0-9760-4c93d7d6b6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:24.829996 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443fb3d2-314d-4fb0-9760-4c93d7d6b6e9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:24.840646 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4434/8881] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:21:24.844765 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f942e3c-ccac-4bfb-af98-8b5d47548d04 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:24.855194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f942e3c-ccac-4bfb-af98-8b5d47548d04 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:24.859706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512341b-faee-4e1a-9ac1-b56ec1860bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:24.860607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512341b-faee-4e1a-9ac1-b56ec1860bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:24.860890 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512341b-faee-4e1a-9ac1-b56ec1860bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:24.861167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512341b-faee-4e1a-9ac1-b56ec1860bb5 admin admin] PATH_INFO: `/v3/projects/b05546126f6f4cb1912284d9801d37e4/users/9e44df8ee3f5405b9e9667b6b97568d7/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:24.875127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512341b-faee-4e1a-9ac1-b56ec1860bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b05546126f6f4cb1912284d9801d37e4, user_id=9e44df8ee3f5405b9e9667b6b97568d7, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:24.877807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512341b-faee-4e1a-9ac1-b56ec1860bb5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:24.989851 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4448/8882] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:21:24 2022] PUT /identity/v3/projects/b05546126f6f4cb1912284d9801d37e4/users/9e44df8ee3f5405b9e9667b6b97568d7/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:21:24.994947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c15fed-ecb0-486f-82c8-7a5a7bf125a3 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:24.995239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c15fed-ecb0-486f-82c8-7a5a7bf125a3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:24.995516 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c15fed-ecb0-486f-82c8-7a5a7bf125a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:25.013472 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-10c15fed-ecb0-486f-82c8-7a5a7bf125a3 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:21:25.014657 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-10c15fed-ecb0-486f-82c8-7a5a7bf125a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:21:25.071761 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4435/8883] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:21:25.082261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512341b-faee-4e1a-9ac1-b56ec1860bb5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:25.083937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c512341b-faee-4e1a-9ac1-b56ec1860bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:21:25.138600 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512341b-faee-4e1a-9ac1-b56ec1860bb5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:25.142231 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea31bf5-6974-4ced-bde7-98e5adb523d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:25.142871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea31bf5-6974-4ced-bde7-98e5adb523d2 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:25.143154 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea31bf5-6974-4ced-bde7-98e5adb523d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:25.143428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea31bf5-6974-4ced-bde7-98e5adb523d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:25.153148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea31bf5-6974-4ced-bde7-98e5adb523d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:25.154556 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea31bf5-6974-4ced-bde7-98e5adb523d2 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:25.164071 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4449/8884] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:21:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 11:21:30.971550 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df63e5-c91d-46d5-9a86-1713a3c816a5 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:30.972095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df63e5-c91d-46d5-9a86-1713a3c816a5 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:30.972214 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df63e5-c91d-46d5-9a86-1713a3c816a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:31.001626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-e2df63e5-c91d-46d5-9a86-1713a3c816a5 None None] MFA Rules not processed for user `9e44df8ee3f5405b9e9667b6b97568d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:21:31.002832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-e2df63e5-c91d-46d5-9a86-1713a3c816a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:21:31.071468 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4436/8885] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:21:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:21:31.076055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea31bf5-6974-4ced-bde7-98e5adb523d2 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:31.085923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea31bf5-6974-4ced-bde7-98e5adb523d2 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:31.090487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d53185-9a37-479b-b83f-ba278c2b3e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:31.091137 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d53185-9a37-479b-b83f-ba278c2b3e03 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:31.091417 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d53185-9a37-479b-b83f-ba278c2b3e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:31.091689 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d53185-9a37-479b-b83f-ba278c2b3e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:31.092386 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d53185-9a37-479b-b83f-ba278c2b3e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:31.094344 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d53185-9a37-479b-b83f-ba278c2b3e03 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:31.219262 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4450/8886] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 11:21:31 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:21:31.223809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df63e5-c91d-46d5-9a86-1713a3c816a5 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:31.234440 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df63e5-c91d-46d5-9a86-1713a3c816a5 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:31.290138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1986c-7f6a-410f-b36e-f60e5e69461a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:31.290817 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1986c-7f6a-410f-b36e-f60e5e69461a admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:31.291119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1986c-7f6a-410f-b36e-f60e5e69461a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:31.291382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1986c-7f6a-410f-b36e-f60e5e69461a admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:31.292080 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1986c-7f6a-410f-b36e-f60e5e69461a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:31.294037 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1986c-7f6a-410f-b36e-f60e5e69461a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:31.384011 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4437/8887] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 11:21:31 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:21:31.388158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d53185-9a37-479b-b83f-ba278c2b3e03 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:31.399597 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d53185-9a37-479b-b83f-ba278c2b3e03 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:31.403488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638724f-619c-4d72-b1df-f8984063b738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:31.404145 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638724f-619c-4d72-b1df-f8984063b738 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:31.404445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638724f-619c-4d72-b1df-f8984063b738 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:31.404790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638724f-619c-4d72-b1df-f8984063b738 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:31.405560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638724f-619c-4d72-b1df-f8984063b738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:31.407399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638724f-619c-4d72-b1df-f8984063b738 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:31.418700 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4451/8888] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:21:31.422872 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1986c-7f6a-410f-b36e-f60e5e69461a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:31.432751 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1986c-7f6a-410f-b36e-f60e5e69461a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:31.437399 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0cb69-efe8-4456-92b6-ca46efd75ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:31.438274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0cb69-efe8-4456-92b6-ca46efd75ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:31.438557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0cb69-efe8-4456-92b6-ca46efd75ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:31.438837 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0cb69-efe8-4456-92b6-ca46efd75ea6 admin admin] PATH_INFO: `/v3/projects/e4d56ad6def840e3bc057469ff9a4b10/users/a955767536314680b0596212ebee1a8b/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:31.453305 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0cb69-efe8-4456-92b6-ca46efd75ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d56ad6def840e3bc057469ff9a4b10, user_id=a955767536314680b0596212ebee1a8b, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:31.455964 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0cb69-efe8-4456-92b6-ca46efd75ea6 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:31.588153 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4438/8889] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:21:31 2022] PUT /identity/v3/projects/e4d56ad6def840e3bc057469ff9a4b10/users/a955767536314680b0596212ebee1a8b/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:21:31.592168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638724f-619c-4d72-b1df-f8984063b738 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:31.602966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638724f-619c-4d72-b1df-f8984063b738 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:31.658651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08bd11-4f50-42e3-b77c-a308fbc1b4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:31.659964 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08bd11-4f50-42e3-b77c-a308fbc1b4cb admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:31.660257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08bd11-4f50-42e3-b77c-a308fbc1b4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:31.660540 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08bd11-4f50-42e3-b77c-a308fbc1b4cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:31.661303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08bd11-4f50-42e3-b77c-a308fbc1b4cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:31.662893 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08bd11-4f50-42e3-b77c-a308fbc1b4cb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:31.676072 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4452/8890] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:21:31.677654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0cb69-efe8-4456-92b6-ca46efd75ea6 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:31.691341 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0cb69-efe8-4456-92b6-ca46efd75ea6 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:31.696260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01542fa9-20b6-4350-b5c2-1603aeb35f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:31.697237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01542fa9-20b6-4350-b5c2-1603aeb35f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:31.697545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01542fa9-20b6-4350-b5c2-1603aeb35f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:31.697823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01542fa9-20b6-4350-b5c2-1603aeb35f64 admin admin] PATH_INFO: `/v3/projects/e4d56ad6def840e3bc057469ff9a4b10/users/a955767536314680b0596212ebee1a8b/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:31.699832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01542fa9-20b6-4350-b5c2-1603aeb35f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d56ad6def840e3bc057469ff9a4b10, user_id=a955767536314680b0596212ebee1a8b, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:31.702627 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01542fa9-20b6-4350-b5c2-1603aeb35f64 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:31.713802 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4439/8891] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:21:31 2022] PUT /identity/v3/projects/e4d56ad6def840e3bc057469ff9a4b10/users/a955767536314680b0596212ebee1a8b/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 11:21:37.274399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8c598-f304-4e36-b4ba-9c7ef13ad0bf None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:37.274399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8c598-f304-4e36-b4ba-9c7ef13ad0bf None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:37.274399 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8c598-f304-4e36-b4ba-9c7ef13ad0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:37.307127 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3dc8c598-f304-4e36-b4ba-9c7ef13ad0bf None None] MFA Rules not processed for user `a955767536314680b0596212ebee1a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:21:37.308996 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3dc8c598-f304-4e36-b4ba-9c7ef13ad0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:21:37.382222 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4453/8892] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:21:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:21:37.412077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db6f37-e6ce-4c7f-835f-41e492f54539 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:37.412584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db6f37-e6ce-4c7f-835f-41e492f54539 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:37.412742 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db6f37-e6ce-4c7f-835f-41e492f54539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:37.466414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-a4db6f37-e6ce-4c7f-835f-41e492f54539 None None] MFA Rules not processed for user `08bc0cd97b6f45339f5dcf1a264b5ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:21:37.467725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a4db6f37-e6ce-4c7f-835f-41e492f54539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:21:37.534318 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4440/8893] 10.222.0.16 () {58 vars in 1059 bytes} [Mon May 2 11:21:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:21:37.540447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8c598-f304-4e36-b4ba-9c7ef13ad0bf None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:37.551110 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8c598-f304-4e36-b4ba-9c7ef13ad0bf None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:37.554946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ce893-962d-4208-8127-302ecd984fe1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:37.555605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ce893-962d-4208-8127-302ecd984fe1 service glance] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:37.555892 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ce893-962d-4208-8127-302ecd984fe1 service glance] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:37.556174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ce893-962d-4208-8127-302ecd984fe1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:37.617372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ce893-962d-4208-8127-302ecd984fe1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:37.618813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ce893-962d-4208-8127-302ecd984fe1 service glance] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:37.629222 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4454/8894] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:21:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 11:21:37.995566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3ec82-82c3-4cf7-b517-0146e0b09c6e None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:37.995566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3ec82-82c3-4cf7-b517-0146e0b09c6e None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:37.995566 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3ec82-82c3-4cf7-b517-0146e0b09c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:38.048405 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ccf3ec82-82c3-4cf7-b517-0146e0b09c6e None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:21:38.049717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ccf3ec82-82c3-4cf7-b517-0146e0b09c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:21:38.119237 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4441/8895] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 11:21:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:21:38.292366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eae647-81ce-4035-8f97-e8f63731ac31 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:38.294948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eae647-81ce-4035-8f97-e8f63731ac31 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:38.294948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eae647-81ce-4035-8f97-e8f63731ac31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:38.356698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-31eae647-81ce-4035-8f97-e8f63731ac31 None None] MFA Rules not processed for user `6573f5c0731c4a18bf2374c3ba006a57`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:21:38.357923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-31eae647-81ce-4035-8f97-e8f63731ac31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:21:38.430167 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4455/8896] 10.222.0.16 () {58 vars in 1039 bytes} [Mon May 2 11:21:38 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:21:38.436289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3ec82-82c3-4cf7-b517-0146e0b09c6e None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:38.448342 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3ec82-82c3-4cf7-b517-0146e0b09c6e None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:38.453538 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a341b9c-af8b-45c8-9acf-c66586157a9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:38.454189 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a341b9c-af8b-45c8-9acf-c66586157a9d service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:38.454505 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a341b9c-af8b-45c8-9acf-c66586157a9d service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:38.454785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a341b9c-af8b-45c8-9acf-c66586157a9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:38.463793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a341b9c-af8b-45c8-9acf-c66586157a9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:38.465441 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a341b9c-af8b-45c8-9acf-c66586157a9d service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:38.474135 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4442/8897] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 11:21:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 11:21:49.586531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7c3f0-4739-4f68-a6ce-34cddcf76b9d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:49.588088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7c3f0-4739-4f68-a6ce-34cddcf76b9d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:49.588088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7c3f0-4739-4f68-a6ce-34cddcf76b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:49.605974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-3fe7c3f0-4739-4f68-a6ce-34cddcf76b9d None None] MFA Rules not processed for user `9e44df8ee3f5405b9e9667b6b97568d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:21:49.611009 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-3fe7c3f0-4739-4f68-a6ce-34cddcf76b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:21:49.614023 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4456/8898] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:21:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:21:53.898573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4097a41-847e-4ab1-861f-f6a37c9f4949 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:53.899127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4097a41-847e-4ab1-861f-f6a37c9f4949 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:53.899421 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4097a41-847e-4ab1-861f-f6a37c9f4949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:53.918774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-d4097a41-847e-4ab1-861f-f6a37c9f4949 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:21:53.920072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d4097a41-847e-4ab1-861f-f6a37c9f4949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:21:53.928083 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4443/8899] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 11:21:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:21:53.943451 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7c3f0-4739-4f68-a6ce-34cddcf76b9d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:21:53.952371 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7c3f0-4739-4f68-a6ce-34cddcf76b9d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:21:53.957993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617835a0-235f-4019-afaa-3a22aa673ea3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:21:53.958577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617835a0-235f-4019-afaa-3a22aa673ea3 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:21:53.958866 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617835a0-235f-4019-afaa-3a22aa673ea3 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:21:53.959152 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617835a0-235f-4019-afaa-3a22aa673ea3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:21:53.967203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617835a0-235f-4019-afaa-3a22aa673ea3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:21:53.969406 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617835a0-235f-4019-afaa-3a22aa673ea3 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:21:53.977368 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4457/8900] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 11:21:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 11:22:17.938412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4097a41-847e-4ab1-861f-f6a37c9f4949 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:22:17.989878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4097a41-847e-4ab1-861f-f6a37c9f4949 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:22:17.993492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0e21e-d1e6-4fc6-b88d-a5f750260f51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:22:17.994138 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0e21e-d1e6-4fc6-b88d-a5f750260f51 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:22:17.994423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0e21e-d1e6-4fc6-b88d-a5f750260f51 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:22:17.994701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0e21e-d1e6-4fc6-b88d-a5f750260f51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:22:18.003372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0e21e-d1e6-4fc6-b88d-a5f750260f51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:22:18.004850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0e21e-d1e6-4fc6-b88d-a5f750260f51 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:22:18.014037 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4444/8901] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:22:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:22:47.454514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617835a0-235f-4019-afaa-3a22aa673ea3 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:22:47.466697 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-617835a0-235f-4019-afaa-3a22aa673ea3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:22:47.505982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617835a0-235f-4019-afaa-3a22aa673ea3 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:22:47.509691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a430b-c3b8-4427-bb4d-e435092e5aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:22:47.510342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a430b-c3b8-4427-bb4d-e435092e5aca service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:22:47.510633 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a430b-c3b8-4427-bb4d-e435092e5aca service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:22:47.510918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a430b-c3b8-4427-bb4d-e435092e5aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:22:47.513276 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6d9a430b-c3b8-4427-bb4d-e435092e5aca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:22:47.619993 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a430b-c3b8-4427-bb4d-e435092e5aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:22:47.621516 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a430b-c3b8-4427-bb4d-e435092e5aca service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:22:47.632928 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4458/8902] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:22:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:22:48.812366 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0e21e-d1e6-4fc6-b88d-a5f750260f51 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:22:48.830991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0e21e-d1e6-4fc6-b88d-a5f750260f51 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:22:48.834702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88089618-5886-421d-85b4-2f8741c81958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:22:48.835347 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88089618-5886-421d-85b4-2f8741c81958 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:22:48.835635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88089618-5886-421d-85b4-2f8741c81958 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:22:48.835916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88089618-5886-421d-85b4-2f8741c81958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:22:48.837767 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-88089618-5886-421d-85b4-2f8741c81958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:22:48.851527 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88089618-5886-421d-85b4-2f8741c81958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:22:48.853000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88089618-5886-421d-85b4-2f8741c81958 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:22:48.863708 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4445/8903] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:22:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:23:21.582688 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a430b-c3b8-4427-bb4d-e435092e5aca service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:23:21.591289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a430b-c3b8-4427-bb4d-e435092e5aca service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:23:21.595030 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9dbaa-3298-47e6-bf6d-b7163e374bf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:23:21.607066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9dbaa-3298-47e6-bf6d-b7163e374bf5 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:21.607066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9dbaa-3298-47e6-bf6d-b7163e374bf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:21.607066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9dbaa-3298-47e6-bf6d-b7163e374bf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:21.607066 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-94b9dbaa-3298-47e6-bf6d-b7163e374bf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:23:21.619163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9dbaa-3298-47e6-bf6d-b7163e374bf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:23:21.620586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9dbaa-3298-47e6-bf6d-b7163e374bf5 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:23:21.628190 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4459/8904] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:23:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:23:37.673136 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88089618-5886-421d-85b4-2f8741c81958 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:23:37.674695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-88089618-5886-421d-85b4-2f8741c81958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:23:37.688792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88089618-5886-421d-85b4-2f8741c81958 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:23:37.694261 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abc139-d181-4b2b-9ffb-47910907858b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:23:37.694904 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abc139-d181-4b2b-9ffb-47910907858b service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:37.695190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abc139-d181-4b2b-9ffb-47910907858b service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:37.695471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abc139-d181-4b2b-9ffb-47910907858b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:37.697216 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-96abc139-d181-4b2b-9ffb-47910907858b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:23:37.708778 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96abc139-d181-4b2b-9ffb-47910907858b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:23:37.711740 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96abc139-d181-4b2b-9ffb-47910907858b service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:23:37.720605 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4446/8905] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:23:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:23:39.392401 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd9f26-9169-4b65-a339-7bf49d666a67 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:39.392907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd9f26-9169-4b65-a339-7bf49d666a67 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:39.393020 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd9f26-9169-4b65-a339-7bf49d666a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:39.420429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-85cd9f26-9169-4b65-a339-7bf49d666a67 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:23:39.421639 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-85cd9f26-9169-4b65-a339-7bf49d666a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:23:39.428650 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4460/8906] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 11:23:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:23:39.468363 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abc139-d181-4b2b-9ffb-47910907858b service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:23:39.479446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abc139-d181-4b2b-9ffb-47910907858b service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:23:39.485026 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623e877-65d1-4ba7-98d8-d3a063456cb3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:23:39.485659 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623e877-65d1-4ba7-98d8-d3a063456cb3 service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:39.485947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623e877-65d1-4ba7-98d8-d3a063456cb3 service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:39.486226 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623e877-65d1-4ba7-98d8-d3a063456cb3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:39.494006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623e877-65d1-4ba7-98d8-d3a063456cb3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:23:39.495573 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623e877-65d1-4ba7-98d8-d3a063456cb3 service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:23:39.503377 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4447/8907] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 11:23:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 11:23:48.129711 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd9f26-9169-4b65-a339-7bf49d666a67 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:23:48.191204 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd9f26-9169-4b65-a339-7bf49d666a67 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:23:48.195654 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e07f32-ada0-4bdc-8100-69d255556711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:23:48.196522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e07f32-ada0-4bdc-8100-69d255556711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:48.196836 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e07f32-ada0-4bdc-8100-69d255556711 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:48.197114 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e07f32-ada0-4bdc-8100-69d255556711 admin admin] PATH_INFO: `/v3/users/9e44df8ee3f5405b9e9667b6b97568d7` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:48.198307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e07f32-ada0-4bdc-8100-69d255556711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e44df8ee3f5405b9e9667b6b97568d7)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:23:48.200274 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e07f32-ada0-4bdc-8100-69d255556711 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:23:48.417682 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-85e07f32-ada0-4bdc-8100-69d255556711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e44df8ee3f5405b9e9667b6b97568d7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:23:48.430708 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-85e07f32-ada0-4bdc-8100-69d255556711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e44df8ee3f5405b9e9667b6b97568d7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:23:48.431444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-85e07f32-ada0-4bdc-8100-69d255556711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e44df8ee3f5405b9e9667b6b97568d7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:23:48.438043 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-85e07f32-ada0-4bdc-8100-69d255556711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e44df8ee3f5405b9e9667b6b97568d7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:23:48.499447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-85e07f32-ada0-4bdc-8100-69d255556711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e44df8ee3f5405b9e9667b6b97568d7'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:23:48.505429 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4461/8908] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 11:23:48 2022] DELETE /identity/v3/users/9e44df8ee3f5405b9e9667b6b97568d7 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:23:48.749839 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623e877-65d1-4ba7-98d8-d3a063456cb3 service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:23:48.761025 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623e877-65d1-4ba7-98d8-d3a063456cb3 service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:23:48.819231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c73cc-ee52-4061-968b-0121e3c37053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:23:48.820100 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c73cc-ee52-4061-968b-0121e3c37053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:48.820390 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c73cc-ee52-4061-968b-0121e3c37053 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:48.820707 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c73cc-ee52-4061-968b-0121e3c37053 admin admin] PATH_INFO: `/v3/projects/b05546126f6f4cb1912284d9801d37e4` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:48.821894 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c73cc-ee52-4061-968b-0121e3c37053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b05546126f6f4cb1912284d9801d37e4)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:23:48.823823 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c73cc-ee52-4061-968b-0121e3c37053 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:23:48.924865 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-171c73cc-ee52-4061-968b-0121e3c37053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b05546126f6f4cb1912284d9801d37e4', 'request_id': 'req-171c73cc-ee52-4061-968b-0121e3c37053'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:23:48.930758 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-171c73cc-ee52-4061-968b-0121e3c37053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b05546126f6f4cb1912284d9801d37e4', 'request_id': 'req-171c73cc-ee52-4061-968b-0121e3c37053'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:23:49.016284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-171c73cc-ee52-4061-968b-0121e3c37053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b05546126f6f4cb1912284d9801d37e4', 'request_id': 'req-171c73cc-ee52-4061-968b-0121e3c37053'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:23:49.026237 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-171c73cc-ee52-4061-968b-0121e3c37053 admin admin] The token cache is being invalidate because project b05546126f6f4cb1912284d9801d37e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 11:23:49.026524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-171c73cc-ee52-4061-968b-0121e3c37053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:23:49.027228 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-171c73cc-ee52-4061-968b-0121e3c37053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:23:49.028884 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4448/8909] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 11:23:48 2022] DELETE /identity/v3/projects/b05546126f6f4cb1912284d9801d37e4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:23:49.033000 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e07f32-ada0-4bdc-8100-69d255556711 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:23:49.034725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-85e07f32-ada0-4bdc-8100-69d255556711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:23:49.048302 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e07f32-ada0-4bdc-8100-69d255556711 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:23:49.101952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13956bad-0a07-4c5e-9120-22c5389fe394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:23:49.102825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13956bad-0a07-4c5e-9120-22c5389fe394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:49.103105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13956bad-0a07-4c5e-9120-22c5389fe394 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:49.103379 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13956bad-0a07-4c5e-9120-22c5389fe394 admin admin] PATH_INFO: `/v3/users/a955767536314680b0596212ebee1a8b` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:49.104586 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13956bad-0a07-4c5e-9120-22c5389fe394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a955767536314680b0596212ebee1a8b)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:23:49.107103 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13956bad-0a07-4c5e-9120-22c5389fe394 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:23:49.272498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-13956bad-0a07-4c5e-9120-22c5389fe394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a955767536314680b0596212ebee1a8b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:23:49.284979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-13956bad-0a07-4c5e-9120-22c5389fe394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a955767536314680b0596212ebee1a8b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:23:49.288357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-13956bad-0a07-4c5e-9120-22c5389fe394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a955767536314680b0596212ebee1a8b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:23:49.292568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-13956bad-0a07-4c5e-9120-22c5389fe394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a955767536314680b0596212ebee1a8b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:23:49.357275 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-13956bad-0a07-4c5e-9120-22c5389fe394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a955767536314680b0596212ebee1a8b'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:23:49.363188 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4462/8910] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 11:23:49 2022] DELETE /identity/v3/users/a955767536314680b0596212ebee1a8b => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:23:49.650238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c73cc-ee52-4061-968b-0121e3c37053 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:23:49.651755 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-171c73cc-ee52-4061-968b-0121e3c37053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:23:49.665771 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c73cc-ee52-4061-968b-0121e3c37053 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:23:49.722576 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16a64f-4e0f-4bf8-8e62-b45ecbcf8e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:23:49.723446 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16a64f-4e0f-4bf8-8e62-b45ecbcf8e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:49.723725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16a64f-4e0f-4bf8-8e62-b45ecbcf8e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:49.723999 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16a64f-4e0f-4bf8-8e62-b45ecbcf8e5f admin admin] PATH_INFO: `/v3/projects/e4d56ad6def840e3bc057469ff9a4b10` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:49.725215 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16a64f-4e0f-4bf8-8e62-b45ecbcf8e5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d56ad6def840e3bc057469ff9a4b10)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:23:49.727176 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16a64f-4e0f-4bf8-8e62-b45ecbcf8e5f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:23:49.873353 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ca16a64f-4e0f-4bf8-8e62-b45ecbcf8e5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d56ad6def840e3bc057469ff9a4b10', 'request_id': 'req-ca16a64f-4e0f-4bf8-8e62-b45ecbcf8e5f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:23:49.879386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ca16a64f-4e0f-4bf8-8e62-b45ecbcf8e5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d56ad6def840e3bc057469ff9a4b10', 'request_id': 'req-ca16a64f-4e0f-4bf8-8e62-b45ecbcf8e5f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:23:49.954338 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ca16a64f-4e0f-4bf8-8e62-b45ecbcf8e5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d56ad6def840e3bc057469ff9a4b10', 'request_id': 'req-ca16a64f-4e0f-4bf8-8e62-b45ecbcf8e5f'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:23:49.965068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ca16a64f-4e0f-4bf8-8e62-b45ecbcf8e5f admin admin] The token cache is being invalidate because project e4d56ad6def840e3bc057469ff9a4b10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 11:23:49.965351 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ca16a64f-4e0f-4bf8-8e62-b45ecbcf8e5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:23:49.970152 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-ca16a64f-4e0f-4bf8-8e62-b45ecbcf8e5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:23:49.970152 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4449/8911] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 11:23:49 2022] DELETE /identity/v3/projects/e4d56ad6def840e3bc057469ff9a4b10 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:23:49.972883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ff5f1-2cfc-4de9-83f1-11578c109e1d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:49.973177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ff5f1-2cfc-4de9-83f1-11578c109e1d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:49.973455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ff5f1-2cfc-4de9-83f1-11578c109e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:50.000966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-f58ff5f1-2cfc-4de9-83f1-11578c109e1d None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:23:50.002177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f58ff5f1-2cfc-4de9-83f1-11578c109e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:23:50.057813 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4463/8912] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:23:50.072269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925579cd-a7a1-4a0c-bc95-368aa6b781f2 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:50.072591 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925579cd-a7a1-4a0c-bc95-368aa6b781f2 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:50.072896 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925579cd-a7a1-4a0c-bc95-368aa6b781f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:50.091672 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-925579cd-a7a1-4a0c-bc95-368aa6b781f2 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:23:50.092919 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-925579cd-a7a1-4a0c-bc95-368aa6b781f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:23:50.101714 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4450/8913] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:23:50.105496 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ff5f1-2cfc-4de9-83f1-11578c109e1d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:23:50.115261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ff5f1-2cfc-4de9-83f1-11578c109e1d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:23:50.120024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cf5a9-e521-47b6-9ddb-04222ce77115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:23:50.120721 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf5a9-e521-47b6-9ddb-04222ce77115 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:50.121492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf5a9-e521-47b6-9ddb-04222ce77115 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:50.121773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf5a9-e521-47b6-9ddb-04222ce77115 admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:50.122500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cf5a9-e521-47b6-9ddb-04222ce77115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 11:23:50.122808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cf5a9-e521-47b6-9ddb-04222ce77115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:23:50.124419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cf5a9-e521-47b6-9ddb-04222ce77115 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:23:50.135565 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4464/8914] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 11:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 11:23:50.140416 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925579cd-a7a1-4a0c-bc95-368aa6b781f2 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:23:50.149642 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925579cd-a7a1-4a0c-bc95-368aa6b781f2 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:23:50.154340 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0169726-06ba-4136-a46d-dcdb12c70347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:23:50.154988 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0169726-06ba-4136-a46d-dcdb12c70347 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:50.155274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0169726-06ba-4136-a46d-dcdb12c70347 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:50.155555 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0169726-06ba-4136-a46d-dcdb12c70347 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:50.156238 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0169726-06ba-4136-a46d-dcdb12c70347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:23:50.158188 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0169726-06ba-4136-a46d-dcdb12c70347 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:23:50.253242 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4451/8915] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 11:23:50 2022] POST /identity/v3/projects => generated 393 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:23:50.257343 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cf5a9-e521-47b6-9ddb-04222ce77115 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:23:50.267815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cf5a9-e521-47b6-9ddb-04222ce77115 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:23:50.323347 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd8a79-9b8e-47ce-b3b4-568cfed03812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:23:50.324028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd8a79-9b8e-47ce-b3b4-568cfed03812 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:50.324336 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd8a79-9b8e-47ce-b3b4-568cfed03812 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:50.324645 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd8a79-9b8e-47ce-b3b4-568cfed03812 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:50.325355 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd8a79-9b8e-47ce-b3b4-568cfed03812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:23:50.327270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd8a79-9b8e-47ce-b3b4-568cfed03812 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:23:50.399368 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4465/8916] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 11:23:50 2022] POST /identity/v3/users => generated 297 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:23:50.403496 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0169726-06ba-4136-a46d-dcdb12c70347 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:23:50.414245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0169726-06ba-4136-a46d-dcdb12c70347 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:23:50.419439 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec251d-e8e4-4b55-bd4f-cd3467951edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:23:50.420094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec251d-e8e4-4b55-bd4f-cd3467951edf admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:50.420383 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec251d-e8e4-4b55-bd4f-cd3467951edf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:50.420705 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec251d-e8e4-4b55-bd4f-cd3467951edf admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:50.421454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec251d-e8e4-4b55-bd4f-cd3467951edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:23:50.423057 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec251d-e8e4-4b55-bd4f-cd3467951edf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:23:50.433276 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4452/8917] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:23:50.437749 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd8a79-9b8e-47ce-b3b4-568cfed03812 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:23:50.447598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd8a79-9b8e-47ce-b3b4-568cfed03812 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:23:50.452293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2529d42-96e9-49eb-80d2-6805acd6ce4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:23:50.452974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2529d42-96e9-49eb-80d2-6805acd6ce4a admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:50.453268 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2529d42-96e9-49eb-80d2-6805acd6ce4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:50.453554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2529d42-96e9-49eb-80d2-6805acd6ce4a admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:50.454282 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2529d42-96e9-49eb-80d2-6805acd6ce4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:23:50.455868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2529d42-96e9-49eb-80d2-6805acd6ce4a admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:23:50.465545 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4466/8918] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:23:50.469677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec251d-e8e4-4b55-bd4f-cd3467951edf admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:23:50.479699 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec251d-e8e4-4b55-bd4f-cd3467951edf admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:23:50.484922 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f1ede-2b6a-4160-a4b9-bfedd8946f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:23:50.485850 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f1ede-2b6a-4160-a4b9-bfedd8946f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:50.486148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f1ede-2b6a-4160-a4b9-bfedd8946f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:50.486431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f1ede-2b6a-4160-a4b9-bfedd8946f0d admin admin] PATH_INFO: `/v3/projects/56d4325012a04948a47fd60cc7640751/users/e4157414af424a3c8fb7f54b58264db2/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:50.501329 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f1ede-2b6a-4160-a4b9-bfedd8946f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d4325012a04948a47fd60cc7640751, user_id=e4157414af424a3c8fb7f54b58264db2, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:23:50.504063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f1ede-2b6a-4160-a4b9-bfedd8946f0d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:23:50.585294 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4453/8919] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:23:50 2022] PUT /identity/v3/projects/56d4325012a04948a47fd60cc7640751/users/e4157414af424a3c8fb7f54b58264db2/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 11:23:50.595856 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8eaf1-7965-48f3-883a-c670dc36c72d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:50.596155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8eaf1-7965-48f3-883a-c670dc36c72d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:50.596446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8eaf1-7965-48f3-883a-c670dc36c72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:50.623249 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-0cc8eaf1-7965-48f3-883a-c670dc36c72d None None] MFA Rules not processed for user `e4157414af424a3c8fb7f54b58264db2`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:23:50.624463 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0cc8eaf1-7965-48f3-883a-c670dc36c72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:23:50.685801 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4467/8920] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:23:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:23:50.690221 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f1ede-2b6a-4160-a4b9-bfedd8946f0d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:23:50.750989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f1ede-2b6a-4160-a4b9-bfedd8946f0d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:23:50.755706 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5fd6b-886b-415b-b7f6-ad796263d0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:23:50.756303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5fd6b-886b-415b-b7f6-ad796263d0a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:50.756587 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5fd6b-886b-415b-b7f6-ad796263d0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:50.756893 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5fd6b-886b-415b-b7f6-ad796263d0a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:50.757592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5fd6b-886b-415b-b7f6-ad796263d0a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:23:50.759519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5fd6b-886b-415b-b7f6-ad796263d0a0 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:23:50.861756 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4454/8921] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 11:23:50 2022] POST /identity/v3/projects => generated 391 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:23:50.865676 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8eaf1-7965-48f3-883a-c670dc36c72d None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:23:50.876896 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8eaf1-7965-48f3-883a-c670dc36c72d None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:23:50.931626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3dd82-d1b8-44d1-826c-23f85f859bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:23:50.932301 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3dd82-d1b8-44d1-826c-23f85f859bfb admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:50.932585 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3dd82-d1b8-44d1-826c-23f85f859bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:50.932891 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3dd82-d1b8-44d1-826c-23f85f859bfb admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:50.933612 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3dd82-d1b8-44d1-826c-23f85f859bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:23:50.935505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3dd82-d1b8-44d1-826c-23f85f859bfb admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:23:51.025119 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4468/8922] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 11:23:50 2022] POST /identity/v3/users => generated 302 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:23:51.029702 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5fd6b-886b-415b-b7f6-ad796263d0a0 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:23:51.040541 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5fd6b-886b-415b-b7f6-ad796263d0a0 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:23:51.045350 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9e5af-cb1a-4873-bb95-55c9967c9664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:23:51.046013 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9e5af-cb1a-4873-bb95-55c9967c9664 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:51.046302 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9e5af-cb1a-4873-bb95-55c9967c9664 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:51.046588 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9e5af-cb1a-4873-bb95-55c9967c9664 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:51.047355 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9e5af-cb1a-4873-bb95-55c9967c9664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:23:51.049077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9e5af-cb1a-4873-bb95-55c9967c9664 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:23:51.060607 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4455/8923] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:23:51.064789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3dd82-d1b8-44d1-826c-23f85f859bfb admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:23:51.075366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3dd82-d1b8-44d1-826c-23f85f859bfb admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:23:51.080310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec1864-87a8-494f-ac9f-fce3bca47004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:23:51.081233 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec1864-87a8-494f-ac9f-fce3bca47004 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:51.081545 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec1864-87a8-494f-ac9f-fce3bca47004 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:51.081825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec1864-87a8-494f-ac9f-fce3bca47004 admin admin] PATH_INFO: `/v3/projects/3f98c987dc6b4ca487a4816e8774f11a/users/b9ba064c722b4f89873aefd17f113dbe/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:51.096864 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec1864-87a8-494f-ac9f-fce3bca47004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f98c987dc6b4ca487a4816e8774f11a, user_id=b9ba064c722b4f89873aefd17f113dbe, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:23:51.099532 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec1864-87a8-494f-ac9f-fce3bca47004 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:23:51.176753 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4469/8924] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:23:51 2022] PUT /identity/v3/projects/3f98c987dc6b4ca487a4816e8774f11a/users/b9ba064c722b4f89873aefd17f113dbe/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 11:23:51.180717 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9e5af-cb1a-4873-bb95-55c9967c9664 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:23:51.190886 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9e5af-cb1a-4873-bb95-55c9967c9664 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:23:51.245532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb6871-45e5-4d5f-a1cb-744ac807d1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:23:51.246801 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb6871-45e5-4d5f-a1cb-744ac807d1ae admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:51.247089 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb6871-45e5-4d5f-a1cb-744ac807d1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:51.247369 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb6871-45e5-4d5f-a1cb-744ac807d1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:51.248086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb6871-45e5-4d5f-a1cb-744ac807d1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:23:51.249724 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb6871-45e5-4d5f-a1cb-744ac807d1ae admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:23:51.259348 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4456/8925] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:23:51.263488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec1864-87a8-494f-ac9f-fce3bca47004 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:23:51.274123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec1864-87a8-494f-ac9f-fce3bca47004 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:23:51.278863 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f125a3-bb2a-4613-924c-853f00759f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:23:51.279730 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f125a3-bb2a-4613-924c-853f00759f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:51.280008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f125a3-bb2a-4613-924c-853f00759f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:51.280290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f125a3-bb2a-4613-924c-853f00759f89 admin admin] PATH_INFO: `/v3/projects/3f98c987dc6b4ca487a4816e8774f11a/users/b9ba064c722b4f89873aefd17f113dbe/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:51.282332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f125a3-bb2a-4613-924c-853f00759f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f98c987dc6b4ca487a4816e8774f11a, user_id=b9ba064c722b4f89873aefd17f113dbe, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:23:51.285333 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f125a3-bb2a-4613-924c-853f00759f89 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:23:51.295749 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4470/8926] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:23:51 2022] PUT /identity/v3/projects/3f98c987dc6b4ca487a4816e8774f11a/users/b9ba064c722b4f89873aefd17f113dbe/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 11:23:51.305384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402c732-7584-47a2-8e92-edb0ee271a54 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:51.305676 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402c732-7584-47a2-8e92-edb0ee271a54 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:51.305959 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402c732-7584-47a2-8e92-edb0ee271a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:51.331970 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-0402c732-7584-47a2-8e92-edb0ee271a54 None None] MFA Rules not processed for user `b9ba064c722b4f89873aefd17f113dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:23:51.333204 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0402c732-7584-47a2-8e92-edb0ee271a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:23:51.396833 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4457/8927] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:23:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:23:51.408613 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f125a3-bb2a-4613-924c-853f00759f89 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:23:51.410734 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f9f125a3-bb2a-4613-924c-853f00759f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:23:51.482014 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f125a3-bb2a-4613-924c-853f00759f89 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:23:51.488102 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8872695-73c8-4467-8e80-f2866dfad1f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:23:51.488773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8872695-73c8-4467-8e80-f2866dfad1f7 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:51.489063 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8872695-73c8-4467-8e80-f2866dfad1f7 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:51.489353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8872695-73c8-4467-8e80-f2866dfad1f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:51.544042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8872695-73c8-4467-8e80-f2866dfad1f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:23:51.545575 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8872695-73c8-4467-8e80-f2866dfad1f7 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:23:51.554345 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4471/8928] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:23:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:23:57.401572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402c732-7584-47a2-8e92-edb0ee271a54 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:23:57.403700 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0402c732-7584-47a2-8e92-edb0ee271a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:23:57.459284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402c732-7584-47a2-8e92-edb0ee271a54 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:23:57.463296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef64a7a-5718-4142-b9f3-497b5eec5364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:23:57.463524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef64a7a-5718-4142-b9f3-497b5eec5364 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:23:57.463809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef64a7a-5718-4142-b9f3-497b5eec5364 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:23:57.464092 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef64a7a-5718-4142-b9f3-497b5eec5364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:23:57.473148 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef64a7a-5718-4142-b9f3-497b5eec5364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:23:57.474597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef64a7a-5718-4142-b9f3-497b5eec5364 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:23:57.484100 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4458/8929] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:23:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:24:00.945370 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edfebf-c272-4388-9ba2-d811eae22a12 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:24:00.945889 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edfebf-c272-4388-9ba2-d811eae22a12 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:24:00.945992 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edfebf-c272-4388-9ba2-d811eae22a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:24:00.963869 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a9edfebf-c272-4388-9ba2-d811eae22a12 None None] MFA Rules not processed for user `e4157414af424a3c8fb7f54b58264db2`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:24:00.965251 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a9edfebf-c272-4388-9ba2-d811eae22a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:24:00.972281 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4472/8930] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:24:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:24:01.337397 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef64a7a-5718-4142-b9f3-497b5eec5364 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:24:01.339201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5ef64a7a-5718-4142-b9f3-497b5eec5364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:24:01.350722 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef64a7a-5718-4142-b9f3-497b5eec5364 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:24:01.355265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208463c-c4e2-4f87-b8e1-5c1ab3b16d24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:24:01.355983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208463c-c4e2-4f87-b8e1-5c1ab3b16d24 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:24:01.356274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208463c-c4e2-4f87-b8e1-5c1ab3b16d24 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:24:01.356796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208463c-c4e2-4f87-b8e1-5c1ab3b16d24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:24:01.358794 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5208463c-c4e2-4f87-b8e1-5c1ab3b16d24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:24:01.369109 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208463c-c4e2-4f87-b8e1-5c1ab3b16d24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:24:01.371391 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208463c-c4e2-4f87-b8e1-5c1ab3b16d24 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:24:01.381631 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4459/8931] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:24:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:24:01.872860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edfebf-c272-4388-9ba2-d811eae22a12 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:24:01.875527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a9edfebf-c272-4388-9ba2-d811eae22a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:24:02.018547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edfebf-c272-4388-9ba2-d811eae22a12 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:24:02.024178 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77caa19a-93fc-4a68-a5ef-f72be783af7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:24:02.025024 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caa19a-93fc-4a68-a5ef-f72be783af7c service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:24:02.025412 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caa19a-93fc-4a68-a5ef-f72be783af7c service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:24:02.025795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caa19a-93fc-4a68-a5ef-f72be783af7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:24:02.027872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-77caa19a-93fc-4a68-a5ef-f72be783af7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:24:02.042174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77caa19a-93fc-4a68-a5ef-f72be783af7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:24:02.043997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77caa19a-93fc-4a68-a5ef-f72be783af7c service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:24:02.055633 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4473/8932] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:24:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:24:05.319733 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208463c-c4e2-4f87-b8e1-5c1ab3b16d24 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:24:05.330172 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208463c-c4e2-4f87-b8e1-5c1ab3b16d24 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:24:05.335323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb959fb8-aa79-4c25-bedd-231b58b85570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:24:05.336021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb959fb8-aa79-4c25-bedd-231b58b85570 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:24:05.336317 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb959fb8-aa79-4c25-bedd-231b58b85570 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:24:05.336703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb959fb8-aa79-4c25-bedd-231b58b85570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:24:05.338695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cb959fb8-aa79-4c25-bedd-231b58b85570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:24:05.349331 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb959fb8-aa79-4c25-bedd-231b58b85570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:24:05.350935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb959fb8-aa79-4c25-bedd-231b58b85570 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:24:05.364989 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4460/8933] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:24:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:24:06.396690 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77caa19a-93fc-4a68-a5ef-f72be783af7c service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:24:06.400242 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-77caa19a-93fc-4a68-a5ef-f72be783af7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:24:06.420768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77caa19a-93fc-4a68-a5ef-f72be783af7c service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:24:06.435561 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e274f-9028-47c0-8019-5f878dfc5244 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:24:06.439799 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e274f-9028-47c0-8019-5f878dfc5244 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:24:06.440246 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e274f-9028-47c0-8019-5f878dfc5244 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:24:06.440626 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e274f-9028-47c0-8019-5f878dfc5244 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:24:06.442982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bf7e274f-9028-47c0-8019-5f878dfc5244 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:24:06.456326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e274f-9028-47c0-8019-5f878dfc5244 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:24:06.458186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e274f-9028-47c0-8019-5f878dfc5244 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:24:06.470794 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4474/8934] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:24:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:24:12.231557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb959fb8-aa79-4c25-bedd-231b58b85570 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:24:12.244619 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb959fb8-aa79-4c25-bedd-231b58b85570 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:24:12.250162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fe4fa-bcd0-4699-a4cf-7a80f6cffd4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:24:12.250903 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fe4fa-bcd0-4699-a4cf-7a80f6cffd4c service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:24:12.251180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fe4fa-bcd0-4699-a4cf-7a80f6cffd4c service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:24:12.251477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fe4fa-bcd0-4699-a4cf-7a80f6cffd4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:24:12.253289 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0f0fe4fa-bcd0-4699-a4cf-7a80f6cffd4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:24:12.266095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0fe4fa-bcd0-4699-a4cf-7a80f6cffd4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:24:12.267677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0fe4fa-bcd0-4699-a4cf-7a80f6cffd4c service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:24:12.279416 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4461/8935] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:24:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:25:14.489778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef01b25-5acb-4731-b3a0-e55b34f836f9 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:25:14.490309 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef01b25-5acb-4731-b3a0-e55b34f836f9 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:25:14.490415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef01b25-5acb-4731-b3a0-e55b34f836f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:25:14.509337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-6ef01b25-5acb-4731-b3a0-e55b34f836f9 None None] MFA Rules not processed for user `e4157414af424a3c8fb7f54b58264db2`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:25:14.510547 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6ef01b25-5acb-4731-b3a0-e55b34f836f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:25:14.519032 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4475/8936] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:25:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:25:14.840220 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fe4fa-bcd0-4699-a4cf-7a80f6cffd4c service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:25:14.849554 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fe4fa-bcd0-4699-a4cf-7a80f6cffd4c service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:25:14.853500 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934808a9-3e9c-4b38-806e-8fee3050457c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:25:14.854210 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934808a9-3e9c-4b38-806e-8fee3050457c service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:25:14.854575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934808a9-3e9c-4b38-806e-8fee3050457c service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:25:14.854916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934808a9-3e9c-4b38-806e-8fee3050457c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:25:14.856777 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-934808a9-3e9c-4b38-806e-8fee3050457c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:25:14.866517 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934808a9-3e9c-4b38-806e-8fee3050457c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:25:14.868038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934808a9-3e9c-4b38-806e-8fee3050457c service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:25:14.885163 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4462/8937] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:25:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:25:15.300520 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef01b25-5acb-4731-b3a0-e55b34f836f9 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:25:15.301948 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-6ef01b25-5acb-4731-b3a0-e55b34f836f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:25:15.318158 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef01b25-5acb-4731-b3a0-e55b34f836f9 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:25:15.324398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cb7ab-078e-471f-b5fe-9a3c35fddc11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:25:15.325298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cb7ab-078e-471f-b5fe-9a3c35fddc11 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:25:15.325604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cb7ab-078e-471f-b5fe-9a3c35fddc11 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:25:15.325973 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cb7ab-078e-471f-b5fe-9a3c35fddc11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:25:15.327905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7d3cb7ab-078e-471f-b5fe-9a3c35fddc11 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:25:15.341429 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3cb7ab-078e-471f-b5fe-9a3c35fddc11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:25:15.343222 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3cb7ab-078e-471f-b5fe-9a3c35fddc11 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:25:15.354490 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4476/8938] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:25:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:25:28.820003 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934808a9-3e9c-4b38-806e-8fee3050457c service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:25:28.833921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934808a9-3e9c-4b38-806e-8fee3050457c service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:25:28.840535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48826699-d9c0-4bd3-ab41-1339c1d0a3cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:25:28.841524 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48826699-d9c0-4bd3-ab41-1339c1d0a3cf service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:25:28.842060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48826699-d9c0-4bd3-ab41-1339c1d0a3cf service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:25:28.842575 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48826699-d9c0-4bd3-ab41-1339c1d0a3cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:25:28.844714 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-48826699-d9c0-4bd3-ab41-1339c1d0a3cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:25:28.857569 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48826699-d9c0-4bd3-ab41-1339c1d0a3cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:25:28.859330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48826699-d9c0-4bd3-ab41-1339c1d0a3cf service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:25:28.870487 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4463/8939] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:25:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:26:20.017290 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cb7ab-078e-471f-b5fe-9a3c35fddc11 service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:26:20.027534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cb7ab-078e-471f-b5fe-9a3c35fddc11 service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:26:20.032753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c80d4e-b4d0-445a-b157-b343023105e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:26:20.033382 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c80d4e-b4d0-445a-b157-b343023105e3 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:26:20.033669 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c80d4e-b4d0-445a-b157-b343023105e3 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:26:20.033947 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c80d4e-b4d0-445a-b157-b343023105e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:26:20.035727 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c8c80d4e-b4d0-445a-b157-b343023105e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:26:20.047216 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c80d4e-b4d0-445a-b157-b343023105e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:26:20.048806 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c80d4e-b4d0-445a-b157-b343023105e3 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:26:20.058824 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4477/8940] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:26:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:27:07.045935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664624b-ecc2-4893-80a1-42ec207908c3 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:27:07.050984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664624b-ecc2-4893-80a1-42ec207908c3 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:27:07.050984 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664624b-ecc2-4893-80a1-42ec207908c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:27:07.064701 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-9664624b-ecc2-4893-80a1-42ec207908c3 None None] MFA Rules not processed for user `e4157414af424a3c8fb7f54b58264db2`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:27:07.065952 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-9664624b-ecc2-4893-80a1-42ec207908c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:27:07.074160 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4464/8941] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:27:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:27:56.782526 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c80d4e-b4d0-445a-b157-b343023105e3 service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:27:56.800824 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c80d4e-b4d0-445a-b157-b343023105e3 service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:27:56.804474 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037472d-8604-4289-8e23-2eed0834a97d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:27:56.805142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037472d-8604-4289-8e23-2eed0834a97d service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:27:56.805428 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037472d-8604-4289-8e23-2eed0834a97d service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:27:56.805709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037472d-8604-4289-8e23-2eed0834a97d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:27:56.807441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d037472d-8604-4289-8e23-2eed0834a97d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:27:56.821032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037472d-8604-4289-8e23-2eed0834a97d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:27:56.822449 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037472d-8604-4289-8e23-2eed0834a97d service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:27:56.842439 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4478/8942] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:27:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:27:56.894736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c8b71-a8ef-40b0-9041-e1da8b168e63 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:27:56.895181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c8b71-a8ef-40b0-9041-e1da8b168e63 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:27:56.895321 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c8b71-a8ef-40b0-9041-e1da8b168e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:27:56.932316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-269c8b71-a8ef-40b0-9041-e1da8b168e63 None None] MFA Rules not processed for user `4cd9fe10f94f43aeb3eb10009ee96ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:27:56.933572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-269c8b71-a8ef-40b0-9041-e1da8b168e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:27:56.940236 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4465/8943] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 11:27:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:27:56.951651 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037472d-8604-4289-8e23-2eed0834a97d service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:27:56.960966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037472d-8604-4289-8e23-2eed0834a97d service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:27:56.968357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05562b-ccb9-4502-b5d1-ee0b127e89af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:27:56.969044 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05562b-ccb9-4502-b5d1-ee0b127e89af service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:27:56.969327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05562b-ccb9-4502-b5d1-ee0b127e89af service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:27:56.969603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05562b-ccb9-4502-b5d1-ee0b127e89af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:27:56.977499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed05562b-ccb9-4502-b5d1-ee0b127e89af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:27:56.978848 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed05562b-ccb9-4502-b5d1-ee0b127e89af service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:27:56.986544 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4479/8944] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:27:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:27:57.129295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8888f47-15d4-4812-bb3d-e3bd109b38a1 None None] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:27:57.129592 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8888f47-15d4-4812-bb3d-e3bd109b38a1 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:27:57.129877 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8888f47-15d4-4812-bb3d-e3bd109b38a1 None None] PATH_INFO: `/` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:27:57.131299 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4466/8945] 10.222.0.16 () {54 vars in 921 bytes} [Mon May 2 11:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 02 11:27:57.136144 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed1192-005f-4416-a6a6-5637cd956223 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:27:57.136457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed1192-005f-4416-a6a6-5637cd956223 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:27:57.136781 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed1192-005f-4416-a6a6-5637cd956223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:27:57.172969 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-bbed1192-005f-4416-a6a6-5637cd956223 None None] MFA Rules not processed for user `eef155f5230d47c29fc3d74c2241130b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:27:57.174159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bbed1192-005f-4416-a6a6-5637cd956223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:27:57.183231 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4480/8946] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 11:27:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:27:57.203118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8888f47-15d4-4812-bb3d-e3bd109b38a1 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:27:57.217001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8888f47-15d4-4812-bb3d-e3bd109b38a1 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:27:57.222697 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22866d-620b-47fb-bac0-39aa629c728c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:27:57.223330 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22866d-620b-47fb-bac0-39aa629c728c service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:27:57.223615 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22866d-620b-47fb-bac0-39aa629c728c service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:27:57.223895 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22866d-620b-47fb-bac0-39aa629c728c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:27:57.232168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22866d-620b-47fb-bac0-39aa629c728c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:27:57.233731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22866d-620b-47fb-bac0-39aa629c728c service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:27:57.243254 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4467/8947] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:27:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:27:58.017880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed1192-005f-4416-a6a6-5637cd956223 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:27:58.026957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed1192-005f-4416-a6a6-5637cd956223 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:27:58.030487 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a6305-ba16-49b3-b2c1-f48a92db81a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:27:58.031129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a6305-ba16-49b3-b2c1-f48a92db81a9 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:27:58.031409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a6305-ba16-49b3-b2c1-f48a92db81a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:27:58.031691 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a6305-ba16-49b3-b2c1-f48a92db81a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:27:58.033461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b78a6305-ba16-49b3-b2c1-f48a92db81a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:27:58.047283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a6305-ba16-49b3-b2c1-f48a92db81a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:27:58.048725 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a6305-ba16-49b3-b2c1-f48a92db81a9 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:27:58.059881 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4481/8948] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:27:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:27:58.531119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b118937-7971-4955-b543-6e1ca4791e30 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:27:58.531546 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b118937-7971-4955-b543-6e1ca4791e30 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:27:58.531680 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b118937-7971-4955-b543-6e1ca4791e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:27:58.567845 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-7b118937-7971-4955-b543-6e1ca4791e30 None None] MFA Rules not processed for user `e6036dd39fb74289a8cbdcd6a21f8662`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:27:58.569068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7b118937-7971-4955-b543-6e1ca4791e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:27:58.578263 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4468/8949] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 11:27:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:27:58.589587 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a6305-ba16-49b3-b2c1-f48a92db81a9 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:27:58.598615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a6305-ba16-49b3-b2c1-f48a92db81a9 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:27:58.602230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6a7c4-4910-417e-996b-aea5aff4d8ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:27:58.602868 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6a7c4-4910-417e-996b-aea5aff4d8ff service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:27:58.603151 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6a7c4-4910-417e-996b-aea5aff4d8ff service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:27:58.603431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6a7c4-4910-417e-996b-aea5aff4d8ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:27:58.613435 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6a7c4-4910-417e-996b-aea5aff4d8ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:27:58.614910 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6a7c4-4910-417e-996b-aea5aff4d8ff service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:27:58.625481 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4482/8950] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:27:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:28:24.561951 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b118937-7971-4955-b543-6e1ca4791e30 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:28:24.571666 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b118937-7971-4955-b543-6e1ca4791e30 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:28:24.575281 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505efb4-42ef-4b5a-9d43-1abb44a255d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:28:24.575901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505efb4-42ef-4b5a-9d43-1abb44a255d7 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:28:24.576180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505efb4-42ef-4b5a-9d43-1abb44a255d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:28:24.576455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505efb4-42ef-4b5a-9d43-1abb44a255d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:28:24.578250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8505efb4-42ef-4b5a-9d43-1abb44a255d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:28:24.587247 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505efb4-42ef-4b5a-9d43-1abb44a255d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:28:24.588852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505efb4-42ef-4b5a-9d43-1abb44a255d7 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:28:24.596381 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4469/8951] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:28:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:28:51.252143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6a7c4-4910-417e-996b-aea5aff4d8ff service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:28:51.264108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6a7c4-4910-417e-996b-aea5aff4d8ff service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:28:51.271280 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e305a6c-356b-4015-8e9b-a0fda47890f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:28:51.271940 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e305a6c-356b-4015-8e9b-a0fda47890f6 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:28:51.272342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e305a6c-356b-4015-8e9b-a0fda47890f6 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:28:51.273133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e305a6c-356b-4015-8e9b-a0fda47890f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:28:51.282831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e305a6c-356b-4015-8e9b-a0fda47890f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:28:51.284441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e305a6c-356b-4015-8e9b-a0fda47890f6 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:28:51.296573 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4483/8952] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:28:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:28:53.491662 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505efb4-42ef-4b5a-9d43-1abb44a255d7 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:28:53.504626 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505efb4-42ef-4b5a-9d43-1abb44a255d7 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:28:53.510054 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f689e-1109-4f81-82d6-a2d9d1d0c34c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:28:53.510691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f689e-1109-4f81-82d6-a2d9d1d0c34c service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:28:53.510982 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f689e-1109-4f81-82d6-a2d9d1d0c34c service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:28:53.511260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f689e-1109-4f81-82d6-a2d9d1d0c34c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:28:53.513061 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d98f689e-1109-4f81-82d6-a2d9d1d0c34c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:28:53.525499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f689e-1109-4f81-82d6-a2d9d1d0c34c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:28:53.527079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f689e-1109-4f81-82d6-a2d9d1d0c34c service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:28:53.537348 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4470/8953] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:28:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:29:03.898430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e305a6c-356b-4015-8e9b-a0fda47890f6 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:29:03.909562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e305a6c-356b-4015-8e9b-a0fda47890f6 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:29:03.913881 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0845c-c423-44ae-96f6-985297f8e3f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:29:03.914522 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0845c-c423-44ae-96f6-985297f8e3f0 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:29:03.914807 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0845c-c423-44ae-96f6-985297f8e3f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:29:03.915085 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0845c-c423-44ae-96f6-985297f8e3f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:29:03.924894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0845c-c423-44ae-96f6-985297f8e3f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:29:03.926332 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0845c-c423-44ae-96f6-985297f8e3f0 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:29:03.938662 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4484/8954] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:29:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:29:07.051696 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed515fe2-b514-41e6-a465-e234eca76304 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:29:07.052245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed515fe2-b514-41e6-a465-e234eca76304 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:29:07.052245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed515fe2-b514-41e6-a465-e234eca76304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:29:07.073864 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-ed515fe2-b514-41e6-a465-e234eca76304 None None] MFA Rules not processed for user `e4157414af424a3c8fb7f54b58264db2`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:29:07.075435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ed515fe2-b514-41e6-a465-e234eca76304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:29:07.084987 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4471/8955] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:29:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:29:07.857455 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0845c-c423-44ae-96f6-985297f8e3f0 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:29:07.886746 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0845c-c423-44ae-96f6-985297f8e3f0 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:29:07.896250 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b032650-66df-4982-a308-ab95d02f2874 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:29:07.899508 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b032650-66df-4982-a308-ab95d02f2874 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:29:07.899997 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b032650-66df-4982-a308-ab95d02f2874 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:29:07.900631 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b032650-66df-4982-a308-ab95d02f2874 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:29:07.918742 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b032650-66df-4982-a308-ab95d02f2874 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:29:07.920490 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b032650-66df-4982-a308-ab95d02f2874 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:29:07.931743 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4485/8956] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:29:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:29:10.859435 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed515fe2-b514-41e6-a465-e234eca76304 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:29:10.866125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed515fe2-b514-41e6-a465-e234eca76304 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:29:10.871280 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ee342-ccb5-4164-8ea4-8eede80406be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:29:10.871950 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ee342-ccb5-4164-8ea4-8eede80406be service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:29:10.872245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ee342-ccb5-4164-8ea4-8eede80406be service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:29:10.872532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ee342-ccb5-4164-8ea4-8eede80406be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:29:10.880482 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ee342-ccb5-4164-8ea4-8eede80406be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:29:10.882027 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ee342-ccb5-4164-8ea4-8eede80406be service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:29:10.890465 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4472/8957] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:29:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:29:12.032795 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b032650-66df-4982-a308-ab95d02f2874 service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:29:12.046492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b032650-66df-4982-a308-ab95d02f2874 service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:29:12.053265 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817aa0c-37ff-47dc-ac55-19f5a89fd2bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:29:12.054023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817aa0c-37ff-47dc-ac55-19f5a89fd2bf service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:29:12.054524 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817aa0c-37ff-47dc-ac55-19f5a89fd2bf service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:29:12.054876 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817aa0c-37ff-47dc-ac55-19f5a89fd2bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:29:12.065073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817aa0c-37ff-47dc-ac55-19f5a89fd2bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:29:12.066805 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817aa0c-37ff-47dc-ac55-19f5a89fd2bf service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:29:12.078753 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4486/8958] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:29:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:29:17.717245 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ee342-ccb5-4164-8ea4-8eede80406be service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:29:17.732229 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ee342-ccb5-4164-8ea4-8eede80406be service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:29:17.737826 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b582110-ac28-4526-acea-4509a2ecb0e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:29:17.738469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b582110-ac28-4526-acea-4509a2ecb0e0 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:29:17.738762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b582110-ac28-4526-acea-4509a2ecb0e0 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:29:17.739041 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b582110-ac28-4526-acea-4509a2ecb0e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:29:17.747849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b582110-ac28-4526-acea-4509a2ecb0e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:29:17.749470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b582110-ac28-4526-acea-4509a2ecb0e0 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:29:17.760219 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4473/8959] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:29:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:30:34.823098 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817aa0c-37ff-47dc-ac55-19f5a89fd2bf service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:30:34.834482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817aa0c-37ff-47dc-ac55-19f5a89fd2bf service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:30:34.839511 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f01e9-ba94-420d-8418-33ab8a882bd5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:30:34.840139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f01e9-ba94-420d-8418-33ab8a882bd5 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:30:34.840420 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f01e9-ba94-420d-8418-33ab8a882bd5 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:30:34.840803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f01e9-ba94-420d-8418-33ab8a882bd5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:30:34.849677 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f01e9-ba94-420d-8418-33ab8a882bd5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:30:34.852188 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f01e9-ba94-420d-8418-33ab8a882bd5 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:30:34.861237 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4487/8960] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:30:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:30:58.559044 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b6826-6491-4d9f-9c5a-8112ad6ba8a7 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:30:58.559523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b6826-6491-4d9f-9c5a-8112ad6ba8a7 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:30:58.559604 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b6826-6491-4d9f-9c5a-8112ad6ba8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:30:58.588001 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-294b6826-6491-4d9f-9c5a-8112ad6ba8a7 None None] MFA Rules not processed for user `e4157414af424a3c8fb7f54b58264db2`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:30:58.590455 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-294b6826-6491-4d9f-9c5a-8112ad6ba8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:30:58.607525 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4474/8961] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:30:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:30:59.011096 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f01e9-ba94-420d-8418-33ab8a882bd5 service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:30:59.020822 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f01e9-ba94-420d-8418-33ab8a882bd5 service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:30:59.025607 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbd334-00f4-45c0-b40e-c0c31266c273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:30:59.026534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbd334-00f4-45c0-b40e-c0c31266c273 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:30:59.027039 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbd334-00f4-45c0-b40e-c0c31266c273 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:30:59.027460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbd334-00f4-45c0-b40e-c0c31266c273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:30:59.038582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbd334-00f4-45c0-b40e-c0c31266c273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:30:59.040351 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbd334-00f4-45c0-b40e-c0c31266c273 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:30:59.051229 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4488/8962] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:30:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:30:59.480269 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b6826-6491-4d9f-9c5a-8112ad6ba8a7 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:30:59.494125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b6826-6491-4d9f-9c5a-8112ad6ba8a7 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:30:59.510454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa6986-1307-431c-a319-00a8364f40f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:30:59.511128 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa6986-1307-431c-a319-00a8364f40f3 service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:30:59.511428 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa6986-1307-431c-a319-00a8364f40f3 service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:30:59.513835 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa6986-1307-431c-a319-00a8364f40f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:30:59.533450 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa6986-1307-431c-a319-00a8364f40f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:30:59.535285 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa6986-1307-431c-a319-00a8364f40f3 service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:30:59.549010 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4475/8963] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:30:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:31:21.932982 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbd334-00f4-45c0-b40e-c0c31266c273 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:31:21.945872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbd334-00f4-45c0-b40e-c0c31266c273 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:31:21.951466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850ba57-e3c2-4f7f-87cf-ba58392563ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:31:21.952171 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850ba57-e3c2-4f7f-87cf-ba58392563ef service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:31:21.952461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850ba57-e3c2-4f7f-87cf-ba58392563ef service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:31:21.952776 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850ba57-e3c2-4f7f-87cf-ba58392563ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:31:21.962037 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850ba57-e3c2-4f7f-87cf-ba58392563ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:31:21.963605 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850ba57-e3c2-4f7f-87cf-ba58392563ef service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:31:21.973902 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4489/8964] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:31:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:31:54.356557 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa6986-1307-431c-a319-00a8364f40f3 service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:31:54.439470 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa6986-1307-431c-a319-00a8364f40f3 service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:31:54.444535 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7979581-c26b-42ef-b430-793389e6cb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:31:54.445434 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7979581-c26b-42ef-b430-793389e6cb8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:31:54.445728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7979581-c26b-42ef-b430-793389e6cb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:31:54.446000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7979581-c26b-42ef-b430-793389e6cb8c admin admin] PATH_INFO: `/v3/users/e4157414af424a3c8fb7f54b58264db2` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:31:54.447168 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7979581-c26b-42ef-b430-793389e6cb8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4157414af424a3c8fb7f54b58264db2)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:31:54.449139 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7979581-c26b-42ef-b430-793389e6cb8c admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:31:54.617288 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f7979581-c26b-42ef-b430-793389e6cb8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4157414af424a3c8fb7f54b58264db2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:31:54.628923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f7979581-c26b-42ef-b430-793389e6cb8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4157414af424a3c8fb7f54b58264db2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:31:54.629663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f7979581-c26b-42ef-b430-793389e6cb8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4157414af424a3c8fb7f54b58264db2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:31:54.636190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f7979581-c26b-42ef-b430-793389e6cb8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4157414af424a3c8fb7f54b58264db2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:31:54.716859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-f7979581-c26b-42ef-b430-793389e6cb8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4157414af424a3c8fb7f54b58264db2'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:31:54.723803 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4476/8965] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 11:31:54 2022] DELETE /identity/v3/users/e4157414af424a3c8fb7f54b58264db2 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:31:54.728946 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acd95f-0014-4bde-83cc-0978c164e293 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:31:54.729416 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acd95f-0014-4bde-83cc-0978c164e293 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:31:54.729533 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acd95f-0014-4bde-83cc-0978c164e293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:31:54.766629 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-33acd95f-0014-4bde-83cc-0978c164e293 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:31:54.767838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-33acd95f-0014-4bde-83cc-0978c164e293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:31:54.824946 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4490/8966] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 11:31:54.835265 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7979581-c26b-42ef-b430-793389e6cb8c admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:31:54.836703 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-f7979581-c26b-42ef-b430-793389e6cb8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:31:54.892670 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7979581-c26b-42ef-b430-793389e6cb8c admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:31:54.896310 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6614efb-bc94-40c5-bf69-407eb03bf64e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:31:54.897479 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6614efb-bc94-40c5-bf69-407eb03bf64e service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:31:54.897762 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6614efb-bc94-40c5-bf69-407eb03bf64e service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:31:54.898047 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6614efb-bc94-40c5-bf69-407eb03bf64e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:31:54.906972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6614efb-bc94-40c5-bf69-407eb03bf64e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:31:54.908401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6614efb-bc94-40c5-bf69-407eb03bf64e service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:31:54.918652 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4477/8967] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:31:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:31:55.129976 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acd95f-0014-4bde-83cc-0978c164e293 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:31:55.132087 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-33acd95f-0014-4bde-83cc-0978c164e293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:31:55.143925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acd95f-0014-4bde-83cc-0978c164e293 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:31:55.148655 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa6694-e31c-4369-b0d0-6f13742595e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:31:55.149656 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa6694-e31c-4369-b0d0-6f13742595e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:31:55.149938 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa6694-e31c-4369-b0d0-6f13742595e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:31:55.150245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa6694-e31c-4369-b0d0-6f13742595e2 admin admin] PATH_INFO: `/v3/projects/56d4325012a04948a47fd60cc7640751` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:31:55.151444 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa6694-e31c-4369-b0d0-6f13742595e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56d4325012a04948a47fd60cc7640751)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:31:55.153392 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa6694-e31c-4369-b0d0-6f13742595e2 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:31:55.236186 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c2fa6694-e31c-4369-b0d0-6f13742595e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56d4325012a04948a47fd60cc7640751', 'request_id': 'req-c2fa6694-e31c-4369-b0d0-6f13742595e2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:31:55.299049 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c2fa6694-e31c-4369-b0d0-6f13742595e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56d4325012a04948a47fd60cc7640751', 'request_id': 'req-c2fa6694-e31c-4369-b0d0-6f13742595e2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:31:55.305284 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c2fa6694-e31c-4369-b0d0-6f13742595e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56d4325012a04948a47fd60cc7640751', 'request_id': 'req-c2fa6694-e31c-4369-b0d0-6f13742595e2'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:31:55.315360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c2fa6694-e31c-4369-b0d0-6f13742595e2 admin admin] The token cache is being invalidate because project 56d4325012a04948a47fd60cc7640751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 11:31:55.315648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c2fa6694-e31c-4369-b0d0-6f13742595e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:31:55.316298 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c2fa6694-e31c-4369-b0d0-6f13742595e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:31:55.317861 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4491/8968] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 11:31:55 2022] DELETE /identity/v3/projects/56d4325012a04948a47fd60cc7640751 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:31:55.322594 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6614efb-bc94-40c5-bf69-407eb03bf64e service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:31:55.332272 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6614efb-bc94-40c5-bf69-407eb03bf64e service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:31:55.386531 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec567c7-8b9f-4a9f-a219-1139a5c0dca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:31:55.387402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec567c7-8b9f-4a9f-a219-1139a5c0dca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:31:55.387692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec567c7-8b9f-4a9f-a219-1139a5c0dca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:31:55.387976 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec567c7-8b9f-4a9f-a219-1139a5c0dca5 admin admin] PATH_INFO: `/v3/users/b9ba064c722b4f89873aefd17f113dbe` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:31:55.389190 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec567c7-8b9f-4a9f-a219-1139a5c0dca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ba064c722b4f89873aefd17f113dbe)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:31:55.391163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec567c7-8b9f-4a9f-a219-1139a5c0dca5 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:31:55.575125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1ec567c7-8b9f-4a9f-a219-1139a5c0dca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ba064c722b4f89873aefd17f113dbe'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:31:55.588201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1ec567c7-8b9f-4a9f-a219-1139a5c0dca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ba064c722b4f89873aefd17f113dbe'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:31:55.588920 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1ec567c7-8b9f-4a9f-a219-1139a5c0dca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ba064c722b4f89873aefd17f113dbe'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:31:55.596067 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1ec567c7-8b9f-4a9f-a219-1139a5c0dca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ba064c722b4f89873aefd17f113dbe'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:31:55.653432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-1ec567c7-8b9f-4a9f-a219-1139a5c0dca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ba064c722b4f89873aefd17f113dbe'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:31:55.659500 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4478/8969] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 11:31:55 2022] DELETE /identity/v3/users/b9ba064c722b4f89873aefd17f113dbe => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:31:56.078293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa6694-e31c-4369-b0d0-6f13742595e2 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:31:56.079720 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c2fa6694-e31c-4369-b0d0-6f13742595e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:31:56.092796 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa6694-e31c-4369-b0d0-6f13742595e2 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:31:56.154228 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd66c2-e3d5-4795-8a83-674db0170293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:31:56.155028 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd66c2-e3d5-4795-8a83-674db0170293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:31:56.155313 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd66c2-e3d5-4795-8a83-674db0170293 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:31:56.155592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd66c2-e3d5-4795-8a83-674db0170293 admin admin] PATH_INFO: `/v3/projects/3f98c987dc6b4ca487a4816e8774f11a` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:31:56.156823 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd66c2-e3d5-4795-8a83-674db0170293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f98c987dc6b4ca487a4816e8774f11a)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:31:56.158736 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd66c2-e3d5-4795-8a83-674db0170293 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:31:56.253016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74dd66c2-e3d5-4795-8a83-674db0170293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f98c987dc6b4ca487a4816e8774f11a', 'request_id': 'req-74dd66c2-e3d5-4795-8a83-674db0170293'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:31:56.315831 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74dd66c2-e3d5-4795-8a83-674db0170293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f98c987dc6b4ca487a4816e8774f11a', 'request_id': 'req-74dd66c2-e3d5-4795-8a83-674db0170293'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:31:56.322048 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74dd66c2-e3d5-4795-8a83-674db0170293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f98c987dc6b4ca487a4816e8774f11a', 'request_id': 'req-74dd66c2-e3d5-4795-8a83-674db0170293'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:31:56.332055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74dd66c2-e3d5-4795-8a83-674db0170293 admin admin] The token cache is being invalidate because project 3f98c987dc6b4ca487a4816e8774f11a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 11:31:56.332346 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74dd66c2-e3d5-4795-8a83-674db0170293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:31:56.333004 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-74dd66c2-e3d5-4795-8a83-674db0170293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:31:56.335044 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4492/8970] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 11:31:56 2022] DELETE /identity/v3/projects/3f98c987dc6b4ca487a4816e8774f11a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:31:56.340360 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb27db-facc-448b-bfe3-56eaf0f73c3b None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:31:56.340681 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb27db-facc-448b-bfe3-56eaf0f73c3b None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:31:56.340965 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb27db-facc-448b-bfe3-56eaf0f73c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:31:56.377678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-31eb27db-facc-448b-bfe3-56eaf0f73c3b None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:31:56.378890 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-31eb27db-facc-448b-bfe3-56eaf0f73c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:31:56.438076 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4479/8971] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:31:56.445952 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c51c2f-ea9b-4020-afce-43b5c9112476 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:31:56.446337 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c51c2f-ea9b-4020-afce-43b5c9112476 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:31:56.446647 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c51c2f-ea9b-4020-afce-43b5c9112476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:31:56.465193 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-16c51c2f-ea9b-4020-afce-43b5c9112476 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:31:56.466393 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-16c51c2f-ea9b-4020-afce-43b5c9112476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:31:56.474316 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4493/8972] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:31:56.479094 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb27db-facc-448b-bfe3-56eaf0f73c3b None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:31:56.488668 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb27db-facc-448b-bfe3-56eaf0f73c3b None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:31:56.493198 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3723ec-9a81-4365-895f-829a3ace9212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:31:56.493848 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3723ec-9a81-4365-895f-829a3ace9212 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:31:56.494134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3723ec-9a81-4365-895f-829a3ace9212 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:31:56.494415 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3723ec-9a81-4365-895f-829a3ace9212 admin admin] PATH_INFO: `/v3/domains` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:31:56.495137 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3723ec-9a81-4365-895f-829a3ace9212 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91119) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 11:31:56.495444 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3723ec-9a81-4365-895f-829a3ace9212 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:31:56.497068 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3723ec-9a81-4365-895f-829a3ace9212 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:31:56.508294 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4480/8973] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 11:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 02 11:31:56.512278 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c51c2f-ea9b-4020-afce-43b5c9112476 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:31:56.521345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c51c2f-ea9b-4020-afce-43b5c9112476 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:31:56.526461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659d344-a48e-4594-a69f-b98220cdc37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:31:56.527105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659d344-a48e-4594-a69f-b98220cdc37b admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:31:56.527388 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659d344-a48e-4594-a69f-b98220cdc37b admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:31:56.527665 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659d344-a48e-4594-a69f-b98220cdc37b admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:31:56.528357 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659d344-a48e-4594-a69f-b98220cdc37b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:31:56.530261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659d344-a48e-4594-a69f-b98220cdc37b admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:31:56.626235 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4494/8974] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 11:31:56 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:31:56.630551 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3723ec-9a81-4365-895f-829a3ace9212 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:31:56.640547 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3723ec-9a81-4365-895f-829a3ace9212 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:31:56.695633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480ebef-a54b-421a-bc9d-1d01f5d57e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:31:56.696282 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480ebef-a54b-421a-bc9d-1d01f5d57e3b admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:31:56.696567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480ebef-a54b-421a-bc9d-1d01f5d57e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:31:56.696878 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480ebef-a54b-421a-bc9d-1d01f5d57e3b admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:31:56.697563 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480ebef-a54b-421a-bc9d-1d01f5d57e3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:31:56.699522 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480ebef-a54b-421a-bc9d-1d01f5d57e3b admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:31:56.796501 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4481/8975] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 11:31:56 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:31:56.800663 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659d344-a48e-4594-a69f-b98220cdc37b admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:31:56.811067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659d344-a48e-4594-a69f-b98220cdc37b admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:31:56.815684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf77f40-f659-4c11-b5d4-55aff6936716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:31:56.816345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf77f40-f659-4c11-b5d4-55aff6936716 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:31:56.816662 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf77f40-f659-4c11-b5d4-55aff6936716 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:31:56.816943 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf77f40-f659-4c11-b5d4-55aff6936716 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:31:56.817661 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf77f40-f659-4c11-b5d4-55aff6936716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:31:56.819774 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf77f40-f659-4c11-b5d4-55aff6936716 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:31:56.829502 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4495/8976] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:31:56.833249 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480ebef-a54b-421a-bc9d-1d01f5d57e3b admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:31:56.844077 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480ebef-a54b-421a-bc9d-1d01f5d57e3b admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:31:56.848752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc9a2c-970d-4202-b7b3-cf515d1c1881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:31:56.852201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc9a2c-970d-4202-b7b3-cf515d1c1881 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:31:56.852201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc9a2c-970d-4202-b7b3-cf515d1c1881 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:31:56.852201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc9a2c-970d-4202-b7b3-cf515d1c1881 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:31:56.852201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc9a2c-970d-4202-b7b3-cf515d1c1881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:31:56.852201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc9a2c-970d-4202-b7b3-cf515d1c1881 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:31:56.862024 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4482/8977] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:31:56.866112 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf77f40-f659-4c11-b5d4-55aff6936716 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:31:56.876403 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf77f40-f659-4c11-b5d4-55aff6936716 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:31:56.881712 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4d045-e226-4cf3-9bba-07fd8f7bc172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:31:56.882598 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4d045-e226-4cf3-9bba-07fd8f7bc172 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:31:56.882880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4d045-e226-4cf3-9bba-07fd8f7bc172 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:31:56.883157 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4d045-e226-4cf3-9bba-07fd8f7bc172 admin admin] PATH_INFO: `/v3/projects/d31245ef5b6547f2b9769a9462c0b6b3/users/7789236e7c354cbe931946ef3b145175/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:31:56.897911 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4d045-e226-4cf3-9bba-07fd8f7bc172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31245ef5b6547f2b9769a9462c0b6b3, user_id=7789236e7c354cbe931946ef3b145175, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:31:56.900542 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4d045-e226-4cf3-9bba-07fd8f7bc172 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:31:56.967496 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4496/8978] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:31:56 2022] PUT /identity/v3/projects/d31245ef5b6547f2b9769a9462c0b6b3/users/7789236e7c354cbe931946ef3b145175/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 11:31:56.972808 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d553e2-2c52-4609-a992-8c71764ec2be None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:31:56.980849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d553e2-2c52-4609-a992-8c71764ec2be None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:31:56.980849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d553e2-2c52-4609-a992-8c71764ec2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:31:56.990834 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-c2d553e2-2c52-4609-a992-8c71764ec2be None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:31:56.992031 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-c2d553e2-2c52-4609-a992-8c71764ec2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:31:57.048547 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4483/8979] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:31:57.058032 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4d045-e226-4cf3-9bba-07fd8f7bc172 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:31:57.059698 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d8b4d045-e226-4cf3-9bba-07fd8f7bc172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:31:57.114389 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4d045-e226-4cf3-9bba-07fd8f7bc172 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:31:57.118562 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78f5cf-f579-4909-b9f6-7c1938677982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:31:57.119211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78f5cf-f579-4909-b9f6-7c1938677982 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:31:57.119498 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78f5cf-f579-4909-b9f6-7c1938677982 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:31:57.119782 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78f5cf-f579-4909-b9f6-7c1938677982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:31:57.128581 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78f5cf-f579-4909-b9f6-7c1938677982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:31:57.130042 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78f5cf-f579-4909-b9f6-7c1938677982 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:31:57.139984 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4497/8980] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:32:02.890260 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234215f-a379-4f2f-9ec0-f7f323ead010 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:32:02.891185 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234215f-a379-4f2f-9ec0-f7f323ead010 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:32:02.891537 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234215f-a379-4f2f-9ec0-f7f323ead010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:32:02.922709 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-1234215f-a379-4f2f-9ec0-f7f323ead010 None None] MFA Rules not processed for user `7789236e7c354cbe931946ef3b145175`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:32:02.932653 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-1234215f-a379-4f2f-9ec0-f7f323ead010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:32:02.988556 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4484/8981] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:32:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:32:02.993965 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78f5cf-f579-4909-b9f6-7c1938677982 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:32:03.003494 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78f5cf-f579-4909-b9f6-7c1938677982 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:32:03.008162 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea52c99-2b9d-4ab1-a372-087a499a5185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:32:03.008930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea52c99-2b9d-4ab1-a372-087a499a5185 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:32:03.009210 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea52c99-2b9d-4ab1-a372-087a499a5185 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:32:03.009493 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea52c99-2b9d-4ab1-a372-087a499a5185 admin admin] PATH_INFO: `/v3/projects` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:32:03.010184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea52c99-2b9d-4ab1-a372-087a499a5185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:32:03.012076 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea52c99-2b9d-4ab1-a372-087a499a5185 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:32:03.078097 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4498/8982] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 11:32:02 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:32:03.082802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234215f-a379-4f2f-9ec0-f7f323ead010 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:32:03.097406 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234215f-a379-4f2f-9ec0-f7f323ead010 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:32:03.154781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f34ef-7782-4702-a16b-1d0a8454a49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:32:03.155523 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f34ef-7782-4702-a16b-1d0a8454a49f admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:32:03.155807 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f34ef-7782-4702-a16b-1d0a8454a49f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:32:03.156083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f34ef-7782-4702-a16b-1d0a8454a49f admin admin] PATH_INFO: `/v3/users` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:32:03.156804 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f34ef-7782-4702-a16b-1d0a8454a49f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:32:03.158723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f34ef-7782-4702-a16b-1d0a8454a49f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:32:03.253216 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4485/8983] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 11:32:03 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:32:03.257649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea52c99-2b9d-4ab1-a372-087a499a5185 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:32:03.267853 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea52c99-2b9d-4ab1-a372-087a499a5185 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:32:03.272394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291edbc8-46b9-4354-830f-d9b7d24232f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:32:03.273088 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291edbc8-46b9-4354-830f-d9b7d24232f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:32:03.273373 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291edbc8-46b9-4354-830f-d9b7d24232f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:32:03.273652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291edbc8-46b9-4354-830f-d9b7d24232f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:32:03.274426 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291edbc8-46b9-4354-830f-d9b7d24232f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:32:03.276008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291edbc8-46b9-4354-830f-d9b7d24232f4 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:32:03.286233 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4499/8984] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:32:03.290556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f34ef-7782-4702-a16b-1d0a8454a49f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:32:03.301005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f34ef-7782-4702-a16b-1d0a8454a49f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:32:03.306284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c709b3-136a-4b66-a708-963f11972514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:32:03.307186 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c709b3-136a-4b66-a708-963f11972514 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:32:03.307468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c709b3-136a-4b66-a708-963f11972514 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:32:03.307743 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c709b3-136a-4b66-a708-963f11972514 admin admin] PATH_INFO: `/v3/projects/d8ddcbace58447f6929f410da45282fc/users/04999b00ac7b47b59a019c9e68b460f5/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:32:03.323469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c709b3-136a-4b66-a708-963f11972514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ddcbace58447f6929f410da45282fc, user_id=04999b00ac7b47b59a019c9e68b460f5, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:32:03.326254 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c709b3-136a-4b66-a708-963f11972514 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:32:03.414154 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4486/8985] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:32:03 2022] PUT /identity/v3/projects/d8ddcbace58447f6929f410da45282fc/users/04999b00ac7b47b59a019c9e68b460f5/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:32:03.418484 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291edbc8-46b9-4354-830f-d9b7d24232f4 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:32:03.428751 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291edbc8-46b9-4354-830f-d9b7d24232f4 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:32:03.486108 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186315f-6fbc-4ff3-9547-e16309ff35f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:32:03.486922 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186315f-6fbc-4ff3-9547-e16309ff35f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:32:03.487209 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186315f-6fbc-4ff3-9547-e16309ff35f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:32:03.487488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186315f-6fbc-4ff3-9547-e16309ff35f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:32:03.488220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186315f-6fbc-4ff3-9547-e16309ff35f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:32:03.489861 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186315f-6fbc-4ff3-9547-e16309ff35f7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:32:03.499914 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4500/8986] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:32:03.508107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c709b3-136a-4b66-a708-963f11972514 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:32:03.515162 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c709b3-136a-4b66-a708-963f11972514 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:32:03.519761 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ad477-0b68-4b03-8a3a-e03e5772398f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:32:03.520677 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ad477-0b68-4b03-8a3a-e03e5772398f admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:32:03.520971 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ad477-0b68-4b03-8a3a-e03e5772398f admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:32:03.521250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ad477-0b68-4b03-8a3a-e03e5772398f admin admin] PATH_INFO: `/v3/projects/d8ddcbace58447f6929f410da45282fc/users/04999b00ac7b47b59a019c9e68b460f5/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:32:03.523303 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ad477-0b68-4b03-8a3a-e03e5772398f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ddcbace58447f6929f410da45282fc, user_id=04999b00ac7b47b59a019c9e68b460f5, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:32:03.526033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ad477-0b68-4b03-8a3a-e03e5772398f admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:32:03.536321 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4487/8987] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:32:03 2022] PUT /identity/v3/projects/d8ddcbace58447f6929f410da45282fc/users/04999b00ac7b47b59a019c9e68b460f5/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:32:08.868808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4b313-82de-4a7f-a7f8-8da202bacd2d None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:32:08.869780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4b313-82de-4a7f-a7f8-8da202bacd2d None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:32:08.870133 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4b313-82de-4a7f-a7f8-8da202bacd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:32:08.899568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d7f4b313-82de-4a7f-a7f8-8da202bacd2d None None] MFA Rules not processed for user `04999b00ac7b47b59a019c9e68b460f5`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:32:08.901447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d7f4b313-82de-4a7f-a7f8-8da202bacd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:32:08.987105 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4501/8988] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:32:08 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:32:08.999063 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ad477-0b68-4b03-8a3a-e03e5772398f admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:32:09.000848 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-433ad477-0b68-4b03-8a3a-e03e5772398f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:32:09.084914 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ad477-0b68-4b03-8a3a-e03e5772398f admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:32:09.090504 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844232d-598d-424e-8e0d-5fbf4a751fa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:32:09.091161 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844232d-598d-424e-8e0d-5fbf4a751fa3 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:32:09.091448 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844232d-598d-424e-8e0d-5fbf4a751fa3 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:32:09.091725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844232d-598d-424e-8e0d-5fbf4a751fa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:32:09.159301 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844232d-598d-424e-8e0d-5fbf4a751fa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:32:09.161418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844232d-598d-424e-8e0d-5fbf4a751fa3 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:32:09.172761 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4488/8989] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:32:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:32:12.164514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b502d-6acf-4a17-9263-3e1d4f9ea9f7 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:32:12.165041 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b502d-6acf-4a17-9263-3e1d4f9ea9f7 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:32:12.165129 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b502d-6acf-4a17-9263-3e1d4f9ea9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:32:12.183269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-ca3b502d-6acf-4a17-9263-3e1d4f9ea9f7 None None] MFA Rules not processed for user `7789236e7c354cbe931946ef3b145175`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:32:12.184502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ca3b502d-6acf-4a17-9263-3e1d4f9ea9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:32:12.191257 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4502/8990] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:32:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:32:12.491781 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844232d-598d-424e-8e0d-5fbf4a751fa3 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:32:12.545389 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844232d-598d-424e-8e0d-5fbf4a751fa3 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:32:12.549132 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e184b4-b62b-403c-b134-782690063ec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:32:12.549859 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e184b4-b62b-403c-b134-782690063ec1 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:32:12.550230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e184b4-b62b-403c-b134-782690063ec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:32:12.550572 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e184b4-b62b-403c-b134-782690063ec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:32:12.552461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-02e184b4-b62b-403c-b134-782690063ec1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:32:12.563091 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e184b4-b62b-403c-b134-782690063ec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:32:12.564549 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e184b4-b62b-403c-b134-782690063ec1 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:32:12.573893 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4489/8991] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:32:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 11:32:27.084703 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b502d-6acf-4a17-9263-3e1d4f9ea9f7 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:32:27.086086 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-ca3b502d-6acf-4a17-9263-3e1d4f9ea9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:32:27.097700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b502d-6acf-4a17-9263-3e1d4f9ea9f7 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:32:27.101409 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a53d9-9c27-4cb7-80e4-30f032664754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:32:27.102058 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a53d9-9c27-4cb7-80e4-30f032664754 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:32:27.102341 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a53d9-9c27-4cb7-80e4-30f032664754 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:32:27.102619 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a53d9-9c27-4cb7-80e4-30f032664754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:32:27.111653 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a53d9-9c27-4cb7-80e4-30f032664754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:32:27.113097 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a53d9-9c27-4cb7-80e4-30f032664754 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:32:27.122881 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4503/8992] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:32:27 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:34:27.012201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35181119-3c5f-4b08-b413-a98e33a56d07 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:34:27.012654 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35181119-3c5f-4b08-b413-a98e33a56d07 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:34:27.012798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35181119-3c5f-4b08-b413-a98e33a56d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:34:27.090491 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-35181119-3c5f-4b08-b413-a98e33a56d07 None None] MFA Rules not processed for user `08bc0cd97b6f45339f5dcf1a264b5ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:34:27.091689 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-35181119-3c5f-4b08-b413-a98e33a56d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:34:27.181118 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4490/8993] 10.222.0.16 () {58 vars in 1059 bytes} [Mon May 2 11:34:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:34:27.187121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a53d9-9c27-4cb7-80e4-30f032664754 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:34:27.205897 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a53d9-9c27-4cb7-80e4-30f032664754 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:34:27.209505 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f02082-1e9c-477f-aed9-b0acccc21438 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:34:27.210142 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f02082-1e9c-477f-aed9-b0acccc21438 service glance] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:34:27.210430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f02082-1e9c-477f-aed9-b0acccc21438 service glance] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:34:27.210712 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f02082-1e9c-477f-aed9-b0acccc21438 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:34:27.213064 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-26f02082-1e9c-477f-aed9-b0acccc21438 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:34:27.264139 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f02082-1e9c-477f-aed9-b0acccc21438 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:34:27.265525 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f02082-1e9c-477f-aed9-b0acccc21438 service glance] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:34:27.276958 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4504/8994] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:34:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:34:28.609857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35181119-3c5f-4b08-b413-a98e33a56d07 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:34:28.621007 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35181119-3c5f-4b08-b413-a98e33a56d07 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:34:28.624782 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de643208-b09c-4140-a0ea-68d14de2aa8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:34:28.628934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de643208-b09c-4140-a0ea-68d14de2aa8b service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:34:28.628934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de643208-b09c-4140-a0ea-68d14de2aa8b service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:34:28.628934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de643208-b09c-4140-a0ea-68d14de2aa8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:34:28.628934 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-de643208-b09c-4140-a0ea-68d14de2aa8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:34:28.644579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de643208-b09c-4140-a0ea-68d14de2aa8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:34:28.646131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de643208-b09c-4140-a0ea-68d14de2aa8b service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:34:28.657858 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4491/8995] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:34:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:34:32.701895 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f02082-1e9c-477f-aed9-b0acccc21438 service glance] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:34:32.711107 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f02082-1e9c-477f-aed9-b0acccc21438 service glance] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:34:32.715203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d4f68-246d-4e1a-bd4d-e3c86f0e9124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:34:32.715842 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d4f68-246d-4e1a-bd4d-e3c86f0e9124 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:34:32.716124 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d4f68-246d-4e1a-bd4d-e3c86f0e9124 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:34:32.716400 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d4f68-246d-4e1a-bd4d-e3c86f0e9124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:34:32.718211 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7b3d4f68-246d-4e1a-bd4d-e3c86f0e9124 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:34:32.740634 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d4f68-246d-4e1a-bd4d-e3c86f0e9124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:34:32.742307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d4f68-246d-4e1a-bd4d-e3c86f0e9124 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:34:32.752272 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4505/8996] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:34:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:34:41.869530 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c69618-beee-4af3-94b9-03e380c67e68 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:34:41.870022 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c69618-beee-4af3-94b9-03e380c67e68 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:34:41.870117 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c69618-beee-4af3-94b9-03e380c67e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:34:41.916584 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-41c69618-beee-4af3-94b9-03e380c67e68 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:34:41.918114 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-41c69618-beee-4af3-94b9-03e380c67e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:34:41.980833 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4492/8997] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 11:34:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:34:42.118564 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d4f68-246d-4e1a-bd4d-e3c86f0e9124 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:34:42.119966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-7b3d4f68-246d-4e1a-bd4d-e3c86f0e9124 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:34:42.211457 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d4f68-246d-4e1a-bd4d-e3c86f0e9124 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:34:42.216567 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9717d4-f5a8-4076-b9ae-5ff9cae67172 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:34:42.217335 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9717d4-f5a8-4076-b9ae-5ff9cae67172 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:34:42.217642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9717d4-f5a8-4076-b9ae-5ff9cae67172 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:34:42.217923 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9717d4-f5a8-4076-b9ae-5ff9cae67172 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:34:42.227021 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9717d4-f5a8-4076-b9ae-5ff9cae67172 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:34:42.228627 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9717d4-f5a8-4076-b9ae-5ff9cae67172 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:34:42.237392 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4506/8998] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 11:34:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 11:34:43.149008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c69618-beee-4af3-94b9-03e380c67e68 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:34:43.150586 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-41c69618-beee-4af3-94b9-03e380c67e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:34:43.169382 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c69618-beee-4af3-94b9-03e380c67e68 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:34:43.176333 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bd7d5-12bd-4e71-9e91-2b86a8d30d62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:34:43.177141 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bd7d5-12bd-4e71-9e91-2b86a8d30d62 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:34:43.177432 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bd7d5-12bd-4e71-9e91-2b86a8d30d62 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:34:43.177718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bd7d5-12bd-4e71-9e91-2b86a8d30d62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:34:43.179565 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-a76bd7d5-12bd-4e71-9e91-2b86a8d30d62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:34:43.198467 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76bd7d5-12bd-4e71-9e91-2b86a8d30d62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:34:43.204088 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76bd7d5-12bd-4e71-9e91-2b86a8d30d62 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:34:43.214265 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4493/8999] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:34:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:34:56.160883 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859055d-2ee5-4db6-85e1-13742dffe6ae None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:34:56.161482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859055d-2ee5-4db6-85e1-13742dffe6ae None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:34:56.161482 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859055d-2ee5-4db6-85e1-13742dffe6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:34:56.179293 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-1859055d-2ee5-4db6-85e1-13742dffe6ae None None] MFA Rules not processed for user `e6036dd39fb74289a8cbdcd6a21f8662`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:34:56.180500 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-1859055d-2ee5-4db6-85e1-13742dffe6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:34:56.189899 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4507/9000] 10.222.0.16 () {58 vars in 1018 bytes} [Mon May 2 11:34:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:34:56.201412 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bd7d5-12bd-4e71-9e91-2b86a8d30d62 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:34:56.211038 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bd7d5-12bd-4e71-9e91-2b86a8d30d62 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:34:56.215119 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f415ce2-58df-4f26-8aec-3b44b223bde6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08bc0cd97b6f45339f5dcf1a264b5ae2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:34:56.215768 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f415ce2-58df-4f26-8aec-3b44b223bde6 service glance] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:34:56.216059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f415ce2-58df-4f26-8aec-3b44b223bde6 service glance] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:34:56.216335 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f415ce2-58df-4f26-8aec-3b44b223bde6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:34:56.231832 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f415ce2-58df-4f26-8aec-3b44b223bde6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:34:56.233327 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f415ce2-58df-4f26-8aec-3b44b223bde6 service glance] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:34:56.247611 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4494/9001] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:34:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:34:56.420930 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859055d-2ee5-4db6-85e1-13742dffe6ae None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:34:56.430480 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859055d-2ee5-4db6-85e1-13742dffe6ae None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:34:56.434008 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ebe0d-d1c8-4a27-8362-35d36516b8d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:34:56.434648 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ebe0d-d1c8-4a27-8362-35d36516b8d2 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:34:56.434931 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ebe0d-d1c8-4a27-8362-35d36516b8d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:34:56.435208 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ebe0d-d1c8-4a27-8362-35d36516b8d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:34:56.436972 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-b01ebe0d-d1c8-4a27-8362-35d36516b8d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:34:56.447141 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ebe0d-d1c8-4a27-8362-35d36516b8d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:34:56.448855 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ebe0d-d1c8-4a27-8362-35d36516b8d2 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:34:56.457217 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4508/9002] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:34:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:34:56.528857 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f415ce2-58df-4f26-8aec-3b44b223bde6 service glance] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:34:56.538236 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f415ce2-58df-4f26-8aec-3b44b223bde6 service glance] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:34:56.541792 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3098b-fcab-4366-921d-c0d08bea95eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:34:56.542426 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3098b-fcab-4366-921d-c0d08bea95eb service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:34:56.542710 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3098b-fcab-4366-921d-c0d08bea95eb service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:34:56.543259 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3098b-fcab-4366-921d-c0d08bea95eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:34:56.545000 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-fba3098b-fcab-4366-921d-c0d08bea95eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:34:56.558403 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3098b-fcab-4366-921d-c0d08bea95eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:34:56.562812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3098b-fcab-4366-921d-c0d08bea95eb service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:34:56.571069 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4495/9003] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:34:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:34:57.677717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ebe0d-d1c8-4a27-8362-35d36516b8d2 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:34:57.686369 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ebe0d-d1c8-4a27-8362-35d36516b8d2 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:34:57.690778 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1ad83-f662-4386-9c7f-aa0d12c5423d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:34:57.691418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1ad83-f662-4386-9c7f-aa0d12c5423d service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:34:57.691707 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1ad83-f662-4386-9c7f-aa0d12c5423d service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:34:57.691991 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1ad83-f662-4386-9c7f-aa0d12c5423d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:34:57.693818 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d9d1ad83-f662-4386-9c7f-aa0d12c5423d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:34:57.703177 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1ad83-f662-4386-9c7f-aa0d12c5423d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:34:57.704981 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1ad83-f662-4386-9c7f-aa0d12c5423d service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:34:57.712843 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4509/9004] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:34:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:34:58.696145 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3098b-fcab-4366-921d-c0d08bea95eb service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:34:58.710907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3098b-fcab-4366-921d-c0d08bea95eb service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:34:58.717723 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a88b4f-47fb-48b2-a393-e568cc0d71b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:34:58.718324 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a88b4f-47fb-48b2-a393-e568cc0d71b9 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:34:58.718608 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a88b4f-47fb-48b2-a393-e568cc0d71b9 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:34:58.718891 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a88b4f-47fb-48b2-a393-e568cc0d71b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:34:58.722407 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-d1a88b4f-47fb-48b2-a393-e568cc0d71b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:34:58.742851 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a88b4f-47fb-48b2-a393-e568cc0d71b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:34:58.744534 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a88b4f-47fb-48b2-a393-e568cc0d71b9 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:34:58.756973 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4496/9005] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:34:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:34:59.694773 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd342e-bd76-4e35-8fe3-c8c52dc34b45 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:34:59.695263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd342e-bd76-4e35-8fe3-c8c52dc34b45 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:34:59.698122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd342e-bd76-4e35-8fe3-c8c52dc34b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:34:59.714363 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-08bd342e-bd76-4e35-8fe3-c8c52dc34b45 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:34:59.715825 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-08bd342e-bd76-4e35-8fe3-c8c52dc34b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:34:59.723873 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4510/9006] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 11:34:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:34:59.736490 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a88b4f-47fb-48b2-a393-e568cc0d71b9 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:34:59.747599 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a88b4f-47fb-48b2-a393-e568cc0d71b9 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:34:59.753384 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75964885-6d21-4fae-bd50-275df2cd7a46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:34:59.754105 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75964885-6d21-4fae-bd50-275df2cd7a46 service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:34:59.754400 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75964885-6d21-4fae-bd50-275df2cd7a46 service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:34:59.754684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75964885-6d21-4fae-bd50-275df2cd7a46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:34:59.764150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75964885-6d21-4fae-bd50-275df2cd7a46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:34:59.765295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75964885-6d21-4fae-bd50-275df2cd7a46 service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:34:59.774295 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4497/9007] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 11:34:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 11:35:14.135719 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5edd98-a414-4d2e-8282-fc34a1a59acb None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:35:14.136230 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5edd98-a414-4d2e-8282-fc34a1a59acb None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:35:14.136322 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5edd98-a414-4d2e-8282-fc34a1a59acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:35:14.154304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-4c5edd98-a414-4d2e-8282-fc34a1a59acb None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:35:14.155439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4c5edd98-a414-4d2e-8282-fc34a1a59acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:35:14.162724 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4511/9008] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 11:35:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:35:14.175052 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75964885-6d21-4fae-bd50-275df2cd7a46 service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:35:14.185652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75964885-6d21-4fae-bd50-275df2cd7a46 service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:35:14.191206 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91313b-6eff-4047-b4a1-3cf02d62e4ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:35:14.191843 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91313b-6eff-4047-b4a1-3cf02d62e4ff service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:35:14.192131 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91313b-6eff-4047-b4a1-3cf02d62e4ff service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:35:14.192414 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91313b-6eff-4047-b4a1-3cf02d62e4ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:35:14.200531 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91313b-6eff-4047-b4a1-3cf02d62e4ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:35:14.202211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91313b-6eff-4047-b4a1-3cf02d62e4ff service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:35:14.210923 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4498/9009] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 11:35:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 11:35:39.801679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5edd98-a414-4d2e-8282-fc34a1a59acb None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:35:39.803055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4c5edd98-a414-4d2e-8282-fc34a1a59acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:35:39.881477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5edd98-a414-4d2e-8282-fc34a1a59acb None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:35:39.886534 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916bb00-ff01-472e-82ee-80938043ab8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:35:39.887183 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916bb00-ff01-472e-82ee-80938043ab8d service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:35:39.887470 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916bb00-ff01-472e-82ee-80938043ab8d service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:35:39.887753 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916bb00-ff01-472e-82ee-80938043ab8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:35:39.889514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a916bb00-ff01-472e-82ee-80938043ab8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:35:39.900768 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916bb00-ff01-472e-82ee-80938043ab8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:35:39.902342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916bb00-ff01-472e-82ee-80938043ab8d service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:35:39.911966 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4512/9010] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:35:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:36:28.243118 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91313b-6eff-4047-b4a1-3cf02d62e4ff service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:36:28.255928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91313b-6eff-4047-b4a1-3cf02d62e4ff service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:36:28.262060 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71276430-0bfc-45aa-95e5-5da6f01bc25f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:36:28.262980 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71276430-0bfc-45aa-95e5-5da6f01bc25f service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:36:28.263276 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71276430-0bfc-45aa-95e5-5da6f01bc25f service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:36:28.263560 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71276430-0bfc-45aa-95e5-5da6f01bc25f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:36:28.265719 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-71276430-0bfc-45aa-95e5-5da6f01bc25f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:36:28.284418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71276430-0bfc-45aa-95e5-5da6f01bc25f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:36:28.284418 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71276430-0bfc-45aa-95e5-5da6f01bc25f service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:36:28.296096 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4499/9011] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:36:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:36:28.989415 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916bb00-ff01-472e-82ee-80938043ab8d service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:36:28.990989 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a916bb00-ff01-472e-82ee-80938043ab8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:36:29.004717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916bb00-ff01-472e-82ee-80938043ab8d service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:36:29.010679 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d2f03-6c38-4e05-8e47-33c2fa22e7d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:36:29.011342 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d2f03-6c38-4e05-8e47-33c2fa22e7d8 service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:36:29.011628 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d2f03-6c38-4e05-8e47-33c2fa22e7d8 service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:36:29.011914 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d2f03-6c38-4e05-8e47-33c2fa22e7d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:36:29.013833 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-de1d2f03-6c38-4e05-8e47-33c2fa22e7d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:36:29.026879 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d2f03-6c38-4e05-8e47-33c2fa22e7d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:36:29.028513 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d2f03-6c38-4e05-8e47-33c2fa22e7d8 service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:36:29.039173 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4513/9012] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:36:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:36:34.485085 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fa34d-4c66-4f35-9d3a-2f5e3fed2559 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:36:34.489684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fa34d-4c66-4f35-9d3a-2f5e3fed2559 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:36:34.489684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fa34d-4c66-4f35-9d3a-2f5e3fed2559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:36:34.503629 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5a6fa34d-4c66-4f35-9d3a-2f5e3fed2559 None None] MFA Rules not processed for user `7789236e7c354cbe931946ef3b145175`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:36:34.504853 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5a6fa34d-4c66-4f35-9d3a-2f5e3fed2559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:36:34.512154 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4500/9013] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:36:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 02 11:36:39.723289 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d2f03-6c38-4e05-8e47-33c2fa22e7d8 service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:36:39.732327 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d2f03-6c38-4e05-8e47-33c2fa22e7d8 service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:36:39.735915 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c9f58-160f-4624-a88c-f0566f8b767f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:36:39.736550 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c9f58-160f-4624-a88c-f0566f8b767f service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:36:39.736894 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c9f58-160f-4624-a88c-f0566f8b767f service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:36:39.737175 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c9f58-160f-4624-a88c-f0566f8b767f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:36:39.738995 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-054c9f58-160f-4624-a88c-f0566f8b767f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:36:39.748069 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c9f58-160f-4624-a88c-f0566f8b767f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:36:39.749514 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c9f58-160f-4624-a88c-f0566f8b767f service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:36:39.757171 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4514/9014] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:36:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:36:40.501056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fa34d-4c66-4f35-9d3a-2f5e3fed2559 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:36:40.513663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fa34d-4c66-4f35-9d3a-2f5e3fed2559 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:36:40.518532 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f002d-61cf-4887-b997-5dae72b69ed7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:36:40.519181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f002d-61cf-4887-b997-5dae72b69ed7 service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:36:40.519462 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f002d-61cf-4887-b997-5dae72b69ed7 service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:36:40.519736 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f002d-61cf-4887-b997-5dae72b69ed7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:36:40.521644 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-522f002d-61cf-4887-b997-5dae72b69ed7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:36:40.534841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f002d-61cf-4887-b997-5dae72b69ed7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:36:40.536422 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f002d-61cf-4887-b997-5dae72b69ed7 service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:36:40.547249 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4501/9015] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:36:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:39:38.701019 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c9f58-160f-4624-a88c-f0566f8b767f service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:39:38.719468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c9f58-160f-4624-a88c-f0566f8b767f service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:39:38.723353 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ab8a8-4da1-44f8-bed4-c42c9e2f148a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:39:38.724001 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ab8a8-4da1-44f8-bed4-c42c9e2f148a service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:39:38.724272 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ab8a8-4da1-44f8-bed4-c42c9e2f148a service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:39:38.724552 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ab8a8-4da1-44f8-bed4-c42c9e2f148a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:39:38.732099 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ab8a8-4da1-44f8-bed4-c42c9e2f148a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:39:38.733775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ab8a8-4da1-44f8-bed4-c42c9e2f148a service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:39:38.741706 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4515/9016] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:39:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:40:14.743508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f002d-61cf-4887-b997-5dae72b69ed7 service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:14.764477 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f002d-61cf-4887-b997-5dae72b69ed7 service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:14.770056 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263ebd7-ad92-4563-97fc-330ec55c55c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:14.770695 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263ebd7-ad92-4563-97fc-330ec55c55c6 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:14.770983 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263ebd7-ad92-4563-97fc-330ec55c55c6 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:14.771300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263ebd7-ad92-4563-97fc-330ec55c55c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:14.779201 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263ebd7-ad92-4563-97fc-330ec55c55c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:14.782443 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263ebd7-ad92-4563-97fc-330ec55c55c6 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:14.790163 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4502/9017] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:40:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 02 11:40:16.740159 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ab8a8-4da1-44f8-bed4-c42c9e2f148a service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:16.756013 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ab8a8-4da1-44f8-bed4-c42c9e2f148a service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:16.762179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288f4b4-b8f9-4de1-befe-08ed375e8884 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:16.763604 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288f4b4-b8f9-4de1-befe-08ed375e8884 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:16.764003 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288f4b4-b8f9-4de1-befe-08ed375e8884 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:16.764360 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288f4b4-b8f9-4de1-befe-08ed375e8884 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:16.775067 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288f4b4-b8f9-4de1-befe-08ed375e8884 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:16.777012 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288f4b4-b8f9-4de1-befe-08ed375e8884 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:16.789545 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4516/9018] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:40:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:40:17.232956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263ebd7-ad92-4563-97fc-330ec55c55c6 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:17.243519 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263ebd7-ad92-4563-97fc-330ec55c55c6 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:17.247386 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19357bc-56fd-44fa-b944-8b15c8587e22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:17.248107 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19357bc-56fd-44fa-b944-8b15c8587e22 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:17.248457 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19357bc-56fd-44fa-b944-8b15c8587e22 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:17.248852 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19357bc-56fd-44fa-b944-8b15c8587e22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:17.260945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19357bc-56fd-44fa-b944-8b15c8587e22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:17.262508 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19357bc-56fd-44fa-b944-8b15c8587e22 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:17.274342 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4503/9019] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:40:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:40:18.463315 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288f4b4-b8f9-4de1-befe-08ed375e8884 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:18.472458 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288f4b4-b8f9-4de1-befe-08ed375e8884 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:18.476531 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc3633-6933-4993-a4a9-0f9b79a5e5bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:18.477194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc3633-6933-4993-a4a9-0f9b79a5e5bb service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:18.477479 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc3633-6933-4993-a4a9-0f9b79a5e5bb service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:18.477775 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc3633-6933-4993-a4a9-0f9b79a5e5bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:18.488439 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc3633-6933-4993-a4a9-0f9b79a5e5bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:18.490492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc3633-6933-4993-a4a9-0f9b79a5e5bb service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:18.501393 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4517/9020] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:40:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:40:22.266274 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19357bc-56fd-44fa-b944-8b15c8587e22 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:22.275669 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19357bc-56fd-44fa-b944-8b15c8587e22 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:22.279625 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262256a-4dd7-4616-8811-bebd465ba6a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:22.284923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262256a-4dd7-4616-8811-bebd465ba6a5 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:22.284923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262256a-4dd7-4616-8811-bebd465ba6a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:22.284923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262256a-4dd7-4616-8811-bebd465ba6a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:22.341296 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262256a-4dd7-4616-8811-bebd465ba6a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:22.342746 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262256a-4dd7-4616-8811-bebd465ba6a5 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:22.353065 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4504/9021] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:40:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:40:30.059712 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc3633-6933-4993-a4a9-0f9b79a5e5bb service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:30.071318 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc3633-6933-4993-a4a9-0f9b79a5e5bb service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:30.075919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa9fdb-a19a-4f34-b917-05143b9a2566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:30.076880 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa9fdb-a19a-4f34-b917-05143b9a2566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:30.077167 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa9fdb-a19a-4f34-b917-05143b9a2566 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:30.077447 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa9fdb-a19a-4f34-b917-05143b9a2566 admin admin] PATH_INFO: `/v3/users/7789236e7c354cbe931946ef3b145175` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:30.078649 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa9fdb-a19a-4f34-b917-05143b9a2566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7789236e7c354cbe931946ef3b145175)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:30.081121 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa9fdb-a19a-4f34-b917-05143b9a2566 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:30.328270 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c1aa9fdb-a19a-4f34-b917-05143b9a2566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7789236e7c354cbe931946ef3b145175'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:40:30.339568 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c1aa9fdb-a19a-4f34-b917-05143b9a2566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7789236e7c354cbe931946ef3b145175'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:40:30.340245 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c1aa9fdb-a19a-4f34-b917-05143b9a2566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7789236e7c354cbe931946ef3b145175'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:40:30.346854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c1aa9fdb-a19a-4f34-b917-05143b9a2566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7789236e7c354cbe931946ef3b145175'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:40:30.412592 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-c1aa9fdb-a19a-4f34-b917-05143b9a2566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7789236e7c354cbe931946ef3b145175'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:40:30.418891 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4518/9022] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 11:40:30 2022] DELETE /identity/v3/users/7789236e7c354cbe931946ef3b145175 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:40:30.659935 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262256a-4dd7-4616-8811-bebd465ba6a5 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:30.670678 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262256a-4dd7-4616-8811-bebd465ba6a5 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:30.730045 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c099a01-872b-40bc-b8d5-14a6b84b1eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:30.730899 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c099a01-872b-40bc-b8d5-14a6b84b1eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:30.731182 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c099a01-872b-40bc-b8d5-14a6b84b1eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:30.731461 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c099a01-872b-40bc-b8d5-14a6b84b1eb1 admin admin] PATH_INFO: `/v3/projects/d31245ef5b6547f2b9769a9462c0b6b3` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:30.732640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c099a01-872b-40bc-b8d5-14a6b84b1eb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d31245ef5b6547f2b9769a9462c0b6b3)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:30.734556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c099a01-872b-40bc-b8d5-14a6b84b1eb1 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:30.843040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4c099a01-872b-40bc-b8d5-14a6b84b1eb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd31245ef5b6547f2b9769a9462c0b6b3', 'request_id': 'req-4c099a01-872b-40bc-b8d5-14a6b84b1eb1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:40:30.849866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4c099a01-872b-40bc-b8d5-14a6b84b1eb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd31245ef5b6547f2b9769a9462c0b6b3', 'request_id': 'req-4c099a01-872b-40bc-b8d5-14a6b84b1eb1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:40:30.960166 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4c099a01-872b-40bc-b8d5-14a6b84b1eb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd31245ef5b6547f2b9769a9462c0b6b3', 'request_id': 'req-4c099a01-872b-40bc-b8d5-14a6b84b1eb1'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:40:30.971337 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4c099a01-872b-40bc-b8d5-14a6b84b1eb1 admin admin] The token cache is being invalidate because project d31245ef5b6547f2b9769a9462c0b6b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 11:40:30.971633 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4c099a01-872b-40bc-b8d5-14a6b84b1eb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:40:30.972433 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-4c099a01-872b-40bc-b8d5-14a6b84b1eb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:40:30.973856 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4505/9023] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 11:40:30 2022] DELETE /identity/v3/projects/d31245ef5b6547f2b9769a9462c0b6b3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:40:30.978461 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa9fdb-a19a-4f34-b917-05143b9a2566 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:30.979854 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c1aa9fdb-a19a-4f34-b917-05143b9a2566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:40:30.993469 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa9fdb-a19a-4f34-b917-05143b9a2566 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:31.047304 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9184c2-f3ef-4bfb-9e09-f7c3c81bc975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:31.048174 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9184c2-f3ef-4bfb-9e09-f7c3c81bc975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:31.048460 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9184c2-f3ef-4bfb-9e09-f7c3c81bc975 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:31.048771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9184c2-f3ef-4bfb-9e09-f7c3c81bc975 admin admin] PATH_INFO: `/v3/users/04999b00ac7b47b59a019c9e68b460f5` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:31.050303 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9184c2-f3ef-4bfb-9e09-f7c3c81bc975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04999b00ac7b47b59a019c9e68b460f5)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:31.052287 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9184c2-f3ef-4bfb-9e09-f7c3c81bc975 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:31.271919 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dc9184c2-f3ef-4bfb-9e09-f7c3c81bc975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04999b00ac7b47b59a019c9e68b460f5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:40:31.283123 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dc9184c2-f3ef-4bfb-9e09-f7c3c81bc975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04999b00ac7b47b59a019c9e68b460f5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:40:31.283780 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dc9184c2-f3ef-4bfb-9e09-f7c3c81bc975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04999b00ac7b47b59a019c9e68b460f5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:40:31.290310 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dc9184c2-f3ef-4bfb-9e09-f7c3c81bc975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04999b00ac7b47b59a019c9e68b460f5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:40:31.355122 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-dc9184c2-f3ef-4bfb-9e09-f7c3c81bc975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04999b00ac7b47b59a019c9e68b460f5'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:40:31.361328 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4519/9024] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 11:40:30 2022] DELETE /identity/v3/users/04999b00ac7b47b59a019c9e68b460f5 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:40:31.608298 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c099a01-872b-40bc-b8d5-14a6b84b1eb1 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:31.609925 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4c099a01-872b-40bc-b8d5-14a6b84b1eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:40:31.623181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c099a01-872b-40bc-b8d5-14a6b84b1eb1 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:31.678847 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b37f68-f66b-4538-af27-19b11ceb1f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:31.679725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b37f68-f66b-4538-af27-19b11ceb1f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:31.680020 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b37f68-f66b-4538-af27-19b11ceb1f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:31.680300 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b37f68-f66b-4538-af27-19b11ceb1f37 admin admin] PATH_INFO: `/v3/projects/d8ddcbace58447f6929f410da45282fc` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:31.681520 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b37f68-f66b-4538-af27-19b11ceb1f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8ddcbace58447f6929f410da45282fc)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:31.683454 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b37f68-f66b-4538-af27-19b11ceb1f37 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:31.788968 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-19b37f68-f66b-4538-af27-19b11ceb1f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ddcbace58447f6929f410da45282fc', 'request_id': 'req-19b37f68-f66b-4538-af27-19b11ceb1f37'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:40:31.794866 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-19b37f68-f66b-4538-af27-19b11ceb1f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ddcbace58447f6929f410da45282fc', 'request_id': 'req-19b37f68-f66b-4538-af27-19b11ceb1f37'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:40:31.840618 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-19b37f68-f66b-4538-af27-19b11ceb1f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ddcbace58447f6929f410da45282fc', 'request_id': 'req-19b37f68-f66b-4538-af27-19b11ceb1f37'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:40:31.855856 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-19b37f68-f66b-4538-af27-19b11ceb1f37 admin admin] The token cache is being invalidate because project d8ddcbace58447f6929f410da45282fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91119) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 11:40:31.856086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-19b37f68-f66b-4538-af27-19b11ceb1f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:40:31.856942 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-19b37f68-f66b-4538-af27-19b11ceb1f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:40:31.858587 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4506/9025] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 11:40:31 2022] DELETE /identity/v3/projects/d8ddcbace58447f6929f410da45282fc => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:40:31.863867 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26794a-360b-46e3-9a66-b6413a00ed49 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:31.864161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26794a-360b-46e3-9a66-b6413a00ed49 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:31.864445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26794a-360b-46e3-9a66-b6413a00ed49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:31.883378 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-aa26794a-360b-46e3-9a66-b6413a00ed49 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:40:31.884583 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-aa26794a-360b-46e3-9a66-b6413a00ed49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:40:31.944411 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4520/9026] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:40:31.951798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192397c-f89a-4816-aa59-0567ff68b1ef None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:31.952103 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192397c-f89a-4816-aa59-0567ff68b1ef None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:31.952558 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192397c-f89a-4816-aa59-0567ff68b1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:31.971019 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4192397c-f89a-4816-aa59-0567ff68b1ef None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:40:31.972250 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4192397c-f89a-4816-aa59-0567ff68b1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:40:31.981761 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4507/9027] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:40:31.986572 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26794a-360b-46e3-9a66-b6413a00ed49 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:31.996771 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26794a-360b-46e3-9a66-b6413a00ed49 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:32.001477 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8d2ee-b1cb-49f3-81ed-45749486b4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:32.002136 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8d2ee-b1cb-49f3-81ed-45749486b4bf admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:32.002423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8d2ee-b1cb-49f3-81ed-45749486b4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:32.002706 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8d2ee-b1cb-49f3-81ed-45749486b4bf admin admin] PATH_INFO: `/v3/domains` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:32.003489 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8d2ee-b1cb-49f3-81ed-45749486b4bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 02 11:40:32.003800 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8d2ee-b1cb-49f3-81ed-45749486b4bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:32.005436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8d2ee-b1cb-49f3-81ed-45749486b4bf admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:32.016722 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4521/9028] 10.222.0.16 () {58 vars in 1152 bytes} [Mon May 2 11:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 02 11:40:32.021086 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192397c-f89a-4816-aa59-0567ff68b1ef None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:32.030334 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192397c-f89a-4816-aa59-0567ff68b1ef None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:32.035006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533b2a5-d250-4e3e-bffd-4958eb7ae678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:32.035663 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533b2a5-d250-4e3e-bffd-4958eb7ae678 admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:32.035947 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533b2a5-d250-4e3e-bffd-4958eb7ae678 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:32.036230 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533b2a5-d250-4e3e-bffd-4958eb7ae678 admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:32.037494 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533b2a5-d250-4e3e-bffd-4958eb7ae678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:32.039409 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533b2a5-d250-4e3e-bffd-4958eb7ae678 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:32.123355 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4508/9029] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 11:40:32 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:40:32.128260 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8d2ee-b1cb-49f3-81ed-45749486b4bf admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:32.137839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8d2ee-b1cb-49f3-81ed-45749486b4bf admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:32.193485 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d852058-235c-4557-8c3b-c8099e193fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:32.194155 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d852058-235c-4557-8c3b-c8099e193fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:32.194466 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d852058-235c-4557-8c3b-c8099e193fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:32.194748 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d852058-235c-4557-8c3b-c8099e193fb5 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:32.195441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d852058-235c-4557-8c3b-c8099e193fb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:32.197398 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d852058-235c-4557-8c3b-c8099e193fb5 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:32.273840 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4522/9030] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 11:40:32 2022] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:40:32.278072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533b2a5-d250-4e3e-bffd-4958eb7ae678 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:32.289023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533b2a5-d250-4e3e-bffd-4958eb7ae678 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:32.293658 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b0cb6-8e0a-4a34-b24c-6ea3351c62bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:32.294316 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b0cb6-8e0a-4a34-b24c-6ea3351c62bf admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:32.294600 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b0cb6-8e0a-4a34-b24c-6ea3351c62bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:32.294882 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b0cb6-8e0a-4a34-b24c-6ea3351c62bf admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:32.295605 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b0cb6-8e0a-4a34-b24c-6ea3351c62bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:32.297606 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b0cb6-8e0a-4a34-b24c-6ea3351c62bf admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:32.308481 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4509/9031] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:40:32.312555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d852058-235c-4557-8c3b-c8099e193fb5 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:32.322632 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d852058-235c-4557-8c3b-c8099e193fb5 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:32.327237 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6cf83-0c26-47c2-819e-041c4c43126d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:32.327908 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6cf83-0c26-47c2-819e-041c4c43126d admin admin] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:32.328189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6cf83-0c26-47c2-819e-041c4c43126d admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:32.328468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6cf83-0c26-47c2-819e-041c4c43126d admin admin] PATH_INFO: `/v3/roles` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:32.329220 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6cf83-0c26-47c2-819e-041c4c43126d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:32.330790 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6cf83-0c26-47c2-819e-041c4c43126d admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:32.341103 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4523/9032] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:40:32.345413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b0cb6-8e0a-4a34-b24c-6ea3351c62bf admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:32.357458 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b0cb6-8e0a-4a34-b24c-6ea3351c62bf admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:32.362774 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e363da-b40b-4bfe-b9be-5d3da1040279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:32.363150 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e363da-b40b-4bfe-b9be-5d3da1040279 admin admin] REQUEST_METHOD: `PUT` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:32.363460 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e363da-b40b-4bfe-b9be-5d3da1040279 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:32.363734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e363da-b40b-4bfe-b9be-5d3da1040279 admin admin] PATH_INFO: `/v3/projects/f900d71299a041ad9114bf5268bf0702/users/0011df046ddc4eb0bcc15c14a51960d3/roles/d1592d47a67b4f4a8d14e2101c799509` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:32.378325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e363da-b40b-4bfe-b9be-5d3da1040279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f900d71299a041ad9114bf5268bf0702, user_id=0011df046ddc4eb0bcc15c14a51960d3, role_id=d1592d47a67b4f4a8d14e2101c799509)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:32.380990 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e363da-b40b-4bfe-b9be-5d3da1040279 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:32.433250 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4510/9033] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:40:32 2022] PUT /identity/v3/projects/f900d71299a041ad9114bf5268bf0702/users/0011df046ddc4eb0bcc15c14a51960d3/roles/d1592d47a67b4f4a8d14e2101c799509 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:40:32.438354 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b86176-c7da-4dcb-825e-7b0b24d44235 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:32.438642 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b86176-c7da-4dcb-825e-7b0b24d44235 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:32.438925 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b86176-c7da-4dcb-825e-7b0b24d44235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:32.456798 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-c8b86176-c7da-4dcb-825e-7b0b24d44235 None None] MFA Rules not processed for user `ac266adf0f16441aa7fe1157ada97e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:40:32.458023 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-c8b86176-c7da-4dcb-825e-7b0b24d44235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:40:32.518784 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4524/9034] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:40:32.529055 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e363da-b40b-4bfe-b9be-5d3da1040279 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:32.530805 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-53e363da-b40b-4bfe-b9be-5d3da1040279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:40:32.587125 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e363da-b40b-4bfe-b9be-5d3da1040279 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:32.591540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdefd2d-7768-40b1-a2e1-d278bad47efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:32.592192 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdefd2d-7768-40b1-a2e1-d278bad47efe service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:32.592473 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdefd2d-7768-40b1-a2e1-d278bad47efe service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:32.592793 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdefd2d-7768-40b1-a2e1-d278bad47efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:32.605006 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdefd2d-7768-40b1-a2e1-d278bad47efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:32.606468 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdefd2d-7768-40b1-a2e1-d278bad47efe service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:32.616292 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4511/9035] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:40:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:40:37.992700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc40b2-9b3e-48a3-857a-e1f87ac35706 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:37.992700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc40b2-9b3e-48a3-857a-e1f87ac35706 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:37.992700 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc40b2-9b3e-48a3-857a-e1f87ac35706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:38.020623 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-a0dc40b2-9b3e-48a3-857a-e1f87ac35706 None None] MFA Rules not processed for user `0011df046ddc4eb0bcc15c14a51960d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:40:38.022433 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-a0dc40b2-9b3e-48a3-857a-e1f87ac35706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:40:38.088528 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4525/9036] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:40:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:40:38.093124 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdefd2d-7768-40b1-a2e1-d278bad47efe service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:38.104193 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdefd2d-7768-40b1-a2e1-d278bad47efe service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:38.109597 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0386a-188c-4633-bdb8-a4ec227cd66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:38.110266 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0386a-188c-4633-bdb8-a4ec227cd66d admin admin] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:38.110694 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0386a-188c-4633-bdb8-a4ec227cd66d admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:38.111127 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0386a-188c-4633-bdb8-a4ec227cd66d admin admin] PATH_INFO: `/v3/projects` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:38.111841 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0386a-188c-4633-bdb8-a4ec227cd66d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:38.113809 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0386a-188c-4633-bdb8-a4ec227cd66d admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:38.209020 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4512/9037] 10.222.0.16 () {60 vars in 1152 bytes} [Mon May 2 11:40:38 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:40:38.218888 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc40b2-9b3e-48a3-857a-e1f87ac35706 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:38.224345 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc40b2-9b3e-48a3-857a-e1f87ac35706 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:38.283263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd681d8-75cf-4628-8e5e-2fafdc8efaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:38.283929 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd681d8-75cf-4628-8e5e-2fafdc8efaf7 admin admin] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:38.284213 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd681d8-75cf-4628-8e5e-2fafdc8efaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:38.284488 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd681d8-75cf-4628-8e5e-2fafdc8efaf7 admin admin] PATH_INFO: `/v3/users` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:38.285216 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd681d8-75cf-4628-8e5e-2fafdc8efaf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:38.287168 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd681d8-75cf-4628-8e5e-2fafdc8efaf7 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:38.378383 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4526/9038] 10.222.0.16 () {60 vars in 1143 bytes} [Mon May 2 11:40:38 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 02 11:40:38.382868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0386a-188c-4633-bdb8-a4ec227cd66d admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:38.393140 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0386a-188c-4633-bdb8-a4ec227cd66d admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:38.397760 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e4f7f-9e75-444b-9a16-3a7c6be1ccb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:38.398411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e4f7f-9e75-444b-9a16-3a7c6be1ccb9 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:38.398692 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e4f7f-9e75-444b-9a16-3a7c6be1ccb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:38.398967 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e4f7f-9e75-444b-9a16-3a7c6be1ccb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:38.399684 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e4f7f-9e75-444b-9a16-3a7c6be1ccb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:38.401309 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e4f7f-9e75-444b-9a16-3a7c6be1ccb9 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:38.411452 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4513/9039] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:40:38.415492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd681d8-75cf-4628-8e5e-2fafdc8efaf7 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:38.425871 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd681d8-75cf-4628-8e5e-2fafdc8efaf7 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:38.431033 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b9d76-4993-45de-8ad9-78426d7821f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:38.431905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b9d76-4993-45de-8ad9-78426d7821f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:38.432194 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b9d76-4993-45de-8ad9-78426d7821f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:38.432476 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b9d76-4993-45de-8ad9-78426d7821f9 admin admin] PATH_INFO: `/v3/projects/fface915b555403e9152c10d565ed1a5/users/732cc456d2c24d4aad4348cf4287220a/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:38.452027 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b9d76-4993-45de-8ad9-78426d7821f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fface915b555403e9152c10d565ed1a5, user_id=732cc456d2c24d4aad4348cf4287220a, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:38.454966 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b9d76-4993-45de-8ad9-78426d7821f9 admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:38.526543 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4527/9040] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:40:38 2022] PUT /identity/v3/projects/fface915b555403e9152c10d565ed1a5/users/732cc456d2c24d4aad4348cf4287220a/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 02 11:40:38.530616 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e4f7f-9e75-444b-9a16-3a7c6be1ccb9 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:38.541151 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e4f7f-9e75-444b-9a16-3a7c6be1ccb9 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:38.595134 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536629f9-30a8-428f-85b1-2e1b3925c074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:38.595796 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536629f9-30a8-428f-85b1-2e1b3925c074 admin admin] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:38.596083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536629f9-30a8-428f-85b1-2e1b3925c074 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:38.596361 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536629f9-30a8-428f-85b1-2e1b3925c074 admin admin] PATH_INFO: `/v3/roles` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:38.597116 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536629f9-30a8-428f-85b1-2e1b3925c074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:38.598753 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536629f9-30a8-428f-85b1-2e1b3925c074 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:38.609770 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4514/9041] 10.222.0.16 () {58 vars in 1121 bytes} [Mon May 2 11:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 02 11:40:38.614022 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b9d76-4993-45de-8ad9-78426d7821f9 admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:38.625263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b9d76-4993-45de-8ad9-78426d7821f9 admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:38.629980 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce83b35-cd68-4424-8989-973b42e8d3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:38.630834 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce83b35-cd68-4424-8989-973b42e8d3fe admin admin] REQUEST_METHOD: `PUT` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:38.631116 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce83b35-cd68-4424-8989-973b42e8d3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:38.631394 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce83b35-cd68-4424-8989-973b42e8d3fe admin admin] PATH_INFO: `/v3/projects/fface915b555403e9152c10d565ed1a5/users/732cc456d2c24d4aad4348cf4287220a/roles/dd8a47ade22941849ebdf8fbdf994b66` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:38.633430 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce83b35-cd68-4424-8989-973b42e8d3fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=fface915b555403e9152c10d565ed1a5, user_id=732cc456d2c24d4aad4348cf4287220a, role_id=dd8a47ade22941849ebdf8fbdf994b66)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:38.636060 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce83b35-cd68-4424-8989-973b42e8d3fe admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:38.646013 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4528/9042] 10.222.0.16 () {60 vars in 1482 bytes} [Mon May 2 11:40:38 2022] PUT /identity/v3/projects/fface915b555403e9152c10d565ed1a5/users/732cc456d2c24d4aad4348cf4287220a/roles/dd8a47ade22941849ebdf8fbdf994b66 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:40:44.389431 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975b607-1d4d-46b5-9ca7-a362b557da83 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:44.389945 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975b607-1d4d-46b5-9ca7-a362b557da83 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:44.390021 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975b607-1d4d-46b5-9ca7-a362b557da83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:44.421170 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-4975b607-1d4d-46b5-9ca7-a362b557da83 None None] MFA Rules not processed for user `732cc456d2c24d4aad4348cf4287220a`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:40:44.422783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4975b607-1d4d-46b5-9ca7-a362b557da83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:40:44.492906 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4515/9043] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:40:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:40:44.504504 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce83b35-cd68-4424-8989-973b42e8d3fe admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:44.507431 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-cce83b35-cd68-4424-8989-973b42e8d3fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:40:44.583860 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce83b35-cd68-4424-8989-973b42e8d3fe admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:44.589554 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21b929-df02-42e0-a2cd-cb60052a02e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:44.590215 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21b929-df02-42e0-a2cd-cb60052a02e7 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:44.590502 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21b929-df02-42e0-a2cd-cb60052a02e7 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:44.590801 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21b929-df02-42e0-a2cd-cb60052a02e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:44.648687 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21b929-df02-42e0-a2cd-cb60052a02e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:44.650292 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21b929-df02-42e0-a2cd-cb60052a02e7 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:44.659060 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4529/9044] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:40:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:40:45.810095 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975b607-1d4d-46b5-9ca7-a362b557da83 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:45.811661 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-4975b607-1d4d-46b5-9ca7-a362b557da83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:40:45.905273 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975b607-1d4d-46b5-9ca7-a362b557da83 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:45.910928 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb75e5-87db-4ee9-995e-cddab1b3dbdb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:45.923849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb75e5-87db-4ee9-995e-cddab1b3dbdb service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:45.923849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb75e5-87db-4ee9-995e-cddab1b3dbdb service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:45.923849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb75e5-87db-4ee9-995e-cddab1b3dbdb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:45.923849 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0bcb75e5-87db-4ee9-995e-cddab1b3dbdb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:40:45.927411 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb75e5-87db-4ee9-995e-cddab1b3dbdb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:45.929840 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb75e5-87db-4ee9-995e-cddab1b3dbdb service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:45.941150 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4516/9045] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:40:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:40:47.880196 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd959cfc-826b-4ad5-8c4d-4fc8c0d6d963 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:47.880713 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd959cfc-826b-4ad5-8c4d-4fc8c0d6d963 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:47.880808 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd959cfc-826b-4ad5-8c4d-4fc8c0d6d963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:47.898702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-bd959cfc-826b-4ad5-8c4d-4fc8c0d6d963 None None] MFA Rules not processed for user `0011df046ddc4eb0bcc15c14a51960d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:40:47.905423 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-bd959cfc-826b-4ad5-8c4d-4fc8c0d6d963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:40:47.907110 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4530/9046] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:40:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:40:48.621018 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb75e5-87db-4ee9-995e-cddab1b3dbdb service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:48.622924 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-0bcb75e5-87db-4ee9-995e-cddab1b3dbdb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:40:48.637304 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb75e5-87db-4ee9-995e-cddab1b3dbdb service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:48.642836 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2f137-06ae-43c0-95d2-44c583c0d65f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:48.643728 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2f137-06ae-43c0-95d2-44c583c0d65f service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:48.644130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2f137-06ae-43c0-95d2-44c583c0d65f service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:48.644646 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2f137-06ae-43c0-95d2-44c583c0d65f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:48.648295 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-81d2f137-06ae-43c0-95d2-44c583c0d65f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:40:48.660916 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2f137-06ae-43c0-95d2-44c583c0d65f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:48.663486 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2f137-06ae-43c0-95d2-44c583c0d65f service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:48.677039 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4517/9047] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:40:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:40:58.945326 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd959cfc-826b-4ad5-8c4d-4fc8c0d6d963 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:40:58.957877 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd959cfc-826b-4ad5-8c4d-4fc8c0d6d963 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:40:58.963917 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd890b-c395-4812-9295-a05fe1bfe196 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:40:58.964560 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd890b-c395-4812-9295-a05fe1bfe196 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:40:58.964872 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd890b-c395-4812-9295-a05fe1bfe196 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:40:58.965148 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd890b-c395-4812-9295-a05fe1bfe196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:40:58.966902 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-4edd890b-c395-4812-9295-a05fe1bfe196 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:40:58.978702 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd890b-c395-4812-9295-a05fe1bfe196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:40:58.980283 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd890b-c395-4812-9295-a05fe1bfe196 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:40:58.990724 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4531/9048] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:40:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:41:01.756032 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2f137-06ae-43c0-95d2-44c583c0d65f service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:41:01.757579 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-81d2f137-06ae-43c0-95d2-44c583c0d65f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:41:01.812153 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2f137-06ae-43c0-95d2-44c583c0d65f service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:41:01.815725 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b460c-b646-40dc-82c1-359f899bfa2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:41:01.816362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b460c-b646-40dc-82c1-359f899bfa2d service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:41:01.816673 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b460c-b646-40dc-82c1-359f899bfa2d service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:41:01.816956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b460c-b646-40dc-82c1-359f899bfa2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:41:01.825912 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b460c-b646-40dc-82c1-359f899bfa2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:41:01.827343 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b460c-b646-40dc-82c1-359f899bfa2d service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:41:01.836688 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4518/9049] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:41:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:41:32.941666 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd890b-c395-4812-9295-a05fe1bfe196 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:41:32.953143 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd890b-c395-4812-9295-a05fe1bfe196 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:41:32.958207 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcbc15-b44f-4caf-b706-4213f8ba0e1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:41:32.958709 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcbc15-b44f-4caf-b706-4213f8ba0e1e service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:41:32.958998 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcbc15-b44f-4caf-b706-4213f8ba0e1e service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:41:32.959281 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcbc15-b44f-4caf-b706-4213f8ba0e1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:41:32.961073 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-94dcbc15-b44f-4caf-b706-4213f8ba0e1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:41:32.972884 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcbc15-b44f-4caf-b706-4213f8ba0e1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:41:32.974507 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcbc15-b44f-4caf-b706-4213f8ba0e1e service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:41:32.984295 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4532/9050] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:41:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:43:05.055918 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e109e-7595-4077-a67b-8079af46f10c None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:43:05.056413 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e109e-7595-4077-a67b-8079af46f10c None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:43:05.056507 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e109e-7595-4077-a67b-8079af46f10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:43:05.073275 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-5d8e109e-7595-4077-a67b-8079af46f10c None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:43:05.074471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-5d8e109e-7595-4077-a67b-8079af46f10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:43:05.128707 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4519/9051] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 11:43:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:43:05.286212 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcbc15-b44f-4caf-b706-4213f8ba0e1e service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:43:05.287717 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-94dcbc15-b44f-4caf-b706-4213f8ba0e1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:43:05.361234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcbc15-b44f-4caf-b706-4213f8ba0e1e service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:43:05.366307 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e379cac-d319-47c2-a1b9-a577111e3c18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:43:05.366957 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e379cac-d319-47c2-a1b9-a577111e3c18 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:43:05.367240 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e379cac-d319-47c2-a1b9-a577111e3c18 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:43:05.367519 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e379cac-d319-47c2-a1b9-a577111e3c18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:43:05.376203 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e379cac-d319-47c2-a1b9-a577111e3c18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:43:05.378050 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e379cac-d319-47c2-a1b9-a577111e3c18 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:43:05.386311 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4533/9052] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 11:43:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 11:43:16.079785 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295fbef-e06f-4577-88c1-e19f634daeac None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:43:16.080294 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295fbef-e06f-4577-88c1-e19f634daeac None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:43:16.080392 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295fbef-e06f-4577-88c1-e19f634daeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:43:16.097735 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-8295fbef-e06f-4577-88c1-e19f634daeac None None] MFA Rules not processed for user `0011df046ddc4eb0bcc15c14a51960d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:43:16.098991 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-8295fbef-e06f-4577-88c1-e19f634daeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:43:16.106345 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4520/9053] 10.222.0.16 () {58 vars in 957 bytes} [Mon May 2 11:43:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:43:16.412446 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e379cac-d319-47c2-a1b9-a577111e3c18 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:43:16.421492 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e379cac-d319-47c2-a1b9-a577111e3c18 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:43:16.425314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030e3b9-b4e8-43bf-b69e-865002c91091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:43:16.429652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030e3b9-b4e8-43bf-b69e-865002c91091 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:43:16.429652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030e3b9-b4e8-43bf-b69e-865002c91091 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:43:16.429652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030e3b9-b4e8-43bf-b69e-865002c91091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:43:16.429652 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-0030e3b9-b4e8-43bf-b69e-865002c91091 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:43:16.440555 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030e3b9-b4e8-43bf-b69e-865002c91091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:43:16.442105 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030e3b9-b4e8-43bf-b69e-865002c91091 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:43:16.449835 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4534/9054] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:43:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:43:16.948489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295fbef-e06f-4577-88c1-e19f634daeac None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:43:16.961251 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295fbef-e06f-4577-88c1-e19f634daeac None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:43:16.966542 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4423c-e59a-4a63-bd2a-33fbff814ab0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:43:16.967284 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4423c-e59a-4a63-bd2a-33fbff814ab0 service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:43:16.967635 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4423c-e59a-4a63-bd2a-33fbff814ab0 service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:43:16.968040 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4423c-e59a-4a63-bd2a-33fbff814ab0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:43:16.969907 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-3de4423c-e59a-4a63-bd2a-33fbff814ab0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:43:16.982989 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4423c-e59a-4a63-bd2a-33fbff814ab0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:43:16.989102 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4423c-e59a-4a63-bd2a-33fbff814ab0 service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:43:16.999594 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4521/9055] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:43:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:43:19.410772 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310db719-7db6-474f-bffd-9df09f5fcfb2 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:43:19.411349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310db719-7db6-474f-bffd-9df09f5fcfb2 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:43:19.411349 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310db719-7db6-474f-bffd-9df09f5fcfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:43:19.430602 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-310db719-7db6-474f-bffd-9df09f5fcfb2 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:43:19.431838 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-310db719-7db6-474f-bffd-9df09f5fcfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:43:19.439368 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4535/9056] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 11:43:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:43:19.453180 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4423c-e59a-4a63-bd2a-33fbff814ab0 service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:43:19.466356 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4423c-e59a-4a63-bd2a-33fbff814ab0 service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:43:19.471929 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8475792-2ec9-4fc8-a065-b0a049f86ea2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:43:19.472652 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8475792-2ec9-4fc8-a065-b0a049f86ea2 service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:43:19.472972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8475792-2ec9-4fc8-a065-b0a049f86ea2 service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:43:19.473231 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8475792-2ec9-4fc8-a065-b0a049f86ea2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:43:19.483005 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8475792-2ec9-4fc8-a065-b0a049f86ea2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:43:19.484718 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8475792-2ec9-4fc8-a065-b0a049f86ea2 service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:43:19.493871 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4522/9057] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 11:43:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 11:43:27.925418 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310db719-7db6-474f-bffd-9df09f5fcfb2 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:43:27.935372 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310db719-7db6-474f-bffd-9df09f5fcfb2 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:43:27.939161 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c37a46-2058-4d54-84f5-06a1ae33ccaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:43:27.939813 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c37a46-2058-4d54-84f5-06a1ae33ccaf service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:43:27.940184 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c37a46-2058-4d54-84f5-06a1ae33ccaf service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:43:27.940468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c37a46-2058-4d54-84f5-06a1ae33ccaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:43:27.943263 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f0c37a46-2058-4d54-84f5-06a1ae33ccaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:43:27.953179 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c37a46-2058-4d54-84f5-06a1ae33ccaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:43:27.954596 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c37a46-2058-4d54-84f5-06a1ae33ccaf service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:43:27.962506 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4536/9058] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:43:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:44:43.663120 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8475792-2ec9-4fc8-a065-b0a049f86ea2 service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:44:43.682784 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8475792-2ec9-4fc8-a065-b0a049f86ea2 service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:44:43.686442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96ce06-425f-42d9-a983-a303bfc6c495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:44:43.687079 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96ce06-425f-42d9-a983-a303bfc6c495 service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:44:43.687362 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96ce06-425f-42d9-a983-a303bfc6c495 service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:44:43.687640 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96ce06-425f-42d9-a983-a303bfc6c495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:44:43.689402 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-2e96ce06-425f-42d9-a983-a303bfc6c495 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:44:43.728667 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96ce06-425f-42d9-a983-a303bfc6c495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:44:43.730104 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96ce06-425f-42d9-a983-a303bfc6c495 service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:44:43.737751 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4523/9059] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:44:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:45:10.730441 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dc70f-f06e-47ed-9aec-3c3c8db30b31 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:45:10.731006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dc70f-f06e-47ed-9aec-3c3c8db30b31 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:45:10.731006 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dc70f-f06e-47ed-9aec-3c3c8db30b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:45:10.786046 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-d85dc70f-f06e-47ed-9aec-3c3c8db30b31 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:45:10.787273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-d85dc70f-f06e-47ed-9aec-3c3c8db30b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:45:10.811069 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4537/9060] 10.222.0.16 () {58 vars in 1009 bytes} [Mon May 2 11:45:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:45:10.850779 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96ce06-425f-42d9-a983-a303bfc6c495 service neutron] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:45:10.892529 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96ce06-425f-42d9-a983-a303bfc6c495 service neutron] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:45:10.897750 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37695b01-2d2e-4720-94bf-9e709e07ba1c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:45:10.898401 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37695b01-2d2e-4720-94bf-9e709e07ba1c service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:45:10.898691 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37695b01-2d2e-4720-94bf-9e709e07ba1c service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:45:10.898975 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37695b01-2d2e-4720-94bf-9e709e07ba1c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:45:10.907375 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37695b01-2d2e-4720-94bf-9e709e07ba1c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:45:10.909029 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37695b01-2d2e-4720-94bf-9e709e07ba1c service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:45:10.920063 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4524/9061] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 11:45:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 02 11:45:21.725266 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d6789-e4ae-4a32-a1de-867002872364 None None] REQUEST_METHOD: `POST` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:45:21.725767 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d6789-e4ae-4a32-a1de-867002872364 None None] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:45:21.725865 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d6789-e4ae-4a32-a1de-867002872364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:45:21.747820 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.auth.core [None req-209d6789-e4ae-4a32-a1de-867002872364 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:45:21.749068 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-209d6789-e4ae-4a32-a1de-867002872364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:45:21.756245 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4538/9062] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 11:45:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:45:21.767938 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37695b01-2d2e-4720-94bf-9e709e07ba1c service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:45:21.778293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37695b01-2d2e-4720-94bf-9e709e07ba1c service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:45:21.783287 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa89a1-1996-4910-8909-e2c7cfa67d74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:45:21.783921 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa89a1-1996-4910-8909-e2c7cfa67d74 service swift] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:45:21.784209 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa89a1-1996-4910-8909-e2c7cfa67d74 service swift] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:45:21.784514 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa89a1-1996-4910-8909-e2c7cfa67d74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:45:21.792953 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa89a1-1996-4910-8909-e2c7cfa67d74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:45:21.794540 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa89a1-1996-4910-8909-e2c7cfa67d74 service swift] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:45:21.802733 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4525/9063] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 11:45:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 11:45:23.672569 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d6789-e4ae-4a32-a1de-867002872364 None None] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:45:23.674803 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-209d6789-e4ae-4a32-a1de-867002872364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:45:23.708760 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d6789-e4ae-4a32-a1de-867002872364 None None] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:45:23.715468 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3284ce-051d-4f9c-994c-baab942d0550 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:45:23.716234 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3284ce-051d-4f9c-994c-baab942d0550 service nova] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:45:23.716589 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3284ce-051d-4f9c-994c-baab942d0550 service nova] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:45:23.716968 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3284ce-051d-4f9c-994c-baab942d0550 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:45:23.719257 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-9b3284ce-051d-4f9c-994c-baab942d0550 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:45:23.733935 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3284ce-051d-4f9c-994c-baab942d0550 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:45:23.735789 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3284ce-051d-4f9c-994c-baab942d0550 service nova] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:45:23.747854 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4539/9064] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:45:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:45:24.090868 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa89a1-1996-4910-8909-e2c7cfa67d74 service swift] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:45:24.107374 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa89a1-1996-4910-8909-e2c7cfa67d74 service swift] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:45:24.111545 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd97e72-ef30-43a9-a893-4083ea18c4df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:45:24.112195 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd97e72-ef30-43a9-a893-4083ea18c4df service neutron] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:45:24.112489 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd97e72-ef30-43a9-a893-4083ea18c4df service neutron] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:45:24.112802 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd97e72-ef30-43a9-a893-4083ea18c4df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:45:24.114567 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-ecd97e72-ef30-43a9-a893-4083ea18c4df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:45:24.128395 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd97e72-ef30-43a9-a893-4083ea18c4df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:45:24.129923 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd97e72-ef30-43a9-a893-4083ea18c4df service neutron] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:45:24.141803 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4526/9065] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:45:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:45:25.637497 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3284ce-051d-4f9c-994c-baab942d0550 service nova] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:45:25.646850 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3284ce-051d-4f9c-994c-baab942d0550 service nova] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:45:25.651189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a991e5-665a-49f1-8fc6-82c357491d15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:45:25.651918 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a991e5-665a-49f1-8fc6-82c357491d15 service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:45:25.652273 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a991e5-665a-49f1-8fc6-82c357491d15 service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:45:25.652646 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a991e5-665a-49f1-8fc6-82c357491d15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:45:25.654527 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-89a991e5-665a-49f1-8fc6-82c357491d15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:45:25.669404 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a991e5-665a-49f1-8fc6-82c357491d15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:45:25.670832 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a991e5-665a-49f1-8fc6-82c357491d15 service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:45:25.681891 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4540/9066] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:45:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:45:28.357726 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594db05-6548-401c-b7eb-603f79167275 None None] REQUEST_METHOD: `POST` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:45:28.358202 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594db05-6548-401c-b7eb-603f79167275 None None] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:45:28.358499 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594db05-6548-401c-b7eb-603f79167275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:45:28.376225 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.auth.core [None req-6594db05-6548-401c-b7eb-603f79167275 None None] MFA Rules not processed for user `c1c06bcf38a942ffbcdc4ee6d2edebb0`. Rule list: `[]` (Enabled: `True`). {{(pid=91119) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 02 11:45:28.377456 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-6594db05-6548-401c-b7eb-603f79167275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:45:28.385419 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4527/9067] 10.222.0.16 () {58 vars in 967 bytes} [Mon May 2 11:45:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 02 11:45:28.397190 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a991e5-665a-49f1-8fc6-82c357491d15 service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:45:28.408758 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a991e5-665a-49f1-8fc6-82c357491d15 service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:45:28.413620 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d1b01-c942-4f8d-8f7a-70908e464ba6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6573f5c0731c4a18bf2374c3ba006a57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:45:28.414253 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d1b01-c942-4f8d-8f7a-70908e464ba6 service swift] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:45:28.414535 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d1b01-c942-4f8d-8f7a-70908e464ba6 service swift] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:45:28.414809 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d1b01-c942-4f8d-8f7a-70908e464ba6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:45:28.422577 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d1b01-c942-4f8d-8f7a-70908e464ba6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:45:28.424391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d1b01-c942-4f8d-8f7a-70908e464ba6 service swift] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:45:28.432227 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4541/9068] 10.222.0.16 () {60 vars in 1384 bytes} [Mon May 2 11:45:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 02 11:45:33.125798 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594db05-6548-401c-b7eb-603f79167275 None None] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:45:33.138258 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594db05-6548-401c-b7eb-603f79167275 None None] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:45:33.143769 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3632f-f00b-4bd3-9a9d-38994b003a83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6036dd39fb74289a8cbdcd6a21f8662', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:45:33.144408 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3632f-f00b-4bd3-9a9d-38994b003a83 service nova] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:45:33.144731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3632f-f00b-4bd3-9a9d-38994b003a83 service nova] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:45:33.145008 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3632f-f00b-4bd3-9a9d-38994b003a83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:45:33.146734 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-cae3632f-f00b-4bd3-9a9d-38994b003a83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:45:33.159749 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3632f-f00b-4bd3-9a9d-38994b003a83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:45:33.161385 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3632f-f00b-4bd3-9a9d-38994b003a83 service nova] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:45:33.172337 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4528/9069] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:45:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:45:34.739308 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d1b01-c942-4f8d-8f7a-70908e464ba6 service swift] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:45:34.748956 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d1b01-c942-4f8d-8f7a-70908e464ba6 service swift] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:45:34.752754 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c744f-b74e-4360-ad1f-12e0eb559d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd9fe10f94f43aeb3eb10009ee96ea9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:45:34.753391 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c744f-b74e-4360-ad1f-12e0eb559d8b service neutron] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:45:34.754269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c744f-b74e-4360-ad1f-12e0eb559d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:45:34.754269 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c744f-b74e-4360-ad1f-12e0eb559d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:45:34.822045 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c744f-b74e-4360-ad1f-12e0eb559d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:45:34.823515 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c744f-b74e-4360-ad1f-12e0eb559d8b service neutron] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:45:34.842268 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4542/9070] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:45:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:45:41.988909 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3632f-f00b-4bd3-9a9d-38994b003a83 service nova] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:45:41.999708 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3632f-f00b-4bd3-9a9d-38994b003a83 service nova] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:45:42.004492 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f5ae0-486c-4274-a6f0-49e2adce5594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:45:42.005177 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5ae0-486c-4274-a6f0-49e2adce5594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:45:42.005469 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5ae0-486c-4274-a6f0-49e2adce5594 admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:45:42.005752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5ae0-486c-4274-a6f0-49e2adce5594 admin admin] PATH_INFO: `/v3/users/0011df046ddc4eb0bcc15c14a51960d3` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:45:42.006972 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f5ae0-486c-4274-a6f0-49e2adce5594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0011df046ddc4eb0bcc15c14a51960d3)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:45:42.009471 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f5ae0-486c-4274-a6f0-49e2adce5594 admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:45:42.161423 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7a9f5ae0-486c-4274-a6f0-49e2adce5594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0011df046ddc4eb0bcc15c14a51960d3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:45:42.173181 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7a9f5ae0-486c-4274-a6f0-49e2adce5594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0011df046ddc4eb0bcc15c14a51960d3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:45:42.173860 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7a9f5ae0-486c-4274-a6f0-49e2adce5594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0011df046ddc4eb0bcc15c14a51960d3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:45:42.181293 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7a9f5ae0-486c-4274-a6f0-49e2adce5594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0011df046ddc4eb0bcc15c14a51960d3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:45:42.239163 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-7a9f5ae0-486c-4274-a6f0-49e2adce5594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0011df046ddc4eb0bcc15c14a51960d3'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:45:42.246199 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4529/9071] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 11:45:41 2022] DELETE /identity/v3/users/0011df046ddc4eb0bcc15c14a51960d3 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:45:42.469615 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c744f-b74e-4360-ad1f-12e0eb559d8b service neutron] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:45:42.480454 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c744f-b74e-4360-ad1f-12e0eb559d8b service neutron] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:45:42.542674 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70753d3f-c8c2-4b00-8c10-4a0b8516083e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:45:42.543603 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70753d3f-c8c2-4b00-8c10-4a0b8516083e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:45:42.543885 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70753d3f-c8c2-4b00-8c10-4a0b8516083e admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:45:42.544163 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70753d3f-c8c2-4b00-8c10-4a0b8516083e admin admin] PATH_INFO: `/v3/projects/f900d71299a041ad9114bf5268bf0702` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:45:42.545499 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70753d3f-c8c2-4b00-8c10-4a0b8516083e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f900d71299a041ad9114bf5268bf0702)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:45:42.547448 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70753d3f-c8c2-4b00-8c10-4a0b8516083e admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:45:42.668814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-70753d3f-c8c2-4b00-8c10-4a0b8516083e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f900d71299a041ad9114bf5268bf0702', 'request_id': 'req-70753d3f-c8c2-4b00-8c10-4a0b8516083e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:45:42.719016 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-70753d3f-c8c2-4b00-8c10-4a0b8516083e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f900d71299a041ad9114bf5268bf0702', 'request_id': 'req-70753d3f-c8c2-4b00-8c10-4a0b8516083e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:45:42.725714 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-70753d3f-c8c2-4b00-8c10-4a0b8516083e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f900d71299a041ad9114bf5268bf0702', 'request_id': 'req-70753d3f-c8c2-4b00-8c10-4a0b8516083e'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:45:42.748366 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-70753d3f-c8c2-4b00-8c10-4a0b8516083e admin admin] The token cache is being invalidate because project f900d71299a041ad9114bf5268bf0702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 11:45:42.748685 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-70753d3f-c8c2-4b00-8c10-4a0b8516083e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:45:42.749314 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-70753d3f-c8c2-4b00-8c10-4a0b8516083e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:45:42.750940 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4543/9072] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 11:45:42 2022] DELETE /identity/v3/projects/f900d71299a041ad9114bf5268bf0702 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:45:42.754910 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f5ae0-486c-4274-a6f0-49e2adce5594 admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:45:42.756325 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-7a9f5ae0-486c-4274-a6f0-49e2adce5594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:45:42.769365 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f5ae0-486c-4274-a6f0-49e2adce5594 admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:45:42.824752 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f8fe8-6c0a-48ff-af7e-a5d31f37500a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:45:42.826033 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f8fe8-6c0a-48ff-af7e-a5d31f37500a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:45:42.826498 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f8fe8-6c0a-48ff-af7e-a5d31f37500a admin admin] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:45:42.826783 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f8fe8-6c0a-48ff-af7e-a5d31f37500a admin admin] PATH_INFO: `/v3/users/732cc456d2c24d4aad4348cf4287220a` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:45:42.828083 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f8fe8-6c0a-48ff-af7e-a5d31f37500a admin admin] RBAC: Authorizing `identity:delete_user(user_id=732cc456d2c24d4aad4348cf4287220a)` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:45:42.830073 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f8fe8-6c0a-48ff-af7e-a5d31f37500a admin admin] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:45:42.978111 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-706f8fe8-6c0a-48ff-af7e-a5d31f37500a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '732cc456d2c24d4aad4348cf4287220a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:45:42.989442 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-706f8fe8-6c0a-48ff-af7e-a5d31f37500a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '732cc456d2c24d4aad4348cf4287220a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:45:42.990130 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-706f8fe8-6c0a-48ff-af7e-a5d31f37500a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '732cc456d2c24d4aad4348cf4287220a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:45:42.997211 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-706f8fe8-6c0a-48ff-af7e-a5d31f37500a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '732cc456d2c24d4aad4348cf4287220a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:45:43.050901 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.notifications [None req-706f8fe8-6c0a-48ff-af7e-a5d31f37500a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '732cc456d2c24d4aad4348cf4287220a'} {{(pid=91119) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:45:43.057616 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4530/9073] 10.222.0.16 () {58 vars in 1223 bytes} [Mon May 2 11:45:42 2022] DELETE /identity/v3/users/732cc456d2c24d4aad4348cf4287220a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:45:43.290582 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70753d3f-c8c2-4b00-8c10-4a0b8516083e admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:45:43.292051 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-70753d3f-c8c2-4b00-8c10-4a0b8516083e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:45:43.305784 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70753d3f-c8c2-4b00-8c10-4a0b8516083e admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:45:43.361089 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2188331-ef99-4a17-be31-b5e57a7c3bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac266adf0f16441aa7fe1157ada97e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af81e2baeae46b0b67902cedc893eb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:45:43.361979 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2188331-ef99-4a17-be31-b5e57a7c3bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:45:43.362261 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2188331-ef99-4a17-be31-b5e57a7c3bad admin admin] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:45:43.362557 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2188331-ef99-4a17-be31-b5e57a7c3bad admin admin] PATH_INFO: `/v3/projects/fface915b555403e9152c10d565ed1a5` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:45:43.363788 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2188331-ef99-4a17-be31-b5e57a7c3bad admin admin] RBAC: Authorizing `identity:delete_project(project_id=fface915b555403e9152c10d565ed1a5)` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:45:43.365723 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2188331-ef99-4a17-be31-b5e57a7c3bad admin admin] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:45:43.462189 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f2188331-ef99-4a17-be31-b5e57a7c3bad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fface915b555403e9152c10d565ed1a5', 'request_id': 'req-f2188331-ef99-4a17-be31-b5e57a7c3bad'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:45:43.527977 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f2188331-ef99-4a17-be31-b5e57a7c3bad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fface915b555403e9152c10d565ed1a5', 'request_id': 'req-f2188331-ef99-4a17-be31-b5e57a7c3bad'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:45:43.536829 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f2188331-ef99-4a17-be31-b5e57a7c3bad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fface915b555403e9152c10d565ed1a5', 'request_id': 'req-f2188331-ef99-4a17-be31-b5e57a7c3bad'} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:45:43.544815 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f2188331-ef99-4a17-be31-b5e57a7c3bad admin admin] The token cache is being invalidate because project fface915b555403e9152c10d565ed1a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 02 11:45:43.545109 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f2188331-ef99-4a17-be31-b5e57a7c3bad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:45:43.545745 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.notifications [None req-f2188331-ef99-4a17-be31-b5e57a7c3bad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 02 11:45:43.547307 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4544/9074] 10.222.0.16 () {58 vars in 1232 bytes} [Mon May 2 11:45:43 2022] DELETE /identity/v3/projects/fface915b555403e9152c10d565ed1a5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 02 11:45:52.774897 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f8fe8-6c0a-48ff-af7e-a5d31f37500a admin admin] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:45:52.776466 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-706f8fe8-6c0a-48ff-af7e-a5d31f37500a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:45:52.856372 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f8fe8-6c0a-48ff-af7e-a5d31f37500a admin admin] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:45:52.912556 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86480ba8-f5e4-4441-9c9e-fe72e138c7f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:45:52.913239 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86480ba8-f5e4-4441-9c9e-fe72e138c7f5 service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:45:52.913531 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86480ba8-f5e4-4441-9c9e-fe72e138c7f5 service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:45:52.913819 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86480ba8-f5e4-4441-9c9e-fe72e138c7f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:45:52.916174 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-86480ba8-f5e4-4441-9c9e-fe72e138c7f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:45:52.927323 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86480ba8-f5e4-4441-9c9e-fe72e138c7f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:45:52.928956 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86480ba8-f5e4-4441-9c9e-fe72e138c7f5 service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:45:52.938627 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4531/9075] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:45:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:46:37.927593 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2188331-ef99-4a17-be31-b5e57a7c3bad admin admin] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:46:37.929223 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-f2188331-ef99-4a17-be31-b5e57a7c3bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:46:37.944445 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2188331-ef99-4a17-be31-b5e57a7c3bad admin admin] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:46:37.949937 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74585f94-1a65-4db6-9aa5-fe87555cc48b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:46:37.951839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74585f94-1a65-4db6-9aa5-fe87555cc48b service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:46:37.951839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74585f94-1a65-4db6-9aa5-fe87555cc48b service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:46:37.951839 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74585f94-1a65-4db6-9aa5-fe87555cc48b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:46:37.952907 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.fernet_utils [None req-74585f94-1a65-4db6-9aa5-fe87555cc48b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:46:37.963814 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74585f94-1a65-4db6-9aa5-fe87555cc48b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:46:37.965419 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74585f94-1a65-4db6-9aa5-fe87555cc48b service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:46:37.975283 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4545/9076] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:46:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:50:59.795072 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86480ba8-f5e4-4441-9c9e-fe72e138c7f5 service placement] Authenticating user token {{(pid=91119) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:50:59.796474 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.fernet_utils [None req-86480ba8-f5e4-4441-9c9e-fe72e138c7f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91119) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 02 11:50:59.819731 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86480ba8-f5e4-4441-9c9e-fe72e138c7f5 service placement] Validating token access rules against request {{(pid=91119) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:50:59.824812 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6252ad1-c9a9-4824-a3be-ddfadd5ec83c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91119) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:50:59.825453 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6252ad1-c9a9-4824-a3be-ddfadd5ec83c service placement] REQUEST_METHOD: `GET` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:50:59.825741 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6252ad1-c9a9-4824-a3be-ddfadd5ec83c service placement] SCRIPT_NAME: `/identity` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:50:59.826023 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6252ad1-c9a9-4824-a3be-ddfadd5ec83c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91119) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:50:59.834483 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6252ad1-c9a9-4824-a3be-ddfadd5ec83c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:50:59.836059 ncdv-master-1 devstack@keystone.service[91119]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6252ad1-c9a9-4824-a3be-ddfadd5ec83c service placement] RBAC: Authorization granted {{(pid=91119) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:50:59.845805 ncdv-master-1 devstack@keystone.service[91119]: [pid: 91119|app: 0|req: 4532/9077] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:50:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 02 11:51:40.920226 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74585f94-1a65-4db6-9aa5-fe87555cc48b service placement] Authenticating user token {{(pid=91118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 02 11:51:40.939905 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74585f94-1a65-4db6-9aa5-fe87555cc48b service placement] Validating token access rules against request {{(pid=91118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 02 11:51:40.945055 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfed648-7262-4f0b-b273-fed28d3ca6bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eef155f5230d47c29fc3d74c2241130b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '972cae0aa9694d6cad22fbdbcf916ff7', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 02 11:51:40.945684 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfed648-7262-4f0b-b273-fed28d3ca6bb service placement] REQUEST_METHOD: `GET` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 02 11:51:40.945974 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfed648-7262-4f0b-b273-fed28d3ca6bb service placement] SCRIPT_NAME: `/identity` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 02 11:51:40.946255 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfed648-7262-4f0b-b273-fed28d3ca6bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 02 11:51:40.954693 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfed648-7262-4f0b-b273-fed28d3ca6bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 02 11:51:40.956436 ncdv-master-1 devstack@keystone.service[91118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfed648-7262-4f0b-b273-fed28d3ca6bb service placement] RBAC: Authorization granted {{(pid=91118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 02 11:51:40.966467 ncdv-master-1 devstack@keystone.service[91118]: [pid: 91118|app: 0|req: 4546/9078] 10.222.0.16 () {60 vars in 1365 bytes} [Mon May 2 11:51:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)